-- Logs begin at Sat 2021-12-18 20:01:14 UTC, end at Sat 2021-12-18 22:15:16 UTC. -- Dec 18 20:30:54.177769 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Dec 18 20:30:54.189123 ncdv-master-1 devstack@keystone.service[96632]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Dec 18 20:30:54.191199 ncdv-master-1 devstack@keystone.service[96632]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Dec 18 20:30:54 2021] *** Dec 18 20:30:54.191199 ncdv-master-1 devstack@keystone.service[96632]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 18 20:30:54.191199 ncdv-master-1 devstack@keystone.service[96632]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 18 20:30:54.191199 ncdv-master-1 devstack@keystone.service[96632]: nodename: ncdv-master-1 Dec 18 20:30:54.191199 ncdv-master-1 devstack@keystone.service[96632]: machine: x86_64 Dec 18 20:30:54.191199 ncdv-master-1 devstack@keystone.service[96632]: clock source: unix Dec 18 20:30:54.191199 ncdv-master-1 devstack@keystone.service[96632]: pcre jit disabled Dec 18 20:30:54.191199 ncdv-master-1 devstack@keystone.service[96632]: detected number of CPU cores: 4 Dec 18 20:30:54.191199 ncdv-master-1 devstack@keystone.service[96632]: current working directory: / Dec 18 20:30:54.191199 ncdv-master-1 devstack@keystone.service[96632]: detected binary path: /usr/bin/uwsgi-core Dec 18 20:30:54.191199 ncdv-master-1 devstack@keystone.service[96632]: your processes number limit is 47680 Dec 18 20:30:54.191837 ncdv-master-1 devstack@keystone.service[96632]: your memory page size is 4096 bytes Dec 18 20:30:54.191837 ncdv-master-1 devstack@keystone.service[96632]: detected max file descriptor number: 2048 Dec 18 20:30:54.191837 ncdv-master-1 devstack@keystone.service[96632]: lock engine: pthread robust mutexes Dec 18 20:30:54.191837 ncdv-master-1 devstack@keystone.service[96632]: thunder lock: enabled Dec 18 20:30:54.191837 ncdv-master-1 devstack@keystone.service[96632]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Dec 18 20:30:54.191837 ncdv-master-1 devstack@keystone.service[96632]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 18 20:30:54.239186 ncdv-master-1 devstack@keystone.service[96632]: Python main interpreter initialized at 0x556433f779c0 Dec 18 20:30:54.239186 ncdv-master-1 devstack@keystone.service[96632]: python threads support enabled Dec 18 20:30:54.239186 ncdv-master-1 devstack@keystone.service[96632]: your server socket listen backlog is limited to 100 connections Dec 18 20:30:54.239186 ncdv-master-1 devstack@keystone.service[96632]: your mercy for graceful operations on workers is 90 seconds Dec 18 20:30:54.239512 ncdv-master-1 devstack@keystone.service[96632]: mapped 403077 bytes (393 KB) for 2 cores Dec 18 20:30:54.239608 ncdv-master-1 devstack@keystone.service[96632]: *** Operational MODE: preforking *** Dec 18 20:30:54.239861 ncdv-master-1 devstack@keystone.service[96632]: *** uWSGI is running in multiple interpreter mode *** Dec 18 20:30:54.239861 ncdv-master-1 devstack@keystone.service[96632]: spawned uWSGI master process (pid: 96632) Dec 18 20:30:54.240042 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Dec 18 20:30:54.241107 ncdv-master-1 devstack@keystone.service[96632]: spawned uWSGI worker 1 (pid: 96645, cores: 1) Dec 18 20:30:54.241107 ncdv-master-1 devstack@keystone.service[96632]: spawned uWSGI worker 2 (pid: 96646, cores: 1) Dec 18 20:30:54.241107 ncdv-master-1 devstack@keystone.service[96632]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 18 20:30:59.653578 ncdv-master-1 devstack@keystone.service[96646]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 20:30:59.653578 ncdv-master-1 devstack@keystone.service[96646]: from cryptography.utils import int_from_bytes Dec 18 20:30:59.654419 ncdv-master-1 devstack@keystone.service[96646]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 20:30:59.654419 ncdv-master-1 devstack@keystone.service[96646]: from cryptography.utils import int_from_bytes Dec 18 20:30:59.654531 ncdv-master-1 devstack@keystone.service[96645]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 20:30:59.654531 ncdv-master-1 devstack@keystone.service[96645]: from cryptography.utils import int_from_bytes Dec 18 20:30:59.654531 ncdv-master-1 devstack@keystone.service[96645]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 18 20:30:59.654531 ncdv-master-1 devstack@keystone.service[96645]: from cryptography.utils import int_from_bytes Dec 18 20:30:59.702533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 18 20:30:59.702729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 18 20:30:59.702922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] command line args: [] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 18 20:30:59.703014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 18 20:30:59.703722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 18 20:30:59.703813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 18 20:30:59.703889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ================================================================================ {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 18 20:30:59.703965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] command line args: [] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 18 20:30:59.704144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] admin_token = **** {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.704222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 18 20:30:59.704349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ================================================================================ {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 18 20:30:59.704432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] config_dir = [] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.704564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.704644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] admin_token = **** {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.704746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] config_source = [] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.704827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] config_dir = [] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.704927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] debug = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.705008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.705125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.705426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] config_source = [] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.705426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] debug = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.705620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.705714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.705835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] insecure_debug = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.705940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.706039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.706137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] insecure_debug = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.706275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.706386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.706487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] list_limit = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.706609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.706716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] log_config_append = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.706814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] list_limit = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.706912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.707010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] log_config_append = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.707169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] log_dir = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.707280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.707380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] log_file = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.707478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] log_dir = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.707561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.707673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] log_file = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.707788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.707873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.707949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.708072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.708151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.708274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.708384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.708505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.708624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.708743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.708861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.708978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.709097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.709205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.709305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.709404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.709503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.709594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.709697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.709796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.709894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.709986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.710083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.710184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.710316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] notification_format = cadf {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.710421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.710515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.710608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] notification_format = cadf {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.710713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.710884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.711066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] publish_errors = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.711187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.711299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.711402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] publish_errors = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.711515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.711621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.711721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.711855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.711980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.712093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.712261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.712375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.712496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] standard_threads = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.712613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.712728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] strict_password_check = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.712840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] standard_threads = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.712955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.713065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] strict_password_check = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.713185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] use_eventlog = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.713297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.713411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] use_journal = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.713522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] use_eventlog = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.713636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] use_json = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.713752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] use_journal = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.713871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] use_stderr = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.713982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] use_json = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.714092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] use_syslog = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.714207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] use_stderr = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.714341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] watch_log_file = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.714462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] use_syslog = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.714586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.714697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] watch_log_file = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 18 20:30:59.714806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.714915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.715030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.715147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.715268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.715379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.715493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.715610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.715725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.715841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.716024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.716137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.716252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.716890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.717004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.717125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.717236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.717352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.717463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.717579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.717689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.717814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.717932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.718043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.718159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.718286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.718398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.718506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.718602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.718708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.718842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.719462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.719558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.719665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.719766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.719861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.719959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.720053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.720165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.720288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.720405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.720516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.720632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.720743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.720853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.720971 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.721083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.721200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.721312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.721427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.721549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.721666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.721778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.721887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.721988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.722102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.722306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.722422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.722540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.722651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.722766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.722877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.722995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.723107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.723217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.723328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.723444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.723555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.723673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.723784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.723894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.724004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.724113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.724223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.724334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.724456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.724573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.724684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.724794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.724903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.725023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.725134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.725243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.725358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.725470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.725589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.725708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.725820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.725930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.726039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.726148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.726280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.726405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.726526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.726636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.726751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.726867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.726984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.727130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.727254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.727371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.727484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.727595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.727705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.727826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.727939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.728049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.728160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.728276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.728393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.728512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.728626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.728736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.728846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.728956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.729075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.729193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.729322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.729441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.729553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.729670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.729782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.729897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.730027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.730150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.730307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.730433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.730547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.730659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.730770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.730907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.731138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.731255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.731366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.731477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.731597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.731711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.731822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.731939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.732050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.732154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.732259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.732355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.enabled = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.732449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.732548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.732647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.enabled = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.732741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.732741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.732925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.733019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.733112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.733204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.733297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.733465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.733569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.733569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.733743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.733837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.733930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.733930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.734112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.734206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.734321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.734416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.734521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.734628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.734750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.734870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.734988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.735101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.735213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.735331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.735443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.735567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.735687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.735800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.735912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.736023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.736145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.736262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.736374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.736374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.736589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.736589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.736815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.736927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] auth.external = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.737039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.737149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] auth.mapped = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.737260 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.737260 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] auth.external = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.737475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.737589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] auth.mapped = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.737700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.737700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] auth.password = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.737924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.738038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] auth.token = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.738157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.738283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.738406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] auth.password = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.738519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] catalog.caching = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.738630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] auth.token = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.738747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.738867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.738980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.739093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] catalog.caching = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.739204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.739315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.739425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.739544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.739656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.739773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.739885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] credential.caching = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.740023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.740150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] credential.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.740263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.740374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.740493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] credential.caching = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.740606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.740723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] credential.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.740835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.740946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.741065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.741185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.741310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.741424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.741541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.741659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.741772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.741892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.742004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.742116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.742228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.742355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.742468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.742591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.742705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.742817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.742817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.743026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.743138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.743258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.743378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.743490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.743602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.743713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] federation.caching = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.743713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.743933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.743933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] federation.caching = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.744145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] federation.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.744145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.744356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.744475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.744595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] federation.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.744708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.744821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.744933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.745044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.745155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.745275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.745395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.745508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.745619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.745731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.745861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.745975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.746092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.746210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.746379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] identity.caching = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.746492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.746678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.746794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.746908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.747020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] identity.caching = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.747132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.747244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.747367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.747482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.747603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] identity.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.747717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.747829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.747941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.748061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.748174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] identity.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.748287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.748399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.748512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.748624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.748743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.748857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.748970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.749081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.749193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.749305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.749425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.749540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.749652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.749765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.749876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.749994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.750115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.750230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.750356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.750479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.750595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.750707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.750828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.750942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.751055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.751167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.751279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.751391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.751513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.751628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.751740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.751852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.751964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.752076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.752195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.752309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.752426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.752540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.752657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.752771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.752892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.753006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.753118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.753230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.753342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.753454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.753574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.753696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.753810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.753923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.754035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.754152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.754286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.754401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.754513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.754625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.754737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.password = **** {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.754850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.754974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.755088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.755200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.755312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.password = **** {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.755423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.755535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.755655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.755769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.755882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.755994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.756106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.756223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.756349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.756463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.756574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.756686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.756798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.756910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.757030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.757151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.757327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.757447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.757561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.757681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.757795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.757907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.758019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.758132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.758243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.758414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.758529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.758641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.758754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.758867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.758980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.759100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.759214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.759326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.759444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.759557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.759669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.759789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.759902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.760015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.760127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.760238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.760350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.760471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.760592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.760706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.760824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.760937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.761050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.761171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.761284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.761397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.761509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.761620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.761732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.761852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.761966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.762135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.762263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.762377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.762489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.762613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.762727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.762846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.762959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.763071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.763184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.763304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.763418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.763530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.763642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.763755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.763866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.763986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.764100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.764213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.764325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.764438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.764550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] policy.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.764670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.764784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.764896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.765008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.765119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] policy.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.765231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.765352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.765466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] receipt.caching = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.765578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.766194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.766380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.766494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.766619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] receipt.caching = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.766733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.766846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.766957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.767069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.767181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.767301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.767416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] resource.caching = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.767529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.767641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.767754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.767866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] resource.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.767986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] resource.caching = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.768100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.768213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.768325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.768444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] resource.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.768558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.768678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.768792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] revoke.caching = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.768905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.769017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.769129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.769241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.769425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] revoke.caching = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.769543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] role.cache_time = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.769655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.769767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] role.caching = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.769880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.769992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] role.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.770112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] role.cache_time = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.770225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] role.list_limit = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.770356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] role.caching = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.770469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.770582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] role.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.770695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.770819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] role.list_limit = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.770934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.771047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.771158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.771270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.771394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.771509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.771623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.771735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.771848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.771960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.772080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.772199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.772312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.772425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.772537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.772537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.772756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.772756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.772968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.773081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.773192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.773304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.773424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.773537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.773650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.773762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.773874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.773986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.774106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.774220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.774347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.774459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.774571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.774571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.774794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.774794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.775008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.775120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.775231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.775343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.775463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.775463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.775675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.775788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.775900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.776020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.776133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.776248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.776360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.776472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.776583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.776702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.776817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.776928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.777040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.777151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.777263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.777381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] token.cache_time = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.777495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.777606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] token.caching = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.777718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.777867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.777979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.778099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] token.provider = fernet {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.778212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] token.cache_time = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.778628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.778744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] token.caching = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.778856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.778969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.779094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.779209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] token.provider = fernet {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.779320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.779432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.779543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.779655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.779774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.779888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.780001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] trust.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.780113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.780225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.780337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.780456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.780571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.780683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.780795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] trust.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.780906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.781019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.781138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.781252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.781395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.781508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.781620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.781732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.781853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.781967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.782081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.connection = **** {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.782193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.782333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.782448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.782572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.782687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.782799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.782911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.connection = **** {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.783022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.783135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.783255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.783369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.783481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.783592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.783704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.783816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.783935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.784048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.784161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.784273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.784385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.784505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.784627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.784749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.784863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.784976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.785087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.785200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.785320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.785442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.785556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.785676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.785797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.785910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.786023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.786134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.786288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.786416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.786530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=96646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 18 20:30:59.786643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.786643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.786643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 18 20:30:59.786643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=96645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 18 20:30:59.817213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:30:59.817443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:30:59.817708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:30:59.817984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:30:59.818219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:30:59.818474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:30:59.826208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:30:59.827038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:30:59.855177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:30:59.855408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:30:59.855980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:30:59.856212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:30:59.909245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:30:59.909743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:30:59.960429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:30:59.960661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:30:59.961639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:30:59.961873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.026962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.027188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.027415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.027636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.027729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.027855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.027934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.028074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.028164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.028295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.028517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.028738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.053346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.053581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.053672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.053808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.053892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.054034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.054126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.054277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.054362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.054498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.054579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.054710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.054806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.054969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.066896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.067373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.079428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.079663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.079891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.079971 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.080117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.080207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.080341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.080422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.080552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.080632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.080765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=96646) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.080848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.080981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.081197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=96645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 18 20:31:00.098079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.098305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 18 20:31:00.098386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.098548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 18 20:31:00.098638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.098834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 18 20:31:00.098915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.099069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 18 20:31:00.099159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.099344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.099425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.099597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.099675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.099849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.099941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.100104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.110667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.110913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.110993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.111192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.111286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.111466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.111548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.111751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.119374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.119667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.122596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.122876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.122957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.123157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.123250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.123436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.123517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.123716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.123833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.124093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.124174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.124361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.124441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.124627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.124706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.124894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.124975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.125702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.125781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.125969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.126056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.126237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.151666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.152016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.153237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.153515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.153598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.153857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.158674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.158954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.159094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.159232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.159414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.159653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.166288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.166574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.166746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.167029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.171066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.171352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.171526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.171620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.171816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.172453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.172619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.172701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.172898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.172989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.173172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.173263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.173440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.173519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.173706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.173972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.191940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.192214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.192532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.192812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.196652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.197274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.200237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.200532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.200867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.201161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.206040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.206602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.209579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.210358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.213273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.213566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.213847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.214040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.214123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.214362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.214448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.214651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.214733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.214936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.215217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.215502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.233147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.233430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.233790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.233997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.234080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.234308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.235190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.235458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.242225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.243152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.243921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.244194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.244825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.245102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.247174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.247475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.247742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.248029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.248110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.248306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.248390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.248644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.248930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.249220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.261695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.262136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.262371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.262640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.262723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.262930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.263133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.263215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.263480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.263633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.263754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.264031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.264112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.264596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.283665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.286870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.287265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.290094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.290446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.291696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.293291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.293572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.293679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.293850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.295275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.296905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.297188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.297465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.302278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.303868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.305814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.307023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.307322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.307405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.307609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.307901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.310554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.310848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.311131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.311421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.317219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.317522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.317803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.320728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.321022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.321312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.325555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=96645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.325838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.326116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.326419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.326703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.326974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.327256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.327541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.327814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.328082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.328882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.329152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.329417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.329662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=96646) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 18 20:31:00.329799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=96645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.329930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.330062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.330298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.330570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.330844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.331123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.331402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.331670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.331939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.332213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.332475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.332744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.333015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=96646) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 18 20:31:00.370018 ncdv-master-1 devstack@keystone.service[96645]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556433f779c0 pid: 96645 (default app) Dec 18 20:31:00.373475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e23fc-c61f-4795-a61a-24f937f9d80a None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:00.373777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e23fc-c61f-4795-a61a-24f937f9d80a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:00.374068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e23fc-c61f-4795-a61a-24f937f9d80a None None] PATH_INFO: `/v3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:00.378300 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Sat Dec 18 20:31:00 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:00.384786 ncdv-master-1 devstack@keystone.service[96646]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556433f779c0 pid: 96646 (default app) Dec 18 20:31:08.304877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ebb63-896b-4d70-9b84-4f42d7157aad None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:08.305387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ebb63-896b-4d70-9b84-4f42d7157aad None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:08.305495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ebb63-896b-4d70-9b84-4f42d7157aad None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:08.307501 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:31:08.315511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd6b7b-adee-479c-9fe2-79f62ad4baec None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:08.315876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd6b7b-adee-479c-9fe2-79f62ad4baec None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:08.316080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd6b7b-adee-479c-9fe2-79f62ad4baec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:08.345397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG oslo_db.sqlalchemy.engines [None req-06bd6b7b-adee-479c-9fe2-79f62ad4baec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:31:08.626497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG passlib.handlers.bcrypt [None req-06bd6b7b-adee-479c-9fe2-79f62ad4baec None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=96646) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 18 20:31:08.626931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG passlib.handlers.bcrypt [None req-06bd6b7b-adee-479c-9fe2-79f62ad4baec None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=96646) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 18 20:31:08.681251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-06bd6b7b-adee-479c-9fe2-79f62ad4baec None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:08.682856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-06bd6b7b-adee-479c-9fe2-79f62ad4baec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:08.810943 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1/3] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:08.989078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ebb63-896b-4d70-9b84-4f42d7157aad None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:09.024135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG oslo_db.sqlalchemy.engines [None req-496ebb63-896b-4d70-9b84-4f42d7157aad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 18 20:31:09.246818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ebb63-896b-4d70-9b84-4f42d7157aad None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:09.251038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78868ee1-5fad-4594-82e0-16207ebc01ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:09.251699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78868ee1-5fad-4594-82e0-16207ebc01ed admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:09.251987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78868ee1-5fad-4594-82e0-16207ebc01ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:09.252269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78868ee1-5fad-4594-82e0-16207ebc01ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:09.260282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78868ee1-5fad-4594-82e0-16207ebc01ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:09.312244 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.common.rbac_enforcer.enforcer [None req-78868ee1-5fad-4594-82e0-16207ebc01ed admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 18 20:31:09.312765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78868ee1-5fad-4594-82e0-16207ebc01ed admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:09.321754 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3/4] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:08 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 20:31:09.328593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd6b7b-adee-479c-9fe2-79f62ad4baec None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:09.342752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd6b7b-adee-479c-9fe2-79f62ad4baec None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:09.347750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e8699-4af1-4d5d-9180-912c329c57a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:09.348857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e8699-4af1-4d5d-9180-912c329c57a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:09.349142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e8699-4af1-4d5d-9180-912c329c57a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:09.349421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e8699-4af1-4d5d-9180-912c329c57a0 admin admin] PATH_INFO: `/v3/projects/b04c3d19c79d4c208395e97f9d293618` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:09.350949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e8699-4af1-4d5d-9180-912c329c57a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=b04c3d19c79d4c208395e97f9d293618)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:09.408274 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.common.rbac_enforcer.enforcer [None req-029e8699-4af1-4d5d-9180-912c329c57a0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 18 20:31:09.408608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e8699-4af1-4d5d-9180-912c329c57a0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:09.413238 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2/5] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:09 2021] GET /identity/v3/projects/b04c3d19c79d4c208395e97f9d293618 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:11.777044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e58a2-0f03-4bad-8cb8-b018cd46ec1a None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:11.777537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e58a2-0f03-4bad-8cb8-b018cd46ec1a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:11.777619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e58a2-0f03-4bad-8cb8-b018cd46ec1a None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:11.782656 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4/6] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:11 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:11.788593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ff259-7dd7-4662-be44-ed0ff70f7920 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:11.789020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ff259-7dd7-4662-be44-ed0ff70f7920 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:11.789254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ff259-7dd7-4662-be44-ed0ff70f7920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:11.808067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-643ff259-7dd7-4662-be44-ed0ff70f7920 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:11.809590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-643ff259-7dd7-4662-be44-ed0ff70f7920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:11.818163 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3/7] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:11.842733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e58a2-0f03-4bad-8cb8-b018cd46ec1a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:11.854471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e58a2-0f03-4bad-8cb8-b018cd46ec1a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:11.858785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e3d8d-9fac-4c32-a3e3-8983e02c00e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:11.859437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e3d8d-9fac-4c32-a3e3-8983e02c00e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:11.859725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e3d8d-9fac-4c32-a3e3-8983e02c00e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:11.860006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e3d8d-9fac-4c32-a3e3-8983e02c00e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:11.867471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e3d8d-9fac-4c32-a3e3-8983e02c00e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:11.869226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e3d8d-9fac-4c32-a3e3-8983e02c00e0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:11.878465 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 5/8] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:11.884016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ff259-7dd7-4662-be44-ed0ff70f7920 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:11.892747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ff259-7dd7-4662-be44-ed0ff70f7920 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:11.897037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582f474-3bc6-45a3-88e4-22ef4b1e4725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:11.897872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582f474-3bc6-45a3-88e4-22ef4b1e4725 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:11.898153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582f474-3bc6-45a3-88e4-22ef4b1e4725 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:11.898721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582f474-3bc6-45a3-88e4-22ef4b1e4725 admin admin] PATH_INFO: `/v3/users/3410b38ddeaf4d83ae78d94fba3a424e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:11.900104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582f474-3bc6-45a3-88e4-22ef4b1e4725 admin admin] RBAC: Authorizing `identity:get_user(user_id=3410b38ddeaf4d83ae78d94fba3a424e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:11.901898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582f474-3bc6-45a3-88e4-22ef4b1e4725 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:11.904033 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4/9] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:11 2021] GET /identity/v3/users/3410b38ddeaf4d83ae78d94fba3a424e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:14.344297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a0894-6f19-40e0-b48f-19e41e1bea42 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:14.344844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a0894-6f19-40e0-b48f-19e41e1bea42 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:14.344844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a0894-6f19-40e0-b48f-19e41e1bea42 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:14.346626 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:31:14.352377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb7d33-3e4a-4914-b5b0-f759bae40c09 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:14.352785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb7d33-3e4a-4914-b5b0-f759bae40c09 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:14.353067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb7d33-3e4a-4914-b5b0-f759bae40c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:14.374181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9acb7d33-3e4a-4914-b5b0-f759bae40c09 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:14.375958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9acb7d33-3e4a-4914-b5b0-f759bae40c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:14.379667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf47590-4cdb-4faf-9f7c-764a248bb84a None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:14.379970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf47590-4cdb-4faf-9f7c-764a248bb84a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:14.380228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf47590-4cdb-4faf-9f7c-764a248bb84a None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:14.381984 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 7/11] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:31:14.385390 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 5/12] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:14.387892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5059a-34d1-475c-a190-0e7a162a8227 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:14.388241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5059a-34d1-475c-a190-0e7a162a8227 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:14.388520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5059a-34d1-475c-a190-0e7a162a8227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:14.412833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb7d33-3e4a-4914-b5b0-f759bae40c09 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:14.422211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb7d33-3e4a-4914-b5b0-f759bae40c09 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:14.426938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60936693-6d83-46f6-9ab7-5417f30009f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:14.427720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60936693-6d83-46f6-9ab7-5417f30009f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:14.428005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60936693-6d83-46f6-9ab7-5417f30009f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:14.428290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60936693-6d83-46f6-9ab7-5417f30009f8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:14.430424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG passlib.handlers.bcrypt [None req-c1e5059a-34d1-475c-a190-0e7a162a8227 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=96645) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 18 20:31:14.430849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG passlib.handlers.bcrypt [None req-c1e5059a-34d1-475c-a190-0e7a162a8227 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=96645) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 18 20:31:14.441968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60936693-6d83-46f6-9ab7-5417f30009f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:14.448763 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-60936693-6d83-46f6-9ab7-5417f30009f8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:31:14.449920 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 6/13] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:31:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:31:14.455906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60936693-6d83-46f6-9ab7-5417f30009f8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:14.464998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60936693-6d83-46f6-9ab7-5417f30009f8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:14.469375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4864c5d-24cf-48a2-93ce-40fcf8887c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:14.469959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4864c5d-24cf-48a2-93ce-40fcf8887c25 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:14.470242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4864c5d-24cf-48a2-93ce-40fcf8887c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:14.470554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4864c5d-24cf-48a2-93ce-40fcf8887c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:14.471288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4864c5d-24cf-48a2-93ce-40fcf8887c25 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:14.471595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4864c5d-24cf-48a2-93ce-40fcf8887c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:14.473336 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-c4864c5d-24cf-48a2-93ce-40fcf8887c25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:14.473336 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:31:14.473336 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:31:14.474225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4864c5d-24cf-48a2-93ce-40fcf8887c25 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:14.476998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c1e5059a-34d1-475c-a190-0e7a162a8227 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:14.478597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c1e5059a-34d1-475c-a190-0e7a162a8227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:14.487263 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:14.493155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4864c5d-24cf-48a2-93ce-40fcf8887c25 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:14.500931 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 8/15] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:14.503162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4864c5d-24cf-48a2-93ce-40fcf8887c25 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:14.507548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d132a99-f74b-432b-b83b-293d99611b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:14.508373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d132a99-f74b-432b-b83b-293d99611b7c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:14.508659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d132a99-f74b-432b-b83b-293d99611b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:14.508940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d132a99-f74b-432b-b83b-293d99611b7c admin admin] PATH_INFO: `/v3/users/3410b38ddeaf4d83ae78d94fba3a424e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:14.510151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d132a99-f74b-432b-b83b-293d99611b7c admin admin] RBAC: Authorizing `identity:get_user(user_id=3410b38ddeaf4d83ae78d94fba3a424e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:14.511989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d132a99-f74b-432b-b83b-293d99611b7c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:14.513522 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 8/16] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:14 2021] GET /identity/v3/users/3410b38ddeaf4d83ae78d94fba3a424e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:14.519142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5059a-34d1-475c-a190-0e7a162a8227 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:14.523962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d132a99-f74b-432b-b83b-293d99611b7c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:14.528821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5059a-34d1-475c-a190-0e7a162a8227 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:14.533343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1d114-572f-4216-a7a4-6b5da5d78b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:14.533613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d132a99-f74b-432b-b83b-293d99611b7c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:14.534482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1d114-572f-4216-a7a4-6b5da5d78b12 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:14.534777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1d114-572f-4216-a7a4-6b5da5d78b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:14.535063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1d114-572f-4216-a7a4-6b5da5d78b12 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:14.536547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1d114-572f-4216-a7a4-6b5da5d78b12 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:14.538048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acd395-2bf3-4f2b-a81c-0f8ec2c86692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:14.538320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1d114-572f-4216-a7a4-6b5da5d78b12 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:14.538688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acd395-2bf3-4f2b-a81c-0f8ec2c86692 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:14.538976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acd395-2bf3-4f2b-a81c-0f8ec2c86692 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:14.539258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acd395-2bf3-4f2b-a81c-0f8ec2c86692 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:14.540144 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:31:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:14.545494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1d114-572f-4216-a7a4-6b5da5d78b12 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:14.547782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acd395-2bf3-4f2b-a81c-0f8ec2c86692 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:14.549500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acd395-2bf3-4f2b-a81c-0f8ec2c86692 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:14.555260 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1d114-572f-4216-a7a4-6b5da5d78b12 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:14.558400 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 9/18] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:14 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 20:31:14.559731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d3d52-9b5f-4ad7-b52f-b103651461ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:14.560341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d3d52-9b5f-4ad7-b52f-b103651461ea admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:14.560631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d3d52-9b5f-4ad7-b52f-b103651461ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:14.560913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d3d52-9b5f-4ad7-b52f-b103651461ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:14.562597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d3d52-9b5f-4ad7-b52f-b103651461ea admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.domain.id=default, user.id=3410b38ddeaf4d83ae78d94fba3a424e) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:14.562915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d3d52-9b5f-4ad7-b52f-b103651461ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:14.564594 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-3a4d3d52-9b5f-4ad7-b52f-b103651461ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:14.564594 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:31:14.564594 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:31:14.564833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acd395-2bf3-4f2b-a81c-0f8ec2c86692 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:14.565742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d3d52-9b5f-4ad7-b52f-b103651461ea admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:14.572859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acd395-2bf3-4f2b-a81c-0f8ec2c86692 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:14.574684 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 10/19] 10.222.0.13 () {56 vars in 1343 bytes} [Sat Dec 18 20:31:14 2021] GET /identity/v3/role_assignments?user.id=3410b38ddeaf4d83ae78d94fba3a424e&scope.domain.id=default&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 233 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:14.577435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45ea7d-61bb-43b9-bbeb-b32a95639975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:14.578277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45ea7d-61bb-43b9-bbeb-b32a95639975 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:14.578580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45ea7d-61bb-43b9-bbeb-b32a95639975 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:14.578857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45ea7d-61bb-43b9-bbeb-b32a95639975 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:14.580086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45ea7d-61bb-43b9-bbeb-b32a95639975 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:14.581823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45ea7d-61bb-43b9-bbeb-b32a95639975 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:14.583540 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 10/20] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:31:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:17.437461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32387e9f-417d-43da-ae80-c11b60a53f8d None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:17.438562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32387e9f-417d-43da-ae80-c11b60a53f8d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:17.439047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32387e9f-417d-43da-ae80-c11b60a53f8d None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:17.441472 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 11/21] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:17.448074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919b4d3-b547-4dbe-a51f-0630f835953b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:17.449016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919b4d3-b547-4dbe-a51f-0630f835953b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:17.449541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919b4d3-b547-4dbe-a51f-0630f835953b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:17.468898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d919b4d3-b547-4dbe-a51f-0630f835953b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:17.470443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d919b4d3-b547-4dbe-a51f-0630f835953b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:17.478645 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 11/22] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:17.515959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32387e9f-417d-43da-ae80-c11b60a53f8d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:17.533165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32387e9f-417d-43da-ae80-c11b60a53f8d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:17.539745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf3752-fab1-4a80-84a9-14f2c4087e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:17.540802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf3752-fab1-4a80-84a9-14f2c4087e3c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:17.541285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf3752-fab1-4a80-84a9-14f2c4087e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:17.541769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf3752-fab1-4a80-84a9-14f2c4087e3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:17.564179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf3752-fab1-4a80-84a9-14f2c4087e3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:17.566392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf3752-fab1-4a80-84a9-14f2c4087e3c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:17.583903 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-8fbf3752-fab1-4a80-84a9-14f2c4087e3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:31:17.585782 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 12/23] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:31:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:17.592040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919b4d3-b547-4dbe-a51f-0630f835953b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:17.601572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919b4d3-b547-4dbe-a51f-0630f835953b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:17.606414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb872d9-019a-4496-9d5d-08c456b4968c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:17.607333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb872d9-019a-4496-9d5d-08c456b4968c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:17.607821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb872d9-019a-4496-9d5d-08c456b4968c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:17.608288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb872d9-019a-4496-9d5d-08c456b4968c admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:17.609751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb872d9-019a-4496-9d5d-08c456b4968c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:17.610264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb872d9-019a-4496-9d5d-08c456b4968c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:17.611464 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-afb872d9-019a-4496-9d5d-08c456b4968c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:17.611464 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:31:17.611464 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:31:17.612671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb872d9-019a-4496-9d5d-08c456b4968c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:17.631374 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 12/24] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:31:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:17.637737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf3752-fab1-4a80-84a9-14f2c4087e3c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:17.644927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfea78-5b5e-41a8-b87e-30b935dd53a2 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:17.645567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfea78-5b5e-41a8-b87e-30b935dd53a2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:17.646039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfea78-5b5e-41a8-b87e-30b935dd53a2 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:17.648609 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 13/25] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:17.649732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf3752-fab1-4a80-84a9-14f2c4087e3c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:17.654097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade90f8-647c-4eff-998c-2c1636dfe645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:17.655099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade90f8-647c-4eff-998c-2c1636dfe645 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:17.655680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade90f8-647c-4eff-998c-2c1636dfe645 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:17.655901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9590ecf-54a4-4cc9-96ed-a25175c29a41 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:17.656274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade90f8-647c-4eff-998c-2c1636dfe645 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:17.656375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9590ecf-54a4-4cc9-96ed-a25175c29a41 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:17.656632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9590ecf-54a4-4cc9-96ed-a25175c29a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:17.657518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade90f8-647c-4eff-998c-2c1636dfe645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:17.658929 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-9ade90f8-647c-4eff-998c-2c1636dfe645 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:17.658929 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:31:17.658929 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:31:17.660530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade90f8-647c-4eff-998c-2c1636dfe645 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:17.680007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e9590ecf-54a4-4cc9-96ed-a25175c29a41 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:17.681162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e9590ecf-54a4-4cc9-96ed-a25175c29a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:17.708886 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 14/26] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:17.753561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9590ecf-54a4-4cc9-96ed-a25175c29a41 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:17.769541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9590ecf-54a4-4cc9-96ed-a25175c29a41 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:17.787798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41ed9c-e970-4cc1-8a37-1ce24f48ab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:17.788597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41ed9c-e970-4cc1-8a37-1ce24f48ab80 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:17.788882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41ed9c-e970-4cc1-8a37-1ce24f48ab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:17.789159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41ed9c-e970-4cc1-8a37-1ce24f48ab80 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:17.812557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41ed9c-e970-4cc1-8a37-1ce24f48ab80 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:17.817130 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 13/27] 10.222.0.13 () {60 vars in 1162 bytes} [Sat Dec 18 20:31:17 2021] POST /identity/v3/projects => generated 301 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:31:17.828803 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-5e41ed9c-e970-4cc1-8a37-1ce24f48ab80 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:31:17.829906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7832566-5097-415e-b023-0af0ab1ca200 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:17.830423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7832566-5097-415e-b023-0af0ab1ca200 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:17.830796 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 15/28] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:31:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:17.831097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7832566-5097-415e-b023-0af0ab1ca200 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:17.833053 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 14/29] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:31:17.837537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41ed9c-e970-4cc1-8a37-1ce24f48ab80 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:17.839608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425948f-2333-489d-9891-19814ea090ad None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:17.840102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425948f-2333-489d-9891-19814ea090ad None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:17.840611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425948f-2333-489d-9891-19814ea090ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:17.854932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41ed9c-e970-4cc1-8a37-1ce24f48ab80 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:17.870881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d425948f-2333-489d-9891-19814ea090ad None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:17.872762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d425948f-2333-489d-9891-19814ea090ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:17.963644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e9552-1c86-4303-b4b6-88e294b36fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:17.964276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e9552-1c86-4303-b4b6-88e294b36fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:17.964561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e9552-1c86-4303-b4b6-88e294b36fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:17.964838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e9552-1c86-4303-b4b6-88e294b36fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:17.965605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e9552-1c86-4303-b4b6-88e294b36fd1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:17.965909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e9552-1c86-4303-b4b6-88e294b36fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:17.967558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e9552-1c86-4303-b4b6-88e294b36fd1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:17.971949 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 15/30] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:17.986198 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 16/31] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:17.992037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425948f-2333-489d-9891-19814ea090ad None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:18.002840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425948f-2333-489d-9891-19814ea090ad None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:18.011717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72ec60-973b-41e3-83de-224e39875d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:18.013005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ec60-973b-41e3-83de-224e39875d0b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:18.013489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ec60-973b-41e3-83de-224e39875d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:18.013965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ec60-973b-41e3-83de-224e39875d0b admin admin] PATH_INFO: `/v3/users/3410b38ddeaf4d83ae78d94fba3a424e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:18.016548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72ec60-973b-41e3-83de-224e39875d0b admin admin] RBAC: Authorizing `identity:get_user(user_id=3410b38ddeaf4d83ae78d94fba3a424e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:18.023341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e9552-1c86-4303-b4b6-88e294b36fd1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:18.030031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72ec60-973b-41e3-83de-224e39875d0b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:18.037146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e9552-1c86-4303-b4b6-88e294b36fd1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:18.039771 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 16/32] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:17 2021] GET /identity/v3/users/3410b38ddeaf4d83ae78d94fba3a424e => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:18.041569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb50c-7ca9-4489-9b76-22d1c40a7fe6 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:18.043593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb50c-7ca9-4489-9b76-22d1c40a7fe6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:18.044588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb50c-7ca9-4489-9b76-22d1c40a7fe6 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:18.047954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7c540-73ab-4b89-a377-7cd9d8a02f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:18.049449 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 17/33] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:18 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:18.049772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7c540-73ab-4b89-a377-7cd9d8a02f90 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:18.050832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cb50c-7ca9-4489-9b76-22d1c40a7fe6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:18.051337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7c540-73ab-4b89-a377-7cd9d8a02f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:18.051805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7c540-73ab-4b89-a377-7cd9d8a02f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:18.052764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7c540-73ab-4b89-a377-7cd9d8a02f90 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:18.055725 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-66f7c540-73ab-4b89-a377-7cd9d8a02f90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:18.055725 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:31:18.055725 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:31:18.057420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7c540-73ab-4b89-a377-7cd9d8a02f90 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:18.076220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cb50c-7ca9-4489-9b76-22d1c40a7fe6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:18.081897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04e958-85fd-4d5e-909b-7bddc0d3a798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:18.083189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04e958-85fd-4d5e-909b-7bddc0d3a798 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:18.083679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04e958-85fd-4d5e-909b-7bddc0d3a798 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:18.084282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04e958-85fd-4d5e-909b-7bddc0d3a798 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:18.085968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04e958-85fd-4d5e-909b-7bddc0d3a798 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:18.099662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04e958-85fd-4d5e-909b-7bddc0d3a798 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:18.106013 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 18/34] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:31:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:18.107625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c40b1-f07d-483b-be5b-4c77fd01f568 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:18.108200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c40b1-f07d-483b-be5b-4c77fd01f568 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:18.108807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c40b1-f07d-483b-be5b-4c77fd01f568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:18.147905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-215c40b1-f07d-483b-be5b-4c77fd01f568 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:18.151506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-215c40b1-f07d-483b-be5b-4c77fd01f568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:18.168118 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 19/35] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:18.169267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c40b1-f07d-483b-be5b-4c77fd01f568 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:18.187958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c40b1-f07d-483b-be5b-4c77fd01f568 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:18.207904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25372d1-eaba-420e-8089-1f7da11182f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:18.208898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25372d1-eaba-420e-8089-1f7da11182f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:18.209194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25372d1-eaba-420e-8089-1f7da11182f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:18.209478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25372d1-eaba-420e-8089-1f7da11182f3 admin admin] PATH_INFO: `/v3/domains/default/users/3410b38ddeaf4d83ae78d94fba3a424e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:18.212150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25372d1-eaba-420e-8089-1f7da11182f3 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3410b38ddeaf4d83ae78d94fba3a424e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:18.213272 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-d25372d1-eaba-420e-8089-1f7da11182f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:18.213272 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:31:18.213272 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:31:18.215317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25372d1-eaba-420e-8089-1f7da11182f3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:18.243250 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 20/36] 10.222.0.13 () {58 vars in 1382 bytes} [Sat Dec 18 20:31:18 2021] PUT /identity/v3/domains/default/users/3410b38ddeaf4d83ae78d94fba3a424e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:31:18.244257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25372d1-eaba-420e-8089-1f7da11182f3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:18.268765 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 17/37] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:31:18 2021] POST /identity/v3/roles => generated 225 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:31:18.343620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25372d1-eaba-420e-8089-1f7da11182f3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:18.354609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1bbcc-fa1d-4ecc-ac38-384796ed9740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:18.355733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1bbcc-fa1d-4ecc-ac38-384796ed9740 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:18.356222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1bbcc-fa1d-4ecc-ac38-384796ed9740 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:18.356697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1bbcc-fa1d-4ecc-ac38-384796ed9740 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:18.357701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1bbcc-fa1d-4ecc-ac38-384796ed9740 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:18.359528 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-36a1bbcc-fa1d-4ecc-ac38-384796ed9740 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:18.359528 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:31:18.359528 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:31:18.360832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1bbcc-fa1d-4ecc-ac38-384796ed9740 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:18.388273 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 21/38] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:31:18 2021] POST /identity/v3/roles => generated 219 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:31:19.138407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315d7e1-444f-4a29-a8af-0f34e73bc826 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:19.138949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315d7e1-444f-4a29-a8af-0f34e73bc826 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:19.138949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315d7e1-444f-4a29-a8af-0f34e73bc826 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:19.141586 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 18/39] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:19.147422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9390db4-834a-4ea1-be72-a78db92f3bd7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:19.147851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9390db4-834a-4ea1-be72-a78db92f3bd7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:19.148011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9390db4-834a-4ea1-be72-a78db92f3bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:19.169892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c9390db4-834a-4ea1-be72-a78db92f3bd7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:19.171640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c9390db4-834a-4ea1-be72-a78db92f3bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:19.179454 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 22/40] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:19.205127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315d7e1-444f-4a29-a8af-0f34e73bc826 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:19.218006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315d7e1-444f-4a29-a8af-0f34e73bc826 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:19.222393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7180e-e36d-4fe4-9ec6-c8bf8baabc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:19.223053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7180e-e36d-4fe4-9ec6-c8bf8baabc95 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:19.223343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7180e-e36d-4fe4-9ec6-c8bf8baabc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:19.223627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7180e-e36d-4fe4-9ec6-c8bf8baabc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:19.224401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff7180e-e36d-4fe4-9ec6-c8bf8baabc95 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:19.226208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff7180e-e36d-4fe4-9ec6-c8bf8baabc95 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:19.241551 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 19/41] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:31:19 2021] POST /identity/v3/roles => generated 223 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:31:19.442479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ed966-af71-46fb-b6e4-6f451f4b5e94 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:19.442786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ed966-af71-46fb-b6e4-6f451f4b5e94 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:19.442978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ed966-af71-46fb-b6e4-6f451f4b5e94 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:19.444917 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 23/42] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:19.450664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a862ded-557c-4037-ae98-0fea6a34e283 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:19.451141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a862ded-557c-4037-ae98-0fea6a34e283 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:19.451429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a862ded-557c-4037-ae98-0fea6a34e283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:19.470183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8a862ded-557c-4037-ae98-0fea6a34e283 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:19.471738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8a862ded-557c-4037-ae98-0fea6a34e283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:19.479625 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 20/43] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:19.505183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ed966-af71-46fb-b6e4-6f451f4b5e94 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:19.518782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ed966-af71-46fb-b6e4-6f451f4b5e94 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:19.523061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767e72b-b6e1-45ec-a6af-905c1e333406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:19.523847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767e72b-b6e1-45ec-a6af-905c1e333406 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:19.524143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767e72b-b6e1-45ec-a6af-905c1e333406 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:19.524426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767e72b-b6e1-45ec-a6af-905c1e333406 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:19.525624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767e72b-b6e1-45ec-a6af-905c1e333406 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:19.527382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767e72b-b6e1-45ec-a6af-905c1e333406 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:19.529114 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 24/44] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:31:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:19.535047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a862ded-557c-4037-ae98-0fea6a34e283 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:19.544076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a862ded-557c-4037-ae98-0fea6a34e283 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:19.548807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa973e44-946d-47a3-86d7-0048301ad988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:19.549486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa973e44-946d-47a3-86d7-0048301ad988 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:19.549770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa973e44-946d-47a3-86d7-0048301ad988 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:19.550048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa973e44-946d-47a3-86d7-0048301ad988 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:19.550906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa973e44-946d-47a3-86d7-0048301ad988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:19.551959 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-fa973e44-946d-47a3-86d7-0048301ad988 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:19.551959 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:31:19.551959 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:31:19.553185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa973e44-946d-47a3-86d7-0048301ad988 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:19.581070 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 21/45] 10.222.0.13 () {60 vars in 1162 bytes} [Sat Dec 18 20:31:19 2021] POST /identity/v3/projects => generated 312 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:31:20.767457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdca82-3b47-4221-a98f-25539414ec4e None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:20.767977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdca82-3b47-4221-a98f-25539414ec4e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:20.768056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdca82-3b47-4221-a98f-25539414ec4e None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:20.769819 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 25/46] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:20.776009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32d892-ea52-4eac-825c-94b002adedd0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:20.776458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32d892-ea52-4eac-825c-94b002adedd0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:20.776577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32d892-ea52-4eac-825c-94b002adedd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:20.794453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6a32d892-ea52-4eac-825c-94b002adedd0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:20.795625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6a32d892-ea52-4eac-825c-94b002adedd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:20.851075 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 22/47] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:20.876051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdca82-3b47-4221-a98f-25539414ec4e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:20.888130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdca82-3b47-4221-a98f-25539414ec4e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:20.893009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85b295-5a4c-41ed-9400-d8649395b38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:20.893919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85b295-5a4c-41ed-9400-d8649395b38d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:20.894197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85b295-5a4c-41ed-9400-d8649395b38d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:20.894513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85b295-5a4c-41ed-9400-d8649395b38d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:20.906775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85b295-5a4c-41ed-9400-d8649395b38d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:20.913527 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-cf85b295-5a4c-41ed-9400-d8649395b38d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:31:20.914730 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 26/48] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:31:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:20.920857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32d892-ea52-4eac-825c-94b002adedd0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:20.929773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32d892-ea52-4eac-825c-94b002adedd0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:20.934200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fc808-c176-45ac-b7c9-a350fe2d5152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:20.934959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fc808-c176-45ac-b7c9-a350fe2d5152 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:20.935307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fc808-c176-45ac-b7c9-a350fe2d5152 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:20.935652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fc808-c176-45ac-b7c9-a350fe2d5152 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:20.936724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fc808-c176-45ac-b7c9-a350fe2d5152 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:20.937625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fc808-c176-45ac-b7c9-a350fe2d5152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:20.939333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fc808-c176-45ac-b7c9-a350fe2d5152 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:20.947539 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 23/49] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:20.954008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85b295-5a4c-41ed-9400-d8649395b38d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:20.963635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85b295-5a4c-41ed-9400-d8649395b38d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:20.968081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22df64f-21a0-4d78-9f2e-c5c1bd649e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:20.968891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22df64f-21a0-4d78-9f2e-c5c1bd649e0b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:20.969181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22df64f-21a0-4d78-9f2e-c5c1bd649e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:20.969466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22df64f-21a0-4d78-9f2e-c5c1bd649e0b admin admin] PATH_INFO: `/v3/users/3410b38ddeaf4d83ae78d94fba3a424e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:20.970721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22df64f-21a0-4d78-9f2e-c5c1bd649e0b admin admin] RBAC: Authorizing `identity:get_user(user_id=3410b38ddeaf4d83ae78d94fba3a424e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:20.972532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22df64f-21a0-4d78-9f2e-c5c1bd649e0b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:20.974101 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 27/50] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:20 2021] GET /identity/v3/users/3410b38ddeaf4d83ae78d94fba3a424e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:20.979753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fc808-c176-45ac-b7c9-a350fe2d5152 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:20.989270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fc808-c176-45ac-b7c9-a350fe2d5152 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:20.993627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98e052-a20a-4a0e-ae3e-dc836d0a84bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:20.994447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98e052-a20a-4a0e-ae3e-dc836d0a84bb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:20.994735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98e052-a20a-4a0e-ae3e-dc836d0a84bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:20.995015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98e052-a20a-4a0e-ae3e-dc836d0a84bb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:20.996208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98e052-a20a-4a0e-ae3e-dc836d0a84bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:20.997908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98e052-a20a-4a0e-ae3e-dc836d0a84bb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:21.000005 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 24/51] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:31:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:21.006066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22df64f-21a0-4d78-9f2e-c5c1bd649e0b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:21.016338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22df64f-21a0-4d78-9f2e-c5c1bd649e0b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:21.020849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eac3b-550e-4541-a087-e3909d6c5b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:21.021492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eac3b-550e-4541-a087-e3909d6c5b40 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:21.021785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eac3b-550e-4541-a087-e3909d6c5b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:21.022069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eac3b-550e-4541-a087-e3909d6c5b40 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:21.022958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63eac3b-550e-4541-a087-e3909d6c5b40 admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.domain.id=default, user.id=3410b38ddeaf4d83ae78d94fba3a424e) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:21.023277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63eac3b-550e-4541-a087-e3909d6c5b40 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:21.025146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63eac3b-550e-4541-a087-e3909d6c5b40 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:21.030979 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 28/52] 10.222.0.13 () {56 vars in 1343 bytes} [Sat Dec 18 20:31:21 2021] GET /identity/v3/role_assignments?user.id=3410b38ddeaf4d83ae78d94fba3a424e&scope.domain.id=default&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:21.975130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d6e9c-857d-43f6-bed5-8b01e5e441db None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:21.975616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d6e9c-857d-43f6-bed5-8b01e5e441db None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:21.975616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d6e9c-857d-43f6-bed5-8b01e5e441db None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:21.977378 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 25/53] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:21.983187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d84b50-f732-4cad-b1c0-efe5b86e20c6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:21.984105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d84b50-f732-4cad-b1c0-efe5b86e20c6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:21.984268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d84b50-f732-4cad-b1c0-efe5b86e20c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:22.002669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-01d84b50-f732-4cad-b1c0-efe5b86e20c6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:22.003863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-01d84b50-f732-4cad-b1c0-efe5b86e20c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:22.011507 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 29/54] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:22.039438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d6e9c-857d-43f6-bed5-8b01e5e441db None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:22.054435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d6e9c-857d-43f6-bed5-8b01e5e441db None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:22.059434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe6c38-0f32-488d-aaec-5008cc811a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:22.060195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe6c38-0f32-488d-aaec-5008cc811a46 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:22.060474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe6c38-0f32-488d-aaec-5008cc811a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:22.060747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe6c38-0f32-488d-aaec-5008cc811a46 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:22.062856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe6c38-0f32-488d-aaec-5008cc811a46 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:22.064520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe6c38-0f32-488d-aaec-5008cc811a46 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:22.066047 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 26/55] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:31:22 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:22.071796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d84b50-f732-4cad-b1c0-efe5b86e20c6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:22.080700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d84b50-f732-4cad-b1c0-efe5b86e20c6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:22.085132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094533ca-985b-404d-ba1c-c3b65c68d605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:22.085780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094533ca-985b-404d-ba1c-c3b65c68d605 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:22.086080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094533ca-985b-404d-ba1c-c3b65c68d605 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:22.086400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094533ca-985b-404d-ba1c-c3b65c68d605 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:22.087139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094533ca-985b-404d-ba1c-c3b65c68d605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:22.089047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094533ca-985b-404d-ba1c-c3b65c68d605 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:22.113829 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 30/56] 10.222.0.13 () {60 vars in 1161 bytes} [Sat Dec 18 20:31:22 2021] POST /identity/v3/projects => generated 298 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:31:24.481764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3617a-161b-458a-a83f-b6d92af4e9b6 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:24.482299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3617a-161b-458a-a83f-b6d92af4e9b6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:24.482409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3617a-161b-458a-a83f-b6d92af4e9b6 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:24.484097 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 27/57] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:24.489597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cc5fc-2895-42d7-948a-c5d28a8caa10 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:24.489991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cc5fc-2895-42d7-948a-c5d28a8caa10 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:24.490169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cc5fc-2895-42d7-948a-c5d28a8caa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:24.507456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-175cc5fc-2895-42d7-948a-c5d28a8caa10 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:24.508651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-175cc5fc-2895-42d7-948a-c5d28a8caa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:24.564922 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 31/58] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:24.591096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3617a-161b-458a-a83f-b6d92af4e9b6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:24.602769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3617a-161b-458a-a83f-b6d92af4e9b6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:24.606958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c1607-3323-45a3-8eb3-18cf5780a025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:24.607740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c1607-3323-45a3-8eb3-18cf5780a025 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:24.608020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c1607-3323-45a3-8eb3-18cf5780a025 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:24.608297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c1607-3323-45a3-8eb3-18cf5780a025 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:24.609450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c1607-3323-45a3-8eb3-18cf5780a025 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:24.611165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c1607-3323-45a3-8eb3-18cf5780a025 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:24.612767 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 28/59] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:31:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:24.617993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cc5fc-2895-42d7-948a-c5d28a8caa10 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:24.627147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cc5fc-2895-42d7-948a-c5d28a8caa10 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:24.631523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1412d-90b2-4f0e-82d7-f256bd6f55df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:24.632181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1412d-90b2-4f0e-82d7-f256bd6f55df admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:24.632473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1412d-90b2-4f0e-82d7-f256bd6f55df admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:24.632758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1412d-90b2-4f0e-82d7-f256bd6f55df admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:24.633488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1412d-90b2-4f0e-82d7-f256bd6f55df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:24.634534 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-99a1412d-90b2-4f0e-82d7-f256bd6f55df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:24.634534 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:31:24.634534 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:31:24.635759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1412d-90b2-4f0e-82d7-f256bd6f55df admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:24.660985 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 32/60] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:31:24 2021] POST /identity/v3/users => generated 275 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:31:28.254874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5821aca-8815-4d0f-9b47-95992350f142 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.255902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5821aca-8815-4d0f-9b47-95992350f142 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.257508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5821aca-8815-4d0f-9b47-95992350f142 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.260601 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 29/61] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:28 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:28.266139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61807c-93cb-49bb-80ff-31b9baa92c5c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.267024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61807c-93cb-49bb-80ff-31b9baa92c5c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.267506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61807c-93cb-49bb-80ff-31b9baa92c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.287511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9d61807c-93cb-49bb-80ff-31b9baa92c5c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:28.289179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9d61807c-93cb-49bb-80ff-31b9baa92c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:28.302477 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 33/62] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:28.330118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5821aca-8815-4d0f-9b47-95992350f142 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.350939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5821aca-8815-4d0f-9b47-95992350f142 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:28.355456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824034e-2876-4f27-a0b5-148bafe78aa8 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.355996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824034e-2876-4f27-a0b5-148bafe78aa8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.356104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1cd14-1982-47a2-a5d1-7941b3ffad33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:28.356625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824034e-2876-4f27-a0b5-148bafe78aa8 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.356800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1cd14-1982-47a2-a5d1-7941b3ffad33 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.357092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1cd14-1982-47a2-a5d1-7941b3ffad33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.357373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1cd14-1982-47a2-a5d1-7941b3ffad33 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.359456 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 34/63] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:28.365396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba9bb5-f963-4b5c-9464-70e3bf5cc017 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.365970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba9bb5-f963-4b5c-9464-70e3bf5cc017 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.366511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba9bb5-f963-4b5c-9464-70e3bf5cc017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.373046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1cd14-1982-47a2-a5d1-7941b3ffad33 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:28.383511 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-f6c1cd14-1982-47a2-a5d1-7941b3ffad33 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:31:28.385022 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 30/64] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:28.391902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1cd14-1982-47a2-a5d1-7941b3ffad33 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.406492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1cd14-1982-47a2-a5d1-7941b3ffad33 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:28.407365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-56ba9bb5-f963-4b5c-9464-70e3bf5cc017 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:28.408808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-56ba9bb5-f963-4b5c-9464-70e3bf5cc017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:28.417951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5b97b-2de2-48cb-a48b-4f842b40933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:28.422278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5b97b-2de2-48cb-a48b-4f842b40933d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.422278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5b97b-2de2-48cb-a48b-4f842b40933d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.422278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5b97b-2de2-48cb-a48b-4f842b40933d admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.422278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5b97b-2de2-48cb-a48b-4f842b40933d admin admin] RBAC: Adding query filter params (name=member) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:28.422278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5b97b-2de2-48cb-a48b-4f842b40933d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:28.424573 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 35/65] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:28.425425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5b97b-2de2-48cb-a48b-4f842b40933d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:28.435176 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 31/66] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:28.444379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba9bb5-f963-4b5c-9464-70e3bf5cc017 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.455994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba9bb5-f963-4b5c-9464-70e3bf5cc017 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:28.460756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2109a-ca7c-460e-a075-0bc20985e4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:28.461801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2109a-ca7c-460e-a075-0bc20985e4dd admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.462225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2109a-ca7c-460e-a075-0bc20985e4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.462681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2109a-ca7c-460e-a075-0bc20985e4dd admin admin] PATH_INFO: `/v3/users/7fd711c1d320431090ade6e28fd8b914` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.466910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5b97b-2de2-48cb-a48b-4f842b40933d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.478138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5b97b-2de2-48cb-a48b-4f842b40933d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:28.483448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a39353-b2d6-41ed-ac56-a3d14544d972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:28.484999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a39353-b2d6-41ed-ac56-a3d14544d972 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.485511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a39353-b2d6-41ed-ac56-a3d14544d972 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.486198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a39353-b2d6-41ed-ac56-a3d14544d972 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.496123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2109a-ca7c-460e-a075-0bc20985e4dd admin admin] RBAC: Authorizing `identity:get_user(user_id=7fd711c1d320431090ade6e28fd8b914)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:28.498398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2109a-ca7c-460e-a075-0bc20985e4dd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:28.501098 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 36/67] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/users/7fd711c1d320431090ade6e28fd8b914 => generated 275 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:28.501366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a39353-b2d6-41ed-ac56-a3d14544d972 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:28.508984 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-b8a39353-b2d6-41ed-ac56-a3d14544d972 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:31:28.510603 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 32/68] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:31:28.515202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2109a-ca7c-460e-a075-0bc20985e4dd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.519551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a39353-b2d6-41ed-ac56-a3d14544d972 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.530993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a39353-b2d6-41ed-ac56-a3d14544d972 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:28.533759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2109a-ca7c-460e-a075-0bc20985e4dd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:28.536288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39b5ae-20ef-4b7d-98b3-7ae70a799a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:28.537174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39b5ae-20ef-4b7d-98b3-7ae70a799a0c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.537656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39b5ae-20ef-4b7d-98b3-7ae70a799a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.538135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39b5ae-20ef-4b7d-98b3-7ae70a799a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.539326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39b5ae-20ef-4b7d-98b3-7ae70a799a0c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:28.539900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39b5ae-20ef-4b7d-98b3-7ae70a799a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:28.541747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39b5ae-20ef-4b7d-98b3-7ae70a799a0c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:28.547453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf77205-cae1-44fb-8e6f-acb18658129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:28.548310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf77205-cae1-44fb-8e6f-acb18658129e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.548422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf77205-cae1-44fb-8e6f-acb18658129e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.548668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf77205-cae1-44fb-8e6f-acb18658129e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.551935 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 33/69] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:28.559244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39b5ae-20ef-4b7d-98b3-7ae70a799a0c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.566010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf77205-cae1-44fb-8e6f-acb18658129e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:28.568031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf77205-cae1-44fb-8e6f-acb18658129e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:28.578469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39b5ae-20ef-4b7d-98b3-7ae70a799a0c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:28.579025 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 37/70] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:28.580740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeef028-9046-4e53-bf83-5eb8987d18dc None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.581238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeef028-9046-4e53-bf83-5eb8987d18dc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.581757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeef028-9046-4e53-bf83-5eb8987d18dc None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.583479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c35d3e-c058-4f6f-8bc7-e0daa81bab04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:28.584124 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 38/71] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:28.585022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeef028-9046-4e53-bf83-5eb8987d18dc None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.588305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c35d3e-c058-4f6f-8bc7-e0daa81bab04 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.588976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c35d3e-c058-4f6f-8bc7-e0daa81bab04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.589464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c35d3e-c058-4f6f-8bc7-e0daa81bab04 admin admin] PATH_INFO: `/v3/users/3410b38ddeaf4d83ae78d94fba3a424e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.590953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c35d3e-c058-4f6f-8bc7-e0daa81bab04 admin admin] RBAC: Authorizing `identity:get_user(user_id=3410b38ddeaf4d83ae78d94fba3a424e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:28.593784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c35d3e-c058-4f6f-8bc7-e0daa81bab04 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:28.596520 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 34/72] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/users/3410b38ddeaf4d83ae78d94fba3a424e => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:28.602685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ee146-54a0-42f8-a877-6de47778d1c5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.602811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeef028-9046-4e53-bf83-5eb8987d18dc None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:28.602889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ee146-54a0-42f8-a877-6de47778d1c5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.603132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ee146-54a0-42f8-a877-6de47778d1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.608808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468ff92-81c0-4e95-8013-63d54292ec48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:28.610132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468ff92-81c0-4e95-8013-63d54292ec48 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.610659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468ff92-81c0-4e95-8013-63d54292ec48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.611991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468ff92-81c0-4e95-8013-63d54292ec48 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.613400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468ff92-81c0-4e95-8013-63d54292ec48 admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:28.615730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468ff92-81c0-4e95-8013-63d54292ec48 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:28.618659 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 39/73] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:28.619607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468ff92-81c0-4e95-8013-63d54292ec48 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.627576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fc6ee146-54a0-42f8-a877-6de47778d1c5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:28.628862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fc6ee146-54a0-42f8-a877-6de47778d1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:28.630104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468ff92-81c0-4e95-8013-63d54292ec48 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:28.635161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f29a3-c74d-4ac6-be65-3a9b185d50fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:28.636006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f29a3-c74d-4ac6-be65-3a9b185d50fc admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.636546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f29a3-c74d-4ac6-be65-3a9b185d50fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.637005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f29a3-c74d-4ac6-be65-3a9b185d50fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.642369 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 35/74] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:28.643261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ee146-54a0-42f8-a877-6de47778d1c5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.646632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f29a3-c74d-4ac6-be65-3a9b185d50fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:28.648760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f29a3-c74d-4ac6-be65-3a9b185d50fc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:28.658839 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 40/75] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:28.663765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ee146-54a0-42f8-a877-6de47778d1c5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:28.664880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f29a3-c74d-4ac6-be65-3a9b185d50fc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.671643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc792497-b2a3-46c2-a510-e90fc6d8a444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:28.672142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc792497-b2a3-46c2-a510-e90fc6d8a444 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.672577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc792497-b2a3-46c2-a510-e90fc6d8a444 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.672935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc792497-b2a3-46c2-a510-e90fc6d8a444 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.673855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc792497-b2a3-46c2-a510-e90fc6d8a444 admin admin] RBAC: Adding query filter params (role.id=d9c784a85e0540d0abdfedac9386a842, scope.project.id=64298b5848d848fdafaf45401789cb0a, user.id=7fd711c1d320431090ade6e28fd8b914) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:28.674237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc792497-b2a3-46c2-a510-e90fc6d8a444 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:28.675387 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-dc792497-b2a3-46c2-a510-e90fc6d8a444 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:28.675387 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:31:28.675387 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:31:28.676546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f29a3-c74d-4ac6-be65-3a9b185d50fc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:28.676653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc792497-b2a3-46c2-a510-e90fc6d8a444 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:28.690174 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 36/76] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/role_assignments?user.id=7fd711c1d320431090ade6e28fd8b914&scope.project.id=64298b5848d848fdafaf45401789cb0a&role.id=d9c784a85e0540d0abdfedac9386a842 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:28.691954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efe02a-4301-415e-b9b9-3e2ee03d9030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:28.693034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efe02a-4301-415e-b9b9-3e2ee03d9030 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.693491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efe02a-4301-415e-b9b9-3e2ee03d9030 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.693938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efe02a-4301-415e-b9b9-3e2ee03d9030 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.695346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc792497-b2a3-46c2-a510-e90fc6d8a444 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.696237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efe02a-4301-415e-b9b9-3e2ee03d9030 admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:28.699056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efe02a-4301-415e-b9b9-3e2ee03d9030 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:28.707760 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 41/77] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:28.717509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc792497-b2a3-46c2-a510-e90fc6d8a444 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:28.717832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efe02a-4301-415e-b9b9-3e2ee03d9030 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.730551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3af106-09b6-4a2b-b602-9559c385c780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:28.731760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3af106-09b6-4a2b-b602-9559c385c780 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.734038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3af106-09b6-4a2b-b602-9559c385c780 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.734571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3af106-09b6-4a2b-b602-9559c385c780 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.743984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efe02a-4301-415e-b9b9-3e2ee03d9030 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:28.753484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c95d3d-19ce-40d8-b9b3-a35a764c7a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:28.757084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c95d3d-19ce-40d8-b9b3-a35a764c7a89 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.757686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c95d3d-19ce-40d8-b9b3-a35a764c7a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.758185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c95d3d-19ce-40d8-b9b3-a35a764c7a89 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.759342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c95d3d-19ce-40d8-b9b3-a35a764c7a89 admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=64298b5848d848fdafaf45401789cb0a, user.id=3410b38ddeaf4d83ae78d94fba3a424e) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:28.760355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c95d3d-19ce-40d8-b9b3-a35a764c7a89 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:28.761165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3af106-09b6-4a2b-b602-9559c385c780 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:28.763366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c95d3d-19ce-40d8-b9b3-a35a764c7a89 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:28.771080 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-1b3af106-09b6-4a2b-b602-9559c385c780 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 18 20:31:28.784647 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 42/79] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/role_assignments?user.id=3410b38ddeaf4d83ae78d94fba3a424e&scope.project.id=64298b5848d848fdafaf45401789cb0a&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 259 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:28.785043 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 37/79] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:28.786541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c95d3d-19ce-40d8-b9b3-a35a764c7a89 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.802138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c95d3d-19ce-40d8-b9b3-a35a764c7a89 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:28.807232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9de7c8-e74e-42d2-9f01-576c0d34871d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:28.808346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9de7c8-e74e-42d2-9f01-576c0d34871d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.808838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9de7c8-e74e-42d2-9f01-576c0d34871d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.809316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9de7c8-e74e-42d2-9f01-576c0d34871d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.810328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9de7c8-e74e-42d2-9f01-576c0d34871d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:28.810870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9de7c8-e74e-42d2-9f01-576c0d34871d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:28.812505 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-df9de7c8-e74e-42d2-9f01-576c0d34871d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:28.812505 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:31:28.812505 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:31:28.813791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9de7c8-e74e-42d2-9f01-576c0d34871d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:28.838107 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 43/80] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:28.845463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3af106-09b6-4a2b-b602-9559c385c780 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.857254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3af106-09b6-4a2b-b602-9559c385c780 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:28.868073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6ed1c-d2bb-4a59-8775-35aa9dcd7cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:28.869326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6ed1c-d2bb-4a59-8775-35aa9dcd7cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.869839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6ed1c-d2bb-4a59-8775-35aa9dcd7cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.870424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6ed1c-d2bb-4a59-8775-35aa9dcd7cd8 admin admin] PATH_INFO: `/v3/users/7fd711c1d320431090ade6e28fd8b914` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.872083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6ed1c-d2bb-4a59-8775-35aa9dcd7cd8 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fd711c1d320431090ade6e28fd8b914)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:28.874711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6ed1c-d2bb-4a59-8775-35aa9dcd7cd8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:28.877015 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 38/81] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/users/7fd711c1d320431090ade6e28fd8b914 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:28.883630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9de7c8-e74e-42d2-9f01-576c0d34871d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.895174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9de7c8-e74e-42d2-9f01-576c0d34871d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:28.906694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027916fd-ca91-4ae5-ad1e-6d781fa86992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:28.907792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027916fd-ca91-4ae5-ad1e-6d781fa86992 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.908287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027916fd-ca91-4ae5-ad1e-6d781fa86992 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.908779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027916fd-ca91-4ae5-ad1e-6d781fa86992 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.918453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027916fd-ca91-4ae5-ad1e-6d781fa86992 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:28.921310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027916fd-ca91-4ae5-ad1e-6d781fa86992 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:28.936777 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 44/82] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:28.942929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6ed1c-d2bb-4a59-8775-35aa9dcd7cd8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.954213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6ed1c-d2bb-4a59-8775-35aa9dcd7cd8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:28.960502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76006b1b-2e34-4f81-9685-77fd1091d0ef None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.961169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76006b1b-2e34-4f81-9685-77fd1091d0ef None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.961668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76006b1b-2e34-4f81-9685-77fd1091d0ef None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.963807 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 45/83] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:31:28.966179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7b59a-5604-4f37-aa4f-64d339d16c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:28.967312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7b59a-5604-4f37-aa4f-64d339d16c3c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.967901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7b59a-5604-4f37-aa4f-64d339d16c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.968459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7b59a-5604-4f37-aa4f-64d339d16c3c admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.970143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f66f9-9283-47dc-95d1-52619c164bf9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:28.970463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f66f9-9283-47dc-95d1-52619c164bf9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:28.970746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f66f9-9283-47dc-95d1-52619c164bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:28.973843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7b59a-5604-4f37-aa4f-64d339d16c3c admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:28.976058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7b59a-5604-4f37-aa4f-64d339d16c3c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:28.977866 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 39/84] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:28.985058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7b59a-5604-4f37-aa4f-64d339d16c3c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:28.996031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-647f66f9-9283-47dc-95d1-52619c164bf9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:28.998709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-647f66f9-9283-47dc-95d1-52619c164bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:29.002601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7b59a-5604-4f37-aa4f-64d339d16c3c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:29.011122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8b1a0-e5dd-4c60-869d-48622db0e392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:29.011726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8b1a0-e5dd-4c60-869d-48622db0e392 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:29.012016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8b1a0-e5dd-4c60-869d-48622db0e392 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:29.012303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8b1a0-e5dd-4c60-869d-48622db0e392 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:29.013170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8b1a0-e5dd-4c60-869d-48622db0e392 admin admin] RBAC: Adding query filter params (role.id=04189c3120df49f6b37322459b571cf1, scope.project.id=64298b5848d848fdafaf45401789cb0a, user.id=7fd711c1d320431090ade6e28fd8b914) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:29.013488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8b1a0-e5dd-4c60-869d-48622db0e392 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:29.015988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8b1a0-e5dd-4c60-869d-48622db0e392 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:29.020743 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 46/85] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:29.023959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7c0f0-fd2f-46b4-b1fe-652d8f4aa1e1 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:29.024254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7c0f0-fd2f-46b4-b1fe-652d8f4aa1e1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:29.024540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7c0f0-fd2f-46b4-b1fe-652d8f4aa1e1 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:29.026632 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 47/86] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:29.030626 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 40/87] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:28 2021] GET /identity/v3/role_assignments?user.id=7fd711c1d320431090ade6e28fd8b914&scope.project.id=64298b5848d848fdafaf45401789cb0a&role.id=04189c3120df49f6b37322459b571cf1 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:29.033018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681d380-9d1c-40a9-be71-7051c7c4c762 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:29.033313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681d380-9d1c-40a9-be71-7051c7c4c762 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:29.033597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681d380-9d1c-40a9-be71-7051c7c4c762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:29.052842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8681d380-9d1c-40a9-be71-7051c7c4c762 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:29.053139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8b1a0-e5dd-4c60-869d-48622db0e392 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:29.054149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8681d380-9d1c-40a9-be71-7051c7c4c762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:29.063747 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 48/88] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:29.064812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8b1a0-e5dd-4c60-869d-48622db0e392 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:29.073446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c62a1-2ea2-4147-ab5e-d5e6cf817282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:29.074290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c62a1-2ea2-4147-ab5e-d5e6cf817282 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:29.074570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c62a1-2ea2-4147-ab5e-d5e6cf817282 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:29.074850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c62a1-2ea2-4147-ab5e-d5e6cf817282 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:29.076093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c62a1-2ea2-4147-ab5e-d5e6cf817282 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:29.078777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c62a1-2ea2-4147-ab5e-d5e6cf817282 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:29.080521 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 41/89] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:31:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:29.086594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681d380-9d1c-40a9-be71-7051c7c4c762 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:29.091810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c62a1-2ea2-4147-ab5e-d5e6cf817282 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:29.101682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681d380-9d1c-40a9-be71-7051c7c4c762 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:29.101986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c62a1-2ea2-4147-ab5e-d5e6cf817282 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:29.106509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2450f3-6e5b-4e69-b004-18e966dd5fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:29.107213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2450f3-6e5b-4e69-b004-18e966dd5fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:29.107378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ca438-ed16-401d-99d0-fbb0a1693cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:29.107540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2450f3-6e5b-4e69-b004-18e966dd5fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:29.107776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2450f3-6e5b-4e69-b004-18e966dd5fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:29.108145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ca438-ed16-401d-99d0-fbb0a1693cff admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:29.108441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ca438-ed16-401d-99d0-fbb0a1693cff admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:29.108601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2450f3-6e5b-4e69-b004-18e966dd5fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:29.108749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ca438-ed16-401d-99d0-fbb0a1693cff admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:29.110627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2450f3-6e5b-4e69-b004-18e966dd5fe8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:29.121458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ca438-ed16-401d-99d0-fbb0a1693cff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:29.131153 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-874ca438-ed16-401d-99d0-fbb0a1693cff admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:31:29.134315 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 42/90] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:29.143585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ca438-ed16-401d-99d0-fbb0a1693cff admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:29.144251 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 49/91] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:31:29 2021] POST /identity/v3/users => generated 289 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:31:29.170163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ca438-ed16-401d-99d0-fbb0a1693cff admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:29.177971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1c0e3-3db5-444c-8185-896bba89f594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:29.178787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1c0e3-3db5-444c-8185-896bba89f594 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:29.179144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1c0e3-3db5-444c-8185-896bba89f594 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:29.179509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1c0e3-3db5-444c-8185-896bba89f594 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:29.187849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1c0e3-3db5-444c-8185-896bba89f594 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:29.188186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1c0e3-3db5-444c-8185-896bba89f594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:29.189969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1c0e3-3db5-444c-8185-896bba89f594 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:29.205275 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 43/92] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:29.213641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2450f3-6e5b-4e69-b004-18e966dd5fe8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:29.230332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2450f3-6e5b-4e69-b004-18e966dd5fe8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:29.241447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94db92a-173e-415e-963b-617d613a900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:29.242382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94db92a-173e-415e-963b-617d613a900b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:29.242730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94db92a-173e-415e-963b-617d613a900b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:29.243022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94db92a-173e-415e-963b-617d613a900b admin admin] PATH_INFO: `/v3/users/7fd711c1d320431090ade6e28fd8b914` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:29.247339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94db92a-173e-415e-963b-617d613a900b admin admin] RBAC: Authorizing `identity:get_user(user_id=7fd711c1d320431090ade6e28fd8b914)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:29.250120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94db92a-173e-415e-963b-617d613a900b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:29.252163 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 50/93] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:29 2021] GET /identity/v3/users/7fd711c1d320431090ade6e28fd8b914 => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:29.258529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1c0e3-3db5-444c-8185-896bba89f594 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:29.273692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1c0e3-3db5-444c-8185-896bba89f594 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:29.278562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b522970-ea1b-4eeb-a073-0a74a102bcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:29.279295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b522970-ea1b-4eeb-a073-0a74a102bcca admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:29.279582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b522970-ea1b-4eeb-a073-0a74a102bcca admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:29.279865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b522970-ea1b-4eeb-a073-0a74a102bcca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:29.295962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b522970-ea1b-4eeb-a073-0a74a102bcca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:29.297851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b522970-ea1b-4eeb-a073-0a74a102bcca admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:29.315077 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 44/94] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:29.321747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94db92a-173e-415e-963b-617d613a900b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:29.339402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94db92a-173e-415e-963b-617d613a900b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:29.351552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74e162-ef33-4150-9016-da3c74a5bf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:29.352437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74e162-ef33-4150-9016-da3c74a5bf63 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:29.352730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74e162-ef33-4150-9016-da3c74a5bf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:29.353017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74e162-ef33-4150-9016-da3c74a5bf63 admin admin] PATH_INFO: `/v3/projects/faaa8b17dafb49dfacff20361e811613` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:29.359166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74e162-ef33-4150-9016-da3c74a5bf63 admin admin] RBAC: Authorizing `identity:get_project(project_id=faaa8b17dafb49dfacff20361e811613)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:29.361350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74e162-ef33-4150-9016-da3c74a5bf63 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:29.363476 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 51/95] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:29 2021] GET /identity/v3/projects/faaa8b17dafb49dfacff20361e811613 => generated 312 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:29.369754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b522970-ea1b-4eeb-a073-0a74a102bcca admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:29.381952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b522970-ea1b-4eeb-a073-0a74a102bcca admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:29.386545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a33d7-2ac3-4aa3-9ab3-3f4a8dadd818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:29.387282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a33d7-2ac3-4aa3-9ab3-3f4a8dadd818 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:29.387572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a33d7-2ac3-4aa3-9ab3-3f4a8dadd818 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:29.387854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a33d7-2ac3-4aa3-9ab3-3f4a8dadd818 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:29.388732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a33d7-2ac3-4aa3-9ab3-3f4a8dadd818 admin admin] RBAC: Adding query filter params (role.id=d9c784a85e0540d0abdfedac9386a842, scope.project.id=faaa8b17dafb49dfacff20361e811613, user.id=7fd711c1d320431090ade6e28fd8b914) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:29.389006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a33d7-2ac3-4aa3-9ab3-3f4a8dadd818 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:29.396268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a33d7-2ac3-4aa3-9ab3-3f4a8dadd818 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:29.402998 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 45/96] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:29 2021] GET /identity/v3/role_assignments?user.id=7fd711c1d320431090ade6e28fd8b914&scope.project.id=faaa8b17dafb49dfacff20361e811613&role.id=d9c784a85e0540d0abdfedac9386a842 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:31.560172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f830334-29a3-4285-8fe0-12573ed2b5c2 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:31.561962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f830334-29a3-4285-8fe0-12573ed2b5c2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:31.562522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f830334-29a3-4285-8fe0-12573ed2b5c2 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:31.564752 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 52/97] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:31 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:31.571092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c0a86-5989-451f-9913-662d24dc14fa None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:31.571565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c0a86-5989-451f-9913-662d24dc14fa None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:31.571660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c0a86-5989-451f-9913-662d24dc14fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:31.595555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5d2c0a86-5989-451f-9913-662d24dc14fa None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:31.596765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5d2c0a86-5989-451f-9913-662d24dc14fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:31.609345 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 46/98] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:31.634538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f830334-29a3-4285-8fe0-12573ed2b5c2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:31.655009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f830334-29a3-4285-8fe0-12573ed2b5c2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:31.659947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9287a67-716e-4b23-b05c-2471cc8442ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:31.661104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9287a67-716e-4b23-b05c-2471cc8442ad admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:31.661608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9287a67-716e-4b23-b05c-2471cc8442ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:31.662089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9287a67-716e-4b23-b05c-2471cc8442ad admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:31.682120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9287a67-716e-4b23-b05c-2471cc8442ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:31.689919 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-d9287a67-716e-4b23-b05c-2471cc8442ad admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:31:31.691706 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 53/99] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:31.698086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c0a86-5989-451f-9913-662d24dc14fa None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:31.707822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c0a86-5989-451f-9913-662d24dc14fa None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:31.716719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa5ba1-ff49-4f73-8519-dc6494b98f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:31.717564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa5ba1-ff49-4f73-8519-dc6494b98f69 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:31.717851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa5ba1-ff49-4f73-8519-dc6494b98f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:31.718132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa5ba1-ff49-4f73-8519-dc6494b98f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:31.718924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa5ba1-ff49-4f73-8519-dc6494b98f69 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:31.719230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa5ba1-ff49-4f73-8519-dc6494b98f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:31.720844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa5ba1-ff49-4f73-8519-dc6494b98f69 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:31.737176 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 47/100] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:31.744001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9287a67-716e-4b23-b05c-2471cc8442ad admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:31.759363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9287a67-716e-4b23-b05c-2471cc8442ad admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:31.764916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77084f8-0af5-41e6-80b0-81a0b9f23fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:31.766040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77084f8-0af5-41e6-80b0-81a0b9f23fec admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:31.766554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77084f8-0af5-41e6-80b0-81a0b9f23fec admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:31.767037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77084f8-0af5-41e6-80b0-81a0b9f23fec admin admin] PATH_INFO: `/v3/users/7fd711c1d320431090ade6e28fd8b914` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:31.768457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77084f8-0af5-41e6-80b0-81a0b9f23fec admin admin] RBAC: Authorizing `identity:get_user(user_id=7fd711c1d320431090ade6e28fd8b914)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:31.770948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77084f8-0af5-41e6-80b0-81a0b9f23fec admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:31.778274 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 54/101] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:31 2021] GET /identity/v3/users/7fd711c1d320431090ade6e28fd8b914 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:31.779715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa5ba1-ff49-4f73-8519-dc6494b98f69 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:31.793902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa5ba1-ff49-4f73-8519-dc6494b98f69 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:31.810029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ca7c1-f3ed-4783-82f8-5b73141d49bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:31.810969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ca7c1-f3ed-4783-82f8-5b73141d49bf admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:31.811381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ca7c1-f3ed-4783-82f8-5b73141d49bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:31.811913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ca7c1-f3ed-4783-82f8-5b73141d49bf admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:31.814963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ca7c1-f3ed-4783-82f8-5b73141d49bf admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:31.817150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ca7c1-f3ed-4783-82f8-5b73141d49bf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:31.818988 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 48/102] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:31 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:31.825411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77084f8-0af5-41e6-80b0-81a0b9f23fec admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:31.840185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77084f8-0af5-41e6-80b0-81a0b9f23fec admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:31.845539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019e07f-e663-405a-bbc5-9ed47ca9056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:31.846684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019e07f-e663-405a-bbc5-9ed47ca9056c admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:31.847204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019e07f-e663-405a-bbc5-9ed47ca9056c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:31.847687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019e07f-e663-405a-bbc5-9ed47ca9056c admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a/users/7fd711c1d320431090ade6e28fd8b914/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:31.849879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019e07f-e663-405a-bbc5-9ed47ca9056c admin admin] RBAC: Authorizing `identity:create_grant(project_id=64298b5848d848fdafaf45401789cb0a, user_id=7fd711c1d320431090ade6e28fd8b914, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:31.858269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019e07f-e663-405a-bbc5-9ed47ca9056c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:31.873014 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 55/103] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:31:31 2021] PUT /identity/v3/projects/64298b5848d848fdafaf45401789cb0a/users/7fd711c1d320431090ade6e28fd8b914/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:31:32.230905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef8f3d-3426-49a6-a79c-b056aad60191 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:32.231289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef8f3d-3426-49a6-a79c-b056aad60191 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:32.231467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef8f3d-3426-49a6-a79c-b056aad60191 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:32.233622 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 49/104] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:32.239631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54548afd-bc40-4fe6-acd3-ca66dc0833df None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:32.240228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54548afd-bc40-4fe6-acd3-ca66dc0833df None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:32.240712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54548afd-bc40-4fe6-acd3-ca66dc0833df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:32.262151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-54548afd-bc40-4fe6-acd3-ca66dc0833df None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:32.263735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-54548afd-bc40-4fe6-acd3-ca66dc0833df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:32.337065 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 56/105] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:32.379827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef8f3d-3426-49a6-a79c-b056aad60191 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:32.403687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef8f3d-3426-49a6-a79c-b056aad60191 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:32.408265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bfb51-946a-49be-a12d-3d87e87c3679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:32.415297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bfb51-946a-49be-a12d-3d87e87c3679 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:32.415592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bfb51-946a-49be-a12d-3d87e87c3679 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:32.415876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bfb51-946a-49be-a12d-3d87e87c3679 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:32.431327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bfb51-946a-49be-a12d-3d87e87c3679 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:32.439132 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-541bfb51-946a-49be-a12d-3d87e87c3679 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 18 20:31:32.440491 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 50/106] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:31:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:32.446710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54548afd-bc40-4fe6-acd3-ca66dc0833df None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:32.459436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54548afd-bc40-4fe6-acd3-ca66dc0833df None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:32.464250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c105d94-47f8-415b-be07-7810dec7b066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:32.470060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105d94-47f8-415b-be07-7810dec7b066 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:32.470632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105d94-47f8-415b-be07-7810dec7b066 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:32.471128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105d94-47f8-415b-be07-7810dec7b066 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:32.472156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c105d94-47f8-415b-be07-7810dec7b066 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:32.472690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c105d94-47f8-415b-be07-7810dec7b066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:32.474539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c105d94-47f8-415b-be07-7810dec7b066 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:32.490526 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 57/107] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:31:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:32.496618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bfb51-946a-49be-a12d-3d87e87c3679 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:32.512900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bfb51-946a-49be-a12d-3d87e87c3679 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:32.517953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ab79f-a11e-4c2a-8e40-ec32a5aea680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:32.519315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab79f-a11e-4c2a-8e40-ec32a5aea680 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:32.519808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab79f-a11e-4c2a-8e40-ec32a5aea680 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:32.520344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab79f-a11e-4c2a-8e40-ec32a5aea680 admin admin] PATH_INFO: `/v3/users/7fd711c1d320431090ade6e28fd8b914` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:32.521881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ab79f-a11e-4c2a-8e40-ec32a5aea680 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fd711c1d320431090ade6e28fd8b914)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:32.524452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ab79f-a11e-4c2a-8e40-ec32a5aea680 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:32.526411 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 51/108] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:32 2021] GET /identity/v3/users/7fd711c1d320431090ade6e28fd8b914 => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:32.532481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c105d94-47f8-415b-be07-7810dec7b066 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:32.543096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c105d94-47f8-415b-be07-7810dec7b066 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:32.548588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31339f9d-d7f1-41c7-820e-ff16fb473cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:32.549744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31339f9d-d7f1-41c7-820e-ff16fb473cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:32.550234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31339f9d-d7f1-41c7-820e-ff16fb473cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:32.550802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31339f9d-d7f1-41c7-820e-ff16fb473cc5 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:32.552337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31339f9d-d7f1-41c7-820e-ff16fb473cc5 admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:32.554783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31339f9d-d7f1-41c7-820e-ff16fb473cc5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:32.556791 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 58/109] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:32 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:32.565512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ab79f-a11e-4c2a-8e40-ec32a5aea680 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:32.576875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ab79f-a11e-4c2a-8e40-ec32a5aea680 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:32.583049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd35cdb-62b7-48a7-a539-17c5e998f506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:32.584194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd35cdb-62b7-48a7-a539-17c5e998f506 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:32.584718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd35cdb-62b7-48a7-a539-17c5e998f506 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:32.585301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd35cdb-62b7-48a7-a539-17c5e998f506 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a/users/7fd711c1d320431090ade6e28fd8b914/roles/04189c3120df49f6b37322459b571cf1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:32.587928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd35cdb-62b7-48a7-a539-17c5e998f506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64298b5848d848fdafaf45401789cb0a, user_id=7fd711c1d320431090ade6e28fd8b914, role_id=04189c3120df49f6b37322459b571cf1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:32.594469 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-acd35cdb-62b7-48a7-a539-17c5e998f506 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:32.594469 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:31:32.594469 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:31:32.596856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd35cdb-62b7-48a7-a539-17c5e998f506 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:32.610148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47f24e-c4fc-496c-a27f-901e521752b8 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:32.611106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47f24e-c4fc-496c-a27f-901e521752b8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:32.611615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47f24e-c4fc-496c-a27f-901e521752b8 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:32.613670 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 59/110] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:32 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:31:32.622744 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 52/111] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:31:32 2021] PUT /identity/v3/projects/64298b5848d848fdafaf45401789cb0a/users/7fd711c1d320431090ade6e28fd8b914/roles/04189c3120df49f6b37322459b571cf1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:31:32.632637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1fe40-8f81-4960-ba0c-1975a980263c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:32.633267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1fe40-8f81-4960-ba0c-1975a980263c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:32.633779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1fe40-8f81-4960-ba0c-1975a980263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:32.653862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-72b1fe40-8f81-4960-ba0c-1975a980263c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:32.655729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-72b1fe40-8f81-4960-ba0c-1975a980263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:32.744065 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 60/112] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:32.770511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd35cdb-62b7-48a7-a539-17c5e998f506 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:32.781956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd35cdb-62b7-48a7-a539-17c5e998f506 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:32.787084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67b073-d07f-40e3-946f-d6ce445946ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:32.788273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67b073-d07f-40e3-946f-d6ce445946ac admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:32.788814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67b073-d07f-40e3-946f-d6ce445946ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:32.789324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67b073-d07f-40e3-946f-d6ce445946ac admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:32.801919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67b073-d07f-40e3-946f-d6ce445946ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:32.809569 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-2b67b073-d07f-40e3-946f-d6ce445946ac admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:31:32.811266 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 53/113] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:31:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:32.818142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1fe40-8f81-4960-ba0c-1975a980263c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:32.828202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1fe40-8f81-4960-ba0c-1975a980263c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:32.833345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5dcf2-5ae4-4766-8f9c-88035c8a7633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:32.834319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5dcf2-5ae4-4766-8f9c-88035c8a7633 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:32.834903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5dcf2-5ae4-4766-8f9c-88035c8a7633 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:32.835390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5dcf2-5ae4-4766-8f9c-88035c8a7633 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:32.836388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5dcf2-5ae4-4766-8f9c-88035c8a7633 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:32.836903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5dcf2-5ae4-4766-8f9c-88035c8a7633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:32.838924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5dcf2-5ae4-4766-8f9c-88035c8a7633 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:32.850790 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 61/114] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:32.859699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67b073-d07f-40e3-946f-d6ce445946ac admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:32.871369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67b073-d07f-40e3-946f-d6ce445946ac admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:32.876648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57c1ff-1413-4395-8012-ef0850ad87b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:32.877936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57c1ff-1413-4395-8012-ef0850ad87b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:32.878450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57c1ff-1413-4395-8012-ef0850ad87b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:32.878932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57c1ff-1413-4395-8012-ef0850ad87b3 admin admin] PATH_INFO: `/v3/users/3410b38ddeaf4d83ae78d94fba3a424e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:32.880522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57c1ff-1413-4395-8012-ef0850ad87b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=3410b38ddeaf4d83ae78d94fba3a424e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:32.882833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57c1ff-1413-4395-8012-ef0850ad87b3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:32.884965 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 54/115] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:32 2021] GET /identity/v3/users/3410b38ddeaf4d83ae78d94fba3a424e => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:32.891341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5dcf2-5ae4-4766-8f9c-88035c8a7633 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:32.902384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5dcf2-5ae4-4766-8f9c-88035c8a7633 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:32.908121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380a253-38ce-432d-b776-5db5368a8828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:32.909331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a253-38ce-432d-b776-5db5368a8828 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:32.909845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a253-38ce-432d-b776-5db5368a8828 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:32.910384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a253-38ce-432d-b776-5db5368a8828 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:32.911993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380a253-38ce-432d-b776-5db5368a8828 admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:32.914471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380a253-38ce-432d-b776-5db5368a8828 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:32.916612 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 62/116] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:32 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:32.923490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57c1ff-1413-4395-8012-ef0850ad87b3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:32.934571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57c1ff-1413-4395-8012-ef0850ad87b3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:32.940062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbae32-f1ef-4559-a83a-762c70c51e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:32.941333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbae32-f1ef-4559-a83a-762c70c51e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:32.941874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbae32-f1ef-4559-a83a-762c70c51e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:32.942403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbae32-f1ef-4559-a83a-762c70c51e86 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a/users/3410b38ddeaf4d83ae78d94fba3a424e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:32.944716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbae32-f1ef-4559-a83a-762c70c51e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64298b5848d848fdafaf45401789cb0a, user_id=3410b38ddeaf4d83ae78d94fba3a424e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:32.947435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7cbe3-3cb3-48e5-9f39-e525fe44a5c7 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:32.947976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7cbe3-3cb3-48e5-9f39-e525fe44a5c7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:32.948455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbae32-f1ef-4559-a83a-762c70c51e86 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:32.948644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7cbe3-3cb3-48e5-9f39-e525fe44a5c7 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:32.950824 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 63/117] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:32.964212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa431580-0d2a-47ea-9bd0-31292facfcaf None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:32.964851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa431580-0d2a-47ea-9bd0-31292facfcaf None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:32.965382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa431580-0d2a-47ea-9bd0-31292facfcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:32.967133 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 55/118] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:31:32 2021] PUT /identity/v3/projects/64298b5848d848fdafaf45401789cb0a/users/3410b38ddeaf4d83ae78d94fba3a424e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:31:32.997021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fa431580-0d2a-47ea-9bd0-31292facfcaf None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:32.998781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fa431580-0d2a-47ea-9bd0-31292facfcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:33.076204 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 64/119] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Dec 18 20:31:33.111306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbae32-f1ef-4559-a83a-762c70c51e86 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:33.122220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbae32-f1ef-4559-a83a-762c70c51e86 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:33.130143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2fdd3-8616-4dbe-96c5-8fe8c21030f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:33.131342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2fdd3-8616-4dbe-96c5-8fe8c21030f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:33.131934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2fdd3-8616-4dbe-96c5-8fe8c21030f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:33.132446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2fdd3-8616-4dbe-96c5-8fe8c21030f9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:33.144409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2fdd3-8616-4dbe-96c5-8fe8c21030f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:33.155660 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-a0e2fdd3-8616-4dbe-96c5-8fe8c21030f9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:31:33.157253 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 56/120] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:33.163811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa431580-0d2a-47ea-9bd0-31292facfcaf None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:33.174658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa431580-0d2a-47ea-9bd0-31292facfcaf None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:33.179518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de075924-f945-4ee3-92c1-a8bddef6ba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:33.180477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de075924-f945-4ee3-92c1-a8bddef6ba99 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:33.181023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de075924-f945-4ee3-92c1-a8bddef6ba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:33.181541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de075924-f945-4ee3-92c1-a8bddef6ba99 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:33.182615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de075924-f945-4ee3-92c1-a8bddef6ba99 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:33.183128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de075924-f945-4ee3-92c1-a8bddef6ba99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:33.184944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de075924-f945-4ee3-92c1-a8bddef6ba99 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:33.198770 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 65/121] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:33.205040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2fdd3-8616-4dbe-96c5-8fe8c21030f9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:33.216922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2fdd3-8616-4dbe-96c5-8fe8c21030f9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:33.226686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acef57-3931-4713-954f-597228a5ab9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:33.228021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acef57-3931-4713-954f-597228a5ab9b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:33.228553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acef57-3931-4713-954f-597228a5ab9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:33.229078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acef57-3931-4713-954f-597228a5ab9b admin admin] PATH_INFO: `/v3/users/7fd711c1d320431090ade6e28fd8b914` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:33.230717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acef57-3931-4713-954f-597228a5ab9b admin admin] RBAC: Authorizing `identity:get_user(user_id=7fd711c1d320431090ade6e28fd8b914)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:33.234152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acef57-3931-4713-954f-597228a5ab9b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:33.237602 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 57/122] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:33 2021] GET /identity/v3/users/7fd711c1d320431090ade6e28fd8b914 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:33.243726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de075924-f945-4ee3-92c1-a8bddef6ba99 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:33.256382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de075924-f945-4ee3-92c1-a8bddef6ba99 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:33.261449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ea3c2-4516-4427-aff8-afc925cf7b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:33.262639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ea3c2-4516-4427-aff8-afc925cf7b13 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:33.263159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ea3c2-4516-4427-aff8-afc925cf7b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:33.263697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ea3c2-4516-4427-aff8-afc925cf7b13 admin admin] PATH_INFO: `/v3/projects/faaa8b17dafb49dfacff20361e811613` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:33.265202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ea3c2-4516-4427-aff8-afc925cf7b13 admin admin] RBAC: Authorizing `identity:get_project(project_id=faaa8b17dafb49dfacff20361e811613)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:33.267750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ea3c2-4516-4427-aff8-afc925cf7b13 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:33.269708 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 66/123] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:33 2021] GET /identity/v3/projects/faaa8b17dafb49dfacff20361e811613 => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:33.276050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acef57-3931-4713-954f-597228a5ab9b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:33.287594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acef57-3931-4713-954f-597228a5ab9b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:33.292953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37651a15-2682-4dcb-9b58-297cdfadd1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:33.294270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37651a15-2682-4dcb-9b58-297cdfadd1fb admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:33.294776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37651a15-2682-4dcb-9b58-297cdfadd1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:33.295282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37651a15-2682-4dcb-9b58-297cdfadd1fb admin admin] PATH_INFO: `/v3/projects/faaa8b17dafb49dfacff20361e811613/users/7fd711c1d320431090ade6e28fd8b914/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:33.298442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37651a15-2682-4dcb-9b58-297cdfadd1fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=faaa8b17dafb49dfacff20361e811613, user_id=7fd711c1d320431090ade6e28fd8b914, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:33.301542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37651a15-2682-4dcb-9b58-297cdfadd1fb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:33.320265 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 58/124] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:31:33 2021] PUT /identity/v3/projects/faaa8b17dafb49dfacff20361e811613/users/7fd711c1d320431090ade6e28fd8b914/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:31:33.538344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37b949-fa9c-48c2-8357-7efa9a3b0222 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:33.539013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37b949-fa9c-48c2-8357-7efa9a3b0222 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:33.539511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37b949-fa9c-48c2-8357-7efa9a3b0222 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:33.541886 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 67/125] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:33.547732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e57c8-b75c-423b-9046-1d2ae0e9d8c2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:33.548024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e57c8-b75c-423b-9046-1d2ae0e9d8c2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:33.548311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e57c8-b75c-423b-9046-1d2ae0e9d8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:33.575318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a97e57c8-b75c-423b-9046-1d2ae0e9d8c2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:33.576487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2f27-4e8c-4221-95af-e5729cd4a1b7 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:33.576672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a97e57c8-b75c-423b-9046-1d2ae0e9d8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:33.577173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2f27-4e8c-4221-95af-e5729cd4a1b7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:33.577789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2f27-4e8c-4221-95af-e5729cd4a1b7 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:33.580192 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 68/126] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:33.597317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df58e0-b88c-4e21-8328-e3352bf027ac None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:33.597956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df58e0-b88c-4e21-8328-e3352bf027ac None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:33.598495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df58e0-b88c-4e21-8328-e3352bf027ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:33.635036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b8df58e0-b88c-4e21-8328-e3352bf027ac None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:33.638304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b8df58e0-b88c-4e21-8328-e3352bf027ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:33.689249 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 59/127] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:33.731369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e57c8-b75c-423b-9046-1d2ae0e9d8c2 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:33.744993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e57c8-b75c-423b-9046-1d2ae0e9d8c2 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:33.755920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076c09f-4ecb-4b68-b902-3eb9f7231e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:33.757730 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 69/128] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:33.758554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076c09f-4ecb-4b68-b902-3eb9f7231e8d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:33.759089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076c09f-4ecb-4b68-b902-3eb9f7231e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:33.759589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076c09f-4ecb-4b68-b902-3eb9f7231e8d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:33.771231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076c09f-4ecb-4b68-b902-3eb9f7231e8d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:33.778540 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-e076c09f-4ecb-4b68-b902-3eb9f7231e8d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 18 20:31:33.780476 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 60/129] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:33 2021] GET /identity/v3/roles/reader => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:31:33.786861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df58e0-b88c-4e21-8328-e3352bf027ac None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:33.797053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df58e0-b88c-4e21-8328-e3352bf027ac None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:33.799452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076c09f-4ecb-4b68-b902-3eb9f7231e8d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:33.811900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1c566-2587-4e54-8505-6d8a7fe02015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:33.812893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1c566-2587-4e54-8505-6d8a7fe02015 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:33.813383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1c566-2587-4e54-8505-6d8a7fe02015 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:33.813896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1c566-2587-4e54-8505-6d8a7fe02015 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:33.816917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1c566-2587-4e54-8505-6d8a7fe02015 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:33.817450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1c566-2587-4e54-8505-6d8a7fe02015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:33.819186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076c09f-4ecb-4b68-b902-3eb9f7231e8d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:33.820801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1c566-2587-4e54-8505-6d8a7fe02015 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:33.829546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea690d6-541e-4cae-a741-9ac58b413af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:33.831607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea690d6-541e-4cae-a741-9ac58b413af4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:33.832097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea690d6-541e-4cae-a741-9ac58b413af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:33.832607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea690d6-541e-4cae-a741-9ac58b413af4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:33.836079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea690d6-541e-4cae-a741-9ac58b413af4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:33.839136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea690d6-541e-4cae-a741-9ac58b413af4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:33.839136 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 61/130] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:31:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:33.842016 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 70/131] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:33 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:33.849822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea690d6-541e-4cae-a741-9ac58b413af4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:33.851066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1c566-2587-4e54-8505-6d8a7fe02015 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:33.867694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1c566-2587-4e54-8505-6d8a7fe02015 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:33.870528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea690d6-541e-4cae-a741-9ac58b413af4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:33.879051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c059180-1666-485d-9b63-7159dfd52d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:33.880354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c059180-1666-485d-9b63-7159dfd52d96 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:33.880901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c059180-1666-485d-9b63-7159dfd52d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:33.881518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c059180-1666-485d-9b63-7159dfd52d96 admin admin] PATH_INFO: `/v3/users/cfc20bd3cd214e1b91efc83b3e9ced46` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:33.887015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82483729-c5e7-454b-9e82-c180fa486243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:33.887685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82483729-c5e7-454b-9e82-c180fa486243 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:33.887972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82483729-c5e7-454b-9e82-c180fa486243 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:33.888253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82483729-c5e7-454b-9e82-c180fa486243 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:33.888991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82483729-c5e7-454b-9e82-c180fa486243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:33.891347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82483729-c5e7-454b-9e82-c180fa486243 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:33.905312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c059180-1666-485d-9b63-7159dfd52d96 admin admin] RBAC: Authorizing `identity:get_user(user_id=cfc20bd3cd214e1b91efc83b3e9ced46)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:33.908215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c059180-1666-485d-9b63-7159dfd52d96 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:33.910285 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 71/132] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:33 2021] GET /identity/v3/users/cfc20bd3cd214e1b91efc83b3e9ced46 => generated 289 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:33.917943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c059180-1666-485d-9b63-7159dfd52d96 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:33.932783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c059180-1666-485d-9b63-7159dfd52d96 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:33.940170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03547c20-f350-49f6-9d23-298838d80178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:33.941149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03547c20-f350-49f6-9d23-298838d80178 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:33.941663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03547c20-f350-49f6-9d23-298838d80178 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:33.942212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03547c20-f350-49f6-9d23-298838d80178 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:33.952757 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 62/133] 10.222.0.13 () {60 vars in 1162 bytes} [Sat Dec 18 20:31:33 2021] POST /identity/v3/projects => generated 302 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:31:33.957195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03547c20-f350-49f6-9d23-298838d80178 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:33.959532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03547c20-f350-49f6-9d23-298838d80178 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:33.973325 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 72/134] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 20:31:33.979678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82483729-c5e7-454b-9e82-c180fa486243 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:34.053602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82483729-c5e7-454b-9e82-c180fa486243 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:34.058177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ce5de-f7ab-4e66-bc51-4fad3390a4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:34.059074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce5de-f7ab-4e66-bc51-4fad3390a4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:34.059361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce5de-f7ab-4e66-bc51-4fad3390a4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:34.059640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce5de-f7ab-4e66-bc51-4fad3390a4c1 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:34.060838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ce5de-f7ab-4e66-bc51-4fad3390a4c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:34.063382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ce5de-f7ab-4e66-bc51-4fad3390a4c1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:34.065218 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 63/135] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:33 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:34.071804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03547c20-f350-49f6-9d23-298838d80178 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:34.081632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03547c20-f350-49f6-9d23-298838d80178 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:34.092180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fafc2-aadc-41d0-91b3-c1e48a854122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:34.092970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fafc2-aadc-41d0-91b3-c1e48a854122 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:34.093266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fafc2-aadc-41d0-91b3-c1e48a854122 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:34.093544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fafc2-aadc-41d0-91b3-c1e48a854122 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:34.094433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fafc2-aadc-41d0-91b3-c1e48a854122 admin admin] RBAC: Adding query filter params (role.id=495c6a4a0775416b980691a2de0b403c, scope.project.id=64298b5848d848fdafaf45401789cb0a, user.id=cfc20bd3cd214e1b91efc83b3e9ced46) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:34.094751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fafc2-aadc-41d0-91b3-c1e48a854122 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:34.096634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fafc2-aadc-41d0-91b3-c1e48a854122 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:34.103064 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 73/136] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:34 2021] GET /identity/v3/role_assignments?user.id=cfc20bd3cd214e1b91efc83b3e9ced46&scope.project.id=64298b5848d848fdafaf45401789cb0a&role.id=495c6a4a0775416b980691a2de0b403c => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:35.716725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b843e08-9f5d-42a5-be3b-d6a83fd9dfc0 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:35.717226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b843e08-9f5d-42a5-be3b-d6a83fd9dfc0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:35.717420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b843e08-9f5d-42a5-be3b-d6a83fd9dfc0 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:35.719214 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 64/137] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:35.725500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bd7d7-f13b-4188-8ec0-b76955a86051 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:35.725975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bd7d7-f13b-4188-8ec0-b76955a86051 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:35.726203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bd7d7-f13b-4188-8ec0-b76955a86051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:35.753788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-657bd7d7-f13b-4188-8ec0-b76955a86051 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:35.755134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-657bd7d7-f13b-4188-8ec0-b76955a86051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:35.765882 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 74/138] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:35.815331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b843e08-9f5d-42a5-be3b-d6a83fd9dfc0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:35.828623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b843e08-9f5d-42a5-be3b-d6a83fd9dfc0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:35.837259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19101e44-cc04-4ce6-beb7-20d97cf2485e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:35.838049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19101e44-cc04-4ce6-beb7-20d97cf2485e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:35.838356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19101e44-cc04-4ce6-beb7-20d97cf2485e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:35.838640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19101e44-cc04-4ce6-beb7-20d97cf2485e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:35.850481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19101e44-cc04-4ce6-beb7-20d97cf2485e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:35.857211 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-19101e44-cc04-4ce6-beb7-20d97cf2485e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:31:35.858660 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 65/139] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:35 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:35.864932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bd7d7-f13b-4188-8ec0-b76955a86051 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:35.874654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bd7d7-f13b-4188-8ec0-b76955a86051 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:35.879258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461db17-e67e-456d-a529-6275432bc0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:35.879999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461db17-e67e-456d-a529-6275432bc0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:35.880359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461db17-e67e-456d-a529-6275432bc0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:35.880708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461db17-e67e-456d-a529-6275432bc0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:35.881580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461db17-e67e-456d-a529-6275432bc0b5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:35.881961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461db17-e67e-456d-a529-6275432bc0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:35.883670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461db17-e67e-456d-a529-6275432bc0b5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:35.893519 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 75/140] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:35 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:35.899333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19101e44-cc04-4ce6-beb7-20d97cf2485e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:35.910102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19101e44-cc04-4ce6-beb7-20d97cf2485e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:35.918736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8245d7c-b41b-4e85-8cc0-18b1013fc987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:35.919689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8245d7c-b41b-4e85-8cc0-18b1013fc987 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:35.920046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8245d7c-b41b-4e85-8cc0-18b1013fc987 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:35.920504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8245d7c-b41b-4e85-8cc0-18b1013fc987 admin admin] PATH_INFO: `/v3/users/7fd711c1d320431090ade6e28fd8b914` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:35.921820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8245d7c-b41b-4e85-8cc0-18b1013fc987 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fd711c1d320431090ade6e28fd8b914)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:35.924071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8245d7c-b41b-4e85-8cc0-18b1013fc987 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:35.925972 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 66/141] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:35 2021] GET /identity/v3/users/7fd711c1d320431090ade6e28fd8b914 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:35.932029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461db17-e67e-456d-a529-6275432bc0b5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:35.942891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461db17-e67e-456d-a529-6275432bc0b5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:35.947802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976cb51-909d-485e-8b47-09031712a061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:35.948681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976cb51-909d-485e-8b47-09031712a061 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:35.949067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976cb51-909d-485e-8b47-09031712a061 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:35.949626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976cb51-909d-485e-8b47-09031712a061 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:35.958173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976cb51-909d-485e-8b47-09031712a061 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:35.960066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976cb51-909d-485e-8b47-09031712a061 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:35.970031 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 76/142] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:35.976043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8245d7c-b41b-4e85-8cc0-18b1013fc987 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:35.986736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8245d7c-b41b-4e85-8cc0-18b1013fc987 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:35.991482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8aac5-2f87-4f4b-ad79-ce6fe6615e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:35.992335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8aac5-2f87-4f4b-ad79-ce6fe6615e90 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:35.992620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8aac5-2f87-4f4b-ad79-ce6fe6615e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:35.992897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8aac5-2f87-4f4b-ad79-ce6fe6615e90 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:35.994100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8aac5-2f87-4f4b-ad79-ce6fe6615e90 admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:35.996176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8aac5-2f87-4f4b-ad79-ce6fe6615e90 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:35.998125 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 67/143] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:35 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:36.004525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976cb51-909d-485e-8b47-09031712a061 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:36.013517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976cb51-909d-485e-8b47-09031712a061 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:36.018059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82df14d-6f68-47c5-90c4-ee15ed54cdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:36.018751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82df14d-6f68-47c5-90c4-ee15ed54cdee admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:36.019048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82df14d-6f68-47c5-90c4-ee15ed54cdee admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:36.019334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82df14d-6f68-47c5-90c4-ee15ed54cdee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:36.020184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82df14d-6f68-47c5-90c4-ee15ed54cdee admin admin] RBAC: Adding query filter params (role.id=d9c784a85e0540d0abdfedac9386a842, scope.project.id=64298b5848d848fdafaf45401789cb0a, user.id=7fd711c1d320431090ade6e28fd8b914) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:36.020570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82df14d-6f68-47c5-90c4-ee15ed54cdee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:36.022454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82df14d-6f68-47c5-90c4-ee15ed54cdee admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:36.028469 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 77/144] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:36 2021] GET /identity/v3/role_assignments?user.id=7fd711c1d320431090ade6e28fd8b914&scope.project.id=64298b5848d848fdafaf45401789cb0a&role.id=d9c784a85e0540d0abdfedac9386a842 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:36.274962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2331f-a957-481e-b1ff-755356f6c165 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:36.275380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2331f-a957-481e-b1ff-755356f6c165 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:36.275774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2331f-a957-481e-b1ff-755356f6c165 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:36.277765 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 68/145] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:36.291132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e132dcd-612c-41c8-b714-6c476158f732 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:36.291394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e132dcd-612c-41c8-b714-6c476158f732 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:36.291683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e132dcd-612c-41c8-b714-6c476158f732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:36.315963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9e132dcd-612c-41c8-b714-6c476158f732 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:36.317208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9e132dcd-612c-41c8-b714-6c476158f732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:36.333515 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 78/146] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:36.365596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2331f-a957-481e-b1ff-755356f6c165 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:36.383800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2331f-a957-481e-b1ff-755356f6c165 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:36.393440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a44457-be08-4095-97a3-d4ac7dd23fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:36.394433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a44457-be08-4095-97a3-d4ac7dd23fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:36.394822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a44457-be08-4095-97a3-d4ac7dd23fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:36.395245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a44457-be08-4095-97a3-d4ac7dd23fb3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:36.414674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a44457-be08-4095-97a3-d4ac7dd23fb3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:36.421977 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-72a44457-be08-4095-97a3-d4ac7dd23fb3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 18 20:31:36.423345 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 69/147] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:31:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:36.429727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e132dcd-612c-41c8-b714-6c476158f732 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:36.442333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e132dcd-612c-41c8-b714-6c476158f732 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:36.449157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd708d4c-7725-4f99-bba8-aa8a90f157d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:36.449998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd708d4c-7725-4f99-bba8-aa8a90f157d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:36.450452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd708d4c-7725-4f99-bba8-aa8a90f157d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:36.451060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd708d4c-7725-4f99-bba8-aa8a90f157d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:36.452618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd708d4c-7725-4f99-bba8-aa8a90f157d0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:36.453138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd708d4c-7725-4f99-bba8-aa8a90f157d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:36.455303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd708d4c-7725-4f99-bba8-aa8a90f157d0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:36.468544 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 79/148] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:31:36 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:36.474421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a44457-be08-4095-97a3-d4ac7dd23fb3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:36.487348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a44457-be08-4095-97a3-d4ac7dd23fb3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:36.497796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0f698-1c63-41c6-a274-e65fd0600d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:36.498870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0f698-1c63-41c6-a274-e65fd0600d78 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:36.499275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0f698-1c63-41c6-a274-e65fd0600d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:36.499640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0f698-1c63-41c6-a274-e65fd0600d78 admin admin] PATH_INFO: `/v3/users/7fd711c1d320431090ade6e28fd8b914` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:36.505384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0f698-1c63-41c6-a274-e65fd0600d78 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fd711c1d320431090ade6e28fd8b914)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:36.507684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0f698-1c63-41c6-a274-e65fd0600d78 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:36.509449 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 70/149] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:36 2021] GET /identity/v3/users/7fd711c1d320431090ade6e28fd8b914 => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:36.516364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd708d4c-7725-4f99-bba8-aa8a90f157d0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:36.528127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd708d4c-7725-4f99-bba8-aa8a90f157d0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:36.535428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10133ac6-5559-4df8-a7b0-a2f9c469dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:36.536246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10133ac6-5559-4df8-a7b0-a2f9c469dfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:36.536725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10133ac6-5559-4df8-a7b0-a2f9c469dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:36.537150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10133ac6-5559-4df8-a7b0-a2f9c469dfa9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:36.550366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10133ac6-5559-4df8-a7b0-a2f9c469dfa9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:36.552655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10133ac6-5559-4df8-a7b0-a2f9c469dfa9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:36.564659 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 80/150] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:36 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:36.571172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0f698-1c63-41c6-a274-e65fd0600d78 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:36.588758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0f698-1c63-41c6-a274-e65fd0600d78 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:36.594938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f748f0-b4d7-46da-a776-c16a97ac5b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:36.596043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f748f0-b4d7-46da-a776-c16a97ac5b7b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:36.596330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f748f0-b4d7-46da-a776-c16a97ac5b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:36.596606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f748f0-b4d7-46da-a776-c16a97ac5b7b admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:36.598968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f748f0-b4d7-46da-a776-c16a97ac5b7b admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:36.601008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f748f0-b4d7-46da-a776-c16a97ac5b7b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:36.602878 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 71/151] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:36 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:36.609199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10133ac6-5559-4df8-a7b0-a2f9c469dfa9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:36.621704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10133ac6-5559-4df8-a7b0-a2f9c469dfa9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:36.629417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b4452-19aa-43eb-9d82-87f189b13886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:36.630403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4452-19aa-43eb-9d82-87f189b13886 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:36.630905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4452-19aa-43eb-9d82-87f189b13886 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:36.631332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4452-19aa-43eb-9d82-87f189b13886 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:36.632426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b4452-19aa-43eb-9d82-87f189b13886 admin admin] RBAC: Adding query filter params (role.id=04189c3120df49f6b37322459b571cf1, scope.project.id=64298b5848d848fdafaf45401789cb0a, user.id=7fd711c1d320431090ade6e28fd8b914) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:36.632931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b4452-19aa-43eb-9d82-87f189b13886 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:36.635207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b4452-19aa-43eb-9d82-87f189b13886 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:36.647650 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 81/152] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:36 2021] GET /identity/v3/role_assignments?user.id=7fd711c1d320431090ade6e28fd8b914&scope.project.id=64298b5848d848fdafaf45401789cb0a&role.id=04189c3120df49f6b37322459b571cf1 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:36.737066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b646-1791-4d2d-b6b6-ce1af8ac60a1 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:36.737570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b646-1791-4d2d-b6b6-ce1af8ac60a1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:36.737679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b646-1791-4d2d-b6b6-ce1af8ac60a1 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:36.739448 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 72/153] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:36.749036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c90b0a-942f-4709-bc0e-9947b43a5251 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:36.749901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c90b0a-942f-4709-bc0e-9947b43a5251 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:36.750364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c90b0a-942f-4709-bc0e-9947b43a5251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:36.775576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-33c90b0a-942f-4709-bc0e-9947b43a5251 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:36.777111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-33c90b0a-942f-4709-bc0e-9947b43a5251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:36.790944 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 82/154] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:36.828095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3b646-1791-4d2d-b6b6-ce1af8ac60a1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:36.847167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3b646-1791-4d2d-b6b6-ce1af8ac60a1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:36.852139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6640f-f2c3-4b2c-8cd2-6326ba3d2402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:36.852931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6640f-f2c3-4b2c-8cd2-6326ba3d2402 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:36.853262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6640f-f2c3-4b2c-8cd2-6326ba3d2402 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:36.853585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6640f-f2c3-4b2c-8cd2-6326ba3d2402 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:36.869061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6640f-f2c3-4b2c-8cd2-6326ba3d2402 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:36.869827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb8f1f-634c-405a-a813-ea5e5ce07b03 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:36.870290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb8f1f-634c-405a-a813-ea5e5ce07b03 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:36.870712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb8f1f-634c-405a-a813-ea5e5ce07b03 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:36.872804 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 83/155] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:31:36.876072 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-1dc6640f-f2c3-4b2c-8cd2-6326ba3d2402 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:31:36.877284 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 73/156] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:31:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:36.883535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb8f1f-634c-405a-a813-ea5e5ce07b03 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:36.886797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373f46d-745f-480c-9ba4-d99d5ea3198a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:36.887091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373f46d-745f-480c-9ba4-d99d5ea3198a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:36.887375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373f46d-745f-480c-9ba4-d99d5ea3198a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:36.912708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb8f1f-634c-405a-a813-ea5e5ce07b03 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:36.921943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0adc5-8cd5-43ec-8659-40581ecfb093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:36.922652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0adc5-8cd5-43ec-8659-40581ecfb093 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:36.922984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0adc5-8cd5-43ec-8659-40581ecfb093 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:36.923264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0adc5-8cd5-43ec-8659-40581ecfb093 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:36.924115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0373f46d-745f-480c-9ba4-d99d5ea3198a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:36.925489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0adc5-8cd5-43ec-8659-40581ecfb093 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:36.925805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0adc5-8cd5-43ec-8659-40581ecfb093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:36.927183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0373f46d-745f-480c-9ba4-d99d5ea3198a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:36.928976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0adc5-8cd5-43ec-8659-40581ecfb093 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:36.947145 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 74/157] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:36.947944 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 84/158] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:36.953732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373f46d-745f-480c-9ba4-d99d5ea3198a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:36.968482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373f46d-745f-480c-9ba4-d99d5ea3198a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:36.976377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0adc5-8cd5-43ec-8659-40581ecfb093 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:36.979491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56aa95-1516-49ba-a356-643cbe79e09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:36.980627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56aa95-1516-49ba-a356-643cbe79e09c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:36.981054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56aa95-1516-49ba-a356-643cbe79e09c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:36.981478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56aa95-1516-49ba-a356-643cbe79e09c admin admin] PATH_INFO: `/v3/users/3410b38ddeaf4d83ae78d94fba3a424e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:36.984151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56aa95-1516-49ba-a356-643cbe79e09c admin admin] RBAC: Authorizing `identity:get_user(user_id=3410b38ddeaf4d83ae78d94fba3a424e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:36.986135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56aa95-1516-49ba-a356-643cbe79e09c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:36.986572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0adc5-8cd5-43ec-8659-40581ecfb093 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:36.988069 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 75/159] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:36 2021] GET /identity/v3/users/3410b38ddeaf4d83ae78d94fba3a424e => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:36.994423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56aa95-1516-49ba-a356-643cbe79e09c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:36.995008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca7e58-8c58-41a3-8a27-48e50c9baa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:36.998280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7e58-8c58-41a3-8a27-48e50c9baa1d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:36.998280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7e58-8c58-41a3-8a27-48e50c9baa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:36.998280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7e58-8c58-41a3-8a27-48e50c9baa1d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:37.007208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56aa95-1516-49ba-a356-643cbe79e09c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:37.011949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9892c2c-e21f-4d29-a4f5-fa14b2d24f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:37.012760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9892c2c-e21f-4d29-a4f5-fa14b2d24f8c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:37.013139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9892c2c-e21f-4d29-a4f5-fa14b2d24f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:37.013558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9892c2c-e21f-4d29-a4f5-fa14b2d24f8c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:37.017844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca7e58-8c58-41a3-8a27-48e50c9baa1d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:37.023367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9892c2c-e21f-4d29-a4f5-fa14b2d24f8c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:37.025339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9892c2c-e21f-4d29-a4f5-fa14b2d24f8c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:37.026118 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-98ca7e58-8c58-41a3-8a27-48e50c9baa1d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:31:37.028047 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 85/160] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:31:37.034919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca7e58-8c58-41a3-8a27-48e50c9baa1d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:37.041272 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 76/161] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:36 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:37.047531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9892c2c-e21f-4d29-a4f5-fa14b2d24f8c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:37.048133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca7e58-8c58-41a3-8a27-48e50c9baa1d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:37.053369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e33ef-ebf4-4f90-b9df-1b21df51c62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:37.054140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e33ef-ebf4-4f90-b9df-1b21df51c62c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:37.054713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e33ef-ebf4-4f90-b9df-1b21df51c62c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:37.055345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e33ef-ebf4-4f90-b9df-1b21df51c62c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:37.057942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e33ef-ebf4-4f90-b9df-1b21df51c62c admin admin] RBAC: Adding query filter params (name=member) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:37.057942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e33ef-ebf4-4f90-b9df-1b21df51c62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:37.058543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9892c2c-e21f-4d29-a4f5-fa14b2d24f8c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:37.060037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e33ef-ebf4-4f90-b9df-1b21df51c62c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:37.063879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d667848-8df6-47f2-bf74-98745551a0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:37.064782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d667848-8df6-47f2-bf74-98745551a0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:37.065067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d667848-8df6-47f2-bf74-98745551a0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:37.066227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d667848-8df6-47f2-bf74-98745551a0a1 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:37.067489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d667848-8df6-47f2-bf74-98745551a0a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:37.070515 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 86/162] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:37.070627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d667848-8df6-47f2-bf74-98745551a0a1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:37.072441 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 77/163] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:37 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:37.076885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e33ef-ebf4-4f90-b9df-1b21df51c62c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:37.078921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d667848-8df6-47f2-bf74-98745551a0a1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:37.087892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e33ef-ebf4-4f90-b9df-1b21df51c62c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:37.089256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d667848-8df6-47f2-bf74-98745551a0a1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:37.093422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03989465-ba1d-4ae2-b91e-da2588ab7705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:37.094451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03989465-ba1d-4ae2-b91e-da2588ab7705 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:37.094848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03989465-ba1d-4ae2-b91e-da2588ab7705 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:37.095252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03989465-ba1d-4ae2-b91e-da2588ab7705 admin admin] PATH_INFO: `/v3/users/7fd711c1d320431090ade6e28fd8b914` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:37.096151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a08226-2c7c-4a04-941b-2db625c00852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:37.096686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03989465-ba1d-4ae2-b91e-da2588ab7705 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fd711c1d320431090ade6e28fd8b914)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:37.096826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a08226-2c7c-4a04-941b-2db625c00852 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:37.097109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a08226-2c7c-4a04-941b-2db625c00852 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:37.097385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a08226-2c7c-4a04-941b-2db625c00852 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:37.098289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a08226-2c7c-4a04-941b-2db625c00852 admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=64298b5848d848fdafaf45401789cb0a, user.id=3410b38ddeaf4d83ae78d94fba3a424e) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:37.098695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a08226-2c7c-4a04-941b-2db625c00852 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:37.099470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03989465-ba1d-4ae2-b91e-da2588ab7705 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:37.100655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a08226-2c7c-4a04-941b-2db625c00852 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:37.101441 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 87/164] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:37 2021] GET /identity/v3/users/7fd711c1d320431090ade6e28fd8b914 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:37.108537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03989465-ba1d-4ae2-b91e-da2588ab7705 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:37.111471 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 78/165] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:37 2021] GET /identity/v3/role_assignments?user.id=3410b38ddeaf4d83ae78d94fba3a424e&scope.project.id=64298b5848d848fdafaf45401789cb0a&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:37.119051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03989465-ba1d-4ae2-b91e-da2588ab7705 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:37.137346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2cf30-96cb-4600-9383-0bc3c6d3d22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:37.138235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2cf30-96cb-4600-9383-0bc3c6d3d22c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:37.138693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2cf30-96cb-4600-9383-0bc3c6d3d22c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:37.139127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2cf30-96cb-4600-9383-0bc3c6d3d22c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:37.149035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2cf30-96cb-4600-9383-0bc3c6d3d22c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:37.151187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2cf30-96cb-4600-9383-0bc3c6d3d22c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:37.162058 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 88/166] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:37 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 20:31:37.168469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a08226-2c7c-4a04-941b-2db625c00852 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:37.187542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a08226-2c7c-4a04-941b-2db625c00852 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:37.192996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97824d-ef65-4d26-bf97-274a992c740f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:37.193866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97824d-ef65-4d26-bf97-274a992c740f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:37.194144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97824d-ef65-4d26-bf97-274a992c740f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:37.194452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97824d-ef65-4d26-bf97-274a992c740f admin admin] PATH_INFO: `/v3/projects/faaa8b17dafb49dfacff20361e811613` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:37.195675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97824d-ef65-4d26-bf97-274a992c740f admin admin] RBAC: Authorizing `identity:get_project(project_id=faaa8b17dafb49dfacff20361e811613)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:37.197746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97824d-ef65-4d26-bf97-274a992c740f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:37.199518 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 79/167] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:37 2021] GET /identity/v3/projects/faaa8b17dafb49dfacff20361e811613 => generated 312 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:37.206354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2cf30-96cb-4600-9383-0bc3c6d3d22c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:37.215934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2cf30-96cb-4600-9383-0bc3c6d3d22c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:37.220811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15d356-bb62-4fdc-a977-80fb5cb785d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:37.221539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15d356-bb62-4fdc-a977-80fb5cb785d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:37.221824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15d356-bb62-4fdc-a977-80fb5cb785d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:37.222194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15d356-bb62-4fdc-a977-80fb5cb785d3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:37.223128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15d356-bb62-4fdc-a977-80fb5cb785d3 admin admin] RBAC: Adding query filter params (role.id=d9c784a85e0540d0abdfedac9386a842, scope.project.id=faaa8b17dafb49dfacff20361e811613, user.id=7fd711c1d320431090ade6e28fd8b914) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:37.223491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15d356-bb62-4fdc-a977-80fb5cb785d3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:37.225587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15d356-bb62-4fdc-a977-80fb5cb785d3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:37.233225 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 89/168] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:37 2021] GET /identity/v3/role_assignments?user.id=7fd711c1d320431090ade6e28fd8b914&scope.project.id=faaa8b17dafb49dfacff20361e811613&role.id=d9c784a85e0540d0abdfedac9386a842 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:37.866461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a021f8-06a7-42ab-a1da-f3c01485dd73 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:37.866963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a021f8-06a7-42ab-a1da-f3c01485dd73 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:37.867109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a021f8-06a7-42ab-a1da-f3c01485dd73 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:37.868772 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 80/169] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:37.875082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95070-d04a-4d0b-9cdd-29147f9dab78 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:37.875496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95070-d04a-4d0b-9cdd-29147f9dab78 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:37.875641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95070-d04a-4d0b-9cdd-29147f9dab78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:37.893096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-74f95070-d04a-4d0b-9cdd-29147f9dab78 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:37.894275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-74f95070-d04a-4d0b-9cdd-29147f9dab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:37.901625 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 90/170] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:37.926144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a021f8-06a7-42ab-a1da-f3c01485dd73 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:37.938234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a021f8-06a7-42ab-a1da-f3c01485dd73 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:37.942448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84e0c5-d794-4bf4-a88f-50c317c84c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:37.943232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84e0c5-d794-4bf4-a88f-50c317c84c70 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:37.943512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84e0c5-d794-4bf4-a88f-50c317c84c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:37.943785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84e0c5-d794-4bf4-a88f-50c317c84c70 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:37.955028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84e0c5-d794-4bf4-a88f-50c317c84c70 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:37.962861 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-6f84e0c5-d794-4bf4-a88f-50c317c84c70 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 18 20:31:37.964827 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 81/171] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:37 2021] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:37.966065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbbf54-55c3-4323-98b2-c48d69eccb74 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:37.966383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbbf54-55c3-4323-98b2-c48d69eccb74 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:37.966663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbbf54-55c3-4323-98b2-c48d69eccb74 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:37.969093 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 91/172] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:31:37.972278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84e0c5-d794-4bf4-a88f-50c317c84c70 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:37.974685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac08ea5-dda6-4acb-9e1b-e24267953d64 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:37.974968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac08ea5-dda6-4acb-9e1b-e24267953d64 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:37.975242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac08ea5-dda6-4acb-9e1b-e24267953d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:37.982480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84e0c5-d794-4bf4-a88f-50c317c84c70 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:37.986697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aeed5b-1b45-4dda-bc30-5f7585207dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:37.987333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aeed5b-1b45-4dda-bc30-5f7585207dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:37.987614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aeed5b-1b45-4dda-bc30-5f7585207dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:37.987888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aeed5b-1b45-4dda-bc30-5f7585207dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:37.988631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aeed5b-1b45-4dda-bc30-5f7585207dd2 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:37.989057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aeed5b-1b45-4dda-bc30-5f7585207dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:37.990683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aeed5b-1b45-4dda-bc30-5f7585207dd2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:37.992226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-cac08ea5-dda6-4acb-9e1b-e24267953d64 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:37.993390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cac08ea5-dda6-4acb-9e1b-e24267953d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:37.998744 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 82/173] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:37 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:38.000856 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 92/174] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:38.004835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aeed5b-1b45-4dda-bc30-5f7585207dd2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:38.013781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aeed5b-1b45-4dda-bc30-5f7585207dd2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:38.018483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58531848-359c-4b4c-b4df-cac22c557f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:38.019285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58531848-359c-4b4c-b4df-cac22c557f25 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:38.019567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58531848-359c-4b4c-b4df-cac22c557f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:38.019844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58531848-359c-4b4c-b4df-cac22c557f25 admin admin] PATH_INFO: `/v3/users/cfc20bd3cd214e1b91efc83b3e9ced46` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:38.021023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58531848-359c-4b4c-b4df-cac22c557f25 admin admin] RBAC: Authorizing `identity:get_user(user_id=cfc20bd3cd214e1b91efc83b3e9ced46)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:38.023136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58531848-359c-4b4c-b4df-cac22c557f25 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:38.024644 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 83/175] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:38 2021] GET /identity/v3/users/cfc20bd3cd214e1b91efc83b3e9ced46 => generated 289 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:38.027183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac08ea5-dda6-4acb-9e1b-e24267953d64 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:38.030774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58531848-359c-4b4c-b4df-cac22c557f25 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:38.036545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac08ea5-dda6-4acb-9e1b-e24267953d64 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:38.039633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58531848-359c-4b4c-b4df-cac22c557f25 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:38.040939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd33a5-0f29-4517-9749-b169e1d76538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:38.041710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd33a5-0f29-4517-9749-b169e1d76538 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:38.042004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd33a5-0f29-4517-9749-b169e1d76538 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:38.042309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd33a5-0f29-4517-9749-b169e1d76538 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:38.043477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd33a5-0f29-4517-9749-b169e1d76538 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:38.043822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813d319-1e49-409d-abeb-e3e0879317b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:38.044596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813d319-1e49-409d-abeb-e3e0879317b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:38.044873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813d319-1e49-409d-abeb-e3e0879317b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:38.045146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813d319-1e49-409d-abeb-e3e0879317b4 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:38.045227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd33a5-0f29-4517-9749-b169e1d76538 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:38.046344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813d319-1e49-409d-abeb-e3e0879317b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:38.046775 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 93/176] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:31:38 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:38.048310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813d319-1e49-409d-abeb-e3e0879317b4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:38.054696 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 84/177] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:38 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:38.054814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd33a5-0f29-4517-9749-b169e1d76538 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:38.055912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813d319-1e49-409d-abeb-e3e0879317b4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:38.062177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd33a5-0f29-4517-9749-b169e1d76538 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:38.065785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813d319-1e49-409d-abeb-e3e0879317b4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:38.066439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bf578-3e0a-4ce9-a0ef-e62e642805a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:38.067067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bf578-3e0a-4ce9-a0ef-e62e642805a1 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:38.067413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bf578-3e0a-4ce9-a0ef-e62e642805a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:38.067639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bf578-3e0a-4ce9-a0ef-e62e642805a1 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:38.068357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9bf578-3e0a-4ce9-a0ef-e62e642805a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:38.070007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e1842-222f-4870-a612-b4eda77e3bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:38.070205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9bf578-3e0a-4ce9-a0ef-e62e642805a1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:38.070844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e1842-222f-4870-a612-b4eda77e3bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:38.071120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e1842-222f-4870-a612-b4eda77e3bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:38.071393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e1842-222f-4870-a612-b4eda77e3bfb admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a/users/cfc20bd3cd214e1b91efc83b3e9ced46/roles/495c6a4a0775416b980691a2de0b403c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:38.073285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e1842-222f-4870-a612-b4eda77e3bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=64298b5848d848fdafaf45401789cb0a, user_id=cfc20bd3cd214e1b91efc83b3e9ced46, role_id=495c6a4a0775416b980691a2de0b403c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:38.075882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e1842-222f-4870-a612-b4eda77e3bfb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:38.089343 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 85/178] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:31:38 2021] PUT /identity/v3/projects/64298b5848d848fdafaf45401789cb0a/users/cfc20bd3cd214e1b91efc83b3e9ced46/roles/495c6a4a0775416b980691a2de0b403c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:31:38.090643 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 94/179] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:31:38 2021] POST /identity/v3/users => generated 283 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:31:40.560478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a4c9f-2bab-4988-a71a-06f85d756489 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.561796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a4c9f-2bab-4988-a71a-06f85d756489 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.561907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a4c9f-2bab-4988-a71a-06f85d756489 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.563941 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 86/180] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:40.569958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198140b-2087-4256-b9f3-15298ed6d2e4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.570388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198140b-2087-4256-b9f3-15298ed6d2e4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.570747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198140b-2087-4256-b9f3-15298ed6d2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.588754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d198140b-2087-4256-b9f3-15298ed6d2e4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:40.589970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d198140b-2087-4256-b9f3-15298ed6d2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:40.636826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be39e1-1a4e-42bf-a413-b9502d4ceb48 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.637121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be39e1-1a4e-42bf-a413-b9502d4ceb48 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.637398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be39e1-1a4e-42bf-a413-b9502d4ceb48 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.639735 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 87/181] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:31:40.645154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f4aab-f3f4-4fc3-96ba-2b46d8c79d8c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.645445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f4aab-f3f4-4fc3-96ba-2b46d8c79d8c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.645730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f4aab-f3f4-4fc3-96ba-2b46d8c79d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.649266 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 95/182] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:40.663359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d90f4aab-f3f4-4fc3-96ba-2b46d8c79d8c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:40.664548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d90f4aab-f3f4-4fc3-96ba-2b46d8c79d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:40.672909 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 88/183] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:40.675638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198140b-2087-4256-b9f3-15298ed6d2e4 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:40.684622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198140b-2087-4256-b9f3-15298ed6d2e4 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:40.689875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900450c-4949-4d61-8863-7728e541a97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:40.690689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900450c-4949-4d61-8863-7728e541a97e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.690969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900450c-4949-4d61-8863-7728e541a97e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.691240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900450c-4949-4d61-8863-7728e541a97e admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.698896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f4aab-f3f4-4fc3-96ba-2b46d8c79d8c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:40.702218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900450c-4949-4d61-8863-7728e541a97e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:40.707827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f4aab-f3f4-4fc3-96ba-2b46d8c79d8c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:40.709149 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-e900450c-4949-4d61-8863-7728e541a97e admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 18 20:31:40.710637 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 96/184] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:40 2021] GET /identity/v3/roles/reader => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:40.716755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900450c-4949-4d61-8863-7728e541a97e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:40.717812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407458b6-b3f6-4263-89ff-97e800770532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:40.718847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407458b6-b3f6-4263-89ff-97e800770532 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.719326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407458b6-b3f6-4263-89ff-97e800770532 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.719787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407458b6-b3f6-4263-89ff-97e800770532 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.726408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900450c-4949-4d61-8863-7728e541a97e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:40.730694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb0f1b-ea36-4496-ae4b-9933bf7eaae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:40.731344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb0f1b-ea36-4496-ae4b-9933bf7eaae5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.731625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb0f1b-ea36-4496-ae4b-9933bf7eaae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.731898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb0f1b-ea36-4496-ae4b-9933bf7eaae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.732232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407458b6-b3f6-4263-89ff-97e800770532 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:40.735778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb0f1b-ea36-4496-ae4b-9933bf7eaae5 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:40.735778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb0f1b-ea36-4496-ae4b-9933bf7eaae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:40.735778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb0f1b-ea36-4496-ae4b-9933bf7eaae5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:40.742782 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-407458b6-b3f6-4263-89ff-97e800770532 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:31:40.744204 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 89/185] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:31:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:31:40.749460 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 97/186] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:40 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:40.751078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407458b6-b3f6-4263-89ff-97e800770532 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:40.752286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb0f1b-ea36-4496-ae4b-9933bf7eaae5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:40.763409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407458b6-b3f6-4263-89ff-97e800770532 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:40.765927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb0f1b-ea36-4496-ae4b-9933bf7eaae5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:40.769086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afcbec-779d-4267-beb5-6ba816d09735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:40.770316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afcbec-779d-4267-beb5-6ba816d09735 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.770421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2db0c-1a4b-4101-8e15-8c9888e70328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:40.770902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afcbec-779d-4267-beb5-6ba816d09735 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.771110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2db0c-1a4b-4101-8e15-8c9888e70328 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.771469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2db0c-1a4b-4101-8e15-8c9888e70328 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.771698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afcbec-779d-4267-beb5-6ba816d09735 admin admin] PATH_INFO: `/v3/users/cfc20bd3cd214e1b91efc83b3e9ced46` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.771836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2db0c-1a4b-4101-8e15-8c9888e70328 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.772699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2db0c-1a4b-4101-8e15-8c9888e70328 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:40.773071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2db0c-1a4b-4101-8e15-8c9888e70328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:40.773589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afcbec-779d-4267-beb5-6ba816d09735 admin admin] RBAC: Authorizing `identity:get_user(user_id=cfc20bd3cd214e1b91efc83b3e9ced46)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:40.774808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2db0c-1a4b-4101-8e15-8c9888e70328 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:40.776134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afcbec-779d-4267-beb5-6ba816d09735 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:40.777750 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 90/187] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:40 2021] GET /identity/v3/users/cfc20bd3cd214e1b91efc83b3e9ced46 => generated 289 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:40.783802 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 98/188] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:40.784173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afcbec-779d-4267-beb5-6ba816d09735 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:40.790611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2db0c-1a4b-4101-8e15-8c9888e70328 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:40.797619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afcbec-779d-4267-beb5-6ba816d09735 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:40.801158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2db0c-1a4b-4101-8e15-8c9888e70328 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:40.802627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e1fa0-3329-4121-9ab9-884862d48a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:40.803669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e1fa0-3329-4121-9ab9-884862d48a18 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.804232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e1fa0-3329-4121-9ab9-884862d48a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.804696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e1fa0-3329-4121-9ab9-884862d48a18 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.805928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a9b85-b237-4658-bdf6-57b094ca18f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:40.806833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a9b85-b237-4658-bdf6-57b094ca18f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.807122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a9b85-b237-4658-bdf6-57b094ca18f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.807403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a9b85-b237-4658-bdf6-57b094ca18f9 admin admin] PATH_INFO: `/v3/users/da0833cce9694931a7250f6858f41ba0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.815570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e1fa0-3329-4121-9ab9-884862d48a18 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:40.817714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e1fa0-3329-4121-9ab9-884862d48a18 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:40.822432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a9b85-b237-4658-bdf6-57b094ca18f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=da0833cce9694931a7250f6858f41ba0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:40.824572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a9b85-b237-4658-bdf6-57b094ca18f9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:40.826305 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 99/189] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:40 2021] GET /identity/v3/users/da0833cce9694931a7250f6858f41ba0 => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:40.828187 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 91/190] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:40 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 20:31:40.829288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b332d-6f6f-4e3e-9431-0f22f8768c39 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.829597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b332d-6f6f-4e3e-9431-0f22f8768c39 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.829869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b332d-6f6f-4e3e-9431-0f22f8768c39 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.831954 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 100/191] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:40.832834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e1fa0-3329-4121-9ab9-884862d48a18 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:40.834241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0cbce-bf60-49f3-aab3-821fbbb96327 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.834662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0cbce-bf60-49f3-aab3-821fbbb96327 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.835037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0cbce-bf60-49f3-aab3-821fbbb96327 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.836746 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 101/192] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:40.838491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0cbce-bf60-49f3-aab3-821fbbb96327 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:40.843112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e1fa0-3329-4121-9ab9-884862d48a18 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:40.847311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe14b6b-5883-40b8-84a1-39cb377db314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:40.847931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe14b6b-5883-40b8-84a1-39cb377db314 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.848208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe14b6b-5883-40b8-84a1-39cb377db314 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.848480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe14b6b-5883-40b8-84a1-39cb377db314 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.850399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0cbce-bf60-49f3-aab3-821fbbb96327 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:40.854565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf1125-0b36-4a56-b4e3-932ed09d1cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:40.855368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf1125-0b36-4a56-b4e3-932ed09d1cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.855672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf1125-0b36-4a56-b4e3-932ed09d1cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.855945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf1125-0b36-4a56-b4e3-932ed09d1cd6 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.857171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf1125-0b36-4a56-b4e3-932ed09d1cd6 admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:40.857356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe14b6b-5883-40b8-84a1-39cb377db314 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:40.859735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf1125-0b36-4a56-b4e3-932ed09d1cd6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:40.860967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe14b6b-5883-40b8-84a1-39cb377db314 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:40.861540 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 102/193] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:40 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:40.862735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a05cf8-0182-4e13-b192-55088368efdd None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.863030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a05cf8-0182-4e13-b192-55088368efdd None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.863311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a05cf8-0182-4e13-b192-55088368efdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.870014 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 92/194] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:40 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:40.871323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f901e-0ab7-4acc-9d1e-2e23e969a291 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.871608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f901e-0ab7-4acc-9d1e-2e23e969a291 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.871882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f901e-0ab7-4acc-9d1e-2e23e969a291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.886141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e6a05cf8-0182-4e13-b192-55088368efdd None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:40.887369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e6a05cf8-0182-4e13-b192-55088368efdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:40.889269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-123f901e-0ab7-4acc-9d1e-2e23e969a291 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:40.890443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-123f901e-0ab7-4acc-9d1e-2e23e969a291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:40.894857 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 103/195] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:40.896777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a05cf8-0182-4e13-b192-55088368efdd None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:40.905164 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 93/196] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:40.905164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f901e-0ab7-4acc-9d1e-2e23e969a291 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:40.907338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a05cf8-0182-4e13-b192-55088368efdd None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:40.907463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f901e-0ab7-4acc-9d1e-2e23e969a291 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:40.911501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae8869-27fc-4d9a-ab3f-ec9df552a87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:40.911617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc85db-dc7c-4c44-8591-3d31182a3a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:40.912151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc85db-dc7c-4c44-8591-3d31182a3a9c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.912337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8869-27fc-4d9a-ab3f-ec9df552a87b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.912428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc85db-dc7c-4c44-8591-3d31182a3a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.912567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8869-27fc-4d9a-ab3f-ec9df552a87b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.912716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc85db-dc7c-4c44-8591-3d31182a3a9c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.912855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8869-27fc-4d9a-ab3f-ec9df552a87b admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.913640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc85db-dc7c-4c44-8591-3d31182a3a9c admin admin] RBAC: Adding query filter params (role.id=495c6a4a0775416b980691a2de0b403c, scope.project.id=64298b5848d848fdafaf45401789cb0a, user.id=cfc20bd3cd214e1b91efc83b3e9ced46) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:40.913955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc85db-dc7c-4c44-8591-3d31182a3a9c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:40.914046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae8869-27fc-4d9a-ab3f-ec9df552a87b admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:40.915817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc85db-dc7c-4c44-8591-3d31182a3a9c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:40.916109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae8869-27fc-4d9a-ab3f-ec9df552a87b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:40.917984 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 94/197] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:40 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:40.922888 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 104/198] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:40 2021] GET /identity/v3/role_assignments?user.id=cfc20bd3cd214e1b91efc83b3e9ced46&scope.project.id=64298b5848d848fdafaf45401789cb0a&role.id=495c6a4a0775416b980691a2de0b403c => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:40.924314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc85db-dc7c-4c44-8591-3d31182a3a9c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:40.924425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae8869-27fc-4d9a-ab3f-ec9df552a87b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:40.934523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae8869-27fc-4d9a-ab3f-ec9df552a87b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:40.937314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc85db-dc7c-4c44-8591-3d31182a3a9c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:40.939980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc9f89-16d7-4c2a-8645-27042f5aa948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:40.940674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc9f89-16d7-4c2a-8645-27042f5aa948 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.940931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc9f89-16d7-4c2a-8645-27042f5aa948 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.941205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc9f89-16d7-4c2a-8645-27042f5aa948 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.941792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252417f-4011-4905-9c53-a5a021d76dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:40.942069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc9f89-16d7-4c2a-8645-27042f5aa948 admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=c0aa413232f44947b73617ef1bf8ba55, user.id=da0833cce9694931a7250f6858f41ba0) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:40.942417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc9f89-16d7-4c2a-8645-27042f5aa948 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:40.942666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252417f-4011-4905-9c53-a5a021d76dac admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.942952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252417f-4011-4905-9c53-a5a021d76dac admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.943230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252417f-4011-4905-9c53-a5a021d76dac admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.944313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc9f89-16d7-4c2a-8645-27042f5aa948 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:40.950546 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 95/199] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:40 2021] GET /identity/v3/role_assignments?user.id=da0833cce9694931a7250f6858f41ba0&scope.project.id=c0aa413232f44947b73617ef1bf8ba55&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:40.955631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252417f-4011-4905-9c53-a5a021d76dac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:40.956027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc9f89-16d7-4c2a-8645-27042f5aa948 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:40.964995 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-2252417f-4011-4905-9c53-a5a021d76dac admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 18 20:31:40.966525 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 105/200] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:31:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:40.968077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc9f89-16d7-4c2a-8645-27042f5aa948 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:40.973152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252417f-4011-4905-9c53-a5a021d76dac admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:40.973724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cb956-ff85-4af9-9e26-47136a193075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:40.975037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cb956-ff85-4af9-9e26-47136a193075 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.975529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cb956-ff85-4af9-9e26-47136a193075 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:40.975998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cb956-ff85-4af9-9e26-47136a193075 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:40.977702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cb956-ff85-4af9-9e26-47136a193075 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:40.980861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cb956-ff85-4af9-9e26-47136a193075 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:40.984036 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 96/201] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:31:40 2021] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:40.989434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252417f-4011-4905-9c53-a5a021d76dac admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:40.990898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cb956-ff85-4af9-9e26-47136a193075 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:40.997897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a48c0-285f-46d6-9316-0ead3438759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:40.999223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a48c0-285f-46d6-9316-0ead3438759d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:40.999702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a48c0-285f-46d6-9316-0ead3438759d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:41.000170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a48c0-285f-46d6-9316-0ead3438759d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:41.001233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a48c0-285f-46d6-9316-0ead3438759d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:41.001778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a48c0-285f-46d6-9316-0ead3438759d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:41.001902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cb956-ff85-4af9-9e26-47136a193075 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:41.004393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a48c0-285f-46d6-9316-0ead3438759d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:41.006794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9009a66-3e6d-44a0-84cb-ca92248ef72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:41.007490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9009a66-3e6d-44a0-84cb-ca92248ef72a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:41.007876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9009a66-3e6d-44a0-84cb-ca92248ef72a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:41.008158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9009a66-3e6d-44a0-84cb-ca92248ef72a admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:41.009037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9009a66-3e6d-44a0-84cb-ca92248ef72a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:41.010171 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-e9009a66-3e6d-44a0-84cb-ca92248ef72a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:41.010171 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:31:41.010171 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:31:41.011513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9009a66-3e6d-44a0-84cb-ca92248ef72a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:41.018224 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 106/202] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:31:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:41.027037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a48c0-285f-46d6-9316-0ead3438759d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:41.046555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a48c0-285f-46d6-9316-0ead3438759d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:41.051825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e29168-ed0b-4828-9c34-93aa4f0ccd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:41.052867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e29168-ed0b-4828-9c34-93aa4f0ccd50 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:41.053110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e29168-ed0b-4828-9c34-93aa4f0ccd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:41.053389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e29168-ed0b-4828-9c34-93aa4f0ccd50 admin admin] PATH_INFO: `/v3/users/da0833cce9694931a7250f6858f41ba0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:41.054943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e29168-ed0b-4828-9c34-93aa4f0ccd50 admin admin] RBAC: Authorizing `identity:get_user(user_id=da0833cce9694931a7250f6858f41ba0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:41.057334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e29168-ed0b-4828-9c34-93aa4f0ccd50 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:41.058099 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 97/203] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:31:40 2021] POST /identity/v3/users => generated 297 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:31:41.064050 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 107/204] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:41 2021] GET /identity/v3/users/da0833cce9694931a7250f6858f41ba0 => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:41.071471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9009a66-3e6d-44a0-84cb-ca92248ef72a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:41.083826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9009a66-3e6d-44a0-84cb-ca92248ef72a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:41.089310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387658-91a6-42df-ae5f-5d46aba4fb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:41.090565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387658-91a6-42df-ae5f-5d46aba4fb33 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:41.091122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387658-91a6-42df-ae5f-5d46aba4fb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:41.091613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387658-91a6-42df-ae5f-5d46aba4fb33 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:41.101725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d387658-91a6-42df-ae5f-5d46aba4fb33 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:41.104074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d387658-91a6-42df-ae5f-5d46aba4fb33 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:41.115597 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 98/205] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:41 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:41.123756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e29168-ed0b-4828-9c34-93aa4f0ccd50 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:41.135647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e29168-ed0b-4828-9c34-93aa4f0ccd50 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:41.141608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c359a-9a1e-40fb-8928-25bbf93f4645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:41.142980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c359a-9a1e-40fb-8928-25bbf93f4645 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:41.143472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c359a-9a1e-40fb-8928-25bbf93f4645 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:41.143969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c359a-9a1e-40fb-8928-25bbf93f4645 admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:41.145657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c359a-9a1e-40fb-8928-25bbf93f4645 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:41.148258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c359a-9a1e-40fb-8928-25bbf93f4645 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:41.150597 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 108/206] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:41 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:41.158028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387658-91a6-42df-ae5f-5d46aba4fb33 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:41.168500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387658-91a6-42df-ae5f-5d46aba4fb33 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:41.174529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d5261-c891-413d-bd43-de9f94eb720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:41.175644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d5261-c891-413d-bd43-de9f94eb720b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:41.176204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d5261-c891-413d-bd43-de9f94eb720b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:41.176536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d5261-c891-413d-bd43-de9f94eb720b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:41.177523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d5261-c891-413d-bd43-de9f94eb720b admin admin] RBAC: Adding query filter params (role.id=04189c3120df49f6b37322459b571cf1, scope.project.id=c0aa413232f44947b73617ef1bf8ba55, user.id=da0833cce9694931a7250f6858f41ba0) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:41.177960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d5261-c891-413d-bd43-de9f94eb720b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:41.180204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d5261-c891-413d-bd43-de9f94eb720b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:41.188297 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 99/207] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:41 2021] GET /identity/v3/role_assignments?user.id=da0833cce9694931a7250f6858f41ba0&scope.project.id=c0aa413232f44947b73617ef1bf8ba55&role.id=04189c3120df49f6b37322459b571cf1 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:43.413683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df0c8b-b82b-4cb9-96f5-c223b2a29d87 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.414184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df0c8b-b82b-4cb9-96f5-c223b2a29d87 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.414287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df0c8b-b82b-4cb9-96f5-c223b2a29d87 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.416034 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 109/208] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:43.421898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345d15b-9ef7-4ba3-b1a7-d3a5f33b6b14 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.422327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345d15b-9ef7-4ba3-b1a7-d3a5f33b6b14 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.422506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345d15b-9ef7-4ba3-b1a7-d3a5f33b6b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.441225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2345d15b-9ef7-4ba3-b1a7-d3a5f33b6b14 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:43.442441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2345d15b-9ef7-4ba3-b1a7-d3a5f33b6b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:43.454323 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 100/209] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:43.474543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df0c8b-b82b-4cb9-96f5-c223b2a29d87 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:43.487164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df0c8b-b82b-4cb9-96f5-c223b2a29d87 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:43.491744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38ecb4-577a-4ba5-bf26-15a24e90d053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:43.492753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38ecb4-577a-4ba5-bf26-15a24e90d053 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.493276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38ecb4-577a-4ba5-bf26-15a24e90d053 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.493747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38ecb4-577a-4ba5-bf26-15a24e90d053 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.505040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38ecb4-577a-4ba5-bf26-15a24e90d053 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:43.512016 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-bd38ecb4-577a-4ba5-bf26-15a24e90d053 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:31:43.513379 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 110/210] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:31:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:43.519825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345d15b-9ef7-4ba3-b1a7-d3a5f33b6b14 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:43.528847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345d15b-9ef7-4ba3-b1a7-d3a5f33b6b14 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:43.533822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac323a-154a-4943-90b3-1e23efadf72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:43.534514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac323a-154a-4943-90b3-1e23efadf72c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.534794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac323a-154a-4943-90b3-1e23efadf72c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.535076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac323a-154a-4943-90b3-1e23efadf72c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.535834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac323a-154a-4943-90b3-1e23efadf72c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:43.536138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac323a-154a-4943-90b3-1e23efadf72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:43.537732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac323a-154a-4943-90b3-1e23efadf72c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:43.546677 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 101/211] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:43.552745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38ecb4-577a-4ba5-bf26-15a24e90d053 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:43.563777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38ecb4-577a-4ba5-bf26-15a24e90d053 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:43.568200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f575a13-52da-4762-8813-d1162eb125e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:43.569045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f575a13-52da-4762-8813-d1162eb125e6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.569325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f575a13-52da-4762-8813-d1162eb125e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.569599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f575a13-52da-4762-8813-d1162eb125e6 admin admin] PATH_INFO: `/v3/users/da0833cce9694931a7250f6858f41ba0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.570817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f575a13-52da-4762-8813-d1162eb125e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=da0833cce9694931a7250f6858f41ba0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:43.572903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f575a13-52da-4762-8813-d1162eb125e6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:43.574497 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 111/212] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:43 2021] GET /identity/v3/users/da0833cce9694931a7250f6858f41ba0 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:43.580491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac323a-154a-4943-90b3-1e23efadf72c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:43.590105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac323a-154a-4943-90b3-1e23efadf72c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:43.595033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4e00f-3c8f-4428-a827-fba669903eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:43.595875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4e00f-3c8f-4428-a827-fba669903eaf admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.596152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4e00f-3c8f-4428-a827-fba669903eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.596422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4e00f-3c8f-4428-a827-fba669903eaf admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.597612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4e00f-3c8f-4428-a827-fba669903eaf admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:43.599672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4e00f-3c8f-4428-a827-fba669903eaf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:43.601593 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 102/213] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:43 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:43.607729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f575a13-52da-4762-8813-d1162eb125e6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:43.621736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f575a13-52da-4762-8813-d1162eb125e6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:43.626765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70869def-1d8c-46a8-808f-e2df695440de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:43.627647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70869def-1d8c-46a8-808f-e2df695440de admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.627983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70869def-1d8c-46a8-808f-e2df695440de admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.628264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70869def-1d8c-46a8-808f-e2df695440de admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55/users/da0833cce9694931a7250f6858f41ba0/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.630280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70869def-1d8c-46a8-808f-e2df695440de admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0aa413232f44947b73617ef1bf8ba55, user_id=da0833cce9694931a7250f6858f41ba0, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:43.632914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70869def-1d8c-46a8-808f-e2df695440de admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:43.649566 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 112/214] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:31:43 2021] PUT /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55/users/da0833cce9694931a7250f6858f41ba0/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:31:43.660985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07304724-65d2-411a-b464-656a71ce2302 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.661555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07304724-65d2-411a-b464-656a71ce2302 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.662034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07304724-65d2-411a-b464-656a71ce2302 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.664185 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 103/215] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:43.671468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd60410-77aa-423d-a2a3-a3314a3acc9e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.671851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd60410-77aa-423d-a2a3-a3314a3acc9e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.672205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd60410-77aa-423d-a2a3-a3314a3acc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.683205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c910dd-06f6-41ab-bfc0-51a3553c3fcc None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.683489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c910dd-06f6-41ab-bfc0-51a3553c3fcc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.683771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c910dd-06f6-41ab-bfc0-51a3553c3fcc None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.685678 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 104/216] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:31:43.692442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-cdd60410-77aa-423d-a2a3-a3314a3acc9e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:43.692844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd5ee6-88c7-44f0-a48b-581dd80d8b3b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.693307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd5ee6-88c7-44f0-a48b-581dd80d8b3b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.693759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd5ee6-88c7-44f0-a48b-581dd80d8b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.693904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cdd60410-77aa-423d-a2a3-a3314a3acc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:43.719229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-eddd5ee6-88c7-44f0-a48b-581dd80d8b3b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:43.720952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-eddd5ee6-88c7-44f0-a48b-581dd80d8b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:43.761297 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 113/217] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:43.763019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdf8e9-d007-445f-8ec8-15eb78843318 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.763308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdf8e9-d007-445f-8ec8-15eb78843318 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.763585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdf8e9-d007-445f-8ec8-15eb78843318 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.765350 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 114/218] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:43.771397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3d461-47d3-464a-8862-85059ae6e98d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.771685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3d461-47d3-464a-8862-85059ae6e98d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.771966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3d461-47d3-464a-8862-85059ae6e98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.790675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a8d3d461-47d3-464a-8862-85059ae6e98d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:43.792035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a8d3d461-47d3-464a-8862-85059ae6e98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:43.800399 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 105/219] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:43.801193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd5ee6-88c7-44f0-a48b-581dd80d8b3b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:43.806352 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 115/220] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:43.815156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd5ee6-88c7-44f0-a48b-581dd80d8b3b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:43.819806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066c672-8709-4aea-9cf2-4792e1cd2a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:43.820642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066c672-8709-4aea-9cf2-4792e1cd2a25 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.820925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066c672-8709-4aea-9cf2-4792e1cd2a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.821205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066c672-8709-4aea-9cf2-4792e1cd2a25 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.827705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3d461-47d3-464a-8862-85059ae6e98d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:43.834083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066c672-8709-4aea-9cf2-4792e1cd2a25 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:43.840298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3d461-47d3-464a-8862-85059ae6e98d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:43.841558 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-4066c672-8709-4aea-9cf2-4792e1cd2a25 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 18 20:31:43.842903 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 106/221] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:31:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:43.843780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066c672-8709-4aea-9cf2-4792e1cd2a25 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:43.845659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fe5e3-ffa5-4805-8a4a-3aa19060f8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:43.846682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fe5e3-ffa5-4805-8a4a-3aa19060f8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.847108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fe5e3-ffa5-4805-8a4a-3aa19060f8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.847526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fe5e3-ffa5-4805-8a4a-3aa19060f8b1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.854636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066c672-8709-4aea-9cf2-4792e1cd2a25 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:43.859557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b71c92-9607-458d-a8fd-874b796a630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:43.860338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b71c92-9607-458d-a8fd-874b796a630b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.860623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b71c92-9607-458d-a8fd-874b796a630b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.860906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b71c92-9607-458d-a8fd-874b796a630b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.862093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b71c92-9607-458d-a8fd-874b796a630b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:43.863606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fe5e3-ffa5-4805-8a4a-3aa19060f8b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:43.863824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b71c92-9607-458d-a8fd-874b796a630b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:43.865444 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 107/222] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:31:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:43.867342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b71c92-9607-458d-a8fd-874b796a630b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:43.871224 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-c57fe5e3-ffa5-4805-8a4a-3aa19060f8b1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:31:43.872664 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 116/223] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:43 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:31:43.873498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fe5e3-ffa5-4805-8a4a-3aa19060f8b1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:43.877362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b71c92-9607-458d-a8fd-874b796a630b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:43.883161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a5592-1214-4622-9bef-226c567e305e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:43.884428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a5592-1214-4622-9bef-226c567e305e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.884718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a5592-1214-4622-9bef-226c567e305e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.884992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a5592-1214-4622-9bef-226c567e305e admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.885940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a5592-1214-4622-9bef-226c567e305e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:43.886217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a5592-1214-4622-9bef-226c567e305e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:43.887755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fe5e3-ffa5-4805-8a4a-3aa19060f8b1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:43.887903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a5592-1214-4622-9bef-226c567e305e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:43.892839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92667a-023d-463e-91a1-af052f8e2dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:43.893509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92667a-023d-463e-91a1-af052f8e2dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.893797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92667a-023d-463e-91a1-af052f8e2dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.894077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92667a-023d-463e-91a1-af052f8e2dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.894845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92667a-023d-463e-91a1-af052f8e2dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:43.896793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92667a-023d-463e-91a1-af052f8e2dd5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:43.898824 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 108/224] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:31:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:43.899542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a5592-1214-4622-9bef-226c567e305e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:43.914074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a5592-1214-4622-9bef-226c567e305e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:43.918819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0f6f5-0889-459e-90ef-874e154179d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:43.919047 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 117/225] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:31:43 2021] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:31:43.919777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0f6f5-0889-459e-90ef-874e154179d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.920480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92667a-023d-463e-91a1-af052f8e2dd5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:43.921050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0f6f5-0889-459e-90ef-874e154179d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.921522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0f6f5-0889-459e-90ef-874e154179d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.922516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0f6f5-0889-459e-90ef-874e154179d4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:43.922960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0f6f5-0889-459e-90ef-874e154179d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:43.924762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0f6f5-0889-459e-90ef-874e154179d4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:43.931765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92667a-023d-463e-91a1-af052f8e2dd5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:43.936956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468ed14-3b06-42a4-8da9-35d0f8a78349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:43.937949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468ed14-3b06-42a4-8da9-35d0f8a78349 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.938335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468ed14-3b06-42a4-8da9-35d0f8a78349 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.938716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468ed14-3b06-42a4-8da9-35d0f8a78349 admin admin] PATH_INFO: `/v3/users/da0833cce9694931a7250f6858f41ba0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.940156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468ed14-3b06-42a4-8da9-35d0f8a78349 admin admin] RBAC: Authorizing `identity:get_user(user_id=da0833cce9694931a7250f6858f41ba0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:43.941868 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 109/226] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:43 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:43.947059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468ed14-3b06-42a4-8da9-35d0f8a78349 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:43.947059 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 118/227] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:43 2021] GET /identity/v3/users/da0833cce9694931a7250f6858f41ba0 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:43.948898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468ed14-3b06-42a4-8da9-35d0f8a78349 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:43.951718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0f6f5-0889-459e-90ef-874e154179d4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:43.961682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468ed14-3b06-42a4-8da9-35d0f8a78349 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:43.965367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0f6f5-0889-459e-90ef-874e154179d4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:43.970806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13ead8-4c66-47cf-a0d1-b8398d30bbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:43.971813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13ead8-4c66-47cf-a0d1-b8398d30bbdf admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.972165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13ead8-4c66-47cf-a0d1-b8398d30bbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.972515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13ead8-4c66-47cf-a0d1-b8398d30bbdf admin admin] PATH_INFO: `/v3/users/eea0be67cad84d50b65bb359a6b5b46d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.972773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3a945-faf1-41a5-8333-b8a8b358891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:43.974272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3a945-faf1-41a5-8333-b8a8b358891c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:43.974984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3a945-faf1-41a5-8333-b8a8b358891c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:43.975482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3a945-faf1-41a5-8333-b8a8b358891c admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:43.977986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3a945-faf1-41a5-8333-b8a8b358891c admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:43.980579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3a945-faf1-41a5-8333-b8a8b358891c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:43.983902 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 110/228] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:43 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:43.990562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3a945-faf1-41a5-8333-b8a8b358891c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:43.992970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13ead8-4c66-47cf-a0d1-b8398d30bbdf admin admin] RBAC: Authorizing `identity:get_user(user_id=eea0be67cad84d50b65bb359a6b5b46d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:43.995335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13ead8-4c66-47cf-a0d1-b8398d30bbdf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:43.997592 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 119/229] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:43 2021] GET /identity/v3/users/eea0be67cad84d50b65bb359a6b5b46d => generated 297 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:44.002978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3a945-faf1-41a5-8333-b8a8b358891c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:44.005659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13ead8-4c66-47cf-a0d1-b8398d30bbdf admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:44.008892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab669cc3-99b2-403a-94c9-2b907ddcb0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:44.010111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab669cc3-99b2-403a-94c9-2b907ddcb0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:44.010590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab669cc3-99b2-403a-94c9-2b907ddcb0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:44.011034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab669cc3-99b2-403a-94c9-2b907ddcb0d1 admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55/users/da0833cce9694931a7250f6858f41ba0/roles/04189c3120df49f6b37322459b571cf1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:44.015342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab669cc3-99b2-403a-94c9-2b907ddcb0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0aa413232f44947b73617ef1bf8ba55, user_id=da0833cce9694931a7250f6858f41ba0, role_id=04189c3120df49f6b37322459b571cf1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:44.019027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab669cc3-99b2-403a-94c9-2b907ddcb0d1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:44.020115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13ead8-4c66-47cf-a0d1-b8398d30bbdf admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:44.027792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5ed99-4dcd-4420-b256-1fe752b74c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:44.028652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ed99-4dcd-4420-b256-1fe752b74c99 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:44.029190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ed99-4dcd-4420-b256-1fe752b74c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:44.030442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ed99-4dcd-4420-b256-1fe752b74c99 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:44.040419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5ed99-4dcd-4420-b256-1fe752b74c99 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:44.040713 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 111/230] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:31:43 2021] PUT /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55/users/da0833cce9694931a7250f6858f41ba0/roles/04189c3120df49f6b37322459b571cf1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:31:44.044598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5ed99-4dcd-4420-b256-1fe752b74c99 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:44.056356 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 120/231] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:44 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:44.063917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab669cc3-99b2-403a-94c9-2b907ddcb0d1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:44.139641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab669cc3-99b2-403a-94c9-2b907ddcb0d1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:44.145016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddaaf38-9693-41bc-a0a5-950b6d15fc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:44.146394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaaf38-9693-41bc-a0a5-950b6d15fc22 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:44.146913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaaf38-9693-41bc-a0a5-950b6d15fc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:44.147363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaaf38-9693-41bc-a0a5-950b6d15fc22 admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:44.148992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddaaf38-9693-41bc-a0a5-950b6d15fc22 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:44.151528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddaaf38-9693-41bc-a0a5-950b6d15fc22 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:44.153727 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 112/232] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:44 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:44.160724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5ed99-4dcd-4420-b256-1fe752b74c99 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:44.172082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5ed99-4dcd-4420-b256-1fe752b74c99 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:44.177769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d5b25-ede5-452b-9210-a8447edd6745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:44.178646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d5b25-ede5-452b-9210-a8447edd6745 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:44.178997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d5b25-ede5-452b-9210-a8447edd6745 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:44.179278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d5b25-ede5-452b-9210-a8447edd6745 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:44.180167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d5b25-ede5-452b-9210-a8447edd6745 admin admin] RBAC: Adding query filter params (role.id=d9c784a85e0540d0abdfedac9386a842, scope.project.id=c0aa413232f44947b73617ef1bf8ba55, user.id=eea0be67cad84d50b65bb359a6b5b46d) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:44.180479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d5b25-ede5-452b-9210-a8447edd6745 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:44.182792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d5b25-ede5-452b-9210-a8447edd6745 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:44.191143 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 121/233] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:44 2021] GET /identity/v3/role_assignments?user.id=eea0be67cad84d50b65bb359a6b5b46d&scope.project.id=c0aa413232f44947b73617ef1bf8ba55&role.id=d9c784a85e0540d0abdfedac9386a842 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:46.666362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f934d1-48e5-4b67-95d4-69596e67c930 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:46.666872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f934d1-48e5-4b67-95d4-69596e67c930 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:46.666970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f934d1-48e5-4b67-95d4-69596e67c930 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:46.668694 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 113/234] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:46.677294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569acbe-5605-45e7-a17a-e92dad12fdb6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:46.677698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569acbe-5605-45e7-a17a-e92dad12fdb6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:46.677875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569acbe-5605-45e7-a17a-e92dad12fdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:46.707371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b569acbe-5605-45e7-a17a-e92dad12fdb6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:46.708581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b569acbe-5605-45e7-a17a-e92dad12fdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:46.716612 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 122/235] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:46.742283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f934d1-48e5-4b67-95d4-69596e67c930 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:46.761632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f934d1-48e5-4b67-95d4-69596e67c930 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:46.768686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937fe36-172c-4c03-8064-9aca5b7020ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:46.769472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937fe36-172c-4c03-8064-9aca5b7020ba admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:46.769756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937fe36-172c-4c03-8064-9aca5b7020ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:46.770032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937fe36-172c-4c03-8064-9aca5b7020ba admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:46.791275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937fe36-172c-4c03-8064-9aca5b7020ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:46.798755 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-0937fe36-172c-4c03-8064-9aca5b7020ba admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:31:46.800306 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 114/236] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:31:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:46.809441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569acbe-5605-45e7-a17a-e92dad12fdb6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:46.829730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569acbe-5605-45e7-a17a-e92dad12fdb6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:46.838791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1a5e1-1be6-44f1-95bc-520fd8aeedf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:46.839473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1a5e1-1be6-44f1-95bc-520fd8aeedf5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:46.839758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1a5e1-1be6-44f1-95bc-520fd8aeedf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:46.840097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1a5e1-1be6-44f1-95bc-520fd8aeedf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:46.841289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1a5e1-1be6-44f1-95bc-520fd8aeedf5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:46.841787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1a5e1-1be6-44f1-95bc-520fd8aeedf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:46.844354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1a5e1-1be6-44f1-95bc-520fd8aeedf5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:46.864670 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 123/237] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:46.873606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937fe36-172c-4c03-8064-9aca5b7020ba admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:46.889016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937fe36-172c-4c03-8064-9aca5b7020ba admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:46.895814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71030cc3-4c10-4fbe-899c-d703911b1843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:46.896676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71030cc3-4c10-4fbe-899c-d703911b1843 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:46.896962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71030cc3-4c10-4fbe-899c-d703911b1843 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:46.897239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71030cc3-4c10-4fbe-899c-d703911b1843 admin admin] PATH_INFO: `/v3/users/da0833cce9694931a7250f6858f41ba0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:46.898503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71030cc3-4c10-4fbe-899c-d703911b1843 admin admin] RBAC: Authorizing `identity:get_user(user_id=da0833cce9694931a7250f6858f41ba0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:46.900612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71030cc3-4c10-4fbe-899c-d703911b1843 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:46.902541 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 115/238] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:46 2021] GET /identity/v3/users/da0833cce9694931a7250f6858f41ba0 => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:46.908631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1a5e1-1be6-44f1-95bc-520fd8aeedf5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:46.923943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1a5e1-1be6-44f1-95bc-520fd8aeedf5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:46.931880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0153b47-4abe-4ac4-80d0-3c00387838f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:46.932543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0153b47-4abe-4ac4-80d0-3c00387838f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:46.932829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0153b47-4abe-4ac4-80d0-3c00387838f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:46.933111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0153b47-4abe-4ac4-80d0-3c00387838f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:46.947879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0153b47-4abe-4ac4-80d0-3c00387838f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:46.949643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0153b47-4abe-4ac4-80d0-3c00387838f9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:46.963702 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 124/239] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:46 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:46.969860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71030cc3-4c10-4fbe-899c-d703911b1843 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:46.977208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92945de5-1727-46ce-a8e7-f11bf50ab720 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:46.977503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92945de5-1727-46ce-a8e7-f11bf50ab720 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:46.977783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92945de5-1727-46ce-a8e7-f11bf50ab720 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:46.979584 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 125/240] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:46 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:46.986264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0012bc9-9273-45e1-a091-6d0ba6938398 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:46.986552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0012bc9-9273-45e1-a091-6d0ba6938398 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:46.986824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0012bc9-9273-45e1-a091-6d0ba6938398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:46.992986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71030cc3-4c10-4fbe-899c-d703911b1843 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.004348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9171c-bf73-45a9-a01a-8b03aa97368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.005209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9171c-bf73-45a9-a01a-8b03aa97368d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.005490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9171c-bf73-45a9-a01a-8b03aa97368d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.005766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9171c-bf73-45a9-a01a-8b03aa97368d admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.007344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a0012bc9-9273-45e1-a091-6d0ba6938398 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:47.008554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a0012bc9-9273-45e1-a091-6d0ba6938398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:47.011213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9171c-bf73-45a9-a01a-8b03aa97368d admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.013301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9171c-bf73-45a9-a01a-8b03aa97368d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.015132 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 116/241] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:46 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:47.016200 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 126/242] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:47.021330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9171c-bf73-45a9-a01a-8b03aa97368d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.035626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9171c-bf73-45a9-a01a-8b03aa97368d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.044476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0012bc9-9273-45e1-a091-6d0ba6938398 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.047585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1562e-0554-41d0-9160-c528d2fefc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.048253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1562e-0554-41d0-9160-c528d2fefc07 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.048545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1562e-0554-41d0-9160-c528d2fefc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.048823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1562e-0554-41d0-9160-c528d2fefc07 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.049673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1562e-0554-41d0-9160-c528d2fefc07 admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=c0aa413232f44947b73617ef1bf8ba55, user.id=da0833cce9694931a7250f6858f41ba0) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:47.049985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1562e-0554-41d0-9160-c528d2fefc07 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.051881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1562e-0554-41d0-9160-c528d2fefc07 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.056675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0012bc9-9273-45e1-a091-6d0ba6938398 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.063476 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 117/243] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/role_assignments?user.id=da0833cce9694931a7250f6858f41ba0&scope.project.id=c0aa413232f44947b73617ef1bf8ba55&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:47.066066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef65bf-4391-4fd3-b2ea-f30917ee6bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.066895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef65bf-4391-4fd3-b2ea-f30917ee6bdd admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.067171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef65bf-4391-4fd3-b2ea-f30917ee6bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.067448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef65bf-4391-4fd3-b2ea-f30917ee6bdd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.074573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c034-5369-4bfb-8fb2-e69dc9b84d42 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.074928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c034-5369-4bfb-8fb2-e69dc9b84d42 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.075115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c034-5369-4bfb-8fb2-e69dc9b84d42 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.077307 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 118/244] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:31:47.080352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef65bf-4391-4fd3-b2ea-f30917ee6bdd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:47.087817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740c518-b1ac-4679-83a5-cf6868eddc8a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.088107 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-d5ef65bf-4391-4fd3-b2ea-f30917ee6bdd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 18 20:31:47.088258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740c518-b1ac-4679-83a5-cf6868eddc8a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.088400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740c518-b1ac-4679-83a5-cf6868eddc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.089549 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 127/245] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:31:47.096489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef65bf-4391-4fd3-b2ea-f30917ee6bdd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.106966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef65bf-4391-4fd3-b2ea-f30917ee6bdd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.112017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74440ed-172e-4ff5-9312-10084dc04cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.112686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74440ed-172e-4ff5-9312-10084dc04cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.112971 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74440ed-172e-4ff5-9312-10084dc04cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.113248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74440ed-172e-4ff5-9312-10084dc04cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.114017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74440ed-172e-4ff5-9312-10084dc04cc5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:47.114356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74440ed-172e-4ff5-9312-10084dc04cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.115958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74440ed-172e-4ff5-9312-10084dc04cc5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.125710 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 128/246] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:47.131630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9740c518-b1ac-4679-83a5-cf6868eddc8a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:47.131914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74440ed-172e-4ff5-9312-10084dc04cc5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.132863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9740c518-b1ac-4679-83a5-cf6868eddc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:47.142650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74440ed-172e-4ff5-9312-10084dc04cc5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.147439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32bf7a-e75b-4b93-bd4c-5086e8cbf0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.148389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32bf7a-e75b-4b93-bd4c-5086e8cbf0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.148679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32bf7a-e75b-4b93-bd4c-5086e8cbf0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.148961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32bf7a-e75b-4b93-bd4c-5086e8cbf0c7 admin admin] PATH_INFO: `/v3/users/da0833cce9694931a7250f6858f41ba0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.150198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32bf7a-e75b-4b93-bd4c-5086e8cbf0c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=da0833cce9694931a7250f6858f41ba0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.152576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32bf7a-e75b-4b93-bd4c-5086e8cbf0c7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.155286 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 129/247] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/users/da0833cce9694931a7250f6858f41ba0 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:47.155997 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 119/248] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:47.161976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32bf7a-e75b-4b93-bd4c-5086e8cbf0c7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.170692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792508f3-887b-4996-9cd7-fd72d11c4a78 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.171056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792508f3-887b-4996-9cd7-fd72d11c4a78 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.171345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792508f3-887b-4996-9cd7-fd72d11c4a78 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.173590 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 120/249] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:31:47.174153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32bf7a-e75b-4b93-bd4c-5086e8cbf0c7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.180625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2185e58-1c2d-4bbb-9199-c4f793fcac24 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.180932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3be1b-a1bf-46fb-8e0f-252135b2895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.181175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2185e58-1c2d-4bbb-9199-c4f793fcac24 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.181412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2185e58-1c2d-4bbb-9199-c4f793fcac24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.182216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3be1b-a1bf-46fb-8e0f-252135b2895a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.182760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3be1b-a1bf-46fb-8e0f-252135b2895a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.183403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3be1b-a1bf-46fb-8e0f-252135b2895a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.194688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3be1b-a1bf-46fb-8e0f-252135b2895a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.196499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3be1b-a1bf-46fb-8e0f-252135b2895a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.207507 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 130/250] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:47.208376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3be1b-a1bf-46fb-8e0f-252135b2895a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.216150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a2185e58-1c2d-4bbb-9199-c4f793fcac24 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:47.217861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a2185e58-1c2d-4bbb-9199-c4f793fcac24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:47.227357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3be1b-a1bf-46fb-8e0f-252135b2895a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.229638 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 121/251] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:47.231025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2185e58-1c2d-4bbb-9199-c4f793fcac24 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.232119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cd630-b46d-43e2-9a38-09c691a56934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.233649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cd630-b46d-43e2-9a38-09c691a56934 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.233935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cd630-b46d-43e2-9a38-09c691a56934 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.234276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cd630-b46d-43e2-9a38-09c691a56934 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.242886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2185e58-1c2d-4bbb-9199-c4f793fcac24 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.247170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cd630-b46d-43e2-9a38-09c691a56934 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:47.248455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea9a82-d488-4201-9706-670e08db8de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.249477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea9a82-d488-4201-9706-670e08db8de1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.249912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea9a82-d488-4201-9706-670e08db8de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.250371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea9a82-d488-4201-9706-670e08db8de1 admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.251732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea9a82-d488-4201-9706-670e08db8de1 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.253927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea9a82-d488-4201-9706-670e08db8de1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.255118 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-c06cd630-b46d-43e2-9a38-09c691a56934 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:31:47.256493 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 131/253] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:47.256630 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 122/253] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:47.262681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cd630-b46d-43e2-9a38-09c691a56934 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.263228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea9a82-d488-4201-9706-670e08db8de1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.274329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea9a82-d488-4201-9706-670e08db8de1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.275265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cd630-b46d-43e2-9a38-09c691a56934 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.280698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db30b72-eb6f-46c5-a37d-e2506033b211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.281273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c8a52-861b-42d8-b5b1-2df85e385fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.281764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db30b72-eb6f-46c5-a37d-e2506033b211 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.282244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db30b72-eb6f-46c5-a37d-e2506033b211 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.282653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c8a52-861b-42d8-b5b1-2df85e385fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.282827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db30b72-eb6f-46c5-a37d-e2506033b211 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.283069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c8a52-861b-42d8-b5b1-2df85e385fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.283409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c8a52-861b-42d8-b5b1-2df85e385fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.284182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db30b72-eb6f-46c5-a37d-e2506033b211 admin admin] RBAC: Adding query filter params (role.id=04189c3120df49f6b37322459b571cf1, scope.project.id=c0aa413232f44947b73617ef1bf8ba55, user.id=da0833cce9694931a7250f6858f41ba0) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:47.284396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c8a52-861b-42d8-b5b1-2df85e385fb4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:47.284781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db30b72-eb6f-46c5-a37d-e2506033b211 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.284886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c8a52-861b-42d8-b5b1-2df85e385fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.286682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c8a52-861b-42d8-b5b1-2df85e385fb4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.287046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db30b72-eb6f-46c5-a37d-e2506033b211 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.295569 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 123/254] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/role_assignments?user.id=da0833cce9694931a7250f6858f41ba0&scope.project.id=c0aa413232f44947b73617ef1bf8ba55&role.id=04189c3120df49f6b37322459b571cf1 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:47.302288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db30b72-eb6f-46c5-a37d-e2506033b211 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.302508 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 132/255] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:47.304918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c8a52-861b-42d8-b5b1-2df85e385fb4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.324843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c8a52-861b-42d8-b5b1-2df85e385fb4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.325805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db30b72-eb6f-46c5-a37d-e2506033b211 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.334468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622f235-ac8e-469a-b693-82753b4f4be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.335372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622f235-ac8e-469a-b693-82753b4f4be4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.335654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622f235-ac8e-469a-b693-82753b4f4be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.335834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea5ff4-5c35-40c7-84fb-66944a8ee4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.336643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea5ff4-5c35-40c7-84fb-66944a8ee4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.336915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea5ff4-5c35-40c7-84fb-66944a8ee4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.337182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea5ff4-5c35-40c7-84fb-66944a8ee4d8 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.337807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622f235-ac8e-469a-b693-82753b4f4be4 admin admin] PATH_INFO: `/v3/users/eea0be67cad84d50b65bb359a6b5b46d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.339596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622f235-ac8e-469a-b693-82753b4f4be4 admin admin] RBAC: Authorizing `identity:get_user(user_id=eea0be67cad84d50b65bb359a6b5b46d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.347050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622f235-ac8e-469a-b693-82753b4f4be4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.352951 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 133/256] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/users/eea0be67cad84d50b65bb359a6b5b46d => generated 297 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:47.365620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622f235-ac8e-469a-b693-82753b4f4be4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.368774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea5ff4-5c35-40c7-84fb-66944a8ee4d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:47.375900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622f235-ac8e-469a-b693-82753b4f4be4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.376087 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-0cea5ff4-5c35-40c7-84fb-66944a8ee4d8 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 18 20:31:47.377159 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 124/257] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/roles/reader => generated 84 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:47.380991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a6bb8-238f-4001-b066-d6499b47eba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.382029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6bb8-238f-4001-b066-d6499b47eba9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.382670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6bb8-238f-4001-b066-d6499b47eba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.382957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6bb8-238f-4001-b066-d6499b47eba9 admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.383442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea5ff4-5c35-40c7-84fb-66944a8ee4d8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.384460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a6bb8-238f-4001-b066-d6499b47eba9 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.386723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a6bb8-238f-4001-b066-d6499b47eba9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.390178 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 134/258] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:47.398156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a6bb8-238f-4001-b066-d6499b47eba9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.405383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea5ff4-5c35-40c7-84fb-66944a8ee4d8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.411179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a6bb8-238f-4001-b066-d6499b47eba9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.415222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e4a7a-b94d-41f8-b854-249f1534c990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.415911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e4a7a-b94d-41f8-b854-249f1534c990 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.416194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e4a7a-b94d-41f8-b854-249f1534c990 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.416473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e4a7a-b94d-41f8-b854-249f1534c990 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.417246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e4a7a-b94d-41f8-b854-249f1534c990 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:47.417551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e4a7a-b94d-41f8-b854-249f1534c990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.419282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e4a7a-b94d-41f8-b854-249f1534c990 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.419841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeecd9e-d947-4246-b3b0-d411b7c576ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.420800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeecd9e-d947-4246-b3b0-d411b7c576ba admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.421081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeecd9e-d947-4246-b3b0-d411b7c576ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.421357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeecd9e-d947-4246-b3b0-d411b7c576ba admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55/users/eea0be67cad84d50b65bb359a6b5b46d/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.423581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeecd9e-d947-4246-b3b0-d411b7c576ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0aa413232f44947b73617ef1bf8ba55, user_id=eea0be67cad84d50b65bb359a6b5b46d, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.426437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeecd9e-d947-4246-b3b0-d411b7c576ba admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.428644 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 125/259] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:47.435277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e4a7a-b94d-41f8-b854-249f1534c990 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.450300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e4a7a-b94d-41f8-b854-249f1534c990 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.450493 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 135/260] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:31:47 2021] PUT /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55/users/eea0be67cad84d50b65bb359a6b5b46d/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:31:47.501295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274487b-887e-46fc-addd-10e2a9893401 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.501638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274487b-887e-46fc-addd-10e2a9893401 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.501857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274487b-887e-46fc-addd-10e2a9893401 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.504086 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 136/261] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:31:47.512377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4d71a-2963-4c6b-987d-6fa5106ce5a8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.512697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4d71a-2963-4c6b-987d-6fa5106ce5a8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.512952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4d71a-2963-4c6b-987d-6fa5106ce5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.536630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42c32d-1d81-4c63-b5ce-58e2e683bc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.537523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42c32d-1d81-4c63-b5ce-58e2e683bc0a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.537804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42c32d-1d81-4c63-b5ce-58e2e683bc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.538080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42c32d-1d81-4c63-b5ce-58e2e683bc0a admin admin] PATH_INFO: `/v3/users/453defdf57e947a899a34839ab961027` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.540644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f0e4d71a-2963-4c6b-987d-6fa5106ce5a8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:47.542039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f0e4d71a-2963-4c6b-987d-6fa5106ce5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:47.551306 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 137/262] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:47.557549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42c32d-1d81-4c63-b5ce-58e2e683bc0a admin admin] RBAC: Authorizing `identity:get_user(user_id=453defdf57e947a899a34839ab961027)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.559965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42c32d-1d81-4c63-b5ce-58e2e683bc0a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.562232 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 126/263] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/users/453defdf57e947a899a34839ab961027 => generated 297 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:47.568811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4d71a-2963-4c6b-987d-6fa5106ce5a8 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.579712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4d71a-2963-4c6b-987d-6fa5106ce5a8 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.583165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42c32d-1d81-4c63-b5ce-58e2e683bc0a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.586564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9c12e-44c3-4646-920f-8562f303d7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.587232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9c12e-44c3-4646-920f-8562f303d7cd admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.587512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9c12e-44c3-4646-920f-8562f303d7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.587836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9c12e-44c3-4646-920f-8562f303d7cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.593161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42c32d-1d81-4c63-b5ce-58e2e683bc0a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.597899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da1521-bf96-4bdb-bb77-309070c10ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.598494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9c12e-44c3-4646-920f-8562f303d7cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.598755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da1521-bf96-4bdb-bb77-309070c10ede admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.599040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da1521-bf96-4bdb-bb77-309070c10ede admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.599314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da1521-bf96-4bdb-bb77-309070c10ede admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.600548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da1521-bf96-4bdb-bb77-309070c10ede admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.600721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9c12e-44c3-4646-920f-8562f303d7cd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.602418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da1521-bf96-4bdb-bb77-309070c10ede admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.606365 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 127/264] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:47.611251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da1521-bf96-4bdb-bb77-309070c10ede admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.618370 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 138/265] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:47.628042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9c12e-44c3-4646-920f-8562f303d7cd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.628333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da1521-bf96-4bdb-bb77-309070c10ede admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.633020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f01e3e-37cb-4b51-b373-20c581fd50af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.633941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f01e3e-37cb-4b51-b373-20c581fd50af admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.633941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f01e3e-37cb-4b51-b373-20c581fd50af admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.634245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f01e3e-37cb-4b51-b373-20c581fd50af admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.635581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f01e3e-37cb-4b51-b373-20c581fd50af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.637523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f01e3e-37cb-4b51-b373-20c581fd50af admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.638005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9c12e-44c3-4646-920f-8562f303d7cd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.644088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0910af-e76b-47bc-9b85-2d36add3307d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.645237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0910af-e76b-47bc-9b85-2d36add3307d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.645340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0910af-e76b-47bc-9b85-2d36add3307d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.645573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0910af-e76b-47bc-9b85-2d36add3307d admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.646880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0910af-e76b-47bc-9b85-2d36add3307d admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.648963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0910af-e76b-47bc-9b85-2d36add3307d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.652419 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 139/266] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:47.661229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0910af-e76b-47bc-9b85-2d36add3307d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:47.665867 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 128/267] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:31:47 2021] POST /identity/v3/users => generated 293 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:31:47.673275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0910af-e76b-47bc-9b85-2d36add3307d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:47.678684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3507c7-54fd-4562-908e-24919108ae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:47.680297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3507c7-54fd-4562-908e-24919108ae36 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:47.680864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3507c7-54fd-4562-908e-24919108ae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:47.681370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3507c7-54fd-4562-908e-24919108ae36 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:47.682782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3507c7-54fd-4562-908e-24919108ae36 admin admin] RBAC: Adding query filter params (role.id=495c6a4a0775416b980691a2de0b403c, scope.project.id=c0aa413232f44947b73617ef1bf8ba55, user.id=453defdf57e947a899a34839ab961027) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:47.683364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3507c7-54fd-4562-908e-24919108ae36 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:47.686679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3507c7-54fd-4562-908e-24919108ae36 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:47.694468 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 140/268] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:47 2021] GET /identity/v3/role_assignments?user.id=453defdf57e947a899a34839ab961027&scope.project.id=c0aa413232f44947b73617ef1bf8ba55&role.id=495c6a4a0775416b980691a2de0b403c => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:49.960267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e6ae6-ee6f-43f3-ae7c-03cd83b779bd None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:49.960771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e6ae6-ee6f-43f3-ae7c-03cd83b779bd None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:49.960882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e6ae6-ee6f-43f3-ae7c-03cd83b779bd None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:49.962697 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 129/269] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:49.969161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602d657-ecec-4e84-a7e8-cc06197a1d28 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:49.969569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602d657-ecec-4e84-a7e8-cc06197a1d28 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:49.969642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602d657-ecec-4e84-a7e8-cc06197a1d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:49.987627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c602d657-ecec-4e84-a7e8-cc06197a1d28 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:49.988808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c602d657-ecec-4e84-a7e8-cc06197a1d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:49.996735 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 141/270] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:50.021675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e6ae6-ee6f-43f3-ae7c-03cd83b779bd None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:50.036614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e6ae6-ee6f-43f3-ae7c-03cd83b779bd None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:50.041084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6966d4-1f60-43ae-af0c-2e9c24f0fd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:50.042065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6966d4-1f60-43ae-af0c-2e9c24f0fd90 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.042545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6966d4-1f60-43ae-af0c-2e9c24f0fd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.042988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6966d4-1f60-43ae-af0c-2e9c24f0fd90 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.053751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6966d4-1f60-43ae-af0c-2e9c24f0fd90 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:50.061525 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-ce6966d4-1f60-43ae-af0c-2e9c24f0fd90 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:31:50.063229 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 130/271] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:50.069543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602d657-ecec-4e84-a7e8-cc06197a1d28 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:50.078910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602d657-ecec-4e84-a7e8-cc06197a1d28 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:50.083599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f9f2a-a96c-47d4-b44a-d1d23eed828d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:50.084540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f9f2a-a96c-47d4-b44a-d1d23eed828d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.084995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f9f2a-a96c-47d4-b44a-d1d23eed828d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.085439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f9f2a-a96c-47d4-b44a-d1d23eed828d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.086526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f9f2a-a96c-47d4-b44a-d1d23eed828d admin admin] RBAC: Adding query filter params (name=member) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:50.087005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f9f2a-a96c-47d4-b44a-d1d23eed828d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:50.088764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f9f2a-a96c-47d4-b44a-d1d23eed828d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:50.098371 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 142/272] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:50.104414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6966d4-1f60-43ae-af0c-2e9c24f0fd90 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:50.115131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6966d4-1f60-43ae-af0c-2e9c24f0fd90 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:50.119835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33815f2-dfb8-4bf6-b726-b64d761f057c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:50.120899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33815f2-dfb8-4bf6-b726-b64d761f057c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.121412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33815f2-dfb8-4bf6-b726-b64d761f057c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.121856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33815f2-dfb8-4bf6-b726-b64d761f057c admin admin] PATH_INFO: `/v3/users/eea0be67cad84d50b65bb359a6b5b46d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.123978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33815f2-dfb8-4bf6-b726-b64d761f057c admin admin] RBAC: Authorizing `identity:get_user(user_id=eea0be67cad84d50b65bb359a6b5b46d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:50.126425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33815f2-dfb8-4bf6-b726-b64d761f057c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:50.128514 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 131/273] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:50 2021] GET /identity/v3/users/eea0be67cad84d50b65bb359a6b5b46d => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:50.134928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f9f2a-a96c-47d4-b44a-d1d23eed828d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:50.143911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9ca81-5203-4217-996e-1981d0114f7d None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.144196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9ca81-5203-4217-996e-1981d0114f7d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.144480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9ca81-5203-4217-996e-1981d0114f7d None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.146280 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 132/274] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:50.147390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f9f2a-a96c-47d4-b44a-d1d23eed828d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:50.150948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c1e13-317a-4522-9d22-85cbdfaa8af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:50.151660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c1e13-317a-4522-9d22-85cbdfaa8af2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.152009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c1e13-317a-4522-9d22-85cbdfaa8af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.152351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c1e13-317a-4522-9d22-85cbdfaa8af2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.152742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de229-3329-482c-9eb3-8b5ca7551e85 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.153167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de229-3329-482c-9eb3-8b5ca7551e85 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.153590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de229-3329-482c-9eb3-8b5ca7551e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.161979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c1e13-317a-4522-9d22-85cbdfaa8af2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:50.163833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c1e13-317a-4522-9d22-85cbdfaa8af2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:50.172969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-716de229-3329-482c-9eb3-8b5ca7551e85 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:50.174025 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 143/275] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:50.174651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-716de229-3329-482c-9eb3-8b5ca7551e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:50.180924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c1e13-317a-4522-9d22-85cbdfaa8af2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:50.193803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c1e13-317a-4522-9d22-85cbdfaa8af2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:50.195541 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 133/276] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:50.202138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42498e57-8f6a-4f06-8b05-162145b9fd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:50.203028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42498e57-8f6a-4f06-8b05-162145b9fd97 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.203312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42498e57-8f6a-4f06-8b05-162145b9fd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.203589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42498e57-8f6a-4f06-8b05-162145b9fd97 admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.204780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42498e57-8f6a-4f06-8b05-162145b9fd97 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:50.206860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42498e57-8f6a-4f06-8b05-162145b9fd97 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:50.208762 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 144/277] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:50 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:50.214926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716de229-3329-482c-9eb3-8b5ca7551e85 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:50.225036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42498e57-8f6a-4f06-8b05-162145b9fd97 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:50.227964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716de229-3329-482c-9eb3-8b5ca7551e85 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:50.235769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68fb4e-53ab-4204-9943-482629fcb004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:50.235943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42498e57-8f6a-4f06-8b05-162145b9fd97 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:50.236984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68fb4e-53ab-4204-9943-482629fcb004 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.237465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68fb4e-53ab-4204-9943-482629fcb004 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.238006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68fb4e-53ab-4204-9943-482629fcb004 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.239076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68fb4e-53ab-4204-9943-482629fcb004 admin admin] RBAC: Adding query filter params (role.id=d9c784a85e0540d0abdfedac9386a842, scope.project.id=c0aa413232f44947b73617ef1bf8ba55, user.id=eea0be67cad84d50b65bb359a6b5b46d) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:50.239606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68fb4e-53ab-4204-9943-482629fcb004 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:50.241613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765b935-ded7-4a8e-94f6-7b9ddffb6c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:50.242096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68fb4e-53ab-4204-9943-482629fcb004 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:50.242427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765b935-ded7-4a8e-94f6-7b9ddffb6c26 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.242711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765b935-ded7-4a8e-94f6-7b9ddffb6c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.242984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765b935-ded7-4a8e-94f6-7b9ddffb6c26 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.250384 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 134/278] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:50 2021] GET /identity/v3/role_assignments?user.id=eea0be67cad84d50b65bb359a6b5b46d&scope.project.id=c0aa413232f44947b73617ef1bf8ba55&role.id=d9c784a85e0540d0abdfedac9386a842 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:50.260054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765b935-ded7-4a8e-94f6-7b9ddffb6c26 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:50.267621 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-7765b935-ded7-4a8e-94f6-7b9ddffb6c26 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 18 20:31:50.269284 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 145/279] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:50 2021] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:50.276480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68fb4e-53ab-4204-9943-482629fcb004 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:50.287704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68fb4e-53ab-4204-9943-482629fcb004 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:50.292709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103a015-ee6a-4140-bce5-741e971a3592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:50.293730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103a015-ee6a-4140-bce5-741e971a3592 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.294213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103a015-ee6a-4140-bce5-741e971a3592 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.295352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103a015-ee6a-4140-bce5-741e971a3592 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.296364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103a015-ee6a-4140-bce5-741e971a3592 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:50.296902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103a015-ee6a-4140-bce5-741e971a3592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:50.298759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103a015-ee6a-4140-bce5-741e971a3592 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:50.304707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424867be-6f6c-43aa-aaf8-24b26f9a5741 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.304993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424867be-6f6c-43aa-aaf8-24b26f9a5741 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.305273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424867be-6f6c-43aa-aaf8-24b26f9a5741 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.308131 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 146/280] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:31:50.309364 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 135/281] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:50 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:50.314281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f57b5-9bd3-4e03-94cd-3f116a493f3b None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.314281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f57b5-9bd3-4e03-94cd-3f116a493f3b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.314281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f57b5-9bd3-4e03-94cd-3f116a493f3b None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.314741 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 147/282] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:50.315216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e49e0f-d0f2-48ea-8baa-d3456fa9a4ff None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.315697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e49e0f-d0f2-48ea-8baa-d3456fa9a4ff None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.315885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e49e0f-d0f2-48ea-8baa-d3456fa9a4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.318173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f57b5-9bd3-4e03-94cd-3f116a493f3b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:50.332089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f57b5-9bd3-4e03-94cd-3f116a493f3b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:50.336366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-09e49e0f-d0f2-48ea-8baa-d3456fa9a4ff None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:50.336531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded65c1-c3cd-4b97-81be-c6534ce2018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:50.337317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded65c1-c3cd-4b97-81be-c6534ce2018a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.337598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded65c1-c3cd-4b97-81be-c6534ce2018a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.337693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-09e49e0f-d0f2-48ea-8baa-d3456fa9a4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:50.337866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded65c1-c3cd-4b97-81be-c6534ce2018a admin admin] PATH_INFO: `/v3/users/453defdf57e947a899a34839ab961027` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.339154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded65c1-c3cd-4b97-81be-c6534ce2018a admin admin] RBAC: Authorizing `identity:get_user(user_id=453defdf57e947a899a34839ab961027)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:50.341280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded65c1-c3cd-4b97-81be-c6534ce2018a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:50.343676 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 148/283] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:50 2021] GET /identity/v3/users/453defdf57e947a899a34839ab961027 => generated 297 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:50.348541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44cb59-345b-4b76-b4b8-dd56c7c1450f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.348541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44cb59-345b-4b76-b4b8-dd56c7c1450f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.348541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44cb59-345b-4b76-b4b8-dd56c7c1450f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.358338 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 136/284] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:50.358338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e49e0f-d0f2-48ea-8baa-d3456fa9a4ff None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:50.364215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e49e0f-d0f2-48ea-8baa-d3456fa9a4ff None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:50.367774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3f44cb59-345b-4b76-b4b8-dd56c7c1450f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:50.368666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff2aa1-9f2b-4645-9ce8-37d7b7b8c7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:50.369123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3f44cb59-345b-4b76-b4b8-dd56c7c1450f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:50.369526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff2aa1-9f2b-4645-9ce8-37d7b7b8c7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.369804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff2aa1-9f2b-4645-9ce8-37d7b7b8c7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.370076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff2aa1-9f2b-4645-9ce8-37d7b7b8c7a6 admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.371327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff2aa1-9f2b-4645-9ce8-37d7b7b8c7a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:50.373429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff2aa1-9f2b-4645-9ce8-37d7b7b8c7a6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:50.375534 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 137/285] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:50 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:50.380893 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 149/286] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:50.383863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff2aa1-9f2b-4645-9ce8-37d7b7b8c7a6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:50.391609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44cb59-345b-4b76-b4b8-dd56c7c1450f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:50.394840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff2aa1-9f2b-4645-9ce8-37d7b7b8c7a6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:50.400598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb7277-ce14-4c1e-ae2a-bffca8a05a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:50.401171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44cb59-345b-4b76-b4b8-dd56c7c1450f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:50.401556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb7277-ce14-4c1e-ae2a-bffca8a05a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.401841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb7277-ce14-4c1e-ae2a-bffca8a05a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.402159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb7277-ce14-4c1e-ae2a-bffca8a05a0e admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55/users/453defdf57e947a899a34839ab961027/roles/495c6a4a0775416b980691a2de0b403c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.405355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb7277-ce14-4c1e-ae2a-bffca8a05a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0aa413232f44947b73617ef1bf8ba55, user_id=453defdf57e947a899a34839ab961027, role_id=495c6a4a0775416b980691a2de0b403c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:50.406380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519ecca-ff21-4446-bc89-599c77a93d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:50.407239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519ecca-ff21-4446-bc89-599c77a93d9d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.407523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519ecca-ff21-4446-bc89-599c77a93d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.407808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519ecca-ff21-4446-bc89-599c77a93d9d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.408077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb7277-ce14-4c1e-ae2a-bffca8a05a0e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:50.421438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519ecca-ff21-4446-bc89-599c77a93d9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:50.424497 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 138/287] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:31:50 2021] PUT /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55/users/453defdf57e947a899a34839ab961027/roles/495c6a4a0775416b980691a2de0b403c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:31:50.429143 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-8519ecca-ff21-4446-bc89-599c77a93d9d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:31:50.430644 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 150/288] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:50.432024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb7277-ce14-4c1e-ae2a-bffca8a05a0e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:50.438044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519ecca-ff21-4446-bc89-599c77a93d9d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:50.448805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519ecca-ff21-4446-bc89-599c77a93d9d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:50.512240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb7277-ce14-4c1e-ae2a-bffca8a05a0e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:50.519396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee2c3c-74ca-46ce-a71f-2639a5348315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:50.519396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee2c3c-74ca-46ce-a71f-2639a5348315 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.519396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee2c3c-74ca-46ce-a71f-2639a5348315 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.519736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee2c3c-74ca-46ce-a71f-2639a5348315 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.520850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee2c3c-74ca-46ce-a71f-2639a5348315 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:50.522601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee2c3c-74ca-46ce-a71f-2639a5348315 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:50.524498 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 139/289] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:31:50 2021] GET /identity/v3/domains/default => generated 199 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:50.525719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dc73a-7722-4d62-b10b-2dbe3246afb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:50.527192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dc73a-7722-4d62-b10b-2dbe3246afb3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.527192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dc73a-7722-4d62-b10b-2dbe3246afb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.527192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dc73a-7722-4d62-b10b-2dbe3246afb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.527805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79dc73a-7722-4d62-b10b-2dbe3246afb3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:50.528110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79dc73a-7722-4d62-b10b-2dbe3246afb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:50.529885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79dc73a-7722-4d62-b10b-2dbe3246afb3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:50.531048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee2c3c-74ca-46ce-a71f-2639a5348315 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:50.542309 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 151/290] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:50.546105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee2c3c-74ca-46ce-a71f-2639a5348315 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:50.548068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dc73a-7722-4d62-b10b-2dbe3246afb3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:50.551192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bbd77-12e3-41f8-850a-9655a7304931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:50.551874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bbd77-12e3-41f8-850a-9655a7304931 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.552152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bbd77-12e3-41f8-850a-9655a7304931 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.552425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bbd77-12e3-41f8-850a-9655a7304931 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.553202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bbd77-12e3-41f8-850a-9655a7304931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:50.557804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bbd77-12e3-41f8-850a-9655a7304931 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:50.560464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dc73a-7722-4d62-b10b-2dbe3246afb3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:50.566623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ca45e-b084-42fc-bba3-da51a2bbe914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:50.567542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ca45e-b084-42fc-bba3-da51a2bbe914 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.567824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ca45e-b084-42fc-bba3-da51a2bbe914 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.568135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ca45e-b084-42fc-bba3-da51a2bbe914 admin admin] PATH_INFO: `/v3/users/be441a3c09c34d9db100fce559f9f50e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.583811 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 140/291] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:31:50 2021] POST /identity/v3/users => generated 293 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:31:50.587390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ca45e-b084-42fc-bba3-da51a2bbe914 admin admin] RBAC: Authorizing `identity:get_user(user_id=be441a3c09c34d9db100fce559f9f50e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:50.589578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ca45e-b084-42fc-bba3-da51a2bbe914 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:50.592388 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 152/292] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:50 2021] GET /identity/v3/users/be441a3c09c34d9db100fce559f9f50e => generated 293 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:50.599183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bbd77-12e3-41f8-850a-9655a7304931 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:50.613430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bbd77-12e3-41f8-850a-9655a7304931 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:50.618196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4601fa-e5ac-4310-8f23-0790ac72c38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:50.619038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4601fa-e5ac-4310-8f23-0790ac72c38f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:50.619416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4601fa-e5ac-4310-8f23-0790ac72c38f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:50.619758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4601fa-e5ac-4310-8f23-0790ac72c38f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:50.620820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4601fa-e5ac-4310-8f23-0790ac72c38f admin admin] RBAC: Adding query filter params (role.id=d9c784a85e0540d0abdfedac9386a842, user.id=be441a3c09c34d9db100fce559f9f50e, scope.system=all) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:50.621204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4601fa-e5ac-4310-8f23-0790ac72c38f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:50.623296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4601fa-e5ac-4310-8f23-0790ac72c38f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:50.634486 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 141/293] 10.222.0.13 () {56 vars in 1329 bytes} [Sat Dec 18 20:31:50 2021] GET /identity/v3/role_assignments?user.id=be441a3c09c34d9db100fce559f9f50e&scope.system=all&role.id=d9c784a85e0540d0abdfedac9386a842 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:52.926738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba315bf-a50f-47ac-aa5f-01deaee1c749 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:52.927951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba315bf-a50f-47ac-aa5f-01deaee1c749 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:52.928434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba315bf-a50f-47ac-aa5f-01deaee1c749 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:52.930448 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 153/294] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:52.937577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2f129-994c-400f-8e77-10a0986d5580 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:52.938709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2f129-994c-400f-8e77-10a0986d5580 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:52.939177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2f129-994c-400f-8e77-10a0986d5580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:52.958540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e3f2f129-994c-400f-8e77-10a0986d5580 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:52.960143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e3f2f129-994c-400f-8e77-10a0986d5580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:52.971979 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 142/295] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:52.997202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba315bf-a50f-47ac-aa5f-01deaee1c749 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:53.010225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba315bf-a50f-47ac-aa5f-01deaee1c749 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:53.015516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6d146-ab08-4597-820c-f857389b4be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:53.016549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6d146-ab08-4597-820c-f857389b4be0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.017054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6d146-ab08-4597-820c-f857389b4be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.017519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6d146-ab08-4597-820c-f857389b4be0 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.028472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6d146-ab08-4597-820c-f857389b4be0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:53.036208 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-5fc6d146-ab08-4597-820c-f857389b4be0 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 18 20:31:53.037585 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 154/296] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:52 2021] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:53.043908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2f129-994c-400f-8e77-10a0986d5580 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:53.053236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2f129-994c-400f-8e77-10a0986d5580 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:53.057899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63acdea-466d-4437-92c0-3ad5bd87d694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:53.058803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63acdea-466d-4437-92c0-3ad5bd87d694 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.059279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63acdea-466d-4437-92c0-3ad5bd87d694 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.059763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63acdea-466d-4437-92c0-3ad5bd87d694 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.061508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63acdea-466d-4437-92c0-3ad5bd87d694 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:53.062023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63acdea-466d-4437-92c0-3ad5bd87d694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:53.063852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63acdea-466d-4437-92c0-3ad5bd87d694 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:53.072762 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 143/297] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:53 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:53.078938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6d146-ab08-4597-820c-f857389b4be0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:53.088799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6d146-ab08-4597-820c-f857389b4be0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:53.093912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b832a0-5e1b-4773-9182-863ebc2426b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:53.095018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b832a0-5e1b-4773-9182-863ebc2426b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.095493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b832a0-5e1b-4773-9182-863ebc2426b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.096000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b832a0-5e1b-4773-9182-863ebc2426b0 admin admin] PATH_INFO: `/v3/users/453defdf57e947a899a34839ab961027` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.097391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b832a0-5e1b-4773-9182-863ebc2426b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=453defdf57e947a899a34839ab961027)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:53.099184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5be5f5-0238-4dbe-bfcd-0575c0661804 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.099473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5be5f5-0238-4dbe-bfcd-0575c0661804 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.099752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5be5f5-0238-4dbe-bfcd-0575c0661804 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.100398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b832a0-5e1b-4773-9182-863ebc2426b0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:53.101524 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 144/298] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:31:53.102645 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 155/299] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:53 2021] GET /identity/v3/users/453defdf57e947a899a34839ab961027 => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:53.107337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3f1a3-bc65-4561-8a4d-4e382b9d6fb4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.107629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3f1a3-bc65-4561-8a4d-4e382b9d6fb4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.107901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3f1a3-bc65-4561-8a4d-4e382b9d6fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.109345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b832a0-5e1b-4773-9182-863ebc2426b0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:53.121163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b832a0-5e1b-4773-9182-863ebc2426b0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:53.126086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e7d25-7cc0-480d-a86d-e8d3db91a091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:53.126770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e7d25-7cc0-480d-a86d-e8d3db91a091 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.127054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e7d25-7cc0-480d-a86d-e8d3db91a091 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.127334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e7d25-7cc0-480d-a86d-e8d3db91a091 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.127607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-50e3f1a3-bc65-4561-8a4d-4e382b9d6fb4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:53.129164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-50e3f1a3-bc65-4561-8a4d-4e382b9d6fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:53.135557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e7d25-7cc0-480d-a86d-e8d3db91a091 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:53.137280 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 145/300] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:53.138444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e7d25-7cc0-480d-a86d-e8d3db91a091 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:53.147761 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 156/301] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:53 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:53.155386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3f1a3-bc65-4561-8a4d-4e382b9d6fb4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:53.164922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3f1a3-bc65-4561-8a4d-4e382b9d6fb4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:53.166723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e7d25-7cc0-480d-a86d-e8d3db91a091 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:53.171135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090019a2-4070-45fb-bcd2-24f94b76099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:53.172081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090019a2-4070-45fb-bcd2-24f94b76099d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.172367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090019a2-4070-45fb-bcd2-24f94b76099d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.172756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090019a2-4070-45fb-bcd2-24f94b76099d admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.174550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090019a2-4070-45fb-bcd2-24f94b76099d admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:53.177854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090019a2-4070-45fb-bcd2-24f94b76099d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:53.179951 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 146/302] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:53 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:53.180567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e7d25-7cc0-480d-a86d-e8d3db91a091 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:53.186682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090019a2-4070-45fb-bcd2-24f94b76099d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:53.187477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb2869-ecb2-4b90-ab11-6d6217a64cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:53.188523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb2869-ecb2-4b90-ab11-6d6217a64cee admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.189121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb2869-ecb2-4b90-ab11-6d6217a64cee admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.189600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb2869-ecb2-4b90-ab11-6d6217a64cee admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.197877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090019a2-4070-45fb-bcd2-24f94b76099d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:53.205859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73f02b-b8c7-4b08-a761-aeea067736b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:53.205859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73f02b-b8c7-4b08-a761-aeea067736b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.205859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73f02b-b8c7-4b08-a761-aeea067736b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.205859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73f02b-b8c7-4b08-a761-aeea067736b7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.206203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73f02b-b8c7-4b08-a761-aeea067736b7 admin admin] RBAC: Adding query filter params (role.id=495c6a4a0775416b980691a2de0b403c, scope.project.id=c0aa413232f44947b73617ef1bf8ba55, user.id=453defdf57e947a899a34839ab961027) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:53.206203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73f02b-b8c7-4b08-a761-aeea067736b7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:53.208650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73f02b-b8c7-4b08-a761-aeea067736b7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:53.211602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb2869-ecb2-4b90-ab11-6d6217a64cee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:53.217911 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 147/303] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:31:53 2021] GET /identity/v3/role_assignments?user.id=453defdf57e947a899a34839ab961027&scope.project.id=c0aa413232f44947b73617ef1bf8ba55&role.id=495c6a4a0775416b980691a2de0b403c => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:53.220699 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-d5fb2869-ecb2-4b90-ab11-6d6217a64cee admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:31:53.222440 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 157/304] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:53 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:53.229256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73f02b-b8c7-4b08-a761-aeea067736b7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:53.252946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73f02b-b8c7-4b08-a761-aeea067736b7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:53.258447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0d512-643e-4479-8e84-a925787444d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:53.259475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0d512-643e-4479-8e84-a925787444d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.259933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0d512-643e-4479-8e84-a925787444d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.260586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0d512-643e-4479-8e84-a925787444d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.261548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0d512-643e-4479-8e84-a925787444d3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:53.262033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0d512-643e-4479-8e84-a925787444d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:53.264160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0d512-643e-4479-8e84-a925787444d3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:53.274302 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 148/305] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:53 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:53.281346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb2869-ecb2-4b90-ab11-6d6217a64cee admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:53.293358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb2869-ecb2-4b90-ab11-6d6217a64cee admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:53.301541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c731e8-067d-4f34-ac46-c1e9e15fab90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:53.302829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c731e8-067d-4f34-ac46-c1e9e15fab90 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.303289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c731e8-067d-4f34-ac46-c1e9e15fab90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.303740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c731e8-067d-4f34-ac46-c1e9e15fab90 admin admin] PATH_INFO: `/v3/users/be441a3c09c34d9db100fce559f9f50e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.305299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c731e8-067d-4f34-ac46-c1e9e15fab90 admin admin] RBAC: Authorizing `identity:get_user(user_id=be441a3c09c34d9db100fce559f9f50e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:53.307751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c731e8-067d-4f34-ac46-c1e9e15fab90 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:53.310032 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 158/306] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:53 2021] GET /identity/v3/users/be441a3c09c34d9db100fce559f9f50e => generated 293 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:53.316754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0d512-643e-4479-8e84-a925787444d3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:53.327514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0d512-643e-4479-8e84-a925787444d3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:53.332445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f9e45-7aa1-4d75-9257-ab577f1ee71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:53.333550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f9e45-7aa1-4d75-9257-ab577f1ee71b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.334031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f9e45-7aa1-4d75-9257-ab577f1ee71b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.334513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f9e45-7aa1-4d75-9257-ab577f1ee71b admin admin] PATH_INFO: `/v3/system/users/be441a3c09c34d9db100fce559f9f50e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.336228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f9e45-7aa1-4d75-9257-ab577f1ee71b admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=be441a3c09c34d9db100fce559f9f50e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:53.337564 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-eb9f9e45-7aa1-4d75-9257-ab577f1ee71b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:53.337564 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:31:53.337564 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:31:53.338817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f9e45-7aa1-4d75-9257-ab577f1ee71b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:53.341970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2a637-f2e9-4296-a780-2fa3596967c1 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.342283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2a637-f2e9-4296-a780-2fa3596967c1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.342596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2a637-f2e9-4296-a780-2fa3596967c1 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.344520 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 159/307] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:53.352189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a8a1-982c-4f53-96f7-13f128b1775e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.352563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a8a1-982c-4f53-96f7-13f128b1775e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.352867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a8a1-982c-4f53-96f7-13f128b1775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.355299 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 149/308] 10.222.0.13 () {58 vars in 1355 bytes} [Sat Dec 18 20:31:53 2021] PUT /identity/v3/system/users/be441a3c09c34d9db100fce559f9f50e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:31:53.375634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2f41a8a1-982c-4f53-96f7-13f128b1775e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:53.376976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2f41a8a1-982c-4f53-96f7-13f128b1775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:53.385594 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 160/309] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:53.413303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f9e45-7aa1-4d75-9257-ab577f1ee71b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:53.419773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28b4bb-5344-4462-b54e-344c0b2c3672 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.420425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28b4bb-5344-4462-b54e-344c0b2c3672 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.420699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28b4bb-5344-4462-b54e-344c0b2c3672 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.423846 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 161/310] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:53.429845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f9e45-7aa1-4d75-9257-ab577f1ee71b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:53.433338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df647033-6a3c-4a37-943d-6304be044c69 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.433629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df647033-6a3c-4a37-943d-6304be044c69 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.433914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df647033-6a3c-4a37-943d-6304be044c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.437145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba654d5d-6532-46a3-b474-e45a6facd0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:53.438275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba654d5d-6532-46a3-b474-e45a6facd0ca admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.438681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba654d5d-6532-46a3-b474-e45a6facd0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.439052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba654d5d-6532-46a3-b474-e45a6facd0ca admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.452734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba654d5d-6532-46a3-b474-e45a6facd0ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:53.455872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-df647033-6a3c-4a37-943d-6304be044c69 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:53.457159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-df647033-6a3c-4a37-943d-6304be044c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:53.461326 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-ba654d5d-6532-46a3-b474-e45a6facd0ca admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 18 20:31:53.462782 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 150/311] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:53 2021] GET /identity/v3/roles/reader => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:53.469798 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 162/312] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:53.469986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba654d5d-6532-46a3-b474-e45a6facd0ca admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:53.480350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba654d5d-6532-46a3-b474-e45a6facd0ca admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:53.486275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd2078-d2b1-4f6f-b1fe-2f6680ff6c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:53.487089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd2078-d2b1-4f6f-b1fe-2f6680ff6c65 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.487449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd2078-d2b1-4f6f-b1fe-2f6680ff6c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.487804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd2078-d2b1-4f6f-b1fe-2f6680ff6c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.488664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd2078-d2b1-4f6f-b1fe-2f6680ff6c65 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:53.489125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd2078-d2b1-4f6f-b1fe-2f6680ff6c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:53.491967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd2078-d2b1-4f6f-b1fe-2f6680ff6c65 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:53.497741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df647033-6a3c-4a37-943d-6304be044c69 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:53.503960 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 151/313] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:53 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:53.506612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df647033-6a3c-4a37-943d-6304be044c69 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:53.510904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd2078-d2b1-4f6f-b1fe-2f6680ff6c65 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:53.514841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900dd92-9c1c-47e9-94f0-d7cfb2a59c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:53.515687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900dd92-9c1c-47e9-94f0-d7cfb2a59c39 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.515972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900dd92-9c1c-47e9-94f0-d7cfb2a59c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.516251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900dd92-9c1c-47e9-94f0-d7cfb2a59c39 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.517464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900dd92-9c1c-47e9-94f0-d7cfb2a59c39 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:53.519219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900dd92-9c1c-47e9-94f0-d7cfb2a59c39 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:53.521039 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 163/314] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:31:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:53.522279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd2078-d2b1-4f6f-b1fe-2f6680ff6c65 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:53.526869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3177e-bbc0-45b4-a60a-8565662a87cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:53.527073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900dd92-9c1c-47e9-94f0-d7cfb2a59c39 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:53.527993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3177e-bbc0-45b4-a60a-8565662a87cd admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.528376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3177e-bbc0-45b4-a60a-8565662a87cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.528785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3177e-bbc0-45b4-a60a-8565662a87cd admin admin] PATH_INFO: `/v3/users/2b9b23a2978940939251a85f60b6af4f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.541111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900dd92-9c1c-47e9-94f0-d7cfb2a59c39 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:53.545826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a4928-3305-41bc-b0de-70f9cb7a4c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:53.549533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a4928-3305-41bc-b0de-70f9cb7a4c8f admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.549687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3177e-bbc0-45b4-a60a-8565662a87cd admin admin] RBAC: Authorizing `identity:get_user(user_id=2b9b23a2978940939251a85f60b6af4f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:53.549766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a4928-3305-41bc-b0de-70f9cb7a4c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.549766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a4928-3305-41bc-b0de-70f9cb7a4c8f admin admin] PATH_INFO: `/v3/groups` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.549766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a4928-3305-41bc-b0de-70f9cb7a4c8f admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:53.549766 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-813a4928-3305-41bc-b0de-70f9cb7a4c8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:53.549766 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:31:53.549766 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:31:53.550184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3177e-bbc0-45b4-a60a-8565662a87cd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:53.550274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a4928-3305-41bc-b0de-70f9cb7a4c8f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:53.550599 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 152/315] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:53 2021] GET /identity/v3/users/2b9b23a2978940939251a85f60b6af4f => generated 293 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:53.558919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3177e-bbc0-45b4-a60a-8565662a87cd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:53.571137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3177e-bbc0-45b4-a60a-8565662a87cd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:53.574180 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 164/316] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Dec 18 20:31:53 2021] POST /identity/v3/groups => generated 229 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:31:53.580146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c261e69-3add-48da-a624-126a5ea64ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:53.580939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c261e69-3add-48da-a624-126a5ea64ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:53.581292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c261e69-3add-48da-a624-126a5ea64ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:53.581676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c261e69-3add-48da-a624-126a5ea64ce8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:53.582759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c261e69-3add-48da-a624-126a5ea64ce8 admin admin] RBAC: Adding query filter params (role.id=495c6a4a0775416b980691a2de0b403c, user.id=2b9b23a2978940939251a85f60b6af4f, scope.system=all) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:53.583196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c261e69-3add-48da-a624-126a5ea64ce8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:53.585294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c261e69-3add-48da-a624-126a5ea64ce8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:53.593478 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 153/317] 10.222.0.13 () {56 vars in 1329 bytes} [Sat Dec 18 20:31:53 2021] GET /identity/v3/role_assignments?user.id=2b9b23a2978940939251a85f60b6af4f&scope.system=all&role.id=495c6a4a0775416b980691a2de0b403c => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:55.818688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66c1d-f45b-4724-a52d-ae4862aad944 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:55.819364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66c1d-f45b-4724-a52d-ae4862aad944 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:55.819364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66c1d-f45b-4724-a52d-ae4862aad944 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:55.821034 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 165/318] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:55.826944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51036b7e-97d0-4c53-9cfa-a50a0a250d4b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:55.827349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51036b7e-97d0-4c53-9cfa-a50a0a250d4b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:55.827513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51036b7e-97d0-4c53-9cfa-a50a0a250d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:55.844717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-51036b7e-97d0-4c53-9cfa-a50a0a250d4b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:55.845884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-51036b7e-97d0-4c53-9cfa-a50a0a250d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:55.853726 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 154/319] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:55.879003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed66c1d-f45b-4724-a52d-ae4862aad944 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:55.891308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed66c1d-f45b-4724-a52d-ae4862aad944 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:55.895407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40b510-231f-453b-af5e-084b68ebc098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:55.896175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40b510-231f-453b-af5e-084b68ebc098 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:55.896454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40b510-231f-453b-af5e-084b68ebc098 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:55.896726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40b510-231f-453b-af5e-084b68ebc098 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:55.906839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40b510-231f-453b-af5e-084b68ebc098 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:55.913572 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-0a40b510-231f-453b-af5e-084b68ebc098 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:31:55.914973 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 166/320] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:55.921495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51036b7e-97d0-4c53-9cfa-a50a0a250d4b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:55.930703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51036b7e-97d0-4c53-9cfa-a50a0a250d4b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:55.935648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23980c6b-0d9b-4751-9dee-394bfb1f9982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:55.936718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23980c6b-0d9b-4751-9dee-394bfb1f9982 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:55.937064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23980c6b-0d9b-4751-9dee-394bfb1f9982 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:55.937405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23980c6b-0d9b-4751-9dee-394bfb1f9982 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:55.938224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23980c6b-0d9b-4751-9dee-394bfb1f9982 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:55.938702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23980c6b-0d9b-4751-9dee-394bfb1f9982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:55.940291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23980c6b-0d9b-4751-9dee-394bfb1f9982 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:55.948580 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 155/321] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:55.954666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40b510-231f-453b-af5e-084b68ebc098 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:55.964913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40b510-231f-453b-af5e-084b68ebc098 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:55.969365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e1da9-9249-42a5-899d-25293bf3c376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:55.970125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e1da9-9249-42a5-899d-25293bf3c376 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:55.970449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e1da9-9249-42a5-899d-25293bf3c376 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:55.970724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e1da9-9249-42a5-899d-25293bf3c376 admin admin] PATH_INFO: `/v3/users/be441a3c09c34d9db100fce559f9f50e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:55.971922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e1da9-9249-42a5-899d-25293bf3c376 admin admin] RBAC: Authorizing `identity:get_user(user_id=be441a3c09c34d9db100fce559f9f50e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:55.974013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e1da9-9249-42a5-899d-25293bf3c376 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:55.975801 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 167/322] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:55 2021] GET /identity/v3/users/be441a3c09c34d9db100fce559f9f50e => generated 293 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:55.981646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23980c6b-0d9b-4751-9dee-394bfb1f9982 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:55.991933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23980c6b-0d9b-4751-9dee-394bfb1f9982 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:55.996259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2de722-6e41-4b07-918d-3a25c777e2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:55.996897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2de722-6e41-4b07-918d-3a25c777e2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:55.997175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2de722-6e41-4b07-918d-3a25c777e2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:55.997449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2de722-6e41-4b07-918d-3a25c777e2d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:55.998540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2de722-6e41-4b07-918d-3a25c777e2d8 admin admin] RBAC: Adding query filter params (role.id=d9c784a85e0540d0abdfedac9386a842, user.id=be441a3c09c34d9db100fce559f9f50e, scope.system=all) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:55.998852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2de722-6e41-4b07-918d-3a25c777e2d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:55.999696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f9956-39b8-44e7-babd-7de37f8202f9 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:55.999986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f9956-39b8-44e7-babd-7de37f8202f9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:56.000267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f9956-39b8-44e7-babd-7de37f8202f9 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:56.000680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2de722-6e41-4b07-918d-3a25c777e2d8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:56.002135 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 168/323] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:31:56.007889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599e7d8-1b31-44ed-a0c8-8f60dccbd8a5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:56.008181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599e7d8-1b31-44ed-a0c8-8f60dccbd8a5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:56.008458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599e7d8-1b31-44ed-a0c8-8f60dccbd8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:56.020759 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 156/324] 10.222.0.13 () {56 vars in 1329 bytes} [Sat Dec 18 20:31:55 2021] GET /identity/v3/role_assignments?user.id=be441a3c09c34d9db100fce559f9f50e&scope.system=all&role.id=d9c784a85e0540d0abdfedac9386a842 => generated 510 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:56.026809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d599e7d8-1b31-44ed-a0c8-8f60dccbd8a5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:56.028024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d599e7d8-1b31-44ed-a0c8-8f60dccbd8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:56.037419 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 169/325] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:56.061915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2de722-6e41-4b07-918d-3a25c777e2d8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:56.072063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2de722-6e41-4b07-918d-3a25c777e2d8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:56.073355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdfa16-c899-4895-b4e1-3e00986a462d None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:56.073652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdfa16-c899-4895-b4e1-3e00986a462d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:56.073936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdfa16-c899-4895-b4e1-3e00986a462d None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:56.076572 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 170/326] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:56.077107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443e5ce-e657-4629-9c94-bd867289a1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:56.077898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443e5ce-e657-4629-9c94-bd867289a1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:56.078178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443e5ce-e657-4629-9c94-bd867289a1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:56.078532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443e5ce-e657-4629-9c94-bd867289a1a6 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:56.082908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b230d00-8441-4f49-ade5-ccada28215c6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:56.083213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b230d00-8441-4f49-ade5-ccada28215c6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:56.083485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b230d00-8441-4f49-ade5-ccada28215c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:56.090504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443e5ce-e657-4629-9c94-bd867289a1a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:56.097439 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-4443e5ce-e657-4629-9c94-bd867289a1a6 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 18 20:31:56.098723 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 157/327] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:56 2021] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:56.103845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7b230d00-8441-4f49-ade5-ccada28215c6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:56.105053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443e5ce-e657-4629-9c94-bd867289a1a6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:56.105290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7b230d00-8441-4f49-ade5-ccada28215c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:56.113228 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 171/328] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:56.115963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443e5ce-e657-4629-9c94-bd867289a1a6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:56.120323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f578e-8706-4a80-8c1f-d8b584d56ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:56.120996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f578e-8706-4a80-8c1f-d8b584d56ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:56.121275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f578e-8706-4a80-8c1f-d8b584d56ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:56.121546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f578e-8706-4a80-8c1f-d8b584d56ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:56.122332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f578e-8706-4a80-8c1f-d8b584d56ba2 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:56.123173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f578e-8706-4a80-8c1f-d8b584d56ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:56.124783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f578e-8706-4a80-8c1f-d8b584d56ba2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:56.133949 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 158/329] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:56 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:56.139033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b230d00-8441-4f49-ade5-ccada28215c6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:56.140346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f578e-8706-4a80-8c1f-d8b584d56ba2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:56.148266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b230d00-8441-4f49-ade5-ccada28215c6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:56.150066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f578e-8706-4a80-8c1f-d8b584d56ba2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:56.152922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77014f1b-bed3-4a4f-ab9c-70246ee9d485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:56.153779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77014f1b-bed3-4a4f-ab9c-70246ee9d485 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:56.154063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77014f1b-bed3-4a4f-ab9c-70246ee9d485 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:56.154366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77014f1b-bed3-4a4f-ab9c-70246ee9d485 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:56.154700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29816bbb-4106-4638-b57c-867ef2d42402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:56.155582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29816bbb-4106-4638-b57c-867ef2d42402 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:56.155677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77014f1b-bed3-4a4f-ab9c-70246ee9d485 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:56.155862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29816bbb-4106-4638-b57c-867ef2d42402 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:56.156135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29816bbb-4106-4638-b57c-867ef2d42402 admin admin] PATH_INFO: `/v3/users/2b9b23a2978940939251a85f60b6af4f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:56.157393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29816bbb-4106-4638-b57c-867ef2d42402 admin admin] RBAC: Authorizing `identity:get_user(user_id=2b9b23a2978940939251a85f60b6af4f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:56.157501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77014f1b-bed3-4a4f-ab9c-70246ee9d485 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:56.159627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29816bbb-4106-4638-b57c-867ef2d42402 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:56.166340 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 159/330] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:56 2021] GET /identity/v3/users/2b9b23a2978940939251a85f60b6af4f => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:56.166504 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 172/331] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:31:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:56.166580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29816bbb-4106-4638-b57c-867ef2d42402 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:56.167301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77014f1b-bed3-4a4f-ab9c-70246ee9d485 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:56.176466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29816bbb-4106-4638-b57c-867ef2d42402 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:56.177762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77014f1b-bed3-4a4f-ab9c-70246ee9d485 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:56.181108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a43e8-83b6-4186-94f5-18f23cd723ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:56.181820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a43e8-83b6-4186-94f5-18f23cd723ab admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:56.182110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a43e8-83b6-4186-94f5-18f23cd723ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:56.182445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a43e8-83b6-4186-94f5-18f23cd723ab admin admin] PATH_INFO: `/v3/groups` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:56.182907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed176a-db7b-42ac-b36b-7c33b7c10e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:56.183168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a43e8-83b6-4186-94f5-18f23cd723ab admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:56.183839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed176a-db7b-42ac-b36b-7c33b7c10e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:56.184129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed176a-db7b-42ac-b36b-7c33b7c10e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:56.184221 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-b15a43e8-83b6-4186-94f5-18f23cd723ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:56.184221 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:31:56.184221 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:31:56.184395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed176a-db7b-42ac-b36b-7c33b7c10e8d admin admin] PATH_INFO: `/v3/system/users/2b9b23a2978940939251a85f60b6af4f/roles/495c6a4a0775416b980691a2de0b403c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:56.185912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a43e8-83b6-4186-94f5-18f23cd723ab admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:56.186939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed176a-db7b-42ac-b36b-7c33b7c10e8d admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2b9b23a2978940939251a85f60b6af4f, role_id=495c6a4a0775416b980691a2de0b403c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:56.188082 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-f6ed176a-db7b-42ac-b36b-7c33b7c10e8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:56.188082 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:31:56.188082 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:31:56.189447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed176a-db7b-42ac-b36b-7c33b7c10e8d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:56.200107 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 173/332] 10.222.0.13 () {58 vars in 1355 bytes} [Sat Dec 18 20:31:56 2021] PUT /identity/v3/system/users/2b9b23a2978940939251a85f60b6af4f/roles/495c6a4a0775416b980691a2de0b403c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:31:56.203816 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 160/333] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Dec 18 20:31:56 2021] POST /identity/v3/groups => generated 226 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:31:59.371468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d475de8-ca24-4f40-9463-3f9f8fbad5fa None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.372041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d475de8-ca24-4f40-9463-3f9f8fbad5fa None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.372041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d475de8-ca24-4f40-9463-3f9f8fbad5fa None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.374095 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 174/334] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:59.387147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14b22e-e681-425c-a2ce-68119f8824ac None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.387649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14b22e-e681-425c-a2ce-68119f8824ac None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.387740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14b22e-e681-425c-a2ce-68119f8824ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.414407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-dc14b22e-e681-425c-a2ce-68119f8824ac None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:59.415616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dc14b22e-e681-425c-a2ce-68119f8824ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:59.428652 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 161/335] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:59.463716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094b09b-83b9-42f0-836e-3fe5b6f374c1 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.464032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094b09b-83b9-42f0-836e-3fe5b6f374c1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.464283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094b09b-83b9-42f0-836e-3fe5b6f374c1 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.466087 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 175/336] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:31:59.473323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14b22e-e681-425c-a2ce-68119f8824ac None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:59.476519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc70e6f-6b3f-4578-850b-91f059aa5e7b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.477135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc70e6f-6b3f-4578-850b-91f059aa5e7b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.477661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc70e6f-6b3f-4578-850b-91f059aa5e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.484988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14b22e-e681-425c-a2ce-68119f8824ac None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:59.494414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc62252-fabc-4506-a304-6065dd1567a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:59.495247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc62252-fabc-4506-a304-6065dd1567a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.495521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc62252-fabc-4506-a304-6065dd1567a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.495798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc62252-fabc-4506-a304-6065dd1567a6 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.520366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc62252-fabc-4506-a304-6065dd1567a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:59.521682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0cc70e6f-6b3f-4578-850b-91f059aa5e7b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:59.523215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0cc70e6f-6b3f-4578-850b-91f059aa5e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:59.533409 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-5cc62252-fabc-4506-a304-6065dd1567a6 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 18 20:31:59.534825 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 162/337] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:59 2021] GET /identity/v3/roles/reader => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:31:59.540610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc62252-fabc-4506-a304-6065dd1567a6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:59.542528 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 176/338] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:31:59.555381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc62252-fabc-4506-a304-6065dd1567a6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:59.560108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa89d24-1b58-4b73-9c7c-7f89e3f272cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:59.560766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa89d24-1b58-4b73-9c7c-7f89e3f272cf admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.561059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa89d24-1b58-4b73-9c7c-7f89e3f272cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.561594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa89d24-1b58-4b73-9c7c-7f89e3f272cf admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.562393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa89d24-1b58-4b73-9c7c-7f89e3f272cf admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:59.562704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa89d24-1b58-4b73-9c7c-7f89e3f272cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:59.564312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa89d24-1b58-4b73-9c7c-7f89e3f272cf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:59.573767 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 163/339] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:59 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:59.581145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc70e6f-6b3f-4578-850b-91f059aa5e7b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:59.584499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683daa-dde9-4f1b-94bd-c4650d2073c0 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.584787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683daa-dde9-4f1b-94bd-c4650d2073c0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.585065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683daa-dde9-4f1b-94bd-c4650d2073c0 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.586877 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 164/340] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:31:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:31:59.594208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79683daa-dde9-4f1b-94bd-c4650d2073c0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:59.597911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc70e6f-6b3f-4578-850b-91f059aa5e7b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:59.605282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdcc4a-6e7d-41e2-aab0-56c45474835c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:59.606340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdcc4a-6e7d-41e2-aab0-56c45474835c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.607263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdcc4a-6e7d-41e2-aab0-56c45474835c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.607263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdcc4a-6e7d-41e2-aab0-56c45474835c admin admin] PATH_INFO: `/v3/users/2b9b23a2978940939251a85f60b6af4f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.608629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdcc4a-6e7d-41e2-aab0-56c45474835c admin admin] RBAC: Authorizing `identity:get_user(user_id=2b9b23a2978940939251a85f60b6af4f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:59.612904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdcc4a-6e7d-41e2-aab0-56c45474835c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:59.613306 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 177/341] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:31:59 2021] GET /identity/v3/users/2b9b23a2978940939251a85f60b6af4f => generated 293 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:59.617959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758b33d-df59-4c96-b77d-a5593eb3a682 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.617959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758b33d-df59-4c96-b77d-a5593eb3a682 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.617959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758b33d-df59-4c96-b77d-a5593eb3a682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.618894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79683daa-dde9-4f1b-94bd-c4650d2073c0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:59.627479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa098c-a607-41f8-b7d3-9384fdf1a77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:59.628957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa098c-a607-41f8-b7d3-9384fdf1a77c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.629402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa098c-a607-41f8-b7d3-9384fdf1a77c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.629831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa098c-a607-41f8-b7d3-9384fdf1a77c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.636693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7758b33d-df59-4c96-b77d-a5593eb3a682 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:31:59.638665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7758b33d-df59-4c96-b77d-a5593eb3a682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:31:59.646057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa098c-a607-41f8-b7d3-9384fdf1a77c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:59.647956 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 178/342] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:31:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:31:59.648851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758b33d-df59-4c96-b77d-a5593eb3a682 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:59.654110 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-05fa098c-a607-41f8-b7d3-9384fdf1a77c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:31:59.657366 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 165/343] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:59 2021] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:31:59.660879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758b33d-df59-4c96-b77d-a5593eb3a682 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:59.666110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa098c-a607-41f8-b7d3-9384fdf1a77c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:59.668989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535d75e-cbe9-43e6-a766-205ea4f609e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:59.670325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535d75e-cbe9-43e6-a766-205ea4f609e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.670715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535d75e-cbe9-43e6-a766-205ea4f609e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.671095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535d75e-cbe9-43e6-a766-205ea4f609e4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.672046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535d75e-cbe9-43e6-a766-205ea4f609e4 admin admin] RBAC: Adding query filter params (role.id=495c6a4a0775416b980691a2de0b403c, user.id=2b9b23a2978940939251a85f60b6af4f, scope.system=all) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:59.672477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535d75e-cbe9-43e6-a766-205ea4f609e4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:59.677693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535d75e-cbe9-43e6-a766-205ea4f609e4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:59.692095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa098c-a607-41f8-b7d3-9384fdf1a77c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:59.707331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3db5c-316a-410d-90b8-f5721dc26695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:59.708811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3db5c-316a-410d-90b8-f5721dc26695 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.715178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3db5c-316a-410d-90b8-f5721dc26695 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.715628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3db5c-316a-410d-90b8-f5721dc26695 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.716617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3db5c-316a-410d-90b8-f5721dc26695 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:59.717074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3db5c-316a-410d-90b8-f5721dc26695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:59.718891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3db5c-316a-410d-90b8-f5721dc26695 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:59.724978 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 179/344] 10.222.0.13 () {56 vars in 1329 bytes} [Sat Dec 18 20:31:59 2021] GET /identity/v3/role_assignments?user.id=2b9b23a2978940939251a85f60b6af4f&scope.system=all&role.id=495c6a4a0775416b980691a2de0b403c => generated 510 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:59.745957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535d75e-cbe9-43e6-a766-205ea4f609e4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:59.754685 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 166/345] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:59 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:59.758772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535d75e-cbe9-43e6-a766-205ea4f609e4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:59.763480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3db5c-316a-410d-90b8-f5721dc26695 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:59.775028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d118a3-7ce3-4747-9663-432306497bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:59.775263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3db5c-316a-410d-90b8-f5721dc26695 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:59.776445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d118a3-7ce3-4747-9663-432306497bda admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.776940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d118a3-7ce3-4747-9663-432306497bda admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.777423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d118a3-7ce3-4747-9663-432306497bda admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.782749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283ef1a-131c-42d2-94d2-46d5a0a051b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:59.783418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283ef1a-131c-42d2-94d2-46d5a0a051b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.783702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283ef1a-131c-42d2-94d2-46d5a0a051b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.783983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283ef1a-131c-42d2-94d2-46d5a0a051b5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.798630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d118a3-7ce3-4747-9663-432306497bda admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:31:59.806097 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-f8d118a3-7ce3-4747-9663-432306497bda admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:31:59.807870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283ef1a-131c-42d2-94d2-46d5a0a051b5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:59.809958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283ef1a-131c-42d2-94d2-46d5a0a051b5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:59.816348 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 180/346] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:31:59 2021] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:31:59.822559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d118a3-7ce3-4747-9663-432306497bda admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:59.829266 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 167/347] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:59 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:59.838138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d118a3-7ce3-4747-9663-432306497bda admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:59.844384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283ef1a-131c-42d2-94d2-46d5a0a051b5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:59.851654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6814e-c425-46a8-b1a7-de5dd9fbe977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:59.852443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6814e-c425-46a8-b1a7-de5dd9fbe977 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.852642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6814e-c425-46a8-b1a7-de5dd9fbe977 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.852992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6814e-c425-46a8-b1a7-de5dd9fbe977 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.853704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6814e-c425-46a8-b1a7-de5dd9fbe977 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:59.854016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6814e-c425-46a8-b1a7-de5dd9fbe977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:59.855708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6814e-c425-46a8-b1a7-de5dd9fbe977 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:59.856273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283ef1a-131c-42d2-94d2-46d5a0a051b5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:59.868274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec27f1f-9722-48f0-b1f4-aec936d43b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:59.870621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27f1f-9722-48f0-b1f4-aec936d43b07 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.871291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27f1f-9722-48f0-b1f4-aec936d43b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.873608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27f1f-9722-48f0-b1f4-aec936d43b07 admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.875328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec27f1f-9722-48f0-b1f4-aec936d43b07 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:59.876105 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 181/348] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:31:59 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:59.878486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec27f1f-9722-48f0-b1f4-aec936d43b07 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:59.881758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6814e-c425-46a8-b1a7-de5dd9fbe977 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:59.886923 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 168/349] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:59 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:31:59.888227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec27f1f-9722-48f0-b1f4-aec936d43b07 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:59.901186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6814e-c425-46a8-b1a7-de5dd9fbe977 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:59.907024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec27f1f-9722-48f0-b1f4-aec936d43b07 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:59.910703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cdd82-f50f-452f-8e53-c53031e60132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:59.911652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cdd82-f50f-452f-8e53-c53031e60132 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.912168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cdd82-f50f-452f-8e53-c53031e60132 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.913300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cdd82-f50f-452f-8e53-c53031e60132 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.923359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a10494-be0d-4d6f-8503-29d3ba6d2ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:59.924581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a10494-be0d-4d6f-8503-29d3ba6d2ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.925091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a10494-be0d-4d6f-8503-29d3ba6d2ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.925571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a10494-be0d-4d6f-8503-29d3ba6d2ce5 admin admin] PATH_INFO: `/v3/groups/349e82a168984d46a30a0734a91c21a7` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.934340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cdd82-f50f-452f-8e53-c53031e60132 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:59.936823 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cdd82-f50f-452f-8e53-c53031e60132 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:59.938499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a10494-be0d-4d6f-8503-29d3ba6d2ce5 admin admin] RBAC: Authorizing `identity:get_group(group_id=349e82a168984d46a30a0734a91c21a7)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:59.944052 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-64a10494-be0d-4d6f-8503-29d3ba6d2ce5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:31:59.944052 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:31:59.944052 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:31:59.945698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a10494-be0d-4d6f-8503-29d3ba6d2ce5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:59.947730 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 169/350] 10.222.0.13 () {56 vars in 1201 bytes} [Sat Dec 18 20:31:59 2021] GET /identity/v3/groups/349e82a168984d46a30a0734a91c21a7 => generated 226 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:31:59.955517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a10494-be0d-4d6f-8503-29d3ba6d2ce5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:59.961115 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 182/351] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:31:59 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:31:59.962304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cdd82-f50f-452f-8e53-c53031e60132 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:31:59.972784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a10494-be0d-4d6f-8503-29d3ba6d2ce5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:59.978957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cdd82-f50f-452f-8e53-c53031e60132 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:31:59.983367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efe130-ef0c-41e1-9790-7d7096bd6ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:59.984339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efe130-ef0c-41e1-9790-7d7096bd6ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.985604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efe130-ef0c-41e1-9790-7d7096bd6ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.986606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efe130-ef0c-41e1-9790-7d7096bd6ad0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.988172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efe130-ef0c-41e1-9790-7d7096bd6ad0 admin admin] RBAC: Adding query filter params (group.id=349e82a168984d46a30a0734a91c21a7, role.id=d9c784a85e0540d0abdfedac9386a842, scope.project.id=c0aa413232f44947b73617ef1bf8ba55) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:31:59.989524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efe130-ef0c-41e1-9790-7d7096bd6ad0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:31:59.991436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4165b4c-ff0c-49d3-9538-9426e8d2500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:31:59.993086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efe130-ef0c-41e1-9790-7d7096bd6ad0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:31:59.994170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4165b4c-ff0c-49d3-9538-9426e8d2500a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:31:59.994710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4165b4c-ff0c-49d3-9538-9426e8d2500a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:31:59.997322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4165b4c-ff0c-49d3-9538-9426e8d2500a admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:31:59.999931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4165b4c-ff0c-49d3-9538-9426e8d2500a admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:00.002189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4165b4c-ff0c-49d3-9538-9426e8d2500a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:00.004459 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 183/352] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:31:59 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:00.009672 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 170/353] 10.222.0.13 () {56 vars in 1397 bytes} [Sat Dec 18 20:31:59 2021] GET /identity/v3/role_assignments?group.id=349e82a168984d46a30a0734a91c21a7&scope.project.id=c0aa413232f44947b73617ef1bf8ba55&role.id=d9c784a85e0540d0abdfedac9386a842 => generated 260 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:00.011054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4165b4c-ff0c-49d3-9538-9426e8d2500a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:00.021517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4165b4c-ff0c-49d3-9538-9426e8d2500a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:00.031511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb09ac-3555-4fff-9ee8-c789f688117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:00.032871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb09ac-3555-4fff-9ee8-c789f688117c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:00.033360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb09ac-3555-4fff-9ee8-c789f688117c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:00.033945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb09ac-3555-4fff-9ee8-c789f688117c admin admin] PATH_INFO: `/v3/groups/349e82a168984d46a30a0734a91c21a7` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:00.036104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb09ac-3555-4fff-9ee8-c789f688117c admin admin] RBAC: Authorizing `identity:get_group(group_id=349e82a168984d46a30a0734a91c21a7)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:00.037421 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-bccb09ac-3555-4fff-9ee8-c789f688117c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:32:00.037421 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:32:00.037421 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:32:00.039071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb09ac-3555-4fff-9ee8-c789f688117c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:00.041482 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 184/354] 10.222.0.13 () {56 vars in 1201 bytes} [Sat Dec 18 20:32:00 2021] GET /identity/v3/groups/349e82a168984d46a30a0734a91c21a7 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:00.048711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efe130-ef0c-41e1-9790-7d7096bd6ad0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:00.067860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efe130-ef0c-41e1-9790-7d7096bd6ad0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:00.078850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2d599-2858-45f3-b20c-6afc3436112e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:00.079514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2d599-2858-45f3-b20c-6afc3436112e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:00.079792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2d599-2858-45f3-b20c-6afc3436112e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:00.080068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2d599-2858-45f3-b20c-6afc3436112e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:00.080914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2d599-2858-45f3-b20c-6afc3436112e admin admin] RBAC: Adding query filter params (group.id=349e82a168984d46a30a0734a91c21a7, role.id=d9c784a85e0540d0abdfedac9386a842, scope.project.id=64298b5848d848fdafaf45401789cb0a) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:00.081225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2d599-2858-45f3-b20c-6afc3436112e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:00.083099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2d599-2858-45f3-b20c-6afc3436112e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:00.094443 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 171/355] 10.222.0.13 () {56 vars in 1397 bytes} [Sat Dec 18 20:32:00 2021] GET /identity/v3/role_assignments?group.id=349e82a168984d46a30a0734a91c21a7&scope.project.id=64298b5848d848fdafaf45401789cb0a&role.id=d9c784a85e0540d0abdfedac9386a842 => generated 260 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:00.171998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeee5e7-d242-4e13-abf6-ed66e88cf2f3 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:00.172600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeee5e7-d242-4e13-abf6-ed66e88cf2f3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:00.173193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeee5e7-d242-4e13-abf6-ed66e88cf2f3 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:00.175457 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 185/356] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:00.189602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246779d0-d7bb-4728-a53f-992828f80fec None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:00.189928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246779d0-d7bb-4728-a53f-992828f80fec None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:00.190161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246779d0-d7bb-4728-a53f-992828f80fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:00.219751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-246779d0-d7bb-4728-a53f-992828f80fec None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:00.220981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-246779d0-d7bb-4728-a53f-992828f80fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:00.229179 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 172/357] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:00.263579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeee5e7-d242-4e13-abf6-ed66e88cf2f3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:00.287158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeee5e7-d242-4e13-abf6-ed66e88cf2f3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:00.292384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117deefd-ae3d-4b7c-bacb-767a81e52159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:00.293566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117deefd-ae3d-4b7c-bacb-767a81e52159 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:00.294077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117deefd-ae3d-4b7c-bacb-767a81e52159 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:00.294643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117deefd-ae3d-4b7c-bacb-767a81e52159 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:00.315454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117deefd-ae3d-4b7c-bacb-767a81e52159 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:00.323084 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-117deefd-ae3d-4b7c-bacb-767a81e52159 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 18 20:32:00.324545 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 186/358] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:32:00 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:00.331763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246779d0-d7bb-4728-a53f-992828f80fec None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:00.345133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246779d0-d7bb-4728-a53f-992828f80fec None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:00.357685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a4046-dd00-408c-9e16-fc6fb2dbc9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:00.358406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a4046-dd00-408c-9e16-fc6fb2dbc9ab admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:00.358687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a4046-dd00-408c-9e16-fc6fb2dbc9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:00.358958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a4046-dd00-408c-9e16-fc6fb2dbc9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:00.359730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a4046-dd00-408c-9e16-fc6fb2dbc9ab admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:00.360034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a4046-dd00-408c-9e16-fc6fb2dbc9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:00.361651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a4046-dd00-408c-9e16-fc6fb2dbc9ab admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:00.377918 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 173/359] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:00 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:00.384390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117deefd-ae3d-4b7c-bacb-767a81e52159 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:00.400218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117deefd-ae3d-4b7c-bacb-767a81e52159 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:00.409467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22ca7a-0479-43fb-8d98-4de25ff99cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:00.410520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22ca7a-0479-43fb-8d98-4de25ff99cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:00.411028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22ca7a-0479-43fb-8d98-4de25ff99cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:00.411738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22ca7a-0479-43fb-8d98-4de25ff99cb6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:00.430420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22ca7a-0479-43fb-8d98-4de25ff99cb6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:00.432569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22ca7a-0479-43fb-8d98-4de25ff99cb6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:00.448287 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 187/360] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:32:00.454726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a4046-dd00-408c-9e16-fc6fb2dbc9ab admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:00.471624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a4046-dd00-408c-9e16-fc6fb2dbc9ab admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:00.479450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f259527-386e-44c5-8e76-16fb10a268d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:00.480352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f259527-386e-44c5-8e76-16fb10a268d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:00.480631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f259527-386e-44c5-8e76-16fb10a268d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:00.480904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f259527-386e-44c5-8e76-16fb10a268d0 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:00.487276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f259527-386e-44c5-8e76-16fb10a268d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:00.489555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f259527-386e-44c5-8e76-16fb10a268d0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:00.491377 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 174/361] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:32:00 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:00.497809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22ca7a-0479-43fb-8d98-4de25ff99cb6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:00.513437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22ca7a-0479-43fb-8d98-4de25ff99cb6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:00.520705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bef5e2-bbfa-4783-a4f6-c079dd789b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:00.521834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bef5e2-bbfa-4783-a4f6-c079dd789b93 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:00.522367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bef5e2-bbfa-4783-a4f6-c079dd789b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:00.522850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bef5e2-bbfa-4783-a4f6-c079dd789b93 admin admin] PATH_INFO: `/v3/groups/349e82a168984d46a30a0734a91c21a7` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:00.525183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bef5e2-bbfa-4783-a4f6-c079dd789b93 admin admin] RBAC: Authorizing `identity:get_group(group_id=349e82a168984d46a30a0734a91c21a7)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:00.527323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bef5e2-bbfa-4783-a4f6-c079dd789b93 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:00.529715 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 188/362] 10.222.0.13 () {56 vars in 1201 bytes} [Sat Dec 18 20:32:00 2021] GET /identity/v3/groups/349e82a168984d46a30a0734a91c21a7 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:00.536812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f259527-386e-44c5-8e76-16fb10a268d0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:00.549654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f259527-386e-44c5-8e76-16fb10a268d0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:00.558098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f5ee7-ed12-4550-b896-d294de87f49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:00.558773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f5ee7-ed12-4550-b896-d294de87f49f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:00.559055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f5ee7-ed12-4550-b896-d294de87f49f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:00.559331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f5ee7-ed12-4550-b896-d294de87f49f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:00.560697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f5ee7-ed12-4550-b896-d294de87f49f admin admin] RBAC: Adding query filter params (group.id=349e82a168984d46a30a0734a91c21a7, role.id=04189c3120df49f6b37322459b571cf1, scope.project.id=64298b5848d848fdafaf45401789cb0a) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:00.561003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f5ee7-ed12-4550-b896-d294de87f49f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:00.563129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f5ee7-ed12-4550-b896-d294de87f49f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:00.572547 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 175/363] 10.222.0.13 () {56 vars in 1397 bytes} [Sat Dec 18 20:32:00 2021] GET /identity/v3/role_assignments?group.id=349e82a168984d46a30a0734a91c21a7&scope.project.id=64298b5848d848fdafaf45401789cb0a&role.id=04189c3120df49f6b37322459b571cf1 => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:00.649704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59653186-e03e-474b-becc-7131f2427ff0 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:00.650024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59653186-e03e-474b-becc-7131f2427ff0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:00.650297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59653186-e03e-474b-becc-7131f2427ff0 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:00.652253 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 189/364] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:00.660410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701e9b-65a7-4864-917e-407d2d2ebc4b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:00.660737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701e9b-65a7-4864-917e-407d2d2ebc4b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:00.661008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701e9b-65a7-4864-917e-407d2d2ebc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:00.689152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5a701e9b-65a7-4864-917e-407d2d2ebc4b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:00.690337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5a701e9b-65a7-4864-917e-407d2d2ebc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:00.699531 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 176/365] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:00.768070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59653186-e03e-474b-becc-7131f2427ff0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:00.785063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59653186-e03e-474b-becc-7131f2427ff0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:00.792701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70208f23-4ead-466e-84f5-35fa32a88233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:00.793514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208f23-4ead-466e-84f5-35fa32a88233 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:00.793804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208f23-4ead-466e-84f5-35fa32a88233 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:00.794084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208f23-4ead-466e-84f5-35fa32a88233 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:00.808601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70208f23-4ead-466e-84f5-35fa32a88233 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:00.816620 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-70208f23-4ead-466e-84f5-35fa32a88233 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 18 20:32:00.817824 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 190/366] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:32:00 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:00.824052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a701e9b-65a7-4864-917e-407d2d2ebc4b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:00.833848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a701e9b-65a7-4864-917e-407d2d2ebc4b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:00.842171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bffa50-c9f9-4eea-99df-99e703ae25f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:00.842889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bffa50-c9f9-4eea-99df-99e703ae25f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:00.843176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bffa50-c9f9-4eea-99df-99e703ae25f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:00.843457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bffa50-c9f9-4eea-99df-99e703ae25f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:00.844234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bffa50-c9f9-4eea-99df-99e703ae25f3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:00.844545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bffa50-c9f9-4eea-99df-99e703ae25f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:00.846175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bffa50-c9f9-4eea-99df-99e703ae25f3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:00.860068 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 177/367] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:00 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:00.866201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70208f23-4ead-466e-84f5-35fa32a88233 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:00.879334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70208f23-4ead-466e-84f5-35fa32a88233 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:00.885570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb383a1-15fc-4af9-be4a-20686d115549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:00.886223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb383a1-15fc-4af9-be4a-20686d115549 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:00.886551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb383a1-15fc-4af9-be4a-20686d115549 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:00.886836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb383a1-15fc-4af9-be4a-20686d115549 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:00.897988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb383a1-15fc-4af9-be4a-20686d115549 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:00.899802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb383a1-15fc-4af9-be4a-20686d115549 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:00.910335 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 191/368] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:32:00.916150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bffa50-c9f9-4eea-99df-99e703ae25f3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:00.926634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bffa50-c9f9-4eea-99df-99e703ae25f3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:00.935527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebcf29-f4bc-44b3-8bc4-c0a30cc57bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:00.936648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebcf29-f4bc-44b3-8bc4-c0a30cc57bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:00.936934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebcf29-f4bc-44b3-8bc4-c0a30cc57bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:00.937213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebcf29-f4bc-44b3-8bc4-c0a30cc57bc7 admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:00.939727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebcf29-f4bc-44b3-8bc4-c0a30cc57bc7 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:00.941731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebcf29-f4bc-44b3-8bc4-c0a30cc57bc7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:00.943837 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 178/369] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:32:00 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:00.949721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb383a1-15fc-4af9-be4a-20686d115549 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:00.958950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb383a1-15fc-4af9-be4a-20686d115549 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:00.970744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46169753-07ab-438e-be4c-c80d3948a717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:00.970744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46169753-07ab-438e-be4c-c80d3948a717 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:00.970744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46169753-07ab-438e-be4c-c80d3948a717 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:00.970744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46169753-07ab-438e-be4c-c80d3948a717 admin admin] PATH_INFO: `/v3/groups/349e82a168984d46a30a0734a91c21a7` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:00.972043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46169753-07ab-438e-be4c-c80d3948a717 admin admin] RBAC: Authorizing `identity:get_group(group_id=349e82a168984d46a30a0734a91c21a7)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:00.974147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46169753-07ab-438e-be4c-c80d3948a717 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:00.976446 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 192/370] 10.222.0.13 () {56 vars in 1201 bytes} [Sat Dec 18 20:32:00 2021] GET /identity/v3/groups/349e82a168984d46a30a0734a91c21a7 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:00.983121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebcf29-f4bc-44b3-8bc4-c0a30cc57bc7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:00.996092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebcf29-f4bc-44b3-8bc4-c0a30cc57bc7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:01.005604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68801872-22b1-4b5f-8f9f-985c765a5286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:01.006276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68801872-22b1-4b5f-8f9f-985c765a5286 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:01.006575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68801872-22b1-4b5f-8f9f-985c765a5286 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:01.006858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68801872-22b1-4b5f-8f9f-985c765a5286 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:01.007705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68801872-22b1-4b5f-8f9f-985c765a5286 admin admin] RBAC: Adding query filter params (group.id=349e82a168984d46a30a0734a91c21a7, role.id=04189c3120df49f6b37322459b571cf1, scope.project.id=c0aa413232f44947b73617ef1bf8ba55) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:01.008019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68801872-22b1-4b5f-8f9f-985c765a5286 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:01.009858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68801872-22b1-4b5f-8f9f-985c765a5286 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:01.016168 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 179/371] 10.222.0.13 () {56 vars in 1397 bytes} [Sat Dec 18 20:32:00 2021] GET /identity/v3/role_assignments?group.id=349e82a168984d46a30a0734a91c21a7&scope.project.id=c0aa413232f44947b73617ef1bf8ba55&role.id=04189c3120df49f6b37322459b571cf1 => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:01.645929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a110b24-43ce-4590-a7e9-f256ac215755 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:01.646982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a110b24-43ce-4590-a7e9-f256ac215755 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:01.647478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a110b24-43ce-4590-a7e9-f256ac215755 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:01.649739 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 193/372] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:01.655462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595253c1-a8f6-4bab-b44f-9a120722b48d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:01.656326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595253c1-a8f6-4bab-b44f-9a120722b48d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:01.656804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595253c1-a8f6-4bab-b44f-9a120722b48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:01.678735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-595253c1-a8f6-4bab-b44f-9a120722b48d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:01.680225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-595253c1-a8f6-4bab-b44f-9a120722b48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:01.692458 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 180/373] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:01.738377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a110b24-43ce-4590-a7e9-f256ac215755 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:01.753164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a110b24-43ce-4590-a7e9-f256ac215755 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:01.757869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b39d1d-79c4-4cb0-b3a9-29265d4be1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:01.758967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b39d1d-79c4-4cb0-b3a9-29265d4be1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:01.759477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b39d1d-79c4-4cb0-b3a9-29265d4be1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:01.759949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b39d1d-79c4-4cb0-b3a9-29265d4be1d1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:01.775453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b39d1d-79c4-4cb0-b3a9-29265d4be1d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:01.782753 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-14b39d1d-79c4-4cb0-b3a9-29265d4be1d1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:32:01.784501 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 194/374] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:32:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:01.790358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595253c1-a8f6-4bab-b44f-9a120722b48d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:01.801329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595253c1-a8f6-4bab-b44f-9a120722b48d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:01.806108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff1e1b-f4c6-4ba9-855b-5787748aa8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:01.807080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff1e1b-f4c6-4ba9-855b-5787748aa8ab admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:01.807587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff1e1b-f4c6-4ba9-855b-5787748aa8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:01.808076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff1e1b-f4c6-4ba9-855b-5787748aa8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:01.809031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff1e1b-f4c6-4ba9-855b-5787748aa8ab admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:01.809534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff1e1b-f4c6-4ba9-855b-5787748aa8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:01.812215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff1e1b-f4c6-4ba9-855b-5787748aa8ab admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:01.825304 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 181/375] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:01.831591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b39d1d-79c4-4cb0-b3a9-29265d4be1d1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:01.843505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b39d1d-79c4-4cb0-b3a9-29265d4be1d1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:01.848514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c73c23-da05-4ebc-ac2e-5b3652344ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:01.849443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c73c23-da05-4ebc-ac2e-5b3652344ace admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:01.849927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c73c23-da05-4ebc-ac2e-5b3652344ace admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:01.850449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c73c23-da05-4ebc-ac2e-5b3652344ace admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:01.863229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c73c23-da05-4ebc-ac2e-5b3652344ace admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:01.865398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c73c23-da05-4ebc-ac2e-5b3652344ace admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:01.878458 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 195/376] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:01 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:32:01.884907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff1e1b-f4c6-4ba9-855b-5787748aa8ab admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:01.899369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff1e1b-f4c6-4ba9-855b-5787748aa8ab admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:01.904334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1ef1c-5b84-4bd8-ba77-8020e35db9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:01.905460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1ef1c-5b84-4bd8-ba77-8020e35db9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:01.905942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1ef1c-5b84-4bd8-ba77-8020e35db9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:01.906532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1ef1c-5b84-4bd8-ba77-8020e35db9e0 admin admin] PATH_INFO: `/v3/projects/b04c3d19c79d4c208395e97f9d293618` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:01.907941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1ef1c-5b84-4bd8-ba77-8020e35db9e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=b04c3d19c79d4c208395e97f9d293618)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:01.910005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1ef1c-5b84-4bd8-ba77-8020e35db9e0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:01.911971 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 182/377] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:32:01 2021] GET /identity/v3/projects/b04c3d19c79d4c208395e97f9d293618 => generated 344 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:01.917957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c73c23-da05-4ebc-ac2e-5b3652344ace admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:01.931372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c73c23-da05-4ebc-ac2e-5b3652344ace admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:01.937232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb818d58-4896-4cff-800d-c06c9d4ac20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:01.938371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb818d58-4896-4cff-800d-c06c9d4ac20d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:01.938930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb818d58-4896-4cff-800d-c06c9d4ac20d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:01.939415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb818d58-4896-4cff-800d-c06c9d4ac20d admin admin] PATH_INFO: `/v3/groups/8badc6ce46e34587b2f620b97c89edd9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:01.950881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb818d58-4896-4cff-800d-c06c9d4ac20d admin admin] RBAC: Authorizing `identity:get_group(group_id=8badc6ce46e34587b2f620b97c89edd9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:01.953206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb818d58-4896-4cff-800d-c06c9d4ac20d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:01.955210 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 196/378] 10.222.0.13 () {56 vars in 1201 bytes} [Sat Dec 18 20:32:01 2021] GET /identity/v3/groups/8badc6ce46e34587b2f620b97c89edd9 => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:01.961503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1ef1c-5b84-4bd8-ba77-8020e35db9e0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:01.972552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1ef1c-5b84-4bd8-ba77-8020e35db9e0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:01.977431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c6fce-60dc-4b12-b9a8-2793d1060f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:01.978396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c6fce-60dc-4b12-b9a8-2793d1060f6f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:01.978879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c6fce-60dc-4b12-b9a8-2793d1060f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:01.979370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c6fce-60dc-4b12-b9a8-2793d1060f6f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:01.980443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c6fce-60dc-4b12-b9a8-2793d1060f6f admin admin] RBAC: Adding query filter params (group.id=8badc6ce46e34587b2f620b97c89edd9, role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=b04c3d19c79d4c208395e97f9d293618) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:01.980964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c6fce-60dc-4b12-b9a8-2793d1060f6f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:01.988405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c6fce-60dc-4b12-b9a8-2793d1060f6f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:01.995106 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 183/379] 10.222.0.13 () {56 vars in 1397 bytes} [Sat Dec 18 20:32:01 2021] GET /identity/v3/role_assignments?group.id=8badc6ce46e34587b2f620b97c89edd9&scope.project.id=b04c3d19c79d4c208395e97f9d293618&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:03.375111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35012ded-a96e-4376-af30-97994edc4cf0 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:03.376092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35012ded-a96e-4376-af30-97994edc4cf0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:03.376650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35012ded-a96e-4376-af30-97994edc4cf0 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:03.378714 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 197/380] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:03.385047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddba85c-56e4-4702-bd8d-aae35c44ce3e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:03.385873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddba85c-56e4-4702-bd8d-aae35c44ce3e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:03.386370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddba85c-56e4-4702-bd8d-aae35c44ce3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:03.411652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1ddba85c-56e4-4702-bd8d-aae35c44ce3e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:03.413158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1ddba85c-56e4-4702-bd8d-aae35c44ce3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:03.424730 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 184/381] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:03.455109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35012ded-a96e-4376-af30-97994edc4cf0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:03.472382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35012ded-a96e-4376-af30-97994edc4cf0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:03.477061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bd85b-4076-46cc-b7f1-c337f6e8e89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:03.478065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bd85b-4076-46cc-b7f1-c337f6e8e89c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:03.478552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bd85b-4076-46cc-b7f1-c337f6e8e89c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:03.479207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bd85b-4076-46cc-b7f1-c337f6e8e89c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:03.491244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bd85b-4076-46cc-b7f1-c337f6e8e89c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:03.498474 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-fb9bd85b-4076-46cc-b7f1-c337f6e8e89c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:32:03.499869 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 198/382] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:03.506130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddba85c-56e4-4702-bd8d-aae35c44ce3e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:03.516067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddba85c-56e4-4702-bd8d-aae35c44ce3e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:03.521922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed349b64-9a74-4032-b71b-7f80373b2c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:03.522948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed349b64-9a74-4032-b71b-7f80373b2c72 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:03.523408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed349b64-9a74-4032-b71b-7f80373b2c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:03.523857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed349b64-9a74-4032-b71b-7f80373b2c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:03.524786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed349b64-9a74-4032-b71b-7f80373b2c72 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:03.525283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed349b64-9a74-4032-b71b-7f80373b2c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:03.527085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed349b64-9a74-4032-b71b-7f80373b2c72 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:03.535850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fda61-e1ce-4396-8e77-d80222aecd2f None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:03.536402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fda61-e1ce-4396-8e77-d80222aecd2f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:03.536902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fda61-e1ce-4396-8e77-d80222aecd2f None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:03.538912 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 199/383] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:03.541028 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 185/384] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:32:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:03.547187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fda61-e1ce-4396-8e77-d80222aecd2f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:03.556265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9df2e5-ac83-4029-ae57-3ed02e4b2c03 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:03.556265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9df2e5-ac83-4029-ae57-3ed02e4b2c03 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:03.556265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9df2e5-ac83-4029-ae57-3ed02e4b2c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:03.561976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fda61-e1ce-4396-8e77-d80222aecd2f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:03.583164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd247c3-1b9d-4265-b63b-feda5886cd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:03.584027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd247c3-1b9d-4265-b63b-feda5886cd22 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:03.584312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd247c3-1b9d-4265-b63b-feda5886cd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:03.584590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd247c3-1b9d-4265-b63b-feda5886cd22 admin admin] PATH_INFO: `/v3/groups/349e82a168984d46a30a0734a91c21a7` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:03.586800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd247c3-1b9d-4265-b63b-feda5886cd22 admin admin] RBAC: Authorizing `identity:get_group(group_id=349e82a168984d46a30a0734a91c21a7)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:03.588733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd247c3-1b9d-4265-b63b-feda5886cd22 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:03.590362 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 200/385] 10.222.0.13 () {56 vars in 1201 bytes} [Sat Dec 18 20:32:03 2021] GET /identity/v3/groups/349e82a168984d46a30a0734a91c21a7 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:03.596773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd247c3-1b9d-4265-b63b-feda5886cd22 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:03.598045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0d9df2e5-ac83-4029-ae57-3ed02e4b2c03 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:03.599280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0d9df2e5-ac83-4029-ae57-3ed02e4b2c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:03.612057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd247c3-1b9d-4265-b63b-feda5886cd22 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:03.618607 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 186/386] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:32:03.624225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb82b4-b32e-474d-a226-3aa4c3bcf00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:03.625092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb82b4-b32e-474d-a226-3aa4c3bcf00d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:03.625429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb82b4-b32e-474d-a226-3aa4c3bcf00d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:03.625654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb82b4-b32e-474d-a226-3aa4c3bcf00d admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:03.626919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb82b4-b32e-474d-a226-3aa4c3bcf00d admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:03.628963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb82b4-b32e-474d-a226-3aa4c3bcf00d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:03.631656 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 201/387] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:32:03 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:03.636704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9df2e5-ac83-4029-ae57-3ed02e4b2c03 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:03.651177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9df2e5-ac83-4029-ae57-3ed02e4b2c03 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:03.659700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be50ffd-5ed9-4373-b600-12ad84a1a6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:03.660582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be50ffd-5ed9-4373-b600-12ad84a1a6de admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:03.660864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be50ffd-5ed9-4373-b600-12ad84a1a6de admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:03.661143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be50ffd-5ed9-4373-b600-12ad84a1a6de admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55/groups/349e82a168984d46a30a0734a91c21a7/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:03.663182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be50ffd-5ed9-4373-b600-12ad84a1a6de admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0aa413232f44947b73617ef1bf8ba55, group_id=349e82a168984d46a30a0734a91c21a7, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:03.665825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be50ffd-5ed9-4373-b600-12ad84a1a6de admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:03.679590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb82b4-b32e-474d-a226-3aa4c3bcf00d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:03.692473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb82b4-b32e-474d-a226-3aa4c3bcf00d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:03.701885 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 187/388] 10.222.0.13 () {58 vars in 1463 bytes} [Sat Dec 18 20:32:03 2021] PUT /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55/groups/349e82a168984d46a30a0734a91c21a7/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:32:03.780704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80f46e-bfde-4205-bf77-11af9308be4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:03.781544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f46e-bfde-4205-bf77-11af9308be4f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:03.781825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f46e-bfde-4205-bf77-11af9308be4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:03.782100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f46e-bfde-4205-bf77-11af9308be4f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:03.799776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80f46e-bfde-4205-bf77-11af9308be4f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:03.806973 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-4b80f46e-bfde-4205-bf77-11af9308be4f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:32:03.808588 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 202/389] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:32:03.818507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be50ffd-5ed9-4373-b600-12ad84a1a6de admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:03.835552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be50ffd-5ed9-4373-b600-12ad84a1a6de admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:03.846411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c07dec-2327-495e-8141-49a5e7158017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:03.847103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c07dec-2327-495e-8141-49a5e7158017 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:03.847388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c07dec-2327-495e-8141-49a5e7158017 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:03.847665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c07dec-2327-495e-8141-49a5e7158017 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:03.848442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c07dec-2327-495e-8141-49a5e7158017 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:03.848749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c07dec-2327-495e-8141-49a5e7158017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:03.850409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c07dec-2327-495e-8141-49a5e7158017 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:03.869324 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 188/390] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:32:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:03.876635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80f46e-bfde-4205-bf77-11af9308be4f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:03.892450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80f46e-bfde-4205-bf77-11af9308be4f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:03.902875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff48df-8d22-4d49-8935-67b8289956cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:03.903801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff48df-8d22-4d49-8935-67b8289956cf admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:03.904086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff48df-8d22-4d49-8935-67b8289956cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:03.904362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff48df-8d22-4d49-8935-67b8289956cf admin admin] PATH_INFO: `/v3/groups/349e82a168984d46a30a0734a91c21a7` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:03.908480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff48df-8d22-4d49-8935-67b8289956cf admin admin] RBAC: Authorizing `identity:get_group(group_id=349e82a168984d46a30a0734a91c21a7)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:03.910548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff48df-8d22-4d49-8935-67b8289956cf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:03.912288 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 203/391] 10.222.0.13 () {56 vars in 1201 bytes} [Sat Dec 18 20:32:03 2021] GET /identity/v3/groups/349e82a168984d46a30a0734a91c21a7 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:03.918659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c07dec-2327-495e-8141-49a5e7158017 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:03.935821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c07dec-2327-495e-8141-49a5e7158017 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:03.946978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255be58-bdf7-4fbd-98ef-958222816c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:03.947866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255be58-bdf7-4fbd-98ef-958222816c4d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:03.948149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255be58-bdf7-4fbd-98ef-958222816c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:03.948428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255be58-bdf7-4fbd-98ef-958222816c4d admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:03.955233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255be58-bdf7-4fbd-98ef-958222816c4d admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:03.957544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255be58-bdf7-4fbd-98ef-958222816c4d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:03.958770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf63f5-768c-4509-ab23-4924992c72a6 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:03.959063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf63f5-768c-4509-ab23-4924992c72a6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:03.959344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf63f5-768c-4509-ab23-4924992c72a6 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:03.959656 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 189/392] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:32:03 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:03.961091 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 204/393] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:32:03.966092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255be58-bdf7-4fbd-98ef-958222816c4d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:03.967161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43687469-7d58-47cf-9f0d-d59f24eb971c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:03.967456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43687469-7d58-47cf-9f0d-d59f24eb971c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:03.967735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43687469-7d58-47cf-9f0d-d59f24eb971c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:03.977044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255be58-bdf7-4fbd-98ef-958222816c4d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:03.982935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ba18a-2bc1-44e5-9b53-0ce3e613c869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:03.983811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ba18a-2bc1-44e5-9b53-0ce3e613c869 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:03.984086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ba18a-2bc1-44e5-9b53-0ce3e613c869 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:03.984354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ba18a-2bc1-44e5-9b53-0ce3e613c869 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a/groups/349e82a168984d46a30a0734a91c21a7/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:03.986458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ba18a-2bc1-44e5-9b53-0ce3e613c869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64298b5848d848fdafaf45401789cb0a, group_id=349e82a168984d46a30a0734a91c21a7, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:03.989483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ba18a-2bc1-44e5-9b53-0ce3e613c869 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:03.993413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-43687469-7d58-47cf-9f0d-d59f24eb971c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:03.994698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-43687469-7d58-47cf-9f0d-d59f24eb971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:04.006146 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 190/394] 10.222.0.13 () {58 vars in 1463 bytes} [Sat Dec 18 20:32:03 2021] PUT /identity/v3/projects/64298b5848d848fdafaf45401789cb0a/groups/349e82a168984d46a30a0734a91c21a7/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:32:04.096183 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 205/395] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:32:04.132273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ba18a-2bc1-44e5-9b53-0ce3e613c869 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:04.145569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ba18a-2bc1-44e5-9b53-0ce3e613c869 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:04.156608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad914c-2292-4fd8-bc85-126925fb2022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:04.157572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad914c-2292-4fd8-bc85-126925fb2022 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:04.157922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad914c-2292-4fd8-bc85-126925fb2022 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:04.158283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad914c-2292-4fd8-bc85-126925fb2022 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:04.172859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad914c-2292-4fd8-bc85-126925fb2022 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:04.181916 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-cdad914c-2292-4fd8-bc85-126925fb2022 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 18 20:32:04.186957 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 191/396] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:32:04 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:04.193525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43687469-7d58-47cf-9f0d-d59f24eb971c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:04.208858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43687469-7d58-47cf-9f0d-d59f24eb971c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:04.217750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f9aa-4325-4df4-a39f-c0fab23c532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:04.218463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f9aa-4325-4df4-a39f-c0fab23c532d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:04.218755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f9aa-4325-4df4-a39f-c0fab23c532d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:04.219028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f9aa-4325-4df4-a39f-c0fab23c532d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:04.219805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683f9aa-4325-4df4-a39f-c0fab23c532d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:04.220115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683f9aa-4325-4df4-a39f-c0fab23c532d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:04.221746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683f9aa-4325-4df4-a39f-c0fab23c532d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:04.235076 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 206/397] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:04 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:04.241000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad914c-2292-4fd8-bc85-126925fb2022 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:04.251969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad914c-2292-4fd8-bc85-126925fb2022 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:04.266473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51303a-41a8-457b-8a35-61bbe2986a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:04.267398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51303a-41a8-457b-8a35-61bbe2986a6c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:04.267675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51303a-41a8-457b-8a35-61bbe2986a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:04.267996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51303a-41a8-457b-8a35-61bbe2986a6c admin admin] PATH_INFO: `/v3/groups/349e82a168984d46a30a0734a91c21a7` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:04.270403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51303a-41a8-457b-8a35-61bbe2986a6c admin admin] RBAC: Authorizing `identity:get_group(group_id=349e82a168984d46a30a0734a91c21a7)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:04.272443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51303a-41a8-457b-8a35-61bbe2986a6c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:04.274412 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 192/398] 10.222.0.13 () {56 vars in 1201 bytes} [Sat Dec 18 20:32:04 2021] GET /identity/v3/groups/349e82a168984d46a30a0734a91c21a7 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:04.280388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f9aa-4325-4df4-a39f-c0fab23c532d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:04.299717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f9aa-4325-4df4-a39f-c0fab23c532d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:04.313211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bdbf9-c63d-4f22-8130-ce23ded83c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:04.314096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bdbf9-c63d-4f22-8130-ce23ded83c78 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:04.314411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bdbf9-c63d-4f22-8130-ce23ded83c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:04.314691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bdbf9-c63d-4f22-8130-ce23ded83c78 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:04.316008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009bdbf9-c63d-4f22-8130-ce23ded83c78 admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:04.318062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009bdbf9-c63d-4f22-8130-ce23ded83c78 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:04.319938 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 207/399] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:32:04 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:04.326303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51303a-41a8-457b-8a35-61bbe2986a6c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:04.337122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51303a-41a8-457b-8a35-61bbe2986a6c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:04.346609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166601e3-55dd-49ab-b7ff-69741b2f1137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:04.347566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166601e3-55dd-49ab-b7ff-69741b2f1137 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:04.347843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166601e3-55dd-49ab-b7ff-69741b2f1137 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:04.348124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166601e3-55dd-49ab-b7ff-69741b2f1137 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a/groups/349e82a168984d46a30a0734a91c21a7/roles/04189c3120df49f6b37322459b571cf1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:04.353038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166601e3-55dd-49ab-b7ff-69741b2f1137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64298b5848d848fdafaf45401789cb0a, group_id=349e82a168984d46a30a0734a91c21a7, role_id=04189c3120df49f6b37322459b571cf1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:04.355841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166601e3-55dd-49ab-b7ff-69741b2f1137 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:04.364421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acda38e-1bb1-4b97-9956-4a618a2616a4 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:04.364733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acda38e-1bb1-4b97-9956-4a618a2616a4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:04.365039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acda38e-1bb1-4b97-9956-4a618a2616a4 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:04.367078 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 208/400] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:04.374482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b89eaf-2bd4-4781-b952-a60f35bf406f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:04.374771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b89eaf-2bd4-4781-b952-a60f35bf406f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:04.375053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b89eaf-2bd4-4781-b952-a60f35bf406f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:04.384004 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 193/401] 10.222.0.13 () {58 vars in 1463 bytes} [Sat Dec 18 20:32:04 2021] PUT /identity/v3/projects/64298b5848d848fdafaf45401789cb0a/groups/349e82a168984d46a30a0734a91c21a7/roles/04189c3120df49f6b37322459b571cf1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:32:04.408335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-41b89eaf-2bd4-4781-b952-a60f35bf406f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:04.409691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-41b89eaf-2bd4-4781-b952-a60f35bf406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:04.484460 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 209/402] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:32:04.524258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166601e3-55dd-49ab-b7ff-69741b2f1137 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:04.534859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166601e3-55dd-49ab-b7ff-69741b2f1137 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:04.545543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216acdc4-a4e6-48f2-92d1-0d769a6d8bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:04.546542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216acdc4-a4e6-48f2-92d1-0d769a6d8bac admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:04.546888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216acdc4-a4e6-48f2-92d1-0d769a6d8bac admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:04.547224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216acdc4-a4e6-48f2-92d1-0d769a6d8bac admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:04.558836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216acdc4-a4e6-48f2-92d1-0d769a6d8bac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:04.571025 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-216acdc4-a4e6-48f2-92d1-0d769a6d8bac admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 18 20:32:04.572504 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 194/403] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:32:04 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:04.578854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b89eaf-2bd4-4781-b952-a60f35bf406f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:04.587984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b89eaf-2bd4-4781-b952-a60f35bf406f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:04.593162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c332e-dc50-4e25-b0cd-51e0bfca9cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:04.593902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c332e-dc50-4e25-b0cd-51e0bfca9cca admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:04.594274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c332e-dc50-4e25-b0cd-51e0bfca9cca admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:04.594623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c332e-dc50-4e25-b0cd-51e0bfca9cca admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:04.595451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c332e-dc50-4e25-b0cd-51e0bfca9cca admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:04.595829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c332e-dc50-4e25-b0cd-51e0bfca9cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:04.597488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c332e-dc50-4e25-b0cd-51e0bfca9cca admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:04.609917 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 210/404] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:04 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:04.616206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216acdc4-a4e6-48f2-92d1-0d769a6d8bac admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:04.626805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216acdc4-a4e6-48f2-92d1-0d769a6d8bac admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:04.631509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd58c33-667d-47f2-a7ca-8e781aeb8547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:04.632464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd58c33-667d-47f2-a7ca-8e781aeb8547 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:04.632814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd58c33-667d-47f2-a7ca-8e781aeb8547 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:04.633154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd58c33-667d-47f2-a7ca-8e781aeb8547 admin admin] PATH_INFO: `/v3/groups/349e82a168984d46a30a0734a91c21a7` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:04.634578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd58c33-667d-47f2-a7ca-8e781aeb8547 admin admin] RBAC: Authorizing `identity:get_group(group_id=349e82a168984d46a30a0734a91c21a7)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:04.636519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd58c33-667d-47f2-a7ca-8e781aeb8547 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:04.640737 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 195/405] 10.222.0.13 () {56 vars in 1201 bytes} [Sat Dec 18 20:32:04 2021] GET /identity/v3/groups/349e82a168984d46a30a0734a91c21a7 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:04.647058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c332e-dc50-4e25-b0cd-51e0bfca9cca admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:04.658552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c332e-dc50-4e25-b0cd-51e0bfca9cca admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:04.663198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7bf46-f72d-4ffb-aebe-2db10004b86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:04.664152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7bf46-f72d-4ffb-aebe-2db10004b86c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:04.664513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7bf46-f72d-4ffb-aebe-2db10004b86c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:04.664862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7bf46-f72d-4ffb-aebe-2db10004b86c admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:04.666172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7bf46-f72d-4ffb-aebe-2db10004b86c admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:04.668338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7bf46-f72d-4ffb-aebe-2db10004b86c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:04.670757 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 211/406] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:32:04 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:04.677130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd58c33-667d-47f2-a7ca-8e781aeb8547 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:04.692673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd58c33-667d-47f2-a7ca-8e781aeb8547 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:04.697542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04db23-297c-481a-a4cf-febe196b6a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:04.698571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04db23-297c-481a-a4cf-febe196b6a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:04.698923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04db23-297c-481a-a4cf-febe196b6a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:04.699269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04db23-297c-481a-a4cf-febe196b6a85 admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55/groups/349e82a168984d46a30a0734a91c21a7/roles/04189c3120df49f6b37322459b571cf1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:04.702296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04db23-297c-481a-a4cf-febe196b6a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0aa413232f44947b73617ef1bf8ba55, group_id=349e82a168984d46a30a0734a91c21a7, role_id=04189c3120df49f6b37322459b571cf1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:04.705135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04db23-297c-481a-a4cf-febe196b6a85 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:04.731244 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 196/407] 10.222.0.13 () {58 vars in 1463 bytes} [Sat Dec 18 20:32:04 2021] PUT /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55/groups/349e82a168984d46a30a0734a91c21a7/roles/04189c3120df49f6b37322459b571cf1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:32:05.156207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a0224-2b9a-408d-85bf-762acf228697 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:05.156578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a0224-2b9a-408d-85bf-762acf228697 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:05.156762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a0224-2b9a-408d-85bf-762acf228697 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:05.158851 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 212/408] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:05.166980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b729231-cc91-48d6-bcb6-32e4aa6626bb None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:05.166980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b729231-cc91-48d6-bcb6-32e4aa6626bb None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:05.166980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b729231-cc91-48d6-bcb6-32e4aa6626bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:05.187045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5b729231-cc91-48d6-bcb6-32e4aa6626bb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:05.188563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5b729231-cc91-48d6-bcb6-32e4aa6626bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:05.250186 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 197/409] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:05.277412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a0224-2b9a-408d-85bf-762acf228697 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:05.292035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a0224-2b9a-408d-85bf-762acf228697 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:05.296800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b6cfd-9655-4b31-81b0-4073dc705e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:05.297840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b6cfd-9655-4b31-81b0-4073dc705e44 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:05.298353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b6cfd-9655-4b31-81b0-4073dc705e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:05.298825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b6cfd-9655-4b31-81b0-4073dc705e44 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:05.311630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b6cfd-9655-4b31-81b0-4073dc705e44 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:05.320586 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-1b5b6cfd-9655-4b31-81b0-4073dc705e44 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:32:05.326598 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 213/410] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:32:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:05.329347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b729231-cc91-48d6-bcb6-32e4aa6626bb None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:05.338756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b729231-cc91-48d6-bcb6-32e4aa6626bb None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:05.346454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1de1d-527c-404b-b640-3b809517fd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:05.347460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1de1d-527c-404b-b640-3b809517fd0f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:05.347950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1de1d-527c-404b-b640-3b809517fd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:05.348435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1de1d-527c-404b-b640-3b809517fd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:05.349412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1de1d-527c-404b-b640-3b809517fd0f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:05.349944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1de1d-527c-404b-b640-3b809517fd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:05.351851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1de1d-527c-404b-b640-3b809517fd0f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:05.362026 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 198/411] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:05.368456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b6cfd-9655-4b31-81b0-4073dc705e44 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:05.380229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b6cfd-9655-4b31-81b0-4073dc705e44 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:05.391889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30159d2d-67c3-495e-a851-c595a3dbe409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:05.392752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30159d2d-67c3-495e-a851-c595a3dbe409 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:05.393032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30159d2d-67c3-495e-a851-c595a3dbe409 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:05.393307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30159d2d-67c3-495e-a851-c595a3dbe409 admin admin] PATH_INFO: `/v3/groups/8badc6ce46e34587b2f620b97c89edd9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:05.395366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30159d2d-67c3-495e-a851-c595a3dbe409 admin admin] RBAC: Authorizing `identity:get_group(group_id=8badc6ce46e34587b2f620b97c89edd9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:05.397261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30159d2d-67c3-495e-a851-c595a3dbe409 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:05.399201 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 214/412] 10.222.0.13 () {56 vars in 1201 bytes} [Sat Dec 18 20:32:05 2021] GET /identity/v3/groups/8badc6ce46e34587b2f620b97c89edd9 => generated 229 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:05.406016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1de1d-527c-404b-b640-3b809517fd0f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:05.418319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1de1d-527c-404b-b640-3b809517fd0f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:05.426601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d564218-bf81-4313-b735-24cdae4bfb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:05.427657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d564218-bf81-4313-b735-24cdae4bfb52 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:05.428148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d564218-bf81-4313-b735-24cdae4bfb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:05.428569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d564218-bf81-4313-b735-24cdae4bfb52 admin admin] PATH_INFO: `/v3/projects/b04c3d19c79d4c208395e97f9d293618` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:05.430008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d564218-bf81-4313-b735-24cdae4bfb52 admin admin] RBAC: Authorizing `identity:get_project(project_id=b04c3d19c79d4c208395e97f9d293618)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:05.432066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d564218-bf81-4313-b735-24cdae4bfb52 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:05.434322 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 199/413] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:32:05 2021] GET /identity/v3/projects/b04c3d19c79d4c208395e97f9d293618 => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:05.440604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30159d2d-67c3-495e-a851-c595a3dbe409 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:05.451153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30159d2d-67c3-495e-a851-c595a3dbe409 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:05.462666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25a67e-a882-4156-a5ad-64cd5ebdfa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:05.463551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25a67e-a882-4156-a5ad-64cd5ebdfa65 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:05.463831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25a67e-a882-4156-a5ad-64cd5ebdfa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:05.464100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25a67e-a882-4156-a5ad-64cd5ebdfa65 admin admin] PATH_INFO: `/v3/projects/b04c3d19c79d4c208395e97f9d293618/groups/8badc6ce46e34587b2f620b97c89edd9/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:05.471028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25a67e-a882-4156-a5ad-64cd5ebdfa65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b04c3d19c79d4c208395e97f9d293618, group_id=8badc6ce46e34587b2f620b97c89edd9, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:05.473679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25a67e-a882-4156-a5ad-64cd5ebdfa65 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:05.498312 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 215/414] 10.222.0.13 () {58 vars in 1463 bytes} [Sat Dec 18 20:32:05 2021] PUT /identity/v3/projects/b04c3d19c79d4c208395e97f9d293618/groups/8badc6ce46e34587b2f620b97c89edd9/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:32:06.987337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fa899-8335-45e7-ae65-b720ac51c557 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:06.987813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fa899-8335-45e7-ae65-b720ac51c557 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:06.987813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fa899-8335-45e7-ae65-b720ac51c557 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:06.989796 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 200/415] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:06.997884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c5bf5-3efb-419d-ad2e-f1c832a9f315 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:06.998351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c5bf5-3efb-419d-ad2e-f1c832a9f315 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:06.998551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c5bf5-3efb-419d-ad2e-f1c832a9f315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.018015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f21c5bf5-3efb-419d-ad2e-f1c832a9f315 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:07.019294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f21c5bf5-3efb-419d-ad2e-f1c832a9f315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:07.083061 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 216/416] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:07.110085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fa899-8335-45e7-ae65-b720ac51c557 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.122464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fa899-8335-45e7-ae65-b720ac51c557 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.126711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b2e92-66d0-46d2-9537-d7a3271d6054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.127494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2e92-66d0-46d2-9537-d7a3271d6054 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.127774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2e92-66d0-46d2-9537-d7a3271d6054 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.128047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2e92-66d0-46d2-9537-d7a3271d6054 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.139460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b2e92-66d0-46d2-9537-d7a3271d6054 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:07.146169 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-f42b2e92-66d0-46d2-9537-d7a3271d6054 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:32:07.147693 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 201/417] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:07.154026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c5bf5-3efb-419d-ad2e-f1c832a9f315 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.163332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c5bf5-3efb-419d-ad2e-f1c832a9f315 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.168118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdf572-8f6c-4628-8469-cf0a8165c21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.168787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf572-8f6c-4628-8469-cf0a8165c21c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.169732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf572-8f6c-4628-8469-cf0a8165c21c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.170052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf572-8f6c-4628-8469-cf0a8165c21c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.171138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdf572-8f6c-4628-8469-cf0a8165c21c admin admin] RBAC: Adding query filter params (name=member) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:07.171485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdf572-8f6c-4628-8469-cf0a8165c21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:07.173092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdf572-8f6c-4628-8469-cf0a8165c21c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:07.183344 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 217/418] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:07.190733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b2e92-66d0-46d2-9537-d7a3271d6054 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.202435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b2e92-66d0-46d2-9537-d7a3271d6054 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.206996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d73710-4ada-460c-adbb-347abffd789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.207664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d73710-4ada-460c-adbb-347abffd789e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.207942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d73710-4ada-460c-adbb-347abffd789e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.208215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d73710-4ada-460c-adbb-347abffd789e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.217074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d73710-4ada-460c-adbb-347abffd789e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:07.218858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d73710-4ada-460c-adbb-347abffd789e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:07.228261 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 202/419] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:32:07.234920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdf572-8f6c-4628-8469-cf0a8165c21c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.244728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdf572-8f6c-4628-8469-cf0a8165c21c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.249689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9909a-b20e-4682-82ff-eceb2c688b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.250588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9909a-b20e-4682-82ff-eceb2c688b27 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.250871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9909a-b20e-4682-82ff-eceb2c688b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.251147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9909a-b20e-4682-82ff-eceb2c688b27 admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.252350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9909a-b20e-4682-82ff-eceb2c688b27 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:07.254406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9909a-b20e-4682-82ff-eceb2c688b27 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:07.256059 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 218/420] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:07.262205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d73710-4ada-460c-adbb-347abffd789e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.271551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d73710-4ada-460c-adbb-347abffd789e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.276067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35adf0-7e05-4067-a179-6ce2f4391922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.276967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35adf0-7e05-4067-a179-6ce2f4391922 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.277241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35adf0-7e05-4067-a179-6ce2f4391922 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.277562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35adf0-7e05-4067-a179-6ce2f4391922 admin admin] PATH_INFO: `/v3/groups/349e82a168984d46a30a0734a91c21a7` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.280370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35adf0-7e05-4067-a179-6ce2f4391922 admin admin] RBAC: Authorizing `identity:get_group(group_id=349e82a168984d46a30a0734a91c21a7)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:07.282333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35adf0-7e05-4067-a179-6ce2f4391922 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:07.283946 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 203/421] 10.222.0.13 () {56 vars in 1201 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/groups/349e82a168984d46a30a0734a91c21a7 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:07.290727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9909a-b20e-4682-82ff-eceb2c688b27 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.301403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9909a-b20e-4682-82ff-eceb2c688b27 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.305896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68405191-9953-414b-b9c0-286985f40736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.306752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68405191-9953-414b-b9c0-286985f40736 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.307088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68405191-9953-414b-b9c0-286985f40736 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.307367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68405191-9953-414b-b9c0-286985f40736 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.308265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68405191-9953-414b-b9c0-286985f40736 admin admin] RBAC: Adding query filter params (group.id=349e82a168984d46a30a0734a91c21a7, role.id=d9c784a85e0540d0abdfedac9386a842, scope.project.id=c0aa413232f44947b73617ef1bf8ba55) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:07.308579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68405191-9953-414b-b9c0-286985f40736 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:07.310546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68405191-9953-414b-b9c0-286985f40736 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:07.317541 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 219/422] 10.222.0.13 () {56 vars in 1397 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/role_assignments?group.id=349e82a168984d46a30a0734a91c21a7&scope.project.id=c0aa413232f44947b73617ef1bf8ba55&role.id=d9c784a85e0540d0abdfedac9386a842 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:07.631715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac9d1-063c-4bfb-afcc-112c6b92373f None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.632105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac9d1-063c-4bfb-afcc-112c6b92373f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.632290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac9d1-063c-4bfb-afcc-112c6b92373f None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.634328 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 204/423] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:07.640890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0efbc5-7ad0-487c-b3ab-787f77121ec3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.641184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0efbc5-7ad0-487c-b3ab-787f77121ec3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.641450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0efbc5-7ad0-487c-b3ab-787f77121ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.663689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7f0efbc5-7ad0-487c-b3ab-787f77121ec3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:07.664878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7f0efbc5-7ad0-487c-b3ab-787f77121ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:07.676121 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 220/424] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:07.685683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cac4e-d4ed-486a-bd3c-a0fc7188ca0c None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.685963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cac4e-d4ed-486a-bd3c-a0fc7188ca0c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.686529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cac4e-d4ed-486a-bd3c-a0fc7188ca0c None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.688319 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 205/425] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:07.694241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67425ae-789f-4e1f-bd74-c788ce309d98 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.694556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67425ae-789f-4e1f-bd74-c788ce309d98 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.694834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67425ae-789f-4e1f-bd74-c788ce309d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.714726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e67425ae-789f-4e1f-bd74-c788ce309d98 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:07.714893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cac4e-d4ed-486a-bd3c-a0fc7188ca0c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.718273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e67425ae-789f-4e1f-bd74-c788ce309d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:07.724432 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 221/426] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:07.731266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cac4e-d4ed-486a-bd3c-a0fc7188ca0c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.746032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cc24a-a368-42a7-a887-20f342afd951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.746877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cc24a-a368-42a7-a887-20f342afd951 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.747804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cc24a-a368-42a7-a887-20f342afd951 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.748078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cc24a-a368-42a7-a887-20f342afd951 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.751742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67425ae-789f-4e1f-bd74-c788ce309d98 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.760992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67425ae-789f-4e1f-bd74-c788ce309d98 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.765178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cc24a-a368-42a7-a887-20f342afd951 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:07.765576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97d799-a862-46af-82c5-0b1a612b373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.766396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97d799-a862-46af-82c5-0b1a612b373f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.766680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97d799-a862-46af-82c5-0b1a612b373f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.766952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97d799-a862-46af-82c5-0b1a612b373f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.773793 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-5a8cc24a-a368-42a7-a887-20f342afd951 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 18 20:32:07.776665 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 206/427] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:07.780343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97d799-a862-46af-82c5-0b1a612b373f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:07.783139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cc24a-a368-42a7-a887-20f342afd951 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.788564 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-6a97d799-a862-46af-82c5-0b1a612b373f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 18 20:32:07.790132 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 222/428] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:07.792999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cc24a-a368-42a7-a887-20f342afd951 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.796963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97d799-a862-46af-82c5-0b1a612b373f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.798005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a0260-2373-4268-81c1-1b7591015fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.798835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a0260-2373-4268-81c1-1b7591015fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.799118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a0260-2373-4268-81c1-1b7591015fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.799388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a0260-2373-4268-81c1-1b7591015fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.800141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a0260-2373-4268-81c1-1b7591015fb2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:07.800443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a0260-2373-4268-81c1-1b7591015fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:07.802289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a0260-2373-4268-81c1-1b7591015fb2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:07.807158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97d799-a862-46af-82c5-0b1a612b373f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.812884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386f55a-4780-48d4-90ff-5d88f789177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.813544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386f55a-4780-48d4-90ff-5d88f789177b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.813868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386f55a-4780-48d4-90ff-5d88f789177b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.814154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386f55a-4780-48d4-90ff-5d88f789177b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.814960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386f55a-4780-48d4-90ff-5d88f789177b admin admin] RBAC: Adding query filter params (name=member) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:07.815316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386f55a-4780-48d4-90ff-5d88f789177b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:07.816786 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 207/429] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:07.817021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386f55a-4780-48d4-90ff-5d88f789177b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:07.823734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a0260-2373-4268-81c1-1b7591015fb2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.827152 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 223/430] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:07.833174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386f55a-4780-48d4-90ff-5d88f789177b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.837166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a0260-2373-4268-81c1-1b7591015fb2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.841767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef47e3-082a-4576-980d-7dd560de0f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.842437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef47e3-082a-4576-980d-7dd560de0f4e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.842765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef47e3-082a-4576-980d-7dd560de0f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.843043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef47e3-082a-4576-980d-7dd560de0f4e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.847353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386f55a-4780-48d4-90ff-5d88f789177b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.852715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b90d4-9514-4d73-9c64-f3480abafeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.852951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef47e3-082a-4576-980d-7dd560de0f4e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:07.853367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b90d4-9514-4d73-9c64-f3480abafeb9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.853648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b90d4-9514-4d73-9c64-f3480abafeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.853921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b90d4-9514-4d73-9c64-f3480abafeb9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.854668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef47e3-082a-4576-980d-7dd560de0f4e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:07.864159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b90d4-9514-4d73-9c64-f3480abafeb9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:07.865154 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 208/431] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 20:32:07.865929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b90d4-9514-4d73-9c64-f3480abafeb9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:07.876738 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 224/432] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:32:07.879319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef47e3-082a-4576-980d-7dd560de0f4e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.882553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b90d4-9514-4d73-9c64-f3480abafeb9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.888562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef47e3-082a-4576-980d-7dd560de0f4e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.891117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b90d4-9514-4d73-9c64-f3480abafeb9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.893767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2ba60-b353-44b4-9b47-f8b5d2a1d8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.894850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2ba60-b353-44b4-9b47-f8b5d2a1d8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.895211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2ba60-b353-44b4-9b47-f8b5d2a1d8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.895493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2ba60-b353-44b4-9b47-f8b5d2a1d8d0 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.895645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc88113-b7c6-40b8-8392-10c28655d577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.896524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc88113-b7c6-40b8-8392-10c28655d577 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.896775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2ba60-b353-44b4-9b47-f8b5d2a1d8d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:07.896919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc88113-b7c6-40b8-8392-10c28655d577 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.897265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc88113-b7c6-40b8-8392-10c28655d577 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.898553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc88113-b7c6-40b8-8392-10c28655d577 admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:07.899085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2ba60-b353-44b4-9b47-f8b5d2a1d8d0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:07.900674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc88113-b7c6-40b8-8392-10c28655d577 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:07.901053 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 209/433] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:07.902816 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 225/434] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:07.906949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2ba60-b353-44b4-9b47-f8b5d2a1d8d0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.908854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc88113-b7c6-40b8-8392-10c28655d577 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.917984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2ba60-b353-44b4-9b47-f8b5d2a1d8d0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.918229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc88113-b7c6-40b8-8392-10c28655d577 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.924442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be855f9a-b890-4a29-a73c-2a060f29b4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.924652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb18b9-44d4-4a0a-a74b-2a73f478b341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.924842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be855f9a-b890-4a29-a73c-2a060f29b4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.924842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be855f9a-b890-4a29-a73c-2a060f29b4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.925121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb18b9-44d4-4a0a-a74b-2a73f478b341 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.925121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb18b9-44d4-4a0a-a74b-2a73f478b341 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.925394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be855f9a-b890-4a29-a73c-2a060f29b4a1 admin admin] PATH_INFO: `/v3/groups/349e82a168984d46a30a0734a91c21a7` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.925545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb18b9-44d4-4a0a-a74b-2a73f478b341 admin admin] PATH_INFO: `/v3/groups/349e82a168984d46a30a0734a91c21a7` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.929988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be855f9a-b890-4a29-a73c-2a060f29b4a1 admin admin] RBAC: Authorizing `identity:get_group(group_id=349e82a168984d46a30a0734a91c21a7)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:07.930183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb18b9-44d4-4a0a-a74b-2a73f478b341 admin admin] RBAC: Authorizing `identity:get_group(group_id=349e82a168984d46a30a0734a91c21a7)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:07.930363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be855f9a-b890-4a29-a73c-2a060f29b4a1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:07.930513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb18b9-44d4-4a0a-a74b-2a73f478b341 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:07.930513 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 210/436] 10.222.0.13 () {56 vars in 1201 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/groups/349e82a168984d46a30a0734a91c21a7 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:07.930810 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 226/436] 10.222.0.13 () {56 vars in 1201 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/groups/349e82a168984d46a30a0734a91c21a7 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:07.936549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb18b9-44d4-4a0a-a74b-2a73f478b341 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.938655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be855f9a-b890-4a29-a73c-2a060f29b4a1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:07.946542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb18b9-44d4-4a0a-a74b-2a73f478b341 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.952228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be855f9a-b890-4a29-a73c-2a060f29b4a1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:07.957720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc212d-208e-4c88-9576-a41a46d9ab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.958418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc212d-208e-4c88-9576-a41a46d9ab41 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.958698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc212d-208e-4c88-9576-a41a46d9ab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.958972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc212d-208e-4c88-9576-a41a46d9ab41 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.959813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc212d-208e-4c88-9576-a41a46d9ab41 admin admin] RBAC: Adding query filter params (group.id=349e82a168984d46a30a0734a91c21a7, role.id=d9c784a85e0540d0abdfedac9386a842, scope.project.id=64298b5848d848fdafaf45401789cb0a) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:07.960119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc212d-208e-4c88-9576-a41a46d9ab41 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:07.961952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc212d-208e-4c88-9576-a41a46d9ab41 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:07.962688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2bf24-7cb3-486c-9f96-7d8585bcb1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:07.963785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2bf24-7cb3-486c-9f96-7d8585bcb1ce admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:07.964501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2bf24-7cb3-486c-9f96-7d8585bcb1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:07.965580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2bf24-7cb3-486c-9f96-7d8585bcb1ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:07.967207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2bf24-7cb3-486c-9f96-7d8585bcb1ce admin admin] RBAC: Adding query filter params (group.id=349e82a168984d46a30a0734a91c21a7, role.id=04189c3120df49f6b37322459b571cf1, scope.project.id=64298b5848d848fdafaf45401789cb0a) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:07.967726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2bf24-7cb3-486c-9f96-7d8585bcb1ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:07.969949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2bf24-7cb3-486c-9f96-7d8585bcb1ce admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:07.974448 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 211/437] 10.222.0.13 () {56 vars in 1397 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/role_assignments?group.id=349e82a168984d46a30a0734a91c21a7&scope.project.id=64298b5848d848fdafaf45401789cb0a&role.id=d9c784a85e0540d0abdfedac9386a842 => generated 611 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:07.980736 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 227/438] 10.222.0.13 () {56 vars in 1397 bytes} [Sat Dec 18 20:32:07 2021] GET /identity/v3/role_assignments?group.id=349e82a168984d46a30a0734a91c21a7&scope.project.id=64298b5848d848fdafaf45401789cb0a&role.id=04189c3120df49f6b37322459b571cf1 => generated 611 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:08.002969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cf704-573f-4cb7-8ae4-b86fdebbb617 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:08.003477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cf704-573f-4cb7-8ae4-b86fdebbb617 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:08.003685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cf704-573f-4cb7-8ae4-b86fdebbb617 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:08.005896 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 212/439] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:08.012521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319bc76-1d23-4e72-8686-e39152ce0995 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:08.013560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319bc76-1d23-4e72-8686-e39152ce0995 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:08.013631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319bc76-1d23-4e72-8686-e39152ce0995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:08.033545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0319bc76-1d23-4e72-8686-e39152ce0995 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:08.034797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0319bc76-1d23-4e72-8686-e39152ce0995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:08.044727 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 228/440] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:08.073402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cf704-573f-4cb7-8ae4-b86fdebbb617 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:08.087849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cf704-573f-4cb7-8ae4-b86fdebbb617 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:08.094055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0033a78-2949-483c-bb7e-bc22d6921244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:08.095107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0033a78-2949-483c-bb7e-bc22d6921244 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:08.095390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0033a78-2949-483c-bb7e-bc22d6921244 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:08.095671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0033a78-2949-483c-bb7e-bc22d6921244 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:08.108310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0033a78-2949-483c-bb7e-bc22d6921244 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:08.115910 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-e0033a78-2949-483c-bb7e-bc22d6921244 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 18 20:32:08.117481 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 213/441] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:32:08 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:08.124535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319bc76-1d23-4e72-8686-e39152ce0995 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:08.134476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319bc76-1d23-4e72-8686-e39152ce0995 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:08.139353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00019e-23be-43f9-bb43-3ad070c3e288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:08.140053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00019e-23be-43f9-bb43-3ad070c3e288 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:08.140338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00019e-23be-43f9-bb43-3ad070c3e288 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:08.140621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00019e-23be-43f9-bb43-3ad070c3e288 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:08.141421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00019e-23be-43f9-bb43-3ad070c3e288 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:08.141732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00019e-23be-43f9-bb43-3ad070c3e288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:08.143570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00019e-23be-43f9-bb43-3ad070c3e288 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:08.154468 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 229/442] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:08 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:08.160885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0033a78-2949-483c-bb7e-bc22d6921244 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:08.172192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0033a78-2949-483c-bb7e-bc22d6921244 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:08.177093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285160e-1b7a-4f3f-9061-2d369e7081d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:08.177759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285160e-1b7a-4f3f-9061-2d369e7081d2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:08.178091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285160e-1b7a-4f3f-9061-2d369e7081d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:08.178416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285160e-1b7a-4f3f-9061-2d369e7081d2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:08.188767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285160e-1b7a-4f3f-9061-2d369e7081d2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:08.190540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285160e-1b7a-4f3f-9061-2d369e7081d2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:08.201844 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 214/443] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:08 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:32:08.208401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00019e-23be-43f9-bb43-3ad070c3e288 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:08.219705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00019e-23be-43f9-bb43-3ad070c3e288 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:08.224689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65b8e4-1f59-4cc5-8e39-92e25dc6016c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:08.225580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65b8e4-1f59-4cc5-8e39-92e25dc6016c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:08.225867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65b8e4-1f59-4cc5-8e39-92e25dc6016c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:08.226206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65b8e4-1f59-4cc5-8e39-92e25dc6016c admin admin] PATH_INFO: `/v3/projects/c0aa413232f44947b73617ef1bf8ba55` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:08.227540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65b8e4-1f59-4cc5-8e39-92e25dc6016c admin admin] RBAC: Authorizing `identity:get_project(project_id=c0aa413232f44947b73617ef1bf8ba55)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:08.229716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65b8e4-1f59-4cc5-8e39-92e25dc6016c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:08.232273 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 230/444] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:32:08 2021] GET /identity/v3/projects/c0aa413232f44947b73617ef1bf8ba55 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:08.238180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285160e-1b7a-4f3f-9061-2d369e7081d2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:08.248154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285160e-1b7a-4f3f-9061-2d369e7081d2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:08.254556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0117380-fb2f-41c1-b011-1fec4c0c4d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:08.255419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0117380-fb2f-41c1-b011-1fec4c0c4d16 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:08.255703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0117380-fb2f-41c1-b011-1fec4c0c4d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:08.255980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0117380-fb2f-41c1-b011-1fec4c0c4d16 admin admin] PATH_INFO: `/v3/groups/349e82a168984d46a30a0734a91c21a7` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:08.257179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0117380-fb2f-41c1-b011-1fec4c0c4d16 admin admin] RBAC: Authorizing `identity:get_group(group_id=349e82a168984d46a30a0734a91c21a7)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:08.259122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0117380-fb2f-41c1-b011-1fec4c0c4d16 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:08.260726 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 215/445] 10.222.0.13 () {56 vars in 1201 bytes} [Sat Dec 18 20:32:08 2021] GET /identity/v3/groups/349e82a168984d46a30a0734a91c21a7 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:08.268349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65b8e4-1f59-4cc5-8e39-92e25dc6016c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:08.279560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65b8e4-1f59-4cc5-8e39-92e25dc6016c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:08.284950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837303b1-569d-4c2b-abe4-8ce39e67a6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:08.285734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837303b1-569d-4c2b-abe4-8ce39e67a6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:08.286025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837303b1-569d-4c2b-abe4-8ce39e67a6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:08.286397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837303b1-569d-4c2b-abe4-8ce39e67a6c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:08.287248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837303b1-569d-4c2b-abe4-8ce39e67a6c7 admin admin] RBAC: Adding query filter params (group.id=349e82a168984d46a30a0734a91c21a7, role.id=04189c3120df49f6b37322459b571cf1, scope.project.id=c0aa413232f44947b73617ef1bf8ba55) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:08.287561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837303b1-569d-4c2b-abe4-8ce39e67a6c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:08.289629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837303b1-569d-4c2b-abe4-8ce39e67a6c7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:08.297655 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 231/446] 10.222.0.13 () {56 vars in 1397 bytes} [Sat Dec 18 20:32:08 2021] GET /identity/v3/role_assignments?group.id=349e82a168984d46a30a0734a91c21a7&scope.project.id=c0aa413232f44947b73617ef1bf8ba55&role.id=04189c3120df49f6b37322459b571cf1 => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:09.021940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c22d7e-1371-4e86-ac77-8d6295f94df0 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:09.022465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c22d7e-1371-4e86-ac77-8d6295f94df0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:09.022465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c22d7e-1371-4e86-ac77-8d6295f94df0 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:09.024193 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 216/447] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:09.030545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d9fa1-97e2-4323-bcd5-4667785ac5bd None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:09.030975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d9fa1-97e2-4323-bcd5-4667785ac5bd None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:09.031111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d9fa1-97e2-4323-bcd5-4667785ac5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:09.050157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fa8d9fa1-97e2-4323-bcd5-4667785ac5bd None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:09.051603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fa8d9fa1-97e2-4323-bcd5-4667785ac5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:09.059429 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 232/448] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:09.084521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c22d7e-1371-4e86-ac77-8d6295f94df0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:09.097476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c22d7e-1371-4e86-ac77-8d6295f94df0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:09.101881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09768973-4753-4b99-b1fa-fc37e8bb80b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:09.102694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09768973-4753-4b99-b1fa-fc37e8bb80b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:09.102977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09768973-4753-4b99-b1fa-fc37e8bb80b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:09.103251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09768973-4753-4b99-b1fa-fc37e8bb80b8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:09.113883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09768973-4753-4b99-b1fa-fc37e8bb80b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:09.120595 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-09768973-4753-4b99-b1fa-fc37e8bb80b8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:32:09.121735 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 217/449] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:32:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:09.127873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d9fa1-97e2-4323-bcd5-4667785ac5bd None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:09.140329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d9fa1-97e2-4323-bcd5-4667785ac5bd None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:09.144939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b9668-675d-45a5-b5ba-725c7d5776be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:09.145602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b9668-675d-45a5-b5ba-725c7d5776be admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:09.145885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b9668-675d-45a5-b5ba-725c7d5776be admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:09.146160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b9668-675d-45a5-b5ba-725c7d5776be admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:09.146956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b9668-675d-45a5-b5ba-725c7d5776be admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:09.147269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b9668-675d-45a5-b5ba-725c7d5776be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:09.148849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b9668-675d-45a5-b5ba-725c7d5776be admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:09.157201 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 233/450] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:09.163305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09768973-4753-4b99-b1fa-fc37e8bb80b8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:09.173722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09768973-4753-4b99-b1fa-fc37e8bb80b8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:09.178410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b24cb3-d243-4702-bf71-431431da9908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:09.179045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b24cb3-d243-4702-bf71-431431da9908 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:09.179327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b24cb3-d243-4702-bf71-431431da9908 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:09.179602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b24cb3-d243-4702-bf71-431431da9908 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:09.188433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b24cb3-d243-4702-bf71-431431da9908 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:09.190165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b24cb3-d243-4702-bf71-431431da9908 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:09.200583 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 218/451] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:09 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:32:09.208331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b9668-675d-45a5-b5ba-725c7d5776be admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:09.220385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b9668-675d-45a5-b5ba-725c7d5776be admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:09.224850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa7c02-b8fe-4a8c-8ddd-8b43c1dae5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:09.225688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa7c02-b8fe-4a8c-8ddd-8b43c1dae5ef admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:09.225970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa7c02-b8fe-4a8c-8ddd-8b43c1dae5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:09.226278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa7c02-b8fe-4a8c-8ddd-8b43c1dae5ef admin admin] PATH_INFO: `/v3/projects/b04c3d19c79d4c208395e97f9d293618` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:09.227491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa7c02-b8fe-4a8c-8ddd-8b43c1dae5ef admin admin] RBAC: Authorizing `identity:get_project(project_id=b04c3d19c79d4c208395e97f9d293618)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:09.229467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa7c02-b8fe-4a8c-8ddd-8b43c1dae5ef admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:09.231147 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 234/452] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:32:09 2021] GET /identity/v3/projects/b04c3d19c79d4c208395e97f9d293618 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:09.237161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b24cb3-d243-4702-bf71-431431da9908 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:09.246538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b24cb3-d243-4702-bf71-431431da9908 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:09.251234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fbf20-974f-4489-a311-8c13ce76a594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:09.252063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fbf20-974f-4489-a311-8c13ce76a594 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:09.252347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fbf20-974f-4489-a311-8c13ce76a594 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:09.252627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fbf20-974f-4489-a311-8c13ce76a594 admin admin] PATH_INFO: `/v3/groups/8badc6ce46e34587b2f620b97c89edd9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:09.253821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fbf20-974f-4489-a311-8c13ce76a594 admin admin] RBAC: Authorizing `identity:get_group(group_id=8badc6ce46e34587b2f620b97c89edd9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:09.255746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fbf20-974f-4489-a311-8c13ce76a594 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:09.257319 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 219/453] 10.222.0.13 () {56 vars in 1201 bytes} [Sat Dec 18 20:32:09 2021] GET /identity/v3/groups/8badc6ce46e34587b2f620b97c89edd9 => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:09.263898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa7c02-b8fe-4a8c-8ddd-8b43c1dae5ef admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:09.273507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa7c02-b8fe-4a8c-8ddd-8b43c1dae5ef admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:09.277955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f9113-ff48-4641-9e73-1c097220f5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:09.279352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f9113-ff48-4641-9e73-1c097220f5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:09.279638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f9113-ff48-4641-9e73-1c097220f5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:09.279915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f9113-ff48-4641-9e73-1c097220f5e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:09.280750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f9113-ff48-4641-9e73-1c097220f5e2 admin admin] RBAC: Adding query filter params (group.id=8badc6ce46e34587b2f620b97c89edd9, role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=b04c3d19c79d4c208395e97f9d293618) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:09.281064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f9113-ff48-4641-9e73-1c097220f5e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:09.282913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f9113-ff48-4641-9e73-1c097220f5e2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:09.289800 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 235/454] 10.222.0.13 () {56 vars in 1397 bytes} [Sat Dec 18 20:32:09 2021] GET /identity/v3/role_assignments?group.id=8badc6ce46e34587b2f620b97c89edd9&scope.project.id=b04c3d19c79d4c208395e97f9d293618&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:12.325383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7efe0-f524-4214-8f6f-9ec7f2bb4a9b None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:12.325910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7efe0-f524-4214-8f6f-9ec7f2bb4a9b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:12.325989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7efe0-f524-4214-8f6f-9ec7f2bb4a9b None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:12.328209 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 220/455] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:12.333984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd6ee5-3920-4ecf-8caf-d8bb16699d97 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:12.334469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd6ee5-3920-4ecf-8caf-d8bb16699d97 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:12.334564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd6ee5-3920-4ecf-8caf-d8bb16699d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:12.371243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-70bd6ee5-3920-4ecf-8caf-d8bb16699d97 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:12.373174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-70bd6ee5-3920-4ecf-8caf-d8bb16699d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:12.390994 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 236/456] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:12.437969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7efe0-f524-4214-8f6f-9ec7f2bb4a9b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:12.468801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7efe0-f524-4214-8f6f-9ec7f2bb4a9b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:12.486999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a2ab-a49b-40be-9352-8ef7aa625552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:12.487807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a2ab-a49b-40be-9352-8ef7aa625552 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:12.488092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a2ab-a49b-40be-9352-8ef7aa625552 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:12.488370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a2ab-a49b-40be-9352-8ef7aa625552 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:12.509740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30a2ab-a49b-40be-9352-8ef7aa625552 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:12.511632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30a2ab-a49b-40be-9352-8ef7aa625552 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:12.540319 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-4e30a2ab-a49b-40be-9352-8ef7aa625552 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:12.541520 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 221/457] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:12.548142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd6ee5-3920-4ecf-8caf-d8bb16699d97 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:12.564566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd6ee5-3920-4ecf-8caf-d8bb16699d97 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:12.587015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868b5ea-6a00-4ca9-b8e3-a460eba173c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:12.587641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868b5ea-6a00-4ca9-b8e3-a460eba173c5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:12.587967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868b5ea-6a00-4ca9-b8e3-a460eba173c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:12.588215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868b5ea-6a00-4ca9-b8e3-a460eba173c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:12.589299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868b5ea-6a00-4ca9-b8e3-a460eba173c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:12.589624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868b5ea-6a00-4ca9-b8e3-a460eba173c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:12.591200 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-6868b5ea-6a00-4ca9-b8e3-a460eba173c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:32:12.591200 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:32:12.591200 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:32:12.592076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868b5ea-6a00-4ca9-b8e3-a460eba173c5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:12.625469 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 237/458] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:12.633195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a2ab-a49b-40be-9352-8ef7aa625552 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:12.656714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a2ab-a49b-40be-9352-8ef7aa625552 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:12.679030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38b8cf-eaf1-416a-8877-539924555526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:12.679729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38b8cf-eaf1-416a-8877-539924555526 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:12.680010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38b8cf-eaf1-416a-8877-539924555526 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:12.680282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38b8cf-eaf1-416a-8877-539924555526 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:12.681370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38b8cf-eaf1-416a-8877-539924555526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:12.682987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38b8cf-eaf1-416a-8877-539924555526 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:12.725365 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 222/459] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:32:12 2021] POST /identity/v3/users => generated 246 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:32:12.832823 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af14f-7cb1-4f8e-880a-c1198b86e89d None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:12.833186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af14f-7cb1-4f8e-880a-c1198b86e89d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:12.833384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af14f-7cb1-4f8e-880a-c1198b86e89d None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:12.835564 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 238/460] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:12.853784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232334b1-c967-4236-8d1e-177111c6a5cf None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:12.854090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232334b1-c967-4236-8d1e-177111c6a5cf None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:12.854408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232334b1-c967-4236-8d1e-177111c6a5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:12.888140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-232334b1-c967-4236-8d1e-177111c6a5cf None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:12.889573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-232334b1-c967-4236-8d1e-177111c6a5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:12.902408 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 223/461] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:12.941044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926af14f-7cb1-4f8e-880a-c1198b86e89d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:12.971200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926af14f-7cb1-4f8e-880a-c1198b86e89d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:12.984313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add9448-02a2-4dae-bf56-c352afc4d51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:12.985189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add9448-02a2-4dae-bf56-c352afc4d51f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:12.985471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add9448-02a2-4dae-bf56-c352afc4d51f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:12.985745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add9448-02a2-4dae-bf56-c352afc4d51f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:13.006599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add9448-02a2-4dae-bf56-c352afc4d51f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:13.008462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add9448-02a2-4dae-bf56-c352afc4d51f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:13.041694 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-0add9448-02a2-4dae-bf56-c352afc4d51f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:13.043307 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 239/462] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:13.050231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232334b1-c967-4236-8d1e-177111c6a5cf None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:13.068605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232334b1-c967-4236-8d1e-177111c6a5cf None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:13.080456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5482ac0-e988-4985-9566-81c31b755b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:13.081128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5482ac0-e988-4985-9566-81c31b755b46 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:13.081413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5482ac0-e988-4985-9566-81c31b755b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:13.081692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5482ac0-e988-4985-9566-81c31b755b46 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:13.082512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5482ac0-e988-4985-9566-81c31b755b46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:13.082818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5482ac0-e988-4985-9566-81c31b755b46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:13.084411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5482ac0-e988-4985-9566-81c31b755b46 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:13.113870 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 224/463] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:13.119334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add9448-02a2-4dae-bf56-c352afc4d51f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:13.140335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add9448-02a2-4dae-bf56-c352afc4d51f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:13.166992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b23ba-2320-48f8-aef3-da94b9eebcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:13.167682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b23ba-2320-48f8-aef3-da94b9eebcd9 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:13.167970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b23ba-2320-48f8-aef3-da94b9eebcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:13.168251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b23ba-2320-48f8-aef3-da94b9eebcd9 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:13.169528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b23ba-2320-48f8-aef3-da94b9eebcd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:13.172188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b23ba-2320-48f8-aef3-da94b9eebcd9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:13.235418 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 240/464] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:32:13 2021] POST /identity/v3/users => generated 248 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:32:13.266008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc3c2b-73af-4b54-b472-d512919bb3ad None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:13.266889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc3c2b-73af-4b54-b472-d512919bb3ad None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:13.267555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc3c2b-73af-4b54-b472-d512919bb3ad None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:13.270806 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 225/465] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:13 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:13.281097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b31aa-b69d-46c1-9618-f9467081ef4d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:13.281097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b31aa-b69d-46c1-9618-f9467081ef4d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:13.281097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b31aa-b69d-46c1-9618-f9467081ef4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:13.311362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-735b31aa-b69d-46c1-9618-f9467081ef4d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:13.312523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-735b31aa-b69d-46c1-9618-f9467081ef4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:13.326106 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 241/466] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:13.355861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc3c2b-73af-4b54-b472-d512919bb3ad None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:13.386355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc3c2b-73af-4b54-b472-d512919bb3ad None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:13.391795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67abfe4-1751-44b1-b8eb-35580880ed57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:13.392648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67abfe4-1751-44b1-b8eb-35580880ed57 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:13.392933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67abfe4-1751-44b1-b8eb-35580880ed57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:13.393211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67abfe4-1751-44b1-b8eb-35580880ed57 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:13.417744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67abfe4-1751-44b1-b8eb-35580880ed57 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:13.420201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67abfe4-1751-44b1-b8eb-35580880ed57 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:13.444718 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-d67abfe4-1751-44b1-b8eb-35580880ed57 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:13.451461 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 226/467] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:13.457721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b31aa-b69d-46c1-9618-f9467081ef4d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:13.474736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b31aa-b69d-46c1-9618-f9467081ef4d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:13.485420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a266f6-a056-4359-9894-a5ef1b7a8833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:13.486145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a266f6-a056-4359-9894-a5ef1b7a8833 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:13.486478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a266f6-a056-4359-9894-a5ef1b7a8833 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:13.486763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a266f6-a056-4359-9894-a5ef1b7a8833 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:13.487515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a266f6-a056-4359-9894-a5ef1b7a8833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:13.487827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a266f6-a056-4359-9894-a5ef1b7a8833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:13.489683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a266f6-a056-4359-9894-a5ef1b7a8833 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:13.511761 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 242/468] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:13.519762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67abfe4-1751-44b1-b8eb-35580880ed57 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:13.534346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67abfe4-1751-44b1-b8eb-35580880ed57 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:13.541780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ee055-ed72-44f7-abf5-4531b6fbc88b None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:13.541780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ee055-ed72-44f7-abf5-4531b6fbc88b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:13.541780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ee055-ed72-44f7-abf5-4531b6fbc88b None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:13.542809 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 243/469] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:13 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:13.550281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45bbbb-3548-4d7e-bf9b-4f5b46ba7e7d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:13.550281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45bbbb-3548-4d7e-bf9b-4f5b46ba7e7d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:13.550281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45bbbb-3548-4d7e-bf9b-4f5b46ba7e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:13.551062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a3c11-3763-4850-b9b0-70caaffbbefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:13.551927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a3c11-3763-4850-b9b0-70caaffbbefa admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:13.553688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a3c11-3763-4850-b9b0-70caaffbbefa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:13.554034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a3c11-3763-4850-b9b0-70caaffbbefa admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:13.554901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a3c11-3763-4850-b9b0-70caaffbbefa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:13.558807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a3c11-3763-4850-b9b0-70caaffbbefa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:13.589511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8b45bbbb-3548-4d7e-bf9b-4f5b46ba7e7d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:13.591742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8b45bbbb-3548-4d7e-bf9b-4f5b46ba7e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:13.611514 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 227/470] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:32:13 2021] POST /identity/v3/users => generated 248 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:32:13.621025 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 244/471] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:13.660020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a3c11-3763-4850-b9b0-70caaffbbefa admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:13.682279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a3c11-3763-4850-b9b0-70caaffbbefa admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:13.689611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a336dec-bf94-4618-8aa5-f69cfa971f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:13.690464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a336dec-bf94-4618-8aa5-f69cfa971f72 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:13.690741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a336dec-bf94-4618-8aa5-f69cfa971f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:13.691020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a336dec-bf94-4618-8aa5-f69cfa971f72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:13.708453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a336dec-bf94-4618-8aa5-f69cfa971f72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:13.713492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a336dec-bf94-4618-8aa5-f69cfa971f72 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:13.741579 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-9a336dec-bf94-4618-8aa5-f69cfa971f72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:13.741949 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 228/472] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:13.751399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45bbbb-3548-4d7e-bf9b-4f5b46ba7e7d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:13.764743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45bbbb-3548-4d7e-bf9b-4f5b46ba7e7d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:13.774005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34603c-174e-46e8-a412-6a51c63e953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:13.775674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34603c-174e-46e8-a412-6a51c63e953b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:13.775962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34603c-174e-46e8-a412-6a51c63e953b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:13.776241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34603c-174e-46e8-a412-6a51c63e953b admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:13.777002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34603c-174e-46e8-a412-6a51c63e953b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:13.777511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34603c-174e-46e8-a412-6a51c63e953b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:13.779789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34603c-174e-46e8-a412-6a51c63e953b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:13.798963 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 245/473] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:13.805210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a336dec-bf94-4618-8aa5-f69cfa971f72 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:13.817263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a336dec-bf94-4618-8aa5-f69cfa971f72 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:13.823379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2574f8-95cf-4255-9be0-bad5ac88cf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:13.824120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2574f8-95cf-4255-9be0-bad5ac88cf2f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:13.824405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2574f8-95cf-4255-9be0-bad5ac88cf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:13.824681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2574f8-95cf-4255-9be0-bad5ac88cf2f admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:13.826014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2574f8-95cf-4255-9be0-bad5ac88cf2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:13.828190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2574f8-95cf-4255-9be0-bad5ac88cf2f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:13.859672 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 229/474] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:32:13 2021] POST /identity/v3/users => generated 249 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:32:14.431351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506901b-4d82-4622-aebb-0892d28be072 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:14.431351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506901b-4d82-4622-aebb-0892d28be072 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:14.431351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506901b-4d82-4622-aebb-0892d28be072 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:14.432536 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 246/475] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:14.439172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b154f9-7c3c-423e-8ff7-0290de6def2c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:14.439620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b154f9-7c3c-423e-8ff7-0290de6def2c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:14.439803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b154f9-7c3c-423e-8ff7-0290de6def2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:14.465426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-45b154f9-7c3c-423e-8ff7-0290de6def2c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:14.466649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-45b154f9-7c3c-423e-8ff7-0290de6def2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:14.477613 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 230/476] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:14.523739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506901b-4d82-4622-aebb-0892d28be072 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:14.547425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506901b-4d82-4622-aebb-0892d28be072 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:14.560019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fca1a-15de-4494-9a13-c7ff7f507d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:14.560967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fca1a-15de-4494-9a13-c7ff7f507d1a admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:14.561710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fca1a-15de-4494-9a13-c7ff7f507d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:14.562196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fca1a-15de-4494-9a13-c7ff7f507d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:14.563193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fca1a-15de-4494-9a13-c7ff7f507d1a admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:14.564998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fca1a-15de-4494-9a13-c7ff7f507d1a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:14.583877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.sql.core [None req-d15fca1a-15de-4494-9a13-c7ff7f507d1a admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Dec 18 20:32:14.583877 ncdv-master-1 devstack@keystone.service[96645]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Dec 18 20:32:14.583877 ncdv-master-1 devstack@keystone.service[96645]: [parameters: {'id': 'f3072336fdd440b185adc2d073c7d852', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Dec 18 20:32:14.583877 ncdv-master-1 devstack@keystone.service[96645]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96645) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 18 20:32:14.607031 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-d15fca1a-15de-4494-9a13-c7ff7f507d1a admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Dec 18 20:32:14.608743 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 247/477] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:32:14 2021] POST /identity/v3/roles => generated 144 bytes in 86 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:14.615290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b154f9-7c3c-423e-8ff7-0290de6def2c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:14.625962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b154f9-7c3c-423e-8ff7-0290de6def2c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:14.642044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e854f47-afba-4ac3-9ee9-f2cb4c3ddff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:14.642749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e854f47-afba-4ac3-9ee9-f2cb4c3ddff4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:14.643026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e854f47-afba-4ac3-9ee9-f2cb4c3ddff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:14.643297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e854f47-afba-4ac3-9ee9-f2cb4c3ddff4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:14.661451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e854f47-afba-4ac3-9ee9-f2cb4c3ddff4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:14.674160 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-5e854f47-afba-4ac3-9ee9-f2cb4c3ddff4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 18 20:32:14.675718 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 231/478] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:32:14 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:14.682297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fca1a-15de-4494-9a13-c7ff7f507d1a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:14.712527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fca1a-15de-4494-9a13-c7ff7f507d1a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:14.739507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1481e41-247a-4bc7-aef7-6fb2ef06aab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:14.740194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1481e41-247a-4bc7-aef7-6fb2ef06aab0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:14.740474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1481e41-247a-4bc7-aef7-6fb2ef06aab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:14.740749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1481e41-247a-4bc7-aef7-6fb2ef06aab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:14.741523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1481e41-247a-4bc7-aef7-6fb2ef06aab0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:14.741830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1481e41-247a-4bc7-aef7-6fb2ef06aab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:14.743466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1481e41-247a-4bc7-aef7-6fb2ef06aab0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:14.768212 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 248/479] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:14 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:16.238299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea3def-0b77-4f75-b071-601dd21792ce None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:16.238821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea3def-0b77-4f75-b071-601dd21792ce None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:16.238821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea3def-0b77-4f75-b071-601dd21792ce None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:16.240629 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 232/480] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:16.254391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec935e1-bf42-456c-a6fa-7ce9dfd0cad6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:16.254391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec935e1-bf42-456c-a6fa-7ce9dfd0cad6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:16.254391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec935e1-bf42-456c-a6fa-7ce9dfd0cad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:16.282509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-aec935e1-bf42-456c-a6fa-7ce9dfd0cad6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:16.284158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-aec935e1-bf42-456c-a6fa-7ce9dfd0cad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:16.302218 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 249/481] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:16.331435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea3def-0b77-4f75-b071-601dd21792ce None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:16.356112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea3def-0b77-4f75-b071-601dd21792ce None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:16.364710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb88f19-88e3-48f0-a01c-1b6b64a4007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:16.365781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb88f19-88e3-48f0-a01c-1b6b64a4007b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:16.366298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb88f19-88e3-48f0-a01c-1b6b64a4007b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:16.366780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb88f19-88e3-48f0-a01c-1b6b64a4007b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:16.392818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb88f19-88e3-48f0-a01c-1b6b64a4007b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:16.406853 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-aeb88f19-88e3-48f0-a01c-1b6b64a4007b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:16.408375 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 233/482] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:16 2021] GET /identity/v3/roles/service => generated 85 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:16.414600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec935e1-bf42-456c-a6fa-7ce9dfd0cad6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:16.427203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec935e1-bf42-456c-a6fa-7ce9dfd0cad6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:16.444141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac8da9-7fb5-4a4c-990b-c81a038b5c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:16.445219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac8da9-7fb5-4a4c-990b-c81a038b5c36 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:16.445740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac8da9-7fb5-4a4c-990b-c81a038b5c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:16.446232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac8da9-7fb5-4a4c-990b-c81a038b5c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:16.447272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac8da9-7fb5-4a4c-990b-c81a038b5c36 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:16.447808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac8da9-7fb5-4a4c-990b-c81a038b5c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:16.449782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac8da9-7fb5-4a4c-990b-c81a038b5c36 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:16.470239 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 250/483] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:16 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:16.476457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb88f19-88e3-48f0-a01c-1b6b64a4007b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:16.492395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb88f19-88e3-48f0-a01c-1b6b64a4007b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:16.506892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09d5ca-4dbb-483c-911b-1c9d3d102170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:16.507972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09d5ca-4dbb-483c-911b-1c9d3d102170 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:16.508559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09d5ca-4dbb-483c-911b-1c9d3d102170 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:16.509039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09d5ca-4dbb-483c-911b-1c9d3d102170 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:16.531792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09d5ca-4dbb-483c-911b-1c9d3d102170 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:16.534063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09d5ca-4dbb-483c-911b-1c9d3d102170 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:16.566168 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-4d09d5ca-4dbb-483c-911b-1c9d3d102170 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:16.568073 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 234/484] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:16.574060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac8da9-7fb5-4a4c-990b-c81a038b5c36 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:16.588676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac8da9-7fb5-4a4c-990b-c81a038b5c36 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:16.603867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4545200-65b8-48c8-b2ad-ae670de4dc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:16.604848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545200-65b8-48c8-b2ad-ae670de4dc66 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:16.605358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545200-65b8-48c8-b2ad-ae670de4dc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:16.605838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545200-65b8-48c8-b2ad-ae670de4dc66 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:16.606877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4545200-65b8-48c8-b2ad-ae670de4dc66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:16.607406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4545200-65b8-48c8-b2ad-ae670de4dc66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:16.609202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4545200-65b8-48c8-b2ad-ae670de4dc66 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:16.632789 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 251/485] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:16.641800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09d5ca-4dbb-483c-911b-1c9d3d102170 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:16.664704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09d5ca-4dbb-483c-911b-1c9d3d102170 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:16.682107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be6f64-85d3-4d7e-abe6-05f84a93b97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:16.683317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be6f64-85d3-4d7e-abe6-05f84a93b97e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:16.683846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be6f64-85d3-4d7e-abe6-05f84a93b97e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:16.684402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be6f64-85d3-4d7e-abe6-05f84a93b97e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:16.700196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be6f64-85d3-4d7e-abe6-05f84a93b97e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:16.702606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be6f64-85d3-4d7e-abe6-05f84a93b97e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:16.730075 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-13be6f64-85d3-4d7e-abe6-05f84a93b97e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 18 20:32:16.732520 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 235/486] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Dec 18 20:32:16 2021] GET /identity/v3/users/nova => generated 82 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:16.743711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4545200-65b8-48c8-b2ad-ae670de4dc66 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:16.762865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4545200-65b8-48c8-b2ad-ae670de4dc66 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:16.780046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084325ee-d3bf-43fa-914f-304163300017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:16.781142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084325ee-d3bf-43fa-914f-304163300017 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:16.781635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084325ee-d3bf-43fa-914f-304163300017 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:16.782115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084325ee-d3bf-43fa-914f-304163300017 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:16.783238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084325ee-d3bf-43fa-914f-304163300017 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:16.783765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084325ee-d3bf-43fa-914f-304163300017 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:16.785085 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-084325ee-d3bf-43fa-914f-304163300017 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:32:16.785085 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:32:16.785085 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:32:16.787150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084325ee-d3bf-43fa-914f-304163300017 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:16.850384 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 252/487] 10.222.0.13 () {56 vars in 1154 bytes} [Sat Dec 18 20:32:16 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:16.853274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be6f64-85d3-4d7e-abe6-05f84a93b97e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:16.873942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be6f64-85d3-4d7e-abe6-05f84a93b97e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:16.892807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a8567-0a18-4c14-84d5-91a96620694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:16.892807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8567-0a18-4c14-84d5-91a96620694f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:16.892807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8567-0a18-4c14-84d5-91a96620694f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:16.892807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8567-0a18-4c14-84d5-91a96620694f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:16.915121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a8567-0a18-4c14-84d5-91a96620694f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:16.917113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a8567-0a18-4c14-84d5-91a96620694f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:16.934722 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 236/488] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:16 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:32:16.944776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084325ee-d3bf-43fa-914f-304163300017 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:16.963546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084325ee-d3bf-43fa-914f-304163300017 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:16.978077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c5e36-394d-4bac-8bad-a375a3fb696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:16.978984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c5e36-394d-4bac-8bad-a375a3fb696e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:16.979276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c5e36-394d-4bac-8bad-a375a3fb696e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:16.979555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c5e36-394d-4bac-8bad-a375a3fb696e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:16.997088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c5e36-394d-4bac-8bad-a375a3fb696e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.007094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c5e36-394d-4bac-8bad-a375a3fb696e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.016957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf29cfb-2bfd-4578-a0c5-439fe1f3cf73 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.017528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf29cfb-2bfd-4578-a0c5-439fe1f3cf73 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.017998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf29cfb-2bfd-4578-a0c5-439fe1f3cf73 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.025244 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 237/489] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:17 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:17.026880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356d0a4-dc0d-4a2c-86a3-5ecbda21f280 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.027208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356d0a4-dc0d-4a2c-86a3-5ecbda21f280 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.027311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356d0a4-dc0d-4a2c-86a3-5ecbda21f280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.033295 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-621c5e36-394d-4bac-8bad-a375a3fb696e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:17.043584 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 253/490] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:17.057494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c5e36-394d-4bac-8bad-a375a3fb696e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.067478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8356d0a4-dc0d-4a2c-86a3-5ecbda21f280 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:17.068889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8356d0a4-dc0d-4a2c-86a3-5ecbda21f280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:17.079650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c5e36-394d-4bac-8bad-a375a3fb696e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.093236 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 238/491] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:17.119038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4fcc6-19a8-462f-9cfa-8361dceeb204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.119725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4fcc6-19a8-462f-9cfa-8361dceeb204 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.120016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4fcc6-19a8-462f-9cfa-8361dceeb204 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.120295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4fcc6-19a8-462f-9cfa-8361dceeb204 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.121127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4fcc6-19a8-462f-9cfa-8361dceeb204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:17.121633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4fcc6-19a8-462f-9cfa-8361dceeb204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.124235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4fcc6-19a8-462f-9cfa-8361dceeb204 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.139737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356d0a4-dc0d-4a2c-86a3-5ecbda21f280 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.159860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356d0a4-dc0d-4a2c-86a3-5ecbda21f280 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.166537 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 254/492] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:17.170702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537c8c7-4f1f-44d7-b852-44b7ee5210d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.176166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537c8c7-4f1f-44d7-b852-44b7ee5210d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.183752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537c8c7-4f1f-44d7-b852-44b7ee5210d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.183752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537c8c7-4f1f-44d7-b852-44b7ee5210d0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.183983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4fcc6-19a8-462f-9cfa-8361dceeb204 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.198802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537c8c7-4f1f-44d7-b852-44b7ee5210d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:17.203002 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-4537c8c7-4f1f-44d7-b852-44b7ee5210d0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:17.203002 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 239/493] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:17.210855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537c8c7-4f1f-44d7-b852-44b7ee5210d0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.216512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4fcc6-19a8-462f-9cfa-8361dceeb204 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.223697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537c8c7-4f1f-44d7-b852-44b7ee5210d0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.232201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489e738-35ec-45c1-abb7-4a32052d35c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.235381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb713ba8-2e43-45d9-a1bf-ab34f3b87de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.236155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489e738-35ec-45c1-abb7-4a32052d35c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.236442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489e738-35ec-45c1-abb7-4a32052d35c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.236715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489e738-35ec-45c1-abb7-4a32052d35c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.237481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489e738-35ec-45c1-abb7-4a32052d35c2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:17.237899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb713ba8-2e43-45d9-a1bf-ab34f3b87de2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.238173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb713ba8-2e43-45d9-a1bf-ab34f3b87de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.238515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb713ba8-2e43-45d9-a1bf-ab34f3b87de2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.239531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489e738-35ec-45c1-abb7-4a32052d35c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.246335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489e738-35ec-45c1-abb7-4a32052d35c2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.259343 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 240/494] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:17.265195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb713ba8-2e43-45d9-a1bf-ab34f3b87de2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.267214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb713ba8-2e43-45d9-a1bf-ab34f3b87de2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.274512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489e738-35ec-45c1-abb7-4a32052d35c2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.297328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489e738-35ec-45c1-abb7-4a32052d35c2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.297508 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-cb713ba8-2e43-45d9-a1bf-ab34f3b87de2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:17.297508 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 255/495] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:17.305206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb713ba8-2e43-45d9-a1bf-ab34f3b87de2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.310339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34de5a-2021-4408-9737-a5f7f390a8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.310339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34de5a-2021-4408-9737-a5f7f390a8fd admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.310339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34de5a-2021-4408-9737-a5f7f390a8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.310339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34de5a-2021-4408-9737-a5f7f390a8fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.317590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb713ba8-2e43-45d9-a1bf-ab34f3b87de2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.323396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802c7ef-edc4-49ba-a785-c2822ff14941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.323663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34de5a-2021-4408-9737-a5f7f390a8fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.324052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802c7ef-edc4-49ba-a785-c2822ff14941 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.324336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802c7ef-edc4-49ba-a785-c2822ff14941 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.324638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802c7ef-edc4-49ba-a785-c2822ff14941 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.325482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802c7ef-edc4-49ba-a785-c2822ff14941 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:17.325709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34de5a-2021-4408-9737-a5f7f390a8fd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.325804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802c7ef-edc4-49ba-a785-c2822ff14941 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.326819 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-e802c7ef-edc4-49ba-a785-c2822ff14941 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:32:17.326819 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:32:17.326819 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:32:17.327934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802c7ef-edc4-49ba-a785-c2822ff14941 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.344365 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-da34de5a-2021-4408-9737-a5f7f390a8fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:17.350382 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 241/496] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:17.350382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372a05f-3ecd-4ed5-b0e9-60ae6d52f5e3 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.350382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372a05f-3ecd-4ed5-b0e9-60ae6d52f5e3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.350382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372a05f-3ecd-4ed5-b0e9-60ae6d52f5e3 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.350693 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 256/497] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:17.350693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b335f-db80-4c62-b9ed-0941fa662443 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.351433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b335f-db80-4c62-b9ed-0941fa662443 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.351433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b335f-db80-4c62-b9ed-0941fa662443 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.353132 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 257/498] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:17.353232 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 242/499] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:17 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:17.355283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372a05f-3ecd-4ed5-b0e9-60ae6d52f5e3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.358287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b335f-db80-4c62-b9ed-0941fa662443 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.372977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372a05f-3ecd-4ed5-b0e9-60ae6d52f5e3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.375635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b335f-db80-4c62-b9ed-0941fa662443 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.378397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6183ad8-13df-418f-885a-7671e721ba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.378996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6183ad8-13df-418f-885a-7671e721ba55 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.379286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6183ad8-13df-418f-885a-7671e721ba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.379567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6183ad8-13df-418f-885a-7671e721ba55 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.380346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af616af-cc33-4220-a224-b72baee01f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.380463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6183ad8-13df-418f-885a-7671e721ba55 admin admin] RBAC: Adding query filter params (role.id=0071fc3d75b34850b7fb01a06a0279c5, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=a180acaefee3489788068c927fbe403c) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:17.380705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6183ad8-13df-418f-885a-7671e721ba55 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.380986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af616af-cc33-4220-a224-b72baee01f7c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.381267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af616af-cc33-4220-a224-b72baee01f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.381559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af616af-cc33-4220-a224-b72baee01f7c admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.382338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af616af-cc33-4220-a224-b72baee01f7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:17.382575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6183ad8-13df-418f-885a-7671e721ba55 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.382810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af616af-cc33-4220-a224-b72baee01f7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.384685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af616af-cc33-4220-a224-b72baee01f7c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.389877 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 243/500] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/role_assignments?user.id=a180acaefee3489788068c927fbe403c&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=0071fc3d75b34850b7fb01a06a0279c5 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:17.404430 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 258/501] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:17.404628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838deb2a-b7cf-421b-a082-6e42dbe48d4f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.404706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac12de-b120-4b60-86b2-b5d1d9134dc6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.404706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac12de-b120-4b60-86b2-b5d1d9134dc6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.404706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac12de-b120-4b60-86b2-b5d1d9134dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.410769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838deb2a-b7cf-421b-a082-6e42dbe48d4f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.413675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838deb2a-b7cf-421b-a082-6e42dbe48d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.447714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b9ac12de-b120-4b60-86b2-b5d1d9134dc6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:17.448944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b9ac12de-b120-4b60-86b2-b5d1d9134dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:17.453303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-838deb2a-b7cf-421b-a082-6e42dbe48d4f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:17.454435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-838deb2a-b7cf-421b-a082-6e42dbe48d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:17.470700 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 259/502] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:17.472469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac12de-b120-4b60-86b2-b5d1d9134dc6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.486816 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 244/503] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:17.494466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac12de-b120-4b60-86b2-b5d1d9134dc6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.508766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838deb2a-b7cf-421b-a082-6e42dbe48d4f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.521937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838deb2a-b7cf-421b-a082-6e42dbe48d4f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.532133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bc7a3-3bec-4e3c-a177-f9db807a017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.533022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bc7a3-3bec-4e3c-a177-f9db807a017b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.533311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bc7a3-3bec-4e3c-a177-f9db807a017b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.533645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bc7a3-3bec-4e3c-a177-f9db807a017b admin admin] PATH_INFO: `/v3/users/glance` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.541064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efb2c8-bd01-40f2-87d6-5e5c8e923f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.541900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efb2c8-bd01-40f2-87d6-5e5c8e923f46 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.542186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efb2c8-bd01-40f2-87d6-5e5c8e923f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.542597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efb2c8-bd01-40f2-87d6-5e5c8e923f46 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.546981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bc7a3-3bec-4e3c-a177-f9db807a017b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.549681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bc7a3-3bec-4e3c-a177-f9db807a017b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.566277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efb2c8-bd01-40f2-87d6-5e5c8e923f46 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:17.567676 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-f81bc7a3-3bec-4e3c-a177-f9db807a017b admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 18 20:32:17.569775 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 260/504] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/users/glance => generated 84 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:17.569775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bc7a3-3bec-4e3c-a177-f9db807a017b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.575653 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-85efb2c8-bd01-40f2-87d6-5e5c8e923f46 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:17.578275 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 245/505] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:32:17.586283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efb2c8-bd01-40f2-87d6-5e5c8e923f46 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.587631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bc7a3-3bec-4e3c-a177-f9db807a017b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.596125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b674c86-c8b7-4b70-aeea-5f457cee7e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.596999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b674c86-c8b7-4b70-aeea-5f457cee7e83 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.597323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b674c86-c8b7-4b70-aeea-5f457cee7e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.598531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b674c86-c8b7-4b70-aeea-5f457cee7e83 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.609190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efb2c8-bd01-40f2-87d6-5e5c8e923f46 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.616898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7c614-3c97-4ea2-8822-0d1fafa7dc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.617690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7c614-3c97-4ea2-8822-0d1fafa7dc55 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.617982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7c614-3c97-4ea2-8822-0d1fafa7dc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.618297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7c614-3c97-4ea2-8822-0d1fafa7dc55 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.619434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b674c86-c8b7-4b70-aeea-5f457cee7e83 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:17.619547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7c614-3c97-4ea2-8822-0d1fafa7dc55 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:17.619870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7c614-3c97-4ea2-8822-0d1fafa7dc55 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.620969 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-60a7c614-3c97-4ea2-8822-0d1fafa7dc55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:32:17.620969 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:32:17.620969 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:32:17.622293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7c614-3c97-4ea2-8822-0d1fafa7dc55 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.627497 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-9b674c86-c8b7-4b70-aeea-5f457cee7e83 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:17.630353 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 261/506] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:17.631376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b674c86-c8b7-4b70-aeea-5f457cee7e83 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.650773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b674c86-c8b7-4b70-aeea-5f457cee7e83 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.656292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdf583-01d2-4fbf-b540-28b41ae0c619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.657015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdf583-01d2-4fbf-b540-28b41ae0c619 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.657296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdf583-01d2-4fbf-b540-28b41ae0c619 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.657572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdf583-01d2-4fbf-b540-28b41ae0c619 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.659157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdf583-01d2-4fbf-b540-28b41ae0c619 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:17.659473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdf583-01d2-4fbf-b540-28b41ae0c619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.661109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdf583-01d2-4fbf-b540-28b41ae0c619 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.672436 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 262/507] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:17.672436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdf583-01d2-4fbf-b540-28b41ae0c619 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.683476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdf583-01d2-4fbf-b540-28b41ae0c619 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.687056 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 246/508] 10.222.0.13 () {56 vars in 1158 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:17.688114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7c614-3c97-4ea2-8822-0d1fafa7dc55 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.700577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7c614-3c97-4ea2-8822-0d1fafa7dc55 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.707580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4bef7-0d37-4750-b38c-3f12f9330c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.708189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bcad0-da01-4bc2-9a5e-63f07d3731b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.708306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4bef7-0d37-4750-b38c-3f12f9330c85 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.708539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4bef7-0d37-4750-b38c-3f12f9330c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.708825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4bef7-0d37-4750-b38c-3f12f9330c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.709597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4bef7-0d37-4750-b38c-3f12f9330c85 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:17.709906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4bef7-0d37-4750-b38c-3f12f9330c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.710139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bcad0-da01-4bc2-9a5e-63f07d3731b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.710690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bcad0-da01-4bc2-9a5e-63f07d3731b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.711148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bcad0-da01-4bc2-9a5e-63f07d3731b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.711530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4bef7-0d37-4750-b38c-3f12f9330c85 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.730273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bcad0-da01-4bc2-9a5e-63f07d3731b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.730273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bcad0-da01-4bc2-9a5e-63f07d3731b4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.734438 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 263/509] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:17.736515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4bef7-0d37-4750-b38c-3f12f9330c85 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.758313 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-a78bcad0-da01-4bc2-9a5e-63f07d3731b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:17.758313 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 247/510] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:17.760636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4bef7-0d37-4750-b38c-3f12f9330c85 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.764364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bcad0-da01-4bc2-9a5e-63f07d3731b4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.774337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14802f17-1554-4f0d-bd5f-2f490a4b8c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.774337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14802f17-1554-4f0d-bd5f-2f490a4b8c83 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.774337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14802f17-1554-4f0d-bd5f-2f490a4b8c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.774337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14802f17-1554-4f0d-bd5f-2f490a4b8c83 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.786282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bcad0-da01-4bc2-9a5e-63f07d3731b4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.786461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14802f17-1554-4f0d-bd5f-2f490a4b8c83 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.786461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14802f17-1554-4f0d-bd5f-2f490a4b8c83 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.798278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b9749-20f8-473a-9ad2-ba05ee99d42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.798585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b9749-20f8-473a-9ad2-ba05ee99d42a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.800301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b9749-20f8-473a-9ad2-ba05ee99d42a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.800301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b9749-20f8-473a-9ad2-ba05ee99d42a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.802354 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 264/511] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:32:17.814274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14802f17-1554-4f0d-bd5f-2f490a4b8c83 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.825770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b9749-20f8-473a-9ad2-ba05ee99d42a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.828475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b9749-20f8-473a-9ad2-ba05ee99d42a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.830539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14802f17-1554-4f0d-bd5f-2f490a4b8c83 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.843476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09005af-2ffe-4dfe-8914-be5e03761729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.844204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09005af-2ffe-4dfe-8914-be5e03761729 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.850285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09005af-2ffe-4dfe-8914-be5e03761729 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.850285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09005af-2ffe-4dfe-8914-be5e03761729 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.850285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09005af-2ffe-4dfe-8914-be5e03761729 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:17.850285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09005af-2ffe-4dfe-8914-be5e03761729 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.850285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09005af-2ffe-4dfe-8914-be5e03761729 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.866287 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-ae3b9749-20f8-473a-9ad2-ba05ee99d42a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:17.870002 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 248/512] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:17.871454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b9749-20f8-473a-9ad2-ba05ee99d42a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.878239 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 265/513] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:17.879123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09005af-2ffe-4dfe-8914-be5e03761729 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.894330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b9749-20f8-473a-9ad2-ba05ee99d42a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.898354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09005af-2ffe-4dfe-8914-be5e03761729 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.901058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcf721-25d7-4c13-aea1-3f46d57a1f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.902029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf721-25d7-4c13-aea1-3f46d57a1f54 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.902562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf721-25d7-4c13-aea1-3f46d57a1f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.906274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf721-25d7-4c13-aea1-3f46d57a1f54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.906393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96b28a-824a-4595-a2d8-d875a9498268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.906668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96b28a-824a-4595-a2d8-d875a9498268 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.906964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96b28a-824a-4595-a2d8-d875a9498268 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.907249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96b28a-824a-4595-a2d8-d875a9498268 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.908407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96b28a-824a-4595-a2d8-d875a9498268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:17.908722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96b28a-824a-4595-a2d8-d875a9498268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.912223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96b28a-824a-4595-a2d8-d875a9498268 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.922279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcf721-25d7-4c13-aea1-3f46d57a1f54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.930273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcf721-25d7-4c13-aea1-3f46d57a1f54 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:17.946272 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 266/514] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:17.946272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96b28a-824a-4595-a2d8-d875a9498268 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.966275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96b28a-824a-4595-a2d8-d875a9498268 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.970272 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-edbcf721-25d7-4c13-aea1-3f46d57a1f54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:17.974280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26c1d1-72ee-4298-8312-2923f78b0df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:17.974414 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 249/515] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:17.974414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcf721-25d7-4c13-aea1-3f46d57a1f54 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:17.974562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26c1d1-72ee-4298-8312-2923f78b0df4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:17.974562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26c1d1-72ee-4298-8312-2923f78b0df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:17.974562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26c1d1-72ee-4298-8312-2923f78b0df4 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:17.994284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26c1d1-72ee-4298-8312-2923f78b0df4 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:17.994453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcf721-25d7-4c13-aea1-3f46d57a1f54 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:17.994553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26c1d1-72ee-4298-8312-2923f78b0df4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.004347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd36be-7143-4fa9-a848-7fabae60e4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.010283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd36be-7143-4fa9-a848-7fabae60e4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.010283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd36be-7143-4fa9-a848-7fabae60e4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.010283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd36be-7143-4fa9-a848-7fabae60e4f1 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.022020 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-dc26c1d1-72ee-4298-8312-2923f78b0df4 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 18 20:32:18.022020 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 267/516] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/users/cinder => generated 84 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:18.026340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26c1d1-72ee-4298-8312-2923f78b0df4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.028241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd36be-7143-4fa9-a848-7fabae60e4f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.034272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd36be-7143-4fa9-a848-7fabae60e4f1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.050648 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-83bd36be-7143-4fa9-a848-7fabae60e4f1 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 18 20:32:18.051832 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 250/517] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:17 2021] GET /identity/v3/users/neutron => generated 85 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:18.052586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd36be-7143-4fa9-a848-7fabae60e4f1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.060913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26c1d1-72ee-4298-8312-2923f78b0df4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.070269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bc597-0a59-469e-9ee0-5783bc46bde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.070269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc597-0a59-469e-9ee0-5783bc46bde5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.070269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc597-0a59-469e-9ee0-5783bc46bde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.070269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc597-0a59-469e-9ee0-5783bc46bde5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.070941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bc597-0a59-469e-9ee0-5783bc46bde5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:18.070941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bc597-0a59-469e-9ee0-5783bc46bde5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.070941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bc597-0a59-469e-9ee0-5783bc46bde5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.086274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd36be-7143-4fa9-a848-7fabae60e4f1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.094279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354674b2-423c-465a-9fe2-265d2583e93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.094279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354674b2-423c-465a-9fe2-265d2583e93c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.094279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354674b2-423c-465a-9fe2-265d2583e93c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.094279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354674b2-423c-465a-9fe2-265d2583e93c admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.094978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354674b2-423c-465a-9fe2-265d2583e93c admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:18.094978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354674b2-423c-465a-9fe2-265d2583e93c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.098271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354674b2-423c-465a-9fe2-265d2583e93c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.100823 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 268/518] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:18.105342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bc597-0a59-469e-9ee0-5783bc46bde5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.118280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bc597-0a59-469e-9ee0-5783bc46bde5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.130273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b69648-1210-447b-bcad-59b15a05f2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.130273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b69648-1210-447b-bcad-59b15a05f2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.130273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b69648-1210-447b-bcad-59b15a05f2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.130273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b69648-1210-447b-bcad-59b15a05f2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.134282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b69648-1210-447b-bcad-59b15a05f2e8 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:18.134282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b69648-1210-447b-bcad-59b15a05f2e8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.134282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b69648-1210-447b-bcad-59b15a05f2e8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.140619 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 251/519] 10.222.0.13 () {56 vars in 1158 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:18.145755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354674b2-423c-465a-9fe2-265d2583e93c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.162968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354674b2-423c-465a-9fe2-265d2583e93c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.178264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a07ee8-4a99-4005-af0c-0ad265334e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.178264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a07ee8-4a99-4005-af0c-0ad265334e7c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.178264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a07ee8-4a99-4005-af0c-0ad265334e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.178264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a07ee8-4a99-4005-af0c-0ad265334e7c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.178997 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 269/520] 10.222.0.13 () {56 vars in 1160 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:18.179278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b69648-1210-447b-bcad-59b15a05f2e8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.194272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a07ee8-4a99-4005-af0c-0ad265334e7c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.196182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a07ee8-4a99-4005-af0c-0ad265334e7c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.199549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b69648-1210-447b-bcad-59b15a05f2e8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.212590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4435394-961e-4343-af1b-79ba8c7053b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.218277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4435394-961e-4343-af1b-79ba8c7053b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.218277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4435394-961e-4343-af1b-79ba8c7053b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.218277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4435394-961e-4343-af1b-79ba8c7053b4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.225716 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-23a07ee8-4a99-4005-af0c-0ad265334e7c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:18.238065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4435394-961e-4343-af1b-79ba8c7053b4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.238065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4435394-961e-4343-af1b-79ba8c7053b4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.242272 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 252/521] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:18.242272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a07ee8-4a99-4005-af0c-0ad265334e7c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.256876 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 270/522] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:32:18.258434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4435394-961e-4343-af1b-79ba8c7053b4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.260990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a07ee8-4a99-4005-af0c-0ad265334e7c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.266866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e088ff2-fa80-4225-a8a1-4fece399f635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.267733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e088ff2-fa80-4225-a8a1-4fece399f635 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.268017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e088ff2-fa80-4225-a8a1-4fece399f635 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.268294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e088ff2-fa80-4225-a8a1-4fece399f635 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.268664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4435394-961e-4343-af1b-79ba8c7053b4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.280494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477032e-27e0-4aed-ba48-1dfeea7ce364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.281087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477032e-27e0-4aed-ba48-1dfeea7ce364 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.281369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477032e-27e0-4aed-ba48-1dfeea7ce364 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.281650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477032e-27e0-4aed-ba48-1dfeea7ce364 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.282473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477032e-27e0-4aed-ba48-1dfeea7ce364 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:18.286381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477032e-27e0-4aed-ba48-1dfeea7ce364 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.286514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e088ff2-fa80-4225-a8a1-4fece399f635 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.286621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477032e-27e0-4aed-ba48-1dfeea7ce364 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.286713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e088ff2-fa80-4225-a8a1-4fece399f635 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.299869 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 271/524] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:18.300116 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 253/524] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:32:18.300649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3c590-085a-43ff-90b3-64754a49b8e3 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.300940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3c590-085a-43ff-90b3-64754a49b8e3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.301218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3c590-085a-43ff-90b3-64754a49b8e3 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.301671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e088ff2-fa80-4225-a8a1-4fece399f635 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.303293 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 272/525] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:18.311726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3c590-085a-43ff-90b3-64754a49b8e3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.314842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e088ff2-fa80-4225-a8a1-4fece399f635 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.320024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b88866-4da7-4d82-9cf3-2bfd5b65be7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.320821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b88866-4da7-4d82-9cf3-2bfd5b65be7f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.321089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b88866-4da7-4d82-9cf3-2bfd5b65be7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.321365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b88866-4da7-4d82-9cf3-2bfd5b65be7f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.328122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3c590-085a-43ff-90b3-64754a49b8e3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.333288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b88866-4da7-4d82-9cf3-2bfd5b65be7f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.334958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58396462-afdd-4618-a1f9-05011cdaabc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.335541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b88866-4da7-4d82-9cf3-2bfd5b65be7f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.336200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58396462-afdd-4618-a1f9-05011cdaabc5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.336701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58396462-afdd-4618-a1f9-05011cdaabc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.337337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58396462-afdd-4618-a1f9-05011cdaabc5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.350503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58396462-afdd-4618-a1f9-05011cdaabc5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.352980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58396462-afdd-4618-a1f9-05011cdaabc5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.357459 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-d8b88866-4da7-4d82-9cf3-2bfd5b65be7f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:18.362447 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 254/526] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:18.364494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c885a-495d-45b2-8b41-d28a0874b2a1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.364976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c885a-495d-45b2-8b41-d28a0874b2a1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.365443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c885a-495d-45b2-8b41-d28a0874b2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.375856 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-58396462-afdd-4618-a1f9-05011cdaabc5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:18.377381 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 273/527] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:18.378436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58396462-afdd-4618-a1f9-05011cdaabc5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.392251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-707c885a-495d-45b2-8b41-d28a0874b2a1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:18.393446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-707c885a-495d-45b2-8b41-d28a0874b2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:18.397276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58396462-afdd-4618-a1f9-05011cdaabc5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.403180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698f879-ab3f-49c4-9c4c-6ce816c8004c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.404008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698f879-ab3f-49c4-9c4c-6ce816c8004c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.404489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698f879-ab3f-49c4-9c4c-6ce816c8004c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.404943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698f879-ab3f-49c4-9c4c-6ce816c8004c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.405998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698f879-ab3f-49c4-9c4c-6ce816c8004c admin admin] RBAC: Adding query filter params (role.id=0071fc3d75b34850b7fb01a06a0279c5, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=82fb4302bcd54627a264f22ad78aa339) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:18.406763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698f879-ab3f-49c4-9c4c-6ce816c8004c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.408939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698f879-ab3f-49c4-9c4c-6ce816c8004c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.410001 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 255/528] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:18.419794 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 274/529] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/role_assignments?user.id=82fb4302bcd54627a264f22ad78aa339&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=0071fc3d75b34850b7fb01a06a0279c5 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:18.421043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698f879-ab3f-49c4-9c4c-6ce816c8004c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.422592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c885a-495d-45b2-8b41-d28a0874b2a1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.433772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698f879-ab3f-49c4-9c4c-6ce816c8004c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.436537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c885a-495d-45b2-8b41-d28a0874b2a1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.440601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6301c-9a3d-498a-b588-a71a2e4e3019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.441698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6301c-9a3d-498a-b588-a71a2e4e3019 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.442344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6301c-9a3d-498a-b588-a71a2e4e3019 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.442867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6301c-9a3d-498a-b588-a71a2e4e3019 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.444028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6301c-9a3d-498a-b588-a71a2e4e3019 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:18.444590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6301c-9a3d-498a-b588-a71a2e4e3019 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.446731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6301c-9a3d-498a-b588-a71a2e4e3019 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.462285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd1d04-d642-4347-8fda-ac8890049810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.462285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd1d04-d642-4347-8fda-ac8890049810 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.462285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd1d04-d642-4347-8fda-ac8890049810 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.462285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd1d04-d642-4347-8fda-ac8890049810 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.462736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd1d04-d642-4347-8fda-ac8890049810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:18.462736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd1d04-d642-4347-8fda-ac8890049810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.462736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd1d04-d642-4347-8fda-ac8890049810 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.467263 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 275/530] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:18.468156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6301c-9a3d-498a-b588-a71a2e4e3019 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.481166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6301c-9a3d-498a-b588-a71a2e4e3019 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.484569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f6903-5ca2-4745-963a-76896a8068a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.485393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f6903-5ca2-4745-963a-76896a8068a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.486828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f6903-5ca2-4745-963a-76896a8068a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.486828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f6903-5ca2-4745-963a-76896a8068a7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.492208 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 256/531] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:18.493238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd1d04-d642-4347-8fda-ac8890049810 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.509271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f6903-5ca2-4745-963a-76896a8068a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.511319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f6903-5ca2-4745-963a-76896a8068a7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.514434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd1d04-d642-4347-8fda-ac8890049810 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.523270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffb06e-be73-4b53-921b-bccb83520eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.525805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffb06e-be73-4b53-921b-bccb83520eae admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.526743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffb06e-be73-4b53-921b-bccb83520eae admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.527265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffb06e-be73-4b53-921b-bccb83520eae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.545015 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-d73f6903-5ca2-4745-963a-76896a8068a7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:18.545949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffb06e-be73-4b53-921b-bccb83520eae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.546144 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 276/532] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:18.547319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f6903-5ca2-4745-963a-76896a8068a7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.549516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffb06e-be73-4b53-921b-bccb83520eae admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.563793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f6903-5ca2-4745-963a-76896a8068a7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.575967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccca5fa-7a82-4168-b710-14b54639344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.576956 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-44ffb06e-be73-4b53-921b-bccb83520eae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:18.583836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccca5fa-7a82-4168-b710-14b54639344b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.583836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccca5fa-7a82-4168-b710-14b54639344b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.583836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccca5fa-7a82-4168-b710-14b54639344b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.584565 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 257/533] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:18.586502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffb06e-be73-4b53-921b-bccb83520eae admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.595063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccca5fa-7a82-4168-b710-14b54639344b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.598900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccca5fa-7a82-4168-b710-14b54639344b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.601423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffb06e-be73-4b53-921b-bccb83520eae admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.610895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e2fd5-2f4d-45d9-8e03-f0f1879b1022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.612020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e2fd5-2f4d-45d9-8e03-f0f1879b1022 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.613050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e2fd5-2f4d-45d9-8e03-f0f1879b1022 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.613545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e2fd5-2f4d-45d9-8e03-f0f1879b1022 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.615363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e2fd5-2f4d-45d9-8e03-f0f1879b1022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:18.616005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e2fd5-2f4d-45d9-8e03-f0f1879b1022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.618089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e2fd5-2f4d-45d9-8e03-f0f1879b1022 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.625830 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-eccca5fa-7a82-4168-b710-14b54639344b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:18.633678 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 277/534] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:18.633678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccca5fa-7a82-4168-b710-14b54639344b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.643925 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 258/535] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:18.645212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e2fd5-2f4d-45d9-8e03-f0f1879b1022 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.650071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccca5fa-7a82-4168-b710-14b54639344b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.657395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e2fd5-2f4d-45d9-8e03-f0f1879b1022 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.661872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d42761-4f4c-4b60-b292-8cec019df62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.661872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d42761-4f4c-4b60-b292-8cec019df62e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.661872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d42761-4f4c-4b60-b292-8cec019df62e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.664495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d42761-4f4c-4b60-b292-8cec019df62e admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.664495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d42761-4f4c-4b60-b292-8cec019df62e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:18.664659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d42761-4f4c-4b60-b292-8cec019df62e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.666866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d42761-4f4c-4b60-b292-8cec019df62e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.667674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3a84c-b589-4617-bb50-4d4e5330b56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.669009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3a84c-b589-4617-bb50-4d4e5330b56b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.669600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3a84c-b589-4617-bb50-4d4e5330b56b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.670120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3a84c-b589-4617-bb50-4d4e5330b56b admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.671693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3a84c-b589-4617-bb50-4d4e5330b56b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:18.673214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3a84c-b589-4617-bb50-4d4e5330b56b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.674607 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-24b3a84c-b589-4617-bb50-4d4e5330b56b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:32:18.674607 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:32:18.674607 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:32:18.676281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3a84c-b589-4617-bb50-4d4e5330b56b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.686335 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 278/536] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:18.686335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d42761-4f4c-4b60-b292-8cec019df62e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.713390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d42761-4f4c-4b60-b292-8cec019df62e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.718076 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 259/537] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:18.720277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29a581-0aeb-4c45-ac16-953c1ce8c14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.721100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29a581-0aeb-4c45-ac16-953c1ce8c14c admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.721512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29a581-0aeb-4c45-ac16-953c1ce8c14c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.721935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29a581-0aeb-4c45-ac16-953c1ce8c14c admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.722883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b29a581-0aeb-4c45-ac16-953c1ce8c14c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.724297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3a84c-b589-4617-bb50-4d4e5330b56b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.727036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b29a581-0aeb-4c45-ac16-953c1ce8c14c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.739161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3a84c-b589-4617-bb50-4d4e5330b56b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.756634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083915c-6eaa-46a9-88cc-acb49dd42fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.757455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083915c-6eaa-46a9-88cc-acb49dd42fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.758455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083915c-6eaa-46a9-88cc-acb49dd42fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.760509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083915c-6eaa-46a9-88cc-acb49dd42fb0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.761529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083915c-6eaa-46a9-88cc-acb49dd42fb0 admin admin] RBAC: Adding query filter params (role.id=0071fc3d75b34850b7fb01a06a0279c5, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=6f8eeb55c523480fb45d4bbb8afe8e7e) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:18.761952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083915c-6eaa-46a9-88cc-acb49dd42fb0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.763483 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 279/538] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:32:18 2021] POST /identity/v3/users => generated 247 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:32:18.765657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083915c-6eaa-46a9-88cc-acb49dd42fb0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.774486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29a581-0aeb-4c45-ac16-953c1ce8c14c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:18.794449 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 260/539] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/role_assignments?user.id=6f8eeb55c523480fb45d4bbb8afe8e7e&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=0071fc3d75b34850b7fb01a06a0279c5 => generated 259 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:18.811296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29a581-0aeb-4c45-ac16-953c1ce8c14c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:18.836004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44771a-dcb7-4cba-a449-0000e53bc066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:18.836694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44771a-dcb7-4cba-a449-0000e53bc066 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:18.836984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44771a-dcb7-4cba-a449-0000e53bc066 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:18.837282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44771a-dcb7-4cba-a449-0000e53bc066 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:18.838236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44771a-dcb7-4cba-a449-0000e53bc066 admin admin] RBAC: Adding query filter params (role.id=0071fc3d75b34850b7fb01a06a0279c5, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=62bd53b4d64643d28ac7f4ea0ea45f90) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:18.838599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44771a-dcb7-4cba-a449-0000e53bc066 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:18.840706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44771a-dcb7-4cba-a449-0000e53bc066 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:18.854464 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 280/540] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:18 2021] GET /identity/v3/role_assignments?user.id=62bd53b4d64643d28ac7f4ea0ea45f90&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=0071fc3d75b34850b7fb01a06a0279c5 => generated 259 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:20.644602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a6b8e-ca26-41fb-9d1e-4e50356f2534 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:20.645104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a6b8e-ca26-41fb-9d1e-4e50356f2534 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:20.645325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a6b8e-ca26-41fb-9d1e-4e50356f2534 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:20.647533 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 261/541] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:20.654462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485af804-0282-41fd-b331-3b763a1ac7bf None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:20.654902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485af804-0282-41fd-b331-3b763a1ac7bf None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:20.655093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485af804-0282-41fd-b331-3b763a1ac7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:20.691154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-485af804-0282-41fd-b331-3b763a1ac7bf None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:20.692548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-485af804-0282-41fd-b331-3b763a1ac7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:20.718900 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 281/542] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:20.767843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a6b8e-ca26-41fb-9d1e-4e50356f2534 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:20.792134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a6b8e-ca26-41fb-9d1e-4e50356f2534 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:20.802574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffb351-8acd-41bc-8fa9-8787e38405c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:20.803440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffb351-8acd-41bc-8fa9-8787e38405c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:20.803747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffb351-8acd-41bc-8fa9-8787e38405c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:20.804050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffb351-8acd-41bc-8fa9-8787e38405c3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:20.829106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffb351-8acd-41bc-8fa9-8787e38405c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:20.844603 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-13ffb351-8acd-41bc-8fa9-8787e38405c3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:20.846317 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 262/543] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:20.852617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485af804-0282-41fd-b331-3b763a1ac7bf None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:20.870602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485af804-0282-41fd-b331-3b763a1ac7bf None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:20.883431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae9c4e-191d-4424-8b48-88a6ba86bb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:20.884172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae9c4e-191d-4424-8b48-88a6ba86bb1f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:20.884471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae9c4e-191d-4424-8b48-88a6ba86bb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:20.884761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae9c4e-191d-4424-8b48-88a6ba86bb1f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:20.885585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae9c4e-191d-4424-8b48-88a6ba86bb1f admin admin] RBAC: Adding query filter params (name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:20.885936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae9c4e-191d-4424-8b48-88a6ba86bb1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:20.887781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae9c4e-191d-4424-8b48-88a6ba86bb1f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:20.902393 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 282/544] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:20.909702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffb351-8acd-41bc-8fa9-8787e38405c3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:20.924993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffb351-8acd-41bc-8fa9-8787e38405c3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:20.939847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8e620-d4af-4958-b58b-f9eac83052be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:20.940647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8e620-d4af-4958-b58b-f9eac83052be admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:20.940928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8e620-d4af-4958-b58b-f9eac83052be admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:20.941201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8e620-d4af-4958-b58b-f9eac83052be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:20.961284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8e620-d4af-4958-b58b-f9eac83052be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:20.963182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8e620-d4af-4958-b58b-f9eac83052be admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:20.985971 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-55d8e620-d4af-4958-b58b-f9eac83052be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:20.992457 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 263/545] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:20.998568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae9c4e-191d-4424-8b48-88a6ba86bb1f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:21.010038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae9c4e-191d-4424-8b48-88a6ba86bb1f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:21.031073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f869a-02a0-4b6f-b771-05ae7b313db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:21.031831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f869a-02a0-4b6f-b771-05ae7b313db4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:21.032120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f869a-02a0-4b6f-b771-05ae7b313db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:21.032437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f869a-02a0-4b6f-b771-05ae7b313db4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:21.033277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f869a-02a0-4b6f-b771-05ae7b313db4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:21.033631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f869a-02a0-4b6f-b771-05ae7b313db4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:21.035493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f869a-02a0-4b6f-b771-05ae7b313db4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:21.052011 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 283/546] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:21.058065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8e620-d4af-4958-b58b-f9eac83052be admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:21.069612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8e620-d4af-4958-b58b-f9eac83052be admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:21.088353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95176f35-563c-4777-b527-1b647bd91ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:21.089386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95176f35-563c-4777-b527-1b647bd91ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:21.089674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95176f35-563c-4777-b527-1b647bd91ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:21.089954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95176f35-563c-4777-b527-1b647bd91ab9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:21.103479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95176f35-563c-4777-b527-1b647bd91ab9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:21.105881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95176f35-563c-4777-b527-1b647bd91ab9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:21.138173 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-95176f35-563c-4777-b527-1b647bd91ab9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 18 20:32:21.139932 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 264/547] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Dec 18 20:32:21 2021] GET /identity/v3/users/nova => generated 82 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:21.146132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f869a-02a0-4b6f-b771-05ae7b313db4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:21.161391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f869a-02a0-4b6f-b771-05ae7b313db4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:21.176285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6ada5-80af-48eb-90dc-e1a695c8d513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:21.177788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6ada5-80af-48eb-90dc-e1a695c8d513 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:21.177892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6ada5-80af-48eb-90dc-e1a695c8d513 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:21.178164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6ada5-80af-48eb-90dc-e1a695c8d513 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:21.179456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6ada5-80af-48eb-90dc-e1a695c8d513 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:21.179816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6ada5-80af-48eb-90dc-e1a695c8d513 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:21.183563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6ada5-80af-48eb-90dc-e1a695c8d513 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:21.219321 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 284/548] 10.222.0.13 () {56 vars in 1154 bytes} [Sat Dec 18 20:32:21 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:21.225438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95176f35-563c-4777-b527-1b647bd91ab9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:21.236998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95176f35-563c-4777-b527-1b647bd91ab9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:21.252854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a8a28-3c24-4e2e-9079-c665daf373a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:21.253934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a8a28-3c24-4e2e-9079-c665daf373a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:21.254243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a8a28-3c24-4e2e-9079-c665daf373a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:21.254579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a8a28-3c24-4e2e-9079-c665daf373a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:21.278080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a8a28-3c24-4e2e-9079-c665daf373a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:21.280140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a8a28-3c24-4e2e-9079-c665daf373a2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:21.306887 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-d20a8a28-3c24-4e2e-9079-c665daf373a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:21.308393 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 265/549] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:21.315047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6ada5-80af-48eb-90dc-e1a695c8d513 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:21.336673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6ada5-80af-48eb-90dc-e1a695c8d513 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:21.341526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b03f3-89f0-4f5f-8256-5bfcde05965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:21.342431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b03f3-89f0-4f5f-8256-5bfcde05965d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:21.342937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b03f3-89f0-4f5f-8256-5bfcde05965d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:21.350340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b03f3-89f0-4f5f-8256-5bfcde05965d admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:21.351454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b03f3-89f0-4f5f-8256-5bfcde05965d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:21.351983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b03f3-89f0-4f5f-8256-5bfcde05965d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:21.353779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b03f3-89f0-4f5f-8256-5bfcde05965d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:21.373686 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 285/550] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:21.379523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a8a28-3c24-4e2e-9079-c665daf373a2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:21.408489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a8a28-3c24-4e2e-9079-c665daf373a2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:21.420202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a7de1-e891-43b4-bdbd-28bb468b5dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:21.420996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a7de1-e891-43b4-bdbd-28bb468b5dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:21.421275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a7de1-e891-43b4-bdbd-28bb468b5dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:21.421545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a7de1-e891-43b4-bdbd-28bb468b5dc2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:21.435390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a7de1-e891-43b4-bdbd-28bb468b5dc2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:21.437728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a7de1-e891-43b4-bdbd-28bb468b5dc2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:21.461085 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-af9a7de1-e891-43b4-bdbd-28bb468b5dc2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:21.462626 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 266/551] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:21.468567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b03f3-89f0-4f5f-8256-5bfcde05965d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:21.504717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b03f3-89f0-4f5f-8256-5bfcde05965d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:21.509616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615599cb-d8bd-4dd3-82a1-aba57a14a1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:21.510551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615599cb-d8bd-4dd3-82a1-aba57a14a1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:21.511040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615599cb-d8bd-4dd3-82a1-aba57a14a1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:21.511538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615599cb-d8bd-4dd3-82a1-aba57a14a1f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:21.513070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615599cb-d8bd-4dd3-82a1-aba57a14a1f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:21.513580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615599cb-d8bd-4dd3-82a1-aba57a14a1f2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:21.522109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615599cb-d8bd-4dd3-82a1-aba57a14a1f2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:21.553763 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 286/552] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:21.560495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a7de1-e891-43b4-bdbd-28bb468b5dc2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:21.583988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f57151-8b2a-4b15-8ea8-2ff2e1aac801 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:21.584707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a7de1-e891-43b4-bdbd-28bb468b5dc2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:21.585044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f57151-8b2a-4b15-8ea8-2ff2e1aac801 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:21.585575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f57151-8b2a-4b15-8ea8-2ff2e1aac801 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:21.591514 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 287/553] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:21 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:21.594802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9a1d7-dd6c-4e65-9128-c6e296ebd0eb None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:21.595706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9a1d7-dd6c-4e65-9128-c6e296ebd0eb None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:21.596584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9a1d7-dd6c-4e65-9128-c6e296ebd0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:21.598179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6abea0-2ef4-4ec7-b2b5-c84dd59ea97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:21.599144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6abea0-2ef4-4ec7-b2b5-c84dd59ea97e admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:21.599430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6abea0-2ef4-4ec7-b2b5-c84dd59ea97e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:21.599693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6abea0-2ef4-4ec7-b2b5-c84dd59ea97e admin admin] PATH_INFO: `/v3/projects/0dd4d15f423642fa8da604b758048203/users/a180acaefee3489788068c927fbe403c/roles/0071fc3d75b34850b7fb01a06a0279c5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:21.623284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-99b9a1d7-dd6c-4e65-9128-c6e296ebd0eb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:21.624913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-99b9a1d7-dd6c-4e65-9128-c6e296ebd0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:21.632192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6abea0-2ef4-4ec7-b2b5-c84dd59ea97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd4d15f423642fa8da604b758048203, user_id=a180acaefee3489788068c927fbe403c, role_id=0071fc3d75b34850b7fb01a06a0279c5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:21.635340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6abea0-2ef4-4ec7-b2b5-c84dd59ea97e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:21.651528 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 288/554] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:32:21.678007 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 267/555] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:32:21 2021] PUT /identity/v3/projects/0dd4d15f423642fa8da604b758048203/users/a180acaefee3489788068c927fbe403c/roles/0071fc3d75b34850b7fb01a06a0279c5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:32:21.707706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9a1d7-dd6c-4e65-9128-c6e296ebd0eb None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:21.728730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9a1d7-dd6c-4e65-9128-c6e296ebd0eb None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:21.863525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade822-beca-4008-8bcb-d4af282eca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:21.864343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade822-beca-4008-8bcb-d4af282eca2a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:21.864637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade822-beca-4008-8bcb-d4af282eca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:21.866614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade822-beca-4008-8bcb-d4af282eca2a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:21.883258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ade822-beca-4008-8bcb-d4af282eca2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:21.904828 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-78ade822-beca-4008-8bcb-d4af282eca2a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:21.904828 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 289/556] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:21 2021] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:21.912933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6abea0-2ef4-4ec7-b2b5-c84dd59ea97e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:21.950433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6abea0-2ef4-4ec7-b2b5-c84dd59ea97e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:21.959846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f38575-e657-43bb-b341-33109076c567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:21.960934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f38575-e657-43bb-b341-33109076c567 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:21.961431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f38575-e657-43bb-b341-33109076c567 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:21.961936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f38575-e657-43bb-b341-33109076c567 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:21.962969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f38575-e657-43bb-b341-33109076c567 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:21.963499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f38575-e657-43bb-b341-33109076c567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:21.966059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f38575-e657-43bb-b341-33109076c567 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:21.983347 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 268/557] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:21 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:21.989624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade822-beca-4008-8bcb-d4af282eca2a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.022277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade822-beca-4008-8bcb-d4af282eca2a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.051887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e0845-fe4b-415e-b703-8fd9344bb833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.052706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e0845-fe4b-415e-b703-8fd9344bb833 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.053004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e0845-fe4b-415e-b703-8fd9344bb833 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.053286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e0845-fe4b-415e-b703-8fd9344bb833 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.068031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e0845-fe4b-415e-b703-8fd9344bb833 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:22.068031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e0845-fe4b-415e-b703-8fd9344bb833 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:22.094277 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-182e0845-fe4b-415e-b703-8fd9344bb833 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:22.096409 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 290/558] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:22.107380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f38575-e657-43bb-b341-33109076c567 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.125260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f38575-e657-43bb-b341-33109076c567 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.143560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60932eec-26b6-4abb-9a4c-7f8390f123ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.144248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60932eec-26b6-4abb-9a4c-7f8390f123ed admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.144537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60932eec-26b6-4abb-9a4c-7f8390f123ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.144820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60932eec-26b6-4abb-9a4c-7f8390f123ed admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.145571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60932eec-26b6-4abb-9a4c-7f8390f123ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:22.145881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60932eec-26b6-4abb-9a4c-7f8390f123ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:22.154369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60932eec-26b6-4abb-9a4c-7f8390f123ed admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:22.164925 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 269/559] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:22.171948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e0845-fe4b-415e-b703-8fd9344bb833 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.181989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e0845-fe4b-415e-b703-8fd9344bb833 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.201815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36494498-a0c5-4704-8ce3-9fd5dce549d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.202572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36494498-a0c5-4704-8ce3-9fd5dce549d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.202860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36494498-a0c5-4704-8ce3-9fd5dce549d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.203132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36494498-a0c5-4704-8ce3-9fd5dce549d8 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.216284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36494498-a0c5-4704-8ce3-9fd5dce549d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:22.226482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36494498-a0c5-4704-8ce3-9fd5dce549d8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:22.243886 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-36494498-a0c5-4704-8ce3-9fd5dce549d8 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 18 20:32:22.245402 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 291/560] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:22 2021] GET /identity/v3/users/glance => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:22.251441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60932eec-26b6-4abb-9a4c-7f8390f123ed admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.274295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60932eec-26b6-4abb-9a4c-7f8390f123ed admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.287544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db64a34-0d5e-4e24-a071-c002c5e2ab93 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.287837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db64a34-0d5e-4e24-a071-c002c5e2ab93 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.288116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db64a34-0d5e-4e24-a071-c002c5e2ab93 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.291058 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 292/561] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:22.291766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b591e43-0c5a-4f7c-b700-ad4060b4a981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.292448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b591e43-0c5a-4f7c-b700-ad4060b4a981 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.292728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b591e43-0c5a-4f7c-b700-ad4060b4a981 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.293004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b591e43-0c5a-4f7c-b700-ad4060b4a981 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.293912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b591e43-0c5a-4f7c-b700-ad4060b4a981 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:22.298276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b591e43-0c5a-4f7c-b700-ad4060b4a981 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:22.298413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d275af4-62cf-470f-9f5e-e3062bb9e3dc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.298413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d275af4-62cf-470f-9f5e-e3062bb9e3dc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.298541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b591e43-0c5a-4f7c-b700-ad4060b4a981 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:22.298607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d275af4-62cf-470f-9f5e-e3062bb9e3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.338278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0d275af4-62cf-470f-9f5e-e3062bb9e3dc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:22.338278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0d275af4-62cf-470f-9f5e-e3062bb9e3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:22.348552 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 270/562] 10.222.0.13 () {56 vars in 1158 bytes} [Sat Dec 18 20:32:22 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:22.358279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b591e43-0c5a-4f7c-b700-ad4060b4a981 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.369884 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 293/563] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:32:22.374279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b591e43-0c5a-4f7c-b700-ad4060b4a981 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.390419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7c227-8c80-4c6b-98ac-bbfb296d9e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.391343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7c227-8c80-4c6b-98ac-bbfb296d9e81 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.391627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7c227-8c80-4c6b-98ac-bbfb296d9e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.391926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7c227-8c80-4c6b-98ac-bbfb296d9e81 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.410980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7c227-8c80-4c6b-98ac-bbfb296d9e81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:22.414282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d275af4-62cf-470f-9f5e-e3062bb9e3dc None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.423887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d275af4-62cf-470f-9f5e-e3062bb9e3dc None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.426279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7c227-8c80-4c6b-98ac-bbfb296d9e81 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:22.443053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76279203-2057-459e-9aa0-2bfadaa0de63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.443864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76279203-2057-459e-9aa0-2bfadaa0de63 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.444205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76279203-2057-459e-9aa0-2bfadaa0de63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.444589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76279203-2057-459e-9aa0-2bfadaa0de63 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.460148 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-8db7c227-8c80-4c6b-98ac-bbfb296d9e81 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:22.460148 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 271/564] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:22.470794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76279203-2057-459e-9aa0-2bfadaa0de63 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:22.476989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7c227-8c80-4c6b-98ac-bbfb296d9e81 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.487948 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-76279203-2057-459e-9aa0-2bfadaa0de63 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:22.487948 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 294/565] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:32:22.492115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7c227-8c80-4c6b-98ac-bbfb296d9e81 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.494292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76279203-2057-459e-9aa0-2bfadaa0de63 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.506510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d1419-6473-4992-8ae9-551f3a33ecf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.507390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d1419-6473-4992-8ae9-551f3a33ecf3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.507839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d1419-6473-4992-8ae9-551f3a33ecf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.508127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d1419-6473-4992-8ae9-551f3a33ecf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.508935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d1419-6473-4992-8ae9-551f3a33ecf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:22.509245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d1419-6473-4992-8ae9-551f3a33ecf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:22.511079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d1419-6473-4992-8ae9-551f3a33ecf3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:22.512284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76279203-2057-459e-9aa0-2bfadaa0de63 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.523618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef3530-9f97-4fd5-b25d-00e09d99e357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.526275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef3530-9f97-4fd5-b25d-00e09d99e357 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.526275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef3530-9f97-4fd5-b25d-00e09d99e357 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.526275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef3530-9f97-4fd5-b25d-00e09d99e357 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.526879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef3530-9f97-4fd5-b25d-00e09d99e357 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:22.527218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef3530-9f97-4fd5-b25d-00e09d99e357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:22.529954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef3530-9f97-4fd5-b25d-00e09d99e357 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:22.532105 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 272/566] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:22.533508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb314b5-0417-48ef-b0d0-47008fa83dcf None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.533837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb314b5-0417-48ef-b0d0-47008fa83dcf None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.534115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb314b5-0417-48ef-b0d0-47008fa83dcf None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.537004 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 273/567] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:22.547001 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 295/568] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:22.547242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb314b5-0417-48ef-b0d0-47008fa83dcf None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.548363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c175ee1-80af-4e34-8ddc-0c6245b8e49b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.550282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c175ee1-80af-4e34-8ddc-0c6245b8e49b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.550282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c175ee1-80af-4e34-8ddc-0c6245b8e49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.572537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4c175ee1-80af-4e34-8ddc-0c6245b8e49b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:22.574126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4c175ee1-80af-4e34-8ddc-0c6245b8e49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:22.575077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb314b5-0417-48ef-b0d0-47008fa83dcf None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.580587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f7338-8b61-47c2-b281-63218061d6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.581358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f7338-8b61-47c2-b281-63218061d6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.581634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f7338-8b61-47c2-b281-63218061d6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.581914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f7338-8b61-47c2-b281-63218061d6d7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.589352 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 296/569] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:22.591195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c175ee1-80af-4e34-8ddc-0c6245b8e49b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.591301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f7338-8b61-47c2-b281-63218061d6d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:22.593381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f7338-8b61-47c2-b281-63218061d6d7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:22.616597 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-504f7338-8b61-47c2-b281-63218061d6d7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:22.617095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c175ee1-80af-4e34-8ddc-0c6245b8e49b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.623998 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 274/570] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:22.625197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170ddf3-f82c-4168-9155-2b1eefad1dcd None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.625453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170ddf3-f82c-4168-9155-2b1eefad1dcd None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.625732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170ddf3-f82c-4168-9155-2b1eefad1dcd None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.627261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f459d56-aa78-4a5d-b5de-ab8cd446f90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.632157 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 275/571] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:22.632157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170ddf3-f82c-4168-9155-2b1eefad1dcd None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.632333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f459d56-aa78-4a5d-b5de-ab8cd446f90b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.632333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f459d56-aa78-4a5d-b5de-ab8cd446f90b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.632333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f459d56-aa78-4a5d-b5de-ab8cd446f90b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.648141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170ddf3-f82c-4168-9155-2b1eefad1dcd None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.648648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f459d56-aa78-4a5d-b5de-ab8cd446f90b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:22.650793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f459d56-aa78-4a5d-b5de-ab8cd446f90b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:22.652980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f74e7-67f9-4c1d-9e31-edd5f8d17144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.653627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f74e7-67f9-4c1d-9e31-edd5f8d17144 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.653909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f74e7-67f9-4c1d-9e31-edd5f8d17144 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.654347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f74e7-67f9-4c1d-9e31-edd5f8d17144 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.655111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f74e7-67f9-4c1d-9e31-edd5f8d17144 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:22.655421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f74e7-67f9-4c1d-9e31-edd5f8d17144 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:22.657245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f74e7-67f9-4c1d-9e31-edd5f8d17144 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:22.674843 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 276/572] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:22.675004 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-3f459d56-aa78-4a5d-b5de-ab8cd446f90b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:22.675087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f74e7-67f9-4c1d-9e31-edd5f8d17144 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.675172 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 297/573] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:22.675172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1092a-84e3-4652-9131-503be37374cb None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.675172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1092a-84e3-4652-9131-503be37374cb None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.675172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1092a-84e3-4652-9131-503be37374cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.693906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f74e7-67f9-4c1d-9e31-edd5f8d17144 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.698935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6ba1092a-84e3-4652-9131-503be37374cb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:22.700163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6ba1092a-84e3-4652-9131-503be37374cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:22.702868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8896bff-deb5-4046-9cb5-35652ee463f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.703665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8896bff-deb5-4046-9cb5-35652ee463f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.703933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8896bff-deb5-4046-9cb5-35652ee463f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.704205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8896bff-deb5-4046-9cb5-35652ee463f2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.708843 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 298/574] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:22.710049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1092a-84e3-4652-9131-503be37374cb None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.723702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1092a-84e3-4652-9131-503be37374cb None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.724237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8896bff-deb5-4046-9cb5-35652ee463f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:22.728135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708e2a7-3941-4f69-99ae-a7cee3fba1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.728996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708e2a7-3941-4f69-99ae-a7cee3fba1d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.729275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708e2a7-3941-4f69-99ae-a7cee3fba1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.729544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708e2a7-3941-4f69-99ae-a7cee3fba1d7 admin admin] PATH_INFO: `/v3/projects/0dd4d15f423642fa8da604b758048203/users/82fb4302bcd54627a264f22ad78aa339/roles/0071fc3d75b34850b7fb01a06a0279c5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.734323 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-a8896bff-deb5-4046-9cb5-35652ee463f2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:22.735716 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 277/575] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:22.736409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8896bff-deb5-4046-9cb5-35652ee463f2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.756108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8896bff-deb5-4046-9cb5-35652ee463f2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.760098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708e2a7-3941-4f69-99ae-a7cee3fba1d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd4d15f423642fa8da604b758048203, user_id=82fb4302bcd54627a264f22ad78aa339, role_id=0071fc3d75b34850b7fb01a06a0279c5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:22.764629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708e2a7-3941-4f69-99ae-a7cee3fba1d7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:22.766576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bee2c-156f-4e6c-964f-adc49bd81fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.767628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bee2c-156f-4e6c-964f-adc49bd81fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.768413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bee2c-156f-4e6c-964f-adc49bd81fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.769517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bee2c-156f-4e6c-964f-adc49bd81fe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.771957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bee2c-156f-4e6c-964f-adc49bd81fe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:22.772351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bee2c-156f-4e6c-964f-adc49bd81fe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:22.774119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bee2c-156f-4e6c-964f-adc49bd81fe7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:22.787810 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 299/576] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:32:22 2021] PUT /identity/v3/projects/0dd4d15f423642fa8da604b758048203/users/82fb4302bcd54627a264f22ad78aa339/roles/0071fc3d75b34850b7fb01a06a0279c5 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:32:22.787810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708e2a7-3941-4f69-99ae-a7cee3fba1d7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.797716 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 278/577] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:22.803732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bee2c-156f-4e6c-964f-adc49bd81fe7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.815010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bee2c-156f-4e6c-964f-adc49bd81fe7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.879446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee1641-6c27-463e-a823-d8246cf7bb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.880135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee1641-6c27-463e-a823-d8246cf7bb3e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.880421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee1641-6c27-463e-a823-d8246cf7bb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.880701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee1641-6c27-463e-a823-d8246cf7bb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.881467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee1641-6c27-463e-a823-d8246cf7bb3e admin admin] RBAC: Adding query filter params (name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:22.881778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee1641-6c27-463e-a823-d8246cf7bb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:22.883479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee1641-6c27-463e-a823-d8246cf7bb3e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:22.895365 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 279/578] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:22.896307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee1641-6c27-463e-a823-d8246cf7bb3e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.897426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708e2a7-3941-4f69-99ae-a7cee3fba1d7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.903395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84738915-e870-4844-8f3e-ae3f17a2370b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.904563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84738915-e870-4844-8f3e-ae3f17a2370b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.905049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84738915-e870-4844-8f3e-ae3f17a2370b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.905611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84738915-e870-4844-8f3e-ae3f17a2370b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.908084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee1641-6c27-463e-a823-d8246cf7bb3e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.913395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e739ab1-459e-4705-904a-cce90a38baec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.914196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739ab1-459e-4705-904a-cce90a38baec admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.914863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739ab1-459e-4705-904a-cce90a38baec admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.915185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739ab1-459e-4705-904a-cce90a38baec admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.924989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84738915-e870-4844-8f3e-ae3f17a2370b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:22.929072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e739ab1-459e-4705-904a-cce90a38baec admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:22.931646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e739ab1-459e-4705-904a-cce90a38baec admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:22.935698 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-84738915-e870-4844-8f3e-ae3f17a2370b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:22.943156 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 300/579] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:22.945113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84738915-e870-4844-8f3e-ae3f17a2370b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.955883 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-8e739ab1-459e-4705-904a-cce90a38baec admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 18 20:32:22.957539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84738915-e870-4844-8f3e-ae3f17a2370b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.963519 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 280/580] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:22 2021] GET /identity/v3/users/cinder => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:22.963694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e739ab1-459e-4705-904a-cce90a38baec admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:22.964732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f61ff-b882-4ff5-b2ea-fe5a63e75c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.965936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f61ff-b882-4ff5-b2ea-fe5a63e75c38 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.966795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f61ff-b882-4ff5-b2ea-fe5a63e75c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.967439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f61ff-b882-4ff5-b2ea-fe5a63e75c38 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.976852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e739ab1-459e-4705-904a-cce90a38baec admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:22.983135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f61ff-b882-4ff5-b2ea-fe5a63e75c38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:22.983674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a2631-73fc-40c6-b561-b3779863812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:22.984362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a2631-73fc-40c6-b561-b3779863812e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:22.984647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a2631-73fc-40c6-b561-b3779863812e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:22.984934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a2631-73fc-40c6-b561-b3779863812e admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:22.985710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a2631-73fc-40c6-b561-b3779863812e admin admin] RBAC: Adding query filter params (name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:22.986017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a2631-73fc-40c6-b561-b3779863812e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:22.987113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f61ff-b882-4ff5-b2ea-fe5a63e75c38 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:22.993624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a2631-73fc-40c6-b561-b3779863812e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.009053 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 281/581] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:23.009919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a2631-73fc-40c6-b561-b3779863812e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.017426 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-de3f61ff-b882-4ff5-b2ea-fe5a63e75c38 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:23.020528 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 301/582] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:23.021529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f61ff-b882-4ff5-b2ea-fe5a63e75c38 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.022188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a2631-73fc-40c6-b561-b3779863812e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.034751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f61ff-b882-4ff5-b2ea-fe5a63e75c38 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.034916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b9bf2-1155-44e1-bfca-d2c80caab03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.035490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b9bf2-1155-44e1-bfca-d2c80caab03e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.035780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b9bf2-1155-44e1-bfca-d2c80caab03e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.036058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b9bf2-1155-44e1-bfca-d2c80caab03e admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.036911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b9bf2-1155-44e1-bfca-d2c80caab03e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:23.037226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b9bf2-1155-44e1-bfca-d2c80caab03e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.039109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b9bf2-1155-44e1-bfca-d2c80caab03e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.040965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9f521-28e2-4c91-9216-78fa1a317c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.042002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9f521-28e2-4c91-9216-78fa1a317c25 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.042531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9f521-28e2-4c91-9216-78fa1a317c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.043006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9f521-28e2-4c91-9216-78fa1a317c25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.063194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9f521-28e2-4c91-9216-78fa1a317c25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.063798 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 282/583] 10.222.0.13 () {56 vars in 1158 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:23.064832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b9bf2-1155-44e1-bfca-d2c80caab03e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.069963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9f521-28e2-4c91-9216-78fa1a317c25 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.076878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b9bf2-1155-44e1-bfca-d2c80caab03e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.083915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45b6bd-1b3e-410e-b790-a8e89fef110e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.084567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45b6bd-1b3e-410e-b790-a8e89fef110e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.084854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45b6bd-1b3e-410e-b790-a8e89fef110e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.085133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45b6bd-1b3e-410e-b790-a8e89fef110e admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.085864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45b6bd-1b3e-410e-b790-a8e89fef110e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:23.086173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45b6bd-1b3e-410e-b790-a8e89fef110e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.088010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45b6bd-1b3e-410e-b790-a8e89fef110e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.096884 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-cfb9f521-28e2-4c91-9216-78fa1a317c25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:23.098279 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 302/584] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:23.103137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9f521-28e2-4c91-9216-78fa1a317c25 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.106662 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 283/585] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:23.108478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45b6bd-1b3e-410e-b790-a8e89fef110e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.119416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9f521-28e2-4c91-9216-78fa1a317c25 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.122814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45b6bd-1b3e-410e-b790-a8e89fef110e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.126774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341816d-b3d9-4b97-9b8b-82a8f26eae73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.127624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341816d-b3d9-4b97-9b8b-82a8f26eae73 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.127966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341816d-b3d9-4b97-9b8b-82a8f26eae73 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.128296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341816d-b3d9-4b97-9b8b-82a8f26eae73 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.129173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eee83d-8706-4d02-947f-a7b5830d03b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.130075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eee83d-8706-4d02-947f-a7b5830d03b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.130722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eee83d-8706-4d02-947f-a7b5830d03b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.131176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eee83d-8706-4d02-947f-a7b5830d03b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.132462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eee83d-8706-4d02-947f-a7b5830d03b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:23.132960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eee83d-8706-4d02-947f-a7b5830d03b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.135878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eee83d-8706-4d02-947f-a7b5830d03b7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.142033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341816d-b3d9-4b97-9b8b-82a8f26eae73 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.145558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341816d-b3d9-4b97-9b8b-82a8f26eae73 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.150773 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 284/586] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:23.152149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eee83d-8706-4d02-947f-a7b5830d03b7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.165027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eee83d-8706-4d02-947f-a7b5830d03b7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.172023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c34bc-0864-45e2-aa92-722683290c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.175690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c34bc-0864-45e2-aa92-722683290c76 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.176194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c34bc-0864-45e2-aa92-722683290c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.176654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c34bc-0864-45e2-aa92-722683290c76 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.178060 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-d341816d-b3d9-4b97-9b8b-82a8f26eae73 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:23.180408 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 303/587] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:23.187357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341816d-b3d9-4b97-9b8b-82a8f26eae73 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.191941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c34bc-0864-45e2-aa92-722683290c76 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.195465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c34bc-0864-45e2-aa92-722683290c76 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.201400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341816d-b3d9-4b97-9b8b-82a8f26eae73 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.209766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823010c9-f639-4a2d-95cc-903ae8c4f9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.211164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823010c9-f639-4a2d-95cc-903ae8c4f9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.211515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823010c9-f639-4a2d-95cc-903ae8c4f9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.211936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823010c9-f639-4a2d-95cc-903ae8c4f9d0 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.212984 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-9a5c34bc-0864-45e2-aa92-722683290c76 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 18 20:32:23.215539 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 285/588] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/users/swift => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:23.216591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c34bc-0864-45e2-aa92-722683290c76 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.233930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823010c9-f639-4a2d-95cc-903ae8c4f9d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.238951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823010c9-f639-4a2d-95cc-903ae8c4f9d0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.241769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c34bc-0864-45e2-aa92-722683290c76 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.258175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68753bab-fd8c-4012-8dbd-c48d3bc076b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.259198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68753bab-fd8c-4012-8dbd-c48d3bc076b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.259623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68753bab-fd8c-4012-8dbd-c48d3bc076b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.260071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68753bab-fd8c-4012-8dbd-c48d3bc076b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.261188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68753bab-fd8c-4012-8dbd-c48d3bc076b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:23.261662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68753bab-fd8c-4012-8dbd-c48d3bc076b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.275248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68753bab-fd8c-4012-8dbd-c48d3bc076b6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.285223 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-823010c9-f639-4a2d-95cc-903ae8c4f9d0 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 18 20:32:23.291846 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 304/589] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/users/neutron => generated 85 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:23.291846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823010c9-f639-4a2d-95cc-903ae8c4f9d0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.308101 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 286/590] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:23.308101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68753bab-fd8c-4012-8dbd-c48d3bc076b6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.311339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823010c9-f639-4a2d-95cc-903ae8c4f9d0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.323506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d8283-3983-4f77-b15c-dcdac38ffb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.324181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d8283-3983-4f77-b15c-dcdac38ffb40 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.324578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d8283-3983-4f77-b15c-dcdac38ffb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.324842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d8283-3983-4f77-b15c-dcdac38ffb40 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.325697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d8283-3983-4f77-b15c-dcdac38ffb40 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:23.326007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d8283-3983-4f77-b15c-dcdac38ffb40 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.327869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d8283-3983-4f77-b15c-dcdac38ffb40 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.330701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68753bab-fd8c-4012-8dbd-c48d3bc076b6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.335260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54253c1a-ce95-449e-a1f5-b584d7329ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.335918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54253c1a-ce95-449e-a1f5-b584d7329ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.336196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54253c1a-ce95-449e-a1f5-b584d7329ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.336476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54253c1a-ce95-449e-a1f5-b584d7329ff4 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.337315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54253c1a-ce95-449e-a1f5-b584d7329ff4 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:23.337636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54253c1a-ce95-449e-a1f5-b584d7329ff4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.339466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54253c1a-ce95-449e-a1f5-b584d7329ff4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.375123 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 305/591] 10.222.0.13 () {56 vars in 1156 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:23.375828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d8283-3983-4f77-b15c-dcdac38ffb40 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.389038 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 287/592] 10.222.0.13 () {56 vars in 1160 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:23.389038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54253c1a-ce95-449e-a1f5-b584d7329ff4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.394454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d8283-3983-4f77-b15c-dcdac38ffb40 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.403799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54253c1a-ce95-449e-a1f5-b584d7329ff4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.405868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51836e-ef0d-460a-b099-54ab230d6e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.406697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51836e-ef0d-460a-b099-54ab230d6e17 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.406987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51836e-ef0d-460a-b099-54ab230d6e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.407261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51836e-ef0d-460a-b099-54ab230d6e17 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.414976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336b6da-4b16-4e02-918e-f5e5ee78d8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.415618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336b6da-4b16-4e02-918e-f5e5ee78d8de admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.415899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336b6da-4b16-4e02-918e-f5e5ee78d8de admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.416184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336b6da-4b16-4e02-918e-f5e5ee78d8de admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.423951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51836e-ef0d-460a-b099-54ab230d6e17 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.425900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51836e-ef0d-460a-b099-54ab230d6e17 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.433652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336b6da-4b16-4e02-918e-f5e5ee78d8de admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.439512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336b6da-4b16-4e02-918e-f5e5ee78d8de admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.454221 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-6d51836e-ef0d-460a-b099-54ab230d6e17 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:23.455450 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 306/593] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:23.459694 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 288/594] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:32:23.461409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336b6da-4b16-4e02-918e-f5e5ee78d8de admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.461884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51836e-ef0d-460a-b099-54ab230d6e17 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.476442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336b6da-4b16-4e02-918e-f5e5ee78d8de admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.482376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51836e-ef0d-460a-b099-54ab230d6e17 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.490026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aa6ad-6967-412a-a55a-63f3fe2ab7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.492567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa6ad-6967-412a-a55a-63f3fe2ab7fc admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.493546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa6ad-6967-412a-a55a-63f3fe2ab7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.494114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa6ad-6967-412a-a55a-63f3fe2ab7fc admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.496310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aa6ad-6967-412a-a55a-63f3fe2ab7fc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:23.497121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aa6ad-6967-412a-a55a-63f3fe2ab7fc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.498883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959299a-c029-4295-8b1f-6063636af9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.499666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959299a-c029-4295-8b1f-6063636af9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.499943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959299a-c029-4295-8b1f-6063636af9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.500219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959299a-c029-4295-8b1f-6063636af9b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.501496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aa6ad-6967-412a-a55a-63f3fe2ab7fc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.520730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959299a-c029-4295-8b1f-6063636af9b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.526527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959299a-c029-4295-8b1f-6063636af9b4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.528754 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 289/595] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:23.529590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aa6ad-6967-412a-a55a-63f3fe2ab7fc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.547942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aa6ad-6967-412a-a55a-63f3fe2ab7fc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.555992 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-3959299a-c029-4295-8b1f-6063636af9b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:23.557336 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 307/596] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:23.562959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7415354-1c80-4ce3-aca8-2626ee320db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.564153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7415354-1c80-4ce3-aca8-2626ee320db4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.564582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7415354-1c80-4ce3-aca8-2626ee320db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.565005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7415354-1c80-4ce3-aca8-2626ee320db4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.566889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959299a-c029-4295-8b1f-6063636af9b4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.589543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959299a-c029-4295-8b1f-6063636af9b4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.592528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7415354-1c80-4ce3-aca8-2626ee320db4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.594420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7415354-1c80-4ce3-aca8-2626ee320db4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.600013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2953ded-b45e-40df-8041-f88b736e5f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.600892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2953ded-b45e-40df-8041-f88b736e5f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.601175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2953ded-b45e-40df-8041-f88b736e5f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.601452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2953ded-b45e-40df-8041-f88b736e5f1b admin admin] PATH_INFO: `/v3/projects/0dd4d15f423642fa8da604b758048203/users/62bd53b4d64643d28ac7f4ea0ea45f90/roles/0071fc3d75b34850b7fb01a06a0279c5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.627765 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-c7415354-1c80-4ce3-aca8-2626ee320db4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:23.634830 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 290/597] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:23.635645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2953ded-b45e-40df-8041-f88b736e5f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd4d15f423642fa8da604b758048203, user_id=62bd53b4d64643d28ac7f4ea0ea45f90, role_id=0071fc3d75b34850b7fb01a06a0279c5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.638805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7415354-1c80-4ce3-aca8-2626ee320db4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.640157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2953ded-b45e-40df-8041-f88b736e5f1b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.659190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7415354-1c80-4ce3-aca8-2626ee320db4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.664453 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 308/598] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:32:23 2021] PUT /identity/v3/projects/0dd4d15f423642fa8da604b758048203/users/62bd53b4d64643d28ac7f4ea0ea45f90/roles/0071fc3d75b34850b7fb01a06a0279c5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:32:23.666473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2953ded-b45e-40df-8041-f88b736e5f1b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.788466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04b40c-fd5e-488e-8597-e76fdecd484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.791190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04b40c-fd5e-488e-8597-e76fdecd484e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.791491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04b40c-fd5e-488e-8597-e76fdecd484e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.791776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04b40c-fd5e-488e-8597-e76fdecd484e admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.794882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04b40c-fd5e-488e-8597-e76fdecd484e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:23.795201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04b40c-fd5e-488e-8597-e76fdecd484e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.799497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04b40c-fd5e-488e-8597-e76fdecd484e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.811634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2953ded-b45e-40df-8041-f88b736e5f1b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.823060 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 291/599] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:23.825823 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8d65a-1239-4ff5-8a29-8de90da585a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.830376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8d65a-1239-4ff5-8a29-8de90da585a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.830376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8d65a-1239-4ff5-8a29-8de90da585a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.830376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8d65a-1239-4ff5-8a29-8de90da585a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.830376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8d65a-1239-4ff5-8a29-8de90da585a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:23.830376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8d65a-1239-4ff5-8a29-8de90da585a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.830376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8d65a-1239-4ff5-8a29-8de90da585a1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.834842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04b40c-fd5e-488e-8597-e76fdecd484e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.846879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04b40c-fd5e-488e-8597-e76fdecd484e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.862279 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 309/600] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:23.862488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e79b0e-2c7e-4627-93d8-d80ad22eca2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.862488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e79b0e-2c7e-4627-93d8-d80ad22eca2b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.862488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e79b0e-2c7e-4627-93d8-d80ad22eca2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.862488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e79b0e-2c7e-4627-93d8-d80ad22eca2b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.868687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8d65a-1239-4ff5-8a29-8de90da585a1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.890307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e79b0e-2c7e-4627-93d8-d80ad22eca2b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.890307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e79b0e-2c7e-4627-93d8-d80ad22eca2b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.902282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8d65a-1239-4ff5-8a29-8de90da585a1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.917876 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-40e79b0e-2c7e-4627-93d8-d80ad22eca2b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:23.917876 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 292/601] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:23.926232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e79b0e-2c7e-4627-93d8-d80ad22eca2b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:23.932776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc36bb-8c69-4f95-85d8-c9d6e39952bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.934378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc36bb-8c69-4f95-85d8-c9d6e39952bd admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.934793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc36bb-8c69-4f95-85d8-c9d6e39952bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.935189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc36bb-8c69-4f95-85d8-c9d6e39952bd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.947686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc36bb-8c69-4f95-85d8-c9d6e39952bd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.951344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc36bb-8c69-4f95-85d8-c9d6e39952bd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.966527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e79b0e-2c7e-4627-93d8-d80ad22eca2b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:23.974675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960a1ba-90de-47e4-bb7c-f7662f5d229c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:23.976287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960a1ba-90de-47e4-bb7c-f7662f5d229c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:23.976564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960a1ba-90de-47e4-bb7c-f7662f5d229c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:23.977005 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-e3bc36bb-8c69-4f95-85d8-c9d6e39952bd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:23.979244 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 310/602] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:32:23.979356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960a1ba-90de-47e4-bb7c-f7662f5d229c admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:23.980077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960a1ba-90de-47e4-bb7c-f7662f5d229c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:23.980386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960a1ba-90de-47e4-bb7c-f7662f5d229c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:23.982347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960a1ba-90de-47e4-bb7c-f7662f5d229c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:23.984888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc36bb-8c69-4f95-85d8-c9d6e39952bd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:24.001212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc36bb-8c69-4f95-85d8-c9d6e39952bd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:24.007261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72eabf-aeef-41d6-ba15-cc817f68b8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:24.008164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72eabf-aeef-41d6-ba15-cc817f68b8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:24.008449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72eabf-aeef-41d6-ba15-cc817f68b8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:24.008726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72eabf-aeef-41d6-ba15-cc817f68b8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:24.008965 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 293/603] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:24.009585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72eabf-aeef-41d6-ba15-cc817f68b8a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:24.009893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72eabf-aeef-41d6-ba15-cc817f68b8a7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:24.015095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72eabf-aeef-41d6-ba15-cc817f68b8a7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:24.015373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960a1ba-90de-47e4-bb7c-f7662f5d229c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:24.032657 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 311/604] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:24.037279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960a1ba-90de-47e4-bb7c-f7662f5d229c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:24.042097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72eabf-aeef-41d6-ba15-cc817f68b8a7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:24.044759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abbec7-bd54-4290-94c3-9f69ca75800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:24.045833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abbec7-bd54-4290-94c3-9f69ca75800a admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:24.045933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abbec7-bd54-4290-94c3-9f69ca75800a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:24.050272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abbec7-bd54-4290-94c3-9f69ca75800a admin admin] PATH_INFO: `/v3/projects/0dd4d15f423642fa8da604b758048203/users/6f8eeb55c523480fb45d4bbb8afe8e7e/roles/0071fc3d75b34850b7fb01a06a0279c5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:24.058272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72eabf-aeef-41d6-ba15-cc817f68b8a7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:24.070271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abbec7-bd54-4290-94c3-9f69ca75800a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd4d15f423642fa8da604b758048203, user_id=6f8eeb55c523480fb45d4bbb8afe8e7e, role_id=0071fc3d75b34850b7fb01a06a0279c5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:24.070428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abbec7-bd54-4290-94c3-9f69ca75800a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:24.074274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65a71b-8a4a-4521-9ee8-76dbb3a43fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:24.074274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65a71b-8a4a-4521-9ee8-76dbb3a43fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:24.074274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65a71b-8a4a-4521-9ee8-76dbb3a43fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:24.074274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65a71b-8a4a-4521-9ee8-76dbb3a43fd7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:24.075180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65a71b-8a4a-4521-9ee8-76dbb3a43fd7 admin admin] RBAC: Adding query filter params (role.id=0071fc3d75b34850b7fb01a06a0279c5, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=f5e4bc28d0744b65ab520bf79cea5a45) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:24.075180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65a71b-8a4a-4521-9ee8-76dbb3a43fd7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:24.078284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65a71b-8a4a-4521-9ee8-76dbb3a43fd7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:24.094284 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 312/605] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:24 2021] GET /identity/v3/role_assignments?user.id=f5e4bc28d0744b65ab520bf79cea5a45&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=0071fc3d75b34850b7fb01a06a0279c5 => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:24.096445 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 294/606] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:32:24 2021] PUT /identity/v3/projects/0dd4d15f423642fa8da604b758048203/users/6f8eeb55c523480fb45d4bbb8afe8e7e/roles/0071fc3d75b34850b7fb01a06a0279c5 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:32:24.708480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20a73f-36fa-470d-913d-ae78ff76fcac None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:24.708868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20a73f-36fa-470d-913d-ae78ff76fcac None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:24.709460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20a73f-36fa-470d-913d-ae78ff76fcac None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:24.711325 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 313/607] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:24.723943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dc95d-040a-4918-8e78-1583493f3c07 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:24.723943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dc95d-040a-4918-8e78-1583493f3c07 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:24.723943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dc95d-040a-4918-8e78-1583493f3c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:24.753201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-297dc95d-040a-4918-8e78-1583493f3c07 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:24.755234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-297dc95d-040a-4918-8e78-1583493f3c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:24.914592 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 295/608] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:24.959463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20a73f-36fa-470d-913d-ae78ff76fcac None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:24.996095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20a73f-36fa-470d-913d-ae78ff76fcac None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:25.014916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55116f9f-0576-472f-a78b-bbf909775508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:25.015726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55116f9f-0576-472f-a78b-bbf909775508 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:25.016016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55116f9f-0576-472f-a78b-bbf909775508 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:25.016297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55116f9f-0576-472f-a78b-bbf909775508 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:25.033590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55116f9f-0576-472f-a78b-bbf909775508 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:25.049153 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-55116f9f-0576-472f-a78b-bbf909775508 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:25.050726 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 314/609] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:24 2021] GET /identity/v3/roles/service => generated 85 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:25.057145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dc95d-040a-4918-8e78-1583493f3c07 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:25.067620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dc95d-040a-4918-8e78-1583493f3c07 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:25.072717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33214c0-17ed-4f36-b8c5-ad05eb140187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:25.073342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33214c0-17ed-4f36-b8c5-ad05eb140187 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:25.073658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33214c0-17ed-4f36-b8c5-ad05eb140187 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:25.073971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33214c0-17ed-4f36-b8c5-ad05eb140187 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:25.074800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33214c0-17ed-4f36-b8c5-ad05eb140187 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:25.075109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33214c0-17ed-4f36-b8c5-ad05eb140187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:25.076813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33214c0-17ed-4f36-b8c5-ad05eb140187 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:25.085331 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 296/610] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:25.091601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55116f9f-0576-472f-a78b-bbf909775508 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:25.102342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55116f9f-0576-472f-a78b-bbf909775508 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:25.107923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173dd0f-f752-465a-9b7b-5e187341c7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:25.108840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173dd0f-f752-465a-9b7b-5e187341c7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:25.109132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173dd0f-f752-465a-9b7b-5e187341c7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:25.109408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173dd0f-f752-465a-9b7b-5e187341c7b3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:25.120814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173dd0f-f752-465a-9b7b-5e187341c7b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:25.123390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173dd0f-f752-465a-9b7b-5e187341c7b3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:25.141890 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-f173dd0f-f752-465a-9b7b-5e187341c7b3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:25.143533 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 315/611] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:25.149804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33214c0-17ed-4f36-b8c5-ad05eb140187 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:25.159667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33214c0-17ed-4f36-b8c5-ad05eb140187 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:25.164351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bb70d-9e67-428a-9f2b-f90d7ad041d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:25.164997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bb70d-9e67-428a-9f2b-f90d7ad041d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:25.165317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bb70d-9e67-428a-9f2b-f90d7ad041d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:25.165681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bb70d-9e67-428a-9f2b-f90d7ad041d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:25.166472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bb70d-9e67-428a-9f2b-f90d7ad041d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:25.166794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bb70d-9e67-428a-9f2b-f90d7ad041d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:25.169107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bb70d-9e67-428a-9f2b-f90d7ad041d1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:25.181721 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 297/612] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:25.188401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173dd0f-f752-465a-9b7b-5e187341c7b3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:25.198703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173dd0f-f752-465a-9b7b-5e187341c7b3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:25.203914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c89d2-da2f-4175-a981-85f0c518dac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:25.204767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c89d2-da2f-4175-a981-85f0c518dac2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:25.205134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c89d2-da2f-4175-a981-85f0c518dac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:25.205436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c89d2-da2f-4175-a981-85f0c518dac2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:25.213795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c89d2-da2f-4175-a981-85f0c518dac2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:25.215995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c89d2-da2f-4175-a981-85f0c518dac2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:25.231554 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-b23c89d2-da2f-4175-a981-85f0c518dac2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 18 20:32:25.233203 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 316/613] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Dec 18 20:32:25 2021] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:25.239474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bb70d-9e67-428a-9f2b-f90d7ad041d1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:25.251997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bb70d-9e67-428a-9f2b-f90d7ad041d1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:25.257452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c082c-88df-4bc0-85db-8477502df914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:25.258214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c082c-88df-4bc0-85db-8477502df914 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:25.258523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c082c-88df-4bc0-85db-8477502df914 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:25.258804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c082c-88df-4bc0-85db-8477502df914 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:25.259706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c082c-88df-4bc0-85db-8477502df914 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:25.260015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c082c-88df-4bc0-85db-8477502df914 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:25.262493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c082c-88df-4bc0-85db-8477502df914 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:25.293570 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 298/614] 10.222.0.13 () {56 vars in 1154 bytes} [Sat Dec 18 20:32:25 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:25.299735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c89d2-da2f-4175-a981-85f0c518dac2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:25.310553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c89d2-da2f-4175-a981-85f0c518dac2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:25.322864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8fe9e-5b3f-40d6-b53a-334f11811d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:25.323518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8fe9e-5b3f-40d6-b53a-334f11811d1e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:25.323807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8fe9e-5b3f-40d6-b53a-334f11811d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:25.324085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8fe9e-5b3f-40d6-b53a-334f11811d1e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:25.333064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8fe9e-5b3f-40d6-b53a-334f11811d1e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:25.334904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8fe9e-5b3f-40d6-b53a-334f11811d1e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:25.352348 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 317/615] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:25 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:32:25.358450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c082c-88df-4bc0-85db-8477502df914 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:25.372417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c082c-88df-4bc0-85db-8477502df914 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:25.378596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9b61f-43b1-4e55-9abc-3bf971a3bd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:25.379354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9b61f-43b1-4e55-9abc-3bf971a3bd66 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:25.379668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9b61f-43b1-4e55-9abc-3bf971a3bd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:25.379918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9b61f-43b1-4e55-9abc-3bf971a3bd66 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:25.397489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9b61f-43b1-4e55-9abc-3bf971a3bd66 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:25.399456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9b61f-43b1-4e55-9abc-3bf971a3bd66 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:25.419625 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-a3e9b61f-43b1-4e55-9abc-3bf971a3bd66 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:25.421236 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 299/616] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:25.426849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8fe9e-5b3f-40d6-b53a-334f11811d1e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:25.439286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8fe9e-5b3f-40d6-b53a-334f11811d1e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:25.444234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b6377-d5f2-4a95-b41d-54dc6af7672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:25.444963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b6377-d5f2-4a95-b41d-54dc6af7672c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:25.445273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b6377-d5f2-4a95-b41d-54dc6af7672c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:25.445576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b6377-d5f2-4a95-b41d-54dc6af7672c admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:25.446373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b6377-d5f2-4a95-b41d-54dc6af7672c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:25.446712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b6377-d5f2-4a95-b41d-54dc6af7672c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:25.448361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b6377-d5f2-4a95-b41d-54dc6af7672c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:25.461964 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 318/617] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:25.467610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9b61f-43b1-4e55-9abc-3bf971a3bd66 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:25.483714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9b61f-43b1-4e55-9abc-3bf971a3bd66 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:25.491832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012fc20-d776-4c58-80d2-e649d1ea7cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:25.492622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012fc20-d776-4c58-80d2-e649d1ea7cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:25.492906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012fc20-d776-4c58-80d2-e649d1ea7cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:25.493186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012fc20-d776-4c58-80d2-e649d1ea7cb4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:25.501377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012fc20-d776-4c58-80d2-e649d1ea7cb4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:25.503590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012fc20-d776-4c58-80d2-e649d1ea7cb4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:25.520596 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-1012fc20-d776-4c58-80d2-e649d1ea7cb4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:25.522058 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 300/618] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:25.527902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b6377-d5f2-4a95-b41d-54dc6af7672c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:25.538137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b6377-d5f2-4a95-b41d-54dc6af7672c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:25.546811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975ce00-cdc8-47f2-9d2f-102e2ecec275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:25.547480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ce00-cdc8-47f2-9d2f-102e2ecec275 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:25.547773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ce00-cdc8-47f2-9d2f-102e2ecec275 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:25.548053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ce00-cdc8-47f2-9d2f-102e2ecec275 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:25.548862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975ce00-cdc8-47f2-9d2f-102e2ecec275 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:25.549178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975ce00-cdc8-47f2-9d2f-102e2ecec275 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:25.551244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975ce00-cdc8-47f2-9d2f-102e2ecec275 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:25.565030 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 319/619] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:25.571313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012fc20-d776-4c58-80d2-e649d1ea7cb4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:25.585367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012fc20-d776-4c58-80d2-e649d1ea7cb4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:25.591758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca3c86-81b8-4e1c-979f-90a1f17e079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:25.592486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca3c86-81b8-4e1c-979f-90a1f17e079b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:25.592803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca3c86-81b8-4e1c-979f-90a1f17e079b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:25.593155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca3c86-81b8-4e1c-979f-90a1f17e079b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:25.594019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca3c86-81b8-4e1c-979f-90a1f17e079b admin admin] RBAC: Adding query filter params (role.id=0071fc3d75b34850b7fb01a06a0279c5, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=a180acaefee3489788068c927fbe403c) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:25.594446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca3c86-81b8-4e1c-979f-90a1f17e079b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:25.596573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca3c86-81b8-4e1c-979f-90a1f17e079b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:25.605074 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 301/620] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:25 2021] GET /identity/v3/role_assignments?user.id=a180acaefee3489788068c927fbe403c&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=0071fc3d75b34850b7fb01a06a0279c5 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:26.009906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac1697-9bef-49f2-9c8d-98e43146df13 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:26.010589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac1697-9bef-49f2-9c8d-98e43146df13 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:26.010589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac1697-9bef-49f2-9c8d-98e43146df13 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:26.012621 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 320/621] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:26.019999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006dab6-71c9-4856-acbc-298fb741a69a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:26.020534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006dab6-71c9-4856-acbc-298fb741a69a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:26.020685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006dab6-71c9-4856-acbc-298fb741a69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:26.051325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a006dab6-71c9-4856-acbc-298fb741a69a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:26.052667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a006dab6-71c9-4856-acbc-298fb741a69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:26.076195 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 302/622] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:26.102543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac1697-9bef-49f2-9c8d-98e43146df13 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:26.118093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac1697-9bef-49f2-9c8d-98e43146df13 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:26.128785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71310f9-cca9-4512-926d-b4750b905eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:26.129852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71310f9-cca9-4512-926d-b4750b905eac admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:26.130393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71310f9-cca9-4512-926d-b4750b905eac admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:26.130868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71310f9-cca9-4512-926d-b4750b905eac admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:26.146160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71310f9-cca9-4512-926d-b4750b905eac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:26.153878 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-f71310f9-cca9-4512-926d-b4750b905eac admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:26.156703 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 321/623] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:26.167429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006dab6-71c9-4856-acbc-298fb741a69a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:26.181754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006dab6-71c9-4856-acbc-298fb741a69a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:26.196509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ae122-702f-484c-8465-fcab7a7a818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:26.197200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ae122-702f-484c-8465-fcab7a7a818f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:26.197488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ae122-702f-484c-8465-fcab7a7a818f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:26.197768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ae122-702f-484c-8465-fcab7a7a818f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:26.198607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ae122-702f-484c-8465-fcab7a7a818f admin admin] RBAC: Adding query filter params (name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:26.198959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ae122-702f-484c-8465-fcab7a7a818f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:26.200733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ae122-702f-484c-8465-fcab7a7a818f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:26.217174 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 303/624] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:26.224417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71310f9-cca9-4512-926d-b4750b905eac admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:26.239622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71310f9-cca9-4512-926d-b4750b905eac admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:26.247920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16eeb80-8c0e-4051-8848-387ee07d0826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:26.248901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16eeb80-8c0e-4051-8848-387ee07d0826 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:26.249213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16eeb80-8c0e-4051-8848-387ee07d0826 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:26.249535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16eeb80-8c0e-4051-8848-387ee07d0826 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:26.263956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16eeb80-8c0e-4051-8848-387ee07d0826 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:26.265771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16eeb80-8c0e-4051-8848-387ee07d0826 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:26.284731 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-a16eeb80-8c0e-4051-8848-387ee07d0826 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:26.286797 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 322/625] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:26.295763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ae122-702f-484c-8465-fcab7a7a818f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:26.310281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ae122-702f-484c-8465-fcab7a7a818f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:26.316334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae40c68-23d5-4408-8e09-75243cbd27f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:26.317067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae40c68-23d5-4408-8e09-75243cbd27f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:26.317387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae40c68-23d5-4408-8e09-75243cbd27f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:26.317752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae40c68-23d5-4408-8e09-75243cbd27f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:26.318543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae40c68-23d5-4408-8e09-75243cbd27f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:26.318967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae40c68-23d5-4408-8e09-75243cbd27f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:26.320758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae40c68-23d5-4408-8e09-75243cbd27f7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:26.334923 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 304/626] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:26.340847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16eeb80-8c0e-4051-8848-387ee07d0826 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:26.363874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16eeb80-8c0e-4051-8848-387ee07d0826 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:26.376820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7ffe7-3f0c-4687-8eaa-741fce9490cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:26.377793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7ffe7-3f0c-4687-8eaa-741fce9490cf admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:26.378089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7ffe7-3f0c-4687-8eaa-741fce9490cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:26.378393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7ffe7-3f0c-4687-8eaa-741fce9490cf admin admin] PATH_INFO: `/v3/users/glance` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:26.391749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7ffe7-3f0c-4687-8eaa-741fce9490cf admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:26.393856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7ffe7-3f0c-4687-8eaa-741fce9490cf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:26.418455 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-50e7ffe7-3f0c-4687-8eaa-741fce9490cf admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 18 20:32:26.427104 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 323/627] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:26 2021] GET /identity/v3/users/glance => generated 84 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:26.441515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae40c68-23d5-4408-8e09-75243cbd27f7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:26.472840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae40c68-23d5-4408-8e09-75243cbd27f7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:26.484377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4259d4b-3209-4e22-94f7-1176a823872c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:26.485113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4259d4b-3209-4e22-94f7-1176a823872c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:26.485431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4259d4b-3209-4e22-94f7-1176a823872c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:26.485753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4259d4b-3209-4e22-94f7-1176a823872c admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:26.486766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4259d4b-3209-4e22-94f7-1176a823872c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:26.487090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4259d4b-3209-4e22-94f7-1176a823872c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:26.489137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4259d4b-3209-4e22-94f7-1176a823872c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:26.522131 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 305/628] 10.222.0.13 () {56 vars in 1158 bytes} [Sat Dec 18 20:32:26 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:26.528159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7ffe7-3f0c-4687-8eaa-741fce9490cf admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:26.547755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7ffe7-3f0c-4687-8eaa-741fce9490cf admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:26.567795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285f176-16fb-4e7b-ad12-34e7e99e81b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:26.568461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285f176-16fb-4e7b-ad12-34e7e99e81b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:26.568751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285f176-16fb-4e7b-ad12-34e7e99e81b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:26.569030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285f176-16fb-4e7b-ad12-34e7e99e81b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:26.589888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285f176-16fb-4e7b-ad12-34e7e99e81b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:26.591682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285f176-16fb-4e7b-ad12-34e7e99e81b6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:26.617444 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 324/629] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:32:26.624317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4259d4b-3209-4e22-94f7-1176a823872c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:26.648786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4259d4b-3209-4e22-94f7-1176a823872c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:26.667503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed4851-b787-4964-a046-3823023423a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:26.668897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed4851-b787-4964-a046-3823023423a8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:26.669207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed4851-b787-4964-a046-3823023423a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:26.671551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed4851-b787-4964-a046-3823023423a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:26.692488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed4851-b787-4964-a046-3823023423a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:26.694558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed4851-b787-4964-a046-3823023423a8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:26.734857 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-64ed4851-b787-4964-a046-3823023423a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:26.742407 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 306/630] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:26.745355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285f176-16fb-4e7b-ad12-34e7e99e81b6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:26.768529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285f176-16fb-4e7b-ad12-34e7e99e81b6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:26.775801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de5ef7-6dad-450a-b7f3-2916270eb39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:26.776424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de5ef7-6dad-450a-b7f3-2916270eb39a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:26.776709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de5ef7-6dad-450a-b7f3-2916270eb39a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:26.776988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de5ef7-6dad-450a-b7f3-2916270eb39a admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:26.778268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de5ef7-6dad-450a-b7f3-2916270eb39a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:26.778584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de5ef7-6dad-450a-b7f3-2916270eb39a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:26.780157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de5ef7-6dad-450a-b7f3-2916270eb39a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:26.803303 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 325/631] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:26.809806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed4851-b787-4964-a046-3823023423a8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:26.827407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed4851-b787-4964-a046-3823023423a8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:26.839505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595532b-791e-4279-8988-a4cf86dd3330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:26.840871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595532b-791e-4279-8988-a4cf86dd3330 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:26.841188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595532b-791e-4279-8988-a4cf86dd3330 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:26.841483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595532b-791e-4279-8988-a4cf86dd3330 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:26.849327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595532b-791e-4279-8988-a4cf86dd3330 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:26.851449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595532b-791e-4279-8988-a4cf86dd3330 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:26.865423 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-3595532b-791e-4279-8988-a4cf86dd3330 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:26.866902 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 307/632] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:26.875334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de5ef7-6dad-450a-b7f3-2916270eb39a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:26.885798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de5ef7-6dad-450a-b7f3-2916270eb39a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:26.894374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f7dee-76fc-4a2b-b34d-606d8dad0cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:26.895174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f7dee-76fc-4a2b-b34d-606d8dad0cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:26.895554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f7dee-76fc-4a2b-b34d-606d8dad0cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:26.895934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f7dee-76fc-4a2b-b34d-606d8dad0cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:26.896874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f7dee-76fc-4a2b-b34d-606d8dad0cb1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:26.897259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f7dee-76fc-4a2b-b34d-606d8dad0cb1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:26.899239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f7dee-76fc-4a2b-b34d-606d8dad0cb1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:26.918728 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 326/633] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:26.926126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595532b-791e-4279-8988-a4cf86dd3330 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:26.943390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595532b-791e-4279-8988-a4cf86dd3330 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:26.952289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606a9cf-7c7b-4b67-b42b-5afc9b9c2fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:26.953136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606a9cf-7c7b-4b67-b42b-5afc9b9c2fec admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:26.953510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606a9cf-7c7b-4b67-b42b-5afc9b9c2fec admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:26.953889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606a9cf-7c7b-4b67-b42b-5afc9b9c2fec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:26.954962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606a9cf-7c7b-4b67-b42b-5afc9b9c2fec admin admin] RBAC: Adding query filter params (role.id=0071fc3d75b34850b7fb01a06a0279c5, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=82fb4302bcd54627a264f22ad78aa339) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:26.955396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606a9cf-7c7b-4b67-b42b-5afc9b9c2fec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:26.957634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606a9cf-7c7b-4b67-b42b-5afc9b9c2fec admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:26.968240 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 308/634] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:26 2021] GET /identity/v3/role_assignments?user.id=82fb4302bcd54627a264f22ad78aa339&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=0071fc3d75b34850b7fb01a06a0279c5 => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:27.296326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f2659-4dea-4177-91c5-6beeef9291de None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.297472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f2659-4dea-4177-91c5-6beeef9291de None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.298053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f2659-4dea-4177-91c5-6beeef9291de None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.300427 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 327/635] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:27 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:27.311695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2ed2b-5d86-4ef1-861c-4b1c096c3765 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.312597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2ed2b-5d86-4ef1-861c-4b1c096c3765 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.313093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2ed2b-5d86-4ef1-861c-4b1c096c3765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.331743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-27a2ed2b-5d86-4ef1-861c-4b1c096c3765 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:27.333259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-27a2ed2b-5d86-4ef1-861c-4b1c096c3765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:27.343066 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 309/636] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:27.369134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f2659-4dea-4177-91c5-6beeef9291de None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.382497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f2659-4dea-4177-91c5-6beeef9291de None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.387980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68950066-6f40-4df6-9c08-abf7e7a7bce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.389127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68950066-6f40-4df6-9c08-abf7e7a7bce4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.389633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68950066-6f40-4df6-9c08-abf7e7a7bce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.390132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68950066-6f40-4df6-9c08-abf7e7a7bce4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.404845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68950066-6f40-4df6-9c08-abf7e7a7bce4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:27.412213 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-68950066-6f40-4df6-9c08-abf7e7a7bce4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:27.413972 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 328/637] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:27.420527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2ed2b-5d86-4ef1-861c-4b1c096c3765 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.430194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2ed2b-5d86-4ef1-861c-4b1c096c3765 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.435281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7568bf-be41-479a-9635-69640c52e037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.436425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7568bf-be41-479a-9635-69640c52e037 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.436941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7568bf-be41-479a-9635-69640c52e037 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.437468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7568bf-be41-479a-9635-69640c52e037 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.438456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7568bf-be41-479a-9635-69640c52e037 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:27.438961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7568bf-be41-479a-9635-69640c52e037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:27.440737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7568bf-be41-479a-9635-69640c52e037 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:27.450619 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 310/638] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:27.456923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68950066-6f40-4df6-9c08-abf7e7a7bce4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.468274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68950066-6f40-4df6-9c08-abf7e7a7bce4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.473248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce25fd-512f-48b4-ad8f-0e4ebdcfffaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.474373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce25fd-512f-48b4-ad8f-0e4ebdcfffaf admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.474885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce25fd-512f-48b4-ad8f-0e4ebdcfffaf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.475354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce25fd-512f-48b4-ad8f-0e4ebdcfffaf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.486649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce25fd-512f-48b4-ad8f-0e4ebdcfffaf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:27.488916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce25fd-512f-48b4-ad8f-0e4ebdcfffaf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:27.506556 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-55ce25fd-512f-48b4-ad8f-0e4ebdcfffaf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:27.508351 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 329/639] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:27.514999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7568bf-be41-479a-9635-69640c52e037 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.525154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7568bf-be41-479a-9635-69640c52e037 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.528233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bda06d-0118-4913-bd5e-f0ad89385589 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.528504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bda06d-0118-4913-bd5e-f0ad89385589 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.528790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bda06d-0118-4913-bd5e-f0ad89385589 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.530730 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 330/640] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:27.534706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc070e-8881-473c-ab1e-77b8cb9f4fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.535356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc070e-8881-473c-ab1e-77b8cb9f4fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.535632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc070e-8881-473c-ab1e-77b8cb9f4fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.535911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc070e-8881-473c-ab1e-77b8cb9f4fe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.536644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc070e-8881-473c-ab1e-77b8cb9f4fe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:27.536949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc070e-8881-473c-ab1e-77b8cb9f4fe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:27.538963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39306238-d347-458f-8ce8-147edb3b0c32 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.539242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39306238-d347-458f-8ce8-147edb3b0c32 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.539513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39306238-d347-458f-8ce8-147edb3b0c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.540011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc070e-8881-473c-ab1e-77b8cb9f4fe8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:27.556496 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 311/641] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:27.563637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc070e-8881-473c-ab1e-77b8cb9f4fe8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.566581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-39306238-d347-458f-8ce8-147edb3b0c32 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:27.567765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-39306238-d347-458f-8ce8-147edb3b0c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:27.577848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc070e-8881-473c-ab1e-77b8cb9f4fe8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.585124 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 331/642] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:32:27.587111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ec70b-9666-4231-9595-2c2d5c476f43 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.587500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ec70b-9666-4231-9595-2c2d5c476f43 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.587787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ec70b-9666-4231-9595-2c2d5c476f43 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.588171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbe20a-7e52-4170-bd42-90b4c2a0b112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.589163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbe20a-7e52-4170-bd42-90b4c2a0b112 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.589448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbe20a-7e52-4170-bd42-90b4c2a0b112 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.589859 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 332/643] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:32:27.589962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbe20a-7e52-4170-bd42-90b4c2a0b112 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.598132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b11c8f-7e8e-4a39-8b75-e3441b088058 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.598455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b11c8f-7e8e-4a39-8b75-e3441b088058 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.598763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b11c8f-7e8e-4a39-8b75-e3441b088058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.601460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbe20a-7e52-4170-bd42-90b4c2a0b112 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:27.603533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbe20a-7e52-4170-bd42-90b4c2a0b112 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:27.618750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-27b11c8f-7e8e-4a39-8b75-e3441b088058 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:27.619273 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-48dbe20a-7e52-4170-bd42-90b4c2a0b112 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 18 20:32:27.619930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-27b11c8f-7e8e-4a39-8b75-e3441b088058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:27.620787 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 312/644] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/users/cinder => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:27.622180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbe20a-7e52-4170-bd42-90b4c2a0b112 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.632676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbe20a-7e52-4170-bd42-90b4c2a0b112 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.637791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f74c5-6ea6-4788-b4ed-acb24d8cd9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.638644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f74c5-6ea6-4788-b4ed-acb24d8cd9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.638928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f74c5-6ea6-4788-b4ed-acb24d8cd9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.639207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f74c5-6ea6-4788-b4ed-acb24d8cd9d3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.639838 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 333/645] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:32:27.640914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b11c8f-7e8e-4a39-8b75-e3441b088058 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.651524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b11c8f-7e8e-4a39-8b75-e3441b088058 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.657637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f74c5-6ea6-4788-b4ed-acb24d8cd9d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:27.658205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ab7f5-a68a-48aa-9f19-df1e94a236c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.659085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab7f5-a68a-48aa-9f19-df1e94a236c9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.659495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab7f5-a68a-48aa-9f19-df1e94a236c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.659904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab7f5-a68a-48aa-9f19-df1e94a236c9 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.660906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ab7f5-a68a-48aa-9f19-df1e94a236c9 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:27.661320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ab7f5-a68a-48aa-9f19-df1e94a236c9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:27.663452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ab7f5-a68a-48aa-9f19-df1e94a236c9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:27.664985 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-8f8f74c5-6ea6-4788-b4ed-acb24d8cd9d3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:27.666175 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 313/646] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:27.673068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f74c5-6ea6-4788-b4ed-acb24d8cd9d3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.686844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f74c5-6ea6-4788-b4ed-acb24d8cd9d3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.691370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56108b16-4a20-43c8-95b7-e11bdb26dabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.692037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56108b16-4a20-43c8-95b7-e11bdb26dabe admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.692319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56108b16-4a20-43c8-95b7-e11bdb26dabe admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.692593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56108b16-4a20-43c8-95b7-e11bdb26dabe admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.693360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56108b16-4a20-43c8-95b7-e11bdb26dabe admin admin] RBAC: Adding query filter params (name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:27.693672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56108b16-4a20-43c8-95b7-e11bdb26dabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:27.695295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56108b16-4a20-43c8-95b7-e11bdb26dabe admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:27.696237 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 334/647] 10.222.0.13 () {56 vars in 1158 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:27.697324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ab7f5-a68a-48aa-9f19-df1e94a236c9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.712215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ab7f5-a68a-48aa-9f19-df1e94a236c9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.714907 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 314/648] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:27.715784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56108b16-4a20-43c8-95b7-e11bdb26dabe admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.728022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ada3f-1cc1-4a2d-ab32-a3d21517f35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.729203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ada3f-1cc1-4a2d-ab32-a3d21517f35b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.729635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ada3f-1cc1-4a2d-ab32-a3d21517f35b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.730123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ada3f-1cc1-4a2d-ab32-a3d21517f35b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.731459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56108b16-4a20-43c8-95b7-e11bdb26dabe admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.741425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91eea1-b0ee-421b-8d1d-323c83e72176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.742072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91eea1-b0ee-421b-8d1d-323c83e72176 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.742387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91eea1-b0ee-421b-8d1d-323c83e72176 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.742668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91eea1-b0ee-421b-8d1d-323c83e72176 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.744439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ada3f-1cc1-4a2d-ab32-a3d21517f35b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:27.751615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91eea1-b0ee-421b-8d1d-323c83e72176 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:27.752790 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-8f1ada3f-1cc1-4a2d-ab32-a3d21517f35b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:27.753361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91eea1-b0ee-421b-8d1d-323c83e72176 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:27.754881 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 335/649] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:27.755789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ada3f-1cc1-4a2d-ab32-a3d21517f35b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.766365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ada3f-1cc1-4a2d-ab32-a3d21517f35b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.771187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd2235-49b7-497f-a1a0-9a13301faa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.772370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd2235-49b7-497f-a1a0-9a13301faa42 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.772896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd2235-49b7-497f-a1a0-9a13301faa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.773357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd2235-49b7-497f-a1a0-9a13301faa42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.777053 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 315/650] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:32:27.777816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91eea1-b0ee-421b-8d1d-323c83e72176 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.791839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91eea1-b0ee-421b-8d1d-323c83e72176 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.792161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd2235-49b7-497f-a1a0-9a13301faa42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:27.795134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd2235-49b7-497f-a1a0-9a13301faa42 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:27.796521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd5012-fd0d-4836-89af-0f5205248211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.797173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd5012-fd0d-4836-89af-0f5205248211 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.797500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd5012-fd0d-4836-89af-0f5205248211 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.797810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd5012-fd0d-4836-89af-0f5205248211 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.798623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd5012-fd0d-4836-89af-0f5205248211 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:27.798931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd5012-fd0d-4836-89af-0f5205248211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:27.800549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd5012-fd0d-4836-89af-0f5205248211 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:27.810877 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 316/651] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:27.811874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd5012-fd0d-4836-89af-0f5205248211 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.819225 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-fedd2235-49b7-497f-a1a0-9a13301faa42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:27.820952 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 336/652] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:27.827007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd2235-49b7-497f-a1a0-9a13301faa42 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.832948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd5012-fd0d-4836-89af-0f5205248211 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.838104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd2235-49b7-497f-a1a0-9a13301faa42 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.839037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268e886-5837-4120-900f-b530ac2afc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.840735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268e886-5837-4120-900f-b530ac2afc34 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.841174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268e886-5837-4120-900f-b530ac2afc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.841637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268e886-5837-4120-900f-b530ac2afc34 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.843675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceae0f8-97b4-4893-867e-f31bf6a259ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.844539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceae0f8-97b4-4893-867e-f31bf6a259ec admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.844822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceae0f8-97b4-4893-867e-f31bf6a259ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.845151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceae0f8-97b4-4893-867e-f31bf6a259ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.855249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268e886-5837-4120-900f-b530ac2afc34 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:27.856901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceae0f8-97b4-4893-867e-f31bf6a259ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:27.857902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268e886-5837-4120-900f-b530ac2afc34 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:27.858816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceae0f8-97b4-4893-867e-f31bf6a259ec admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:27.877831 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-bceae0f8-97b4-4893-867e-f31bf6a259ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:27.878560 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-e268e886-5837-4120-900f-b530ac2afc34 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:27.879079 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 337/653] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:27.879850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceae0f8-97b4-4893-867e-f31bf6a259ec admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.880421 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 317/654] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:27.886807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268e886-5837-4120-900f-b530ac2afc34 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.896451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268e886-5837-4120-900f-b530ac2afc34 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.897755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceae0f8-97b4-4893-867e-f31bf6a259ec admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.901454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c94c1-acd2-4276-b1d5-b870022cd3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.902165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c94c1-acd2-4276-b1d5-b870022cd3ba admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.902607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c94c1-acd2-4276-b1d5-b870022cd3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.902890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c94c1-acd2-4276-b1d5-b870022cd3ba admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.903721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a0b0d-1164-4a4d-9f23-0a705b6bbd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.903867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c94c1-acd2-4276-b1d5-b870022cd3ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:27.904089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c94c1-acd2-4276-b1d5-b870022cd3ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:27.904853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a0b0d-1164-4a4d-9f23-0a705b6bbd03 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.905297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a0b0d-1164-4a4d-9f23-0a705b6bbd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.905721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a0b0d-1164-4a4d-9f23-0a705b6bbd03 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.905829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c94c1-acd2-4276-b1d5-b870022cd3ba admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:27.906759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a0b0d-1164-4a4d-9f23-0a705b6bbd03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:27.907484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a0b0d-1164-4a4d-9f23-0a705b6bbd03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:27.909962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a0b0d-1164-4a4d-9f23-0a705b6bbd03 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:27.924188 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 318/655] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:27.924880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c94c1-acd2-4276-b1d5-b870022cd3ba admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.925880 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 338/656] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:27.931971 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a0b0d-1164-4a4d-9f23-0a705b6bbd03 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.937486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c94c1-acd2-4276-b1d5-b870022cd3ba admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.942269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9a9ae-5842-439c-8b72-e667a2d29ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.942931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9a9ae-5842-439c-8b72-e667a2d29ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.943267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9a9ae-5842-439c-8b72-e667a2d29ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.943544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9a9ae-5842-439c-8b72-e667a2d29ec4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.944273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9a9ae-5842-439c-8b72-e667a2d29ec4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:27.944632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9a9ae-5842-439c-8b72-e667a2d29ec4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:27.945190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a0b0d-1164-4a4d-9f23-0a705b6bbd03 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.946360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9a9ae-5842-439c-8b72-e667a2d29ec4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:27.950868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0009720-0489-40fd-99c5-838c58400ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.951926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0009720-0489-40fd-99c5-838c58400ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.952390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0009720-0489-40fd-99c5-838c58400ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.952846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0009720-0489-40fd-99c5-838c58400ad6 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.959678 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 319/657] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:27.965725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9a9ae-5842-439c-8b72-e667a2d29ec4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.970915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0009720-0489-40fd-99c5-838c58400ad6 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:27.972904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0009720-0489-40fd-99c5-838c58400ad6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:27.979111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9a9ae-5842-439c-8b72-e667a2d29ec4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:27.985143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892d0f7-d640-4a61-bcb5-a3ad4dbbca92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:27.986213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892d0f7-d640-4a61-bcb5-a3ad4dbbca92 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:27.986871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892d0f7-d640-4a61-bcb5-a3ad4dbbca92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:27.987442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892d0f7-d640-4a61-bcb5-a3ad4dbbca92 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:27.987898 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-e0009720-0489-40fd-99c5-838c58400ad6 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 18 20:32:27.989319 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 339/658] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:27.989916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0009720-0489-40fd-99c5-838c58400ad6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:27.998097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892d0f7-d640-4a61-bcb5-a3ad4dbbca92 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:28.000687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892d0f7-d640-4a61-bcb5-a3ad4dbbca92 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:28.004694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0009720-0489-40fd-99c5-838c58400ad6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:28.009140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb61185-d7b4-464e-af14-d0af78976d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:28.009888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb61185-d7b4-464e-af14-d0af78976d44 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.010167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb61185-d7b4-464e-af14-d0af78976d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.010491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb61185-d7b4-464e-af14-d0af78976d44 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.017496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb61185-d7b4-464e-af14-d0af78976d44 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:28.018319 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-b892d0f7-d640-4a61-bcb5-a3ad4dbbca92 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 18 20:32:28.019583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb61185-d7b4-464e-af14-d0af78976d44 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:28.020109 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 320/659] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/users/neutron => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:28.021043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892d0f7-d640-4a61-bcb5-a3ad4dbbca92 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:28.035051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892d0f7-d640-4a61-bcb5-a3ad4dbbca92 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:28.039614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08620d8-5603-44ce-b6ae-3741ef897cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:28.040164 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-2bb61185-d7b4-464e-af14-d0af78976d44 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:28.040316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08620d8-5603-44ce-b6ae-3741ef897cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.040494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08620d8-5603-44ce-b6ae-3741ef897cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.040824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08620d8-5603-44ce-b6ae-3741ef897cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.041653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08620d8-5603-44ce-b6ae-3741ef897cf9 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:28.041959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08620d8-5603-44ce-b6ae-3741ef897cf9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:28.042579 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 340/660] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:28.047652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08620d8-5603-44ce-b6ae-3741ef897cf9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:28.047772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb61185-d7b4-464e-af14-d0af78976d44 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:28.062052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb61185-d7b4-464e-af14-d0af78976d44 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:28.069691 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 321/661] 10.222.0.13 () {56 vars in 1156 bytes} [Sat Dec 18 20:32:28 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:28.071113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55c339-3c58-4f43-8720-f350218f6855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:28.071753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c339-3c58-4f43-8720-f350218f6855 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.072071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c339-3c58-4f43-8720-f350218f6855 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.072368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c339-3c58-4f43-8720-f350218f6855 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.073292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55c339-3c58-4f43-8720-f350218f6855 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:28.073609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55c339-3c58-4f43-8720-f350218f6855 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:28.074827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08620d8-5603-44ce-b6ae-3741ef897cf9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:28.075585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55c339-3c58-4f43-8720-f350218f6855 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:28.084769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08620d8-5603-44ce-b6ae-3741ef897cf9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:28.092342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5665d27-fb25-4e9a-b371-c366eb0bf5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:28.093168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5665d27-fb25-4e9a-b371-c366eb0bf5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.093637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5665d27-fb25-4e9a-b371-c366eb0bf5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.094054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5665d27-fb25-4e9a-b371-c366eb0bf5f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.095091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5665d27-fb25-4e9a-b371-c366eb0bf5f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:28.097151 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 341/662] 10.222.0.13 () {56 vars in 1160 bytes} [Sat Dec 18 20:32:28 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:28.097151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55c339-3c58-4f43-8720-f350218f6855 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:28.097442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5665d27-fb25-4e9a-b371-c366eb0bf5f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:28.099659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5665d27-fb25-4e9a-b371-c366eb0bf5f0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:28.110863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55c339-3c58-4f43-8720-f350218f6855 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:28.113774 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 322/663] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:28.114629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5665d27-fb25-4e9a-b371-c366eb0bf5f0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:28.116080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e39eb0-3f2f-4851-816d-765a190f8998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:28.117058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e39eb0-3f2f-4851-816d-765a190f8998 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.117489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e39eb0-3f2f-4851-816d-765a190f8998 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.117988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e39eb0-3f2f-4851-816d-765a190f8998 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.124657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5665d27-fb25-4e9a-b371-c366eb0bf5f0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:28.129132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5495dfe-5617-4069-a039-800176e58a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:28.130122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5495dfe-5617-4069-a039-800176e58a3f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.130364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5495dfe-5617-4069-a039-800176e58a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.130643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5495dfe-5617-4069-a039-800176e58a3f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.131519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e39eb0-3f2f-4851-816d-765a190f8998 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:28.133894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e39eb0-3f2f-4851-816d-765a190f8998 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:28.139490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5495dfe-5617-4069-a039-800176e58a3f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:28.141210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5495dfe-5617-4069-a039-800176e58a3f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:28.150292 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 323/664] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:32:28.151076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5495dfe-5617-4069-a039-800176e58a3f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:28.154651 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-a2e39eb0-3f2f-4851-816d-765a190f8998 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:28.156393 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 342/665] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:28.163935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e39eb0-3f2f-4851-816d-765a190f8998 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:28.169490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5495dfe-5617-4069-a039-800176e58a3f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:28.174389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c3b39-8513-484d-84a8-ab2e06123497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:28.175017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c3b39-8513-484d-84a8-ab2e06123497 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.175300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c3b39-8513-484d-84a8-ab2e06123497 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.175576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c3b39-8513-484d-84a8-ab2e06123497 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.176360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e39eb0-3f2f-4851-816d-765a190f8998 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:28.176478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c3b39-8513-484d-84a8-ab2e06123497 admin admin] RBAC: Adding query filter params (role.id=0071fc3d75b34850b7fb01a06a0279c5, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=62bd53b4d64643d28ac7f4ea0ea45f90) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:28.176774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c3b39-8513-484d-84a8-ab2e06123497 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:28.178862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c3b39-8513-484d-84a8-ab2e06123497 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:28.182635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd51715-18a0-416b-9b89-c21289aa9e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:28.183981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd51715-18a0-416b-9b89-c21289aa9e60 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.184460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd51715-18a0-416b-9b89-c21289aa9e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.184905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd51715-18a0-416b-9b89-c21289aa9e60 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.185399 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 324/666] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:28 2021] GET /identity/v3/role_assignments?user.id=62bd53b4d64643d28ac7f4ea0ea45f90&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=0071fc3d75b34850b7fb01a06a0279c5 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:28.194306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c3b39-8513-484d-84a8-ab2e06123497 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:28.204720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c3b39-8513-484d-84a8-ab2e06123497 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:28.214652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd5ccd-14f3-4d9d-9a5b-4bb8594d7b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:28.215774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd51715-18a0-416b-9b89-c21289aa9e60 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:28.216684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd5ccd-14f3-4d9d-9a5b-4bb8594d7b77 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.216965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd5ccd-14f3-4d9d-9a5b-4bb8594d7b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.217246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd5ccd-14f3-4d9d-9a5b-4bb8594d7b77 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.219375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd5ccd-14f3-4d9d-9a5b-4bb8594d7b77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:28.219685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd5ccd-14f3-4d9d-9a5b-4bb8594d7b77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:28.220983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd51715-18a0-416b-9b89-c21289aa9e60 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:28.223749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd5ccd-14f3-4d9d-9a5b-4bb8594d7b77 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:28.248708 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-5cd51715-18a0-416b-9b89-c21289aa9e60 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:28.250361 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 343/667] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:32:28.252593 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 325/668] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:28.262485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd5ccd-14f3-4d9d-9a5b-4bb8594d7b77 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:28.262775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd51715-18a0-416b-9b89-c21289aa9e60 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:28.272854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd51715-18a0-416b-9b89-c21289aa9e60 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:28.278545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b02e8-da8d-4ef2-b9b7-6900665bcef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:28.279227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b02e8-da8d-4ef2-b9b7-6900665bcef6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.279516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b02e8-da8d-4ef2-b9b7-6900665bcef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.279797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b02e8-da8d-4ef2-b9b7-6900665bcef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.281320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b02e8-da8d-4ef2-b9b7-6900665bcef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:28.281637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b02e8-da8d-4ef2-b9b7-6900665bcef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:28.283568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b02e8-da8d-4ef2-b9b7-6900665bcef6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:28.288860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd5ccd-14f3-4d9d-9a5b-4bb8594d7b77 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:28.297224 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 344/669] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:28.303124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b02e8-da8d-4ef2-b9b7-6900665bcef6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:28.306970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3304f92-7637-4220-891f-0dad158a9399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:28.307784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3304f92-7637-4220-891f-0dad158a9399 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.308216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3304f92-7637-4220-891f-0dad158a9399 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.309010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3304f92-7637-4220-891f-0dad158a9399 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.323957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b02e8-da8d-4ef2-b9b7-6900665bcef6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:28.326284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3304f92-7637-4220-891f-0dad158a9399 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:28.328357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3304f92-7637-4220-891f-0dad158a9399 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:28.328500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca90b36-0bb0-4ece-90c6-12f347ae3f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:28.334278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca90b36-0bb0-4ece-90c6-12f347ae3f82 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.334278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca90b36-0bb0-4ece-90c6-12f347ae3f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.334278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca90b36-0bb0-4ece-90c6-12f347ae3f82 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.338486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca90b36-0bb0-4ece-90c6-12f347ae3f82 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:28.340562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca90b36-0bb0-4ece-90c6-12f347ae3f82 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:28.353873 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-b3304f92-7637-4220-891f-0dad158a9399 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:28.355512 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 326/670] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:28.362053 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-5ca90b36-0bb0-4ece-90c6-12f347ae3f82 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:28.362053 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 345/671] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:28.363465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca90b36-0bb0-4ece-90c6-12f347ae3f82 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:28.363571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3304f92-7637-4220-891f-0dad158a9399 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:28.374872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca90b36-0bb0-4ece-90c6-12f347ae3f82 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:28.380134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3304f92-7637-4220-891f-0dad158a9399 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:28.387945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a8deb-36e8-4e97-80aa-aa771f1c56e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:28.389406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a8deb-36e8-4e97-80aa-aa771f1c56e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.389933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47f80e-05b4-4981-ba91-d0900553ff09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:28.390894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47f80e-05b4-4981-ba91-d0900553ff09 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.391453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a8deb-36e8-4e97-80aa-aa771f1c56e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.391945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a8deb-36e8-4e97-80aa-aa771f1c56e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.393331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a8deb-36e8-4e97-80aa-aa771f1c56e5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:28.393583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47f80e-05b4-4981-ba91-d0900553ff09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.394096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47f80e-05b4-4981-ba91-d0900553ff09 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.395172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47f80e-05b4-4981-ba91-d0900553ff09 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:28.395756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a8deb-36e8-4e97-80aa-aa771f1c56e5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:28.397893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a8deb-36e8-4e97-80aa-aa771f1c56e5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:28.398694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47f80e-05b4-4981-ba91-d0900553ff09 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:28.400786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47f80e-05b4-4981-ba91-d0900553ff09 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:28.423492 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 327/672] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:28.425880 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 346/673] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:28.431857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a8deb-36e8-4e97-80aa-aa771f1c56e5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:28.433081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47f80e-05b4-4981-ba91-d0900553ff09 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:28.449066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47f80e-05b4-4981-ba91-d0900553ff09 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:28.454023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a8deb-36e8-4e97-80aa-aa771f1c56e5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:28.458419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9cd3f-1c94-4e7c-9002-61f9ec897eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:28.459580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9cd3f-1c94-4e7c-9002-61f9ec897eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.460086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9cd3f-1c94-4e7c-9002-61f9ec897eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.460565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9cd3f-1c94-4e7c-9002-61f9ec897eb4 admin admin] PATH_INFO: `/v3/projects/0dd4d15f423642fa8da604b758048203/users/f5e4bc28d0744b65ab520bf79cea5a45/roles/0071fc3d75b34850b7fb01a06a0279c5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.462328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d966a8-4ece-492f-812f-1f4d1a2db660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:28.462986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d966a8-4ece-492f-812f-1f4d1a2db660 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.463267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d966a8-4ece-492f-812f-1f4d1a2db660 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.463544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d966a8-4ece-492f-812f-1f4d1a2db660 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.464388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d966a8-4ece-492f-812f-1f4d1a2db660 admin admin] RBAC: Adding query filter params (role.id=0071fc3d75b34850b7fb01a06a0279c5, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=6f8eeb55c523480fb45d4bbb8afe8e7e) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:28.464699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d966a8-4ece-492f-812f-1f4d1a2db660 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:28.466936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d966a8-4ece-492f-812f-1f4d1a2db660 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:28.473762 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 328/674] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:28 2021] GET /identity/v3/role_assignments?user.id=6f8eeb55c523480fb45d4bbb8afe8e7e&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=0071fc3d75b34850b7fb01a06a0279c5 => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:28.486590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9cd3f-1c94-4e7c-9002-61f9ec897eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd4d15f423642fa8da604b758048203, user_id=f5e4bc28d0744b65ab520bf79cea5a45, role_id=0071fc3d75b34850b7fb01a06a0279c5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:28.489226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9cd3f-1c94-4e7c-9002-61f9ec897eb4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:28.512805 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 347/675] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:32:28 2021] PUT /identity/v3/projects/0dd4d15f423642fa8da604b758048203/users/f5e4bc28d0744b65ab520bf79cea5a45/roles/0071fc3d75b34850b7fb01a06a0279c5 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:32:28.969404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cb10a-4dd5-40ec-bdfd-04e97b7c48da None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.969594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cb10a-4dd5-40ec-bdfd-04e97b7c48da None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.969887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cb10a-4dd5-40ec-bdfd-04e97b7c48da None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.971856 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 329/676] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:28.977806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1ef4f-b90f-48dc-8197-1bbed7bb4e97 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:28.978100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1ef4f-b90f-48dc-8197-1bbed7bb4e97 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:28.978407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1ef4f-b90f-48dc-8197-1bbed7bb4e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:28.997679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2ab1ef4f-b90f-48dc-8197-1bbed7bb4e97 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:28.998894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2ab1ef4f-b90f-48dc-8197-1bbed7bb4e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:29.059176 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 348/677] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:29.084818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cb10a-4dd5-40ec-bdfd-04e97b7c48da None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:29.097810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cb10a-4dd5-40ec-bdfd-04e97b7c48da None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:29.102287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ed81a-05d5-4252-b5f3-13e89416b084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:29.103104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ed81a-05d5-4252-b5f3-13e89416b084 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:29.103417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ed81a-05d5-4252-b5f3-13e89416b084 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:29.103698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ed81a-05d5-4252-b5f3-13e89416b084 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:29.114417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ed81a-05d5-4252-b5f3-13e89416b084 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:29.121685 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-7e5ed81a-05d5-4252-b5f3-13e89416b084 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:32:29.123153 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 330/678] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:32:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:29.129268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1ef4f-b90f-48dc-8197-1bbed7bb4e97 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:29.138356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1ef4f-b90f-48dc-8197-1bbed7bb4e97 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:29.142803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca69a3-3718-4119-b0e3-029c8ebbade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:29.143451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca69a3-3718-4119-b0e3-029c8ebbade0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:29.143734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca69a3-3718-4119-b0e3-029c8ebbade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:29.144010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca69a3-3718-4119-b0e3-029c8ebbade0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:29.144762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca69a3-3718-4119-b0e3-029c8ebbade0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:29.145069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca69a3-3718-4119-b0e3-029c8ebbade0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:29.146832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca69a3-3718-4119-b0e3-029c8ebbade0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:29.156747 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 349/679] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:29.162618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ed81a-05d5-4252-b5f3-13e89416b084 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:29.173217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ed81a-05d5-4252-b5f3-13e89416b084 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:29.178103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b72a70-fc48-468c-9454-20325b86a5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:29.179233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b72a70-fc48-468c-9454-20325b86a5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:29.179517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b72a70-fc48-468c-9454-20325b86a5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:29.179844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b72a70-fc48-468c-9454-20325b86a5e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:29.191352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b72a70-fc48-468c-9454-20325b86a5e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:29.193214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b72a70-fc48-468c-9454-20325b86a5e5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:29.211289 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-50b72a70-fc48-468c-9454-20325b86a5e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:29.212761 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 331/680] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:29.219197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca69a3-3718-4119-b0e3-029c8ebbade0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:29.229143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca69a3-3718-4119-b0e3-029c8ebbade0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:29.233703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94885a50-a08a-4b75-8705-4196ddc6d6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:29.234382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94885a50-a08a-4b75-8705-4196ddc6d6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:29.234720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94885a50-a08a-4b75-8705-4196ddc6d6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:29.235000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94885a50-a08a-4b75-8705-4196ddc6d6f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:29.235775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94885a50-a08a-4b75-8705-4196ddc6d6f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:29.236084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94885a50-a08a-4b75-8705-4196ddc6d6f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:29.237704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94885a50-a08a-4b75-8705-4196ddc6d6f7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:29.250816 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 350/681] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:29.256520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b72a70-fc48-468c-9454-20325b86a5e5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:29.267060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b72a70-fc48-468c-9454-20325b86a5e5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:29.271668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92933845-2bcd-4c84-8970-5b95901e1eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:29.272531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933845-2bcd-4c84-8970-5b95901e1eaf admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:29.272861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933845-2bcd-4c84-8970-5b95901e1eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:29.273141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933845-2bcd-4c84-8970-5b95901e1eaf admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:29.281209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92933845-2bcd-4c84-8970-5b95901e1eaf admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:29.283238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92933845-2bcd-4c84-8970-5b95901e1eaf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:29.297993 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-92933845-2bcd-4c84-8970-5b95901e1eaf admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 18 20:32:29.299458 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 332/682] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Dec 18 20:32:29 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:29.305345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94885a50-a08a-4b75-8705-4196ddc6d6f7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:29.316970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94885a50-a08a-4b75-8705-4196ddc6d6f7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:29.322081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07ed26-69c2-4ffa-99ea-7a21b6e66fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:29.322770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07ed26-69c2-4ffa-99ea-7a21b6e66fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:29.323103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07ed26-69c2-4ffa-99ea-7a21b6e66fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:29.323381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07ed26-69c2-4ffa-99ea-7a21b6e66fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:29.324407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07ed26-69c2-4ffa-99ea-7a21b6e66fb0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:29.324718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07ed26-69c2-4ffa-99ea-7a21b6e66fb0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:29.326695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07ed26-69c2-4ffa-99ea-7a21b6e66fb0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:29.345534 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 351/683] 10.222.0.13 () {56 vars in 1154 bytes} [Sat Dec 18 20:32:29 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:29.351473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92933845-2bcd-4c84-8970-5b95901e1eaf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:29.361648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92933845-2bcd-4c84-8970-5b95901e1eaf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:29.370271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cf098-4682-4f98-a7e4-36146083e722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:29.370966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cf098-4682-4f98-a7e4-36146083e722 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:29.371806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cf098-4682-4f98-a7e4-36146083e722 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:29.372082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cf098-4682-4f98-a7e4-36146083e722 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:29.381553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cf098-4682-4f98-a7e4-36146083e722 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:29.383296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cf098-4682-4f98-a7e4-36146083e722 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:29.392815 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 333/684] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:32:29.398936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07ed26-69c2-4ffa-99ea-7a21b6e66fb0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:29.408826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07ed26-69c2-4ffa-99ea-7a21b6e66fb0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:29.413357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21810e-3877-40f2-b91e-206588db28fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:29.414181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21810e-3877-40f2-b91e-206588db28fd admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:29.414494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21810e-3877-40f2-b91e-206588db28fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:29.414825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21810e-3877-40f2-b91e-206588db28fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:29.425976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21810e-3877-40f2-b91e-206588db28fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:29.427860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21810e-3877-40f2-b91e-206588db28fd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:29.445552 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-7e21810e-3877-40f2-b91e-206588db28fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:29.447019 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 352/685] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:29.453015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cf098-4682-4f98-a7e4-36146083e722 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:29.462279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cf098-4682-4f98-a7e4-36146083e722 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:29.470910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e583e2-8075-40a0-8bfb-420de44b4ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:29.471564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e583e2-8075-40a0-8bfb-420de44b4ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:29.471844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e583e2-8075-40a0-8bfb-420de44b4ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:29.472171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e583e2-8075-40a0-8bfb-420de44b4ca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:29.472898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e583e2-8075-40a0-8bfb-420de44b4ca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:29.473199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e583e2-8075-40a0-8bfb-420de44b4ca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:29.474841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e583e2-8075-40a0-8bfb-420de44b4ca6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:29.495767 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 334/686] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:29.502360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21810e-3877-40f2-b91e-206588db28fd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:29.515758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21810e-3877-40f2-b91e-206588db28fd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:29.526357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03382ec-ce3a-44ca-bf9c-c1396789864c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:29.527145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03382ec-ce3a-44ca-bf9c-c1396789864c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:29.527459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03382ec-ce3a-44ca-bf9c-c1396789864c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:29.527742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03382ec-ce3a-44ca-bf9c-c1396789864c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:29.543876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03382ec-ce3a-44ca-bf9c-c1396789864c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:29.545815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03382ec-ce3a-44ca-bf9c-c1396789864c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:29.566581 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-c03382ec-ce3a-44ca-bf9c-c1396789864c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:29.568063 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 353/687] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:29.574013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e583e2-8075-40a0-8bfb-420de44b4ca6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:29.585005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e583e2-8075-40a0-8bfb-420de44b4ca6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:29.598582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7986fb-dde4-48b0-8690-368d19070ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:29.599243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7986fb-dde4-48b0-8690-368d19070ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:29.599527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7986fb-dde4-48b0-8690-368d19070ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:29.599807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7986fb-dde4-48b0-8690-368d19070ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:29.600603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7986fb-dde4-48b0-8690-368d19070ea5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:29.600970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7986fb-dde4-48b0-8690-368d19070ea5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:29.602852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7986fb-dde4-48b0-8690-368d19070ea5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:29.624443 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 335/688] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:29.631746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03382ec-ce3a-44ca-bf9c-c1396789864c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:29.647099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03382ec-ce3a-44ca-bf9c-c1396789864c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:29.656214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27c84c-6d1c-41e6-93c0-ffb6694e4768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:29.656856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27c84c-6d1c-41e6-93c0-ffb6694e4768 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:29.657141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27c84c-6d1c-41e6-93c0-ffb6694e4768 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:29.657418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27c84c-6d1c-41e6-93c0-ffb6694e4768 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:29.658272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27c84c-6d1c-41e6-93c0-ffb6694e4768 admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=a180acaefee3489788068c927fbe403c) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:29.658587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27c84c-6d1c-41e6-93c0-ffb6694e4768 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:29.660408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27c84c-6d1c-41e6-93c0-ffb6694e4768 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:29.667453 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 354/689] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:29 2021] GET /identity/v3/role_assignments?user.id=a180acaefee3489788068c927fbe403c&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:30.309841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10522490-2600-41ef-9313-65a9eaad5a3d None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:30.310274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10522490-2600-41ef-9313-65a9eaad5a3d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:30.310453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10522490-2600-41ef-9313-65a9eaad5a3d None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:30.312744 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 336/690] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:30.318430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350979-b090-4b5b-87a6-16db64c614d8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:30.318970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350979-b090-4b5b-87a6-16db64c614d8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:30.319147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350979-b090-4b5b-87a6-16db64c614d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:30.355942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e6350979-b090-4b5b-87a6-16db64c614d8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:30.357259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e6350979-b090-4b5b-87a6-16db64c614d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:30.365904 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 355/691] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:30.404908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10522490-2600-41ef-9313-65a9eaad5a3d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:30.419250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10522490-2600-41ef-9313-65a9eaad5a3d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:30.429516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8563a9e-970f-4594-9f9d-37000962cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:30.430391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8563a9e-970f-4594-9f9d-37000962cad6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:30.430644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8563a9e-970f-4594-9f9d-37000962cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:30.430948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8563a9e-970f-4594-9f9d-37000962cad6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:30.445881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8563a9e-970f-4594-9f9d-37000962cad6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:30.449084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8563a9e-970f-4594-9f9d-37000962cad6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:30.470122 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-a8563a9e-970f-4594-9f9d-37000962cad6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:30.471793 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 337/692] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:30.478147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6350979-b090-4b5b-87a6-16db64c614d8 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:30.491373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6350979-b090-4b5b-87a6-16db64c614d8 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:30.496719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6067862-8eff-4240-8ac0-875dbbb664f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:30.497416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6067862-8eff-4240-8ac0-875dbbb664f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:30.497724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6067862-8eff-4240-8ac0-875dbbb664f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:30.498028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6067862-8eff-4240-8ac0-875dbbb664f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:30.498862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6067862-8eff-4240-8ac0-875dbbb664f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:30.499189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6067862-8eff-4240-8ac0-875dbbb664f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:30.500927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6067862-8eff-4240-8ac0-875dbbb664f0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:30.513638 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 356/693] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:30.519650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8563a9e-970f-4594-9f9d-37000962cad6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:30.531830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8563a9e-970f-4594-9f9d-37000962cad6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:30.541722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e26472-4f21-4b59-9e43-bd5dfddf299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:30.542516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e26472-4f21-4b59-9e43-bd5dfddf299e admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:30.543373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e26472-4f21-4b59-9e43-bd5dfddf299e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:30.543671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e26472-4f21-4b59-9e43-bd5dfddf299e admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:30.544485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e26472-4f21-4b59-9e43-bd5dfddf299e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:30.546638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e26472-4f21-4b59-9e43-bd5dfddf299e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:30.569416 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 338/694] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:32:30 2021] POST /identity/v3/users => generated 254 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:32:31.389583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9962fd-d89a-4d34-ae98-e5b12c814747 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:31.390521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9962fd-d89a-4d34-ae98-e5b12c814747 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:31.391009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9962fd-d89a-4d34-ae98-e5b12c814747 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:31.393248 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 357/695] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:31 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:31.399329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876460e4-c5b5-4391-8201-9a38a5c3363b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:31.399767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876460e4-c5b5-4391-8201-9a38a5c3363b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:31.400185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876460e4-c5b5-4391-8201-9a38a5c3363b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:31.432475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-876460e4-c5b5-4391-8201-9a38a5c3363b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:31.434269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-876460e4-c5b5-4391-8201-9a38a5c3363b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:31.447666 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 339/696] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:31.489727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9962fd-d89a-4d34-ae98-e5b12c814747 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:31.512436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9962fd-d89a-4d34-ae98-e5b12c814747 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:31.519073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7958e-b172-41ad-a46b-610a2d30ddcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:31.519993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7958e-b172-41ad-a46b-610a2d30ddcc admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:31.520284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7958e-b172-41ad-a46b-610a2d30ddcc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:31.520565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7958e-b172-41ad-a46b-610a2d30ddcc admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:31.521249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7958e-b172-41ad-a46b-610a2d30ddcc admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:31.522279 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-a2a7958e-b172-41ad-a46b-610a2d30ddcc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:32:31.522279 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:32:31.522279 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:32:31.523174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7958e-b172-41ad-a46b-610a2d30ddcc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:31.541598 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-a2a7958e-b172-41ad-a46b-610a2d30ddcc admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 18 20:32:31.543007 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 358/697] 10.222.0.13 () {56 vars in 1150 bytes} [Sat Dec 18 20:32:31 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:31.549431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876460e4-c5b5-4391-8201-9a38a5c3363b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:31.559031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876460e4-c5b5-4391-8201-9a38a5c3363b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:31.566363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6e073-f601-4890-96d3-91d38510b670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:31.567025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6e073-f601-4890-96d3-91d38510b670 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:31.567308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6e073-f601-4890-96d3-91d38510b670 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:31.567583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6e073-f601-4890-96d3-91d38510b670 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:31.568304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6e073-f601-4890-96d3-91d38510b670 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:31.568605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6e073-f601-4890-96d3-91d38510b670 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:31.569608 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-86b6e073-f601-4890-96d3-91d38510b670 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:32:31.569608 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:32:31.569608 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:32:31.570606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6e073-f601-4890-96d3-91d38510b670 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:31.578443 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 340/698] 10.222.0.13 () {56 vars in 1145 bytes} [Sat Dec 18 20:32:31 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:31.584206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7958e-b172-41ad-a46b-610a2d30ddcc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:31.596348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7958e-b172-41ad-a46b-610a2d30ddcc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:31.604236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317562a5-8a4c-4a67-853b-c43f508cebc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:31.604890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317562a5-8a4c-4a67-853b-c43f508cebc4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:31.605175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317562a5-8a4c-4a67-853b-c43f508cebc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:31.605486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317562a5-8a4c-4a67-853b-c43f508cebc4 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:31.606206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317562a5-8a4c-4a67-853b-c43f508cebc4 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:31.606539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317562a5-8a4c-4a67-853b-c43f508cebc4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:31.607541 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-317562a5-8a4c-4a67-853b-c43f508cebc4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:32:31.607541 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:32:31.607541 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:32:31.608404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317562a5-8a4c-4a67-853b-c43f508cebc4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:31.619008 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 359/699] 10.222.0.13 () {56 vars in 1145 bytes} [Sat Dec 18 20:32:31 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:31.632456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bc7c7-97fc-4aee-b76b-d44a88270242 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:31.632777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bc7c7-97fc-4aee-b76b-d44a88270242 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:31.633018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bc7c7-97fc-4aee-b76b-d44a88270242 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:31.635096 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 341/700] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:31.649484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cc8ac-de38-4c6a-98b0-f840f901ad5f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:31.649859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cc8ac-de38-4c6a-98b0-f840f901ad5f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:31.649959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cc8ac-de38-4c6a-98b0-f840f901ad5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:31.669899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8c6cc8ac-de38-4c6a-98b0-f840f901ad5f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:31.671136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8c6cc8ac-de38-4c6a-98b0-f840f901ad5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:31.679435 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 360/701] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:31.706169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bc7c7-97fc-4aee-b76b-d44a88270242 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:31.723127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bc7c7-97fc-4aee-b76b-d44a88270242 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:31.728130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f21350-030b-461b-978a-bd88dcd53263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:31.728920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f21350-030b-461b-978a-bd88dcd53263 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:31.729249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f21350-030b-461b-978a-bd88dcd53263 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:31.729521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f21350-030b-461b-978a-bd88dcd53263 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:31.745694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f21350-030b-461b-978a-bd88dcd53263 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:31.754736 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-89f21350-030b-461b-978a-bd88dcd53263 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:31.756352 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 342/702] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:31.762596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cc8ac-de38-4c6a-98b0-f840f901ad5f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:31.772131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cc8ac-de38-4c6a-98b0-f840f901ad5f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:31.776692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b60dbe-a4d2-4786-8a84-ca46192e172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:31.777443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60dbe-a4d2-4786-8a84-ca46192e172d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:31.777730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60dbe-a4d2-4786-8a84-ca46192e172d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:31.778005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60dbe-a4d2-4786-8a84-ca46192e172d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:31.778855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b60dbe-a4d2-4786-8a84-ca46192e172d admin admin] RBAC: Adding query filter params (name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:31.779212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b60dbe-a4d2-4786-8a84-ca46192e172d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:31.780852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b60dbe-a4d2-4786-8a84-ca46192e172d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:31.790684 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 361/703] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:31.797401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f21350-030b-461b-978a-bd88dcd53263 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:31.807506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f21350-030b-461b-978a-bd88dcd53263 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:31.813313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2022505-96c7-45c6-99ae-311f2180f3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:31.814179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022505-96c7-45c6-99ae-311f2180f3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:31.814499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022505-96c7-45c6-99ae-311f2180f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:31.814775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022505-96c7-45c6-99ae-311f2180f3b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:31.826718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2022505-96c7-45c6-99ae-311f2180f3b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:31.828617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2022505-96c7-45c6-99ae-311f2180f3b7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:31.846220 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-d2022505-96c7-45c6-99ae-311f2180f3b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:31.847737 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 343/704] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:31.853812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b60dbe-a4d2-4786-8a84-ca46192e172d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:31.864739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b60dbe-a4d2-4786-8a84-ca46192e172d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:31.869369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0eec1-9b67-49e3-a1bc-597abf921812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:31.870044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0eec1-9b67-49e3-a1bc-597abf921812 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:31.870435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0eec1-9b67-49e3-a1bc-597abf921812 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:31.870721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0eec1-9b67-49e3-a1bc-597abf921812 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:31.871580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0eec1-9b67-49e3-a1bc-597abf921812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:31.871885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0eec1-9b67-49e3-a1bc-597abf921812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:31.874086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0eec1-9b67-49e3-a1bc-597abf921812 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:31.885232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a721f-5815-4b30-aa4e-499d77f932c5 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:31.885535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a721f-5815-4b30-aa4e-499d77f932c5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:31.885792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a721f-5815-4b30-aa4e-499d77f932c5 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:31.888297 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 344/705] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:31.890867 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 362/706] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:31.895666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3c3a9-73f0-4e4b-8612-36a1a081f7c2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:31.895952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3c3a9-73f0-4e4b-8612-36a1a081f7c2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:31.896228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3c3a9-73f0-4e4b-8612-36a1a081f7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:31.901030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0eec1-9b67-49e3-a1bc-597abf921812 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:31.919713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0ce3c3a9-73f0-4e4b-8612-36a1a081f7c2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:31.920631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0ce3c3a9-73f0-4e4b-8612-36a1a081f7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:31.922146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0eec1-9b67-49e3-a1bc-597abf921812 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:31.929241 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 345/707] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:31.935596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29b64d-0104-44de-9b78-25878248d230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:31.936687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29b64d-0104-44de-9b78-25878248d230 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:31.936972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29b64d-0104-44de-9b78-25878248d230 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:31.937251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29b64d-0104-44de-9b78-25878248d230 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:31.954669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29b64d-0104-44de-9b78-25878248d230 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:31.956694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29b64d-0104-44de-9b78-25878248d230 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:31.967515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3c3a9-73f0-4e4b-8612-36a1a081f7c2 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:31.971378 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-af29b64d-0104-44de-9b78-25878248d230 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 18 20:32:31.972909 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 363/708] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:32:31 2021] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:31.980142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29b64d-0104-44de-9b78-25878248d230 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:31.980798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3c3a9-73f0-4e4b-8612-36a1a081f7c2 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:31.985313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537e606-4f37-4790-8bf0-a879679b7f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:31.986097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537e606-4f37-4790-8bf0-a879679b7f8e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:31.986428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537e606-4f37-4790-8bf0-a879679b7f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:31.986708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537e606-4f37-4790-8bf0-a879679b7f8e admin admin] PATH_INFO: `/v3/services/network` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:31.987376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537e606-4f37-4790-8bf0-a879679b7f8e admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:31.988388 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-d537e606-4f37-4790-8bf0-a879679b7f8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:32:31.988388 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:32:31.988388 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:32:31.989451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537e606-4f37-4790-8bf0-a879679b7f8e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:31.990873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29b64d-0104-44de-9b78-25878248d230 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:31.995447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0a25f-e64b-403c-8218-5b338e9a97a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:31.996128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0a25f-e64b-403c-8218-5b338e9a97a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:31.996410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0a25f-e64b-403c-8218-5b338e9a97a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:31.996735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0a25f-e64b-403c-8218-5b338e9a97a2 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:31.997579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0a25f-e64b-403c-8218-5b338e9a97a2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:31.997886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0a25f-e64b-403c-8218-5b338e9a97a2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:31.999796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0a25f-e64b-403c-8218-5b338e9a97a2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:32.003183 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-d537e606-4f37-4790-8bf0-a879679b7f8e admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 18 20:32:32.004515 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 346/709] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:31 2021] GET /identity/v3/services/network => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:32:32.010700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537e606-4f37-4790-8bf0-a879679b7f8e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:32.020934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537e606-4f37-4790-8bf0-a879679b7f8e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:32.021669 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 364/710] 10.222.0.13 () {56 vars in 1156 bytes} [Sat Dec 18 20:32:31 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:32.024834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0a25f-e64b-403c-8218-5b338e9a97a2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:32.026605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907667df-490f-46aa-9527-fd3d1ad2cbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:32.027821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907667df-490f-46aa-9527-fd3d1ad2cbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:32.028104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907667df-490f-46aa-9527-fd3d1ad2cbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:32.028380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907667df-490f-46aa-9527-fd3d1ad2cbc7 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:32.029096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907667df-490f-46aa-9527-fd3d1ad2cbc7 admin admin] RBAC: Adding query filter params (name=network) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:32.029400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907667df-490f-46aa-9527-fd3d1ad2cbc7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:32.031115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907667df-490f-46aa-9527-fd3d1ad2cbc7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:32.035763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0a25f-e64b-403c-8218-5b338e9a97a2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:32.040221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f3fa0-0981-4009-bc5f-830b84da7ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:32.040619 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 347/711] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Dec 18 20:32:32 2021] GET /identity/v3/services?name=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:32.040936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f3fa0-0981-4009-bc5f-830b84da7ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:32.041220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f3fa0-0981-4009-bc5f-830b84da7ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:32.041494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f3fa0-0981-4009-bc5f-830b84da7ce3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:32.041810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907667df-490f-46aa-9527-fd3d1ad2cbc7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:32.050425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f3fa0-0981-4009-bc5f-830b84da7ce3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:32.051300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907667df-490f-46aa-9527-fd3d1ad2cbc7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:32.052455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f3fa0-0981-4009-bc5f-830b84da7ce3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:32.056686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afac773-c107-4515-b2ae-cbd1a621934d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:32.057342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afac773-c107-4515-b2ae-cbd1a621934d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:32.057626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afac773-c107-4515-b2ae-cbd1a621934d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:32.057909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afac773-c107-4515-b2ae-cbd1a621934d admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:32.059199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afac773-c107-4515-b2ae-cbd1a621934d admin admin] RBAC: Adding query filter params (type=network) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:32.059507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afac773-c107-4515-b2ae-cbd1a621934d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:32.061355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afac773-c107-4515-b2ae-cbd1a621934d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:32.064058 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 365/712] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:32 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 20:32:32.067429 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 348/713] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Dec 18 20:32:32 2021] GET /identity/v3/services?type=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:32.070047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f3fa0-0981-4009-bc5f-830b84da7ce3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:32.080013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f3fa0-0981-4009-bc5f-830b84da7ce3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:32.085037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3a946-4270-4e28-ba83-e4ef85f138a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:32.085855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3a946-4270-4e28-ba83-e4ef85f138a8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:32.086136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3a946-4270-4e28-ba83-e4ef85f138a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:32.086456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3a946-4270-4e28-ba83-e4ef85f138a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:32.098313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3a946-4270-4e28-ba83-e4ef85f138a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:32.100220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3a946-4270-4e28-ba83-e4ef85f138a8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:32.119623 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-b0b3a946-4270-4e28-ba83-e4ef85f138a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:32.121692 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 366/714] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:32.127918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afac773-c107-4515-b2ae-cbd1a621934d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:32.139481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afac773-c107-4515-b2ae-cbd1a621934d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:32.144560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a0204-c2f9-4e2c-ad7c-04723c9d79de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:32.145333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a0204-c2f9-4e2c-ad7c-04723c9d79de admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:32.145619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a0204-c2f9-4e2c-ad7c-04723c9d79de admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:32.145894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a0204-c2f9-4e2c-ad7c-04723c9d79de admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:32.146716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a0204-c2f9-4e2c-ad7c-04723c9d79de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:32.147069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a0204-c2f9-4e2c-ad7c-04723c9d79de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:32.148730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a0204-c2f9-4e2c-ad7c-04723c9d79de admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:32.162281 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 349/715] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:32.168705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3a946-4270-4e28-ba83-e4ef85f138a8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:32.179799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3a946-4270-4e28-ba83-e4ef85f138a8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:32.185319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f229688-652e-47d4-bcd0-c296604a2d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:32.186456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f229688-652e-47d4-bcd0-c296604a2d1c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:32.186736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f229688-652e-47d4-bcd0-c296604a2d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:32.187006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f229688-652e-47d4-bcd0-c296604a2d1c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:32.195043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f229688-652e-47d4-bcd0-c296604a2d1c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:32.197107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f229688-652e-47d4-bcd0-c296604a2d1c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:32.211830 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-1f229688-652e-47d4-bcd0-c296604a2d1c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:32.213490 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 367/716] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:32.220742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a0204-c2f9-4e2c-ad7c-04723c9d79de admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:32.231628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a0204-c2f9-4e2c-ad7c-04723c9d79de admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:32.236399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53256d-6be9-4e17-a156-73bf3bebc341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:32.237111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53256d-6be9-4e17-a156-73bf3bebc341 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:32.237394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53256d-6be9-4e17-a156-73bf3bebc341 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:32.237669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53256d-6be9-4e17-a156-73bf3bebc341 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:32.238634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53256d-6be9-4e17-a156-73bf3bebc341 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:32.238945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53256d-6be9-4e17-a156-73bf3bebc341 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:32.240879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53256d-6be9-4e17-a156-73bf3bebc341 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:32.254855 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 350/717] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:32.261781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f229688-652e-47d4-bcd0-c296604a2d1c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:32.272635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f229688-652e-47d4-bcd0-c296604a2d1c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:32.277901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5e81d-e702-4986-9107-ce8cfd409d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:32.278636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5e81d-e702-4986-9107-ce8cfd409d6e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:32.278917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5e81d-e702-4986-9107-ce8cfd409d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:32.279236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5e81d-e702-4986-9107-ce8cfd409d6e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:32.280095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5e81d-e702-4986-9107-ce8cfd409d6e admin admin] RBAC: Adding query filter params (role.id=0071fc3d75b34850b7fb01a06a0279c5, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=f5e4bc28d0744b65ab520bf79cea5a45) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:32.280452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5e81d-e702-4986-9107-ce8cfd409d6e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:32.282399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5e81d-e702-4986-9107-ce8cfd409d6e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:32.289746 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 368/718] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:32 2021] GET /identity/v3/role_assignments?user.id=f5e4bc28d0744b65ab520bf79cea5a45&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=0071fc3d75b34850b7fb01a06a0279c5 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:32.884745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976f9e-cc5a-40bf-9820-94b9c17ac367 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:32.885425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976f9e-cc5a-40bf-9820-94b9c17ac367 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:32.885425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976f9e-cc5a-40bf-9820-94b9c17ac367 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:32.887319 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 351/719] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:32.893767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a490fe6-e359-49db-8c2c-5bc5db949f09 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:32.894235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a490fe6-e359-49db-8c2c-5bc5db949f09 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:32.894419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a490fe6-e359-49db-8c2c-5bc5db949f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:32.912175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9a490fe6-e359-49db-8c2c-5bc5db949f09 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:32.913349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9a490fe6-e359-49db-8c2c-5bc5db949f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:32.921902 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 369/720] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 18 20:32:32.946088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3976f9e-cc5a-40bf-9820-94b9c17ac367 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:32.958178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3976f9e-cc5a-40bf-9820-94b9c17ac367 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:32.962482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83ef0c-e116-4747-a6d2-90abf7bfba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:32.963260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83ef0c-e116-4747-a6d2-90abf7bfba11 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:32.963539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83ef0c-e116-4747-a6d2-90abf7bfba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:32.963814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83ef0c-e116-4747-a6d2-90abf7bfba11 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:32.975062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83ef0c-e116-4747-a6d2-90abf7bfba11 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:32.982402 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-8b83ef0c-e116-4747-a6d2-90abf7bfba11 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:32:32.983934 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 352/721] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:32:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:32.990061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a490fe6-e359-49db-8c2c-5bc5db949f09 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:32.999144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a490fe6-e359-49db-8c2c-5bc5db949f09 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:33.003598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fbd97-ca78-45e9-8e4a-2cffc0c4b41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:33.004257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fbd97-ca78-45e9-8e4a-2cffc0c4b41b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:33.004537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fbd97-ca78-45e9-8e4a-2cffc0c4b41b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:33.004813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fbd97-ca78-45e9-8e4a-2cffc0c4b41b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:33.005571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fbd97-ca78-45e9-8e4a-2cffc0c4b41b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:33.005877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fbd97-ca78-45e9-8e4a-2cffc0c4b41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:33.007476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fbd97-ca78-45e9-8e4a-2cffc0c4b41b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:33.016177 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 370/722] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:33.021939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83ef0c-e116-4747-a6d2-90abf7bfba11 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:33.032313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83ef0c-e116-4747-a6d2-90abf7bfba11 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:33.037245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d649d-4b18-42b2-8bef-9c6a6d3e4026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:33.038016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d649d-4b18-42b2-8bef-9c6a6d3e4026 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:33.038324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d649d-4b18-42b2-8bef-9c6a6d3e4026 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:33.038601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d649d-4b18-42b2-8bef-9c6a6d3e4026 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:33.049452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d649d-4b18-42b2-8bef-9c6a6d3e4026 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:33.051315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d649d-4b18-42b2-8bef-9c6a6d3e4026 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:33.068392 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-d62d649d-4b18-42b2-8bef-9c6a6d3e4026 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:33.069898 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 353/723] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:33.076399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fbd97-ca78-45e9-8e4a-2cffc0c4b41b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:33.086168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fbd97-ca78-45e9-8e4a-2cffc0c4b41b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:33.091489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf8ab4-fdb9-442f-b10b-e069bd11cbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:33.092148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf8ab4-fdb9-442f-b10b-e069bd11cbcf admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:33.092431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf8ab4-fdb9-442f-b10b-e069bd11cbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:33.092710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf8ab4-fdb9-442f-b10b-e069bd11cbcf admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:33.093443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf8ab4-fdb9-442f-b10b-e069bd11cbcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:33.093750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf8ab4-fdb9-442f-b10b-e069bd11cbcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:33.095352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf8ab4-fdb9-442f-b10b-e069bd11cbcf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:33.108095 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 371/724] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:33.113794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d649d-4b18-42b2-8bef-9c6a6d3e4026 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:33.124563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d649d-4b18-42b2-8bef-9c6a6d3e4026 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:33.128983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b0980-7a36-4bdc-b213-4f7e13e34803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:33.129755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b0980-7a36-4bdc-b213-4f7e13e34803 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:33.130032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b0980-7a36-4bdc-b213-4f7e13e34803 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:33.130333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b0980-7a36-4bdc-b213-4f7e13e34803 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:33.139189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b0980-7a36-4bdc-b213-4f7e13e34803 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:33.141183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b0980-7a36-4bdc-b213-4f7e13e34803 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:33.154761 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-fa8b0980-7a36-4bdc-b213-4f7e13e34803 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 18 20:32:33.156068 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 354/725] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Dec 18 20:32:33 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:33.162305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf8ab4-fdb9-442f-b10b-e069bd11cbcf admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:33.173879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf8ab4-fdb9-442f-b10b-e069bd11cbcf admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:33.189589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592126-d334-4655-9557-8f5d2d5d25e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:33.190730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592126-d334-4655-9557-8f5d2d5d25e1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:33.191179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592126-d334-4655-9557-8f5d2d5d25e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:33.191604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592126-d334-4655-9557-8f5d2d5d25e1 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:33.193053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac592126-d334-4655-9557-8f5d2d5d25e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:33.193541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac592126-d334-4655-9557-8f5d2d5d25e1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:33.195806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac592126-d334-4655-9557-8f5d2d5d25e1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:33.221957 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 372/726] 10.222.0.13 () {56 vars in 1154 bytes} [Sat Dec 18 20:32:33 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:33.228647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b0980-7a36-4bdc-b213-4f7e13e34803 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:33.243283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b0980-7a36-4bdc-b213-4f7e13e34803 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:33.252713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be26b6-7daf-43ab-af70-40e3c01297af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:33.253870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be26b6-7daf-43ab-af70-40e3c01297af admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:33.254395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be26b6-7daf-43ab-af70-40e3c01297af admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:33.254898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be26b6-7daf-43ab-af70-40e3c01297af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:33.272499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be26b6-7daf-43ab-af70-40e3c01297af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:33.274433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be26b6-7daf-43ab-af70-40e3c01297af admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:33.294890 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-d3be26b6-7daf-43ab-af70-40e3c01297af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:33.296535 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 355/727] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:33.302345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592126-d334-4655-9557-8f5d2d5d25e1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:33.320777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592126-d334-4655-9557-8f5d2d5d25e1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:33.331479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdcabb-d9a7-437a-a115-993d96d0db24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:33.332166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdcabb-d9a7-437a-a115-993d96d0db24 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:33.332448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdcabb-d9a7-437a-a115-993d96d0db24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:33.332720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdcabb-d9a7-437a-a115-993d96d0db24 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:33.333462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdcabb-d9a7-437a-a115-993d96d0db24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:33.333767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdcabb-d9a7-437a-a115-993d96d0db24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:33.335380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdcabb-d9a7-437a-a115-993d96d0db24 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:33.352785 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 373/728] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:33.358790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be26b6-7daf-43ab-af70-40e3c01297af admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:33.375639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be26b6-7daf-43ab-af70-40e3c01297af admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:33.387864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31f5aa-6eb2-46ee-8f8b-b21eba8ed310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:33.388723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31f5aa-6eb2-46ee-8f8b-b21eba8ed310 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:33.389008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31f5aa-6eb2-46ee-8f8b-b21eba8ed310 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:33.389347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31f5aa-6eb2-46ee-8f8b-b21eba8ed310 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:33.400181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31f5aa-6eb2-46ee-8f8b-b21eba8ed310 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:33.402435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31f5aa-6eb2-46ee-8f8b-b21eba8ed310 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:33.422245 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-3a31f5aa-6eb2-46ee-8f8b-b21eba8ed310 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:33.423748 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 356/729] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:33.429651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdcabb-d9a7-437a-a115-993d96d0db24 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:33.440250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdcabb-d9a7-437a-a115-993d96d0db24 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:33.450336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98161bf-1c58-441b-9de6-0b6fc3c22c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:33.450991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98161bf-1c58-441b-9de6-0b6fc3c22c2a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:33.451277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98161bf-1c58-441b-9de6-0b6fc3c22c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:33.451557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98161bf-1c58-441b-9de6-0b6fc3c22c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:33.452376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98161bf-1c58-441b-9de6-0b6fc3c22c2a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:33.452658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98161bf-1c58-441b-9de6-0b6fc3c22c2a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:33.454507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98161bf-1c58-441b-9de6-0b6fc3c22c2a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:33.474106 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 374/730] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:33.481227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31f5aa-6eb2-46ee-8f8b-b21eba8ed310 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:33.495136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31f5aa-6eb2-46ee-8f8b-b21eba8ed310 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:33.504628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d675a99-ed3f-4d31-818d-9d59c1c8e8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:33.505497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d675a99-ed3f-4d31-818d-9d59c1c8e8de admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:33.505776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d675a99-ed3f-4d31-818d-9d59c1c8e8de admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:33.506049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d675a99-ed3f-4d31-818d-9d59c1c8e8de admin admin] PATH_INFO: `/v3/projects/0dd4d15f423642fa8da604b758048203/users/a180acaefee3489788068c927fbe403c/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:33.508057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d675a99-ed3f-4d31-818d-9d59c1c8e8de admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd4d15f423642fa8da604b758048203, user_id=a180acaefee3489788068c927fbe403c, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:33.510689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d675a99-ed3f-4d31-818d-9d59c1c8e8de admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:33.532311 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 357/731] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:32:33 2021] PUT /identity/v3/projects/0dd4d15f423642fa8da604b758048203/users/a180acaefee3489788068c927fbe403c/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:32:33.972143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acca729-b9ce-4db6-ac24-40a25a16b9b7 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:33.972654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acca729-b9ce-4db6-ac24-40a25a16b9b7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:33.972753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acca729-b9ce-4db6-ac24-40a25a16b9b7 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:33.974823 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 375/732] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:33.980956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87332886-dd07-411d-9087-d9fb5b944737 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:33.981398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87332886-dd07-411d-9087-d9fb5b944737 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:33.981626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87332886-dd07-411d-9087-d9fb5b944737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:34.007290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-87332886-dd07-411d-9087-d9fb5b944737 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:34.008501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-87332886-dd07-411d-9087-d9fb5b944737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:34.082668 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 358/733] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:34.124061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acca729-b9ce-4db6-ac24-40a25a16b9b7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:34.140456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acca729-b9ce-4db6-ac24-40a25a16b9b7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:34.146493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e674f8f-b91a-4437-832c-e43bb69304a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:34.147278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e674f8f-b91a-4437-832c-e43bb69304a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:34.147565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e674f8f-b91a-4437-832c-e43bb69304a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:34.147841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e674f8f-b91a-4437-832c-e43bb69304a4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:34.164306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e674f8f-b91a-4437-832c-e43bb69304a4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:34.171196 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-0e674f8f-b91a-4437-832c-e43bb69304a4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:34.172559 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 376/734] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:34.179316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87332886-dd07-411d-9087-d9fb5b944737 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:34.188643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87332886-dd07-411d-9087-d9fb5b944737 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:34.194922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de477c2-ef4f-4f82-8b30-be41fc4c42da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:34.195668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de477c2-ef4f-4f82-8b30-be41fc4c42da admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:34.195977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de477c2-ef4f-4f82-8b30-be41fc4c42da admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:34.196278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de477c2-ef4f-4f82-8b30-be41fc4c42da admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:34.197128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de477c2-ef4f-4f82-8b30-be41fc4c42da admin admin] RBAC: Adding query filter params (name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:34.197471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de477c2-ef4f-4f82-8b30-be41fc4c42da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:34.199766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de477c2-ef4f-4f82-8b30-be41fc4c42da admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:34.208778 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 359/735] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:34.215141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e674f8f-b91a-4437-832c-e43bb69304a4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:34.227174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e674f8f-b91a-4437-832c-e43bb69304a4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:34.234733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844e48a-1f1a-4ddd-a3f2-799c450e029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:34.235527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844e48a-1f1a-4ddd-a3f2-799c450e029c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:34.235816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844e48a-1f1a-4ddd-a3f2-799c450e029c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:34.236096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844e48a-1f1a-4ddd-a3f2-799c450e029c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:34.258012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844e48a-1f1a-4ddd-a3f2-799c450e029c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:34.259884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844e48a-1f1a-4ddd-a3f2-799c450e029c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:34.288322 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-c844e48a-1f1a-4ddd-a3f2-799c450e029c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:34.289830 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 377/736] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:34.295879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de477c2-ef4f-4f82-8b30-be41fc4c42da admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:34.313090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de477c2-ef4f-4f82-8b30-be41fc4c42da admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:34.330648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa1112-094e-4955-b9f3-d67e91b9ae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:34.331437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa1112-094e-4955-b9f3-d67e91b9ae19 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:34.331745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa1112-094e-4955-b9f3-d67e91b9ae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:34.332026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa1112-094e-4955-b9f3-d67e91b9ae19 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:34.332835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa1112-094e-4955-b9f3-d67e91b9ae19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:34.333169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa1112-094e-4955-b9f3-d67e91b9ae19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:34.334907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa1112-094e-4955-b9f3-d67e91b9ae19 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:34.357351 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 360/737] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:34.363635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844e48a-1f1a-4ddd-a3f2-799c450e029c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:34.378848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844e48a-1f1a-4ddd-a3f2-799c450e029c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:34.386785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40db585-479c-48ff-b4e6-cd65432ecb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:34.387613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40db585-479c-48ff-b4e6-cd65432ecb62 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:34.387900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40db585-479c-48ff-b4e6-cd65432ecb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:34.388179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40db585-479c-48ff-b4e6-cd65432ecb62 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:34.407655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40db585-479c-48ff-b4e6-cd65432ecb62 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:34.409696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40db585-479c-48ff-b4e6-cd65432ecb62 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:34.434189 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-d40db585-479c-48ff-b4e6-cd65432ecb62 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 18 20:32:34.435558 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 378/738] 10.222.0.13 () {56 vars in 1138 bytes} [Sat Dec 18 20:32:34 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:34.442130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa1112-094e-4955-b9f3-d67e91b9ae19 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:34.459841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa1112-094e-4955-b9f3-d67e91b9ae19 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:34.467887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc80076-6b4a-4096-afb9-335f161c21c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:34.468633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc80076-6b4a-4096-afb9-335f161c21c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:34.468935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc80076-6b4a-4096-afb9-335f161c21c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:34.469236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc80076-6b4a-4096-afb9-335f161c21c7 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:34.470148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc80076-6b4a-4096-afb9-335f161c21c7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:34.470492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc80076-6b4a-4096-afb9-335f161c21c7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:34.472386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc80076-6b4a-4096-afb9-335f161c21c7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:34.507601 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 361/739] 10.222.0.13 () {56 vars in 1170 bytes} [Sat Dec 18 20:32:34 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:34.514424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40db585-479c-48ff-b4e6-cd65432ecb62 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:34.527840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40db585-479c-48ff-b4e6-cd65432ecb62 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:34.539423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe8192-cb50-44b0-a759-d3a43421935e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:34.540073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8192-cb50-44b0-a759-d3a43421935e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:34.540362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8192-cb50-44b0-a759-d3a43421935e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:34.540645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8192-cb50-44b0-a759-d3a43421935e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:34.554088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe8192-cb50-44b0-a759-d3a43421935e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:34.555871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe8192-cb50-44b0-a759-d3a43421935e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:34.571963 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 379/740] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 20:32:34.578606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc80076-6b4a-4096-afb9-335f161c21c7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:34.589159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc80076-6b4a-4096-afb9-335f161c21c7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:34.600677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fef14-a5f3-435c-8fb5-5951036cd63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:34.601529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fef14-a5f3-435c-8fb5-5951036cd63f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:34.601838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fef14-a5f3-435c-8fb5-5951036cd63f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:34.602139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fef14-a5f3-435c-8fb5-5951036cd63f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:34.623240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fef14-a5f3-435c-8fb5-5951036cd63f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:34.623991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fef14-a5f3-435c-8fb5-5951036cd63f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:34.648666 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-504fef14-a5f3-435c-8fb5-5951036cd63f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:34.650682 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 362/741] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:34.657087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe8192-cb50-44b0-a759-d3a43421935e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:34.671944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe8192-cb50-44b0-a759-d3a43421935e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:34.686876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919818b-8b8c-4db9-9722-0a0ff0e1d12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:34.687553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919818b-8b8c-4db9-9722-0a0ff0e1d12c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:34.687842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919818b-8b8c-4db9-9722-0a0ff0e1d12c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:34.688125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919818b-8b8c-4db9-9722-0a0ff0e1d12c admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:34.688857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919818b-8b8c-4db9-9722-0a0ff0e1d12c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:34.689165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919818b-8b8c-4db9-9722-0a0ff0e1d12c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:34.690771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919818b-8b8c-4db9-9722-0a0ff0e1d12c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:34.707411 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 380/742] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:34.713499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fef14-a5f3-435c-8fb5-5951036cd63f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:34.731319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fef14-a5f3-435c-8fb5-5951036cd63f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:34.738899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fcb21-0624-4f65-9477-6ff05cc36d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:34.739976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fcb21-0624-4f65-9477-6ff05cc36d50 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:34.740514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fcb21-0624-4f65-9477-6ff05cc36d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:34.741034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fcb21-0624-4f65-9477-6ff05cc36d50 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:34.754749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fcb21-0624-4f65-9477-6ff05cc36d50 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:34.756952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fcb21-0624-4f65-9477-6ff05cc36d50 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:34.778889 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-508fcb21-0624-4f65-9477-6ff05cc36d50 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:34.780449 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 363/743] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:34.787804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919818b-8b8c-4db9-9722-0a0ff0e1d12c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:34.803775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919818b-8b8c-4db9-9722-0a0ff0e1d12c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:34.814677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6e124-20a2-4645-8ca6-eb98a0091924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:34.815339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6e124-20a2-4645-8ca6-eb98a0091924 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:34.815626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6e124-20a2-4645-8ca6-eb98a0091924 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:34.815900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6e124-20a2-4645-8ca6-eb98a0091924 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:34.816713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6e124-20a2-4645-8ca6-eb98a0091924 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:34.817020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6e124-20a2-4645-8ca6-eb98a0091924 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:34.818882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6e124-20a2-4645-8ca6-eb98a0091924 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:34.840003 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 381/744] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:34.846768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fcb21-0624-4f65-9477-6ff05cc36d50 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:34.861047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fcb21-0624-4f65-9477-6ff05cc36d50 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:34.868073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfff84-0123-410d-add3-f74f381c125e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:34.868960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfff84-0123-410d-add3-f74f381c125e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:34.869479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfff84-0123-410d-add3-f74f381c125e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:34.869990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfff84-0123-410d-add3-f74f381c125e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:34.871712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfff84-0123-410d-add3-f74f381c125e admin admin] RBAC: Adding query filter params (role.id=0071fc3d75b34850b7fb01a06a0279c5, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=1157bb6f43474dfa96d91a444d850b67) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:34.872228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfff84-0123-410d-add3-f74f381c125e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:34.874374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfff84-0123-410d-add3-f74f381c125e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:34.882575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebcace-32d5-41e7-b3f9-ff366e1ecbf3 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:34.882973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebcace-32d5-41e7-b3f9-ff366e1ecbf3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:34.883118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebcace-32d5-41e7-b3f9-ff366e1ecbf3 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:34.886520 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 382/745] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:34.890095 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 364/746] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:34 2021] GET /identity/v3/role_assignments?user.id=1157bb6f43474dfa96d91a444d850b67&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=0071fc3d75b34850b7fb01a06a0279c5 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:34.893128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a09d7-7dac-4697-970e-3fff4bed9b05 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:34.893421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a09d7-7dac-4697-970e-3fff4bed9b05 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:34.893702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a09d7-7dac-4697-970e-3fff4bed9b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:34.912348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-476a09d7-7dac-4697-970e-3fff4bed9b05 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:34.913668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-476a09d7-7dac-4697-970e-3fff4bed9b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:34.922531 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 383/747] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 18 20:32:34.949323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfff84-0123-410d-add3-f74f381c125e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:34.959458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfff84-0123-410d-add3-f74f381c125e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:34.964394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca660c3-ae91-47a8-8922-fbd3a9f25853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:34.965158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca660c3-ae91-47a8-8922-fbd3a9f25853 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:34.965441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca660c3-ae91-47a8-8922-fbd3a9f25853 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:34.965719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca660c3-ae91-47a8-8922-fbd3a9f25853 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:34.966573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca660c3-ae91-47a8-8922-fbd3a9f25853 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:34.967665 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-7ca660c3-ae91-47a8-8922-fbd3a9f25853 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:32:34.967665 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:32:34.967665 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:32:34.968667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca660c3-ae91-47a8-8922-fbd3a9f25853 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:34.997073 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 365/748] 10.222.0.13 () {60 vars in 1162 bytes} [Sat Dec 18 20:32:34 2021] POST /identity/v3/services => generated 251 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:32:35.252458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe31d2-63f8-46bd-8900-5b897491aa4d None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:35.252964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe31d2-63f8-46bd-8900-5b897491aa4d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:35.253064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe31d2-63f8-46bd-8900-5b897491aa4d None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:35.255155 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 384/749] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:35.261031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4b425-bf74-4fc8-aba6-789518f7a582 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:35.261611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4b425-bf74-4fc8-aba6-789518f7a582 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:35.262091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4b425-bf74-4fc8-aba6-789518f7a582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:35.285240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8ca4b425-bf74-4fc8-aba6-789518f7a582 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:35.286798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8ca4b425-bf74-4fc8-aba6-789518f7a582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:35.311490 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 366/750] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:35 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:35.337390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe31d2-63f8-46bd-8900-5b897491aa4d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:35.351585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe31d2-63f8-46bd-8900-5b897491aa4d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:35.361030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a2dd3-35e2-4e87-98f1-91b0f2f1b7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:35.362075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a2dd3-35e2-4e87-98f1-91b0f2f1b7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:35.362685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a2dd3-35e2-4e87-98f1-91b0f2f1b7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:35.363278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a2dd3-35e2-4e87-98f1-91b0f2f1b7d4 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:35.364259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a2dd3-35e2-4e87-98f1-91b0f2f1b7d4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:35.365612 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-496a2dd3-35e2-4e87-98f1-91b0f2f1b7d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:32:35.365612 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:32:35.365612 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:32:35.366807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a2dd3-35e2-4e87-98f1-91b0f2f1b7d4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:35.389035 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 385/751] 10.222.0.13 () {60 vars in 1162 bytes} [Sat Dec 18 20:32:35 2021] POST /identity/v3/services => generated 240 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:32:35.912867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f7d83-b585-41fc-b5cb-3f0b132f4d21 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:35.913238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f7d83-b585-41fc-b5cb-3f0b132f4d21 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:35.913460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f7d83-b585-41fc-b5cb-3f0b132f4d21 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:35.915545 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 367/752] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:35.921611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b1fba-e15d-44b9-b3f0-e5cec481d18e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:35.921927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b1fba-e15d-44b9-b3f0-e5cec481d18e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:35.922190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b1fba-e15d-44b9-b3f0-e5cec481d18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:35.951275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-382b1fba-e15d-44b9-b3f0-e5cec481d18e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:35.952482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-382b1fba-e15d-44b9-b3f0-e5cec481d18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:35.983682 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 386/753] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:35 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:36.030139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f7d83-b585-41fc-b5cb-3f0b132f4d21 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:36.048021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f7d83-b585-41fc-b5cb-3f0b132f4d21 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:36.055726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ef1ed-e5e2-41ad-8ca3-aa675fdca82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:36.056512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ef1ed-e5e2-41ad-8ca3-aa675fdca82c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:36.056794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ef1ed-e5e2-41ad-8ca3-aa675fdca82c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:36.057072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ef1ed-e5e2-41ad-8ca3-aa675fdca82c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:36.072212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ef1ed-e5e2-41ad-8ca3-aa675fdca82c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:36.079488 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-906ef1ed-e5e2-41ad-8ca3-aa675fdca82c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:32:36.080686 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 368/754] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:32:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:36.087428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b1fba-e15d-44b9-b3f0-e5cec481d18e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:36.097724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b1fba-e15d-44b9-b3f0-e5cec481d18e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:36.106161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff3dae-3e8f-4bad-9061-33fe270dcde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:36.106867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff3dae-3e8f-4bad-9061-33fe270dcde6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:36.107154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff3dae-3e8f-4bad-9061-33fe270dcde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:36.107437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff3dae-3e8f-4bad-9061-33fe270dcde6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:36.108274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff3dae-3e8f-4bad-9061-33fe270dcde6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:36.108584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff3dae-3e8f-4bad-9061-33fe270dcde6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:36.110238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff3dae-3e8f-4bad-9061-33fe270dcde6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:36.126351 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 387/755] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:36.129089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ef1ed-e5e2-41ad-8ca3-aa675fdca82c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:36.139085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ef1ed-e5e2-41ad-8ca3-aa675fdca82c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:36.144091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fba0b3-945c-439a-916b-111de1081702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:36.144928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fba0b3-945c-439a-916b-111de1081702 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:36.145454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fba0b3-945c-439a-916b-111de1081702 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:36.145795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fba0b3-945c-439a-916b-111de1081702 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:36.157251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fba0b3-945c-439a-916b-111de1081702 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:36.159177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fba0b3-945c-439a-916b-111de1081702 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:36.175892 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-f2fba0b3-945c-439a-916b-111de1081702 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:36.180081 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 369/756] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:36.183639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff3dae-3e8f-4bad-9061-33fe270dcde6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:36.194145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff3dae-3e8f-4bad-9061-33fe270dcde6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:36.199461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bb0c1-cfd9-4107-b8d6-0fce0a8de548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:36.200124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bb0c1-cfd9-4107-b8d6-0fce0a8de548 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:36.200460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bb0c1-cfd9-4107-b8d6-0fce0a8de548 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:36.200780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bb0c1-cfd9-4107-b8d6-0fce0a8de548 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:36.201522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bb0c1-cfd9-4107-b8d6-0fce0a8de548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:36.201980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bb0c1-cfd9-4107-b8d6-0fce0a8de548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:36.204628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bb0c1-cfd9-4107-b8d6-0fce0a8de548 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:36.225199 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 388/757] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:36.226626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fba0b3-945c-439a-916b-111de1081702 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:36.239557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fba0b3-945c-439a-916b-111de1081702 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:36.246041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689913f-cf5b-4beb-bd91-da6856edb660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:36.247351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689913f-cf5b-4beb-bd91-da6856edb660 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:36.247791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689913f-cf5b-4beb-bd91-da6856edb660 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:36.248209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689913f-cf5b-4beb-bd91-da6856edb660 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:36.260796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689913f-cf5b-4beb-bd91-da6856edb660 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:36.264643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689913f-cf5b-4beb-bd91-da6856edb660 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:36.282856 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-7689913f-cf5b-4beb-bd91-da6856edb660 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 18 20:32:36.284065 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 370/758] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:32:36 2021] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:36.290507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bb0c1-cfd9-4107-b8d6-0fce0a8de548 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:36.300648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bb0c1-cfd9-4107-b8d6-0fce0a8de548 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:36.305660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f39b7-4a05-4d5a-88bb-4c2dc1561cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:36.306455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f39b7-4a05-4d5a-88bb-4c2dc1561cfc admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:36.306744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f39b7-4a05-4d5a-88bb-4c2dc1561cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:36.307080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f39b7-4a05-4d5a-88bb-4c2dc1561cfc admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:36.307957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f39b7-4a05-4d5a-88bb-4c2dc1561cfc admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:36.308306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f39b7-4a05-4d5a-88bb-4c2dc1561cfc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:36.310298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f39b7-4a05-4d5a-88bb-4c2dc1561cfc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:36.335712 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 389/759] 10.222.0.13 () {56 vars in 1156 bytes} [Sat Dec 18 20:32:36 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:36.338947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689913f-cf5b-4beb-bd91-da6856edb660 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:36.352091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689913f-cf5b-4beb-bd91-da6856edb660 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:36.359356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd8c12-85b3-4ee7-bab7-9471bb121e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:36.360063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd8c12-85b3-4ee7-bab7-9471bb121e79 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:36.360400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd8c12-85b3-4ee7-bab7-9471bb121e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:36.360677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd8c12-85b3-4ee7-bab7-9471bb121e79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:36.374062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd8c12-85b3-4ee7-bab7-9471bb121e79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:36.375857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd8c12-85b3-4ee7-bab7-9471bb121e79 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:36.387068 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 371/760] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:36 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:32:36.393549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f39b7-4a05-4d5a-88bb-4c2dc1561cfc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:36.405603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f39b7-4a05-4d5a-88bb-4c2dc1561cfc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:36.411733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169a0ed-65a2-4bb8-8b23-0f89ba3637af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:36.412535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169a0ed-65a2-4bb8-8b23-0f89ba3637af admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:36.412871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169a0ed-65a2-4bb8-8b23-0f89ba3637af admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:36.413145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169a0ed-65a2-4bb8-8b23-0f89ba3637af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:36.429087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169a0ed-65a2-4bb8-8b23-0f89ba3637af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:36.431070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169a0ed-65a2-4bb8-8b23-0f89ba3637af admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:36.453378 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-a169a0ed-65a2-4bb8-8b23-0f89ba3637af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:36.455840 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 390/761] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:36.461173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd8c12-85b3-4ee7-bab7-9471bb121e79 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:36.470242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd8c12-85b3-4ee7-bab7-9471bb121e79 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:36.474872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185e10d-4e94-4d68-9f74-56c1e8424537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:36.475557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185e10d-4e94-4d68-9f74-56c1e8424537 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:36.475895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185e10d-4e94-4d68-9f74-56c1e8424537 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:36.476176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185e10d-4e94-4d68-9f74-56c1e8424537 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:36.476905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185e10d-4e94-4d68-9f74-56c1e8424537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:36.477209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185e10d-4e94-4d68-9f74-56c1e8424537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:36.478813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185e10d-4e94-4d68-9f74-56c1e8424537 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:36.494437 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 372/762] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:36.498822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169a0ed-65a2-4bb8-8b23-0f89ba3637af admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:36.508857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169a0ed-65a2-4bb8-8b23-0f89ba3637af admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:36.513515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a484d-bc0a-4b3b-b061-2a2d9b1ff50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:36.514382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a484d-bc0a-4b3b-b061-2a2d9b1ff50e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:36.514669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a484d-bc0a-4b3b-b061-2a2d9b1ff50e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:36.515002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a484d-bc0a-4b3b-b061-2a2d9b1ff50e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:36.522059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a484d-bc0a-4b3b-b061-2a2d9b1ff50e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:36.524094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a484d-bc0a-4b3b-b061-2a2d9b1ff50e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:36.543172 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-af2a484d-bc0a-4b3b-b061-2a2d9b1ff50e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:36.547986 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 391/763] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:36.552207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185e10d-4e94-4d68-9f74-56c1e8424537 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:36.571472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185e10d-4e94-4d68-9f74-56c1e8424537 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:36.587834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d91d34-8c22-4414-8684-57a27390bfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:36.588550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d91d34-8c22-4414-8684-57a27390bfc5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:36.588862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d91d34-8c22-4414-8684-57a27390bfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:36.589159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d91d34-8c22-4414-8684-57a27390bfc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:36.590582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d91d34-8c22-4414-8684-57a27390bfc5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:36.590920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d91d34-8c22-4414-8684-57a27390bfc5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:36.592907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d91d34-8c22-4414-8684-57a27390bfc5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:36.613051 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 373/764] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:36.619957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a484d-bc0a-4b3b-b061-2a2d9b1ff50e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:36.632748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a484d-bc0a-4b3b-b061-2a2d9b1ff50e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:36.642849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e02b45-d457-4be0-a405-d50ed09ed686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:36.643561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e02b45-d457-4be0-a405-d50ed09ed686 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:36.643854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e02b45-d457-4be0-a405-d50ed09ed686 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:36.644152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e02b45-d457-4be0-a405-d50ed09ed686 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:36.645048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e02b45-d457-4be0-a405-d50ed09ed686 admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=f5e4bc28d0744b65ab520bf79cea5a45) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:36.645368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e02b45-d457-4be0-a405-d50ed09ed686 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:36.647254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e02b45-d457-4be0-a405-d50ed09ed686 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:36.658956 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 392/765] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:36 2021] GET /identity/v3/role_assignments?user.id=f5e4bc28d0744b65ab520bf79cea5a45&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:36.806676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893ea08-d04f-41ee-9144-ff62bbf3c329 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:36.806930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893ea08-d04f-41ee-9144-ff62bbf3c329 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:36.807222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893ea08-d04f-41ee-9144-ff62bbf3c329 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:36.809985 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 374/766] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:36.816053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31852d-c9ef-4bd6-b75e-04671c2a14c5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:36.816369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31852d-c9ef-4bd6-b75e-04671c2a14c5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:36.816664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31852d-c9ef-4bd6-b75e-04671c2a14c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:36.843690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1d31852d-c9ef-4bd6-b75e-04671c2a14c5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:36.845077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1d31852d-c9ef-4bd6-b75e-04671c2a14c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:36.854092 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 393/767] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:36 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:36.903138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893ea08-d04f-41ee-9144-ff62bbf3c329 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:36.922280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893ea08-d04f-41ee-9144-ff62bbf3c329 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:36.926777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53cb46-395b-47fb-ba0c-32d35c13bdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:36.927793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53cb46-395b-47fb-ba0c-32d35c13bdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:36.928311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53cb46-395b-47fb-ba0c-32d35c13bdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:36.928812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53cb46-395b-47fb-ba0c-32d35c13bdb5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:36.943285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53cb46-395b-47fb-ba0c-32d35c13bdb5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:36.950711 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-4a53cb46-395b-47fb-ba0c-32d35c13bdb5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:32:36.952523 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 375/768] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:32:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:36.958421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31852d-c9ef-4bd6-b75e-04671c2a14c5 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:36.968461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31852d-c9ef-4bd6-b75e-04671c2a14c5 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:36.975526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cce10-014c-40b6-8427-1f11cb517dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:36.976186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cce10-014c-40b6-8427-1f11cb517dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:36.976466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cce10-014c-40b6-8427-1f11cb517dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:36.976740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cce10-014c-40b6-8427-1f11cb517dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:36.977491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cce10-014c-40b6-8427-1f11cb517dc6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:36.977798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cce10-014c-40b6-8427-1f11cb517dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:36.979467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cce10-014c-40b6-8427-1f11cb517dc6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:36.989203 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 394/769] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:36.995132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53cb46-395b-47fb-ba0c-32d35c13bdb5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:37.006766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53cb46-395b-47fb-ba0c-32d35c13bdb5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:37.011543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8d897-cb85-4c02-b5ae-f3123355b010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:37.012554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8d897-cb85-4c02-b5ae-f3123355b010 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:37.012972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8d897-cb85-4c02-b5ae-f3123355b010 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:37.013431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8d897-cb85-4c02-b5ae-f3123355b010 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:37.024705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8d897-cb85-4c02-b5ae-f3123355b010 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:37.026896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8d897-cb85-4c02-b5ae-f3123355b010 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:37.045050 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-eea8d897-cb85-4c02-b5ae-f3123355b010 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:37.047318 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 376/770] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:37.053843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cce10-014c-40b6-8427-1f11cb517dc6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:37.065389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cce10-014c-40b6-8427-1f11cb517dc6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:37.070216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3b68d-4464-4f09-bc23-4b11390b07a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:37.071112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3b68d-4464-4f09-bc23-4b11390b07a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:37.071535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3b68d-4464-4f09-bc23-4b11390b07a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:37.071982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3b68d-4464-4f09-bc23-4b11390b07a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:37.072897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3b68d-4464-4f09-bc23-4b11390b07a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:37.073342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3b68d-4464-4f09-bc23-4b11390b07a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:37.075145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3b68d-4464-4f09-bc23-4b11390b07a0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:37.088068 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 395/771] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:37.094151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8d897-cb85-4c02-b5ae-f3123355b010 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:37.104424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8d897-cb85-4c02-b5ae-f3123355b010 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:37.109828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c224b-90f1-4edc-b48e-3cb1f4da33cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:37.110847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c224b-90f1-4edc-b48e-3cb1f4da33cc admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:37.111307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c224b-90f1-4edc-b48e-3cb1f4da33cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:37.111745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c224b-90f1-4edc-b48e-3cb1f4da33cc admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:37.119979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c224b-90f1-4edc-b48e-3cb1f4da33cc admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:37.122865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c224b-90f1-4edc-b48e-3cb1f4da33cc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:37.138239 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-314c224b-90f1-4edc-b48e-3cb1f4da33cc admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 18 20:32:37.139966 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 377/772] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Dec 18 20:32:37 2021] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:37.146022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3b68d-4464-4f09-bc23-4b11390b07a0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:37.156532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3b68d-4464-4f09-bc23-4b11390b07a0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:37.175849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf366d1-7aab-46ba-a130-1a69b9f8b8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:37.176539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf366d1-7aab-46ba-a130-1a69b9f8b8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:37.176825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf366d1-7aab-46ba-a130-1a69b9f8b8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:37.177103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf366d1-7aab-46ba-a130-1a69b9f8b8a3 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:37.177954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf366d1-7aab-46ba-a130-1a69b9f8b8a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:37.178285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf366d1-7aab-46ba-a130-1a69b9f8b8a3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:37.180124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf366d1-7aab-46ba-a130-1a69b9f8b8a3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:37.213958 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 396/773] 10.222.0.13 () {56 vars in 1154 bytes} [Sat Dec 18 20:32:37 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:37.219893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c224b-90f1-4edc-b48e-3cb1f4da33cc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:37.231397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c224b-90f1-4edc-b48e-3cb1f4da33cc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:37.243676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68261fe-5321-46a4-844a-1e0791025634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:37.244575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68261fe-5321-46a4-844a-1e0791025634 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:37.245003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68261fe-5321-46a4-844a-1e0791025634 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:37.245416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68261fe-5321-46a4-844a-1e0791025634 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:37.257073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68261fe-5321-46a4-844a-1e0791025634 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:37.259077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68261fe-5321-46a4-844a-1e0791025634 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:37.272512 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 378/774] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:37 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:32:37.279231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf366d1-7aab-46ba-a130-1a69b9f8b8a3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:37.300638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf366d1-7aab-46ba-a130-1a69b9f8b8a3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:37.314878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c0923-35aa-4a52-ad12-d65f4d2619cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:37.315736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c0923-35aa-4a52-ad12-d65f4d2619cb admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:37.315965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c0923-35aa-4a52-ad12-d65f4d2619cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:37.316243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c0923-35aa-4a52-ad12-d65f4d2619cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:37.329864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c0923-35aa-4a52-ad12-d65f4d2619cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:37.331720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c0923-35aa-4a52-ad12-d65f4d2619cb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:37.360223 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-ff3c0923-35aa-4a52-ad12-d65f4d2619cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:37.361695 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 397/775] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:37.367745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68261fe-5321-46a4-844a-1e0791025634 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:37.382125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68261fe-5321-46a4-844a-1e0791025634 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:37.394678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73502a-9ed0-42ae-9998-de1eead20a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:37.395621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73502a-9ed0-42ae-9998-de1eead20a95 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:37.396063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73502a-9ed0-42ae-9998-de1eead20a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:37.396475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73502a-9ed0-42ae-9998-de1eead20a95 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:37.397359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73502a-9ed0-42ae-9998-de1eead20a95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:37.397822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73502a-9ed0-42ae-9998-de1eead20a95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:37.399567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73502a-9ed0-42ae-9998-de1eead20a95 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:37.416370 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 379/776] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:37.422376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c0923-35aa-4a52-ad12-d65f4d2619cb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:37.440933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c0923-35aa-4a52-ad12-d65f4d2619cb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:37.455747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da71b6-7b54-45c9-8e2f-cc6dad95c066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:37.456612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da71b6-7b54-45c9-8e2f-cc6dad95c066 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:37.456905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da71b6-7b54-45c9-8e2f-cc6dad95c066 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:37.457180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da71b6-7b54-45c9-8e2f-cc6dad95c066 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:37.475692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da71b6-7b54-45c9-8e2f-cc6dad95c066 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:37.477671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da71b6-7b54-45c9-8e2f-cc6dad95c066 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:37.498354 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-e2da71b6-7b54-45c9-8e2f-cc6dad95c066 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:37.499703 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 398/777] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:37.505942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73502a-9ed0-42ae-9998-de1eead20a95 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:37.517039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73502a-9ed0-42ae-9998-de1eead20a95 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:37.534990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35149d-620b-496b-9fe5-07d2751be3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:37.535720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35149d-620b-496b-9fe5-07d2751be3be admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:37.536012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35149d-620b-496b-9fe5-07d2751be3be admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:37.536328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35149d-620b-496b-9fe5-07d2751be3be admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:37.537229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35149d-620b-496b-9fe5-07d2751be3be admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:37.537564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35149d-620b-496b-9fe5-07d2751be3be admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:37.539643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35149d-620b-496b-9fe5-07d2751be3be admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:37.569913 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 380/778] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:37.578323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da71b6-7b54-45c9-8e2f-cc6dad95c066 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:37.595269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da71b6-7b54-45c9-8e2f-cc6dad95c066 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:37.602438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a3e0b-8ef2-40d0-813c-5cd7f5471f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:37.603084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a3e0b-8ef2-40d0-813c-5cd7f5471f0b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:37.603368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a3e0b-8ef2-40d0-813c-5cd7f5471f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:37.603642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a3e0b-8ef2-40d0-813c-5cd7f5471f0b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:37.604487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a3e0b-8ef2-40d0-813c-5cd7f5471f0b admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=a180acaefee3489788068c927fbe403c) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:37.604799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a3e0b-8ef2-40d0-813c-5cd7f5471f0b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:37.607239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a3e0b-8ef2-40d0-813c-5cd7f5471f0b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:37.619629 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 399/779] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:37 2021] GET /identity/v3/role_assignments?user.id=a180acaefee3489788068c927fbe403c&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:37.965161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25747c-332c-4982-ad41-4c6ce0ab1921 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:37.965869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25747c-332c-4982-ad41-4c6ce0ab1921 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:37.966385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25747c-332c-4982-ad41-4c6ce0ab1921 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:37.968347 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 381/780] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:37.974882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec002e-b838-416a-9785-75bb67172554 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:37.975182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec002e-b838-416a-9785-75bb67172554 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:37.975462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec002e-b838-416a-9785-75bb67172554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:37.997273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-41ec002e-b838-416a-9785-75bb67172554 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:37.998488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-41ec002e-b838-416a-9785-75bb67172554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:38.009264 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 400/781] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:37 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:38.034505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25747c-332c-4982-ad41-4c6ce0ab1921 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:38.048160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25747c-332c-4982-ad41-4c6ce0ab1921 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:38.053321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3159cf-96c1-4708-b133-8cefcdb35fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:38.055078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3159cf-96c1-4708-b133-8cefcdb35fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.055580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3159cf-96c1-4708-b133-8cefcdb35fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.056099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3159cf-96c1-4708-b133-8cefcdb35fa1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.068501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3159cf-96c1-4708-b133-8cefcdb35fa1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:38.075817 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-8b3159cf-96c1-4708-b133-8cefcdb35fa1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:38.077563 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 382/782] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:38.084021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec002e-b838-416a-9785-75bb67172554 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:38.099297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec002e-b838-416a-9785-75bb67172554 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:38.106366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c36ed-2b61-4fc0-977c-67d7bfd11691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:38.107042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c36ed-2b61-4fc0-977c-67d7bfd11691 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.107325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c36ed-2b61-4fc0-977c-67d7bfd11691 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.107603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c36ed-2b61-4fc0-977c-67d7bfd11691 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.108365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c36ed-2b61-4fc0-977c-67d7bfd11691 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:38.108675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c36ed-2b61-4fc0-977c-67d7bfd11691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:38.110290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c36ed-2b61-4fc0-977c-67d7bfd11691 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:38.119228 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 401/783] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:38.125581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3159cf-96c1-4708-b133-8cefcdb35fa1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:38.135854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3159cf-96c1-4708-b133-8cefcdb35fa1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:38.147153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f91f5-ef6a-4f0f-a390-b8d91e9ecfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:38.148102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f91f5-ef6a-4f0f-a390-b8d91e9ecfde admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.148485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f91f5-ef6a-4f0f-a390-b8d91e9ecfde admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.148915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f91f5-ef6a-4f0f-a390-b8d91e9ecfde admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.164691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f91f5-ef6a-4f0f-a390-b8d91e9ecfde admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:38.166584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f91f5-ef6a-4f0f-a390-b8d91e9ecfde admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:38.190779 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-9c6f91f5-ef6a-4f0f-a390-b8d91e9ecfde admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:38.192310 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 383/784] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:38.198095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c36ed-2b61-4fc0-977c-67d7bfd11691 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:38.212403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c36ed-2b61-4fc0-977c-67d7bfd11691 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:38.228060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39e6df-3503-4977-84d5-108749a6ca81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:38.228958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39e6df-3503-4977-84d5-108749a6ca81 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.229385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39e6df-3503-4977-84d5-108749a6ca81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.229800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39e6df-3503-4977-84d5-108749a6ca81 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.230806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39e6df-3503-4977-84d5-108749a6ca81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:38.231380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39e6df-3503-4977-84d5-108749a6ca81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:38.233307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39e6df-3503-4977-84d5-108749a6ca81 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:38.251475 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 402/785] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:38.257627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f91f5-ef6a-4f0f-a390-b8d91e9ecfde admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:38.271470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f91f5-ef6a-4f0f-a390-b8d91e9ecfde admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:38.286922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03e8ef-4381-4317-99ed-64698a4fc8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:38.287743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03e8ef-4381-4317-99ed-64698a4fc8ce admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.288029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03e8ef-4381-4317-99ed-64698a4fc8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.288304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03e8ef-4381-4317-99ed-64698a4fc8ce admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.299404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03e8ef-4381-4317-99ed-64698a4fc8ce admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:38.301414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03e8ef-4381-4317-99ed-64698a4fc8ce admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:38.304707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f3a82-db29-4b3f-816e-38139e0cc9f9 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.305152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f3a82-db29-4b3f-816e-38139e0cc9f9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.305269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f3a82-db29-4b3f-816e-38139e0cc9f9 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.308902 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 403/786] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:38.313775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafe52c-2e13-432d-b259-17f52e1911ea None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.314064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafe52c-2e13-432d-b259-17f52e1911ea None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.314392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafe52c-2e13-432d-b259-17f52e1911ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.322174 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-9a03e8ef-4381-4317-99ed-64698a4fc8ce admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 18 20:32:38.330672 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 384/787] 10.222.0.13 () {56 vars in 1138 bytes} [Sat Dec 18 20:32:38 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:38.333357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-aaafe52c-2e13-432d-b259-17f52e1911ea None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:38.334798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-aaafe52c-2e13-432d-b259-17f52e1911ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:38.336833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03e8ef-4381-4317-99ed-64698a4fc8ce admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:38.350374 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 404/788] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:38 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:32:38.360838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03e8ef-4381-4317-99ed-64698a4fc8ce admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:38.366684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aacc17-4c76-418a-9087-12f5fb955ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:38.367606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aacc17-4c76-418a-9087-12f5fb955ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.368048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aacc17-4c76-418a-9087-12f5fb955ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.368515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aacc17-4c76-418a-9087-12f5fb955ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.369499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aacc17-4c76-418a-9087-12f5fb955ce4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:38.370007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aacc17-4c76-418a-9087-12f5fb955ce4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:38.372748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aacc17-4c76-418a-9087-12f5fb955ce4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:38.397920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafe52c-2e13-432d-b259-17f52e1911ea None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:38.407192 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 385/789] 10.222.0.13 () {56 vars in 1170 bytes} [Sat Dec 18 20:32:38 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:38.410077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafe52c-2e13-432d-b259-17f52e1911ea None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:38.413968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aacc17-4c76-418a-9087-12f5fb955ce4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:38.420881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162cc9f-4071-4f29-9545-38474d10bd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:38.422072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162cc9f-4071-4f29-9545-38474d10bd44 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.422549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162cc9f-4071-4f29-9545-38474d10bd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.422971 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162cc9f-4071-4f29-9545-38474d10bd44 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.423818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162cc9f-4071-4f29-9545-38474d10bd44 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:38.427498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162cc9f-4071-4f29-9545-38474d10bd44 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:38.436268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aacc17-4c76-418a-9087-12f5fb955ce4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:38.447262 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-4162cc9f-4071-4f29-9545-38474d10bd44 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 18 20:32:38.451141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7866444-9347-4e94-a8c3-9e9d950cb565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:38.452198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7866444-9347-4e94-a8c3-9e9d950cb565 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.452617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7866444-9347-4e94-a8c3-9e9d950cb565 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.453030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7866444-9347-4e94-a8c3-9e9d950cb565 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.455022 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 405/790] 10.222.0.13 () {56 vars in 1150 bytes} [Sat Dec 18 20:32:38 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:32:38.463384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162cc9f-4071-4f29-9545-38474d10bd44 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:38.477140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7866444-9347-4e94-a8c3-9e9d950cb565 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:38.479626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7866444-9347-4e94-a8c3-9e9d950cb565 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:38.482609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162cc9f-4071-4f29-9545-38474d10bd44 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:38.492235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2584d5-fba3-483f-afa1-13aaf9312d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:38.492931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2584d5-fba3-483f-afa1-13aaf9312d54 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.493225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2584d5-fba3-483f-afa1-13aaf9312d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.493506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2584d5-fba3-483f-afa1-13aaf9312d54 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.496433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2584d5-fba3-483f-afa1-13aaf9312d54 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:38.497329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2584d5-fba3-483f-afa1-13aaf9312d54 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:38.499285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2584d5-fba3-483f-afa1-13aaf9312d54 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:38.511423 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-c7866444-9347-4e94-a8c3-9e9d950cb565 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:38.513050 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 386/791] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:38.516012 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 406/792] 10.222.0.13 () {56 vars in 1145 bytes} [Sat Dec 18 20:32:38 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:38.523606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7866444-9347-4e94-a8c3-9e9d950cb565 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:38.527558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2584d5-fba3-483f-afa1-13aaf9312d54 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:38.533482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7866444-9347-4e94-a8c3-9e9d950cb565 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:38.538696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255429d-2613-4a50-83f6-3b7daaf36b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:38.539483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255429d-2613-4a50-83f6-3b7daaf36b4d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.539772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255429d-2613-4a50-83f6-3b7daaf36b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.540049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255429d-2613-4a50-83f6-3b7daaf36b4d admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.540765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255429d-2613-4a50-83f6-3b7daaf36b4d admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:38.541067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255429d-2613-4a50-83f6-3b7daaf36b4d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:38.543388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255429d-2613-4a50-83f6-3b7daaf36b4d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:38.545114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2584d5-fba3-483f-afa1-13aaf9312d54 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:38.548799 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 387/793] 10.222.0.13 () {56 vars in 1145 bytes} [Sat Dec 18 20:32:38 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:38.554909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255429d-2613-4a50-83f6-3b7daaf36b4d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:38.558899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72c40e-7bd6-4f56-a286-89afcae68fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:38.559570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72c40e-7bd6-4f56-a286-89afcae68fea admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.559858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72c40e-7bd6-4f56-a286-89afcae68fea admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.560135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72c40e-7bd6-4f56-a286-89afcae68fea admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.561126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72c40e-7bd6-4f56-a286-89afcae68fea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:38.561436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72c40e-7bd6-4f56-a286-89afcae68fea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:38.563050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72c40e-7bd6-4f56-a286-89afcae68fea admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:38.565188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255429d-2613-4a50-83f6-3b7daaf36b4d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:38.574499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641ca61-57ef-4ed9-b15a-693612b469e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:38.575486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641ca61-57ef-4ed9-b15a-693612b469e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.575768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641ca61-57ef-4ed9-b15a-693612b469e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.577440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641ca61-57ef-4ed9-b15a-693612b469e0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.580034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641ca61-57ef-4ed9-b15a-693612b469e0 admin admin] RBAC: Adding query filter params (interface=public, service_id=c25d208dd7824830b02549c887917f90, region_id=RegionOne) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:38.580395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641ca61-57ef-4ed9-b15a-693612b469e0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:38.582226 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-0641ca61-57ef-4ed9-b15a-693612b469e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:32:38.582226 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:32:38.582226 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:32:38.584756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641ca61-57ef-4ed9-b15a-693612b469e0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:38.588067 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 407/794] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:38.598669 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 388/795] 10.222.0.13 () {56 vars in 1272 bytes} [Sat Dec 18 20:32:38 2021] GET /identity/v3/endpoints?service_id=c25d208dd7824830b02549c887917f90&interface=public®ion_id=RegionOne => generated 194 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:38.603530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72c40e-7bd6-4f56-a286-89afcae68fea admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:38.613901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72c40e-7bd6-4f56-a286-89afcae68fea admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:38.617740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641ca61-57ef-4ed9-b15a-693612b469e0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:38.630702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a564bff-3361-4420-87d1-e94f3e93aca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:38.632224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564bff-3361-4420-87d1-e94f3e93aca7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.632567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641ca61-57ef-4ed9-b15a-693612b469e0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:38.633199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564bff-3361-4420-87d1-e94f3e93aca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.633493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564bff-3361-4420-87d1-e94f3e93aca7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.643156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd367e-67f5-4227-83b6-8b0d2e306d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:38.644047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd367e-67f5-4227-83b6-8b0d2e306d7e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.644335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd367e-67f5-4227-83b6-8b0d2e306d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.644607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd367e-67f5-4227-83b6-8b0d2e306d7e admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.645358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd367e-67f5-4227-83b6-8b0d2e306d7e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:38.647202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd367e-67f5-4227-83b6-8b0d2e306d7e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:38.647388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a564bff-3361-4420-87d1-e94f3e93aca7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:38.649247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a564bff-3361-4420-87d1-e94f3e93aca7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:38.653263 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 389/796] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Dec 18 20:32:38 2021] GET /identity/v3/services => generated 772 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:38.674163 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-6a564bff-3361-4420-87d1-e94f3e93aca7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:38.675889 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 408/797] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:38.681808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd367e-67f5-4227-83b6-8b0d2e306d7e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:38.694501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd367e-67f5-4227-83b6-8b0d2e306d7e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:38.702948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4b615-25d1-4433-a70f-f7fe6ab7bc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:38.703604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4b615-25d1-4433-a70f-f7fe6ab7bc04 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.703883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4b615-25d1-4433-a70f-f7fe6ab7bc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.704159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4b615-25d1-4433-a70f-f7fe6ab7bc04 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.705010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4b615-25d1-4433-a70f-f7fe6ab7bc04 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:38.705315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4b615-25d1-4433-a70f-f7fe6ab7bc04 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:38.707373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4b615-25d1-4433-a70f-f7fe6ab7bc04 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:38.730785 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 390/798] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:38.733601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a564bff-3361-4420-87d1-e94f3e93aca7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:38.754428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a564bff-3361-4420-87d1-e94f3e93aca7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:38.772841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcadbc6-a889-4a25-a117-b8f6f67c36f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:38.773774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcadbc6-a889-4a25-a117-b8f6f67c36f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.774064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcadbc6-a889-4a25-a117-b8f6f67c36f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.774386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcadbc6-a889-4a25-a117-b8f6f67c36f5 admin admin] PATH_INFO: `/v3/projects/0dd4d15f423642fa8da604b758048203/users/1157bb6f43474dfa96d91a444d850b67/roles/0071fc3d75b34850b7fb01a06a0279c5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.804684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcadbc6-a889-4a25-a117-b8f6f67c36f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd4d15f423642fa8da604b758048203, user_id=1157bb6f43474dfa96d91a444d850b67, role_id=0071fc3d75b34850b7fb01a06a0279c5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:38.807406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcadbc6-a889-4a25-a117-b8f6f67c36f5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:38.837138 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 409/799] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:32:38 2021] PUT /identity/v3/projects/0dd4d15f423642fa8da604b758048203/users/1157bb6f43474dfa96d91a444d850b67/roles/0071fc3d75b34850b7fb01a06a0279c5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:32:38.874556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefec39-0f43-4911-a8b8-226f26f9ca85 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.874891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefec39-0f43-4911-a8b8-226f26f9ca85 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.875090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefec39-0f43-4911-a8b8-226f26f9ca85 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.876983 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 391/800] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:38.883454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d74962-c5f7-4b68-829f-8bd06758c8bc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:38.883795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d74962-c5f7-4b68-829f-8bd06758c8bc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:38.884006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d74962-c5f7-4b68-829f-8bd06758c8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:38.907751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-47d74962-c5f7-4b68-829f-8bd06758c8bc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:38.908974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-47d74962-c5f7-4b68-829f-8bd06758c8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:39.001268 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 410/801] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:38 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:39.026725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefec39-0f43-4911-a8b8-226f26f9ca85 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:39.043653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefec39-0f43-4911-a8b8-226f26f9ca85 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:39.048106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9215996-da39-440f-bba8-81992572efdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:39.048908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9215996-da39-440f-bba8-81992572efdf admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:39.049454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9215996-da39-440f-bba8-81992572efdf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:39.049454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9215996-da39-440f-bba8-81992572efdf admin admin] PATH_INFO: `/v3/services/network` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:39.050101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9215996-da39-440f-bba8-81992572efdf admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:39.051739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9215996-da39-440f-bba8-81992572efdf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:39.064933 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-e9215996-da39-440f-bba8-81992572efdf admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 18 20:32:39.066546 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 392/802] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:39 2021] GET /identity/v3/services/network => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:39.072774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d74962-c5f7-4b68-829f-8bd06758c8bc None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:39.082756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d74962-c5f7-4b68-829f-8bd06758c8bc None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:39.087388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028e02b-94b6-4585-88aa-e43ff8fb07c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:39.088071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028e02b-94b6-4585-88aa-e43ff8fb07c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:39.088351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028e02b-94b6-4585-88aa-e43ff8fb07c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:39.088624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028e02b-94b6-4585-88aa-e43ff8fb07c3 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:39.089408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028e02b-94b6-4585-88aa-e43ff8fb07c3 admin admin] RBAC: Adding query filter params (name=network) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:39.089715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028e02b-94b6-4585-88aa-e43ff8fb07c3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:39.091378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028e02b-94b6-4585-88aa-e43ff8fb07c3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:39.096917 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 411/803] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Dec 18 20:32:39 2021] GET /identity/v3/services?name=network => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:39.102833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9215996-da39-440f-bba8-81992572efdf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:39.113291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9215996-da39-440f-bba8-81992572efdf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:39.118005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaa364-faf6-4f96-942d-aefb5a2e2313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:39.118774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaa364-faf6-4f96-942d-aefb5a2e2313 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:39.119053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaa364-faf6-4f96-942d-aefb5a2e2313 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:39.119385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaa364-faf6-4f96-942d-aefb5a2e2313 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:39.120116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfaa364-faf6-4f96-942d-aefb5a2e2313 admin admin] RBAC: Adding query filter params (type=network) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:39.120980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfaa364-faf6-4f96-942d-aefb5a2e2313 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:39.122686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfaa364-faf6-4f96-942d-aefb5a2e2313 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:39.128812 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 393/804] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Dec 18 20:32:39 2021] GET /identity/v3/services?type=network => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:39.134668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028e02b-94b6-4585-88aa-e43ff8fb07c3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:39.145555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028e02b-94b6-4585-88aa-e43ff8fb07c3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:39.149999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cd81e-1a99-4b1c-b89e-343b86c79fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:39.150740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cd81e-1a99-4b1c-b89e-343b86c79fad admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:39.151074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cd81e-1a99-4b1c-b89e-343b86c79fad admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:39.151348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cd81e-1a99-4b1c-b89e-343b86c79fad admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:39.152380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902cd81e-1a99-4b1c-b89e-343b86c79fad admin admin] RBAC: Adding query filter params (interface=public, service_id=d5bdc49cb57e48da9bc27b39a073bd09, region_id=RegionOne) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:39.152689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902cd81e-1a99-4b1c-b89e-343b86c79fad admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:39.153739 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-902cd81e-1a99-4b1c-b89e-343b86c79fad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:32:39.153739 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:32:39.153739 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:32:39.154674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902cd81e-1a99-4b1c-b89e-343b86c79fad admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:39.163101 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 412/805] 10.222.0.13 () {56 vars in 1272 bytes} [Sat Dec 18 20:32:39 2021] GET /identity/v3/endpoints?service_id=d5bdc49cb57e48da9bc27b39a073bd09&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:39.170944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaa364-faf6-4f96-942d-aefb5a2e2313 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:39.181017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaa364-faf6-4f96-942d-aefb5a2e2313 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:39.186568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149f4ef-511a-4d65-be69-a81c2b8961e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:39.187433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149f4ef-511a-4d65-be69-a81c2b8961e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:39.187775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149f4ef-511a-4d65-be69-a81c2b8961e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:39.188180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149f4ef-511a-4d65-be69-a81c2b8961e2 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:39.188930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149f4ef-511a-4d65-be69-a81c2b8961e2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:39.190749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149f4ef-511a-4d65-be69-a81c2b8961e2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:39.197233 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 394/806] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Dec 18 20:32:39 2021] GET /identity/v3/services => generated 772 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:39.685144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1a6cc-c784-4a41-b1b7-09e1f84c4e12 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:39.685795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1a6cc-c784-4a41-b1b7-09e1f84c4e12 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:39.685795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1a6cc-c784-4a41-b1b7-09e1f84c4e12 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:39.688002 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 413/807] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:39.693830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4746c0-50c7-4b50-b061-09d803573964 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:39.694118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4746c0-50c7-4b50-b061-09d803573964 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:39.694430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4746c0-50c7-4b50-b061-09d803573964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:39.722007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1f4746c0-50c7-4b50-b061-09d803573964 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:39.723273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1f4746c0-50c7-4b50-b061-09d803573964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:39.744001 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 395/808] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:39 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:39.787296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1a6cc-c784-4a41-b1b7-09e1f84c4e12 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:39.804797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1a6cc-c784-4a41-b1b7-09e1f84c4e12 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:39.812649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1647e77-1efc-4ccd-91e1-f42cda77a99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:39.813448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1647e77-1efc-4ccd-91e1-f42cda77a99d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:39.813733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1647e77-1efc-4ccd-91e1-f42cda77a99d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:39.814012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1647e77-1efc-4ccd-91e1-f42cda77a99d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:39.831658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1647e77-1efc-4ccd-91e1-f42cda77a99d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:39.837667 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-f1647e77-1efc-4ccd-91e1-f42cda77a99d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:32:39.839893 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 414/809] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:32:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:39.846027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4746c0-50c7-4b50-b061-09d803573964 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:39.859738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4746c0-50c7-4b50-b061-09d803573964 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:39.870325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05440911-78e2-4adb-968a-8ce5cf62bf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:39.871083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05440911-78e2-4adb-968a-8ce5cf62bf85 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:39.871370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05440911-78e2-4adb-968a-8ce5cf62bf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:39.871647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05440911-78e2-4adb-968a-8ce5cf62bf85 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:39.872410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05440911-78e2-4adb-968a-8ce5cf62bf85 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:39.872714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05440911-78e2-4adb-968a-8ce5cf62bf85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:39.874339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05440911-78e2-4adb-968a-8ce5cf62bf85 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:39.889727 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 396/810] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:39.895863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1647e77-1efc-4ccd-91e1-f42cda77a99d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:39.910635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1647e77-1efc-4ccd-91e1-f42cda77a99d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:39.922839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb21577-6a0b-4c0a-ac36-5cd4f056e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:39.923902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb21577-6a0b-4c0a-ac36-5cd4f056e2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:39.924405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb21577-6a0b-4c0a-ac36-5cd4f056e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:39.924879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb21577-6a0b-4c0a-ac36-5cd4f056e2c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:39.939688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb21577-6a0b-4c0a-ac36-5cd4f056e2c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:39.941824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb21577-6a0b-4c0a-ac36-5cd4f056e2c1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:39.970277 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-5fb21577-6a0b-4c0a-ac36-5cd4f056e2c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:39.970277 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 415/811] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:39.973712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05440911-78e2-4adb-968a-8ce5cf62bf85 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:39.991187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05440911-78e2-4adb-968a-8ce5cf62bf85 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:40.003775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ecdd6-8f23-4bde-86a7-23218dcc014c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:40.004435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ecdd6-8f23-4bde-86a7-23218dcc014c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:40.004718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ecdd6-8f23-4bde-86a7-23218dcc014c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:40.004994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ecdd6-8f23-4bde-86a7-23218dcc014c admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:40.005726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ecdd6-8f23-4bde-86a7-23218dcc014c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:40.006033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ecdd6-8f23-4bde-86a7-23218dcc014c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:40.007661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ecdd6-8f23-4bde-86a7-23218dcc014c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:40.028090 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 397/812] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:40.034233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb21577-6a0b-4c0a-ac36-5cd4f056e2c1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:40.047166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb21577-6a0b-4c0a-ac36-5cd4f056e2c1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:40.053713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd432344-8906-4a53-91fa-ebf399b169ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:40.054611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432344-8906-4a53-91fa-ebf399b169ce admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:40.054896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432344-8906-4a53-91fa-ebf399b169ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:40.055170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432344-8906-4a53-91fa-ebf399b169ce admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:40.068626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd432344-8906-4a53-91fa-ebf399b169ce admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:40.070704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd432344-8906-4a53-91fa-ebf399b169ce admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:40.091515 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-dd432344-8906-4a53-91fa-ebf399b169ce admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 18 20:32:40.091984 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 416/813] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:32:40 2021] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:40.097984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ecdd6-8f23-4bde-86a7-23218dcc014c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:40.115216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ecdd6-8f23-4bde-86a7-23218dcc014c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:40.127441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8559b35-e74b-4eb9-ab5e-48d3a2a6d8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:40.128100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8559b35-e74b-4eb9-ab5e-48d3a2a6d8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:40.128379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8559b35-e74b-4eb9-ab5e-48d3a2a6d8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:40.128655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8559b35-e74b-4eb9-ab5e-48d3a2a6d8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:40.129502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8559b35-e74b-4eb9-ab5e-48d3a2a6d8a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:40.129809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8559b35-e74b-4eb9-ab5e-48d3a2a6d8a9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:40.131694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8559b35-e74b-4eb9-ab5e-48d3a2a6d8a9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:40.150902 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 398/814] 10.222.0.13 () {56 vars in 1156 bytes} [Sat Dec 18 20:32:40 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:40.156761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd432344-8906-4a53-91fa-ebf399b169ce admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:40.171754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd432344-8906-4a53-91fa-ebf399b169ce admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:40.176223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a1d14-16f2-4f2e-97af-c779603ca7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:40.177007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a1d14-16f2-4f2e-97af-c779603ca7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:40.177285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a1d14-16f2-4f2e-97af-c779603ca7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:40.177555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a1d14-16f2-4f2e-97af-c779603ca7a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:40.191951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a1d14-16f2-4f2e-97af-c779603ca7a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:40.193703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a1d14-16f2-4f2e-97af-c779603ca7a9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:40.214278 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-137a1d14-16f2-4f2e-97af-c779603ca7a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:40.215905 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 417/815] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:40.222026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8559b35-e74b-4eb9-ab5e-48d3a2a6d8a9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:40.232682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8559b35-e74b-4eb9-ab5e-48d3a2a6d8a9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:40.241744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea391d-0464-41e1-a8ce-9ee0eaa7d443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:40.242429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea391d-0464-41e1-a8ce-9ee0eaa7d443 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:40.242714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea391d-0464-41e1-a8ce-9ee0eaa7d443 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:40.242990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea391d-0464-41e1-a8ce-9ee0eaa7d443 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:40.243720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea391d-0464-41e1-a8ce-9ee0eaa7d443 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:40.244021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea391d-0464-41e1-a8ce-9ee0eaa7d443 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:40.245706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea391d-0464-41e1-a8ce-9ee0eaa7d443 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:40.262010 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 399/816] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:40.268235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a1d14-16f2-4f2e-97af-c779603ca7a9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:40.283129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a1d14-16f2-4f2e-97af-c779603ca7a9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:40.287566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc736295-7d50-4214-948f-7480b7f4edac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:40.288353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc736295-7d50-4214-948f-7480b7f4edac admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:40.288637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc736295-7d50-4214-948f-7480b7f4edac admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:40.288909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc736295-7d50-4214-948f-7480b7f4edac admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:40.299583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc736295-7d50-4214-948f-7480b7f4edac admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:40.301589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc736295-7d50-4214-948f-7480b7f4edac admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:40.317584 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-fc736295-7d50-4214-948f-7480b7f4edac admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:40.318958 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 418/817] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:32:40.325481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea391d-0464-41e1-a8ce-9ee0eaa7d443 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:40.339838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea391d-0464-41e1-a8ce-9ee0eaa7d443 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:40.344310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136082b-fc79-4701-807a-f02a8398a690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:40.344960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136082b-fc79-4701-807a-f02a8398a690 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:40.345240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136082b-fc79-4701-807a-f02a8398a690 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:40.345517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136082b-fc79-4701-807a-f02a8398a690 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:40.346339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136082b-fc79-4701-807a-f02a8398a690 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:40.346643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136082b-fc79-4701-807a-f02a8398a690 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:40.348484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136082b-fc79-4701-807a-f02a8398a690 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:40.364983 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 400/818] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:40.371829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc736295-7d50-4214-948f-7480b7f4edac admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:40.383785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc736295-7d50-4214-948f-7480b7f4edac admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:40.388864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a9f9b-75fe-494a-b700-6d075b165752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:40.389740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a9f9b-75fe-494a-b700-6d075b165752 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:40.390020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a9f9b-75fe-494a-b700-6d075b165752 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:40.390318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a9f9b-75fe-494a-b700-6d075b165752 admin admin] PATH_INFO: `/v3/projects/0dd4d15f423642fa8da604b758048203/users/f5e4bc28d0744b65ab520bf79cea5a45/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:40.392275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a9f9b-75fe-494a-b700-6d075b165752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd4d15f423642fa8da604b758048203, user_id=f5e4bc28d0744b65ab520bf79cea5a45, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:40.394923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a9f9b-75fe-494a-b700-6d075b165752 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:40.425518 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 419/819] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:32:40 2021] PUT /identity/v3/projects/0dd4d15f423642fa8da604b758048203/users/f5e4bc28d0744b65ab520bf79cea5a45/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:32:40.932914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e8f33-e8e5-4863-a994-8b91d2c4c534 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:40.933287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e8f33-e8e5-4863-a994-8b91d2c4c534 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:40.933495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e8f33-e8e5-4863-a994-8b91d2c4c534 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:40.935487 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 401/820] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:40.941718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad04ae-3f86-4249-88cc-9aa375889956 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:40.942236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad04ae-3f86-4249-88cc-9aa375889956 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:40.942415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad04ae-3f86-4249-88cc-9aa375889956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:40.968187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3cad04ae-3f86-4249-88cc-9aa375889956 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:40.968482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3cad04ae-3f86-4249-88cc-9aa375889956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:41.051895 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 420/821] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:40 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:41.098069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e8f33-e8e5-4863-a994-8b91d2c4c534 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:41.116971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e8f33-e8e5-4863-a994-8b91d2c4c534 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:41.122116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a4bad-743b-45c8-acc6-45972909806c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:41.122950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a4bad-743b-45c8-acc6-45972909806c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:41.123232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a4bad-743b-45c8-acc6-45972909806c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:41.123510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a4bad-743b-45c8-acc6-45972909806c admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:41.124175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a4bad-743b-45c8-acc6-45972909806c admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:41.125768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a4bad-743b-45c8-acc6-45972909806c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:41.137410 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-a57a4bad-743b-45c8-acc6-45972909806c admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 18 20:32:41.138883 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 402/822] 10.222.0.13 () {56 vars in 1153 bytes} [Sat Dec 18 20:32:41 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:41.145269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad04ae-3f86-4249-88cc-9aa375889956 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:41.159253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad04ae-3f86-4249-88cc-9aa375889956 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:41.170868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839805d1-1a57-46f3-a886-244aecb927a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:41.171538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839805d1-1a57-46f3-a886-244aecb927a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:41.171815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839805d1-1a57-46f3-a886-244aecb927a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:41.172090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839805d1-1a57-46f3-a886-244aecb927a5 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:41.172811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839805d1-1a57-46f3-a886-244aecb927a5 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:41.173117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839805d1-1a57-46f3-a886-244aecb927a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:41.174731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839805d1-1a57-46f3-a886-244aecb927a5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:41.179823 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 421/823] 10.222.0.13 () {56 vars in 1147 bytes} [Sat Dec 18 20:32:41 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:41.186566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a4bad-743b-45c8-acc6-45972909806c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:41.199299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a4bad-743b-45c8-acc6-45972909806c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:41.206870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09be81-f0b2-4e1c-a5c0-63e0e82cb0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:41.207799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09be81-f0b2-4e1c-a5c0-63e0e82cb0bb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:41.208286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09be81-f0b2-4e1c-a5c0-63e0e82cb0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:41.208812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09be81-f0b2-4e1c-a5c0-63e0e82cb0bb admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:41.209725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09be81-f0b2-4e1c-a5c0-63e0e82cb0bb admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:41.210325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09be81-f0b2-4e1c-a5c0-63e0e82cb0bb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:41.212186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09be81-f0b2-4e1c-a5c0-63e0e82cb0bb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:41.221893 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 403/824] 10.222.0.13 () {56 vars in 1147 bytes} [Sat Dec 18 20:32:41 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:41.883408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc047398-fc0e-49a9-ac83-501beebd70ae None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:41.884113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc047398-fc0e-49a9-ac83-501beebd70ae None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:41.884622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc047398-fc0e-49a9-ac83-501beebd70ae None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:41.887473 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 422/825] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:41.893523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d6707-36ff-46a5-a76b-65d3f53d4f1a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:41.893813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d6707-36ff-46a5-a76b-65d3f53d4f1a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:41.894094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d6707-36ff-46a5-a76b-65d3f53d4f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:41.922440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7d6d6707-36ff-46a5-a76b-65d3f53d4f1a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:41.923824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7d6d6707-36ff-46a5-a76b-65d3f53d4f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:41.938081 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 404/826] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:41 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:41.987813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc047398-fc0e-49a9-ac83-501beebd70ae None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.007814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc047398-fc0e-49a9-ac83-501beebd70ae None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.012395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112818c-a862-4451-b0b3-addc805ff193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.013191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112818c-a862-4451-b0b3-addc805ff193 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.013479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112818c-a862-4451-b0b3-addc805ff193 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.013752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112818c-a862-4451-b0b3-addc805ff193 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.014518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112818c-a862-4451-b0b3-addc805ff193 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.016089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112818c-a862-4451-b0b3-addc805ff193 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.029982 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-4112818c-a862-4451-b0b3-addc805ff193 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 18 20:32:42.031445 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 423/827] 10.222.0.13 () {56 vars in 1150 bytes} [Sat Dec 18 20:32:41 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:42.037833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d6707-36ff-46a5-a76b-65d3f53d4f1a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.047511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d6707-36ff-46a5-a76b-65d3f53d4f1a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.058525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfbcbe9-eae7-4fa8-94f5-5a239c85c2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.059328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbcbe9-eae7-4fa8-94f5-5a239c85c2fa admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.059609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbcbe9-eae7-4fa8-94f5-5a239c85c2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.059882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbcbe9-eae7-4fa8-94f5-5a239c85c2fa admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.060605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfbcbe9-eae7-4fa8-94f5-5a239c85c2fa admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:42.061163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfbcbe9-eae7-4fa8-94f5-5a239c85c2fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.062771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfbcbe9-eae7-4fa8-94f5-5a239c85c2fa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.068257 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 405/828] 10.222.0.13 () {56 vars in 1145 bytes} [Sat Dec 18 20:32:42 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:42.073995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112818c-a862-4451-b0b3-addc805ff193 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.085616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112818c-a862-4451-b0b3-addc805ff193 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.094457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ab7bd-dbc8-4957-8bf4-11426ef5f48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.095419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ab7bd-dbc8-4957-8bf4-11426ef5f48e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.095964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ab7bd-dbc8-4957-8bf4-11426ef5f48e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.096459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ab7bd-dbc8-4957-8bf4-11426ef5f48e admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.097390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ab7bd-dbc8-4957-8bf4-11426ef5f48e admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:42.097965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ab7bd-dbc8-4957-8bf4-11426ef5f48e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.099872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ab7bd-dbc8-4957-8bf4-11426ef5f48e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.110341 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 424/829] 10.222.0.13 () {56 vars in 1145 bytes} [Sat Dec 18 20:32:42 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:42.115436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a2655-fbeb-4014-99db-f76af28997c7 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.115877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a2655-fbeb-4014-99db-f76af28997c7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.115993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a2655-fbeb-4014-99db-f76af28997c7 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.117127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ab7bd-dbc8-4957-8bf4-11426ef5f48e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.118014 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 406/830] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:42.125338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cee1d-e228-44b1-aa36-82fb77d28dc8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.125338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cee1d-e228-44b1-aa36-82fb77d28dc8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.125338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cee1d-e228-44b1-aa36-82fb77d28dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.134466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ab7bd-dbc8-4957-8bf4-11426ef5f48e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.148098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd3d57-a414-4163-ba5a-4df7ef0f3f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.148751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd3d57-a414-4163-ba5a-4df7ef0f3f84 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.149030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd3d57-a414-4163-ba5a-4df7ef0f3f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.149308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd3d57-a414-4163-ba5a-4df7ef0f3f84 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.150051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd3d57-a414-4163-ba5a-4df7ef0f3f84 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.151085 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-ffcd3d57-a414-4163-ba5a-4df7ef0f3f84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:32:42.151085 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:32:42.151085 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:32:42.152166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd3d57-a414-4163-ba5a-4df7ef0f3f84 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.158327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-012cee1d-e228-44b1-aa36-82fb77d28dc8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:42.159498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-012cee1d-e228-44b1-aa36-82fb77d28dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:42.175268 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 407/831] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:42 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:42.192955 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 425/832] 10.222.0.13 () {60 vars in 1165 bytes} [Sat Dec 18 20:32:42 2021] POST /identity/v3/endpoints => generated 346 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:32:42.210139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cee1d-e228-44b1-aa36-82fb77d28dc8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.219695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cee1d-e228-44b1-aa36-82fb77d28dc8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.234968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b484547-1a98-4d4f-9da6-43643c733259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.235767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484547-1a98-4d4f-9da6-43643c733259 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.236042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484547-1a98-4d4f-9da6-43643c733259 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.236316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484547-1a98-4d4f-9da6-43643c733259 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.248570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b484547-1a98-4d4f-9da6-43643c733259 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:42.255598 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-4b484547-1a98-4d4f-9da6-43643c733259 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:32:42.257167 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 408/833] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:32:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:42.263851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd3d57-a414-4163-ba5a-4df7ef0f3f84 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.275299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd3d57-a414-4163-ba5a-4df7ef0f3f84 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.280032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49041671-c50c-4222-b705-e78d7edd8ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.280718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49041671-c50c-4222-b705-e78d7edd8ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.281001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49041671-c50c-4222-b705-e78d7edd8ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.281281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49041671-c50c-4222-b705-e78d7edd8ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.282111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49041671-c50c-4222-b705-e78d7edd8ab4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:42.282460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49041671-c50c-4222-b705-e78d7edd8ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.284086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49041671-c50c-4222-b705-e78d7edd8ab4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.295218 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 426/834] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:32:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:42.303161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b484547-1a98-4d4f-9da6-43643c733259 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.314134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b484547-1a98-4d4f-9da6-43643c733259 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.324184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a25f5-1897-45ad-a5ed-c78b15b73985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.325006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a25f5-1897-45ad-a5ed-c78b15b73985 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.325286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a25f5-1897-45ad-a5ed-c78b15b73985 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.325562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a25f5-1897-45ad-a5ed-c78b15b73985 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.334243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052db2d-5067-4830-9e7b-b3212dc3c29f None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.334937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052db2d-5067-4830-9e7b-b3212dc3c29f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.335472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052db2d-5067-4830-9e7b-b3212dc3c29f None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.337817 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 427/835] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:42.344238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca0c48-d68a-450e-8198-1871e8c927b7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.345392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a25f5-1897-45ad-a5ed-c78b15b73985 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.347481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a25f5-1897-45ad-a5ed-c78b15b73985 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.348011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca0c48-d68a-450e-8198-1871e8c927b7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.348498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca0c48-d68a-450e-8198-1871e8c927b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.378312 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-f36a25f5-1897-45ad-a5ed-c78b15b73985 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:42.384756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6bca0c48-d68a-450e-8198-1871e8c927b7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:42.386923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6bca0c48-d68a-450e-8198-1871e8c927b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:42.388528 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 409/836] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:42.396352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a25f5-1897-45ad-a5ed-c78b15b73985 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.407458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a25f5-1897-45ad-a5ed-c78b15b73985 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.411245 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 428/837] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:42 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:42.412108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf0851-9ddf-4560-b712-253a97113b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.412919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf0851-9ddf-4560-b712-253a97113b42 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.413266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf0851-9ddf-4560-b712-253a97113b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.413611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf0851-9ddf-4560-b712-253a97113b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.414455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf0851-9ddf-4560-b712-253a97113b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:42.414841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf0851-9ddf-4560-b712-253a97113b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.416501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf0851-9ddf-4560-b712-253a97113b42 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.428875 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 410/838] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:42.435043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca0c48-d68a-450e-8198-1871e8c927b7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.445806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf0851-9ddf-4560-b712-253a97113b42 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.451374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca0c48-d68a-450e-8198-1871e8c927b7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.457467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf0851-9ddf-4560-b712-253a97113b42 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.462693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40dc05a-1f55-49f5-90b8-2eac254d5400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.463517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dc05a-1f55-49f5-90b8-2eac254d5400 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.463798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dc05a-1f55-49f5-90b8-2eac254d5400 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.464146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dc05a-1f55-49f5-90b8-2eac254d5400 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.468811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61501fd-71e0-4641-9b03-18dfdfd9c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.469609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61501fd-71e0-4641-9b03-18dfdfd9c99e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.469882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61501fd-71e0-4641-9b03-18dfdfd9c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.470239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61501fd-71e0-4641-9b03-18dfdfd9c99e admin admin] PATH_INFO: `/v3/services/network` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.470932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61501fd-71e0-4641-9b03-18dfdfd9c99e admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.472530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61501fd-71e0-4641-9b03-18dfdfd9c99e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.482998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40dc05a-1f55-49f5-90b8-2eac254d5400 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.485048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40dc05a-1f55-49f5-90b8-2eac254d5400 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.494467 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-e61501fd-71e0-4641-9b03-18dfdfd9c99e admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 18 20:32:42.495264 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 411/839] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:42 2021] GET /identity/v3/services/network => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:32:42.503056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61501fd-71e0-4641-9b03-18dfdfd9c99e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.511899 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-d40dc05a-1f55-49f5-90b8-2eac254d5400 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 18 20:32:42.513390 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 429/840] 10.222.0.13 () {56 vars in 1138 bytes} [Sat Dec 18 20:32:42 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:42.519828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40dc05a-1f55-49f5-90b8-2eac254d5400 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.522204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61501fd-71e0-4641-9b03-18dfdfd9c99e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.529359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40dc05a-1f55-49f5-90b8-2eac254d5400 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.532488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36499222-98ed-480d-98d3-27ec25796a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.533586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36499222-98ed-480d-98d3-27ec25796a1e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.534088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36499222-98ed-480d-98d3-27ec25796a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.534591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36499222-98ed-480d-98d3-27ec25796a1e admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.535513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36499222-98ed-480d-98d3-27ec25796a1e admin admin] RBAC: Adding query filter params (name=network) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:42.536027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36499222-98ed-480d-98d3-27ec25796a1e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.536344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a9e75-a158-432f-8d75-601a5eb95683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.537120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a9e75-a158-432f-8d75-601a5eb95683 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.537509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a9e75-a158-432f-8d75-601a5eb95683 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.537886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a9e75-a158-432f-8d75-601a5eb95683 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.538514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36499222-98ed-480d-98d3-27ec25796a1e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.539006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a9e75-a158-432f-8d75-601a5eb95683 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:42.539424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a9e75-a158-432f-8d75-601a5eb95683 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.541323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a9e75-a158-432f-8d75-601a5eb95683 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.545070 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 412/841] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Dec 18 20:32:42 2021] GET /identity/v3/services?name=network => generated 124 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:42.551123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36499222-98ed-480d-98d3-27ec25796a1e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.561727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36499222-98ed-480d-98d3-27ec25796a1e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.562388 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 430/842] 10.222.0.13 () {56 vars in 1170 bytes} [Sat Dec 18 20:32:42 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:42.567139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc287a1-0cfe-4792-b708-78bbd8677751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.568069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc287a1-0cfe-4792-b708-78bbd8677751 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.568176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a9e75-a158-432f-8d75-601a5eb95683 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.568713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc287a1-0cfe-4792-b708-78bbd8677751 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.569290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc287a1-0cfe-4792-b708-78bbd8677751 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.570283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc287a1-0cfe-4792-b708-78bbd8677751 admin admin] RBAC: Adding query filter params (type=network) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:42.570846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc287a1-0cfe-4792-b708-78bbd8677751 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.572694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc287a1-0cfe-4792-b708-78bbd8677751 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.577844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a9e75-a158-432f-8d75-601a5eb95683 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.578807 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 413/843] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Dec 18 20:32:42 2021] GET /identity/v3/services?type=network => generated 350 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:42.584724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc287a1-0cfe-4792-b708-78bbd8677751 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.585490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28acb4-33d1-4b1b-95df-87110acceec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.586242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28acb4-33d1-4b1b-95df-87110acceec3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.587278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28acb4-33d1-4b1b-95df-87110acceec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.587555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28acb4-33d1-4b1b-95df-87110acceec3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.596079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc287a1-0cfe-4792-b708-78bbd8677751 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.596411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28acb4-33d1-4b1b-95df-87110acceec3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.598358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28acb4-33d1-4b1b-95df-87110acceec3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.601513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6fc73-3cb7-49ff-b6ba-f086f5b63e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.602480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6fc73-3cb7-49ff-b6ba-f086f5b63e66 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.602968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6fc73-3cb7-49ff-b6ba-f086f5b63e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.603448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6fc73-3cb7-49ff-b6ba-f086f5b63e66 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.604427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6fc73-3cb7-49ff-b6ba-f086f5b63e66 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.605740 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-f2d6fc73-3cb7-49ff-b6ba-f086f5b63e66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:32:42.605740 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:32:42.605740 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:32:42.607116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6fc73-3cb7-49ff-b6ba-f086f5b63e66 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.607800 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 431/844] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:42 2021] GET /identity/v3/auth/tokens => generated 1303 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:32:42.613655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28acb4-33d1-4b1b-95df-87110acceec3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.623732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28acb4-33d1-4b1b-95df-87110acceec3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.628841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2dbd3-8c0d-4699-affc-ef73458cf1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.629718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2dbd3-8c0d-4699-affc-ef73458cf1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.630001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2dbd3-8c0d-4699-affc-ef73458cf1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.630383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2dbd3-8c0d-4699-affc-ef73458cf1b6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.633474 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 414/845] 10.222.0.13 () {60 vars in 1165 bytes} [Sat Dec 18 20:32:42 2021] POST /identity/v3/endpoints => generated 327 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:32:42.643320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2dbd3-8c0d-4699-affc-ef73458cf1b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.645249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2dbd3-8c0d-4699-affc-ef73458cf1b6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.664432 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-c7c2dbd3-8c0d-4699-affc-ef73458cf1b6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:42.666005 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 432/846] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:42.672859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6fc73-3cb7-49ff-b6ba-f086f5b63e66 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.700714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6fc73-3cb7-49ff-b6ba-f086f5b63e66 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.705405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1375bc3-477f-4dc1-b717-2d320f7300d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.706077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1375bc3-477f-4dc1-b717-2d320f7300d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.706397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1375bc3-477f-4dc1-b717-2d320f7300d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.706670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1375bc3-477f-4dc1-b717-2d320f7300d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.707411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1375bc3-477f-4dc1-b717-2d320f7300d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:42.707720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1375bc3-477f-4dc1-b717-2d320f7300d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.709415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1375bc3-477f-4dc1-b717-2d320f7300d4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.732626 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 415/847] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:42.742310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2dbd3-8c0d-4699-affc-ef73458cf1b6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.756329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2dbd3-8c0d-4699-affc-ef73458cf1b6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.764613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284652b4-7a2e-4e37-a787-dbf67503f396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.765422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284652b4-7a2e-4e37-a787-dbf67503f396 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.765706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284652b4-7a2e-4e37-a787-dbf67503f396 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.765982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284652b4-7a2e-4e37-a787-dbf67503f396 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.781829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284652b4-7a2e-4e37-a787-dbf67503f396 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.783870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284652b4-7a2e-4e37-a787-dbf67503f396 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.802706 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-284652b4-7a2e-4e37-a787-dbf67503f396 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:42.804141 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 433/848] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:42.811130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1375bc3-477f-4dc1-b717-2d320f7300d4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.825629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1375bc3-477f-4dc1-b717-2d320f7300d4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.832058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02ab79-0d1b-4196-8a8d-5cae83018556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.832787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02ab79-0d1b-4196-8a8d-5cae83018556 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.833066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02ab79-0d1b-4196-8a8d-5cae83018556 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.833339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02ab79-0d1b-4196-8a8d-5cae83018556 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.834204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02ab79-0d1b-4196-8a8d-5cae83018556 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:42.834555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02ab79-0d1b-4196-8a8d-5cae83018556 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.836547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02ab79-0d1b-4196-8a8d-5cae83018556 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.857969 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 416/849] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:42.865557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284652b4-7a2e-4e37-a787-dbf67503f396 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:42.878817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284652b4-7a2e-4e37-a787-dbf67503f396 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:42.886798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff32cd-23d2-48a5-9567-0454f7ebf9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:42.887490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff32cd-23d2-48a5-9567-0454f7ebf9ad admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:42.887794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff32cd-23d2-48a5-9567-0454f7ebf9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:42.888080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff32cd-23d2-48a5-9567-0454f7ebf9ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:42.889136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff32cd-23d2-48a5-9567-0454f7ebf9ad admin admin] RBAC: Adding query filter params (role.id=0071fc3d75b34850b7fb01a06a0279c5, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=1157bb6f43474dfa96d91a444d850b67) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:42.889453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff32cd-23d2-48a5-9567-0454f7ebf9ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:42.891424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff32cd-23d2-48a5-9567-0454f7ebf9ad admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:42.903246 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 434/850] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:42 2021] GET /identity/v3/role_assignments?user.id=1157bb6f43474dfa96d91a444d850b67&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=0071fc3d75b34850b7fb01a06a0279c5 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:43.425817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115ced1-5283-4786-a463-86a3ac4c6d1e None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:43.426873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115ced1-5283-4786-a463-86a3ac4c6d1e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:43.427411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115ced1-5283-4786-a463-86a3ac4c6d1e None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:43.429668 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 417/851] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:43.436529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1233e-9a5c-4c7a-94a0-6cf9ff79a7d7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:43.437394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1233e-9a5c-4c7a-94a0-6cf9ff79a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:43.437881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1233e-9a5c-4c7a-94a0-6cf9ff79a7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:43.456660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8bf1233e-9a5c-4c7a-94a0-6cf9ff79a7d7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:43.458152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8bf1233e-9a5c-4c7a-94a0-6cf9ff79a7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:43.466620 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 435/852] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:43 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:43.492550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115ced1-5283-4786-a463-86a3ac4c6d1e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:43.505980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115ced1-5283-4786-a463-86a3ac4c6d1e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:43.510741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ee554-fb89-4525-9f21-63e367f25966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:43.512399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ee554-fb89-4525-9f21-63e367f25966 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:43.512918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ee554-fb89-4525-9f21-63e367f25966 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:43.513397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ee554-fb89-4525-9f21-63e367f25966 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:43.524275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ee554-fb89-4525-9f21-63e367f25966 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:43.531352 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-bc7ee554-fb89-4525-9f21-63e367f25966 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:32:43.533018 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 418/853] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:32:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:43.539455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1233e-9a5c-4c7a-94a0-6cf9ff79a7d7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:43.548925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1233e-9a5c-4c7a-94a0-6cf9ff79a7d7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:43.553898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967a28e-0a17-4536-980f-ca438396b211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:43.554843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967a28e-0a17-4536-980f-ca438396b211 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:43.555341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967a28e-0a17-4536-980f-ca438396b211 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:43.555846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967a28e-0a17-4536-980f-ca438396b211 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:43.556810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967a28e-0a17-4536-980f-ca438396b211 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:43.557353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967a28e-0a17-4536-980f-ca438396b211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:43.559714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967a28e-0a17-4536-980f-ca438396b211 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:43.569299 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 436/854] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:43.576206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ee554-fb89-4525-9f21-63e367f25966 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:43.586432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ee554-fb89-4525-9f21-63e367f25966 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:43.591373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988f02e-a30b-4473-b72c-9c62779c565c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:43.592385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988f02e-a30b-4473-b72c-9c62779c565c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:43.592880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988f02e-a30b-4473-b72c-9c62779c565c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:43.593448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988f02e-a30b-4473-b72c-9c62779c565c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:43.604803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988f02e-a30b-4473-b72c-9c62779c565c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:43.607046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988f02e-a30b-4473-b72c-9c62779c565c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:43.624339 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-0988f02e-a30b-4473-b72c-9c62779c565c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:43.626072 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 419/855] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:43.632444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967a28e-0a17-4536-980f-ca438396b211 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:43.643190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967a28e-0a17-4536-980f-ca438396b211 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:43.648085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c809b99-3166-41b5-aee6-981deb30b3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:43.648996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c809b99-3166-41b5-aee6-981deb30b3ad admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:43.649557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c809b99-3166-41b5-aee6-981deb30b3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:43.650069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c809b99-3166-41b5-aee6-981deb30b3ad admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:43.651049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c809b99-3166-41b5-aee6-981deb30b3ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:43.651656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c809b99-3166-41b5-aee6-981deb30b3ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:43.653436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c809b99-3166-41b5-aee6-981deb30b3ad admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:43.666160 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 437/856] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:43.672864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988f02e-a30b-4473-b72c-9c62779c565c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:43.682898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988f02e-a30b-4473-b72c-9c62779c565c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:43.687742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4f946-3c89-44dd-b219-2050d7bc2602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:43.688519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4f946-3c89-44dd-b219-2050d7bc2602 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:43.688802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4f946-3c89-44dd-b219-2050d7bc2602 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:43.689090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4f946-3c89-44dd-b219-2050d7bc2602 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:43.697359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4f946-3c89-44dd-b219-2050d7bc2602 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:43.699963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4f946-3c89-44dd-b219-2050d7bc2602 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:43.719089 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-baf4f946-3c89-44dd-b219-2050d7bc2602 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 18 20:32:43.720624 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 420/857] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:32:43 2021] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:43.726750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c809b99-3166-41b5-aee6-981deb30b3ad admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:43.740552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c809b99-3166-41b5-aee6-981deb30b3ad admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:43.745235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b761f-a932-470b-bd05-afd47064bf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:43.745938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b761f-a932-470b-bd05-afd47064bf49 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:43.746228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b761f-a932-470b-bd05-afd47064bf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:43.746553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b761f-a932-470b-bd05-afd47064bf49 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:43.747406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b761f-a932-470b-bd05-afd47064bf49 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:43.747719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b761f-a932-470b-bd05-afd47064bf49 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:43.749556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b761f-a932-470b-bd05-afd47064bf49 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:43.767980 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 438/858] 10.222.0.13 () {56 vars in 1156 bytes} [Sat Dec 18 20:32:43 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:43.774220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4f946-3c89-44dd-b219-2050d7bc2602 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:43.785451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4f946-3c89-44dd-b219-2050d7bc2602 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:43.790497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acda0f5-56f6-431f-90eb-56e1b38a086e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:43.791180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acda0f5-56f6-431f-90eb-56e1b38a086e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:43.791465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acda0f5-56f6-431f-90eb-56e1b38a086e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:43.791751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acda0f5-56f6-431f-90eb-56e1b38a086e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:43.801090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acda0f5-56f6-431f-90eb-56e1b38a086e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:43.802919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acda0f5-56f6-431f-90eb-56e1b38a086e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:43.818984 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 421/859] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:43 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:32:43.826145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b761f-a932-470b-bd05-afd47064bf49 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:43.836151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b761f-a932-470b-bd05-afd47064bf49 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:43.841370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa443b-81c5-4d8c-8183-99ae78871a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:43.842153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa443b-81c5-4d8c-8183-99ae78871a60 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:43.842497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa443b-81c5-4d8c-8183-99ae78871a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:43.842741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa443b-81c5-4d8c-8183-99ae78871a60 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:43.853455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa443b-81c5-4d8c-8183-99ae78871a60 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:43.855362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa443b-81c5-4d8c-8183-99ae78871a60 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:43.872803 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-39aa443b-81c5-4d8c-8183-99ae78871a60 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:43.874346 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 439/860] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:43.880401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acda0f5-56f6-431f-90eb-56e1b38a086e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:43.890083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acda0f5-56f6-431f-90eb-56e1b38a086e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:43.894820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0530d6-a2e6-4188-a673-9442b582e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:43.895470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0530d6-a2e6-4188-a673-9442b582e13c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:43.895750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0530d6-a2e6-4188-a673-9442b582e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:43.896024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0530d6-a2e6-4188-a673-9442b582e13c admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:43.896755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0530d6-a2e6-4188-a673-9442b582e13c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:43.897065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0530d6-a2e6-4188-a673-9442b582e13c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:43.898683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0530d6-a2e6-4188-a673-9442b582e13c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:43.911499 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 422/861] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:43.918531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa443b-81c5-4d8c-8183-99ae78871a60 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:43.928174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa443b-81c5-4d8c-8183-99ae78871a60 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:43.932617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85945f50-47c5-4737-b065-80990e798e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:43.933582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85945f50-47c5-4737-b065-80990e798e2d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:43.933787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85945f50-47c5-4737-b065-80990e798e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:43.934066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85945f50-47c5-4737-b065-80990e798e2d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:43.941981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85945f50-47c5-4737-b065-80990e798e2d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:43.943935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85945f50-47c5-4737-b065-80990e798e2d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:43.957687 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-85945f50-47c5-4737-b065-80990e798e2d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:43.959256 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 440/862] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:43.965993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0530d6-a2e6-4188-a673-9442b582e13c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:43.979069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0530d6-a2e6-4188-a673-9442b582e13c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:43.983952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e848b90-815a-4eac-a775-929ae692195d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:43.984828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e848b90-815a-4eac-a775-929ae692195d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:43.985308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e848b90-815a-4eac-a775-929ae692195d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:43.985787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e848b90-815a-4eac-a775-929ae692195d admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:43.986808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e848b90-815a-4eac-a775-929ae692195d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:43.987314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e848b90-815a-4eac-a775-929ae692195d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:43.989330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e848b90-815a-4eac-a775-929ae692195d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:44.002292 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 423/863] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:44.008363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85945f50-47c5-4737-b065-80990e798e2d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:44.019397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85945f50-47c5-4737-b065-80990e798e2d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:44.024240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b728f8f-5c94-44a1-b818-26c135eae9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:44.025016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b728f8f-5c94-44a1-b818-26c135eae9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:44.025404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b728f8f-5c94-44a1-b818-26c135eae9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:44.025785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b728f8f-5c94-44a1-b818-26c135eae9f1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:44.027303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b728f8f-5c94-44a1-b818-26c135eae9f1 admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=f5e4bc28d0744b65ab520bf79cea5a45) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:44.027723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b728f8f-5c94-44a1-b818-26c135eae9f1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:44.029640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b728f8f-5c94-44a1-b818-26c135eae9f1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:44.036299 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 441/864] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:44 2021] GET /identity/v3/role_assignments?user.id=f5e4bc28d0744b65ab520bf79cea5a45&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:44.248856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c8633-3282-4681-ab3b-8e7e8ffa436b None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:44.249335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c8633-3282-4681-ab3b-8e7e8ffa436b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:44.249751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c8633-3282-4681-ab3b-8e7e8ffa436b None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:44.251917 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 424/865] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:44.257725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fca144-0042-4048-9bf2-01ec2ad3d078 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:44.258141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fca144-0042-4048-9bf2-01ec2ad3d078 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:44.258554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fca144-0042-4048-9bf2-01ec2ad3d078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:44.277628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-67fca144-0042-4048-9bf2-01ec2ad3d078 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:44.278994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-67fca144-0042-4048-9bf2-01ec2ad3d078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:44.287520 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 442/866] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:44 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:44.313349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c8633-3282-4681-ab3b-8e7e8ffa436b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:44.326407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c8633-3282-4681-ab3b-8e7e8ffa436b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:44.331010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480c6ff-dea0-4875-85e0-592f67168f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:44.331652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480c6ff-dea0-4875-85e0-592f67168f55 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:44.331928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480c6ff-dea0-4875-85e0-592f67168f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:44.332252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480c6ff-dea0-4875-85e0-592f67168f55 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:44.333045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480c6ff-dea0-4875-85e0-592f67168f55 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:44.334725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480c6ff-dea0-4875-85e0-592f67168f55 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:44.349531 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 425/867] 10.222.0.13 () {60 vars in 1162 bytes} [Sat Dec 18 20:32:44 2021] POST /identity/v3/services => generated 269 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:32:45.057219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff601cf0-da13-4b41-ae5f-27cace9732f6 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:45.057734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff601cf0-da13-4b41-ae5f-27cace9732f6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:45.057734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff601cf0-da13-4b41-ae5f-27cace9732f6 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:45.059761 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 443/868] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:45.065967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af06b5-cc52-41c0-a125-9e43b44fa65a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:45.066413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af06b5-cc52-41c0-a125-9e43b44fa65a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:45.066617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af06b5-cc52-41c0-a125-9e43b44fa65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:45.084461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-17af06b5-cc52-41c0-a125-9e43b44fa65a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:45.085633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-17af06b5-cc52-41c0-a125-9e43b44fa65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:45.102498 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 426/869] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:45 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:45.127528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff601cf0-da13-4b41-ae5f-27cace9732f6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:45.141735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff601cf0-da13-4b41-ae5f-27cace9732f6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:45.146954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01014f9-afa9-44e6-a164-eeff45ebd70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:45.147815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01014f9-afa9-44e6-a164-eeff45ebd70e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:45.148105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01014f9-afa9-44e6-a164-eeff45ebd70e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:45.148388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01014f9-afa9-44e6-a164-eeff45ebd70e admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:45.149064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01014f9-afa9-44e6-a164-eeff45ebd70e admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:45.150736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01014f9-afa9-44e6-a164-eeff45ebd70e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:45.162540 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-e01014f9-afa9-44e6-a164-eeff45ebd70e admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 18 20:32:45.164030 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 444/870] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:32:45 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:45.171047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af06b5-cc52-41c0-a125-9e43b44fa65a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:45.180095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af06b5-cc52-41c0-a125-9e43b44fa65a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:45.185598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473d193-8ce2-4c28-8ee9-74bf12741bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:45.186617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473d193-8ce2-4c28-8ee9-74bf12741bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:45.186926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473d193-8ce2-4c28-8ee9-74bf12741bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:45.187206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473d193-8ce2-4c28-8ee9-74bf12741bb6 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:45.187965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473d193-8ce2-4c28-8ee9-74bf12741bb6 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:45.188278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473d193-8ce2-4c28-8ee9-74bf12741bb6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:45.190218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473d193-8ce2-4c28-8ee9-74bf12741bb6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:45.195504 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 427/871] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:32:45 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:45.201983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01014f9-afa9-44e6-a164-eeff45ebd70e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:45.211908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01014f9-afa9-44e6-a164-eeff45ebd70e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:45.216725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d1a51-6b93-4ba7-9280-5bde9d7e5801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:45.217443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d1a51-6b93-4ba7-9280-5bde9d7e5801 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:45.217731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d1a51-6b93-4ba7-9280-5bde9d7e5801 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:45.218049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d1a51-6b93-4ba7-9280-5bde9d7e5801 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:45.218816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d1a51-6b93-4ba7-9280-5bde9d7e5801 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:45.219128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d1a51-6b93-4ba7-9280-5bde9d7e5801 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:45.220810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d1a51-6b93-4ba7-9280-5bde9d7e5801 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:45.225921 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 445/872] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:32:45 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:45.546356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8168381-6248-4dcf-a21c-bfde6122ba98 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:45.546738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8168381-6248-4dcf-a21c-bfde6122ba98 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:45.546914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8168381-6248-4dcf-a21c-bfde6122ba98 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:45.548955 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 428/873] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:45.554865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7373c-0de0-4df8-9d3a-8b21b178f2f5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:45.555156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7373c-0de0-4df8-9d3a-8b21b178f2f5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:45.555434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7373c-0de0-4df8-9d3a-8b21b178f2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:45.574282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c8c7373c-0de0-4df8-9d3a-8b21b178f2f5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:45.575479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c8c7373c-0de0-4df8-9d3a-8b21b178f2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:45.590388 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 446/874] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:45 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:45.609979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8168381-6248-4dcf-a21c-bfde6122ba98 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:45.622814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8168381-6248-4dcf-a21c-bfde6122ba98 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:45.627159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3ae7a-77dc-46df-b6f7-a7edfdd38100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:45.627948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3ae7a-77dc-46df-b6f7-a7edfdd38100 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:45.628229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3ae7a-77dc-46df-b6f7-a7edfdd38100 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:45.628506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3ae7a-77dc-46df-b6f7-a7edfdd38100 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:45.639331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3ae7a-77dc-46df-b6f7-a7edfdd38100 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:45.646501 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-3ef3ae7a-77dc-46df-b6f7-a7edfdd38100 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 18 20:32:45.653560 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 429/875] 10.222.0.13 () {56 vars in 1141 bytes} [Sat Dec 18 20:32:45 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:45.654950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7373c-0de0-4df8-9d3a-8b21b178f2f5 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:45.664046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7373c-0de0-4df8-9d3a-8b21b178f2f5 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:45.668625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c468be-12ea-4d15-9aff-e02e0ad75487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:45.669294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c468be-12ea-4d15-9aff-e02e0ad75487 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:45.669577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c468be-12ea-4d15-9aff-e02e0ad75487 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:45.669857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c468be-12ea-4d15-9aff-e02e0ad75487 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:45.670645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c468be-12ea-4d15-9aff-e02e0ad75487 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:45.670955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c468be-12ea-4d15-9aff-e02e0ad75487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:45.672550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c468be-12ea-4d15-9aff-e02e0ad75487 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:45.686438 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 447/876] 10.222.0.13 () {56 vars in 1136 bytes} [Sat Dec 18 20:32:45 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:45.687756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3ae7a-77dc-46df-b6f7-a7edfdd38100 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:45.698134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3ae7a-77dc-46df-b6f7-a7edfdd38100 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:45.702762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040841a-a638-47f6-92ec-119baf0308a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:45.703537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040841a-a638-47f6-92ec-119baf0308a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:45.703818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040841a-a638-47f6-92ec-119baf0308a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:45.704093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040841a-a638-47f6-92ec-119baf0308a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:45.716098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040841a-a638-47f6-92ec-119baf0308a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:45.716098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040841a-a638-47f6-92ec-119baf0308a2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:45.743255 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-2040841a-a638-47f6-92ec-119baf0308a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:45.745080 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 430/877] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:45.751954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c468be-12ea-4d15-9aff-e02e0ad75487 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:45.762655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c468be-12ea-4d15-9aff-e02e0ad75487 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:45.767282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1744de0-4d80-4da2-a8d4-2488f605fea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:45.767993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1744de0-4d80-4da2-a8d4-2488f605fea3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:45.768280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1744de0-4d80-4da2-a8d4-2488f605fea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:45.768616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1744de0-4d80-4da2-a8d4-2488f605fea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:45.769357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1744de0-4d80-4da2-a8d4-2488f605fea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:45.769668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1744de0-4d80-4da2-a8d4-2488f605fea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:45.771340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1744de0-4d80-4da2-a8d4-2488f605fea3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:45.786381 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 448/878] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:45.789663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040841a-a638-47f6-92ec-119baf0308a2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:45.799398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040841a-a638-47f6-92ec-119baf0308a2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:45.803870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4268b9-c221-487f-9512-9880acd0eb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:45.804661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4268b9-c221-487f-9512-9880acd0eb93 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:45.804946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4268b9-c221-487f-9512-9880acd0eb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:45.805223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4268b9-c221-487f-9512-9880acd0eb93 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:45.813378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4268b9-c221-487f-9512-9880acd0eb93 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:45.815417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4268b9-c221-487f-9512-9880acd0eb93 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:45.831571 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-ea4268b9-c221-487f-9512-9880acd0eb93 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 18 20:32:45.833077 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 431/879] 10.222.0.13 () {56 vars in 1138 bytes} [Sat Dec 18 20:32:45 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:45.839390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1744de0-4d80-4da2-a8d4-2488f605fea3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:45.853684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1744de0-4d80-4da2-a8d4-2488f605fea3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:45.858316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5136c0-aeac-4cfa-93f6-a83f73ad6b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:45.858982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5136c0-aeac-4cfa-93f6-a83f73ad6b7c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:45.859269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5136c0-aeac-4cfa-93f6-a83f73ad6b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:45.859556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5136c0-aeac-4cfa-93f6-a83f73ad6b7c admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:45.860392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5136c0-aeac-4cfa-93f6-a83f73ad6b7c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:45.860703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5136c0-aeac-4cfa-93f6-a83f73ad6b7c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:45.862570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5136c0-aeac-4cfa-93f6-a83f73ad6b7c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:45.880411 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 449/880] 10.222.0.13 () {56 vars in 1170 bytes} [Sat Dec 18 20:32:45 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:45.887146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4268b9-c221-487f-9512-9880acd0eb93 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:45.896773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4268b9-c221-487f-9512-9880acd0eb93 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:45.901312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4793b81-e2ca-427d-9fd2-ae05693ff131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:45.901975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4793b81-e2ca-427d-9fd2-ae05693ff131 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:45.902275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4793b81-e2ca-427d-9fd2-ae05693ff131 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:45.902564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4793b81-e2ca-427d-9fd2-ae05693ff131 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:45.910441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4793b81-e2ca-427d-9fd2-ae05693ff131 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:45.912192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4793b81-e2ca-427d-9fd2-ae05693ff131 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:45.921840 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 432/881] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:45 2021] GET /identity/v3/auth/tokens => generated 1562 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:32:45.927835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5136c0-aeac-4cfa-93f6-a83f73ad6b7c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:45.938911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5136c0-aeac-4cfa-93f6-a83f73ad6b7c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:45.943440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3684b-eabd-4afa-818c-e2c217794269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:45.944220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3684b-eabd-4afa-818c-e2c217794269 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:45.944507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3684b-eabd-4afa-818c-e2c217794269 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:45.944787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3684b-eabd-4afa-818c-e2c217794269 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:45.954937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3684b-eabd-4afa-818c-e2c217794269 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:45.956745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3684b-eabd-4afa-818c-e2c217794269 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:45.973910 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-f3d3684b-eabd-4afa-818c-e2c217794269 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:45.975365 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 450/882] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:45.981919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4793b81-e2ca-427d-9fd2-ae05693ff131 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:45.990929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4793b81-e2ca-427d-9fd2-ae05693ff131 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:45.996110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ea04b-0cb7-45e3-959f-d761035190cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:45.996765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ea04b-0cb7-45e3-959f-d761035190cb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:45.997044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ea04b-0cb7-45e3-959f-d761035190cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:45.997320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ea04b-0cb7-45e3-959f-d761035190cb admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:45.998054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ea04b-0cb7-45e3-959f-d761035190cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:45.998403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ea04b-0cb7-45e3-959f-d761035190cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:46.004722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ea04b-0cb7-45e3-959f-d761035190cb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:46.018920 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 433/883] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:46.025950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3684b-eabd-4afa-818c-e2c217794269 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:46.036470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3684b-eabd-4afa-818c-e2c217794269 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:46.042696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077515ed-fc58-4930-b39b-243fdb02ca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:46.043688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077515ed-fc58-4930-b39b-243fdb02ca1b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:46.043968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077515ed-fc58-4930-b39b-243fdb02ca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:46.044241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077515ed-fc58-4930-b39b-243fdb02ca1b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:46.051832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077515ed-fc58-4930-b39b-243fdb02ca1b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:46.053703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077515ed-fc58-4930-b39b-243fdb02ca1b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:46.067596 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-077515ed-fc58-4930-b39b-243fdb02ca1b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:46.069069 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 451/884] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:46.076020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ea04b-0cb7-45e3-959f-d761035190cb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:46.085866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ea04b-0cb7-45e3-959f-d761035190cb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:46.093187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60346f68-d76e-4747-8bad-989060a688b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:46.093872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60346f68-d76e-4747-8bad-989060a688b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:46.094153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60346f68-d76e-4747-8bad-989060a688b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:46.094458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60346f68-d76e-4747-8bad-989060a688b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:46.095251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60346f68-d76e-4747-8bad-989060a688b8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:46.095563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60346f68-d76e-4747-8bad-989060a688b8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:46.099496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60346f68-d76e-4747-8bad-989060a688b8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:46.119940 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 434/885] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:46.126758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077515ed-fc58-4930-b39b-243fdb02ca1b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:46.137295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077515ed-fc58-4930-b39b-243fdb02ca1b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:46.142125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e390000-701a-408f-a726-6fea15fc97b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:46.142851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e390000-701a-408f-a726-6fea15fc97b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:46.143132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e390000-701a-408f-a726-6fea15fc97b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:46.143411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e390000-701a-408f-a726-6fea15fc97b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:46.144299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e390000-701a-408f-a726-6fea15fc97b1 admin admin] RBAC: Adding query filter params (role.id=14c5ef1664374a9aa883c0b6d860b63a, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=1157bb6f43474dfa96d91a444d850b67) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:46.144610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e390000-701a-408f-a726-6fea15fc97b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:46.146515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e390000-701a-408f-a726-6fea15fc97b1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:46.154720 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 452/886] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:46 2021] GET /identity/v3/role_assignments?user.id=1157bb6f43474dfa96d91a444d850b67&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=14c5ef1664374a9aa883c0b6d860b63a => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:46.703069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adf477-9245-4b57-96f0-5674df2812ca None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:46.703507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adf477-9245-4b57-96f0-5674df2812ca None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:46.703684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adf477-9245-4b57-96f0-5674df2812ca None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:46.705634 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 435/887] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:46.711453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67934a-c744-4377-ad81-25dc3931c8d2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:46.711746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67934a-c744-4377-ad81-25dc3931c8d2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:46.712032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67934a-c744-4377-ad81-25dc3931c8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:46.730563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9b67934a-c744-4377-ad81-25dc3931c8d2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:46.731766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9b67934a-c744-4377-ad81-25dc3931c8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:46.744193 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 453/888] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:46 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:46.769503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adf477-9245-4b57-96f0-5674df2812ca None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:46.782743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adf477-9245-4b57-96f0-5674df2812ca None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:46.787266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38701d-4e6e-425b-9071-096f4be4f035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:46.788063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38701d-4e6e-425b-9071-096f4be4f035 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:46.788344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38701d-4e6e-425b-9071-096f4be4f035 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:46.788622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38701d-4e6e-425b-9071-096f4be4f035 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:46.789433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38701d-4e6e-425b-9071-096f4be4f035 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:46.791089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38701d-4e6e-425b-9071-096f4be4f035 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:46.805793 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-ef38701d-4e6e-425b-9071-096f4be4f035 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 18 20:32:46.807464 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 436/889] 10.222.0.13 () {56 vars in 1147 bytes} [Sat Dec 18 20:32:46 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:46.814779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67934a-c744-4377-ad81-25dc3931c8d2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:46.823829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67934a-c744-4377-ad81-25dc3931c8d2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:46.828433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd05e9-6069-4105-92fd-b1e96204cce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:46.829088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd05e9-6069-4105-92fd-b1e96204cce1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:46.829377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd05e9-6069-4105-92fd-b1e96204cce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:46.829658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd05e9-6069-4105-92fd-b1e96204cce1 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:46.830417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd05e9-6069-4105-92fd-b1e96204cce1 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:46.830730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd05e9-6069-4105-92fd-b1e96204cce1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:46.832317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd05e9-6069-4105-92fd-b1e96204cce1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:46.837183 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 454/890] 10.222.0.13 () {56 vars in 1143 bytes} [Sat Dec 18 20:32:46 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:46.843283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38701d-4e6e-425b-9071-096f4be4f035 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:46.852881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38701d-4e6e-425b-9071-096f4be4f035 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:46.857930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcd20a-abe2-455f-9809-14a75be3e993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:46.858610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcd20a-abe2-455f-9809-14a75be3e993 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:46.858898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcd20a-abe2-455f-9809-14a75be3e993 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:46.859182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcd20a-abe2-455f-9809-14a75be3e993 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:46.859898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcd20a-abe2-455f-9809-14a75be3e993 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:46.860207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcd20a-abe2-455f-9809-14a75be3e993 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:46.861791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcd20a-abe2-455f-9809-14a75be3e993 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:46.866511 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 437/891] 10.222.0.13 () {56 vars in 1143 bytes} [Sat Dec 18 20:32:46 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:46.929640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fbbf3-75b3-402f-bf48-150d38f70855 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:46.929977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fbbf3-75b3-402f-bf48-150d38f70855 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:46.930221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fbbf3-75b3-402f-bf48-150d38f70855 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:46.932145 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 455/892] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:46.938817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aa8d1-fc1d-4d19-8e0e-62f630463c01 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:46.939150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aa8d1-fc1d-4d19-8e0e-62f630463c01 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:46.939383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aa8d1-fc1d-4d19-8e0e-62f630463c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:46.958974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bb2aa8d1-fc1d-4d19-8e0e-62f630463c01 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:46.960236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bb2aa8d1-fc1d-4d19-8e0e-62f630463c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:46.969976 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 438/893] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:46 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:46.994719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fbbf3-75b3-402f-bf48-150d38f70855 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:47.007965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fbbf3-75b3-402f-bf48-150d38f70855 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:47.013329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f959d-bb9a-415d-ae5f-8e863f27db47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:47.014278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f959d-bb9a-415d-ae5f-8e863f27db47 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:47.014583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f959d-bb9a-415d-ae5f-8e863f27db47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:47.014864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f959d-bb9a-415d-ae5f-8e863f27db47 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:47.015605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f959d-bb9a-415d-ae5f-8e863f27db47 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:47.017262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f959d-bb9a-415d-ae5f-8e863f27db47 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:47.030593 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-4d4f959d-bb9a-415d-ae5f-8e863f27db47 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 18 20:32:47.032264 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 456/894] 10.222.0.13 () {56 vars in 1153 bytes} [Sat Dec 18 20:32:46 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:47.039139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2aa8d1-fc1d-4d19-8e0e-62f630463c01 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:47.049194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2aa8d1-fc1d-4d19-8e0e-62f630463c01 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:47.054586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ebe23-3ace-43ec-b095-bd97c7e3f455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:47.055674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ebe23-3ace-43ec-b095-bd97c7e3f455 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:47.056185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ebe23-3ace-43ec-b095-bd97c7e3f455 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:47.056675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ebe23-3ace-43ec-b095-bd97c7e3f455 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:47.058125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ebe23-3ace-43ec-b095-bd97c7e3f455 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:47.058709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ebe23-3ace-43ec-b095-bd97c7e3f455 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:47.060641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ebe23-3ace-43ec-b095-bd97c7e3f455 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:47.067116 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 439/895] 10.222.0.13 () {56 vars in 1147 bytes} [Sat Dec 18 20:32:47 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:47.074498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f959d-bb9a-415d-ae5f-8e863f27db47 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:47.085788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f959d-bb9a-415d-ae5f-8e863f27db47 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:47.095595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea408a-e029-49e9-aa1e-a0b7cf029d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:47.096339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea408a-e029-49e9-aa1e-a0b7cf029d20 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:47.096628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea408a-e029-49e9-aa1e-a0b7cf029d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:47.096909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea408a-e029-49e9-aa1e-a0b7cf029d20 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:47.097712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea408a-e029-49e9-aa1e-a0b7cf029d20 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:47.098028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea408a-e029-49e9-aa1e-a0b7cf029d20 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:47.099718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea408a-e029-49e9-aa1e-a0b7cf029d20 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:47.107341 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 457/896] 10.222.0.13 () {56 vars in 1147 bytes} [Sat Dec 18 20:32:47 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:47.113202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ebe23-3ace-43ec-b095-bd97c7e3f455 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:47.123824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ebe23-3ace-43ec-b095-bd97c7e3f455 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:47.129975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe40a4-593c-439d-bc5e-87e72c8854d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:47.134303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe40a4-593c-439d-bc5e-87e72c8854d5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:47.134303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe40a4-593c-439d-bc5e-87e72c8854d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:47.134303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe40a4-593c-439d-bc5e-87e72c8854d5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:47.134303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe40a4-593c-439d-bc5e-87e72c8854d5 admin admin] RBAC: Adding query filter params (interface=public, service_id=286d0b743b07401db77dde596de975ba, region_id=RegionOne) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:47.134303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe40a4-593c-439d-bc5e-87e72c8854d5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:47.134303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe40a4-593c-439d-bc5e-87e72c8854d5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:47.144102 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 440/897] 10.222.0.13 () {56 vars in 1272 bytes} [Sat Dec 18 20:32:47 2021] GET /identity/v3/endpoints?service_id=286d0b743b07401db77dde596de975ba&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:47.150102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea408a-e029-49e9-aa1e-a0b7cf029d20 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:47.164282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea408a-e029-49e9-aa1e-a0b7cf029d20 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:47.180115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5112f8-0544-4d66-a40c-4ef979a89c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:47.180115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5112f8-0544-4d66-a40c-4ef979a89c72 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:47.180115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5112f8-0544-4d66-a40c-4ef979a89c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:47.180457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5112f8-0544-4d66-a40c-4ef979a89c72 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:47.182716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5112f8-0544-4d66-a40c-4ef979a89c72 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:47.189571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5112f8-0544-4d66-a40c-4ef979a89c72 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:47.206276 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 458/898] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Dec 18 20:32:47 2021] GET /identity/v3/services => generated 1029 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:32:47.765958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa2f28-1906-48dd-abc1-993d3de3ea60 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:47.766615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa2f28-1906-48dd-abc1-993d3de3ea60 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:47.767122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa2f28-1906-48dd-abc1-993d3de3ea60 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:47.769315 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 441/899] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:47.775209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f7810-9f7a-4b38-8421-4c53726c50a6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:47.775808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f7810-9f7a-4b38-8421-4c53726c50a6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:47.776367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f7810-9f7a-4b38-8421-4c53726c50a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:47.794269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ae1f7810-9f7a-4b38-8421-4c53726c50a6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:47.795710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ae1f7810-9f7a-4b38-8421-4c53726c50a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:47.803889 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 459/900] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:47 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:47.829616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa2f28-1906-48dd-abc1-993d3de3ea60 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:47.842620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa2f28-1906-48dd-abc1-993d3de3ea60 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:47.847305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed387e-59a8-471b-b19b-ae818dee21c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:47.848240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed387e-59a8-471b-b19b-ae818dee21c4 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:47.848747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed387e-59a8-471b-b19b-ae818dee21c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:47.849221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed387e-59a8-471b-b19b-ae818dee21c4 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:47.850173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed387e-59a8-471b-b19b-ae818dee21c4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:47.851984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed387e-59a8-471b-b19b-ae818dee21c4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:47.867869 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 442/901] 10.222.0.13 () {60 vars in 1162 bytes} [Sat Dec 18 20:32:47 2021] POST /identity/v3/services => generated 251 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:32:48.671341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdb437-5e87-4ba4-b704-a1c0bbe3fc59 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:48.672390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdb437-5e87-4ba4-b704-a1c0bbe3fc59 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:48.672900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdb437-5e87-4ba4-b704-a1c0bbe3fc59 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:48.675168 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 460/902] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:48.680851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08465e34-f269-4c3d-8875-a91ce46a6b08 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:48.681275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08465e34-f269-4c3d-8875-a91ce46a6b08 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:48.681499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08465e34-f269-4c3d-8875-a91ce46a6b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:48.699573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-08465e34-f269-4c3d-8875-a91ce46a6b08 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:48.700760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-08465e34-f269-4c3d-8875-a91ce46a6b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:48.720475 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 443/903] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:48 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:32:48.750975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdb437-5e87-4ba4-b704-a1c0bbe3fc59 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:48.763550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdb437-5e87-4ba4-b704-a1c0bbe3fc59 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:48.768031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b6420-9bbc-4cc7-be0d-1763f5a21d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:48.770361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b6420-9bbc-4cc7-be0d-1763f5a21d7e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:48.770361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b6420-9bbc-4cc7-be0d-1763f5a21d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:48.770361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b6420-9bbc-4cc7-be0d-1763f5a21d7e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:48.782163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b6420-9bbc-4cc7-be0d-1763f5a21d7e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:48.789756 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-1b2b6420-9bbc-4cc7-be0d-1763f5a21d7e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 18 20:32:48.794938 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 461/904] 10.222.0.13 () {56 vars in 1141 bytes} [Sat Dec 18 20:32:48 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:48.798804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08465e34-f269-4c3d-8875-a91ce46a6b08 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:48.808658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08465e34-f269-4c3d-8875-a91ce46a6b08 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:48.813560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c846b0-178e-4036-b5e5-bedc6ac8f514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:48.814402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c846b0-178e-4036-b5e5-bedc6ac8f514 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:48.814825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c846b0-178e-4036-b5e5-bedc6ac8f514 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:48.815242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c846b0-178e-4036-b5e5-bedc6ac8f514 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:48.816151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c846b0-178e-4036-b5e5-bedc6ac8f514 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:48.816599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c846b0-178e-4036-b5e5-bedc6ac8f514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:48.818372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c846b0-178e-4036-b5e5-bedc6ac8f514 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:48.832445 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 444/905] 10.222.0.13 () {56 vars in 1136 bytes} [Sat Dec 18 20:32:48 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:48.833926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b6420-9bbc-4cc7-be0d-1763f5a21d7e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:48.844047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b6420-9bbc-4cc7-be0d-1763f5a21d7e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:48.848765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d7a52-35ed-4870-b401-4ebac28c60fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:48.849706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d7a52-35ed-4870-b401-4ebac28c60fc admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:48.850151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d7a52-35ed-4870-b401-4ebac28c60fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:48.850604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d7a52-35ed-4870-b401-4ebac28c60fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:48.862070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d7a52-35ed-4870-b401-4ebac28c60fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:48.864072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d7a52-35ed-4870-b401-4ebac28c60fc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:48.880966 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-3a6d7a52-35ed-4870-b401-4ebac28c60fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:48.886487 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 462/906] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:48.889524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c846b0-178e-4036-b5e5-bedc6ac8f514 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:48.900364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c846b0-178e-4036-b5e5-bedc6ac8f514 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:48.905001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e51ccd-962c-4fac-a7b1-39c8f86018cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:48.905828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e51ccd-962c-4fac-a7b1-39c8f86018cc admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:48.906286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e51ccd-962c-4fac-a7b1-39c8f86018cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:48.906733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e51ccd-962c-4fac-a7b1-39c8f86018cc admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:48.907604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e51ccd-962c-4fac-a7b1-39c8f86018cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:48.908051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e51ccd-962c-4fac-a7b1-39c8f86018cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:48.909781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e51ccd-962c-4fac-a7b1-39c8f86018cc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:48.926419 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 445/907] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:48.929199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d7a52-35ed-4870-b401-4ebac28c60fc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:48.940071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d7a52-35ed-4870-b401-4ebac28c60fc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:48.944810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48a29a-da71-42af-8cbf-a4762ba7e097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:48.945811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48a29a-da71-42af-8cbf-a4762ba7e097 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:48.946343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48a29a-da71-42af-8cbf-a4762ba7e097 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:48.946819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48a29a-da71-42af-8cbf-a4762ba7e097 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:48.956212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48a29a-da71-42af-8cbf-a4762ba7e097 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:48.958868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48a29a-da71-42af-8cbf-a4762ba7e097 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:48.974700 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-dc48a29a-da71-42af-8cbf-a4762ba7e097 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 18 20:32:48.976256 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 463/908] 10.222.0.13 () {56 vars in 1138 bytes} [Sat Dec 18 20:32:48 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:48.983464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e51ccd-962c-4fac-a7b1-39c8f86018cc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:48.993881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e51ccd-962c-4fac-a7b1-39c8f86018cc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:48.999347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f5dda-7e45-4b2a-9adf-de8048ce6c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:49.000257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f5dda-7e45-4b2a-9adf-de8048ce6c0f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:49.000761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f5dda-7e45-4b2a-9adf-de8048ce6c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:49.001219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f5dda-7e45-4b2a-9adf-de8048ce6c0f admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:49.002317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f5dda-7e45-4b2a-9adf-de8048ce6c0f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:49.002811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f5dda-7e45-4b2a-9adf-de8048ce6c0f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:49.004901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f5dda-7e45-4b2a-9adf-de8048ce6c0f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:49.023264 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 446/909] 10.222.0.13 () {56 vars in 1170 bytes} [Sat Dec 18 20:32:48 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:49.029248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48a29a-da71-42af-8cbf-a4762ba7e097 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:49.039674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48a29a-da71-42af-8cbf-a4762ba7e097 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:49.044959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718e755-7deb-407f-aa88-994f24b422f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:49.046028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718e755-7deb-407f-aa88-994f24b422f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:49.046553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718e755-7deb-407f-aa88-994f24b422f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:49.047063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718e755-7deb-407f-aa88-994f24b422f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:49.059117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718e755-7deb-407f-aa88-994f24b422f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:49.061501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718e755-7deb-407f-aa88-994f24b422f5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:49.078343 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-d718e755-7deb-407f-aa88-994f24b422f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:49.084934 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 464/910] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:49.086659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f5dda-7e45-4b2a-9adf-de8048ce6c0f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:49.096947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f5dda-7e45-4b2a-9adf-de8048ce6c0f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:49.102359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76b106-19e2-4228-a523-c43c01043890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:49.103279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76b106-19e2-4228-a523-c43c01043890 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:49.103768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76b106-19e2-4228-a523-c43c01043890 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:49.104262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76b106-19e2-4228-a523-c43c01043890 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:49.105762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76b106-19e2-4228-a523-c43c01043890 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:49.106301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76b106-19e2-4228-a523-c43c01043890 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:49.109062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76b106-19e2-4228-a523-c43c01043890 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:49.126353 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 447/911] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:49.128305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718e755-7deb-407f-aa88-994f24b422f5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:49.138475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718e755-7deb-407f-aa88-994f24b422f5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:49.143297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54eb19b-a874-4159-8f61-0d3e2fc94cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:49.144316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eb19b-a874-4159-8f61-0d3e2fc94cbe admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:49.144825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eb19b-a874-4159-8f61-0d3e2fc94cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:49.145332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eb19b-a874-4159-8f61-0d3e2fc94cbe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:49.154043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54eb19b-a874-4159-8f61-0d3e2fc94cbe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:49.156405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54eb19b-a874-4159-8f61-0d3e2fc94cbe admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:49.172219 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-d54eb19b-a874-4159-8f61-0d3e2fc94cbe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:49.178403 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 465/912] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:49.180596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76b106-19e2-4228-a523-c43c01043890 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:49.191866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76b106-19e2-4228-a523-c43c01043890 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:49.196710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083d30d-0867-4e4d-be1e-fb6154dc8176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:49.197596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083d30d-0867-4e4d-be1e-fb6154dc8176 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:49.198083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083d30d-0867-4e4d-be1e-fb6154dc8176 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:49.198648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083d30d-0867-4e4d-be1e-fb6154dc8176 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:49.199639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083d30d-0867-4e4d-be1e-fb6154dc8176 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:49.200150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083d30d-0867-4e4d-be1e-fb6154dc8176 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:49.202173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083d30d-0867-4e4d-be1e-fb6154dc8176 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:49.222183 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 448/913] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:49.224051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54eb19b-a874-4159-8f61-0d3e2fc94cbe admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:49.235241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54eb19b-a874-4159-8f61-0d3e2fc94cbe admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:49.242229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb786083-a3d0-445e-b60a-781f2e833f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:49.243461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb786083-a3d0-445e-b60a-781f2e833f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:49.243954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb786083-a3d0-445e-b60a-781f2e833f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:49.244491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb786083-a3d0-445e-b60a-781f2e833f7f admin admin] PATH_INFO: `/v3/projects/0dd4d15f423642fa8da604b758048203/users/1157bb6f43474dfa96d91a444d850b67/roles/14c5ef1664374a9aa883c0b6d860b63a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:49.247137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb786083-a3d0-445e-b60a-781f2e833f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd4d15f423642fa8da604b758048203, user_id=1157bb6f43474dfa96d91a444d850b67, role_id=14c5ef1664374a9aa883c0b6d860b63a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:49.250047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb786083-a3d0-445e-b60a-781f2e833f7f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:49.274546 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 466/914] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:32:49 2021] PUT /identity/v3/projects/0dd4d15f423642fa8da604b758048203/users/1157bb6f43474dfa96d91a444d850b67/roles/14c5ef1664374a9aa883c0b6d860b63a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:32:49.392612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bad569-cc88-479d-b4f1-191b8edbccc8 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:49.392981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bad569-cc88-479d-b4f1-191b8edbccc8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:49.393178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bad569-cc88-479d-b4f1-191b8edbccc8 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:49.395267 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 449/915] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:49.401611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29b2b2-a0b8-463c-85fa-5f3fea96352f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:49.401920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29b2b2-a0b8-463c-85fa-5f3fea96352f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:49.402169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29b2b2-a0b8-463c-85fa-5f3fea96352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:49.421289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9c29b2b2-a0b8-463c-85fa-5f3fea96352f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:49.422527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9c29b2b2-a0b8-463c-85fa-5f3fea96352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:49.484620 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 467/916] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:49 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:49.511888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bad569-cc88-479d-b4f1-191b8edbccc8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:49.524198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bad569-cc88-479d-b4f1-191b8edbccc8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:49.528627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933770d5-ac3f-49fa-be29-760627120625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:49.529268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933770d5-ac3f-49fa-be29-760627120625 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:49.529547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933770d5-ac3f-49fa-be29-760627120625 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:49.529818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933770d5-ac3f-49fa-be29-760627120625 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:49.530614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933770d5-ac3f-49fa-be29-760627120625 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:49.532179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933770d5-ac3f-49fa-be29-760627120625 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:49.549254 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 450/917] 10.222.0.13 () {60 vars in 1162 bytes} [Sat Dec 18 20:32:49 2021] POST /identity/v3/services => generated 241 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:32:49.724505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6bc0b-8ad0-4e6e-af43-545d1722036d None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:49.725049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6bc0b-8ad0-4e6e-af43-545d1722036d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:49.725049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6bc0b-8ad0-4e6e-af43-545d1722036d None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:49.727167 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 468/918] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:49.734145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebf16f-6748-4dec-88e5-43a212430991 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:49.734727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebf16f-6748-4dec-88e5-43a212430991 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:49.734727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebf16f-6748-4dec-88e5-43a212430991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:49.754216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-48ebf16f-6748-4dec-88e5-43a212430991 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:49.755793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-48ebf16f-6748-4dec-88e5-43a212430991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:49.774304 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 451/919] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:49 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:32:49.798998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6bc0b-8ad0-4e6e-af43-545d1722036d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:49.813281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6bc0b-8ad0-4e6e-af43-545d1722036d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:49.817906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7614f2-3c56-496b-b683-1d94226b1c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:49.818975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7614f2-3c56-496b-b683-1d94226b1c5d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:49.819467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7614f2-3c56-496b-b683-1d94226b1c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:49.819946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7614f2-3c56-496b-b683-1d94226b1c5d admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:49.820836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7614f2-3c56-496b-b683-1d94226b1c5d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:49.822699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7614f2-3c56-496b-b683-1d94226b1c5d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:49.835065 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-0f7614f2-3c56-496b-b683-1d94226b1c5d admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 18 20:32:49.836867 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 469/920] 10.222.0.13 () {56 vars in 1153 bytes} [Sat Dec 18 20:32:49 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:49.845782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebf16f-6748-4dec-88e5-43a212430991 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:49.852927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebf16f-6748-4dec-88e5-43a212430991 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:49.857945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c5054-5ac2-4100-ad8a-d7623447f739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:49.859727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c5054-5ac2-4100-ad8a-d7623447f739 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:49.860230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c5054-5ac2-4100-ad8a-d7623447f739 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:49.860735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c5054-5ac2-4100-ad8a-d7623447f739 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:49.861949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c5054-5ac2-4100-ad8a-d7623447f739 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:49.862283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c5054-5ac2-4100-ad8a-d7623447f739 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:49.863923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c5054-5ac2-4100-ad8a-d7623447f739 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:49.870091 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 452/921] 10.222.0.13 () {56 vars in 1147 bytes} [Sat Dec 18 20:32:49 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:49.876471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7614f2-3c56-496b-b683-1d94226b1c5d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:49.887004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7614f2-3c56-496b-b683-1d94226b1c5d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:49.891552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e96ee-205a-4b5d-a45f-25a50b0aa874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:49.892214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e96ee-205a-4b5d-a45f-25a50b0aa874 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:49.892503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e96ee-205a-4b5d-a45f-25a50b0aa874 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:49.892784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e96ee-205a-4b5d-a45f-25a50b0aa874 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:49.893508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e96ee-205a-4b5d-a45f-25a50b0aa874 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:49.893822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e96ee-205a-4b5d-a45f-25a50b0aa874 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:49.895430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e96ee-205a-4b5d-a45f-25a50b0aa874 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:49.900678 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 470/922] 10.222.0.13 () {56 vars in 1147 bytes} [Sat Dec 18 20:32:49 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:49.907225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c5054-5ac2-4100-ad8a-d7623447f739 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:49.917609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c5054-5ac2-4100-ad8a-d7623447f739 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:49.922123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ccc25-0f3b-4816-9227-75ce44edb571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:49.922807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ccc25-0f3b-4816-9227-75ce44edb571 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:49.923083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ccc25-0f3b-4816-9227-75ce44edb571 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:49.923364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ccc25-0f3b-4816-9227-75ce44edb571 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:49.924120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ccc25-0f3b-4816-9227-75ce44edb571 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:49.925704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ccc25-0f3b-4816-9227-75ce44edb571 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:49.948929 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 453/923] 10.222.0.13 () {60 vars in 1165 bytes} [Sat Dec 18 20:32:49 2021] POST /identity/v3/endpoints => generated 347 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:32:50.493107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3243c44-dae9-46f3-bece-95982ebdf4cf None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:50.493489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3243c44-dae9-46f3-bece-95982ebdf4cf None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:50.493696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3243c44-dae9-46f3-bece-95982ebdf4cf None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:50.495838 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 471/924] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:50.501774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b58c38-6731-4309-92ad-a96edfa6358c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:50.502067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b58c38-6731-4309-92ad-a96edfa6358c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:50.502388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b58c38-6731-4309-92ad-a96edfa6358c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:50.521038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a6b58c38-6731-4309-92ad-a96edfa6358c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:50.522240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a6b58c38-6731-4309-92ad-a96edfa6358c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:50.540738 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 454/925] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:50 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:50.566848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3243c44-dae9-46f3-bece-95982ebdf4cf None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:50.579564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3243c44-dae9-46f3-bece-95982ebdf4cf None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:50.583995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0f797-362c-415d-86fe-a3b65e7dc9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:50.584771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0f797-362c-415d-86fe-a3b65e7dc9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:50.585056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0f797-362c-415d-86fe-a3b65e7dc9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:50.585336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0f797-362c-415d-86fe-a3b65e7dc9b5 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:50.585996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0f797-362c-415d-86fe-a3b65e7dc9b5 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:50.587624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0f797-362c-415d-86fe-a3b65e7dc9b5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:50.598596 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-0bb0f797-362c-415d-86fe-a3b65e7dc9b5 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 18 20:32:50.600011 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 472/926] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:32:50 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:50.606798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b58c38-6731-4309-92ad-a96edfa6358c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:50.615712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b58c38-6731-4309-92ad-a96edfa6358c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:50.620357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cf8ca-17dd-4929-900c-434e52e2f7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:50.621004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cf8ca-17dd-4929-900c-434e52e2f7fa admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:50.621283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cf8ca-17dd-4929-900c-434e52e2f7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:50.621561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cf8ca-17dd-4929-900c-434e52e2f7fa admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:50.622293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cf8ca-17dd-4929-900c-434e52e2f7fa admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:50.622605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cf8ca-17dd-4929-900c-434e52e2f7fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:50.624209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cf8ca-17dd-4929-900c-434e52e2f7fa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:50.629186 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 455/927] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:32:50 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:50.635109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0f797-362c-415d-86fe-a3b65e7dc9b5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:50.645818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0f797-362c-415d-86fe-a3b65e7dc9b5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:50.650674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72cc1f-f5db-4134-bfd2-599de4739314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:50.651460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72cc1f-f5db-4134-bfd2-599de4739314 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:50.651787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72cc1f-f5db-4134-bfd2-599de4739314 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:50.652073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72cc1f-f5db-4134-bfd2-599de4739314 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:50.652789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72cc1f-f5db-4134-bfd2-599de4739314 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:50.653097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72cc1f-f5db-4134-bfd2-599de4739314 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:50.654750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72cc1f-f5db-4134-bfd2-599de4739314 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:50.660025 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 473/928] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:32:50 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:50.666118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cf8ca-17dd-4929-900c-434e52e2f7fa admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:50.676483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cf8ca-17dd-4929-900c-434e52e2f7fa admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:50.681538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3229deb-6b89-4291-a743-24c8681eae64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:50.682312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3229deb-6b89-4291-a743-24c8681eae64 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:50.683228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3229deb-6b89-4291-a743-24c8681eae64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:50.683512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3229deb-6b89-4291-a743-24c8681eae64 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:50.684357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3229deb-6b89-4291-a743-24c8681eae64 admin admin] RBAC: Adding query filter params (interface=public, service_id=91721a9b806940c99062575dbd40752a, region_id=RegionOne) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:50.684670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3229deb-6b89-4291-a743-24c8681eae64 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:50.686584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3229deb-6b89-4291-a743-24c8681eae64 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:50.692277 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 456/929] 10.222.0.13 () {56 vars in 1272 bytes} [Sat Dec 18 20:32:50 2021] GET /identity/v3/endpoints?service_id=91721a9b806940c99062575dbd40752a&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:50.698234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72cc1f-f5db-4134-bfd2-599de4739314 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:50.708378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72cc1f-f5db-4134-bfd2-599de4739314 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:50.714080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335a5f3-6992-4143-972c-c84f5b84cb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:50.714080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335a5f3-6992-4143-972c-c84f5b84cb40 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:50.715055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335a5f3-6992-4143-972c-c84f5b84cb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:50.715055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335a5f3-6992-4143-972c-c84f5b84cb40 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:50.715363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335a5f3-6992-4143-972c-c84f5b84cb40 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:50.718470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335a5f3-6992-4143-972c-c84f5b84cb40 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:50.724231 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 474/930] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Dec 18 20:32:50 2021] GET /identity/v3/services => generated 1497 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:32:51.916943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d9ca8-333e-4ce8-92d4-4e5e496196ef None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:51.917489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d9ca8-333e-4ce8-92d4-4e5e496196ef None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:51.917489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d9ca8-333e-4ce8-92d4-4e5e496196ef None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:51.919731 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 457/931] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:32:51.925991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc7483-860b-4cdf-b1be-777fcf7de4c0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:51.926468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc7483-860b-4cdf-b1be-777fcf7de4c0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:51.926563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc7483-860b-4cdf-b1be-777fcf7de4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:51.945058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f1cc7483-860b-4cdf-b1be-777fcf7de4c0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:51.946559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f1cc7483-860b-4cdf-b1be-777fcf7de4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:51.955793 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 475/932] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:51 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:51.981644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d9ca8-333e-4ce8-92d4-4e5e496196ef None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:51.994015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d9ca8-333e-4ce8-92d4-4e5e496196ef None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:51.998782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1a4bd-0ddf-4acf-b79b-b563fc9b0171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:51.999574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1a4bd-0ddf-4acf-b79b-b563fc9b0171 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:51.999850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1a4bd-0ddf-4acf-b79b-b563fc9b0171 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.000121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1a4bd-0ddf-4acf-b79b-b563fc9b0171 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.011129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1a4bd-0ddf-4acf-b79b-b563fc9b0171 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:32:52.018127 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-20d1a4bd-0ddf-4acf-b79b-b563fc9b0171 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 18 20:32:52.019609 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 458/933] 10.222.0.13 () {56 vars in 1141 bytes} [Sat Dec 18 20:32:51 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:52.025858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc7483-860b-4cdf-b1be-777fcf7de4c0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.035593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc7483-860b-4cdf-b1be-777fcf7de4c0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.040198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c627082-e514-4961-b51c-1d2267bc6e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.040869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c627082-e514-4961-b51c-1d2267bc6e86 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.041150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c627082-e514-4961-b51c-1d2267bc6e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.041423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c627082-e514-4961-b51c-1d2267bc6e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.042230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c627082-e514-4961-b51c-1d2267bc6e86 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:52.042573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c627082-e514-4961-b51c-1d2267bc6e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.044183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c627082-e514-4961-b51c-1d2267bc6e86 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.053870 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 476/934] 10.222.0.13 () {56 vars in 1136 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:52.060188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1a4bd-0ddf-4acf-b79b-b563fc9b0171 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.070744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1a4bd-0ddf-4acf-b79b-b563fc9b0171 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.075826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694ba97-88a9-437a-b8ac-11b195f64469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.076590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694ba97-88a9-437a-b8ac-11b195f64469 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.076864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694ba97-88a9-437a-b8ac-11b195f64469 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.077130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694ba97-88a9-437a-b8ac-11b195f64469 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.088128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694ba97-88a9-437a-b8ac-11b195f64469 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.090382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694ba97-88a9-437a-b8ac-11b195f64469 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.107946 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-1694ba97-88a9-437a-b8ac-11b195f64469 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:52.109436 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 459/935] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:52.115445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c627082-e514-4961-b51c-1d2267bc6e86 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.125751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c627082-e514-4961-b51c-1d2267bc6e86 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.130341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac94b6d-5519-479d-8238-f6c7859eba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.130989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac94b6d-5519-479d-8238-f6c7859eba3c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.131271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac94b6d-5519-479d-8238-f6c7859eba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.131544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac94b6d-5519-479d-8238-f6c7859eba3c admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.132276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac94b6d-5519-479d-8238-f6c7859eba3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:52.132580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac94b6d-5519-479d-8238-f6c7859eba3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.134150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac94b6d-5519-479d-8238-f6c7859eba3c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.146000 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 477/936] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:52.152098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694ba97-88a9-437a-b8ac-11b195f64469 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.162018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694ba97-88a9-437a-b8ac-11b195f64469 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.167263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80b907-d96f-441e-96a8-36e7e60b3e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.168077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80b907-d96f-441e-96a8-36e7e60b3e62 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.168358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80b907-d96f-441e-96a8-36e7e60b3e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.168633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80b907-d96f-441e-96a8-36e7e60b3e62 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.176974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80b907-d96f-441e-96a8-36e7e60b3e62 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.179125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80b907-d96f-441e-96a8-36e7e60b3e62 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.195795 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-2f80b907-d96f-441e-96a8-36e7e60b3e62 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 18 20:32:52.197400 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 460/937] 10.222.0.13 () {56 vars in 1138 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:52.202195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e3f8b-0c9f-4fed-957a-aab78e9caa22 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.202551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e3f8b-0c9f-4fed-957a-aab78e9caa22 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.202880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e3f8b-0c9f-4fed-957a-aab78e9caa22 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.204729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80b907-d96f-441e-96a8-36e7e60b3e62 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.207078 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 478/938] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:52 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:32:52.214934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d3b8f-6834-4120-ac27-f70c7a19a7ab None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.215340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d3b8f-6834-4120-ac27-f70c7a19a7ab None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.215691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d3b8f-6834-4120-ac27-f70c7a19a7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.220415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80b907-d96f-441e-96a8-36e7e60b3e62 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.226708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c543a-38b3-446a-bc2e-fa11927951d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.227588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c543a-38b3-446a-bc2e-fa11927951d9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.228018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c543a-38b3-446a-bc2e-fa11927951d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.228453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c543a-38b3-446a-bc2e-fa11927951d9 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.229478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c543a-38b3-446a-bc2e-fa11927951d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:52.229788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c543a-38b3-446a-bc2e-fa11927951d9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.232496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c543a-38b3-446a-bc2e-fa11927951d9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.236601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3d2d3b8f-6834-4120-ac27-f70c7a19a7ab None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:52.238036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3d2d3b8f-6834-4120-ac27-f70c7a19a7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:52.251175 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 461/940] 10.222.0.13 () {56 vars in 1170 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:52.251472 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 479/940] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:52 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:52.257126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c543a-38b3-446a-bc2e-fa11927951d9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.267134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c543a-38b3-446a-bc2e-fa11927951d9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.271845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849090f3-9dce-40f8-b81d-948d6af2e77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.272841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849090f3-9dce-40f8-b81d-948d6af2e77d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.272841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849090f3-9dce-40f8-b81d-948d6af2e77d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.272999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849090f3-9dce-40f8-b81d-948d6af2e77d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.280476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d3b8f-6834-4120-ac27-f70c7a19a7ab None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.283108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849090f3-9dce-40f8-b81d-948d6af2e77d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.284871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849090f3-9dce-40f8-b81d-948d6af2e77d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.290412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d3b8f-6834-4120-ac27-f70c7a19a7ab None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.294283 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 462/941] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:32:52.297148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b4700-3dc7-4d53-9506-324a61ceff57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.298244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b4700-3dc7-4d53-9506-324a61ceff57 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.298866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b4700-3dc7-4d53-9506-324a61ceff57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.299409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b4700-3dc7-4d53-9506-324a61ceff57 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.302520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b4700-3dc7-4d53-9506-324a61ceff57 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.302615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849090f3-9dce-40f8-b81d-948d6af2e77d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.302834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b4700-3dc7-4d53-9506-324a61ceff57 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.310945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849090f3-9dce-40f8-b81d-948d6af2e77d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.318166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ca980-9e66-4786-a3b0-b44a3b91fde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.319020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ca980-9e66-4786-a3b0-b44a3b91fde9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.319296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ca980-9e66-4786-a3b0-b44a3b91fde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.319568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ca980-9e66-4786-a3b0-b44a3b91fde9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.321498 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-5e8b4700-3dc7-4d53-9506-324a61ceff57 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 18 20:32:52.329037 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 480/942] 10.222.0.13 () {56 vars in 1147 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/services/object-store => generated 93 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:32:52.330667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b4700-3dc7-4d53-9506-324a61ceff57 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.331499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ca980-9e66-4786-a3b0-b44a3b91fde9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.333341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ca980-9e66-4786-a3b0-b44a3b91fde9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.340963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b4700-3dc7-4d53-9506-324a61ceff57 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.345930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c9523-7270-4326-ae8e-ae8c0be08085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.346900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c9523-7270-4326-ae8e-ae8c0be08085 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.347404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c9523-7270-4326-ae8e-ae8c0be08085 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.347889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c9523-7270-4326-ae8e-ae8c0be08085 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.348795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c9523-7270-4326-ae8e-ae8c0be08085 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:52.349298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c9523-7270-4326-ae8e-ae8c0be08085 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.351114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c9523-7270-4326-ae8e-ae8c0be08085 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.352049 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-d37ca980-9e66-4786-a3b0-b44a3b91fde9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:32:52.353534 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 463/943] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:52.362112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ca980-9e66-4786-a3b0-b44a3b91fde9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.362395 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 481/944] 10.222.0.13 () {56 vars in 1143 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:52.363794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c9523-7270-4326-ae8e-ae8c0be08085 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.368839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ca980-9e66-4786-a3b0-b44a3b91fde9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.373863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0e52c-42c1-4c7d-8503-921e1f90b05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.374522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0e52c-42c1-4c7d-8503-921e1f90b05f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.374800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0e52c-42c1-4c7d-8503-921e1f90b05f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.375071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0e52c-42c1-4c7d-8503-921e1f90b05f admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.375546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c9523-7270-4326-ae8e-ae8c0be08085 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.375788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0e52c-42c1-4c7d-8503-921e1f90b05f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:52.376088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0e52c-42c1-4c7d-8503-921e1f90b05f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.377827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0e52c-42c1-4c7d-8503-921e1f90b05f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.381346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65feb70-36ec-4d9b-a9b6-73bcee168389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.382368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65feb70-36ec-4d9b-a9b6-73bcee168389 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.382862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65feb70-36ec-4d9b-a9b6-73bcee168389 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.383382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65feb70-36ec-4d9b-a9b6-73bcee168389 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.384281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65feb70-36ec-4d9b-a9b6-73bcee168389 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:52.384833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65feb70-36ec-4d9b-a9b6-73bcee168389 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.386741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65feb70-36ec-4d9b-a9b6-73bcee168389 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.389653 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 464/945] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:52.397901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0e52c-42c1-4c7d-8503-921e1f90b05f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.398202 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 482/946] 10.222.0.13 () {56 vars in 1143 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:52.399547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65feb70-36ec-4d9b-a9b6-73bcee168389 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.407770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0e52c-42c1-4c7d-8503-921e1f90b05f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.412279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c8bd2-9f0d-4234-b5da-ddef32c85da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.412536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65feb70-36ec-4d9b-a9b6-73bcee168389 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.413044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c8bd2-9f0d-4234-b5da-ddef32c85da9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.413320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c8bd2-9f0d-4234-b5da-ddef32c85da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.413591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c8bd2-9f0d-4234-b5da-ddef32c85da9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.418843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936edd8-731d-446d-950c-e5cb5c3be85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.419730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936edd8-731d-446d-950c-e5cb5c3be85a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.420254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936edd8-731d-446d-950c-e5cb5c3be85a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.420730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936edd8-731d-446d-950c-e5cb5c3be85a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.421271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c8bd2-9f0d-4234-b5da-ddef32c85da9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.421988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936edd8-731d-446d-950c-e5cb5c3be85a admin admin] RBAC: Adding query filter params (interface=public, service_id=7146178f80da4b6e90f3d3d46a974962, region_id=RegionOne) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:52.422579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936edd8-731d-446d-950c-e5cb5c3be85a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.423242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c8bd2-9f0d-4234-b5da-ddef32c85da9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.424597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936edd8-731d-446d-950c-e5cb5c3be85a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.435311 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 483/947] 10.222.0.13 () {56 vars in 1272 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/endpoints?service_id=7146178f80da4b6e90f3d3d46a974962&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:52.436966 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-ec4c8bd2-9f0d-4234-b5da-ddef32c85da9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:52.438439 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 465/948] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:52.439506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936edd8-731d-446d-950c-e5cb5c3be85a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.447616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c8bd2-9f0d-4234-b5da-ddef32c85da9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.449636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936edd8-731d-446d-950c-e5cb5c3be85a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.454542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57024793-b1a7-42c3-8be0-1fe91032c6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.455402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57024793-b1a7-42c3-8be0-1fe91032c6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.455879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57024793-b1a7-42c3-8be0-1fe91032c6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.456349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57024793-b1a7-42c3-8be0-1fe91032c6f2 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.457236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57024793-b1a7-42c3-8be0-1fe91032c6f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.457404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c8bd2-9f0d-4234-b5da-ddef32c85da9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.459586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57024793-b1a7-42c3-8be0-1fe91032c6f2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.462525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1da3a-5696-4632-b915-95898373bcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.463161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1da3a-5696-4632-b915-95898373bcbd admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.464201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1da3a-5696-4632-b915-95898373bcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.464484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1da3a-5696-4632-b915-95898373bcbd admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.465268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1da3a-5696-4632-b915-95898373bcbd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:52.465576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1da3a-5696-4632-b915-95898373bcbd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.467421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1da3a-5696-4632-b915-95898373bcbd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.474316 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 484/949] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:32:52.480724 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 466/950] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:52.487469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57024793-b1a7-42c3-8be0-1fe91032c6f2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.497739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57024793-b1a7-42c3-8be0-1fe91032c6f2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.502569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2040a45-e695-4d45-887c-8784a930c8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.503237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2040a45-e695-4d45-887c-8784a930c8ad admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.503517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2040a45-e695-4d45-887c-8784a930c8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.503788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2040a45-e695-4d45-887c-8784a930c8ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.504636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2040a45-e695-4d45-887c-8784a930c8ad admin admin] RBAC: Adding query filter params (role.id=14c5ef1664374a9aa883c0b6d860b63a, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=1157bb6f43474dfa96d91a444d850b67) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:52.504931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2040a45-e695-4d45-887c-8784a930c8ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.506816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2040a45-e695-4d45-887c-8784a930c8ad admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.513735 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 485/951] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/role_assignments?user.id=1157bb6f43474dfa96d91a444d850b67&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=14c5ef1664374a9aa883c0b6d860b63a => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:52.634615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b625815-f397-4f03-a639-520ecef98907 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.635018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b625815-f397-4f03-a639-520ecef98907 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.635189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b625815-f397-4f03-a639-520ecef98907 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.637402 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 467/952] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:52.643939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb227c9-8bde-41ee-adcd-2bdec7349632 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.644227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb227c9-8bde-41ee-adcd-2bdec7349632 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.644504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb227c9-8bde-41ee-adcd-2bdec7349632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.665117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5eb227c9-8bde-41ee-adcd-2bdec7349632 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:52.666384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5eb227c9-8bde-41ee-adcd-2bdec7349632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:52.675286 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 486/953] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:52 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:52.700758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b625815-f397-4f03-a639-520ecef98907 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.714008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b625815-f397-4f03-a639-520ecef98907 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.723027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bfbd6-cbe3-4b4e-a69e-5194c663eaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.723437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bfbd6-cbe3-4b4e-a69e-5194c663eaea admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.723911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bfbd6-cbe3-4b4e-a69e-5194c663eaea admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.724194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bfbd6-cbe3-4b4e-a69e-5194c663eaea admin admin] PATH_INFO: `/v3/services/compute` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.724876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bfbd6-cbe3-4b4e-a69e-5194c663eaea admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.726541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bfbd6-cbe3-4b4e-a69e-5194c663eaea admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.740408 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-099bfbd6-cbe3-4b4e-a69e-5194c663eaea admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 18 20:32:52.741916 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 468/954] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/services/compute => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:52.748494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb227c9-8bde-41ee-adcd-2bdec7349632 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.758701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb227c9-8bde-41ee-adcd-2bdec7349632 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.765361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e3c41-3d91-4ea3-ac52-52bea261e783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.766038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e3c41-3d91-4ea3-ac52-52bea261e783 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.766459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e3c41-3d91-4ea3-ac52-52bea261e783 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.766772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e3c41-3d91-4ea3-ac52-52bea261e783 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.767572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e3c41-3d91-4ea3-ac52-52bea261e783 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:52.767883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e3c41-3d91-4ea3-ac52-52bea261e783 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.769710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e3c41-3d91-4ea3-ac52-52bea261e783 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.775448 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 487/955] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:52.781495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bfbd6-cbe3-4b4e-a69e-5194c663eaea admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:52.791436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bfbd6-cbe3-4b4e-a69e-5194c663eaea admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:52.796606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2064c0-9f64-4bc8-94d8-cec5c5a102fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:52.797259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2064c0-9f64-4bc8-94d8-cec5c5a102fe admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:52.797551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2064c0-9f64-4bc8-94d8-cec5c5a102fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:52.797824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2064c0-9f64-4bc8-94d8-cec5c5a102fe admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:52.798596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2064c0-9f64-4bc8-94d8-cec5c5a102fe admin admin] RBAC: Adding query filter params (type=compute) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:52.798909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2064c0-9f64-4bc8-94d8-cec5c5a102fe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:52.800492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2064c0-9f64-4bc8-94d8-cec5c5a102fe admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:52.805364 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 469/956] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Dec 18 20:32:52 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:53.401488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e047e6-5324-4f3c-863f-3f9b039f1371 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:53.402008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e047e6-5324-4f3c-863f-3f9b039f1371 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:53.402360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e047e6-5324-4f3c-863f-3f9b039f1371 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:53.404500 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 488/957] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:53.410412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221b262-34a2-4214-8a28-3ae65ba7a174 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:53.410821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221b262-34a2-4214-8a28-3ae65ba7a174 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:53.411146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221b262-34a2-4214-8a28-3ae65ba7a174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:53.429519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2221b262-34a2-4214-8a28-3ae65ba7a174 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:53.430866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2221b262-34a2-4214-8a28-3ae65ba7a174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:53.442338 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 470/958] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:53 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:53.464862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e047e6-5324-4f3c-863f-3f9b039f1371 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:53.477102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e047e6-5324-4f3c-863f-3f9b039f1371 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:53.482265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82543fc6-170b-4c2a-be2c-ae25bd4dcce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:53.483133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82543fc6-170b-4c2a-be2c-ae25bd4dcce3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:53.483478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82543fc6-170b-4c2a-be2c-ae25bd4dcce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:53.483817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82543fc6-170b-4c2a-be2c-ae25bd4dcce3 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:53.484547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82543fc6-170b-4c2a-be2c-ae25bd4dcce3 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:53.486183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82543fc6-170b-4c2a-be2c-ae25bd4dcce3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:53.497145 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-82543fc6-170b-4c2a-be2c-ae25bd4dcce3 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 18 20:32:53.502366 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 489/959] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:32:53 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:53.505170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221b262-34a2-4214-8a28-3ae65ba7a174 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:53.514881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221b262-34a2-4214-8a28-3ae65ba7a174 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:53.519436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61419c0-de46-491d-8cd6-e27c55a37796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:53.520083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61419c0-de46-491d-8cd6-e27c55a37796 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:53.520359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61419c0-de46-491d-8cd6-e27c55a37796 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:53.520628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61419c0-de46-491d-8cd6-e27c55a37796 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:53.521333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61419c0-de46-491d-8cd6-e27c55a37796 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:53.521632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61419c0-de46-491d-8cd6-e27c55a37796 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:53.523227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61419c0-de46-491d-8cd6-e27c55a37796 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:53.533082 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 471/960] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:32:53 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:53.534455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82543fc6-170b-4c2a-be2c-ae25bd4dcce3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:53.544489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82543fc6-170b-4c2a-be2c-ae25bd4dcce3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:53.549117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46424b-2194-4c2c-a511-33150596a1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:53.549767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46424b-2194-4c2c-a511-33150596a1bd admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:53.550047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46424b-2194-4c2c-a511-33150596a1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:53.550420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46424b-2194-4c2c-a511-33150596a1bd admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:53.551188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46424b-2194-4c2c-a511-33150596a1bd admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:53.551494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46424b-2194-4c2c-a511-33150596a1bd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:53.553122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46424b-2194-4c2c-a511-33150596a1bd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:53.563992 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 490/961] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Dec 18 20:32:53 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:53.565318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61419c0-de46-491d-8cd6-e27c55a37796 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:53.576152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61419c0-de46-491d-8cd6-e27c55a37796 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:53.580858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50307270-002e-41cd-b5e0-fd307420f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:53.581551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50307270-002e-41cd-b5e0-fd307420f852 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:53.581831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50307270-002e-41cd-b5e0-fd307420f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:53.582101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50307270-002e-41cd-b5e0-fd307420f852 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:53.582928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50307270-002e-41cd-b5e0-fd307420f852 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:53.584552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50307270-002e-41cd-b5e0-fd307420f852 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:53.607183 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 472/962] 10.222.0.13 () {60 vars in 1165 bytes} [Sat Dec 18 20:32:53 2021] POST /identity/v3/endpoints => generated 346 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:32:54.989803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e2d4c-daa0-4eff-895c-2bfc2af8472c None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:54.990358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e2d4c-daa0-4eff-895c-2bfc2af8472c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:54.990358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e2d4c-daa0-4eff-895c-2bfc2af8472c None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:54.992026 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 491/963] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:54.998192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14711c-964d-4ceb-b4f3-bc4c435bb1fb None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:54.998673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14711c-964d-4ceb-b4f3-bc4c435bb1fb None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:54.998785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14711c-964d-4ceb-b4f3-bc4c435bb1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:55.016929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1b14711c-964d-4ceb-b4f3-bc4c435bb1fb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:55.018088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1b14711c-964d-4ceb-b4f3-bc4c435bb1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:55.042381 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 473/964] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:54 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:55.060158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e2d4c-daa0-4eff-895c-2bfc2af8472c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:55.072743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e2d4c-daa0-4eff-895c-2bfc2af8472c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:55.077667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b523bd2-4167-41ed-bbc9-99125efbad4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:55.078516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523bd2-4167-41ed-bbc9-99125efbad4f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:55.078797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523bd2-4167-41ed-bbc9-99125efbad4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:55.079072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523bd2-4167-41ed-bbc9-99125efbad4f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:55.079730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b523bd2-4167-41ed-bbc9-99125efbad4f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:55.081289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b523bd2-4167-41ed-bbc9-99125efbad4f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:55.092811 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-0b523bd2-4167-41ed-bbc9-99125efbad4f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 18 20:32:55.098358 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 492/965] 10.222.0.13 () {56 vars in 1147 bytes} [Sat Dec 18 20:32:55 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:55.100774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14711c-964d-4ceb-b4f3-bc4c435bb1fb None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:55.109774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14711c-964d-4ceb-b4f3-bc4c435bb1fb None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:55.114374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b170a05-da7b-4204-a447-db2c521d8d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:55.115027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b170a05-da7b-4204-a447-db2c521d8d60 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:55.115301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b170a05-da7b-4204-a447-db2c521d8d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:55.115576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b170a05-da7b-4204-a447-db2c521d8d60 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:55.116293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b170a05-da7b-4204-a447-db2c521d8d60 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:55.116594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b170a05-da7b-4204-a447-db2c521d8d60 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:55.118173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b170a05-da7b-4204-a447-db2c521d8d60 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:55.128559 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 474/966] 10.222.0.13 () {56 vars in 1143 bytes} [Sat Dec 18 20:32:55 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:55.129928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b523bd2-4167-41ed-bbc9-99125efbad4f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:55.140646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b523bd2-4167-41ed-bbc9-99125efbad4f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:55.145155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fb368-8a10-4611-9cd6-8c807289346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:55.145799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fb368-8a10-4611-9cd6-8c807289346a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:55.146079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fb368-8a10-4611-9cd6-8c807289346a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:55.146387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fb368-8a10-4611-9cd6-8c807289346a admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:55.147089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091fb368-8a10-4611-9cd6-8c807289346a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:55.147397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091fb368-8a10-4611-9cd6-8c807289346a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:55.148956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091fb368-8a10-4611-9cd6-8c807289346a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:55.155819 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 493/967] 10.222.0.13 () {56 vars in 1143 bytes} [Sat Dec 18 20:32:55 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:55.159915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57bdca-182c-44ff-b951-96c236973979 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:55.160250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57bdca-182c-44ff-b951-96c236973979 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:55.160540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57bdca-182c-44ff-b951-96c236973979 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:55.162424 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 475/968] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:55.163160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fb368-8a10-4611-9cd6-8c807289346a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:55.171148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f1c73-0d9a-4ad8-a56c-2a9bf5190b64 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:55.171747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f1c73-0d9a-4ad8-a56c-2a9bf5190b64 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:55.172220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f1c73-0d9a-4ad8-a56c-2a9bf5190b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:55.173885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fb368-8a10-4611-9cd6-8c807289346a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:55.178357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438bdc0-f675-4e33-bfe2-413cd88587dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:55.178994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438bdc0-f675-4e33-bfe2-413cd88587dd admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:55.179293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438bdc0-f675-4e33-bfe2-413cd88587dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:55.179552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438bdc0-f675-4e33-bfe2-413cd88587dd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:55.180281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438bdc0-f675-4e33-bfe2-413cd88587dd admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:55.181844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438bdc0-f675-4e33-bfe2-413cd88587dd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:55.193984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f03f1c73-0d9a-4ad8-a56c-2a9bf5190b64 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:55.195570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f03f1c73-0d9a-4ad8-a56c-2a9bf5190b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:55.205437 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 494/969] 10.222.0.13 () {60 vars in 1165 bytes} [Sat Dec 18 20:32:55 2021] POST /identity/v3/endpoints => generated 349 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:32:55.206397 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 476/970] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:55 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:32:55.230683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438bdc0-f675-4e33-bfe2-413cd88587dd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:55.252251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438bdc0-f675-4e33-bfe2-413cd88587dd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:55.258578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbebbe-7cd6-4d23-af5c-d90c4821b554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:55.260081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbebbe-7cd6-4d23-af5c-d90c4821b554 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:55.260961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbebbe-7cd6-4d23-af5c-d90c4821b554 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:55.261243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbebbe-7cd6-4d23-af5c-d90c4821b554 admin admin] PATH_INFO: `/v3/services/image` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:55.261929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbebbe-7cd6-4d23-af5c-d90c4821b554 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:55.263760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbebbe-7cd6-4d23-af5c-d90c4821b554 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:55.277766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bae2ef-1912-4d38-97db-e3f70353863d None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:55.278024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bae2ef-1912-4d38-97db-e3f70353863d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:55.278381 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-aabbebbe-7cd6-4d23-af5c-d90c4821b554 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 18 20:32:55.278589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bae2ef-1912-4d38-97db-e3f70353863d None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:55.281338 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 477/972] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:55 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:32:55.285905 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 495/972] 10.222.0.13 () {56 vars in 1126 bytes} [Sat Dec 18 20:32:55 2021] GET /identity/v3/services/image => generated 86 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:55.287531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbebbe-7cd6-4d23-af5c-d90c4821b554 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:55.287962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3281be-246b-492c-9f8b-36d8bbfa142f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:55.288352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3281be-246b-492c-9f8b-36d8bbfa142f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:55.288732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3281be-246b-492c-9f8b-36d8bbfa142f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:55.298050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbebbe-7cd6-4d23-af5c-d90c4821b554 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:55.303944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94f5ff-705e-4121-85b9-8e8f29e4e72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:55.304790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94f5ff-705e-4121-85b9-8e8f29e4e72b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:55.305208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94f5ff-705e-4121-85b9-8e8f29e4e72b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:55.305615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94f5ff-705e-4121-85b9-8e8f29e4e72b admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:55.306454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94f5ff-705e-4121-85b9-8e8f29e4e72b admin admin] RBAC: Adding query filter params (name=image) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:55.306769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94f5ff-705e-4121-85b9-8e8f29e4e72b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:55.309248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1c3281be-246b-492c-9f8b-36d8bbfa142f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:55.309418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94f5ff-705e-4121-85b9-8e8f29e4e72b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:55.311144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1c3281be-246b-492c-9f8b-36d8bbfa142f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:55.321269 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 496/973] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:55 2021] GET /identity/v3/services?name=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:55.323212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94f5ff-705e-4121-85b9-8e8f29e4e72b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:55.327329 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 478/974] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:55 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:55.336497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94f5ff-705e-4121-85b9-8e8f29e4e72b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:55.342020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e293b9-6ad5-4714-9354-6abc3d951641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:55.342989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e293b9-6ad5-4714-9354-6abc3d951641 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:55.343550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e293b9-6ad5-4714-9354-6abc3d951641 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:55.344081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e293b9-6ad5-4714-9354-6abc3d951641 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:55.345044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e293b9-6ad5-4714-9354-6abc3d951641 admin admin] RBAC: Adding query filter params (type=image) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:55.345564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e293b9-6ad5-4714-9354-6abc3d951641 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:55.347767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e293b9-6ad5-4714-9354-6abc3d951641 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:55.349061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3281be-246b-492c-9f8b-36d8bbfa142f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:55.360636 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 497/975] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:32:55 2021] GET /identity/v3/services?type=image => generated 122 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:55.364663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3281be-246b-492c-9f8b-36d8bbfa142f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:55.369672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8f40a-1269-4d5d-b6f8-7dd025b4c5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:55.370535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8f40a-1269-4d5d-b6f8-7dd025b4c5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:55.370826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8f40a-1269-4d5d-b6f8-7dd025b4c5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:55.371107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8f40a-1269-4d5d-b6f8-7dd025b4c5a9 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:55.371893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8f40a-1269-4d5d-b6f8-7dd025b4c5a9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:55.373603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8f40a-1269-4d5d-b6f8-7dd025b4c5a9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:55.391758 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 479/976] 10.222.0.13 () {60 vars in 1162 bytes} [Sat Dec 18 20:32:55 2021] POST /identity/v3/services => generated 242 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:32:56.177551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbb301-e36d-4727-9775-095a5f20fef7 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:56.178627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbb301-e36d-4727-9775-095a5f20fef7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:56.179110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbb301-e36d-4727-9775-095a5f20fef7 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:56.181298 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 498/977] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:56.189046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47d9e9-3d1b-43e9-b868-6848cbca1339 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:56.189884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47d9e9-3d1b-43e9-b868-6848cbca1339 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:56.190459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47d9e9-3d1b-43e9-b868-6848cbca1339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:56.209296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9e47d9e9-3d1b-43e9-b868-6848cbca1339 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:56.210527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9e47d9e9-3d1b-43e9-b868-6848cbca1339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:56.228574 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 480/978] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:56 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:56.254636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbb301-e36d-4727-9775-095a5f20fef7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:56.267753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbb301-e36d-4727-9775-095a5f20fef7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:56.272773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67f46a-7b26-4d1f-876e-388658932852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:56.273646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67f46a-7b26-4d1f-876e-388658932852 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:56.274121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67f46a-7b26-4d1f-876e-388658932852 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:56.274630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67f46a-7b26-4d1f-876e-388658932852 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:56.275555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67f46a-7b26-4d1f-876e-388658932852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:56.278087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67f46a-7b26-4d1f-876e-388658932852 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:56.279750 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.common [None req-9a67f46a-7b26-4d1f-876e-388658932852 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 18 20:32:56.299398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.sql.core [None req-9a67f46a-7b26-4d1f-876e-388658932852 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Dec 18 20:32:56.299398 ncdv-master-1 devstack@keystone.service[96645]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 18 20:32:56.299398 ncdv-master-1 devstack@keystone.service[96645]: [parameters: {'id': 'aa06154648f34ff1ba474a654208f16c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 18 20:32:56.299398 ncdv-master-1 devstack@keystone.service[96645]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96645) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 18 20:32:56.306524 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-9a67f46a-7b26-4d1f-876e-388658932852 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aa06154648f34ff1ba474a654208f16c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aa06154648f34ff1ba474a654208f16c. Dec 18 20:32:56.308445 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 499/979] 10.222.0.13 () {60 vars in 1161 bytes} [Sat Dec 18 20:32:56 2021] POST /identity/v3/projects => generated 262 bytes in 54 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:56.315432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47d9e9-3d1b-43e9-b868-6848cbca1339 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:56.324844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47d9e9-3d1b-43e9-b868-6848cbca1339 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:56.329743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7594f-4ff7-44fa-910d-def98bb16205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:56.330821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7594f-4ff7-44fa-910d-def98bb16205 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:56.331299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7594f-4ff7-44fa-910d-def98bb16205 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:56.331766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7594f-4ff7-44fa-910d-def98bb16205 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:56.339892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7594f-4ff7-44fa-910d-def98bb16205 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:56.342682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7594f-4ff7-44fa-910d-def98bb16205 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:56.357489 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-bde7594f-4ff7-44fa-910d-def98bb16205 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:32:56.359074 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 481/980] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:56.366164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67f46a-7b26-4d1f-876e-388658932852 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:56.377356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67f46a-7b26-4d1f-876e-388658932852 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:56.382655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92bab1-ac32-465f-a0a6-7c9e075cf08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:56.383590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92bab1-ac32-465f-a0a6-7c9e075cf08d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:56.384087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92bab1-ac32-465f-a0a6-7c9e075cf08d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:56.384588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92bab1-ac32-465f-a0a6-7c9e075cf08d admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:56.386075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92bab1-ac32-465f-a0a6-7c9e075cf08d admin admin] RBAC: Adding query filter params (name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:56.386608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92bab1-ac32-465f-a0a6-7c9e075cf08d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:56.389180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92bab1-ac32-465f-a0a6-7c9e075cf08d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:56.411511 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 500/981] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Dec 18 20:32:56 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:57.917063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec0f8f-6766-447d-b1a4-ac872f8cbc5e None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:57.917063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec0f8f-6766-447d-b1a4-ac872f8cbc5e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:57.917063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec0f8f-6766-447d-b1a4-ac872f8cbc5e None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:57.917834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49728dd-c0fb-41d2-8d86-67866d993901 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:57.917834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49728dd-c0fb-41d2-8d86-67866d993901 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:57.917834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49728dd-c0fb-41d2-8d86-67866d993901 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:57.918431 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 482/982] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:57.919148 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 501/983] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:57.920962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7726e9c-4711-4480-b387-eace2e9dbb48 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:57.921253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7726e9c-4711-4480-b387-eace2e9dbb48 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:57.921532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7726e9c-4711-4480-b387-eace2e9dbb48 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:57.922505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e37d86-89a7-4ef6-b1cc-40334d271e0f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:57.922792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e37d86-89a7-4ef6-b1cc-40334d271e0f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:57.923069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e37d86-89a7-4ef6-b1cc-40334d271e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:57.923444 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 483/984] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:57.926825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168c210-3104-4ca6-b759-120c4be5dda2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:57.927108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168c210-3104-4ca6-b759-120c4be5dda2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:57.927371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168c210-3104-4ca6-b759-120c4be5dda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:57.946617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-20e37d86-89a7-4ef6-b1cc-40334d271e0f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:57.947180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f168c210-3104-4ca6-b759-120c4be5dda2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:57.948313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-20e37d86-89a7-4ef6-b1cc-40334d271e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:57.948439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f168c210-3104-4ca6-b759-120c4be5dda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:57.956064 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 484/985] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:57 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:57.957109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32953bf1-8a44-4413-8581-eee7750c5cc4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:57.957393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32953bf1-8a44-4413-8581-eee7750c5cc4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:57.957668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32953bf1-8a44-4413-8581-eee7750c5cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:57.959035 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 502/986] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:57 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:32:57.981848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-32953bf1-8a44-4413-8581-eee7750c5cc4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:57.983519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-32953bf1-8a44-4413-8581-eee7750c5cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:57.988425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e37d86-89a7-4ef6-b1cc-40334d271e0f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:57.998306 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 485/987] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:57 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:32:57.999491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32953bf1-8a44-4413-8581-eee7750c5cc4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:57.999619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e37d86-89a7-4ef6-b1cc-40334d271e0f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:58.004180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ece280-b343-4bd5-8b28-12b6869c7cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:58.004979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ece280-b343-4bd5-8b28-12b6869c7cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:58.005285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ece280-b343-4bd5-8b28-12b6869c7cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:58.005537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ece280-b343-4bd5-8b28-12b6869c7cd9 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:58.006206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ece280-b343-4bd5-8b28-12b6869c7cd9 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:58.007818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ece280-b343-4bd5-8b28-12b6869c7cd9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:58.011079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32953bf1-8a44-4413-8581-eee7750c5cc4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:58.016362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6c11d-2e4e-4754-8908-70ea6f8ce49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:58.017427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6c11d-2e4e-4754-8908-70ea6f8ce49d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:58.017966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6c11d-2e4e-4754-8908-70ea6f8ce49d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:58.018540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6c11d-2e4e-4754-8908-70ea6f8ce49d admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:58.019406 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-97ece280-b343-4bd5-8b28-12b6869c7cd9 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 18 20:32:58.019918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6c11d-2e4e-4754-8908-70ea6f8ce49d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:58.026278 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 503/988] 10.222.0.13 () {56 vars in 1147 bytes} [Sat Dec 18 20:32:57 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:58.026435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6c11d-2e4e-4754-8908-70ea6f8ce49d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:58.026526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ece280-b343-4bd5-8b28-12b6869c7cd9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:58.035868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ece280-b343-4bd5-8b28-12b6869c7cd9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:58.037465 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 486/989] 10.222.0.13 () {60 vars in 1162 bytes} [Sat Dec 18 20:32:57 2021] POST /identity/v3/services => generated 242 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:32:58.038288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6c11d-2e4e-4754-8908-70ea6f8ce49d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:58.055058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dade13c-79b1-4c86-92dd-b16602738f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:58.056358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dade13c-79b1-4c86-92dd-b16602738f08 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:58.056980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dade13c-79b1-4c86-92dd-b16602738f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:58.058055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dade13c-79b1-4c86-92dd-b16602738f08 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:58.059001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dade13c-79b1-4c86-92dd-b16602738f08 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:58.061314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dade13c-79b1-4c86-92dd-b16602738f08 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:58.061469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6c11d-2e4e-4754-8908-70ea6f8ce49d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:58.067312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7a8a1-04a6-46ca-a7e1-6ff581b0f9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:58.067990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7a8a1-04a6-46ca-a7e1-6ff581b0f9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:58.068324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7a8a1-04a6-46ca-a7e1-6ff581b0f9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:58.068608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7a8a1-04a6-46ca-a7e1-6ff581b0f9d6 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:58.069339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7a8a1-04a6-46ca-a7e1-6ff581b0f9d6 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:58.069647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7a8a1-04a6-46ca-a7e1-6ff581b0f9d6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:58.071388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7a8a1-04a6-46ca-a7e1-6ff581b0f9d6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:58.076556 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-2dade13c-79b1-4c86-92dd-b16602738f08 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 18 20:32:58.077095 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 487/990] 10.222.0.13 () {56 vars in 1143 bytes} [Sat Dec 18 20:32:58 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:58.084035 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 504/991] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:32:58 2021] GET /identity/v3/services/compute => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:32:58.084735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7a8a1-04a6-46ca-a7e1-6ff581b0f9d6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:58.085614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dade13c-79b1-4c86-92dd-b16602738f08 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:58.095631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dade13c-79b1-4c86-92dd-b16602738f08 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:58.095828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7a8a1-04a6-46ca-a7e1-6ff581b0f9d6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:58.100600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d4e93-cabc-443f-8d9a-311b99c73abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:58.101271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d4e93-cabc-443f-8d9a-311b99c73abf admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:58.101555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d4e93-cabc-443f-8d9a-311b99c73abf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:58.101837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d4e93-cabc-443f-8d9a-311b99c73abf admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:58.102275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f99561-e154-4cbb-adb6-51252ffd8907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:58.102621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d4e93-cabc-443f-8d9a-311b99c73abf admin admin] RBAC: Adding query filter params (name=compute) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:58.102982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d4e93-cabc-443f-8d9a-311b99c73abf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:58.103605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f99561-e154-4cbb-adb6-51252ffd8907 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:58.104624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f99561-e154-4cbb-adb6-51252ffd8907 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:58.105092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f99561-e154-4cbb-adb6-51252ffd8907 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:58.105193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d4e93-cabc-443f-8d9a-311b99c73abf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:58.106111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f99561-e154-4cbb-adb6-51252ffd8907 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:58.106643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f99561-e154-4cbb-adb6-51252ffd8907 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:58.108471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f99561-e154-4cbb-adb6-51252ffd8907 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:58.116666 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 488/992] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Dec 18 20:32:58 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:58.117603 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 505/993] 10.222.0.13 () {56 vars in 1143 bytes} [Sat Dec 18 20:32:58 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:58.119076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d4e93-cabc-443f-8d9a-311b99c73abf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:58.125255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f99561-e154-4cbb-adb6-51252ffd8907 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:58.133989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d4e93-cabc-443f-8d9a-311b99c73abf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:58.136690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f99561-e154-4cbb-adb6-51252ffd8907 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:58.139655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562be95-7e16-4575-8bf5-72388c4ec320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:58.140709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562be95-7e16-4575-8bf5-72388c4ec320 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:58.141258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562be95-7e16-4575-8bf5-72388c4ec320 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:58.141621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b02192-be19-4631-b4ba-eee8c075d9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:58.141911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562be95-7e16-4575-8bf5-72388c4ec320 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:58.142457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b02192-be19-4631-b4ba-eee8c075d9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:58.142813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b02192-be19-4631-b4ba-eee8c075d9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:58.143163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b02192-be19-4631-b4ba-eee8c075d9f4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:58.143423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562be95-7e16-4575-8bf5-72388c4ec320 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:58.143895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562be95-7e16-4575-8bf5-72388c4ec320 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:58.144152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b02192-be19-4631-b4ba-eee8c075d9f4 admin admin] RBAC: Adding query filter params (interface=admin, service_id=7146178f80da4b6e90f3d3d46a974962, region_id=RegionOne) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:58.144544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b02192-be19-4631-b4ba-eee8c075d9f4 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:58.146057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562be95-7e16-4575-8bf5-72388c4ec320 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:58.146165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b02192-be19-4631-b4ba-eee8c075d9f4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:58.157112 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 506/994] 10.222.0.13 () {56 vars in 1270 bytes} [Sat Dec 18 20:32:58 2021] GET /identity/v3/endpoints?service_id=7146178f80da4b6e90f3d3d46a974962&interface=admin®ion_id=RegionOne => generated 193 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:32:58.157759 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 489/995] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Dec 18 20:32:58 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:58.158812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b02192-be19-4631-b4ba-eee8c075d9f4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:58.160372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562be95-7e16-4575-8bf5-72388c4ec320 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:58.169983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b02192-be19-4631-b4ba-eee8c075d9f4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:58.171409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562be95-7e16-4575-8bf5-72388c4ec320 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:58.174833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f0d8d-20ad-4b18-8f5c-5cd987b1bd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:58.175611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f0d8d-20ad-4b18-8f5c-5cd987b1bd83 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:58.176004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f0d8d-20ad-4b18-8f5c-5cd987b1bd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:58.176311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f0d8d-20ad-4b18-8f5c-5cd987b1bd83 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:58.177194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f0d8d-20ad-4b18-8f5c-5cd987b1bd83 admin admin] RBAC: Adding query filter params (interface=public, service_id=46a191456e9b45b48a5443f7fca0b451, region_id=RegionOne) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:58.177578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f0d8d-20ad-4b18-8f5c-5cd987b1bd83 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:58.177905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d9f96-3d3e-41f2-8342-52a1f44f4dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:58.178810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d9f96-3d3e-41f2-8342-52a1f44f4dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:58.179586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f0d8d-20ad-4b18-8f5c-5cd987b1bd83 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:58.180070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d9f96-3d3e-41f2-8342-52a1f44f4dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:58.180519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d9f96-3d3e-41f2-8342-52a1f44f4dc8 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:58.181414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d9f96-3d3e-41f2-8342-52a1f44f4dc8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:58.184521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d9f96-3d3e-41f2-8342-52a1f44f4dc8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:58.191942 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 507/996] 10.222.0.13 () {56 vars in 1272 bytes} [Sat Dec 18 20:32:58 2021] GET /identity/v3/endpoints?service_id=46a191456e9b45b48a5443f7fca0b451&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:32:58.193902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f0d8d-20ad-4b18-8f5c-5cd987b1bd83 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:58.198293 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 490/997] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Dec 18 20:32:58 2021] GET /identity/v3/services => generated 1957 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:32:58.209546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f0d8d-20ad-4b18-8f5c-5cd987b1bd83 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:58.214772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654445b-8a2b-44bb-bb7d-a42f240dc772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:58.215523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654445b-8a2b-44bb-bb7d-a42f240dc772 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:58.215858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654445b-8a2b-44bb-bb7d-a42f240dc772 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:58.216136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654445b-8a2b-44bb-bb7d-a42f240dc772 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:58.216847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654445b-8a2b-44bb-bb7d-a42f240dc772 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:58.218552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654445b-8a2b-44bb-bb7d-a42f240dc772 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:58.226583 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 508/998] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Dec 18 20:32:58 2021] GET /identity/v3/services => generated 1957 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:32:58.975086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67024eea-8753-4c7a-9574-91e45e300741 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:58.975593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67024eea-8753-4c7a-9574-91e45e300741 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:58.975593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67024eea-8753-4c7a-9574-91e45e300741 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:58.977553 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 491/999] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:32:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:32:58.988139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a43ce3-f397-4467-8948-f742884f868c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:58.988828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a43ce3-f397-4467-8948-f742884f868c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:58.988828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a43ce3-f397-4467-8948-f742884f868c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:59.007835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-06a43ce3-f397-4467-8948-f742884f868c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:32:59.009003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-06a43ce3-f397-4467-8948-f742884f868c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:32:59.019127 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 509/1000] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:32:58 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:32:59.044570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67024eea-8753-4c7a-9574-91e45e300741 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:59.061907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67024eea-8753-4c7a-9574-91e45e300741 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:59.067245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7cc51-4196-468c-8970-a800034fcd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:59.068392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7cc51-4196-468c-8970-a800034fcd9a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:59.068680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7cc51-4196-468c-8970-a800034fcd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:59.068944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7cc51-4196-468c-8970-a800034fcd9a admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:59.069664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7cc51-4196-468c-8970-a800034fcd9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:59.071677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7cc51-4196-468c-8970-a800034fcd9a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:59.073018 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.common [None req-07f7cc51-4196-468c-8970-a800034fcd9a admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 18 20:32:59.086164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.sql.core [None req-07f7cc51-4196-468c-8970-a800034fcd9a admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Dec 18 20:32:59.086164 ncdv-master-1 devstack@keystone.service[96646]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Dec 18 20:32:59.086164 ncdv-master-1 devstack@keystone.service[96646]: [parameters: {'user_id': '42c79d013bce4c229bb3ed51bbd1c5cf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Dec 18 20:32:59.086164 ncdv-master-1 devstack@keystone.service[96646]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96646) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 18 20:32:59.101207 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-07f7cc51-4196-468c-8970-a800034fcd9a admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Dec 18 20:32:59.106350 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 492/1001] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:32:59 2021] POST /identity/v3/users => generated 160 bytes in 59 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:32:59.109449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a43ce3-f397-4467-8948-f742884f868c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:59.118525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a43ce3-f397-4467-8948-f742884f868c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:59.123852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c05f7-3f6b-4aa3-aedd-5b061ab76865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:59.124638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c05f7-3f6b-4aa3-aedd-5b061ab76865 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:59.124925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c05f7-3f6b-4aa3-aedd-5b061ab76865 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:59.125206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c05f7-3f6b-4aa3-aedd-5b061ab76865 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:59.132864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c05f7-3f6b-4aa3-aedd-5b061ab76865 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:59.134895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c05f7-3f6b-4aa3-aedd-5b061ab76865 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:59.149854 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-954c05f7-3f6b-4aa3-aedd-5b061ab76865 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 18 20:32:59.151439 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 510/1002] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:32:59 2021] GET /identity/v3/users/cinder => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:32:59.157867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7cc51-4196-468c-8970-a800034fcd9a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:32:59.170568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7cc51-4196-468c-8970-a800034fcd9a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:32:59.175584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ea4d4-f835-4334-a374-7658502c6603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:32:59.176469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ea4d4-f835-4334-a374-7658502c6603 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:32:59.176983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ea4d4-f835-4334-a374-7658502c6603 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:32:59.177528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ea4d4-f835-4334-a374-7658502c6603 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:32:59.178798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ea4d4-f835-4334-a374-7658502c6603 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:32:59.179319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ea4d4-f835-4334-a374-7658502c6603 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:32:59.181765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ea4d4-f835-4334-a374-7658502c6603 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:32:59.229566 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 493/1003] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Dec 18 20:32:59 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:00.609165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11e1de-8c05-4651-abd9-3049326083d0 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.609741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11e1de-8c05-4651-abd9-3049326083d0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.609741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11e1de-8c05-4651-abd9-3049326083d0 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.611709 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 511/1004] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:00.617329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efb39f-efcc-47b6-996a-3b5d720586c1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.617745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efb39f-efcc-47b6-996a-3b5d720586c1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.617911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efb39f-efcc-47b6-996a-3b5d720586c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.638416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-97efb39f-efcc-47b6-996a-3b5d720586c1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:00.639917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-97efb39f-efcc-47b6-996a-3b5d720586c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:00.647683 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 494/1005] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:00 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:00.672049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11e1de-8c05-4651-abd9-3049326083d0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:00.684840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11e1de-8c05-4651-abd9-3049326083d0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:00.689441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8246a-fc67-4eb4-bfc5-c28d518f3ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:00.690206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8246a-fc67-4eb4-bfc5-c28d518f3ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.690518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8246a-fc67-4eb4-bfc5-c28d518f3ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.690791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8246a-fc67-4eb4-bfc5-c28d518f3ae2 admin admin] PATH_INFO: `/v3/services/image` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.691481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8246a-fc67-4eb4-bfc5-c28d518f3ae2 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:00.693132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8246a-fc67-4eb4-bfc5-c28d518f3ae2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:00.706715 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-48c8246a-fc67-4eb4-bfc5-c28d518f3ae2 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 18 20:33:00.708113 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 512/1006] 10.222.0.13 () {56 vars in 1126 bytes} [Sat Dec 18 20:33:00 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:00.714944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efb39f-efcc-47b6-996a-3b5d720586c1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:00.723521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efb39f-efcc-47b6-996a-3b5d720586c1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:00.727924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f212e0-a222-4fa8-a10c-28f0c3619eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:00.728569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f212e0-a222-4fa8-a10c-28f0c3619eff admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.728876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f212e0-a222-4fa8-a10c-28f0c3619eff admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.729243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f212e0-a222-4fa8-a10c-28f0c3619eff admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.729856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f212e0-a222-4fa8-a10c-28f0c3619eff admin admin] RBAC: Adding query filter params (name=image) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:00.730155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f212e0-a222-4fa8-a10c-28f0c3619eff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:00.731768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f212e0-a222-4fa8-a10c-28f0c3619eff admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:00.739493 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 495/1007] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:33:00 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:00.743490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a21958-7ef6-46fb-9824-ca47a718311c None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.743651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af70b5-4343-4fc7-9ab4-74faae396f57 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.743851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af70b5-4343-4fc7-9ab4-74faae396f57 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.743959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a21958-7ef6-46fb-9824-ca47a718311c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.744035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af70b5-4343-4fc7-9ab4-74faae396f57 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.744112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a21958-7ef6-46fb-9824-ca47a718311c None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.746229 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 496/1008] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:33:00.746596 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 513/1009] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:00.746953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af70b5-4343-4fc7-9ab4-74faae396f57 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:00.751832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0288cd-5b16-461a-99bb-fbefd25c9895 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.752122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0288cd-5b16-461a-99bb-fbefd25c9895 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.752398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0288cd-5b16-461a-99bb-fbefd25c9895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.759052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af70b5-4343-4fc7-9ab4-74faae396f57 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:00.764190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef93924-2f11-4dcd-a74d-a61ea7391048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:00.764802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef93924-2f11-4dcd-a74d-a61ea7391048 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.765085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef93924-2f11-4dcd-a74d-a61ea7391048 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.765362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef93924-2f11-4dcd-a74d-a61ea7391048 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.766062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef93924-2f11-4dcd-a74d-a61ea7391048 admin admin] RBAC: Adding query filter params (type=image) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:00.766405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef93924-2f11-4dcd-a74d-a61ea7391048 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:00.767990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef93924-2f11-4dcd-a74d-a61ea7391048 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:00.770164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-df0288cd-5b16-461a-99bb-fbefd25c9895 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:00.771367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-df0288cd-5b16-461a-99bb-fbefd25c9895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:00.772700 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 497/1010] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:33:00 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:00.773925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8a99f-1625-499e-9f6d-898aae6852cc None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.774213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8a99f-1625-499e-9f6d-898aae6852cc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.774526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8a99f-1625-499e-9f6d-898aae6852cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.783477 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 514/1011] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:00 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:33:00.783676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0288cd-5b16-461a-99bb-fbefd25c9895 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:00.792735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0288cd-5b16-461a-99bb-fbefd25c9895 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:00.793322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3dd8a99f-1625-499e-9f6d-898aae6852cc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:00.794514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3dd8a99f-1625-499e-9f6d-898aae6852cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:00.797453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa7bac-304a-4b84-8812-01297b388d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:00.798078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa7bac-304a-4b84-8812-01297b388d5b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.798397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa7bac-304a-4b84-8812-01297b388d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.798675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa7bac-304a-4b84-8812-01297b388d5b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.799472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa7bac-304a-4b84-8812-01297b388d5b admin admin] RBAC: Adding query filter params (interface=public, service_id=24ea013f08704b20bfd13f221623ab74, region_id=RegionOne) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:00.799785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa7bac-304a-4b84-8812-01297b388d5b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:00.801337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa7bac-304a-4b84-8812-01297b388d5b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:00.802235 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 498/1012] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:00 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:00.806865 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 515/1013] 10.222.0.13 () {56 vars in 1272 bytes} [Sat Dec 18 20:33:00 2021] GET /identity/v3/endpoints?service_id=24ea013f08704b20bfd13f221623ab74&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:00.808625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8a99f-1625-499e-9f6d-898aae6852cc None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:00.813386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa7bac-304a-4b84-8812-01297b388d5b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:00.818227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8a99f-1625-499e-9f6d-898aae6852cc None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:00.822413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa7bac-304a-4b84-8812-01297b388d5b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:00.823447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee7dc7-1b20-4bac-aa17-5fb39e5afc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:00.824230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee7dc7-1b20-4bac-aa17-5fb39e5afc93 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.824515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee7dc7-1b20-4bac-aa17-5fb39e5afc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.824793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee7dc7-1b20-4bac-aa17-5fb39e5afc93 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.825632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee7dc7-1b20-4bac-aa17-5fb39e5afc93 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:00.827263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee7dc7-1b20-4bac-aa17-5fb39e5afc93 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:00.828218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6ac9f-89c8-4675-8794-7c34de3e16e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:00.828859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6ac9f-89c8-4675-8794-7c34de3e16e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.829140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6ac9f-89c8-4675-8794-7c34de3e16e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.829409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6ac9f-89c8-4675-8794-7c34de3e16e7 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.830085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6ac9f-89c8-4675-8794-7c34de3e16e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:00.831666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6ac9f-89c8-4675-8794-7c34de3e16e7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:00.838028 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 516/1014] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Dec 18 20:33:00 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:33:00.838372 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-b1ee7dc7-1b20-4bac-aa17-5fb39e5afc93 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 18 20:33:00.838820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6ac9f-89c8-4675-8794-7c34de3e16e7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:00.839509 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 499/1015] 10.222.0.13 () {56 vars in 1147 bytes} [Sat Dec 18 20:33:00 2021] GET /identity/v3/services/object-store => generated 93 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:00.846128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee7dc7-1b20-4bac-aa17-5fb39e5afc93 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:00.855121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6ac9f-89c8-4675-8794-7c34de3e16e7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:00.860541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee7dc7-1b20-4bac-aa17-5fb39e5afc93 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:00.860743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdeef9-460e-4ca0-b485-48c600cab608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:00.861354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdeef9-460e-4ca0-b485-48c600cab608 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.861660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdeef9-460e-4ca0-b485-48c600cab608 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.861934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdeef9-460e-4ca0-b485-48c600cab608 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.862717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdeef9-460e-4ca0-b485-48c600cab608 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:00.864336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdeef9-460e-4ca0-b485-48c600cab608 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:00.865423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec158839-2ee5-4df9-9b13-d55e8b1441bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:00.866097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec158839-2ee5-4df9-9b13-d55e8b1441bd admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.866426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec158839-2ee5-4df9-9b13-d55e8b1441bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.866705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec158839-2ee5-4df9-9b13-d55e8b1441bd admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.867437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec158839-2ee5-4df9-9b13-d55e8b1441bd admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:00.867741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec158839-2ee5-4df9-9b13-d55e8b1441bd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:00.869385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec158839-2ee5-4df9-9b13-d55e8b1441bd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:00.880569 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 500/1016] 10.222.0.13 () {56 vars in 1143 bytes} [Sat Dec 18 20:33:00 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:33:00.880764 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-dfcdeef9-460e-4ca0-b485-48c600cab608 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 18 20:33:00.881626 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 517/1017] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:33:00 2021] GET /identity/v3/services/compute => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:00.881843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec158839-2ee5-4df9-9b13-d55e8b1441bd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:00.888657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdeef9-460e-4ca0-b485-48c600cab608 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:00.892584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec158839-2ee5-4df9-9b13-d55e8b1441bd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:00.898732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdeef9-460e-4ca0-b485-48c600cab608 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:00.899242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1bb7c-fdfb-4407-bf97-e9abd96194dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:00.900268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1bb7c-fdfb-4407-bf97-e9abd96194dc admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.900789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1bb7c-fdfb-4407-bf97-e9abd96194dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.901259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1bb7c-fdfb-4407-bf97-e9abd96194dc admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.902397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1bb7c-fdfb-4407-bf97-e9abd96194dc admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:00.902935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1bb7c-fdfb-4407-bf97-e9abd96194dc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:00.903724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd653927-fb7a-4ee5-862a-c91ad70c66e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:00.904388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd653927-fb7a-4ee5-862a-c91ad70c66e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.904664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1bb7c-fdfb-4407-bf97-e9abd96194dc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:00.904773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd653927-fb7a-4ee5-862a-c91ad70c66e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.904929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd653927-fb7a-4ee5-862a-c91ad70c66e3 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.905656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd653927-fb7a-4ee5-862a-c91ad70c66e3 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:00.905957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd653927-fb7a-4ee5-862a-c91ad70c66e3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:00.907603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd653927-fb7a-4ee5-862a-c91ad70c66e3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:00.917130 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 501/1018] 10.222.0.13 () {56 vars in 1143 bytes} [Sat Dec 18 20:33:00 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:00.917337 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 518/1019] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Dec 18 20:33:00 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:33:00.919307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd653927-fb7a-4ee5-862a-c91ad70c66e3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:00.920417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1bb7c-fdfb-4407-bf97-e9abd96194dc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:00.929253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd653927-fb7a-4ee5-862a-c91ad70c66e3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:00.929916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1bb7c-fdfb-4407-bf97-e9abd96194dc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:00.934690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c32ea6-358e-4d64-849f-370d28bdfad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:00.935039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b04074-0bac-4c4c-a90c-e856bb4cb528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:00.935989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b04074-0bac-4c4c-a90c-e856bb4cb528 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.936196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c32ea6-358e-4d64-849f-370d28bdfad5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.936310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b04074-0bac-4c4c-a90c-e856bb4cb528 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.936529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b04074-0bac-4c4c-a90c-e856bb4cb528 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.936855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c32ea6-358e-4d64-849f-370d28bdfad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.937278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c32ea6-358e-4d64-849f-370d28bdfad5 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.937384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b04074-0bac-4c4c-a90c-e856bb4cb528 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:00.938241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c32ea6-358e-4d64-849f-370d28bdfad5 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:00.938712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c32ea6-358e-4d64-849f-370d28bdfad5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:00.938947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b04074-0bac-4c4c-a90c-e856bb4cb528 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:00.940609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c32ea6-358e-4d64-849f-370d28bdfad5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:00.946281 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 519/1020] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Dec 18 20:33:00 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:00.952662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c32ea6-358e-4d64-849f-370d28bdfad5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:00.962291 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 502/1021] 10.222.0.13 () {60 vars in 1165 bytes} [Sat Dec 18 20:33:00 2021] POST /identity/v3/endpoints => generated 325 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:33:00.968637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c32ea6-358e-4d64-849f-370d28bdfad5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:00.985383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa5828-1bb7-4b2e-bd2a-f1614ed714ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:00.986056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa5828-1bb7-4b2e-bd2a-f1614ed714ad admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:00.986373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa5828-1bb7-4b2e-bd2a-f1614ed714ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:00.986677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa5828-1bb7-4b2e-bd2a-f1614ed714ad admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:00.987459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa5828-1bb7-4b2e-bd2a-f1614ed714ad admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:00.989117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa5828-1bb7-4b2e-bd2a-f1614ed714ad admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:01.011559 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 520/1022] 10.222.0.13 () {60 vars in 1165 bytes} [Sat Dec 18 20:33:00 2021] POST /identity/v3/endpoints => generated 334 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:33:03.295257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16724cb6-3f27-4581-a285-34974dae0748 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.295818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16724cb6-3f27-4581-a285-34974dae0748 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.295818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16724cb6-3f27-4581-a285-34974dae0748 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.297599 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 503/1023] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:03.303194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43a21f-b578-4f1a-a0e4-c2dbe21e87ac None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.303622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43a21f-b578-4f1a-a0e4-c2dbe21e87ac None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.303802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43a21f-b578-4f1a-a0e4-c2dbe21e87ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.321544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8e43a21f-b578-4f1a-a0e4-c2dbe21e87ac None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:03.322748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8e43a21f-b578-4f1a-a0e4-c2dbe21e87ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:03.339161 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 521/1024] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:03 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:03.365098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16724cb6-3f27-4581-a285-34974dae0748 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:03.377656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16724cb6-3f27-4581-a285-34974dae0748 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:03.382243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794e497-d28f-42d5-bb2f-896fc8a4a5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:03.383140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794e497-d28f-42d5-bb2f-896fc8a4a5ae admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.383424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794e497-d28f-42d5-bb2f-896fc8a4a5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.383695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794e497-d28f-42d5-bb2f-896fc8a4a5ae admin admin] PATH_INFO: `/v3/services/image` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.384348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794e497-d28f-42d5-bb2f-896fc8a4a5ae admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:03.385974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794e497-d28f-42d5-bb2f-896fc8a4a5ae admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:03.396777 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-f794e497-d28f-42d5-bb2f-896fc8a4a5ae admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 18 20:33:03.398072 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 504/1025] 10.222.0.13 () {56 vars in 1126 bytes} [Sat Dec 18 20:33:03 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:03.404433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43a21f-b578-4f1a-a0e4-c2dbe21e87ac None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:03.413777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43a21f-b578-4f1a-a0e4-c2dbe21e87ac None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:03.420448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f825a-3b19-4aa3-b4e9-ae3ce2d01b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:03.421418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f825a-3b19-4aa3-b4e9-ae3ce2d01b35 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.421706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f825a-3b19-4aa3-b4e9-ae3ce2d01b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.421959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f825a-3b19-4aa3-b4e9-ae3ce2d01b35 admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.422910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f825a-3b19-4aa3-b4e9-ae3ce2d01b35 admin admin] RBAC: Adding query filter params (name=image) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:03.423314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f825a-3b19-4aa3-b4e9-ae3ce2d01b35 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:03.424899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f825a-3b19-4aa3-b4e9-ae3ce2d01b35 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:03.430502 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 522/1026] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:33:03 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:03.437085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794e497-d28f-42d5-bb2f-896fc8a4a5ae admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:03.447246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794e497-d28f-42d5-bb2f-896fc8a4a5ae admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:03.452396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42365686-73f6-4cae-8bd3-cfb246bba76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:03.453043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42365686-73f6-4cae-8bd3-cfb246bba76f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.453322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42365686-73f6-4cae-8bd3-cfb246bba76f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.453595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42365686-73f6-4cae-8bd3-cfb246bba76f admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.454343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42365686-73f6-4cae-8bd3-cfb246bba76f admin admin] RBAC: Adding query filter params (type=image) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:03.454649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42365686-73f6-4cae-8bd3-cfb246bba76f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:03.456236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42365686-73f6-4cae-8bd3-cfb246bba76f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:03.461592 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 505/1027] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:33:03 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:03.468603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f825a-3b19-4aa3-b4e9-ae3ce2d01b35 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:03.476980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12089db-e872-4f3c-867b-349eb0d52660 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.477259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12089db-e872-4f3c-867b-349eb0d52660 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.477538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12089db-e872-4f3c-867b-349eb0d52660 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.479497 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 506/1028] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:33:03.479613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f825a-3b19-4aa3-b4e9-ae3ce2d01b35 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:03.484825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc7150-1797-4597-9cc9-bab1afcd36e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:03.484965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b365b-b51b-4a87-900f-d2436fb63c07 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.485127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b365b-b51b-4a87-900f-d2436fb63c07 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.485392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b365b-b51b-4a87-900f-d2436fb63c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.485483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc7150-1797-4597-9cc9-bab1afcd36e8 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.485774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc7150-1797-4597-9cc9-bab1afcd36e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.486081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc7150-1797-4597-9cc9-bab1afcd36e8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.487133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc7150-1797-4597-9cc9-bab1afcd36e8 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:03.488967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc7150-1797-4597-9cc9-bab1afcd36e8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:03.503747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-839b365b-b51b-4a87-900f-d2436fb63c07 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:03.505146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-839b365b-b51b-4a87-900f-d2436fb63c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:03.511812 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 523/1029] 10.222.0.13 () {60 vars in 1165 bytes} [Sat Dec 18 20:33:03 2021] POST /identity/v3/endpoints => generated 327 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:33:03.525161 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 507/1030] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:33:03.552217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc7150-1797-4597-9cc9-bab1afcd36e8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:03.557480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84643522-a7b7-4953-a521-8c30474cd180 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.558072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84643522-a7b7-4953-a521-8c30474cd180 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.558610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84643522-a7b7-4953-a521-8c30474cd180 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.561168 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 508/1031] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:33:03.564013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc7150-1797-4597-9cc9-bab1afcd36e8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:03.567660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9a6a8-a16c-454e-9daf-a4c5e155b26e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.567977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9a6a8-a16c-454e-9daf-a4c5e155b26e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.568238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9a6a8-a16c-454e-9daf-a4c5e155b26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.568803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e26511-4922-4723-967c-c77d7448a9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:03.569618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e26511-4922-4723-967c-c77d7448a9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.569909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e26511-4922-4723-967c-c77d7448a9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.570192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e26511-4922-4723-967c-c77d7448a9f5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.571471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e26511-4922-4723-967c-c77d7448a9f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:03.573773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e26511-4922-4723-967c-c77d7448a9f5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:03.575522 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 524/1032] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:33:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:03.582166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e26511-4922-4723-967c-c77d7448a9f5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:03.589605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5eb9a6a8-a16c-454e-9daf-a4c5e155b26e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:03.590851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5eb9a6a8-a16c-454e-9daf-a4c5e155b26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:03.592967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e26511-4922-4723-967c-c77d7448a9f5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:03.597771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4ac69-dc41-47fe-90c3-dac73798c0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:03.598488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4ac69-dc41-47fe-90c3-dac73798c0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.598977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4ac69-dc41-47fe-90c3-dac73798c0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.599092 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 509/1033] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:33:03.599186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4ac69-dc41-47fe-90c3-dac73798c0f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.599774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4ac69-dc41-47fe-90c3-dac73798c0f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:03.601688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4ac69-dc41-47fe-90c3-dac73798c0f0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:03.625633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9a6a8-a16c-454e-9daf-a4c5e155b26e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:03.638511 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 525/1034] 10.222.0.13 () {60 vars in 1162 bytes} [Sat Dec 18 20:33:03 2021] POST /identity/v3/projects => generated 311 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:33:03.638728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9a6a8-a16c-454e-9daf-a4c5e155b26e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:03.700520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5197c0d-948d-4e41-a348-208c75762742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:03.701370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5197c0d-948d-4e41-a348-208c75762742 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.701651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5197c0d-948d-4e41-a348-208c75762742 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.701926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5197c0d-948d-4e41-a348-208c75762742 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.719069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5197c0d-948d-4e41-a348-208c75762742 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:33:03.726697 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-e5197c0d-948d-4e41-a348-208c75762742 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 18 20:33:03.728209 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 510/1035] 10.222.0.13 () {56 vars in 1141 bytes} [Sat Dec 18 20:33:03 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:33:03.735627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4ac69-dc41-47fe-90c3-dac73798c0f0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:03.746403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4ac69-dc41-47fe-90c3-dac73798c0f0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:03.751812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5e476-f382-4f9c-b0b9-d1203c4603b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:03.752662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5e476-f382-4f9c-b0b9-d1203c4603b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.752977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5e476-f382-4f9c-b0b9-d1203c4603b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.753306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5e476-f382-4f9c-b0b9-d1203c4603b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.754384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5e476-f382-4f9c-b0b9-d1203c4603b8 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:03.754739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5e476-f382-4f9c-b0b9-d1203c4603b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:03.756595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5e476-f382-4f9c-b0b9-d1203c4603b8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:03.766996 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 526/1036] 10.222.0.13 () {56 vars in 1136 bytes} [Sat Dec 18 20:33:03 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:03.774418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5197c0d-948d-4e41-a348-208c75762742 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:03.785421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5197c0d-948d-4e41-a348-208c75762742 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:03.790584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06342b74-6055-44c7-b50e-8048326d7106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:03.791943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06342b74-6055-44c7-b50e-8048326d7106 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.792227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06342b74-6055-44c7-b50e-8048326d7106 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.792501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06342b74-6055-44c7-b50e-8048326d7106 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.805002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06342b74-6055-44c7-b50e-8048326d7106 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:03.807041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06342b74-6055-44c7-b50e-8048326d7106 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:03.824667 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-06342b74-6055-44c7-b50e-8048326d7106 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:33:03.826109 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 511/1037] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:33:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:03.832516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5e476-f382-4f9c-b0b9-d1203c4603b8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:03.843123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5e476-f382-4f9c-b0b9-d1203c4603b8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:03.847704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf01455-464a-4ecd-81ff-607b2432b666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:03.848368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf01455-464a-4ecd-81ff-607b2432b666 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.848652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf01455-464a-4ecd-81ff-607b2432b666 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.848929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf01455-464a-4ecd-81ff-607b2432b666 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.849669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf01455-464a-4ecd-81ff-607b2432b666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:03.849979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf01455-464a-4ecd-81ff-607b2432b666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:03.851668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf01455-464a-4ecd-81ff-607b2432b666 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:03.866406 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 527/1038] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:33:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:03.872952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06342b74-6055-44c7-b50e-8048326d7106 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:03.884871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06342b74-6055-44c7-b50e-8048326d7106 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:03.890243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9de140-5523-46bc-bfef-883116990b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:03.891106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9de140-5523-46bc-bfef-883116990b91 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.891388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9de140-5523-46bc-bfef-883116990b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.891667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9de140-5523-46bc-bfef-883116990b91 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.902331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9de140-5523-46bc-bfef-883116990b91 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:03.904349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9de140-5523-46bc-bfef-883116990b91 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:03.919641 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-0e9de140-5523-46bc-bfef-883116990b91 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 18 20:33:03.920843 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 512/1039] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Dec 18 20:33:03 2021] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:03.928547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf01455-464a-4ecd-81ff-607b2432b666 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:03.941318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf01455-464a-4ecd-81ff-607b2432b666 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:03.947158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2eec1-7048-4e46-821f-727f486ca0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:03.948346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2eec1-7048-4e46-821f-727f486ca0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.948633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2eec1-7048-4e46-821f-727f486ca0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.948913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2eec1-7048-4e46-821f-727f486ca0d1 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:03.949764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2eec1-7048-4e46-821f-727f486ca0d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:03.950987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2eec1-7048-4e46-821f-727f486ca0d1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:03.952164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2eec1-7048-4e46-821f-727f486ca0d1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:03.971540 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 528/1040] 10.222.0.13 () {56 vars in 1154 bytes} [Sat Dec 18 20:33:03 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:03.978030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9de140-5523-46bc-bfef-883116990b91 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:03.988882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9de140-5523-46bc-bfef-883116990b91 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:03.993661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5646f0-6c19-4195-8ba8-1b239b3ec36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:03.994377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5646f0-6c19-4195-8ba8-1b239b3ec36f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:03.994684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5646f0-6c19-4195-8ba8-1b239b3ec36f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:03.994998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5646f0-6c19-4195-8ba8-1b239b3ec36f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:04.003675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5646f0-6c19-4195-8ba8-1b239b3ec36f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:04.005510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5646f0-6c19-4195-8ba8-1b239b3ec36f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:04.016496 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 513/1041] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:33:03 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:33:04.022029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2eec1-7048-4e46-821f-727f486ca0d1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:04.032339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2eec1-7048-4e46-821f-727f486ca0d1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:04.036980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471e76c-c387-431a-8e58-bb15f49937a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:04.037852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471e76c-c387-431a-8e58-bb15f49937a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:04.038222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471e76c-c387-431a-8e58-bb15f49937a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:04.038635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471e76c-c387-431a-8e58-bb15f49937a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:04.049202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471e76c-c387-431a-8e58-bb15f49937a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:04.051128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471e76c-c387-431a-8e58-bb15f49937a6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:04.067895 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-f471e76c-c387-431a-8e58-bb15f49937a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:33:04.069152 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 529/1042] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:33:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:33:04.075800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5646f0-6c19-4195-8ba8-1b239b3ec36f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:04.084990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5646f0-6c19-4195-8ba8-1b239b3ec36f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:04.090386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135b026-5752-4121-9301-9d84757ce520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:04.091109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135b026-5752-4121-9301-9d84757ce520 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:04.091468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135b026-5752-4121-9301-9d84757ce520 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:04.091821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135b026-5752-4121-9301-9d84757ce520 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:04.092623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135b026-5752-4121-9301-9d84757ce520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:04.093001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135b026-5752-4121-9301-9d84757ce520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:04.094693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135b026-5752-4121-9301-9d84757ce520 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:04.107726 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 514/1043] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:33:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:33:04.114178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471e76c-c387-431a-8e58-bb15f49937a6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:04.124178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471e76c-c387-431a-8e58-bb15f49937a6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:04.128917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1328b-7226-4ae8-87b7-0a7f8ea9af79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:04.129887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1328b-7226-4ae8-87b7-0a7f8ea9af79 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:04.130445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1328b-7226-4ae8-87b7-0a7f8ea9af79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:04.130919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1328b-7226-4ae8-87b7-0a7f8ea9af79 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:04.138326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1328b-7226-4ae8-87b7-0a7f8ea9af79 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:04.140433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1328b-7226-4ae8-87b7-0a7f8ea9af79 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:04.153844 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-38a1328b-7226-4ae8-87b7-0a7f8ea9af79 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:33:04.155189 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 530/1044] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:33:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:04.161596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135b026-5752-4121-9301-9d84757ce520 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:04.171365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135b026-5752-4121-9301-9d84757ce520 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:04.175959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfbac8-1bf6-4db9-b45a-faeeccdddaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:04.176672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfbac8-1bf6-4db9-b45a-faeeccdddaea admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:04.177028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfbac8-1bf6-4db9-b45a-faeeccdddaea admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:04.177377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfbac8-1bf6-4db9-b45a-faeeccdddaea admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:04.178237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfbac8-1bf6-4db9-b45a-faeeccdddaea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:04.178660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfbac8-1bf6-4db9-b45a-faeeccdddaea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:04.180595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfbac8-1bf6-4db9-b45a-faeeccdddaea admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:04.193399 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 515/1045] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:33:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:04.200092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1328b-7226-4ae8-87b7-0a7f8ea9af79 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:04.210260 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1328b-7226-4ae8-87b7-0a7f8ea9af79 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:04.215430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c060c3-9236-49e9-8543-fb387ae3eb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:04.216089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c060c3-9236-49e9-8543-fb387ae3eb0e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:04.216346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c060c3-9236-49e9-8543-fb387ae3eb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:04.216624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c060c3-9236-49e9-8543-fb387ae3eb0e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:04.217451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c060c3-9236-49e9-8543-fb387ae3eb0e admin admin] RBAC: Adding query filter params (role.id=14c5ef1664374a9aa883c0b6d860b63a, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=a180acaefee3489788068c927fbe403c) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:04.217765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c060c3-9236-49e9-8543-fb387ae3eb0e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:04.219610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c060c3-9236-49e9-8543-fb387ae3eb0e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:04.225006 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 531/1046] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:33:04 2021] GET /identity/v3/role_assignments?user.id=a180acaefee3489788068c927fbe403c&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=14c5ef1664374a9aa883c0b6d860b63a => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:05.982205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00d2db-ff08-4963-bb9b-3e3c2ab3b0f0 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:05.982729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00d2db-ff08-4963-bb9b-3e3c2ab3b0f0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:05.982729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00d2db-ff08-4963-bb9b-3e3c2ab3b0f0 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:05.984726 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 516/1047] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:05.991478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf327d-6138-426f-85e4-f9df7d3cd1d1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:05.991976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf327d-6138-426f-85e4-f9df7d3cd1d1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:05.992130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf327d-6138-426f-85e4-f9df7d3cd1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:06.008896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3fcf327d-6138-426f-85e4-f9df7d3cd1d1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:06.010095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3fcf327d-6138-426f-85e4-f9df7d3cd1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:06.018700 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 532/1048] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:06.043617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00d2db-ff08-4963-bb9b-3e3c2ab3b0f0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:06.055630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00d2db-ff08-4963-bb9b-3e3c2ab3b0f0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:06.060007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852d569-6cfe-4650-9159-8bc8fc623ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:06.060890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852d569-6cfe-4650-9159-8bc8fc623ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:06.061172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852d569-6cfe-4650-9159-8bc8fc623ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:06.061448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852d569-6cfe-4650-9159-8bc8fc623ea1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:06.069107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852d569-6cfe-4650-9159-8bc8fc623ea1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:06.070979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852d569-6cfe-4650-9159-8bc8fc623ea1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:06.080072 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 517/1049] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:33:06 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:33:06.086286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf327d-6138-426f-85e4-f9df7d3cd1d1 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:06.095595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf327d-6138-426f-85e4-f9df7d3cd1d1 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:06.100072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34084e-4f99-4cf0-a2ec-e4b56b554b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:06.100850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34084e-4f99-4cf0-a2ec-e4b56b554b40 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:06.101134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34084e-4f99-4cf0-a2ec-e4b56b554b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:06.101408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34084e-4f99-4cf0-a2ec-e4b56b554b40 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:06.102626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34084e-4f99-4cf0-a2ec-e4b56b554b40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:06.104886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34084e-4f99-4cf0-a2ec-e4b56b554b40 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:06.106693 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 533/1050] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:33:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:06.119031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e1152-d7fd-411b-877d-bb2876d2bc16 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:06.119502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e1152-d7fd-411b-877d-bb2876d2bc16 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:06.119857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e1152-d7fd-411b-877d-bb2876d2bc16 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:06.121851 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 518/1051] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:06.128849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef40e2-3309-4beb-a6af-c5bf2f6b355c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:06.129186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef40e2-3309-4beb-a6af-c5bf2f6b355c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:06.129418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef40e2-3309-4beb-a6af-c5bf2f6b355c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:06.152252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-aaef40e2-3309-4beb-a6af-c5bf2f6b355c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:06.153455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-aaef40e2-3309-4beb-a6af-c5bf2f6b355c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:06.161384 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 534/1052] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:06.188564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e1152-d7fd-411b-877d-bb2876d2bc16 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:06.201696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e1152-d7fd-411b-877d-bb2876d2bc16 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:06.206229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7bf10-c520-4a3a-82b2-9f90fbad300d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:06.207139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7bf10-c520-4a3a-82b2-9f90fbad300d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:06.207419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7bf10-c520-4a3a-82b2-9f90fbad300d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:06.207694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7bf10-c520-4a3a-82b2-9f90fbad300d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:06.208911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7bf10-c520-4a3a-82b2-9f90fbad300d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:06.210627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7bf10-c520-4a3a-82b2-9f90fbad300d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:06.212483 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 519/1053] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:33:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:06.219312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef40e2-3309-4beb-a6af-c5bf2f6b355c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:06.228958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef40e2-3309-4beb-a6af-c5bf2f6b355c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:06.233893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0ce9c-d435-4315-8617-6b6a96df0ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:06.234548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ce9c-d435-4315-8617-6b6a96df0ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:06.234832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ce9c-d435-4315-8617-6b6a96df0ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:06.235105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ce9c-d435-4315-8617-6b6a96df0ab7 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:06.235882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0ce9c-d435-4315-8617-6b6a96df0ab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:06.237884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0ce9c-d435-4315-8617-6b6a96df0ab7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:06.261536 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 535/1054] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:33:06 2021] POST /identity/v3/users => generated 285 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:33:06.645893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0b26e-c666-4ba3-bad7-158d7d548ad8 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:06.646191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0b26e-c666-4ba3-bad7-158d7d548ad8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:06.646521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0b26e-c666-4ba3-bad7-158d7d548ad8 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:06.648304 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 520/1055] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:06.654741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11161a00-d813-4163-96a3-cccdb75be0ca None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:06.655036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11161a00-d813-4163-96a3-cccdb75be0ca None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:06.655317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11161a00-d813-4163-96a3-cccdb75be0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:06.673169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-11161a00-d813-4163-96a3-cccdb75be0ca None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:06.674368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-11161a00-d813-4163-96a3-cccdb75be0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:06.682076 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 536/1056] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:06.706919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0b26e-c666-4ba3-bad7-158d7d548ad8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:06.719578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0b26e-c666-4ba3-bad7-158d7d548ad8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:06.723960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c7493-e1e1-4ca0-a996-1ed708167982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:06.724745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c7493-e1e1-4ca0-a996-1ed708167982 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:06.725028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c7493-e1e1-4ca0-a996-1ed708167982 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:06.725304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c7493-e1e1-4ca0-a996-1ed708167982 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:06.736503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c7493-e1e1-4ca0-a996-1ed708167982 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:33:06.743692 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-010c7493-e1e1-4ca0-a996-1ed708167982 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 18 20:33:06.744993 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 521/1057] 10.222.0.13 () {56 vars in 1141 bytes} [Sat Dec 18 20:33:06 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:06.751233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11161a00-d813-4163-96a3-cccdb75be0ca None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:06.760096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11161a00-d813-4163-96a3-cccdb75be0ca None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:06.764579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217ddd2-a51c-4f19-a234-374b6be4cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:06.765227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217ddd2-a51c-4f19-a234-374b6be4cd2d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:06.765509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217ddd2-a51c-4f19-a234-374b6be4cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:06.765783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217ddd2-a51c-4f19-a234-374b6be4cd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:06.766569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217ddd2-a51c-4f19-a234-374b6be4cd2d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:06.766875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217ddd2-a51c-4f19-a234-374b6be4cd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:06.768440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217ddd2-a51c-4f19-a234-374b6be4cd2d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:06.776802 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 537/1058] 10.222.0.13 () {56 vars in 1136 bytes} [Sat Dec 18 20:33:06 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:06.782637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c7493-e1e1-4ca0-a996-1ed708167982 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:06.792184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c7493-e1e1-4ca0-a996-1ed708167982 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:06.796639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371308d-6d69-4708-896e-27c32c6d6527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:06.797400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371308d-6d69-4708-896e-27c32c6d6527 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:06.797679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371308d-6d69-4708-896e-27c32c6d6527 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:06.797959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371308d-6d69-4708-896e-27c32c6d6527 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:06.808289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371308d-6d69-4708-896e-27c32c6d6527 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:06.810096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371308d-6d69-4708-896e-27c32c6d6527 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:06.827231 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-a371308d-6d69-4708-896e-27c32c6d6527 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:33:06.828348 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 522/1059] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:33:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:33:06.834574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217ddd2-a51c-4f19-a234-374b6be4cd2d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:06.843847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217ddd2-a51c-4f19-a234-374b6be4cd2d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:06.848320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bc10b-a931-4ac3-98e2-81acd27347bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:06.848953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc10b-a931-4ac3-98e2-81acd27347bd admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:06.849238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc10b-a931-4ac3-98e2-81acd27347bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:06.849514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc10b-a931-4ac3-98e2-81acd27347bd admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:06.850237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bc10b-a931-4ac3-98e2-81acd27347bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:06.850575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bc10b-a931-4ac3-98e2-81acd27347bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:06.852129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bc10b-a931-4ac3-98e2-81acd27347bd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:06.863241 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 538/1060] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:33:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:06.869060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371308d-6d69-4708-896e-27c32c6d6527 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:06.878907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371308d-6d69-4708-896e-27c32c6d6527 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:06.883353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427a5b9-7f4d-4582-86f9-50627023868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:06.884099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427a5b9-7f4d-4582-86f9-50627023868f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:06.884381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427a5b9-7f4d-4582-86f9-50627023868f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:06.884656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427a5b9-7f4d-4582-86f9-50627023868f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:06.892790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427a5b9-7f4d-4582-86f9-50627023868f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:06.894824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427a5b9-7f4d-4582-86f9-50627023868f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:06.908045 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-3427a5b9-7f4d-4582-86f9-50627023868f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 18 20:33:06.909087 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 523/1061] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Dec 18 20:33:06 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:33:06.915141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bc10b-a931-4ac3-98e2-81acd27347bd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:06.925001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bc10b-a931-4ac3-98e2-81acd27347bd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:06.929447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980805e-bbaa-4ce5-b24a-7d41af2ac3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:06.930093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980805e-bbaa-4ce5-b24a-7d41af2ac3ae admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:06.930417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980805e-bbaa-4ce5-b24a-7d41af2ac3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:06.930695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980805e-bbaa-4ce5-b24a-7d41af2ac3ae admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:06.931527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980805e-bbaa-4ce5-b24a-7d41af2ac3ae admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:06.931905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980805e-bbaa-4ce5-b24a-7d41af2ac3ae admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:06.933699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980805e-bbaa-4ce5-b24a-7d41af2ac3ae admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:06.950825 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 539/1062] 10.222.0.13 () {56 vars in 1154 bytes} [Sat Dec 18 20:33:06 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:06.956809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427a5b9-7f4d-4582-86f9-50627023868f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:06.966694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427a5b9-7f4d-4582-86f9-50627023868f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:06.971167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fc2ff-402d-4dde-bd75-d17f13bbac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:06.971910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fc2ff-402d-4dde-bd75-d17f13bbac4c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:06.972191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fc2ff-402d-4dde-bd75-d17f13bbac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:06.972457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fc2ff-402d-4dde-bd75-d17f13bbac4c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:06.982362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fc2ff-402d-4dde-bd75-d17f13bbac4c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:06.984148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fc2ff-402d-4dde-bd75-d17f13bbac4c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:07.001043 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-0f7fc2ff-402d-4dde-bd75-d17f13bbac4c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:33:07.002130 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 524/1063] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:33:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:07.007942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980805e-bbaa-4ce5-b24a-7d41af2ac3ae admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:07.017762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980805e-bbaa-4ce5-b24a-7d41af2ac3ae admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:07.022239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7934b0f-5e8d-426c-be73-8fd87e4ffe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:07.022905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7934b0f-5e8d-426c-be73-8fd87e4ffe3a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:07.023189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7934b0f-5e8d-426c-be73-8fd87e4ffe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:07.023478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7934b0f-5e8d-426c-be73-8fd87e4ffe3a admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:07.024190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7934b0f-5e8d-426c-be73-8fd87e4ffe3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:07.024499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7934b0f-5e8d-426c-be73-8fd87e4ffe3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:07.026837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7934b0f-5e8d-426c-be73-8fd87e4ffe3a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:07.037639 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 540/1064] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:33:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:33:07.044245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fc2ff-402d-4dde-bd75-d17f13bbac4c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:07.053540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fc2ff-402d-4dde-bd75-d17f13bbac4c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:07.057953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ab6d2-057e-4e1c-92ad-c144f8adffe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:07.058742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ab6d2-057e-4e1c-92ad-c144f8adffe9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:07.059019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ab6d2-057e-4e1c-92ad-c144f8adffe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:07.059286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ab6d2-057e-4e1c-92ad-c144f8adffe9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:07.066161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ab6d2-057e-4e1c-92ad-c144f8adffe9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:07.068107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ab6d2-057e-4e1c-92ad-c144f8adffe9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:07.081025 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-db4ab6d2-057e-4e1c-92ad-c144f8adffe9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:33:07.082139 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 525/1065] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:33:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:07.088915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7934b0f-5e8d-426c-be73-8fd87e4ffe3a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:07.098527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7934b0f-5e8d-426c-be73-8fd87e4ffe3a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:07.103940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71392692-668c-40ee-8371-3949156a49be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:07.104593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71392692-668c-40ee-8371-3949156a49be admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:07.104879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71392692-668c-40ee-8371-3949156a49be admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:07.105156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71392692-668c-40ee-8371-3949156a49be admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:07.105956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71392692-668c-40ee-8371-3949156a49be admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:07.106284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71392692-668c-40ee-8371-3949156a49be admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:07.108131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71392692-668c-40ee-8371-3949156a49be admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:07.120227 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 541/1066] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:33:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:33:07.126598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ab6d2-057e-4e1c-92ad-c144f8adffe9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:07.137226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ab6d2-057e-4e1c-92ad-c144f8adffe9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:07.142031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10740403-75f5-4fdd-a27e-f3372dd804e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:07.142915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10740403-75f5-4fdd-a27e-f3372dd804e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:07.143452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10740403-75f5-4fdd-a27e-f3372dd804e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:07.143452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10740403-75f5-4fdd-a27e-f3372dd804e2 admin admin] PATH_INFO: `/v3/projects/0dd4d15f423642fa8da604b758048203/users/a180acaefee3489788068c927fbe403c/roles/14c5ef1664374a9aa883c0b6d860b63a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:07.145643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10740403-75f5-4fdd-a27e-f3372dd804e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd4d15f423642fa8da604b758048203, user_id=a180acaefee3489788068c927fbe403c, role_id=14c5ef1664374a9aa883c0b6d860b63a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:07.148280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10740403-75f5-4fdd-a27e-f3372dd804e2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:07.162289 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 526/1067] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:33:07 2021] PUT /identity/v3/projects/0dd4d15f423642fa8da604b758048203/users/a180acaefee3489788068c927fbe403c/roles/14c5ef1664374a9aa883c0b6d860b63a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:33:08.754900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fff9-9393-4254-b8a0-ad9239cd8584 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:08.755409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fff9-9393-4254-b8a0-ad9239cd8584 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:08.755502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fff9-9393-4254-b8a0-ad9239cd8584 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:08.757227 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 542/1068] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:08.763195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed2acd-2b8f-42d3-ae94-ab5e6a94da96 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:08.763593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed2acd-2b8f-42d3-ae94-ab5e6a94da96 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:08.763857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed2acd-2b8f-42d3-ae94-ab5e6a94da96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:08.781508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-33ed2acd-2b8f-42d3-ae94-ab5e6a94da96 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:08.782705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-33ed2acd-2b8f-42d3-ae94-ab5e6a94da96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:08.836583 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 527/1069] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:08 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:33:08.862570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2fff9-9393-4254-b8a0-ad9239cd8584 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:08.874626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2fff9-9393-4254-b8a0-ad9239cd8584 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:08.879033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bb7f9-c694-4e53-ba10-42b3652f5b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:08.879802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bb7f9-c694-4e53-ba10-42b3652f5b00 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:08.880088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bb7f9-c694-4e53-ba10-42b3652f5b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:08.880366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bb7f9-c694-4e53-ba10-42b3652f5b00 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:08.890397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459bb7f9-c694-4e53-ba10-42b3652f5b00 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:33:08.897127 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-459bb7f9-c694-4e53-ba10-42b3652f5b00 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:33:08.898336 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 543/1070] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:33:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:08.905114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed2acd-2b8f-42d3-ae94-ab5e6a94da96 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:08.913854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed2acd-2b8f-42d3-ae94-ab5e6a94da96 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:08.918929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e3b7c-1eed-4962-b19a-9be01e222fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:08.919571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e3b7c-1eed-4962-b19a-9be01e222fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:08.919853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e3b7c-1eed-4962-b19a-9be01e222fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:08.920129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e3b7c-1eed-4962-b19a-9be01e222fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:08.920880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e3b7c-1eed-4962-b19a-9be01e222fb8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:08.921185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e3b7c-1eed-4962-b19a-9be01e222fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:08.922783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e3b7c-1eed-4962-b19a-9be01e222fb8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:08.930937 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 528/1071] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:33:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:08.937308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bb7f9-c694-4e53-ba10-42b3652f5b00 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:08.947543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bb7f9-c694-4e53-ba10-42b3652f5b00 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:08.951970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b13eb-5500-4284-9639-9332dcec8db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:08.952812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b13eb-5500-4284-9639-9332dcec8db7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:08.953096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b13eb-5500-4284-9639-9332dcec8db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:08.953369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b13eb-5500-4284-9639-9332dcec8db7 admin admin] PATH_INFO: `/v3/users/dc3e539f087144248cbaf4aa9dd1b9ec` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:08.966749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b13eb-5500-4284-9639-9332dcec8db7 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc3e539f087144248cbaf4aa9dd1b9ec)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:08.968764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b13eb-5500-4284-9639-9332dcec8db7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:08.970545 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 544/1072] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:33:08 2021] GET /identity/v3/users/dc3e539f087144248cbaf4aa9dd1b9ec => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:08.977033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e3b7c-1eed-4962-b19a-9be01e222fb8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:08.987091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e3b7c-1eed-4962-b19a-9be01e222fb8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:08.991639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91c51a-49ca-49af-b3ca-c40bc57dc08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:08.992262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c51a-49ca-49af-b3ca-c40bc57dc08f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:08.992541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c51a-49ca-49af-b3ca-c40bc57dc08f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:08.992814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c51a-49ca-49af-b3ca-c40bc57dc08f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:09.000298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91c51a-49ca-49af-b3ca-c40bc57dc08f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:09.002005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91c51a-49ca-49af-b3ca-c40bc57dc08f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:09.010546 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 529/1073] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:33:08 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:33:09.017919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b13eb-5500-4284-9639-9332dcec8db7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:09.028991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b13eb-5500-4284-9639-9332dcec8db7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:09.033964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb871bd-9bce-4546-8a11-04a64a6bcb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:09.035033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb871bd-9bce-4546-8a11-04a64a6bcb67 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:09.035426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb871bd-9bce-4546-8a11-04a64a6bcb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:09.035799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb871bd-9bce-4546-8a11-04a64a6bcb67 admin admin] PATH_INFO: `/v3/projects/d9176d2fa1fc4792b7472f87de493374` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:09.037115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb871bd-9bce-4546-8a11-04a64a6bcb67 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9176d2fa1fc4792b7472f87de493374)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:09.039241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb871bd-9bce-4546-8a11-04a64a6bcb67 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:09.040955 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 545/1074] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:33:09 2021] GET /identity/v3/projects/d9176d2fa1fc4792b7472f87de493374 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:09.047828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91c51a-49ca-49af-b3ca-c40bc57dc08f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:09.057681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91c51a-49ca-49af-b3ca-c40bc57dc08f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:09.062493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b871eef-05fb-4a13-b782-f7d3cccf4a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:09.063127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871eef-05fb-4a13-b782-f7d3cccf4a00 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:09.063411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871eef-05fb-4a13-b782-f7d3cccf4a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:09.063686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871eef-05fb-4a13-b782-f7d3cccf4a00 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:09.064516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b871eef-05fb-4a13-b782-f7d3cccf4a00 admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=d9176d2fa1fc4792b7472f87de493374, user.id=dc3e539f087144248cbaf4aa9dd1b9ec) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:09.064826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b871eef-05fb-4a13-b782-f7d3cccf4a00 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:09.066682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b871eef-05fb-4a13-b782-f7d3cccf4a00 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:09.078332 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 530/1075] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:33:09 2021] GET /identity/v3/role_assignments?user.id=dc3e539f087144248cbaf4aa9dd1b9ec&scope.project.id=d9176d2fa1fc4792b7472f87de493374&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:33:09.571770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5a7ee-678e-4d7c-b061-876f73bcab55 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:09.572061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5a7ee-678e-4d7c-b061-876f73bcab55 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:09.572387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5a7ee-678e-4d7c-b061-876f73bcab55 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:09.574160 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 546/1076] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:09.579897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47026fa-7893-4a98-b5f3-3b95f061ba85 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:09.580259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47026fa-7893-4a98-b5f3-3b95f061ba85 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:09.580612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47026fa-7893-4a98-b5f3-3b95f061ba85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:09.598511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f47026fa-7893-4a98-b5f3-3b95f061ba85 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:09.599688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f47026fa-7893-4a98-b5f3-3b95f061ba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:09.607770 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 531/1077] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:09.633112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5a7ee-678e-4d7c-b061-876f73bcab55 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:09.645071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5a7ee-678e-4d7c-b061-876f73bcab55 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:09.649453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988eecb-3db2-4247-9938-91059d2d25a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:09.650230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988eecb-3db2-4247-9938-91059d2d25a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:09.651042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988eecb-3db2-4247-9938-91059d2d25a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:09.651320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988eecb-3db2-4247-9938-91059d2d25a2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:09.661445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988eecb-3db2-4247-9938-91059d2d25a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:33:09.668701 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-e988eecb-3db2-4247-9938-91059d2d25a2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 18 20:33:09.669811 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 547/1078] 10.222.0.13 () {56 vars in 1141 bytes} [Sat Dec 18 20:33:09 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:09.675800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47026fa-7893-4a98-b5f3-3b95f061ba85 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:09.684931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47026fa-7893-4a98-b5f3-3b95f061ba85 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:09.689614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591a5fe-aff0-4ad1-b3e8-25b9eebb9703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:09.690270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591a5fe-aff0-4ad1-b3e8-25b9eebb9703 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:09.690557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591a5fe-aff0-4ad1-b3e8-25b9eebb9703 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:09.690835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591a5fe-aff0-4ad1-b3e8-25b9eebb9703 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:09.691584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591a5fe-aff0-4ad1-b3e8-25b9eebb9703 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:09.691889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591a5fe-aff0-4ad1-b3e8-25b9eebb9703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:09.693465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591a5fe-aff0-4ad1-b3e8-25b9eebb9703 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:09.701872 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 532/1079] 10.222.0.13 () {56 vars in 1136 bytes} [Sat Dec 18 20:33:09 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:09.707699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988eecb-3db2-4247-9938-91059d2d25a2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:09.718044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988eecb-3db2-4247-9938-91059d2d25a2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:09.722546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612d3d-bf1e-40b4-a6f5-8e04cad74891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:09.723309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612d3d-bf1e-40b4-a6f5-8e04cad74891 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:09.723596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612d3d-bf1e-40b4-a6f5-8e04cad74891 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:09.723875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612d3d-bf1e-40b4-a6f5-8e04cad74891 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:09.733922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22612d3d-bf1e-40b4-a6f5-8e04cad74891 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:09.735840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22612d3d-bf1e-40b4-a6f5-8e04cad74891 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:09.752568 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-22612d3d-bf1e-40b4-a6f5-8e04cad74891 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:33:09.753896 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 548/1080] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:33:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:09.760537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591a5fe-aff0-4ad1-b3e8-25b9eebb9703 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:09.769943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591a5fe-aff0-4ad1-b3e8-25b9eebb9703 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:09.774402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bf257-e26d-4a83-b038-d16b3f8ba01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:09.775037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bf257-e26d-4a83-b038-d16b3f8ba01e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:09.775346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bf257-e26d-4a83-b038-d16b3f8ba01e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:09.775624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bf257-e26d-4a83-b038-d16b3f8ba01e admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:09.776346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bf257-e26d-4a83-b038-d16b3f8ba01e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:09.776651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bf257-e26d-4a83-b038-d16b3f8ba01e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:09.778227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bf257-e26d-4a83-b038-d16b3f8ba01e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:09.789504 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 533/1081] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:33:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:09.795988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612d3d-bf1e-40b4-a6f5-8e04cad74891 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:09.805775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612d3d-bf1e-40b4-a6f5-8e04cad74891 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:09.810991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11217d-905f-4b60-955c-4ea18208178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:09.811752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11217d-905f-4b60-955c-4ea18208178d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:09.812032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11217d-905f-4b60-955c-4ea18208178d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:09.812300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11217d-905f-4b60-955c-4ea18208178d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:09.819354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11217d-905f-4b60-955c-4ea18208178d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:09.821325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11217d-905f-4b60-955c-4ea18208178d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:09.836197 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-4f11217d-905f-4b60-955c-4ea18208178d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 18 20:33:09.837270 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 549/1082] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Dec 18 20:33:09 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:09.844767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bf257-e26d-4a83-b038-d16b3f8ba01e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:09.854206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bf257-e26d-4a83-b038-d16b3f8ba01e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:09.858633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af65713-9a82-4d55-a4bb-e824c8f6c8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:09.859275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af65713-9a82-4d55-a4bb-e824c8f6c8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:09.859552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af65713-9a82-4d55-a4bb-e824c8f6c8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:09.859824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af65713-9a82-4d55-a4bb-e824c8f6c8f1 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:09.860697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af65713-9a82-4d55-a4bb-e824c8f6c8f1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:09.860982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af65713-9a82-4d55-a4bb-e824c8f6c8f1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:09.862829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af65713-9a82-4d55-a4bb-e824c8f6c8f1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:09.879938 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 534/1083] 10.222.0.13 () {56 vars in 1154 bytes} [Sat Dec 18 20:33:09 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:09.886671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11217d-905f-4b60-955c-4ea18208178d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:09.896065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11217d-905f-4b60-955c-4ea18208178d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:09.900507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f8d2b-b90b-4015-bff0-97e3849c614f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:09.901133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f8d2b-b90b-4015-bff0-97e3849c614f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:09.901413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f8d2b-b90b-4015-bff0-97e3849c614f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:09.901686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f8d2b-b90b-4015-bff0-97e3849c614f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:09.909210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f8d2b-b90b-4015-bff0-97e3849c614f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:09.910954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f8d2b-b90b-4015-bff0-97e3849c614f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:09.919951 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 550/1084] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:33:09 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:33:09.926128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af65713-9a82-4d55-a4bb-e824c8f6c8f1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:09.936471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af65713-9a82-4d55-a4bb-e824c8f6c8f1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:09.940912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e5149-4622-4cc8-9899-1fe1bd54d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:09.941676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e5149-4622-4cc8-9899-1fe1bd54d8df admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:09.941955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e5149-4622-4cc8-9899-1fe1bd54d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:09.942227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e5149-4622-4cc8-9899-1fe1bd54d8df admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:09.953215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e5149-4622-4cc8-9899-1fe1bd54d8df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:09.955065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e5149-4622-4cc8-9899-1fe1bd54d8df admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:09.971147 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-229e5149-4622-4cc8-9899-1fe1bd54d8df admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:33:09.972288 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 535/1085] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:33:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:33:09.979051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f8d2b-b90b-4015-bff0-97e3849c614f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:09.987888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f8d2b-b90b-4015-bff0-97e3849c614f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:09.992395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c32df-c77a-4274-80cb-1673575a4d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:09.993036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c32df-c77a-4274-80cb-1673575a4d71 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:09.993317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c32df-c77a-4274-80cb-1673575a4d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:09.993589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c32df-c77a-4274-80cb-1673575a4d71 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:09.994903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c32df-c77a-4274-80cb-1673575a4d71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:09.995209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c32df-c77a-4274-80cb-1673575a4d71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:09.996764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c32df-c77a-4274-80cb-1673575a4d71 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:10.007745 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 551/1086] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:33:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:10.013851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e5149-4622-4cc8-9899-1fe1bd54d8df admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:10.023472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e5149-4622-4cc8-9899-1fe1bd54d8df admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:10.028030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b602ea-fcc4-41bb-a18e-281d435096e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:10.028793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b602ea-fcc4-41bb-a18e-281d435096e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:10.029072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b602ea-fcc4-41bb-a18e-281d435096e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:10.029346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b602ea-fcc4-41bb-a18e-281d435096e3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:10.036098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b602ea-fcc4-41bb-a18e-281d435096e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:10.038032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b602ea-fcc4-41bb-a18e-281d435096e3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:10.051117 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-c8b602ea-fcc4-41bb-a18e-281d435096e3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:33:10.052243 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 536/1087] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:33:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:10.059060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c32df-c77a-4274-80cb-1673575a4d71 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:10.068728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c32df-c77a-4274-80cb-1673575a4d71 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:10.073362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c760ca-1f97-4685-b15e-95eacef59f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:10.073996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c760ca-1f97-4685-b15e-95eacef59f9b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:10.074301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c760ca-1f97-4685-b15e-95eacef59f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:10.074580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c760ca-1f97-4685-b15e-95eacef59f9b admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:10.075364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c760ca-1f97-4685-b15e-95eacef59f9b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:10.075674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c760ca-1f97-4685-b15e-95eacef59f9b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:10.077477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c760ca-1f97-4685-b15e-95eacef59f9b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:10.094553 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 552/1088] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:33:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:33:10.095436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b602ea-fcc4-41bb-a18e-281d435096e3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:10.105970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b602ea-fcc4-41bb-a18e-281d435096e3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:10.110430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9fa35-092f-45db-a7f7-1ef86c595534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:10.111049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9fa35-092f-45db-a7f7-1ef86c595534 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:10.111329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9fa35-092f-45db-a7f7-1ef86c595534 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:10.111602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9fa35-092f-45db-a7f7-1ef86c595534 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:10.112422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9fa35-092f-45db-a7f7-1ef86c595534 admin admin] RBAC: Adding query filter params (role.id=14c5ef1664374a9aa883c0b6d860b63a, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=a180acaefee3489788068c927fbe403c) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:10.112729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9fa35-092f-45db-a7f7-1ef86c595534 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:10.114557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9fa35-092f-45db-a7f7-1ef86c595534 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:10.120791 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 537/1089] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:33:10 2021] GET /identity/v3/role_assignments?user.id=a180acaefee3489788068c927fbe403c&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=14c5ef1664374a9aa883c0b6d860b63a => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:33:11.495039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241b7d2-7bab-4c94-9dc5-d851e21b45a7 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:11.495565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241b7d2-7bab-4c94-9dc5-d851e21b45a7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:11.495565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241b7d2-7bab-4c94-9dc5-d851e21b45a7 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:11.497319 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 553/1090] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:11.503280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b430d6f-660c-4cbd-8f2f-f4f7e7e537ac None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:11.503646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b430d6f-660c-4cbd-8f2f-f4f7e7e537ac None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:11.503837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b430d6f-660c-4cbd-8f2f-f4f7e7e537ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:11.521434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3b430d6f-660c-4cbd-8f2f-f4f7e7e537ac None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:11.522648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3b430d6f-660c-4cbd-8f2f-f4f7e7e537ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:11.530933 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 538/1091] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:11.555260 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241b7d2-7bab-4c94-9dc5-d851e21b45a7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:11.567299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241b7d2-7bab-4c94-9dc5-d851e21b45a7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:11.571620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1a3e2-dd77-49a1-a131-0c701b0ddf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:11.574660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1a3e2-dd77-49a1-a131-0c701b0ddf7a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:11.574940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1a3e2-dd77-49a1-a131-0c701b0ddf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:11.575210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1a3e2-dd77-49a1-a131-0c701b0ddf7a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:11.585057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1a3e2-dd77-49a1-a131-0c701b0ddf7a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:33:11.592255 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-3bd1a3e2-dd77-49a1-a131-0c701b0ddf7a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:33:11.593378 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 554/1092] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:33:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:33:11.599736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b430d6f-660c-4cbd-8f2f-f4f7e7e537ac None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:11.608453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b430d6f-660c-4cbd-8f2f-f4f7e7e537ac None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:11.612915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563c401-a04e-4c73-8d44-a4342289bbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:11.613557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563c401-a04e-4c73-8d44-a4342289bbdf admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:11.613840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563c401-a04e-4c73-8d44-a4342289bbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:11.614119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563c401-a04e-4c73-8d44-a4342289bbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:11.614977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563c401-a04e-4c73-8d44-a4342289bbdf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:11.615280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563c401-a04e-4c73-8d44-a4342289bbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:11.616847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563c401-a04e-4c73-8d44-a4342289bbdf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:11.624896 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 539/1093] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:33:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:11.630593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1a3e2-dd77-49a1-a131-0c701b0ddf7a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:11.640654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1a3e2-dd77-49a1-a131-0c701b0ddf7a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:11.645026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039e20a-a91e-4c0b-b2e5-c37b76fc58b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:11.645837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039e20a-a91e-4c0b-b2e5-c37b76fc58b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:11.646118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039e20a-a91e-4c0b-b2e5-c37b76fc58b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:11.646430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039e20a-a91e-4c0b-b2e5-c37b76fc58b6 admin admin] PATH_INFO: `/v3/users/dc3e539f087144248cbaf4aa9dd1b9ec` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:11.647610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039e20a-a91e-4c0b-b2e5-c37b76fc58b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc3e539f087144248cbaf4aa9dd1b9ec)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:11.649676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039e20a-a91e-4c0b-b2e5-c37b76fc58b6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:11.651792 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 555/1094] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:33:11 2021] GET /identity/v3/users/dc3e539f087144248cbaf4aa9dd1b9ec => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:11.657593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563c401-a04e-4c73-8d44-a4342289bbdf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:11.666640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563c401-a04e-4c73-8d44-a4342289bbdf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:11.671069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d3048-f9b5-430f-9a85-6232e642a68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:11.671863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d3048-f9b5-430f-9a85-6232e642a68c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:11.672144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d3048-f9b5-430f-9a85-6232e642a68c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:11.672422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d3048-f9b5-430f-9a85-6232e642a68c admin admin] PATH_INFO: `/v3/projects/d9176d2fa1fc4792b7472f87de493374` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:11.673580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d3048-f9b5-430f-9a85-6232e642a68c admin admin] RBAC: Authorizing `identity:get_project(project_id=d9176d2fa1fc4792b7472f87de493374)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:11.675596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d3048-f9b5-430f-9a85-6232e642a68c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:11.677181 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 540/1095] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:33:11 2021] GET /identity/v3/projects/d9176d2fa1fc4792b7472f87de493374 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:11.682864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039e20a-a91e-4c0b-b2e5-c37b76fc58b6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:11.692214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039e20a-a91e-4c0b-b2e5-c37b76fc58b6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:11.696709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9577a2-bd9c-4c3c-9f3b-da1cb478b638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:11.698060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9577a2-bd9c-4c3c-9f3b-da1cb478b638 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:11.698371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9577a2-bd9c-4c3c-9f3b-da1cb478b638 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:11.698649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9577a2-bd9c-4c3c-9f3b-da1cb478b638 admin admin] PATH_INFO: `/v3/projects/d9176d2fa1fc4792b7472f87de493374/users/dc3e539f087144248cbaf4aa9dd1b9ec/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:11.700596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9577a2-bd9c-4c3c-9f3b-da1cb478b638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9176d2fa1fc4792b7472f87de493374, user_id=dc3e539f087144248cbaf4aa9dd1b9ec, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:11.703174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9577a2-bd9c-4c3c-9f3b-da1cb478b638 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:11.715942 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 556/1096] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:33:11 2021] PUT /identity/v3/projects/d9176d2fa1fc4792b7472f87de493374/users/dc3e539f087144248cbaf4aa9dd1b9ec/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:33:14.089789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76b359-2e78-45db-817c-741448741e3c None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:14.090317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76b359-2e78-45db-817c-741448741e3c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:14.090407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76b359-2e78-45db-817c-741448741e3c None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:14.092174 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 541/1097] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:14.098021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99b44-44f5-43c8-bdc9-d1af10f73375 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:14.098422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99b44-44f5-43c8-bdc9-d1af10f73375 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:14.098618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99b44-44f5-43c8-bdc9-d1af10f73375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:14.116386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-abd99b44-44f5-43c8-bdc9-d1af10f73375 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:14.117577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-abd99b44-44f5-43c8-bdc9-d1af10f73375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:14.172766 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 557/1098] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:14 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:14.204687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76b359-2e78-45db-817c-741448741e3c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:14.218365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76b359-2e78-45db-817c-741448741e3c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:14.222753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1dcbf-5188-4175-a370-458a215af4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:14.223542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1dcbf-5188-4175-a370-458a215af4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:14.223823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1dcbf-5188-4175-a370-458a215af4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:14.224096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1dcbf-5188-4175-a370-458a215af4a7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:14.237034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1dcbf-5188-4175-a370-458a215af4a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:33:14.243768 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-7ee1dcbf-5188-4175-a370-458a215af4a7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:33:14.245375 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 542/1099] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:33:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:14.251717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd99b44-44f5-43c8-bdc9-d1af10f73375 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:14.260800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd99b44-44f5-43c8-bdc9-d1af10f73375 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:14.265353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaac34-f2eb-46af-bdd5-19a3b0d84505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:14.266023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaac34-f2eb-46af-bdd5-19a3b0d84505 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:14.266344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaac34-f2eb-46af-bdd5-19a3b0d84505 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:14.266628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaac34-f2eb-46af-bdd5-19a3b0d84505 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:14.267397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defaac34-f2eb-46af-bdd5-19a3b0d84505 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:14.267708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defaac34-f2eb-46af-bdd5-19a3b0d84505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:14.269340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defaac34-f2eb-46af-bdd5-19a3b0d84505 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:14.278195 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 558/1100] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:33:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:14.284792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1dcbf-5188-4175-a370-458a215af4a7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:14.295563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1dcbf-5188-4175-a370-458a215af4a7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:14.300033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bd3db-c357-4057-a448-b05d8de2e213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:14.300872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bd3db-c357-4057-a448-b05d8de2e213 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:14.301145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bd3db-c357-4057-a448-b05d8de2e213 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:14.301412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bd3db-c357-4057-a448-b05d8de2e213 admin admin] PATH_INFO: `/v3/users/dc3e539f087144248cbaf4aa9dd1b9ec` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:14.302627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bd3db-c357-4057-a448-b05d8de2e213 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc3e539f087144248cbaf4aa9dd1b9ec)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:14.304786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bd3db-c357-4057-a448-b05d8de2e213 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:14.306571 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 543/1101] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:33:14 2021] GET /identity/v3/users/dc3e539f087144248cbaf4aa9dd1b9ec => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:14.315503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaac34-f2eb-46af-bdd5-19a3b0d84505 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:14.325834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaac34-f2eb-46af-bdd5-19a3b0d84505 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:14.330514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b0a75-679a-4238-bb22-498d70719de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:14.331143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b0a75-679a-4238-bb22-498d70719de3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:14.331427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b0a75-679a-4238-bb22-498d70719de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:14.331701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b0a75-679a-4238-bb22-498d70719de3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:14.339688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b0a75-679a-4238-bb22-498d70719de3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:14.341441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b0a75-679a-4238-bb22-498d70719de3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:14.349886 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 559/1102] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:33:14 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:33:14.357063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bd3db-c357-4057-a448-b05d8de2e213 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:14.366576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bd3db-c357-4057-a448-b05d8de2e213 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:14.371090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250429d-a104-4bd6-b5f2-98d41315376a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:14.371917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250429d-a104-4bd6-b5f2-98d41315376a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:14.372201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250429d-a104-4bd6-b5f2-98d41315376a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:14.372478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250429d-a104-4bd6-b5f2-98d41315376a admin admin] PATH_INFO: `/v3/projects/d9176d2fa1fc4792b7472f87de493374` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:14.373653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250429d-a104-4bd6-b5f2-98d41315376a admin admin] RBAC: Authorizing `identity:get_project(project_id=d9176d2fa1fc4792b7472f87de493374)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:14.375713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250429d-a104-4bd6-b5f2-98d41315376a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:14.377328 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 544/1103] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:33:14 2021] GET /identity/v3/projects/d9176d2fa1fc4792b7472f87de493374 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:14.383243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b0a75-679a-4238-bb22-498d70719de3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:14.392295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b0a75-679a-4238-bb22-498d70719de3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:14.396783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cce82-de2b-42d1-ae45-7396498ed8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:14.397395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cce82-de2b-42d1-ae45-7396498ed8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:14.397679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cce82-de2b-42d1-ae45-7396498ed8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:14.397952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cce82-de2b-42d1-ae45-7396498ed8f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:14.398809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cce82-de2b-42d1-ae45-7396498ed8f7 admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=d9176d2fa1fc4792b7472f87de493374, user.id=dc3e539f087144248cbaf4aa9dd1b9ec) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:14.399118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cce82-de2b-42d1-ae45-7396498ed8f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:14.401586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cce82-de2b-42d1-ae45-7396498ed8f7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:14.407279 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 560/1104] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:33:14 2021] GET /identity/v3/role_assignments?user.id=dc3e539f087144248cbaf4aa9dd1b9ec&scope.project.id=d9176d2fa1fc4792b7472f87de493374&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:16.816167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76e25c-dc91-42a9-a550-73df97bd65b1 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:16.816672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76e25c-dc91-42a9-a550-73df97bd65b1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:16.816761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76e25c-dc91-42a9-a550-73df97bd65b1 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:16.818493 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 545/1105] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:16.824681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee4052-424d-49ad-b238-276d5cb8bfc6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:16.825115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee4052-424d-49ad-b238-276d5cb8bfc6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:16.825241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee4052-424d-49ad-b238-276d5cb8bfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:16.843038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a8ee4052-424d-49ad-b238-276d5cb8bfc6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:16.844207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a8ee4052-424d-49ad-b238-276d5cb8bfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:16.851722 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 561/1106] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:33:16.877343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76e25c-dc91-42a9-a550-73df97bd65b1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:16.889579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76e25c-dc91-42a9-a550-73df97bd65b1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:16.893838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f2c8f-1118-4541-b24c-6980b2117b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:16.894614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f2c8f-1118-4541-b24c-6980b2117b69 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:16.894892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f2c8f-1118-4541-b24c-6980b2117b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:16.895165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f2c8f-1118-4541-b24c-6980b2117b69 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:16.896311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f2c8f-1118-4541-b24c-6980b2117b69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:16.897960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f2c8f-1118-4541-b24c-6980b2117b69 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:16.899546 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 546/1107] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:33:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:16.905736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee4052-424d-49ad-b238-276d5cb8bfc6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:16.914349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee4052-424d-49ad-b238-276d5cb8bfc6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:16.918796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7f601-79a6-4ff8-b9d9-25d104c7eaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:16.919433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7f601-79a6-4ff8-b9d9-25d104c7eaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:16.919717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7f601-79a6-4ff8-b9d9-25d104c7eaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:16.919994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7f601-79a6-4ff8-b9d9-25d104c7eaf0 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:16.920715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7f601-79a6-4ff8-b9d9-25d104c7eaf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:16.922617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7f601-79a6-4ff8-b9d9-25d104c7eaf0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:16.941051 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 562/1108] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:33:16 2021] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:33:19.448038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5a3a1-f791-4ac1-98e3-7fdad298653d None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:19.448568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5a3a1-f791-4ac1-98e3-7fdad298653d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:19.448568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5a3a1-f791-4ac1-98e3-7fdad298653d None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:19.450369 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 547/1109] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:19.456222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb22cd-a903-41b4-846b-e228c0f659c2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:19.456597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb22cd-a903-41b4-846b-e228c0f659c2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:19.456789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb22cd-a903-41b4-846b-e228c0f659c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:19.473974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-87bb22cd-a903-41b4-846b-e228c0f659c2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:19.475189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-87bb22cd-a903-41b4-846b-e228c0f659c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:19.482786 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 563/1110] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:19.508459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5a3a1-f791-4ac1-98e3-7fdad298653d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:19.520827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5a3a1-f791-4ac1-98e3-7fdad298653d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:19.525084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dfc1f-8dec-4519-8abe-4509cdf7a83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:19.525892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dfc1f-8dec-4519-8abe-4509cdf7a83f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:19.526169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dfc1f-8dec-4519-8abe-4509cdf7a83f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:19.526467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dfc1f-8dec-4519-8abe-4509cdf7a83f admin admin] PATH_INFO: `/v3/roles/04189c3120df49f6b37322459b571cf1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:19.527917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dfc1f-8dec-4519-8abe-4509cdf7a83f admin admin] RBAC: Authorizing `identity:get_role(role_id=04189c3120df49f6b37322459b571cf1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:19.528915 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-ca7dfc1f-8dec-4519-8abe-4509cdf7a83f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:33:19.528915 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:33:19.528915 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:33:19.529765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dfc1f-8dec-4519-8abe-4509cdf7a83f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:19.531078 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 548/1111] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:33:19 2021] GET /identity/v3/roles/04189c3120df49f6b37322459b571cf1 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:19.536844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb22cd-a903-41b4-846b-e228c0f659c2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:19.545549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb22cd-a903-41b4-846b-e228c0f659c2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:19.550087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30ba86-3674-4282-81eb-4d5b9959e236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:19.550980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30ba86-3674-4282-81eb-4d5b9959e236 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:19.551268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30ba86-3674-4282-81eb-4d5b9959e236 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:19.551547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30ba86-3674-4282-81eb-4d5b9959e236 admin admin] PATH_INFO: `/v3/users/a277f4cec53f47039cc7f1c7ee83d3e1` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:19.565035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30ba86-3674-4282-81eb-4d5b9959e236 admin admin] RBAC: Authorizing `identity:get_user(user_id=a277f4cec53f47039cc7f1c7ee83d3e1)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:19.567185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30ba86-3674-4282-81eb-4d5b9959e236 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:19.568751 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 564/1112] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:33:19 2021] GET /identity/v3/users/a277f4cec53f47039cc7f1c7ee83d3e1 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:19.575251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dfc1f-8dec-4519-8abe-4509cdf7a83f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:19.584567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dfc1f-8dec-4519-8abe-4509cdf7a83f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:19.589083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581bc84-a7d1-4bb8-a392-11a38cbca474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:19.589696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581bc84-a7d1-4bb8-a392-11a38cbca474 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:19.589980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581bc84-a7d1-4bb8-a392-11a38cbca474 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:19.590274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581bc84-a7d1-4bb8-a392-11a38cbca474 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:19.597763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581bc84-a7d1-4bb8-a392-11a38cbca474 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:19.599487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581bc84-a7d1-4bb8-a392-11a38cbca474 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:19.608129 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 549/1113] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:33:19 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:33:19.613914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30ba86-3674-4282-81eb-4d5b9959e236 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:19.623654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30ba86-3674-4282-81eb-4d5b9959e236 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:19.628120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4cff2-0ecb-4150-9338-73dcf0019bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:19.628933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4cff2-0ecb-4150-9338-73dcf0019bcf admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:19.629219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4cff2-0ecb-4150-9338-73dcf0019bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:19.629498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4cff2-0ecb-4150-9338-73dcf0019bcf admin admin] PATH_INFO: `/v3/projects/d9176d2fa1fc4792b7472f87de493374` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:19.630701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4cff2-0ecb-4150-9338-73dcf0019bcf admin admin] RBAC: Authorizing `identity:get_project(project_id=d9176d2fa1fc4792b7472f87de493374)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:19.632703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4cff2-0ecb-4150-9338-73dcf0019bcf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:19.634896 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 565/1114] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:33:19 2021] GET /identity/v3/projects/d9176d2fa1fc4792b7472f87de493374 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:19.640823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581bc84-a7d1-4bb8-a392-11a38cbca474 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:19.649194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581bc84-a7d1-4bb8-a392-11a38cbca474 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:19.653714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e715430-dcda-4417-848a-e875709f0a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:19.654342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e715430-dcda-4417-848a-e875709f0a5f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:19.654631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e715430-dcda-4417-848a-e875709f0a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:19.654911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e715430-dcda-4417-848a-e875709f0a5f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:19.655721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e715430-dcda-4417-848a-e875709f0a5f admin admin] RBAC: Adding query filter params (role.id=04189c3120df49f6b37322459b571cf1, scope.project.id=d9176d2fa1fc4792b7472f87de493374, user.id=a277f4cec53f47039cc7f1c7ee83d3e1) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:19.656030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e715430-dcda-4417-848a-e875709f0a5f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:19.657801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e715430-dcda-4417-848a-e875709f0a5f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:19.663024 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 550/1115] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:33:19 2021] GET /identity/v3/role_assignments?user.id=a277f4cec53f47039cc7f1c7ee83d3e1&scope.project.id=d9176d2fa1fc4792b7472f87de493374&role.id=04189c3120df49f6b37322459b571cf1 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:33:22.028476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6572bc-31d5-47f0-980b-ec6e7a13032c None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:22.029197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6572bc-31d5-47f0-980b-ec6e7a13032c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:22.029197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6572bc-31d5-47f0-980b-ec6e7a13032c None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:22.030723 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 566/1116] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:22.036682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91717b3-5760-43dc-9fc6-fe3c6e44c200 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:22.037087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91717b3-5760-43dc-9fc6-fe3c6e44c200 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:22.037235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91717b3-5760-43dc-9fc6-fe3c6e44c200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:22.055232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a91717b3-5760-43dc-9fc6-fe3c6e44c200 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:22.057057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a91717b3-5760-43dc-9fc6-fe3c6e44c200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:22.064810 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 551/1117] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:22 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:22.089064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6572bc-31d5-47f0-980b-ec6e7a13032c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:22.100779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6572bc-31d5-47f0-980b-ec6e7a13032c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:22.105529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fab524-2d6e-4373-998e-f85decc37190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:22.106375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fab524-2d6e-4373-998e-f85decc37190 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:22.106656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fab524-2d6e-4373-998e-f85decc37190 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:22.106929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fab524-2d6e-4373-998e-f85decc37190 admin admin] PATH_INFO: `/v3/roles/04189c3120df49f6b37322459b571cf1` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:22.108368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fab524-2d6e-4373-998e-f85decc37190 admin admin] RBAC: Authorizing `identity:get_role(role_id=04189c3120df49f6b37322459b571cf1)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:22.109398 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-65fab524-2d6e-4373-998e-f85decc37190 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:33:22.109398 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:33:22.109398 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:33:22.110491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fab524-2d6e-4373-998e-f85decc37190 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:22.111920 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 567/1118] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:33:22 2021] GET /identity/v3/roles/04189c3120df49f6b37322459b571cf1 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:22.118084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91717b3-5760-43dc-9fc6-fe3c6e44c200 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:22.127470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91717b3-5760-43dc-9fc6-fe3c6e44c200 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:22.131969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821da99-41d9-4071-a43e-2677afce5961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:22.132810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821da99-41d9-4071-a43e-2677afce5961 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:22.133089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821da99-41d9-4071-a43e-2677afce5961 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:22.133362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821da99-41d9-4071-a43e-2677afce5961 admin admin] PATH_INFO: `/v3/users/a277f4cec53f47039cc7f1c7ee83d3e1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:22.134592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821da99-41d9-4071-a43e-2677afce5961 admin admin] RBAC: Authorizing `identity:get_user(user_id=a277f4cec53f47039cc7f1c7ee83d3e1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:22.136728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821da99-41d9-4071-a43e-2677afce5961 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:22.138294 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 552/1119] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:33:22 2021] GET /identity/v3/users/a277f4cec53f47039cc7f1c7ee83d3e1 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:22.144078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fab524-2d6e-4373-998e-f85decc37190 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:22.153259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fab524-2d6e-4373-998e-f85decc37190 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:22.157644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccb4e9-fb9d-493c-ab34-da2d23304857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:22.158493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccb4e9-fb9d-493c-ab34-da2d23304857 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:22.158776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccb4e9-fb9d-493c-ab34-da2d23304857 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:22.159051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccb4e9-fb9d-493c-ab34-da2d23304857 admin admin] PATH_INFO: `/v3/projects/d9176d2fa1fc4792b7472f87de493374` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:22.160207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccb4e9-fb9d-493c-ab34-da2d23304857 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9176d2fa1fc4792b7472f87de493374)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:22.162176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccb4e9-fb9d-493c-ab34-da2d23304857 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:22.163778 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 568/1120] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:33:22 2021] GET /identity/v3/projects/d9176d2fa1fc4792b7472f87de493374 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:22.170130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821da99-41d9-4071-a43e-2677afce5961 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:22.179328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821da99-41d9-4071-a43e-2677afce5961 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:22.184391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d76e5-253c-401d-89b6-1e3d429f8e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:22.185240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d76e5-253c-401d-89b6-1e3d429f8e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:22.185775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d76e5-253c-401d-89b6-1e3d429f8e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:22.186052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d76e5-253c-401d-89b6-1e3d429f8e42 admin admin] PATH_INFO: `/v3/projects/d9176d2fa1fc4792b7472f87de493374/users/a277f4cec53f47039cc7f1c7ee83d3e1/roles/04189c3120df49f6b37322459b571cf1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:22.188293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d76e5-253c-401d-89b6-1e3d429f8e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9176d2fa1fc4792b7472f87de493374, user_id=a277f4cec53f47039cc7f1c7ee83d3e1, role_id=04189c3120df49f6b37322459b571cf1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:22.190922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d76e5-253c-401d-89b6-1e3d429f8e42 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:22.203132 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 553/1121] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:33:22 2021] PUT /identity/v3/projects/d9176d2fa1fc4792b7472f87de493374/users/a277f4cec53f47039cc7f1c7ee83d3e1/roles/04189c3120df49f6b37322459b571cf1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:33:24.632744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1df48-7c95-4a42-9b77-e046e2783bee None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:24.633272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1df48-7c95-4a42-9b77-e046e2783bee None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:24.633365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1df48-7c95-4a42-9b77-e046e2783bee None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:24.635101 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 569/1122] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:24.641394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bf411-77c6-44d8-8cbb-fa9aa240bcdb None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:24.641758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bf411-77c6-44d8-8cbb-fa9aa240bcdb None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:24.641952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bf411-77c6-44d8-8cbb-fa9aa240bcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:24.659747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0d9bf411-77c6-44d8-8cbb-fa9aa240bcdb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:24.660919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0d9bf411-77c6-44d8-8cbb-fa9aa240bcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:24.715682 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 554/1123] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:24 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:24.741102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1df48-7c95-4a42-9b77-e046e2783bee None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:24.753564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1df48-7c95-4a42-9b77-e046e2783bee None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:24.757946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884ecb3-2f4c-4a5a-b5c2-b61aa63c35fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:24.758837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884ecb3-2f4c-4a5a-b5c2-b61aa63c35fc admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:24.759746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884ecb3-2f4c-4a5a-b5c2-b61aa63c35fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:24.760026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884ecb3-2f4c-4a5a-b5c2-b61aa63c35fc admin admin] PATH_INFO: `/v3/roles/04189c3120df49f6b37322459b571cf1` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:24.761502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884ecb3-2f4c-4a5a-b5c2-b61aa63c35fc admin admin] RBAC: Authorizing `identity:get_role(role_id=04189c3120df49f6b37322459b571cf1)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:24.763130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884ecb3-2f4c-4a5a-b5c2-b61aa63c35fc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:24.764424 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 570/1124] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:33:24 2021] GET /identity/v3/roles/04189c3120df49f6b37322459b571cf1 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:24.770472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bf411-77c6-44d8-8cbb-fa9aa240bcdb None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:24.779644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bf411-77c6-44d8-8cbb-fa9aa240bcdb None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:24.784116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8119c-8f61-43fc-87a6-501c7125cd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:24.784969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8119c-8f61-43fc-87a6-501c7125cd7c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:24.785249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8119c-8f61-43fc-87a6-501c7125cd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:24.785524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8119c-8f61-43fc-87a6-501c7125cd7c admin admin] PATH_INFO: `/v3/users/a277f4cec53f47039cc7f1c7ee83d3e1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:24.786751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8119c-8f61-43fc-87a6-501c7125cd7c admin admin] RBAC: Authorizing `identity:get_user(user_id=a277f4cec53f47039cc7f1c7ee83d3e1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:24.788885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8119c-8f61-43fc-87a6-501c7125cd7c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:24.790516 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 555/1125] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:33:24 2021] GET /identity/v3/users/a277f4cec53f47039cc7f1c7ee83d3e1 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:24.796584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884ecb3-2f4c-4a5a-b5c2-b61aa63c35fc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:24.806451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884ecb3-2f4c-4a5a-b5c2-b61aa63c35fc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:24.811201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66cec5-3fb5-44a4-81df-278046036484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:24.811822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66cec5-3fb5-44a4-81df-278046036484 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:24.812111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66cec5-3fb5-44a4-81df-278046036484 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:24.812388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66cec5-3fb5-44a4-81df-278046036484 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:24.819936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66cec5-3fb5-44a4-81df-278046036484 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:24.822235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66cec5-3fb5-44a4-81df-278046036484 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:24.830889 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 571/1126] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:33:24 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:33:24.836861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8119c-8f61-43fc-87a6-501c7125cd7c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:24.846048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8119c-8f61-43fc-87a6-501c7125cd7c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:24.850489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011cb18-dff4-45ad-89d7-96d47c2748e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:24.851273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011cb18-dff4-45ad-89d7-96d47c2748e1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:24.851556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011cb18-dff4-45ad-89d7-96d47c2748e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:24.851832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011cb18-dff4-45ad-89d7-96d47c2748e1 admin admin] PATH_INFO: `/v3/projects/d9176d2fa1fc4792b7472f87de493374` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:24.853014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011cb18-dff4-45ad-89d7-96d47c2748e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9176d2fa1fc4792b7472f87de493374)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:24.855024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011cb18-dff4-45ad-89d7-96d47c2748e1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:24.856602 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 556/1127] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:33:24 2021] GET /identity/v3/projects/d9176d2fa1fc4792b7472f87de493374 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:24.862728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66cec5-3fb5-44a4-81df-278046036484 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:24.871545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66cec5-3fb5-44a4-81df-278046036484 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:24.875980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be646b-dff8-433a-b68a-8d2a7387eb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:24.876583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be646b-dff8-433a-b68a-8d2a7387eb51 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:24.876864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be646b-dff8-433a-b68a-8d2a7387eb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:24.877138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be646b-dff8-433a-b68a-8d2a7387eb51 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:24.877940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be646b-dff8-433a-b68a-8d2a7387eb51 admin admin] RBAC: Adding query filter params (role.id=04189c3120df49f6b37322459b571cf1, scope.project.id=d9176d2fa1fc4792b7472f87de493374, user.id=a277f4cec53f47039cc7f1c7ee83d3e1) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:24.878246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be646b-dff8-433a-b68a-8d2a7387eb51 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:24.880029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be646b-dff8-433a-b68a-8d2a7387eb51 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:24.886309 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 572/1128] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:33:24 2021] GET /identity/v3/role_assignments?user.id=a277f4cec53f47039cc7f1c7ee83d3e1&scope.project.id=d9176d2fa1fc4792b7472f87de493374&role.id=04189c3120df49f6b37322459b571cf1 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:27.311299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2a1f3-415d-451f-a005-79d8a2aa6f7d None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:27.311825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2a1f3-415d-451f-a005-79d8a2aa6f7d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:27.311937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2a1f3-415d-451f-a005-79d8a2aa6f7d None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:27.313621 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 557/1129] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:27.319326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa5b5e-47f5-4b95-a589-8de4ee4a5b34 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:27.319756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa5b5e-47f5-4b95-a589-8de4ee4a5b34 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:27.319876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa5b5e-47f5-4b95-a589-8de4ee4a5b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:27.337008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-47aa5b5e-47f5-4b95-a589-8de4ee4a5b34 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:27.338165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-47aa5b5e-47f5-4b95-a589-8de4ee4a5b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:27.345635 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 573/1130] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:27 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:27.372368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2a1f3-415d-451f-a005-79d8a2aa6f7d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:27.384241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2a1f3-415d-451f-a005-79d8a2aa6f7d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:27.388854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f3f7a-47f8-4713-b75a-3d3b4c73ae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:27.389719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f3f7a-47f8-4713-b75a-3d3b4c73ae63 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:27.390028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f3f7a-47f8-4713-b75a-3d3b4c73ae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:27.390455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f3f7a-47f8-4713-b75a-3d3b4c73ae63 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:27.391661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f3f7a-47f8-4713-b75a-3d3b4c73ae63 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:27.393317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f3f7a-47f8-4713-b75a-3d3b4c73ae63 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:27.394911 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 558/1131] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:33:27 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:27.400542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa5b5e-47f5-4b95-a589-8de4ee4a5b34 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:27.409030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa5b5e-47f5-4b95-a589-8de4ee4a5b34 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:27.413384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d51701-9f83-461b-8c43-d82f69b3d4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:27.414006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d51701-9f83-461b-8c43-d82f69b3d4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:27.414318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d51701-9f83-461b-8c43-d82f69b3d4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:27.414593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d51701-9f83-461b-8c43-d82f69b3d4f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:27.415816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d51701-9f83-461b-8c43-d82f69b3d4f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:27.417646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d51701-9f83-461b-8c43-d82f69b3d4f3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:27.442791 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 574/1132] 10.222.0.13 () {60 vars in 1162 bytes} [Sat Dec 18 20:33:27 2021] POST /identity/v3/projects => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:33:29.863078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2763224-2c9c-409d-b4a5-adbfdf29bc4a None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:29.863653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2763224-2c9c-409d-b4a5-adbfdf29bc4a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:29.863653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2763224-2c9c-409d-b4a5-adbfdf29bc4a None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:29.865367 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 559/1133] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:29.871524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecac5c-cc51-4905-9fe3-68c2baba1b34 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:29.871963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecac5c-cc51-4905-9fe3-68c2baba1b34 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:29.872084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecac5c-cc51-4905-9fe3-68c2baba1b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:29.890350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-20ecac5c-cc51-4905-9fe3-68c2baba1b34 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:29.891560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-20ecac5c-cc51-4905-9fe3-68c2baba1b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:29.945609 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 575/1134] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:29 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:29.972406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2763224-2c9c-409d-b4a5-adbfdf29bc4a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:29.984196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2763224-2c9c-409d-b4a5-adbfdf29bc4a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:29.988478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2942ca9-4153-4a97-802d-9745f64ca5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:29.989233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2942ca9-4153-4a97-802d-9745f64ca5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:29.989510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2942ca9-4153-4a97-802d-9745f64ca5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:29.989782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2942ca9-4153-4a97-802d-9745f64ca5e0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:29.990955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2942ca9-4153-4a97-802d-9745f64ca5e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:29.992633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2942ca9-4153-4a97-802d-9745f64ca5e0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:29.994694 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 560/1135] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:33:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:30.000479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecac5c-cc51-4905-9fe3-68c2baba1b34 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:30.009833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecac5c-cc51-4905-9fe3-68c2baba1b34 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:30.014343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c034081-fa89-4437-a478-e872541aa1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:30.015000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c034081-fa89-4437-a478-e872541aa1ed admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:30.015285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c034081-fa89-4437-a478-e872541aa1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:30.015559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c034081-fa89-4437-a478-e872541aa1ed admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:30.016276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c034081-fa89-4437-a478-e872541aa1ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:30.018432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c034081-fa89-4437-a478-e872541aa1ed admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:30.041687 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 576/1136] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:33:29 2021] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:33:32.454394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb28b7-2612-4414-ac99-80e7468b4438 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:32.454941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb28b7-2612-4414-ac99-80e7468b4438 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:32.454941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb28b7-2612-4414-ac99-80e7468b4438 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:32.456689 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 561/1137] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:32.462510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aae65-dfa2-424f-bc5d-d334bdc79083 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:32.462877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aae65-dfa2-424f-bc5d-d334bdc79083 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:32.463077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aae65-dfa2-424f-bc5d-d334bdc79083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:32.480618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-744aae65-dfa2-424f-bc5d-d334bdc79083 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:32.481792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-744aae65-dfa2-424f-bc5d-d334bdc79083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:32.489440 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 577/1138] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:32 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:32.514923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb28b7-2612-4414-ac99-80e7468b4438 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:32.526727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb28b7-2612-4414-ac99-80e7468b4438 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:32.531011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f69c8f-eb3b-4a85-a2ca-5e7d65036b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:32.531755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f69c8f-eb3b-4a85-a2ca-5e7d65036b48 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:32.532030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f69c8f-eb3b-4a85-a2ca-5e7d65036b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:32.532298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f69c8f-eb3b-4a85-a2ca-5e7d65036b48 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:32.542576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f69c8f-eb3b-4a85-a2ca-5e7d65036b48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:33:32.549121 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-16f69c8f-eb3b-4a85-a2ca-5e7d65036b48 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:33:32.550211 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 562/1139] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:33:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:32.556901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744aae65-dfa2-424f-bc5d-d334bdc79083 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:32.565769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744aae65-dfa2-424f-bc5d-d334bdc79083 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:32.570165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8bdb2-5199-483e-bafb-723a2f3d0c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:32.570840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8bdb2-5199-483e-bafb-723a2f3d0c07 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:32.571156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8bdb2-5199-483e-bafb-723a2f3d0c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:32.571455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8bdb2-5199-483e-bafb-723a2f3d0c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:32.572185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8bdb2-5199-483e-bafb-723a2f3d0c07 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:32.572494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8bdb2-5199-483e-bafb-723a2f3d0c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:32.574060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8bdb2-5199-483e-bafb-723a2f3d0c07 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:32.581968 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 578/1140] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:33:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:32.587780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f69c8f-eb3b-4a85-a2ca-5e7d65036b48 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:32.597407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f69c8f-eb3b-4a85-a2ca-5e7d65036b48 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:32.601783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3653dd0-5a5d-4b7b-9cae-a9c6c58266e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:32.603113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3653dd0-5a5d-4b7b-9cae-a9c6c58266e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:32.603389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3653dd0-5a5d-4b7b-9cae-a9c6c58266e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:32.603659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3653dd0-5a5d-4b7b-9cae-a9c6c58266e3 admin admin] PATH_INFO: `/v3/users/464efe64b1cb4cbf94fb0e0d0fce0c16` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:32.616101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3653dd0-5a5d-4b7b-9cae-a9c6c58266e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=464efe64b1cb4cbf94fb0e0d0fce0c16)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:32.618822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3653dd0-5a5d-4b7b-9cae-a9c6c58266e3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:32.620373 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 563/1141] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:33:32 2021] GET /identity/v3/users/464efe64b1cb4cbf94fb0e0d0fce0c16 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:32.626616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8bdb2-5199-483e-bafb-723a2f3d0c07 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:32.635891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8bdb2-5199-483e-bafb-723a2f3d0c07 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:32.641024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526055e-dbaa-4bea-8cfc-54b02a8f4913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:32.641830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526055e-dbaa-4bea-8cfc-54b02a8f4913 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:32.642121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526055e-dbaa-4bea-8cfc-54b02a8f4913 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:32.642436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526055e-dbaa-4bea-8cfc-54b02a8f4913 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:32.651663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526055e-dbaa-4bea-8cfc-54b02a8f4913 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:32.653400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526055e-dbaa-4bea-8cfc-54b02a8f4913 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:32.662134 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 579/1142] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:33:32 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:33:32.669188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3653dd0-5a5d-4b7b-9cae-a9c6c58266e3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:32.678586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3653dd0-5a5d-4b7b-9cae-a9c6c58266e3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:32.683743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dc8eb-284f-466e-a10e-1a7c684e9e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:32.684563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dc8eb-284f-466e-a10e-1a7c684e9e84 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:32.684843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dc8eb-284f-466e-a10e-1a7c684e9e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:32.685116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dc8eb-284f-466e-a10e-1a7c684e9e84 admin admin] PATH_INFO: `/v3/projects/5335cc09e088419b8d557692fadbd82b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:32.686580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17dc8eb-284f-466e-a10e-1a7c684e9e84 admin admin] RBAC: Authorizing `identity:get_project(project_id=5335cc09e088419b8d557692fadbd82b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:32.688579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17dc8eb-284f-466e-a10e-1a7c684e9e84 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:32.690185 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 564/1143] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:33:32 2021] GET /identity/v3/projects/5335cc09e088419b8d557692fadbd82b => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:32.696175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526055e-dbaa-4bea-8cfc-54b02a8f4913 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:32.704629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526055e-dbaa-4bea-8cfc-54b02a8f4913 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:32.708998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff74a2-09e4-4660-be30-ea59180adc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:32.709621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff74a2-09e4-4660-be30-ea59180adc33 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:32.709907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff74a2-09e4-4660-be30-ea59180adc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:32.710184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff74a2-09e4-4660-be30-ea59180adc33 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:32.711044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff74a2-09e4-4660-be30-ea59180adc33 admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=5335cc09e088419b8d557692fadbd82b, user.id=464efe64b1cb4cbf94fb0e0d0fce0c16) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:32.711356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff74a2-09e4-4660-be30-ea59180adc33 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:32.713136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff74a2-09e4-4660-be30-ea59180adc33 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:32.718360 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 580/1144] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:33:32 2021] GET /identity/v3/role_assignments?user.id=464efe64b1cb4cbf94fb0e0d0fce0c16&scope.project.id=5335cc09e088419b8d557692fadbd82b&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:35.088557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28aac0-03b6-43e8-9c7b-a6cb8a7105b4 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:35.089013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28aac0-03b6-43e8-9c7b-a6cb8a7105b4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:35.089110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28aac0-03b6-43e8-9c7b-a6cb8a7105b4 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:35.090929 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 565/1145] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:35.096647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145dc4d-8dec-4756-af45-bb6854146ad3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:35.097046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145dc4d-8dec-4756-af45-bb6854146ad3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:35.097206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145dc4d-8dec-4756-af45-bb6854146ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:35.115621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a145dc4d-8dec-4756-af45-bb6854146ad3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:35.116782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a145dc4d-8dec-4756-af45-bb6854146ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:35.124274 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 581/1146] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:35.148637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28aac0-03b6-43e8-9c7b-a6cb8a7105b4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:35.161017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28aac0-03b6-43e8-9c7b-a6cb8a7105b4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:35.165952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5657e-ba00-4a9a-a040-9bccaf61fac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:35.166744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5657e-ba00-4a9a-a040-9bccaf61fac7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:35.167026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5657e-ba00-4a9a-a040-9bccaf61fac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:35.167300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5657e-ba00-4a9a-a040-9bccaf61fac7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:35.177374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a5657e-ba00-4a9a-a040-9bccaf61fac7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:33:35.184055 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-76a5657e-ba00-4a9a-a040-9bccaf61fac7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:33:35.185166 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 566/1147] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:33:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:35.191342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145dc4d-8dec-4756-af45-bb6854146ad3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:35.199917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145dc4d-8dec-4756-af45-bb6854146ad3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:35.204290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7e148-875d-4b31-ad66-be8c199c054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:35.204921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7e148-875d-4b31-ad66-be8c199c054c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:35.205203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7e148-875d-4b31-ad66-be8c199c054c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:35.205477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7e148-875d-4b31-ad66-be8c199c054c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:35.206219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7e148-875d-4b31-ad66-be8c199c054c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:35.206560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7e148-875d-4b31-ad66-be8c199c054c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:35.208116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7e148-875d-4b31-ad66-be8c199c054c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:35.216449 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 582/1148] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:33:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:35.222476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5657e-ba00-4a9a-a040-9bccaf61fac7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:35.232364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5657e-ba00-4a9a-a040-9bccaf61fac7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:35.236849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1598606-19be-4409-ba83-3139cc18b5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:35.237656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1598606-19be-4409-ba83-3139cc18b5fb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:35.237938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1598606-19be-4409-ba83-3139cc18b5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:35.238215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1598606-19be-4409-ba83-3139cc18b5fb admin admin] PATH_INFO: `/v3/users/464efe64b1cb4cbf94fb0e0d0fce0c16` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:35.239448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1598606-19be-4409-ba83-3139cc18b5fb admin admin] RBAC: Authorizing `identity:get_user(user_id=464efe64b1cb4cbf94fb0e0d0fce0c16)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:35.241531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1598606-19be-4409-ba83-3139cc18b5fb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:35.243629 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 567/1149] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:33:35 2021] GET /identity/v3/users/464efe64b1cb4cbf94fb0e0d0fce0c16 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:35.249166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7e148-875d-4b31-ad66-be8c199c054c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:35.258222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7e148-875d-4b31-ad66-be8c199c054c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:35.263270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906cb5f-a5af-44db-ad27-7891fc14026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:35.264096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906cb5f-a5af-44db-ad27-7891fc14026a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:35.264380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906cb5f-a5af-44db-ad27-7891fc14026a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:35.264655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906cb5f-a5af-44db-ad27-7891fc14026a admin admin] PATH_INFO: `/v3/projects/5335cc09e088419b8d557692fadbd82b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:35.265822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906cb5f-a5af-44db-ad27-7891fc14026a admin admin] RBAC: Authorizing `identity:get_project(project_id=5335cc09e088419b8d557692fadbd82b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:35.267832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906cb5f-a5af-44db-ad27-7891fc14026a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:35.269409 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 583/1150] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:33:35 2021] GET /identity/v3/projects/5335cc09e088419b8d557692fadbd82b => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:35.275093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1598606-19be-4409-ba83-3139cc18b5fb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:35.284164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1598606-19be-4409-ba83-3139cc18b5fb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:35.288555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76ea0c-1b01-4620-a4f6-86120ea93f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:35.289372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76ea0c-1b01-4620-a4f6-86120ea93f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:35.289648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76ea0c-1b01-4620-a4f6-86120ea93f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:35.289917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76ea0c-1b01-4620-a4f6-86120ea93f21 admin admin] PATH_INFO: `/v3/projects/5335cc09e088419b8d557692fadbd82b/users/464efe64b1cb4cbf94fb0e0d0fce0c16/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:35.291888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76ea0c-1b01-4620-a4f6-86120ea93f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5335cc09e088419b8d557692fadbd82b, user_id=464efe64b1cb4cbf94fb0e0d0fce0c16, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:35.294443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76ea0c-1b01-4620-a4f6-86120ea93f21 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:35.307633 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 568/1151] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:33:35 2021] PUT /identity/v3/projects/5335cc09e088419b8d557692fadbd82b/users/464efe64b1cb4cbf94fb0e0d0fce0c16/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:33:37.688639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ba6f6-66c3-4a27-acea-2a76b6a88136 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:37.689194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ba6f6-66c3-4a27-acea-2a76b6a88136 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:37.689194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ba6f6-66c3-4a27-acea-2a76b6a88136 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:37.690980 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 584/1152] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:37.697267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbe7d6-74da-40a4-963b-b67ea090c6b6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:37.697722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbe7d6-74da-40a4-963b-b67ea090c6b6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:37.697843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbe7d6-74da-40a4-963b-b67ea090c6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:37.715615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-27cbe7d6-74da-40a4-963b-b67ea090c6b6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:37.716781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-27cbe7d6-74da-40a4-963b-b67ea090c6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:37.770652 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 569/1153] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:37 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:37.796924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ba6f6-66c3-4a27-acea-2a76b6a88136 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:37.809301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ba6f6-66c3-4a27-acea-2a76b6a88136 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:37.813836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b688c-2cd7-406a-abea-9c6662512e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:37.814632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b688c-2cd7-406a-abea-9c6662512e77 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:37.814918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b688c-2cd7-406a-abea-9c6662512e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:37.815197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b688c-2cd7-406a-abea-9c6662512e77 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:37.825062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b688c-2cd7-406a-abea-9c6662512e77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:33:37.831812 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-849b688c-2cd7-406a-abea-9c6662512e77 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:33:37.832919 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 585/1154] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:33:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:37.839000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbe7d6-74da-40a4-963b-b67ea090c6b6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:37.847511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbe7d6-74da-40a4-963b-b67ea090c6b6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:37.851887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c269ab-adf8-4fae-99a4-0f4b473e03db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:37.853011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c269ab-adf8-4fae-99a4-0f4b473e03db admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:37.853285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c269ab-adf8-4fae-99a4-0f4b473e03db admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:37.853551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c269ab-adf8-4fae-99a4-0f4b473e03db admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:37.854312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c269ab-adf8-4fae-99a4-0f4b473e03db admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:37.854617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c269ab-adf8-4fae-99a4-0f4b473e03db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:37.856178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c269ab-adf8-4fae-99a4-0f4b473e03db admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:37.864035 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 570/1155] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:33:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:37.870547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b688c-2cd7-406a-abea-9c6662512e77 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:37.880219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b688c-2cd7-406a-abea-9c6662512e77 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:37.884598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b81d2b-9249-43d5-bd12-6d94cff89741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:37.885431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b81d2b-9249-43d5-bd12-6d94cff89741 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:37.885710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b81d2b-9249-43d5-bd12-6d94cff89741 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:37.885983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b81d2b-9249-43d5-bd12-6d94cff89741 admin admin] PATH_INFO: `/v3/users/464efe64b1cb4cbf94fb0e0d0fce0c16` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:37.887219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b81d2b-9249-43d5-bd12-6d94cff89741 admin admin] RBAC: Authorizing `identity:get_user(user_id=464efe64b1cb4cbf94fb0e0d0fce0c16)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:37.889314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b81d2b-9249-43d5-bd12-6d94cff89741 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:37.890871 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 586/1156] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:33:37 2021] GET /identity/v3/users/464efe64b1cb4cbf94fb0e0d0fce0c16 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:37.896927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c269ab-adf8-4fae-99a4-0f4b473e03db admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:37.906000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c269ab-adf8-4fae-99a4-0f4b473e03db admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:37.910439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a0acd-b020-4235-9620-8da3d27091b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:37.911031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a0acd-b020-4235-9620-8da3d27091b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:37.911310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a0acd-b020-4235-9620-8da3d27091b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:37.911583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a0acd-b020-4235-9620-8da3d27091b7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:37.919642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a0acd-b020-4235-9620-8da3d27091b7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:37.921317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a0acd-b020-4235-9620-8da3d27091b7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:37.929802 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 571/1157] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:33:37 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:33:37.936782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b81d2b-9249-43d5-bd12-6d94cff89741 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:37.946057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b81d2b-9249-43d5-bd12-6d94cff89741 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:37.950449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd200c-359a-41f9-9363-8887cd445e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:37.951253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd200c-359a-41f9-9363-8887cd445e41 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:37.951537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd200c-359a-41f9-9363-8887cd445e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:37.951809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd200c-359a-41f9-9363-8887cd445e41 admin admin] PATH_INFO: `/v3/projects/5335cc09e088419b8d557692fadbd82b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:37.952969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd200c-359a-41f9-9363-8887cd445e41 admin admin] RBAC: Authorizing `identity:get_project(project_id=5335cc09e088419b8d557692fadbd82b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:37.954976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd200c-359a-41f9-9363-8887cd445e41 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:37.956579 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 587/1158] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:33:37 2021] GET /identity/v3/projects/5335cc09e088419b8d557692fadbd82b => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:33:37.962641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a0acd-b020-4235-9620-8da3d27091b7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:37.971039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a0acd-b020-4235-9620-8da3d27091b7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:37.975477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf09261-9aad-48b5-9a1f-bf512daa6d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:37.976081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf09261-9aad-48b5-9a1f-bf512daa6d58 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:37.976363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf09261-9aad-48b5-9a1f-bf512daa6d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:37.976641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf09261-9aad-48b5-9a1f-bf512daa6d58 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:37.977956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf09261-9aad-48b5-9a1f-bf512daa6d58 admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=5335cc09e088419b8d557692fadbd82b, user.id=464efe64b1cb4cbf94fb0e0d0fce0c16) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:37.978317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf09261-9aad-48b5-9a1f-bf512daa6d58 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:37.980129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf09261-9aad-48b5-9a1f-bf512daa6d58 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:37.985818 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 572/1159] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:33:37 2021] GET /identity/v3/role_assignments?user.id=464efe64b1cb4cbf94fb0e0d0fce0c16&scope.project.id=5335cc09e088419b8d557692fadbd82b&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:40.401433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767e2a9-fa82-4d53-83b2-f0be2eb49603 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:40.401985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767e2a9-fa82-4d53-83b2-f0be2eb49603 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:40.401985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767e2a9-fa82-4d53-83b2-f0be2eb49603 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:40.403792 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 588/1160] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:40.409704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a2707-15b9-4b86-adb0-0c26255a9c63 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:40.410119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a2707-15b9-4b86-adb0-0c26255a9c63 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:40.410274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a2707-15b9-4b86-adb0-0c26255a9c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:40.428051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d19a2707-15b9-4b86-adb0-0c26255a9c63 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:40.429216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d19a2707-15b9-4b86-adb0-0c26255a9c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:40.436985 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 573/1161] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:33:40.460894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767e2a9-fa82-4d53-83b2-f0be2eb49603 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:40.473127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767e2a9-fa82-4d53-83b2-f0be2eb49603 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:40.478132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf18dff-9682-49ca-b260-774b5a200afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:40.478781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf18dff-9682-49ca-b260-774b5a200afe admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:40.479067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf18dff-9682-49ca-b260-774b5a200afe admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:40.479343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf18dff-9682-49ca-b260-774b5a200afe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:40.486803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf18dff-9682-49ca-b260-774b5a200afe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:40.488515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf18dff-9682-49ca-b260-774b5a200afe admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:40.497001 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 589/1162] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:33:40 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:33:40.502980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a2707-15b9-4b86-adb0-0c26255a9c63 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:40.511535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a2707-15b9-4b86-adb0-0c26255a9c63 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:40.515939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767320c-74d6-4952-aced-0e8aacebed63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:40.516699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767320c-74d6-4952-aced-0e8aacebed63 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:40.516977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767320c-74d6-4952-aced-0e8aacebed63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:40.517251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767320c-74d6-4952-aced-0e8aacebed63 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:40.524359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767320c-74d6-4952-aced-0e8aacebed63 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:40.526136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767320c-74d6-4952-aced-0e8aacebed63 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:40.540694 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-f767320c-74d6-4952-aced-0e8aacebed63 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Dec 18 20:33:40.541775 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 574/1163] 10.222.0.13 () {56 vars in 1138 bytes} [Sat Dec 18 20:33:40 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:40.547806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf18dff-9682-49ca-b260-774b5a200afe admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:40.556359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf18dff-9682-49ca-b260-774b5a200afe admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:40.561093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e46ab4-d725-4d94-9c54-0010bfc28f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:40.561729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e46ab4-d725-4d94-9c54-0010bfc28f28 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:40.562015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e46ab4-d725-4d94-9c54-0010bfc28f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:40.562327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e46ab4-d725-4d94-9c54-0010bfc28f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:40.563047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e46ab4-d725-4d94-9c54-0010bfc28f28 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:40.563353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e46ab4-d725-4d94-9c54-0010bfc28f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:40.564897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e46ab4-d725-4d94-9c54-0010bfc28f28 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:40.571876 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 590/1164] 10.222.0.13 () {56 vars in 1136 bytes} [Sat Dec 18 20:33:40 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:42.941463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5eda2-06ac-4a63-94b1-5e208dd474ad None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:42.942009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5eda2-06ac-4a63-94b1-5e208dd474ad None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:42.942009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5eda2-06ac-4a63-94b1-5e208dd474ad None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:42.943810 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 575/1165] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:42.950104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef0758-9b84-4730-85b4-9fd607ae64fe None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:42.950540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef0758-9b84-4730-85b4-9fd607ae64fe None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:42.950707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef0758-9b84-4730-85b4-9fd607ae64fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:42.968510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-39ef0758-9b84-4730-85b4-9fd607ae64fe None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:42.969625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-39ef0758-9b84-4730-85b4-9fd607ae64fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:42.977150 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 591/1166] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:42 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:43.001141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5eda2-06ac-4a63-94b1-5e208dd474ad None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:43.013795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5eda2-06ac-4a63-94b1-5e208dd474ad None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:43.018222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841356e4-ba8a-4df1-b07d-795eea9903e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:43.018870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841356e4-ba8a-4df1-b07d-795eea9903e6 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:43.019155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841356e4-ba8a-4df1-b07d-795eea9903e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:43.019433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841356e4-ba8a-4df1-b07d-795eea9903e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:43.020182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841356e4-ba8a-4df1-b07d-795eea9903e6 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:43.021188 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-841356e4-ba8a-4df1-b07d-795eea9903e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:33:43.021188 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:33:43.021188 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:33:43.022065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841356e4-ba8a-4df1-b07d-795eea9903e6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:43.036990 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 576/1167] 10.222.0.13 () {60 vars in 1159 bytes} [Sat Dec 18 20:33:43 2021] POST /identity/v3/domains => generated 267 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:33:45.464398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0604b2-5855-4900-9f86-a17435cf0357 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:45.464923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0604b2-5855-4900-9f86-a17435cf0357 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:45.465012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0604b2-5855-4900-9f86-a17435cf0357 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:45.466763 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 592/1168] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:45.472442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438a60d-cce2-432e-af41-0bfe5a8b2cc3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:45.472857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438a60d-cce2-432e-af41-0bfe5a8b2cc3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:45.472990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438a60d-cce2-432e-af41-0bfe5a8b2cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:45.490813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d438a60d-cce2-432e-af41-0bfe5a8b2cc3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:45.491998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d438a60d-cce2-432e-af41-0bfe5a8b2cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:45.545946 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 577/1169] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:33:45.572298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0604b2-5855-4900-9f86-a17435cf0357 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:45.584118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0604b2-5855-4900-9f86-a17435cf0357 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:45.588438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632bcb4-dc4e-4b5c-a681-08855949ebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:45.589296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632bcb4-dc4e-4b5c-a681-08855949ebd3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:45.589586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632bcb4-dc4e-4b5c-a681-08855949ebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:45.589864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632bcb4-dc4e-4b5c-a681-08855949ebd3 admin admin] PATH_INFO: `/v3/domains/1af1fe0cbb294e43ae1fff4d56f9b429` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:45.600100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632bcb4-dc4e-4b5c-a681-08855949ebd3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=1af1fe0cbb294e43ae1fff4d56f9b429)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:45.602025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632bcb4-dc4e-4b5c-a681-08855949ebd3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:45.603636 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 593/1170] 10.222.0.13 () {56 vars in 1204 bytes} [Sat Dec 18 20:33:45 2021] GET /identity/v3/domains/1af1fe0cbb294e43ae1fff4d56f9b429 => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:45.609500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438a60d-cce2-432e-af41-0bfe5a8b2cc3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:45.618560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438a60d-cce2-432e-af41-0bfe5a8b2cc3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:45.622910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa451c-d583-499b-919e-f9186443f352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:45.623535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa451c-d583-499b-919e-f9186443f352 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:45.623813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa451c-d583-499b-919e-f9186443f352 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:45.624085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa451c-d583-499b-919e-f9186443f352 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:45.624789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa451c-d583-499b-919e-f9186443f352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:45.626696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa451c-d583-499b-919e-f9186443f352 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:45.651379 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 578/1171] 10.222.0.13 () {60 vars in 1162 bytes} [Sat Dec 18 20:33:45 2021] POST /identity/v3/projects => generated 361 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:33:48.065715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b7506-5214-4e3f-948b-00d35e6b16fa None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:48.066212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b7506-5214-4e3f-948b-00d35e6b16fa None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:48.066212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b7506-5214-4e3f-948b-00d35e6b16fa None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:48.067987 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 594/1172] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:48.073640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555c1dc-144e-4209-ad70-413ebb174702 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:48.074034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555c1dc-144e-4209-ad70-413ebb174702 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:48.074189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555c1dc-144e-4209-ad70-413ebb174702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:48.091795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9555c1dc-144e-4209-ad70-413ebb174702 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:48.092954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9555c1dc-144e-4209-ad70-413ebb174702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:48.147255 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 579/1173] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:48.174085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b7506-5214-4e3f-948b-00d35e6b16fa None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:48.186607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b7506-5214-4e3f-948b-00d35e6b16fa None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:48.190992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca25fe6-bf0e-4063-a344-2f55f6a7e18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:48.191829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca25fe6-bf0e-4063-a344-2f55f6a7e18d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:48.192113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca25fe6-bf0e-4063-a344-2f55f6a7e18d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:48.192388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca25fe6-bf0e-4063-a344-2f55f6a7e18d admin admin] PATH_INFO: `/v3/domains/1af1fe0cbb294e43ae1fff4d56f9b429` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:48.193558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca25fe6-bf0e-4063-a344-2f55f6a7e18d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=1af1fe0cbb294e43ae1fff4d56f9b429)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:48.196373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca25fe6-bf0e-4063-a344-2f55f6a7e18d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:48.197927 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 595/1174] 10.222.0.13 () {56 vars in 1204 bytes} [Sat Dec 18 20:33:48 2021] GET /identity/v3/domains/1af1fe0cbb294e43ae1fff4d56f9b429 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:48.203937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555c1dc-144e-4209-ad70-413ebb174702 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:48.213210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555c1dc-144e-4209-ad70-413ebb174702 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:48.217573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7441342-68da-4455-b665-21bc3e266921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:48.218213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7441342-68da-4455-b665-21bc3e266921 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:48.218520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7441342-68da-4455-b665-21bc3e266921 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:48.218792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7441342-68da-4455-b665-21bc3e266921 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:48.219503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7441342-68da-4455-b665-21bc3e266921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:48.221388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7441342-68da-4455-b665-21bc3e266921 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:48.240123 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 580/1175] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:33:48 2021] POST /identity/v3/users => generated 311 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:33:50.679022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabe7db-f4ef-4d57-822a-224a7c25a4de None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:50.679559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabe7db-f4ef-4d57-822a-224a7c25a4de None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:50.679559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabe7db-f4ef-4d57-822a-224a7c25a4de None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:50.681885 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 596/1176] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:50.687803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ddb24-6d7d-4a51-a00a-1fc60eb8ef2c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:50.688199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ddb24-6d7d-4a51-a00a-1fc60eb8ef2c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:50.688360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ddb24-6d7d-4a51-a00a-1fc60eb8ef2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:50.705958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f42ddb24-6d7d-4a51-a00a-1fc60eb8ef2c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:50.707201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f42ddb24-6d7d-4a51-a00a-1fc60eb8ef2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:50.714872 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 581/1177] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:33:50.740773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabe7db-f4ef-4d57-822a-224a7c25a4de None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:50.753235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabe7db-f4ef-4d57-822a-224a7c25a4de None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:50.757723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c941c52-45a5-4b9d-866d-e6a3cc4f2d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:50.758528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c941c52-45a5-4b9d-866d-e6a3cc4f2d48 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:50.758838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c941c52-45a5-4b9d-866d-e6a3cc4f2d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:50.759112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c941c52-45a5-4b9d-866d-e6a3cc4f2d48 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:50.769345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c941c52-45a5-4b9d-866d-e6a3cc4f2d48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:33:50.776630 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-9c941c52-45a5-4b9d-866d-e6a3cc4f2d48 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:33:50.777738 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 597/1178] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:33:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:50.783890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ddb24-6d7d-4a51-a00a-1fc60eb8ef2c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:50.793077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ddb24-6d7d-4a51-a00a-1fc60eb8ef2c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:50.797510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f52764-795d-442b-a243-ac2b7a9d02f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:50.798145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f52764-795d-442b-a243-ac2b7a9d02f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:50.798461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f52764-795d-442b-a243-ac2b7a9d02f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:50.798737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f52764-795d-442b-a243-ac2b7a9d02f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:50.799481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f52764-795d-442b-a243-ac2b7a9d02f5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:50.799781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f52764-795d-442b-a243-ac2b7a9d02f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:50.801354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f52764-795d-442b-a243-ac2b7a9d02f5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:50.809322 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 582/1179] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:33:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:33:50.815686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c941c52-45a5-4b9d-866d-e6a3cc4f2d48 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:50.824811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c941c52-45a5-4b9d-866d-e6a3cc4f2d48 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:50.829394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db11103-64ea-4f74-a181-fb5c1241ff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:50.830213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db11103-64ea-4f74-a181-fb5c1241ff63 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:50.830527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db11103-64ea-4f74-a181-fb5c1241ff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:50.830802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db11103-64ea-4f74-a181-fb5c1241ff63 admin admin] PATH_INFO: `/v3/users/06c3400f2c9545f2a8a7a7b7fdbcb490` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:50.844104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db11103-64ea-4f74-a181-fb5c1241ff63 admin admin] RBAC: Authorizing `identity:get_user(user_id=06c3400f2c9545f2a8a7a7b7fdbcb490)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:50.846209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db11103-64ea-4f74-a181-fb5c1241ff63 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:50.847790 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 598/1180] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:33:50 2021] GET /identity/v3/users/06c3400f2c9545f2a8a7a7b7fdbcb490 => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:50.854677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f52764-795d-442b-a243-ac2b7a9d02f5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:50.863938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f52764-795d-442b-a243-ac2b7a9d02f5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:50.868385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a979c8-3b86-47eb-86b7-d48aac9a3ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:50.868997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a979c8-3b86-47eb-86b7-d48aac9a3ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:50.869281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a979c8-3b86-47eb-86b7-d48aac9a3ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:50.869559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a979c8-3b86-47eb-86b7-d48aac9a3ad4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:50.877062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a979c8-3b86-47eb-86b7-d48aac9a3ad4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:50.878804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a979c8-3b86-47eb-86b7-d48aac9a3ad4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:50.887343 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 583/1181] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:33:50 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:33:50.893195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db11103-64ea-4f74-a181-fb5c1241ff63 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:50.902805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db11103-64ea-4f74-a181-fb5c1241ff63 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:50.907278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a6808-27d9-4e59-bace-9c97d0c3bf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:50.908107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a6808-27d9-4e59-bace-9c97d0c3bf52 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:50.908389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a6808-27d9-4e59-bace-9c97d0c3bf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:50.908662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a6808-27d9-4e59-bace-9c97d0c3bf52 admin admin] PATH_INFO: `/v3/projects/35745d7a611143e285f41247889f517a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:50.909824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a6808-27d9-4e59-bace-9c97d0c3bf52 admin admin] RBAC: Authorizing `identity:get_project(project_id=35745d7a611143e285f41247889f517a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:50.911819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a6808-27d9-4e59-bace-9c97d0c3bf52 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:50.913394 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 599/1182] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:33:50 2021] GET /identity/v3/projects/35745d7a611143e285f41247889f517a => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:50.919908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a979c8-3b86-47eb-86b7-d48aac9a3ad4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:50.928197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a979c8-3b86-47eb-86b7-d48aac9a3ad4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:50.932705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7be21-1a04-4ec7-a05d-086b10253f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:50.933253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7be21-1a04-4ec7-a05d-086b10253f39 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:50.933536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7be21-1a04-4ec7-a05d-086b10253f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:50.933815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7be21-1a04-4ec7-a05d-086b10253f39 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:50.934666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7be21-1a04-4ec7-a05d-086b10253f39 admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=35745d7a611143e285f41247889f517a, user.id=06c3400f2c9545f2a8a7a7b7fdbcb490) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:50.934974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7be21-1a04-4ec7-a05d-086b10253f39 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:50.936983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7be21-1a04-4ec7-a05d-086b10253f39 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:50.942122 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 584/1183] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:33:50 2021] GET /identity/v3/role_assignments?user.id=06c3400f2c9545f2a8a7a7b7fdbcb490&scope.project.id=35745d7a611143e285f41247889f517a&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:53.333749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cedf1-85b0-4720-a2cb-3ca17180ff1f None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:53.334326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cedf1-85b0-4720-a2cb-3ca17180ff1f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:53.334326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cedf1-85b0-4720-a2cb-3ca17180ff1f None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:53.336558 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 600/1184] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:53.342187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c0489-bce3-450b-96df-8887dabce8b4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:53.342603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c0489-bce3-450b-96df-8887dabce8b4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:53.342772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c0489-bce3-450b-96df-8887dabce8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:53.360349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d52c0489-bce3-450b-96df-8887dabce8b4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:53.361502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d52c0489-bce3-450b-96df-8887dabce8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:53.368946 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 585/1185] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:53.392861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cedf1-85b0-4720-a2cb-3ca17180ff1f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:53.404968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cedf1-85b0-4720-a2cb-3ca17180ff1f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:53.411003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b7859-de29-4fbb-9a62-91afed93f0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:53.411758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b7859-de29-4fbb-9a62-91afed93f0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:53.412041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b7859-de29-4fbb-9a62-91afed93f0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:53.412318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b7859-de29-4fbb-9a62-91afed93f0c9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:53.422928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b7859-de29-4fbb-9a62-91afed93f0c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:33:53.429688 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-f02b7859-de29-4fbb-9a62-91afed93f0c9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:33:53.430838 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 601/1186] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:33:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:53.437073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c0489-bce3-450b-96df-8887dabce8b4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:53.446139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c0489-bce3-450b-96df-8887dabce8b4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:53.450573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1af9a-8969-4200-b01b-c73b844027aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:53.451237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1af9a-8969-4200-b01b-c73b844027aa admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:53.451480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1af9a-8969-4200-b01b-c73b844027aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:53.451755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1af9a-8969-4200-b01b-c73b844027aa admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:53.452490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1af9a-8969-4200-b01b-c73b844027aa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:53.452797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1af9a-8969-4200-b01b-c73b844027aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:53.454390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1af9a-8969-4200-b01b-c73b844027aa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:53.463093 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 586/1187] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:33:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:53.468967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b7859-de29-4fbb-9a62-91afed93f0c9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:53.478576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b7859-de29-4fbb-9a62-91afed93f0c9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:53.482933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a54ceb-bb13-4e80-bf3b-5dc9aa7e35f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:53.483743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a54ceb-bb13-4e80-bf3b-5dc9aa7e35f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:53.484025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a54ceb-bb13-4e80-bf3b-5dc9aa7e35f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:53.484298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a54ceb-bb13-4e80-bf3b-5dc9aa7e35f8 admin admin] PATH_INFO: `/v3/users/06c3400f2c9545f2a8a7a7b7fdbcb490` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:53.485456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a54ceb-bb13-4e80-bf3b-5dc9aa7e35f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=06c3400f2c9545f2a8a7a7b7fdbcb490)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:53.487562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a54ceb-bb13-4e80-bf3b-5dc9aa7e35f8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:53.489068 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 602/1188] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:33:53 2021] GET /identity/v3/users/06c3400f2c9545f2a8a7a7b7fdbcb490 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:53.494860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1af9a-8969-4200-b01b-c73b844027aa admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:53.503979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1af9a-8969-4200-b01b-c73b844027aa admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:53.508922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae8551-0a2d-4823-b969-f4ea038505f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:53.509729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae8551-0a2d-4823-b969-f4ea038505f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:53.510008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae8551-0a2d-4823-b969-f4ea038505f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:53.510310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae8551-0a2d-4823-b969-f4ea038505f8 admin admin] PATH_INFO: `/v3/projects/35745d7a611143e285f41247889f517a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:53.511553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae8551-0a2d-4823-b969-f4ea038505f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=35745d7a611143e285f41247889f517a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:53.513524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae8551-0a2d-4823-b969-f4ea038505f8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:53.515135 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 587/1189] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:33:53 2021] GET /identity/v3/projects/35745d7a611143e285f41247889f517a => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:53.520898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a54ceb-bb13-4e80-bf3b-5dc9aa7e35f8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:53.530726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a54ceb-bb13-4e80-bf3b-5dc9aa7e35f8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:53.535295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7baf69-a4d6-4ddb-8846-acf49df6c79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:53.536133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7baf69-a4d6-4ddb-8846-acf49df6c79d admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:53.536421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7baf69-a4d6-4ddb-8846-acf49df6c79d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:53.536700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7baf69-a4d6-4ddb-8846-acf49df6c79d admin admin] PATH_INFO: `/v3/projects/35745d7a611143e285f41247889f517a/users/06c3400f2c9545f2a8a7a7b7fdbcb490/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:53.538676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7baf69-a4d6-4ddb-8846-acf49df6c79d admin admin] RBAC: Authorizing `identity:create_grant(project_id=35745d7a611143e285f41247889f517a, user_id=06c3400f2c9545f2a8a7a7b7fdbcb490, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:53.541269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7baf69-a4d6-4ddb-8846-acf49df6c79d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:53.553766 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 603/1190] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:33:53 2021] PUT /identity/v3/projects/35745d7a611143e285f41247889f517a/users/06c3400f2c9545f2a8a7a7b7fdbcb490/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:33:55.957427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39474404-eb27-406c-812c-cb9331194da9 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:55.957943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39474404-eb27-406c-812c-cb9331194da9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:55.958032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39474404-eb27-406c-812c-cb9331194da9 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:55.959796 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 588/1191] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:33:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:33:55.965672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a970b84-0b5a-4efc-804f-178de170659e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:55.966104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a970b84-0b5a-4efc-804f-178de170659e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:55.966200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a970b84-0b5a-4efc-804f-178de170659e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:55.983647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0a970b84-0b5a-4efc-804f-178de170659e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:33:55.984805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0a970b84-0b5a-4efc-804f-178de170659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:33:56.038072 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 604/1192] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:33:55 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:33:56.064039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39474404-eb27-406c-812c-cb9331194da9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:56.075965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39474404-eb27-406c-812c-cb9331194da9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:56.080329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a868c-d76f-46d5-88ef-6f2b2017bdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:56.081086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a868c-d76f-46d5-88ef-6f2b2017bdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:56.081372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a868c-d76f-46d5-88ef-6f2b2017bdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:56.081646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a868c-d76f-46d5-88ef-6f2b2017bdc9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:56.092158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a868c-d76f-46d5-88ef-6f2b2017bdc9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:33:56.098857 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-7a6a868c-d76f-46d5-88ef-6f2b2017bdc9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:33:56.099968 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 589/1193] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:33:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:33:56.106573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a970b84-0b5a-4efc-804f-178de170659e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:56.115060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a970b84-0b5a-4efc-804f-178de170659e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:56.119412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd18ff2-4c1b-49ae-a5b9-c0f97426c8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:56.120045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd18ff2-4c1b-49ae-a5b9-c0f97426c8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:56.120326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd18ff2-4c1b-49ae-a5b9-c0f97426c8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:56.120601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd18ff2-4c1b-49ae-a5b9-c0f97426c8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:56.121345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd18ff2-4c1b-49ae-a5b9-c0f97426c8a7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:56.121648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd18ff2-4c1b-49ae-a5b9-c0f97426c8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:56.123239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd18ff2-4c1b-49ae-a5b9-c0f97426c8a7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:56.131076 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 605/1194] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:33:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:56.136880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a868c-d76f-46d5-88ef-6f2b2017bdc9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:56.146642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a868c-d76f-46d5-88ef-6f2b2017bdc9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:56.152348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226c46c-32a8-4021-b91b-d2a91fb96c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:56.153202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226c46c-32a8-4021-b91b-d2a91fb96c5e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:56.153487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226c46c-32a8-4021-b91b-d2a91fb96c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:56.153769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226c46c-32a8-4021-b91b-d2a91fb96c5e admin admin] PATH_INFO: `/v3/users/06c3400f2c9545f2a8a7a7b7fdbcb490` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:56.154952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226c46c-32a8-4021-b91b-d2a91fb96c5e admin admin] RBAC: Authorizing `identity:get_user(user_id=06c3400f2c9545f2a8a7a7b7fdbcb490)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:56.157062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226c46c-32a8-4021-b91b-d2a91fb96c5e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:56.158741 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 590/1195] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Dec 18 20:33:56 2021] GET /identity/v3/users/06c3400f2c9545f2a8a7a7b7fdbcb490 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:33:56.165645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd18ff2-4c1b-49ae-a5b9-c0f97426c8a7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:56.174956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd18ff2-4c1b-49ae-a5b9-c0f97426c8a7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:56.179423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1623851-2353-4567-b406-8421b989fdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:56.180037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1623851-2353-4567-b406-8421b989fdda admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:56.180318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1623851-2353-4567-b406-8421b989fdda admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:56.180591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1623851-2353-4567-b406-8421b989fdda admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:56.189779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1623851-2353-4567-b406-8421b989fdda admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:56.191931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1623851-2353-4567-b406-8421b989fdda admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:56.203170 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 606/1196] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:33:56 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:33:56.209601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226c46c-32a8-4021-b91b-d2a91fb96c5e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:56.219673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226c46c-32a8-4021-b91b-d2a91fb96c5e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:56.224190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee5ae8-d38b-4157-802d-1354e7ff0f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:56.225007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee5ae8-d38b-4157-802d-1354e7ff0f5d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:56.225291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee5ae8-d38b-4157-802d-1354e7ff0f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:56.225578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee5ae8-d38b-4157-802d-1354e7ff0f5d admin admin] PATH_INFO: `/v3/projects/35745d7a611143e285f41247889f517a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:56.227363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee5ae8-d38b-4157-802d-1354e7ff0f5d admin admin] RBAC: Authorizing `identity:get_project(project_id=35745d7a611143e285f41247889f517a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:56.229363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee5ae8-d38b-4157-802d-1354e7ff0f5d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:56.231013 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 591/1197] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:33:56 2021] GET /identity/v3/projects/35745d7a611143e285f41247889f517a => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:33:56.236871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1623851-2353-4567-b406-8421b989fdda admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:33:56.245227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1623851-2353-4567-b406-8421b989fdda admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:33:56.249666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eaac6-17bb-4cbf-9fc7-efe22f725df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:33:56.250317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eaac6-17bb-4cbf-9fc7-efe22f725df3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:33:56.250601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eaac6-17bb-4cbf-9fc7-efe22f725df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:33:56.250875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eaac6-17bb-4cbf-9fc7-efe22f725df3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:33:56.251698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eaac6-17bb-4cbf-9fc7-efe22f725df3 admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=35745d7a611143e285f41247889f517a, user.id=06c3400f2c9545f2a8a7a7b7fdbcb490) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:33:56.252007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eaac6-17bb-4cbf-9fc7-efe22f725df3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:33:56.253848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eaac6-17bb-4cbf-9fc7-efe22f725df3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:33:56.259540 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 607/1198] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:33:56 2021] GET /identity/v3/role_assignments?user.id=06c3400f2c9545f2a8a7a7b7fdbcb490&scope.project.id=35745d7a611143e285f41247889f517a&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:34:56.369386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15b20-204d-4408-9dad-dbed4401ee2a None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:56.370034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15b20-204d-4408-9dad-dbed4401ee2a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:56.370034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15b20-204d-4408-9dad-dbed4401ee2a None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:56.371935 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 592/1199] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:34:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:34:56.378222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b7550-4a1f-4563-a009-0ff464a3e83a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:56.378713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b7550-4a1f-4563-a009-0ff464a3e83a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:56.378819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b7550-4a1f-4563-a009-0ff464a3e83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:56.399157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-902b7550-4a1f-4563-a009-0ff464a3e83a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:34:56.400380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-902b7550-4a1f-4563-a009-0ff464a3e83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:34:56.408566 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 608/1200] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:34:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:34:56.437864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa15b20-204d-4408-9dad-dbed4401ee2a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:34:56.451960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa15b20-204d-4408-9dad-dbed4401ee2a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:34:56.456756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeaf6a-30b6-49a8-89da-63799300fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:34:56.457535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeaf6a-30b6-49a8-89da-63799300fb94 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:56.458420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeaf6a-30b6-49a8-89da-63799300fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:56.458692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeaf6a-30b6-49a8-89da-63799300fb94 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:56.469426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeaf6a-30b6-49a8-89da-63799300fb94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:34:56.471304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeaf6a-30b6-49a8-89da-63799300fb94 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:34:56.492327 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-32aeaf6a-30b6-49a8-89da-63799300fb94 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:34:56.494036 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 593/1201] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:34:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:34:56.500458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b7550-4a1f-4563-a009-0ff464a3e83a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:34:56.510108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b7550-4a1f-4563-a009-0ff464a3e83a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:34:56.515169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bee948-4fb1-48a3-8467-04e4cc3f2959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:34:56.517811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bee948-4fb1-48a3-8467-04e4cc3f2959 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:56.517811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bee948-4fb1-48a3-8467-04e4cc3f2959 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:56.517811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bee948-4fb1-48a3-8467-04e4cc3f2959 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:56.517811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bee948-4fb1-48a3-8467-04e4cc3f2959 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:34:56.517811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bee948-4fb1-48a3-8467-04e4cc3f2959 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:34:56.519252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bee948-4fb1-48a3-8467-04e4cc3f2959 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:34:56.533019 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 609/1202] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:34:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:34:56.540006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeaf6a-30b6-49a8-89da-63799300fb94 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:34:56.551696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeaf6a-30b6-49a8-89da-63799300fb94 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:34:56.558072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619c828-aea4-41f4-9e8a-b80b714e10a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:34:56.559619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619c828-aea4-41f4-9e8a-b80b714e10a7 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:56.560197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619c828-aea4-41f4-9e8a-b80b714e10a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:56.560671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619c828-aea4-41f4-9e8a-b80b714e10a7 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:56.561645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619c828-aea4-41f4-9e8a-b80b714e10a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:34:56.563897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619c828-aea4-41f4-9e8a-b80b714e10a7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:34:56.589258 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 594/1203] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Dec 18 20:34:56 2021] POST /identity/v3/users => generated 251 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:34:59.225798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd0695-b600-4c52-868b-ba179cc61b32 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:59.226464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd0695-b600-4c52-868b-ba179cc61b32 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:59.226577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd0695-b600-4c52-868b-ba179cc61b32 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:59.228582 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 610/1204] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:34:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:34:59.235940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7cf1e-4ecd-4710-a047-18aabcbc8bfd None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:59.237134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7cf1e-4ecd-4710-a047-18aabcbc8bfd None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:59.237134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7cf1e-4ecd-4710-a047-18aabcbc8bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:59.256593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5fc7cf1e-4ecd-4710-a047-18aabcbc8bfd None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:34:59.257808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5fc7cf1e-4ecd-4710-a047-18aabcbc8bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:34:59.273427 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 595/1205] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:34:59 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:34:59.296872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd0695-b600-4c52-868b-ba179cc61b32 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:34:59.312441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd0695-b600-4c52-868b-ba179cc61b32 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:34:59.319879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8f017-0af0-4681-9de7-0ae575890fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:34:59.320899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8f017-0af0-4681-9de7-0ae575890fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:59.321161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8f017-0af0-4681-9de7-0ae575890fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:59.321392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8f017-0af0-4681-9de7-0ae575890fd3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:59.340361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8f017-0af0-4681-9de7-0ae575890fd3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:34:59.348548 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-9cc8f017-0af0-4681-9de7-0ae575890fd3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:34:59.350375 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 611/1206] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:34:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:34:59.356676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7cf1e-4ecd-4710-a047-18aabcbc8bfd None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:34:59.367992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7cf1e-4ecd-4710-a047-18aabcbc8bfd None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:34:59.373644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee3ded-d93a-421d-b7ab-e5e5a0011c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:34:59.374454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee3ded-d93a-421d-b7ab-e5e5a0011c3c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:59.375608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee3ded-d93a-421d-b7ab-e5e5a0011c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:59.375608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee3ded-d93a-421d-b7ab-e5e5a0011c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:59.375956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee3ded-d93a-421d-b7ab-e5e5a0011c3c admin admin] RBAC: Adding query filter params (name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:34:59.376316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee3ded-d93a-421d-b7ab-e5e5a0011c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:34:59.378085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee3ded-d93a-421d-b7ab-e5e5a0011c3c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:34:59.388874 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 596/1207] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:34:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:34:59.394421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8f017-0af0-4681-9de7-0ae575890fd3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:34:59.406124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8f017-0af0-4681-9de7-0ae575890fd3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:34:59.411818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc8175-027c-4031-82a0-5b29d6743fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:34:59.412799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc8175-027c-4031-82a0-5b29d6743fda admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:59.413125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc8175-027c-4031-82a0-5b29d6743fda admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:59.413431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc8175-027c-4031-82a0-5b29d6743fda admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:59.425033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc8175-027c-4031-82a0-5b29d6743fda admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:34:59.427606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc8175-027c-4031-82a0-5b29d6743fda admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:34:59.449879 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-7abc8175-027c-4031-82a0-5b29d6743fda admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:34:59.456125 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 612/1208] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:34:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:34:59.459833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee3ded-d93a-421d-b7ab-e5e5a0011c3c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:34:59.471274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee3ded-d93a-421d-b7ab-e5e5a0011c3c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:34:59.477071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5f125-72be-4e7d-85b8-fa7b2f997662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:34:59.477791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5f125-72be-4e7d-85b8-fa7b2f997662 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:59.478138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5f125-72be-4e7d-85b8-fa7b2f997662 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:59.478513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5f125-72be-4e7d-85b8-fa7b2f997662 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:59.479312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5f125-72be-4e7d-85b8-fa7b2f997662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:34:59.479670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5f125-72be-4e7d-85b8-fa7b2f997662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:34:59.481371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5f125-72be-4e7d-85b8-fa7b2f997662 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:34:59.496178 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 597/1209] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:34:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:34:59.503723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc8175-027c-4031-82a0-5b29d6743fda admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:34:59.514163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc8175-027c-4031-82a0-5b29d6743fda admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:34:59.519506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a418ffd-51e9-414a-a4f0-74cff216528b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:34:59.520493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a418ffd-51e9-414a-a4f0-74cff216528b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:59.520717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a418ffd-51e9-414a-a4f0-74cff216528b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:59.521013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a418ffd-51e9-414a-a4f0-74cff216528b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:59.529799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a418ffd-51e9-414a-a4f0-74cff216528b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:34:59.532086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a418ffd-51e9-414a-a4f0-74cff216528b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:34:59.549408 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-4a418ffd-51e9-414a-a4f0-74cff216528b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 18 20:34:59.550909 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 613/1210] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:34:59 2021] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:34:59.558179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5f125-72be-4e7d-85b8-fa7b2f997662 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:34:59.569722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5f125-72be-4e7d-85b8-fa7b2f997662 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:34:59.574696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ce924-e76c-48f8-b582-d264955d3f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:34:59.575434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ce924-e76c-48f8-b582-d264955d3f75 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:59.575737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ce924-e76c-48f8-b582-d264955d3f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:59.576176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ce924-e76c-48f8-b582-d264955d3f75 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:59.576927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ce924-e76c-48f8-b582-d264955d3f75 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:34:59.577262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ce924-e76c-48f8-b582-d264955d3f75 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:34:59.579400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ce924-e76c-48f8-b582-d264955d3f75 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:34:59.601216 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 598/1211] 10.222.0.13 () {56 vars in 1164 bytes} [Sat Dec 18 20:34:59 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:34:59.608183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a418ffd-51e9-414a-a4f0-74cff216528b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:34:59.619106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a418ffd-51e9-414a-a4f0-74cff216528b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:34:59.624501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016217d7-6b83-4408-83da-94f858c89450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:34:59.625391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016217d7-6b83-4408-83da-94f858c89450 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:59.625933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016217d7-6b83-4408-83da-94f858c89450 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:59.626413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016217d7-6b83-4408-83da-94f858c89450 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:59.638277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016217d7-6b83-4408-83da-94f858c89450 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:34:59.640986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016217d7-6b83-4408-83da-94f858c89450 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:34:59.652449 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 614/1212] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:34:59 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:34:59.659045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ce924-e76c-48f8-b582-d264955d3f75 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:34:59.670275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ce924-e76c-48f8-b582-d264955d3f75 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:34:59.675489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ef756-3d86-48e7-8217-84baf0443eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:34:59.676462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ef756-3d86-48e7-8217-84baf0443eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:59.676810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ef756-3d86-48e7-8217-84baf0443eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:59.677039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ef756-3d86-48e7-8217-84baf0443eb6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:59.689728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ef756-3d86-48e7-8217-84baf0443eb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:34:59.692409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ef756-3d86-48e7-8217-84baf0443eb6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:34:59.710372 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-c47ef756-3d86-48e7-8217-84baf0443eb6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:34:59.712471 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 599/1213] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:34:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:34:59.718436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016217d7-6b83-4408-83da-94f858c89450 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:34:59.729167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016217d7-6b83-4408-83da-94f858c89450 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:34:59.734783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2434b67-b338-47bb-bd0d-4bb37e0f6856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:34:59.735458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2434b67-b338-47bb-bd0d-4bb37e0f6856 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:59.735732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2434b67-b338-47bb-bd0d-4bb37e0f6856 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:59.736010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2434b67-b338-47bb-bd0d-4bb37e0f6856 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:59.736836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2434b67-b338-47bb-bd0d-4bb37e0f6856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:34:59.737145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2434b67-b338-47bb-bd0d-4bb37e0f6856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:34:59.739370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2434b67-b338-47bb-bd0d-4bb37e0f6856 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:34:59.755239 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 615/1214] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:34:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:34:59.761928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ef756-3d86-48e7-8217-84baf0443eb6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:34:59.773565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ef756-3d86-48e7-8217-84baf0443eb6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:34:59.778513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21f22c-f0d9-4951-bdb7-49e0d0f5f471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:34:59.779420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21f22c-f0d9-4951-bdb7-49e0d0f5f471 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:59.780420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21f22c-f0d9-4951-bdb7-49e0d0f5f471 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:59.780420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21f22c-f0d9-4951-bdb7-49e0d0f5f471 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:59.789807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21f22c-f0d9-4951-bdb7-49e0d0f5f471 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:34:59.792286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21f22c-f0d9-4951-bdb7-49e0d0f5f471 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:34:59.807697 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-6c21f22c-f0d9-4951-bdb7-49e0d0f5f471 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:34:59.809263 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 600/1215] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:34:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:34:59.816031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2434b67-b338-47bb-bd0d-4bb37e0f6856 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:34:59.827254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2434b67-b338-47bb-bd0d-4bb37e0f6856 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:34:59.832088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b8dd4-ec4d-4940-8f47-9eff6005e23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:34:59.833258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b8dd4-ec4d-4940-8f47-9eff6005e23a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:59.833542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b8dd4-ec4d-4940-8f47-9eff6005e23a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:59.833819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b8dd4-ec4d-4940-8f47-9eff6005e23a admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:59.834645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b8dd4-ec4d-4940-8f47-9eff6005e23a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:34:59.834954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b8dd4-ec4d-4940-8f47-9eff6005e23a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:34:59.837052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b8dd4-ec4d-4940-8f47-9eff6005e23a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:34:59.853190 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 616/1216] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:34:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:34:59.860177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21f22c-f0d9-4951-bdb7-49e0d0f5f471 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:34:59.871516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21f22c-f0d9-4951-bdb7-49e0d0f5f471 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:34:59.876178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaca5e5-6a2a-4c49-b77c-f9a74ed934c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:34:59.876869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaca5e5-6a2a-4c49-b77c-f9a74ed934c4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:34:59.877155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaca5e5-6a2a-4c49-b77c-f9a74ed934c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:34:59.877430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaca5e5-6a2a-4c49-b77c-f9a74ed934c4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:34:59.878284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaca5e5-6a2a-4c49-b77c-f9a74ed934c4 admin admin] RBAC: Adding query filter params (role.id=0071fc3d75b34850b7fb01a06a0279c5, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=55f16dc3d38a4270a0fb29944a655356) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:34:59.878659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaca5e5-6a2a-4c49-b77c-f9a74ed934c4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:34:59.881288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaca5e5-6a2a-4c49-b77c-f9a74ed934c4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:34:59.888026 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 601/1217] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:34:59 2021] GET /identity/v3/role_assignments?user.id=55f16dc3d38a4270a0fb29944a655356&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=0071fc3d75b34850b7fb01a06a0279c5 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:02.606067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133b9ad-c260-4acc-8ff3-e14bef7579ae None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:02.606744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133b9ad-c260-4acc-8ff3-e14bef7579ae None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:02.606744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133b9ad-c260-4acc-8ff3-e14bef7579ae None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:02.608535 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 617/1218] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:35:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:35:02.615731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3128d0-18dd-496f-ad0a-f75ddfea04ce None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:02.616185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3128d0-18dd-496f-ad0a-f75ddfea04ce None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:02.616453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3128d0-18dd-496f-ad0a-f75ddfea04ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:02.635001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4d3128d0-18dd-496f-ad0a-f75ddfea04ce None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:35:02.636294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4d3128d0-18dd-496f-ad0a-f75ddfea04ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:35:02.644644 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 602/1219] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:35:02 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:35:02.674907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133b9ad-c260-4acc-8ff3-e14bef7579ae None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:02.689712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133b9ad-c260-4acc-8ff3-e14bef7579ae None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:02.694835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d94ec-6b41-4b83-b870-67fb67deac42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:02.695682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d94ec-6b41-4b83-b870-67fb67deac42 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:02.695995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d94ec-6b41-4b83-b870-67fb67deac42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:02.696318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d94ec-6b41-4b83-b870-67fb67deac42 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:02.707613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d94ec-6b41-4b83-b870-67fb67deac42 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:35:02.714946 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-d89d94ec-6b41-4b83-b870-67fb67deac42 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:35:02.716040 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 618/1220] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:35:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:02.723491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3128d0-18dd-496f-ad0a-f75ddfea04ce None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:02.733878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3128d0-18dd-496f-ad0a-f75ddfea04ce None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:02.739737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9587e1-735f-44cc-8672-10e7da42bf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:02.740553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9587e1-735f-44cc-8672-10e7da42bf47 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:02.740834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9587e1-735f-44cc-8672-10e7da42bf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:02.741104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9587e1-735f-44cc-8672-10e7da42bf47 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:02.741857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9587e1-735f-44cc-8672-10e7da42bf47 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:02.742160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9587e1-735f-44cc-8672-10e7da42bf47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:02.743773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9587e1-735f-44cc-8672-10e7da42bf47 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:02.753674 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 603/1221] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:35:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:02.760128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d94ec-6b41-4b83-b870-67fb67deac42 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:02.770505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d94ec-6b41-4b83-b870-67fb67deac42 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:02.775172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a2945-2eba-488c-a81f-5b5edd35d1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:02.776035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a2945-2eba-488c-a81f-5b5edd35d1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:02.776391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a2945-2eba-488c-a81f-5b5edd35d1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:02.776675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a2945-2eba-488c-a81f-5b5edd35d1c9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:02.789193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a2945-2eba-488c-a81f-5b5edd35d1c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:02.791093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a2945-2eba-488c-a81f-5b5edd35d1c9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:02.812043 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-b45a2945-2eba-488c-a81f-5b5edd35d1c9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:35:02.813372 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 619/1222] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:35:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:02.820265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9587e1-735f-44cc-8672-10e7da42bf47 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:02.833390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9587e1-735f-44cc-8672-10e7da42bf47 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:02.838879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f7ee4-693c-4585-863c-da3cf22fe8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:02.839579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f7ee4-693c-4585-863c-da3cf22fe8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:02.840002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f7ee4-693c-4585-863c-da3cf22fe8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:02.840375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f7ee4-693c-4585-863c-da3cf22fe8a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:02.841356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f7ee4-693c-4585-863c-da3cf22fe8a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:02.841739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f7ee4-693c-4585-863c-da3cf22fe8a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:02.843872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f7ee4-693c-4585-863c-da3cf22fe8a2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:02.856458 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 604/1223] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:35:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:02.862644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a2945-2eba-488c-a81f-5b5edd35d1c9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:02.873416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a2945-2eba-488c-a81f-5b5edd35d1c9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:02.879060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b5049-8624-48c5-bdfb-6edb5df8a053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:02.879895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b5049-8624-48c5-bdfb-6edb5df8a053 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:02.880216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b5049-8624-48c5-bdfb-6edb5df8a053 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:02.880690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b5049-8624-48c5-bdfb-6edb5df8a053 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:02.890603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b5049-8624-48c5-bdfb-6edb5df8a053 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:02.893305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b5049-8624-48c5-bdfb-6edb5df8a053 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:02.911093 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-4f9b5049-8624-48c5-bdfb-6edb5df8a053 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 18 20:35:02.918042 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 620/1224] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:35:02 2021] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:02.919242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f7ee4-693c-4585-863c-da3cf22fe8a2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:02.929194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f7ee4-693c-4585-863c-da3cf22fe8a2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:02.933899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b98c2-b3a3-412b-a8fc-b6f296f65c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:02.934937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b98c2-b3a3-412b-a8fc-b6f296f65c99 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:02.935292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b98c2-b3a3-412b-a8fc-b6f296f65c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:02.935639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b98c2-b3a3-412b-a8fc-b6f296f65c99 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:02.936555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b98c2-b3a3-412b-a8fc-b6f296f65c99 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:02.936872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b98c2-b3a3-412b-a8fc-b6f296f65c99 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:02.938762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b98c2-b3a3-412b-a8fc-b6f296f65c99 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:02.955870 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 605/1225] 10.222.0.13 () {56 vars in 1164 bytes} [Sat Dec 18 20:35:02 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:02.962728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b5049-8624-48c5-bdfb-6edb5df8a053 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:02.973889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b5049-8624-48c5-bdfb-6edb5df8a053 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:02.980221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b6f90-9778-4a25-b92c-8aa1afeeeb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:02.981323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b6f90-9778-4a25-b92c-8aa1afeeeb1a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:02.981640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b6f90-9778-4a25-b92c-8aa1afeeeb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:02.982069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b6f90-9778-4a25-b92c-8aa1afeeeb1a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:02.995726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b6f90-9778-4a25-b92c-8aa1afeeeb1a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:02.997813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b6f90-9778-4a25-b92c-8aa1afeeeb1a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:03.017633 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-d80b6f90-9778-4a25-b92c-8aa1afeeeb1a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:35:03.019253 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 621/1226] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:35:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:35:03.026530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b98c2-b3a3-412b-a8fc-b6f296f65c99 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:03.036864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b98c2-b3a3-412b-a8fc-b6f296f65c99 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:03.041378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5c2e9-57b9-48c5-9511-5f6fb6ea958f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:03.042020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5c2e9-57b9-48c5-9511-5f6fb6ea958f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:03.042337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5c2e9-57b9-48c5-9511-5f6fb6ea958f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:03.042618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5c2e9-57b9-48c5-9511-5f6fb6ea958f admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:03.043343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5c2e9-57b9-48c5-9511-5f6fb6ea958f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:03.043648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5c2e9-57b9-48c5-9511-5f6fb6ea958f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:03.045235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5c2e9-57b9-48c5-9511-5f6fb6ea958f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:03.063051 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 606/1227] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:35:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:35:03.064346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b6f90-9778-4a25-b92c-8aa1afeeeb1a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:03.076554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b6f90-9778-4a25-b92c-8aa1afeeeb1a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:03.081889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f96d6f-c2be-4fa3-822f-b77a0ae67484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:03.083341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96d6f-c2be-4fa3-822f-b77a0ae67484 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:03.083692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96d6f-c2be-4fa3-822f-b77a0ae67484 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:03.084208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96d6f-c2be-4fa3-822f-b77a0ae67484 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:03.092422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f96d6f-c2be-4fa3-822f-b77a0ae67484 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:03.095040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f96d6f-c2be-4fa3-822f-b77a0ae67484 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:03.112733 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-73f96d6f-c2be-4fa3-822f-b77a0ae67484 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:35:03.114021 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 622/1228] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:35:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:03.120892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5c2e9-57b9-48c5-9511-5f6fb6ea958f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:03.131042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5c2e9-57b9-48c5-9511-5f6fb6ea958f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:03.135683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928d3e2-cd53-4712-8aa7-d98575287837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:03.136322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928d3e2-cd53-4712-8aa7-d98575287837 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:03.136612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928d3e2-cd53-4712-8aa7-d98575287837 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:03.136890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928d3e2-cd53-4712-8aa7-d98575287837 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:03.137684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928d3e2-cd53-4712-8aa7-d98575287837 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:03.137992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928d3e2-cd53-4712-8aa7-d98575287837 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:03.139882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928d3e2-cd53-4712-8aa7-d98575287837 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:03.153315 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 607/1229] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:35:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:03.159835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f96d6f-c2be-4fa3-822f-b77a0ae67484 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:03.169406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f96d6f-c2be-4fa3-822f-b77a0ae67484 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:03.174138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc8166-a0be-4592-b728-efabb5f7fba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:03.175052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8166-a0be-4592-b728-efabb5f7fba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:03.175338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8166-a0be-4592-b728-efabb5f7fba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:03.175615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8166-a0be-4592-b728-efabb5f7fba6 admin admin] PATH_INFO: `/v3/projects/0dd4d15f423642fa8da604b758048203/users/55f16dc3d38a4270a0fb29944a655356/roles/0071fc3d75b34850b7fb01a06a0279c5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:03.193094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc8166-a0be-4592-b728-efabb5f7fba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd4d15f423642fa8da604b758048203, user_id=55f16dc3d38a4270a0fb29944a655356, role_id=0071fc3d75b34850b7fb01a06a0279c5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:03.196279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc8166-a0be-4592-b728-efabb5f7fba6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:03.214392 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 623/1230] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:35:03 2021] PUT /identity/v3/projects/0dd4d15f423642fa8da604b758048203/users/55f16dc3d38a4270a0fb29944a655356/roles/0071fc3d75b34850b7fb01a06a0279c5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:35:05.955075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5949b-498b-46fc-bcb8-30e034b0f1e0 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:05.955611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5949b-498b-46fc-bcb8-30e034b0f1e0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:05.955611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5949b-498b-46fc-bcb8-30e034b0f1e0 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:05.957883 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 608/1231] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:35:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:35:05.964487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d141f1-86ab-4ffb-8561-f41be6bc8a54 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:05.965029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d141f1-86ab-4ffb-8561-f41be6bc8a54 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:05.965178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d141f1-86ab-4ffb-8561-f41be6bc8a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:05.986483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-93d141f1-86ab-4ffb-8561-f41be6bc8a54 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:35:05.987683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-93d141f1-86ab-4ffb-8561-f41be6bc8a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:35:06.049907 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 624/1232] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:35:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:35:06.083733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5949b-498b-46fc-bcb8-30e034b0f1e0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:06.097378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5949b-498b-46fc-bcb8-30e034b0f1e0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:06.101774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f684552-bf70-4e64-b421-f3eb8ca099a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:06.102584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f684552-bf70-4e64-b421-f3eb8ca099a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:06.102866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f684552-bf70-4e64-b421-f3eb8ca099a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:06.103140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f684552-bf70-4e64-b421-f3eb8ca099a7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:06.113250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f684552-bf70-4e64-b421-f3eb8ca099a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:35:06.120843 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-0f684552-bf70-4e64-b421-f3eb8ca099a7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 18 20:35:06.122102 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 609/1233] 10.222.0.13 () {56 vars in 1123 bytes} [Sat Dec 18 20:35:06 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:06.128523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d141f1-86ab-4ffb-8561-f41be6bc8a54 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:06.138086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d141f1-86ab-4ffb-8561-f41be6bc8a54 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:06.142579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbfe36-2f03-4dfc-9853-448240a3cd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:06.143235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbfe36-2f03-4dfc-9853-448240a3cd90 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:06.143517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbfe36-2f03-4dfc-9853-448240a3cd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:06.143793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbfe36-2f03-4dfc-9853-448240a3cd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:06.144542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbfe36-2f03-4dfc-9853-448240a3cd90 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:06.145206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbfe36-2f03-4dfc-9853-448240a3cd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:06.146802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbfe36-2f03-4dfc-9853-448240a3cd90 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:06.154950 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 625/1234] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Dec 18 20:35:06 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:06.161448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f684552-bf70-4e64-b421-f3eb8ca099a7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:06.171193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f684552-bf70-4e64-b421-f3eb8ca099a7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:06.176762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92abc9-4e65-4d4f-8237-e6333dd03b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:06.177553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92abc9-4e65-4d4f-8237-e6333dd03b8a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:06.177838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92abc9-4e65-4d4f-8237-e6333dd03b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:06.178150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92abc9-4e65-4d4f-8237-e6333dd03b8a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:06.190956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92abc9-4e65-4d4f-8237-e6333dd03b8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:06.193368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92abc9-4e65-4d4f-8237-e6333dd03b8a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:06.212993 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-eb92abc9-4e65-4d4f-8237-e6333dd03b8a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:35:06.214217 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 610/1235] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:35:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:06.220984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbfe36-2f03-4dfc-9853-448240a3cd90 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:06.232694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbfe36-2f03-4dfc-9853-448240a3cd90 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:06.238589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82702930-9efb-4f46-a06b-d5bd93c2e57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:06.239180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82702930-9efb-4f46-a06b-d5bd93c2e57a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:06.239995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82702930-9efb-4f46-a06b-d5bd93c2e57a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:06.240323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82702930-9efb-4f46-a06b-d5bd93c2e57a admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:06.241138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82702930-9efb-4f46-a06b-d5bd93c2e57a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:06.241474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82702930-9efb-4f46-a06b-d5bd93c2e57a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:06.243391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82702930-9efb-4f46-a06b-d5bd93c2e57a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:06.266158 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 626/1236] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:35:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:06.272685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92abc9-4e65-4d4f-8237-e6333dd03b8a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:06.283780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92abc9-4e65-4d4f-8237-e6333dd03b8a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:06.291211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041463d-e9ca-46b4-9aa6-339af9c9c8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:06.292318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041463d-e9ca-46b4-9aa6-339af9c9c8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:06.292681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041463d-e9ca-46b4-9aa6-339af9c9c8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:06.292961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041463d-e9ca-46b4-9aa6-339af9c9c8a3 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:06.303889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041463d-e9ca-46b4-9aa6-339af9c9c8a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:06.305973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041463d-e9ca-46b4-9aa6-339af9c9c8a3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:06.320359 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-7041463d-e9ca-46b4-9aa6-339af9c9c8a3 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 18 20:35:06.321548 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 611/1237] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:35:06 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:35:06.328601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82702930-9efb-4f46-a06b-d5bd93c2e57a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:06.338736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82702930-9efb-4f46-a06b-d5bd93c2e57a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:06.343366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c7416-1450-420f-ad97-b1221129c8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:06.344075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c7416-1450-420f-ad97-b1221129c8bf admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:06.344358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c7416-1450-420f-ad97-b1221129c8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:06.344636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c7416-1450-420f-ad97-b1221129c8bf admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:06.345510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c7416-1450-420f-ad97-b1221129c8bf admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:06.345816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c7416-1450-420f-ad97-b1221129c8bf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:06.347703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c7416-1450-420f-ad97-b1221129c8bf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:06.367322 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 627/1238] 10.222.0.13 () {56 vars in 1164 bytes} [Sat Dec 18 20:35:06 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:06.376482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041463d-e9ca-46b4-9aa6-339af9c9c8a3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:06.387199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041463d-e9ca-46b4-9aa6-339af9c9c8a3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:06.394334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751a6ce-4e58-4f4c-8ce8-8dc0a3283196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:06.395216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751a6ce-4e58-4f4c-8ce8-8dc0a3283196 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:06.395540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751a6ce-4e58-4f4c-8ce8-8dc0a3283196 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:06.395816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751a6ce-4e58-4f4c-8ce8-8dc0a3283196 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:06.404315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751a6ce-4e58-4f4c-8ce8-8dc0a3283196 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:06.406041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751a6ce-4e58-4f4c-8ce8-8dc0a3283196 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:06.417377 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 612/1239] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:35:06 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:35:06.424116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c7416-1450-420f-ad97-b1221129c8bf admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:06.434949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c7416-1450-420f-ad97-b1221129c8bf admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:06.439463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c2f2a-5ba8-4c0e-9252-3d3758662d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:06.440241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c2f2a-5ba8-4c0e-9252-3d3758662d42 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:06.440518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c2f2a-5ba8-4c0e-9252-3d3758662d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:06.440831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c2f2a-5ba8-4c0e-9252-3d3758662d42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:06.451272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c2f2a-5ba8-4c0e-9252-3d3758662d42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:06.453686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c2f2a-5ba8-4c0e-9252-3d3758662d42 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:06.471368 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-2d1c2f2a-5ba8-4c0e-9252-3d3758662d42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:35:06.473402 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 628/1240] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:35:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:35:06.479924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751a6ce-4e58-4f4c-8ce8-8dc0a3283196 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:06.490470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751a6ce-4e58-4f4c-8ce8-8dc0a3283196 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:06.495551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17dcdc-44db-432f-a045-a20e6200294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:06.496308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17dcdc-44db-432f-a045-a20e6200294e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:06.496594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17dcdc-44db-432f-a045-a20e6200294e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:06.496874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17dcdc-44db-432f-a045-a20e6200294e admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:06.497633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17dcdc-44db-432f-a045-a20e6200294e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:06.497986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17dcdc-44db-432f-a045-a20e6200294e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:06.499806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17dcdc-44db-432f-a045-a20e6200294e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:06.513233 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 613/1241] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:35:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:06.519426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c2f2a-5ba8-4c0e-9252-3d3758662d42 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:06.529466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c2f2a-5ba8-4c0e-9252-3d3758662d42 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:06.534268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892515d4-ac05-48a6-894f-9eedd204634a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:06.535052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892515d4-ac05-48a6-894f-9eedd204634a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:06.535950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892515d4-ac05-48a6-894f-9eedd204634a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:06.536223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892515d4-ac05-48a6-894f-9eedd204634a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:06.543378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892515d4-ac05-48a6-894f-9eedd204634a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:06.545306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892515d4-ac05-48a6-894f-9eedd204634a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:06.557977 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-892515d4-ac05-48a6-894f-9eedd204634a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:35:06.559161 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 629/1242] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:35:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:06.565719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17dcdc-44db-432f-a045-a20e6200294e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:06.575478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17dcdc-44db-432f-a045-a20e6200294e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:06.580094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b691c9-4eef-47b2-be55-99804cdeefdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:06.580731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b691c9-4eef-47b2-be55-99804cdeefdd admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:06.581018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b691c9-4eef-47b2-be55-99804cdeefdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:06.581304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b691c9-4eef-47b2-be55-99804cdeefdd admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:06.582060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b691c9-4eef-47b2-be55-99804cdeefdd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:06.582935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b691c9-4eef-47b2-be55-99804cdeefdd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:06.584751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b691c9-4eef-47b2-be55-99804cdeefdd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:06.602473 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 614/1243] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:35:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:06.603905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892515d4-ac05-48a6-894f-9eedd204634a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:06.614578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892515d4-ac05-48a6-894f-9eedd204634a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:06.619292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1341d3f-dba9-4958-8563-4e4735487d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:06.619925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1341d3f-dba9-4958-8563-4e4735487d0a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:06.620206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1341d3f-dba9-4958-8563-4e4735487d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:06.620479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1341d3f-dba9-4958-8563-4e4735487d0a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:06.621308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1341d3f-dba9-4958-8563-4e4735487d0a admin admin] RBAC: Adding query filter params (role.id=0071fc3d75b34850b7fb01a06a0279c5, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=55f16dc3d38a4270a0fb29944a655356) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:06.621615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1341d3f-dba9-4958-8563-4e4735487d0a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:06.623468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1341d3f-dba9-4958-8563-4e4735487d0a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:06.629406 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 630/1244] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:35:06 2021] GET /identity/v3/role_assignments?user.id=55f16dc3d38a4270a0fb29944a655356&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=0071fc3d75b34850b7fb01a06a0279c5 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:35:09.343886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7103d8-9207-4d1f-a840-53c3170b59bd None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:09.344437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7103d8-9207-4d1f-a840-53c3170b59bd None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:09.344437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7103d8-9207-4d1f-a840-53c3170b59bd None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:09.346272 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 615/1245] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:35:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:35:09.353409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb796d-2846-465d-940f-d1fddec941c8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:09.353859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb796d-2846-465d-940f-d1fddec941c8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:09.353951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb796d-2846-465d-940f-d1fddec941c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:09.374889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0efb796d-2846-465d-940f-d1fddec941c8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:35:09.376236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0efb796d-2846-465d-940f-d1fddec941c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:35:09.386690 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 631/1246] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:35:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:35:09.414094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7103d8-9207-4d1f-a840-53c3170b59bd None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:09.427501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7103d8-9207-4d1f-a840-53c3170b59bd None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:09.432689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac687a3-51e9-4d13-af40-3f04120269d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:09.433736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac687a3-51e9-4d13-af40-3f04120269d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:09.434094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac687a3-51e9-4d13-af40-3f04120269d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:09.434719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac687a3-51e9-4d13-af40-3f04120269d4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:09.446682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac687a3-51e9-4d13-af40-3f04120269d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:35:09.453406 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-7ac687a3-51e9-4d13-af40-3f04120269d4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:35:09.454651 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 616/1247] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:35:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:09.461112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb796d-2846-465d-940f-d1fddec941c8 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:09.470628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb796d-2846-465d-940f-d1fddec941c8 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:09.475824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26a635-eb40-4b23-8d2a-980aafe67919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:09.476481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26a635-eb40-4b23-8d2a-980aafe67919 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:09.476763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26a635-eb40-4b23-8d2a-980aafe67919 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:09.477035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26a635-eb40-4b23-8d2a-980aafe67919 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:09.477785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26a635-eb40-4b23-8d2a-980aafe67919 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:09.478088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26a635-eb40-4b23-8d2a-980aafe67919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:09.479782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26a635-eb40-4b23-8d2a-980aafe67919 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:09.488265 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 632/1248] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:35:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:09.496039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac687a3-51e9-4d13-af40-3f04120269d4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:09.507321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac687a3-51e9-4d13-af40-3f04120269d4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:09.511896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab033166-c72b-4cbe-84c5-23484c079a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:09.512728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab033166-c72b-4cbe-84c5-23484c079a40 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:09.513113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab033166-c72b-4cbe-84c5-23484c079a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:09.513478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab033166-c72b-4cbe-84c5-23484c079a40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:09.525387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab033166-c72b-4cbe-84c5-23484c079a40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:09.527234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab033166-c72b-4cbe-84c5-23484c079a40 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:09.544531 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-ab033166-c72b-4cbe-84c5-23484c079a40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:35:09.545762 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 617/1249] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:35:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:09.552400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26a635-eb40-4b23-8d2a-980aafe67919 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:09.564594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26a635-eb40-4b23-8d2a-980aafe67919 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:09.570776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cdf24-6413-4303-b7e9-04a387b6b3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:09.571477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cdf24-6413-4303-b7e9-04a387b6b3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:09.571862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cdf24-6413-4303-b7e9-04a387b6b3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:09.572258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cdf24-6413-4303-b7e9-04a387b6b3d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:09.573140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cdf24-6413-4303-b7e9-04a387b6b3d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:09.573455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cdf24-6413-4303-b7e9-04a387b6b3d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:09.575506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cdf24-6413-4303-b7e9-04a387b6b3d7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:09.594677 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 633/1250] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:35:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:09.596418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab033166-c72b-4cbe-84c5-23484c079a40 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:09.606273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab033166-c72b-4cbe-84c5-23484c079a40 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:09.610772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2aab94-6eff-45c3-b3c8-65eb6847a400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:09.611553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aab94-6eff-45c3-b3c8-65eb6847a400 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:09.611887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aab94-6eff-45c3-b3c8-65eb6847a400 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:09.612238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aab94-6eff-45c3-b3c8-65eb6847a400 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:09.619997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2aab94-6eff-45c3-b3c8-65eb6847a400 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:09.621996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2aab94-6eff-45c3-b3c8-65eb6847a400 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:09.636742 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-0f2aab94-6eff-45c3-b3c8-65eb6847a400 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 18 20:35:09.638235 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 618/1251] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:35:09 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:09.645105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cdf24-6413-4303-b7e9-04a387b6b3d7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:09.655094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cdf24-6413-4303-b7e9-04a387b6b3d7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:09.659767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd49f6-aace-458a-bf61-25d400960806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:09.661089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd49f6-aace-458a-bf61-25d400960806 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:09.661384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd49f6-aace-458a-bf61-25d400960806 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:09.661659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd49f6-aace-458a-bf61-25d400960806 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:09.662579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd49f6-aace-458a-bf61-25d400960806 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:09.662944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd49f6-aace-458a-bf61-25d400960806 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:09.665012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd49f6-aace-458a-bf61-25d400960806 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:09.686841 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 634/1252] 10.222.0.13 () {56 vars in 1164 bytes} [Sat Dec 18 20:35:09 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:09.693325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2aab94-6eff-45c3-b3c8-65eb6847a400 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:09.705558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2aab94-6eff-45c3-b3c8-65eb6847a400 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:09.713820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efc58a-85b8-4e77-a186-ac525b0a1d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:09.714884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efc58a-85b8-4e77-a186-ac525b0a1d78 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:09.714884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efc58a-85b8-4e77-a186-ac525b0a1d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:09.715062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efc58a-85b8-4e77-a186-ac525b0a1d78 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:09.724623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efc58a-85b8-4e77-a186-ac525b0a1d78 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:09.726614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efc58a-85b8-4e77-a186-ac525b0a1d78 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:09.737798 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 619/1253] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:35:09 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:35:09.744494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd49f6-aace-458a-bf61-25d400960806 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:09.754475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd49f6-aace-458a-bf61-25d400960806 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:09.759083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165afcf2-b6b0-4be6-bd52-1cd115234fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:09.759868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165afcf2-b6b0-4be6-bd52-1cd115234fff admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:09.760151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165afcf2-b6b0-4be6-bd52-1cd115234fff admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:09.760430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165afcf2-b6b0-4be6-bd52-1cd115234fff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:09.772226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165afcf2-b6b0-4be6-bd52-1cd115234fff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:09.774040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165afcf2-b6b0-4be6-bd52-1cd115234fff admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:09.793023 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-165afcf2-b6b0-4be6-bd52-1cd115234fff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:35:09.795558 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 635/1254] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:35:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:09.803260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efc58a-85b8-4e77-a186-ac525b0a1d78 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:09.814634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efc58a-85b8-4e77-a186-ac525b0a1d78 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:09.819431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d83ec-c8dd-4f46-901a-2ed9ed09e9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:09.820391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d83ec-c8dd-4f46-901a-2ed9ed09e9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:09.820784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d83ec-c8dd-4f46-901a-2ed9ed09e9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:09.821159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d83ec-c8dd-4f46-901a-2ed9ed09e9f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:09.822021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d83ec-c8dd-4f46-901a-2ed9ed09e9f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:09.822451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d83ec-c8dd-4f46-901a-2ed9ed09e9f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:09.824132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d83ec-c8dd-4f46-901a-2ed9ed09e9f1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:09.839225 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 620/1255] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:35:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:09.846495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165afcf2-b6b0-4be6-bd52-1cd115234fff admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:09.859156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165afcf2-b6b0-4be6-bd52-1cd115234fff admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:09.866103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c44125-4f3a-4c85-90a0-56a760ee4d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:09.866925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c44125-4f3a-4c85-90a0-56a760ee4d42 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:09.867215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c44125-4f3a-4c85-90a0-56a760ee4d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:09.867490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c44125-4f3a-4c85-90a0-56a760ee4d42 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:09.876222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c44125-4f3a-4c85-90a0-56a760ee4d42 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:09.879508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c44125-4f3a-4c85-90a0-56a760ee4d42 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:09.896921 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-10c44125-4f3a-4c85-90a0-56a760ee4d42 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:35:09.898465 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 636/1256] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:35:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:09.906465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d83ec-c8dd-4f46-901a-2ed9ed09e9f1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:09.916323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d83ec-c8dd-4f46-901a-2ed9ed09e9f1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:09.921948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3c07f-0b00-4f52-88f6-66b2fc086c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:09.922858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3c07f-0b00-4f52-88f6-66b2fc086c1e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:09.923288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3c07f-0b00-4f52-88f6-66b2fc086c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:09.923592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3c07f-0b00-4f52-88f6-66b2fc086c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:09.924662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3c07f-0b00-4f52-88f6-66b2fc086c1e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:09.925088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3c07f-0b00-4f52-88f6-66b2fc086c1e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:09.927600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3c07f-0b00-4f52-88f6-66b2fc086c1e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:09.942928 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 621/1257] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:35:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:35:09.951328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c44125-4f3a-4c85-90a0-56a760ee4d42 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:09.964525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c44125-4f3a-4c85-90a0-56a760ee4d42 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:09.970138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15168a98-a8f5-4b63-8986-8b91e30e921d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:09.970814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15168a98-a8f5-4b63-8986-8b91e30e921d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:09.971099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15168a98-a8f5-4b63-8986-8b91e30e921d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:09.971377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15168a98-a8f5-4b63-8986-8b91e30e921d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:09.972241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15168a98-a8f5-4b63-8986-8b91e30e921d admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=55f16dc3d38a4270a0fb29944a655356) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:09.972555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15168a98-a8f5-4b63-8986-8b91e30e921d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:09.974434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15168a98-a8f5-4b63-8986-8b91e30e921d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:09.982346 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 637/1258] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:35:09 2021] GET /identity/v3/role_assignments?user.id=55f16dc3d38a4270a0fb29944a655356&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:12.562683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303ea91-e897-4d52-b687-41af4e099f98 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:12.563268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303ea91-e897-4d52-b687-41af4e099f98 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:12.563462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303ea91-e897-4d52-b687-41af4e099f98 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:12.565350 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 622/1259] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:35:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:35:12.571903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19be626-9565-4094-91a1-c04dce75a623 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:12.572362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19be626-9565-4094-91a1-c04dce75a623 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:12.572478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19be626-9565-4094-91a1-c04dce75a623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:12.591788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d19be626-9565-4094-91a1-c04dce75a623 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:35:12.592982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d19be626-9565-4094-91a1-c04dce75a623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:35:12.602707 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 638/1260] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:35:12 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:35:12.628671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303ea91-e897-4d52-b687-41af4e099f98 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:12.641719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303ea91-e897-4d52-b687-41af4e099f98 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:12.647357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e123574-8c0f-4a0e-8236-2181281e4bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:12.648183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e123574-8c0f-4a0e-8236-2181281e4bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:12.648471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e123574-8c0f-4a0e-8236-2181281e4bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:12.648700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e123574-8c0f-4a0e-8236-2181281e4bf0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:12.659712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e123574-8c0f-4a0e-8236-2181281e4bf0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:35:12.668476 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-5e123574-8c0f-4a0e-8236-2181281e4bf0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:35:12.668955 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 623/1261] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:35:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:12.680959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19be626-9565-4094-91a1-c04dce75a623 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:12.690742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19be626-9565-4094-91a1-c04dce75a623 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:12.695523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992c12c-3e73-453b-8595-705b5f8b779b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:12.696214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992c12c-3e73-453b-8595-705b5f8b779b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:12.696496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992c12c-3e73-453b-8595-705b5f8b779b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:12.696784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992c12c-3e73-453b-8595-705b5f8b779b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:12.697535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992c12c-3e73-453b-8595-705b5f8b779b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:12.697996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992c12c-3e73-453b-8595-705b5f8b779b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:12.699838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992c12c-3e73-453b-8595-705b5f8b779b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:12.710065 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 639/1262] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:35:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:12.716682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e123574-8c0f-4a0e-8236-2181281e4bf0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:12.727590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e123574-8c0f-4a0e-8236-2181281e4bf0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:12.732214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fabb5a-848f-4c6d-af5f-f01a467780a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:12.734414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fabb5a-848f-4c6d-af5f-f01a467780a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:12.734414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fabb5a-848f-4c6d-af5f-f01a467780a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:12.734414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fabb5a-848f-4c6d-af5f-f01a467780a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:12.745570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fabb5a-848f-4c6d-af5f-f01a467780a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:12.747473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fabb5a-848f-4c6d-af5f-f01a467780a6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:12.765569 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-c1fabb5a-848f-4c6d-af5f-f01a467780a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:35:12.766831 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 624/1263] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:35:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:12.773347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992c12c-3e73-453b-8595-705b5f8b779b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:12.783508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992c12c-3e73-453b-8595-705b5f8b779b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:12.788244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a2f43-1587-4071-ad08-4e4d9326fa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:12.789015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a2f43-1587-4071-ad08-4e4d9326fa97 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:12.789309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a2f43-1587-4071-ad08-4e4d9326fa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:12.789584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a2f43-1587-4071-ad08-4e4d9326fa97 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:12.790372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a2f43-1587-4071-ad08-4e4d9326fa97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:12.790687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a2f43-1587-4071-ad08-4e4d9326fa97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:12.792306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a2f43-1587-4071-ad08-4e4d9326fa97 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:12.805925 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 640/1264] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:35:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:12.812660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fabb5a-848f-4c6d-af5f-f01a467780a6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:12.823322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fabb5a-848f-4c6d-af5f-f01a467780a6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:12.827817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0d5f8-e391-4cc4-a069-31568cdf3bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:12.828623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0d5f8-e391-4cc4-a069-31568cdf3bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:12.828900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0d5f8-e391-4cc4-a069-31568cdf3bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:12.829169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0d5f8-e391-4cc4-a069-31568cdf3bf3 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:12.837730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0d5f8-e391-4cc4-a069-31568cdf3bf3 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:12.839800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0d5f8-e391-4cc4-a069-31568cdf3bf3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:12.854681 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-31f0d5f8-e391-4cc4-a069-31568cdf3bf3 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 18 20:35:12.855920 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 625/1265] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:35:12 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:12.862481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a2f43-1587-4071-ad08-4e4d9326fa97 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:12.873077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a2f43-1587-4071-ad08-4e4d9326fa97 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:12.877745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38257a-8702-4330-bff8-6b58d4124a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:12.878469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38257a-8702-4330-bff8-6b58d4124a4a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:12.879365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38257a-8702-4330-bff8-6b58d4124a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:12.879649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38257a-8702-4330-bff8-6b58d4124a4a admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:12.880512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38257a-8702-4330-bff8-6b58d4124a4a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:12.880825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38257a-8702-4330-bff8-6b58d4124a4a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:12.882738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38257a-8702-4330-bff8-6b58d4124a4a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:12.906314 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 641/1266] 10.222.0.13 () {56 vars in 1164 bytes} [Sat Dec 18 20:35:12 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:12.907581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0d5f8-e391-4cc4-a069-31568cdf3bf3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:12.918004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0d5f8-e391-4cc4-a069-31568cdf3bf3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:12.922619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706a2a3-57ac-445b-967f-8a3c48f7a593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:12.923416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706a2a3-57ac-445b-967f-8a3c48f7a593 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:12.923696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706a2a3-57ac-445b-967f-8a3c48f7a593 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:12.923971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706a2a3-57ac-445b-967f-8a3c48f7a593 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:12.935755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706a2a3-57ac-445b-967f-8a3c48f7a593 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:12.937599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706a2a3-57ac-445b-967f-8a3c48f7a593 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:12.955111 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-8706a2a3-57ac-445b-967f-8a3c48f7a593 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:35:12.956373 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 626/1267] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:35:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:35:12.962938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38257a-8702-4330-bff8-6b58d4124a4a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:12.973405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38257a-8702-4330-bff8-6b58d4124a4a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:12.977955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06010d-a1ea-4b32-9fc0-fd44456bc19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:12.978671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06010d-a1ea-4b32-9fc0-fd44456bc19a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:12.978959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06010d-a1ea-4b32-9fc0-fd44456bc19a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:12.979236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06010d-a1ea-4b32-9fc0-fd44456bc19a admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:12.979978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06010d-a1ea-4b32-9fc0-fd44456bc19a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:12.980288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06010d-a1ea-4b32-9fc0-fd44456bc19a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:12.981884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06010d-a1ea-4b32-9fc0-fd44456bc19a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:12.994873 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 642/1268] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:35:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:13.000889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706a2a3-57ac-445b-967f-8a3c48f7a593 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:13.010600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706a2a3-57ac-445b-967f-8a3c48f7a593 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:13.015144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef121afd-a912-4445-a961-3f7bd8dffa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:13.015903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef121afd-a912-4445-a961-3f7bd8dffa5c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:13.016184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef121afd-a912-4445-a961-3f7bd8dffa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:13.016455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef121afd-a912-4445-a961-3f7bd8dffa5c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:13.023169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef121afd-a912-4445-a961-3f7bd8dffa5c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:13.025120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef121afd-a912-4445-a961-3f7bd8dffa5c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:13.038220 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-ef121afd-a912-4445-a961-3f7bd8dffa5c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:35:13.039411 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 627/1269] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:35:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:13.045766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06010d-a1ea-4b32-9fc0-fd44456bc19a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:13.057431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06010d-a1ea-4b32-9fc0-fd44456bc19a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:13.062164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a600f9-5583-4b45-8fcb-d071c568d64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:13.062837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a600f9-5583-4b45-8fcb-d071c568d64c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:13.063122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a600f9-5583-4b45-8fcb-d071c568d64c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:13.063396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a600f9-5583-4b45-8fcb-d071c568d64c admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:13.064181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a600f9-5583-4b45-8fcb-d071c568d64c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:13.064486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a600f9-5583-4b45-8fcb-d071c568d64c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:13.066327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a600f9-5583-4b45-8fcb-d071c568d64c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:13.080005 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 643/1270] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:35:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:13.086377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef121afd-a912-4445-a961-3f7bd8dffa5c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:13.098519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef121afd-a912-4445-a961-3f7bd8dffa5c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:13.103056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191a216-601f-4125-b86b-caa05e1a1db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:13.103914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191a216-601f-4125-b86b-caa05e1a1db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:13.104189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191a216-601f-4125-b86b-caa05e1a1db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:13.104460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191a216-601f-4125-b86b-caa05e1a1db4 admin admin] PATH_INFO: `/v3/projects/0dd4d15f423642fa8da604b758048203/users/55f16dc3d38a4270a0fb29944a655356/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:13.106456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191a216-601f-4125-b86b-caa05e1a1db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd4d15f423642fa8da604b758048203, user_id=55f16dc3d38a4270a0fb29944a655356, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:13.109068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191a216-601f-4125-b86b-caa05e1a1db4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:13.123453 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 628/1271] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:35:13 2021] PUT /identity/v3/projects/0dd4d15f423642fa8da604b758048203/users/55f16dc3d38a4270a0fb29944a655356/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:35:15.537872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9966bf6-68ac-4151-89a0-80ad5aaffcaf None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:15.538465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9966bf6-68ac-4151-89a0-80ad5aaffcaf None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:15.538465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9966bf6-68ac-4151-89a0-80ad5aaffcaf None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:15.540213 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 644/1272] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:35:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:35:15.545784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874a839-a826-4bbe-bfeb-a49e7ef0984e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:15.546150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874a839-a826-4bbe-bfeb-a49e7ef0984e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:15.546509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874a839-a826-4bbe-bfeb-a49e7ef0984e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:15.563902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1874a839-a826-4bbe-bfeb-a49e7ef0984e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:35:15.565078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1874a839-a826-4bbe-bfeb-a49e7ef0984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:35:15.619812 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 629/1273] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:35:15 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:35:15.645163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9966bf6-68ac-4151-89a0-80ad5aaffcaf None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:15.656936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9966bf6-68ac-4151-89a0-80ad5aaffcaf None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:15.661842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a2495-9531-4fd2-b913-099368207a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:15.662634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a2495-9531-4fd2-b913-099368207a07 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:15.662920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a2495-9531-4fd2-b913-099368207a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:15.663196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a2495-9531-4fd2-b913-099368207a07 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:15.673054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a2495-9531-4fd2-b913-099368207a07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 20:35:15.679741 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-349a2495-9531-4fd2-b913-099368207a07 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 18 20:35:15.680844 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 645/1274] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Dec 18 20:35:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:15.687077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874a839-a826-4bbe-bfeb-a49e7ef0984e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:15.695639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874a839-a826-4bbe-bfeb-a49e7ef0984e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:15.700090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38045ca0-0108-43fd-acd3-b81edfac4904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:15.700727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38045ca0-0108-43fd-acd3-b81edfac4904 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:15.701009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38045ca0-0108-43fd-acd3-b81edfac4904 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:15.701286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38045ca0-0108-43fd-acd3-b81edfac4904 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:15.702034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38045ca0-0108-43fd-acd3-b81edfac4904 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:15.702374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38045ca0-0108-43fd-acd3-b81edfac4904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:15.703953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38045ca0-0108-43fd-acd3-b81edfac4904 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:15.712789 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 630/1275] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Dec 18 20:35:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:15.718456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a2495-9531-4fd2-b913-099368207a07 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:15.729134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a2495-9531-4fd2-b913-099368207a07 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:15.733663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15e24d-537e-4794-a178-98c1b2a58a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:15.734456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15e24d-537e-4794-a178-98c1b2a58a4e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:15.734743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15e24d-537e-4794-a178-98c1b2a58a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:15.735027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15e24d-537e-4794-a178-98c1b2a58a4e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:15.745407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15e24d-537e-4794-a178-98c1b2a58a4e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:15.748002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15e24d-537e-4794-a178-98c1b2a58a4e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:15.766124 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-6a15e24d-537e-4794-a178-98c1b2a58a4e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:35:15.767314 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 646/1276] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:35:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:15.773990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38045ca0-0108-43fd-acd3-b81edfac4904 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:15.783451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38045ca0-0108-43fd-acd3-b81edfac4904 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:15.788590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e97715-64b6-4f20-8fe5-7303ddba86fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:15.789167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e97715-64b6-4f20-8fe5-7303ddba86fa admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:15.789444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e97715-64b6-4f20-8fe5-7303ddba86fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:15.789713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e97715-64b6-4f20-8fe5-7303ddba86fa admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:15.790466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e97715-64b6-4f20-8fe5-7303ddba86fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:15.790767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e97715-64b6-4f20-8fe5-7303ddba86fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:15.792320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e97715-64b6-4f20-8fe5-7303ddba86fa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:15.803505 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 631/1277] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:35:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:15.810373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15e24d-537e-4794-a178-98c1b2a58a4e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:15.819730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15e24d-537e-4794-a178-98c1b2a58a4e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:15.824267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cc6e2-fa84-4328-a74f-52f5cc5e14bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:15.825024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cc6e2-fa84-4328-a74f-52f5cc5e14bc admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:15.825312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cc6e2-fa84-4328-a74f-52f5cc5e14bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:15.825683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cc6e2-fa84-4328-a74f-52f5cc5e14bc admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:15.833264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cc6e2-fa84-4328-a74f-52f5cc5e14bc admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:15.835277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cc6e2-fa84-4328-a74f-52f5cc5e14bc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:15.848970 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-c14cc6e2-fa84-4328-a74f-52f5cc5e14bc admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 18 20:35:15.850746 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 647/1278] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:35:15 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:15.857427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e97715-64b6-4f20-8fe5-7303ddba86fa admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:15.866755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e97715-64b6-4f20-8fe5-7303ddba86fa admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:15.871160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67809c68-2966-4796-a774-f65e29098ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:15.871794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67809c68-2966-4796-a774-f65e29098ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:15.872073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67809c68-2966-4796-a774-f65e29098ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:15.872346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67809c68-2966-4796-a774-f65e29098ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:15.873166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67809c68-2966-4796-a774-f65e29098ba5 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:15.873470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67809c68-2966-4796-a774-f65e29098ba5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:15.875304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67809c68-2966-4796-a774-f65e29098ba5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:15.892207 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 632/1279] 10.222.0.13 () {56 vars in 1164 bytes} [Sat Dec 18 20:35:15 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:15.898516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cc6e2-fa84-4328-a74f-52f5cc5e14bc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:15.907766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cc6e2-fa84-4328-a74f-52f5cc5e14bc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:15.912260 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bb838-1846-4b3b-b5d1-209e0b26cb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:15.912933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bb838-1846-4b3b-b5d1-209e0b26cb41 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:15.913220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bb838-1846-4b3b-b5d1-209e0b26cb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:15.913496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bb838-1846-4b3b-b5d1-209e0b26cb41 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:15.921015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7bb838-1846-4b3b-b5d1-209e0b26cb41 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:15.922750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7bb838-1846-4b3b-b5d1-209e0b26cb41 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:15.931237 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 648/1280] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Dec 18 20:35:15 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:35:15.937020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67809c68-2966-4796-a774-f65e29098ba5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:15.946543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67809c68-2966-4796-a774-f65e29098ba5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:15.950912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e987d4-10ed-4559-af71-e23cd74af372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:15.951653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e987d4-10ed-4559-af71-e23cd74af372 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:15.951930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e987d4-10ed-4559-af71-e23cd74af372 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:15.952202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e987d4-10ed-4559-af71-e23cd74af372 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:15.962792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e987d4-10ed-4559-af71-e23cd74af372 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:15.964575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e987d4-10ed-4559-af71-e23cd74af372 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:15.980507 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-a3e987d4-10ed-4559-af71-e23cd74af372 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 18 20:35:15.981618 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 633/1281] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Dec 18 20:35:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:15.987608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bb838-1846-4b3b-b5d1-209e0b26cb41 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:15.996210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bb838-1846-4b3b-b5d1-209e0b26cb41 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:16.000741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd665075-b9a1-471f-b1c8-fd96e3317b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:16.001375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd665075-b9a1-471f-b1c8-fd96e3317b36 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:16.001660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd665075-b9a1-471f-b1c8-fd96e3317b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:16.001938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd665075-b9a1-471f-b1c8-fd96e3317b36 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:16.002696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd665075-b9a1-471f-b1c8-fd96e3317b36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:16.003001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd665075-b9a1-471f-b1c8-fd96e3317b36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:16.005055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd665075-b9a1-471f-b1c8-fd96e3317b36 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:16.015886 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 649/1282] 10.222.0.13 () {56 vars in 1130 bytes} [Sat Dec 18 20:35:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:16.022298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e987d4-10ed-4559-af71-e23cd74af372 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:16.031410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e987d4-10ed-4559-af71-e23cd74af372 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:16.035865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d2b94-4e8f-40cc-b434-c84ff51bb7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:16.036605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d2b94-4e8f-40cc-b434-c84ff51bb7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:16.036883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d2b94-4e8f-40cc-b434-c84ff51bb7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:16.037153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d2b94-4e8f-40cc-b434-c84ff51bb7e7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:16.043764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d2b94-4e8f-40cc-b434-c84ff51bb7e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:16.045607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d2b94-4e8f-40cc-b434-c84ff51bb7e7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:16.057942 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-ef7d2b94-4e8f-40cc-b434-c84ff51bb7e7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 18 20:35:16.059056 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 634/1283] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Dec 18 20:35:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 18 20:35:16.066676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd665075-b9a1-471f-b1c8-fd96e3317b36 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:16.075886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd665075-b9a1-471f-b1c8-fd96e3317b36 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:16.080315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395ef2f-bc81-4aeb-b2cd-57a4f322a005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:16.080935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395ef2f-bc81-4aeb-b2cd-57a4f322a005 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:16.081216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395ef2f-bc81-4aeb-b2cd-57a4f322a005 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:16.081490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395ef2f-bc81-4aeb-b2cd-57a4f322a005 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:16.082874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395ef2f-bc81-4aeb-b2cd-57a4f322a005 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:16.083179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395ef2f-bc81-4aeb-b2cd-57a4f322a005 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:16.084950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395ef2f-bc81-4aeb-b2cd-57a4f322a005 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:16.096420 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 650/1284] 10.222.0.13 () {56 vars in 1169 bytes} [Sat Dec 18 20:35:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:16.102625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d2b94-4e8f-40cc-b434-c84ff51bb7e7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:16.112524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d2b94-4e8f-40cc-b434-c84ff51bb7e7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:16.117001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094893c-2837-4bf4-9f32-bd37dea38130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:16.117620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094893c-2837-4bf4-9f32-bd37dea38130 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:16.117898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094893c-2837-4bf4-9f32-bd37dea38130 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:16.118176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094893c-2837-4bf4-9f32-bd37dea38130 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:16.119031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094893c-2837-4bf4-9f32-bd37dea38130 admin admin] RBAC: Adding query filter params (role.id=422f56dd2e5b4c57a3e3decac47f893e, scope.project.id=0dd4d15f423642fa8da604b758048203, user.id=55f16dc3d38a4270a0fb29944a655356) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:16.119339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094893c-2837-4bf4-9f32-bd37dea38130 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:16.121131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094893c-2837-4bf4-9f32-bd37dea38130 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:16.126704 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 635/1285] 10.222.0.13 () {56 vars in 1395 bytes} [Sat Dec 18 20:35:16 2021] GET /identity/v3/role_assignments?user.id=55f16dc3d38a4270a0fb29944a655356&scope.project.id=0dd4d15f423642fa8da604b758048203&role.id=422f56dd2e5b4c57a3e3decac47f893e => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:35:18.581310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117c87f-f40b-4d3f-b373-6d9f77c57af9 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:18.581839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117c87f-f40b-4d3f-b373-6d9f77c57af9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:18.581928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117c87f-f40b-4d3f-b373-6d9f77c57af9 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:18.583675 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 651/1286] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:35:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:35:18.589363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a2d90-6b5e-4842-9f03-774f78381649 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:18.589772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a2d90-6b5e-4842-9f03-774f78381649 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:18.589916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a2d90-6b5e-4842-9f03-774f78381649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:18.607357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ce1a2d90-6b5e-4842-9f03-774f78381649 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:35:18.608529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ce1a2d90-6b5e-4842-9f03-774f78381649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:35:18.616545 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 636/1287] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:35:18 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:35:18.640665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117c87f-f40b-4d3f-b373-6d9f77c57af9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:18.652392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117c87f-f40b-4d3f-b373-6d9f77c57af9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:18.656653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8218948-c1bc-4b1c-9d13-c418f55fdd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:18.657414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8218948-c1bc-4b1c-9d13-c418f55fdd26 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:18.657692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8218948-c1bc-4b1c-9d13-c418f55fdd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:18.657963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8218948-c1bc-4b1c-9d13-c418f55fdd26 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:18.658650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8218948-c1bc-4b1c-9d13-c418f55fdd26 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:18.660232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8218948-c1bc-4b1c-9d13-c418f55fdd26 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:18.670703 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-a8218948-c1bc-4b1c-9d13-c418f55fdd26 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 18 20:35:18.671780 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 652/1288] 10.222.0.13 () {56 vars in 1138 bytes} [Sat Dec 18 20:35:18 2021] GET /identity/v3/services/placement => generated 90 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:18.678367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a2d90-6b5e-4842-9f03-774f78381649 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:18.687248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a2d90-6b5e-4842-9f03-774f78381649 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:18.691773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d91896-7697-47db-ba43-44983631f44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:18.692406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d91896-7697-47db-ba43-44983631f44b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:18.692686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d91896-7697-47db-ba43-44983631f44b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:18.692959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d91896-7697-47db-ba43-44983631f44b admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:18.693667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d91896-7697-47db-ba43-44983631f44b admin admin] RBAC: Adding query filter params (name=placement) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:18.693969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d91896-7697-47db-ba43-44983631f44b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:18.695574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d91896-7697-47db-ba43-44983631f44b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:18.700173 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 637/1289] 10.222.0.13 () {56 vars in 1137 bytes} [Sat Dec 18 20:35:18 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:18.705772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8218948-c1bc-4b1c-9d13-c418f55fdd26 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:18.717233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8218948-c1bc-4b1c-9d13-c418f55fdd26 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:18.721894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2c7ae-7604-4a7b-9818-185229578e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:18.723183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2c7ae-7604-4a7b-9818-185229578e2c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:18.723461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2c7ae-7604-4a7b-9818-185229578e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:18.723732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2c7ae-7604-4a7b-9818-185229578e2c admin admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:18.724469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2c7ae-7604-4a7b-9818-185229578e2c admin admin] RBAC: Adding query filter params (type=placement) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:18.724773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2c7ae-7604-4a7b-9818-185229578e2c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:18.726355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2c7ae-7604-4a7b-9818-185229578e2c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:18.730657 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 653/1290] 10.222.0.13 () {56 vars in 1137 bytes} [Sat Dec 18 20:35:18 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:21.149216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c05f87-8ca3-4fcf-a51c-d2d46d361410 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:21.149735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c05f87-8ca3-4fcf-a51c-d2d46d361410 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:21.149851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c05f87-8ca3-4fcf-a51c-d2d46d361410 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:21.151599 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 638/1291] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:35:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:35:21.157186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cefad-d9a1-4a18-81ed-341cb6334565 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:21.157609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cefad-d9a1-4a18-81ed-341cb6334565 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:21.157743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cefad-d9a1-4a18-81ed-341cb6334565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:21.175015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7d7cefad-d9a1-4a18-81ed-341cb6334565 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:35:21.176186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7d7cefad-d9a1-4a18-81ed-341cb6334565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:35:21.183695 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 654/1292] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:35:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:35:21.212380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c05f87-8ca3-4fcf-a51c-d2d46d361410 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:21.225983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c05f87-8ca3-4fcf-a51c-d2d46d361410 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:21.231458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56f6e5-0dc7-42e1-91fd-6a6963d2b65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:21.232429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56f6e5-0dc7-42e1-91fd-6a6963d2b65f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:21.232756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56f6e5-0dc7-42e1-91fd-6a6963d2b65f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:21.233143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56f6e5-0dc7-42e1-91fd-6a6963d2b65f admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:21.234229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56f6e5-0dc7-42e1-91fd-6a6963d2b65f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:21.235823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56f6e5-0dc7-42e1-91fd-6a6963d2b65f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:21.252306 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 639/1293] 10.222.0.13 () {60 vars in 1162 bytes} [Sat Dec 18 20:35:21 2021] POST /identity/v3/services => generated 246 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:35:23.642832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2971c3-e1c7-449b-8222-04f1561d8c34 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:23.643398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2971c3-e1c7-449b-8222-04f1561d8c34 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:23.643398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2971c3-e1c7-449b-8222-04f1561d8c34 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:23.645122 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 655/1294] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:35:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:35:23.651164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e16ea0-3972-4a8a-b4f5-47907f39bcf7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:23.651559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e16ea0-3972-4a8a-b4f5-47907f39bcf7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:23.651710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e16ea0-3972-4a8a-b4f5-47907f39bcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:23.668733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-44e16ea0-3972-4a8a-b4f5-47907f39bcf7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:35:23.669888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-44e16ea0-3972-4a8a-b4f5-47907f39bcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:35:23.686370 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 640/1295] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:35:23 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:35:23.711764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2971c3-e1c7-449b-8222-04f1561d8c34 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:23.723849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2971c3-e1c7-449b-8222-04f1561d8c34 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:23.728230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f698b-df97-470f-8513-a86a99abc691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:23.729004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f698b-df97-470f-8513-a86a99abc691 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:23.729289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f698b-df97-470f-8513-a86a99abc691 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:23.729567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f698b-df97-470f-8513-a86a99abc691 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:23.730230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f698b-df97-470f-8513-a86a99abc691 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:23.731887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f698b-df97-470f-8513-a86a99abc691 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:23.742662 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-d16f698b-df97-470f-8513-a86a99abc691 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 18 20:35:23.743807 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 656/1296] 10.222.0.13 () {56 vars in 1138 bytes} [Sat Dec 18 20:35:23 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:23.749999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e16ea0-3972-4a8a-b4f5-47907f39bcf7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:23.759256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e16ea0-3972-4a8a-b4f5-47907f39bcf7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:23.763682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f30063-0fa8-4b2f-ab2f-d94faccd4828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:23.764313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f30063-0fa8-4b2f-ab2f-d94faccd4828 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:23.764593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f30063-0fa8-4b2f-ab2f-d94faccd4828 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:23.764867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f30063-0fa8-4b2f-ab2f-d94faccd4828 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:23.765571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f30063-0fa8-4b2f-ab2f-d94faccd4828 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:23.765872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f30063-0fa8-4b2f-ab2f-d94faccd4828 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:23.767488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f30063-0fa8-4b2f-ab2f-d94faccd4828 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:23.773012 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 641/1297] 10.222.0.13 () {56 vars in 1137 bytes} [Sat Dec 18 20:35:23 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:23.779358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f698b-df97-470f-8513-a86a99abc691 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:23.788497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f698b-df97-470f-8513-a86a99abc691 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:23.792951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8a469-9956-4bb9-918a-3e8ea404ae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:23.793602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8a469-9956-4bb9-918a-3e8ea404ae71 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:23.793887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8a469-9956-4bb9-918a-3e8ea404ae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:23.794167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8a469-9956-4bb9-918a-3e8ea404ae71 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:23.794980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8a469-9956-4bb9-918a-3e8ea404ae71 admin admin] RBAC: Adding query filter params (interface=public, service_id=a37771e9b6fe4785a8a828fff8e0efa6, region_id=RegionOne) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:23.795293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8a469-9956-4bb9-918a-3e8ea404ae71 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:23.796824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8a469-9956-4bb9-918a-3e8ea404ae71 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:23.802038 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 657/1298] 10.222.0.13 () {56 vars in 1272 bytes} [Sat Dec 18 20:35:23 2021] GET /identity/v3/endpoints?service_id=a37771e9b6fe4785a8a828fff8e0efa6&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:23.807435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f30063-0fa8-4b2f-ab2f-d94faccd4828 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:23.817298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f30063-0fa8-4b2f-ab2f-d94faccd4828 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:23.821639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd062e88-d8af-421f-a744-117e2968196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:23.822238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062e88-d8af-421f-a744-117e2968196d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:23.822549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062e88-d8af-421f-a744-117e2968196d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:23.822824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062e88-d8af-421f-a744-117e2968196d admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:23.823490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd062e88-d8af-421f-a744-117e2968196d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:23.824983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd062e88-d8af-421f-a744-117e2968196d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:23.831813 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 642/1299] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Dec 18 20:35:23 2021] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:35:26.217305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41816d-0b40-466a-92ca-b6f3de3a120d None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:26.219530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41816d-0b40-466a-92ca-b6f3de3a120d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:26.219530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41816d-0b40-466a-92ca-b6f3de3a120d None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:26.220124 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 658/1300] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:35:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:35:26.226688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ce16c-e505-4014-b5c2-124ce0294826 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:26.227148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ce16c-e505-4014-b5c2-124ce0294826 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:26.227441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ce16c-e505-4014-b5c2-124ce0294826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:26.246196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5b1ce16c-e505-4014-b5c2-124ce0294826 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:35:26.247481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5b1ce16c-e505-4014-b5c2-124ce0294826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:35:26.255790 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 643/1301] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:35:26 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:35:26.286296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41816d-0b40-466a-92ca-b6f3de3a120d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:26.298194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41816d-0b40-466a-92ca-b6f3de3a120d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:26.303015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77d76e-b0fa-4a08-8fd0-ab9f86830a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:26.303783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77d76e-b0fa-4a08-8fd0-ab9f86830a00 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:26.304064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77d76e-b0fa-4a08-8fd0-ab9f86830a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:26.304335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77d76e-b0fa-4a08-8fd0-ab9f86830a00 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:26.304987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77d76e-b0fa-4a08-8fd0-ab9f86830a00 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:26.306572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77d76e-b0fa-4a08-8fd0-ab9f86830a00 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:26.317969 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-ee77d76e-b0fa-4a08-8fd0-ab9f86830a00 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 18 20:35:26.319087 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 659/1302] 10.222.0.13 () {56 vars in 1138 bytes} [Sat Dec 18 20:35:26 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:35:26.325237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ce16c-e505-4014-b5c2-124ce0294826 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:26.334077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ce16c-e505-4014-b5c2-124ce0294826 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:26.338684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f5476-fa20-4c02-b002-66d99faf5142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:26.339327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f5476-fa20-4c02-b002-66d99faf5142 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:26.339613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f5476-fa20-4c02-b002-66d99faf5142 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:26.339892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f5476-fa20-4c02-b002-66d99faf5142 admin admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:26.340608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f5476-fa20-4c02-b002-66d99faf5142 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:35:26.340913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f5476-fa20-4c02-b002-66d99faf5142 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:26.342506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f5476-fa20-4c02-b002-66d99faf5142 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:26.347537 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 644/1303] 10.222.0.13 () {56 vars in 1137 bytes} [Sat Dec 18 20:35:26 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:35:26.353227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77d76e-b0fa-4a08-8fd0-ab9f86830a00 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:35:26.362682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77d76e-b0fa-4a08-8fd0-ab9f86830a00 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:35:26.367526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b3ce5-f9a1-4385-aee1-046813535060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:35:26.368128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b3ce5-f9a1-4385-aee1-046813535060 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:35:26.368409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b3ce5-f9a1-4385-aee1-046813535060 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:35:26.368683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b3ce5-f9a1-4385-aee1-046813535060 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:35:26.369401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b3ce5-f9a1-4385-aee1-046813535060 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:35:26.370947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b3ce5-f9a1-4385-aee1-046813535060 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:35:26.388966 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 660/1304] 10.222.0.13 () {60 vars in 1165 bytes} [Sat Dec 18 20:35:26 2021] POST /identity/v3/endpoints => generated 331 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:36:35.977820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd4c50-34d0-43c2-89e9-b1803b4a56f6 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:35.978953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd4c50-34d0-43c2-89e9-b1803b4a56f6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:35.979489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd4c50-34d0-43c2-89e9-b1803b4a56f6 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:35.991913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768692c-489c-4db9-9786-aa03e7b0e1dd None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:35.993073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768692c-489c-4db9-9786-aa03e7b0e1dd None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:35.994192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768692c-489c-4db9-9786-aa03e7b0e1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:36.000004 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 645/1305] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:36:35 2021] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:36:36.300202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a768692c-489c-4db9-9786-aa03e7b0e1dd None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:36:36.301504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a768692c-489c-4db9-9786-aa03e7b0e1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:36.404973 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 661/1306] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:36:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:36:36.429566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd4c50-34d0-43c2-89e9-b1803b4a56f6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:36:36.431479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8cdd4c50-34d0-43c2-89e9-b1803b4a56f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:36.568873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd4c50-34d0-43c2-89e9-b1803b4a56f6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:36:36.781646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a310abf-e134-4cff-a0a8-cf0681c52cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:36:36.782338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a310abf-e134-4cff-a0a8-cf0681c52cda admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:36.782620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a310abf-e134-4cff-a0a8-cf0681c52cda admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:36.782893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a310abf-e134-4cff-a0a8-cf0681c52cda admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:36.783629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a310abf-e134-4cff-a0a8-cf0681c52cda admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:36:36.785517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a310abf-e134-4cff-a0a8-cf0681c52cda admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:36:36.807721 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 646/1307] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Dec 18 20:36:36 2021] GET /identity/v3/projects => generated 2553 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:36:39.265026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded8122-c2c2-411e-bf27-d5eb847fd602 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:39.265560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded8122-c2c2-411e-bf27-d5eb847fd602 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:39.265560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded8122-c2c2-411e-bf27-d5eb847fd602 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:39.267393 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 662/1308] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:36:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:36:39.273861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11267c-3d97-4806-a223-1c2ec32bc17f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:39.274314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11267c-3d97-4806-a223-1c2ec32bc17f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:39.274456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11267c-3d97-4806-a223-1c2ec32bc17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:39.341593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7e11267c-3d97-4806-a223-1c2ec32bc17f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:36:39.342844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7e11267c-3d97-4806-a223-1c2ec32bc17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:39.436674 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 647/1309] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:36:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:36:39.488954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12afb33-3fde-4054-aa91-f697a656fb7f None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:39.489245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12afb33-3fde-4054-aa91-f697a656fb7f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:39.489524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12afb33-3fde-4054-aa91-f697a656fb7f None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:39.491319 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 663/1310] 10.222.0.13 () {54 vars in 964 bytes} [Sat Dec 18 20:36:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:36:39.497873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05bdb6-c576-4735-ad9f-aea83059104d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:39.498399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05bdb6-c576-4735-ad9f-aea83059104d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:39.498694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05bdb6-c576-4735-ad9f-aea83059104d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:39.577209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-cf05bdb6-c576-4735-ad9f-aea83059104d None None] MFA Rules not processed for user `6f8eeb55c523480fb45d4bbb8afe8e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:36:39.578358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cf05bdb6-c576-4735-ad9f-aea83059104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:39.651484 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 648/1311] 10.222.0.13 () {58 vars in 1061 bytes} [Sat Dec 18 20:36:39 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:36:39.660607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12afb33-3fde-4054-aa91-f697a656fb7f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:36:39.662099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a12afb33-3fde-4054-aa91-f697a656fb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:39.768885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12afb33-3fde-4054-aa91-f697a656fb7f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:36:39.844391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186d5ca-7167-4927-8aee-846cdd05cc23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:36:39.845056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186d5ca-7167-4927-8aee-846cdd05cc23 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:39.845340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186d5ca-7167-4927-8aee-846cdd05cc23 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:39.845615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186d5ca-7167-4927-8aee-846cdd05cc23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:39.847327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a186d5ca-7167-4927-8aee-846cdd05cc23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:39.961557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186d5ca-7167-4927-8aee-846cdd05cc23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:36:39.963016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186d5ca-7167-4927-8aee-846cdd05cc23 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:36:39.981103 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 664/1312] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:36:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:36:42.677769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d7816-83d8-4c7b-b01f-5fa32a72982d None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:42.678290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d7816-83d8-4c7b-b01f-5fa32a72982d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:42.678373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d7816-83d8-4c7b-b01f-5fa32a72982d None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:42.680153 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 649/1313] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:36:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:36:42.686337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec5038-f816-4ce0-8126-57e6e2f0727d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:42.686781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec5038-f816-4ce0-8126-57e6e2f0727d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:42.686926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec5038-f816-4ce0-8126-57e6e2f0727d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:42.753320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0fec5038-f816-4ce0-8126-57e6e2f0727d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:36:42.755230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0fec5038-f816-4ce0-8126-57e6e2f0727d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:42.850018 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 665/1314] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:36:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:36:42.904998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d7816-83d8-4c7b-b01f-5fa32a72982d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:36:42.906557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-261d7816-83d8-4c7b-b01f-5fa32a72982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:43.006754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d7816-83d8-4c7b-b01f-5fa32a72982d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:36:43.077746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fd2aa-1ea0-462d-8e9b-6e9c3a4890fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:36:43.078413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fd2aa-1ea0-462d-8e9b-6e9c3a4890fb service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:43.078692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fd2aa-1ea0-462d-8e9b-6e9c3a4890fb service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:43.078965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fd2aa-1ea0-462d-8e9b-6e9c3a4890fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:43.080562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8d2fd2aa-1ea0-462d-8e9b-6e9c3a4890fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:43.185460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fd2aa-1ea0-462d-8e9b-6e9c3a4890fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:36:43.187080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fd2aa-1ea0-462d-8e9b-6e9c3a4890fb service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:36:43.204776 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 650/1315] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:36:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:36:45.907446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d9e73-89c7-48d9-ae64-9b6a07ef4a7a None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:45.908004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d9e73-89c7-48d9-ae64-9b6a07ef4a7a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:45.908004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d9e73-89c7-48d9-ae64-9b6a07ef4a7a None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:45.909752 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 666/1316] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:36:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:36:45.915659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeff8ff-1012-4a8a-b8b9-c26b93fb872e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:45.916095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeff8ff-1012-4a8a-b8b9-c26b93fb872e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:45.916224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeff8ff-1012-4a8a-b8b9-c26b93fb872e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:45.978775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5aeff8ff-1012-4a8a-b8b9-c26b93fb872e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:36:45.979881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5aeff8ff-1012-4a8a-b8b9-c26b93fb872e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:46.075769 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 651/1317] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:36:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:36:46.112742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d9e73-89c7-48d9-ae64-9b6a07ef4a7a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:36:46.114236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-359d9e73-89c7-48d9-ae64-9b6a07ef4a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:46.246806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d9e73-89c7-48d9-ae64-9b6a07ef4a7a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:36:46.335564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200f0c6-e5bb-4cf0-94c4-9a8f8db198ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:36:46.336402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200f0c6-e5bb-4cf0-94c4-9a8f8db198ba admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:46.336685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200f0c6-e5bb-4cf0-94c4-9a8f8db198ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:46.336960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200f0c6-e5bb-4cf0-94c4-9a8f8db198ba admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:46.346449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200f0c6-e5bb-4cf0-94c4-9a8f8db198ba admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:36:46.348527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200f0c6-e5bb-4cf0-94c4-9a8f8db198ba admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:36:46.350209 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 667/1318] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:36:46 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:36:46.362839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeff8ff-1012-4a8a-b8b9-c26b93fb872e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:36:46.364522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5aeff8ff-1012-4a8a-b8b9-c26b93fb872e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:46.452128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeff8ff-1012-4a8a-b8b9-c26b93fb872e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:36:46.521879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1926b2-a0ad-4c1e-8f3c-60669c11c6d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:36:46.522592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1926b2-a0ad-4c1e-8f3c-60669c11c6d0 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:46.522872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1926b2-a0ad-4c1e-8f3c-60669c11c6d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:46.523146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1926b2-a0ad-4c1e-8f3c-60669c11c6d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:46.524753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3f1926b2-a0ad-4c1e-8f3c-60669c11c6d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:46.629618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1926b2-a0ad-4c1e-8f3c-60669c11c6d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:36:46.631064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1926b2-a0ad-4c1e-8f3c-60669c11c6d0 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:36:46.648510 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 652/1319] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:36:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:36:49.629184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d6aad-7b83-43c7-8f4c-7b994ca3b770 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:49.629738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d6aad-7b83-43c7-8f4c-7b994ca3b770 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:49.629738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d6aad-7b83-43c7-8f4c-7b994ca3b770 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:49.631564 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 668/1320] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:36:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:36:49.637293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348908d-9116-46ce-814f-4c21ae0a834b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:49.637698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348908d-9116-46ce-814f-4c21ae0a834b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:49.637844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348908d-9116-46ce-814f-4c21ae0a834b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:49.699388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2348908d-9116-46ce-814f-4c21ae0a834b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:36:49.700561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2348908d-9116-46ce-814f-4c21ae0a834b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:49.792092 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 653/1321] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:36:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:36:49.828048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d6aad-7b83-43c7-8f4c-7b994ca3b770 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:36:49.829525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-018d6aad-7b83-43c7-8f4c-7b994ca3b770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:49.949070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d6aad-7b83-43c7-8f4c-7b994ca3b770 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:36:50.037283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb27ea-ab5f-4961-8fc3-b1c25b4983d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:36:50.038124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb27ea-ab5f-4961-8fc3-b1c25b4983d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:50.038440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb27ea-ab5f-4961-8fc3-b1c25b4983d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:50.038719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb27ea-ab5f-4961-8fc3-b1c25b4983d3 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:50.048085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb27ea-ab5f-4961-8fc3-b1c25b4983d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:36:50.050100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb27ea-ab5f-4961-8fc3-b1c25b4983d3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:36:50.051812 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 669/1322] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:36:49 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:36:50.079850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d46a8e-f422-4f4b-bf6f-72e432281a13 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:50.080145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d46a8e-f422-4f4b-bf6f-72e432281a13 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:50.080430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d46a8e-f422-4f4b-bf6f-72e432281a13 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:50.082761 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 654/1323] 10.222.0.13 () {54 vars in 964 bytes} [Sat Dec 18 20:36:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:36:50.088644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a34ac-f5b0-4865-8e5e-9bb61b39e171 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:50.088924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a34ac-f5b0-4865-8e5e-9bb61b39e171 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:50.089196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a34ac-f5b0-4865-8e5e-9bb61b39e171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:50.161475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-860a34ac-f5b0-4865-8e5e-9bb61b39e171 None None] MFA Rules not processed for user `6f8eeb55c523480fb45d4bbb8afe8e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:36:50.162671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-860a34ac-f5b0-4865-8e5e-9bb61b39e171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:50.235388 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 670/1324] 10.222.0.13 () {58 vars in 1061 bytes} [Sat Dec 18 20:36:50 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:36:50.244542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d46a8e-f422-4f4b-bf6f-72e432281a13 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:36:50.246107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c9d46a8e-f422-4f4b-bf6f-72e432281a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:50.350833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d46a8e-f422-4f4b-bf6f-72e432281a13 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:36:50.419896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec979e-8404-4445-8665-6a81875d4cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:36:50.420627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec979e-8404-4445-8665-6a81875d4cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:50.420911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec979e-8404-4445-8665-6a81875d4cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:50.421186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec979e-8404-4445-8665-6a81875d4cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:50.422828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e3ec979e-8404-4445-8665-6a81875d4cc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:50.525228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec979e-8404-4445-8665-6a81875d4cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:36:50.526611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec979e-8404-4445-8665-6a81875d4cc9 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:36:50.544139 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 655/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:36:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:36:54.128952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca36cb-c1a4-410a-b561-5ff24737a80d None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:54.129509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca36cb-c1a4-410a-b561-5ff24737a80d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:54.129509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca36cb-c1a4-410a-b561-5ff24737a80d None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:54.131395 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 671/1326] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:36:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:36:54.137027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d57a23-b508-4a90-8661-268ede455780 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:54.137424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d57a23-b508-4a90-8661-268ede455780 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:54.137586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d57a23-b508-4a90-8661-268ede455780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:54.200975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-96d57a23-b508-4a90-8661-268ede455780 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:36:54.202158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-96d57a23-b508-4a90-8661-268ede455780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:54.296101 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 656/1327] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:36:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:36:54.334981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca36cb-c1a4-410a-b561-5ff24737a80d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:36:54.336487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-aaca36cb-c1a4-410a-b561-5ff24737a80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:54.435073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca36cb-c1a4-410a-b561-5ff24737a80d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:36:54.509190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af46887-0c65-4a04-89ce-a9d6e9432c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:36:54.509847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af46887-0c65-4a04-89ce-a9d6e9432c88 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:54.510136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af46887-0c65-4a04-89ce-a9d6e9432c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:54.510453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af46887-0c65-4a04-89ce-a9d6e9432c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:54.512081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6af46887-0c65-4a04-89ce-a9d6e9432c88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:54.618340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af46887-0c65-4a04-89ce-a9d6e9432c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:36:54.619781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af46887-0c65-4a04-89ce-a9d6e9432c88 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:36:54.639983 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 672/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:36:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:36:57.119896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c6175-f6cf-4dde-8b73-ccb300e9eaee None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:57.120428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c6175-f6cf-4dde-8b73-ccb300e9eaee None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:57.120428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c6175-f6cf-4dde-8b73-ccb300e9eaee None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:57.122269 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 657/1329] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:36:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:36:57.128002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84327c0b-d9a1-4e54-9bf9-bb3ea2e8539b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:57.128444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84327c0b-d9a1-4e54-9bf9-bb3ea2e8539b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:57.128631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84327c0b-d9a1-4e54-9bf9-bb3ea2e8539b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:57.193270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-84327c0b-d9a1-4e54-9bf9-bb3ea2e8539b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:36:57.194511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-84327c0b-d9a1-4e54-9bf9-bb3ea2e8539b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:57.293405 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 673/1330] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:36:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:36:57.330728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c6175-f6cf-4dde-8b73-ccb300e9eaee None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:36:57.332330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-359c6175-f6cf-4dde-8b73-ccb300e9eaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:57.430754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c6175-f6cf-4dde-8b73-ccb300e9eaee None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:36:57.499894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f4d60-aca3-4077-93df-7285d4c7d73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:36:57.500531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f4d60-aca3-4077-93df-7285d4c7d73c service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:36:57.500814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f4d60-aca3-4077-93df-7285d4c7d73c service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:36:57.501086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f4d60-aca3-4077-93df-7285d4c7d73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:36:57.502794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e22f4d60-aca3-4077-93df-7285d4c7d73c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:36:57.607919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f4d60-aca3-4077-93df-7285d4c7d73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:36:57.609346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f4d60-aca3-4077-93df-7285d4c7d73c service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:36:57.626427 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 658/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:36:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:37:00.136893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13c8f1-fca2-4cf8-8cec-3cbf40a0b226 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:00.137467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13c8f1-fca2-4cf8-8cec-3cbf40a0b226 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:00.137571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13c8f1-fca2-4cf8-8cec-3cbf40a0b226 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:00.139364 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 674/1332] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:37:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:00.145288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29c674-5d49-4c02-bf15-3168d069006a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:00.145690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29c674-5d49-4c02-bf15-3168d069006a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:00.145847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29c674-5d49-4c02-bf15-3168d069006a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:00.208629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7c29c674-5d49-4c02-bf15-3168d069006a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:00.209824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7c29c674-5d49-4c02-bf15-3168d069006a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:00.302223 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 659/1333] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:37:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:00.338740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13c8f1-fca2-4cf8-8cec-3cbf40a0b226 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:00.340398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4c13c8f1-fca2-4cf8-8cec-3cbf40a0b226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:00.460615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13c8f1-fca2-4cf8-8cec-3cbf40a0b226 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:00.548631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04b525-db80-46c3-b8bc-32a58f17ab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:00.549491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04b525-db80-46c3-b8bc-32a58f17ab32 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:00.549905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04b525-db80-46c3-b8bc-32a58f17ab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:00.550825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04b525-db80-46c3-b8bc-32a58f17ab32 admin admin] PATH_INFO: `/v3/projects/64298b5848d848fdafaf45401789cb0a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:00.561593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04b525-db80-46c3-b8bc-32a58f17ab32 admin admin] RBAC: Authorizing `identity:get_project(project_id=64298b5848d848fdafaf45401789cb0a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:00.563665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04b525-db80-46c3-b8bc-32a58f17ab32 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:00.565613 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 675/1334] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Dec 18 20:37:00 2021] GET /identity/v3/projects/64298b5848d848fdafaf45401789cb0a => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:37:00.578417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29c674-5d49-4c02-bf15-3168d069006a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:00.579629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7c29c674-5d49-4c02-bf15-3168d069006a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:00.666101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29c674-5d49-4c02-bf15-3168d069006a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:00.738574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf8c24-7d95-4846-850b-0e1b7cc00d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:00.739243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf8c24-7d95-4846-850b-0e1b7cc00d07 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:00.739523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf8c24-7d95-4846-850b-0e1b7cc00d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:00.739797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf8c24-7d95-4846-850b-0e1b7cc00d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:00.741522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a5cf8c24-7d95-4846-850b-0e1b7cc00d07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:00.863773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf8c24-7d95-4846-850b-0e1b7cc00d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:00.865227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf8c24-7d95-4846-850b-0e1b7cc00d07 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:00.883704 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 660/1335] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:37:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:37:03.567512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469350d9-14c8-4a57-80fa-e75b1fe8cd4c None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:03.568076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469350d9-14c8-4a57-80fa-e75b1fe8cd4c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:03.568076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469350d9-14c8-4a57-80fa-e75b1fe8cd4c None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:03.569811 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 676/1336] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:37:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:37:03.575387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942826d9-8f3d-47a5-93bf-15418fb10544 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:03.575772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942826d9-8f3d-47a5-93bf-15418fb10544 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:03.575936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942826d9-8f3d-47a5-93bf-15418fb10544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:03.637594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-942826d9-8f3d-47a5-93bf-15418fb10544 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:03.638801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-942826d9-8f3d-47a5-93bf-15418fb10544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:03.731354 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 661/1337] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:37:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:03.768530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469350d9-14c8-4a57-80fa-e75b1fe8cd4c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:03.770571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-469350d9-14c8-4a57-80fa-e75b1fe8cd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:03.869481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469350d9-14c8-4a57-80fa-e75b1fe8cd4c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:03.938897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818c059-a93d-401b-b66d-a51e0dc7a809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:03.939534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818c059-a93d-401b-b66d-a51e0dc7a809 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:03.939817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818c059-a93d-401b-b66d-a51e0dc7a809 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:03.940092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818c059-a93d-401b-b66d-a51e0dc7a809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:03.942229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b818c059-a93d-401b-b66d-a51e0dc7a809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:04.044267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818c059-a93d-401b-b66d-a51e0dc7a809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:04.045671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818c059-a93d-401b-b66d-a51e0dc7a809 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:04.062994 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 677/1338] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:37:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:37:06.504053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe7a35-534d-4892-bd70-d26faa26bd78 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:06.504628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe7a35-534d-4892-bd70-d26faa26bd78 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:06.504628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe7a35-534d-4892-bd70-d26faa26bd78 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:06.506314 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 662/1339] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:37:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:06.512071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcba290-1916-4341-8f5f-af0b084d3494 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:06.512514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcba290-1916-4341-8f5f-af0b084d3494 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:06.512625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcba290-1916-4341-8f5f-af0b084d3494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:06.583809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ffcba290-1916-4341-8f5f-af0b084d3494 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:06.584994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ffcba290-1916-4341-8f5f-af0b084d3494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:06.685842 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 678/1340] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:37:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:06.728946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe7a35-534d-4892-bd70-d26faa26bd78 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:06.731056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2dfe7a35-534d-4892-bd70-d26faa26bd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:06.821972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe7a35-534d-4892-bd70-d26faa26bd78 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:06.825719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d318eaa-421c-4597-8c88-f3e29fd756f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:06.826412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d318eaa-421c-4597-8c88-f3e29fd756f7 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:06.826697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d318eaa-421c-4597-8c88-f3e29fd756f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:06.826976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d318eaa-421c-4597-8c88-f3e29fd756f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:06.836186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d318eaa-421c-4597-8c88-f3e29fd756f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:06.837602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d318eaa-421c-4597-8c88-f3e29fd756f7 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:06.846677 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 663/1341] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:37:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:37:09.651646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d825dd6-e3e3-4c7f-bb53-85131346fd84 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:09.652177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d825dd6-e3e3-4c7f-bb53-85131346fd84 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:09.652293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d825dd6-e3e3-4c7f-bb53-85131346fd84 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:09.654200 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 679/1342] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:37:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:09.660041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3da17-6289-40a0-a1b9-f74394e374c1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:09.660646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3da17-6289-40a0-a1b9-f74394e374c1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:09.660969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3da17-6289-40a0-a1b9-f74394e374c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:09.678987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-85a3da17-6289-40a0-a1b9-f74394e374c1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:09.680152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-85a3da17-6289-40a0-a1b9-f74394e374c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:09.687938 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 664/1343] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:37:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:09.725589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d825dd6-e3e3-4c7f-bb53-85131346fd84 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:09.736044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d825dd6-e3e3-4c7f-bb53-85131346fd84 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:09.740079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e93a0a-3500-4377-b1f0-bb99d64b5005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:09.740710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e93a0a-3500-4377-b1f0-bb99d64b5005 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:09.740995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e93a0a-3500-4377-b1f0-bb99d64b5005 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:09.741272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e93a0a-3500-4377-b1f0-bb99d64b5005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:09.749917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e93a0a-3500-4377-b1f0-bb99d64b5005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:09.751372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e93a0a-3500-4377-b1f0-bb99d64b5005 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:09.761175 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 680/1344] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:37:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:37:14.085197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126e01c-de84-4989-aa8b-4ebaa59fd4a4 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:14.085780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126e01c-de84-4989-aa8b-4ebaa59fd4a4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:14.085780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126e01c-de84-4989-aa8b-4ebaa59fd4a4 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:14.087659 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 665/1345] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:37:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:14.093644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b8a15-1a03-4d47-8d2c-f2d3f01375b8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:14.094108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b8a15-1a03-4d47-8d2c-f2d3f01375b8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:14.094373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b8a15-1a03-4d47-8d2c-f2d3f01375b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:14.113616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-cd1b8a15-1a03-4d47-8d2c-f2d3f01375b8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:14.115127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cd1b8a15-1a03-4d47-8d2c-f2d3f01375b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:14.123005 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 681/1346] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:37:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:14.163354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126e01c-de84-4989-aa8b-4ebaa59fd4a4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:14.165027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0126e01c-de84-4989-aa8b-4ebaa59fd4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:14.178176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126e01c-de84-4989-aa8b-4ebaa59fd4a4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:14.181665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391722d5-7464-4088-a5ba-9c82bc8d5498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:14.182329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391722d5-7464-4088-a5ba-9c82bc8d5498 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:14.182617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391722d5-7464-4088-a5ba-9c82bc8d5498 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:14.182894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391722d5-7464-4088-a5ba-9c82bc8d5498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:14.192649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391722d5-7464-4088-a5ba-9c82bc8d5498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:14.194071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391722d5-7464-4088-a5ba-9c82bc8d5498 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:14.203548 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 666/1347] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:37:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:37:17.379148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212de0e-cb4b-4bcb-b950-bf8563ea8d52 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:17.379717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212de0e-cb4b-4bcb-b950-bf8563ea8d52 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:17.379717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212de0e-cb4b-4bcb-b950-bf8563ea8d52 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:17.381530 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 682/1348] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:37:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:17.387763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4220e8-986a-4d91-94ff-eefa63883795 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:17.388278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4220e8-986a-4d91-94ff-eefa63883795 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:17.388453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4220e8-986a-4d91-94ff-eefa63883795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:17.407602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6f4220e8-986a-4d91-94ff-eefa63883795 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:17.408944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6f4220e8-986a-4d91-94ff-eefa63883795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:17.416952 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 667/1349] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:37:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:17.457537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212de0e-cb4b-4bcb-b950-bf8563ea8d52 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:17.468590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212de0e-cb4b-4bcb-b950-bf8563ea8d52 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:17.472182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1665b5-12a9-4980-afb0-5459d1a2a2d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:17.472824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1665b5-12a9-4980-afb0-5459d1a2a2d2 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:17.473112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1665b5-12a9-4980-afb0-5459d1a2a2d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:17.473921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1665b5-12a9-4980-afb0-5459d1a2a2d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:17.482794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1665b5-12a9-4980-afb0-5459d1a2a2d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:17.484214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1665b5-12a9-4980-afb0-5459d1a2a2d2 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:17.493778 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 683/1350] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:37:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:37:22.069609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35b040-3afb-4003-9d14-f3b0338d61c6 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:22.070084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35b040-3afb-4003-9d14-f3b0338d61c6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:22.070175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35b040-3afb-4003-9d14-f3b0338d61c6 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:22.071987 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 668/1351] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:37:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:22.077749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93757dfc-f42a-41ab-93eb-d9933e01569d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:22.078202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93757dfc-f42a-41ab-93eb-d9933e01569d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:22.078442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93757dfc-f42a-41ab-93eb-d9933e01569d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:22.095671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-93757dfc-f42a-41ab-93eb-d9933e01569d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:22.097363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-93757dfc-f42a-41ab-93eb-d9933e01569d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:22.105261 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 684/1352] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:37:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:22.146705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35b040-3afb-4003-9d14-f3b0338d61c6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:22.157011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35b040-3afb-4003-9d14-f3b0338d61c6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:22.161056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf5373-cb50-45f4-911d-78bb78786ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:22.161685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf5373-cb50-45f4-911d-78bb78786ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:22.162138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf5373-cb50-45f4-911d-78bb78786ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:22.162457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf5373-cb50-45f4-911d-78bb78786ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:22.171234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf5373-cb50-45f4-911d-78bb78786ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:22.172665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf5373-cb50-45f4-911d-78bb78786ac8 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:22.182587 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 669/1353] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:37:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:37:27.188523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a9bde-e4a8-4a80-aa66-5bf26f9ed8e8 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:27.189030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a9bde-e4a8-4a80-aa66-5bf26f9ed8e8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:27.189125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a9bde-e4a8-4a80-aa66-5bf26f9ed8e8 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:27.191421 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 685/1354] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:37:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:27.197325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba971594-3c6e-49ad-8233-a01603600e14 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:27.198054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba971594-3c6e-49ad-8233-a01603600e14 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:27.199640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba971594-3c6e-49ad-8233-a01603600e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:27.274464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ba971594-3c6e-49ad-8233-a01603600e14 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:27.276038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ba971594-3c6e-49ad-8233-a01603600e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:27.380755 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 670/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:37:27 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:31.972136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c85bab-bf72-4f84-87da-f03f7a5c107c None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:31.973090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c85bab-bf72-4f84-87da-f03f7a5c107c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:31.973391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c85bab-bf72-4f84-87da-f03f7a5c107c None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:31.975361 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 686/1356] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:37:31 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:31.981480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1fa43-57b5-453c-87bf-5d004b335709 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:31.981932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1fa43-57b5-453c-87bf-5d004b335709 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:31.982483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1fa43-57b5-453c-87bf-5d004b335709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:32.003908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3ae1fa43-57b5-453c-87bf-5d004b335709 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:32.005488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3ae1fa43-57b5-453c-87bf-5d004b335709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:32.015070 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 671/1357] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:37:31 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:33.520115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6dd8-dca7-4f07-baae-978083c9a4fe None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:33.520656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6dd8-dca7-4f07-baae-978083c9a4fe None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:33.520656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6dd8-dca7-4f07-baae-978083c9a4fe None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:33.522469 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 687/1358] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:37:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:33.527766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf93049-3eb0-4e0a-ac16-e473f5285e6b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:33.528177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf93049-3eb0-4e0a-ac16-e473f5285e6b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:33.528334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf93049-3eb0-4e0a-ac16-e473f5285e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:33.546090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2bf93049-3eb0-4e0a-ac16-e473f5285e6b None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:33.547295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2bf93049-3eb0-4e0a-ac16-e473f5285e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:33.556058 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 672/1359] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:37:33 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:37:37.409398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415a2dc-dcbd-44e8-92f3-1d9fca36a2dc None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:37.409988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415a2dc-dcbd-44e8-92f3-1d9fca36a2dc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:37.409988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415a2dc-dcbd-44e8-92f3-1d9fca36a2dc None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:37.411762 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 688/1360] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:37:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:37.417666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f02c4-69aa-4e64-aa21-f22c2bec073f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:37.418078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f02c4-69aa-4e64-aa21-f22c2bec073f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:37.418217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f02c4-69aa-4e64-aa21-f22c2bec073f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:37.440406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-559f02c4-69aa-4e64-aa21-f22c2bec073f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:37.441600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-559f02c4-69aa-4e64-aa21-f22c2bec073f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:37.449457 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 673/1361] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:37:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:37.502000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48f21a-1784-430c-be40-57748adbf85f None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:37.502441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48f21a-1784-430c-be40-57748adbf85f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:37.502801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48f21a-1784-430c-be40-57748adbf85f None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:37.504629 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 689/1362] 10.222.0.13 () {54 vars in 961 bytes} [Sat Dec 18 20:37:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:37.510384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec08a5a-f260-4530-a55b-6f8b47db15b2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:37.510678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec08a5a-f260-4530-a55b-6f8b47db15b2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:37.510960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec08a5a-f260-4530-a55b-6f8b47db15b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:37.559512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4ec08a5a-f260-4530-a55b-6f8b47db15b2 None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:37.560710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4ec08a5a-f260-4530-a55b-6f8b47db15b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:37.648169 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 674/1363] 10.222.0.13 () {58 vars in 1058 bytes} [Sat Dec 18 20:37:37 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:37.656684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48f21a-1784-430c-be40-57748adbf85f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:37.674531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48f21a-1784-430c-be40-57748adbf85f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:37.680110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce80eb1-c1f3-45f5-a3d3-1f012742626f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:37.680860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce80eb1-c1f3-45f5-a3d3-1f012742626f service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:37.681391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce80eb1-c1f3-45f5-a3d3-1f012742626f service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:37.681769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce80eb1-c1f3-45f5-a3d3-1f012742626f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:37.690934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce80eb1-c1f3-45f5-a3d3-1f012742626f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:37.692602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce80eb1-c1f3-45f5-a3d3-1f012742626f service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:37.702190 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 690/1364] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:37:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:37:40.375517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2af4d-83da-461e-a346-811c97fea756 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:40.376098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2af4d-83da-461e-a346-811c97fea756 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:40.376098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2af4d-83da-461e-a346-811c97fea756 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:40.378290 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 675/1365] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:37:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:40.385464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733128c-3de1-42ca-b505-ee21fdfcb3c1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:40.385966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733128c-3de1-42ca-b505-ee21fdfcb3c1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:40.386046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733128c-3de1-42ca-b505-ee21fdfcb3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:40.404300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1733128c-3de1-42ca-b505-ee21fdfcb3c1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:40.405575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1733128c-3de1-42ca-b505-ee21fdfcb3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:40.414362 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 691/1366] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:37:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:40.461436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2af4d-83da-461e-a346-811c97fea756 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:40.476481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2af4d-83da-461e-a346-811c97fea756 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:40.482619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b54f0-e472-461e-884c-5592eb7d3c90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:40.483349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b54f0-e472-461e-884c-5592eb7d3c90 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:40.483774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b54f0-e472-461e-884c-5592eb7d3c90 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:40.484100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b54f0-e472-461e-884c-5592eb7d3c90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:40.492628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b54f0-e472-461e-884c-5592eb7d3c90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:40.494316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b54f0-e472-461e-884c-5592eb7d3c90 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:40.506005 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 676/1367] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:37:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:37:43.240672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc67fb8-e969-403c-9f58-ad960b9d8e47 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:43.241230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc67fb8-e969-403c-9f58-ad960b9d8e47 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:43.241230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc67fb8-e969-403c-9f58-ad960b9d8e47 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:43.243018 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 692/1368] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:37:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:43.248991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594d166-2d2d-4490-b365-597b601c9b98 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:43.249435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594d166-2d2d-4490-b365-597b601c9b98 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:43.249530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594d166-2d2d-4490-b365-597b601c9b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:43.268962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5594d166-2d2d-4490-b365-597b601c9b98 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:43.270170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5594d166-2d2d-4490-b365-597b601c9b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:43.279490 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 677/1369] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:37:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:43.329347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb5c1c-914f-4c2f-a564-839b3c642223 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:43.329769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb5c1c-914f-4c2f-a564-839b3c642223 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:43.330125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb5c1c-914f-4c2f-a564-839b3c642223 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:43.332057 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 693/1370] 10.222.0.13 () {54 vars in 961 bytes} [Sat Dec 18 20:37:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:43.337982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc5acd-156c-4df4-ad4a-689fd868aa2f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:43.338674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc5acd-156c-4df4-ad4a-689fd868aa2f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:43.339171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc5acd-156c-4df4-ad4a-689fd868aa2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:43.360409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-08fc5acd-156c-4df4-ad4a-689fd868aa2f None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:43.363024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-08fc5acd-156c-4df4-ad4a-689fd868aa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:43.374152 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 678/1371] 10.222.0.13 () {58 vars in 1058 bytes} [Sat Dec 18 20:37:43 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:43.385451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb5c1c-914f-4c2f-a564-839b3c642223 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:43.399665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb5c1c-914f-4c2f-a564-839b3c642223 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:43.405584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df4cab-1b14-488f-9d63-61b3e47bb663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:43.406276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df4cab-1b14-488f-9d63-61b3e47bb663 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:43.406684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df4cab-1b14-488f-9d63-61b3e47bb663 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:43.407709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df4cab-1b14-488f-9d63-61b3e47bb663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:43.419555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df4cab-1b14-488f-9d63-61b3e47bb663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:43.421490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df4cab-1b14-488f-9d63-61b3e47bb663 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:43.434185 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 694/1372] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:37:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:37:46.083315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ae208-a6bd-4003-9b80-c5f16a9622b6 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:46.084128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ae208-a6bd-4003-9b80-c5f16a9622b6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:46.084538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ae208-a6bd-4003-9b80-c5f16a9622b6 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:46.090657 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 679/1373] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:37:46 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:46.092988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc76022-e97d-48fb-bb9a-c6c483ca3091 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:46.093747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc76022-e97d-48fb-bb9a-c6c483ca3091 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:46.094188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc76022-e97d-48fb-bb9a-c6c483ca3091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:46.115420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5cc76022-e97d-48fb-bb9a-c6c483ca3091 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:46.116886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5cc76022-e97d-48fb-bb9a-c6c483ca3091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:46.172889 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 695/1374] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:37:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:46.213119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ae208-a6bd-4003-9b80-c5f16a9622b6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:46.231490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ae208-a6bd-4003-9b80-c5f16a9622b6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:46.238851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff1221-094a-4227-be89-991d31648685 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:46.239497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff1221-094a-4227-be89-991d31648685 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:46.239775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff1221-094a-4227-be89-991d31648685 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:46.240047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff1221-094a-4227-be89-991d31648685 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:46.249467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff1221-094a-4227-be89-991d31648685 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:46.251081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff1221-094a-4227-be89-991d31648685 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:46.262453 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 680/1375] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:37:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:37:49.024600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd20e4-81bc-4245-9eb0-ef257ba398bc None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:49.025493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd20e4-81bc-4245-9eb0-ef257ba398bc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:49.026086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd20e4-81bc-4245-9eb0-ef257ba398bc None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:49.031037 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 696/1376] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:37:49 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:49.037872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c84588-2298-48fc-beec-9a40840fb345 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:49.038833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c84588-2298-48fc-beec-9a40840fb345 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:49.039346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c84588-2298-48fc-beec-9a40840fb345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:49.060693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e5c84588-2298-48fc-beec-9a40840fb345 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:49.062423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e5c84588-2298-48fc-beec-9a40840fb345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:49.071045 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 681/1377] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:37:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:49.120662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd20e4-81bc-4245-9eb0-ef257ba398bc None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:49.134907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd20e4-81bc-4245-9eb0-ef257ba398bc None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:49.140171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca62f7-e619-40c2-b29b-8db20e991931 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:49.140806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca62f7-e619-40c2-b29b-8db20e991931 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:49.141090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca62f7-e619-40c2-b29b-8db20e991931 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:49.141365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca62f7-e619-40c2-b29b-8db20e991931 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:49.150000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca62f7-e619-40c2-b29b-8db20e991931 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:49.151607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca62f7-e619-40c2-b29b-8db20e991931 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:49.161665 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 697/1378] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:37:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:37:49.415579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed13a6-cf50-42ac-87be-1be7f5ba076c None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:49.415953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed13a6-cf50-42ac-87be-1be7f5ba076c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:49.416211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed13a6-cf50-42ac-87be-1be7f5ba076c None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:49.418842 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 682/1379] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:37:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:49.427727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0d209-6a4d-478b-af27-a5e7e65d61f0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:49.428019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0d209-6a4d-478b-af27-a5e7e65d61f0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:49.428481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0d209-6a4d-478b-af27-a5e7e65d61f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:49.449476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-73b0d209-6a4d-478b-af27-a5e7e65d61f0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:49.450817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-73b0d209-6a4d-478b-af27-a5e7e65d61f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:49.461881 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 698/1380] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:37:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:49.516743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2e967-2652-4386-855d-545cd77d8768 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:49.517202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2e967-2652-4386-855d-545cd77d8768 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:49.517587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2e967-2652-4386-855d-545cd77d8768 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:49.520118 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 683/1381] 10.222.0.13 () {54 vars in 963 bytes} [Sat Dec 18 20:37:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:49.525698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f74ce8-80a6-43bf-a87c-d4bb59199868 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:49.526116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f74ce8-80a6-43bf-a87c-d4bb59199868 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:49.526525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f74ce8-80a6-43bf-a87c-d4bb59199868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:49.575626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e2f74ce8-80a6-43bf-a87c-d4bb59199868 None None] MFA Rules not processed for user `62bd53b4d64643d28ac7f4ea0ea45f90`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:49.576839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e2f74ce8-80a6-43bf-a87c-d4bb59199868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:49.637112 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 699/1382] 10.222.0.13 () {58 vars in 1060 bytes} [Sat Dec 18 20:37:49 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:49.645449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2e967-2652-4386-855d-545cd77d8768 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:49.656884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2e967-2652-4386-855d-545cd77d8768 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:49.661089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62dd2f-b63b-497c-93a5-d87ad6cdfab0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:49.661758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62dd2f-b63b-497c-93a5-d87ad6cdfab0 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:49.662044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62dd2f-b63b-497c-93a5-d87ad6cdfab0 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:49.662544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62dd2f-b63b-497c-93a5-d87ad6cdfab0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:49.672832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62dd2f-b63b-497c-93a5-d87ad6cdfab0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:49.674811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62dd2f-b63b-497c-93a5-d87ad6cdfab0 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:49.685494 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 684/1383] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:37:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:37:51.690824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae69ed-6b11-46e4-9eb9-700ddc98dbff None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:51.691306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae69ed-6b11-46e4-9eb9-700ddc98dbff None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:51.691306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae69ed-6b11-46e4-9eb9-700ddc98dbff None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:51.693108 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 700/1384] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:37:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:51.698989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b97c0-126a-427f-966b-2eed3fffa746 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:51.699448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b97c0-126a-427f-966b-2eed3fffa746 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:51.699552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b97c0-126a-427f-966b-2eed3fffa746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:51.719507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ea2b97c0-126a-427f-966b-2eed3fffa746 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:51.720730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ea2b97c0-126a-427f-966b-2eed3fffa746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:51.728684 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 685/1385] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:37:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:37:51.777115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae69ed-6b11-46e4-9eb9-700ddc98dbff None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:51.791469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae69ed-6b11-46e4-9eb9-700ddc98dbff None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:51.797268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5c7c0-d91e-4ca7-8782-da0acae4b89d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:51.797942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5c7c0-d91e-4ca7-8782-da0acae4b89d service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:51.798229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5c7c0-d91e-4ca7-8782-da0acae4b89d service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:51.798551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5c7c0-d91e-4ca7-8782-da0acae4b89d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:51.807466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5c7c0-d91e-4ca7-8782-da0acae4b89d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:51.809147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5c7c0-d91e-4ca7-8782-da0acae4b89d service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:51.819798 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 701/1386] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:37:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:37:54.331035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf303b-2d28-4db1-ab23-08af4c88d347 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:54.331955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf303b-2d28-4db1-ab23-08af4c88d347 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:54.332346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf303b-2d28-4db1-ab23-08af4c88d347 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:54.334517 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 686/1387] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:37:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:54.340254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee15fc-f82c-48dd-a0d0-cc783e0d92ec None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:54.340675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee15fc-f82c-48dd-a0d0-cc783e0d92ec None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:54.340808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee15fc-f82c-48dd-a0d0-cc783e0d92ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:54.359207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-afee15fc-f82c-48dd-a0d0-cc783e0d92ec None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:54.360526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-afee15fc-f82c-48dd-a0d0-cc783e0d92ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:54.368804 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 702/1388] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:37:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:54.413377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf303b-2d28-4db1-ab23-08af4c88d347 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:54.427435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf303b-2d28-4db1-ab23-08af4c88d347 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:54.432892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00613ecc-7894-49cc-b4f9-6871c83de3f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:54.433519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00613ecc-7894-49cc-b4f9-6871c83de3f7 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:54.433803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00613ecc-7894-49cc-b4f9-6871c83de3f7 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:54.434083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00613ecc-7894-49cc-b4f9-6871c83de3f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:54.442834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00613ecc-7894-49cc-b4f9-6871c83de3f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:54.444443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00613ecc-7894-49cc-b4f9-6871c83de3f7 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:54.453837 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 687/1389] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:37:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:37:56.926935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c483b4-b758-4d95-9442-984d5c952f4e None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:56.927982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c483b4-b758-4d95-9442-984d5c952f4e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:56.927982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c483b4-b758-4d95-9442-984d5c952f4e None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:56.929346 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 703/1390] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:37:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:56.935413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ab34b-712a-4aa3-989a-0cdfd6559b38 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:56.935904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ab34b-712a-4aa3-989a-0cdfd6559b38 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:56.936105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ab34b-712a-4aa3-989a-0cdfd6559b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:56.954158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7a2ab34b-712a-4aa3-989a-0cdfd6559b38 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:56.955701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7a2ab34b-712a-4aa3-989a-0cdfd6559b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:56.964166 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 688/1391] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:37:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:57.010548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c483b4-b758-4d95-9442-984d5c952f4e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:57.026413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c483b4-b758-4d95-9442-984d5c952f4e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:57.036861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf6f06-be00-435c-8c48-02992c68b66d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:57.037625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf6f06-be00-435c-8c48-02992c68b66d service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:57.038013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf6f06-be00-435c-8c48-02992c68b66d service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:57.038431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf6f06-be00-435c-8c48-02992c68b66d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:57.048531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf6f06-be00-435c-8c48-02992c68b66d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:57.050834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf6f06-be00-435c-8c48-02992c68b66d service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:57.060956 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 704/1392] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:37:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:37:59.739399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0083ee-fe7a-4e9f-8839-5865c4407e4c None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:59.740013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0083ee-fe7a-4e9f-8839-5865c4407e4c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:59.740013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0083ee-fe7a-4e9f-8839-5865c4407e4c None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:59.741779 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 689/1393] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:37:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:37:59.747650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbe0e2-bfd9-4650-8cd8-b17a0a2748cc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:59.748117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbe0e2-bfd9-4650-8cd8-b17a0a2748cc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:59.748308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbe0e2-bfd9-4650-8cd8-b17a0a2748cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:59.769555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1cdbe0e2-bfd9-4650-8cd8-b17a0a2748cc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:37:59.770840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1cdbe0e2-bfd9-4650-8cd8-b17a0a2748cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:37:59.778864 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 705/1394] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:37:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:37:59.828415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0083ee-fe7a-4e9f-8839-5865c4407e4c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:37:59.846191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0083ee-fe7a-4e9f-8839-5865c4407e4c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:37:59.853263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae216a-6634-462b-a24d-70c811e3bcc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:37:59.854081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae216a-6634-462b-a24d-70c811e3bcc4 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:37:59.854464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae216a-6634-462b-a24d-70c811e3bcc4 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:37:59.854849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae216a-6634-462b-a24d-70c811e3bcc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:37:59.867003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae216a-6634-462b-a24d-70c811e3bcc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:37:59.869156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae216a-6634-462b-a24d-70c811e3bcc4 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:37:59.882038 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 690/1395] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:37:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:02.782175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add75026-4222-40a5-b0ab-5e67c99f9912 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:02.782815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add75026-4222-40a5-b0ab-5e67c99f9912 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:02.782815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add75026-4222-40a5-b0ab-5e67c99f9912 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:02.785114 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 706/1396] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:38:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:02.791584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2823c71-702c-4a99-87d5-737e3f614fbc None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:02.792041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2823c71-702c-4a99-87d5-737e3f614fbc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:02.792433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2823c71-702c-4a99-87d5-737e3f614fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:02.813649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b2823c71-702c-4a99-87d5-737e3f614fbc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:02.814924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b2823c71-702c-4a99-87d5-737e3f614fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:02.822983 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 691/1397] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:38:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:02.872182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add75026-4222-40a5-b0ab-5e67c99f9912 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:02.889396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add75026-4222-40a5-b0ab-5e67c99f9912 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:02.894938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fb969-0b3a-4017-909d-992e9fe030de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:02.895584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fb969-0b3a-4017-909d-992e9fe030de service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:02.895864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fb969-0b3a-4017-909d-992e9fe030de service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:02.896140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fb969-0b3a-4017-909d-992e9fe030de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:02.904429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fb969-0b3a-4017-909d-992e9fe030de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:02.905983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fb969-0b3a-4017-909d-992e9fe030de service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:02.915144 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 707/1398] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:38:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:05.300628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c351fcc-d83f-4698-bbfd-c968aa7001e9 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:05.301222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c351fcc-d83f-4698-bbfd-c968aa7001e9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:05.301222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c351fcc-d83f-4698-bbfd-c968aa7001e9 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:05.303009 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 692/1399] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:38:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:05.308669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f84409-5c5e-41c8-97c9-98a3d0f105fb None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:05.309121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f84409-5c5e-41c8-97c9-98a3d0f105fb None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:05.309274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f84409-5c5e-41c8-97c9-98a3d0f105fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:05.327311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-67f84409-5c5e-41c8-97c9-98a3d0f105fb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:05.328497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-67f84409-5c5e-41c8-97c9-98a3d0f105fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:05.336838 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 708/1400] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:38:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:05.374239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839d8fd-edf4-481d-a8d4-8a2a62d6b1e6 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:05.374620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839d8fd-edf4-481d-a8d4-8a2a62d6b1e6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:05.374906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839d8fd-edf4-481d-a8d4-8a2a62d6b1e6 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:05.377186 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 693/1401] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:38:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:05.383120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aca8e-617f-483e-9e26-5dbde70a5dc5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:05.383417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aca8e-617f-483e-9e26-5dbde70a5dc5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:05.383701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aca8e-617f-483e-9e26-5dbde70a5dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:05.395701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46254701-472f-4960-b274-2d0ebcd5c682 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:05.396131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46254701-472f-4960-b274-2d0ebcd5c682 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:05.396786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46254701-472f-4960-b274-2d0ebcd5c682 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:05.401494 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 694/1402] 10.222.0.13 () {54 vars in 962 bytes} [Sat Dec 18 20:38:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:38:05.402604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-252aca8e-617f-483e-9e26-5dbde70a5dc5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:05.403802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-252aca8e-617f-483e-9e26-5dbde70a5dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:05.404144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0855d-5362-41ca-a3a8-6e4cc001e0af None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:05.404495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0855d-5362-41ca-a3a8-6e4cc001e0af None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:05.404837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0855d-5362-41ca-a3a8-6e4cc001e0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:05.412860 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 709/1403] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:38:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:05.452998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0ee0855d-5362-41ca-a3a8-6e4cc001e0af None None] MFA Rules not processed for user `82fb4302bcd54627a264f22ad78aa339`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:05.454193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0ee0855d-5362-41ca-a3a8-6e4cc001e0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:05.460746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252aca8e-617f-483e-9e26-5dbde70a5dc5 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:05.472549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252aca8e-617f-483e-9e26-5dbde70a5dc5 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:05.478018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78a15d-f60f-4a79-bf5a-bb6076aadaa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:05.478679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78a15d-f60f-4a79-bf5a-bb6076aadaa2 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:05.478969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78a15d-f60f-4a79-bf5a-bb6076aadaa2 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:05.479254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78a15d-f60f-4a79-bf5a-bb6076aadaa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:05.487261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78a15d-f60f-4a79-bf5a-bb6076aadaa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:05.488821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78a15d-f60f-4a79-bf5a-bb6076aadaa2 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:05.498041 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 710/1404] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:38:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:38:05.513381 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 695/1405] 10.222.0.13 () {58 vars in 1059 bytes} [Sat Dec 18 20:38:05 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:38:05.521650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78a15d-f60f-4a79-bf5a-bb6076aadaa2 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:05.530470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78a15d-f60f-4a79-bf5a-bb6076aadaa2 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:05.534422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08b51d-3416-4da0-a683-67ac15d0cb87 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:05.535072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08b51d-3416-4da0-a683-67ac15d0cb87 service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:05.535343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08b51d-3416-4da0-a683-67ac15d0cb87 service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:05.535624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08b51d-3416-4da0-a683-67ac15d0cb87 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:05.545390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08b51d-3416-4da0-a683-67ac15d0cb87 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:05.546925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08b51d-3416-4da0-a683-67ac15d0cb87 service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:05.557389 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 711/1406] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:38:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:05.998578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362fd0a-51a4-4965-af78-28364a3c5cfe None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:05.998979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362fd0a-51a4-4965-af78-28364a3c5cfe None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:05.999357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362fd0a-51a4-4965-af78-28364a3c5cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:06.046649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f362fd0a-51a4-4965-af78-28364a3c5cfe None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:06.047838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f362fd0a-51a4-4965-af78-28364a3c5cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:06.111797 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 696/1407] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:38:05 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:06.154892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713064-5246-4c52-962e-8b6fe4c3343e None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:06.155363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713064-5246-4c52-962e-8b6fe4c3343e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:06.155802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713064-5246-4c52-962e-8b6fe4c3343e None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:06.158088 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 712/1408] 10.222.0.13 () {54 vars in 942 bytes} [Sat Dec 18 20:38:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:06.164167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaf759-916f-42c3-88a1-c2b1558bb598 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:06.164525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaf759-916f-42c3-88a1-c2b1558bb598 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:06.165005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaf759-916f-42c3-88a1-c2b1558bb598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:06.220455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-36aaf759-916f-42c3-88a1-c2b1558bb598 None None] MFA Rules not processed for user `f5e4bc28d0744b65ab520bf79cea5a45`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:06.221604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-36aaf759-916f-42c3-88a1-c2b1558bb598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:06.292410 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 697/1409] 10.222.0.13 () {58 vars in 1039 bytes} [Sat Dec 18 20:38:06 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:38:06.302106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c713064-5246-4c52-962e-8b6fe4c3343e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:06.316040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c713064-5246-4c52-962e-8b6fe4c3343e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:06.321080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551837a2-14cc-4219-8d43-6e69a1245857 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:06.321720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551837a2-14cc-4219-8d43-6e69a1245857 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:06.322034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551837a2-14cc-4219-8d43-6e69a1245857 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:06.322349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551837a2-14cc-4219-8d43-6e69a1245857 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:06.331075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551837a2-14cc-4219-8d43-6e69a1245857 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:06.332644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551837a2-14cc-4219-8d43-6e69a1245857 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:06.340570 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 713/1410] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:38:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:38:08.074638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31852452-c694-4299-8af9-42710165a6d3 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:08.075601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31852452-c694-4299-8af9-42710165a6d3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:08.076076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31852452-c694-4299-8af9-42710165a6d3 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:08.078546 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 698/1411] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:38:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:08.084183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae38c68-81e7-4807-a754-30bc9d53f2a0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:08.085060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae38c68-81e7-4807-a754-30bc9d53f2a0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:08.085536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae38c68-81e7-4807-a754-30bc9d53f2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:08.103567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4ae38c68-81e7-4807-a754-30bc9d53f2a0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:08.112275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4ae38c68-81e7-4807-a754-30bc9d53f2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:08.121850 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 714/1412] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:38:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:08.176581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31852452-c694-4299-8af9-42710165a6d3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:08.192081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31852452-c694-4299-8af9-42710165a6d3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:08.197720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb804fb3-6ee0-49ad-a4ac-f3d12b11c45e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:08.198403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb804fb3-6ee0-49ad-a4ac-f3d12b11c45e service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:08.198695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb804fb3-6ee0-49ad-a4ac-f3d12b11c45e service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:08.198971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb804fb3-6ee0-49ad-a4ac-f3d12b11c45e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:08.208063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb804fb3-6ee0-49ad-a4ac-f3d12b11c45e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:08.209639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb804fb3-6ee0-49ad-a4ac-f3d12b11c45e service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:08.220451 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 699/1413] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:38:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:30.016142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927f131-c73f-48d0-9f61-bdd570dc651a None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:30.016728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927f131-c73f-48d0-9f61-bdd570dc651a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:30.016728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927f131-c73f-48d0-9f61-bdd570dc651a None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:30.018448 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 715/1414] 10.222.0.13 () {54 vars in 918 bytes} [Sat Dec 18 20:38:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:38:30.024340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f5554-b714-4d14-bd6b-1ec6860ef1e1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:30.024814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f5554-b714-4d14-bd6b-1ec6860ef1e1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:30.024936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f5554-b714-4d14-bd6b-1ec6860ef1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:30.042524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4d9f5554-b714-4d14-bd6b-1ec6860ef1e1 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:30.043744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4d9f5554-b714-4d14-bd6b-1ec6860ef1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:30.052639 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 700/1415] 10.222.0.13 () {58 vars in 1015 bytes} [Sat Dec 18 20:38:30 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:30.068415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb2a72-ce3d-4225-a118-ccc0b6ffe830 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:30.068705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb2a72-ce3d-4225-a118-ccc0b6ffe830 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:30.068985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb2a72-ce3d-4225-a118-ccc0b6ffe830 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:30.070771 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 716/1416] 10.222.0.13 () {54 vars in 918 bytes} [Sat Dec 18 20:38:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:30.075889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25dd4-d404-40fa-ab73-1d9edc919cf7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:30.076196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25dd4-d404-40fa-ab73-1d9edc919cf7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:30.076466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25dd4-d404-40fa-ab73-1d9edc919cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:30.093775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fad25dd4-d404-40fa-ab73-1d9edc919cf7 None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:30.095497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fad25dd4-d404-40fa-ab73-1d9edc919cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:30.104341 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 701/1417] 10.222.0.13 () {58 vars in 1015 bytes} [Sat Dec 18 20:38:30 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:32.946137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba00f1-ba3a-4270-9332-164a9d051363 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:32.946717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba00f1-ba3a-4270-9332-164a9d051363 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:32.946717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba00f1-ba3a-4270-9332-164a9d051363 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:32.948465 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 717/1418] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 18 20:38:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:38:32.954327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df43bb9-08f8-4db2-a445-63c0df93b3c0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:32.954725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df43bb9-08f8-4db2-a445-63c0df93b3c0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:32.954883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df43bb9-08f8-4db2-a445-63c0df93b3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:32.972192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1df43bb9-08f8-4db2-a445-63c0df93b3c0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:32.973294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1df43bb9-08f8-4db2-a445-63c0df93b3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:32.980837 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 702/1419] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 18 20:38:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:33.024934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba00f1-ba3a-4270-9332-164a9d051363 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:33.039193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba00f1-ba3a-4270-9332-164a9d051363 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:33.044530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e4493-e8e9-4bc4-8762-c8d27d497de8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:33.045154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e4493-e8e9-4bc4-8762-c8d27d497de8 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:33.045439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e4493-e8e9-4bc4-8762-c8d27d497de8 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:33.045715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e4493-e8e9-4bc4-8762-c8d27d497de8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:33.054422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e4493-e8e9-4bc4-8762-c8d27d497de8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:33.056013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e4493-e8e9-4bc4-8762-c8d27d497de8 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:33.065951 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 718/1420] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:38:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:34.733281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261d4cb-1ae9-4df0-9737-9ce484285a35 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:34.733737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261d4cb-1ae9-4df0-9737-9ce484285a35 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:34.733839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261d4cb-1ae9-4df0-9737-9ce484285a35 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:34.736273 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 703/1421] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 18 20:38:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:34.742096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490b11d-f198-41d5-b200-267ca057d46a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:34.742560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490b11d-f198-41d5-b200-267ca057d46a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:34.742744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490b11d-f198-41d5-b200-267ca057d46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:34.760374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1490b11d-f198-41d5-b200-267ca057d46a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:34.761563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1490b11d-f198-41d5-b200-267ca057d46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:34.769110 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 719/1422] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 18 20:38:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:35.000009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261d4cb-1ae9-4df0-9737-9ce484285a35 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:35.014363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261d4cb-1ae9-4df0-9737-9ce484285a35 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:35.020643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7864c62-b909-4392-9130-9bc96c5f7ac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:35.021304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7864c62-b909-4392-9130-9bc96c5f7ac7 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:35.021587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7864c62-b909-4392-9130-9bc96c5f7ac7 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:35.021862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7864c62-b909-4392-9130-9bc96c5f7ac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:35.030118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7864c62-b909-4392-9130-9bc96c5f7ac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:35.031730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7864c62-b909-4392-9130-9bc96c5f7ac7 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:35.041769 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 704/1423] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:38:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:36.691671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517a97f-b488-490d-a31d-054a03860d54 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:36.692228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517a97f-b488-490d-a31d-054a03860d54 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:36.692228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517a97f-b488-490d-a31d-054a03860d54 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:36.693997 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 720/1424] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 18 20:38:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:36.699502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647a609-f499-4c24-b7d8-b50e58929e2c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:36.699964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647a609-f499-4c24-b7d8-b50e58929e2c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:36.700070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647a609-f499-4c24-b7d8-b50e58929e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:36.719132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0647a609-f499-4c24-b7d8-b50e58929e2c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:36.720361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0647a609-f499-4c24-b7d8-b50e58929e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:36.728102 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 705/1425] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 18 20:38:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:36.887281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517a97f-b488-490d-a31d-054a03860d54 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:36.901352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517a97f-b488-490d-a31d-054a03860d54 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:36.906748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c92ef4-9d67-4cdb-8f4c-8c14f392a617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:36.907874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c92ef4-9d67-4cdb-8f4c-8c14f392a617 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:36.908165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c92ef4-9d67-4cdb-8f4c-8c14f392a617 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:36.908448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c92ef4-9d67-4cdb-8f4c-8c14f392a617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:36.916424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c92ef4-9d67-4cdb-8f4c-8c14f392a617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:36.917986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c92ef4-9d67-4cdb-8f4c-8c14f392a617 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:36.927806 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 721/1426] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:38:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:38.617526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2625e6a-f5dc-49a2-be79-121f08313e71 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:38.618089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2625e6a-f5dc-49a2-be79-121f08313e71 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:38.618089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2625e6a-f5dc-49a2-be79-121f08313e71 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:38.619893 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 706/1427] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 18 20:38:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:38.626590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503eb24-64e3-42ca-8f8b-6e0329441d74 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:38.627038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503eb24-64e3-42ca-8f8b-6e0329441d74 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:38.627212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503eb24-64e3-42ca-8f8b-6e0329441d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:38.647837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b503eb24-64e3-42ca-8f8b-6e0329441d74 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:38.649511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b503eb24-64e3-42ca-8f8b-6e0329441d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:38.658882 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 722/1428] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 18 20:38:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:38.856518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2625e6a-f5dc-49a2-be79-121f08313e71 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:38.880169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2625e6a-f5dc-49a2-be79-121f08313e71 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:38.886230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44158d44-e7d3-422c-a50c-36631abec8a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:38.887090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44158d44-e7d3-422c-a50c-36631abec8a8 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:38.887369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44158d44-e7d3-422c-a50c-36631abec8a8 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:38.887643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44158d44-e7d3-422c-a50c-36631abec8a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:38.897586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44158d44-e7d3-422c-a50c-36631abec8a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:38.899238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44158d44-e7d3-422c-a50c-36631abec8a8 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:38.908785 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 707/1429] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:38:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:40.536459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0ec71-3cbc-4dbe-8e6a-0e217cc590c2 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:40.536964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0ec71-3cbc-4dbe-8e6a-0e217cc590c2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:40.536964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0ec71-3cbc-4dbe-8e6a-0e217cc590c2 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:40.538830 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 723/1430] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 18 20:38:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:40.544415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d071060-1ec8-4858-8fa8-6cc900423d1e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:40.544869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d071060-1ec8-4858-8fa8-6cc900423d1e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:40.544980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d071060-1ec8-4858-8fa8-6cc900423d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:40.562634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1d071060-1ec8-4858-8fa8-6cc900423d1e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:40.563827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1d071060-1ec8-4858-8fa8-6cc900423d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:40.571393 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 708/1431] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 18 20:38:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:40.734821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0ec71-3cbc-4dbe-8e6a-0e217cc590c2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:40.748777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0ec71-3cbc-4dbe-8e6a-0e217cc590c2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:40.754804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cac81-84b8-4045-b1a6-d956ee256290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:40.755434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cac81-84b8-4045-b1a6-d956ee256290 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:40.755715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cac81-84b8-4045-b1a6-d956ee256290 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:40.755992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cac81-84b8-4045-b1a6-d956ee256290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:40.763760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cac81-84b8-4045-b1a6-d956ee256290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:40.765337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cac81-84b8-4045-b1a6-d956ee256290 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:40.775545 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 724/1432] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:38:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:42.343237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c73b61-3ece-4e6e-92fe-f691b903001f None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:42.343728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c73b61-3ece-4e6e-92fe-f691b903001f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:42.343839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c73b61-3ece-4e6e-92fe-f691b903001f None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:42.345614 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 709/1433] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 18 20:38:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:42.351156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd54353-6f1d-4b18-9701-c96abc50d805 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:42.351585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd54353-6f1d-4b18-9701-c96abc50d805 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:42.351718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd54353-6f1d-4b18-9701-c96abc50d805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:42.370120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2bd54353-6f1d-4b18-9701-c96abc50d805 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:42.371329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2bd54353-6f1d-4b18-9701-c96abc50d805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:42.379430 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 725/1434] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 18 20:38:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:42.538969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c73b61-3ece-4e6e-92fe-f691b903001f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:42.553575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c73b61-3ece-4e6e-92fe-f691b903001f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:42.559067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d43a11-14f4-45e0-a2e9-b145ac84c68d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:42.559696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d43a11-14f4-45e0-a2e9-b145ac84c68d service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:42.559979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d43a11-14f4-45e0-a2e9-b145ac84c68d service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:42.560256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d43a11-14f4-45e0-a2e9-b145ac84c68d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:42.569124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d43a11-14f4-45e0-a2e9-b145ac84c68d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:42.570724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d43a11-14f4-45e0-a2e9-b145ac84c68d service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:42.579884 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 710/1435] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:38:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:44.171064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f3ea9-d3ce-47f6-8a64-7f486fd66805 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:44.171660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f3ea9-d3ce-47f6-8a64-7f486fd66805 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:44.171660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f3ea9-d3ce-47f6-8a64-7f486fd66805 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:44.173908 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 726/1436] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 18 20:38:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:44.179334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912f351-2ce3-427d-b620-caa910d747a5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:44.179742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912f351-2ce3-427d-b620-caa910d747a5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:44.179893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912f351-2ce3-427d-b620-caa910d747a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:44.198601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e912f351-2ce3-427d-b620-caa910d747a5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:44.199789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e912f351-2ce3-427d-b620-caa910d747a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:44.207466 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 711/1437] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 18 20:38:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:44.384651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f3ea9-d3ce-47f6-8a64-7f486fd66805 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:44.398788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f3ea9-d3ce-47f6-8a64-7f486fd66805 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:44.404908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39846e-dada-4114-a845-238ba4f77370 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:44.405545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39846e-dada-4114-a845-238ba4f77370 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:44.405832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39846e-dada-4114-a845-238ba4f77370 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:44.406114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39846e-dada-4114-a845-238ba4f77370 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:44.414746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39846e-dada-4114-a845-238ba4f77370 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:44.416300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39846e-dada-4114-a845-238ba4f77370 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:44.426158 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 727/1438] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:38:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:45.946924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22f054-3c33-46cf-9779-588e6aab9f1f None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:45.947482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22f054-3c33-46cf-9779-588e6aab9f1f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:45.947482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22f054-3c33-46cf-9779-588e6aab9f1f None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:45.949230 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 712/1439] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 18 20:38:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:45.954846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38296d-2097-4b78-8209-6bb40811e964 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:45.955335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38296d-2097-4b78-8209-6bb40811e964 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:45.955448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38296d-2097-4b78-8209-6bb40811e964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:45.973585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-da38296d-2097-4b78-8209-6bb40811e964 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:45.974809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-da38296d-2097-4b78-8209-6bb40811e964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:45.982561 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 728/1440] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 18 20:38:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:38:46.141522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22f054-3c33-46cf-9779-588e6aab9f1f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:46.155164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22f054-3c33-46cf-9779-588e6aab9f1f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:46.160884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acc5ec-3209-4a4d-ac46-5f704e90c909 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:46.161502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acc5ec-3209-4a4d-ac46-5f704e90c909 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:46.161781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acc5ec-3209-4a4d-ac46-5f704e90c909 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:46.162054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acc5ec-3209-4a4d-ac46-5f704e90c909 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:46.169793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acc5ec-3209-4a4d-ac46-5f704e90c909 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:46.171377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acc5ec-3209-4a4d-ac46-5f704e90c909 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:46.180904 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 713/1441] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:38:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:47.723875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06c82b-9698-464c-9e0a-7afe9e50e57b None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:47.724350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06c82b-9698-464c-9e0a-7afe9e50e57b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:47.724442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06c82b-9698-464c-9e0a-7afe9e50e57b None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:47.726215 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 729/1442] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 18 20:38:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:47.731744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd98115-85c7-4a0c-9456-e0deee38e34b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:47.732156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd98115-85c7-4a0c-9456-e0deee38e34b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:47.732337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd98115-85c7-4a0c-9456-e0deee38e34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:47.751217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-edd98115-85c7-4a0c-9456-e0deee38e34b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:47.752385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-edd98115-85c7-4a0c-9456-e0deee38e34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:47.760057 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 714/1443] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 18 20:38:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:47.922541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06c82b-9698-464c-9e0a-7afe9e50e57b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:47.936459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06c82b-9698-464c-9e0a-7afe9e50e57b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:47.942018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56924fe-aa39-4544-b67f-ac1283d09ade service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:47.942681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56924fe-aa39-4544-b67f-ac1283d09ade service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:47.942966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56924fe-aa39-4544-b67f-ac1283d09ade service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:47.943246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56924fe-aa39-4544-b67f-ac1283d09ade service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:47.951107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56924fe-aa39-4544-b67f-ac1283d09ade service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:47.952655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56924fe-aa39-4544-b67f-ac1283d09ade service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:47.962213 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 730/1444] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:38:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:50.290767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8b575-576f-4a8e-8770-c626a56a6bc8 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:50.291207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8b575-576f-4a8e-8770-c626a56a6bc8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:50.291301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8b575-576f-4a8e-8770-c626a56a6bc8 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:50.293086 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 715/1445] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 18 20:38:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:50.299608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21033871-9754-463b-96bb-b8e6aaccde1c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:50.300033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21033871-9754-463b-96bb-b8e6aaccde1c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:50.300164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21033871-9754-463b-96bb-b8e6aaccde1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:50.318478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-21033871-9754-463b-96bb-b8e6aaccde1c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:50.319659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-21033871-9754-463b-96bb-b8e6aaccde1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:50.327747 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 731/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 18 20:38:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:50.369070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8b575-576f-4a8e-8770-c626a56a6bc8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:50.379601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8b575-576f-4a8e-8770-c626a56a6bc8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:50.383096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8b2b5-ea29-4340-8240-846b799f3461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:50.383720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8b2b5-ea29-4340-8240-846b799f3461 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:50.384002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8b2b5-ea29-4340-8240-846b799f3461 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:50.384279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8b2b5-ea29-4340-8240-846b799f3461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:50.392956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8b2b5-ea29-4340-8240-846b799f3461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:50.394398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8b2b5-ea29-4340-8240-846b799f3461 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:50.403465 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 716/1447] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:38:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:52.979891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e801332-c560-47e9-b09d-c4d0c613cf24 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:52.980416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e801332-c560-47e9-b09d-c4d0c613cf24 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:52.980416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e801332-c560-47e9-b09d-c4d0c613cf24 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:52.982124 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 732/1448] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 18 20:38:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:52.988591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad613d45-77a9-4927-96c0-d60a76f2b42d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:52.989003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad613d45-77a9-4927-96c0-d60a76f2b42d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:52.989156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad613d45-77a9-4927-96c0-d60a76f2b42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:53.006990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ad613d45-77a9-4927-96c0-d60a76f2b42d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:53.008171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ad613d45-77a9-4927-96c0-d60a76f2b42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:53.015826 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 717/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 18 20:38:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:38:53.055254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e801332-c560-47e9-b09d-c4d0c613cf24 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:53.066459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e801332-c560-47e9-b09d-c4d0c613cf24 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:53.069895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcb33e-59fb-44cb-ac26-b01f96f40886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:53.070560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcb33e-59fb-44cb-ac26-b01f96f40886 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:53.070845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcb33e-59fb-44cb-ac26-b01f96f40886 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:53.071121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcb33e-59fb-44cb-ac26-b01f96f40886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:53.079682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcb33e-59fb-44cb-ac26-b01f96f40886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:53.081084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcb33e-59fb-44cb-ac26-b01f96f40886 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:53.090404 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 733/1450] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:38:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:55.829610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe7f63-2766-45f9-9c38-77780e5584a8 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:55.830168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe7f63-2766-45f9-9c38-77780e5584a8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:55.830168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe7f63-2766-45f9-9c38-77780e5584a8 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:55.832069 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 718/1451] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 18 20:38:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:55.838012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db94e7-549c-443e-a865-2e06c7f1379b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:55.838423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db94e7-549c-443e-a865-2e06c7f1379b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:55.838614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db94e7-549c-443e-a865-2e06c7f1379b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:55.856889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-89db94e7-549c-443e-a865-2e06c7f1379b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:55.858064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-89db94e7-549c-443e-a865-2e06c7f1379b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:55.865883 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 734/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 18 20:38:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:55.907289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe7f63-2766-45f9-9c38-77780e5584a8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:55.917780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe7f63-2766-45f9-9c38-77780e5584a8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:55.921338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd2635-6148-44e0-b7c9-8ef4ad6cad9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:55.921960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd2635-6148-44e0-b7c9-8ef4ad6cad9a service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:55.922241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd2635-6148-44e0-b7c9-8ef4ad6cad9a service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:55.922551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd2635-6148-44e0-b7c9-8ef4ad6cad9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:55.931168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd2635-6148-44e0-b7c9-8ef4ad6cad9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:55.932577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd2635-6148-44e0-b7c9-8ef4ad6cad9a service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:55.942371 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 719/1453] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:38:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:38:58.511052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665b495-76ec-4d40-943b-f44a2fbeb793 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:58.511602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665b495-76ec-4d40-943b-f44a2fbeb793 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:58.511712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665b495-76ec-4d40-943b-f44a2fbeb793 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:58.513428 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 735/1454] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 18 20:38:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:38:58.519318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa663b-0e12-4c1b-9495-9e740419776d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:58.519797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa663b-0e12-4c1b-9495-9e740419776d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:58.519897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa663b-0e12-4c1b-9495-9e740419776d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:58.537654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-adaa663b-0e12-4c1b-9495-9e740419776d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:38:58.538812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-adaa663b-0e12-4c1b-9495-9e740419776d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:38:58.546536 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 720/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 18 20:38:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:38:58.587598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665b495-76ec-4d40-943b-f44a2fbeb793 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:38:58.598448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665b495-76ec-4d40-943b-f44a2fbeb793 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:38:58.601887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b000d08-607c-456a-b7a7-2035478d68d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:38:58.602554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b000d08-607c-456a-b7a7-2035478d68d0 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:38:58.602839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b000d08-607c-456a-b7a7-2035478d68d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:38:58.603116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b000d08-607c-456a-b7a7-2035478d68d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:38:58.612376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b000d08-607c-456a-b7a7-2035478d68d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:38:58.613778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b000d08-607c-456a-b7a7-2035478d68d0 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:38:58.622826 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 736/1456] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:38:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:39:01.111202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a9655-7ad1-4c74-9ce5-a6481718d304 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:01.111741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a9655-7ad1-4c74-9ce5-a6481718d304 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:01.111838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a9655-7ad1-4c74-9ce5-a6481718d304 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:01.113548 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 721/1457] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 18 20:39:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:39:01.119619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b0b53-3a9b-467b-a07d-6b1193c59a8b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:01.120027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b0b53-3a9b-467b-a07d-6b1193c59a8b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:01.120203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b0b53-3a9b-467b-a07d-6b1193c59a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:01.137364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2e7b0b53-3a9b-467b-a07d-6b1193c59a8b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:39:01.138567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2e7b0b53-3a9b-467b-a07d-6b1193c59a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:39:01.146195 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 737/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 18 20:39:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:39:01.187138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a9655-7ad1-4c74-9ce5-a6481718d304 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:39:01.197886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a9655-7ad1-4c74-9ce5-a6481718d304 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:39:01.201379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5daba-2f0e-4820-b3af-3d9c0ddf3630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:39:01.202003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5daba-2f0e-4820-b3af-3d9c0ddf3630 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:01.202317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5daba-2f0e-4820-b3af-3d9c0ddf3630 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:01.202598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5daba-2f0e-4820-b3af-3d9c0ddf3630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:01.211808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5daba-2f0e-4820-b3af-3d9c0ddf3630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:39:01.213232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5daba-2f0e-4820-b3af-3d9c0ddf3630 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:39:01.223664 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 722/1459] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:39:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:39:03.709502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6793e2-1226-4b6c-aa67-709507a9dd4c None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:03.710040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6793e2-1226-4b6c-aa67-709507a9dd4c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:03.710040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6793e2-1226-4b6c-aa67-709507a9dd4c None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:03.711872 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 738/1460] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 18 20:39:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:39:03.718001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750d851-b12c-455d-8529-a992ae82df54 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:03.718449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750d851-b12c-455d-8529-a992ae82df54 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:03.718664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750d851-b12c-455d-8529-a992ae82df54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:03.736619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c750d851-b12c-455d-8529-a992ae82df54 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:39:03.737780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c750d851-b12c-455d-8529-a992ae82df54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:39:03.745406 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 723/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 18 20:39:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:39:03.786339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6793e2-1226-4b6c-aa67-709507a9dd4c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:39:03.796760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6793e2-1226-4b6c-aa67-709507a9dd4c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:39:03.802424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18d94c-67d4-497e-af6d-62ef738b4a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:39:03.803065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18d94c-67d4-497e-af6d-62ef738b4a6d service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:03.803354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18d94c-67d4-497e-af6d-62ef738b4a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:03.803633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18d94c-67d4-497e-af6d-62ef738b4a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:03.813136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18d94c-67d4-497e-af6d-62ef738b4a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:39:03.815294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18d94c-67d4-497e-af6d-62ef738b4a6d service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:39:03.824710 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 739/1462] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:39:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:39:06.309464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9abbb-3243-4b31-af29-4619434a00ce None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:06.309932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9abbb-3243-4b31-af29-4619434a00ce None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:06.310033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9abbb-3243-4b31-af29-4619434a00ce None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:06.311858 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 724/1463] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 18 20:39:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:39:06.319067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe49ad-a328-476d-96ae-087c632e0469 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:06.319494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe49ad-a328-476d-96ae-087c632e0469 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:06.319665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe49ad-a328-476d-96ae-087c632e0469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:06.337195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6cfe49ad-a328-476d-96ae-087c632e0469 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:39:06.338414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6cfe49ad-a328-476d-96ae-087c632e0469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:39:06.346055 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 740/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 18 20:39:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:39:06.385895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9abbb-3243-4b31-af29-4619434a00ce None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:39:06.396303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9abbb-3243-4b31-af29-4619434a00ce None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:39:06.399863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca26294-e946-444f-911f-7ae4728396a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:39:06.400524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca26294-e946-444f-911f-7ae4728396a7 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:06.400802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca26294-e946-444f-911f-7ae4728396a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:06.401076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca26294-e946-444f-911f-7ae4728396a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:06.409780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca26294-e946-444f-911f-7ae4728396a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:39:06.411263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca26294-e946-444f-911f-7ae4728396a7 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:39:06.420220 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 725/1465] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:39:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:39:08.880159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa85d93-1832-4de1-9946-24989edc3c09 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:08.880711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa85d93-1832-4de1-9946-24989edc3c09 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:08.880711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa85d93-1832-4de1-9946-24989edc3c09 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:08.882525 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 741/1466] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 18 20:39:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:39:08.888438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ca316-de3f-4daf-9199-2515037b7be3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:08.888824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ca316-de3f-4daf-9199-2515037b7be3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:08.889002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ca316-de3f-4daf-9199-2515037b7be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:08.906660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-889ca316-de3f-4daf-9199-2515037b7be3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:39:08.908381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-889ca316-de3f-4daf-9199-2515037b7be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:39:08.916464 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 726/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 18 20:39:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:39:08.956847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa85d93-1832-4de1-9946-24989edc3c09 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:39:08.967407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa85d93-1832-4de1-9946-24989edc3c09 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:39:08.971395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39b857-d084-4d60-b0e9-656e7a31435b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:39:08.972021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39b857-d084-4d60-b0e9-656e7a31435b service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:08.972306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39b857-d084-4d60-b0e9-656e7a31435b service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:08.972586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39b857-d084-4d60-b0e9-656e7a31435b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:08.981207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39b857-d084-4d60-b0e9-656e7a31435b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:39:08.982666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39b857-d084-4d60-b0e9-656e7a31435b service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:39:08.992410 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 742/1468] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:39:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:39:11.435484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d900b08-be8d-4ea4-b936-57bab265ae38 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:11.436052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d900b08-be8d-4ea4-b936-57bab265ae38 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:11.436052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d900b08-be8d-4ea4-b936-57bab265ae38 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:11.438068 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 727/1469] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 18 20:39:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:39:11.444840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869ddc-e5b5-48e0-a2c1-46f2b39afcfd None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:11.445252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869ddc-e5b5-48e0-a2c1-46f2b39afcfd None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:11.445407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869ddc-e5b5-48e0-a2c1-46f2b39afcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:11.463976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5c869ddc-e5b5-48e0-a2c1-46f2b39afcfd None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:39:11.465165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5c869ddc-e5b5-48e0-a2c1-46f2b39afcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:39:11.473012 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 743/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 18 20:39:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:39:11.512396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d900b08-be8d-4ea4-b936-57bab265ae38 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:39:11.522980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d900b08-be8d-4ea4-b936-57bab265ae38 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:39:11.526474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c319f-d9cd-4c3a-abbb-3dd3cd875f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:39:11.527093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c319f-d9cd-4c3a-abbb-3dd3cd875f6b service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:11.527374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c319f-d9cd-4c3a-abbb-3dd3cd875f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:11.527662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c319f-d9cd-4c3a-abbb-3dd3cd875f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:11.536144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c319f-d9cd-4c3a-abbb-3dd3cd875f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:39:11.537553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c319f-d9cd-4c3a-abbb-3dd3cd875f6b service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:39:11.546450 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 728/1471] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:39:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:39:13.981502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2beca-07ec-49e6-8924-e5c414e0eefb None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:13.982024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2beca-07ec-49e6-8924-e5c414e0eefb None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:13.982024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2beca-07ec-49e6-8924-e5c414e0eefb None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:13.983979 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 744/1472] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 18 20:39:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:39:13.989804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f334086-f335-45fc-b36a-a8d5705f6682 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:13.990232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f334086-f335-45fc-b36a-a8d5705f6682 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:13.990390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f334086-f335-45fc-b36a-a8d5705f6682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:14.008107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1f334086-f335-45fc-b36a-a8d5705f6682 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:39:14.009272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1f334086-f335-45fc-b36a-a8d5705f6682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:39:14.016851 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 729/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 18 20:39:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:39:14.055379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2beca-07ec-49e6-8924-e5c414e0eefb None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:39:14.066407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2beca-07ec-49e6-8924-e5c414e0eefb None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:39:14.069828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a569da-8840-4af6-bf48-a62551cba807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:39:14.070482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a569da-8840-4af6-bf48-a62551cba807 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:14.070767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a569da-8840-4af6-bf48-a62551cba807 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:14.071042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a569da-8840-4af6-bf48-a62551cba807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:14.080163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a569da-8840-4af6-bf48-a62551cba807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:39:14.081558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a569da-8840-4af6-bf48-a62551cba807 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:39:14.090545 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 745/1474] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:39:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:39:32.178041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d957df6-7108-4663-939b-66cd14bd9c59 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:32.178673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d957df6-7108-4663-939b-66cd14bd9c59 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:32.178673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d957df6-7108-4663-939b-66cd14bd9c59 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:32.180411 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 730/1475] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:39:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:39:32.186090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1940e8-3640-46a6-87ea-da211d4366b6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:32.186676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1940e8-3640-46a6-87ea-da211d4366b6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:32.186961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1940e8-3640-46a6-87ea-da211d4366b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:32.205075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0e1940e8-3640-46a6-87ea-da211d4366b6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:39:32.206874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0e1940e8-3640-46a6-87ea-da211d4366b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:39:32.214601 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 746/1476] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:39:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:39:32.263737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87984b-f4bc-44e3-aa13-e712f4f66469 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:32.264031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87984b-f4bc-44e3-aa13-e712f4f66469 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:32.264311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87984b-f4bc-44e3-aa13-e712f4f66469 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:32.266103 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 731/1477] 10.222.0.13 () {54 vars in 962 bytes} [Sat Dec 18 20:39:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:39:32.271994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fe934-d8fc-43d1-a0e9-5b2c85aec9ce None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:32.272285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fe934-d8fc-43d1-a0e9-5b2c85aec9ce None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:32.272566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fe934-d8fc-43d1-a0e9-5b2c85aec9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:32.290572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-bb0fe934-d8fc-43d1-a0e9-5b2c85aec9ce None None] MFA Rules not processed for user `82fb4302bcd54627a264f22ad78aa339`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:39:32.291745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bb0fe934-d8fc-43d1-a0e9-5b2c85aec9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:39:32.298098 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 747/1478] 10.222.0.13 () {58 vars in 1059 bytes} [Sat Dec 18 20:39:32 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:39:32.306246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87984b-f4bc-44e3-aa13-e712f4f66469 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:39:32.317449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87984b-f4bc-44e3-aa13-e712f4f66469 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:39:32.320919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfe0e1-5aaa-4476-858d-2d619e37c308 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:39:32.321542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfe0e1-5aaa-4476-858d-2d619e37c308 service glance] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:32.321824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfe0e1-5aaa-4476-858d-2d619e37c308 service glance] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:32.322097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfe0e1-5aaa-4476-858d-2d619e37c308 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:32.330749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfe0e1-5aaa-4476-858d-2d619e37c308 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:39:32.332194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfe0e1-5aaa-4476-858d-2d619e37c308 service glance] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:39:32.341218 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 732/1479] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:39:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:39:34.837453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0f0ab-2a40-4220-88b7-1316c2d5d10e None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:34.837910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0f0ab-2a40-4220-88b7-1316c2d5d10e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:34.838021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0f0ab-2a40-4220-88b7-1316c2d5d10e None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:34.840062 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 748/1480] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:39:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:39:34.845643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf48b7d-7698-4d4b-bf56-2d0d96660be7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:34.846038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf48b7d-7698-4d4b-bf56-2d0d96660be7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:34.846200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf48b7d-7698-4d4b-bf56-2d0d96660be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:34.864306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ecf48b7d-7698-4d4b-bf56-2d0d96660be7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:39:34.865474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ecf48b7d-7698-4d4b-bf56-2d0d96660be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:39:34.873371 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 733/1481] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:39:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:39:34.899433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0f0ab-2a40-4220-88b7-1316c2d5d10e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:39:34.912640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0f0ab-2a40-4220-88b7-1316c2d5d10e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:39:34.917104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2156aa6-93be-4bbe-a7e6-d828356c9adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:39:34.917739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156aa6-93be-4bbe-a7e6-d828356c9adb admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:34.918020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156aa6-93be-4bbe-a7e6-d828356c9adb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:34.918327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156aa6-93be-4bbe-a7e6-d828356c9adb admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:34.919065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2156aa6-93be-4bbe-a7e6-d828356c9adb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:39:34.920888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2156aa6-93be-4bbe-a7e6-d828356c9adb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:39:34.940356 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 749/1482] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Dec 18 20:39:34 2021] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:39:37.385413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e4bb5-3a2e-42a1-8ea5-5cdf2292b224 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:37.385990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e4bb5-3a2e-42a1-8ea5-5cdf2292b224 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:37.385990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e4bb5-3a2e-42a1-8ea5-5cdf2292b224 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:37.387836 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 734/1483] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:39:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:39:37.394425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b52867-2845-4d5f-a948-7574da7de948 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:37.394828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b52867-2845-4d5f-a948-7574da7de948 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:37.394986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b52867-2845-4d5f-a948-7574da7de948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:37.412442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a3b52867-2845-4d5f-a948-7574da7de948 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:39:37.413621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a3b52867-2845-4d5f-a948-7574da7de948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:39:37.421900 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 750/1484] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:39:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:39:37.469526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e4bb5-3a2e-42a1-8ea5-5cdf2292b224 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:39:37.483672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e4bb5-3a2e-42a1-8ea5-5cdf2292b224 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:39:37.488956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe66a5a-4e7c-48d2-981f-e95f7b6444fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:39:37.489603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe66a5a-4e7c-48d2-981f-e95f7b6444fc service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:37.489884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe66a5a-4e7c-48d2-981f-e95f7b6444fc service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:37.490158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe66a5a-4e7c-48d2-981f-e95f7b6444fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:37.497992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe66a5a-4e7c-48d2-981f-e95f7b6444fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:39:37.499593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe66a5a-4e7c-48d2-981f-e95f7b6444fc service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:39:37.509310 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 735/1485] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:39:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:39:40.093283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30672953-d589-477f-8983-54aa2dec94ca None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:40.093816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30672953-d589-477f-8983-54aa2dec94ca None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:40.093913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30672953-d589-477f-8983-54aa2dec94ca None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:40.095663 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 751/1486] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:39:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:39:40.102139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda15d15-32a0-4ce1-b485-6cecb032fa32 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:40.102591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda15d15-32a0-4ce1-b485-6cecb032fa32 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:40.102754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda15d15-32a0-4ce1-b485-6cecb032fa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:40.120306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bda15d15-32a0-4ce1-b485-6cecb032fa32 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:39:40.121516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bda15d15-32a0-4ce1-b485-6cecb032fa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:39:40.129198 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 736/1487] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:39:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:39:40.168223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30672953-d589-477f-8983-54aa2dec94ca None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:39:40.178615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30672953-d589-477f-8983-54aa2dec94ca None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:39:40.182011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e5602-9485-4f47-be9d-19552f468cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:39:40.182666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e5602-9485-4f47-be9d-19552f468cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:40.182950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e5602-9485-4f47-be9d-19552f468cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:40.183229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e5602-9485-4f47-be9d-19552f468cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:40.192479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e5602-9485-4f47-be9d-19552f468cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:39:40.193878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e5602-9485-4f47-be9d-19552f468cd4 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:39:40.202831 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 752/1488] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:39:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:39:42.681617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b7e3e-866e-4b09-9e4c-ecbd286c358c None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:42.682156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b7e3e-866e-4b09-9e4c-ecbd286c358c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:42.682156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b7e3e-866e-4b09-9e4c-ecbd286c358c None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:42.684073 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 737/1489] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:39:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:39:42.690136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883f0e4-a82d-4eb9-a00a-01f19dde5686 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:42.690600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883f0e4-a82d-4eb9-a00a-01f19dde5686 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:42.691044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883f0e4-a82d-4eb9-a00a-01f19dde5686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:42.708548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8883f0e4-a82d-4eb9-a00a-01f19dde5686 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:39:42.709736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8883f0e4-a82d-4eb9-a00a-01f19dde5686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:39:42.717467 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 753/1490] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:39:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:39:42.758000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b7e3e-866e-4b09-9e4c-ecbd286c358c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:39:42.768929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b7e3e-866e-4b09-9e4c-ecbd286c358c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:39:42.772427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fb712-3507-43ae-92f4-33610b26028a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:39:42.773049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fb712-3507-43ae-92f4-33610b26028a service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:42.773332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fb712-3507-43ae-92f4-33610b26028a service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:42.773610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fb712-3507-43ae-92f4-33610b26028a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:42.782246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fb712-3507-43ae-92f4-33610b26028a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:39:42.783685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fb712-3507-43ae-92f4-33610b26028a service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:39:42.793410 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 738/1491] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:39:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:39:45.406134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70043a6-faf9-4cbc-a116-3604d56a01c2 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:45.406812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70043a6-faf9-4cbc-a116-3604d56a01c2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:45.406812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70043a6-faf9-4cbc-a116-3604d56a01c2 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:45.408506 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 754/1492] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:39:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:39:45.414913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba52b51-c853-4fee-ae13-a3aa06d9788e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:45.415302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba52b51-c853-4fee-ae13-a3aa06d9788e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:45.415471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba52b51-c853-4fee-ae13-a3aa06d9788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:45.433473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1ba52b51-c853-4fee-ae13-a3aa06d9788e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:39:45.434698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1ba52b51-c853-4fee-ae13-a3aa06d9788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:39:45.442683 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 739/1493] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:39:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:39:45.485238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70043a6-faf9-4cbc-a116-3604d56a01c2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:39:45.496172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70043a6-faf9-4cbc-a116-3604d56a01c2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:39:45.499611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27496cde-a009-4ab8-b745-d12e7b5e75cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:39:45.500232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27496cde-a009-4ab8-b745-d12e7b5e75cf service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:45.500516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27496cde-a009-4ab8-b745-d12e7b5e75cf service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:45.500791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27496cde-a009-4ab8-b745-d12e7b5e75cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:45.509295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27496cde-a009-4ab8-b745-d12e7b5e75cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:39:45.510749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27496cde-a009-4ab8-b745-d12e7b5e75cf service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:39:45.519827 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 755/1494] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:39:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:39:48.126241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60008cd5-fcad-4153-8f91-21546a34fe4d None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:48.126806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60008cd5-fcad-4153-8f91-21546a34fe4d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:48.126806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60008cd5-fcad-4153-8f91-21546a34fe4d None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:48.129268 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 740/1495] 10.222.0.13 () {54 vars in 926 bytes} [Sat Dec 18 20:39:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:39:48.134987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52406475-546d-4c83-a20e-237bcf74cd65 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:48.135382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52406475-546d-4c83-a20e-237bcf74cd65 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:48.135541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52406475-546d-4c83-a20e-237bcf74cd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:48.153776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-52406475-546d-4c83-a20e-237bcf74cd65 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:39:48.154980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-52406475-546d-4c83-a20e-237bcf74cd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:39:48.162530 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 756/1496] 10.222.0.13 () {58 vars in 1023 bytes} [Sat Dec 18 20:39:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:39:48.203220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60008cd5-fcad-4153-8f91-21546a34fe4d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:39:48.213667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60008cd5-fcad-4153-8f91-21546a34fe4d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:39:48.217136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdc929-fc75-4454-8554-4ff9d7f4bb15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:39:48.217755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdc929-fc75-4454-8554-4ff9d7f4bb15 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:39:48.218040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdc929-fc75-4454-8554-4ff9d7f4bb15 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:39:48.218362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdc929-fc75-4454-8554-4ff9d7f4bb15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:39:48.229698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdc929-fc75-4454-8554-4ff9d7f4bb15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:39:48.231292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdc929-fc75-4454-8554-4ff9d7f4bb15 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:39:48.242039 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 741/1497] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:39:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:41:00.543824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbb7e0-ca4f-49e1-bcd0-5e62e758e0cd None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:41:00.544412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbb7e0-ca4f-49e1-bcd0-5e62e758e0cd None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:41:00.544412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbb7e0-ca4f-49e1-bcd0-5e62e758e0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:41:00.563399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9cfbb7e0-ca4f-49e1-bcd0-5e62e758e0cd None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:41:00.564564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9cfbb7e0-ca4f-49e1-bcd0-5e62e758e0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:41:00.572114 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 757/1498] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:41:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:41:00.580014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80986d-09ce-409d-a3eb-01ed377e02b7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:41:00.580483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80986d-09ce-409d-a3eb-01ed377e02b7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:41:00.580590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80986d-09ce-409d-a3eb-01ed377e02b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:41:00.598927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-aa80986d-09ce-409d-a3eb-01ed377e02b7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:41:00.600103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-aa80986d-09ce-409d-a3eb-01ed377e02b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:41:00.607623 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 742/1499] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:41:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:41:00.612472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbb7e0-ca4f-49e1-bcd0-5e62e758e0cd None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:41:00.621848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbb7e0-ca4f-49e1-bcd0-5e62e758e0cd None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:41:00.626920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241eab2e-0cf2-47f7-a872-866995aa0486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:41:00.627556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eab2e-0cf2-47f7-a872-866995aa0486 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:41:00.627839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eab2e-0cf2-47f7-a872-866995aa0486 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:41:00.628110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eab2e-0cf2-47f7-a872-866995aa0486 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:41:00.628830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241eab2e-0cf2-47f7-a872-866995aa0486 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:41:00.629133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241eab2e-0cf2-47f7-a872-866995aa0486 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:41:00.630734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241eab2e-0cf2-47f7-a872-866995aa0486 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:41:00.641593 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 758/1500] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:41:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:41:00.649289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80986d-09ce-409d-a3eb-01ed377e02b7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:41:00.657910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80986d-09ce-409d-a3eb-01ed377e02b7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:41:00.662421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d4293-974f-4638-a4a9-46d26b7e163c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:41:00.663050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4293-974f-4638-a4a9-46d26b7e163c admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:41:00.663325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4293-974f-4638-a4a9-46d26b7e163c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:41:00.663595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4293-974f-4638-a4a9-46d26b7e163c admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:41:00.664289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d4293-974f-4638-a4a9-46d26b7e163c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:41:00.666148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d4293-974f-4638-a4a9-46d26b7e163c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:41:00.700548 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 743/1501] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:41:00 2021] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:41:00.704523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241eab2e-0cf2-47f7-a872-866995aa0486 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:41:00.713976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241eab2e-0cf2-47f7-a872-866995aa0486 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:41:00.767463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c997b0-bceb-4171-b40d-87e3b910c5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:41:00.768120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c997b0-bceb-4171-b40d-87e3b910c5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:41:00.768402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c997b0-bceb-4171-b40d-87e3b910c5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:41:00.768678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c997b0-bceb-4171-b40d-87e3b910c5b0 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:41:00.769377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c997b0-bceb-4171-b40d-87e3b910c5b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:41:00.771295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c997b0-bceb-4171-b40d-87e3b910c5b0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:41:00.791256 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 759/1502] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:41:00 2021] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:41:00.795639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d4293-974f-4638-a4a9-46d26b7e163c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:41:00.807211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d4293-974f-4638-a4a9-46d26b7e163c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:41:00.811662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6ddb7-40bc-4953-9a5e-b90bd700d4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:41:00.812309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6ddb7-40bc-4953-9a5e-b90bd700d4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:41:00.812615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6ddb7-40bc-4953-9a5e-b90bd700d4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:41:00.813161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6ddb7-40bc-4953-9a5e-b90bd700d4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:41:00.813882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6ddb7-40bc-4953-9a5e-b90bd700d4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:41:00.815509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6ddb7-40bc-4953-9a5e-b90bd700d4c7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:41:00.828791 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 744/1503] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:41:00 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:41:00.832697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c997b0-bceb-4171-b40d-87e3b910c5b0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:41:00.842241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c997b0-bceb-4171-b40d-87e3b910c5b0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:41:00.847202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e87d3-bf7e-45ef-bc00-e7acfffacfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:41:00.847845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e87d3-bf7e-45ef-bc00-e7acfffacfa3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:41:00.848128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e87d3-bf7e-45ef-bc00-e7acfffacfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:41:00.848402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e87d3-bf7e-45ef-bc00-e7acfffacfa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:41:00.849201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e87d3-bf7e-45ef-bc00-e7acfffacfa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:41:00.850755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e87d3-bf7e-45ef-bc00-e7acfffacfa3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:41:00.864156 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 760/1504] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:41:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:41:00.868224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6ddb7-40bc-4953-9a5e-b90bd700d4c7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:41:00.877938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6ddb7-40bc-4953-9a5e-b90bd700d4c7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:41:00.882666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6789783-850c-48cf-85fa-86304e92cf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:41:00.883574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6789783-850c-48cf-85fa-86304e92cf08 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:41:00.883858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6789783-850c-48cf-85fa-86304e92cf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:41:00.884138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6789783-850c-48cf-85fa-86304e92cf08 admin admin] PATH_INFO: `/v3/projects/b1777210639d4a3c9bbbbd10bfc42e54/users/f1a2979c8d0d48c888b5cd336088be14/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:41:00.898175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6789783-850c-48cf-85fa-86304e92cf08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1777210639d4a3c9bbbbd10bfc42e54, user_id=f1a2979c8d0d48c888b5cd336088be14, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:41:00.900839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6789783-850c-48cf-85fa-86304e92cf08 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:41:00.913983 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 745/1505] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:41:00 2021] PUT /identity/v3/projects/b1777210639d4a3c9bbbbd10bfc42e54/users/f1a2979c8d0d48c888b5cd336088be14/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:41:00.926072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9d075-c910-4880-947f-fceb02bbbc69 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:41:00.926402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9d075-c910-4880-947f-fceb02bbbc69 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:41:00.926678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9d075-c910-4880-947f-fceb02bbbc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:41:00.951672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-dfd9d075-c910-4880-947f-fceb02bbbc69 None None] MFA Rules not processed for user `f1a2979c8d0d48c888b5cd336088be14`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:41:00.952843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-dfd9d075-c910-4880-947f-fceb02bbbc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:41:01.013415 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 761/1506] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:41:00 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:41:01.025971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6789783-850c-48cf-85fa-86304e92cf08 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:41:01.095077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6789783-850c-48cf-85fa-86304e92cf08 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:41:01.100558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca117fe-e93d-46a4-b97a-cbc702ed02bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:41:01.101137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca117fe-e93d-46a4-b97a-cbc702ed02bf service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:41:01.101419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca117fe-e93d-46a4-b97a-cbc702ed02bf service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:41:01.101704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca117fe-e93d-46a4-b97a-cbc702ed02bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:41:01.109215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca117fe-e93d-46a4-b97a-cbc702ed02bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:41:01.111356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca117fe-e93d-46a4-b97a-cbc702ed02bf service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:41:01.119856 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 746/1507] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:41:01 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:41:01.186672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6664591-619f-46cf-afe6-8aa2068c5ebe None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:41:01.186978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6664591-619f-46cf-afe6-8aa2068c5ebe None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:41:01.187243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6664591-619f-46cf-afe6-8aa2068c5ebe None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:41:01.189557 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 762/1508] 10.222.0.13 () {52 vars in 829 bytes} [Sat Dec 18 20:41:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:41:01.193106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca117fe-e93d-46a4-b97a-cbc702ed02bf service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:41:01.251539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca117fe-e93d-46a4-b97a-cbc702ed02bf service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:41:01.255949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d2c71-959f-41f5-ba25-cf61ae3fccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:41:01.256796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d2c71-959f-41f5-ba25-cf61ae3fccfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:41:01.257072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d2c71-959f-41f5-ba25-cf61ae3fccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:41:01.257341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d2c71-959f-41f5-ba25-cf61ae3fccfa admin admin] PATH_INFO: `/v3/users/f1a2979c8d0d48c888b5cd336088be14` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:41:01.258538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d2c71-959f-41f5-ba25-cf61ae3fccfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1a2979c8d0d48c888b5cd336088be14)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:41:01.259545 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-ab2d2c71-959f-41f5-ba25-cf61ae3fccfa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:41:01.259545 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:41:01.259545 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:41:01.260718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d2c71-959f-41f5-ba25-cf61ae3fccfa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:41:01.321788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ab2d2c71-959f-41f5-ba25-cf61ae3fccfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1a2979c8d0d48c888b5cd336088be14'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:41:01.333777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ab2d2c71-959f-41f5-ba25-cf61ae3fccfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1a2979c8d0d48c888b5cd336088be14'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:41:01.334571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ab2d2c71-959f-41f5-ba25-cf61ae3fccfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1a2979c8d0d48c888b5cd336088be14'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:41:01.353357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ab2d2c71-959f-41f5-ba25-cf61ae3fccfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1a2979c8d0d48c888b5cd336088be14'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:41:01.362911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ab2d2c71-959f-41f5-ba25-cf61ae3fccfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1a2979c8d0d48c888b5cd336088be14'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:41:01.369056 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 747/1509] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:41:01 2021] DELETE /identity/v3/users/f1a2979c8d0d48c888b5cd336088be14 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:41:01.373627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39280-cdc6-479b-b110-ae9a850249f3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:41:01.373964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39280-cdc6-479b-b110-ae9a850249f3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:41:01.374272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39280-cdc6-479b-b110-ae9a850249f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:41:01.392232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-25a39280-cdc6-479b-b110-ae9a850249f3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:41:01.393496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-25a39280-cdc6-479b-b110-ae9a850249f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:41:01.448502 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 763/1510] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:41:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:41:01.459200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d2c71-959f-41f5-ba25-cf61ae3fccfa admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:41:01.460579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ab2d2c71-959f-41f5-ba25-cf61ae3fccfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:41:01.515390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d2c71-959f-41f5-ba25-cf61ae3fccfa admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:41:01.518992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187ece9-7a23-49e0-b566-57f878f8d585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:41:01.519623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187ece9-7a23-49e0-b566-57f878f8d585 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:41:01.519904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187ece9-7a23-49e0-b566-57f878f8d585 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:41:01.520181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187ece9-7a23-49e0-b566-57f878f8d585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:41:01.528667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187ece9-7a23-49e0-b566-57f878f8d585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:41:01.530079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187ece9-7a23-49e0-b566-57f878f8d585 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:41:01.539669 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 748/1511] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:41:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:41:01.850934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a39280-cdc6-479b-b110-ae9a850249f3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:41:01.852364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-25a39280-cdc6-479b-b110-ae9a850249f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:41:01.864022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a39280-cdc6-479b-b110-ae9a850249f3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:41:01.868546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a438f-aa64-45f0-af5f-bbf80c33999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:41:01.869404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a438f-aa64-45f0-af5f-bbf80c33999c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:41:01.869699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a438f-aa64-45f0-af5f-bbf80c33999c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:41:01.869975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a438f-aa64-45f0-af5f-bbf80c33999c admin admin] PATH_INFO: `/v3/projects/b1777210639d4a3c9bbbbd10bfc42e54` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:41:01.871204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a438f-aa64-45f0-af5f-bbf80c33999c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1777210639d4a3c9bbbbd10bfc42e54)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:41:01.872243 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-986a438f-aa64-45f0-af5f-bbf80c33999c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:41:01.872243 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:41:01.872243 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:41:01.873423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a438f-aa64-45f0-af5f-bbf80c33999c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:41:01.931644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-986a438f-aa64-45f0-af5f-bbf80c33999c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1777210639d4a3c9bbbbd10bfc42e54', 'request_id': 'req-986a438f-aa64-45f0-af5f-bbf80c33999c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:41:01.945809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-986a438f-aa64-45f0-af5f-bbf80c33999c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1777210639d4a3c9bbbbd10bfc42e54', 'request_id': 'req-986a438f-aa64-45f0-af5f-bbf80c33999c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:41:01.951597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-986a438f-aa64-45f0-af5f-bbf80c33999c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1777210639d4a3c9bbbbd10bfc42e54', 'request_id': 'req-986a438f-aa64-45f0-af5f-bbf80c33999c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:41:01.965514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-986a438f-aa64-45f0-af5f-bbf80c33999c admin admin] The token cache is being invalidate because project b1777210639d4a3c9bbbbd10bfc42e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:41:01.965846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-986a438f-aa64-45f0-af5f-bbf80c33999c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:41:01.966463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-986a438f-aa64-45f0-af5f-bbf80c33999c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:41:01.968093 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 764/1512] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:41:01 2021] DELETE /identity/v3/projects/b1777210639d4a3c9bbbbd10bfc42e54 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:44:14.769458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cbe79-5d09-48f7-986a-aceaa999cdb3 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:44:14.770021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cbe79-5d09-48f7-986a-aceaa999cdb3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:44:14.770021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cbe79-5d09-48f7-986a-aceaa999cdb3 None None] PATH_INFO: `/v3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:44:14.771383 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 749/1513] 10.222.0.31 () {54 vars in 925 bytes} [Sat Dec 18 20:44:14 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:44:14.778779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c8012-5b03-4644-aec0-14920c771fcf None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:44:14.779208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c8012-5b03-4644-aec0-14920c771fcf None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:44:14.779320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c8012-5b03-4644-aec0-14920c771fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:44:14.799113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-bf4c8012-5b03-4644-aec0-14920c771fcf None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:44:14.800305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bf4c8012-5b03-4644-aec0-14920c771fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:44:14.860026 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 765/1514] 10.222.0.31 () {58 vars in 1015 bytes} [Sat Dec 18 20:44:14 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:44:18.683520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496544-ec42-4cd9-a776-4cb8b55c0ab1 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:44:18.683944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496544-ec42-4cd9-a776-4cb8b55c0ab1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:44:18.684078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496544-ec42-4cd9-a776-4cb8b55c0ab1 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:44:18.685771 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 750/1515] 10.222.0.13 () {54 vars in 960 bytes} [Sat Dec 18 20:44:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:44:18.692201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5077d-b20a-45c4-93ec-768140e4d3bf None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:44:18.692640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5077d-b20a-45c4-93ec-768140e4d3bf None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:44:18.692765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5077d-b20a-45c4-93ec-768140e4d3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:44:18.713551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1fa5077d-b20a-45c4-93ec-768140e4d3bf None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:44:18.714777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1fa5077d-b20a-45c4-93ec-768140e4d3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:44:18.724310 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 766/1516] 10.222.0.13 () {58 vars in 1057 bytes} [Sat Dec 18 20:44:18 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:44:18.732002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00496544-ec42-4cd9-a776-4cb8b55c0ab1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:44:18.747148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00496544-ec42-4cd9-a776-4cb8b55c0ab1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:44:18.752102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88acc8-0c08-4493-aa96-2750f688a1b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:44:18.752734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88acc8-0c08-4493-aa96-2750f688a1b3 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:44:18.753018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88acc8-0c08-4493-aa96-2750f688a1b3 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:44:18.753297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88acc8-0c08-4493-aa96-2750f688a1b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:44:18.761768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88acc8-0c08-4493-aa96-2750f688a1b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:44:18.763410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88acc8-0c08-4493-aa96-2750f688a1b3 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:44:18.772813 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 751/1517] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:44:18 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:44:19.886945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea44290-8201-48fe-aaf4-80f4d59c669c None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:44:19.887509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea44290-8201-48fe-aaf4-80f4d59c669c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:44:19.887509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea44290-8201-48fe-aaf4-80f4d59c669c None None] PATH_INFO: `/v3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:44:19.888824 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 767/1518] 10.222.0.36 () {54 vars in 925 bytes} [Sat Dec 18 20:44:19 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:44:19.917804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c766a-dc55-446b-9480-09e042948abe None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:44:19.918236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c766a-dc55-446b-9480-09e042948abe None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:44:19.918422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c766a-dc55-446b-9480-09e042948abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:44:19.939573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a71c766a-dc55-446b-9480-09e042948abe None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:44:19.940766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a71c766a-dc55-446b-9480-09e042948abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:44:19.949304 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 752/1519] 10.222.0.36 () {58 vars in 1015 bytes} [Sat Dec 18 20:44:19 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:44:24.018004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea44290-8201-48fe-aaf4-80f4d59c669c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:44:24.031153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea44290-8201-48fe-aaf4-80f4d59c669c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:44:24.036057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091002ca-7766-4305-b047-5d8c685a586e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:44:24.036684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091002ca-7766-4305-b047-5d8c685a586e service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:44:24.036962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091002ca-7766-4305-b047-5d8c685a586e service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:44:24.037232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091002ca-7766-4305-b047-5d8c685a586e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:44:24.045594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091002ca-7766-4305-b047-5d8c685a586e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:44:24.047204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091002ca-7766-4305-b047-5d8c685a586e service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:44:24.063889 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 768/1520] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:44:24 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:45:00.222970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21984ea-d2ad-4afc-b280-e539f674dfd7 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:45:00.223563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21984ea-d2ad-4afc-b280-e539f674dfd7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:45:00.223563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21984ea-d2ad-4afc-b280-e539f674dfd7 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:45:00.225289 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 753/1521] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 18 20:45:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:45:00.230865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d129641-507d-4789-ac9c-355b95e8b473 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:45:00.231314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d129641-507d-4789-ac9c-355b95e8b473 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:45:00.231557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d129641-507d-4789-ac9c-355b95e8b473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:45:00.249535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9d129641-507d-4789-ac9c-355b95e8b473 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:45:00.250744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9d129641-507d-4789-ac9c-355b95e8b473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:45:00.306884 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 769/1522] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 18 20:45:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:45:00.468806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21984ea-d2ad-4afc-b280-e539f674dfd7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:45:00.470501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a21984ea-d2ad-4afc-b280-e539f674dfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:45:00.540331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21984ea-d2ad-4afc-b280-e539f674dfd7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:45:00.545513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd32bd9-6436-4630-9c92-8587f29f71c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:45:00.546143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd32bd9-6436-4630-9c92-8587f29f71c5 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:45:00.546471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd32bd9-6436-4630-9c92-8587f29f71c5 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:45:00.546753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd32bd9-6436-4630-9c92-8587f29f71c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:45:00.554526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd32bd9-6436-4630-9c92-8587f29f71c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:45:00.556101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd32bd9-6436-4630-9c92-8587f29f71c5 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:45:00.565808 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 754/1523] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:45:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:45:02.108780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3b68a-c996-4c63-812a-942d4df9d860 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:45:02.109321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3b68a-c996-4c63-812a-942d4df9d860 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:45:02.109321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3b68a-c996-4c63-812a-942d4df9d860 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:45:02.111343 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 770/1524] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 18 20:45:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:45:02.116717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c40032-a1e9-4a38-ad27-e476753c3304 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:45:02.117180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c40032-a1e9-4a38-ad27-e476753c3304 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:45:02.117270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c40032-a1e9-4a38-ad27-e476753c3304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:45:02.135029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-67c40032-a1e9-4a38-ad27-e476753c3304 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:45:02.136248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-67c40032-a1e9-4a38-ad27-e476753c3304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:45:02.143981 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 755/1525] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 18 20:45:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:45:02.302670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3b68a-c996-4c63-812a-942d4df9d860 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:45:02.316891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3b68a-c996-4c63-812a-942d4df9d860 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:45:02.322147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6239a-e871-469e-99a8-7a49acbf9d87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:45:02.322803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6239a-e871-469e-99a8-7a49acbf9d87 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:45:02.323083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6239a-e871-469e-99a8-7a49acbf9d87 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:45:02.323854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6239a-e871-469e-99a8-7a49acbf9d87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:45:02.331666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6239a-e871-469e-99a8-7a49acbf9d87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:45:02.333241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6239a-e871-469e-99a8-7a49acbf9d87 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:45:02.343085 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 771/1526] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:45:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:45:06.929304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3e6aa-04ef-474a-84a7-79e377730fd7 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:45:06.929855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3e6aa-04ef-474a-84a7-79e377730fd7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:45:06.930118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3e6aa-04ef-474a-84a7-79e377730fd7 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:45:06.933415 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 756/1527] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 18 20:45:06 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:45:06.939320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887882e-0196-4550-a489-44d5202462f7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:45:06.939834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887882e-0196-4550-a489-44d5202462f7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:45:06.939939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887882e-0196-4550-a489-44d5202462f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:45:06.957278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c887882e-0196-4550-a489-44d5202462f7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:45:06.958487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c887882e-0196-4550-a489-44d5202462f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:45:06.966094 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 772/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 18 20:45:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:45:07.004627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3e6aa-04ef-474a-84a7-79e377730fd7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:45:07.006444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-28f3e6aa-04ef-474a-84a7-79e377730fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:45:07.061650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3e6aa-04ef-474a-84a7-79e377730fd7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:45:07.065432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef1803-9c96-4c14-bd79-c325266344f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:45:07.066076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1803-9c96-4c14-bd79-c325266344f6 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:45:07.066394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1803-9c96-4c14-bd79-c325266344f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:45:07.066678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1803-9c96-4c14-bd79-c325266344f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:45:07.075448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef1803-9c96-4c14-bd79-c325266344f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:45:07.076870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef1803-9c96-4c14-bd79-c325266344f6 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:45:07.086067 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 757/1529] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:45:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:45:09.512987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c71e-7b29-41f6-b5bf-3eccc940a54c None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:45:09.513577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c71e-7b29-41f6-b5bf-3eccc940a54c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:45:09.513577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c71e-7b29-41f6-b5bf-3eccc940a54c None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:45:09.515354 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 773/1530] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 18 20:45:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:45:09.521081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc41bad-6b0d-43b7-a12e-d19e81ecb5a2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:45:09.521535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc41bad-6b0d-43b7-a12e-d19e81ecb5a2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:45:09.521644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc41bad-6b0d-43b7-a12e-d19e81ecb5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:45:09.539919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1fc41bad-6b0d-43b7-a12e-d19e81ecb5a2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:45:09.541086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1fc41bad-6b0d-43b7-a12e-d19e81ecb5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:45:09.549354 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 758/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 18 20:45:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:45:09.587305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986c71e-7b29-41f6-b5bf-3eccc940a54c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:45:09.598287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986c71e-7b29-41f6-b5bf-3eccc940a54c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:45:09.601702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d457280-37e2-4945-89bd-da06841b77b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:45:09.602370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d457280-37e2-4945-89bd-da06841b77b2 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:45:09.602657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d457280-37e2-4945-89bd-da06841b77b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:45:09.602935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d457280-37e2-4945-89bd-da06841b77b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:45:09.612474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d457280-37e2-4945-89bd-da06841b77b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:45:09.613880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d457280-37e2-4945-89bd-da06841b77b2 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:45:09.623423 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 774/1532] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:45:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:02.364472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f85ad-19de-4732-9ebb-0bfb544644f0 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:02.365056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f85ad-19de-4732-9ebb-0bfb544644f0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:02.365056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f85ad-19de-4732-9ebb-0bfb544644f0 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:02.367004 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 759/1533] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:46:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:46:02.372412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c787a9-5be4-4622-9dbf-eab6c12cfb2c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:02.372836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c787a9-5be4-4622-9dbf-eab6c12cfb2c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:02.373087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c787a9-5be4-4622-9dbf-eab6c12cfb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:02.391393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-40c787a9-5be4-4622-9dbf-eab6c12cfb2c None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:02.392675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-40c787a9-5be4-4622-9dbf-eab6c12cfb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:02.403913 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 775/1534] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:46:02 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:32.017509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc37d66-b7dc-4e7a-a758-f037847befa0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.018105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc37d66-b7dc-4e7a-a758-f037847befa0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.018105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc37d66-b7dc-4e7a-a758-f037847befa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.042443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8fc37d66-b7dc-4e7a-a758-f037847befa0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:32.050054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8fc37d66-b7dc-4e7a-a758-f037847befa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:32.059262 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 760/1535] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:46:32.067958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031b94f-8cee-47fc-9c39-1106dcc5bf46 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.068514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031b94f-8cee-47fc-9c39-1106dcc5bf46 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.068514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031b94f-8cee-47fc-9c39-1106dcc5bf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.103395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5031b94f-8cee-47fc-9c39-1106dcc5bf46 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:32.104614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5031b94f-8cee-47fc-9c39-1106dcc5bf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:32.113580 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 776/1536] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:32.118283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc37d66-b7dc-4e7a-a758-f037847befa0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:32.134108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc37d66-b7dc-4e7a-a758-f037847befa0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:32.148007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e40a8-8884-46e1-af2b-836329d0fcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:32.148692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e40a8-8884-46e1-af2b-836329d0fcb0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.149090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e40a8-8884-46e1-af2b-836329d0fcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.149386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e40a8-8884-46e1-af2b-836329d0fcb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.150173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e40a8-8884-46e1-af2b-836329d0fcb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:46:32.150511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e40a8-8884-46e1-af2b-836329d0fcb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:32.152487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e40a8-8884-46e1-af2b-836329d0fcb0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:32.173204 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 761/1537] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:46:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:46:32.182382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031b94f-8cee-47fc-9c39-1106dcc5bf46 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:32.192794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031b94f-8cee-47fc-9c39-1106dcc5bf46 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:32.202244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff31a9-69b6-488a-9898-8405ba4e52a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:32.202940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff31a9-69b6-488a-9898-8405ba4e52a9 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.203228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff31a9-69b6-488a-9898-8405ba4e52a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.203509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff31a9-69b6-488a-9898-8405ba4e52a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.204225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff31a9-69b6-488a-9898-8405ba4e52a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:32.206146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff31a9-69b6-488a-9898-8405ba4e52a9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:32.250537 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 777/1538] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/projects => generated 397 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:32.254834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e40a8-8884-46e1-af2b-836329d0fcb0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:32.268551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e40a8-8884-46e1-af2b-836329d0fcb0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:32.268757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc94a16-06f8-4726-b6ca-08633cd4fa19 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.268994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc94a16-06f8-4726-b6ca-08633cd4fa19 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.269377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc94a16-06f8-4726-b6ca-08633cd4fa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.308193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5cc94a16-06f8-4726-b6ca-08633cd4fa19 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:32.311068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5cc94a16-06f8-4726-b6ca-08633cd4fa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:32.378074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251ccee-b0ea-4fb3-8a99-a7a3ec1dbb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:32.378794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251ccee-b0ea-4fb3-8a99-a7a3ec1dbb0a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.379086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251ccee-b0ea-4fb3-8a99-a7a3ec1dbb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.379371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251ccee-b0ea-4fb3-8a99-a7a3ec1dbb0a admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.380095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251ccee-b0ea-4fb3-8a99-a7a3ec1dbb0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:32.382285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251ccee-b0ea-4fb3-8a99-a7a3ec1dbb0a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:32.407829 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 762/1539] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:32.409411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab015a87-6103-405d-96c8-ea42c3f36a72 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.409710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab015a87-6103-405d-96c8-ea42c3f36a72 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.409995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab015a87-6103-405d-96c8-ea42c3f36a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.426963 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 778/1540] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:32.428313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc73f7f-1508-429b-9d1e-2e20d63bdc66 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.428950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc73f7f-1508-429b-9d1e-2e20d63bdc66 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.429692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc73f7f-1508-429b-9d1e-2e20d63bdc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.436468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ab015a87-6103-405d-96c8-ea42c3f36a72 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:32.437978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ab015a87-6103-405d-96c8-ea42c3f36a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:32.456213 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 763/1541] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:32.457704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f9985-6d02-4db8-ad37-5d22847a2420 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.457995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f9985-6d02-4db8-ad37-5d22847a2420 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.458296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f9985-6d02-4db8-ad37-5d22847a2420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.458522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6dc73f7f-1508-429b-9d1e-2e20d63bdc66 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:32.459745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6dc73f7f-1508-429b-9d1e-2e20d63bdc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:32.469586 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 779/1542] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:32.470959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e7adf-ac2d-478d-bde2-a04d49f4dd34 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.471255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e7adf-ac2d-478d-bde2-a04d49f4dd34 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.471538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e7adf-ac2d-478d-bde2-a04d49f4dd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.481630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-976f9985-6d02-4db8-ad37-5d22847a2420 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:32.482916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-976f9985-6d02-4db8-ad37-5d22847a2420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:32.492546 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 764/1543] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:32.493336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f9985-6d02-4db8-ad37-5d22847a2420 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:32.501959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-288e7adf-ac2d-478d-bde2-a04d49f4dd34 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:32.503039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f9985-6d02-4db8-ad37-5d22847a2420 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:32.503184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-288e7adf-ac2d-478d-bde2-a04d49f4dd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:32.508404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae219f70-d647-4fe0-b167-b363de966939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:32.509143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae219f70-d647-4fe0-b167-b363de966939 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.510175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae219f70-d647-4fe0-b167-b363de966939 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.510487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae219f70-d647-4fe0-b167-b363de966939 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.511224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae219f70-d647-4fe0-b167-b363de966939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:32.511952 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 780/1544] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:32.512843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae219f70-d647-4fe0-b167-b363de966939 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:32.513233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcee65-2173-486d-905d-3967bd81709f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.513529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcee65-2173-486d-905d-3967bd81709f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.513809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcee65-2173-486d-905d-3967bd81709f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.524246 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 765/1545] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:32 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:32.525773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ac3ca-3b90-4673-9ed2-4d7571b803f2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.526079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ac3ca-3b90-4673-9ed2-4d7571b803f2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.526371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ac3ca-3b90-4673-9ed2-4d7571b803f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.540539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e2dcee65-2173-486d-905d-3967bd81709f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:32.542019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e2dcee65-2173-486d-905d-3967bd81709f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:32.545139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-759ac3ca-3b90-4673-9ed2-4d7571b803f2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:32.546285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-759ac3ca-3b90-4673-9ed2-4d7571b803f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:32.550901 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 781/1546] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:32.552133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becfdf5-4ffd-44f3-9b03-21b4741b9df7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.552421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becfdf5-4ffd-44f3-9b03-21b4741b9df7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.552701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becfdf5-4ffd-44f3-9b03-21b4741b9df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.558885 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 766/1547] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:32.560594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a9625-b62d-45fa-897d-44d6f4a173da None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.561062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a9625-b62d-45fa-897d-44d6f4a173da None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.561346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a9625-b62d-45fa-897d-44d6f4a173da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.579293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7becfdf5-4ffd-44f3-9b03-21b4741b9df7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:32.580489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7becfdf5-4ffd-44f3-9b03-21b4741b9df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:32.582421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2c8a9625-b62d-45fa-897d-44d6f4a173da None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:32.583599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2c8a9625-b62d-45fa-897d-44d6f4a173da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:32.589314 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 782/1548] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:32.590827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc9dd6-a014-4384-80cd-e16bc651b8d8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.591114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc9dd6-a014-4384-80cd-e16bc651b8d8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.591395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc9dd6-a014-4384-80cd-e16bc651b8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.595093 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 767/1549] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:32.596402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab6300-c272-4941-a229-9f2fb2b3f9af None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.596689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab6300-c272-4941-a229-9f2fb2b3f9af None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.597025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab6300-c272-4941-a229-9f2fb2b3f9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.609715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f9dc9dd6-a014-4384-80cd-e16bc651b8d8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:32.611051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f9dc9dd6-a014-4384-80cd-e16bc651b8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:32.614996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-cdab6300-c272-4941-a229-9f2fb2b3f9af None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:32.616163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cdab6300-c272-4941-a229-9f2fb2b3f9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:32.619621 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 783/1550] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:32.621049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f59298-e5cc-455b-8217-4e530fdc7745 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.621360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f59298-e5cc-455b-8217-4e530fdc7745 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.621645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f59298-e5cc-455b-8217-4e530fdc7745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.625253 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 768/1551] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:32.626030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab6300-c272-4941-a229-9f2fb2b3f9af None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:32.635797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab6300-c272-4941-a229-9f2fb2b3f9af None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:32.639908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d8f59298-e5cc-455b-8217-4e530fdc7745 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:32.640359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f78429-af9c-42b3-9299-b57ebaba347a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:32.641003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f78429-af9c-42b3-9299-b57ebaba347a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.641118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d8f59298-e5cc-455b-8217-4e530fdc7745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:32.641289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f78429-af9c-42b3-9299-b57ebaba347a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.641570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f78429-af9c-42b3-9299-b57ebaba347a admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.642336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f78429-af9c-42b3-9299-b57ebaba347a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:32.643923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f78429-af9c-42b3-9299-b57ebaba347a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:32.648894 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 784/1552] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:32.649662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f59298-e5cc-455b-8217-4e530fdc7745 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:32.654633 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 769/1553] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:32 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:32.655749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c625db6-e0c4-464f-a797-99d1bc4709f8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.656037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c625db6-e0c4-464f-a797-99d1bc4709f8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.656322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c625db6-e0c4-464f-a797-99d1bc4709f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.662243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f59298-e5cc-455b-8217-4e530fdc7745 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:32.667087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b8f73-2da4-4f91-8d43-ead4bf9df2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:32.667844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b8f73-2da4-4f91-8d43-ead4bf9df2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.668135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b8f73-2da4-4f91-8d43-ead4bf9df2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.668417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b8f73-2da4-4f91-8d43-ead4bf9df2c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.669143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b8f73-2da4-4f91-8d43-ead4bf9df2c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:46:32.669564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b8f73-2da4-4f91-8d43-ead4bf9df2c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:32.671282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b8f73-2da4-4f91-8d43-ead4bf9df2c3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:32.674613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2c625db6-e0c4-464f-a797-99d1bc4709f8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:32.675812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2c625db6-e0c4-464f-a797-99d1bc4709f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:32.683226 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 785/1554] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:46:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:46:32.684081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b8f73-2da4-4f91-8d43-ead4bf9df2c3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:32.684513 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 770/1555] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:32.685743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa132f4-afaa-43e8-8a5f-e32e764adb07 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.686032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa132f4-afaa-43e8-8a5f-e32e764adb07 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.687211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa132f4-afaa-43e8-8a5f-e32e764adb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.697781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b8f73-2da4-4f91-8d43-ead4bf9df2c3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:32.702430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911347bb-3759-4876-8150-a8a1afbe7e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:32.703074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911347bb-3759-4876-8150-a8a1afbe7e59 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.703361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911347bb-3759-4876-8150-a8a1afbe7e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.703637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911347bb-3759-4876-8150-a8a1afbe7e59 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.704364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911347bb-3759-4876-8150-a8a1afbe7e59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:46:32.704671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911347bb-3759-4876-8150-a8a1afbe7e59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:32.704921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6fa132f4-afaa-43e8-8a5f-e32e764adb07 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:32.706111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6fa132f4-afaa-43e8-8a5f-e32e764adb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:32.706362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911347bb-3759-4876-8150-a8a1afbe7e59 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:32.714793 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 771/1556] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:32.718904 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 786/1557] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:46:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:46:32.719144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa132f4-afaa-43e8-8a5f-e32e764adb07 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:32.719989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911347bb-3759-4876-8150-a8a1afbe7e59 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:32.730310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa132f4-afaa-43e8-8a5f-e32e764adb07 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:32.730736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911347bb-3759-4876-8150-a8a1afbe7e59 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:32.735071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdb26d-ea29-48f8-98e9-b9d5c1a4dbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:32.735733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdb26d-ea29-48f8-98e9-b9d5c1a4dbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.736010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdb26d-ea29-48f8-98e9-b9d5c1a4dbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.736123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10449925-045b-4da8-8c6d-c47e839095be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:32.736307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdb26d-ea29-48f8-98e9-b9d5c1a4dbc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.736722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449925-045b-4da8-8c6d-c47e839095be admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.737011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449925-045b-4da8-8c6d-c47e839095be admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.737125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdb26d-ea29-48f8-98e9-b9d5c1a4dbc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:46:32.737302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449925-045b-4da8-8c6d-c47e839095be admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.737400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdb26d-ea29-48f8-98e9-b9d5c1a4dbc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:32.738023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10449925-045b-4da8-8c6d-c47e839095be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:46:32.738379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10449925-045b-4da8-8c6d-c47e839095be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:32.738934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdb26d-ea29-48f8-98e9-b9d5c1a4dbc3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:32.739955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10449925-045b-4da8-8c6d-c47e839095be admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:32.758023 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 772/1558] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:46:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:46:32.758339 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 787/1559] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:46:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:46:32.758479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdb26d-ea29-48f8-98e9-b9d5c1a4dbc3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:32.758580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10449925-045b-4da8-8c6d-c47e839095be admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:32.763647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10449925-045b-4da8-8c6d-c47e839095be admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:32.768068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdb26d-ea29-48f8-98e9-b9d5c1a4dbc3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:32.768208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae970525-9d0b-4bdd-8a9f-310bfeaa0d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:32.769043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae970525-9d0b-4bdd-8a9f-310bfeaa0d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.769331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae970525-9d0b-4bdd-8a9f-310bfeaa0d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.769611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae970525-9d0b-4bdd-8a9f-310bfeaa0d7c admin admin] PATH_INFO: `/v3/projects/f38480e435834a8cb37eacd183315171/users/9a188df8ed504951b850b40842ffbe73/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.772639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2ecd9-a87f-4d8c-8538-de8698ad3d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:32.773292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2ecd9-a87f-4d8c-8538-de8698ad3d6d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.773558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2ecd9-a87f-4d8c-8538-de8698ad3d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.773861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2ecd9-a87f-4d8c-8538-de8698ad3d6d admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.774669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2ecd9-a87f-4d8c-8538-de8698ad3d6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:46:32.775441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2ecd9-a87f-4d8c-8538-de8698ad3d6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:32.777013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2ecd9-a87f-4d8c-8538-de8698ad3d6d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:32.784605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae970525-9d0b-4bdd-8a9f-310bfeaa0d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38480e435834a8cb37eacd183315171, user_id=9a188df8ed504951b850b40842ffbe73, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:32.787272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae970525-9d0b-4bdd-8a9f-310bfeaa0d7c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:32.789217 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 773/1560] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:46:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:46:32.790142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2ecd9-a87f-4d8c-8538-de8698ad3d6d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:32.800053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2ecd9-a87f-4d8c-8538-de8698ad3d6d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:32.805083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ee75a-3fea-465a-a405-0239e07b3813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:32.805724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ee75a-3fea-465a-a405-0239e07b3813 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.806009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ee75a-3fea-465a-a405-0239e07b3813 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.806488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ee75a-3fea-465a-a405-0239e07b3813 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.807273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ee75a-3fea-465a-a405-0239e07b3813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:46:32.807608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ee75a-3fea-465a-a405-0239e07b3813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:32.819517 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 788/1561] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:32 2021] PUT /identity/v3/projects/f38480e435834a8cb37eacd183315171/users/9a188df8ed504951b850b40842ffbe73/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:32.819517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae970525-9d0b-4bdd-8a9f-310bfeaa0d7c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:32.819766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ee75a-3fea-465a-a405-0239e07b3813 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:32.821362 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 774/1562] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:46:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:46:32.822176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ee75a-3fea-465a-a405-0239e07b3813 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:32.837111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ee75a-3fea-465a-a405-0239e07b3813 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:32.876837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae970525-9d0b-4bdd-8a9f-310bfeaa0d7c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:32.881803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7d355-f5b8-4181-aa09-18481e58b529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:32.882598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7d355-f5b8-4181-aa09-18481e58b529 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.882868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7d355-f5b8-4181-aa09-18481e58b529 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.883142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7d355-f5b8-4181-aa09-18481e58b529 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.883842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7d355-f5b8-4181-aa09-18481e58b529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:32.885764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7d355-f5b8-4181-aa09-18481e58b529 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:32.892158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90424018-c4a2-4079-b0ae-9b8735aa90c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:32.892844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90424018-c4a2-4079-b0ae-9b8735aa90c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.893115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90424018-c4a2-4079-b0ae-9b8735aa90c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.893396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90424018-c4a2-4079-b0ae-9b8735aa90c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.894132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90424018-c4a2-4079-b0ae-9b8735aa90c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:46:32.894463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90424018-c4a2-4079-b0ae-9b8735aa90c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:32.896059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90424018-c4a2-4079-b0ae-9b8735aa90c8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:32.908158 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 775/1563] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:46:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:46:32.911237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90424018-c4a2-4079-b0ae-9b8735aa90c8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:32.917678 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 789/1564] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:32.919380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7d355-f5b8-4181-aa09-18481e58b529 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:32.923332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90424018-c4a2-4079-b0ae-9b8735aa90c8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:32.977336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297a871-d72b-4f12-a357-d66e374ecf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:32.977988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297a871-d72b-4f12-a357-d66e374ecf9a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.978859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297a871-d72b-4f12-a357-d66e374ecf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.979135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297a871-d72b-4f12-a357-d66e374ecf9a admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.979830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297a871-d72b-4f12-a357-d66e374ecf9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:32.981745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297a871-d72b-4f12-a357-d66e374ecf9a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:32.982649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7d355-f5b8-4181-aa09-18481e58b529 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:32.987257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544dc54-0720-4235-bc20-8496b55fd0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:32.987906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544dc54-0720-4235-bc20-8496b55fd0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:32.988190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544dc54-0720-4235-bc20-8496b55fd0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:32.988469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544dc54-0720-4235-bc20-8496b55fd0c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:32.989201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544dc54-0720-4235-bc20-8496b55fd0c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:32.991141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544dc54-0720-4235-bc20-8496b55fd0c2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.007146 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 776/1565] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:33.008083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297a871-d72b-4f12-a357-d66e374ecf9a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.019726 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 790/1566] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:32 2021] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:33.020427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544dc54-0720-4235-bc20-8496b55fd0c2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.067229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297a871-d72b-4f12-a357-d66e374ecf9a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.079851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544dc54-0720-4235-bc20-8496b55fd0c2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.084332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431b41c-09e4-46f9-8129-1820deaf5aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.084984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431b41c-09e4-46f9-8129-1820deaf5aef admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.085265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431b41c-09e4-46f9-8129-1820deaf5aef admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.085540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431b41c-09e4-46f9-8129-1820deaf5aef admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.086227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431b41c-09e4-46f9-8129-1820deaf5aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.088719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431b41c-09e4-46f9-8129-1820deaf5aef admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.114438 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 791/1567] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:33 2021] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:33.116533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a6333-223d-4f3c-8b53-5d3e41325dd3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.116838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a6333-223d-4f3c-8b53-5d3e41325dd3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.117212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a6333-223d-4f3c-8b53-5d3e41325dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.128630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b3436-5f7b-482f-9538-eb79b6f4d0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.129293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b3436-5f7b-482f-9538-eb79b6f4d0aa admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.129579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b3436-5f7b-482f-9538-eb79b6f4d0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.129856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b3436-5f7b-482f-9538-eb79b6f4d0aa admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.130621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b3436-5f7b-482f-9538-eb79b6f4d0aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.132573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b3436-5f7b-482f-9538-eb79b6f4d0aa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.144145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4e4a6333-223d-4f3c-8b53-5d3e41325dd3 None None] MFA Rules not processed for user `9a188df8ed504951b850b40842ffbe73`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:33.145348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4e4a6333-223d-4f3c-8b53-5d3e41325dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:33.159209 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 777/1568] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:33 2021] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:33.159805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b3436-5f7b-482f-9538-eb79b6f4d0aa admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.211419 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 792/1569] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:33 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:33.212239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a6333-223d-4f3c-8b53-5d3e41325dd3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.221241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b3436-5f7b-482f-9538-eb79b6f4d0aa admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.225967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe1d90-8440-41fb-85f6-015ced893ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.226659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe1d90-8440-41fb-85f6-015ced893ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.226945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe1d90-8440-41fb-85f6-015ced893ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.227225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe1d90-8440-41fb-85f6-015ced893ec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.227950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe1d90-8440-41fb-85f6-015ced893ec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.229899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe1d90-8440-41fb-85f6-015ced893ec4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.255476 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 778/1570] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:33 2021] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:33.256506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe1d90-8440-41fb-85f6-015ced893ec4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.273316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a6333-223d-4f3c-8b53-5d3e41325dd3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.317729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe1d90-8440-41fb-85f6-015ced893ec4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.322846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21026039-8159-448f-9998-b7278ffb23e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.323502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21026039-8159-448f-9998-b7278ffb23e1 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.323784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21026039-8159-448f-9998-b7278ffb23e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.324061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21026039-8159-448f-9998-b7278ffb23e1 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.324786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21026039-8159-448f-9998-b7278ffb23e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.326766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21026039-8159-448f-9998-b7278ffb23e1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.326878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d814a0-ed48-476c-a3a1-b3722fc9e054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.327485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d814a0-ed48-476c-a3a1-b3722fc9e054 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.327773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d814a0-ed48-476c-a3a1-b3722fc9e054 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.328050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d814a0-ed48-476c-a3a1-b3722fc9e054 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.328746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d814a0-ed48-476c-a3a1-b3722fc9e054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.330661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d814a0-ed48-476c-a3a1-b3722fc9e054 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.347153 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 779/1571] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:33 2021] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:33.348160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21026039-8159-448f-9998-b7278ffb23e1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.356487 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 793/1572] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:33 2021] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:33.357575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d814a0-ed48-476c-a3a1-b3722fc9e054 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.357803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21026039-8159-448f-9998-b7278ffb23e1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.413253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1816f-01af-4083-afe8-9fe0c67a6561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.413954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1816f-01af-4083-afe8-9fe0c67a6561 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.414246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1816f-01af-4083-afe8-9fe0c67a6561 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.414563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1816f-01af-4083-afe8-9fe0c67a6561 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.415260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1816f-01af-4083-afe8-9fe0c67a6561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.417207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d814a0-ed48-476c-a3a1-b3722fc9e054 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.417322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1816f-01af-4083-afe8-9fe0c67a6561 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.421726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5a126-3551-4db0-a47e-93003f03a8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.422417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5a126-3551-4db0-a47e-93003f03a8eb admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.422702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5a126-3551-4db0-a47e-93003f03a8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.422975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5a126-3551-4db0-a47e-93003f03a8eb admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.423696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5a126-3551-4db0-a47e-93003f03a8eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.425579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5a126-3551-4db0-a47e-93003f03a8eb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.437683 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 780/1573] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:33 2021] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:33.438783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1816f-01af-4083-afe8-9fe0c67a6561 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.448771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1816f-01af-4083-afe8-9fe0c67a6561 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.450975 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 794/1574] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:33 2021] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:33.451918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5a126-3551-4db0-a47e-93003f03a8eb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.453866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd3e01-3cc6-435e-8f61-4ee6b0271887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.454683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd3e01-3cc6-435e-8f61-4ee6b0271887 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.455010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd3e01-3cc6-435e-8f61-4ee6b0271887 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.455292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd3e01-3cc6-435e-8f61-4ee6b0271887 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.456008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd3e01-3cc6-435e-8f61-4ee6b0271887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.457952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd3e01-3cc6-435e-8f61-4ee6b0271887 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.462217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5a126-3551-4db0-a47e-93003f03a8eb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.467274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8142f-2c42-4c7b-9f32-ea3cb3377ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.467938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8142f-2c42-4c7b-9f32-ea3cb3377ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.468233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8142f-2c42-4c7b-9f32-ea3cb3377ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.468494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8142f-2c42-4c7b-9f32-ea3cb3377ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.469197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8142f-2c42-4c7b-9f32-ea3cb3377ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.471416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8142f-2c42-4c7b-9f32-ea3cb3377ce6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.481533 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 781/1575] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:33 2021] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:33.482384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd3e01-3cc6-435e-8f61-4ee6b0271887 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.492547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd3e01-3cc6-435e-8f61-4ee6b0271887 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.497836 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 795/1576] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:33 2021] POST /identity/v3/users => generated 286 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:33.497836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8142f-2c42-4c7b-9f32-ea3cb3377ce6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.498050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5181c1-8424-48f8-a21b-2229b4339505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.498596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5181c1-8424-48f8-a21b-2229b4339505 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.498900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5181c1-8424-48f8-a21b-2229b4339505 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.499174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5181c1-8424-48f8-a21b-2229b4339505 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.499856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5181c1-8424-48f8-a21b-2229b4339505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.501753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5181c1-8424-48f8-a21b-2229b4339505 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.505286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8142f-2c42-4c7b-9f32-ea3cb3377ce6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.510925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fc337-9162-4cfc-b813-15795de68f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.511603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fc337-9162-4cfc-b813-15795de68f4d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.511886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fc337-9162-4cfc-b813-15795de68f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.512158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fc337-9162-4cfc-b813-15795de68f4d admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.513310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fc337-9162-4cfc-b813-15795de68f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.515257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fc337-9162-4cfc-b813-15795de68f4d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.529634 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 782/1577] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:33 2021] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:33.530478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5181c1-8424-48f8-a21b-2229b4339505 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.537588 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 796/1578] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:33 2021] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:33.538369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fc337-9162-4cfc-b813-15795de68f4d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.547631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fc337-9162-4cfc-b813-15795de68f4d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.590107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5181c1-8424-48f8-a21b-2229b4339505 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.594663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7782c-ecfe-4d32-9966-0dde0bc14a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.595310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7782c-ecfe-4d32-9966-0dde0bc14a7e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.595589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7782c-ecfe-4d32-9966-0dde0bc14a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.595859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7782c-ecfe-4d32-9966-0dde0bc14a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.596612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7782c-ecfe-4d32-9966-0dde0bc14a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.598192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7782c-ecfe-4d32-9966-0dde0bc14a7e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.600606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d5811-f350-4462-a79d-cc8ddb479b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.601264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d5811-f350-4462-a79d-cc8ddb479b00 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.601547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d5811-f350-4462-a79d-cc8ddb479b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.601823 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d5811-f350-4462-a79d-cc8ddb479b00 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.602546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d5811-f350-4462-a79d-cc8ddb479b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.604455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d5811-f350-4462-a79d-cc8ddb479b00 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.608149 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 783/1579] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:33 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:33.608943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7782c-ecfe-4d32-9966-0dde0bc14a7e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.619822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7782c-ecfe-4d32-9966-0dde0bc14a7e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.624799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d1890-c0cd-4742-b275-6caeb1d2d6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.625452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d1890-c0cd-4742-b275-6caeb1d2d6da admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.625738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d1890-c0cd-4742-b275-6caeb1d2d6da admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.626017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d1890-c0cd-4742-b275-6caeb1d2d6da admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.629410 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 797/1580] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:33 2021] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:33.629563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d1890-c0cd-4742-b275-6caeb1d2d6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.629670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d5811-f350-4462-a79d-cc8ddb479b00 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.629754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d1890-c0cd-4742-b275-6caeb1d2d6da admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.636962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d5811-f350-4462-a79d-cc8ddb479b00 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.641951 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 784/1581] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:33 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:33.641951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d1890-c0cd-4742-b275-6caeb1d2d6da admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.644680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9062d4c-55e1-4945-a632-d97922c92a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.645337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062d4c-55e1-4945-a632-d97922c92a5f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.645624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062d4c-55e1-4945-a632-d97922c92a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.645906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062d4c-55e1-4945-a632-d97922c92a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.646678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9062d4c-55e1-4945-a632-d97922c92a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.648254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9062d4c-55e1-4945-a632-d97922c92a5f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.651552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d1890-c0cd-4742-b275-6caeb1d2d6da admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.656324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc1ed5-6f7e-4ea5-a9ca-b52bd5d985fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.656981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc1ed5-6f7e-4ea5-a9ca-b52bd5d985fb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.657261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc1ed5-6f7e-4ea5-a9ca-b52bd5d985fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.657537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc1ed5-6f7e-4ea5-a9ca-b52bd5d985fb admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.658266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc1ed5-6f7e-4ea5-a9ca-b52bd5d985fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.658402 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 798/1582] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:33.659041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9062d4c-55e1-4945-a632-d97922c92a5f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.659829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc1ed5-6f7e-4ea5-a9ca-b52bd5d985fb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.668395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9062d4c-55e1-4945-a632-d97922c92a5f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.669575 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 785/1583] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:33 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:33.670361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc1ed5-6f7e-4ea5-a9ca-b52bd5d985fb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.672972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aedef-3585-4dcb-a44a-9bff7b788658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.673603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aedef-3585-4dcb-a44a-9bff7b788658 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.673889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aedef-3585-4dcb-a44a-9bff7b788658 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.674165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aedef-3585-4dcb-a44a-9bff7b788658 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.675048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1aedef-3585-4dcb-a44a-9bff7b788658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.676461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1aedef-3585-4dcb-a44a-9bff7b788658 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.679531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc1ed5-6f7e-4ea5-a9ca-b52bd5d985fb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.684867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dbe62-9c66-459c-a6d2-245c33f063f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.685485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dbe62-9c66-459c-a6d2-245c33f063f5 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.685765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dbe62-9c66-459c-a6d2-245c33f063f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.686039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dbe62-9c66-459c-a6d2-245c33f063f5 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.686555 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 799/1584] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:33 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:33.687017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1dbe62-9c66-459c-a6d2-245c33f063f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.687576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aedef-3585-4dcb-a44a-9bff7b788658 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.689004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1dbe62-9c66-459c-a6d2-245c33f063f5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.696523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aedef-3585-4dcb-a44a-9bff7b788658 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.702219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ff48f-1db0-4b80-b5d3-eaaa5585e83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.703096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ff48f-1db0-4b80-b5d3-eaaa5585e83c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.703494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ff48f-1db0-4b80-b5d3-eaaa5585e83c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.703818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ff48f-1db0-4b80-b5d3-eaaa5585e83c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.704630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ff48f-1db0-4b80-b5d3-eaaa5585e83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.706553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ff48f-1db0-4b80-b5d3-eaaa5585e83c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.711970 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 786/1585] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:33 2021] POST /identity/v3/users => generated 306 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:33.716056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dbe62-9c66-459c-a6d2-245c33f063f5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.717736 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 800/1586] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:33.718463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ff48f-1db0-4b80-b5d3-eaaa5585e83c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.725823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dbe62-9c66-459c-a6d2-245c33f063f5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.727506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ff48f-1db0-4b80-b5d3-eaaa5585e83c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.731115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc1df3-60d4-4a3a-97e5-b905a6aef275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.731759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc1df3-60d4-4a3a-97e5-b905a6aef275 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.732072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc1df3-60d4-4a3a-97e5-b905a6aef275 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.734322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc1df3-60d4-4a3a-97e5-b905a6aef275 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.734454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057c9bc-987a-43f3-a318-c21b1783c7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.734574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc1df3-60d4-4a3a-97e5-b905a6aef275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.734660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057c9bc-987a-43f3-a318-c21b1783c7ff admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.734660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057c9bc-987a-43f3-a318-c21b1783c7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.734660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057c9bc-987a-43f3-a318-c21b1783c7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.734660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057c9bc-987a-43f3-a318-c21b1783c7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.734976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc1df3-60d4-4a3a-97e5-b905a6aef275 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.736874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057c9bc-987a-43f3-a318-c21b1783c7ff admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.746108 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 801/1587] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:33 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:33.746933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057c9bc-987a-43f3-a318-c21b1783c7ff admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.747071 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 787/1588] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:33 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:33.748255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc1df3-60d4-4a3a-97e5-b905a6aef275 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.757789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc1df3-60d4-4a3a-97e5-b905a6aef275 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.758358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057c9bc-987a-43f3-a318-c21b1783c7ff admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.762342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ca36c-0a6f-44bc-bd2a-d9d89304b8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.762819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d718b-f6b9-45a6-a205-1f698245cf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.762973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ca36c-0a6f-44bc-bd2a-d9d89304b8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.763253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ca36c-0a6f-44bc-bd2a-d9d89304b8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.763458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d718b-f6b9-45a6-a205-1f698245cf26 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.763561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ca36c-0a6f-44bc-bd2a-d9d89304b8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.763743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d718b-f6b9-45a6-a205-1f698245cf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.764024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d718b-f6b9-45a6-a205-1f698245cf26 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.764227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ca36c-0a6f-44bc-bd2a-d9d89304b8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.764745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d718b-f6b9-45a6-a205-1f698245cf26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.765795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ca36c-0a6f-44bc-bd2a-d9d89304b8d5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.766316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d718b-f6b9-45a6-a205-1f698245cf26 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.775561 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 788/1589] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:33 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:33.776331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ca36c-0a6f-44bc-bd2a-d9d89304b8d5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.776668 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 802/1590] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:33 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:33.777573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d718b-f6b9-45a6-a205-1f698245cf26 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.787516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ca36c-0a6f-44bc-bd2a-d9d89304b8d5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.787671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d718b-f6b9-45a6-a205-1f698245cf26 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.792704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fff533-4fb8-413c-b36e-a016a0ccf7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.792873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5f9cf-64b5-4dec-bde8-8b138b0ccf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.793345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fff533-4fb8-413c-b36e-a016a0ccf7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.793445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f9cf-64b5-4dec-bde8-8b138b0ccf8e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.793625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f9cf-64b5-4dec-bde8-8b138b0ccf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.793719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fff533-4fb8-413c-b36e-a016a0ccf7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.793895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fff533-4fb8-413c-b36e-a016a0ccf7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.793983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f9cf-64b5-4dec-bde8-8b138b0ccf8e admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.794649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5f9cf-64b5-4dec-bde8-8b138b0ccf8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.794753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fff533-4fb8-413c-b36e-a016a0ccf7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.796198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5f9cf-64b5-4dec-bde8-8b138b0ccf8e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.796317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fff533-4fb8-413c-b36e-a016a0ccf7c9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.806936 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 803/1591] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:33 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:33.807569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5f9cf-64b5-4dec-bde8-8b138b0ccf8e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.808282 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 789/1592] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:33 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:33.808965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fff533-4fb8-413c-b36e-a016a0ccf7c9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.817706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5f9cf-64b5-4dec-bde8-8b138b0ccf8e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.818645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fff533-4fb8-413c-b36e-a016a0ccf7c9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.822491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed2eae-901c-4228-a5b5-ee389c2c6f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.823121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed2eae-901c-4228-a5b5-ee389c2c6f48 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.823229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376319ec-f148-4f50-a6c5-bab9a0202f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.823403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed2eae-901c-4228-a5b5-ee389c2c6f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.823678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed2eae-901c-4228-a5b5-ee389c2c6f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.823822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376319ec-f148-4f50-a6c5-bab9a0202f35 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.824107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376319ec-f148-4f50-a6c5-bab9a0202f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.824384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed2eae-901c-4228-a5b5-ee389c2c6f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.824479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376319ec-f148-4f50-a6c5-bab9a0202f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.825100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376319ec-f148-4f50-a6c5-bab9a0202f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.826090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed2eae-901c-4228-a5b5-ee389c2c6f48 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.826690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376319ec-f148-4f50-a6c5-bab9a0202f35 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.835563 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 804/1593] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:33 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:33.836330 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 790/1594] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:33 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:33.836447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed2eae-901c-4228-a5b5-ee389c2c6f48 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.836888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376319ec-f148-4f50-a6c5-bab9a0202f35 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.846428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376319ec-f148-4f50-a6c5-bab9a0202f35 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.850777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed2eae-901c-4228-a5b5-ee389c2c6f48 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.850971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093aa89-bf64-4cf4-b07d-eab2952a89f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.851831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093aa89-bf64-4cf4-b07d-eab2952a89f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.852113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093aa89-bf64-4cf4-b07d-eab2952a89f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.852388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093aa89-bf64-4cf4-b07d-eab2952a89f7 admin admin] PATH_INFO: `/v3/projects/3c96780722de45bcb58f837b002f04fd/users/607f604cee5c41ae890dfdd27ed4c0de/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.855901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e182dc-1a9f-4eb8-8b85-af849c92b690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.856529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e182dc-1a9f-4eb8-8b85-af849c92b690 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.856810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e182dc-1a9f-4eb8-8b85-af849c92b690 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.857087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e182dc-1a9f-4eb8-8b85-af849c92b690 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.857814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e182dc-1a9f-4eb8-8b85-af849c92b690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.859391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e182dc-1a9f-4eb8-8b85-af849c92b690 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.867017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093aa89-bf64-4cf4-b07d-eab2952a89f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c96780722de45bcb58f837b002f04fd, user_id=607f604cee5c41ae890dfdd27ed4c0de, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.869582 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 805/1595] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:33 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:33.870424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093aa89-bf64-4cf4-b07d-eab2952a89f7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.870814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e182dc-1a9f-4eb8-8b85-af849c92b690 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.880568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e182dc-1a9f-4eb8-8b85-af849c92b690 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.886036 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 791/1596] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:33 2021] PUT /identity/v3/projects/3c96780722de45bcb58f837b002f04fd/users/607f604cee5c41ae890dfdd27ed4c0de/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:33.887460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093aa89-bf64-4cf4-b07d-eab2952a89f7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.943496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a7014-aac9-4879-9f5b-79b4bea3e103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.944387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a7014-aac9-4879-9f5b-79b4bea3e103 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.944665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a7014-aac9-4879-9f5b-79b4bea3e103 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.944939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a7014-aac9-4879-9f5b-79b4bea3e103 admin admin] PATH_INFO: `/v3/projects/b7dca90913954d84b4c8c43d5b58aa78/users/1544cf5d4aa2457a95e685d201b557f6/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.947883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093aa89-bf64-4cf4-b07d-eab2952a89f7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:33.952565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82334224-4570-4cfd-a8fa-9b2f125c10f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:33.953448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82334224-4570-4cfd-a8fa-9b2f125c10f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:33.953731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82334224-4570-4cfd-a8fa-9b2f125c10f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:33.954009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82334224-4570-4cfd-a8fa-9b2f125c10f0 admin admin] PATH_INFO: `/v3/projects/2bf312b8fafb46a980c1a757f5d4b7d9/users/41404fc63abe4b4eb666637014c527fa/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:33.959030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a7014-aac9-4879-9f5b-79b4bea3e103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7dca90913954d84b4c8c43d5b58aa78, user_id=1544cf5d4aa2457a95e685d201b557f6, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.961695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a7014-aac9-4879-9f5b-79b4bea3e103 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.968301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82334224-4570-4cfd-a8fa-9b2f125c10f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf312b8fafb46a980c1a757f5d4b7d9, user_id=41404fc63abe4b4eb666637014c527fa, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:33.971086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82334224-4570-4cfd-a8fa-9b2f125c10f0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:33.973834 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 806/1597] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:33 2021] PUT /identity/v3/projects/b7dca90913954d84b4c8c43d5b58aa78/users/1544cf5d4aa2457a95e685d201b557f6/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:33.974628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a7014-aac9-4879-9f5b-79b4bea3e103 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:33.997301 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 792/1598] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:33 2021] PUT /identity/v3/projects/2bf312b8fafb46a980c1a757f5d4b7d9/users/41404fc63abe4b4eb666637014c527fa/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:33.998440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82334224-4570-4cfd-a8fa-9b2f125c10f0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:34.034682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a7014-aac9-4879-9f5b-79b4bea3e103 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:34.058499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82334224-4570-4cfd-a8fa-9b2f125c10f0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:34.063356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aded9f4-e94f-4d89-8653-3ef8c609a365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:34.064228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aded9f4-e94f-4d89-8653-3ef8c609a365 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.064510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aded9f4-e94f-4d89-8653-3ef8c609a365 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.064786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aded9f4-e94f-4d89-8653-3ef8c609a365 admin admin] PATH_INFO: `/v3/projects/fd46334a58394a98a92a0d9dbcfcfe59/users/38872124d18947de9ea12c83e207715e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.078504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aded9f4-e94f-4d89-8653-3ef8c609a365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd46334a58394a98a92a0d9dbcfcfe59, user_id=38872124d18947de9ea12c83e207715e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:34.081128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aded9f4-e94f-4d89-8653-3ef8c609a365 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:34.089675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d752331-b319-4b45-ac56-fb66120cdafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:34.090596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d752331-b319-4b45-ac56-fb66120cdafd admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.091003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d752331-b319-4b45-ac56-fb66120cdafd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.091292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d752331-b319-4b45-ac56-fb66120cdafd admin admin] PATH_INFO: `/v3/projects/d1bc98b6f3fb48c7b74e584fadd9794e/users/1abe9f9e75624a4fabac5c4a77a6d4c0/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.094169 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 793/1599] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:33 2021] PUT /identity/v3/projects/fd46334a58394a98a92a0d9dbcfcfe59/users/38872124d18947de9ea12c83e207715e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:34.095102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aded9f4-e94f-4d89-8653-3ef8c609a365 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:34.106719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d752331-b319-4b45-ac56-fb66120cdafd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1bc98b6f3fb48c7b74e584fadd9794e, user_id=1abe9f9e75624a4fabac5c4a77a6d4c0, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:34.110546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d752331-b319-4b45-ac56-fb66120cdafd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:34.125082 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 807/1600] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:33 2021] PUT /identity/v3/projects/d1bc98b6f3fb48c7b74e584fadd9794e/users/1abe9f9e75624a4fabac5c4a77a6d4c0/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:34.125851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d752331-b319-4b45-ac56-fb66120cdafd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:34.177250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aded9f4-e94f-4d89-8653-3ef8c609a365 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:34.183555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd9935-1cf7-4da0-86ca-2060bc39218f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:34.184435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd9935-1cf7-4da0-86ca-2060bc39218f admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.184716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd9935-1cf7-4da0-86ca-2060bc39218f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.184991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd9935-1cf7-4da0-86ca-2060bc39218f admin admin] PATH_INFO: `/v3/projects/9bb9a96950044c4f8efb2951d1b58705/users/9dd0ab8b14534ef5b70f1b7015dec8d4/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.187769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d752331-b319-4b45-ac56-fb66120cdafd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:34.192379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36a88d-54dc-4427-b6d1-35e910e8fc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:34.193263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36a88d-54dc-4427-b6d1-35e910e8fc35 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.193547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36a88d-54dc-4427-b6d1-35e910e8fc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.193837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36a88d-54dc-4427-b6d1-35e910e8fc35 admin admin] PATH_INFO: `/v3/projects/f29dd54b2964457e95128f9a02b57ccc/users/1aa113311ab047528213dbb8102775ea/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.200197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd9935-1cf7-4da0-86ca-2060bc39218f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb9a96950044c4f8efb2951d1b58705, user_id=9dd0ab8b14534ef5b70f1b7015dec8d4, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:34.202919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd9935-1cf7-4da0-86ca-2060bc39218f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:34.208407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36a88d-54dc-4427-b6d1-35e910e8fc35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f29dd54b2964457e95128f9a02b57ccc, user_id=1aa113311ab047528213dbb8102775ea, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:34.211610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36a88d-54dc-4427-b6d1-35e910e8fc35 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:34.215464 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 794/1601] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:34 2021] PUT /identity/v3/projects/9bb9a96950044c4f8efb2951d1b58705/users/9dd0ab8b14534ef5b70f1b7015dec8d4/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:34.216468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd9935-1cf7-4da0-86ca-2060bc39218f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:34.226128 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 808/1602] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:34 2021] PUT /identity/v3/projects/f29dd54b2964457e95128f9a02b57ccc/users/1aa113311ab047528213dbb8102775ea/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:34.227441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af908a4-bd60-47cb-ace0-9dba0495656d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.227733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af908a4-bd60-47cb-ace0-9dba0495656d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.228174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af908a4-bd60-47cb-ace0-9dba0495656d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.254625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3af908a4-bd60-47cb-ace0-9dba0495656d None None] MFA Rules not processed for user `607f604cee5c41ae890dfdd27ed4c0de`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:34.255843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3af908a4-bd60-47cb-ace0-9dba0495656d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:34.277513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd9935-1cf7-4da0-86ca-2060bc39218f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:34.317430 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 809/1603] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:34 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:34.321200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98392d3-74b7-4132-9239-de37c51e9620 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.321200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98392d3-74b7-4132-9239-de37c51e9620 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.321200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98392d3-74b7-4132-9239-de37c51e9620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.334329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d9a7a-f2ff-457e-912f-adabbbebba23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:34.335262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9a7a-f2ff-457e-912f-adabbbebba23 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.335596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9a7a-f2ff-457e-912f-adabbbebba23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.335874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9a7a-f2ff-457e-912f-adabbbebba23 admin admin] PATH_INFO: `/v3/projects/6cbee547725d4a06ad0a4be9314d8d6e/users/da04cb8260ca46fb8738fdfd071158f9/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.350580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e98392d3-74b7-4132-9239-de37c51e9620 None None] MFA Rules not processed for user `1544cf5d4aa2457a95e685d201b557f6`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:34.352093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e98392d3-74b7-4132-9239-de37c51e9620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:34.352763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d9a7a-f2ff-457e-912f-adabbbebba23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cbee547725d4a06ad0a4be9314d8d6e, user_id=da04cb8260ca46fb8738fdfd071158f9, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:34.356028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d9a7a-f2ff-457e-912f-adabbbebba23 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:34.372553 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 795/1604] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:34 2021] PUT /identity/v3/projects/6cbee547725d4a06ad0a4be9314d8d6e/users/da04cb8260ca46fb8738fdfd071158f9/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:34.373870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f40fea-ff45-4da2-93fa-0b1f268efc7e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.374162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f40fea-ff45-4da2-93fa-0b1f268efc7e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.374489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f40fea-ff45-4da2-93fa-0b1f268efc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.403380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-92f40fea-ff45-4da2-93fa-0b1f268efc7e None None] MFA Rules not processed for user `41404fc63abe4b4eb666637014c527fa`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:34.404606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-92f40fea-ff45-4da2-93fa-0b1f268efc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:34.426181 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 810/1605] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:34 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:34.427990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14e9da-5a5a-4de9-8e02-3be81c5f43cd None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.428361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14e9da-5a5a-4de9-8e02-3be81c5f43cd None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.428727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14e9da-5a5a-4de9-8e02-3be81c5f43cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.457351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2c14e9da-5a5a-4de9-8e02-3be81c5f43cd None None] MFA Rules not processed for user `38872124d18947de9ea12c83e207715e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:34.458604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2c14e9da-5a5a-4de9-8e02-3be81c5f43cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:34.475964 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 796/1606] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:34 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:34.477265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed6ae1-79e6-4844-b847-bf2a87cf9022 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.477556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed6ae1-79e6-4844-b847-bf2a87cf9022 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.477835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed6ae1-79e6-4844-b847-bf2a87cf9022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.505398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-89ed6ae1-79e6-4844-b847-bf2a87cf9022 None None] MFA Rules not processed for user `1abe9f9e75624a4fabac5c4a77a6d4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:34.506629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-89ed6ae1-79e6-4844-b847-bf2a87cf9022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:34.523483 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 811/1607] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:34 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:34.524431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14e9da-5a5a-4de9-8e02-3be81c5f43cd None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:34.568199 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 797/1608] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:34 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:34.569290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c050e-a39b-4911-a40b-8475d87c1eb2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.569576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c050e-a39b-4911-a40b-8475d87c1eb2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.570016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c050e-a39b-4911-a40b-8475d87c1eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.585208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14e9da-5a5a-4de9-8e02-3be81c5f43cd None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:34.589756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68d111-775e-493b-8b48-bca595e9d15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:34.590472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68d111-775e-493b-8b48-bca595e9d15c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.591373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68d111-775e-493b-8b48-bca595e9d15c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.591666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68d111-775e-493b-8b48-bca595e9d15c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.592407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68d111-775e-493b-8b48-bca595e9d15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:34.593990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68d111-775e-493b-8b48-bca595e9d15c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:34.594722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3f2c050e-a39b-4911-a40b-8475d87c1eb2 None None] MFA Rules not processed for user `1aa113311ab047528213dbb8102775ea`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:34.595918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3f2c050e-a39b-4911-a40b-8475d87c1eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:34.621837 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 812/1609] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:34 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:34.621837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68d111-775e-493b-8b48-bca595e9d15c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:34.621837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68d111-775e-493b-8b48-bca595e9d15c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:34.625716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfad4c-8b7f-43f9-8ea6-359a3d90c8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:34.625716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfad4c-8b7f-43f9-8ea6-359a3d90c8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.626012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfad4c-8b7f-43f9-8ea6-359a3d90c8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.626525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfad4c-8b7f-43f9-8ea6-359a3d90c8b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.627680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfad4c-8b7f-43f9-8ea6-359a3d90c8b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:34.630119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfad4c-8b7f-43f9-8ea6-359a3d90c8b4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:34.658072 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 813/1610] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:34 2021] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:34.659451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22354a-d09f-4c75-b299-c94053b0d743 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.659740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22354a-d09f-4c75-b299-c94053b0d743 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.660013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22354a-d09f-4c75-b299-c94053b0d743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.666403 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 798/1611] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:34 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:34.666403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c050e-a39b-4911-a40b-8475d87c1eb2 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:34.686407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7a22354a-d09f-4c75-b299-c94053b0d743 None None] MFA Rules not processed for user `da04cb8260ca46fb8738fdfd071158f9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:34.687872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7a22354a-d09f-4c75-b299-c94053b0d743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:34.722369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c050e-a39b-4911-a40b-8475d87c1eb2 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:34.751616 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 814/1612] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:34 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:34.752434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22354a-d09f-4c75-b299-c94053b0d743 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:34.770900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356faa6-367f-4643-b637-69533926e64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:34.771549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356faa6-367f-4643-b637-69533926e64e service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.771835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356faa6-367f-4643-b637-69533926e64e service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.772116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356faa6-367f-4643-b637-69533926e64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.812029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22354a-d09f-4c75-b299-c94053b0d743 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:34.816663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dce56d-ae26-4eb0-b68f-f068d93f2914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:34.817318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dce56d-ae26-4eb0-b68f-f068d93f2914 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.817606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dce56d-ae26-4eb0-b68f-f068d93f2914 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.817888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dce56d-ae26-4eb0-b68f-f068d93f2914 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.818742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dce56d-ae26-4eb0-b68f-f068d93f2914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:34.820742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dce56d-ae26-4eb0-b68f-f068d93f2914 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:34.825569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356faa6-367f-4643-b637-69533926e64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:34.827024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356faa6-367f-4643-b637-69533926e64e service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:34.835551 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 799/1613] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:34 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:34.836652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356faa6-367f-4643-b637-69533926e64e service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:34.847787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356faa6-367f-4643-b637-69533926e64e service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:34.848224 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 815/1614] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:34 2021] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:34.849080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dce56d-ae26-4eb0-b68f-f068d93f2914 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:34.910983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb897e88-c930-4c8e-9a30-85226def9bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:34.911641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb897e88-c930-4c8e-9a30-85226def9bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.911954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb897e88-c930-4c8e-9a30-85226def9bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.912227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb897e88-c930-4c8e-9a30-85226def9bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.912919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb897e88-c930-4c8e-9a30-85226def9bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:34.914914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb897e88-c930-4c8e-9a30-85226def9bf7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:34.917471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dce56d-ae26-4eb0-b68f-f068d93f2914 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:34.923991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04815487-d0fe-4317-aa39-7e6772d66bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:34.924662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04815487-d0fe-4317-aa39-7e6772d66bdd admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:34.924951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04815487-d0fe-4317-aa39-7e6772d66bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:34.925230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04815487-d0fe-4317-aa39-7e6772d66bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:34.925943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04815487-d0fe-4317-aa39-7e6772d66bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:34.927980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04815487-d0fe-4317-aa39-7e6772d66bdd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:34.944647 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 800/1615] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:34 2021] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:34.947917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb897e88-c930-4c8e-9a30-85226def9bf7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:34.955369 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 816/1616] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:34 2021] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:34.956289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04815487-d0fe-4317-aa39-7e6772d66bdd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.017745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb897e88-c930-4c8e-9a30-85226def9bf7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.018623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04815487-d0fe-4317-aa39-7e6772d66bdd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.022987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c832cb-a9cc-48d0-b860-a58c6b9df499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.023959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a1ff9-0bb9-4ec6-819b-f24d4e09bf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.023959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a1ff9-0bb9-4ec6-819b-f24d4e09bf50 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.024125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c832cb-a9cc-48d0-b860-a58c6b9df499 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.024302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a1ff9-0bb9-4ec6-819b-f24d4e09bf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.024404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c832cb-a9cc-48d0-b860-a58c6b9df499 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.024544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a1ff9-0bb9-4ec6-819b-f24d4e09bf50 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.024626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c832cb-a9cc-48d0-b860-a58c6b9df499 admin admin] PATH_INFO: `/v3/projects/9bb9a96950044c4f8efb2951d1b58705/users/9dd0ab8b14534ef5b70f1b7015dec8d4/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.025541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a1ff9-0bb9-4ec6-819b-f24d4e09bf50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.027364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c832cb-a9cc-48d0-b860-a58c6b9df499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb9a96950044c4f8efb2951d1b58705, user_id=9dd0ab8b14534ef5b70f1b7015dec8d4, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.027799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a1ff9-0bb9-4ec6-819b-f24d4e09bf50 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.030568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c832cb-a9cc-48d0-b860-a58c6b9df499 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.043278 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 801/1617] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:34 2021] PUT /identity/v3/projects/9bb9a96950044c4f8efb2951d1b58705/users/9dd0ab8b14534ef5b70f1b7015dec8d4/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:35.043913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c832cb-a9cc-48d0-b860-a58c6b9df499 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.049772 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 817/1618] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:34 2021] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:35.050899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a1ff9-0bb9-4ec6-819b-f24d4e09bf50 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.063745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a1ff9-0bb9-4ec6-819b-f24d4e09bf50 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.118401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c832cb-a9cc-48d0-b860-a58c6b9df499 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.126803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96338672-19e2-4556-8c6c-6313b926a1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.127473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96338672-19e2-4556-8c6c-6313b926a1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.127788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96338672-19e2-4556-8c6c-6313b926a1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.128100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96338672-19e2-4556-8c6c-6313b926a1f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.128896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96338672-19e2-4556-8c6c-6313b926a1f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.129420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6241a8a-b755-4e11-8203-ebe4c3360172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.130210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6241a8a-b755-4e11-8203-ebe4c3360172 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.130610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6241a8a-b755-4e11-8203-ebe4c3360172 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.130986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6241a8a-b755-4e11-8203-ebe4c3360172 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.131100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96338672-19e2-4556-8c6c-6313b926a1f2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.131862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6241a8a-b755-4e11-8203-ebe4c3360172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.133929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6241a8a-b755-4e11-8203-ebe4c3360172 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.163402 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 802/1619] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:35 2021] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:35.163570 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 818/1620] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:35 2021] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:35.163649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96338672-19e2-4556-8c6c-6313b926a1f2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.163722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6241a8a-b755-4e11-8203-ebe4c3360172 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.226102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6241a8a-b755-4e11-8203-ebe4c3360172 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.228675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96338672-19e2-4556-8c6c-6313b926a1f2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.231437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573b9ac-21ba-42ad-8978-df13f522fe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.232094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573b9ac-21ba-42ad-8978-df13f522fe41 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.232383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573b9ac-21ba-42ad-8978-df13f522fe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.232739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573b9ac-21ba-42ad-8978-df13f522fe41 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.233354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573b9ac-21ba-42ad-8978-df13f522fe41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.233883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4c59e-0280-47a2-991e-7e1bcc3ced06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.234778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4c59e-0280-47a2-991e-7e1bcc3ced06 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.235068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4c59e-0280-47a2-991e-7e1bcc3ced06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.235294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573b9ac-21ba-42ad-8978-df13f522fe41 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.235385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4c59e-0280-47a2-991e-7e1bcc3ced06 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.236095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4c59e-0280-47a2-991e-7e1bcc3ced06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.238086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4c59e-0280-47a2-991e-7e1bcc3ced06 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.258332 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 819/1621] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:35 2021] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:35.258495 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 803/1622] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:35 2021] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:35.258495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd509a-e058-4051-a7f3-9bdc62fae5dc None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.258495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd509a-e058-4051-a7f3-9bdc62fae5dc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.258495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd509a-e058-4051-a7f3-9bdc62fae5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.258768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573b9ac-21ba-42ad-8978-df13f522fe41 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.269794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573b9ac-21ba-42ad-8978-df13f522fe41 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.274406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08327c6-a92e-4c3d-a093-5d1afb0ebbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.275684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08327c6-a92e-4c3d-a093-5d1afb0ebbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.275970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08327c6-a92e-4c3d-a093-5d1afb0ebbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.276254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08327c6-a92e-4c3d-a093-5d1afb0ebbc4 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.276947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08327c6-a92e-4c3d-a093-5d1afb0ebbc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.278866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08327c6-a92e-4c3d-a093-5d1afb0ebbc4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.285337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-42fd509a-e058-4051-a7f3-9bdc62fae5dc None None] MFA Rules not processed for user `9dd0ab8b14534ef5b70f1b7015dec8d4`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:35.286768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-42fd509a-e058-4051-a7f3-9bdc62fae5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:35.297910 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 820/1623] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:35 2021] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:35.298758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08327c6-a92e-4c3d-a093-5d1afb0ebbc4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.308002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08327c6-a92e-4c3d-a093-5d1afb0ebbc4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.312972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0723fd-f9ff-4be7-9db7-9a129ed449f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.313611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0723fd-f9ff-4be7-9db7-9a129ed449f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.313977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0723fd-f9ff-4be7-9db7-9a129ed449f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.314293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0723fd-f9ff-4be7-9db7-9a129ed449f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.315127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0723fd-f9ff-4be7-9db7-9a129ed449f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.316914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0723fd-f9ff-4be7-9db7-9a129ed449f0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.326986 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 821/1624] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:35 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:35.327743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0723fd-f9ff-4be7-9db7-9a129ed449f0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.336888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0723fd-f9ff-4be7-9db7-9a129ed449f0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.342012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba498ffe-3a16-4ec1-aebe-b343396d6014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.342677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba498ffe-3a16-4ec1-aebe-b343396d6014 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.342965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba498ffe-3a16-4ec1-aebe-b343396d6014 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.343273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba498ffe-3a16-4ec1-aebe-b343396d6014 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.343958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba498ffe-3a16-4ec1-aebe-b343396d6014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.345817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba498ffe-3a16-4ec1-aebe-b343396d6014 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.355807 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 804/1625] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:35 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:35.356882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd509a-e058-4051-a7f3-9bdc62fae5dc None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.367443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd509a-e058-4051-a7f3-9bdc62fae5dc None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.371018 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 822/1626] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:35 2021] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:35.372079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba498ffe-3a16-4ec1-aebe-b343396d6014 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.374992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc958d0d-b2bc-4607-a33d-30e8487f27bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.375662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc958d0d-b2bc-4607-a33d-30e8487f27bc admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.375947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc958d0d-b2bc-4607-a33d-30e8487f27bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.376224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc958d0d-b2bc-4607-a33d-30e8487f27bc admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.376955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc958d0d-b2bc-4607-a33d-30e8487f27bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.378953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc958d0d-b2bc-4607-a33d-30e8487f27bc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.382591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba498ffe-3a16-4ec1-aebe-b343396d6014 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.387840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726c76-42e5-4a62-8c85-c59eca150083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.388772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726c76-42e5-4a62-8c85-c59eca150083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.389041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726c76-42e5-4a62-8c85-c59eca150083 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.389318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726c76-42e5-4a62-8c85-c59eca150083 admin admin] PATH_INFO: `/v3/users/1544cf5d4aa2457a95e685d201b557f6` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.390668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5726c76-42e5-4a62-8c85-c59eca150083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1544cf5d4aa2457a95e685d201b557f6)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.391880 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-b5726c76-42e5-4a62-8c85-c59eca150083 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:35.391880 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:46:35.391880 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:46:35.393177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5726c76-42e5-4a62-8c85-c59eca150083 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.399764 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 805/1627] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:35 2021] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:35.400592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc958d0d-b2bc-4607-a33d-30e8487f27bc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.409912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc958d0d-b2bc-4607-a33d-30e8487f27bc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.414715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7a8bf-ee5b-459a-ae8c-b39632208f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.415356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7a8bf-ee5b-459a-ae8c-b39632208f11 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.415661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7a8bf-ee5b-459a-ae8c-b39632208f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.416105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7a8bf-ee5b-459a-ae8c-b39632208f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.416666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7a8bf-ee5b-459a-ae8c-b39632208f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.418246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7a8bf-ee5b-459a-ae8c-b39632208f11 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.428371 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 806/1628] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:35 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:35.429179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7a8bf-ee5b-459a-ae8c-b39632208f11 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.439139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7a8bf-ee5b-459a-ae8c-b39632208f11 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.445423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1b417-7d34-42cb-a86e-264e97c6bfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.446060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1b417-7d34-42cb-a86e-264e97c6bfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.446396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1b417-7d34-42cb-a86e-264e97c6bfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.446670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1b417-7d34-42cb-a86e-264e97c6bfa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.447946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1b417-7d34-42cb-a86e-264e97c6bfa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.449521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1b417-7d34-42cb-a86e-264e97c6bfa8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.457403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b5726c76-42e5-4a62-8c85-c59eca150083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1544cf5d4aa2457a95e685d201b557f6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:35.459845 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 807/1629] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:35 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:35.460634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1b417-7d34-42cb-a86e-264e97c6bfa8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.468763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b5726c76-42e5-4a62-8c85-c59eca150083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1544cf5d4aa2457a95e685d201b557f6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:35.470354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1b417-7d34-42cb-a86e-264e97c6bfa8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.474921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848adb4-8265-4459-85df-978e555e7ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.475538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848adb4-8265-4459-85df-978e555e7ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.475823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848adb4-8265-4459-85df-978e555e7ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.476104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848adb4-8265-4459-85df-978e555e7ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.476819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848adb4-8265-4459-85df-978e555e7ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.478426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848adb4-8265-4459-85df-978e555e7ec0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.486362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b5726c76-42e5-4a62-8c85-c59eca150083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1544cf5d4aa2457a95e685d201b557f6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:35.487115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b5726c76-42e5-4a62-8c85-c59eca150083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1544cf5d4aa2457a95e685d201b557f6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:35.487874 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 808/1630] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:35 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:35.488622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848adb4-8265-4459-85df-978e555e7ec0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.494936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b5726c76-42e5-4a62-8c85-c59eca150083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1544cf5d4aa2457a95e685d201b557f6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:35.497882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848adb4-8265-4459-85df-978e555e7ec0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.503721 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 823/1631] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:35 2021] DELETE /identity/v3/users/1544cf5d4aa2457a95e685d201b557f6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:35.503721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f5f5a-4f4a-4120-b503-50cf2c244ff9 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.503721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f5f5a-4f4a-4120-b503-50cf2c244ff9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.503721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f5f5a-4f4a-4120-b503-50cf2c244ff9 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.504719 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 824/1632] 10.222.0.13 () {54 vars in 961 bytes} [Sat Dec 18 20:46:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:46:35.505423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f5f5a-4f4a-4120-b503-50cf2c244ff9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.507170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d35f5f5a-4f4a-4120-b503-50cf2c244ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:35.508015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c389d-7f28-4006-924f-49d807f65873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.510038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c389d-7f28-4006-924f-49d807f65873 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.510455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c389d-7f28-4006-924f-49d807f65873 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.510829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c389d-7f28-4006-924f-49d807f65873 admin admin] PATH_INFO: `/v3/projects/eea784636a9d4c95904d7121290a2936/users/88849a95f3514ad695eb27055a2e888e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.526558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c389d-7f28-4006-924f-49d807f65873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea784636a9d4c95904d7121290a2936, user_id=88849a95f3514ad695eb27055a2e888e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.529214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c389d-7f28-4006-924f-49d807f65873 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.541739 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 809/1633] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:35 2021] PUT /identity/v3/projects/eea784636a9d4c95904d7121290a2936/users/88849a95f3514ad695eb27055a2e888e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:35.542734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c389d-7f28-4006-924f-49d807f65873 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.544632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-024c389d-7f28-4006-924f-49d807f65873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:35.575466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f5f5a-4f4a-4120-b503-50cf2c244ff9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.605446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c389d-7f28-4006-924f-49d807f65873 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.610056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50857f15-8527-46ac-b1aa-3760ae8c266d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.610756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857f15-8527-46ac-b1aa-3760ae8c266d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.611048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857f15-8527-46ac-b1aa-3760ae8c266d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.611324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857f15-8527-46ac-b1aa-3760ae8c266d admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.612082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50857f15-8527-46ac-b1aa-3760ae8c266d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.613636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50857f15-8527-46ac-b1aa-3760ae8c266d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.625052 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 810/1634] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:35 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:35.626043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50857f15-8527-46ac-b1aa-3760ae8c266d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.628258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-50857f15-8527-46ac-b1aa-3760ae8c266d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:35.632774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572d133-e756-485e-8aaf-385110fdad35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.633589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572d133-e756-485e-8aaf-385110fdad35 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.633976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572d133-e756-485e-8aaf-385110fdad35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.634933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572d133-e756-485e-8aaf-385110fdad35 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.635677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572d133-e756-485e-8aaf-385110fdad35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.637285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572d133-e756-485e-8aaf-385110fdad35 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.640785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50857f15-8527-46ac-b1aa-3760ae8c266d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.645393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf0849-15f3-438a-b505-78be5334abb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.646237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf0849-15f3-438a-b505-78be5334abb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.646550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf0849-15f3-438a-b505-78be5334abb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.646843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf0849-15f3-438a-b505-78be5334abb8 admin admin] PATH_INFO: `/v3/projects/518803ba297043b9bab4a6bf6f6e254c/users/0ffa6d8593f44030b4eb450653cc32a0/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.650588 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 825/1635] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:35 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:35.650588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572d133-e756-485e-8aaf-385110fdad35 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.651924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8572d133-e756-485e-8aaf-385110fdad35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:35.664127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572d133-e756-485e-8aaf-385110fdad35 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.665198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf0849-15f3-438a-b505-78be5334abb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=518803ba297043b9bab4a6bf6f6e254c, user_id=0ffa6d8593f44030b4eb450653cc32a0, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.667919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf0849-15f3-438a-b505-78be5334abb8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.668853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d2ad1-52b6-4430-ae78-6c692413012f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.669894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d2ad1-52b6-4430-ae78-6c692413012f admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.670184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d2ad1-52b6-4430-ae78-6c692413012f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.670497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d2ad1-52b6-4430-ae78-6c692413012f admin admin] PATH_INFO: `/v3/projects/11d0faa9f7e345159183e7a33d001dca/users/400cefc5127f477daeff98b350b234c0/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.682602 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 811/1636] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:35 2021] PUT /identity/v3/projects/518803ba297043b9bab4a6bf6f6e254c/users/0ffa6d8593f44030b4eb450653cc32a0/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:35.683458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf0849-15f3-438a-b505-78be5334abb8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.684996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0abf0849-15f3-438a-b505-78be5334abb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:35.686456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d2ad1-52b6-4430-ae78-6c692413012f admin admin] RBAC: Authorizing `identity:create_grant(project_id=11d0faa9f7e345159183e7a33d001dca, user_id=400cefc5127f477daeff98b350b234c0, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.689316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d2ad1-52b6-4430-ae78-6c692413012f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.703174 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 826/1637] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:35 2021] PUT /identity/v3/projects/11d0faa9f7e345159183e7a33d001dca/users/400cefc5127f477daeff98b350b234c0/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:35.704622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f5aa2-abb8-4cd8-b577-30868fa8b955 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.705001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f5aa2-abb8-4cd8-b577-30868fa8b955 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.705354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f5aa2-abb8-4cd8-b577-30868fa8b955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.721969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ac9f5aa2-abb8-4cd8-b577-30868fa8b955 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:35.723216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ac9f5aa2-abb8-4cd8-b577-30868fa8b955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:35.752004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf0849-15f3-438a-b505-78be5334abb8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.779614 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 827/1638] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:35.780886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63909253-e146-4a14-975d-863ce9db3b9a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.781172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63909253-e146-4a14-975d-863ce9db3b9a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.781448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63909253-e146-4a14-975d-863ce9db3b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.799039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-63909253-e146-4a14-975d-863ce9db3b9a None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:35.800208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-63909253-e146-4a14-975d-863ce9db3b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:35.807318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8851a-8b7c-43a2-8770-4358365516a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.808154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8851a-8b7c-43a2-8770-4358365516a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.808436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8851a-8b7c-43a2-8770-4358365516a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.808712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8851a-8b7c-43a2-8770-4358365516a9 admin admin] PATH_INFO: `/v3/projects/cf2c454d55914e329ea2dcafcd2be35b/users/41baf6fcee8e45bf9804dd8b98eedcf1/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.823232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8851a-8b7c-43a2-8770-4358365516a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2c454d55914e329ea2dcafcd2be35b, user_id=41baf6fcee8e45bf9804dd8b98eedcf1, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.826235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8851a-8b7c-43a2-8770-4358365516a9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.839146 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 812/1639] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:35 2021] PUT /identity/v3/projects/cf2c454d55914e329ea2dcafcd2be35b/users/41baf6fcee8e45bf9804dd8b98eedcf1/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:35.839934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8851a-8b7c-43a2-8770-4358365516a9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.841564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c7c8851a-8b7c-43a2-8770-4358365516a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:35.864445 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 828/1640] 10.222.0.13 () {58 vars in 1058 bytes} [Sat Dec 18 20:46:35 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:35.865254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63909253-e146-4a14-975d-863ce9db3b9a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.875392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63909253-e146-4a14-975d-863ce9db3b9a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.907247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8851a-8b7c-43a2-8770-4358365516a9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.911856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe890a7-ad11-4654-b07a-ab54ed824547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.912509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe890a7-ad11-4654-b07a-ab54ed824547 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.912787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe890a7-ad11-4654-b07a-ab54ed824547 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.913060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe890a7-ad11-4654-b07a-ab54ed824547 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.913813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe890a7-ad11-4654-b07a-ab54ed824547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.915454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe890a7-ad11-4654-b07a-ab54ed824547 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.925122 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 813/1641] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:35 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:35.926004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe890a7-ad11-4654-b07a-ab54ed824547 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.932347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb83cd5-6d00-4e8e-b1d1-46ee9decfcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.933239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb83cd5-6d00-4e8e-b1d1-46ee9decfcf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.933532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb83cd5-6d00-4e8e-b1d1-46ee9decfcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.933810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb83cd5-6d00-4e8e-b1d1-46ee9decfcf0 admin admin] PATH_INFO: `/v3/projects/c99ad8217aa2405dafaa3ef440e303ee/users/497aeb9520d34f8cbcd2b25455d2fd58/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.935945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe890a7-ad11-4654-b07a-ab54ed824547 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:35.940772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a245d9-6659-47db-b3b9-160ce55b290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:35.941658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a245d9-6659-47db-b3b9-160ce55b290f admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:35.941941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a245d9-6659-47db-b3b9-160ce55b290f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:35.942213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a245d9-6659-47db-b3b9-160ce55b290f admin admin] PATH_INFO: `/v3/projects/d56eb9d105b249e7bce1ad7ddc8f73d3/users/46460d4afe6b44bd931bb01225aff2f6/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:35.949699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb83cd5-6d00-4e8e-b1d1-46ee9decfcf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99ad8217aa2405dafaa3ef440e303ee, user_id=497aeb9520d34f8cbcd2b25455d2fd58, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.952379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb83cd5-6d00-4e8e-b1d1-46ee9decfcf0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.957145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a245d9-6659-47db-b3b9-160ce55b290f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d56eb9d105b249e7bce1ad7ddc8f73d3, user_id=46460d4afe6b44bd931bb01225aff2f6, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:35.960318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a245d9-6659-47db-b3b9-160ce55b290f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:35.965794 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 829/1642] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:35 2021] PUT /identity/v3/projects/c99ad8217aa2405dafaa3ef440e303ee/users/497aeb9520d34f8cbcd2b25455d2fd58/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:35.966740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb83cd5-6d00-4e8e-b1d1-46ee9decfcf0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:35.973325 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 814/1643] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:35 2021] PUT /identity/v3/projects/d56eb9d105b249e7bce1ad7ddc8f73d3/users/46460d4afe6b44bd931bb01225aff2f6/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:35.974390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a245d9-6659-47db-b3b9-160ce55b290f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:36.027329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb83cd5-6d00-4e8e-b1d1-46ee9decfcf0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:36.037749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a245d9-6659-47db-b3b9-160ce55b290f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:36.043152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22e851-e692-4a5e-864e-b6eb09171103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:36.043810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22e851-e692-4a5e-864e-b6eb09171103 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.044094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22e851-e692-4a5e-864e-b6eb09171103 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.044372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22e851-e692-4a5e-864e-b6eb09171103 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.045101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22e851-e692-4a5e-864e-b6eb09171103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:36.046737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22e851-e692-4a5e-864e-b6eb09171103 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:36.060089 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 815/1644] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:35 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:36.060089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22e851-e692-4a5e-864e-b6eb09171103 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:36.062115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ec22e851-e692-4a5e-864e-b6eb09171103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:36.083258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfaad7-97d6-4126-af64-7367b261ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:36.083928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfaad7-97d6-4126-af64-7367b261ac51 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.084219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfaad7-97d6-4126-af64-7367b261ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.084500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfaad7-97d6-4126-af64-7367b261ac51 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.085234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfaad7-97d6-4126-af64-7367b261ac51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:36.086893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfaad7-97d6-4126-af64-7367b261ac51 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:36.096457 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 830/1645] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:35 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:36.097235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfaad7-97d6-4126-af64-7367b261ac51 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:36.106891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfaad7-97d6-4126-af64-7367b261ac51 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:36.111470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6101aff-fd16-48f7-9fb7-9a271b22f574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:36.112099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101aff-fd16-48f7-9fb7-9a271b22f574 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.112379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101aff-fd16-48f7-9fb7-9a271b22f574 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.112655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101aff-fd16-48f7-9fb7-9a271b22f574 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.113370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6101aff-fd16-48f7-9fb7-9a271b22f574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:36.114939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6101aff-fd16-48f7-9fb7-9a271b22f574 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:36.116207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22e851-e692-4a5e-864e-b6eb09171103 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:36.120347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d03223-e52b-4239-8697-3943316dda15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:36.120986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d03223-e52b-4239-8697-3943316dda15 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.121269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d03223-e52b-4239-8697-3943316dda15 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.121545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d03223-e52b-4239-8697-3943316dda15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.125148 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 831/1646] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:36 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:36.125978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6101aff-fd16-48f7-9fb7-9a271b22f574 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:36.130967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d03223-e52b-4239-8697-3943316dda15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:36.132534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d03223-e52b-4239-8697-3943316dda15 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:36.142594 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 816/1647] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:36.143376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d03223-e52b-4239-8697-3943316dda15 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:36.152135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d03223-e52b-4239-8697-3943316dda15 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:36.157299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a649f09-cd62-4b2c-927b-657ae92fbebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:36.158171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a649f09-cd62-4b2c-927b-657ae92fbebf admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.158875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a649f09-cd62-4b2c-927b-657ae92fbebf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.158875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a649f09-cd62-4b2c-927b-657ae92fbebf admin admin] PATH_INFO: `/v3/projects/eea784636a9d4c95904d7121290a2936/users/88849a95f3514ad695eb27055a2e888e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.160748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a649f09-cd62-4b2c-927b-657ae92fbebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea784636a9d4c95904d7121290a2936, user_id=88849a95f3514ad695eb27055a2e888e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:36.163415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a649f09-cd62-4b2c-927b-657ae92fbebf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:36.174970 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 817/1648] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:36 2021] PUT /identity/v3/projects/eea784636a9d4c95904d7121290a2936/users/88849a95f3514ad695eb27055a2e888e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:36.184451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a649f09-cd62-4b2c-927b-657ae92fbebf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:36.202917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6101aff-fd16-48f7-9fb7-9a271b22f574 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:36.262287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a649f09-cd62-4b2c-927b-657ae92fbebf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:36.269884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9c0f4-3f2b-40a0-bbe4-8f04b76adef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:36.271094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9c0f4-3f2b-40a0-bbe4-8f04b76adef0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.271094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9c0f4-3f2b-40a0-bbe4-8f04b76adef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.271250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9c0f4-3f2b-40a0-bbe4-8f04b76adef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.272036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9c0f4-3f2b-40a0-bbe4-8f04b76adef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:36.273654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9c0f4-3f2b-40a0-bbe4-8f04b76adef0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:36.279623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711a7f5-a026-43c7-9179-d1af27db463f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:36.280280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711a7f5-a026-43c7-9179-d1af27db463f service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.280875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711a7f5-a026-43c7-9179-d1af27db463f service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.281070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711a7f5-a026-43c7-9179-d1af27db463f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.282994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9711a7f5-a026-43c7-9179-d1af27db463f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:36.284686 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 818/1649] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:36 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:36.285636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9c0f4-3f2b-40a0-bbe4-8f04b76adef0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:36.301774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9c0f4-3f2b-40a0-bbe4-8f04b76adef0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:36.308706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9c744-5890-4966-bac4-39fb8688c72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:36.309582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9c744-5890-4966-bac4-39fb8688c72a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.310032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9c744-5890-4966-bac4-39fb8688c72a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.310454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9c744-5890-4966-bac4-39fb8688c72a admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.313397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9c744-5890-4966-bac4-39fb8688c72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:36.316710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9c744-5890-4966-bac4-39fb8688c72a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:36.330315 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 819/1650] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:36 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:36.331099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9c744-5890-4966-bac4-39fb8688c72a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:36.342768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9c744-5890-4966-bac4-39fb8688c72a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:36.347757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130af343-6c0b-473c-b65f-99db271c63cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:36.348720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130af343-6c0b-473c-b65f-99db271c63cf admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.349076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130af343-6c0b-473c-b65f-99db271c63cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.349431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130af343-6c0b-473c-b65f-99db271c63cf admin admin] PATH_INFO: `/v3/projects/11d0faa9f7e345159183e7a33d001dca/users/400cefc5127f477daeff98b350b234c0/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.351727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130af343-6c0b-473c-b65f-99db271c63cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=11d0faa9f7e345159183e7a33d001dca, user_id=400cefc5127f477daeff98b350b234c0, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:36.355152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130af343-6c0b-473c-b65f-99db271c63cf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:36.367356 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 820/1651] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:36 2021] PUT /identity/v3/projects/11d0faa9f7e345159183e7a33d001dca/users/400cefc5127f477daeff98b350b234c0/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:36.367634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711a7f5-a026-43c7-9179-d1af27db463f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:36.367973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130af343-6c0b-473c-b65f-99db271c63cf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:36.369317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711a7f5-a026-43c7-9179-d1af27db463f service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:36.379636 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 832/1652] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:36 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:36.380318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711a7f5-a026-43c7-9179-d1af27db463f service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:36.389946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711a7f5-a026-43c7-9179-d1af27db463f service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:36.437810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130af343-6c0b-473c-b65f-99db271c63cf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:36.443374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b114424-436d-4af7-b9c1-04b2bf840e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:36.444260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b114424-436d-4af7-b9c1-04b2bf840e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.444936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b114424-436d-4af7-b9c1-04b2bf840e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.444936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b114424-436d-4af7-b9c1-04b2bf840e79 admin admin] PATH_INFO: `/v3/projects/518803ba297043b9bab4a6bf6f6e254c/users/0ffa6d8593f44030b4eb450653cc32a0/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.448906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b114424-436d-4af7-b9c1-04b2bf840e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=518803ba297043b9bab4a6bf6f6e254c, user_id=0ffa6d8593f44030b4eb450653cc32a0, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:36.450899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b114424-436d-4af7-b9c1-04b2bf840e79 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:36.471942 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 821/1653] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:36 2021] PUT /identity/v3/projects/518803ba297043b9bab4a6bf6f6e254c/users/0ffa6d8593f44030b4eb450653cc32a0/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:36.472206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f33869-145e-44c5-a6ad-119d66bf0b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:36.472206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f33869-145e-44c5-a6ad-119d66bf0b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.472206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f33869-145e-44c5-a6ad-119d66bf0b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.472206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f33869-145e-44c5-a6ad-119d66bf0b1a admin admin] PATH_INFO: `/v3/projects/cf2c454d55914e329ea2dcafcd2be35b/users/41baf6fcee8e45bf9804dd8b98eedcf1/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.472520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13b6aa-e582-4a26-96fd-7ef1949b520e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.472520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13b6aa-e582-4a26-96fd-7ef1949b520e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.472520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13b6aa-e582-4a26-96fd-7ef1949b520e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.476010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f33869-145e-44c5-a6ad-119d66bf0b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2c454d55914e329ea2dcafcd2be35b, user_id=41baf6fcee8e45bf9804dd8b98eedcf1, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:36.480787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f33869-145e-44c5-a6ad-119d66bf0b1a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:36.493562 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 833/1654] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:36 2021] PUT /identity/v3/projects/cf2c454d55914e329ea2dcafcd2be35b/users/41baf6fcee8e45bf9804dd8b98eedcf1/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:36.494482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f33869-145e-44c5-a6ad-119d66bf0b1a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:36.514591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5b13b6aa-e582-4a26-96fd-7ef1949b520e None None] MFA Rules not processed for user `88849a95f3514ad695eb27055a2e888e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:36.515806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5b13b6aa-e582-4a26-96fd-7ef1949b520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:36.564785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f33869-145e-44c5-a6ad-119d66bf0b1a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:36.569821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68f1ba-bdd7-4a21-b555-0c5f68a3e543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:36.570864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68f1ba-bdd7-4a21-b555-0c5f68a3e543 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.571224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68f1ba-bdd7-4a21-b555-0c5f68a3e543 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.571580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68f1ba-bdd7-4a21-b555-0c5f68a3e543 admin admin] PATH_INFO: `/v3/projects/c99ad8217aa2405dafaa3ef440e303ee/users/497aeb9520d34f8cbcd2b25455d2fd58/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.573974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68f1ba-bdd7-4a21-b555-0c5f68a3e543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99ad8217aa2405dafaa3ef440e303ee, user_id=497aeb9520d34f8cbcd2b25455d2fd58, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:36.576950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68f1ba-bdd7-4a21-b555-0c5f68a3e543 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:36.592859 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 822/1656] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:36 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:36.592859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13b6aa-e582-4a26-96fd-7ef1949b520e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:36.598329 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 834/1656] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:36 2021] PUT /identity/v3/projects/c99ad8217aa2405dafaa3ef440e303ee/users/497aeb9520d34f8cbcd2b25455d2fd58/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:36.600767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3562e5c-6292-43f3-a4f2-b22ebb0d4d3f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.601210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3562e5c-6292-43f3-a4f2-b22ebb0d4d3f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.601921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3562e5c-6292-43f3-a4f2-b22ebb0d4d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.604977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13b6aa-e582-4a26-96fd-7ef1949b520e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:36.631311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d3562e5c-6292-43f3-a4f2-b22ebb0d4d3f None None] MFA Rules not processed for user `400cefc5127f477daeff98b350b234c0`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:36.632635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d3562e5c-6292-43f3-a4f2-b22ebb0d4d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:36.664328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8299814-01df-4b75-ad47-84b88a4f8d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:36.665443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8299814-01df-4b75-ad47-84b88a4f8d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.666371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8299814-01df-4b75-ad47-84b88a4f8d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.666731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8299814-01df-4b75-ad47-84b88a4f8d1b admin admin] PATH_INFO: `/v3/projects/d56eb9d105b249e7bce1ad7ddc8f73d3/users/46460d4afe6b44bd931bb01225aff2f6/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.668897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8299814-01df-4b75-ad47-84b88a4f8d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d56eb9d105b249e7bce1ad7ddc8f73d3, user_id=46460d4afe6b44bd931bb01225aff2f6, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:36.671975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8299814-01df-4b75-ad47-84b88a4f8d1b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:36.685414 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 823/1657] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:36 2021] PUT /identity/v3/projects/d56eb9d105b249e7bce1ad7ddc8f73d3/users/46460d4afe6b44bd931bb01225aff2f6/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:36.687655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4901a47-f184-4b9e-a530-f9b75961e2c7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.687939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4901a47-f184-4b9e-a530-f9b75961e2c7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.688215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4901a47-f184-4b9e-a530-f9b75961e2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.720575 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 835/1658] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:36 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:36.721484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3562e5c-6292-43f3-a4f2-b22ebb0d4d3f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:36.722890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d3562e5c-6292-43f3-a4f2-b22ebb0d4d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:36.727027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f4901a47-f184-4b9e-a530-f9b75961e2c7 None None] MFA Rules not processed for user `0ffa6d8593f44030b4eb450653cc32a0`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:36.729145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f4901a47-f184-4b9e-a530-f9b75961e2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:36.739882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3562e5c-6292-43f3-a4f2-b22ebb0d4d3f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:36.801928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a55ca-0f5c-4019-a47b-49292a87937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:36.802840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a55ca-0f5c-4019-a47b-49292a87937f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.803126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a55ca-0f5c-4019-a47b-49292a87937f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.803401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a55ca-0f5c-4019-a47b-49292a87937f admin admin] PATH_INFO: `/v3/projects/b7dca90913954d84b4c8c43d5b58aa78` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.804607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a55ca-0f5c-4019-a47b-49292a87937f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7dca90913954d84b4c8c43d5b58aa78)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:36.806622 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 824/1659] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:36 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:36.806812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a55ca-0f5c-4019-a47b-49292a87937f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:36.808128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31619f5-7151-4d92-b3b8-3099541f54d5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.808492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31619f5-7151-4d92-b3b8-3099541f54d5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.808843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31619f5-7151-4d92-b3b8-3099541f54d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.845431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a31619f5-7151-4d92-b3b8-3099541f54d5 None None] MFA Rules not processed for user `41baf6fcee8e45bf9804dd8b98eedcf1`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:36.846831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a31619f5-7151-4d92-b3b8-3099541f54d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:36.872831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e36a55ca-0f5c-4019-a47b-49292a87937f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7dca90913954d84b4c8c43d5b58aa78', 'request_id': 'req-e36a55ca-0f5c-4019-a47b-49292a87937f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:36.879177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e36a55ca-0f5c-4019-a47b-49292a87937f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7dca90913954d84b4c8c43d5b58aa78', 'request_id': 'req-e36a55ca-0f5c-4019-a47b-49292a87937f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:36.885331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e36a55ca-0f5c-4019-a47b-49292a87937f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7dca90913954d84b4c8c43d5b58aa78', 'request_id': 'req-e36a55ca-0f5c-4019-a47b-49292a87937f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:36.897749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e36a55ca-0f5c-4019-a47b-49292a87937f admin admin] The token cache is being invalidate because project b7dca90913954d84b4c8c43d5b58aa78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:36.898180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e36a55ca-0f5c-4019-a47b-49292a87937f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:36.898895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e36a55ca-0f5c-4019-a47b-49292a87937f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:36.907849 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 836/1660] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:36 2021] DELETE /identity/v3/projects/b7dca90913954d84b4c8c43d5b58aa78 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:36.907849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fff35-1d7b-4260-a383-aa2ad3606c71 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.907849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fff35-1d7b-4260-a383-aa2ad3606c71 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.907849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fff35-1d7b-4260-a383-aa2ad3606c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.935256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ce9fff35-1d7b-4260-a383-aa2ad3606c71 None None] MFA Rules not processed for user `497aeb9520d34f8cbcd2b25455d2fd58`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:36.936484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ce9fff35-1d7b-4260-a383-aa2ad3606c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:36.944131 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 825/1661] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:36 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:36.945596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ffeb6-52f4-43d1-844f-ac8703979b81 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.945888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ffeb6-52f4-43d1-844f-ac8703979b81 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.947144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ffeb6-52f4-43d1-844f-ac8703979b81 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.948942 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 826/1662] 10.222.0.13 () {54 vars in 961 bytes} [Sat Dec 18 20:46:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:46:36.949922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d50fa5-b9c2-4b49-b48f-61bb746828a9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:36.950218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d50fa5-b9c2-4b49-b48f-61bb746828a9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:36.951168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d50fa5-b9c2-4b49-b48f-61bb746828a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:36.977212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-60d50fa5-b9c2-4b49-b48f-61bb746828a9 None None] MFA Rules not processed for user `46460d4afe6b44bd931bb01225aff2f6`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:36.978488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-60d50fa5-b9c2-4b49-b48f-61bb746828a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:37.003500 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 837/1663] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:36 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:37.004339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fff35-1d7b-4260-a383-aa2ad3606c71 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:37.005619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ce9fff35-1d7b-4260-a383-aa2ad3606c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:37.044854 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 827/1664] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:36 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:37.046153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5f83-e6bf-47b1-a375-719de06cb212 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.046477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5f83-e6bf-47b1-a375-719de06cb212 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.046755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5f83-e6bf-47b1-a375-719de06cb212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.063726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2a9d5f83-e6bf-47b1-a375-719de06cb212 None None] MFA Rules not processed for user `38872124d18947de9ea12c83e207715e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:37.064915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2a9d5f83-e6bf-47b1-a375-719de06cb212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:37.068105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fff35-1d7b-4260-a383-aa2ad3606c71 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:37.073152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc8ffa-545c-4aad-8ff8-003a4729b9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:37.074031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc8ffa-545c-4aad-8ff8-003a4729b9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.074377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc8ffa-545c-4aad-8ff8-003a4729b9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.074660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc8ffa-545c-4aad-8ff8-003a4729b9fc admin admin] PATH_INFO: `/v3/users/41404fc63abe4b4eb666637014c527fa` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.075868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc8ffa-545c-4aad-8ff8-003a4729b9fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=41404fc63abe4b4eb666637014c527fa)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:37.077778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc8ffa-545c-4aad-8ff8-003a4729b9fc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:37.118995 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 828/1665] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:37 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:37.120532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fc752-4e87-4dfa-995e-4ae747eea35e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.121086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fc752-4e87-4dfa-995e-4ae747eea35e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.121210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fc752-4e87-4dfa-995e-4ae747eea35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.125836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2ffc8ffa-545c-4aad-8ff8-003a4729b9fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41404fc63abe4b4eb666637014c527fa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:37.132710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2ffc8ffa-545c-4aad-8ff8-003a4729b9fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41404fc63abe4b4eb666637014c527fa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:37.139551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c04fc752-4e87-4dfa-995e-4ae747eea35e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:37.140676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c04fc752-4e87-4dfa-995e-4ae747eea35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:37.145085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2ffc8ffa-545c-4aad-8ff8-003a4729b9fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41404fc63abe4b4eb666637014c527fa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:37.145788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2ffc8ffa-545c-4aad-8ff8-003a4729b9fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41404fc63abe4b4eb666637014c527fa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:37.148559 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 829/1666] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:37.150082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab414a-e1d0-4f67-aece-2f78211c6224 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.150443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab414a-e1d0-4f67-aece-2f78211c6224 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.150732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab414a-e1d0-4f67-aece-2f78211c6224 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.152402 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 830/1667] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:46:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:46:37.153510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43eca5d-f085-45d8-a063-573fdb627f50 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.153826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43eca5d-f085-45d8-a063-573fdb627f50 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.154108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43eca5d-f085-45d8-a063-573fdb627f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.157286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2ffc8ffa-545c-4aad-8ff8-003a4729b9fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41404fc63abe4b4eb666637014c527fa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:37.164210 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 838/1668] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:37 2021] DELETE /identity/v3/users/41404fc63abe4b4eb666637014c527fa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:37.165892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f5828-7a75-4b12-a831-81e4c6b80e19 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.166388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f5828-7a75-4b12-a831-81e4c6b80e19 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.166804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f5828-7a75-4b12-a831-81e4c6b80e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.173007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d43eca5d-f085-45d8-a063-573fdb627f50 None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:37.174246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d43eca5d-f085-45d8-a063-573fdb627f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:37.184398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-074f5828-7a75-4b12-a831-81e4c6b80e19 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:37.185585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-074f5828-7a75-4b12-a831-81e4c6b80e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:37.241145 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 831/1669] 10.222.0.13 () {58 vars in 1058 bytes} [Sat Dec 18 20:46:37 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:37.243089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba174156-dfff-414b-bad0-80f55aeb74b4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.243377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba174156-dfff-414b-bad0-80f55aeb74b4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.244176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba174156-dfff-414b-bad0-80f55aeb74b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.248501 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 839/1670] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:37.249973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d156c-90b6-4518-a5d1-12495d58f395 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.250290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d156c-90b6-4518-a5d1-12495d58f395 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.250586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d156c-90b6-4518-a5d1-12495d58f395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.263461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ba174156-dfff-414b-bad0-80f55aeb74b4 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:37.264665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ba174156-dfff-414b-bad0-80f55aeb74b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:37.268370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f49d156c-90b6-4518-a5d1-12495d58f395 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:37.269523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f49d156c-90b6-4518-a5d1-12495d58f395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:37.277093 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 840/1671] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:37.277847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d156c-90b6-4518-a5d1-12495d58f395 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:37.287220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d156c-90b6-4518-a5d1-12495d58f395 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:37.291991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78285541-c550-41ea-b202-54d06f279e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:37.292647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78285541-c550-41ea-b202-54d06f279e69 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.292940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78285541-c550-41ea-b202-54d06f279e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.293222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78285541-c550-41ea-b202-54d06f279e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.293984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78285541-c550-41ea-b202-54d06f279e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:46:37.294327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78285541-c550-41ea-b202-54d06f279e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:37.295928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78285541-c550-41ea-b202-54d06f279e69 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:37.307973 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 841/1672] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:46:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:46:37.308755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78285541-c550-41ea-b202-54d06f279e69 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:37.320676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78285541-c550-41ea-b202-54d06f279e69 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:37.326668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28f1c5-fed8-4f54-b11e-f8b78f8ce85c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:37.327285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28f1c5-fed8-4f54-b11e-f8b78f8ce85c service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.327573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28f1c5-fed8-4f54-b11e-f8b78f8ce85c service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.327856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28f1c5-fed8-4f54-b11e-f8b78f8ce85c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.329548 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 832/1673] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:46:37 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:37.330406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba174156-dfff-414b-bad0-80f55aeb74b4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:37.331645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ba174156-dfff-414b-bad0-80f55aeb74b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:37.334385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ef28f1c5-fed8-4f54-b11e-f8b78f8ce85c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:37.386234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba174156-dfff-414b-bad0-80f55aeb74b4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:37.389950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58374a-8c97-481b-bf92-621c4deaf60d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:37.390551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58374a-8c97-481b-bf92-621c4deaf60d service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.390834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58374a-8c97-481b-bf92-621c4deaf60d service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.391117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58374a-8c97-481b-bf92-621c4deaf60d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.398732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28f1c5-fed8-4f54-b11e-f8b78f8ce85c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:37.399985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58374a-8c97-481b-bf92-621c4deaf60d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:37.400346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28f1c5-fed8-4f54-b11e-f8b78f8ce85c service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:37.401415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58374a-8c97-481b-bf92-621c4deaf60d service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:37.409607 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 842/1674] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:37 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:37.410785 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 833/1675] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:37.411402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28f1c5-fed8-4f54-b11e-f8b78f8ce85c service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:37.412105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ab9b8-9d59-4e46-99ea-24afa5cbe10e None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.412444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ab9b8-9d59-4e46-99ea-24afa5cbe10e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.412728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ab9b8-9d59-4e46-99ea-24afa5cbe10e None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.414723 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 834/1676] 10.222.0.13 () {54 vars in 960 bytes} [Sat Dec 18 20:46:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:46:37.419955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488e4aa-8511-4839-87d3-8fc7c1d8993d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.420312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488e4aa-8511-4839-87d3-8fc7c1d8993d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.420666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488e4aa-8511-4839-87d3-8fc7c1d8993d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.430434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28f1c5-fed8-4f54-b11e-f8b78f8ce85c service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:37.435427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496f9c7-b86a-4279-b111-f5f002170445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:37.436088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496f9c7-b86a-4279-b111-f5f002170445 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.436374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496f9c7-b86a-4279-b111-f5f002170445 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.436909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496f9c7-b86a-4279-b111-f5f002170445 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.437616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496f9c7-b86a-4279-b111-f5f002170445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:37.439521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496f9c7-b86a-4279-b111-f5f002170445 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:37.444509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e488e4aa-8511-4839-87d3-8fc7c1d8993d None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:37.446375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e488e4aa-8511-4839-87d3-8fc7c1d8993d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:37.460310 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 835/1677] 10.222.0.13 () {58 vars in 1057 bytes} [Sat Dec 18 20:46:37 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:37.469324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488e4aa-8511-4839-87d3-8fc7c1d8993d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:37.480986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488e4aa-8511-4839-87d3-8fc7c1d8993d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:37.481477 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 843/1678] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:37 2021] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:37.482753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496f9c7-b86a-4279-b111-f5f002170445 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:37.553745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddf799-dfe3-41c5-8196-832a410cc94a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:37.554790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddf799-dfe3-41c5-8196-832a410cc94a service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.555248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddf799-dfe3-41c5-8196-832a410cc94a service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.555740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddf799-dfe3-41c5-8196-832a410cc94a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.566221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ddf799-dfe3-41c5-8196-832a410cc94a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:37.568508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ddf799-dfe3-41c5-8196-832a410cc94a service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:37.574601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496f9c7-b86a-4279-b111-f5f002170445 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:37.580185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3a44a-48ed-4051-9086-f86fac5e1db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:37.581219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3a44a-48ed-4051-9086-f86fac5e1db4 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.581612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3a44a-48ed-4051-9086-f86fac5e1db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.582127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3a44a-48ed-4051-9086-f86fac5e1db4 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.583212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3a44a-48ed-4051-9086-f86fac5e1db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:37.585293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3a44a-48ed-4051-9086-f86fac5e1db4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:37.605518 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 836/1679] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:37 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:46:37.616330 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 844/1680] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:37 2021] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:37.623077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddf799-dfe3-41c5-8196-832a410cc94a service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:37.638890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddf799-dfe3-41c5-8196-832a410cc94a service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:37.644267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85f9f0-5f7b-4c27-b6b8-62ec2d83ac86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:37.645082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85f9f0-5f7b-4c27-b6b8-62ec2d83ac86 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.645371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85f9f0-5f7b-4c27-b6b8-62ec2d83ac86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.645647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85f9f0-5f7b-4c27-b6b8-62ec2d83ac86 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.646419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85f9f0-5f7b-4c27-b6b8-62ec2d83ac86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:37.648190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85f9f0-5f7b-4c27-b6b8-62ec2d83ac86 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:37.664506 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 837/1681] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:37 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:37.665249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3a44a-48ed-4051-9086-f86fac5e1db4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:37.681860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3a44a-48ed-4051-9086-f86fac5e1db4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:37.688527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b34cbe-5a5d-464d-8f4d-6afedf00b903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:37.689217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b34cbe-5a5d-464d-8f4d-6afedf00b903 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.689506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b34cbe-5a5d-464d-8f4d-6afedf00b903 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.689869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b34cbe-5a5d-464d-8f4d-6afedf00b903 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.690569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b34cbe-5a5d-464d-8f4d-6afedf00b903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:37.692354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b34cbe-5a5d-464d-8f4d-6afedf00b903 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:37.704589 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 845/1682] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:37 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:46:37.708620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85f9f0-5f7b-4c27-b6b8-62ec2d83ac86 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:37.709171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b34cbe-5a5d-464d-8f4d-6afedf00b903 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:37.720688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b34cbe-5a5d-464d-8f4d-6afedf00b903 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:37.725698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0a0a6-c5ab-4682-8d04-fc938bf1121e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:37.726790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0a0a6-c5ab-4682-8d04-fc938bf1121e admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.727079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0a0a6-c5ab-4682-8d04-fc938bf1121e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.727690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0a0a6-c5ab-4682-8d04-fc938bf1121e admin admin] PATH_INFO: `/v3/projects/6e6f09a202884d71925cc98e3fb0b247/users/963b180028784ee39897503c223f771a/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.754593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0a0a6-c5ab-4682-8d04-fc938bf1121e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6f09a202884d71925cc98e3fb0b247, user_id=963b180028784ee39897503c223f771a, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:37.757561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0a0a6-c5ab-4682-8d04-fc938bf1121e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:37.775037 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 846/1683] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:37 2021] PUT /identity/v3/projects/6e6f09a202884d71925cc98e3fb0b247/users/963b180028784ee39897503c223f771a/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:37.775739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0a0a6-c5ab-4682-8d04-fc938bf1121e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:37.777365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d4e0a0a6-c5ab-4682-8d04-fc938bf1121e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:37.805005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85f9f0-5f7b-4c27-b6b8-62ec2d83ac86 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:37.859105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0a0a6-c5ab-4682-8d04-fc938bf1121e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:37.867380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0961da-716a-4eba-98cc-65117e51ead8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:37.867709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa0e5f-4a3d-4c5e-977f-8a8e10df8bce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:37.868039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0961da-716a-4eba-98cc-65117e51ead8 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.868541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0961da-716a-4eba-98cc-65117e51ead8 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.868819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0961da-716a-4eba-98cc-65117e51ead8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.868931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa0e5f-4a3d-4c5e-977f-8a8e10df8bce service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.869417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa0e5f-4a3d-4c5e-977f-8a8e10df8bce service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.869903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa0e5f-4a3d-4c5e-977f-8a8e10df8bce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.870890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4e0961da-716a-4eba-98cc-65117e51ead8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:37.872391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f6aa0e5f-4a3d-4c5e-977f-8a8e10df8bce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:37.939081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0961da-716a-4eba-98cc-65117e51ead8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:37.940728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0961da-716a-4eba-98cc-65117e51ead8 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:37.942202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa0e5f-4a3d-4c5e-977f-8a8e10df8bce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:37.943814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa0e5f-4a3d-4c5e-977f-8a8e10df8bce service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:37.950891 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 838/1684] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:37 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:37.951935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0961da-716a-4eba-98cc-65117e51ead8 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:37.953264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4e0961da-716a-4eba-98cc-65117e51ead8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:37.957262 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 847/1685] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:37 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:37.958705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daf0e6-8b27-4e00-a896-325560ef4e1f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:37.959091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daf0e6-8b27-4e00-a896-325560ef4e1f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:37.959425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daf0e6-8b27-4e00-a896-325560ef4e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:37.993336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a7daf0e6-8b27-4e00-a896-325560ef4e1f None None] MFA Rules not processed for user `963b180028784ee39897503c223f771a`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:37.994997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a7daf0e6-8b27-4e00-a896-325560ef4e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:38.041087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0961da-716a-4eba-98cc-65117e51ead8 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:38.045924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f006b8d-2928-444f-8185-900a1978c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:38.046977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006b8d-2928-444f-8185-900a1978c838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:38.047322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006b8d-2928-444f-8185-900a1978c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:38.047667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006b8d-2928-444f-8185-900a1978c838 admin admin] PATH_INFO: `/v3/projects/2bf312b8fafb46a980c1a757f5d4b7d9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:38.048943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f006b8d-2928-444f-8185-900a1978c838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf312b8fafb46a980c1a757f5d4b7d9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:38.049956 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-2f006b8d-2928-444f-8185-900a1978c838 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:46:38.049956 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:46:38.049956 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:46:38.051166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f006b8d-2928-444f-8185-900a1978c838 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:38.067542 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 848/1686] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:37 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:38.068397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7daf0e6-8b27-4e00-a896-325560ef4e1f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:38.084160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7daf0e6-8b27-4e00-a896-325560ef4e1f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:38.091210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb025d3-c132-4c82-9ae8-d89e657cf76b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:38.091565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb025d3-c132-4c82-9ae8-d89e657cf76b service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:38.091853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb025d3-c132-4c82-9ae8-d89e657cf76b service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:38.092137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb025d3-c132-4c82-9ae8-d89e657cf76b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:38.094103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ccb025d3-c132-4c82-9ae8-d89e657cf76b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:38.109314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f006b8d-2928-444f-8185-900a1978c838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf312b8fafb46a980c1a757f5d4b7d9', 'request_id': 'req-2f006b8d-2928-444f-8185-900a1978c838'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:38.123314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f006b8d-2928-444f-8185-900a1978c838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf312b8fafb46a980c1a757f5d4b7d9', 'request_id': 'req-2f006b8d-2928-444f-8185-900a1978c838'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:38.131140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f006b8d-2928-444f-8185-900a1978c838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf312b8fafb46a980c1a757f5d4b7d9', 'request_id': 'req-2f006b8d-2928-444f-8185-900a1978c838'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:38.141797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f006b8d-2928-444f-8185-900a1978c838 admin admin] The token cache is being invalidate because project 2bf312b8fafb46a980c1a757f5d4b7d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:38.142080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f006b8d-2928-444f-8185-900a1978c838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:38.142779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f006b8d-2928-444f-8185-900a1978c838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:38.144285 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 839/1687] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:37 2021] DELETE /identity/v3/projects/2bf312b8fafb46a980c1a757f5d4b7d9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:38.145125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f006b8d-2928-444f-8185-900a1978c838 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:38.146379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2f006b8d-2928-444f-8185-900a1978c838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:38.158170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb025d3-c132-4c82-9ae8-d89e657cf76b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:38.159771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb025d3-c132-4c82-9ae8-d89e657cf76b service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:38.169671 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 849/1688] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:38 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:38.170542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb025d3-c132-4c82-9ae8-d89e657cf76b service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:38.185557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb025d3-c132-4c82-9ae8-d89e657cf76b service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:38.229360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f006b8d-2928-444f-8185-900a1978c838 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:38.235537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fb72c-5283-48fc-9f6d-c69d69d5d7e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:38.236217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fb72c-5283-48fc-9f6d-c69d69d5d7e5 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:38.236503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fb72c-5283-48fc-9f6d-c69d69d5d7e5 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:38.236784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fb72c-5283-48fc-9f6d-c69d69d5d7e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:38.238617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-699fb72c-5283-48fc-9f6d-c69d69d5d7e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:38.271547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4819516-3314-4730-b7e0-2108f2e8b755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:38.272219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4819516-3314-4730-b7e0-2108f2e8b755 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:38.272491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4819516-3314-4730-b7e0-2108f2e8b755 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:38.272802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4819516-3314-4730-b7e0-2108f2e8b755 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:38.273517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4819516-3314-4730-b7e0-2108f2e8b755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:38.276090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4819516-3314-4730-b7e0-2108f2e8b755 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:38.305641 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 850/1689] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:38 2021] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:38.311596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4819516-3314-4730-b7e0-2108f2e8b755 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:38.313477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d4819516-3314-4730-b7e0-2108f2e8b755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:38.317463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fb72c-5283-48fc-9f6d-c69d69d5d7e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:38.323099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fb72c-5283-48fc-9f6d-c69d69d5d7e5 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:38.334962 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 840/1690] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:38 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:38.335897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fb72c-5283-48fc-9f6d-c69d69d5d7e5 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:38.338156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-699fb72c-5283-48fc-9f6d-c69d69d5d7e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:38.352768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fb72c-5283-48fc-9f6d-c69d69d5d7e5 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:38.422630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4819516-3314-4730-b7e0-2108f2e8b755 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:38.427862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39df0b-c51e-43c3-92bc-c735bbb9e59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:38.429995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39df0b-c51e-43c3-92bc-c735bbb9e59b admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:38.430221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40d291-f5e3-4622-a89c-e55ac0dca640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:38.430489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39df0b-c51e-43c3-92bc-c735bbb9e59b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:38.430859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39df0b-c51e-43c3-92bc-c735bbb9e59b admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:38.431869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39df0b-c51e-43c3-92bc-c735bbb9e59b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:38.432614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40d291-f5e3-4622-a89c-e55ac0dca640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:38.433284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40d291-f5e3-4622-a89c-e55ac0dca640 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:38.433956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40d291-f5e3-4622-a89c-e55ac0dca640 admin admin] PATH_INFO: `/v3/users/400cefc5127f477daeff98b350b234c0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:38.434733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39df0b-c51e-43c3-92bc-c735bbb9e59b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:38.436047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40d291-f5e3-4622-a89c-e55ac0dca640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=400cefc5127f477daeff98b350b234c0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:38.439727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40d291-f5e3-4622-a89c-e55ac0dca640 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:38.467904 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 841/1691] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:38 2021] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:38.470182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0048cba-f3b6-43c1-bb8b-ec114a139a76 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:38.471023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0048cba-f3b6-43c1-bb8b-ec114a139a76 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:38.471598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0048cba-f3b6-43c1-bb8b-ec114a139a76 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:38.474864 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 842/1692] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:46:38 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:46:38.476191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0048cba-f3b6-43c1-bb8b-ec114a139a76 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:38.497208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0048cba-f3b6-43c1-bb8b-ec114a139a76 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:38.502396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-be40d291-f5e3-4622-a89c-e55ac0dca640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400cefc5127f477daeff98b350b234c0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:38.504973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a961ce8-92bf-4255-9380-54b42727c23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:38.506138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a961ce8-92bf-4255-9380-54b42727c23f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:38.506695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a961ce8-92bf-4255-9380-54b42727c23f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:38.507203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a961ce8-92bf-4255-9380-54b42727c23f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:38.508262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a961ce8-92bf-4255-9380-54b42727c23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:38.511109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a961ce8-92bf-4255-9380-54b42727c23f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:38.513937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-be40d291-f5e3-4622-a89c-e55ac0dca640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400cefc5127f477daeff98b350b234c0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:38.533784 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 843/1693] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:38 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:38.533784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6afcc-8f92-443d-a33b-9723597dcf18 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:38.534135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-be40d291-f5e3-4622-a89c-e55ac0dca640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400cefc5127f477daeff98b350b234c0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:38.534321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6afcc-8f92-443d-a33b-9723597dcf18 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:38.534321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6afcc-8f92-443d-a33b-9723597dcf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:38.534548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-be40d291-f5e3-4622-a89c-e55ac0dca640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400cefc5127f477daeff98b350b234c0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:38.542426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-be40d291-f5e3-4622-a89c-e55ac0dca640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400cefc5127f477daeff98b350b234c0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:38.550974 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 851/1694] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:38 2021] DELETE /identity/v3/users/400cefc5127f477daeff98b350b234c0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:38.552306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40d291-f5e3-4622-a89c-e55ac0dca640 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:38.554362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-be40d291-f5e3-4622-a89c-e55ac0dca640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:38.564471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2eb6afcc-8f92-443d-a33b-9723597dcf18 None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:38.566745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2eb6afcc-8f92-443d-a33b-9723597dcf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:38.660282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40d291-f5e3-4622-a89c-e55ac0dca640 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:38.667477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488ac5b-a737-4a0e-b4cc-462750a59b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:38.667978 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 844/1695] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:46:38 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:38.669003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488ac5b-a737-4a0e-b4cc-462750a59b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:38.669429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94af539-a53e-4a87-894c-7c7477a1e91b None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:38.669593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488ac5b-a737-4a0e-b4cc-462750a59b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:38.669756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94af539-a53e-4a87-894c-7c7477a1e91b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:38.670022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94af539-a53e-4a87-894c-7c7477a1e91b None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:38.670161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488ac5b-a737-4a0e-b4cc-462750a59b1c admin admin] PATH_INFO: `/v3/projects/5d2297eec03a48769d234826a1af33ea/users/66f5c067ad664e75b26fd66a4acdd0d3/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:38.671814 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 845/1696] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:46:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:46:38.677636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969be59-7563-419b-b107-c777b698fcda None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:38.677954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969be59-7563-419b-b107-c777b698fcda None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:38.678349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969be59-7563-419b-b107-c777b698fcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:38.700245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488ac5b-a737-4a0e-b4cc-462750a59b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d2297eec03a48769d234826a1af33ea, user_id=66f5c067ad664e75b26fd66a4acdd0d3, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:38.705606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488ac5b-a737-4a0e-b4cc-462750a59b1c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:38.720272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9969be59-7563-419b-b107-c777b698fcda None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:38.721530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9969be59-7563-419b-b107-c777b698fcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:38.729953 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 852/1697] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:38 2021] PUT /identity/v3/projects/5d2297eec03a48769d234826a1af33ea/users/66f5c067ad664e75b26fd66a4acdd0d3/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:38.729953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488ac5b-a737-4a0e-b4cc-462750a59b1c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:38.735164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f488ac5b-a737-4a0e-b4cc-462750a59b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:38.808683 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 846/1698] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:46:38 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:46:38.809752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969be59-7563-419b-b107-c777b698fcda None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:38.832643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488ac5b-a737-4a0e-b4cc-462750a59b1c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:38.846590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97d45b-bde1-4c63-bf64-7d8b28bd020d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:38.847711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97d45b-bde1-4c63-bf64-7d8b28bd020d service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:38.848263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97d45b-bde1-4c63-bf64-7d8b28bd020d service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:38.848772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97d45b-bde1-4c63-bf64-7d8b28bd020d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:38.893202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969be59-7563-419b-b107-c777b698fcda None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:38.897852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb7486-bac1-4543-b65f-240ba21311fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:38.898561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb7486-bac1-4543-b65f-240ba21311fc admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:38.898841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb7486-bac1-4543-b65f-240ba21311fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:38.899115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb7486-bac1-4543-b65f-240ba21311fc admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:38.899875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb7486-bac1-4543-b65f-240ba21311fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:38.901448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb7486-bac1-4543-b65f-240ba21311fc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:38.911036 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 847/1699] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:38 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:38.911799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb7486-bac1-4543-b65f-240ba21311fc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:38.914285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6ccb7486-bac1-4543-b65f-240ba21311fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:38.923107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97d45b-bde1-4c63-bf64-7d8b28bd020d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:38.924534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97d45b-bde1-4c63-bf64-7d8b28bd020d service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:38.927951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb7486-bac1-4543-b65f-240ba21311fc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:38.934943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2eafa-8f15-4561-995b-33af1536cc95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:38.935572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2eafa-8f15-4561-995b-33af1536cc95 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:38.935856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2eafa-8f15-4561-995b-33af1536cc95 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:38.936135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2eafa-8f15-4561-995b-33af1536cc95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:38.936905 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 853/1700] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:38.937726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97d45b-bde1-4c63-bf64-7d8b28bd020d service glance] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:38.939151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6b97d45b-bde1-4c63-bf64-7d8b28bd020d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:38.945652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2eafa-8f15-4561-995b-33af1536cc95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:38.947840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2eafa-8f15-4561-995b-33af1536cc95 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:38.952813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97d45b-bde1-4c63-bf64-7d8b28bd020d service glance] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:38.957478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b77354-6fef-4571-850f-cab1515f4f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:38.957624 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 848/1701] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:38 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:38.958431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b77354-6fef-4571-850f-cab1515f4f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:38.958532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2eafa-8f15-4561-995b-33af1536cc95 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:38.958734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b77354-6fef-4571-850f-cab1515f4f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:38.959117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b77354-6fef-4571-850f-cab1515f4f7e admin admin] PATH_INFO: `/v3/projects/11d0faa9f7e345159183e7a33d001dca` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:38.960389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b77354-6fef-4571-850f-cab1515f4f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=11d0faa9f7e345159183e7a33d001dca)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:38.962310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b77354-6fef-4571-850f-cab1515f4f7e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:38.970967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2eafa-8f15-4561-995b-33af1536cc95 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:38.978768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bbabd-7d87-4498-871e-1071ecff5c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:38.979746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bbabd-7d87-4498-871e-1071ecff5c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:38.980034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bbabd-7d87-4498-871e-1071ecff5c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:38.980344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bbabd-7d87-4498-871e-1071ecff5c3e admin admin] PATH_INFO: `/v3/projects/5d2297eec03a48769d234826a1af33ea/users/66f5c067ad664e75b26fd66a4acdd0d3/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:38.983133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bbabd-7d87-4498-871e-1071ecff5c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d2297eec03a48769d234826a1af33ea, user_id=66f5c067ad664e75b26fd66a4acdd0d3, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:38.986464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bbabd-7d87-4498-871e-1071ecff5c3e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:39.001685 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 849/1702] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:38 2021] PUT /identity/v3/projects/5d2297eec03a48769d234826a1af33ea/users/66f5c067ad664e75b26fd66a4acdd0d3/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:39.012318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94334828-18cc-4695-abd4-b077e5ad682d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:39.012612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94334828-18cc-4695-abd4-b077e5ad682d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:39.012913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94334828-18cc-4695-abd4-b077e5ad682d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:39.045568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-65b77354-6fef-4571-850f-cab1515f4f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11d0faa9f7e345159183e7a33d001dca', 'request_id': 'req-65b77354-6fef-4571-850f-cab1515f4f7e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:39.054656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-65b77354-6fef-4571-850f-cab1515f4f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11d0faa9f7e345159183e7a33d001dca', 'request_id': 'req-65b77354-6fef-4571-850f-cab1515f4f7e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:39.054821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-94334828-18cc-4695-abd4-b077e5ad682d None None] MFA Rules not processed for user `66f5c067ad664e75b26fd66a4acdd0d3`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:39.056054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-94334828-18cc-4695-abd4-b077e5ad682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:39.061460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-65b77354-6fef-4571-850f-cab1515f4f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11d0faa9f7e345159183e7a33d001dca', 'request_id': 'req-65b77354-6fef-4571-850f-cab1515f4f7e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:39.077507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-65b77354-6fef-4571-850f-cab1515f4f7e admin admin] The token cache is being invalidate because project 11d0faa9f7e345159183e7a33d001dca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:39.077868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-65b77354-6fef-4571-850f-cab1515f4f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:39.079458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-65b77354-6fef-4571-850f-cab1515f4f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:39.080776 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 854/1703] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:38 2021] DELETE /identity/v3/projects/11d0faa9f7e345159183e7a33d001dca => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:39.102365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a4b9c-6ac4-439a-b769-c1060b583574 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:39.102737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a4b9c-6ac4-439a-b769-c1060b583574 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:39.103549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a4b9c-6ac4-439a-b769-c1060b583574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:39.136045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f94a4b9c-6ac4-439a-b769-c1060b583574 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:39.138162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f94a4b9c-6ac4-439a-b769-c1060b583574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:39.162490 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 850/1704] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:39 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:39.215807 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 855/1705] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:46:39.217372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94334828-18cc-4695-abd4-b077e5ad682d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:39.218819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-94334828-18cc-4695-abd4-b077e5ad682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:39.224628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d24dc-d972-48f0-9677-f73c86df5969 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:39.224924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d24dc-d972-48f0-9677-f73c86df5969 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:39.225203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d24dc-d972-48f0-9677-f73c86df5969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:39.244231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e26d24dc-d972-48f0-9677-f73c86df5969 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:39.245868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e26d24dc-d972-48f0-9677-f73c86df5969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:39.253890 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 856/1706] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:39.257778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d24dc-d972-48f0-9677-f73c86df5969 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:39.268293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d24dc-d972-48f0-9677-f73c86df5969 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:39.273853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6ef8c-bd32-4fd1-953c-970e5157a1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:39.279018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6ef8c-bd32-4fd1-953c-970e5157a1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:39.279393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6ef8c-bd32-4fd1-953c-970e5157a1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:39.279785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6ef8c-bd32-4fd1-953c-970e5157a1f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:39.280931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6ef8c-bd32-4fd1-953c-970e5157a1f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:46:39.281256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6ef8c-bd32-4fd1-953c-970e5157a1f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:39.283133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6ef8c-bd32-4fd1-953c-970e5157a1f0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:39.295597 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 857/1707] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:46:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:46:39.299797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6ef8c-bd32-4fd1-953c-970e5157a1f0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:39.309743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6ef8c-bd32-4fd1-953c-970e5157a1f0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:39.314824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f112e-450a-4db4-a280-47421e00bea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:39.315488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f112e-450a-4db4-a280-47421e00bea5 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:39.315785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f112e-450a-4db4-a280-47421e00bea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:39.316071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f112e-450a-4db4-a280-47421e00bea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:39.316648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94334828-18cc-4695-abd4-b077e5ad682d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:39.317004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f112e-450a-4db4-a280-47421e00bea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:39.318961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f112e-450a-4db4-a280-47421e00bea5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:39.324364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2469ce8-6fb6-4dff-bf70-0ffc3fa7e747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:39.325447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2469ce8-6fb6-4dff-bf70-0ffc3fa7e747 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:39.325740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2469ce8-6fb6-4dff-bf70-0ffc3fa7e747 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:39.326020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2469ce8-6fb6-4dff-bf70-0ffc3fa7e747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:39.336194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2469ce8-6fb6-4dff-bf70-0ffc3fa7e747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:39.338442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2469ce8-6fb6-4dff-bf70-0ffc3fa7e747 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:39.351930 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 851/1708] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:39 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:46:39.352104 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 858/1709] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:39 2021] POST /identity/v3/projects => generated 411 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:46:39.353088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2469ce8-6fb6-4dff-bf70-0ffc3fa7e747 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:39.364491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2469ce8-6fb6-4dff-bf70-0ffc3fa7e747 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:39.438179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229811ec-b560-44bf-8a83-cae6ef8f8561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:39.438972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229811ec-b560-44bf-8a83-cae6ef8f8561 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:39.439186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229811ec-b560-44bf-8a83-cae6ef8f8561 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:39.439464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229811ec-b560-44bf-8a83-cae6ef8f8561 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:39.440156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229811ec-b560-44bf-8a83-cae6ef8f8561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:39.442075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229811ec-b560-44bf-8a83-cae6ef8f8561 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:39.465161 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 852/1710] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:39 2021] POST /identity/v3/users => generated 306 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:46:39.513585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f112e-450a-4db4-a280-47421e00bea5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:39.526648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f112e-450a-4db4-a280-47421e00bea5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:39.532824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421916d-bc6c-47d6-8135-dbacf6125fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:39.533494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421916d-bc6c-47d6-8135-dbacf6125fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:39.534005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421916d-bc6c-47d6-8135-dbacf6125fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:39.534323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421916d-bc6c-47d6-8135-dbacf6125fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:39.535192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421916d-bc6c-47d6-8135-dbacf6125fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:39.537130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421916d-bc6c-47d6-8135-dbacf6125fc7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:39.554041 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 859/1711] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:39 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:39.555240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229811ec-b560-44bf-8a83-cae6ef8f8561 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:39.559764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421916d-bc6c-47d6-8135-dbacf6125fc7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:39.565730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8421916d-bc6c-47d6-8135-dbacf6125fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:39.568938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229811ec-b560-44bf-8a83-cae6ef8f8561 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:39.574993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb6e30-13e6-4320-bcb4-d18d0928cd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:39.575947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb6e30-13e6-4320-bcb4-d18d0928cd3f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:39.576935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb6e30-13e6-4320-bcb4-d18d0928cd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:39.577295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb6e30-13e6-4320-bcb4-d18d0928cd3f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:39.578452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb6e30-13e6-4320-bcb4-d18d0928cd3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:39.580304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb6e30-13e6-4320-bcb4-d18d0928cd3f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:39.580409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421916d-bc6c-47d6-8135-dbacf6125fc7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:39.592020 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 853/1712] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:39 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:46:39.593197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb6e30-13e6-4320-bcb4-d18d0928cd3f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:39.608592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5de2c5-b50d-4d2e-a548-6e6d42f135f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:39.609524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5de2c5-b50d-4d2e-a548-6e6d42f135f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:39.609718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5de2c5-b50d-4d2e-a548-6e6d42f135f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:39.609997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5de2c5-b50d-4d2e-a548-6e6d42f135f7 admin admin] PATH_INFO: `/v3/users/963b180028784ee39897503c223f771a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:39.611909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5de2c5-b50d-4d2e-a548-6e6d42f135f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=963b180028784ee39897503c223f771a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:39.613803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5de2c5-b50d-4d2e-a548-6e6d42f135f7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:39.683350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-fc5de2c5-b50d-4d2e-a548-6e6d42f135f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '963b180028784ee39897503c223f771a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:39.694362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-fc5de2c5-b50d-4d2e-a548-6e6d42f135f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '963b180028784ee39897503c223f771a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:39.711771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb6e30-13e6-4320-bcb4-d18d0928cd3f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:39.716691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-fc5de2c5-b50d-4d2e-a548-6e6d42f135f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '963b180028784ee39897503c223f771a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:39.717557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-fc5de2c5-b50d-4d2e-a548-6e6d42f135f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '963b180028784ee39897503c223f771a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:39.718947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870b748-26f8-42d0-ae92-1baf1387347a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:39.719656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870b748-26f8-42d0-ae92-1baf1387347a service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:39.719924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870b748-26f8-42d0-ae92-1baf1387347a service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:39.720210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870b748-26f8-42d0-ae92-1baf1387347a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:39.722220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b870b748-26f8-42d0-ae92-1baf1387347a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:39.727068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-fc5de2c5-b50d-4d2e-a548-6e6d42f135f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '963b180028784ee39897503c223f771a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:39.740065 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 860/1713] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:39 2021] DELETE /identity/v3/users/963b180028784ee39897503c223f771a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:39.740065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5de2c5-b50d-4d2e-a548-6e6d42f135f7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:39.741579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fc5de2c5-b50d-4d2e-a548-6e6d42f135f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:39.798982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870b748-26f8-42d0-ae92-1baf1387347a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:39.800734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870b748-26f8-42d0-ae92-1baf1387347a service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:39.822323 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 854/1714] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:39 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:39.823510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870b748-26f8-42d0-ae92-1baf1387347a service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:39.825089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b870b748-26f8-42d0-ae92-1baf1387347a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:39.830229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5de2c5-b50d-4d2e-a548-6e6d42f135f7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:39.839328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3418fb-d60c-4696-aec6-25090edd8dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:39.840720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3418fb-d60c-4696-aec6-25090edd8dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:39.841189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3418fb-d60c-4696-aec6-25090edd8dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:39.841614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3418fb-d60c-4696-aec6-25090edd8dcb admin admin] PATH_INFO: `/v3/projects/d76f59e79d2644fdb8fdecb14f0a06cc/users/3f837d6a45324047b431286734ff9d6b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:39.869340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3418fb-d60c-4696-aec6-25090edd8dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76f59e79d2644fdb8fdecb14f0a06cc, user_id=3f837d6a45324047b431286734ff9d6b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:39.873157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3418fb-d60c-4696-aec6-25090edd8dcb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:39.895526 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 861/1715] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:39 2021] PUT /identity/v3/projects/d76f59e79d2644fdb8fdecb14f0a06cc/users/3f837d6a45324047b431286734ff9d6b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:39.896926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a53b2-ab9a-4b20-8068-b407bec92455 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:39.897182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a53b2-ab9a-4b20-8068-b407bec92455 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:39.897461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a53b2-ab9a-4b20-8068-b407bec92455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:39.920814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ab4a53b2-ab9a-4b20-8068-b407bec92455 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:39.922342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ab4a53b2-ab9a-4b20-8068-b407bec92455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:39.923387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870b748-26f8-42d0-ae92-1baf1387347a service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:39.998058 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 862/1716] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:39.999753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15490e8-072b-4a70-8318-84a803bf67e4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:40.000217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15490e8-072b-4a70-8318-84a803bf67e4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:40.000686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15490e8-072b-4a70-8318-84a803bf67e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:40.005033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c665012-d98a-44b8-b480-7e77cb3120dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:40.005770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665012-d98a-44b8-b480-7e77cb3120dc service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:40.006143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665012-d98a-44b8-b480-7e77cb3120dc service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:40.006513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665012-d98a-44b8-b480-7e77cb3120dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:40.008601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1c665012-d98a-44b8-b480-7e77cb3120dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:40.023069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c665012-d98a-44b8-b480-7e77cb3120dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:40.025256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c665012-d98a-44b8-b480-7e77cb3120dc service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:40.037697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e15490e8-072b-4a70-8318-84a803bf67e4 None None] MFA Rules not processed for user `3f837d6a45324047b431286734ff9d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:40.039203 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 855/1717] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:39 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:40.039852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e15490e8-072b-4a70-8318-84a803bf67e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:40.040795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c665012-d98a-44b8-b480-7e77cb3120dc service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:40.042408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1c665012-d98a-44b8-b480-7e77cb3120dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:40.120868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c665012-d98a-44b8-b480-7e77cb3120dc service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:40.125414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b22e7-6ce7-485c-84ee-eb7021812d28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:40.126587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b22e7-6ce7-485c-84ee-eb7021812d28 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:40.126872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b22e7-6ce7-485c-84ee-eb7021812d28 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:40.127667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b22e7-6ce7-485c-84ee-eb7021812d28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:40.143180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b22e7-6ce7-485c-84ee-eb7021812d28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:40.144782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b22e7-6ce7-485c-84ee-eb7021812d28 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:40.170186 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 856/1718] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:40.171399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b22e7-6ce7-485c-84ee-eb7021812d28 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:40.175323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b91b22e7-6ce7-485c-84ee-eb7021812d28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:40.191545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b22e7-6ce7-485c-84ee-eb7021812d28 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:40.199363 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 863/1719] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:39 2021] POST /identity/v3/auth/tokens => generated 3278 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:40.200512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e461ef0-27c1-40cd-822d-3ab1b92d1e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:40.204214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15490e8-072b-4a70-8318-84a803bf67e4 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:40.205341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e461ef0-27c1-40cd-822d-3ab1b92d1e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:40.205959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e461ef0-27c1-40cd-822d-3ab1b92d1e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:40.206474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e461ef0-27c1-40cd-822d-3ab1b92d1e94 admin admin] PATH_INFO: `/v3/users/1abe9f9e75624a4fabac5c4a77a6d4c0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:40.210614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e461ef0-27c1-40cd-822d-3ab1b92d1e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1abe9f9e75624a4fabac5c4a77a6d4c0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:40.213738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e461ef0-27c1-40cd-822d-3ab1b92d1e94 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:40.224793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15490e8-072b-4a70-8318-84a803bf67e4 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:40.232654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec2d30-47ff-4a73-91ca-658c056db0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:40.233730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec2d30-47ff-4a73-91ca-658c056db0aa admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:40.246536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec2d30-47ff-4a73-91ca-658c056db0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:40.246536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec2d30-47ff-4a73-91ca-658c056db0aa admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:40.246536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec2d30-47ff-4a73-91ca-658c056db0aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:40.246536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec2d30-47ff-4a73-91ca-658c056db0aa admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:40.305299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5e461ef0-27c1-40cd-822d-3ab1b92d1e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1abe9f9e75624a4fabac5c4a77a6d4c0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:40.312137 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 864/1720] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:40 2021] POST /identity/v3/projects => generated 409 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:40.316055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec2d30-47ff-4a73-91ca-658c056db0aa admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:40.317493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5e461ef0-27c1-40cd-822d-3ab1b92d1e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1abe9f9e75624a4fabac5c4a77a6d4c0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:40.318736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5e461ef0-27c1-40cd-822d-3ab1b92d1e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1abe9f9e75624a4fabac5c4a77a6d4c0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:40.337625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5e461ef0-27c1-40cd-822d-3ab1b92d1e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1abe9f9e75624a4fabac5c4a77a6d4c0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:40.365161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5e461ef0-27c1-40cd-822d-3ab1b92d1e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1abe9f9e75624a4fabac5c4a77a6d4c0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:40.373633 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 857/1721] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:40 2021] DELETE /identity/v3/users/1abe9f9e75624a4fabac5c4a77a6d4c0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:40.377991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ad98f-b2a3-4941-9a97-ff6bee004dec None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:40.378795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ad98f-b2a3-4941-9a97-ff6bee004dec None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:40.379181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ad98f-b2a3-4941-9a97-ff6bee004dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:40.420978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec2d30-47ff-4a73-91ca-658c056db0aa admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:40.457125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b50ad98f-b2a3-4941-9a97-ff6bee004dec None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:40.461547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b50ad98f-b2a3-4941-9a97-ff6bee004dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:40.537811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc84fd-50b9-4030-9e3f-dbe07e34b637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:40.538673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc84fd-50b9-4030-9e3f-dbe07e34b637 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:40.538961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc84fd-50b9-4030-9e3f-dbe07e34b637 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:40.539242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc84fd-50b9-4030-9e3f-dbe07e34b637 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:40.540415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc84fd-50b9-4030-9e3f-dbe07e34b637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:40.548344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc84fd-50b9-4030-9e3f-dbe07e34b637 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:40.594301 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 865/1722] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:40 2021] POST /identity/v3/users => generated 311 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:40.598692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc84fd-50b9-4030-9e3f-dbe07e34b637 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:40.599193 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 858/1723] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:40.600623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-87bc84fd-50b9-4030-9e3f-dbe07e34b637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:40.609856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ad98f-b2a3-4941-9a97-ff6bee004dec None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:40.611747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b50ad98f-b2a3-4941-9a97-ff6bee004dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:40.643352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc84fd-50b9-4030-9e3f-dbe07e34b637 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:40.659162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4032e5-e3b3-41ce-9c03-7d6f76c34b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:40.659847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4032e5-e3b3-41ce-9c03-7d6f76c34b86 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:40.660368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4032e5-e3b3-41ce-9c03-7d6f76c34b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:40.660493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4032e5-e3b3-41ce-9c03-7d6f76c34b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:40.661148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4032e5-e3b3-41ce-9c03-7d6f76c34b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:40.663578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4032e5-e3b3-41ce-9c03-7d6f76c34b86 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:40.679826 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 866/1724] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:40 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:40.680384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4032e5-e3b3-41ce-9c03-7d6f76c34b86 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:40.697426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4032e5-e3b3-41ce-9c03-7d6f76c34b86 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:40.705492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1c2ab-f3a1-4e3f-80ea-0dab4906a445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:40.706580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1c2ab-f3a1-4e3f-80ea-0dab4906a445 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:40.706816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1c2ab-f3a1-4e3f-80ea-0dab4906a445 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:40.707100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1c2ab-f3a1-4e3f-80ea-0dab4906a445 admin admin] PATH_INFO: `/v3/projects/8a5caa20873b44c4a1818f17e4484682/users/a7de451913494921ba929ba74ba43a67/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:40.726045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1c2ab-f3a1-4e3f-80ea-0dab4906a445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5caa20873b44c4a1818f17e4484682, user_id=a7de451913494921ba929ba74ba43a67, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:40.729826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1c2ab-f3a1-4e3f-80ea-0dab4906a445 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:40.753233 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 867/1725] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:40 2021] PUT /identity/v3/projects/8a5caa20873b44c4a1818f17e4484682/users/a7de451913494921ba929ba74ba43a67/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:40.757208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1c2ab-f3a1-4e3f-80ea-0dab4906a445 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:40.770191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ad98f-b2a3-4941-9a97-ff6bee004dec None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:40.864687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e75dc-d0d7-4d60-947d-79f9f6065df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:40.865832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e75dc-d0d7-4d60-947d-79f9f6065df8 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:40.866215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e75dc-d0d7-4d60-947d-79f9f6065df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:40.867486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e75dc-d0d7-4d60-947d-79f9f6065df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:40.895952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1c2ab-f3a1-4e3f-80ea-0dab4906a445 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:40.906544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391d5c1-1c9e-4994-bd75-74d622c92697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:40.907291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391d5c1-1c9e-4994-bd75-74d622c92697 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:40.908144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391d5c1-1c9e-4994-bd75-74d622c92697 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:40.908455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391d5c1-1c9e-4994-bd75-74d622c92697 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:40.909528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391d5c1-1c9e-4994-bd75-74d622c92697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:40.912464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391d5c1-1c9e-4994-bd75-74d622c92697 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:40.927463 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 868/1726] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:40 2021] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:40.928732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391d5c1-1c9e-4994-bd75-74d622c92697 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:40.931927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e391d5c1-1c9e-4994-bd75-74d622c92697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:40.949962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391d5c1-1c9e-4994-bd75-74d622c92697 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:40.960730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:40.960730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:40.960730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:40.960730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92 admin admin] PATH_INFO: `/v3/projects/6e6f09a202884d71925cc98e3fb0b247` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:40.962750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e6f09a202884d71925cc98e3fb0b247)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:40.964680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:40.979093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e75dc-d0d7-4d60-947d-79f9f6065df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:40.989689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e75dc-d0d7-4d60-947d-79f9f6065df8 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:41.003028 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 859/1727] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:46:41.003028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e75dc-d0d7-4d60-947d-79f9f6065df8 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:41.004679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b38e75dc-d0d7-4d60-947d-79f9f6065df8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:41.028548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6f09a202884d71925cc98e3fb0b247', 'request_id': 'req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.034156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e75dc-d0d7-4d60-947d-79f9f6065df8 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:41.036486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6f09a202884d71925cc98e3fb0b247', 'request_id': 'req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.058072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6f09a202884d71925cc98e3fb0b247', 'request_id': 'req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.081843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92 admin admin] The token cache is being invalidate because project 6e6f09a202884d71925cc98e3fb0b247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:41.082279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.083685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.086168 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 869/1728] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:40 2021] DELETE /identity/v3/projects/6e6f09a202884d71925cc98e3fb0b247 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:41.089514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:41.090686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:41.189143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab7394-57a4-4c1a-9887-6b1cdbbb3f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:41.192075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddbeb7-a087-4028-a80e-5dcbc98dbb92 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:41.193048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab7394-57a4-4c1a-9887-6b1cdbbb3f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:41.193503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab7394-57a4-4c1a-9887-6b1cdbbb3f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:41.195164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab7394-57a4-4c1a-9887-6b1cdbbb3f5a admin admin] PATH_INFO: `/v3/users/607f604cee5c41ae890dfdd27ed4c0de` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:41.198269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf2e5a-01aa-41ea-8ab2-88ac84ab166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:41.199055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab7394-57a4-4c1a-9887-6b1cdbbb3f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=607f604cee5c41ae890dfdd27ed4c0de)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:41.199341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf2e5a-01aa-41ea-8ab2-88ac84ab166c admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:41.199698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf2e5a-01aa-41ea-8ab2-88ac84ab166c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:41.200105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf2e5a-01aa-41ea-8ab2-88ac84ab166c admin admin] PATH_INFO: `/v3/projects/8a5caa20873b44c4a1818f17e4484682/users/a7de451913494921ba929ba74ba43a67/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:41.202186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf2e5a-01aa-41ea-8ab2-88ac84ab166c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5caa20873b44c4a1818f17e4484682, user_id=a7de451913494921ba929ba74ba43a67, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:41.205132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf2e5a-01aa-41ea-8ab2-88ac84ab166c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:41.213257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab7394-57a4-4c1a-9887-6b1cdbbb3f5a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:41.232214 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 870/1729] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:41 2021] PUT /identity/v3/projects/8a5caa20873b44c4a1818f17e4484682/users/a7de451913494921ba929ba74ba43a67/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:41.236643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf2e5a-01aa-41ea-8ab2-88ac84ab166c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:41.242988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d4bf2e5a-01aa-41ea-8ab2-88ac84ab166c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:41.280566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebab7394-57a4-4c1a-9887-6b1cdbbb3f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '607f604cee5c41ae890dfdd27ed4c0de'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.293861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebab7394-57a4-4c1a-9887-6b1cdbbb3f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '607f604cee5c41ae890dfdd27ed4c0de'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.295112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebab7394-57a4-4c1a-9887-6b1cdbbb3f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '607f604cee5c41ae890dfdd27ed4c0de'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.311131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebab7394-57a4-4c1a-9887-6b1cdbbb3f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '607f604cee5c41ae890dfdd27ed4c0de'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.319291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebab7394-57a4-4c1a-9887-6b1cdbbb3f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '607f604cee5c41ae890dfdd27ed4c0de'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.328629 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 860/1730] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:41 2021] DELETE /identity/v3/users/607f604cee5c41ae890dfdd27ed4c0de => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:41.346840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab7394-57a4-4c1a-9887-6b1cdbbb3f5a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:41.349035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ebab7394-57a4-4c1a-9887-6b1cdbbb3f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:41.378791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf2e5a-01aa-41ea-8ab2-88ac84ab166c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:41.452642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab7394-57a4-4c1a-9887-6b1cdbbb3f5a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:41.463919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ca092-58bc-4bc6-9419-0b4f4d8f805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:41.464815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ca092-58bc-4bc6-9419-0b4f4d8f805f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:41.465145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ca092-58bc-4bc6-9419-0b4f4d8f805f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:41.465420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ca092-58bc-4bc6-9419-0b4f4d8f805f admin admin] PATH_INFO: `/v3/users/66f5c067ad664e75b26fd66a4acdd0d3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:41.466817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ca092-58bc-4bc6-9419-0b4f4d8f805f admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f5c067ad664e75b26fd66a4acdd0d3)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:41.479307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ca092-58bc-4bc6-9419-0b4f4d8f805f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:41.492925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb277106-b52e-499a-9b92-bf8af08082ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:41.493832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb277106-b52e-499a-9b92-bf8af08082ca service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:41.494173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb277106-b52e-499a-9b92-bf8af08082ca service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:41.494463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb277106-b52e-499a-9b92-bf8af08082ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:41.498420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cb277106-b52e-499a-9b92-bf8af08082ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:41.554212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f8ca092-58bc-4bc6-9419-0b4f4d8f805f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f5c067ad664e75b26fd66a4acdd0d3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.561118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f8ca092-58bc-4bc6-9419-0b4f4d8f805f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f5c067ad664e75b26fd66a4acdd0d3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.562284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f8ca092-58bc-4bc6-9419-0b4f4d8f805f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f5c067ad664e75b26fd66a4acdd0d3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.566238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb277106-b52e-499a-9b92-bf8af08082ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:41.568057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb277106-b52e-499a-9b92-bf8af08082ca service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:41.577175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f8ca092-58bc-4bc6-9419-0b4f4d8f805f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f5c067ad664e75b26fd66a4acdd0d3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.578704 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 871/1731] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:41 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:41.580076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89eba1-7c04-4c4a-af4c-e584cec6f6d2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:41.580356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89eba1-7c04-4c4a-af4c-e584cec6f6d2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:41.580636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89eba1-7c04-4c4a-af4c-e584cec6f6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:41.589108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f8ca092-58bc-4bc6-9419-0b4f4d8f805f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f5c067ad664e75b26fd66a4acdd0d3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.600090 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 861/1732] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:41 2021] DELETE /identity/v3/users/66f5c067ad664e75b26fd66a4acdd0d3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:41.600090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eac0e6-8e2f-4ef2-8898-1139820355d3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:41.600090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eac0e6-8e2f-4ef2-8898-1139820355d3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:41.600090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eac0e6-8e2f-4ef2-8898-1139820355d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:41.612445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9f89eba1-7c04-4c4a-af4c-e584cec6f6d2 None None] MFA Rules not processed for user `a7de451913494921ba929ba74ba43a67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:41.613653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9f89eba1-7c04-4c4a-af4c-e584cec6f6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:41.625741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-32eac0e6-8e2f-4ef2-8898-1139820355d3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:41.627741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-32eac0e6-8e2f-4ef2-8898-1139820355d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:41.714389 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 872/1733] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:41 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:41.715502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89eba1-7c04-4c4a-af4c-e584cec6f6d2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:41.716927 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 862/1734] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:41.717143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9f89eba1-7c04-4c4a-af4c-e584cec6f6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:41.718817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5e25e-4aaf-47d0-9f24-032fc9954da6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:41.719367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5e25e-4aaf-47d0-9f24-032fc9954da6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:41.721872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5e25e-4aaf-47d0-9f24-032fc9954da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:41.746230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89eba1-7c04-4c4a-af4c-e584cec6f6d2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:41.752634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17494b7f-ef72-4e1a-8152-c7acb3558415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:41.753787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17494b7f-ef72-4e1a-8152-c7acb3558415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:41.754240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17494b7f-ef72-4e1a-8152-c7acb3558415 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:41.754705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17494b7f-ef72-4e1a-8152-c7acb3558415 admin admin] PATH_INFO: `/v3/projects/d1bc98b6f3fb48c7b74e584fadd9794e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:41.756058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17494b7f-ef72-4e1a-8152-c7acb3558415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1bc98b6f3fb48c7b74e584fadd9794e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:41.758722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17494b7f-ef72-4e1a-8152-c7acb3558415 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:41.775649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0cd5e25e-4aaf-47d0-9f24-032fc9954da6 None None] MFA Rules not processed for user `da04cb8260ca46fb8738fdfd071158f9`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:41.776760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0cd5e25e-4aaf-47d0-9f24-032fc9954da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:41.851948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-17494b7f-ef72-4e1a-8152-c7acb3558415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1bc98b6f3fb48c7b74e584fadd9794e', 'request_id': 'req-17494b7f-ef72-4e1a-8152-c7acb3558415'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.865059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-17494b7f-ef72-4e1a-8152-c7acb3558415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1bc98b6f3fb48c7b74e584fadd9794e', 'request_id': 'req-17494b7f-ef72-4e1a-8152-c7acb3558415'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.875881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-17494b7f-ef72-4e1a-8152-c7acb3558415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1bc98b6f3fb48c7b74e584fadd9794e', 'request_id': 'req-17494b7f-ef72-4e1a-8152-c7acb3558415'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.897072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-17494b7f-ef72-4e1a-8152-c7acb3558415 admin admin] The token cache is being invalidate because project d1bc98b6f3fb48c7b74e584fadd9794e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:41.897457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-17494b7f-ef72-4e1a-8152-c7acb3558415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.898565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-17494b7f-ef72-4e1a-8152-c7acb3558415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:41.901229 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 873/1735] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:41 2021] DELETE /identity/v3/projects/d1bc98b6f3fb48c7b74e584fadd9794e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:41.906657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17494b7f-ef72-4e1a-8152-c7acb3558415 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:41.908954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-17494b7f-ef72-4e1a-8152-c7acb3558415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:41.913205 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 863/1736] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:41 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:41.913205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5e25e-4aaf-47d0-9f24-032fc9954da6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:41.914129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0cd5e25e-4aaf-47d0-9f24-032fc9954da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:41.991162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5e25e-4aaf-47d0-9f24-032fc9954da6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:42.015232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17494b7f-ef72-4e1a-8152-c7acb3558415 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:42.025949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa02ee7-3d29-4860-ba4e-61cbf1f56967 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:42.026512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02ee7-3d29-4860-ba4e-61cbf1f56967 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:42.026802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02ee7-3d29-4860-ba4e-61cbf1f56967 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:42.027082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02ee7-3d29-4860-ba4e-61cbf1f56967 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:42.029174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2aa02ee7-3d29-4860-ba4e-61cbf1f56967 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:42.048260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456559c-894d-4816-9f4d-1eb7a484b166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:42.048957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456559c-894d-4816-9f4d-1eb7a484b166 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:42.049245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456559c-894d-4816-9f4d-1eb7a484b166 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:42.049521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456559c-894d-4816-9f4d-1eb7a484b166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:42.052062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d456559c-894d-4816-9f4d-1eb7a484b166 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:42.090800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa02ee7-3d29-4860-ba4e-61cbf1f56967 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:42.092378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa02ee7-3d29-4860-ba4e-61cbf1f56967 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:42.101660 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 874/1737] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:41 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:42.102499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa02ee7-3d29-4860-ba4e-61cbf1f56967 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:42.103886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2aa02ee7-3d29-4860-ba4e-61cbf1f56967 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:42.123454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456559c-894d-4816-9f4d-1eb7a484b166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:42.125460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456559c-894d-4816-9f4d-1eb7a484b166 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:42.142305 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 864/1738] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:42.143837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456559c-894d-4816-9f4d-1eb7a484b166 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:42.145634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d456559c-894d-4816-9f4d-1eb7a484b166 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:42.167014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456559c-894d-4816-9f4d-1eb7a484b166 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:42.174363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb9e42-6aab-4928-8a8b-30b17ad9e842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:42.174611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa02ee7-3d29-4860-ba4e-61cbf1f56967 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:42.175565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9e42-6aab-4928-8a8b-30b17ad9e842 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:42.176400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9e42-6aab-4928-8a8b-30b17ad9e842 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:42.176877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9e42-6aab-4928-8a8b-30b17ad9e842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:42.179091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-52cb9e42-6aab-4928-8a8b-30b17ad9e842 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:42.180036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827af54-90bd-461e-88a3-c970101d523f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:42.181485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827af54-90bd-461e-88a3-c970101d523f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:42.181777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827af54-90bd-461e-88a3-c970101d523f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:42.182058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827af54-90bd-461e-88a3-c970101d523f admin admin] PATH_INFO: `/v3/users/41baf6fcee8e45bf9804dd8b98eedcf1` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:42.183326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827af54-90bd-461e-88a3-c970101d523f admin admin] RBAC: Authorizing `identity:delete_user(user_id=41baf6fcee8e45bf9804dd8b98eedcf1)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:42.185270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827af54-90bd-461e-88a3-c970101d523f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:42.248141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d827af54-90bd-461e-88a3-c970101d523f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41baf6fcee8e45bf9804dd8b98eedcf1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:42.255931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d827af54-90bd-461e-88a3-c970101d523f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41baf6fcee8e45bf9804dd8b98eedcf1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:42.268699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb9e42-6aab-4928-8a8b-30b17ad9e842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:42.269330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d827af54-90bd-461e-88a3-c970101d523f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41baf6fcee8e45bf9804dd8b98eedcf1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:42.270113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d827af54-90bd-461e-88a3-c970101d523f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41baf6fcee8e45bf9804dd8b98eedcf1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:42.271433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb9e42-6aab-4928-8a8b-30b17ad9e842 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:42.279172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d827af54-90bd-461e-88a3-c970101d523f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41baf6fcee8e45bf9804dd8b98eedcf1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:42.287847 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 875/1739] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:42 2021] DELETE /identity/v3/users/41baf6fcee8e45bf9804dd8b98eedcf1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:42.289193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827af54-90bd-461e-88a3-c970101d523f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:42.291342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d827af54-90bd-461e-88a3-c970101d523f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:42.298831 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 865/1740] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:42 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:42.365989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c568f8c-aea1-4f56-9447-fcb216a13345 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:42.366890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c568f8c-aea1-4f56-9447-fcb216a13345 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:42.367177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c568f8c-aea1-4f56-9447-fcb216a13345 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:42.370580 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 866/1741] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:46:42 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:46:42.375073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827af54-90bd-461e-88a3-c970101d523f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:42.383018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6f645-d1f1-490f-bfc9-dae50b29af76 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:42.383384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6f645-d1f1-490f-bfc9-dae50b29af76 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:42.383677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6f645-d1f1-490f-bfc9-dae50b29af76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:42.388709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:42.389926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:42.390381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:42.390711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e admin admin] PATH_INFO: `/v3/projects/5d2297eec03a48769d234826a1af33ea` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:42.395767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d2297eec03a48769d234826a1af33ea)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:42.401237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:42.424923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5ec6f645-d1f1-490f-bfc9-dae50b29af76 None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:42.426142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5ec6f645-d1f1-490f-bfc9-dae50b29af76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:42.511620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d2297eec03a48769d234826a1af33ea', 'request_id': 'req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:42.516968 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 867/1742] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:46:42 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:42.518496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6f645-d1f1-490f-bfc9-dae50b29af76 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:42.519469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d2297eec03a48769d234826a1af33ea', 'request_id': 'req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:42.520515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5ec6f645-d1f1-490f-bfc9-dae50b29af76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:42.544764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6f645-d1f1-490f-bfc9-dae50b29af76 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:42.553924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d2297eec03a48769d234826a1af33ea', 'request_id': 'req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:42.579752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e admin admin] The token cache is being invalidate because project 5d2297eec03a48769d234826a1af33ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:42.580033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:42.580745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:42.582524 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 876/1743] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:42 2021] DELETE /identity/v3/projects/5d2297eec03a48769d234826a1af33ea => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:42.583496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:42.590935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:42.647258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be1962-d780-499d-809d-bfe9706630fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:42.647934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be1962-d780-499d-809d-bfe9706630fa service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:42.648207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be1962-d780-499d-809d-bfe9706630fa service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:42.648487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be1962-d780-499d-809d-bfe9706630fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:42.655189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d2be1962-d780-499d-809d-bfe9706630fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:42.715197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8764a-b5a5-4dd3-8719-fcaf41114b1e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:42.719273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a2c60-0521-4fad-af6e-45e92305d04a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:42.721215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a2c60-0521-4fad-af6e-45e92305d04a service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:42.721511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a2c60-0521-4fad-af6e-45e92305d04a service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:42.721827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a2c60-0521-4fad-af6e-45e92305d04a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:42.723859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-da6a2c60-0521-4fad-af6e-45e92305d04a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:42.738420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be1962-d780-499d-809d-bfe9706630fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:42.740981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be1962-d780-499d-809d-bfe9706630fa service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:42.747982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a2c60-0521-4fad-af6e-45e92305d04a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:42.749477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a2c60-0521-4fad-af6e-45e92305d04a service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:42.751813 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 868/1744] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:42 2021] GET /identity/v3/auth/tokens => generated 3278 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:42.753062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab348b0-c3b2-4f38-b2b9-472826d4a83c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:42.753339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab348b0-c3b2-4f38-b2b9-472826d4a83c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:42.753880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab348b0-c3b2-4f38-b2b9-472826d4a83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:42.776444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bab348b0-c3b2-4f38-b2b9-472826d4a83c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:42.777732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bab348b0-c3b2-4f38-b2b9-472826d4a83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:42.781560 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 877/1745] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:42 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:42.782595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a2c60-0521-4fad-af6e-45e92305d04a service glance] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:42.787283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-da6a2c60-0521-4fad-af6e-45e92305d04a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:42.863302 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 869/1746] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:42.864711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac251b-bebd-45c7-8030-f7c870ef919b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:42.865001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac251b-bebd-45c7-8030-f7c870ef919b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:42.865279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac251b-bebd-45c7-8030-f7c870ef919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:42.894168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9eac251b-bebd-45c7-8030-f7c870ef919b None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:42.895521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9eac251b-bebd-45c7-8030-f7c870ef919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:42.982397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a2c60-0521-4fad-af6e-45e92305d04a service glance] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:43.002795 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 870/1747] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:46:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:43.004019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac251b-bebd-45c7-8030-f7c870ef919b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:43.005290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9eac251b-bebd-45c7-8030-f7c870ef919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:43.007513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee057a-caad-4ee5-a102-042af658dfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:43.010167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee057a-caad-4ee5-a102-042af658dfa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:43.011800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee057a-caad-4ee5-a102-042af658dfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:43.013208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee057a-caad-4ee5-a102-042af658dfa3 admin admin] PATH_INFO: `/v3/projects/3c96780722de45bcb58f837b002f04fd` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:43.021613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee057a-caad-4ee5-a102-042af658dfa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c96780722de45bcb58f837b002f04fd)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:43.023051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac251b-bebd-45c7-8030-f7c870ef919b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:43.029956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee057a-caad-4ee5-a102-042af658dfa3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:43.033188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98421da-a677-4f77-b748-b67cefba48db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:43.034437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98421da-a677-4f77-b748-b67cefba48db admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:43.034777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98421da-a677-4f77-b748-b67cefba48db admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:43.035044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98421da-a677-4f77-b748-b67cefba48db admin admin] PATH_INFO: `/v3/users/3f837d6a45324047b431286734ff9d6b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:43.036542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98421da-a677-4f77-b748-b67cefba48db admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f837d6a45324047b431286734ff9d6b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:43.044546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98421da-a677-4f77-b748-b67cefba48db admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:43.170983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7fee057a-caad-4ee5-a102-042af658dfa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c96780722de45bcb58f837b002f04fd', 'request_id': 'req-7fee057a-caad-4ee5-a102-042af658dfa3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.187948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7fee057a-caad-4ee5-a102-042af658dfa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c96780722de45bcb58f837b002f04fd', 'request_id': 'req-7fee057a-caad-4ee5-a102-042af658dfa3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.201549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7fee057a-caad-4ee5-a102-042af658dfa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c96780722de45bcb58f837b002f04fd', 'request_id': 'req-7fee057a-caad-4ee5-a102-042af658dfa3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.203827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f98421da-a677-4f77-b748-b67cefba48db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f837d6a45324047b431286734ff9d6b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.221992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f98421da-a677-4f77-b748-b67cefba48db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f837d6a45324047b431286734ff9d6b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.223034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f98421da-a677-4f77-b748-b67cefba48db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f837d6a45324047b431286734ff9d6b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.225401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7fee057a-caad-4ee5-a102-042af658dfa3 admin admin] The token cache is being invalidate because project 3c96780722de45bcb58f837b002f04fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:43.225723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7fee057a-caad-4ee5-a102-042af658dfa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.227447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7fee057a-caad-4ee5-a102-042af658dfa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.230515 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 878/1748] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:42 2021] DELETE /identity/v3/projects/3c96780722de45bcb58f837b002f04fd => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:43.232240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cdee8-b3bd-407a-b40e-c46d084d2744 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:43.232978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cdee8-b3bd-407a-b40e-c46d084d2744 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:43.233274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cdee8-b3bd-407a-b40e-c46d084d2744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:43.267326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f84cdee8-b3bd-407a-b40e-c46d084d2744 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:43.268243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f98421da-a677-4f77-b748-b67cefba48db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f837d6a45324047b431286734ff9d6b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.269342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f84cdee8-b3bd-407a-b40e-c46d084d2744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:43.278690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f98421da-a677-4f77-b748-b67cefba48db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f837d6a45324047b431286734ff9d6b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.287196 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 871/1749] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:43 2021] DELETE /identity/v3/users/3f837d6a45324047b431286734ff9d6b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:43.290244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98421da-a677-4f77-b748-b67cefba48db admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:43.290244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f98421da-a677-4f77-b748-b67cefba48db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:43.379192 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 879/1750] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:43.379192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cdee8-b3bd-407a-b40e-c46d084d2744 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:43.379705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f84cdee8-b3bd-407a-b40e-c46d084d2744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:43.409078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98421da-a677-4f77-b748-b67cefba48db admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:43.426733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed06f36-8fdf-4c8a-9597-afac94370dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:43.427617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed06f36-8fdf-4c8a-9597-afac94370dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:43.427896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed06f36-8fdf-4c8a-9597-afac94370dad admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:43.428221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed06f36-8fdf-4c8a-9597-afac94370dad admin admin] PATH_INFO: `/v3/projects/cf2c454d55914e329ea2dcafcd2be35b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:43.429462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed06f36-8fdf-4c8a-9597-afac94370dad admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2c454d55914e329ea2dcafcd2be35b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:43.431982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed06f36-8fdf-4c8a-9597-afac94370dad admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:43.562751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bed06f36-8fdf-4c8a-9597-afac94370dad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2c454d55914e329ea2dcafcd2be35b', 'request_id': 'req-bed06f36-8fdf-4c8a-9597-afac94370dad'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.576885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cdee8-b3bd-407a-b40e-c46d084d2744 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:43.579261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bed06f36-8fdf-4c8a-9597-afac94370dad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2c454d55914e329ea2dcafcd2be35b', 'request_id': 'req-bed06f36-8fdf-4c8a-9597-afac94370dad'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.587906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bed06f36-8fdf-4c8a-9597-afac94370dad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2c454d55914e329ea2dcafcd2be35b', 'request_id': 'req-bed06f36-8fdf-4c8a-9597-afac94370dad'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.612149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bed06f36-8fdf-4c8a-9597-afac94370dad admin admin] The token cache is being invalidate because project cf2c454d55914e329ea2dcafcd2be35b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:43.612496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bed06f36-8fdf-4c8a-9597-afac94370dad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.613689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bed06f36-8fdf-4c8a-9597-afac94370dad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.615607 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 872/1751] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:43 2021] DELETE /identity/v3/projects/cf2c454d55914e329ea2dcafcd2be35b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:43.621738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed06f36-8fdf-4c8a-9597-afac94370dad admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:43.623268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bed06f36-8fdf-4c8a-9597-afac94370dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:43.730068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed06f36-8fdf-4c8a-9597-afac94370dad admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:43.736378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffe45e-5e97-4e6e-ad9d-4a3cece99c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:43.737437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffe45e-5e97-4e6e-ad9d-4a3cece99c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:43.737720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffe45e-5e97-4e6e-ad9d-4a3cece99c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:43.737992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffe45e-5e97-4e6e-ad9d-4a3cece99c40 admin admin] PATH_INFO: `/v3/users/88849a95f3514ad695eb27055a2e888e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:43.739434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffe45e-5e97-4e6e-ad9d-4a3cece99c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88849a95f3514ad695eb27055a2e888e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:43.742046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffe45e-5e97-4e6e-ad9d-4a3cece99c40 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:43.765950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b664f-fb59-4c88-8cbf-6db0c716b692 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:43.766721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b664f-fb59-4c88-8cbf-6db0c716b692 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:43.766934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b664f-fb59-4c88-8cbf-6db0c716b692 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:43.767216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b664f-fb59-4c88-8cbf-6db0c716b692 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:43.784070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5c8b664f-fb59-4c88-8cbf-6db0c716b692 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:43.811910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47ffe45e-5e97-4e6e-ad9d-4a3cece99c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88849a95f3514ad695eb27055a2e888e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.830675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47ffe45e-5e97-4e6e-ad9d-4a3cece99c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88849a95f3514ad695eb27055a2e888e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.831442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47ffe45e-5e97-4e6e-ad9d-4a3cece99c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88849a95f3514ad695eb27055a2e888e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.848555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b664f-fb59-4c88-8cbf-6db0c716b692 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:43.850339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b664f-fb59-4c88-8cbf-6db0c716b692 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:43.852523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47ffe45e-5e97-4e6e-ad9d-4a3cece99c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88849a95f3514ad695eb27055a2e888e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.864285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47ffe45e-5e97-4e6e-ad9d-4a3cece99c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88849a95f3514ad695eb27055a2e888e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:43.866526 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 880/1752] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:46:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:46:43.868521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf6ed5-3e9a-4362-b0af-bd6b7cfa3479 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:43.868875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf6ed5-3e9a-4362-b0af-bd6b7cfa3479 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:43.869216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf6ed5-3e9a-4362-b0af-bd6b7cfa3479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:43.875854 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 873/1753] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:43 2021] DELETE /identity/v3/users/88849a95f3514ad695eb27055a2e888e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:43.878285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffe45e-5e97-4e6e-ad9d-4a3cece99c40 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:43.879662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-47ffe45e-5e97-4e6e-ad9d-4a3cece99c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:43.888658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b9cf6ed5-3e9a-4362-b0af-bd6b7cfa3479 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:43.890152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b9cf6ed5-3e9a-4362-b0af-bd6b7cfa3479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:44.017884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffe45e-5e97-4e6e-ad9d-4a3cece99c40 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:44.025582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021e3bf-75a4-4ed5-9060-7de86d301f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:44.026363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021e3bf-75a4-4ed5-9060-7de86d301f0d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:44.026698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021e3bf-75a4-4ed5-9060-7de86d301f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:44.027963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021e3bf-75a4-4ed5-9060-7de86d301f0d admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:44.028809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021e3bf-75a4-4ed5-9060-7de86d301f0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:46:44.029362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021e3bf-75a4-4ed5-9060-7de86d301f0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:44.034412 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 881/1754] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:44.051087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021e3bf-75a4-4ed5-9060-7de86d301f0d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:44.052829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff4d01-2368-4404-a87d-e48ff5388a42 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:44.053181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff4d01-2368-4404-a87d-e48ff5388a42 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:44.053521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff4d01-2368-4404-a87d-e48ff5388a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:44.105457 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 874/1755] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:46:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:46:44.113057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021e3bf-75a4-4ed5-9060-7de86d301f0d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:44.121363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f021e3bf-75a4-4ed5-9060-7de86d301f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:44.130567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8fff4d01-2368-4404-a87d-e48ff5388a42 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:44.149231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8fff4d01-2368-4404-a87d-e48ff5388a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:44.186296 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 882/1756] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:44.186296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff4d01-2368-4404-a87d-e48ff5388a42 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:44.186296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8fff4d01-2368-4404-a87d-e48ff5388a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:44.260007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021e3bf-75a4-4ed5-9060-7de86d301f0d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:44.294653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af471356-3c75-4ed9-b2af-7b620f4e4453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:44.295739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af471356-3c75-4ed9-b2af-7b620f4e4453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:44.296147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af471356-3c75-4ed9-b2af-7b620f4e4453 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:44.296479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af471356-3c75-4ed9-b2af-7b620f4e4453 admin admin] PATH_INFO: `/v3/users/1aa113311ab047528213dbb8102775ea` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:44.299938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af471356-3c75-4ed9-b2af-7b620f4e4453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa113311ab047528213dbb8102775ea)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:44.303305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af471356-3c75-4ed9-b2af-7b620f4e4453 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:44.347694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff4d01-2368-4404-a87d-e48ff5388a42 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:44.361307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d91f22-88ee-4652-b4ba-f3081d4c38c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:44.366292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d91f22-88ee-4652-b4ba-f3081d4c38c8 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:44.366490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d91f22-88ee-4652-b4ba-f3081d4c38c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:44.366772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d91f22-88ee-4652-b4ba-f3081d4c38c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:44.396150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d91f22-88ee-4652-b4ba-f3081d4c38c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:44.397670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d91f22-88ee-4652-b4ba-f3081d4c38c8 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:44.426762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-af471356-3c75-4ed9-b2af-7b620f4e4453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa113311ab047528213dbb8102775ea'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:44.438712 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 883/1757] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:44.439610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d91f22-88ee-4652-b4ba-f3081d4c38c8 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:44.454412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-af471356-3c75-4ed9-b2af-7b620f4e4453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa113311ab047528213dbb8102775ea'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:44.455692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-af471356-3c75-4ed9-b2af-7b620f4e4453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa113311ab047528213dbb8102775ea'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:44.462541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d91f22-88ee-4652-b4ba-f3081d4c38c8 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:44.478202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874b32c-ed2e-4ff5-bf41-4cf0cb6383c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:44.479057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874b32c-ed2e-4ff5-bf41-4cf0cb6383c2 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:44.479188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874b32c-ed2e-4ff5-bf41-4cf0cb6383c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:44.479459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874b32c-ed2e-4ff5-bf41-4cf0cb6383c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:44.480220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874b32c-ed2e-4ff5-bf41-4cf0cb6383c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:44.482169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874b32c-ed2e-4ff5-bf41-4cf0cb6383c2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:44.509961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-af471356-3c75-4ed9-b2af-7b620f4e4453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa113311ab047528213dbb8102775ea'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:44.530518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-af471356-3c75-4ed9-b2af-7b620f4e4453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa113311ab047528213dbb8102775ea'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:44.540920 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 884/1758] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:44 2021] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:44.545946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a2368-3222-430c-bb91-081085ec744e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:44.546234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a2368-3222-430c-bb91-081085ec744e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:44.546545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a2368-3222-430c-bb91-081085ec744e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:44.563156 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 875/1759] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:44 2021] DELETE /identity/v3/users/1aa113311ab047528213dbb8102775ea => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:44.564984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d730743-6aa9-4b42-ac4e-56d6e0e1c3a1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:44.565339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d730743-6aa9-4b42-ac4e-56d6e0e1c3a1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:44.569055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d730743-6aa9-4b42-ac4e-56d6e0e1c3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:44.595947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5d9a2368-3222-430c-bb91-081085ec744e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:44.597209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5d9a2368-3222-430c-bb91-081085ec744e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:44.739772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8d730743-6aa9-4b42-ac4e-56d6e0e1c3a1 None None] MFA Rules not processed for user `6f8eeb55c523480fb45d4bbb8afe8e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:44.742194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8d730743-6aa9-4b42-ac4e-56d6e0e1c3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:44.754940 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 885/1760] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:44.757846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a2368-3222-430c-bb91-081085ec744e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:44.762366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5d9a2368-3222-430c-bb91-081085ec744e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:44.792812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a2368-3222-430c-bb91-081085ec744e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:44.804922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07304362-669f-4db6-a00c-ef4f6e3d9cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:44.814081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07304362-669f-4db6-a00c-ef4f6e3d9cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:44.814664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07304362-669f-4db6-a00c-ef4f6e3d9cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:44.815087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07304362-669f-4db6-a00c-ef4f6e3d9cb0 admin admin] PATH_INFO: `/v3/projects/eea784636a9d4c95904d7121290a2936` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:44.824639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07304362-669f-4db6-a00c-ef4f6e3d9cb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea784636a9d4c95904d7121290a2936)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:44.829527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07304362-669f-4db6-a00c-ef4f6e3d9cb0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:44.871725 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 876/1761] 10.222.0.31 () {58 vars in 1015 bytes} [Sat Dec 18 20:46:44 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:44.872927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d730743-6aa9-4b42-ac4e-56d6e0e1c3a1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:44.874379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8d730743-6aa9-4b42-ac4e-56d6e0e1c3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:44.892004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d730743-6aa9-4b42-ac4e-56d6e0e1c3a1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:44.901038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f967387-8cec-4f09-af5c-a02ce191ff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:44.901741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f967387-8cec-4f09-af5c-a02ce191ff1e admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:44.902208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f967387-8cec-4f09-af5c-a02ce191ff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:44.902774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f967387-8cec-4f09-af5c-a02ce191ff1e admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:44.904317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f967387-8cec-4f09-af5c-a02ce191ff1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:44.906703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f967387-8cec-4f09-af5c-a02ce191ff1e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:44.946117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-07304362-669f-4db6-a00c-ef4f6e3d9cb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea784636a9d4c95904d7121290a2936', 'request_id': 'req-07304362-669f-4db6-a00c-ef4f6e3d9cb0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:44.954341 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 877/1762] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:44 2021] POST /identity/v3/users => generated 292 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:44.955601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-07304362-669f-4db6-a00c-ef4f6e3d9cb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea784636a9d4c95904d7121290a2936', 'request_id': 'req-07304362-669f-4db6-a00c-ef4f6e3d9cb0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:44.957986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37da37-9ae9-41dd-84a7-e7568638d950 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:44.959356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37da37-9ae9-41dd-84a7-e7568638d950 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:44.960439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37da37-9ae9-41dd-84a7-e7568638d950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:44.962617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-07304362-669f-4db6-a00c-ef4f6e3d9cb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea784636a9d4c95904d7121290a2936', 'request_id': 'req-07304362-669f-4db6-a00c-ef4f6e3d9cb0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:44.991659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-07304362-669f-4db6-a00c-ef4f6e3d9cb0 admin admin] The token cache is being invalidate because project eea784636a9d4c95904d7121290a2936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:44.991884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7e37da37-9ae9-41dd-84a7-e7568638d950 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:44.991985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-07304362-669f-4db6-a00c-ef4f6e3d9cb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:44.994151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7e37da37-9ae9-41dd-84a7-e7568638d950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:44.995516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-07304362-669f-4db6-a00c-ef4f6e3d9cb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:44.998369 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 886/1763] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:44 2021] DELETE /identity/v3/projects/eea784636a9d4c95904d7121290a2936 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:44.998980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07304362-669f-4db6-a00c-ef4f6e3d9cb0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:45.008679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-07304362-669f-4db6-a00c-ef4f6e3d9cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:45.103951 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 878/1764] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:45.105442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37da37-9ae9-41dd-84a7-e7568638d950 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:45.116785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7e37da37-9ae9-41dd-84a7-e7568638d950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:45.198177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07304362-669f-4db6-a00c-ef4f6e3d9cb0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:45.207442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514374a7-4fd7-4598-99d7-28657b20b570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:45.208128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514374a7-4fd7-4598-99d7-28657b20b570 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:45.208483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514374a7-4fd7-4598-99d7-28657b20b570 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:45.208775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514374a7-4fd7-4598-99d7-28657b20b570 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:45.209701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514374a7-4fd7-4598-99d7-28657b20b570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:46:45.210109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514374a7-4fd7-4598-99d7-28657b20b570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:45.212691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514374a7-4fd7-4598-99d7-28657b20b570 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:45.221454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37da37-9ae9-41dd-84a7-e7568638d950 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:45.226848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adc2d2-6345-4269-95d3-ad1af64d9b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:45.227413 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 887/1765] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:46:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:46:45.227771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adc2d2-6345-4269-95d3-ad1af64d9b8f service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:45.228062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adc2d2-6345-4269-95d3-ad1af64d9b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:45.228350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adc2d2-6345-4269-95d3-ad1af64d9b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:45.228504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514374a7-4fd7-4598-99d7-28657b20b570 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:45.230569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-514374a7-4fd7-4598-99d7-28657b20b570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:45.232158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-49adc2d2-6345-4269-95d3-ad1af64d9b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:45.244271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514374a7-4fd7-4598-99d7-28657b20b570 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:45.244477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49adc2d2-6345-4269-95d3-ad1af64d9b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:45.254788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49adc2d2-6345-4269-95d3-ad1af64d9b8f service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:45.257299 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 879/1766] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:45 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:45.259387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2b437-9868-4e1a-9688-c76200b378df None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:45.259692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2b437-9868-4e1a-9688-c76200b378df None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:45.260059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2b437-9868-4e1a-9688-c76200b378df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:45.267837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461ed2e-dcd9-4df2-9e28-d86944fcfd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:45.269364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461ed2e-dcd9-4df2-9e28-d86944fcfd06 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:45.271890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461ed2e-dcd9-4df2-9e28-d86944fcfd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:45.272292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461ed2e-dcd9-4df2-9e28-d86944fcfd06 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:45.273427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461ed2e-dcd9-4df2-9e28-d86944fcfd06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:45.277427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461ed2e-dcd9-4df2-9e28-d86944fcfd06 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:45.283774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1bc2b437-9868-4e1a-9688-c76200b378df None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:45.285104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1bc2b437-9868-4e1a-9688-c76200b378df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:45.297118 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 880/1767] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:45.302368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2b437-9868-4e1a-9688-c76200b378df None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:45.309734 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 888/1768] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:45 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:45.309734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461ed2e-dcd9-4df2-9e28-d86944fcfd06 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:45.317160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c461ed2e-dcd9-4df2-9e28-d86944fcfd06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:45.326148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2b437-9868-4e1a-9688-c76200b378df None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:45.331080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3c925-6c4b-4a37-a7fd-c9419d4882f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:45.332146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3c925-6c4b-4a37-a7fd-c9419d4882f3 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:45.333213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3c925-6c4b-4a37-a7fd-c9419d4882f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:45.333646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3c925-6c4b-4a37-a7fd-c9419d4882f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:45.337769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461ed2e-dcd9-4df2-9e28-d86944fcfd06 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:45.348758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3c925-6c4b-4a37-a7fd-c9419d4882f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:45.350571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3c925-6c4b-4a37-a7fd-c9419d4882f3 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:45.360802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e771c-37ff-46b3-88a4-86f038648f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:45.361706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e771c-37ff-46b3-88a4-86f038648f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:45.362185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e771c-37ff-46b3-88a4-86f038648f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:45.362575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e771c-37ff-46b3-88a4-86f038648f68 admin admin] PATH_INFO: `/v3/projects/d76f59e79d2644fdb8fdecb14f0a06cc` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:45.364062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e771c-37ff-46b3-88a4-86f038648f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76f59e79d2644fdb8fdecb14f0a06cc)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:45.366345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e771c-37ff-46b3-88a4-86f038648f68 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:45.366550 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 881/1769] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:45.368107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3c925-6c4b-4a37-a7fd-c9419d4882f3 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:45.379742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3c925-6c4b-4a37-a7fd-c9419d4882f3 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:45.386413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cc462-b46d-4946-8bd0-d17f46ddb519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:45.387415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cc462-b46d-4946-8bd0-d17f46ddb519 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:45.387842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cc462-b46d-4946-8bd0-d17f46ddb519 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:45.388263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cc462-b46d-4946-8bd0-d17f46ddb519 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:45.389126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cc462-b46d-4946-8bd0-d17f46ddb519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:45.391384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cc462-b46d-4946-8bd0-d17f46ddb519 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:45.432529 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 882/1770] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:45 2021] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:45.437692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96a9e1-cf8c-4c99-9cb1-6be67b16c1c0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:45.437986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96a9e1-cf8c-4c99-9cb1-6be67b16c1c0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:45.438095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0f7e771c-37ff-46b3-88a4-86f038648f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76f59e79d2644fdb8fdecb14f0a06cc', 'request_id': 'req-0f7e771c-37ff-46b3-88a4-86f038648f68'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:45.440426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96a9e1-cf8c-4c99-9cb1-6be67b16c1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:45.447690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0f7e771c-37ff-46b3-88a4-86f038648f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76f59e79d2644fdb8fdecb14f0a06cc', 'request_id': 'req-0f7e771c-37ff-46b3-88a4-86f038648f68'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:45.467440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0f7e771c-37ff-46b3-88a4-86f038648f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76f59e79d2644fdb8fdecb14f0a06cc', 'request_id': 'req-0f7e771c-37ff-46b3-88a4-86f038648f68'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:45.480789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5c96a9e1-cf8c-4c99-9cb1-6be67b16c1c0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:45.483750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5c96a9e1-cf8c-4c99-9cb1-6be67b16c1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:45.484713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0f7e771c-37ff-46b3-88a4-86f038648f68 admin admin] The token cache is being invalidate because project d76f59e79d2644fdb8fdecb14f0a06cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:45.485152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0f7e771c-37ff-46b3-88a4-86f038648f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:45.486199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0f7e771c-37ff-46b3-88a4-86f038648f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:45.490912 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 889/1771] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:45 2021] DELETE /identity/v3/projects/d76f59e79d2644fdb8fdecb14f0a06cc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:45.490912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e771c-37ff-46b3-88a4-86f038648f68 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:45.492338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0f7e771c-37ff-46b3-88a4-86f038648f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:45.576263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e771c-37ff-46b3-88a4-86f038648f68 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:45.620928 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 883/1772] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:45.620928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96a9e1-cf8c-4c99-9cb1-6be67b16c1c0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:45.632645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5c96a9e1-cf8c-4c99-9cb1-6be67b16c1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:45.638989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f5b82-25c4-43ae-8f33-c5a352e39bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:45.639722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f5b82-25c4-43ae-8f33-c5a352e39bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:45.640007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f5b82-25c4-43ae-8f33-c5a352e39bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:45.640283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f5b82-25c4-43ae-8f33-c5a352e39bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:45.641020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f5b82-25c4-43ae-8f33-c5a352e39bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:45.642710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f5b82-25c4-43ae-8f33-c5a352e39bf6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:45.649043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96a9e1-cf8c-4c99-9cb1-6be67b16c1c0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:45.654136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b588e-ede8-4330-8b58-9083c2d1c9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:45.655037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b588e-ede8-4330-8b58-9083c2d1c9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:45.655447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b588e-ede8-4330-8b58-9083c2d1c9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:45.655859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b588e-ede8-4330-8b58-9083c2d1c9f4 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:45.656753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b588e-ede8-4330-8b58-9083c2d1c9f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:45.658228 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 890/1773] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:45 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:45.659237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f5b82-25c4-43ae-8f33-c5a352e39bf6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:45.660077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b588e-ede8-4330-8b58-9083c2d1c9f4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:45.665302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a71f5b82-25c4-43ae-8f33-c5a352e39bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:45.701976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f5b82-25c4-43ae-8f33-c5a352e39bf6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:45.707472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe4086-d15a-4cda-96a1-51e96718b91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:45.708513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe4086-d15a-4cda-96a1-51e96718b91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:45.710327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe4086-d15a-4cda-96a1-51e96718b91e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:45.711438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe4086-d15a-4cda-96a1-51e96718b91e admin admin] PATH_INFO: `/v3/users/a7de451913494921ba929ba74ba43a67` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:45.713139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe4086-d15a-4cda-96a1-51e96718b91e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7de451913494921ba929ba74ba43a67)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:45.718128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe4086-d15a-4cda-96a1-51e96718b91e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:45.720146 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 884/1774] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:45 2021] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:45.723005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b588e-ede8-4330-8b58-9083c2d1c9f4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:45.745723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b588e-ede8-4330-8b58-9083c2d1c9f4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:45.759391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32be78-bf15-4360-baba-0f315c3c9353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:45.760434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32be78-bf15-4360-baba-0f315c3c9353 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:45.760982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32be78-bf15-4360-baba-0f315c3c9353 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:45.761578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32be78-bf15-4360-baba-0f315c3c9353 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:45.762802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32be78-bf15-4360-baba-0f315c3c9353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:46:45.763378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32be78-bf15-4360-baba-0f315c3c9353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:45.765306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32be78-bf15-4360-baba-0f315c3c9353 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:45.799681 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 885/1775] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:46:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:46:45.800092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbbe4086-d15a-4cda-96a1-51e96718b91e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7de451913494921ba929ba74ba43a67'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:45.803434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32be78-bf15-4360-baba-0f315c3c9353 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:45.812371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbbe4086-d15a-4cda-96a1-51e96718b91e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7de451913494921ba929ba74ba43a67'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:45.824432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32be78-bf15-4360-baba-0f315c3c9353 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:45.832678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbbe4086-d15a-4cda-96a1-51e96718b91e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7de451913494921ba929ba74ba43a67'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:45.833931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbbe4086-d15a-4cda-96a1-51e96718b91e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7de451913494921ba929ba74ba43a67'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:45.847240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbbe4086-d15a-4cda-96a1-51e96718b91e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7de451913494921ba929ba74ba43a67'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:45.854724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cf58a-069c-4481-87ad-a949fea0ff09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:45.859577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf58a-069c-4481-87ad-a949fea0ff09 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:45.859851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf58a-069c-4481-87ad-a949fea0ff09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:45.860203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf58a-069c-4481-87ad-a949fea0ff09 admin admin] PATH_INFO: `/v3/projects/a1bec72855984e15b784ddb87c4516cf/users/bda7ac78bfc44746b26992edcf507be5/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:45.864717 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 891/1776] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:45 2021] DELETE /identity/v3/users/a7de451913494921ba929ba74ba43a67 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:45.864717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe4086-d15a-4cda-96a1-51e96718b91e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:45.868832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cbbe4086-d15a-4cda-96a1-51e96718b91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:45.931760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cf58a-069c-4481-87ad-a949fea0ff09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1bec72855984e15b784ddb87c4516cf, user_id=bda7ac78bfc44746b26992edcf507be5, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:45.937786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cf58a-069c-4481-87ad-a949fea0ff09 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:45.991553 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 886/1777] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:45 2021] PUT /identity/v3/projects/a1bec72855984e15b784ddb87c4516cf/users/bda7ac78bfc44746b26992edcf507be5/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:45.992563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cf58a-069c-4481-87ad-a949fea0ff09 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:45.997291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-399cf58a-069c-4481-87ad-a949fea0ff09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:46.007174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe4086-d15a-4cda-96a1-51e96718b91e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:46.135782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00febd6-a66a-465c-896e-766feffe3208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:46.136432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00febd6-a66a-465c-896e-766feffe3208 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:46.136726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00febd6-a66a-465c-896e-766feffe3208 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:46.137003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00febd6-a66a-465c-896e-766feffe3208 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:46.139322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00febd6-a66a-465c-896e-766feffe3208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:46.144890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00febd6-a66a-465c-896e-766feffe3208 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:46.175816 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 892/1778] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:45 2021] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:46.182181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ea6f3-ec3b-4391-b1d6-76447fbddb35 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:46.182509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ea6f3-ec3b-4391-b1d6-76447fbddb35 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:46.182797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ea6f3-ec3b-4391-b1d6-76447fbddb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:46.261147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cf58a-069c-4481-87ad-a949fea0ff09 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:46.269477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fb5ea6f3-ec3b-4391-b1d6-76447fbddb35 None None] MFA Rules not processed for user `bda7ac78bfc44746b26992edcf507be5`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:46.275923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f83950-efeb-49bc-aa16-4eb56ca034e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:46.276606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f83950-efeb-49bc-aa16-4eb56ca034e1 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:46.276894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f83950-efeb-49bc-aa16-4eb56ca034e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:46.277183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f83950-efeb-49bc-aa16-4eb56ca034e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:46.277902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f83950-efeb-49bc-aa16-4eb56ca034e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:46.283274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fb5ea6f3-ec3b-4391-b1d6-76447fbddb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:46.286139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f83950-efeb-49bc-aa16-4eb56ca034e1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:46.334829 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 887/1779] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:45 2021] POST /identity/v3/projects => generated 377 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:46.336588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f83950-efeb-49bc-aa16-4eb56ca034e1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:46.462095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f83950-efeb-49bc-aa16-4eb56ca034e1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:46.481095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9109fe-f6f6-47c6-980f-66796ddbf3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:46.481910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9109fe-f6f6-47c6-980f-66796ddbf3aa admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:46.482200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9109fe-f6f6-47c6-980f-66796ddbf3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:46.482501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9109fe-f6f6-47c6-980f-66796ddbf3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:46.483336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9109fe-f6f6-47c6-980f-66796ddbf3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:46.485205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9109fe-f6f6-47c6-980f-66796ddbf3aa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:46.490601 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 893/1780] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:46 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:46.491755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ea6f3-ec3b-4391-b1d6-76447fbddb35 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:46.504341 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 888/1781] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:46 2021] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:46.504341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9109fe-f6f6-47c6-980f-66796ddbf3aa admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:46.506670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4f9109fe-f6f6-47c6-980f-66796ddbf3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:46.529499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9109fe-f6f6-47c6-980f-66796ddbf3aa admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:46.537199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1680f13-aac4-4b77-a454-59819e1f7dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:46.538126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1680f13-aac4-4b77-a454-59819e1f7dae admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:46.538558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1680f13-aac4-4b77-a454-59819e1f7dae admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:46.539010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1680f13-aac4-4b77-a454-59819e1f7dae admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:46.546433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1680f13-aac4-4b77-a454-59819e1f7dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:46.549221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1680f13-aac4-4b77-a454-59819e1f7dae admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:46.557738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ea6f3-ec3b-4391-b1d6-76447fbddb35 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:46.568418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a8379-d908-499e-81a1-87adc72c5383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:46.569781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a8379-d908-499e-81a1-87adc72c5383 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:46.570467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a8379-d908-499e-81a1-87adc72c5383 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:46.571093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a8379-d908-499e-81a1-87adc72c5383 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:46.572135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a8379-d908-499e-81a1-87adc72c5383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:46.575726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a8379-d908-499e-81a1-87adc72c5383 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:46.608097 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 889/1782] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:46 2021] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:46.610421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1680f13-aac4-4b77-a454-59819e1f7dae admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:46.626639 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 894/1783] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:46 2021] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:46.627502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a8379-d908-499e-81a1-87adc72c5383 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:46.658874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a8379-d908-499e-81a1-87adc72c5383 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:46.781443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ce3bc-476d-4a18-8db5-4327f1f2cbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:46.782321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ce3bc-476d-4a18-8db5-4327f1f2cbd4 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:46.783312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ce3bc-476d-4a18-8db5-4327f1f2cbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:46.783312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ce3bc-476d-4a18-8db5-4327f1f2cbd4 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:46.783802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ce3bc-476d-4a18-8db5-4327f1f2cbd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:46.786084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ce3bc-476d-4a18-8db5-4327f1f2cbd4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:46.808230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1680f13-aac4-4b77-a454-59819e1f7dae admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:46.825258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6edee3-7ae6-44b6-9569-a85a65a44b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:46.826410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6edee3-7ae6-44b6-9569-a85a65a44b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:46.826695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6edee3-7ae6-44b6-9569-a85a65a44b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:46.826982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6edee3-7ae6-44b6-9569-a85a65a44b6c admin admin] PATH_INFO: `/v3/projects/1c1f758740e442a0829910680148236b/users/b9e4893e5d944bce9da0588758509af4/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:46.832376 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 895/1784] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:46 2021] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:46.835122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ce3bc-476d-4a18-8db5-4327f1f2cbd4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:46.837934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9c4ce3bc-476d-4a18-8db5-4327f1f2cbd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:46.861453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6edee3-7ae6-44b6-9569-a85a65a44b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1f758740e442a0829910680148236b, user_id=b9e4893e5d944bce9da0588758509af4, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:46.866479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6edee3-7ae6-44b6-9569-a85a65a44b6c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:46.867880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ce3bc-476d-4a18-8db5-4327f1f2cbd4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:46.904947 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 890/1785] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:46 2021] PUT /identity/v3/projects/1c1f758740e442a0829910680148236b/users/b9e4893e5d944bce9da0588758509af4/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:46.904947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6edee3-7ae6-44b6-9569-a85a65a44b6c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:46.905427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de4596-437f-4c48-8742-09074677f15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:46.905427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de4596-437f-4c48-8742-09074677f15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:46.905427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de4596-437f-4c48-8742-09074677f15c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:46.905427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de4596-437f-4c48-8742-09074677f15c admin admin] PATH_INFO: `/v3/projects/8a5caa20873b44c4a1818f17e4484682` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:46.906108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de4596-437f-4c48-8742-09074677f15c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5caa20873b44c4a1818f17e4484682)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:46.909922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de4596-437f-4c48-8742-09074677f15c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:46.996952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6edee3-7ae6-44b6-9569-a85a65a44b6c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:47.003174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b9986-ee11-4b72-b89c-345e910eb0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:47.004090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b9986-ee11-4b72-b89c-345e910eb0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:47.004522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b9986-ee11-4b72-b89c-345e910eb0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:47.005559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b9986-ee11-4b72-b89c-345e910eb0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:47.006871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b9986-ee11-4b72-b89c-345e910eb0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:47.008872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b9986-ee11-4b72-b89c-345e910eb0f4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:47.034375 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 891/1786] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:46 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:47.036177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b9986-ee11-4b72-b89c-345e910eb0f4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:47.062299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a0de4596-437f-4c48-8742-09074677f15c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5caa20873b44c4a1818f17e4484682', 'request_id': 'req-a0de4596-437f-4c48-8742-09074677f15c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:47.067400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b9986-ee11-4b72-b89c-345e910eb0f4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:47.091642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a0de4596-437f-4c48-8742-09074677f15c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5caa20873b44c4a1818f17e4484682', 'request_id': 'req-a0de4596-437f-4c48-8742-09074677f15c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:47.115424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a0de4596-437f-4c48-8742-09074677f15c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5caa20873b44c4a1818f17e4484682', 'request_id': 'req-a0de4596-437f-4c48-8742-09074677f15c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:47.146464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6aca9-f3af-4e79-a750-a67b8b6fa199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:47.147262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6aca9-f3af-4e79-a750-a67b8b6fa199 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:47.147544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6aca9-f3af-4e79-a750-a67b8b6fa199 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:47.147901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6aca9-f3af-4e79-a750-a67b8b6fa199 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:47.148823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6aca9-f3af-4e79-a750-a67b8b6fa199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:47.151185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6aca9-f3af-4e79-a750-a67b8b6fa199 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:47.153788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a0de4596-437f-4c48-8742-09074677f15c admin admin] The token cache is being invalidate because project 8a5caa20873b44c4a1818f17e4484682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:47.154084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a0de4596-437f-4c48-8742-09074677f15c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:47.158523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a0de4596-437f-4c48-8742-09074677f15c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:47.164849 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 896/1787] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:46 2021] DELETE /identity/v3/projects/8a5caa20873b44c4a1818f17e4484682 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:47.166675 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 892/1788] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:47 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:47.168089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28229089-a7d4-4939-b2fa-b1e825c2bbb6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:47.168384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28229089-a7d4-4939-b2fa-b1e825c2bbb6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:47.168718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28229089-a7d4-4939-b2fa-b1e825c2bbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:47.171016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de4596-437f-4c48-8742-09074677f15c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:47.174456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a0de4596-437f-4c48-8742-09074677f15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:47.214343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-28229089-a7d4-4939-b2fa-b1e825c2bbb6 None None] MFA Rules not processed for user `b9e4893e5d944bce9da0588758509af4`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:47.218709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-28229089-a7d4-4939-b2fa-b1e825c2bbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:47.220926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de4596-437f-4c48-8742-09074677f15c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:47.244972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbbb58-bdde-4481-903f-fe92e5fe0c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:47.245875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbbb58-bdde-4481-903f-fe92e5fe0c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:47.246187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbbb58-bdde-4481-903f-fe92e5fe0c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:47.246473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbbb58-bdde-4481-903f-fe92e5fe0c98 admin admin] PATH_INFO: `/v3/projects/f29dd54b2964457e95128f9a02b57ccc` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:47.253158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbbb58-bdde-4481-903f-fe92e5fe0c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f29dd54b2964457e95128f9a02b57ccc)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:47.257026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbbb58-bdde-4481-903f-fe92e5fe0c98 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:47.304248 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 893/1789] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:47 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:47.305955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55992e-f835-4723-a1c1-c0463938c9ee None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:47.306409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55992e-f835-4723-a1c1-c0463938c9ee None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:47.306771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55992e-f835-4723-a1c1-c0463938c9ee None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:47.308937 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 894/1790] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:46:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:46:47.309771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55992e-f835-4723-a1c1-c0463938c9ee None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:47.312330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fc55992e-f835-4723-a1c1-c0463938c9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:47.328865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55992e-f835-4723-a1c1-c0463938c9ee None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:47.339467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea1b34-bcf5-46ad-a58d-cfe4a8417ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:47.341766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea1b34-bcf5-46ad-a58d-cfe4a8417ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:47.342845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea1b34-bcf5-46ad-a58d-cfe4a8417ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:47.343321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea1b34-bcf5-46ad-a58d-cfe4a8417ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:47.344626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea1b34-bcf5-46ad-a58d-cfe4a8417ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:47.349372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea1b34-bcf5-46ad-a58d-cfe4a8417ac8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:47.374557 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 895/1791] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:47 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:47.376332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc05add-e71c-4ccb-aa68-c9ea9abc479c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:47.381834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc05add-e71c-4ccb-aa68-c9ea9abc479c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:47.382283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc05add-e71c-4ccb-aa68-c9ea9abc479c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:47.413434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2cc05add-e71c-4ccb-aa68-c9ea9abc479c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:47.419079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2cc05add-e71c-4ccb-aa68-c9ea9abc479c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:47.423492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74cbbb58-bdde-4481-903f-fe92e5fe0c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f29dd54b2964457e95128f9a02b57ccc', 'request_id': 'req-74cbbb58-bdde-4481-903f-fe92e5fe0c98'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:47.431662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74cbbb58-bdde-4481-903f-fe92e5fe0c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f29dd54b2964457e95128f9a02b57ccc', 'request_id': 'req-74cbbb58-bdde-4481-903f-fe92e5fe0c98'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:47.438665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74cbbb58-bdde-4481-903f-fe92e5fe0c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f29dd54b2964457e95128f9a02b57ccc', 'request_id': 'req-74cbbb58-bdde-4481-903f-fe92e5fe0c98'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:47.469139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74cbbb58-bdde-4481-903f-fe92e5fe0c98 admin admin] The token cache is being invalidate because project f29dd54b2964457e95128f9a02b57ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:47.469139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74cbbb58-bdde-4481-903f-fe92e5fe0c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:47.469139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74cbbb58-bdde-4481-903f-fe92e5fe0c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:47.475249 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 897/1792] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:47 2021] DELETE /identity/v3/projects/f29dd54b2964457e95128f9a02b57ccc => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:47.476280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbbb58-bdde-4481-903f-fe92e5fe0c98 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:47.478030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-74cbbb58-bdde-4481-903f-fe92e5fe0c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:47.511692 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 896/1793] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:47.512769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc05add-e71c-4ccb-aa68-c9ea9abc479c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:47.514192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2cc05add-e71c-4ccb-aa68-c9ea9abc479c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:47.527538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc05add-e71c-4ccb-aa68-c9ea9abc479c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:47.532332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16395fb-f112-40b6-97b9-bceec49cc271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:47.532993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16395fb-f112-40b6-97b9-bceec49cc271 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:47.542497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16395fb-f112-40b6-97b9-bceec49cc271 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:47.542857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16395fb-f112-40b6-97b9-bceec49cc271 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:47.543611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16395fb-f112-40b6-97b9-bceec49cc271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:47.545554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16395fb-f112-40b6-97b9-bceec49cc271 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:47.552577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbbb58-bdde-4481-903f-fe92e5fe0c98 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:47.558716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d5ec1-f55e-43df-a299-67b11f361a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:47.560669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d5ec1-f55e-43df-a299-67b11f361a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:47.561223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d5ec1-f55e-43df-a299-67b11f361a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:47.562095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d5ec1-f55e-43df-a299-67b11f361a99 admin admin] PATH_INFO: `/v3/projects/7dc44731a90b43229a1aef2876e01c26/users/e1ed840352674b438f2ae2e6df3a6636/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:47.574684 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 897/1794] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:47 2021] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:47.575920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfeb8e5-6eb4-454e-a3ea-3fb7afd2c7ba None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:47.576216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfeb8e5-6eb4-454e-a3ea-3fb7afd2c7ba None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:47.576499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfeb8e5-6eb4-454e-a3ea-3fb7afd2c7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:47.578815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d5ec1-f55e-43df-a299-67b11f361a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc44731a90b43229a1aef2876e01c26, user_id=e1ed840352674b438f2ae2e6df3a6636, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:47.582192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d5ec1-f55e-43df-a299-67b11f361a99 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:47.598352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4bfeb8e5-6eb4-454e-a3ea-3fb7afd2c7ba None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:47.599983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4bfeb8e5-6eb4-454e-a3ea-3fb7afd2c7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:47.603906 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 898/1795] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:47 2021] PUT /identity/v3/projects/7dc44731a90b43229a1aef2876e01c26/users/e1ed840352674b438f2ae2e6df3a6636/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:47.604821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d5ec1-f55e-43df-a299-67b11f361a99 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:47.611393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6c2d5ec1-f55e-43df-a299-67b11f361a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:47.688338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d5ec1-f55e-43df-a299-67b11f361a99 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:47.694333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb90c9-0d77-4602-ab47-9b7eded134a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:47.695385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb90c9-0d77-4602-ab47-9b7eded134a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:47.696255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb90c9-0d77-4602-ab47-9b7eded134a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:47.696255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb90c9-0d77-4602-ab47-9b7eded134a8 admin admin] PATH_INFO: `/v3/projects/14f76973866547f0a574aeef810ea2ca/users/c1cef2e4be554adabdff1c3f00c1bd6d/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:47.710608 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 898/1796] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:46:47 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:47.710608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfeb8e5-6eb4-454e-a3ea-3fb7afd2c7ba None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:47.717537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4bfeb8e5-6eb4-454e-a3ea-3fb7afd2c7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:47.729537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb90c9-0d77-4602-ab47-9b7eded134a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f76973866547f0a574aeef810ea2ca, user_id=c1cef2e4be554adabdff1c3f00c1bd6d, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:47.736762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb90c9-0d77-4602-ab47-9b7eded134a8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:47.736938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfeb8e5-6eb4-454e-a3ea-3fb7afd2c7ba None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:47.742537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aae25-fefc-4805-a3cf-1181c50e344e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:47.744347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aae25-fefc-4805-a3cf-1181c50e344e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:47.744932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aae25-fefc-4805-a3cf-1181c50e344e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:47.745465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aae25-fefc-4805-a3cf-1181c50e344e admin admin] PATH_INFO: `/v3/users/46460d4afe6b44bd931bb01225aff2f6` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:47.747048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72aae25-fefc-4805-a3cf-1181c50e344e admin admin] RBAC: Authorizing `identity:delete_user(user_id=46460d4afe6b44bd931bb01225aff2f6)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:47.749968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72aae25-fefc-4805-a3cf-1181c50e344e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:47.767538 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 899/1797] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:47 2021] PUT /identity/v3/projects/14f76973866547f0a574aeef810ea2ca/users/c1cef2e4be554adabdff1c3f00c1bd6d/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:47.769172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb11494-604a-4692-ad5b-b37bca19a101 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:47.769611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb11494-604a-4692-ad5b-b37bca19a101 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:47.770023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb11494-604a-4692-ad5b-b37bca19a101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:47.802276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7bb11494-604a-4692-ad5b-b37bca19a101 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:47.804397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7bb11494-604a-4692-ad5b-b37bca19a101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:47.826182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a72aae25-fefc-4805-a3cf-1181c50e344e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46460d4afe6b44bd931bb01225aff2f6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:47.841755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a72aae25-fefc-4805-a3cf-1181c50e344e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46460d4afe6b44bd931bb01225aff2f6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:47.842807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a72aae25-fefc-4805-a3cf-1181c50e344e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46460d4afe6b44bd931bb01225aff2f6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:47.856710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a72aae25-fefc-4805-a3cf-1181c50e344e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46460d4afe6b44bd931bb01225aff2f6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:47.867392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a72aae25-fefc-4805-a3cf-1181c50e344e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46460d4afe6b44bd931bb01225aff2f6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:47.895329 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 899/1798] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:47 2021] DELETE /identity/v3/users/46460d4afe6b44bd931bb01225aff2f6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:47.896431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aae25-fefc-4805-a3cf-1181c50e344e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:47.898070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a72aae25-fefc-4805-a3cf-1181c50e344e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:47.907379 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 900/1799] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:47.910744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb11494-604a-4692-ad5b-b37bca19a101 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:47.910744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7bb11494-604a-4692-ad5b-b37bca19a101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:47.924975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb11494-604a-4692-ad5b-b37bca19a101 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:47.997051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aae25-fefc-4805-a3cf-1181c50e344e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:48.002606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ec189-5c5b-494a-b133-4306f2c5ae0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:48.003082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0874b26-a87b-4ab8-bfa4-a270a1231ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:48.003290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ec189-5c5b-494a-b133-4306f2c5ae0c admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:48.003648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ec189-5c5b-494a-b133-4306f2c5ae0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:48.003773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0874b26-a87b-4ab8-bfa4-a270a1231ddb admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:48.004074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ec189-5c5b-494a-b133-4306f2c5ae0c admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:48.004241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0874b26-a87b-4ab8-bfa4-a270a1231ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:48.004524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0874b26-a87b-4ab8-bfa4-a270a1231ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:48.004804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ec189-5c5b-494a-b133-4306f2c5ae0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:48.005299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0874b26-a87b-4ab8-bfa4-a270a1231ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:48.006744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ec189-5c5b-494a-b133-4306f2c5ae0c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:48.007267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0874b26-a87b-4ab8-bfa4-a270a1231ddb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:48.018521 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 901/1800] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:47 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:48.019504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0874b26-a87b-4ab8-bfa4-a270a1231ddb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:48.022819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f0874b26-a87b-4ab8-bfa4-a270a1231ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:48.048868 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 900/1801] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:47 2021] POST /identity/v3/users => generated 300 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:48.050453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778975a-1c2f-4d85-bef2-ef67ae9c6551 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:48.050941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778975a-1c2f-4d85-bef2-ef67ae9c6551 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:48.051231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778975a-1c2f-4d85-bef2-ef67ae9c6551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:48.082178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6778975a-1c2f-4d85-bef2-ef67ae9c6551 None None] MFA Rules not processed for user `c1cef2e4be554adabdff1c3f00c1bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:48.083572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6778975a-1c2f-4d85-bef2-ef67ae9c6551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:48.165180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0874b26-a87b-4ab8-bfa4-a270a1231ddb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:48.170970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a71f9-6d60-47bb-bc52-84369a27f94d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:48.171631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a71f9-6d60-47bb-bc52-84369a27f94d service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:48.171917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a71f9-6d60-47bb-bc52-84369a27f94d service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:48.172200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a71f9-6d60-47bb-bc52-84369a27f94d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:48.174196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-204a71f9-6d60-47bb-bc52-84369a27f94d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:48.176527 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 901/1802] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:48 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:48.177466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778975a-1c2f-4d85-bef2-ef67ae9c6551 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:48.188221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a71f9-6d60-47bb-bc52-84369a27f94d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:48.189301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778975a-1c2f-4d85-bef2-ef67ae9c6551 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:48.190274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a71f9-6d60-47bb-bc52-84369a27f94d service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:48.194688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba8497-a9e8-4702-92df-c89e895048f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:48.195416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba8497-a9e8-4702-92df-c89e895048f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:48.195705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba8497-a9e8-4702-92df-c89e895048f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:48.195995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba8497-a9e8-4702-92df-c89e895048f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:48.197329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba8497-a9e8-4702-92df-c89e895048f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:46:48.197704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba8497-a9e8-4702-92df-c89e895048f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:48.199493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba8497-a9e8-4702-92df-c89e895048f8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:48.203054 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 902/1803] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:48.204165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a71f9-6d60-47bb-bc52-84369a27f94d service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:48.219977 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 902/1804] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:46:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:46:48.220835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba8497-a9e8-4702-92df-c89e895048f8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:48.230818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a71f9-6d60-47bb-bc52-84369a27f94d service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:48.233852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba8497-a9e8-4702-92df-c89e895048f8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:48.237306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c92adc-b614-4f61-a273-66b40328e984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:48.238548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c92adc-b614-4f61-a273-66b40328e984 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:48.238849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0fec5-ad7c-4dba-b8c1-89c1bef5bfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:48.238998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c92adc-b614-4f61-a273-66b40328e984 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:48.239286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c92adc-b614-4f61-a273-66b40328e984 admin admin] PATH_INFO: `/v3/projects/7dc44731a90b43229a1aef2876e01c26/users/e1ed840352674b438f2ae2e6df3a6636/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:48.239514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0fec5-ad7c-4dba-b8c1-89c1bef5bfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:48.239801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0fec5-ad7c-4dba-b8c1-89c1bef5bfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:48.240083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0fec5-ad7c-4dba-b8c1-89c1bef5bfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:48.240828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0fec5-ad7c-4dba-b8c1-89c1bef5bfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:48.247110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0fec5-ad7c-4dba-b8c1-89c1bef5bfd2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:48.248498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c92adc-b614-4f61-a273-66b40328e984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc44731a90b43229a1aef2876e01c26, user_id=e1ed840352674b438f2ae2e6df3a6636, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:48.252167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c92adc-b614-4f61-a273-66b40328e984 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:48.263906 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 903/1805] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:48 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:48.264763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0fec5-ad7c-4dba-b8c1-89c1bef5bfd2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:48.267235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c9e0fec5-ad7c-4dba-b8c1-89c1bef5bfd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:48.289499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0fec5-ad7c-4dba-b8c1-89c1bef5bfd2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:48.296120 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 903/1806] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:48 2021] PUT /identity/v3/projects/7dc44731a90b43229a1aef2876e01c26/users/e1ed840352674b438f2ae2e6df3a6636/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:48.300211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c92adc-b614-4f61-a273-66b40328e984 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:48.370728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3da83-2ca9-4283-831f-7e32d57caf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:48.371462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3da83-2ca9-4283-831f-7e32d57caf65 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:48.371747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3da83-2ca9-4283-831f-7e32d57caf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:48.372070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3da83-2ca9-4283-831f-7e32d57caf65 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:48.372788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3da83-2ca9-4283-831f-7e32d57caf65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:48.374915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3da83-2ca9-4283-831f-7e32d57caf65 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:48.404460 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 904/1807] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:48 2021] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:48.405549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3da83-2ca9-4283-831f-7e32d57caf65 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:48.421924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c92adc-b614-4f61-a273-66b40328e984 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:48.476615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3da83-2ca9-4283-831f-7e32d57caf65 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:48.482001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896536c1-5e07-44dc-9362-1d6f63375cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:48.483371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896536c1-5e07-44dc-9362-1d6f63375cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:48.483810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896536c1-5e07-44dc-9362-1d6f63375cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:48.484254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896536c1-5e07-44dc-9362-1d6f63375cb2 admin admin] PATH_INFO: `/v3/projects/b2adf91e52aa4917b2b5cea4bc3e0bd3/users/f0cd779b29434fe69771becab092ee2d/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:48.489515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4baa77-1299-4b3e-880e-88c47dc34aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:48.490216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4baa77-1299-4b3e-880e-88c47dc34aea admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:48.490557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4baa77-1299-4b3e-880e-88c47dc34aea admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:48.490839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4baa77-1299-4b3e-880e-88c47dc34aea admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:48.491607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4baa77-1299-4b3e-880e-88c47dc34aea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:48.494528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4baa77-1299-4b3e-880e-88c47dc34aea admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:48.500514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896536c1-5e07-44dc-9362-1d6f63375cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2adf91e52aa4917b2b5cea4bc3e0bd3, user_id=f0cd779b29434fe69771becab092ee2d, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:48.503213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896536c1-5e07-44dc-9362-1d6f63375cb2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:48.523180 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 905/1808] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:48 2021] PUT /identity/v3/projects/b2adf91e52aa4917b2b5cea4bc3e0bd3/users/f0cd779b29434fe69771becab092ee2d/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:48.524147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896536c1-5e07-44dc-9362-1d6f63375cb2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:48.527843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-896536c1-5e07-44dc-9362-1d6f63375cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:48.532100 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 904/1809] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:48 2021] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:48.533488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3848b9-1daf-4a76-9ee3-232a28739222 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:48.533789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3848b9-1daf-4a76-9ee3-232a28739222 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:48.534093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3848b9-1daf-4a76-9ee3-232a28739222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:48.598305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ac3848b9-1daf-4a76-9ee3-232a28739222 None None] MFA Rules not processed for user `e1ed840352674b438f2ae2e6df3a6636`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:48.598305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ac3848b9-1daf-4a76-9ee3-232a28739222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:48.608245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896536c1-5e07-44dc-9362-1d6f63375cb2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:48.663970 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 905/1810] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:48 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:48.664785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3848b9-1daf-4a76-9ee3-232a28739222 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:48.670472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9f214-ffde-4716-a670-f06458af2071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:48.671606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9f214-ffde-4716-a670-f06458af2071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:48.671939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9f214-ffde-4716-a670-f06458af2071 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:48.672256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9f214-ffde-4716-a670-f06458af2071 admin admin] PATH_INFO: `/v3/projects/d56eb9d105b249e7bce1ad7ddc8f73d3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:48.673511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9f214-ffde-4716-a670-f06458af2071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d56eb9d105b249e7bce1ad7ddc8f73d3)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:48.675526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9f214-ffde-4716-a670-f06458af2071 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:48.737207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7a9f214-ffde-4716-a670-f06458af2071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd56eb9d105b249e7bce1ad7ddc8f73d3', 'request_id': 'req-e7a9f214-ffde-4716-a670-f06458af2071'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:48.740475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3848b9-1daf-4a76-9ee3-232a28739222 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:48.743708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7a9f214-ffde-4716-a670-f06458af2071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd56eb9d105b249e7bce1ad7ddc8f73d3', 'request_id': 'req-e7a9f214-ffde-4716-a670-f06458af2071'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:48.753858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7a9f214-ffde-4716-a670-f06458af2071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd56eb9d105b249e7bce1ad7ddc8f73d3', 'request_id': 'req-e7a9f214-ffde-4716-a670-f06458af2071'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:48.775600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7a9f214-ffde-4716-a670-f06458af2071 admin admin] The token cache is being invalidate because project d56eb9d105b249e7bce1ad7ddc8f73d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:48.775894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7a9f214-ffde-4716-a670-f06458af2071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:48.777105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7a9f214-ffde-4716-a670-f06458af2071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:48.782847 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 906/1811] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:48 2021] DELETE /identity/v3/projects/d56eb9d105b249e7bce1ad7ddc8f73d3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:48.782847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9f214-ffde-4716-a670-f06458af2071 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:48.784776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e7a9f214-ffde-4716-a670-f06458af2071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:48.825394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508db48c-b7a4-476f-9820-c136ac1ebdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:48.826669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508db48c-b7a4-476f-9820-c136ac1ebdbb admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:48.827153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508db48c-b7a4-476f-9820-c136ac1ebdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:48.827435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508db48c-b7a4-476f-9820-c136ac1ebdbb admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:48.828183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508db48c-b7a4-476f-9820-c136ac1ebdbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:48.830100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508db48c-b7a4-476f-9820-c136ac1ebdbb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:48.850607 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 906/1812] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:48 2021] POST /identity/v3/users => generated 295 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:48.855628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508db48c-b7a4-476f-9820-c136ac1ebdbb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:48.857302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-508db48c-b7a4-476f-9820-c136ac1ebdbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:48.860017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9f214-ffde-4716-a670-f06458af2071 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:48.864944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7aeb3b-c0db-4349-a446-7d55cfb40014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:48.865705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7aeb3b-c0db-4349-a446-7d55cfb40014 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:48.866136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7aeb3b-c0db-4349-a446-7d55cfb40014 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:48.866501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7aeb3b-c0db-4349-a446-7d55cfb40014 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:48.867587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7aeb3b-c0db-4349-a446-7d55cfb40014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:48.869092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508db48c-b7a4-476f-9820-c136ac1ebdbb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:48.869306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7aeb3b-c0db-4349-a446-7d55cfb40014 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:48.873870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dd813-cb7e-4715-84fb-15c0ee1b6039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:48.874582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dd813-cb7e-4715-84fb-15c0ee1b6039 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:48.874868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dd813-cb7e-4715-84fb-15c0ee1b6039 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:48.875151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dd813-cb7e-4715-84fb-15c0ee1b6039 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:48.876019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948dd813-cb7e-4715-84fb-15c0ee1b6039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:48.877922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948dd813-cb7e-4715-84fb-15c0ee1b6039 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:48.881957 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 907/1813] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:48 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:48.886455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7aeb3b-c0db-4349-a446-7d55cfb40014 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:48.888196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-df7aeb3b-c0db-4349-a446-7d55cfb40014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:48.900837 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 907/1814] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:48 2021] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:48.900837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74b27b-d154-435c-8056-185af9f0332f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:48.902656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74b27b-d154-435c-8056-185af9f0332f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:48.902767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74b27b-d154-435c-8056-185af9f0332f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:48.933477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5b74b27b-d154-435c-8056-185af9f0332f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:48.934730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5b74b27b-d154-435c-8056-185af9f0332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:48.955916 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 908/1815] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:48.957358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74b27b-d154-435c-8056-185af9f0332f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:48.959143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5b74b27b-d154-435c-8056-185af9f0332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:48.977740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74b27b-d154-435c-8056-185af9f0332f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:48.997516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c49785-4e94-43a2-a762-92df38126520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:48.998323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c49785-4e94-43a2-a762-92df38126520 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:48.998824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c49785-4e94-43a2-a762-92df38126520 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:48.999224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c49785-4e94-43a2-a762-92df38126520 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.000792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c49785-4e94-43a2-a762-92df38126520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:49.003361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c49785-4e94-43a2-a762-92df38126520 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:49.022302 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 909/1816] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:48 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:49.022302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c49785-4e94-43a2-a762-92df38126520 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:49.030719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7aeb3b-c0db-4349-a446-7d55cfb40014 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:49.036987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731b242-2def-4e2c-a170-cf75c89fe222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:49.037799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731b242-2def-4e2c-a170-cf75c89fe222 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.038085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731b242-2def-4e2c-a170-cf75c89fe222 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.038475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731b242-2def-4e2c-a170-cf75c89fe222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.040904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0731b242-2def-4e2c-a170-cf75c89fe222 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:49.065456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c49785-4e94-43a2-a762-92df38126520 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:49.070573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835bfcf-fed3-442f-b97b-fcaa8bd12cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:49.072150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835bfcf-fed3-442f-b97b-fcaa8bd12cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.072522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835bfcf-fed3-442f-b97b-fcaa8bd12cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.072883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835bfcf-fed3-442f-b97b-fcaa8bd12cb9 admin admin] PATH_INFO: `/v3/projects/b2adf91e52aa4917b2b5cea4bc3e0bd3/users/f0cd779b29434fe69771becab092ee2d/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.075160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835bfcf-fed3-442f-b97b-fcaa8bd12cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2adf91e52aa4917b2b5cea4bc3e0bd3, user_id=f0cd779b29434fe69771becab092ee2d, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:49.077913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835bfcf-fed3-442f-b97b-fcaa8bd12cb9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:49.103052 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 910/1817] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:49 2021] PUT /identity/v3/projects/b2adf91e52aa4917b2b5cea4bc3e0bd3/users/f0cd779b29434fe69771becab092ee2d/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:49.112374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835bfcf-fed3-442f-b97b-fcaa8bd12cb9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:49.140206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731b242-2def-4e2c-a170-cf75c89fe222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:49.142128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731b242-2def-4e2c-a170-cf75c89fe222 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:49.151705 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 908/1818] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:48 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:49.153198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39a840-4b38-4e46-ae01-ebf2d0b2e136 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.153487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39a840-4b38-4e46-ae01-ebf2d0b2e136 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.153767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39a840-4b38-4e46-ae01-ebf2d0b2e136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.179573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7d39a840-4b38-4e46-ae01-ebf2d0b2e136 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:49.181769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7d39a840-4b38-4e46-ae01-ebf2d0b2e136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:49.183626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835bfcf-fed3-442f-b97b-fcaa8bd12cb9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:49.192125 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 909/1819] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:49.192888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39a840-4b38-4e46-ae01-ebf2d0b2e136 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:49.197401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60705c4-02f6-4ed0-9d3d-f677f90a5007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:49.198356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60705c4-02f6-4ed0-9d3d-f677f90a5007 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.198644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60705c4-02f6-4ed0-9d3d-f677f90a5007 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.198942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60705c4-02f6-4ed0-9d3d-f677f90a5007 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.199681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60705c4-02f6-4ed0-9d3d-f677f90a5007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:49.201278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60705c4-02f6-4ed0-9d3d-f677f90a5007 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:49.210059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39a840-4b38-4e46-ae01-ebf2d0b2e136 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:49.214471 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 911/1820] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:49 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:49.215827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce983f75-3972-49ef-9796-38493328e53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:49.217026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce983f75-3972-49ef-9796-38493328e53e admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.217566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce983f75-3972-49ef-9796-38493328e53e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.217850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce983f75-3972-49ef-9796-38493328e53e admin admin] PATH_INFO: `/v3/projects/79c1a11aa4e0420fb64e2fecc5783455/users/9623a93108e2442bb6e99505d20929d1/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.218659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895533f6-02a8-453b-be2d-8a72752f2dd6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.218948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895533f6-02a8-453b-be2d-8a72752f2dd6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.219222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895533f6-02a8-453b-be2d-8a72752f2dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.237234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce983f75-3972-49ef-9796-38493328e53e admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c1a11aa4e0420fb64e2fecc5783455, user_id=9623a93108e2442bb6e99505d20929d1, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:49.239940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce983f75-3972-49ef-9796-38493328e53e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:49.257442 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 910/1821] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:49 2021] PUT /identity/v3/projects/79c1a11aa4e0420fb64e2fecc5783455/users/9623a93108e2442bb6e99505d20929d1/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:49.258168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce983f75-3972-49ef-9796-38493328e53e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:49.262089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-895533f6-02a8-453b-be2d-8a72752f2dd6 None None] MFA Rules not processed for user `f0cd779b29434fe69771becab092ee2d`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:49.262517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ce983f75-3972-49ef-9796-38493328e53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:49.264228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-895533f6-02a8-453b-be2d-8a72752f2dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:49.327460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce983f75-3972-49ef-9796-38493328e53e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:49.332098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5337a-d2d8-4403-86b2-e0591690c077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:49.332956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5337a-d2d8-4403-86b2-e0591690c077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.333262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5337a-d2d8-4403-86b2-e0591690c077 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.333535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5337a-d2d8-4403-86b2-e0591690c077 admin admin] PATH_INFO: `/v3/users/bda7ac78bfc44746b26992edcf507be5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.334766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5337a-d2d8-4403-86b2-e0591690c077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda7ac78bfc44746b26992edcf507be5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:49.336664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5337a-d2d8-4403-86b2-e0591690c077 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:49.340598 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 912/1822] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:49 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:49.341520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895533f6-02a8-453b-be2d-8a72752f2dd6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:49.358393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895533f6-02a8-453b-be2d-8a72752f2dd6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:49.368675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9daa4-dbb2-4dcb-a7cf-e1e23e2c8848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:49.369356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9daa4-dbb2-4dcb-a7cf-e1e23e2c8848 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.369639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9daa4-dbb2-4dcb-a7cf-e1e23e2c8848 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.369913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9daa4-dbb2-4dcb-a7cf-e1e23e2c8848 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.370798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9daa4-dbb2-4dcb-a7cf-e1e23e2c8848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:46:49.370984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9daa4-dbb2-4dcb-a7cf-e1e23e2c8848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:49.373251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9daa4-dbb2-4dcb-a7cf-e1e23e2c8848 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:49.387753 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 913/1823] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:46:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:46:49.388738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9daa4-dbb2-4dcb-a7cf-e1e23e2c8848 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:49.396248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1bb5337a-d2d8-4403-86b2-e0591690c077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda7ac78bfc44746b26992edcf507be5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:49.401502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9daa4-dbb2-4dcb-a7cf-e1e23e2c8848 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:49.403028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1bb5337a-d2d8-4403-86b2-e0591690c077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda7ac78bfc44746b26992edcf507be5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:49.403796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1bb5337a-d2d8-4403-86b2-e0591690c077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda7ac78bfc44746b26992edcf507be5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:49.412040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cc3e1-440b-4a57-bb24-b9b8f4642d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:49.412997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cc3e1-440b-4a57-bb24-b9b8f4642d69 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.413283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cc3e1-440b-4a57-bb24-b9b8f4642d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.413565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cc3e1-440b-4a57-bb24-b9b8f4642d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.414380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cc3e1-440b-4a57-bb24-b9b8f4642d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:49.416046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cc3e1-440b-4a57-bb24-b9b8f4642d69 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:49.418983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1bb5337a-d2d8-4403-86b2-e0591690c077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda7ac78bfc44746b26992edcf507be5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:49.429290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1bb5337a-d2d8-4403-86b2-e0591690c077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda7ac78bfc44746b26992edcf507be5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:49.435796 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 914/1824] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:49 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:49.436406 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 911/1825] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:49 2021] DELETE /identity/v3/users/bda7ac78bfc44746b26992edcf507be5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:49.437346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cc3e1-440b-4a57-bb24-b9b8f4642d69 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:49.438059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965d1cd-d288-4a4d-abfa-5595b6699e46 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.438382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965d1cd-d288-4a4d-abfa-5595b6699e46 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.438666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965d1cd-d288-4a4d-abfa-5595b6699e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.440453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-444cc3e1-440b-4a57-bb24-b9b8f4642d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:49.453969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cc3e1-440b-4a57-bb24-b9b8f4642d69 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:49.457397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c965d1cd-d288-4a4d-abfa-5595b6699e46 None None] MFA Rules not processed for user `b9e4893e5d944bce9da0588758509af4`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:49.458598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c965d1cd-d288-4a4d-abfa-5595b6699e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:49.510192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b885bd5-02cd-4665-b5dd-6d6dfb6caae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:49.510842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b885bd5-02cd-4665-b5dd-6d6dfb6caae9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.511131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b885bd5-02cd-4665-b5dd-6d6dfb6caae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.511410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b885bd5-02cd-4665-b5dd-6d6dfb6caae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.512147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b885bd5-02cd-4665-b5dd-6d6dfb6caae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:49.514396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b885bd5-02cd-4665-b5dd-6d6dfb6caae9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:49.527266 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 915/1826] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:49 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:49.530811 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 912/1827] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:49 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:49.530951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b885bd5-02cd-4665-b5dd-6d6dfb6caae9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:49.531033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965d1cd-d288-4a4d-abfa-5595b6699e46 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:49.531033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c965d1cd-d288-4a4d-abfa-5595b6699e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:49.533119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4b885bd5-02cd-4665-b5dd-6d6dfb6caae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:49.546693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b885bd5-02cd-4665-b5dd-6d6dfb6caae9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:49.547048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965d1cd-d288-4a4d-abfa-5595b6699e46 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:49.551616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949aa416-b194-4035-895e-62cd326ccdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:49.551762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a1409-c340-4524-bd2c-4f800cb3f198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:49.552284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949aa416-b194-4035-895e-62cd326ccdfa admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.552601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949aa416-b194-4035-895e-62cd326ccdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.552698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a1409-c340-4524-bd2c-4f800cb3f198 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.552878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a1409-c340-4524-bd2c-4f800cb3f198 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.552978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949aa416-b194-4035-895e-62cd326ccdfa admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.553322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a1409-c340-4524-bd2c-4f800cb3f198 admin admin] PATH_INFO: `/v3/projects/6a53df86cdf64762840ba9ff9232c0c2/users/0cb04b2e2bf0485fad61ca99141fb21d/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.553744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949aa416-b194-4035-895e-62cd326ccdfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:49.556279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949aa416-b194-4035-895e-62cd326ccdfa admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:49.570640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a1409-c340-4524-bd2c-4f800cb3f198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a53df86cdf64762840ba9ff9232c0c2, user_id=0cb04b2e2bf0485fad61ca99141fb21d, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:49.573433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a1409-c340-4524-bd2c-4f800cb3f198 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:49.594947 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 916/1828] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:49 2021] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:49.594947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a50a9-bf86-4c91-b9a3-1f176c80326e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.594947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a50a9-bf86-4c91-b9a3-1f176c80326e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.594947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a50a9-bf86-4c91-b9a3-1f176c80326e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.604893 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 913/1829] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:49 2021] PUT /identity/v3/projects/6a53df86cdf64762840ba9ff9232c0c2/users/0cb04b2e2bf0485fad61ca99141fb21d/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:49.605867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a1409-c340-4524-bd2c-4f800cb3f198 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:49.616876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e26a50a9-bf86-4c91-b9a3-1f176c80326e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:49.618707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e26a50a9-bf86-4c91-b9a3-1f176c80326e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:49.688432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a1409-c340-4524-bd2c-4f800cb3f198 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:49.700091 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 917/1830] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:49.700473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a50a9-bf86-4c91-b9a3-1f176c80326e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:49.701762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e26a50a9-bf86-4c91-b9a3-1f176c80326e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:49.781688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b39d7b-857e-43c5-83f5-7a0dc158c5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:49.782610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b39d7b-857e-43c5-83f5-7a0dc158c5d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.782891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b39d7b-857e-43c5-83f5-7a0dc158c5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.783173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b39d7b-857e-43c5-83f5-7a0dc158c5d0 admin admin] PATH_INFO: `/v3/projects/79c1a11aa4e0420fb64e2fecc5783455/users/9623a93108e2442bb6e99505d20929d1/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.785213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b39d7b-857e-43c5-83f5-7a0dc158c5d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c1a11aa4e0420fb64e2fecc5783455, user_id=9623a93108e2442bb6e99505d20929d1, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:49.788147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b39d7b-857e-43c5-83f5-7a0dc158c5d0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:49.799528 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 914/1831] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:49 2021] PUT /identity/v3/projects/79c1a11aa4e0420fb64e2fecc5783455/users/9623a93108e2442bb6e99505d20929d1/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:49.800331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b39d7b-857e-43c5-83f5-7a0dc158c5d0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:49.819533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a50a9-bf86-4c91-b9a3-1f176c80326e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:49.870090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b39d7b-857e-43c5-83f5-7a0dc158c5d0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:49.881221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a111f-3165-4452-9f66-ec5ac7ec721a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:49.881910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a111f-3165-4452-9f66-ec5ac7ec721a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.882577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a111f-3165-4452-9f66-ec5ac7ec721a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.882868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a111f-3165-4452-9f66-ec5ac7ec721a admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.883864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a111f-3165-4452-9f66-ec5ac7ec721a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:49.885553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a111f-3165-4452-9f66-ec5ac7ec721a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:49.906914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec902d7-336d-462d-a0fa-addc3ea2dc1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:49.907675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec902d7-336d-462d-a0fa-addc3ea2dc1a service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.907967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec902d7-336d-462d-a0fa-addc3ea2dc1a service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.908291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec902d7-336d-462d-a0fa-addc3ea2dc1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.910297 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 915/1832] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:49 2021] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:49.911019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfeefe-c472-4b31-b3ce-9ed1b9b59654 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:49.911391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfeefe-c472-4b31-b3ce-9ed1b9b59654 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:49.911739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfeefe-c472-4b31-b3ce-9ed1b9b59654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:49.911869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bec902d7-336d-462d-a0fa-addc3ea2dc1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:49.940158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8fcfeefe-c472-4b31-b3ce-9ed1b9b59654 None None] MFA Rules not processed for user `0cb04b2e2bf0485fad61ca99141fb21d`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:49.941451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8fcfeefe-c472-4b31-b3ce-9ed1b9b59654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:50.001795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec902d7-336d-462d-a0fa-addc3ea2dc1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:50.003379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec902d7-336d-462d-a0fa-addc3ea2dc1a service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:50.012636 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 918/1833] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:49 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:50.013472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec902d7-336d-462d-a0fa-addc3ea2dc1a service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:50.014942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bec902d7-336d-462d-a0fa-addc3ea2dc1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:50.047312 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 916/1834] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:49 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:50.048457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229bd1-a382-46e8-a347-46c93d985312 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:50.048746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229bd1-a382-46e8-a347-46c93d985312 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:50.049028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229bd1-a382-46e8-a347-46c93d985312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:50.077274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-26229bd1-a382-46e8-a347-46c93d985312 None None] MFA Rules not processed for user `9623a93108e2442bb6e99505d20929d1`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:50.078879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-26229bd1-a382-46e8-a347-46c93d985312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:50.093954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec902d7-336d-462d-a0fa-addc3ea2dc1a service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:50.098434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac199c-4a6e-4972-a290-8baaaeda7915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:50.099406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac199c-4a6e-4972-a290-8baaaeda7915 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:50.101165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac199c-4a6e-4972-a290-8baaaeda7915 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:50.101315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac199c-4a6e-4972-a290-8baaaeda7915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:50.112611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac199c-4a6e-4972-a290-8baaaeda7915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:50.114297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac199c-4a6e-4972-a290-8baaaeda7915 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:50.125142 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 919/1835] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:50.137792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac199c-4a6e-4972-a290-8baaaeda7915 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:50.165470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac199c-4a6e-4972-a290-8baaaeda7915 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:50.174910 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 917/1836] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:50 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:50.175885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26229bd1-a382-46e8-a347-46c93d985312 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:50.176897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44548c38-a8ed-4eb0-895e-fc944bb399cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:50.177666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44548c38-a8ed-4eb0-895e-fc944bb399cf admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:50.179680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44548c38-a8ed-4eb0-895e-fc944bb399cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:50.180063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44548c38-a8ed-4eb0-895e-fc944bb399cf admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:50.181448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44548c38-a8ed-4eb0-895e-fc944bb399cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:50.190461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26229bd1-a382-46e8-a347-46c93d985312 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:50.190649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44548c38-a8ed-4eb0-895e-fc944bb399cf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:50.201778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd6f0b-d002-496a-a916-7f66d542dbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:50.202340 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 920/1837] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:50 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:50.203375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd6f0b-d002-496a-a916-7f66d542dbef admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:50.203787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd6f0b-d002-496a-a916-7f66d542dbef admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:50.204204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd6f0b-d002-496a-a916-7f66d542dbef admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:50.205150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd6f0b-d002-496a-a916-7f66d542dbef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:50.206541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44548c38-a8ed-4eb0-895e-fc944bb399cf admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:50.210847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd6f0b-d002-496a-a916-7f66d542dbef admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:50.217521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44548c38-a8ed-4eb0-895e-fc944bb399cf admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:50.222990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbe902-94d1-4f87-8371-37158d343a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:50.223693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbe902-94d1-4f87-8371-37158d343a52 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:50.224073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbe902-94d1-4f87-8371-37158d343a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:50.224423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbe902-94d1-4f87-8371-37158d343a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:50.225196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbe902-94d1-4f87-8371-37158d343a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:50.226998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbe902-94d1-4f87-8371-37158d343a52 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:50.241459 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 921/1838] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:50 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:50.242563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbe902-94d1-4f87-8371-37158d343a52 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:50.255116 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 918/1839] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:50 2021] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:50.261177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbe902-94d1-4f87-8371-37158d343a52 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:50.273966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd6f0b-d002-496a-a916-7f66d542dbef admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:50.344720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d056247-23b0-4406-ab30-21e6fe7bad08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:50.345769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d056247-23b0-4406-ab30-21e6fe7bad08 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:50.346094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d056247-23b0-4406-ab30-21e6fe7bad08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:50.346417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d056247-23b0-4406-ab30-21e6fe7bad08 admin admin] PATH_INFO: `/v3/projects/a4b87a38aaf24b5b8bb90fb9e4e479c8/users/c7ff8c9eec54474c9b71a59dddffc7d4/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:50.370306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d056247-23b0-4406-ab30-21e6fe7bad08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b87a38aaf24b5b8bb90fb9e4e479c8, user_id=c7ff8c9eec54474c9b71a59dddffc7d4, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:50.371096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d056247-23b0-4406-ab30-21e6fe7bad08 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:50.388719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd6f0b-d002-496a-a916-7f66d542dbef admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:50.395837 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 922/1840] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:50 2021] PUT /identity/v3/projects/a4b87a38aaf24b5b8bb90fb9e4e479c8/users/c7ff8c9eec54474c9b71a59dddffc7d4/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:50.405112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c60eb-8f01-4a24-bd08-41d53b22d339 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:50.405605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c60eb-8f01-4a24-bd08-41d53b22d339 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:50.406147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c60eb-8f01-4a24-bd08-41d53b22d339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:50.442896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c59c60eb-8f01-4a24-bd08-41d53b22d339 None None] MFA Rules not processed for user `c7ff8c9eec54474c9b71a59dddffc7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:50.444630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c59c60eb-8f01-4a24-bd08-41d53b22d339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:50.529680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a72a64-780d-421e-a2ad-e607e0ffe2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:50.530465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a72a64-780d-421e-a2ad-e607e0ffe2de admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:50.530755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a72a64-780d-421e-a2ad-e607e0ffe2de admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:50.531032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a72a64-780d-421e-a2ad-e607e0ffe2de admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:50.532478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a72a64-780d-421e-a2ad-e607e0ffe2de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:50.541614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a72a64-780d-421e-a2ad-e607e0ffe2de admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:50.568360 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 923/1841] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:50 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:50.569924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c60eb-8f01-4a24-bd08-41d53b22d339 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:50.585902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c60eb-8f01-4a24-bd08-41d53b22d339 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:50.594683 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 919/1842] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:50 2021] POST /identity/v3/users => generated 296 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:50.594878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651075ae-cb9b-40be-af7c-60bbc8d52666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:50.594878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651075ae-cb9b-40be-af7c-60bbc8d52666 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:50.594878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651075ae-cb9b-40be-af7c-60bbc8d52666 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:50.594878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651075ae-cb9b-40be-af7c-60bbc8d52666 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:50.595340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651075ae-cb9b-40be-af7c-60bbc8d52666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:50.595748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a72a64-780d-421e-a2ad-e607e0ffe2de admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:50.597291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651075ae-cb9b-40be-af7c-60bbc8d52666 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:50.620550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a72a64-780d-421e-a2ad-e607e0ffe2de admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:50.627267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae323b5-bfbd-4edf-97cb-02a30232a853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:50.627946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae323b5-bfbd-4edf-97cb-02a30232a853 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:50.628232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae323b5-bfbd-4edf-97cb-02a30232a853 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:50.628516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae323b5-bfbd-4edf-97cb-02a30232a853 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:50.629308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae323b5-bfbd-4edf-97cb-02a30232a853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:50.631028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae323b5-bfbd-4edf-97cb-02a30232a853 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:50.645175 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 924/1844] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:50 2021] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:50.646369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651075ae-cb9b-40be-af7c-60bbc8d52666 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:50.647962 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 920/1843] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:50 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:46:50.648268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-651075ae-cb9b-40be-af7c-60bbc8d52666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:50.649802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae323b5-bfbd-4edf-97cb-02a30232a853 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:50.676764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae323b5-bfbd-4edf-97cb-02a30232a853 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:50.810987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651075ae-cb9b-40be-af7c-60bbc8d52666 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:50.817719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442d684-3216-430a-b374-83d3772aaa55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:50.818470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442d684-3216-430a-b374-83d3772aaa55 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:50.818760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442d684-3216-430a-b374-83d3772aaa55 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:50.819084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442d684-3216-430a-b374-83d3772aaa55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:50.838039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fa3dc-2b79-4135-96df-cfb76f3fe5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:50.838855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fa3dc-2b79-4135-96df-cfb76f3fe5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:50.839773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fa3dc-2b79-4135-96df-cfb76f3fe5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:50.840120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fa3dc-2b79-4135-96df-cfb76f3fe5c5 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:50.840904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fa3dc-2b79-4135-96df-cfb76f3fe5c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:50.845904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fa3dc-2b79-4135-96df-cfb76f3fe5c5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:50.901031 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 921/1845] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:50 2021] POST /identity/v3/users => generated 295 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:50.901847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fa3dc-2b79-4135-96df-cfb76f3fe5c5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:50.918910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442d684-3216-430a-b374-83d3772aaa55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:50.921048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442d684-3216-430a-b374-83d3772aaa55 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:50.921950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fa3dc-2b79-4135-96df-cfb76f3fe5c5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:50.935093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bf81f-0dd6-4244-9772-cb35a2a215db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:50.936002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bf81f-0dd6-4244-9772-cb35a2a215db admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:50.936467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bf81f-0dd6-4244-9772-cb35a2a215db admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:50.937007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bf81f-0dd6-4244-9772-cb35a2a215db admin admin] PATH_INFO: `/v3/projects/90f789868fb14e8a99859aabd68e8f2e/users/ea934bcf6f7f4c7fb493924b98845fcf/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:50.952507 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 925/1846] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:50 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:50.953565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442d684-3216-430a-b374-83d3772aaa55 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:50.959106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8442d684-3216-430a-b374-83d3772aaa55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:50.977151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bf81f-0dd6-4244-9772-cb35a2a215db admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f789868fb14e8a99859aabd68e8f2e, user_id=ea934bcf6f7f4c7fb493924b98845fcf, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:50.980203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bf81f-0dd6-4244-9772-cb35a2a215db admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:50.981196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442d684-3216-430a-b374-83d3772aaa55 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:50.991695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d835520-d25d-4d4d-a834-6cdd613797d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:50.993761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d835520-d25d-4d4d-a834-6cdd613797d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:50.994415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d835520-d25d-4d4d-a834-6cdd613797d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:50.995592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d835520-d25d-4d4d-a834-6cdd613797d8 admin admin] PATH_INFO: `/v3/projects/a1bec72855984e15b784ddb87c4516cf` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:51.012051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d835520-d25d-4d4d-a834-6cdd613797d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1bec72855984e15b784ddb87c4516cf)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:51.027917 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 922/1847] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:50 2021] PUT /identity/v3/projects/90f789868fb14e8a99859aabd68e8f2e/users/ea934bcf6f7f4c7fb493924b98845fcf/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:51.028780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bf81f-0dd6-4244-9772-cb35a2a215db admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:51.029002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d835520-d25d-4d4d-a834-6cdd613797d8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:51.120273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8d835520-d25d-4d4d-a834-6cdd613797d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1bec72855984e15b784ddb87c4516cf', 'request_id': 'req-8d835520-d25d-4d4d-a834-6cdd613797d8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:51.127201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8d835520-d25d-4d4d-a834-6cdd613797d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1bec72855984e15b784ddb87c4516cf', 'request_id': 'req-8d835520-d25d-4d4d-a834-6cdd613797d8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:51.131785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bf81f-0dd6-4244-9772-cb35a2a215db admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:51.133103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8d835520-d25d-4d4d-a834-6cdd613797d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1bec72855984e15b784ddb87c4516cf', 'request_id': 'req-8d835520-d25d-4d4d-a834-6cdd613797d8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:51.156959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8d835520-d25d-4d4d-a834-6cdd613797d8 admin admin] The token cache is being invalidate because project a1bec72855984e15b784ddb87c4516cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:51.158113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8d835520-d25d-4d4d-a834-6cdd613797d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:51.159492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8d835520-d25d-4d4d-a834-6cdd613797d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:51.169789 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 926/1848] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:50 2021] DELETE /identity/v3/projects/a1bec72855984e15b784ddb87c4516cf => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:51.169789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d835520-d25d-4d4d-a834-6cdd613797d8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:51.173726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8d835520-d25d-4d4d-a834-6cdd613797d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:51.236673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53a34e-8cb0-4663-95ce-7f5057429611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:51.237566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53a34e-8cb0-4663-95ce-7f5057429611 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:51.237852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53a34e-8cb0-4663-95ce-7f5057429611 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:51.238196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53a34e-8cb0-4663-95ce-7f5057429611 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:51.239236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53a34e-8cb0-4663-95ce-7f5057429611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:51.240941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53a34e-8cb0-4663-95ce-7f5057429611 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:51.253408 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 923/1849] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:51 2021] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:51.254732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53a34e-8cb0-4663-95ce-7f5057429611 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:51.256787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4c53a34e-8cb0-4663-95ce-7f5057429611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:51.295091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53a34e-8cb0-4663-95ce-7f5057429611 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:51.309744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89220dc4-eca7-4adc-bcb8-5bd814ca6703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:51.312247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89220dc4-eca7-4adc-bcb8-5bd814ca6703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:51.312739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89220dc4-eca7-4adc-bcb8-5bd814ca6703 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:51.313273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89220dc4-eca7-4adc-bcb8-5bd814ca6703 admin admin] PATH_INFO: `/v3/users/e1ed840352674b438f2ae2e6df3a6636` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:51.314991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89220dc4-eca7-4adc-bcb8-5bd814ca6703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ed840352674b438f2ae2e6df3a6636)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:51.318474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89220dc4-eca7-4adc-bcb8-5bd814ca6703 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:51.345800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d835520-d25d-4d4d-a834-6cdd613797d8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:51.359309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385efde7-4564-4cd0-a777-df7337c7ebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:51.360164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385efde7-4564-4cd0-a777-df7337c7ebb8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:51.360442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385efde7-4564-4cd0-a777-df7337c7ebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:51.360910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385efde7-4564-4cd0-a777-df7337c7ebb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:51.361998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385efde7-4564-4cd0-a777-df7337c7ebb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:51.364353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385efde7-4564-4cd0-a777-df7337c7ebb8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:51.376948 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 927/1850] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:51 2021] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:51.393557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385efde7-4564-4cd0-a777-df7337c7ebb8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:51.395671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-385efde7-4564-4cd0-a777-df7337c7ebb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:51.402515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-89220dc4-eca7-4adc-bcb8-5bd814ca6703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ed840352674b438f2ae2e6df3a6636'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:51.411454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385efde7-4564-4cd0-a777-df7337c7ebb8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:51.417269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9b33e-7cf4-47b2-b70d-4f60056f6322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:51.418231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9b33e-7cf4-47b2-b70d-4f60056f6322 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:51.418628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9b33e-7cf4-47b2-b70d-4f60056f6322 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:51.418973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9b33e-7cf4-47b2-b70d-4f60056f6322 admin admin] PATH_INFO: `/v3/projects/8dd4aeb197724abc99d99350c9ab72ab/users/1e358d284ffb4579913c0df4006107fa/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:51.419607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-89220dc4-eca7-4adc-bcb8-5bd814ca6703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ed840352674b438f2ae2e6df3a6636'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:51.421200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-89220dc4-eca7-4adc-bcb8-5bd814ca6703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ed840352674b438f2ae2e6df3a6636'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:51.436045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9b33e-7cf4-47b2-b70d-4f60056f6322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd4aeb197724abc99d99350c9ab72ab, user_id=1e358d284ffb4579913c0df4006107fa, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:51.439558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9b33e-7cf4-47b2-b70d-4f60056f6322 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:51.468422 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 928/1851] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:51 2021] PUT /identity/v3/projects/8dd4aeb197724abc99d99350c9ab72ab/users/1e358d284ffb4579913c0df4006107fa/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:51.469095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9b33e-7cf4-47b2-b70d-4f60056f6322 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:51.471254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-89220dc4-eca7-4adc-bcb8-5bd814ca6703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ed840352674b438f2ae2e6df3a6636'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:51.484195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-89220dc4-eca7-4adc-bcb8-5bd814ca6703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ed840352674b438f2ae2e6df3a6636'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:51.493515 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 924/1852] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:51 2021] DELETE /identity/v3/users/e1ed840352674b438f2ae2e6df3a6636 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:51.495911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89220dc4-eca7-4adc-bcb8-5bd814ca6703 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:51.498912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-89220dc4-eca7-4adc-bcb8-5bd814ca6703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:51.606454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9b33e-7cf4-47b2-b70d-4f60056f6322 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:51.648005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89220dc4-eca7-4adc-bcb8-5bd814ca6703 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:51.662021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f9a7e-b6f9-4fe5-bc9c-4f57fc89bdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:51.662912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f9a7e-b6f9-4fe5-bc9c-4f57fc89bdfe admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:51.663218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f9a7e-b6f9-4fe5-bc9c-4f57fc89bdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:51.663738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f9a7e-b6f9-4fe5-bc9c-4f57fc89bdfe admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:51.664457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f9a7e-b6f9-4fe5-bc9c-4f57fc89bdfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:51.670553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f9a7e-b6f9-4fe5-bc9c-4f57fc89bdfe admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:51.694807 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 925/1853] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:51 2021] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:51.696887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59c80a-5201-4710-aef6-679dcd74b087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:51.697904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59c80a-5201-4710-aef6-679dcd74b087 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:51.698323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59c80a-5201-4710-aef6-679dcd74b087 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:51.698715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59c80a-5201-4710-aef6-679dcd74b087 admin admin] PATH_INFO: `/v3/projects/90f789868fb14e8a99859aabd68e8f2e/users/ea934bcf6f7f4c7fb493924b98845fcf/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:51.699321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f9a7e-b6f9-4fe5-bc9c-4f57fc89bdfe admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:51.701541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59c80a-5201-4710-aef6-679dcd74b087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f789868fb14e8a99859aabd68e8f2e, user_id=ea934bcf6f7f4c7fb493924b98845fcf, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:51.707969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59c80a-5201-4710-aef6-679dcd74b087 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:51.718764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f9a7e-b6f9-4fe5-bc9c-4f57fc89bdfe admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:51.734018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc9eaa-46f6-421c-bfb0-642c09715654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:51.735541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc9eaa-46f6-421c-bfb0-642c09715654 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:51.737666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc9eaa-46f6-421c-bfb0-642c09715654 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:51.738551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc9eaa-46f6-421c-bfb0-642c09715654 admin admin] PATH_INFO: `/v3/projects/8dd4aeb197724abc99d99350c9ab72ab/users/1e358d284ffb4579913c0df4006107fa/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:51.741934 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 929/1854] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:51 2021] PUT /identity/v3/projects/90f789868fb14e8a99859aabd68e8f2e/users/ea934bcf6f7f4c7fb493924b98845fcf/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:51.742951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc9eaa-46f6-421c-bfb0-642c09715654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd4aeb197724abc99d99350c9ab72ab, user_id=1e358d284ffb4579913c0df4006107fa, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:51.750719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc9eaa-46f6-421c-bfb0-642c09715654 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:51.752438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c787040-f325-45d7-90e7-33df3edd0c71 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:51.752829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c787040-f325-45d7-90e7-33df3edd0c71 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:51.753806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c787040-f325-45d7-90e7-33df3edd0c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:51.786310 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 926/1855] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:51 2021] PUT /identity/v3/projects/8dd4aeb197724abc99d99350c9ab72ab/users/1e358d284ffb4579913c0df4006107fa/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:46:51.788756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a23d18-3fb1-49c4-80af-aefd20886809 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:51.789047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a23d18-3fb1-49c4-80af-aefd20886809 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:51.789331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a23d18-3fb1-49c4-80af-aefd20886809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:51.832675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2c787040-f325-45d7-90e7-33df3edd0c71 None None] MFA Rules not processed for user `ea934bcf6f7f4c7fb493924b98845fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:51.833912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2c787040-f325-45d7-90e7-33df3edd0c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:51.895242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-43a23d18-3fb1-49c4-80af-aefd20886809 None None] MFA Rules not processed for user `1e358d284ffb4579913c0df4006107fa`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:51.898396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-43a23d18-3fb1-49c4-80af-aefd20886809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:52.050078 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 930/1856] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:51 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:46:52.070737 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 927/1857] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:51 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:46:52.086011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c787040-f325-45d7-90e7-33df3edd0c71 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:52.086011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2c787040-f325-45d7-90e7-33df3edd0c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:52.145685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a23d18-3fb1-49c4-80af-aefd20886809 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:52.147879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-43a23d18-3fb1-49c4-80af-aefd20886809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:52.188767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c787040-f325-45d7-90e7-33df3edd0c71 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:52.194561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:52.195527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:52.195887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:52.196875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851 admin admin] PATH_INFO: `/v3/projects/7dc44731a90b43229a1aef2876e01c26` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:52.198190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc44731a90b43229a1aef2876e01c26)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:52.200417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:52.271829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc44731a90b43229a1aef2876e01c26', 'request_id': 'req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:52.280226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc44731a90b43229a1aef2876e01c26', 'request_id': 'req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:52.293677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc44731a90b43229a1aef2876e01c26', 'request_id': 'req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:52.317701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851 admin admin] The token cache is being invalidate because project 7dc44731a90b43229a1aef2876e01c26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:52.318139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:52.321927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:52.324000 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 931/1858] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:52 2021] DELETE /identity/v3/projects/7dc44731a90b43229a1aef2876e01c26 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:52.324673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:52.326244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:52.332614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a23d18-3fb1-49c4-80af-aefd20886809 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:52.424823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03722157-6b08-4291-804b-be96685237d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:52.425802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03722157-6b08-4291-804b-be96685237d4 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:52.426239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03722157-6b08-4291-804b-be96685237d4 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:52.426691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03722157-6b08-4291-804b-be96685237d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:52.429061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-03722157-6b08-4291-804b-be96685237d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:52.467129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d439c5-72a0-4bd2-b8d5-e3ee2deb5851 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:52.480827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1245323-e41f-4554-83ec-a79da039485b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:52.481643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1245323-e41f-4554-83ec-a79da039485b service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:52.481968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1245323-e41f-4554-83ec-a79da039485b service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:52.482329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1245323-e41f-4554-83ec-a79da039485b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:52.497119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a1245323-e41f-4554-83ec-a79da039485b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:52.507928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03722157-6b08-4291-804b-be96685237d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:52.510481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03722157-6b08-4291-804b-be96685237d4 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:52.526672 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 928/1859] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:52 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:52.528222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d119ce-b355-4cba-b928-0d400288ca4e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:52.528715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d119ce-b355-4cba-b928-0d400288ca4e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:52.529095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d119ce-b355-4cba-b928-0d400288ca4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:52.557292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-88d119ce-b355-4cba-b928-0d400288ca4e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:52.559848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-88d119ce-b355-4cba-b928-0d400288ca4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:52.593014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1245323-e41f-4554-83ec-a79da039485b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:52.594909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1245323-e41f-4554-83ec-a79da039485b service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:52.606642 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 932/1860] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:52 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:52.683135 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 929/1861] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:52.694458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c45d70-7064-4809-b07a-36978ac807f9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:52.695357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c45d70-7064-4809-b07a-36978ac807f9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:52.696965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c45d70-7064-4809-b07a-36978ac807f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:52.720268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c2427-c9d4-413f-8764-7c5dfb180678 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:52.720736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c2427-c9d4-413f-8764-7c5dfb180678 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:52.721100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c2427-c9d4-413f-8764-7c5dfb180678 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:52.727137 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 930/1862] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:46:52 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:46:52.739754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c2427-c9d4-413f-8764-7c5dfb180678 None None] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:46:52.747865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b5c45d70-7064-4809-b07a-36978ac807f9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:52.755414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b5c45d70-7064-4809-b07a-36978ac807f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:52.769363 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-d62c2427-c9d4-413f-8764-7c5dfb180678 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Dec 18 20:46:52.769363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c2427-c9d4-413f-8764-7c5dfb180678 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:52.778638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c2427-c9d4-413f-8764-7c5dfb180678 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:52.780702 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 933/1863] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:52.782082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f815a69-66ec-4f38-905e-313b9a5271c9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:52.782469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f815a69-66ec-4f38-905e-313b9a5271c9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:52.782816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f815a69-66ec-4f38-905e-313b9a5271c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:52.784003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd45b31-0b81-4a90-ae2e-bd63555f6eb1 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e358d284ffb4579913c0df4006107fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dd4aeb197724abc99d99350c9ab72ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:52.785093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd45b31-0b81-4a90-ae2e-bd63555f6eb1 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:52.785481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd45b31-0b81-4a90-ae2e-bd63555f6eb1 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:52.786357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd45b31-0b81-4a90-ae2e-bd63555f6eb1 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] PATH_INFO: `/v3/projects/a4b87a38aaf24b5b8bb90fb9e4e479c8` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:52.787869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd45b31-0b81-4a90-ae2e-bd63555f6eb1 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] RBAC: Authorizing `identity:get_project(project_id=a4b87a38aaf24b5b8bb90fb9e4e479c8)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:52.790407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd45b31-0b81-4a90-ae2e-bd63555f6eb1 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:52.799891 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 931/1864] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:46:52 2021] GET /identity/v3/projects/a4b87a38aaf24b5b8bb90fb9e4e479c8 => generated 377 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:46:52.805213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd45b31-0b81-4a90-ae2e-bd63555f6eb1 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:52.840848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd45b31-0b81-4a90-ae2e-bd63555f6eb1 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:52.844511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2f815a69-66ec-4f38-905e-313b9a5271c9 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:52.845776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2f815a69-66ec-4f38-905e-313b9a5271c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:52.855497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ba0d2-c957-47fe-9f99-3249f47cc069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:52.856410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ba0d2-c957-47fe-9f99-3249f47cc069 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:52.856882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ba0d2-c957-47fe-9f99-3249f47cc069 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:52.857558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ba0d2-c957-47fe-9f99-3249f47cc069 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:52.858700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ba0d2-c957-47fe-9f99-3249f47cc069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:46:52.859313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ba0d2-c957-47fe-9f99-3249f47cc069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:52.866818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ba0d2-c957-47fe-9f99-3249f47cc069 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:52.897312 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 932/1865] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:46:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:46:52.902011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ba0d2-c957-47fe-9f99-3249f47cc069 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:52.923044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ba0d2-c957-47fe-9f99-3249f47cc069 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:52.938506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeec108-a647-485c-b155-cd31b34c886b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:52.939416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeec108-a647-485c-b155-cd31b34c886b admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:52.939870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeec108-a647-485c-b155-cd31b34c886b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:52.940295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeec108-a647-485c-b155-cd31b34c886b admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:52.941153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeec108-a647-485c-b155-cd31b34c886b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:52.948960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeec108-a647-485c-b155-cd31b34c886b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:52.971865 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 934/1866] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:46:52 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:52.989770 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 933/1867] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:52 2021] POST /identity/v3/projects => generated 401 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:52.990873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeec108-a647-485c-b155-cd31b34c886b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:52.991199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f815a69-66ec-4f38-905e-313b9a5271c9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:53.011619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f815a69-66ec-4f38-905e-313b9a5271c9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:53.075417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeec108-a647-485c-b155-cd31b34c886b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:53.081410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7401c-6d76-4bb2-8380-0e519c1bcd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:53.082281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7401c-6d76-4bb2-8380-0e519c1bcd5c admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:53.082663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7401c-6d76-4bb2-8380-0e519c1bcd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:53.083033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7401c-6d76-4bb2-8380-0e519c1bcd5c admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:53.083995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7401c-6d76-4bb2-8380-0e519c1bcd5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:53.086982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7401c-6d76-4bb2-8380-0e519c1bcd5c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:53.141733 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 934/1868] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:52 2021] POST /identity/v3/users => generated 301 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:53.142738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7401c-6d76-4bb2-8380-0e519c1bcd5c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:53.145391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b2d7401c-6d76-4bb2-8380-0e519c1bcd5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:53.171606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731212e2-2fa0-4a4a-8ee7-bd258dafddd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:53.172383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731212e2-2fa0-4a4a-8ee7-bd258dafddd2 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:53.172685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731212e2-2fa0-4a4a-8ee7-bd258dafddd2 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:53.172967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731212e2-2fa0-4a4a-8ee7-bd258dafddd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:53.180067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-731212e2-2fa0-4a4a-8ee7-bd258dafddd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:53.260661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7401c-6d76-4bb2-8380-0e519c1bcd5c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:53.282113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e26ad-3420-4a3e-9ac7-a2b27c5996f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:53.283686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e26ad-3420-4a3e-9ac7-a2b27c5996f8 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:53.283686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e26ad-3420-4a3e-9ac7-a2b27c5996f8 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:53.283686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e26ad-3420-4a3e-9ac7-a2b27c5996f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:53.330178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731212e2-2fa0-4a4a-8ee7-bd258dafddd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:53.339389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731212e2-2fa0-4a4a-8ee7-bd258dafddd2 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:53.360515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e26ad-3420-4a3e-9ac7-a2b27c5996f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:53.362201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e26ad-3420-4a3e-9ac7-a2b27c5996f8 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:53.362355 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 935/1869] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:52 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:53.363134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731212e2-2fa0-4a4a-8ee7-bd258dafddd2 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:53.371920 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 935/1870] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:46:53 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:46:53.377578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731212e2-2fa0-4a4a-8ee7-bd258dafddd2 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:53.391014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1f4a0-fec5-4c18-bbe5-b66c79ba3ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:53.391705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1f4a0-fec5-4c18-bbe5-b66c79ba3ecb admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:53.391995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1f4a0-fec5-4c18-bbe5-b66c79ba3ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:53.392274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1f4a0-fec5-4c18-bbe5-b66c79ba3ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:53.393023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1f4a0-fec5-4c18-bbe5-b66c79ba3ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:53.395485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1f4a0-fec5-4c18-bbe5-b66c79ba3ecb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:53.420570 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 936/1871] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:53 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:53.424746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e26ad-3420-4a3e-9ac7-a2b27c5996f8 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:53.438825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e26ad-3420-4a3e-9ac7-a2b27c5996f8 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:53.444408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e2950-693c-47df-820a-226dfa845e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:53.445340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e2950-693c-47df-820a-226dfa845e3b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:53.445814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e2950-693c-47df-820a-226dfa845e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:53.447426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e2950-693c-47df-820a-226dfa845e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:53.448388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e2950-693c-47df-820a-226dfa845e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:53.450092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e2950-693c-47df-820a-226dfa845e3b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:53.465953 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 936/1872] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:53 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:53.467877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1f4a0-fec5-4c18-bbe5-b66c79ba3ecb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:53.483731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1f4a0-fec5-4c18-bbe5-b66c79ba3ecb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:53.491977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9237e-16f6-4429-830b-2fa5a251a4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:53.493797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9237e-16f6-4429-830b-2fa5a251a4b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:53.494329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9237e-16f6-4429-830b-2fa5a251a4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:53.494808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9237e-16f6-4429-830b-2fa5a251a4b7 admin admin] PATH_INFO: `/v3/projects/5e15548f5de148ff92b951b5b631bef5/users/147de5c7427e4f88b1db71476ebcc5bc/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:53.517273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9237e-16f6-4429-830b-2fa5a251a4b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e15548f5de148ff92b951b5b631bef5, user_id=147de5c7427e4f88b1db71476ebcc5bc, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:53.520807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9237e-16f6-4429-830b-2fa5a251a4b7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:53.570825 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 937/1873] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:53 2021] PUT /identity/v3/projects/5e15548f5de148ff92b951b5b631bef5/users/147de5c7427e4f88b1db71476ebcc5bc/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:53.571517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c9eeb-0414-44d9-8f8c-3122c2ea69ce None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:53.571755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c9eeb-0414-44d9-8f8c-3122c2ea69ce None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:53.572033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c9eeb-0414-44d9-8f8c-3122c2ea69ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:53.627676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9237e-16f6-4429-830b-2fa5a251a4b7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:53.629435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d5d9237e-16f6-4429-830b-2fa5a251a4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:53.633473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-702c9eeb-0414-44d9-8f8c-3122c2ea69ce None None] MFA Rules not processed for user `147de5c7427e4f88b1db71476ebcc5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:53.635457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-702c9eeb-0414-44d9-8f8c-3122c2ea69ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:53.770001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9237e-16f6-4429-830b-2fa5a251a4b7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:53.778319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f468abc-808d-4abd-8b31-f855423e1246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:53.779655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f468abc-808d-4abd-8b31-f855423e1246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:53.780109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f468abc-808d-4abd-8b31-f855423e1246 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:53.780540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f468abc-808d-4abd-8b31-f855423e1246 admin admin] PATH_INFO: `/v3/users/0cb04b2e2bf0485fad61ca99141fb21d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:53.785476 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 937/1874] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:53 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:53.786950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f468abc-808d-4abd-8b31-f855423e1246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cb04b2e2bf0485fad61ca99141fb21d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:53.788087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c9eeb-0414-44d9-8f8c-3122c2ea69ce None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:53.789070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f468abc-808d-4abd-8b31-f855423e1246 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:53.822536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c9eeb-0414-44d9-8f8c-3122c2ea69ce None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:53.844686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69ed09-c831-4ee4-9162-e50c074e15de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:53.845838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69ed09-c831-4ee4-9162-e50c074e15de admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:53.848635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69ed09-c831-4ee4-9162-e50c074e15de admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:53.850618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69ed09-c831-4ee4-9162-e50c074e15de admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:53.854357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69ed09-c831-4ee4-9162-e50c074e15de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:53.864728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69ed09-c831-4ee4-9162-e50c074e15de admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:53.946384 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 938/1875] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:53 2021] POST /identity/v3/projects => generated 403 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:53.950522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9e38b-0d3c-4880-a8e6-537fe003f872 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:53.951289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9e38b-0d3c-4880-a8e6-537fe003f872 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:53.951921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9e38b-0d3c-4880-a8e6-537fe003f872 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:53.954730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f468abc-808d-4abd-8b31-f855423e1246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cb04b2e2bf0485fad61ca99141fb21d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:53.963151 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 939/1876] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:46:53 2021] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:46:53.965620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9e38b-0d3c-4880-a8e6-537fe003f872 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:53.983448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f468abc-808d-4abd-8b31-f855423e1246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cb04b2e2bf0485fad61ca99141fb21d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:54.016571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f468abc-808d-4abd-8b31-f855423e1246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cb04b2e2bf0485fad61ca99141fb21d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:54.018031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f468abc-808d-4abd-8b31-f855423e1246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cb04b2e2bf0485fad61ca99141fb21d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:54.034729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f468abc-808d-4abd-8b31-f855423e1246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cb04b2e2bf0485fad61ca99141fb21d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:54.057420 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 938/1877] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:53 2021] DELETE /identity/v3/users/0cb04b2e2bf0485fad61ca99141fb21d => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:54.058770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f468abc-808d-4abd-8b31-f855423e1246 admin admin] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:46:54.061115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7f468abc-808d-4abd-8b31-f855423e1246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:54.135599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9e38b-0d3c-4880-a8e6-537fe003f872 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:54.298613 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-7f468abc-808d-4abd-8b31-f855423e1246 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Dec 18 20:46:54.300692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f468abc-808d-4abd-8b31-f855423e1246 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:54.306234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7f468abc-808d-4abd-8b31-f855423e1246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:54.323129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f743bc-8ae3-4c69-819b-d6c47ad60f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:54.323834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f743bc-8ae3-4c69-819b-d6c47ad60f59 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:54.324120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f743bc-8ae3-4c69-819b-d6c47ad60f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:54.324395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f743bc-8ae3-4c69-819b-d6c47ad60f59 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:54.325136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f743bc-8ae3-4c69-819b-d6c47ad60f59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:54.327363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f743bc-8ae3-4c69-819b-d6c47ad60f59 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:54.375962 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 940/1878] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:46:53 2021] POST /identity/v3/users => generated 308 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:46:54.375962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f433e-6280-481a-a027-22373b236800 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:54.375962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f433e-6280-481a-a027-22373b236800 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:54.375962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f433e-6280-481a-a027-22373b236800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:54.415381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6b8f433e-6280-481a-a027-22373b236800 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:54.417335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6b8f433e-6280-481a-a027-22373b236800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:54.451979 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 941/1879] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:54.451979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f433e-6280-481a-a027-22373b236800 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:54.453497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6b8f433e-6280-481a-a027-22373b236800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:54.488867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f433e-6280-481a-a027-22373b236800 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:54.520232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347dbbd-796c-4ff3-bcdd-e022e673d204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:54.521812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347dbbd-796c-4ff3-bcdd-e022e673d204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:54.521812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347dbbd-796c-4ff3-bcdd-e022e673d204 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:54.521812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347dbbd-796c-4ff3-bcdd-e022e673d204 admin admin] PATH_INFO: `/v3/users/c1cef2e4be554adabdff1c3f00c1bd6d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:54.524501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347dbbd-796c-4ff3-bcdd-e022e673d204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1cef2e4be554adabdff1c3f00c1bd6d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:54.525026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347dbbd-796c-4ff3-bcdd-e022e673d204 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:54.626831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f468abc-808d-4abd-8b31-f855423e1246 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:54.642989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4082dab-9ade-4670-b40e-d0b9241944f7 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e358d284ffb4579913c0df4006107fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dd4aeb197724abc99d99350c9ab72ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:54.647843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4082dab-9ade-4670-b40e-d0b9241944f7 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:54.648516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4082dab-9ade-4670-b40e-d0b9241944f7 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:54.649017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4082dab-9ade-4670-b40e-d0b9241944f7 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] PATH_INFO: `/v3/projects/a4b87a38aaf24b5b8bb90fb9e4e479c8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:54.654193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4082dab-9ade-4670-b40e-d0b9241944f7 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] RBAC: Authorizing `identity:get_project(project_id=a4b87a38aaf24b5b8bb90fb9e4e479c8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:54.658988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7347dbbd-796c-4ff3-bcdd-e022e673d204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1cef2e4be554adabdff1c3f00c1bd6d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:54.661722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4082dab-9ade-4670-b40e-d0b9241944f7 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:54.667917 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 939/1880] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:46:54 2021] GET /identity/v3/projects/a4b87a38aaf24b5b8bb90fb9e4e479c8 => generated 377 bytes in 608 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:46:54.669099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4082dab-9ade-4670-b40e-d0b9241944f7 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:54.678956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7347dbbd-796c-4ff3-bcdd-e022e673d204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1cef2e4be554adabdff1c3f00c1bd6d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:54.682789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7347dbbd-796c-4ff3-bcdd-e022e673d204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1cef2e4be554adabdff1c3f00c1bd6d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:54.690032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f4082dab-9ade-4670-b40e-d0b9241944f7 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:54.708841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7347dbbd-796c-4ff3-bcdd-e022e673d204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1cef2e4be554adabdff1c3f00c1bd6d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:54.721794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7347dbbd-796c-4ff3-bcdd-e022e673d204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1cef2e4be554adabdff1c3f00c1bd6d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:54.746159 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 942/1881] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:54 2021] DELETE /identity/v3/users/c1cef2e4be554adabdff1c3f00c1bd6d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:54.747247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347dbbd-796c-4ff3-bcdd-e022e673d204 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:54.747379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4082dab-9ade-4670-b40e-d0b9241944f7 tempest-FlavorsAccessTestJSON-324592262 tempest-FlavorsAccessTestJSON-324592262-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:54.748719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7347dbbd-796c-4ff3-bcdd-e022e673d204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:54.901308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347dbbd-796c-4ff3-bcdd-e022e673d204 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:54.905426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db9775-0a4d-48e1-a2db-48d778a5e2b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:54.906080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db9775-0a4d-48e1-a2db-48d778a5e2b5 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:54.906385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db9775-0a4d-48e1-a2db-48d778a5e2b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:54.906673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db9775-0a4d-48e1-a2db-48d778a5e2b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:54.914571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b2db9775-0a4d-48e1-a2db-48d778a5e2b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:54.931786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618a3ff-f677-4d35-b4ae-8cdc673f9b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:54.935804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618a3ff-f677-4d35-b4ae-8cdc673f9b0d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:54.949609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618a3ff-f677-4d35-b4ae-8cdc673f9b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:54.949908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618a3ff-f677-4d35-b4ae-8cdc673f9b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:54.950751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618a3ff-f677-4d35-b4ae-8cdc673f9b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:54.961758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618a3ff-f677-4d35-b4ae-8cdc673f9b0d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:54.967903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db9775-0a4d-48e1-a2db-48d778a5e2b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:54.969598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db9775-0a4d-48e1-a2db-48d778a5e2b5 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:54.997726 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 943/1882] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:55.006304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838fa66-9cd2-4a7f-894e-fa5481f75c58 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:55.006604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838fa66-9cd2-4a7f-894e-fa5481f75c58 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:55.006889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838fa66-9cd2-4a7f-894e-fa5481f75c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:55.018597 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 940/1883] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:54 2021] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:55.030356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618a3ff-f677-4d35-b4ae-8cdc673f9b0d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:55.035222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0618a3ff-f677-4d35-b4ae-8cdc673f9b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:55.071638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9838fa66-9cd2-4a7f-894e-fa5481f75c58 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:55.072797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9838fa66-9cd2-4a7f-894e-fa5481f75c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:55.094023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618a3ff-f677-4d35-b4ae-8cdc673f9b0d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:55.105152 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 944/1884] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:55.119248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a804d-6e93-4635-9794-fd0733ac4114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:55.120248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a804d-6e93-4635-9794-fd0733ac4114 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:55.120544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a804d-6e93-4635-9794-fd0733ac4114 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:55.120826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a804d-6e93-4635-9794-fd0733ac4114 admin admin] PATH_INFO: `/v3/projects/35c196c56e8344e4a76b904c4b8ba624/users/49d185bd12fc44d494d5346254ac9595/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:55.225105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a804d-6e93-4635-9794-fd0733ac4114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c196c56e8344e4a76b904c4b8ba624, user_id=49d185bd12fc44d494d5346254ac9595, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:55.233769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a804d-6e93-4635-9794-fd0733ac4114 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:55.264391 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 941/1885] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:55 2021] PUT /identity/v3/projects/35c196c56e8344e4a76b904c4b8ba624/users/49d185bd12fc44d494d5346254ac9595/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:55.268704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838fa66-9cd2-4a7f-894e-fa5481f75c58 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:55.275744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a804d-6e93-4635-9794-fd0733ac4114 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:55.280052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838fa66-9cd2-4a7f-894e-fa5481f75c58 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:55.404532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b140ed-a291-4cf1-a5a7-a34516bb5648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:55.405828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b140ed-a291-4cf1-a5a7-a34516bb5648 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:55.406123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b140ed-a291-4cf1-a5a7-a34516bb5648 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:55.406435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b140ed-a291-4cf1-a5a7-a34516bb5648 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:55.407187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b140ed-a291-4cf1-a5a7-a34516bb5648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:55.410976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b140ed-a291-4cf1-a5a7-a34516bb5648 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:55.411926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a804d-6e93-4635-9794-fd0733ac4114 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:55.420140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83c6e5-d11c-4f58-a753-69508cb6ef1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:55.421861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83c6e5-d11c-4f58-a753-69508cb6ef1f service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:55.422166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83c6e5-d11c-4f58-a753-69508cb6ef1f service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:55.422954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83c6e5-d11c-4f58-a753-69508cb6ef1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:55.439051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83c6e5-d11c-4f58-a753-69508cb6ef1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:55.440611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83c6e5-d11c-4f58-a753-69508cb6ef1f service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:55.452763 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 945/1886] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:46:55 2021] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:46:55.456024 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 942/1887] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:46:55.457230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b140ed-a291-4cf1-a5a7-a34516bb5648 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:55.494151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b140ed-a291-4cf1-a5a7-a34516bb5648 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:55.505385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83c6e5-d11c-4f58-a753-69508cb6ef1f service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:55.507902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4d83c6e5-d11c-4f58-a753-69508cb6ef1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:55.512734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ea000-ec8a-417e-af40-56792e406099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:55.513760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ea000-ec8a-417e-af40-56792e406099 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:55.514175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ea000-ec8a-417e-af40-56792e406099 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:55.515142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ea000-ec8a-417e-af40-56792e406099 admin admin] PATH_INFO: `/v3/projects/35c196c56e8344e4a76b904c4b8ba624/users/49d185bd12fc44d494d5346254ac9595/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:55.517323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ea000-ec8a-417e-af40-56792e406099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c196c56e8344e4a76b904c4b8ba624, user_id=49d185bd12fc44d494d5346254ac9595, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:55.527543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ea000-ec8a-417e-af40-56792e406099 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:55.558358 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 946/1888] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:46:55 2021] PUT /identity/v3/projects/35c196c56e8344e4a76b904c4b8ba624/users/49d185bd12fc44d494d5346254ac9595/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:55.560845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f3176-8612-4f0f-94e2-db09e84887cc None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:55.561337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f3176-8612-4f0f-94e2-db09e84887cc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:55.561885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83c6e5-d11c-4f58-a753-69508cb6ef1f service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:55.562045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f3176-8612-4f0f-94e2-db09e84887cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:55.601956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7b9f3176-8612-4f0f-94e2-db09e84887cc None None] MFA Rules not processed for user `49d185bd12fc44d494d5346254ac9595`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:55.603461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7b9f3176-8612-4f0f-94e2-db09e84887cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:55.779119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a66989-a254-4f0a-b889-3f8107acbfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:55.780299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a66989-a254-4f0a-b889-3f8107acbfc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:55.780430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a66989-a254-4f0a-b889-3f8107acbfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:55.780719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a66989-a254-4f0a-b889-3f8107acbfc7 admin admin] PATH_INFO: `/v3/users/c7ff8c9eec54474c9b71a59dddffc7d4` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:55.782642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a66989-a254-4f0a-b889-3f8107acbfc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ff8c9eec54474c9b71a59dddffc7d4)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:55.784776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a66989-a254-4f0a-b889-3f8107acbfc7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:55.788333 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 947/1889] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:55 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:55.790333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d768b-30b6-4145-9080-048d5131c3dc None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:55.790779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d768b-30b6-4145-9080-048d5131c3dc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:55.791926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d768b-30b6-4145-9080-048d5131c3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:55.817207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-951d768b-30b6-4145-9080-048d5131c3dc None None] MFA Rules not processed for user `6f8eeb55c523480fb45d4bbb8afe8e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:55.819009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-951d768b-30b6-4145-9080-048d5131c3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:55.886345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a9a66989-a254-4f0a-b889-3f8107acbfc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ff8c9eec54474c9b71a59dddffc7d4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:55.903686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a9a66989-a254-4f0a-b889-3f8107acbfc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ff8c9eec54474c9b71a59dddffc7d4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:55.935896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a9a66989-a254-4f0a-b889-3f8107acbfc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ff8c9eec54474c9b71a59dddffc7d4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:55.937020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a9a66989-a254-4f0a-b889-3f8107acbfc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ff8c9eec54474c9b71a59dddffc7d4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:55.954857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a9a66989-a254-4f0a-b889-3f8107acbfc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ff8c9eec54474c9b71a59dddffc7d4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:55.968588 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 943/1890] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:55 2021] DELETE /identity/v3/users/c7ff8c9eec54474c9b71a59dddffc7d4 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:46:55.972350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a66989-a254-4f0a-b889-3f8107acbfc7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:55.972350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a9a66989-a254-4f0a-b889-3f8107acbfc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:56.055070 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 948/1891] 10.222.0.36 () {58 vars in 1015 bytes} [Sat Dec 18 20:46:55 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:56.062824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8815-cf60-4dd6-a432-0cb09895199b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:56.070402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8815-cf60-4dd6-a432-0cb09895199b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:56.074414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8815-cf60-4dd6-a432-0cb09895199b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:56.129521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-10bd8815-cf60-4dd6-a432-0cb09895199b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:56.131105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-10bd8815-cf60-4dd6-a432-0cb09895199b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:56.164389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a66989-a254-4f0a-b889-3f8107acbfc7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:56.178801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf179e42-4b77-4caf-bc41-69192fa6fb90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:56.179574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf179e42-4b77-4caf-bc41-69192fa6fb90 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:56.180774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf179e42-4b77-4caf-bc41-69192fa6fb90 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:56.180774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf179e42-4b77-4caf-bc41-69192fa6fb90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:56.182668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bf179e42-4b77-4caf-bc41-69192fa6fb90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:56.314323 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 949/1892] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:56.315412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd8815-cf60-4dd6-a432-0cb09895199b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:56.322892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-10bd8815-cf60-4dd6-a432-0cb09895199b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:56.354967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf179e42-4b77-4caf-bc41-69192fa6fb90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:56.364211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf179e42-4b77-4caf-bc41-69192fa6fb90 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:56.414076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd8815-cf60-4dd6-a432-0cb09895199b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:56.420165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5eae74-94e5-464b-8460-65d31e992b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:56.421139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eae74-94e5-464b-8460-65d31e992b99 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:56.421536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eae74-94e5-464b-8460-65d31e992b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:56.421700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eae74-94e5-464b-8460-65d31e992b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:56.429980 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 944/1893] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:55 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:56.432767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5eae74-94e5-464b-8460-65d31e992b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:56.434544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5eae74-94e5-464b-8460-65d31e992b99 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:56.439436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf179e42-4b77-4caf-bc41-69192fa6fb90 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:56.446954 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 950/1894] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:56 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:56.498564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf179e42-4b77-4caf-bc41-69192fa6fb90 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:56.505183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7f4f2-c97e-4752-81ff-c14e87afa4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:56.506154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7f4f2-c97e-4752-81ff-c14e87afa4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:56.506648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7f4f2-c97e-4752-81ff-c14e87afa4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:56.507611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7f4f2-c97e-4752-81ff-c14e87afa4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:56.551966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7f4f2-c97e-4752-81ff-c14e87afa4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:56.555259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7f4f2-c97e-4752-81ff-c14e87afa4f2 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:56.580297 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 945/1895] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:56.788047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5eae74-94e5-464b-8460-65d31e992b99 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:56.789772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fe5eae74-94e5-464b-8460-65d31e992b99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:56.818154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5eae74-94e5-464b-8460-65d31e992b99 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:56.836305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca4fc-fba6-4587-bccf-06f102cc5341 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:56.838641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca4fc-fba6-4587-bccf-06f102cc5341 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:56.838928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca4fc-fba6-4587-bccf-06f102cc5341 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:56.839207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca4fc-fba6-4587-bccf-06f102cc5341 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:56.845326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-88dca4fc-fba6-4587-bccf-06f102cc5341 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:56.924306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7f4f2-c97e-4752-81ff-c14e87afa4f2 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:56.929264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cbc7f4f2-c97e-4752-81ff-c14e87afa4f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:56.956117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7f4f2-c97e-4752-81ff-c14e87afa4f2 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:56.961195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dca4fc-fba6-4587-bccf-06f102cc5341 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:56.963030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dca4fc-fba6-4587-bccf-06f102cc5341 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:56.966068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf87af3-121c-4eb1-aba1-0e2859fe225d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:56.967166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf87af3-121c-4eb1-aba1-0e2859fe225d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:56.967616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf87af3-121c-4eb1-aba1-0e2859fe225d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:56.968043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf87af3-121c-4eb1-aba1-0e2859fe225d admin admin] PATH_INFO: `/v3/projects/6a53df86cdf64762840ba9ff9232c0c2` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:56.970387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf87af3-121c-4eb1-aba1-0e2859fe225d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a53df86cdf64762840ba9ff9232c0c2)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:56.972305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf87af3-121c-4eb1-aba1-0e2859fe225d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:56.984155 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 951/1896] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:56 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:56.985284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca4fc-fba6-4587-bccf-06f102cc5341 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:56.999330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-88dca4fc-fba6-4587-bccf-06f102cc5341 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:57.062837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca4fc-fba6-4587-bccf-06f102cc5341 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:57.077047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5bf87af3-121c-4eb1-aba1-0e2859fe225d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a53df86cdf64762840ba9ff9232c0c2', 'request_id': 'req-5bf87af3-121c-4eb1-aba1-0e2859fe225d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.083938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5bf87af3-121c-4eb1-aba1-0e2859fe225d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a53df86cdf64762840ba9ff9232c0c2', 'request_id': 'req-5bf87af3-121c-4eb1-aba1-0e2859fe225d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.090932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5bf87af3-121c-4eb1-aba1-0e2859fe225d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a53df86cdf64762840ba9ff9232c0c2', 'request_id': 'req-5bf87af3-121c-4eb1-aba1-0e2859fe225d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.113270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5bf87af3-121c-4eb1-aba1-0e2859fe225d admin admin] The token cache is being invalidate because project 6a53df86cdf64762840ba9ff9232c0c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:57.113869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5bf87af3-121c-4eb1-aba1-0e2859fe225d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.114839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5bf87af3-121c-4eb1-aba1-0e2859fe225d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.120253 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 946/1897] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:56 2021] DELETE /identity/v3/projects/6a53df86cdf64762840ba9ff9232c0c2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:57.121946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf87af3-121c-4eb1-aba1-0e2859fe225d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:57.125172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5bf87af3-121c-4eb1-aba1-0e2859fe225d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:57.222107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf87af3-121c-4eb1-aba1-0e2859fe225d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:57.234430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1ddc6-539e-4092-b7a8-0a8cf6a67591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:57.235675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1ddc6-539e-4092-b7a8-0a8cf6a67591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:57.236238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1ddc6-539e-4092-b7a8-0a8cf6a67591 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:57.236879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1ddc6-539e-4092-b7a8-0a8cf6a67591 admin admin] PATH_INFO: `/v3/users/ea934bcf6f7f4c7fb493924b98845fcf` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:57.238855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1ddc6-539e-4092-b7a8-0a8cf6a67591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea934bcf6f7f4c7fb493924b98845fcf)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:57.242349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1ddc6-539e-4092-b7a8-0a8cf6a67591 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:57.309958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866c410-08f3-4ba1-bf23-dc22938ec6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:57.311334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866c410-08f3-4ba1-bf23-dc22938ec6e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:57.316912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866c410-08f3-4ba1-bf23-dc22938ec6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:57.317348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866c410-08f3-4ba1-bf23-dc22938ec6e5 admin admin] PATH_INFO: `/v3/projects/14f76973866547f0a574aeef810ea2ca` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:57.318951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866c410-08f3-4ba1-bf23-dc22938ec6e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f76973866547f0a574aeef810ea2ca)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:57.321511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866c410-08f3-4ba1-bf23-dc22938ec6e5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:57.323268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-11e1ddc6-539e-4092-b7a8-0a8cf6a67591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea934bcf6f7f4c7fb493924b98845fcf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.332570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-11e1ddc6-539e-4092-b7a8-0a8cf6a67591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea934bcf6f7f4c7fb493924b98845fcf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.347501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-11e1ddc6-539e-4092-b7a8-0a8cf6a67591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea934bcf6f7f4c7fb493924b98845fcf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.348384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-11e1ddc6-539e-4092-b7a8-0a8cf6a67591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea934bcf6f7f4c7fb493924b98845fcf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.359158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-11e1ddc6-539e-4092-b7a8-0a8cf6a67591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea934bcf6f7f4c7fb493924b98845fcf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.370595 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 947/1898] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:57 2021] DELETE /identity/v3/users/ea934bcf6f7f4c7fb493924b98845fcf => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:57.407132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f866c410-08f3-4ba1-bf23-dc22938ec6e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f76973866547f0a574aeef810ea2ca', 'request_id': 'req-f866c410-08f3-4ba1-bf23-dc22938ec6e5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.420258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f866c410-08f3-4ba1-bf23-dc22938ec6e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f76973866547f0a574aeef810ea2ca', 'request_id': 'req-f866c410-08f3-4ba1-bf23-dc22938ec6e5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.432669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f866c410-08f3-4ba1-bf23-dc22938ec6e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f76973866547f0a574aeef810ea2ca', 'request_id': 'req-f866c410-08f3-4ba1-bf23-dc22938ec6e5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.453852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f866c410-08f3-4ba1-bf23-dc22938ec6e5 admin admin] The token cache is being invalidate because project 14f76973866547f0a574aeef810ea2ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:57.454149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f866c410-08f3-4ba1-bf23-dc22938ec6e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.455057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f866c410-08f3-4ba1-bf23-dc22938ec6e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.469148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1ddc6-539e-4092-b7a8-0a8cf6a67591 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:57.470659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-11e1ddc6-539e-4092-b7a8-0a8cf6a67591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:57.471003 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 952/1899] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:56 2021] DELETE /identity/v3/projects/14f76973866547f0a574aeef810ea2ca => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:57.475352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866c410-08f3-4ba1-bf23-dc22938ec6e5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:57.477974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f866c410-08f3-4ba1-bf23-dc22938ec6e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:57.590474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866c410-08f3-4ba1-bf23-dc22938ec6e5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:57.597668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8eb236-74a9-44da-9807-45845fb6c372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:57.599143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eb236-74a9-44da-9807-45845fb6c372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:57.599957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eb236-74a9-44da-9807-45845fb6c372 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:57.600420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eb236-74a9-44da-9807-45845fb6c372 admin admin] PATH_INFO: `/v3/users/9623a93108e2442bb6e99505d20929d1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:57.603621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8eb236-74a9-44da-9807-45845fb6c372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9623a93108e2442bb6e99505d20929d1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:57.607018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8eb236-74a9-44da-9807-45845fb6c372 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:57.619500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1ddc6-539e-4092-b7a8-0a8cf6a67591 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:57.639304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34692c73-14c7-455f-a0bf-2e061429544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:57.640225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34692c73-14c7-455f-a0bf-2e061429544c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:57.640500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34692c73-14c7-455f-a0bf-2e061429544c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:57.640783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34692c73-14c7-455f-a0bf-2e061429544c admin admin] PATH_INFO: `/v3/users/147de5c7427e4f88b1db71476ebcc5bc` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:57.648254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34692c73-14c7-455f-a0bf-2e061429544c admin admin] RBAC: Authorizing `identity:delete_user(user_id=147de5c7427e4f88b1db71476ebcc5bc)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:57.651898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34692c73-14c7-455f-a0bf-2e061429544c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:57.719358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e8eb236-74a9-44da-9807-45845fb6c372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9623a93108e2442bb6e99505d20929d1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.749148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e8eb236-74a9-44da-9807-45845fb6c372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9623a93108e2442bb6e99505d20929d1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.755346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e8eb236-74a9-44da-9807-45845fb6c372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9623a93108e2442bb6e99505d20929d1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.777467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-34692c73-14c7-455f-a0bf-2e061429544c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147de5c7427e4f88b1db71476ebcc5bc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.791558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e8eb236-74a9-44da-9807-45845fb6c372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9623a93108e2442bb6e99505d20929d1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.796401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-34692c73-14c7-455f-a0bf-2e061429544c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147de5c7427e4f88b1db71476ebcc5bc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.808788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e8eb236-74a9-44da-9807-45845fb6c372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9623a93108e2442bb6e99505d20929d1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.821952 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 953/1900] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:57 2021] DELETE /identity/v3/users/9623a93108e2442bb6e99505d20929d1 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:57.825187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-34692c73-14c7-455f-a0bf-2e061429544c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147de5c7427e4f88b1db71476ebcc5bc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.826450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-34692c73-14c7-455f-a0bf-2e061429544c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147de5c7427e4f88b1db71476ebcc5bc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.844689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-34692c73-14c7-455f-a0bf-2e061429544c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147de5c7427e4f88b1db71476ebcc5bc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:57.854171 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 948/1901] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:57 2021] DELETE /identity/v3/users/147de5c7427e4f88b1db71476ebcc5bc => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:46:57.864819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46e122-39dc-43ca-bb4e-d9a96115dfcc None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:57.866468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46e122-39dc-43ca-bb4e-d9a96115dfcc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:57.866468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46e122-39dc-43ca-bb4e-d9a96115dfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:57.893295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3c46e122-39dc-43ca-bb4e-d9a96115dfcc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:57.895746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3c46e122-39dc-43ca-bb4e-d9a96115dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:58.013548 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 954/1902] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:58.045808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34692c73-14c7-455f-a0bf-2e061429544c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:58.047588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-34692c73-14c7-455f-a0bf-2e061429544c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:58.053536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46e122-39dc-43ca-bb4e-d9a96115dfcc None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:58.055737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3c46e122-39dc-43ca-bb4e-d9a96115dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:58.078659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46e122-39dc-43ca-bb4e-d9a96115dfcc None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:58.105786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873d321-a735-4dc5-9bf6-61656ea93698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:58.107111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873d321-a735-4dc5-9bf6-61656ea93698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:58.109182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873d321-a735-4dc5-9bf6-61656ea93698 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:58.117452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873d321-a735-4dc5-9bf6-61656ea93698 admin admin] PATH_INFO: `/v3/projects/a4b87a38aaf24b5b8bb90fb9e4e479c8` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:58.127526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873d321-a735-4dc5-9bf6-61656ea93698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b87a38aaf24b5b8bb90fb9e4e479c8)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:58.131083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873d321-a735-4dc5-9bf6-61656ea93698 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:58.184201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34692c73-14c7-455f-a0bf-2e061429544c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:58.192799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e6927-8e62-404b-9bab-b55a952daa9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:58.193849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e6927-8e62-404b-9bab-b55a952daa9c service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:58.194641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e6927-8e62-404b-9bab-b55a952daa9c service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:58.195038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e6927-8e62-404b-9bab-b55a952daa9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:58.207396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e6927-8e62-404b-9bab-b55a952daa9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:58.209263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e6927-8e62-404b-9bab-b55a952daa9c service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:58.222153 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 949/1903] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:46:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:46:58.270942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8873d321-a735-4dc5-9bf6-61656ea93698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b87a38aaf24b5b8bb90fb9e4e479c8', 'request_id': 'req-8873d321-a735-4dc5-9bf6-61656ea93698'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:58.280064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8873d321-a735-4dc5-9bf6-61656ea93698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b87a38aaf24b5b8bb90fb9e4e479c8', 'request_id': 'req-8873d321-a735-4dc5-9bf6-61656ea93698'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:58.292237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8873d321-a735-4dc5-9bf6-61656ea93698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b87a38aaf24b5b8bb90fb9e4e479c8', 'request_id': 'req-8873d321-a735-4dc5-9bf6-61656ea93698'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:58.308827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e6927-8e62-404b-9bab-b55a952daa9c service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:58.310308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0d0e6927-8e62-404b-9bab-b55a952daa9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:58.310890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8873d321-a735-4dc5-9bf6-61656ea93698 admin admin] The token cache is being invalidate because project a4b87a38aaf24b5b8bb90fb9e4e479c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:58.311797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8873d321-a735-4dc5-9bf6-61656ea93698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:58.312697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8873d321-a735-4dc5-9bf6-61656ea93698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:58.315991 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 955/1904] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:58 2021] DELETE /identity/v3/projects/a4b87a38aaf24b5b8bb90fb9e4e479c8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:58.318634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873d321-a735-4dc5-9bf6-61656ea93698 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:58.322784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8873d321-a735-4dc5-9bf6-61656ea93698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:58.330105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e6927-8e62-404b-9bab-b55a952daa9c service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:58.457047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873d321-a735-4dc5-9bf6-61656ea93698 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:58.464901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba9ae3-01c8-4f09-b7b8-953fad925eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:58.467464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba9ae3-01c8-4f09-b7b8-953fad925eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:58.468892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba9ae3-01c8-4f09-b7b8-953fad925eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:58.469367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba9ae3-01c8-4f09-b7b8-953fad925eb0 admin admin] PATH_INFO: `/v3/users/1e358d284ffb4579913c0df4006107fa` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:58.472803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba9ae3-01c8-4f09-b7b8-953fad925eb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e358d284ffb4579913c0df4006107fa)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:58.481169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba9ae3-01c8-4f09-b7b8-953fad925eb0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:58.501016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470530b0-581c-47dd-92c7-07d6fc4fb016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:58.502727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470530b0-581c-47dd-92c7-07d6fc4fb016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:58.503478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470530b0-581c-47dd-92c7-07d6fc4fb016 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:58.504556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470530b0-581c-47dd-92c7-07d6fc4fb016 admin admin] PATH_INFO: `/v3/projects/90f789868fb14e8a99859aabd68e8f2e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:58.506463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470530b0-581c-47dd-92c7-07d6fc4fb016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90f789868fb14e8a99859aabd68e8f2e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:58.508670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470530b0-581c-47dd-92c7-07d6fc4fb016 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:58.595385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebba9ae3-01c8-4f09-b7b8-953fad925eb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e358d284ffb4579913c0df4006107fa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:58.627052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebba9ae3-01c8-4f09-b7b8-953fad925eb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e358d284ffb4579913c0df4006107fa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:58.630092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebba9ae3-01c8-4f09-b7b8-953fad925eb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e358d284ffb4579913c0df4006107fa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:58.637869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-470530b0-581c-47dd-92c7-07d6fc4fb016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f789868fb14e8a99859aabd68e8f2e', 'request_id': 'req-470530b0-581c-47dd-92c7-07d6fc4fb016'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:58.645337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-470530b0-581c-47dd-92c7-07d6fc4fb016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f789868fb14e8a99859aabd68e8f2e', 'request_id': 'req-470530b0-581c-47dd-92c7-07d6fc4fb016'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:58.667334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebba9ae3-01c8-4f09-b7b8-953fad925eb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e358d284ffb4579913c0df4006107fa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:58.670198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-470530b0-581c-47dd-92c7-07d6fc4fb016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f789868fb14e8a99859aabd68e8f2e', 'request_id': 'req-470530b0-581c-47dd-92c7-07d6fc4fb016'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:58.681606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebba9ae3-01c8-4f09-b7b8-953fad925eb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e358d284ffb4579913c0df4006107fa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:58.702424 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 956/1905] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:58 2021] DELETE /identity/v3/users/1e358d284ffb4579913c0df4006107fa => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:58.702424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba9ae3-01c8-4f09-b7b8-953fad925eb0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:58.704373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ebba9ae3-01c8-4f09-b7b8-953fad925eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:58.715801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-470530b0-581c-47dd-92c7-07d6fc4fb016 admin admin] The token cache is being invalidate because project 90f789868fb14e8a99859aabd68e8f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:58.716280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-470530b0-581c-47dd-92c7-07d6fc4fb016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:58.717070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-470530b0-581c-47dd-92c7-07d6fc4fb016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:58.718995 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 950/1906] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:58 2021] DELETE /identity/v3/projects/90f789868fb14e8a99859aabd68e8f2e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:46:58.728606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591e834-c5d7-402f-9db5-28a003c4b4b3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:58.728908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591e834-c5d7-402f-9db5-28a003c4b4b3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:58.729193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591e834-c5d7-402f-9db5-28a003c4b4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:58.773383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6591e834-c5d7-402f-9db5-28a003c4b4b3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:58.775671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6591e834-c5d7-402f-9db5-28a003c4b4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:58.901644 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 951/1907] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:58.912825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba9ae3-01c8-4f09-b7b8-953fad925eb0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:58.913489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d36b07-b2d3-4b06-aac1-9eb84bb060fd None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:58.913796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d36b07-b2d3-4b06-aac1-9eb84bb060fd None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:58.915621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d36b07-b2d3-4b06-aac1-9eb84bb060fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:58.921040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:58.922116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:58.922568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:58.922989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708 admin admin] PATH_INFO: `/v3/projects/79c1a11aa4e0420fb64e2fecc5783455` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:58.924579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c1a11aa4e0420fb64e2fecc5783455)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:58.929203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:58.963338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e1d36b07-b2d3-4b06-aac1-9eb84bb060fd None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:58.964581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e1d36b07-b2d3-4b06-aac1-9eb84bb060fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:58.992168 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 952/1908] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:59.006117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d36b07-b2d3-4b06-aac1-9eb84bb060fd None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:59.007645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e1d36b07-b2d3-4b06-aac1-9eb84bb060fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:59.027234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d36b07-b2d3-4b06-aac1-9eb84bb060fd None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:59.030115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c1a11aa4e0420fb64e2fecc5783455', 'request_id': 'req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.063003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c1a11aa4e0420fb64e2fecc5783455', 'request_id': 'req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.078115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c1a11aa4e0420fb64e2fecc5783455', 'request_id': 'req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.106866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708 admin admin] The token cache is being invalidate because project 79c1a11aa4e0420fb64e2fecc5783455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:59.106866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.111127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.120678 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 957/1909] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:58 2021] DELETE /identity/v3/projects/79c1a11aa4e0420fb64e2fecc5783455 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:59.121379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:59.126192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:59.140864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afa9ce-5644-414f-abc1-c9aead5265c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:59.141898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afa9ce-5644-414f-abc1-c9aead5265c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:59.142737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afa9ce-5644-414f-abc1-c9aead5265c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:59.142737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afa9ce-5644-414f-abc1-c9aead5265c4 admin admin] PATH_INFO: `/v3/projects/5e15548f5de148ff92b951b5b631bef5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:59.144090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afa9ce-5644-414f-abc1-c9aead5265c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e15548f5de148ff92b951b5b631bef5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:59.146499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afa9ce-5644-414f-abc1-c9aead5265c4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:59.229399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-99afa9ce-5644-414f-abc1-c9aead5265c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e15548f5de148ff92b951b5b631bef5', 'request_id': 'req-99afa9ce-5644-414f-abc1-c9aead5265c4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.237515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-99afa9ce-5644-414f-abc1-c9aead5265c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e15548f5de148ff92b951b5b631bef5', 'request_id': 'req-99afa9ce-5644-414f-abc1-c9aead5265c4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.250468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-99afa9ce-5644-414f-abc1-c9aead5265c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e15548f5de148ff92b951b5b631bef5', 'request_id': 'req-99afa9ce-5644-414f-abc1-c9aead5265c4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.271680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-99afa9ce-5644-414f-abc1-c9aead5265c4 admin admin] The token cache is being invalidate because project 5e15548f5de148ff92b951b5b631bef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:59.272153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-99afa9ce-5644-414f-abc1-c9aead5265c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.272872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-99afa9ce-5644-414f-abc1-c9aead5265c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.293325 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 953/1910] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:58 2021] DELETE /identity/v3/projects/5e15548f5de148ff92b951b5b631bef5 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:59.297862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf24cd1-0291-4c8c-9bb7-065a7b816ca9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:59.298325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf24cd1-0291-4c8c-9bb7-065a7b816ca9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:59.298919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf24cd1-0291-4c8c-9bb7-065a7b816ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:59.310289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2aef8-2a8e-4d04-9d22-fa8c98ed5708 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:59.349304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4bf24cd1-0291-4c8c-9bb7-065a7b816ca9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:59.353156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4bf24cd1-0291-4c8c-9bb7-065a7b816ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:59.444348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc62b3-0b61-4cd3-84d0-295c2111a4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:59.445018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc62b3-0b61-4cd3-84d0-295c2111a4ff admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:59.449995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc62b3-0b61-4cd3-84d0-295c2111a4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:59.450291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc62b3-0b61-4cd3-84d0-295c2111a4ff admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:59.453505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc62b3-0b61-4cd3-84d0-295c2111a4ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:46:59.453505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc62b3-0b61-4cd3-84d0-295c2111a4ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:59.453989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc62b3-0b61-4cd3-84d0-295c2111a4ff admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:59.470020 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 954/1911] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:59.470020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf24cd1-0291-4c8c-9bb7-065a7b816ca9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:59.475292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4bf24cd1-0291-4c8c-9bb7-065a7b816ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:59.506219 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 958/1912] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:46:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:46:59.506219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc62b3-0b61-4cd3-84d0-295c2111a4ff admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:59.510868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-65fc62b3-0b61-4cd3-84d0-295c2111a4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:59.514833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf24cd1-0291-4c8c-9bb7-065a7b816ca9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:59.521034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd4827-0be9-4bef-ba0a-700cfa9fd7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:59.522110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd4827-0be9-4bef-ba0a-700cfa9fd7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:59.522539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd4827-0be9-4bef-ba0a-700cfa9fd7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:59.522914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd4827-0be9-4bef-ba0a-700cfa9fd7dd admin admin] PATH_INFO: `/v3/users/49d185bd12fc44d494d5346254ac9595` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:59.525241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd4827-0be9-4bef-ba0a-700cfa9fd7dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=49d185bd12fc44d494d5346254ac9595)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:59.527726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd4827-0be9-4bef-ba0a-700cfa9fd7dd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:59.536005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc62b3-0b61-4cd3-84d0-295c2111a4ff admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:59.541103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7ce43-eead-413f-be98-bee53a4efb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:59.542101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7ce43-eead-413f-be98-bee53a4efb32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:59.542355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7ce43-eead-413f-be98-bee53a4efb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:59.542640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7ce43-eead-413f-be98-bee53a4efb32 admin admin] PATH_INFO: `/v3/projects/8dd4aeb197724abc99d99350c9ab72ab` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:59.544567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7ce43-eead-413f-be98-bee53a4efb32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd4aeb197724abc99d99350c9ab72ab)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:59.546722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7ce43-eead-413f-be98-bee53a4efb32 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:59.593581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2edd4827-0be9-4bef-ba0a-700cfa9fd7dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d185bd12fc44d494d5346254ac9595'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.606071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2edd4827-0be9-4bef-ba0a-700cfa9fd7dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d185bd12fc44d494d5346254ac9595'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.622207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ccd7ce43-eead-413f-be98-bee53a4efb32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd4aeb197724abc99d99350c9ab72ab', 'request_id': 'req-ccd7ce43-eead-413f-be98-bee53a4efb32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.627564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2edd4827-0be9-4bef-ba0a-700cfa9fd7dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d185bd12fc44d494d5346254ac9595'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.628332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2edd4827-0be9-4bef-ba0a-700cfa9fd7dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d185bd12fc44d494d5346254ac9595'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.630966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ccd7ce43-eead-413f-be98-bee53a4efb32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd4aeb197724abc99d99350c9ab72ab', 'request_id': 'req-ccd7ce43-eead-413f-be98-bee53a4efb32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.639015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2edd4827-0be9-4bef-ba0a-700cfa9fd7dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d185bd12fc44d494d5346254ac9595'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.641667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ccd7ce43-eead-413f-be98-bee53a4efb32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd4aeb197724abc99d99350c9ab72ab', 'request_id': 'req-ccd7ce43-eead-413f-be98-bee53a4efb32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.651196 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 955/1913] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:46:59 2021] DELETE /identity/v3/users/49d185bd12fc44d494d5346254ac9595 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:59.652761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761de74-56fe-43c7-9b1d-fe4f925388a9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:59.653144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761de74-56fe-43c7-9b1d-fe4f925388a9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:59.653396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761de74-56fe-43c7-9b1d-fe4f925388a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:59.653865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ccd7ce43-eead-413f-be98-bee53a4efb32 admin admin] The token cache is being invalidate because project 8dd4aeb197724abc99d99350c9ab72ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:46:59.654224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ccd7ce43-eead-413f-be98-bee53a4efb32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.655064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ccd7ce43-eead-413f-be98-bee53a4efb32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:46:59.656739 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 959/1914] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:46:59 2021] DELETE /identity/v3/projects/8dd4aeb197724abc99d99350c9ab72ab => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:46:59.675634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7761de74-56fe-43c7-9b1d-fe4f925388a9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:59.677803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7761de74-56fe-43c7-9b1d-fe4f925388a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:59.691534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7ce43-eead-413f-be98-bee53a4efb32 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:46:59.693802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ccd7ce43-eead-413f-be98-bee53a4efb32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:46:59.940105 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 956/1915] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:46:59.940322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7ce43-eead-413f-be98-bee53a4efb32 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:46:59.941126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0895ee-586d-40a9-89ac-8c9164cb89ea None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:59.941803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0895ee-586d-40a9-89ac-8c9164cb89ea None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:59.942091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0895ee-586d-40a9-89ac-8c9164cb89ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:59.950364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0fad8-bc3d-4d1b-9fd4-78dc48564c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:46:59.951055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0fad8-bc3d-4d1b-9fd4-78dc48564c48 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:46:59.951361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0fad8-bc3d-4d1b-9fd4-78dc48564c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:46:59.951697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0fad8-bc3d-4d1b-9fd4-78dc48564c48 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:46:59.952577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0fad8-bc3d-4d1b-9fd4-78dc48564c48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:46:59.955838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0fad8-bc3d-4d1b-9fd4-78dc48564c48 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:46:59.994167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8f0895ee-586d-40a9-89ac-8c9164cb89ea None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:46:59.996289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8f0895ee-586d-40a9-89ac-8c9164cb89ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:00.050314 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 957/1916] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:46:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:00.050314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daecbd3-8da8-4e22-95ae-d59763f29521 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:00.050314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daecbd3-8da8-4e22-95ae-d59763f29521 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:00.050314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daecbd3-8da8-4e22-95ae-d59763f29521 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:00.050314 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 958/1917] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:47:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:47:00.050314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daecbd3-8da8-4e22-95ae-d59763f29521 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:00.079839 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 960/1918] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:46:59 2021] POST /identity/v3/projects => generated 371 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:00.082562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8006b60-d80f-4b9a-a244-546fb0e168bd None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:00.082858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8006b60-d80f-4b9a-a244-546fb0e168bd None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:00.083137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8006b60-d80f-4b9a-a244-546fb0e168bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:00.093283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daecbd3-8da8-4e22-95ae-d59763f29521 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:00.125668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b8006b60-d80f-4b9a-a244-546fb0e168bd None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:00.128469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b8006b60-d80f-4b9a-a244-546fb0e168bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:00.201335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52877c-3e3e-48a9-b80f-40f55a5db570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:00.202558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52877c-3e3e-48a9-b80f-40f55a5db570 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:00.203054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52877c-3e3e-48a9-b80f-40f55a5db570 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:00.203645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52877c-3e3e-48a9-b80f-40f55a5db570 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:00.204602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52877c-3e3e-48a9-b80f-40f55a5db570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:47:00.205116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52877c-3e3e-48a9-b80f-40f55a5db570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:00.207275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52877c-3e3e-48a9-b80f-40f55a5db570 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:00.235473 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 959/1919] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:47:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:47:00.237160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa1db5-7b3d-475b-9af8-faf28691a744 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:00.237975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa1db5-7b3d-475b-9af8-faf28691a744 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:00.238817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa1db5-7b3d-475b-9af8-faf28691a744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:00.261939 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 961/1920] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:00.262916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8006b60-d80f-4b9a-a244-546fb0e168bd None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:00.274200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8006b60-d80f-4b9a-a244-546fb0e168bd None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:00.279378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec97712-2875-40e8-9bb4-cb891162d39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:00.280106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec97712-2875-40e8-9bb4-cb891162d39b admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:00.280392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec97712-2875-40e8-9bb4-cb891162d39b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:00.283580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec97712-2875-40e8-9bb4-cb891162d39b admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:00.283580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec97712-2875-40e8-9bb4-cb891162d39b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:00.283580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec97712-2875-40e8-9bb4-cb891162d39b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:00.309175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0eaa1db5-7b3d-475b-9af8-faf28691a744 None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:00.310604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0eaa1db5-7b3d-475b-9af8-faf28691a744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:00.329647 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 962/1921] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:00 2021] POST /identity/v3/users => generated 286 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:00.330564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec97712-2875-40e8-9bb4-cb891162d39b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:00.344995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec97712-2875-40e8-9bb4-cb891162d39b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:00.355860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea5699-2c38-4962-b0a8-41ca57c53265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:00.356676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea5699-2c38-4962-b0a8-41ca57c53265 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:00.356855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea5699-2c38-4962-b0a8-41ca57c53265 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:00.357094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea5699-2c38-4962-b0a8-41ca57c53265 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:00.357868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea5699-2c38-4962-b0a8-41ca57c53265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:00.359975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea5699-2c38-4962-b0a8-41ca57c53265 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:00.401436 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 963/1922] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:00 2021] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:00.402496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea5699-2c38-4962-b0a8-41ca57c53265 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:00.423720 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 960/1923] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:47:00 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:00.423720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa1db5-7b3d-475b-9af8-faf28691a744 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:00.426107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0eaa1db5-7b3d-475b-9af8-faf28691a744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:00.440740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa1db5-7b3d-475b-9af8-faf28691a744 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:00.482564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea5699-2c38-4962-b0a8-41ca57c53265 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:00.488503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ca695-61ed-41d0-80f2-d2a7a836a467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:00.489867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ca695-61ed-41d0-80f2-d2a7a836a467 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:00.490317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ca695-61ed-41d0-80f2-d2a7a836a467 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:00.490903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ca695-61ed-41d0-80f2-d2a7a836a467 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:00.491669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ca695-61ed-41d0-80f2-d2a7a836a467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:47:00.494543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ca695-61ed-41d0-80f2-d2a7a836a467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:00.497210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ca695-61ed-41d0-80f2-d2a7a836a467 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:00.509989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962addb-9efd-4a02-a6d1-f575064b5351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:00.511457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962addb-9efd-4a02-a6d1-f575064b5351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:00.511753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962addb-9efd-4a02-a6d1-f575064b5351 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:00.512038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962addb-9efd-4a02-a6d1-f575064b5351 admin admin] PATH_INFO: `/v3/projects/35c196c56e8344e4a76b904c4b8ba624` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:00.513283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962addb-9efd-4a02-a6d1-f575064b5351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35c196c56e8344e4a76b904c4b8ba624)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:00.517789 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 964/1924] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:47:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:47:00.518100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962addb-9efd-4a02-a6d1-f575064b5351 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:00.518539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ca695-61ed-41d0-80f2-d2a7a836a467 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:00.541829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ca695-61ed-41d0-80f2-d2a7a836a467 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:00.548322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248ee5d-c7ad-4651-9cf4-8b668a62d6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:00.549459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248ee5d-c7ad-4651-9cf4-8b668a62d6ba admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:00.549871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248ee5d-c7ad-4651-9cf4-8b668a62d6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:00.550146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248ee5d-c7ad-4651-9cf4-8b668a62d6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:00.551198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248ee5d-c7ad-4651-9cf4-8b668a62d6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:00.552830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248ee5d-c7ad-4651-9cf4-8b668a62d6ba admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:00.564177 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 965/1925] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:00 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:00.565102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248ee5d-c7ad-4651-9cf4-8b668a62d6ba admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:00.576826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248ee5d-c7ad-4651-9cf4-8b668a62d6ba admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:00.611135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6962addb-9efd-4a02-a6d1-f575064b5351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35c196c56e8344e4a76b904c4b8ba624', 'request_id': 'req-6962addb-9efd-4a02-a6d1-f575064b5351'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:00.629486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6962addb-9efd-4a02-a6d1-f575064b5351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35c196c56e8344e4a76b904c4b8ba624', 'request_id': 'req-6962addb-9efd-4a02-a6d1-f575064b5351'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:00.643380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6962addb-9efd-4a02-a6d1-f575064b5351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35c196c56e8344e4a76b904c4b8ba624', 'request_id': 'req-6962addb-9efd-4a02-a6d1-f575064b5351'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:00.657288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692b6f4-cdae-4bf5-9321-e5f5fb4f67d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:00.658117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692b6f4-cdae-4bf5-9321-e5f5fb4f67d2 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:00.658451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692b6f4-cdae-4bf5-9321-e5f5fb4f67d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:00.658841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692b6f4-cdae-4bf5-9321-e5f5fb4f67d2 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:00.660059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692b6f4-cdae-4bf5-9321-e5f5fb4f67d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:00.663329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692b6f4-cdae-4bf5-9321-e5f5fb4f67d2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:00.665161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6962addb-9efd-4a02-a6d1-f575064b5351 admin admin] The token cache is being invalidate because project 35c196c56e8344e4a76b904c4b8ba624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:00.665803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6962addb-9efd-4a02-a6d1-f575064b5351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:00.666679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6962addb-9efd-4a02-a6d1-f575064b5351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:00.668773 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 961/1926] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:00 2021] DELETE /identity/v3/projects/35c196c56e8344e4a76b904c4b8ba624 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:00.669765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962addb-9efd-4a02-a6d1-f575064b5351 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:00.671587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6962addb-9efd-4a02-a6d1-f575064b5351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:00.705818 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 966/1927] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:00 2021] POST /identity/v3/users => generated 285 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:00.707068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692b6f4-cdae-4bf5-9321-e5f5fb4f67d2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:00.709242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4692b6f4-cdae-4bf5-9321-e5f5fb4f67d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:00.726194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692b6f4-cdae-4bf5-9321-e5f5fb4f67d2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:00.732345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf63a47-1019-43f0-b094-b1d52bbd6d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:00.733327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf63a47-1019-43f0-b094-b1d52bbd6d0b admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:00.733812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf63a47-1019-43f0-b094-b1d52bbd6d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:00.734339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf63a47-1019-43f0-b094-b1d52bbd6d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:00.735252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf63a47-1019-43f0-b094-b1d52bbd6d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:00.737663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf63a47-1019-43f0-b094-b1d52bbd6d0b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:00.782030 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 967/1928] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:00 2021] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:00.782030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf63a47-1019-43f0-b094-b1d52bbd6d0b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:00.782030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ddf63a47-1019-43f0-b094-b1d52bbd6d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:00.786666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962addb-9efd-4a02-a6d1-f575064b5351 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:00.888271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf63a47-1019-43f0-b094-b1d52bbd6d0b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:00.893306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824f5f4-2375-4b2e-b8db-8735c415e30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:00.894018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824f5f4-2375-4b2e-b8db-8735c415e30e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:00.894539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824f5f4-2375-4b2e-b8db-8735c415e30e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:00.894958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824f5f4-2375-4b2e-b8db-8735c415e30e admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:00.895724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824f5f4-2375-4b2e-b8db-8735c415e30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:00.897438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824f5f4-2375-4b2e-b8db-8735c415e30e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:00.914967 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 968/1929] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:00 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:00.917213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54953f-9798-48d8-87ad-fa6598177129 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:00.917887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54953f-9798-48d8-87ad-fa6598177129 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:00.918062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54953f-9798-48d8-87ad-fa6598177129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:00.929730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614738c-6855-458e-aac8-d3934e187b2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:00.930984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614738c-6855-458e-aac8-d3934e187b2b service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:00.931272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614738c-6855-458e-aac8-d3934e187b2b service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:00.931553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614738c-6855-458e-aac8-d3934e187b2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:00.933400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9614738c-6855-458e-aac8-d3934e187b2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:00.940023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4c54953f-9798-48d8-87ad-fa6598177129 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:00.941471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4c54953f-9798-48d8-87ad-fa6598177129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:00.952451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614738c-6855-458e-aac8-d3934e187b2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:00.954323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614738c-6855-458e-aac8-d3934e187b2b service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:00.966870 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 962/1930] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:00 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:00.967734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614738c-6855-458e-aac8-d3934e187b2b service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:00.970045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9614738c-6855-458e-aac8-d3934e187b2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:00.972142 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 969/1931] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:00.973155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54953f-9798-48d8-87ad-fa6598177129 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:00.990157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614738c-6855-458e-aac8-d3934e187b2b service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:00.996257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c331d-daac-430f-9593-ca52d0f60777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:00.997682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c331d-daac-430f-9593-ca52d0f60777 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:00.998029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c331d-daac-430f-9593-ca52d0f60777 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:00.998348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c331d-daac-430f-9593-ca52d0f60777 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:00.999101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c331d-daac-430f-9593-ca52d0f60777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:00.999661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54953f-9798-48d8-87ad-fa6598177129 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:01.001081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c331d-daac-430f-9593-ca52d0f60777 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:01.006236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050437a-8bce-47a5-82e5-01aec3eb1557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:01.007352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050437a-8bce-47a5-82e5-01aec3eb1557 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:01.007834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050437a-8bce-47a5-82e5-01aec3eb1557 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:01.008311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050437a-8bce-47a5-82e5-01aec3eb1557 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:01.009108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050437a-8bce-47a5-82e5-01aec3eb1557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:01.020410 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 963/1932] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:00 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:01.020410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c331d-daac-430f-9593-ca52d0f60777 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:01.025510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050437a-8bce-47a5-82e5-01aec3eb1557 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:01.058434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c331d-daac-430f-9593-ca52d0f60777 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:01.064638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb295a1e-f19f-435c-83ba-80825c496c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:01.065535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb295a1e-f19f-435c-83ba-80825c496c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:01.066156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb295a1e-f19f-435c-83ba-80825c496c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:01.066156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb295a1e-f19f-435c-83ba-80825c496c6f admin admin] PATH_INFO: `/v3/projects/672bebdd2d0047d19344e3d9cbb83869/users/9402162a10884271aa192ce5fc2fa63b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:01.091499 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 970/1933] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:00 2021] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:01.097924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5cf46-66b0-4164-8aaa-a5de4d9a7f64 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:01.098584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5cf46-66b0-4164-8aaa-a5de4d9a7f64 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:01.098584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5cf46-66b0-4164-8aaa-a5de4d9a7f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:01.105984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb295a1e-f19f-435c-83ba-80825c496c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=672bebdd2d0047d19344e3d9cbb83869, user_id=9402162a10884271aa192ce5fc2fa63b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:01.111348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb295a1e-f19f-435c-83ba-80825c496c6f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:01.135634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-76b5cf46-66b0-4164-8aaa-a5de4d9a7f64 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:01.135634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-76b5cf46-66b0-4164-8aaa-a5de4d9a7f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:01.154936 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 964/1934] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:01 2021] PUT /identity/v3/projects/672bebdd2d0047d19344e3d9cbb83869/users/9402162a10884271aa192ce5fc2fa63b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:01.155990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb295a1e-f19f-435c-83ba-80825c496c6f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:01.302613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb295a1e-f19f-435c-83ba-80825c496c6f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:01.312391 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 971/1935] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:01.317599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5cf46-66b0-4164-8aaa-a5de4d9a7f64 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:01.318730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e62c5-7e3e-4cd1-a697-9ef10a314fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:01.320788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e62c5-7e3e-4cd1-a697-9ef10a314fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:01.321043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e62c5-7e3e-4cd1-a697-9ef10a314fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:01.322576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e62c5-7e3e-4cd1-a697-9ef10a314fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:01.323952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e62c5-7e3e-4cd1-a697-9ef10a314fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:01.329580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e62c5-7e3e-4cd1-a697-9ef10a314fc8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:01.342939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5cf46-66b0-4164-8aaa-a5de4d9a7f64 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:01.350406 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 965/1936] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:01 2021] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:01.353786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39564763-d0df-4d6c-ab44-ba51564807f9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:01.354199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39564763-d0df-4d6c-ab44-ba51564807f9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:01.354429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39564763-d0df-4d6c-ab44-ba51564807f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:01.357518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829239fe-ac46-484b-9f54-6202754850c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:01.358194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829239fe-ac46-484b-9f54-6202754850c5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:01.358508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829239fe-ac46-484b-9f54-6202754850c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:01.358787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829239fe-ac46-484b-9f54-6202754850c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:01.359530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829239fe-ac46-484b-9f54-6202754850c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:01.365146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829239fe-ac46-484b-9f54-6202754850c5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:01.382221 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 972/1937] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:01 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:01.383688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829239fe-ac46-484b-9f54-6202754850c5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:01.396431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829239fe-ac46-484b-9f54-6202754850c5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:01.405713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd34b3-5bfb-48c2-b1b9-f3f7d3542560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:01.409011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd34b3-5bfb-48c2-b1b9-f3f7d3542560 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:01.409011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd34b3-5bfb-48c2-b1b9-f3f7d3542560 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:01.409011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd34b3-5bfb-48c2-b1b9-f3f7d3542560 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:01.409011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd34b3-5bfb-48c2-b1b9-f3f7d3542560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:47:01.409011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd34b3-5bfb-48c2-b1b9-f3f7d3542560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:01.410861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd34b3-5bfb-48c2-b1b9-f3f7d3542560 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:01.429667 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 973/1938] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:47:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:47:01.435473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd34b3-5bfb-48c2-b1b9-f3f7d3542560 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:01.459559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd34b3-5bfb-48c2-b1b9-f3f7d3542560 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:01.460577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-39564763-d0df-4d6c-ab44-ba51564807f9 None None] MFA Rules not processed for user `9402162a10884271aa192ce5fc2fa63b`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:01.462552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-39564763-d0df-4d6c-ab44-ba51564807f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:01.476345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ea75a-8caf-4ab9-b43c-0943e2e60ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:01.477849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ea75a-8caf-4ab9-b43c-0943e2e60ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:01.478128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ea75a-8caf-4ab9-b43c-0943e2e60ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:01.478880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ea75a-8caf-4ab9-b43c-0943e2e60ee0 admin admin] PATH_INFO: `/v3/projects/0870e14bc2934bae9138d4818b260729/users/5aaf1ced6baf4e1d9c940cfe96b2c254/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:01.510712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ea75a-8caf-4ab9-b43c-0943e2e60ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0870e14bc2934bae9138d4818b260729, user_id=5aaf1ced6baf4e1d9c940cfe96b2c254, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:01.513403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ea75a-8caf-4ab9-b43c-0943e2e60ee0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:01.548933 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 974/1939] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:01 2021] PUT /identity/v3/projects/0870e14bc2934bae9138d4818b260729/users/5aaf1ced6baf4e1d9c940cfe96b2c254/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:01.548933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ea75a-8caf-4ab9-b43c-0943e2e60ee0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:01.623616 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 966/1940] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:01 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:01.624594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39564763-d0df-4d6c-ab44-ba51564807f9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:01.639716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39564763-d0df-4d6c-ab44-ba51564807f9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:01.722114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ea75a-8caf-4ab9-b43c-0943e2e60ee0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:01.727341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f68fdf-5589-460b-b9f2-106405e0fd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:01.728069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f68fdf-5589-460b-b9f2-106405e0fd95 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:01.728456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f68fdf-5589-460b-b9f2-106405e0fd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:01.728751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f68fdf-5589-460b-b9f2-106405e0fd95 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:01.729500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f68fdf-5589-460b-b9f2-106405e0fd95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:01.731297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f68fdf-5589-460b-b9f2-106405e0fd95 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:01.746431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed3c8d-4097-4b9e-a833-79b25eb41805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:01.747683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed3c8d-4097-4b9e-a833-79b25eb41805 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:01.748200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed3c8d-4097-4b9e-a833-79b25eb41805 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:01.748671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed3c8d-4097-4b9e-a833-79b25eb41805 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:01.749860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed3c8d-4097-4b9e-a833-79b25eb41805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:01.753562 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 975/1941] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:01 2021] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:01.753562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d104888-889f-48d7-8adc-f03da0356bc4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:01.753562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d104888-889f-48d7-8adc-f03da0356bc4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:01.753562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d104888-889f-48d7-8adc-f03da0356bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:01.756904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed3c8d-4097-4b9e-a833-79b25eb41805 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:01.790346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9d104888-889f-48d7-8adc-f03da0356bc4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:01.791899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9d104888-889f-48d7-8adc-f03da0356bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:01.817444 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 976/1942] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:01.823936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d104888-889f-48d7-8adc-f03da0356bc4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:01.827021 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 967/1943] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:01 2021] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:01.827398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9d104888-889f-48d7-8adc-f03da0356bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:01.828198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed3c8d-4097-4b9e-a833-79b25eb41805 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:01.944541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed3c8d-4097-4b9e-a833-79b25eb41805 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:01.947350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d104888-889f-48d7-8adc-f03da0356bc4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:01.951656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69ac42-6d11-4b91-a639-057a4f61b765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:01.952806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ac42-6d11-4b91-a639-057a4f61b765 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:01.953243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ac42-6d11-4b91-a639-057a4f61b765 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:01.954026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ac42-6d11-4b91-a639-057a4f61b765 admin admin] PATH_INFO: `/v3/projects/e7f864f89c274d6484fa3bf4415a6bdc/users/da2977a4846847cfbe2bc895e8163d03/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:01.977785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69ac42-6d11-4b91-a639-057a4f61b765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7f864f89c274d6484fa3bf4415a6bdc, user_id=da2977a4846847cfbe2bc895e8163d03, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:01.980468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69ac42-6d11-4b91-a639-057a4f61b765 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:02.004107 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 968/1944] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:01 2021] PUT /identity/v3/projects/e7f864f89c274d6484fa3bf4415a6bdc/users/da2977a4846847cfbe2bc895e8163d03/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:02.007198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69ac42-6d11-4b91-a639-057a4f61b765 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:02.007198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ec69ac42-6d11-4b91-a639-057a4f61b765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:02.034061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d88de-6434-49a1-8db5-e337b4956db8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:02.034829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d88de-6434-49a1-8db5-e337b4956db8 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:02.035250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d88de-6434-49a1-8db5-e337b4956db8 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:02.035739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d88de-6434-49a1-8db5-e337b4956db8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:02.097264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69ac42-6d11-4b91-a639-057a4f61b765 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:02.102122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f88a4-db31-441a-8f56-de970505a014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:02.102976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f88a4-db31-441a-8f56-de970505a014 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:02.103536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f88a4-db31-441a-8f56-de970505a014 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:02.104044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f88a4-db31-441a-8f56-de970505a014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:02.147010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d88de-6434-49a1-8db5-e337b4956db8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:02.152210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d88de-6434-49a1-8db5-e337b4956db8 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:02.163399 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 977/1945] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:01 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:02.164642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d88de-6434-49a1-8db5-e337b4956db8 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:02.176427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d88de-6434-49a1-8db5-e337b4956db8 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:02.215641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f88a4-db31-441a-8f56-de970505a014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:02.217380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f88a4-db31-441a-8f56-de970505a014 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:02.229030 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 969/1946] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:02.230233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c571fd-6963-4318-96ff-e421e503f042 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:02.230593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c571fd-6963-4318-96ff-e421e503f042 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:02.230883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c571fd-6963-4318-96ff-e421e503f042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:02.283556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-11c571fd-6963-4318-96ff-e421e503f042 None None] MFA Rules not processed for user `da2977a4846847cfbe2bc895e8163d03`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:02.285074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-11c571fd-6963-4318-96ff-e421e503f042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:02.296177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e20c4-5449-4dc5-9815-bbd6f0d2331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:02.297286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e20c4-5449-4dc5-9815-bbd6f0d2331e admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:02.299175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e20c4-5449-4dc5-9815-bbd6f0d2331e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:02.299886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e20c4-5449-4dc5-9815-bbd6f0d2331e admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:02.301628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e20c4-5449-4dc5-9815-bbd6f0d2331e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:02.304377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e20c4-5449-4dc5-9815-bbd6f0d2331e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:02.346531 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 978/1947] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:02 2021] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:02.350334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e20c4-5449-4dc5-9815-bbd6f0d2331e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:02.361956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e20c4-5449-4dc5-9815-bbd6f0d2331e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:02.367328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4d774-88f3-41f8-a15a-5a7346fcf7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:02.368986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4d774-88f3-41f8-a15a-5a7346fcf7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:02.369378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4d774-88f3-41f8-a15a-5a7346fcf7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:02.373930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4d774-88f3-41f8-a15a-5a7346fcf7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:02.374858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4d774-88f3-41f8-a15a-5a7346fcf7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:02.376650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4d774-88f3-41f8-a15a-5a7346fcf7e7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:02.388841 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 979/1948] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:02 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:47:02.392557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4d774-88f3-41f8-a15a-5a7346fcf7e7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:02.398069 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 970/1949] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:02 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:02.400376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c571fd-6963-4318-96ff-e421e503f042 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:02.416054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c571fd-6963-4318-96ff-e421e503f042 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:02.417202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4d774-88f3-41f8-a15a-5a7346fcf7e7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:02.422842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3ddae-0c8d-4165-b7a4-384325fd0859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:02.423525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3ddae-0c8d-4165-b7a4-384325fd0859 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:02.423982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3ddae-0c8d-4165-b7a4-384325fd0859 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:02.424279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3ddae-0c8d-4165-b7a4-384325fd0859 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:02.425015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3ddae-0c8d-4165-b7a4-384325fd0859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:02.428808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3ddae-0c8d-4165-b7a4-384325fd0859 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:02.437370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57574597-e730-4c63-b93a-433868958af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:02.438053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574597-e730-4c63-b93a-433868958af4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:02.438382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574597-e730-4c63-b93a-433868958af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:02.438702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574597-e730-4c63-b93a-433868958af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:02.439792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57574597-e730-4c63-b93a-433868958af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:02.441995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57574597-e730-4c63-b93a-433868958af4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:02.470432 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 980/1950] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:02 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:02.472338 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 971/1951] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:02 2021] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:02.473617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57574597-e730-4c63-b93a-433868958af4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:02.477621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3ddae-0c8d-4165-b7a4-384325fd0859 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:02.494808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57574597-e730-4c63-b93a-433868958af4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:02.582417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3ddae-0c8d-4165-b7a4-384325fd0859 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:02.595263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a52735-9113-4786-bf26-bfbd7ca4d341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:02.596010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a52735-9113-4786-bf26-bfbd7ca4d341 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:02.596302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a52735-9113-4786-bf26-bfbd7ca4d341 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:02.596840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a52735-9113-4786-bf26-bfbd7ca4d341 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:02.597303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a52735-9113-4786-bf26-bfbd7ca4d341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:02.599464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a52735-9113-4786-bf26-bfbd7ca4d341 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:02.629405 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 972/1952] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:02 2021] POST /identity/v3/users => generated 301 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:02.633723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a52735-9113-4786-bf26-bfbd7ca4d341 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:02.648600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a52735-9113-4786-bf26-bfbd7ca4d341 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:02.656784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9d036-9f47-4bf7-9f2e-1aac10b3af61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:02.657917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9d036-9f47-4bf7-9f2e-1aac10b3af61 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:02.658558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9d036-9f47-4bf7-9f2e-1aac10b3af61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:02.659264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9d036-9f47-4bf7-9f2e-1aac10b3af61 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:02.660295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9d036-9f47-4bf7-9f2e-1aac10b3af61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:02.662390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9d036-9f47-4bf7-9f2e-1aac10b3af61 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:02.675984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dd1cc-29a4-4b35-a6e4-cc41b39abbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:02.676931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dd1cc-29a4-4b35-a6e4-cc41b39abbff admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:02.677327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dd1cc-29a4-4b35-a6e4-cc41b39abbff admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:02.677558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dd1cc-29a4-4b35-a6e4-cc41b39abbff admin admin] PATH_INFO: `/v3/projects/2d4895af67194a949bf0f863c579506a/users/616f7911dc7d46018684f13535a620aa/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:02.678126 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 973/1953] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:02 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:02.682763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9d036-9f47-4bf7-9f2e-1aac10b3af61 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:02.703401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dd1cc-29a4-4b35-a6e4-cc41b39abbff admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d4895af67194a949bf0f863c579506a, user_id=616f7911dc7d46018684f13535a620aa, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:02.706569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dd1cc-29a4-4b35-a6e4-cc41b39abbff admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:02.723798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9d036-9f47-4bf7-9f2e-1aac10b3af61 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:02.742102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dcb58-55a7-45fc-90f7-228f234d73af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:02.745123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dcb58-55a7-45fc-90f7-228f234d73af admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:02.745600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dcb58-55a7-45fc-90f7-228f234d73af admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:02.746061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dcb58-55a7-45fc-90f7-228f234d73af admin admin] PATH_INFO: `/v3/projects/1331c14b3d704507b576904afb796ded/users/294f461f45d04d2d80b18791abbc97e4/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:02.756276 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 981/1954] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:02 2021] PUT /identity/v3/projects/2d4895af67194a949bf0f863c579506a/users/616f7911dc7d46018684f13535a620aa/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:02.757992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55147cf1-7f97-42e6-92d4-1150a514363c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:02.758397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55147cf1-7f97-42e6-92d4-1150a514363c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:02.758683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55147cf1-7f97-42e6-92d4-1150a514363c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:02.792115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73dcb58-55a7-45fc-90f7-228f234d73af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1331c14b3d704507b576904afb796ded, user_id=294f461f45d04d2d80b18791abbc97e4, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:02.797252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73dcb58-55a7-45fc-90f7-228f234d73af admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:02.798494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-55147cf1-7f97-42e6-92d4-1150a514363c None None] MFA Rules not processed for user `616f7911dc7d46018684f13535a620aa`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:02.799790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-55147cf1-7f97-42e6-92d4-1150a514363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:02.825010 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 974/1955] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:02 2021] PUT /identity/v3/projects/1331c14b3d704507b576904afb796ded/users/294f461f45d04d2d80b18791abbc97e4/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:02.828990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dcb58-55a7-45fc-90f7-228f234d73af admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:02.905293 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 982/1956] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:02 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:02.914338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55147cf1-7f97-42e6-92d4-1150a514363c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:02.938824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dcb58-55a7-45fc-90f7-228f234d73af admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:02.946655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c2573-81bd-4de6-b358-274d5499affa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:02.947210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c2573-81bd-4de6-b358-274d5499affa admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:02.947564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c2573-81bd-4de6-b358-274d5499affa admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:02.947847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c2573-81bd-4de6-b358-274d5499affa admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:02.948764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c2573-81bd-4de6-b358-274d5499affa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:02.950619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c2573-81bd-4de6-b358-274d5499affa admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:02.971151 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 975/1957] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:02 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:02.972778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c2573-81bd-4de6-b358-274d5499affa admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:02.986945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c2573-81bd-4de6-b358-274d5499affa admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:03.000210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da51d6b-8f1d-4e9f-ad8f-a7adaa0a2079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:03.002060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da51d6b-8f1d-4e9f-ad8f-a7adaa0a2079 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:03.002458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da51d6b-8f1d-4e9f-ad8f-a7adaa0a2079 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:03.003218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da51d6b-8f1d-4e9f-ad8f-a7adaa0a2079 admin admin] PATH_INFO: `/v3/projects/1331c14b3d704507b576904afb796ded/users/294f461f45d04d2d80b18791abbc97e4/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:03.005696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da51d6b-8f1d-4e9f-ad8f-a7adaa0a2079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1331c14b3d704507b576904afb796ded, user_id=294f461f45d04d2d80b18791abbc97e4, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:03.012063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da51d6b-8f1d-4e9f-ad8f-a7adaa0a2079 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:03.047000 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 976/1958] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:02 2021] PUT /identity/v3/projects/1331c14b3d704507b576904afb796ded/users/294f461f45d04d2d80b18791abbc97e4/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:03.060100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb209c5-3fc8-4647-9759-d2648b99a5ab None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:03.060462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb209c5-3fc8-4647-9759-d2648b99a5ab None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:03.060661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb209c5-3fc8-4647-9759-d2648b99a5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:03.083999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55147cf1-7f97-42e6-92d4-1150a514363c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:03.111753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5eb209c5-3fc8-4647-9759-d2648b99a5ab None None] MFA Rules not processed for user `294f461f45d04d2d80b18791abbc97e4`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:03.114581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5eb209c5-3fc8-4647-9759-d2648b99a5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:03.232854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129e71c-4773-4a9b-aeb1-cacf963bfe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:03.233542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129e71c-4773-4a9b-aeb1-cacf963bfe74 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:03.233934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129e71c-4773-4a9b-aeb1-cacf963bfe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:03.234220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129e71c-4773-4a9b-aeb1-cacf963bfe74 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:03.234965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129e71c-4773-4a9b-aeb1-cacf963bfe74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:03.236889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129e71c-4773-4a9b-aeb1-cacf963bfe74 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:03.256122 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 977/1959] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:03 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:03.335227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb209c5-3fc8-4647-9759-d2648b99a5ab None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:03.341531 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 983/1960] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:02 2021] POST /identity/v3/projects => generated 373 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:03.342642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129e71c-4773-4a9b-aeb1-cacf963bfe74 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:03.370810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb209c5-3fc8-4647-9759-d2648b99a5ab None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:03.476807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129e71c-4773-4a9b-aeb1-cacf963bfe74 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:03.484140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26424f-bf4b-470f-ae31-badf5cac7796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:03.485779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26424f-bf4b-470f-ae31-badf5cac7796 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:03.486423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26424f-bf4b-470f-ae31-badf5cac7796 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:03.486864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26424f-bf4b-470f-ae31-badf5cac7796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:03.541321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82064a-251b-4906-929b-f75b8ae525ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:03.542021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82064a-251b-4906-929b-f75b8ae525ba admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:03.542962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82064a-251b-4906-929b-f75b8ae525ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:03.543258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82064a-251b-4906-929b-f75b8ae525ba admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:03.544026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82064a-251b-4906-929b-f75b8ae525ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:03.546532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82064a-251b-4906-929b-f75b8ae525ba admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:03.582159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26424f-bf4b-470f-ae31-badf5cac7796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:03.586209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26424f-bf4b-470f-ae31-badf5cac7796 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:03.600084 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 984/1961] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:03 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:03.602092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ce9c-af23-487c-aceb-a7ed4f4ea42b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:03.602776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ce9c-af23-487c-aceb-a7ed4f4ea42b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:03.603249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ce9c-af23-487c-aceb-a7ed4f4ea42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:03.643607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-cef2ce9c-af23-487c-aceb-a7ed4f4ea42b None None] MFA Rules not processed for user `5aaf1ced6baf4e1d9c940cfe96b2c254`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:03.644926 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 978/1962] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:03 2021] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:03.645403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cef2ce9c-af23-487c-aceb-a7ed4f4ea42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:03.645924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82064a-251b-4906-929b-f75b8ae525ba admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:03.683539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82064a-251b-4906-929b-f75b8ae525ba admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:03.716105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd588f7-046d-41e0-af9b-8925775016e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:03.717252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd588f7-046d-41e0-af9b-8925775016e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:03.717252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd588f7-046d-41e0-af9b-8925775016e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:03.717411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd588f7-046d-41e0-af9b-8925775016e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:03.718235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd588f7-046d-41e0-af9b-8925775016e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:03.721695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd588f7-046d-41e0-af9b-8925775016e2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:03.767452 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 979/1963] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:03 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:03.768476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd588f7-046d-41e0-af9b-8925775016e2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:03.796710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd588f7-046d-41e0-af9b-8925775016e2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:03.812245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73920e-7534-4f12-8715-f1595aa75c02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:03.812968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73920e-7534-4f12-8715-f1595aa75c02 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:03.814352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73920e-7534-4f12-8715-f1595aa75c02 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:03.814700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73920e-7534-4f12-8715-f1595aa75c02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:03.844283 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 985/1964] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:03 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:03.851198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2ce9c-af23-487c-aceb-a7ed4f4ea42b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:03.873783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2ce9c-af23-487c-aceb-a7ed4f4ea42b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:03.878282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a540c-7bac-4f2a-a5bb-99b144985305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:03.879202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a540c-7bac-4f2a-a5bb-99b144985305 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:03.879488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a540c-7bac-4f2a-a5bb-99b144985305 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:03.879773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a540c-7bac-4f2a-a5bb-99b144985305 admin admin] PATH_INFO: `/v3/projects/d0fa3b4c35f14bb7afc98fd734dfe1e5/users/40e23bca9d3547c7aea9b6f149ec3621/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:03.907967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73920e-7534-4f12-8715-f1595aa75c02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:03.909770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73920e-7534-4f12-8715-f1595aa75c02 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:03.912576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a540c-7bac-4f2a-a5bb-99b144985305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0fa3b4c35f14bb7afc98fd734dfe1e5, user_id=40e23bca9d3547c7aea9b6f149ec3621, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:03.916610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a540c-7bac-4f2a-a5bb-99b144985305 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:03.926031 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 980/1965] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:03 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:03.927642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73920e-7534-4f12-8715-f1595aa75c02 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:03.943375 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 986/1966] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:03 2021] PUT /identity/v3/projects/d0fa3b4c35f14bb7afc98fd734dfe1e5/users/40e23bca9d3547c7aea9b6f149ec3621/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:03.945100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a540c-7bac-4f2a-a5bb-99b144985305 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:03.945994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73920e-7534-4f12-8715-f1595aa75c02 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:04.047130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a540c-7bac-4f2a-a5bb-99b144985305 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:04.052497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126fda9c-0fe4-4e8d-a1ae-b5444e6e8bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:04.053155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fda9c-0fe4-4e8d-a1ae-b5444e6e8bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:04.053437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fda9c-0fe4-4e8d-a1ae-b5444e6e8bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:04.054033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fda9c-0fe4-4e8d-a1ae-b5444e6e8bb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:04.054443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fda9c-0fe4-4e8d-a1ae-b5444e6e8bb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:04.056880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fda9c-0fe4-4e8d-a1ae-b5444e6e8bb1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:04.103431 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 987/1967] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:03 2021] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:04.104556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126fda9c-0fe4-4e8d-a1ae-b5444e6e8bb1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:04.157196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad29eb6-b202-4825-99c5-a6514d2fc32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:04.158360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad29eb6-b202-4825-99c5-a6514d2fc32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:04.158718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad29eb6-b202-4825-99c5-a6514d2fc32d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:04.159066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad29eb6-b202-4825-99c5-a6514d2fc32d admin admin] PATH_INFO: `/v3/users/9402162a10884271aa192ce5fc2fa63b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:04.160425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad29eb6-b202-4825-99c5-a6514d2fc32d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9402162a10884271aa192ce5fc2fa63b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:04.163686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad29eb6-b202-4825-99c5-a6514d2fc32d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:04.190063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126fda9c-0fe4-4e8d-a1ae-b5444e6e8bb1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:04.195102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d9e5c-5890-402e-9926-40ac29743751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:04.196368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d9e5c-5890-402e-9926-40ac29743751 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:04.196677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d9e5c-5890-402e-9926-40ac29743751 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:04.196939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d9e5c-5890-402e-9926-40ac29743751 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:04.197715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d9e5c-5890-402e-9926-40ac29743751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:04.202535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d9e5c-5890-402e-9926-40ac29743751 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:04.213131 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 988/1968] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:04 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:04.215875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ea2ee-c891-400c-8479-d80fdb63dd40 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:04.216314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ea2ee-c891-400c-8479-d80fdb63dd40 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:04.216601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ea2ee-c891-400c-8479-d80fdb63dd40 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:04.225531 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 989/1969] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:47:04 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:47:04.226498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ea2ee-c891-400c-8479-d80fdb63dd40 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:04.241754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ea2ee-c891-400c-8479-d80fdb63dd40 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:04.250353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f0e24-1ac9-46a5-ae1b-32481f7489dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:04.251053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bad29eb6-b202-4825-99c5-a6514d2fc32d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9402162a10884271aa192ce5fc2fa63b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:04.251164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f0e24-1ac9-46a5-ae1b-32481f7489dd admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:04.251350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f0e24-1ac9-46a5-ae1b-32481f7489dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:04.251628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f0e24-1ac9-46a5-ae1b-32481f7489dd admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:04.252346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f0e24-1ac9-46a5-ae1b-32481f7489dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:04.254385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f0e24-1ac9-46a5-ae1b-32481f7489dd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:04.258880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bad29eb6-b202-4825-99c5-a6514d2fc32d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9402162a10884271aa192ce5fc2fa63b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:04.272594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bad29eb6-b202-4825-99c5-a6514d2fc32d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9402162a10884271aa192ce5fc2fa63b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:04.274338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bad29eb6-b202-4825-99c5-a6514d2fc32d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9402162a10884271aa192ce5fc2fa63b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:04.283770 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 990/1970] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:04 2021] POST /identity/v3/users => generated 291 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:04.285268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f0e24-1ac9-46a5-ae1b-32481f7489dd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:04.286769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bad29eb6-b202-4825-99c5-a6514d2fc32d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9402162a10884271aa192ce5fc2fa63b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:04.293916 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 981/1971] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:03 2021] DELETE /identity/v3/users/9402162a10884271aa192ce5fc2fa63b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:04.296994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f0e24-1ac9-46a5-ae1b-32481f7489dd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:04.298403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaef9dc-4f24-4a6d-948c-a2bd25a0512f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:04.299350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaef9dc-4f24-4a6d-948c-a2bd25a0512f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:04.299610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaef9dc-4f24-4a6d-948c-a2bd25a0512f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:04.328142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ddaef9dc-4f24-4a6d-948c-a2bd25a0512f None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:04.329592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ddaef9dc-4f24-4a6d-948c-a2bd25a0512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:04.370757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952acb1-4861-47f8-8230-5d5fa6aedb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:04.371844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952acb1-4861-47f8-8230-5d5fa6aedb94 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:04.372150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952acb1-4861-47f8-8230-5d5fa6aedb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:04.372430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952acb1-4861-47f8-8230-5d5fa6aedb94 admin admin] PATH_INFO: `/v3/projects/d0fa3b4c35f14bb7afc98fd734dfe1e5/users/40e23bca9d3547c7aea9b6f149ec3621/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:04.374572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952acb1-4861-47f8-8230-5d5fa6aedb94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0fa3b4c35f14bb7afc98fd734dfe1e5, user_id=40e23bca9d3547c7aea9b6f149ec3621, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:04.388309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952acb1-4861-47f8-8230-5d5fa6aedb94 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:04.405580 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 991/1972] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:04 2021] PUT /identity/v3/projects/d0fa3b4c35f14bb7afc98fd734dfe1e5/users/40e23bca9d3547c7aea9b6f149ec3621/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:04.406549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952acb1-4861-47f8-8230-5d5fa6aedb94 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:04.408215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c952acb1-4861-47f8-8230-5d5fa6aedb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:04.412241 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 982/1973] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:47:04 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:04.413501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9c739-a71b-4129-91cc-9cb044e8b8c4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:04.413809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9c739-a71b-4129-91cc-9cb044e8b8c4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:04.415364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9c739-a71b-4129-91cc-9cb044e8b8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:04.435524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e8f9c739-a71b-4129-91cc-9cb044e8b8c4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:04.437950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e8f9c739-a71b-4129-91cc-9cb044e8b8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:04.505762 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 983/1974] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:04.507410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952acb1-4861-47f8-8230-5d5fa6aedb94 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:04.507824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48a9a5-63e2-430b-83ce-a89a013c2e00 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:04.508345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48a9a5-63e2-430b-83ce-a89a013c2e00 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:04.510524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48a9a5-63e2-430b-83ce-a89a013c2e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:04.512699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594067d2-6520-4419-a650-3e801060331d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:04.513390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594067d2-6520-4419-a650-3e801060331d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:04.513677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594067d2-6520-4419-a650-3e801060331d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:04.513962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594067d2-6520-4419-a650-3e801060331d admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:04.514750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594067d2-6520-4419-a650-3e801060331d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:04.516819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594067d2-6520-4419-a650-3e801060331d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:04.528734 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 992/1975] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:04 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:04.529653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594067d2-6520-4419-a650-3e801060331d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:04.531416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-594067d2-6520-4419-a650-3e801060331d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:04.546061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3f48a9a5-63e2-430b-83ce-a89a013c2e00 None None] MFA Rules not processed for user `40e23bca9d3547c7aea9b6f149ec3621`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:04.547684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3f48a9a5-63e2-430b-83ce-a89a013c2e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:04.598373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594067d2-6520-4419-a650-3e801060331d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:04.603488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2c92d-6523-4939-bcdb-af996549bc31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:04.604221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2c92d-6523-4939-bcdb-af996549bc31 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:04.604598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2c92d-6523-4939-bcdb-af996549bc31 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:04.604948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2c92d-6523-4939-bcdb-af996549bc31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:04.616736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2c92d-6523-4939-bcdb-af996549bc31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:04.619130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2c92d-6523-4939-bcdb-af996549bc31 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:04.643732 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 993/1976] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:04.643732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2c92d-6523-4939-bcdb-af996549bc31 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:04.651455 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 984/1977] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:04 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:04.652105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48a9a5-63e2-430b-83ce-a89a013c2e00 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:04.652233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2c92d-6523-4939-bcdb-af996549bc31 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:04.656339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3f48a9a5-63e2-430b-83ce-a89a013c2e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:04.659500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f3c22-e420-4628-98ba-2814c49ff61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:04.661186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f3c22-e420-4628-98ba-2814c49ff61c admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:04.661692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f3c22-e420-4628-98ba-2814c49ff61c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:04.662063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f3c22-e420-4628-98ba-2814c49ff61c admin admin] PATH_INFO: `/v3/projects/5f8e3b51044244cca78d83ab1ecb036d/users/c1531140d045456cb091602f4660e2e8/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:04.685470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f3c22-e420-4628-98ba-2814c49ff61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8e3b51044244cca78d83ab1ecb036d, user_id=c1531140d045456cb091602f4660e2e8, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:04.689271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f3c22-e420-4628-98ba-2814c49ff61c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:04.711749 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 994/1978] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:04 2021] PUT /identity/v3/projects/5f8e3b51044244cca78d83ab1ecb036d/users/c1531140d045456cb091602f4660e2e8/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:04.718888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f3c22-e420-4628-98ba-2814c49ff61c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:04.777977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48a9a5-63e2-430b-83ce-a89a013c2e00 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:04.804757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f3c22-e420-4628-98ba-2814c49ff61c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:04.825411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871d995-c843-4825-b7db-0315d32a8875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:04.828797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871d995-c843-4825-b7db-0315d32a8875 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:04.829096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871d995-c843-4825-b7db-0315d32a8875 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:04.829384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871d995-c843-4825-b7db-0315d32a8875 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:04.830144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871d995-c843-4825-b7db-0315d32a8875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:04.832593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871d995-c843-4825-b7db-0315d32a8875 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:04.860953 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 995/1979] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:04 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:04.860953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871d995-c843-4825-b7db-0315d32a8875 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:04.863415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9871d995-c843-4825-b7db-0315d32a8875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:04.886012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c37623-2640-4acb-9b2d-8e222f649858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:04.887516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c37623-2640-4acb-9b2d-8e222f649858 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:04.887516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c37623-2640-4acb-9b2d-8e222f649858 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:04.887692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c37623-2640-4acb-9b2d-8e222f649858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:04.897519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c37623-2640-4acb-9b2d-8e222f649858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:04.899231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c37623-2640-4acb-9b2d-8e222f649858 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:04.910405 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 985/1980] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:04 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:04.911145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c37623-2640-4acb-9b2d-8e222f649858 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:04.921144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c37623-2640-4acb-9b2d-8e222f649858 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:04.925923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acbe85-2897-4fe4-9695-3eb378eb38f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:04.926842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acbe85-2897-4fe4-9695-3eb378eb38f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:04.927131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acbe85-2897-4fe4-9695-3eb378eb38f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:04.927409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acbe85-2897-4fe4-9695-3eb378eb38f6 admin admin] PATH_INFO: `/v3/projects/5f8e3b51044244cca78d83ab1ecb036d/users/c1531140d045456cb091602f4660e2e8/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:04.929518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acbe85-2897-4fe4-9695-3eb378eb38f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8e3b51044244cca78d83ab1ecb036d, user_id=c1531140d045456cb091602f4660e2e8, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:04.942342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acbe85-2897-4fe4-9695-3eb378eb38f6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:04.958545 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 986/1981] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:04 2021] PUT /identity/v3/projects/5f8e3b51044244cca78d83ab1ecb036d/users/c1531140d045456cb091602f4660e2e8/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:04.966343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871d995-c843-4825-b7db-0315d32a8875 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:05.062488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acbe85-2897-4fe4-9695-3eb378eb38f6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:05.067035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-96acbe85-2897-4fe4-9695-3eb378eb38f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:05.086112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed569a66-0c74-4879-a2d5-b34c7babdb66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:05.086910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed569a66-0c74-4879-a2d5-b34c7babdb66 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:05.087808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed569a66-0c74-4879-a2d5-b34c7babdb66 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:05.087808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed569a66-0c74-4879-a2d5-b34c7babdb66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:05.214494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acbe85-2897-4fe4-9695-3eb378eb38f6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:05.217794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed569a66-0c74-4879-a2d5-b34c7babdb66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:05.220024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed569a66-0c74-4879-a2d5-b34c7babdb66 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:05.223893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869d95c-0221-4cd6-af33-a9cfef567e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:05.224916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869d95c-0221-4cd6-af33-a9cfef567e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:05.225240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869d95c-0221-4cd6-af33-a9cfef567e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:05.225460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869d95c-0221-4cd6-af33-a9cfef567e74 admin admin] PATH_INFO: `/v3/projects/672bebdd2d0047d19344e3d9cbb83869` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:05.230872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869d95c-0221-4cd6-af33-a9cfef567e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=672bebdd2d0047d19344e3d9cbb83869)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:05.234305 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 996/1982] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:04 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:05.235239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869d95c-0221-4cd6-af33-a9cfef567e74 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:05.249303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed569a66-0c74-4879-a2d5-b34c7babdb66 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:05.255171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ed569a66-0c74-4879-a2d5-b34c7babdb66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:05.298639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed569a66-0c74-4879-a2d5-b34c7babdb66 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:05.323016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a869d95c-0221-4cd6-af33-a9cfef567e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672bebdd2d0047d19344e3d9cbb83869', 'request_id': 'req-a869d95c-0221-4cd6-af33-a9cfef567e74'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:05.335231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a869d95c-0221-4cd6-af33-a9cfef567e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672bebdd2d0047d19344e3d9cbb83869', 'request_id': 'req-a869d95c-0221-4cd6-af33-a9cfef567e74'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:05.352482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a869d95c-0221-4cd6-af33-a9cfef567e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672bebdd2d0047d19344e3d9cbb83869', 'request_id': 'req-a869d95c-0221-4cd6-af33-a9cfef567e74'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:05.372175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a869d95c-0221-4cd6-af33-a9cfef567e74 admin admin] The token cache is being invalidate because project 672bebdd2d0047d19344e3d9cbb83869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:05.372487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a869d95c-0221-4cd6-af33-a9cfef567e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:05.373936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a869d95c-0221-4cd6-af33-a9cfef567e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:05.377408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc76814-0b78-4a1c-98a3-843dd8ef02eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:05.382300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc76814-0b78-4a1c-98a3-843dd8ef02eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:05.382433 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 987/1983] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:05 2021] DELETE /identity/v3/projects/672bebdd2d0047d19344e3d9cbb83869 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:47:05.382529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc76814-0b78-4a1c-98a3-843dd8ef02eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:05.382529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc76814-0b78-4a1c-98a3-843dd8ef02eb admin admin] PATH_INFO: `/v3/users/da2977a4846847cfbe2bc895e8163d03` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:05.382668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869d95c-0221-4cd6-af33-a9cfef567e74 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:05.382747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc76814-0b78-4a1c-98a3-843dd8ef02eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2977a4846847cfbe2bc895e8163d03)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:05.382816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a869d95c-0221-4cd6-af33-a9cfef567e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:05.382944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc76814-0b78-4a1c-98a3-843dd8ef02eb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:05.478415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5cc76814-0b78-4a1c-98a3-843dd8ef02eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2977a4846847cfbe2bc895e8163d03'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:05.500602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5cc76814-0b78-4a1c-98a3-843dd8ef02eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2977a4846847cfbe2bc895e8163d03'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:05.502010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5cc76814-0b78-4a1c-98a3-843dd8ef02eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2977a4846847cfbe2bc895e8163d03'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:05.527524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869d95c-0221-4cd6-af33-a9cfef567e74 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:05.532338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5cc76814-0b78-4a1c-98a3-843dd8ef02eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2977a4846847cfbe2bc895e8163d03'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:05.534203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7aa226-1730-4413-b815-5ee200ad99ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:05.534985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7aa226-1730-4413-b815-5ee200ad99ac service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:05.535345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7aa226-1730-4413-b815-5ee200ad99ac service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:05.535703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7aa226-1730-4413-b815-5ee200ad99ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:05.538364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1f7aa226-1730-4413-b815-5ee200ad99ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:05.543801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5cc76814-0b78-4a1c-98a3-843dd8ef02eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2977a4846847cfbe2bc895e8163d03'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:05.556380 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 997/1984] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:05 2021] DELETE /identity/v3/users/da2977a4846847cfbe2bc895e8163d03 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:05.557838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8910b-e782-41ff-aa1c-fe53e074b0cb None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:05.558131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8910b-e782-41ff-aa1c-fe53e074b0cb None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:05.558930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8910b-e782-41ff-aa1c-fe53e074b0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:05.588716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-dea8910b-e782-41ff-aa1c-fe53e074b0cb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:05.590387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dea8910b-e782-41ff-aa1c-fe53e074b0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:05.658303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7aa226-1730-4413-b815-5ee200ad99ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:05.659998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7aa226-1730-4413-b815-5ee200ad99ac service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:05.680863 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 988/1985] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:05 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:05.685543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e379f1-4d60-4d7e-9227-d1da6e87cf06 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:05.685878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e379f1-4d60-4d7e-9227-d1da6e87cf06 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:05.686813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e379f1-4d60-4d7e-9227-d1da6e87cf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:05.733314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c8e379f1-4d60-4d7e-9227-d1da6e87cf06 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:05.734555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c8e379f1-4d60-4d7e-9227-d1da6e87cf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:05.765017 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 998/1986] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:05.774456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee17c3-329c-4506-be98-25dc73c3d407 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:05.775055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee17c3-329c-4506-be98-25dc73c3d407 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:05.776125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee17c3-329c-4506-be98-25dc73c3d407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:05.811901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2fee17c3-329c-4506-be98-25dc73c3d407 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:05.815605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2fee17c3-329c-4506-be98-25dc73c3d407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:05.837739 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 999/1987] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:47:05.839408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee17c3-329c-4506-be98-25dc73c3d407 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:05.853172 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 989/1988] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:05.857452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee17c3-329c-4506-be98-25dc73c3d407 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:05.866188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e03a97-7258-49fe-936b-2e3299ceeedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:05.866975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e03a97-7258-49fe-936b-2e3299ceeedb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:05.867638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e03a97-7258-49fe-936b-2e3299ceeedb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:05.867988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e03a97-7258-49fe-936b-2e3299ceeedb admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:05.868798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e03a97-7258-49fe-936b-2e3299ceeedb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:47:05.869167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e03a97-7258-49fe-936b-2e3299ceeedb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:05.870877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e03a97-7258-49fe-936b-2e3299ceeedb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:05.884576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e379f1-4d60-4d7e-9227-d1da6e87cf06 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:05.886196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c8e379f1-4d60-4d7e-9227-d1da6e87cf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:05.886365 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1000/1989] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:47:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:47:05.890579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e03a97-7258-49fe-936b-2e3299ceeedb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:05.903422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e03a97-7258-49fe-936b-2e3299ceeedb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:05.909414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b865bb6-fe9b-4c2c-be3b-8a4a89d10047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:05.910560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b865bb6-fe9b-4c2c-be3b-8a4a89d10047 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:05.911530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b865bb6-fe9b-4c2c-be3b-8a4a89d10047 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:05.911915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b865bb6-fe9b-4c2c-be3b-8a4a89d10047 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:05.912730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b865bb6-fe9b-4c2c-be3b-8a4a89d10047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:05.915666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b865bb6-fe9b-4c2c-be3b-8a4a89d10047 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:05.976750 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1001/1990] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:05 2021] POST /identity/v3/projects => generated 395 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:05.978429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b865bb6-fe9b-4c2c-be3b-8a4a89d10047 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:06.000324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e379f1-4d60-4d7e-9227-d1da6e87cf06 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:06.102933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b865bb6-fe9b-4c2c-be3b-8a4a89d10047 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:06.113731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b544fff-ab44-46d6-ac92-6e612f92a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:06.123159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b544fff-ab44-46d6-ac92-6e612f92a7bd admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:06.123159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b544fff-ab44-46d6-ac92-6e612f92a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:06.123159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b544fff-ab44-46d6-ac92-6e612f92a7bd admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:06.123159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b544fff-ab44-46d6-ac92-6e612f92a7bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:06.123159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b544fff-ab44-46d6-ac92-6e612f92a7bd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:06.123451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268982c-c536-49d5-87ee-d6b159adde5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:06.123451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268982c-c536-49d5-87ee-d6b159adde5a service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:06.123451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268982c-c536-49d5-87ee-d6b159adde5a service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:06.124357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268982c-c536-49d5-87ee-d6b159adde5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:06.150492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268982c-c536-49d5-87ee-d6b159adde5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:06.154985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268982c-c536-49d5-87ee-d6b159adde5a service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:06.180865 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1002/1991] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:05 2021] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:06.181752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b544fff-ab44-46d6-ac92-6e612f92a7bd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:06.191175 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 990/1992] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:47:06.193197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b544fff-ab44-46d6-ac92-6e612f92a7bd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:06.206361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd03792-76f8-4500-a714-71190aca01c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:06.209134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd03792-76f8-4500-a714-71190aca01c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:06.209630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd03792-76f8-4500-a714-71190aca01c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:06.210512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd03792-76f8-4500-a714-71190aca01c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:06.222728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd03792-76f8-4500-a714-71190aca01c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:06.222728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd03792-76f8-4500-a714-71190aca01c3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:06.248053 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1003/1993] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:06 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:06.253439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268982c-c536-49d5-87ee-d6b159adde5a service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:06.270192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268982c-c536-49d5-87ee-d6b159adde5a service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:06.293065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54904f17-844b-4e9a-8c1d-0d9d1a713794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:06.294676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54904f17-844b-4e9a-8c1d-0d9d1a713794 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:06.294985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54904f17-844b-4e9a-8c1d-0d9d1a713794 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:06.295545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54904f17-844b-4e9a-8c1d-0d9d1a713794 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:06.297018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54904f17-844b-4e9a-8c1d-0d9d1a713794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:06.298963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54904f17-844b-4e9a-8c1d-0d9d1a713794 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:06.323134 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 991/1994] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:06 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:06.324020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd03792-76f8-4500-a714-71190aca01c3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:06.343609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd03792-76f8-4500-a714-71190aca01c3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:06.359915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54904f17-844b-4e9a-8c1d-0d9d1a713794 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:06.362416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-54904f17-844b-4e9a-8c1d-0d9d1a713794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:06.363117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368ea02-e207-4e6d-a1da-952b195971f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:06.364181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368ea02-e207-4e6d-a1da-952b195971f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:06.364464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368ea02-e207-4e6d-a1da-952b195971f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:06.364752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368ea02-e207-4e6d-a1da-952b195971f2 admin admin] PATH_INFO: `/v3/projects/e622a6218cdd40c8861466b0d36c1ffe/users/6992d255e81c499a8373dd4c727e1f41/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:06.387814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54904f17-844b-4e9a-8c1d-0d9d1a713794 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:06.392633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368ea02-e207-4e6d-a1da-952b195971f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e622a6218cdd40c8861466b0d36c1ffe, user_id=6992d255e81c499a8373dd4c727e1f41, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:06.396941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368ea02-e207-4e6d-a1da-952b195971f2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:06.401071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f3ad8-3507-457c-af25-2a70a058f2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:06.401947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f3ad8-3507-457c-af25-2a70a058f2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:06.402282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f3ad8-3507-457c-af25-2a70a058f2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:06.402580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f3ad8-3507-457c-af25-2a70a058f2ab admin admin] PATH_INFO: `/v3/users/616f7911dc7d46018684f13535a620aa` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:06.404708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f3ad8-3507-457c-af25-2a70a058f2ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=616f7911dc7d46018684f13535a620aa)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:06.406984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f3ad8-3507-457c-af25-2a70a058f2ab admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:06.425075 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1004/1995] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:06 2021] PUT /identity/v3/projects/e622a6218cdd40c8861466b0d36c1ffe/users/6992d255e81c499a8373dd4c727e1f41/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:47:06.427311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d6ef7-4d74-4a03-801a-859bacb00380 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:06.427940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d6ef7-4d74-4a03-801a-859bacb00380 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:06.428664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d6ef7-4d74-4a03-801a-859bacb00380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:06.467455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a29d6ef7-4d74-4a03-801a-859bacb00380 None None] MFA Rules not processed for user `c1531140d045456cb091602f4660e2e8`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:06.468666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a29d6ef7-4d74-4a03-801a-859bacb00380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:06.479496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2f9f3ad8-3507-457c-af25-2a70a058f2ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616f7911dc7d46018684f13535a620aa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:06.510477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2f9f3ad8-3507-457c-af25-2a70a058f2ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616f7911dc7d46018684f13535a620aa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:06.552857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2f9f3ad8-3507-457c-af25-2a70a058f2ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616f7911dc7d46018684f13535a620aa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:06.553864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2f9f3ad8-3507-457c-af25-2a70a058f2ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616f7911dc7d46018684f13535a620aa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:06.567327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2f9f3ad8-3507-457c-af25-2a70a058f2ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616f7911dc7d46018684f13535a620aa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:06.581852 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 992/1996] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:06 2021] DELETE /identity/v3/users/616f7911dc7d46018684f13535a620aa => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:06.584067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5800b-eebd-4c1c-9bbb-42a476c9f9fc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:06.584067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5800b-eebd-4c1c-9bbb-42a476c9f9fc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:06.584307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5800b-eebd-4c1c-9bbb-42a476c9f9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:06.584689 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1005/1997] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:06 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:06.586231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc5458-56a2-45db-8d13-f8b33cb8083d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:06.586809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc5458-56a2-45db-8d13-f8b33cb8083d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:06.586956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc5458-56a2-45db-8d13-f8b33cb8083d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:06.642349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-84cc5458-56a2-45db-8d13-f8b33cb8083d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:06.643957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-84cc5458-56a2-45db-8d13-f8b33cb8083d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:06.645402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5bd5800b-eebd-4c1c-9bbb-42a476c9f9fc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:06.646593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5bd5800b-eebd-4c1c-9bbb-42a476c9f9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:06.749940 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 993/1998] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:06.751387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eae3ca-7886-4a1b-8702-88c0a57d91f0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:06.751675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eae3ca-7886-4a1b-8702-88c0a57d91f0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:06.751947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eae3ca-7886-4a1b-8702-88c0a57d91f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:06.756791 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1006/1999] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:06.758106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc5458-56a2-45db-8d13-f8b33cb8083d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:06.761005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-84cc5458-56a2-45db-8d13-f8b33cb8083d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:06.770819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f5eae3ca-7886-4a1b-8702-88c0a57d91f0 None None] MFA Rules not processed for user `5aaf1ced6baf4e1d9c940cfe96b2c254`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:06.771993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f5eae3ca-7886-4a1b-8702-88c0a57d91f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:06.772847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc5458-56a2-45db-8d13-f8b33cb8083d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:06.777796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:06.778859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:06.779209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:06.779554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6 admin admin] PATH_INFO: `/v3/projects/e7f864f89c274d6484fa3bf4415a6bdc` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:06.780771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7f864f89c274d6484fa3bf4415a6bdc)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:06.782706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:06.826176 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 994/2000] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:06 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:06.827068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eae3ca-7886-4a1b-8702-88c0a57d91f0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:06.829305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7f864f89c274d6484fa3bf4415a6bdc', 'request_id': 'req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:06.831960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f5eae3ca-7886-4a1b-8702-88c0a57d91f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:06.835756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7f864f89c274d6484fa3bf4415a6bdc', 'request_id': 'req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:06.843813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7f864f89c274d6484fa3bf4415a6bdc', 'request_id': 'req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:06.855428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6 admin admin] The token cache is being invalidate because project e7f864f89c274d6484fa3bf4415a6bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:06.855716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:06.856380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:06.858030 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1007/2001] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:06 2021] DELETE /identity/v3/projects/e7f864f89c274d6484fa3bf4415a6bdc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:06.859784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:06.861733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:06.925142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eae3ca-7886-4a1b-8702-88c0a57d91f0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:06.928185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426ec10-1106-47d4-9e0a-7d69e11dd5c6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:06.928825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140f9fb-266b-4d1f-b89c-2becd515171d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:06.929476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140f9fb-266b-4d1f-b89c-2becd515171d service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:06.929810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140f9fb-266b-4d1f-b89c-2becd515171d service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:06.930611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140f9fb-266b-4d1f-b89c-2becd515171d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:06.932379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d140f9fb-266b-4d1f-b89c-2becd515171d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:06.932734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc55c7-a8a9-486a-b092-107ed1843bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:06.933408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc55c7-a8a9-486a-b092-107ed1843bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:06.933716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc55c7-a8a9-486a-b092-107ed1843bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:06.934144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc55c7-a8a9-486a-b092-107ed1843bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:06.935916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e3bc55c7-a8a9-486a-b092-107ed1843bf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:06.992090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140f9fb-266b-4d1f-b89c-2becd515171d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:06.994060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140f9fb-266b-4d1f-b89c-2becd515171d service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:06.996609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc55c7-a8a9-486a-b092-107ed1843bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:06.998031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc55c7-a8a9-486a-b092-107ed1843bf4 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:07.003406 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 995/2002] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:07.004278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140f9fb-266b-4d1f-b89c-2becd515171d service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:07.005630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d140f9fb-266b-4d1f-b89c-2becd515171d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:07.007315 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1008/2003] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:07.008280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc55c7-a8a9-486a-b092-107ed1843bf4 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:07.009565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e3bc55c7-a8a9-486a-b092-107ed1843bf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:07.020897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc55c7-a8a9-486a-b092-107ed1843bf4 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:07.026145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37f569-779b-40d1-8b02-8f13c5b58bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:07.027188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37f569-779b-40d1-8b02-8f13c5b58bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:07.027552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37f569-779b-40d1-8b02-8f13c5b58bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:07.027832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37f569-779b-40d1-8b02-8f13c5b58bf2 admin admin] PATH_INFO: `/v3/users/294f461f45d04d2d80b18791abbc97e4` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:07.029059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37f569-779b-40d1-8b02-8f13c5b58bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=294f461f45d04d2d80b18791abbc97e4)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:07.031167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37f569-779b-40d1-8b02-8f13c5b58bf2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:07.082102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5c37f569-779b-40d1-8b02-8f13c5b58bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '294f461f45d04d2d80b18791abbc97e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:07.084917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140f9fb-266b-4d1f-b89c-2becd515171d service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:07.092247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed03fd-4f90-4df4-8f68-e885dc83c3db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:07.093106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed03fd-4f90-4df4-8f68-e885dc83c3db service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:07.093514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed03fd-4f90-4df4-8f68-e885dc83c3db service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:07.093898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed03fd-4f90-4df4-8f68-e885dc83c3db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:07.096377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e1ed03fd-4f90-4df4-8f68-e885dc83c3db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:07.098126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5c37f569-779b-40d1-8b02-8f13c5b58bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '294f461f45d04d2d80b18791abbc97e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:07.099206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5c37f569-779b-40d1-8b02-8f13c5b58bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '294f461f45d04d2d80b18791abbc97e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:07.122132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5c37f569-779b-40d1-8b02-8f13c5b58bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '294f461f45d04d2d80b18791abbc97e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:07.132952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5c37f569-779b-40d1-8b02-8f13c5b58bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '294f461f45d04d2d80b18791abbc97e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:07.146354 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1009/2004] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:07 2021] DELETE /identity/v3/users/294f461f45d04d2d80b18791abbc97e4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:07.180817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed03fd-4f90-4df4-8f68-e885dc83c3db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:07.182614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed03fd-4f90-4df4-8f68-e885dc83c3db service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:07.194148 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 996/2005] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:07 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:07.754514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37f569-779b-40d1-8b02-8f13c5b58bf2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:07.756157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5c37f569-779b-40d1-8b02-8f13c5b58bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:07.832023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b1144-cf15-4e2e-b586-878b2c035973 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:07.832521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b1144-cf15-4e2e-b586-878b2c035973 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:07.832648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b1144-cf15-4e2e-b586-878b2c035973 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:07.834576 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 997/2006] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:47:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:47:07.841876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689deb87-9ac8-4a85-8e65-32f43f4db127 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:07.842457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689deb87-9ac8-4a85-8e65-32f43f4db127 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:07.842925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689deb87-9ac8-4a85-8e65-32f43f4db127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:07.844307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37f569-779b-40d1-8b02-8f13c5b58bf2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:07.850481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94326d3b-cbf7-4859-a0ae-1c0e7c40ccce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:07.851581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94326d3b-cbf7-4859-a0ae-1c0e7c40ccce admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:07.851876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94326d3b-cbf7-4859-a0ae-1c0e7c40ccce admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:07.853174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94326d3b-cbf7-4859-a0ae-1c0e7c40ccce admin admin] PATH_INFO: `/v3/projects/1331c14b3d704507b576904afb796ded` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:07.855550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94326d3b-cbf7-4859-a0ae-1c0e7c40ccce admin admin] RBAC: Authorizing `identity:delete_project(project_id=1331c14b3d704507b576904afb796ded)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:07.857561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94326d3b-cbf7-4859-a0ae-1c0e7c40ccce admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:07.867922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-689deb87-9ac8-4a85-8e65-32f43f4db127 None None] MFA Rules not processed for user `6f8eeb55c523480fb45d4bbb8afe8e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:07.869167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-689deb87-9ac8-4a85-8e65-32f43f4db127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:07.944266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-94326d3b-cbf7-4859-a0ae-1c0e7c40ccce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1331c14b3d704507b576904afb796ded', 'request_id': 'req-94326d3b-cbf7-4859-a0ae-1c0e7c40ccce'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:07.952393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-94326d3b-cbf7-4859-a0ae-1c0e7c40ccce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1331c14b3d704507b576904afb796ded', 'request_id': 'req-94326d3b-cbf7-4859-a0ae-1c0e7c40ccce'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:07.955386 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 998/2007] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:47:07 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:47:07.956363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689deb87-9ac8-4a85-8e65-32f43f4db127 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:07.958009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-689deb87-9ac8-4a85-8e65-32f43f4db127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:07.964033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-94326d3b-cbf7-4859-a0ae-1c0e7c40ccce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1331c14b3d704507b576904afb796ded', 'request_id': 'req-94326d3b-cbf7-4859-a0ae-1c0e7c40ccce'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:07.974268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689deb87-9ac8-4a85-8e65-32f43f4db127 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:07.986961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-94326d3b-cbf7-4859-a0ae-1c0e7c40ccce admin admin] The token cache is being invalidate because project 1331c14b3d704507b576904afb796ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:07.987391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-94326d3b-cbf7-4859-a0ae-1c0e7c40ccce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:07.987932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-94326d3b-cbf7-4859-a0ae-1c0e7c40ccce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:07.990030 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1010/2008] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:07 2021] DELETE /identity/v3/projects/1331c14b3d704507b576904afb796ded => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:47:07.996130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da557fa-82a1-44fc-8477-9bfc9f8d4d37 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:07.996422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da557fa-82a1-44fc-8477-9bfc9f8d4d37 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:07.996705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da557fa-82a1-44fc-8477-9bfc9f8d4d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:08.037664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3da557fa-82a1-44fc-8477-9bfc9f8d4d37 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:08.038174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5746068-6aee-4a57-9d70-43ed60c83252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:08.039154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5746068-6aee-4a57-9d70-43ed60c83252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:08.039768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3da557fa-82a1-44fc-8477-9bfc9f8d4d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:08.040687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5746068-6aee-4a57-9d70-43ed60c83252 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:08.040899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5746068-6aee-4a57-9d70-43ed60c83252 admin admin] PATH_INFO: `/v3/projects/2d4895af67194a949bf0f863c579506a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:08.042307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5746068-6aee-4a57-9d70-43ed60c83252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d4895af67194a949bf0f863c579506a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:08.044183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5746068-6aee-4a57-9d70-43ed60c83252 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:08.048737 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1011/2009] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:47:08.049745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da557fa-82a1-44fc-8477-9bfc9f8d4d37 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:08.051143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3da557fa-82a1-44fc-8477-9bfc9f8d4d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:08.106796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d5746068-6aee-4a57-9d70-43ed60c83252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d4895af67194a949bf0f863c579506a', 'request_id': 'req-d5746068-6aee-4a57-9d70-43ed60c83252'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:08.114083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d5746068-6aee-4a57-9d70-43ed60c83252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d4895af67194a949bf0f863c579506a', 'request_id': 'req-d5746068-6aee-4a57-9d70-43ed60c83252'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:08.120898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d5746068-6aee-4a57-9d70-43ed60c83252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d4895af67194a949bf0f863c579506a', 'request_id': 'req-d5746068-6aee-4a57-9d70-43ed60c83252'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:08.132345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da557fa-82a1-44fc-8477-9bfc9f8d4d37 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:08.141018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d5746068-6aee-4a57-9d70-43ed60c83252 admin admin] The token cache is being invalidate because project 2d4895af67194a949bf0f863c579506a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:08.141317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d5746068-6aee-4a57-9d70-43ed60c83252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:08.141972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d5746068-6aee-4a57-9d70-43ed60c83252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:08.143972 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 999/2010] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:07 2021] DELETE /identity/v3/projects/2d4895af67194a949bf0f863c579506a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:08.145239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abe54-8e57-4865-b870-80f9d4aa2256 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:08.145528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abe54-8e57-4865-b870-80f9d4aa2256 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:08.145810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abe54-8e57-4865-b870-80f9d4aa2256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:08.185082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ed8abe54-8e57-4865-b870-80f9d4aa2256 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:08.187942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ed8abe54-8e57-4865-b870-80f9d4aa2256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:08.197890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c9c6c-e84f-49db-8b2a-86d2ad6e0501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:08.199023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9c6c-e84f-49db-8b2a-86d2ad6e0501 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:08.199023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9c6c-e84f-49db-8b2a-86d2ad6e0501 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:08.199296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9c6c-e84f-49db-8b2a-86d2ad6e0501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:08.201775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5c0c9c6c-e84f-49db-8b2a-86d2ad6e0501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:08.212402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c9c6c-e84f-49db-8b2a-86d2ad6e0501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:08.213745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c9c6c-e84f-49db-8b2a-86d2ad6e0501 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:08.222228 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1012/2011] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:08 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:08.223054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c9c6c-e84f-49db-8b2a-86d2ad6e0501 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:08.224513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5c0c9c6c-e84f-49db-8b2a-86d2ad6e0501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:08.256481 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1000/2012] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:08.261364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8abe54-8e57-4865-b870-80f9d4aa2256 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:08.271698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8abe54-8e57-4865-b870-80f9d4aa2256 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:08.277517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffa4a3-8cf6-41ce-9250-81da3bd05553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:08.282888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffa4a3-8cf6-41ce-9250-81da3bd05553 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:08.283412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffa4a3-8cf6-41ce-9250-81da3bd05553 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:08.283709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffa4a3-8cf6-41ce-9250-81da3bd05553 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:08.285489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffa4a3-8cf6-41ce-9250-81da3bd05553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:47:08.285838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffa4a3-8cf6-41ce-9250-81da3bd05553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:08.288266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffa4a3-8cf6-41ce-9250-81da3bd05553 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:08.299262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c9c6c-e84f-49db-8b2a-86d2ad6e0501 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:08.304517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed64039-fc65-4331-a9e3-1052fa4d7e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:08.305448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed64039-fc65-4331-a9e3-1052fa4d7e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:08.305734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed64039-fc65-4331-a9e3-1052fa4d7e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:08.306013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed64039-fc65-4331-a9e3-1052fa4d7e53 admin admin] PATH_INFO: `/v3/users/40e23bca9d3547c7aea9b6f149ec3621` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:08.309634 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1001/2013] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:47:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:47:08.309796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed64039-fc65-4331-a9e3-1052fa4d7e53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e23bca9d3547c7aea9b6f149ec3621)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:08.309796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed64039-fc65-4331-a9e3-1052fa4d7e53 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:08.312227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffa4a3-8cf6-41ce-9250-81da3bd05553 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:08.328622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffa4a3-8cf6-41ce-9250-81da3bd05553 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:08.335551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83be24-d473-4778-8d21-2acf52f5e88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:08.337938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83be24-d473-4778-8d21-2acf52f5e88e admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:08.338373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83be24-d473-4778-8d21-2acf52f5e88e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:08.338806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83be24-d473-4778-8d21-2acf52f5e88e admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:08.339770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83be24-d473-4778-8d21-2acf52f5e88e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:08.342739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83be24-d473-4778-8d21-2acf52f5e88e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:08.363349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5ed64039-fc65-4331-a9e3-1052fa4d7e53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e23bca9d3547c7aea9b6f149ec3621'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:08.370713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5ed64039-fc65-4331-a9e3-1052fa4d7e53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e23bca9d3547c7aea9b6f149ec3621'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:08.371597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5ed64039-fc65-4331-a9e3-1052fa4d7e53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e23bca9d3547c7aea9b6f149ec3621'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:08.374301 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1002/2014] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:08 2021] POST /identity/v3/projects => generated 397 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:08.378070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83be24-d473-4778-8d21-2acf52f5e88e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:08.387507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5ed64039-fc65-4331-a9e3-1052fa4d7e53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e23bca9d3547c7aea9b6f149ec3621'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:08.396366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5ed64039-fc65-4331-a9e3-1052fa4d7e53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e23bca9d3547c7aea9b6f149ec3621'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:08.403537 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1013/2015] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:08 2021] DELETE /identity/v3/users/40e23bca9d3547c7aea9b6f149ec3621 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:08.466065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83be24-d473-4778-8d21-2acf52f5e88e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:08.560977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d9866-113f-434d-8c62-8d11c2cb32d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:08.560977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d9866-113f-434d-8c62-8d11c2cb32d9 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:08.560977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d9866-113f-434d-8c62-8d11c2cb32d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:08.561379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d9866-113f-434d-8c62-8d11c2cb32d9 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:08.562439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d9866-113f-434d-8c62-8d11c2cb32d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:08.565301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d9866-113f-434d-8c62-8d11c2cb32d9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:08.601063 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1003/2016] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:08 2021] POST /identity/v3/users => generated 299 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:47:08.604812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed64039-fc65-4331-a9e3-1052fa4d7e53 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:08.606645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5ed64039-fc65-4331-a9e3-1052fa4d7e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:08.629273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed64039-fc65-4331-a9e3-1052fa4d7e53 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:08.638121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af146846-0cf8-4084-814b-1403b5d6ca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:08.639141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af146846-0cf8-4084-814b-1403b5d6ca41 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:08.639606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af146846-0cf8-4084-814b-1403b5d6ca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:08.640515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af146846-0cf8-4084-814b-1403b5d6ca41 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:08.642088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af146846-0cf8-4084-814b-1403b5d6ca41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:08.644937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af146846-0cf8-4084-814b-1403b5d6ca41 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:08.661143 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1014/2017] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:08 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:47:08.665000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d9866-113f-434d-8c62-8d11c2cb32d9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:08.676778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d9866-113f-434d-8c62-8d11c2cb32d9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:08.683687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59583f49-d205-4d6d-8dfd-e9ca8c04c283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:08.684692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59583f49-d205-4d6d-8dfd-e9ca8c04c283 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:08.686281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59583f49-d205-4d6d-8dfd-e9ca8c04c283 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:08.686281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59583f49-d205-4d6d-8dfd-e9ca8c04c283 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:08.686815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59583f49-d205-4d6d-8dfd-e9ca8c04c283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:08.688997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59583f49-d205-4d6d-8dfd-e9ca8c04c283 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:08.715210 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1004/2018] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:08 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:08.715392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af146846-0cf8-4084-814b-1403b5d6ca41 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:08.722694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af146846-0cf8-4084-814b-1403b5d6ca41 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:08.737721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673a863-cb15-4068-8dfe-d34b374f7ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:08.737721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673a863-cb15-4068-8dfe-d34b374f7ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:08.737721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673a863-cb15-4068-8dfe-d34b374f7ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:08.737721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673a863-cb15-4068-8dfe-d34b374f7ea9 admin admin] PATH_INFO: `/v3/projects/a84b125f83d34481adc5617b5ca62e2e/users/8042de28328d4b26b910f1be4b499879/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:08.761601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673a863-cb15-4068-8dfe-d34b374f7ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a84b125f83d34481adc5617b5ca62e2e, user_id=8042de28328d4b26b910f1be4b499879, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:08.764871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673a863-cb15-4068-8dfe-d34b374f7ea9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:08.800459 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1015/2019] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:08 2021] PUT /identity/v3/projects/a84b125f83d34481adc5617b5ca62e2e/users/8042de28328d4b26b910f1be4b499879/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:08.806304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367adfb5-7d9a-4133-8c0c-30cce113deed None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:08.806640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367adfb5-7d9a-4133-8c0c-30cce113deed None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:08.806995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367adfb5-7d9a-4133-8c0c-30cce113deed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:08.820339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673a863-cb15-4068-8dfe-d34b374f7ea9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:08.820339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a673a863-cb15-4068-8dfe-d34b374f7ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:08.838599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-367adfb5-7d9a-4133-8c0c-30cce113deed None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:08.841598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-367adfb5-7d9a-4133-8c0c-30cce113deed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:08.912265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673a863-cb15-4068-8dfe-d34b374f7ea9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:08.918823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa797dbd-d56f-41eb-8866-1d82e51fab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:08.919780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa797dbd-d56f-41eb-8866-1d82e51fab9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:08.920133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa797dbd-d56f-41eb-8866-1d82e51fab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:08.920491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa797dbd-d56f-41eb-8866-1d82e51fab9a admin admin] PATH_INFO: `/v3/projects/d0fa3b4c35f14bb7afc98fd734dfe1e5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:08.922596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa797dbd-d56f-41eb-8866-1d82e51fab9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0fa3b4c35f14bb7afc98fd734dfe1e5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:08.924595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa797dbd-d56f-41eb-8866-1d82e51fab9a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:08.935435 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1005/2020] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:08.943438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367adfb5-7d9a-4133-8c0c-30cce113deed None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:08.947655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-367adfb5-7d9a-4133-8c0c-30cce113deed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:08.988989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-aa797dbd-d56f-41eb-8866-1d82e51fab9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0fa3b4c35f14bb7afc98fd734dfe1e5', 'request_id': 'req-aa797dbd-d56f-41eb-8866-1d82e51fab9a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:08.997487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-aa797dbd-d56f-41eb-8866-1d82e51fab9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0fa3b4c35f14bb7afc98fd734dfe1e5', 'request_id': 'req-aa797dbd-d56f-41eb-8866-1d82e51fab9a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:09.008078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-aa797dbd-d56f-41eb-8866-1d82e51fab9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0fa3b4c35f14bb7afc98fd734dfe1e5', 'request_id': 'req-aa797dbd-d56f-41eb-8866-1d82e51fab9a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:09.021297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-aa797dbd-d56f-41eb-8866-1d82e51fab9a admin admin] The token cache is being invalidate because project d0fa3b4c35f14bb7afc98fd734dfe1e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:09.021592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-aa797dbd-d56f-41eb-8866-1d82e51fab9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:09.022287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-aa797dbd-d56f-41eb-8866-1d82e51fab9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:09.028273 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1016/2021] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:08 2021] DELETE /identity/v3/projects/d0fa3b4c35f14bb7afc98fd734dfe1e5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:09.030280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42292a-28aa-4927-a047-4eaaeffb9737 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:09.030567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42292a-28aa-4927-a047-4eaaeffb9737 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:09.030850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42292a-28aa-4927-a047-4eaaeffb9737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:09.052877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367adfb5-7d9a-4133-8c0c-30cce113deed None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:09.076266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ad42292a-28aa-4927-a047-4eaaeffb9737 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:09.078285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ad42292a-28aa-4927-a047-4eaaeffb9737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:09.146090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb9434-c2d1-466b-a7d2-debcf309ac27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:09.147292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb9434-c2d1-466b-a7d2-debcf309ac27 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:09.147812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb9434-c2d1-466b-a7d2-debcf309ac27 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:09.148596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb9434-c2d1-466b-a7d2-debcf309ac27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:09.156420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-83cb9434-c2d1-466b-a7d2-debcf309ac27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:09.217174 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1017/2022] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:09.227925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6038439-fec2-42ec-8662-b5ea0c67d8a8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:09.228437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6038439-fec2-42ec-8662-b5ea0c67d8a8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:09.228891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6038439-fec2-42ec-8662-b5ea0c67d8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:09.272630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a6038439-fec2-42ec-8662-b5ea0c67d8a8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:09.274024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a6038439-fec2-42ec-8662-b5ea0c67d8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:09.291577 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1018/2023] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:47:09.299800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb9434-c2d1-466b-a7d2-debcf309ac27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:09.301327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb9434-c2d1-466b-a7d2-debcf309ac27 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:09.308018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6038439-fec2-42ec-8662-b5ea0c67d8a8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:09.318999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6038439-fec2-42ec-8662-b5ea0c67d8a8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:09.325481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3514f38-907f-42ce-96f6-087ab7e46dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:09.326560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3514f38-907f-42ce-96f6-087ab7e46dfc admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:09.327197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3514f38-907f-42ce-96f6-087ab7e46dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:09.327629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3514f38-907f-42ce-96f6-087ab7e46dfc admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:09.328476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3514f38-907f-42ce-96f6-087ab7e46dfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:47:09.328926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3514f38-907f-42ce-96f6-087ab7e46dfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:09.331288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3514f38-907f-42ce-96f6-087ab7e46dfc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:09.351496 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1019/2024] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:47:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:47:09.355537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3514f38-907f-42ce-96f6-087ab7e46dfc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:09.355927 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1006/2025] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:47:09.375954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3514f38-907f-42ce-96f6-087ab7e46dfc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:09.389967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e8d0c-5a5f-44f2-9a1f-d0772e79aa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:09.390838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e8d0c-5a5f-44f2-9a1f-d0772e79aa5f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:09.391228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e8d0c-5a5f-44f2-9a1f-d0772e79aa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:09.391608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e8d0c-5a5f-44f2-9a1f-d0772e79aa5f admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:09.392419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e8d0c-5a5f-44f2-9a1f-d0772e79aa5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:09.395843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e8d0c-5a5f-44f2-9a1f-d0772e79aa5f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:09.468462 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1020/2026] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:09 2021] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:09.472646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb9434-c2d1-466b-a7d2-debcf309ac27 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:09.483643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb9434-c2d1-466b-a7d2-debcf309ac27 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:09.545218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e8d0c-5a5f-44f2-9a1f-d0772e79aa5f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:09.548412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4b0e8d0c-5a5f-44f2-9a1f-d0772e79aa5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:09.636677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507ebe6-b153-4419-b9fb-6c5e9c069778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:09.637541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507ebe6-b153-4419-b9fb-6c5e9c069778 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:09.638284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507ebe6-b153-4419-b9fb-6c5e9c069778 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:09.638594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507ebe6-b153-4419-b9fb-6c5e9c069778 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:09.639367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507ebe6-b153-4419-b9fb-6c5e9c069778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:09.650199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507ebe6-b153-4419-b9fb-6c5e9c069778 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:09.746039 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1007/2027] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:09 2021] POST /identity/v3/users => generated 291 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:09.750879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507ebe6-b153-4419-b9fb-6c5e9c069778 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:09.778303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507ebe6-b153-4419-b9fb-6c5e9c069778 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:09.796840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb926152-5280-4a6b-8976-8be431bc63b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:09.801118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb926152-5280-4a6b-8976-8be431bc63b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:09.801698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb926152-5280-4a6b-8976-8be431bc63b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:09.802219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb926152-5280-4a6b-8976-8be431bc63b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:09.806353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb926152-5280-4a6b-8976-8be431bc63b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:09.808554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb926152-5280-4a6b-8976-8be431bc63b3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:09.836163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e8d0c-5a5f-44f2-9a1f-d0772e79aa5f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:09.843233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed73b54-7971-4838-871e-3c52feae8303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:09.844015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73b54-7971-4838-871e-3c52feae8303 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:09.845115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73b54-7971-4838-871e-3c52feae8303 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:09.845478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73b54-7971-4838-871e-3c52feae8303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:09.848828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0ed73b54-7971-4838-871e-3c52feae8303 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:09.857156 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1008/2028] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:09 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:09.863296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb926152-5280-4a6b-8976-8be431bc63b3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:09.882763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb926152-5280-4a6b-8976-8be431bc63b3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:09.890550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec234a0f-a83e-4d05-98c8-321afef84069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:09.891664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec234a0f-a83e-4d05-98c8-321afef84069 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:09.892164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec234a0f-a83e-4d05-98c8-321afef84069 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:09.892636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec234a0f-a83e-4d05-98c8-321afef84069 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:09.893568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec234a0f-a83e-4d05-98c8-321afef84069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:09.896365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec234a0f-a83e-4d05-98c8-321afef84069 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:09.928919 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1009/2029] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:09 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:09.934468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec234a0f-a83e-4d05-98c8-321afef84069 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:09.955192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec234a0f-a83e-4d05-98c8-321afef84069 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:09.960581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed73b54-7971-4838-871e-3c52feae8303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:09.963926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed73b54-7971-4838-871e-3c52feae8303 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:09.971221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc4619-edaf-4d02-b835-9c0138e0b7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:09.973439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc4619-edaf-4d02-b835-9c0138e0b7eb admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:09.974245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc4619-edaf-4d02-b835-9c0138e0b7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:09.974908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc4619-edaf-4d02-b835-9c0138e0b7eb admin admin] PATH_INFO: `/v3/projects/42de22b28229440f89f37385a65aefcc/users/90a9201cd4c5404b94e974a402a2371e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:09.996973 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1021/2030] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:09 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:47:10.020344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc4619-edaf-4d02-b835-9c0138e0b7eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=42de22b28229440f89f37385a65aefcc, user_id=90a9201cd4c5404b94e974a402a2371e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:10.024117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc4619-edaf-4d02-b835-9c0138e0b7eb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:10.067301 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1010/2031] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:09 2021] PUT /identity/v3/projects/42de22b28229440f89f37385a65aefcc/users/90a9201cd4c5404b94e974a402a2371e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:47:10.068877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0a647-a39a-4296-8bd2-89d8617bacb3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:10.069322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0a647-a39a-4296-8bd2-89d8617bacb3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:10.069814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0a647-a39a-4296-8bd2-89d8617bacb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:10.130541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0db0a647-a39a-4296-8bd2-89d8617bacb3 None None] MFA Rules not processed for user `90a9201cd4c5404b94e974a402a2371e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:10.132075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0db0a647-a39a-4296-8bd2-89d8617bacb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:10.229916 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1022/2032] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:10 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:10.231818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc4619-edaf-4d02-b835-9c0138e0b7eb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:10.384750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc4619-edaf-4d02-b835-9c0138e0b7eb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:10.421901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca96a6c-63c9-4a30-a9e6-7e4e90eeffe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:10.422952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca96a6c-63c9-4a30-a9e6-7e4e90eeffe7 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:10.423688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca96a6c-63c9-4a30-a9e6-7e4e90eeffe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:10.424136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca96a6c-63c9-4a30-a9e6-7e4e90eeffe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:10.425135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca96a6c-63c9-4a30-a9e6-7e4e90eeffe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:10.431665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca96a6c-63c9-4a30-a9e6-7e4e90eeffe7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:10.533769 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1011/2033] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:10 2021] POST /identity/v3/projects => generated 381 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:10.537536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0a647-a39a-4296-8bd2-89d8617bacb3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:10.571286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0a647-a39a-4296-8bd2-89d8617bacb3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:10.693387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee97e6-865a-4c26-bf6a-0091d1f5e020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:10.694362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee97e6-865a-4c26-bf6a-0091d1f5e020 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:10.694918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee97e6-865a-4c26-bf6a-0091d1f5e020 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:10.696086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee97e6-865a-4c26-bf6a-0091d1f5e020 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:10.697399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee97e6-865a-4c26-bf6a-0091d1f5e020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:10.699993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee97e6-865a-4c26-bf6a-0091d1f5e020 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:10.712035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f587b-7040-4d9e-b7f8-27d44fb5f111 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:10.712329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f587b-7040-4d9e-b7f8-27d44fb5f111 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:10.712670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f587b-7040-4d9e-b7f8-27d44fb5f111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:10.746667 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1023/2034] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:10 2021] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:10.750410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee97e6-865a-4c26-bf6a-0091d1f5e020 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:10.763363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee97e6-865a-4c26-bf6a-0091d1f5e020 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:10.768828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7457ce4-6ae3-44e0-b989-7aa0859ac5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:10.769792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7457ce4-6ae3-44e0-b989-7aa0859ac5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:10.770172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7457ce4-6ae3-44e0-b989-7aa0859ac5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:10.770606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7457ce4-6ae3-44e0-b989-7aa0859ac5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:10.771641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7457ce4-6ae3-44e0-b989-7aa0859ac5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:10.772504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-058f587b-7040-4d9e-b7f8-27d44fb5f111 None None] MFA Rules not processed for user `8042de28328d4b26b910f1be4b499879`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:10.774162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7457ce4-6ae3-44e0-b989-7aa0859ac5f7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:10.774436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-058f587b-7040-4d9e-b7f8-27d44fb5f111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:10.801829 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1024/2035] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:10 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:47:10.806666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7457ce4-6ae3-44e0-b989-7aa0859ac5f7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:10.839140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7457ce4-6ae3-44e0-b989-7aa0859ac5f7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:10.857234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41967c2-effc-4a2d-87f8-3eb10a1f7e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:10.858509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41967c2-effc-4a2d-87f8-3eb10a1f7e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:10.858987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41967c2-effc-4a2d-87f8-3eb10a1f7e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:10.861229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41967c2-effc-4a2d-87f8-3eb10a1f7e8d admin admin] PATH_INFO: `/v3/projects/4d62bea6c6b0430aa2cec3b05337e2b0/users/c13e8461ae774242a4636de49e9cea4e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:10.905754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41967c2-effc-4a2d-87f8-3eb10a1f7e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d62bea6c6b0430aa2cec3b05337e2b0, user_id=c13e8461ae774242a4636de49e9cea4e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:10.911959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41967c2-effc-4a2d-87f8-3eb10a1f7e8d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:10.938134 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1025/2036] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:10 2021] PUT /identity/v3/projects/4d62bea6c6b0430aa2cec3b05337e2b0/users/c13e8461ae774242a4636de49e9cea4e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:10.942790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41967c2-effc-4a2d-87f8-3eb10a1f7e8d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:10.953262 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1012/2037] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:10 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:10.957362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f587b-7040-4d9e-b7f8-27d44fb5f111 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:10.961198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-058f587b-7040-4d9e-b7f8-27d44fb5f111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:11.009345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f587b-7040-4d9e-b7f8-27d44fb5f111 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:11.087804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41967c2-effc-4a2d-87f8-3eb10a1f7e8d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:11.103878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576da43b-c41e-4011-afd3-2e8d3653478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:11.104661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576da43b-c41e-4011-afd3-2e8d3653478e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:11.105045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576da43b-c41e-4011-afd3-2e8d3653478e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:11.105419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576da43b-c41e-4011-afd3-2e8d3653478e admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:11.106302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576da43b-c41e-4011-afd3-2e8d3653478e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:11.108078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576da43b-c41e-4011-afd3-2e8d3653478e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:11.128420 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1026/2038] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:10 2021] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:47:11.138940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576da43b-c41e-4011-afd3-2e8d3653478e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:11.139999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b45ca-eaed-42c5-b571-7c07519dab12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:11.140814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b45ca-eaed-42c5-b571-7c07519dab12 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:11.141101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b45ca-eaed-42c5-b571-7c07519dab12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:11.141373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b45ca-eaed-42c5-b571-7c07519dab12 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:11.142086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b45ca-eaed-42c5-b571-7c07519dab12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:11.148917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b45ca-eaed-42c5-b571-7c07519dab12 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:11.163927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576da43b-c41e-4011-afd3-2e8d3653478e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:11.177044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cf8d7-7d0b-49d0-b41b-6d15fc47ab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:11.182722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cf8d7-7d0b-49d0-b41b-6d15fc47ab14 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:11.183093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cf8d7-7d0b-49d0-b41b-6d15fc47ab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:11.183469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cf8d7-7d0b-49d0-b41b-6d15fc47ab14 admin admin] PATH_INFO: `/v3/projects/4d62bea6c6b0430aa2cec3b05337e2b0/users/c13e8461ae774242a4636de49e9cea4e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:11.187549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1cf8d7-7d0b-49d0-b41b-6d15fc47ab14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d62bea6c6b0430aa2cec3b05337e2b0, user_id=c13e8461ae774242a4636de49e9cea4e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:11.196680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1cf8d7-7d0b-49d0-b41b-6d15fc47ab14 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:11.213223 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1027/2039] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:11 2021] PUT /identity/v3/projects/4d62bea6c6b0430aa2cec3b05337e2b0/users/c13e8461ae774242a4636de49e9cea4e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:11.225049 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1013/2040] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:10 2021] POST /identity/v3/projects => generated 397 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:11.225317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8144bb1-0989-45f9-8522-3f0d81d2753e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:11.225648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8144bb1-0989-45f9-8522-3f0d81d2753e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:11.227012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8144bb1-0989-45f9-8522-3f0d81d2753e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:11.229601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b45ca-eaed-42c5-b571-7c07519dab12 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:11.264681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a8144bb1-0989-45f9-8522-3f0d81d2753e None None] MFA Rules not processed for user `c13e8461ae774242a4636de49e9cea4e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:11.266796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a8144bb1-0989-45f9-8522-3f0d81d2753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:11.318227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b45ca-eaed-42c5-b571-7c07519dab12 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:11.324826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c1c0b-c7da-40a0-be7e-ab4b71973902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:11.325911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c1c0b-c7da-40a0-be7e-ab4b71973902 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:11.326206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c1c0b-c7da-40a0-be7e-ab4b71973902 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:11.326519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c1c0b-c7da-40a0-be7e-ab4b71973902 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:11.327550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c1c0b-c7da-40a0-be7e-ab4b71973902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:11.329787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c1c0b-c7da-40a0-be7e-ab4b71973902 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:11.356606 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1014/2042] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:11 2021] POST /identity/v3/users => generated 305 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:47:11.356883 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1028/2042] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:11 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:47:11.359820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c1c0b-c7da-40a0-be7e-ab4b71973902 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:11.377972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c1c0b-c7da-40a0-be7e-ab4b71973902 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:11.382855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce3eaf-52da-476b-97b7-ea66b3a45774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:11.383705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce3eaf-52da-476b-97b7-ea66b3a45774 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:11.383985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce3eaf-52da-476b-97b7-ea66b3a45774 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:11.384264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce3eaf-52da-476b-97b7-ea66b3a45774 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:11.385014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce3eaf-52da-476b-97b7-ea66b3a45774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:11.387088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce3eaf-52da-476b-97b7-ea66b3a45774 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:11.401705 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1015/2043] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:11 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:47:11.403140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8144bb1-0989-45f9-8522-3f0d81d2753e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:11.414603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce3eaf-52da-476b-97b7-ea66b3a45774 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:11.431688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8144bb1-0989-45f9-8522-3f0d81d2753e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:11.444214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba2745-4b19-4275-8a0c-c57e3a46e32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:11.446652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba2745-4b19-4275-8a0c-c57e3a46e32b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:11.447133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba2745-4b19-4275-8a0c-c57e3a46e32b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:11.448418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba2745-4b19-4275-8a0c-c57e3a46e32b admin admin] PATH_INFO: `/v3/projects/96bbc9ed26984947a2211c73165f2ca5/users/4fa66b6ec8904baab2ec5e337d241dc0/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:11.481576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba2745-4b19-4275-8a0c-c57e3a46e32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=96bbc9ed26984947a2211c73165f2ca5, user_id=4fa66b6ec8904baab2ec5e337d241dc0, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:11.485041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba2745-4b19-4275-8a0c-c57e3a46e32b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:11.522497 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1029/2044] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:11 2021] PUT /identity/v3/projects/96bbc9ed26984947a2211c73165f2ca5/users/4fa66b6ec8904baab2ec5e337d241dc0/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:11.523669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba2745-4b19-4275-8a0c-c57e3a46e32b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:11.555278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce3eaf-52da-476b-97b7-ea66b3a45774 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:11.651698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba2745-4b19-4275-8a0c-c57e3a46e32b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:11.662126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9552e-75d0-4ec1-b4b2-ae4ef47a704d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:11.662841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9552e-75d0-4ec1-b4b2-ae4ef47a704d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:11.663127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9552e-75d0-4ec1-b4b2-ae4ef47a704d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:11.663405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9552e-75d0-4ec1-b4b2-ae4ef47a704d admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:11.664708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9552e-75d0-4ec1-b4b2-ae4ef47a704d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:11.666554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9552e-75d0-4ec1-b4b2-ae4ef47a704d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:11.681105 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1030/2045] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:11 2021] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:11.682045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9552e-75d0-4ec1-b4b2-ae4ef47a704d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:11.695248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e55de-b867-4da4-ae64-0cf6863143ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:11.695923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e55de-b867-4da4-ae64-0cf6863143ed service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:11.696207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e55de-b867-4da4-ae64-0cf6863143ed service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:11.696445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9552e-75d0-4ec1-b4b2-ae4ef47a704d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:11.696983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e55de-b867-4da4-ae64-0cf6863143ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:11.703020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa314d82-256b-4e7e-ab33-10be69b8fddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:11.703607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa314d82-256b-4e7e-ab33-10be69b8fddc admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:11.703896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa314d82-256b-4e7e-ab33-10be69b8fddc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:11.704174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa314d82-256b-4e7e-ab33-10be69b8fddc admin admin] PATH_INFO: `/v3/projects/96bbc9ed26984947a2211c73165f2ca5/users/4fa66b6ec8904baab2ec5e337d241dc0/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:11.706561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa314d82-256b-4e7e-ab33-10be69b8fddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=96bbc9ed26984947a2211c73165f2ca5, user_id=4fa66b6ec8904baab2ec5e337d241dc0, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:11.709368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa314d82-256b-4e7e-ab33-10be69b8fddc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:11.722907 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1031/2046] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:11 2021] PUT /identity/v3/projects/96bbc9ed26984947a2211c73165f2ca5/users/4fa66b6ec8904baab2ec5e337d241dc0/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:11.805169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e55de-b867-4da4-ae64-0cf6863143ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:11.808711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e55de-b867-4da4-ae64-0cf6863143ed service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:11.821398 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1016/2047] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:11 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:12.081288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa314d82-256b-4e7e-ab33-10be69b8fddc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:12.155128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa314d82-256b-4e7e-ab33-10be69b8fddc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:12.175034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d48d5-a039-4b53-8274-1842d0956df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:12.176582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d48d5-a039-4b53-8274-1842d0956df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:12.177011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d48d5-a039-4b53-8274-1842d0956df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:12.177430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d48d5-a039-4b53-8274-1842d0956df4 admin admin] PATH_INFO: `/v3/users/90a9201cd4c5404b94e974a402a2371e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:12.178989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d48d5-a039-4b53-8274-1842d0956df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a9201cd4c5404b94e974a402a2371e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:12.181689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d48d5-a039-4b53-8274-1842d0956df4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:12.266688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-258d48d5-a039-4b53-8274-1842d0956df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a9201cd4c5404b94e974a402a2371e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:12.278399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-258d48d5-a039-4b53-8274-1842d0956df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a9201cd4c5404b94e974a402a2371e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:12.279494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-258d48d5-a039-4b53-8274-1842d0956df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a9201cd4c5404b94e974a402a2371e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:12.305805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-258d48d5-a039-4b53-8274-1842d0956df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a9201cd4c5404b94e974a402a2371e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:12.321427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-258d48d5-a039-4b53-8274-1842d0956df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a9201cd4c5404b94e974a402a2371e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:12.328459 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1032/2048] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:12 2021] DELETE /identity/v3/users/90a9201cd4c5404b94e974a402a2371e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:12.332820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fb150-79fa-4c74-84f9-5470417d77a3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:12.333273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fb150-79fa-4c74-84f9-5470417d77a3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:12.333391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fb150-79fa-4c74-84f9-5470417d77a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:12.355041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-541fb150-79fa-4c74-84f9-5470417d77a3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:12.357065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-541fb150-79fa-4c74-84f9-5470417d77a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:12.431221 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1017/2049] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:12.443670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d48d5-a039-4b53-8274-1842d0956df4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:12.446242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-258d48d5-a039-4b53-8274-1842d0956df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:12.525986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7763b12-d875-4220-aafc-3286fbeccf3a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:12.526352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7763b12-d875-4220-aafc-3286fbeccf3a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:12.526699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7763b12-d875-4220-aafc-3286fbeccf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:12.527436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d48d5-a039-4b53-8274-1842d0956df4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:12.532718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25edc00-2c52-48d5-9e9c-ff610eb980fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:12.533393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25edc00-2c52-48d5-9e9c-ff610eb980fa service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:12.533699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25edc00-2c52-48d5-9e9c-ff610eb980fa service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:12.534026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25edc00-2c52-48d5-9e9c-ff610eb980fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:12.550296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25edc00-2c52-48d5-9e9c-ff610eb980fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:12.552182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25edc00-2c52-48d5-9e9c-ff610eb980fa service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:12.578294 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1033/2050] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:12.591904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f7763b12-d875-4220-aafc-3286fbeccf3a None None] MFA Rules not processed for user `4fa66b6ec8904baab2ec5e337d241dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:12.593717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f7763b12-d875-4220-aafc-3286fbeccf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:12.756334 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1018/2051] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:12 2021] POST /identity/v3/auth/tokens => generated 3331 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:12.767509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e6f8a-7e01-412c-ba8e-197fd3af9edc None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:12.768120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e6f8a-7e01-412c-ba8e-197fd3af9edc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:12.768605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e6f8a-7e01-412c-ba8e-197fd3af9edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:12.804473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d91e6f8a-7e01-412c-ba8e-197fd3af9edc None None] MFA Rules not processed for user `8042de28328d4b26b910f1be4b499879`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:12.805693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d91e6f8a-7e01-412c-ba8e-197fd3af9edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:12.888185 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1034/2052] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:12 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:12.951653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7763b12-d875-4220-aafc-3286fbeccf3a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:12.953088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f7763b12-d875-4220-aafc-3286fbeccf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:12.976066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7763b12-d875-4220-aafc-3286fbeccf3a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:12.981676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:12.983200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:12.983200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:12.983200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b admin admin] PATH_INFO: `/v3/projects/42de22b28229440f89f37385a65aefcc` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:12.984821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b admin admin] RBAC: Authorizing `identity:delete_project(project_id=42de22b28229440f89f37385a65aefcc)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:12.986864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:13.035694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42de22b28229440f89f37385a65aefcc', 'request_id': 'req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:13.042230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42de22b28229440f89f37385a65aefcc', 'request_id': 'req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:13.047655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42de22b28229440f89f37385a65aefcc', 'request_id': 'req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:13.061750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b admin admin] The token cache is being invalidate because project 42de22b28229440f89f37385a65aefcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:13.062160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:13.063137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:13.067564 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1019/2053] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:12 2021] DELETE /identity/v3/projects/42de22b28229440f89f37385a65aefcc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:13.068757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e6f8a-7e01-412c-ba8e-197fd3af9edc None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:13.079861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e6f8a-7e01-412c-ba8e-197fd3af9edc None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:13.146283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1c400-9341-4f1d-ab90-aedc292cff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:13.147777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1c400-9341-4f1d-ab90-aedc292cff1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:13.148023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1c400-9341-4f1d-ab90-aedc292cff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:13.148295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1c400-9341-4f1d-ab90-aedc292cff1e admin admin] PATH_INFO: `/v3/users/c13e8461ae774242a4636de49e9cea4e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:13.149535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1c400-9341-4f1d-ab90-aedc292cff1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c13e8461ae774242a4636de49e9cea4e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:13.151592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1c400-9341-4f1d-ab90-aedc292cff1e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:13.201951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0e1c400-9341-4f1d-ab90-aedc292cff1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c13e8461ae774242a4636de49e9cea4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:13.209071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0e1c400-9341-4f1d-ab90-aedc292cff1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c13e8461ae774242a4636de49e9cea4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:13.209866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0e1c400-9341-4f1d-ab90-aedc292cff1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c13e8461ae774242a4636de49e9cea4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:13.222751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0e1c400-9341-4f1d-ab90-aedc292cff1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c13e8461ae774242a4636de49e9cea4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:13.230237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0e1c400-9341-4f1d-ab90-aedc292cff1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c13e8461ae774242a4636de49e9cea4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:13.238147 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1035/2054] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:13 2021] DELETE /identity/v3/users/c13e8461ae774242a4636de49e9cea4e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:47:13.513161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:13.514673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:13.529029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aff7f4-2ee1-4a4f-9ec0-c68c8961571b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:13.567297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1c400-9341-4f1d-ab90-aedc292cff1e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:13.568692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d0e1c400-9341-4f1d-ab90-aedc292cff1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:13.617901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28483e3e-6bc5-49c6-9072-e822dd5d4a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:13.619106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28483e3e-6bc5-49c6-9072-e822dd5d4a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:13.619396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28483e3e-6bc5-49c6-9072-e822dd5d4a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:13.619672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28483e3e-6bc5-49c6-9072-e822dd5d4a5c admin admin] PATH_INFO: `/v3/projects/4d62bea6c6b0430aa2cec3b05337e2b0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:13.621209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28483e3e-6bc5-49c6-9072-e822dd5d4a5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d62bea6c6b0430aa2cec3b05337e2b0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:13.623304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28483e3e-6bc5-49c6-9072-e822dd5d4a5c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:13.663295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1c400-9341-4f1d-ab90-aedc292cff1e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:13.721869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-28483e3e-6bc5-49c6-9072-e822dd5d4a5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d62bea6c6b0430aa2cec3b05337e2b0', 'request_id': 'req-28483e3e-6bc5-49c6-9072-e822dd5d4a5c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:13.744018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-28483e3e-6bc5-49c6-9072-e822dd5d4a5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d62bea6c6b0430aa2cec3b05337e2b0', 'request_id': 'req-28483e3e-6bc5-49c6-9072-e822dd5d4a5c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:13.751284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-28483e3e-6bc5-49c6-9072-e822dd5d4a5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d62bea6c6b0430aa2cec3b05337e2b0', 'request_id': 'req-28483e3e-6bc5-49c6-9072-e822dd5d4a5c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:13.761581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5e957-c78a-45d2-a37d-1b2b39ce0b22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:13.762914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5e957-c78a-45d2-a37d-1b2b39ce0b22 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:13.763196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5e957-c78a-45d2-a37d-1b2b39ce0b22 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:13.763503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5e957-c78a-45d2-a37d-1b2b39ce0b22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:13.765270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-28483e3e-6bc5-49c6-9072-e822dd5d4a5c admin admin] The token cache is being invalidate because project 4d62bea6c6b0430aa2cec3b05337e2b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:13.765385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-38c5e957-c78a-45d2-a37d-1b2b39ce0b22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:13.765552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-28483e3e-6bc5-49c6-9072-e822dd5d4a5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:13.766178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-28483e3e-6bc5-49c6-9072-e822dd5d4a5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:13.768050 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1020/2055] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:13 2021] DELETE /identity/v3/projects/4d62bea6c6b0430aa2cec3b05337e2b0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:13.774110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fe2fa-10f4-4274-8628-f300a9468de5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:13.774492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fe2fa-10f4-4274-8628-f300a9468de5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:13.774858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fe2fa-10f4-4274-8628-f300a9468de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:13.795871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-bc0fe2fa-10f4-4274-8628-f300a9468de5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:13.797223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bc0fe2fa-10f4-4274-8628-f300a9468de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:13.833583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5e957-c78a-45d2-a37d-1b2b39ce0b22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:13.837380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5e957-c78a-45d2-a37d-1b2b39ce0b22 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:13.850744 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1036/2056] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:13 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:13.877515 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1021/2057] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:47:13.885943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54fda5-6882-4469-8fef-83c91d12a5af None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:13.886223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54fda5-6882-4469-8fef-83c91d12a5af None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:13.886548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54fda5-6882-4469-8fef-83c91d12a5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:13.912653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bd54fda5-6882-4469-8fef-83c91d12a5af None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:13.914224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bd54fda5-6882-4469-8fef-83c91d12a5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:13.928994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fe2fa-10f4-4274-8628-f300a9468de5 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:13.941221 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1037/2058] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:13.962906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fe2fa-10f4-4274-8628-f300a9468de5 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:13.991238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a667b4-095f-44ac-a478-d2d12d668a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:13.992892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a667b4-095f-44ac-a478-d2d12d668a85 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:13.993370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a667b4-095f-44ac-a478-d2d12d668a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:13.993753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a667b4-095f-44ac-a478-d2d12d668a85 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:13.994865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a667b4-095f-44ac-a478-d2d12d668a85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:47:13.995318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a667b4-095f-44ac-a478-d2d12d668a85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:13.998289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a667b4-095f-44ac-a478-d2d12d668a85 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:14.017205 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1022/2059] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:47:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:47:14.021487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54fda5-6882-4469-8fef-83c91d12a5af None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:14.031591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54fda5-6882-4469-8fef-83c91d12a5af None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:14.040873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1fe47-4bab-43a2-8766-f57504c3bb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:14.041565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1fe47-4bab-43a2-8766-f57504c3bb0d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:14.041850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1fe47-4bab-43a2-8766-f57504c3bb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:14.042133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1fe47-4bab-43a2-8766-f57504c3bb0d admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:14.042871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1fe47-4bab-43a2-8766-f57504c3bb0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:14.044754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1fe47-4bab-43a2-8766-f57504c3bb0d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:14.079727 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1038/2060] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:14 2021] POST /identity/v3/projects => generated 393 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:47:14.083940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a667b4-095f-44ac-a478-d2d12d668a85 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:14.095556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a667b4-095f-44ac-a478-d2d12d668a85 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:14.203906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2485a-3d25-4bb2-9a75-380177593e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:14.204673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2485a-3d25-4bb2-9a75-380177593e94 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:14.204958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2485a-3d25-4bb2-9a75-380177593e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:14.205268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2485a-3d25-4bb2-9a75-380177593e94 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:14.206717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2485a-3d25-4bb2-9a75-380177593e94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:14.209177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2485a-3d25-4bb2-9a75-380177593e94 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:14.258159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1fe47-4bab-43a2-8766-f57504c3bb0d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:14.259260 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1023/2061] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:14 2021] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:14.300897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1fe47-4bab-43a2-8766-f57504c3bb0d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:14.321235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6cf72-de50-499b-a7c4-de370d02a753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:14.325438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6cf72-de50-499b-a7c4-de370d02a753 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:14.325902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6cf72-de50-499b-a7c4-de370d02a753 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:14.326374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6cf72-de50-499b-a7c4-de370d02a753 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:14.329704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6cf72-de50-499b-a7c4-de370d02a753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:14.338570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6cf72-de50-499b-a7c4-de370d02a753 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:14.363388 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1039/2062] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:14 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:14.366077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2485a-3d25-4bb2-9a75-380177593e94 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:14.384773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2485a-3d25-4bb2-9a75-380177593e94 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:14.390959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce585b3d-177b-4f25-8d91-2ee37e2757e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:14.391686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce585b3d-177b-4f25-8d91-2ee37e2757e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:14.391980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce585b3d-177b-4f25-8d91-2ee37e2757e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:14.392264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce585b3d-177b-4f25-8d91-2ee37e2757e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:14.394103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce585b3d-177b-4f25-8d91-2ee37e2757e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:14.398930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce585b3d-177b-4f25-8d91-2ee37e2757e2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:14.444693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6cf72-de50-499b-a7c4-de370d02a753 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:14.454592 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1024/2063] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:14 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:14.460295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6cf72-de50-499b-a7c4-de370d02a753 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:14.474746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acacac6-90c2-4a9a-b9d1-f55b71a80865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:14.475676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acacac6-90c2-4a9a-b9d1-f55b71a80865 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:14.479783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acacac6-90c2-4a9a-b9d1-f55b71a80865 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:14.480149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acacac6-90c2-4a9a-b9d1-f55b71a80865 admin admin] PATH_INFO: `/v3/projects/5a64115a8fdc4fd78580446ebb4622de/users/09e05995c6824c90ab707fca61caaf85/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:14.501795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5fe84-8b51-4f0f-a6d2-293c8f8a7293 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:14.502093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5fe84-8b51-4f0f-a6d2-293c8f8a7293 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:14.502410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5fe84-8b51-4f0f-a6d2-293c8f8a7293 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:14.507542 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1025/2064] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:47:14 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:47:14.513980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f392c91-9bc8-49ff-a741-55ca527ef2ca None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:14.514644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f392c91-9bc8-49ff-a741-55ca527ef2ca None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:14.514644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f392c91-9bc8-49ff-a741-55ca527ef2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:14.534494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acacac6-90c2-4a9a-b9d1-f55b71a80865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a64115a8fdc4fd78580446ebb4622de, user_id=09e05995c6824c90ab707fca61caaf85, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:14.540858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acacac6-90c2-4a9a-b9d1-f55b71a80865 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:14.558279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1f392c91-9bc8-49ff-a741-55ca527ef2ca None None] MFA Rules not processed for user `6f8eeb55c523480fb45d4bbb8afe8e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:14.560919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1f392c91-9bc8-49ff-a741-55ca527ef2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:14.572421 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1040/2065] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:14 2021] PUT /identity/v3/projects/5a64115a8fdc4fd78580446ebb4622de/users/09e05995c6824c90ab707fca61caaf85/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:14.582881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdb6c2-2c8f-4d1c-a460-54487a857a40 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:14.583180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdb6c2-2c8f-4d1c-a460-54487a857a40 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:14.583463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdb6c2-2c8f-4d1c-a460-54487a857a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:14.660836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f9bdb6c2-2c8f-4d1c-a460-54487a857a40 None None] MFA Rules not processed for user `09e05995c6824c90ab707fca61caaf85`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:14.667079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f9bdb6c2-2c8f-4d1c-a460-54487a857a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:14.669007 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1026/2066] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:47:14 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:47:14.697046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f392c91-9bc8-49ff-a741-55ca527ef2ca None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:14.699039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1f392c91-9bc8-49ff-a741-55ca527ef2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:14.713714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f392c91-9bc8-49ff-a741-55ca527ef2ca None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:14.730534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556774a9-9052-4b15-803a-937901882a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:14.731232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556774a9-9052-4b15-803a-937901882a9a service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:14.731507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556774a9-9052-4b15-803a-937901882a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:14.731791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556774a9-9052-4b15-803a-937901882a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:14.753397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556774a9-9052-4b15-803a-937901882a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:14.763056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556774a9-9052-4b15-803a-937901882a9a service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:14.791775 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1027/2067] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:14 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:47:14.911993 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1041/2068] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:14 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:47:14.916587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556774a9-9052-4b15-803a-937901882a9a service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:15.026437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556774a9-9052-4b15-803a-937901882a9a service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:15.034604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb341c-8ba6-4445-bebe-7c56b5c5591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:15.038215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb341c-8ba6-4445-bebe-7c56b5c5591b admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:15.038617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb341c-8ba6-4445-bebe-7c56b5c5591b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:15.040567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb341c-8ba6-4445-bebe-7c56b5c5591b admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:15.041576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb341c-8ba6-4445-bebe-7c56b5c5591b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:15.046573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb341c-8ba6-4445-bebe-7c56b5c5591b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:15.083605 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1028/2069] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:14 2021] POST /identity/v3/projects => generated 393 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:15.088689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdb6c2-2c8f-4d1c-a460-54487a857a40 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:15.102954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdb6c2-2c8f-4d1c-a460-54487a857a40 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:15.178540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39425fdc-b757-45b9-a3f0-71bcbffb0dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:15.180295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425fdc-b757-45b9-a3f0-71bcbffb0dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:15.180769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425fdc-b757-45b9-a3f0-71bcbffb0dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:15.181941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425fdc-b757-45b9-a3f0-71bcbffb0dc5 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:15.182967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39425fdc-b757-45b9-a3f0-71bcbffb0dc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:15.185391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39425fdc-b757-45b9-a3f0-71bcbffb0dc5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:15.222225 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1042/2070] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:15 2021] POST /identity/v3/users => generated 303 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:47:15.224729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb341c-8ba6-4445-bebe-7c56b5c5591b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:15.241935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb341c-8ba6-4445-bebe-7c56b5c5591b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:15.250670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ecd7e-1ab6-43e3-a862-27a5d8ea65f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:15.250670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ecd7e-1ab6-43e3-a862-27a5d8ea65f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:15.251050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ecd7e-1ab6-43e3-a862-27a5d8ea65f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:15.251594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ecd7e-1ab6-43e3-a862-27a5d8ea65f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:15.253313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ecd7e-1ab6-43e3-a862-27a5d8ea65f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:15.255615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ecd7e-1ab6-43e3-a862-27a5d8ea65f6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:15.292377 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1029/2071] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:15 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:15.295793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39425fdc-b757-45b9-a3f0-71bcbffb0dc5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:15.314830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39425fdc-b757-45b9-a3f0-71bcbffb0dc5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:15.331498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9a951-0ac6-4e29-b8e2-93526317ea9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:15.334853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9a951-0ac6-4e29-b8e2-93526317ea9b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:15.336873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9a951-0ac6-4e29-b8e2-93526317ea9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:15.337030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9a951-0ac6-4e29-b8e2-93526317ea9b admin admin] PATH_INFO: `/v3/projects/5fc36a8f761c4e7882527a99234ee363/users/d5963a35bdf0484aa1ad4d7c584c2f38/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:15.375907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9a951-0ac6-4e29-b8e2-93526317ea9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc36a8f761c4e7882527a99234ee363, user_id=d5963a35bdf0484aa1ad4d7c584c2f38, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:15.380969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9a951-0ac6-4e29-b8e2-93526317ea9b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:15.419798 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1043/2072] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:15 2021] PUT /identity/v3/projects/5fc36a8f761c4e7882527a99234ee363/users/d5963a35bdf0484aa1ad4d7c584c2f38/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:15.424638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ecd7e-1ab6-43e3-a862-27a5d8ea65f6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:15.442001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ecd7e-1ab6-43e3-a862-27a5d8ea65f6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:15.568733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284b874-8c33-440c-b60c-9c9d81f49535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:15.569601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284b874-8c33-440c-b60c-9c9d81f49535 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:15.569893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284b874-8c33-440c-b60c-9c9d81f49535 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:15.570218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284b874-8c33-440c-b60c-9c9d81f49535 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:15.571011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284b874-8c33-440c-b60c-9c9d81f49535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:15.575455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284b874-8c33-440c-b60c-9c9d81f49535 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:15.597745 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1030/2073] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:15 2021] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:15.604291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9a951-0ac6-4e29-b8e2-93526317ea9b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:15.626972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9a951-0ac6-4e29-b8e2-93526317ea9b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:15.645421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4223bd-cc31-4e75-ab35-94e92a98e6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:15.650753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4223bd-cc31-4e75-ab35-94e92a98e6df admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:15.651013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4223bd-cc31-4e75-ab35-94e92a98e6df admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:15.651312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4223bd-cc31-4e75-ab35-94e92a98e6df admin admin] PATH_INFO: `/v3/projects/5fc36a8f761c4e7882527a99234ee363/users/d5963a35bdf0484aa1ad4d7c584c2f38/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:15.660420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4223bd-cc31-4e75-ab35-94e92a98e6df admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc36a8f761c4e7882527a99234ee363, user_id=d5963a35bdf0484aa1ad4d7c584c2f38, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:15.668800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4223bd-cc31-4e75-ab35-94e92a98e6df admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:15.682010 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1044/2074] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:15 2021] PUT /identity/v3/projects/5fc36a8f761c4e7882527a99234ee363/users/d5963a35bdf0484aa1ad4d7c584c2f38/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:15.696263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324e398-9422-4cf9-902f-cbba3c5daae4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:15.696961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324e398-9422-4cf9-902f-cbba3c5daae4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:15.697423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324e398-9422-4cf9-902f-cbba3c5daae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:15.796824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e324e398-9422-4cf9-902f-cbba3c5daae4 None None] MFA Rules not processed for user `d5963a35bdf0484aa1ad4d7c584c2f38`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:15.800628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e324e398-9422-4cf9-902f-cbba3c5daae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:15.990370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10db1a6-1735-4753-b216-3a5d30c4e72b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:15.990604 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1031/2075] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:15 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:15.991209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10db1a6-1735-4753-b216-3a5d30c4e72b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:15.991660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10db1a6-1735-4753-b216-3a5d30c4e72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:16.040058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c10db1a6-1735-4753-b216-3a5d30c4e72b None None] MFA Rules not processed for user `09e05995c6824c90ab707fca61caaf85`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:16.041869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c10db1a6-1735-4753-b216-3a5d30c4e72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:16.100874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08c54c-a936-4889-9ec8-5b518c16b370 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:16.101199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08c54c-a936-4889-9ec8-5b518c16b370 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:16.102008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08c54c-a936-4889-9ec8-5b518c16b370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:16.159357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-bd08c54c-a936-4889-9ec8-5b518c16b370 None None] MFA Rules not processed for user `38872124d18947de9ea12c83e207715e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:16.160593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bd08c54c-a936-4889-9ec8-5b518c16b370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:16.211667 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1045/2076] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:15 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:16.220938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10db1a6-1735-4753-b216-3a5d30c4e72b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:16.222628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c10db1a6-1735-4753-b216-3a5d30c4e72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:16.313981 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1032/2077] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:16 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:16.388550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10db1a6-1735-4753-b216-3a5d30c4e72b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:16.401557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b2a88-aeaf-4218-ac26-14ed85f90631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:16.402224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b2a88-aeaf-4218-ac26-14ed85f90631 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:16.403006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b2a88-aeaf-4218-ac26-14ed85f90631 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:16.403006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b2a88-aeaf-4218-ac26-14ed85f90631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:16.417883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b2a88-aeaf-4218-ac26-14ed85f90631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:16.419777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b2a88-aeaf-4218-ac26-14ed85f90631 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:16.433136 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1046/2078] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:16 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:47:17.311728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0c2a9-8de8-4c31-8f83-450d05c2f74b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:17.312248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0c2a9-8de8-4c31-8f83-450d05c2f74b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:17.312323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0c2a9-8de8-4c31-8f83-450d05c2f74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:17.412372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8fc0c2a9-8de8-4c31-8f83-450d05c2f74b None None] MFA Rules not processed for user `6992d255e81c499a8373dd4c727e1f41`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:17.413792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8fc0c2a9-8de8-4c31-8f83-450d05c2f74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:17.572206 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1033/2079] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:17 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:17.582803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b01571-5ae5-4fa0-a2a1-6916a64a3e15 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:17.585297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b01571-5ae5-4fa0-a2a1-6916a64a3e15 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:17.586515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b01571-5ae5-4fa0-a2a1-6916a64a3e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:17.612257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-95b01571-5ae5-4fa0-a2a1-6916a64a3e15 None None] MFA Rules not processed for user `6992d255e81c499a8373dd4c727e1f41`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:17.614063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-95b01571-5ae5-4fa0-a2a1-6916a64a3e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:17.624861 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1047/2080] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:17 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:18.012772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0c2a9-8de8-4c31-8f83-450d05c2f74b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:18.031125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0c2a9-8de8-4c31-8f83-450d05c2f74b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:18.040212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcdfac-3faa-4d28-9f96-18df62818d72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:18.041404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcdfac-3faa-4d28-9f96-18df62818d72 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:18.041909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcdfac-3faa-4d28-9f96-18df62818d72 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:18.042460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcdfac-3faa-4d28-9f96-18df62818d72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:18.054232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcdfac-3faa-4d28-9f96-18df62818d72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:18.058836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcdfac-3faa-4d28-9f96-18df62818d72 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:18.069948 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1034/2081] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:18 2021] GET /identity/v3/auth/tokens => generated 3262 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:20.318987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b01571-5ae5-4fa0-a2a1-6916a64a3e15 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:20.338496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b01571-5ae5-4fa0-a2a1-6916a64a3e15 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:20.352960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7601d-657b-4eca-8dd9-75ce8cc4cda9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:20.355542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7601d-657b-4eca-8dd9-75ce8cc4cda9 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:20.355968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7601d-657b-4eca-8dd9-75ce8cc4cda9 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:20.356354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7601d-657b-4eca-8dd9-75ce8cc4cda9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:20.362683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c8f7601d-657b-4eca-8dd9-75ce8cc4cda9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:20.519179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7601d-657b-4eca-8dd9-75ce8cc4cda9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:20.521227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7601d-657b-4eca-8dd9-75ce8cc4cda9 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:20.535779 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1048/2082] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:20 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:22.512123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32beb1-8385-4cd9-8589-95d6dfe1927d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:22.513029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32beb1-8385-4cd9-8589-95d6dfe1927d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:22.513692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32beb1-8385-4cd9-8589-95d6dfe1927d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:22.547836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0b32beb1-8385-4cd9-8589-95d6dfe1927d None None] MFA Rules not processed for user `b9e4893e5d944bce9da0588758509af4`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:22.550844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0b32beb1-8385-4cd9-8589-95d6dfe1927d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:22.757066 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1035/2083] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:22 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:28.174539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7601d-657b-4eca-8dd9-75ce8cc4cda9 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:28.195420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7601d-657b-4eca-8dd9-75ce8cc4cda9 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:28.211937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff2331-3331-466b-af0c-14b9ab5c41a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:28.212594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff2331-3331-466b-af0c-14b9ab5c41a0 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:28.212875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff2331-3331-466b-af0c-14b9ab5c41a0 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:28.213148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff2331-3331-466b-af0c-14b9ab5c41a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:28.215111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f6ff2331-3331-466b-af0c-14b9ab5c41a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:28.328362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff2331-3331-466b-af0c-14b9ab5c41a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:28.329986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff2331-3331-466b-af0c-14b9ab5c41a0 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:28.343942 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1049/2084] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:28 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:29.313327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32beb1-8385-4cd9-8589-95d6dfe1927d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:29.314929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0b32beb1-8385-4cd9-8589-95d6dfe1927d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:29.451355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32beb1-8385-4cd9-8589-95d6dfe1927d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:29.457915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993dea3-d0ea-4503-b754-ec47abc94862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:29.458940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993dea3-d0ea-4503-b754-ec47abc94862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:29.459322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993dea3-d0ea-4503-b754-ec47abc94862 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:29.459670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993dea3-d0ea-4503-b754-ec47abc94862 admin admin] PATH_INFO: `/v3/users/9a188df8ed504951b850b40842ffbe73` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:29.461131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993dea3-d0ea-4503-b754-ec47abc94862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a188df8ed504951b850b40842ffbe73)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:29.463295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993dea3-d0ea-4503-b754-ec47abc94862 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:29.524561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6993dea3-d0ea-4503-b754-ec47abc94862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a188df8ed504951b850b40842ffbe73'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:29.541334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6993dea3-d0ea-4503-b754-ec47abc94862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a188df8ed504951b850b40842ffbe73'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:29.561926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6993dea3-d0ea-4503-b754-ec47abc94862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a188df8ed504951b850b40842ffbe73'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:29.563135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6993dea3-d0ea-4503-b754-ec47abc94862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a188df8ed504951b850b40842ffbe73'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:29.573461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6993dea3-d0ea-4503-b754-ec47abc94862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a188df8ed504951b850b40842ffbe73'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:29.586210 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1036/2085] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:29 2021] DELETE /identity/v3/users/9a188df8ed504951b850b40842ffbe73 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:29.590506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ebaff-54db-4c08-87af-f817021072ab None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:29.591573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ebaff-54db-4c08-87af-f817021072ab None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:29.591966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ebaff-54db-4c08-87af-f817021072ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:29.615226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-947ebaff-54db-4c08-87af-f817021072ab None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:29.616734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-947ebaff-54db-4c08-87af-f817021072ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:29.695251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6ffd8-85a6-4622-b029-bee33e4e4942 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:29.695558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6ffd8-85a6-4622-b029-bee33e4e4942 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:29.695897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6ffd8-85a6-4622-b029-bee33e4e4942 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:29.698080 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1037/2086] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:47:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:47:29.704100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922e6e9-6561-45c2-a576-12b3f89f8710 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:29.704395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922e6e9-6561-45c2-a576-12b3f89f8710 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:29.704679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922e6e9-6561-45c2-a576-12b3f89f8710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:29.725676 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1050/2087] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:47:29.739336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ebaff-54db-4c08-87af-f817021072ab None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:29.740715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-947ebaff-54db-4c08-87af-f817021072ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:29.806759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1922e6e9-6561-45c2-a576-12b3f89f8710 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:29.808541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ebaff-54db-4c08-87af-f817021072ab None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:29.808675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1922e6e9-6561-45c2-a576-12b3f89f8710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:29.814613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6003c-deb6-478b-a078-ac5b602ebd10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:29.815759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6003c-deb6-478b-a078-ac5b602ebd10 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:29.816243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6003c-deb6-478b-a078-ac5b602ebd10 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:29.816732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6003c-deb6-478b-a078-ac5b602ebd10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:29.830366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6003c-deb6-478b-a078-ac5b602ebd10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:29.832026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6003c-deb6-478b-a078-ac5b602ebd10 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:29.842600 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1051/2088] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:29.927035 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1038/2089] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:47:29 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:47:29.954566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6003c-deb6-478b-a078-ac5b602ebd10 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:29.956608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dee6003c-deb6-478b-a078-ac5b602ebd10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:29.975491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6003c-deb6-478b-a078-ac5b602ebd10 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:29.982815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fe636-86b8-4562-a9b0-030c316ccd8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:29.983528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fe636-86b8-4562-a9b0-030c316ccd8e service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:29.983823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fe636-86b8-4562-a9b0-030c316ccd8e service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:29.984108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fe636-86b8-4562-a9b0-030c316ccd8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:29.993793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fe636-86b8-4562-a9b0-030c316ccd8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:29.995538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fe636-86b8-4562-a9b0-030c316ccd8e service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:30.006355 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1052/2090] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:29 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:30.222678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922e6e9-6561-45c2-a576-12b3f89f8710 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:30.224873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1922e6e9-6561-45c2-a576-12b3f89f8710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:30.235762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fe636-86b8-4562-a9b0-030c316ccd8e service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:30.248423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922e6e9-6561-45c2-a576-12b3f89f8710 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:30.251955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fe636-86b8-4562-a9b0-030c316ccd8e service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:30.259527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db88f5a-184a-4a90-bbc4-9d547a72376a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:30.259900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995ffd4-4e5f-448b-9c49-4e507ba48ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:30.260668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88f5a-184a-4a90-bbc4-9d547a72376a service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:30.260799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995ffd4-4e5f-448b-9c49-4e507ba48ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:30.261032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995ffd4-4e5f-448b-9c49-4e507ba48ede admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:30.261318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995ffd4-4e5f-448b-9c49-4e507ba48ede admin admin] PATH_INFO: `/v3/projects/f38480e435834a8cb37eacd183315171` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:30.261632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88f5a-184a-4a90-bbc4-9d547a72376a service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:30.262620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995ffd4-4e5f-448b-9c49-4e507ba48ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=f38480e435834a8cb37eacd183315171)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:30.264509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995ffd4-4e5f-448b-9c49-4e507ba48ede admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:30.266524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88f5a-184a-4a90-bbc4-9d547a72376a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:30.270670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2db88f5a-184a-4a90-bbc4-9d547a72376a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:30.284705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db88f5a-184a-4a90-bbc4-9d547a72376a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:30.286600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db88f5a-184a-4a90-bbc4-9d547a72376a service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:30.301257 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1053/2091] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:30 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:30.328612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7995ffd4-4e5f-448b-9c49-4e507ba48ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38480e435834a8cb37eacd183315171', 'request_id': 'req-7995ffd4-4e5f-448b-9c49-4e507ba48ede'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:30.336244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7995ffd4-4e5f-448b-9c49-4e507ba48ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38480e435834a8cb37eacd183315171', 'request_id': 'req-7995ffd4-4e5f-448b-9c49-4e507ba48ede'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:30.342928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7995ffd4-4e5f-448b-9c49-4e507ba48ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38480e435834a8cb37eacd183315171', 'request_id': 'req-7995ffd4-4e5f-448b-9c49-4e507ba48ede'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:30.357858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7995ffd4-4e5f-448b-9c49-4e507ba48ede admin admin] The token cache is being invalidate because project f38480e435834a8cb37eacd183315171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:30.358432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7995ffd4-4e5f-448b-9c49-4e507ba48ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:30.359522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7995ffd4-4e5f-448b-9c49-4e507ba48ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:30.361376 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1039/2092] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:30 2021] DELETE /identity/v3/projects/f38480e435834a8cb37eacd183315171 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:30.365438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db88f5a-184a-4a90-bbc4-9d547a72376a service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:30.376598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db88f5a-184a-4a90-bbc4-9d547a72376a service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:30.457406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f28a10-1dc5-49e1-a09c-22ec45a21d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:30.458307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f28a10-1dc5-49e1-a09c-22ec45a21d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:30.458593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f28a10-1dc5-49e1-a09c-22ec45a21d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:30.458871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f28a10-1dc5-49e1-a09c-22ec45a21d0d admin admin] PATH_INFO: `/v3/users/9dd0ab8b14534ef5b70f1b7015dec8d4` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:30.460261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f28a10-1dc5-49e1-a09c-22ec45a21d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd0ab8b14534ef5b70f1b7015dec8d4)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:30.466843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f28a10-1dc5-49e1-a09c-22ec45a21d0d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:30.523259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-64f28a10-1dc5-49e1-a09c-22ec45a21d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd0ab8b14534ef5b70f1b7015dec8d4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:30.530499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-64f28a10-1dc5-49e1-a09c-22ec45a21d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd0ab8b14534ef5b70f1b7015dec8d4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:30.531234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-64f28a10-1dc5-49e1-a09c-22ec45a21d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd0ab8b14534ef5b70f1b7015dec8d4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:30.543327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-64f28a10-1dc5-49e1-a09c-22ec45a21d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd0ab8b14534ef5b70f1b7015dec8d4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:30.551228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-64f28a10-1dc5-49e1-a09c-22ec45a21d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd0ab8b14534ef5b70f1b7015dec8d4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:30.557777 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1054/2093] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:30 2021] DELETE /identity/v3/users/9dd0ab8b14534ef5b70f1b7015dec8d4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:30.731395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c16b59-538b-498a-a6b2-d7f8ff888819 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:30.731695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c16b59-538b-498a-a6b2-d7f8ff888819 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:30.731977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c16b59-538b-498a-a6b2-d7f8ff888819 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:30.734446 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1040/2094] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:47:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:47:30.740408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2587664-36b8-43d6-ad79-f20a30855446 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:30.740915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2587664-36b8-43d6-ad79-f20a30855446 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:30.741025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2587664-36b8-43d6-ad79-f20a30855446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:30.762193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b2587664-36b8-43d6-ad79-f20a30855446 None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:30.764227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b2587664-36b8-43d6-ad79-f20a30855446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:30.854465 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1055/2095] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:47:30 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:30.868937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c16b59-538b-498a-a6b2-d7f8ff888819 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:30.873512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d4c16b59-538b-498a-a6b2-d7f8ff888819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:30.892539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2587664-36b8-43d6-ad79-f20a30855446 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:30.894184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b2587664-36b8-43d6-ad79-f20a30855446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:30.964773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c16b59-538b-498a-a6b2-d7f8ff888819 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:30.969185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6200f-bef3-447d-be49-28ad0e92a9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:30.970117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6200f-bef3-447d-be49-28ad0e92a9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:30.970581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6200f-bef3-447d-be49-28ad0e92a9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:30.971022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6200f-bef3-447d-be49-28ad0e92a9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:30.984195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6200f-bef3-447d-be49-28ad0e92a9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:30.986621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6200f-bef3-447d-be49-28ad0e92a9f5 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:30.988818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2587664-36b8-43d6-ad79-f20a30855446 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:30.994487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ef58e-b9c0-4bc4-b1b6-912c3d6fd922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:30.995628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ef58e-b9c0-4bc4-b1b6-912c3d6fd922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:30.996075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ef58e-b9c0-4bc4-b1b6-912c3d6fd922 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:30.996522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ef58e-b9c0-4bc4-b1b6-912c3d6fd922 admin admin] PATH_INFO: `/v3/projects/9bb9a96950044c4f8efb2951d1b58705` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:30.997859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ef58e-b9c0-4bc4-b1b6-912c3d6fd922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb9a96950044c4f8efb2951d1b58705)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:30.999795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ef58e-b9c0-4bc4-b1b6-912c3d6fd922 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:31.004290 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1041/2096] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:30 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:31.033049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029aff-ebe3-41cd-8ef9-0d9c5cbb0ced None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:31.033344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029aff-ebe3-41cd-8ef9-0d9c5cbb0ced None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:31.033683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029aff-ebe3-41cd-8ef9-0d9c5cbb0ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:31.051276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ea3ef58e-b9c0-4bc4-b1b6-912c3d6fd922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb9a96950044c4f8efb2951d1b58705', 'request_id': 'req-ea3ef58e-b9c0-4bc4-b1b6-912c3d6fd922'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:31.052107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-99029aff-ebe3-41cd-8ef9-0d9c5cbb0ced None None] MFA Rules not processed for user `6f8eeb55c523480fb45d4bbb8afe8e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:31.053781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-99029aff-ebe3-41cd-8ef9-0d9c5cbb0ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:31.059757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ea3ef58e-b9c0-4bc4-b1b6-912c3d6fd922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb9a96950044c4f8efb2951d1b58705', 'request_id': 'req-ea3ef58e-b9c0-4bc4-b1b6-912c3d6fd922'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:31.069001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ea3ef58e-b9c0-4bc4-b1b6-912c3d6fd922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb9a96950044c4f8efb2951d1b58705', 'request_id': 'req-ea3ef58e-b9c0-4bc4-b1b6-912c3d6fd922'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:31.080967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ea3ef58e-b9c0-4bc4-b1b6-912c3d6fd922 admin admin] The token cache is being invalidate because project 9bb9a96950044c4f8efb2951d1b58705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:31.081250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ea3ef58e-b9c0-4bc4-b1b6-912c3d6fd922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:31.082091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ea3ef58e-b9c0-4bc4-b1b6-912c3d6fd922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:31.084067 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1056/2097] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:30 2021] DELETE /identity/v3/projects/9bb9a96950044c4f8efb2951d1b58705 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:31.091415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84873b7c-d4fe-4f68-bb32-16b21abffb49 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:31.092143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84873b7c-d4fe-4f68-bb32-16b21abffb49 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:31.092143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84873b7c-d4fe-4f68-bb32-16b21abffb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:31.110958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-84873b7c-d4fe-4f68-bb32-16b21abffb49 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:31.112155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-84873b7c-d4fe-4f68-bb32-16b21abffb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:31.122086 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1042/2098] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:47:31 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:47:31.122754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99029aff-ebe3-41cd-8ef9-0d9c5cbb0ced None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:31.123997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-99029aff-ebe3-41cd-8ef9-0d9c5cbb0ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:31.174774 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1057/2099] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:47:31.183315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84873b7c-d4fe-4f68-bb32-16b21abffb49 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:31.185047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-84873b7c-d4fe-4f68-bb32-16b21abffb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:31.198765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84873b7c-d4fe-4f68-bb32-16b21abffb49 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:31.202735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f5f46-6268-47ca-812b-15e6f59201f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:31.203108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99029aff-ebe3-41cd-8ef9-0d9c5cbb0ced None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:31.203559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f5f46-6268-47ca-812b-15e6f59201f0 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:31.203943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f5f46-6268-47ca-812b-15e6f59201f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:31.204296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f5f46-6268-47ca-812b-15e6f59201f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:31.209434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3a299-0e66-4fdf-b3a8-b715041b16ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:31.210175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a299-0e66-4fdf-b3a8-b715041b16ca service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:31.210513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a299-0e66-4fdf-b3a8-b715041b16ca service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:31.210781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a299-0e66-4fdf-b3a8-b715041b16ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:31.212836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f5f46-6268-47ca-812b-15e6f59201f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:31.213505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4cd3a299-0e66-4fdf-b3a8-b715041b16ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:31.214466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f5f46-6268-47ca-812b-15e6f59201f0 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:31.223818 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1058/2100] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:31 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:31.225246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fce7c-f68f-4c81-b141-f7651871697d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:31.225733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fce7c-f68f-4c81-b141-f7651871697d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:31.226007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fce7c-f68f-4c81-b141-f7651871697d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:31.245418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2e7fce7c-f68f-4c81-b141-f7651871697d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:31.246853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2e7fce7c-f68f-4c81-b141-f7651871697d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:31.255597 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1059/2101] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:31.260345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fce7c-f68f-4c81-b141-f7651871697d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:31.270687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fce7c-f68f-4c81-b141-f7651871697d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:31.275713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdc94d-ae27-4dad-851a-5c584d69e88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:31.276401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdc94d-ae27-4dad-851a-5c584d69e88c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:31.276683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdc94d-ae27-4dad-851a-5c584d69e88c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:31.276956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdc94d-ae27-4dad-851a-5c584d69e88c admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:31.277692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fdc94d-ae27-4dad-851a-5c584d69e88c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:47:31.278001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fdc94d-ae27-4dad-851a-5c584d69e88c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:31.279660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fdc94d-ae27-4dad-851a-5c584d69e88c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:31.282336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3a299-0e66-4fdf-b3a8-b715041b16ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:31.283924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3a299-0e66-4fdf-b3a8-b715041b16ca service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:31.295184 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1060/2102] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:47:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:47:31.295873 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1043/2103] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:31 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:31.296537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdc94d-ae27-4dad-851a-5c584d69e88c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:31.307945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdc94d-ae27-4dad-851a-5c584d69e88c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:31.322879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8db46a-9bf6-4cce-9efd-f92e43f1823e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:31.323197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8db46a-9bf6-4cce-9efd-f92e43f1823e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:31.323501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8db46a-9bf6-4cce-9efd-f92e43f1823e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:31.324483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e7e45-9751-4277-9f43-bc3f983e53ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:31.325215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e7e45-9751-4277-9f43-bc3f983e53ae admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:31.325561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e7e45-9751-4277-9f43-bc3f983e53ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:31.325901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e7e45-9751-4277-9f43-bc3f983e53ae admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:31.326881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e7e45-9751-4277-9f43-bc3f983e53ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:31.333266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e7e45-9751-4277-9f43-bc3f983e53ae admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:31.344291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-de8db46a-9bf6-4cce-9efd-f92e43f1823e None None] MFA Rules not processed for user `09e05995c6824c90ab707fca61caaf85`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:31.345637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-de8db46a-9bf6-4cce-9efd-f92e43f1823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:31.371664 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1061/2104] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:31 2021] POST /identity/v3/projects => generated 395 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:47:31.373246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e7e45-9751-4277-9f43-bc3f983e53ae admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:31.432339 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1044/2105] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:31 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:47:31.449725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e7e45-9751-4277-9f43-bc3f983e53ae admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:31.454636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36523cda-0b6c-412b-a217-72ee61ae6c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:31.455489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36523cda-0b6c-412b-a217-72ee61ae6c97 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:31.455811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36523cda-0b6c-412b-a217-72ee61ae6c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:31.456093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36523cda-0b6c-412b-a217-72ee61ae6c97 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:31.456954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36523cda-0b6c-412b-a217-72ee61ae6c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:31.458904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36523cda-0b6c-412b-a217-72ee61ae6c97 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:31.487450 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1062/2106] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:31 2021] POST /identity/v3/users => generated 298 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:31.488240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8db46a-9bf6-4cce-9efd-f92e43f1823e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:31.500552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8db46a-9bf6-4cce-9efd-f92e43f1823e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:31.506411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c9bb4-57ea-48b0-8481-99135cd83d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:31.507595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c9bb4-57ea-48b0-8481-99135cd83d56 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:31.508055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c9bb4-57ea-48b0-8481-99135cd83d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:31.508431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c9bb4-57ea-48b0-8481-99135cd83d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:31.509628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c9bb4-57ea-48b0-8481-99135cd83d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:31.512115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c9bb4-57ea-48b0-8481-99135cd83d56 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:31.526294 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1045/2107] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:31 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:47:31.528146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36523cda-0b6c-412b-a217-72ee61ae6c97 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:31.540116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36523cda-0b6c-412b-a217-72ee61ae6c97 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:31.547269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c358e-d054-489a-8edd-d27cedf7059d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:31.548220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c358e-d054-489a-8edd-d27cedf7059d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:31.548220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c358e-d054-489a-8edd-d27cedf7059d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:31.548574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c358e-d054-489a-8edd-d27cedf7059d admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:31.549715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c358e-d054-489a-8edd-d27cedf7059d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:31.551561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c358e-d054-489a-8edd-d27cedf7059d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:31.565336 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1063/2108] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:31 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:31.569406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c9bb4-57ea-48b0-8481-99135cd83d56 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:31.580132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c9bb4-57ea-48b0-8481-99135cd83d56 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:31.586873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf981685-8465-4dfb-8063-01f5a34c59a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:31.588148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf981685-8465-4dfb-8063-01f5a34c59a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:31.588148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf981685-8465-4dfb-8063-01f5a34c59a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:31.588469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf981685-8465-4dfb-8063-01f5a34c59a9 admin admin] PATH_INFO: `/v3/projects/d2b26001001846edad29d1588d2ddeb0/users/603f790d6a4f497fa99f48765d323d5e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:31.605503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf981685-8465-4dfb-8063-01f5a34c59a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b26001001846edad29d1588d2ddeb0, user_id=603f790d6a4f497fa99f48765d323d5e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:31.607983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf981685-8465-4dfb-8063-01f5a34c59a9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:31.628373 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1046/2109] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:31 2021] PUT /identity/v3/projects/d2b26001001846edad29d1588d2ddeb0/users/603f790d6a4f497fa99f48765d323d5e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:47:31.636642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbac1c-9a21-44b6-980e-2a4f13b0578e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:31.636927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbac1c-9a21-44b6-980e-2a4f13b0578e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:31.637261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbac1c-9a21-44b6-980e-2a4f13b0578e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:31.669041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0cdbac1c-9a21-44b6-980e-2a4f13b0578e None None] MFA Rules not processed for user `603f790d6a4f497fa99f48765d323d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:31.670290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0cdbac1c-9a21-44b6-980e-2a4f13b0578e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:31.775247 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1064/2110] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:31 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:31.779752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf981685-8465-4dfb-8063-01f5a34c59a9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:31.888311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf981685-8465-4dfb-8063-01f5a34c59a9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:31.894573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e679f6a-ef2f-4aa9-8f70-2f079d9dfa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:31.895800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e679f6a-ef2f-4aa9-8f70-2f079d9dfa2e admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:31.896228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e679f6a-ef2f-4aa9-8f70-2f079d9dfa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:31.896636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e679f6a-ef2f-4aa9-8f70-2f079d9dfa2e admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:31.898096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e679f6a-ef2f-4aa9-8f70-2f079d9dfa2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:31.900608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e679f6a-ef2f-4aa9-8f70-2f079d9dfa2e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:31.942042 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1047/2111] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:31 2021] POST /identity/v3/projects => generated 395 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:31.943470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbac1c-9a21-44b6-980e-2a4f13b0578e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:31.955466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbac1c-9a21-44b6-980e-2a4f13b0578e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:32.045201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6072e-2c28-4ba4-b6a4-b220afef7935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:32.045707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6072e-2c28-4ba4-b6a4-b220afef7935 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:32.046282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6072e-2c28-4ba4-b6a4-b220afef7935 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:32.046519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6072e-2c28-4ba4-b6a4-b220afef7935 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:32.047337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6072e-2c28-4ba4-b6a4-b220afef7935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:32.049375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6072e-2c28-4ba4-b6a4-b220afef7935 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:32.095726 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1065/2112] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:31 2021] POST /identity/v3/users => generated 304 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:32.100118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e679f6a-ef2f-4aa9-8f70-2f079d9dfa2e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:32.114369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e679f6a-ef2f-4aa9-8f70-2f079d9dfa2e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:32.121433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f7e26-7574-4bd5-9ad8-f3580079e319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:32.122444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7e26-7574-4bd5-9ad8-f3580079e319 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:32.122874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7e26-7574-4bd5-9ad8-f3580079e319 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:32.123257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7e26-7574-4bd5-9ad8-f3580079e319 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:32.124150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f7e26-7574-4bd5-9ad8-f3580079e319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:32.125836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f7e26-7574-4bd5-9ad8-f3580079e319 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:32.140459 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1048/2113] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:32 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:32.144630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6072e-2c28-4ba4-b6a4-b220afef7935 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:32.155616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6072e-2c28-4ba4-b6a4-b220afef7935 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:32.181758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a895cc9-b4e7-47dd-8843-16d393d22900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:32.183881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a895cc9-b4e7-47dd-8843-16d393d22900 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:32.183881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a895cc9-b4e7-47dd-8843-16d393d22900 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:32.183881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a895cc9-b4e7-47dd-8843-16d393d22900 admin admin] PATH_INFO: `/v3/projects/4da9bd9748b34df9b0b67c42cf929226/users/d884a7dabb25458d96bed4f2e9828ef8/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:32.201910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a895cc9-b4e7-47dd-8843-16d393d22900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da9bd9748b34df9b0b67c42cf929226, user_id=d884a7dabb25458d96bed4f2e9828ef8, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:32.205420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a895cc9-b4e7-47dd-8843-16d393d22900 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:32.243589 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1066/2114] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:32 2021] PUT /identity/v3/projects/4da9bd9748b34df9b0b67c42cf929226/users/d884a7dabb25458d96bed4f2e9828ef8/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:32.248425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f7e26-7574-4bd5-9ad8-f3580079e319 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:32.266962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f7e26-7574-4bd5-9ad8-f3580079e319 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:32.349177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef2e4b-981f-4b27-845c-715638f8f272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:32.350184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef2e4b-981f-4b27-845c-715638f8f272 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:32.350759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef2e4b-981f-4b27-845c-715638f8f272 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:32.351165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef2e4b-981f-4b27-845c-715638f8f272 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:32.352093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef2e4b-981f-4b27-845c-715638f8f272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:32.353959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef2e4b-981f-4b27-845c-715638f8f272 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:32.368560 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1049/2115] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:32 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:32.372501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a895cc9-b4e7-47dd-8843-16d393d22900 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:32.388877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a895cc9-b4e7-47dd-8843-16d393d22900 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:32.398419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9149a-eaee-4047-a92c-6c0fda270a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:32.399332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9149a-eaee-4047-a92c-6c0fda270a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:32.400146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9149a-eaee-4047-a92c-6c0fda270a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:32.400437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9149a-eaee-4047-a92c-6c0fda270a15 admin admin] PATH_INFO: `/v3/projects/4da9bd9748b34df9b0b67c42cf929226/users/d884a7dabb25458d96bed4f2e9828ef8/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:32.402942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9149a-eaee-4047-a92c-6c0fda270a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da9bd9748b34df9b0b67c42cf929226, user_id=d884a7dabb25458d96bed4f2e9828ef8, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:32.406571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9149a-eaee-4047-a92c-6c0fda270a15 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:32.429588 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1067/2116] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:32 2021] PUT /identity/v3/projects/4da9bd9748b34df9b0b67c42cf929226/users/d884a7dabb25458d96bed4f2e9828ef8/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:32.441662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5cb10-5079-4b9e-97d8-975b4a05cb2b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:32.441662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5cb10-5079-4b9e-97d8-975b4a05cb2b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:32.441851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5cb10-5079-4b9e-97d8-975b4a05cb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:32.501705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-72d5cb10-5079-4b9e-97d8-975b4a05cb2b None None] MFA Rules not processed for user `d884a7dabb25458d96bed4f2e9828ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:32.503442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-72d5cb10-5079-4b9e-97d8-975b4a05cb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:32.634569 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1050/2117] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:32 2021] POST /identity/v3/auth/tokens => generated 3329 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:32.639223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9149a-eaee-4047-a92c-6c0fda270a15 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:32.786814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9149a-eaee-4047-a92c-6c0fda270a15 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:32.798885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c1053-de63-4723-957b-1a2e91cb12a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:32.799632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c1053-de63-4723-957b-1a2e91cb12a3 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:32.799920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c1053-de63-4723-957b-1a2e91cb12a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:32.800479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c1053-de63-4723-957b-1a2e91cb12a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:32.801371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c1053-de63-4723-957b-1a2e91cb12a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:32.804599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c1053-de63-4723-957b-1a2e91cb12a3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:32.866982 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1068/2118] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:32 2021] POST /identity/v3/projects => generated 395 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:32.877471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5cb10-5079-4b9e-97d8-975b4a05cb2b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:32.890883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5cb10-5079-4b9e-97d8-975b4a05cb2b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:32.995117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92a5c7-003c-4e8c-97ba-eb7c05f165e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:32.996109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92a5c7-003c-4e8c-97ba-eb7c05f165e2 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:32.996648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92a5c7-003c-4e8c-97ba-eb7c05f165e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:32.997225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92a5c7-003c-4e8c-97ba-eb7c05f165e2 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:32.998171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92a5c7-003c-4e8c-97ba-eb7c05f165e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:33.000649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92a5c7-003c-4e8c-97ba-eb7c05f165e2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:33.057642 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1051/2119] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:32 2021] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:47:33.059757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c1053-de63-4723-957b-1a2e91cb12a3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:33.071036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c1053-de63-4723-957b-1a2e91cb12a3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:33.075846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef8856-9b5e-41d1-ac0b-71a4f6dd31fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:33.076892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef8856-9b5e-41d1-ac0b-71a4f6dd31fd admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:33.083472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef8856-9b5e-41d1-ac0b-71a4f6dd31fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:33.090306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef8856-9b5e-41d1-ac0b-71a4f6dd31fd admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:33.091328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef8856-9b5e-41d1-ac0b-71a4f6dd31fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:33.093104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef8856-9b5e-41d1-ac0b-71a4f6dd31fd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:33.112512 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1069/2120] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:33 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:47:33.116093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92a5c7-003c-4e8c-97ba-eb7c05f165e2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:33.127531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92a5c7-003c-4e8c-97ba-eb7c05f165e2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:33.144354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50cc3d-c203-426e-96e4-50f7496efc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:33.145282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50cc3d-c203-426e-96e4-50f7496efc01 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:33.145741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50cc3d-c203-426e-96e4-50f7496efc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:33.146163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50cc3d-c203-426e-96e4-50f7496efc01 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:33.147189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50cc3d-c203-426e-96e4-50f7496efc01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:33.150069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50cc3d-c203-426e-96e4-50f7496efc01 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:33.166976 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1052/2121] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:33 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:33.170074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef8856-9b5e-41d1-ac0b-71a4f6dd31fd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:33.182228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef8856-9b5e-41d1-ac0b-71a4f6dd31fd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:33.188854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876b0b1-76ee-4a95-ad04-8ba954cc1cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:33.189821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876b0b1-76ee-4a95-ad04-8ba954cc1cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:33.190103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876b0b1-76ee-4a95-ad04-8ba954cc1cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:33.190415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876b0b1-76ee-4a95-ad04-8ba954cc1cd8 admin admin] PATH_INFO: `/v3/projects/c140ea4d18ca492086b1d65b30864d5c/users/6ca33f1148a04779aefd7b6315c8c66f/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:33.210220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876b0b1-76ee-4a95-ad04-8ba954cc1cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c140ea4d18ca492086b1d65b30864d5c, user_id=6ca33f1148a04779aefd7b6315c8c66f, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:33.212871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876b0b1-76ee-4a95-ad04-8ba954cc1cd8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:33.228007 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1070/2122] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:33 2021] PUT /identity/v3/projects/c140ea4d18ca492086b1d65b30864d5c/users/6ca33f1148a04779aefd7b6315c8c66f/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:33.238732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a6dae-5628-4e2f-ba0f-6c7e4cc228af None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:33.239183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a6dae-5628-4e2f-ba0f-6c7e4cc228af None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:33.239645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a6dae-5628-4e2f-ba0f-6c7e4cc228af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:33.271572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8d5a6dae-5628-4e2f-ba0f-6c7e4cc228af None None] MFA Rules not processed for user `6ca33f1148a04779aefd7b6315c8c66f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:33.273611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8d5a6dae-5628-4e2f-ba0f-6c7e4cc228af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:33.369160 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1053/2123] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:33 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:47:33.653559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876b0b1-76ee-4a95-ad04-8ba954cc1cd8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:33.655335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2876b0b1-76ee-4a95-ad04-8ba954cc1cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:33.760798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876b0b1-76ee-4a95-ad04-8ba954cc1cd8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:33.768538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8019170-a819-41f0-aae8-8823dfd40248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:33.768901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8019170-a819-41f0-aae8-8823dfd40248 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:33.770054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8019170-a819-41f0-aae8-8823dfd40248 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:33.770054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8019170-a819-41f0-aae8-8823dfd40248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:33.850018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8019170-a819-41f0-aae8-8823dfd40248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:33.852396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8019170-a819-41f0-aae8-8823dfd40248 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:33.863096 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1071/2124] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:33 2021] GET /identity/v3/auth/tokens => generated 3329 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:33.992920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66a21e-d232-435e-b6e6-6e57b363e8e3 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:33.993336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66a21e-d232-435e-b6e6-6e57b363e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:33.993765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66a21e-d232-435e-b6e6-6e57b363e8e3 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:33.996120 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1054/2125] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:47:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:47:34.004254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8019170-a819-41f0-aae8-8823dfd40248 service nova] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:47:34.017473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8019170-a819-41f0-aae8-8823dfd40248 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:34.031390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8019170-a819-41f0-aae8-8823dfd40248 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:34.040667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3993d62-0dab-4ae7-9f49-89a8b2cb8c2b tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd884a7dabb25458d96bed4f2e9828ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4da9bd9748b34df9b0b67c42cf929226', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:34.041544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3993d62-0dab-4ae7-9f49-89a8b2cb8c2b tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:34.041833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3993d62-0dab-4ae7-9f49-89a8b2cb8c2b tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:34.042139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3993d62-0dab-4ae7-9f49-89a8b2cb8c2b tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] PATH_INFO: `/v3/projects/d2b26001001846edad29d1588d2ddeb0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:34.043411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3993d62-0dab-4ae7-9f49-89a8b2cb8c2b tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: Authorizing `identity:get_project(project_id=d2b26001001846edad29d1588d2ddeb0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:34.045493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3993d62-0dab-4ae7-9f49-89a8b2cb8c2b tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:34.051636 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1072/2126] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:47:34 2021] GET /identity/v3/projects/d2b26001001846edad29d1588d2ddeb0 => generated 395 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:47:34.421470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc44d9-be2a-4906-9510-f6db5b1abaca None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:34.422377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc44d9-be2a-4906-9510-f6db5b1abaca None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:34.422834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc44d9-be2a-4906-9510-f6db5b1abaca None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:34.426164 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1055/2127] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:47:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:47:34.433503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3993d62-0dab-4ae7-9f49-89a8b2cb8c2b tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:47:34.449065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3993d62-0dab-4ae7-9f49-89a8b2cb8c2b tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:34.461916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3993d62-0dab-4ae7-9f49-89a8b2cb8c2b tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:34.469228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495e710-bf7d-4371-9f79-d1df0806548d tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd884a7dabb25458d96bed4f2e9828ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4da9bd9748b34df9b0b67c42cf929226', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:34.470236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495e710-bf7d-4371-9f79-d1df0806548d tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:34.470629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495e710-bf7d-4371-9f79-d1df0806548d tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:34.470974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495e710-bf7d-4371-9f79-d1df0806548d tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] PATH_INFO: `/v3/projects/d2b26001001846edad29d1588d2ddeb0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:34.472255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495e710-bf7d-4371-9f79-d1df0806548d tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: Authorizing `identity:get_project(project_id=d2b26001001846edad29d1588d2ddeb0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:34.474431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495e710-bf7d-4371-9f79-d1df0806548d tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:34.481845 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1073/2128] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:47:34 2021] GET /identity/v3/projects/d2b26001001846edad29d1588d2ddeb0 => generated 395 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:47:36.097501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f005b-e64f-40d3-94bf-315e1a665521 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:36.098012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f005b-e64f-40d3-94bf-315e1a665521 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:36.098104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f005b-e64f-40d3-94bf-315e1a665521 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:36.100011 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1056/2129] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:47:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:47:36.106271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495e710-bf7d-4371-9f79-d1df0806548d tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:47:36.120142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495e710-bf7d-4371-9f79-d1df0806548d tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:36.129016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495e710-bf7d-4371-9f79-d1df0806548d tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:36.134270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485bdf8-76b1-484b-9c5f-626ef2fbbf91 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd884a7dabb25458d96bed4f2e9828ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4da9bd9748b34df9b0b67c42cf929226', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:36.135190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485bdf8-76b1-484b-9c5f-626ef2fbbf91 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:36.135557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485bdf8-76b1-484b-9c5f-626ef2fbbf91 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:36.136046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485bdf8-76b1-484b-9c5f-626ef2fbbf91 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] PATH_INFO: `/v3/projects/d2b26001001846edad29d1588d2ddeb0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:36.137309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485bdf8-76b1-484b-9c5f-626ef2fbbf91 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: Authorizing `identity:get_project(project_id=d2b26001001846edad29d1588d2ddeb0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:36.139435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485bdf8-76b1-484b-9c5f-626ef2fbbf91 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:36.141715 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1074/2130] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:47:36 2021] GET /identity/v3/projects/d2b26001001846edad29d1588d2ddeb0 => generated 395 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:47:36.828006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562d5ff-f21f-4c3a-a2ab-dd6b11d6d6b6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:36.828294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562d5ff-f21f-4c3a-a2ab-dd6b11d6d6b6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:36.828863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562d5ff-f21f-4c3a-a2ab-dd6b11d6d6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:36.849502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3562d5ff-f21f-4c3a-a2ab-dd6b11d6d6b6 None None] MFA Rules not processed for user `6992d255e81c499a8373dd4c727e1f41`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:36.851427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3562d5ff-f21f-4c3a-a2ab-dd6b11d6d6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:36.871169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485bdf8-76b1-484b-9c5f-626ef2fbbf91 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:36.894446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485bdf8-76b1-484b-9c5f-626ef2fbbf91 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:36.902372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a2c9c-177a-4fb3-8d35-ddea6456f518 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:36.903026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a2c9c-177a-4fb3-8d35-ddea6456f518 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:36.903449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a2c9c-177a-4fb3-8d35-ddea6456f518 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:36.903733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a2c9c-177a-4fb3-8d35-ddea6456f518 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:36.905800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-774a2c9c-177a-4fb3-8d35-ddea6456f518 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:36.965964 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1057/2131] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:36 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:36.997541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a2c9c-177a-4fb3-8d35-ddea6456f518 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:36.999674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a2c9c-177a-4fb3-8d35-ddea6456f518 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:37.011786 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1075/2132] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:36 2021] GET /identity/v3/auth/tokens => generated 3331 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:37.976682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562d5ff-f21f-4c3a-a2ab-dd6b11d6d6b6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:37.978110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3562d5ff-f21f-4c3a-a2ab-dd6b11d6d6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:38.075356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562d5ff-f21f-4c3a-a2ab-dd6b11d6d6b6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:38.080958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5c638-c644-4df2-bd08-0126aac2ccdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:38.082926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5c638-c644-4df2-bd08-0126aac2ccdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:38.083366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5c638-c644-4df2-bd08-0126aac2ccdf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:38.083816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5c638-c644-4df2-bd08-0126aac2ccdf admin admin] PATH_INFO: `/v3/users/da04cb8260ca46fb8738fdfd071158f9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:38.086003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5c638-c644-4df2-bd08-0126aac2ccdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=da04cb8260ca46fb8738fdfd071158f9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:38.088113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5c638-c644-4df2-bd08-0126aac2ccdf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:38.173208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-67a5c638-c644-4df2-bd08-0126aac2ccdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da04cb8260ca46fb8738fdfd071158f9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:38.182774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-67a5c638-c644-4df2-bd08-0126aac2ccdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da04cb8260ca46fb8738fdfd071158f9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:38.200571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-67a5c638-c644-4df2-bd08-0126aac2ccdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da04cb8260ca46fb8738fdfd071158f9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:38.202165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-67a5c638-c644-4df2-bd08-0126aac2ccdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da04cb8260ca46fb8738fdfd071158f9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:38.214141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-67a5c638-c644-4df2-bd08-0126aac2ccdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da04cb8260ca46fb8738fdfd071158f9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:38.222153 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1058/2133] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:37 2021] DELETE /identity/v3/users/da04cb8260ca46fb8738fdfd071158f9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:38.227284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1ccbf-4394-4d89-b8e0-d9f905b9d903 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:38.228205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1ccbf-4394-4d89-b8e0-d9f905b9d903 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:38.228694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1ccbf-4394-4d89-b8e0-d9f905b9d903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:38.301240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-64b1ccbf-4394-4d89-b8e0-d9f905b9d903 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:38.302612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-64b1ccbf-4394-4d89-b8e0-d9f905b9d903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:38.380740 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1076/2134] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:38.392080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5c638-c644-4df2-bd08-0126aac2ccdf admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:38.395005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-67a5c638-c644-4df2-bd08-0126aac2ccdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:38.498916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf839e-a32b-42c0-b979-f7c5a5e6700f None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:38.499198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf839e-a32b-42c0-b979-f7c5a5e6700f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:38.499793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf839e-a32b-42c0-b979-f7c5a5e6700f None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:38.502922 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1077/2135] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:47:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:47:38.511780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5c638-c644-4df2-bd08-0126aac2ccdf admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:38.521132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063edb6-38fd-4865-b1f4-a70b3200ada1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:38.521371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed24175-0861-4e9a-a8fe-55d4db1b39eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:38.521523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063edb6-38fd-4865-b1f4-a70b3200ada1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:38.521727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063edb6-38fd-4865-b1f4-a70b3200ada1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:38.522528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed24175-0861-4e9a-a8fe-55d4db1b39eb service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:38.523038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed24175-0861-4e9a-a8fe-55d4db1b39eb service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:38.523613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed24175-0861-4e9a-a8fe-55d4db1b39eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:38.533529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed24175-0861-4e9a-a8fe-55d4db1b39eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:38.535378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed24175-0861-4e9a-a8fe-55d4db1b39eb service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:38.544768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6063edb6-38fd-4865-b1f4-a70b3200ada1 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:38.546382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6063edb6-38fd-4865-b1f4-a70b3200ada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:38.569649 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1059/2136] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:38.641475 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1078/2137] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:47:38 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:38.666731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed24175-0861-4e9a-a8fe-55d4db1b39eb service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:38.668547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eed24175-0861-4e9a-a8fe-55d4db1b39eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:38.690829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed24175-0861-4e9a-a8fe-55d4db1b39eb service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:38.700589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013213c8-c432-49d0-8176-7ab556dfde53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:38.701271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013213c8-c432-49d0-8176-7ab556dfde53 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:38.701566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013213c8-c432-49d0-8176-7ab556dfde53 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:38.701851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013213c8-c432-49d0-8176-7ab556dfde53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:38.716836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013213c8-c432-49d0-8176-7ab556dfde53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:38.718837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013213c8-c432-49d0-8176-7ab556dfde53 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:38.739894 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1060/2138] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:38 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:38.803553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063edb6-38fd-4865-b1f4-a70b3200ada1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:38.805056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6063edb6-38fd-4865-b1f4-a70b3200ada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:38.836206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063edb6-38fd-4865-b1f4-a70b3200ada1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:38.841600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2599fe-152a-452d-90e1-791f54ef9c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:38.842494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2599fe-152a-452d-90e1-791f54ef9c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:38.842779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2599fe-152a-452d-90e1-791f54ef9c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:38.843057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2599fe-152a-452d-90e1-791f54ef9c98 admin admin] PATH_INFO: `/v3/projects/6cbee547725d4a06ad0a4be9314d8d6e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:38.844304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2599fe-152a-452d-90e1-791f54ef9c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cbee547725d4a06ad0a4be9314d8d6e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:38.846766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2599fe-152a-452d-90e1-791f54ef9c98 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:38.912128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5d2599fe-152a-452d-90e1-791f54ef9c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cbee547725d4a06ad0a4be9314d8d6e', 'request_id': 'req-5d2599fe-152a-452d-90e1-791f54ef9c98'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:38.921193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5d2599fe-152a-452d-90e1-791f54ef9c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cbee547725d4a06ad0a4be9314d8d6e', 'request_id': 'req-5d2599fe-152a-452d-90e1-791f54ef9c98'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:38.928947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5d2599fe-152a-452d-90e1-791f54ef9c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cbee547725d4a06ad0a4be9314d8d6e', 'request_id': 'req-5d2599fe-152a-452d-90e1-791f54ef9c98'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:38.940313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5d2599fe-152a-452d-90e1-791f54ef9c98 admin admin] The token cache is being invalidate because project 6cbee547725d4a06ad0a4be9314d8d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:38.940656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5d2599fe-152a-452d-90e1-791f54ef9c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:38.941362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5d2599fe-152a-452d-90e1-791f54ef9c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:38.943133 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1079/2139] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:38 2021] DELETE /identity/v3/projects/6cbee547725d4a06ad0a4be9314d8d6e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:47:38.947027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013213c8-c432-49d0-8176-7ab556dfde53 service placement] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:38.962731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013213c8-c432-49d0-8176-7ab556dfde53 service placement] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:39.018149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5672935-3aad-4d3d-bbc1-ee0e080da27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:39.019134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5672935-3aad-4d3d-bbc1-ee0e080da27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:39.019421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5672935-3aad-4d3d-bbc1-ee0e080da27f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:39.019692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5672935-3aad-4d3d-bbc1-ee0e080da27f admin admin] PATH_INFO: `/v3/users/497aeb9520d34f8cbcd2b25455d2fd58` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:39.020907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5672935-3aad-4d3d-bbc1-ee0e080da27f admin admin] RBAC: Authorizing `identity:delete_user(user_id=497aeb9520d34f8cbcd2b25455d2fd58)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:39.025848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5672935-3aad-4d3d-bbc1-ee0e080da27f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:39.087550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c5672935-3aad-4d3d-bbc1-ee0e080da27f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '497aeb9520d34f8cbcd2b25455d2fd58'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:39.096961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c5672935-3aad-4d3d-bbc1-ee0e080da27f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '497aeb9520d34f8cbcd2b25455d2fd58'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:39.118418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c5672935-3aad-4d3d-bbc1-ee0e080da27f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '497aeb9520d34f8cbcd2b25455d2fd58'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:39.119320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c5672935-3aad-4d3d-bbc1-ee0e080da27f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '497aeb9520d34f8cbcd2b25455d2fd58'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:39.127787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c5672935-3aad-4d3d-bbc1-ee0e080da27f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '497aeb9520d34f8cbcd2b25455d2fd58'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:39.141621 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1061/2140] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:38 2021] DELETE /identity/v3/users/497aeb9520d34f8cbcd2b25455d2fd58 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:39.143194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2599fe-152a-452d-90e1-791f54ef9c98 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:39.144899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5d2599fe-152a-452d-90e1-791f54ef9c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:39.285393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2599fe-152a-452d-90e1-791f54ef9c98 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:39.351798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc58b64-cece-4006-b4f6-1438187f0f76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:39.352480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc58b64-cece-4006-b4f6-1438187f0f76 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:39.352763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc58b64-cece-4006-b4f6-1438187f0f76 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:39.353071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc58b64-cece-4006-b4f6-1438187f0f76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:39.354883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6dc58b64-cece-4006-b4f6-1438187f0f76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:39.421070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc58b64-cece-4006-b4f6-1438187f0f76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:39.423473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc58b64-cece-4006-b4f6-1438187f0f76 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:39.436180 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1080/2141] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:39 2021] GET /identity/v3/auth/tokens => generated 3262 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:39.504736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5672935-3aad-4d3d-bbc1-ee0e080da27f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:39.506154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c5672935-3aad-4d3d-bbc1-ee0e080da27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:39.604896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5672935-3aad-4d3d-bbc1-ee0e080da27f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:39.614559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32bec1-7a73-4e1e-ab36-8bb07b8dc042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:39.616662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32bec1-7a73-4e1e-ab36-8bb07b8dc042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:39.617098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32bec1-7a73-4e1e-ab36-8bb07b8dc042 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:39.618604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32bec1-7a73-4e1e-ab36-8bb07b8dc042 admin admin] PATH_INFO: `/v3/projects/c99ad8217aa2405dafaa3ef440e303ee` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:39.622358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32bec1-7a73-4e1e-ab36-8bb07b8dc042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c99ad8217aa2405dafaa3ef440e303ee)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:39.624395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32bec1-7a73-4e1e-ab36-8bb07b8dc042 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:39.685346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ae32bec1-7a73-4e1e-ab36-8bb07b8dc042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99ad8217aa2405dafaa3ef440e303ee', 'request_id': 'req-ae32bec1-7a73-4e1e-ab36-8bb07b8dc042'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:39.695044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ae32bec1-7a73-4e1e-ab36-8bb07b8dc042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99ad8217aa2405dafaa3ef440e303ee', 'request_id': 'req-ae32bec1-7a73-4e1e-ab36-8bb07b8dc042'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:39.706884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ae32bec1-7a73-4e1e-ab36-8bb07b8dc042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99ad8217aa2405dafaa3ef440e303ee', 'request_id': 'req-ae32bec1-7a73-4e1e-ab36-8bb07b8dc042'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:39.733582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ae32bec1-7a73-4e1e-ab36-8bb07b8dc042 admin admin] The token cache is being invalidate because project c99ad8217aa2405dafaa3ef440e303ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:39.734095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ae32bec1-7a73-4e1e-ab36-8bb07b8dc042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:39.734936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ae32bec1-7a73-4e1e-ab36-8bb07b8dc042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:39.743138 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1062/2142] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:39 2021] DELETE /identity/v3/projects/c99ad8217aa2405dafaa3ef440e303ee => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:39.743981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdaa7f-e33b-4fde-8dd0-bab55cd61b4d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:39.744411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdaa7f-e33b-4fde-8dd0-bab55cd61b4d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:39.744788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdaa7f-e33b-4fde-8dd0-bab55cd61b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:39.768585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d8fdaa7f-e33b-4fde-8dd0-bab55cd61b4d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:39.769868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d8fdaa7f-e33b-4fde-8dd0-bab55cd61b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:39.855464 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1081/2143] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:39.863644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ababc-0ff5-4c22-97a6-2e05705ba412 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:39.864061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ababc-0ff5-4c22-97a6-2e05705ba412 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:39.864444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ababc-0ff5-4c22-97a6-2e05705ba412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:39.888703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-221ababc-0ff5-4c22-97a6-2e05705ba412 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:39.890153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-221ababc-0ff5-4c22-97a6-2e05705ba412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:39.898670 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1063/2144] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:39.903428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdaa7f-e33b-4fde-8dd0-bab55cd61b4d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:39.913579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdaa7f-e33b-4fde-8dd0-bab55cd61b4d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:39.920075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c236a2-95b4-40b0-840a-190306d285bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:39.920346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c236a2-95b4-40b0-840a-190306d285bc admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:39.920630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c236a2-95b4-40b0-840a-190306d285bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:39.922108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c236a2-95b4-40b0-840a-190306d285bc admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:39.922108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c236a2-95b4-40b0-840a-190306d285bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:47:39.922108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c236a2-95b4-40b0-840a-190306d285bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:39.923643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c236a2-95b4-40b0-840a-190306d285bc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:39.941714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ababc-0ff5-4c22-97a6-2e05705ba412 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:39.947818 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1082/2145] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:47:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:47:39.951781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ababc-0ff5-4c22-97a6-2e05705ba412 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:39.956713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a311a22-f880-4ce1-a46d-c00ab6b61328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:39.957367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a311a22-f880-4ce1-a46d-c00ab6b61328 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:39.957650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a311a22-f880-4ce1-a46d-c00ab6b61328 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:39.957926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a311a22-f880-4ce1-a46d-c00ab6b61328 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:39.958677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a311a22-f880-4ce1-a46d-c00ab6b61328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:39.961084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a311a22-f880-4ce1-a46d-c00ab6b61328 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:40.049534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c236a2-95b4-40b0-840a-190306d285bc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:40.061586 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1064/2146] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:39 2021] POST /identity/v3/projects => generated 403 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:40.065276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c236a2-95b4-40b0-840a-190306d285bc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:40.139466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba807657-732a-4803-8880-e4ce149032e3 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:40.140011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba807657-732a-4803-8880-e4ce149032e3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:40.140542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba807657-732a-4803-8880-e4ce149032e3 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:40.143389 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1065/2147] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:47:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:47:40.154209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b42316-3500-4e71-bf15-f3a3ec769913 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:40.155195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b42316-3500-4e71-bf15-f3a3ec769913 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:40.155544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b42316-3500-4e71-bf15-f3a3ec769913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:40.192931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20a82-68d0-4d65-88c4-464aaf952047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:40.193748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20a82-68d0-4d65-88c4-464aaf952047 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:40.194446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20a82-68d0-4d65-88c4-464aaf952047 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:40.195319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20a82-68d0-4d65-88c4-464aaf952047 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:40.196162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b20a82-68d0-4d65-88c4-464aaf952047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:40.199330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b20a82-68d0-4d65-88c4-464aaf952047 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:40.241126 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1083/2148] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:40 2021] POST /identity/v3/users => generated 302 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:40.242555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20a82-68d0-4d65-88c4-464aaf952047 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:40.258043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20a82-68d0-4d65-88c4-464aaf952047 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:40.262130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-77b42316-3500-4e71-bf15-f3a3ec769913 None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:40.267454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-77b42316-3500-4e71-bf15-f3a3ec769913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:40.278124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e924b-1c6a-4b8a-a7db-9f5f89c58f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:40.279580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e924b-1c6a-4b8a-a7db-9f5f89c58f85 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:40.280195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e924b-1c6a-4b8a-a7db-9f5f89c58f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:40.280675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e924b-1c6a-4b8a-a7db-9f5f89c58f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:40.281657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e924b-1c6a-4b8a-a7db-9f5f89c58f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:40.286516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e924b-1c6a-4b8a-a7db-9f5f89c58f85 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:40.311115 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1084/2149] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:40 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:40.312615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e924b-1c6a-4b8a-a7db-9f5f89c58f85 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:40.326943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e924b-1c6a-4b8a-a7db-9f5f89c58f85 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:40.333358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721fa79-1124-4cf5-a3d5-829dada73562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:40.335233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721fa79-1124-4cf5-a3d5-829dada73562 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:40.335847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721fa79-1124-4cf5-a3d5-829dada73562 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:40.336399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721fa79-1124-4cf5-a3d5-829dada73562 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:40.337337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721fa79-1124-4cf5-a3d5-829dada73562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:40.339189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721fa79-1124-4cf5-a3d5-829dada73562 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:40.355799 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1085/2150] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:40 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:40.357369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721fa79-1124-4cf5-a3d5-829dada73562 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:40.370923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721fa79-1124-4cf5-a3d5-829dada73562 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:40.377103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251a48f-b4ef-4fef-b638-c2a95bb1cdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:40.378243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a48f-b4ef-4fef-b638-c2a95bb1cdba admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:40.378786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a48f-b4ef-4fef-b638-c2a95bb1cdba admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:40.379252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a48f-b4ef-4fef-b638-c2a95bb1cdba admin admin] PATH_INFO: `/v3/projects/b48e95c75c9444f2a0d2cb6704727346/users/c3e0c0d3dc8441968dafc98b902ab349/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:40.395620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251a48f-b4ef-4fef-b638-c2a95bb1cdba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b48e95c75c9444f2a0d2cb6704727346, user_id=c3e0c0d3dc8441968dafc98b902ab349, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:40.399447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251a48f-b4ef-4fef-b638-c2a95bb1cdba admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:40.425645 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1086/2151] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:40 2021] PUT /identity/v3/projects/b48e95c75c9444f2a0d2cb6704727346/users/c3e0c0d3dc8441968dafc98b902ab349/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:40.427767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48359e9f-1332-4c91-b362-df1aa6e76d4e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:40.428586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48359e9f-1332-4c91-b362-df1aa6e76d4e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:40.429152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48359e9f-1332-4c91-b362-df1aa6e76d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:40.453336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-48359e9f-1332-4c91-b362-df1aa6e76d4e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:40.455929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-48359e9f-1332-4c91-b362-df1aa6e76d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:40.490693 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1066/2152] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:47:40 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Dec 18 20:47:40.508771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b42316-3500-4e71-bf15-f3a3ec769913 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:40.511117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-77b42316-3500-4e71-bf15-f3a3ec769913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:40.582631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b42316-3500-4e71-bf15-f3a3ec769913 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:40.601718 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1087/2153] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:40.612947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48359e9f-1332-4c91-b362-df1aa6e76d4e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:40.616920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-48359e9f-1332-4c91-b362-df1aa6e76d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:40.642980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892ae27-e7c5-44fe-be7a-18c0f016d4ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:40.643749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892ae27-e7c5-44fe-be7a-18c0f016d4ba service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:40.644531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892ae27-e7c5-44fe-be7a-18c0f016d4ba service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:40.644531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892ae27-e7c5-44fe-be7a-18c0f016d4ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:40.737385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48359e9f-1332-4c91-b362-df1aa6e76d4e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:40.743441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd9da7-f62b-42e4-a7f3-4e8e156ccc81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:40.744221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd9da7-f62b-42e4-a7f3-4e8e156ccc81 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:40.744618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd9da7-f62b-42e4-a7f3-4e8e156ccc81 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:40.744990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd9da7-f62b-42e4-a7f3-4e8e156ccc81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:40.746480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892ae27-e7c5-44fe-be7a-18c0f016d4ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:40.752878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892ae27-e7c5-44fe-be7a-18c0f016d4ba service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:40.760531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd9da7-f62b-42e4-a7f3-4e8e156ccc81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:40.762074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd9da7-f62b-42e4-a7f3-4e8e156ccc81 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:40.773520 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1067/2154] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:40.774788 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1088/2155] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:47:40.838623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbfe0d-ff5f-44a5-925a-67c302e03de9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:40.838919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbfe0d-ff5f-44a5-925a-67c302e03de9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:40.839203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbfe0d-ff5f-44a5-925a-67c302e03de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:40.859273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-dbfbfe0d-ff5f-44a5-925a-67c302e03de9 None None] MFA Rules not processed for user `6f8eeb55c523480fb45d4bbb8afe8e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:40.860804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-dbfbfe0d-ff5f-44a5-925a-67c302e03de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:40.873809 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1068/2156] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:47:40 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:47:40.894412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd9da7-f62b-42e4-a7f3-4e8e156ccc81 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:40.905789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd9da7-f62b-42e4-a7f3-4e8e156ccc81 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:40.918290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6867b0c-d533-4fc0-9c18-94cf239bfc36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:40.918630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6867b0c-d533-4fc0-9c18-94cf239bfc36 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:40.919077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6867b0c-d533-4fc0-9c18-94cf239bfc36 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:40.919444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6867b0c-d533-4fc0-9c18-94cf239bfc36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:40.929428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6867b0c-d533-4fc0-9c18-94cf239bfc36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:40.930996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6867b0c-d533-4fc0-9c18-94cf239bfc36 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:40.939576 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1089/2157] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:40 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:41.798529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfd50c-72ac-43b6-bc60-39c077dc705b None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:41.799116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfd50c-72ac-43b6-bc60-39c077dc705b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:41.799116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfd50c-72ac-43b6-bc60-39c077dc705b None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:41.801344 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1069/2158] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:47:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:47:41.813926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6867b0c-d533-4fc0-9c18-94cf239bfc36 service neutron] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:47:41.816699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a6867b0c-d533-4fc0-9c18-94cf239bfc36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:41.873885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6867b0c-d533-4fc0-9c18-94cf239bfc36 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:41.875389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a6867b0c-d533-4fc0-9c18-94cf239bfc36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:41.985188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6867b0c-d533-4fc0-9c18-94cf239bfc36 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:42.002112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ef422-111f-40c7-976f-67a1d314e365 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd884a7dabb25458d96bed4f2e9828ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4da9bd9748b34df9b0b67c42cf929226', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:42.003321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ef422-111f-40c7-976f-67a1d314e365 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:42.003591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ef422-111f-40c7-976f-67a1d314e365 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:42.003945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ef422-111f-40c7-976f-67a1d314e365 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] PATH_INFO: `/v3/projects/d2b26001001846edad29d1588d2ddeb0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:42.005951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ef422-111f-40c7-976f-67a1d314e365 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: Authorizing `identity:get_project(project_id=d2b26001001846edad29d1588d2ddeb0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:42.009724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ef422-111f-40c7-976f-67a1d314e365 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:42.013796 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1090/2159] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:47:41 2021] GET /identity/v3/projects/d2b26001001846edad29d1588d2ddeb0 => generated 395 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:47:43.975797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03c1cd-fe87-489d-ab7e-132216fc8c5c None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:43.976623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03c1cd-fe87-489d-ab7e-132216fc8c5c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:43.976914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03c1cd-fe87-489d-ab7e-132216fc8c5c None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:43.979280 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1070/2160] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:47:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:47:43.985964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ef422-111f-40c7-976f-67a1d314e365 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:47:43.987951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-797ef422-111f-40c7-976f-67a1d314e365 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:44.007406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ef422-111f-40c7-976f-67a1d314e365 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:44.017346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ef422-111f-40c7-976f-67a1d314e365 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:44.022910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035057de-80f9-4639-9730-93bb845afad0 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd884a7dabb25458d96bed4f2e9828ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4da9bd9748b34df9b0b67c42cf929226', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:44.024303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035057de-80f9-4639-9730-93bb845afad0 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:44.024599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035057de-80f9-4639-9730-93bb845afad0 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:44.024890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035057de-80f9-4639-9730-93bb845afad0 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] PATH_INFO: `/v3/projects/d2b26001001846edad29d1588d2ddeb0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:44.026203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035057de-80f9-4639-9730-93bb845afad0 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: Authorizing `identity:get_project(project_id=d2b26001001846edad29d1588d2ddeb0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:44.028307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035057de-80f9-4639-9730-93bb845afad0 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:44.034802 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1091/2161] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:47:43 2021] GET /identity/v3/projects/d2b26001001846edad29d1588d2ddeb0 => generated 395 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:47:46.392431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39d1e2-37ea-4729-92ff-26b6468fde52 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:46.392976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39d1e2-37ea-4729-92ff-26b6468fde52 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:46.393166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39d1e2-37ea-4729-92ff-26b6468fde52 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:46.396805 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1071/2162] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:47:46 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:47:46.405934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035057de-80f9-4639-9730-93bb845afad0 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:47:46.429687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035057de-80f9-4639-9730-93bb845afad0 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:46.457633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035057de-80f9-4639-9730-93bb845afad0 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:46.465074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796491d-24c4-42ec-8e15-2650a2570fa1 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd884a7dabb25458d96bed4f2e9828ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4da9bd9748b34df9b0b67c42cf929226', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:46.466711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796491d-24c4-42ec-8e15-2650a2570fa1 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:46.467150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796491d-24c4-42ec-8e15-2650a2570fa1 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:46.467580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796491d-24c4-42ec-8e15-2650a2570fa1 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] PATH_INFO: `/v3/projects/c140ea4d18ca492086b1d65b30864d5c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:46.484388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796491d-24c4-42ec-8e15-2650a2570fa1 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: Authorizing `identity:get_project(project_id=c140ea4d18ca492086b1d65b30864d5c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:46.486777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796491d-24c4-42ec-8e15-2650a2570fa1 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:46.494768 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1092/2163] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:47:46 2021] GET /identity/v3/projects/c140ea4d18ca492086b1d65b30864d5c => generated 395 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:47:47.627996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8595a-d509-468d-a9c4-88663d52b07b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:47.628507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8595a-d509-468d-a9c4-88663d52b07b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:47.628605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8595a-d509-468d-a9c4-88663d52b07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:47.671779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2ef8595a-d509-468d-a9c4-88663d52b07b None None] MFA Rules not processed for user `c3e0c0d3dc8441968dafc98b902ab349`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:47.681796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2ef8595a-d509-468d-a9c4-88663d52b07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:47.743815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796491d-24c4-42ec-8e15-2650a2570fa1 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:47.745868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1796491d-24c4-42ec-8e15-2650a2570fa1 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:47.775501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796491d-24c4-42ec-8e15-2650a2570fa1 tempest-FlavorsAccessNegativeTestJSON-1278186859 tempest-FlavorsAccessNegativeTestJSON-1278186859-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:47.790340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027ea89-1a80-440d-9f60-35899cad126c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:47.799302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027ea89-1a80-440d-9f60-35899cad126c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:47.799610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027ea89-1a80-440d-9f60-35899cad126c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:47.799918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027ea89-1a80-440d-9f60-35899cad126c admin admin] PATH_INFO: `/v3/users/603f790d6a4f497fa99f48765d323d5e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:47.807642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027ea89-1a80-440d-9f60-35899cad126c admin admin] RBAC: Authorizing `identity:delete_user(user_id=603f790d6a4f497fa99f48765d323d5e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:47.809516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027ea89-1a80-440d-9f60-35899cad126c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:47.858591 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1072/2164] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:47 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:47.861402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8595a-d509-468d-a9c4-88663d52b07b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:47.898684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8595a-d509-468d-a9c4-88663d52b07b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:47.920922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792e128-5cbf-4db7-a186-f3f4dd2d72da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:47.921610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792e128-5cbf-4db7-a186-f3f4dd2d72da admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:47.921894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792e128-5cbf-4db7-a186-f3f4dd2d72da admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:47.922219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792e128-5cbf-4db7-a186-f3f4dd2d72da admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:47.924021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792e128-5cbf-4db7-a186-f3f4dd2d72da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:47.926510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792e128-5cbf-4db7-a186-f3f4dd2d72da admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:47.965658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f027ea89-1a80-440d-9f60-35899cad126c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '603f790d6a4f497fa99f48765d323d5e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:47.985757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f027ea89-1a80-440d-9f60-35899cad126c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '603f790d6a4f497fa99f48765d323d5e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:47.987934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f027ea89-1a80-440d-9f60-35899cad126c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '603f790d6a4f497fa99f48765d323d5e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:48.010610 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1073/2165] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:47 2021] POST /identity/v3/projects => generated 401 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:48.016010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5705b-3877-4c54-ae60-5d4e2417da61 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:48.016309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5705b-3877-4c54-ae60-5d4e2417da61 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:48.016589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5705b-3877-4c54-ae60-5d4e2417da61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:48.044635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f027ea89-1a80-440d-9f60-35899cad126c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '603f790d6a4f497fa99f48765d323d5e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:48.062847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f027ea89-1a80-440d-9f60-35899cad126c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '603f790d6a4f497fa99f48765d323d5e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:48.074949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a2a5705b-3877-4c54-ae60-5d4e2417da61 None None] MFA Rules not processed for user `5aaf1ced6baf4e1d9c940cfe96b2c254`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:48.085300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a2a5705b-3877-4c54-ae60-5d4e2417da61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:48.085496 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1093/2166] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:47 2021] DELETE /identity/v3/users/603f790d6a4f497fa99f48765d323d5e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:48.087043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027ea89-1a80-440d-9f60-35899cad126c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:48.089011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f027ea89-1a80-440d-9f60-35899cad126c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:48.214552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027ea89-1a80-440d-9f60-35899cad126c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:48.229468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e102a96-44ab-42ff-af60-41f52d9755a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:48.230160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e102a96-44ab-42ff-af60-41f52d9755a6 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:48.230630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e102a96-44ab-42ff-af60-41f52d9755a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:48.230927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e102a96-44ab-42ff-af60-41f52d9755a6 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:48.231643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e102a96-44ab-42ff-af60-41f52d9755a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:48.233643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e102a96-44ab-42ff-af60-41f52d9755a6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:48.239712 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1074/2167] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:48 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:48.241256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25bbe1-488d-4813-9afd-46985329a3ed None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:48.241546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25bbe1-488d-4813-9afd-46985329a3ed None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:48.241822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25bbe1-488d-4813-9afd-46985329a3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:48.278737 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1094/2168] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:48 2021] POST /identity/v3/users => generated 307 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:48.281144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e102a96-44ab-42ff-af60-41f52d9755a6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:48.282199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6b25bbe1-488d-4813-9afd-46985329a3ed None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:48.285494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6b25bbe1-488d-4813-9afd-46985329a3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:48.294931 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1075/2169] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:48.301854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e102a96-44ab-42ff-af60-41f52d9755a6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:48.309303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2911de-1e28-4c2f-94c0-c01bda0c36dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:48.309980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2911de-1e28-4c2f-94c0-c01bda0c36dd admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:48.310502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2911de-1e28-4c2f-94c0-c01bda0c36dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:48.310796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2911de-1e28-4c2f-94c0-c01bda0c36dd admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:48.311817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2911de-1e28-4c2f-94c0-c01bda0c36dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:48.316986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2911de-1e28-4c2f-94c0-c01bda0c36dd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:48.320349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25bbe1-488d-4813-9afd-46985329a3ed None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:48.322582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6b25bbe1-488d-4813-9afd-46985329a3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:48.338500 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1095/2170] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:48 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:48.339476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2911de-1e28-4c2f-94c0-c01bda0c36dd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:48.352102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2911de-1e28-4c2f-94c0-c01bda0c36dd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:48.359869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23d5c0-58a5-4a22-9f23-f98730c5f60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:48.360777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23d5c0-58a5-4a22-9f23-f98730c5f60a admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:48.361062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23d5c0-58a5-4a22-9f23-f98730c5f60a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:48.361343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23d5c0-58a5-4a22-9f23-f98730c5f60a admin admin] PATH_INFO: `/v3/projects/45a1dd6e308a471d8df32a7caacfdb44/users/cea2e12107304c1aadf2872c125d84d7/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:48.380036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23d5c0-58a5-4a22-9f23-f98730c5f60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a1dd6e308a471d8df32a7caacfdb44, user_id=cea2e12107304c1aadf2872c125d84d7, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:48.385637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23d5c0-58a5-4a22-9f23-f98730c5f60a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:48.408300 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1096/2171] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:48 2021] PUT /identity/v3/projects/45a1dd6e308a471d8df32a7caacfdb44/users/cea2e12107304c1aadf2872c125d84d7/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:48.409864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23d5c0-58a5-4a22-9f23-f98730c5f60a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:48.413889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25bbe1-488d-4813-9afd-46985329a3ed None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:48.507664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473a804-5008-44f8-87db-3815f5243b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:48.508320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473a804-5008-44f8-87db-3815f5243b2b service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:48.508601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473a804-5008-44f8-87db-3815f5243b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:48.508718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23d5c0-58a5-4a22-9f23-f98730c5f60a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:48.509060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473a804-5008-44f8-87db-3815f5243b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:48.514394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f47d2-9810-4ec4-a5e4-c9e1ebd590d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:48.515173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f47d2-9810-4ec4-a5e4-c9e1ebd590d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:48.515561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f47d2-9810-4ec4-a5e4-c9e1ebd590d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:48.515944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f47d2-9810-4ec4-a5e4-c9e1ebd590d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:48.516797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f47d2-9810-4ec4-a5e4-c9e1ebd590d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:48.518827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f47d2-9810-4ec4-a5e4-c9e1ebd590d1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:48.528438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473a804-5008-44f8-87db-3815f5243b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:48.530403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473a804-5008-44f8-87db-3815f5243b2b service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:48.543448 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1076/2172] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:47:48.547665 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1097/2173] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:48 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:48.548878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473a804-5008-44f8-87db-3815f5243b2b service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:48.564404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473a804-5008-44f8-87db-3815f5243b2b service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:48.590339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee80421-bc25-44e7-a72c-ff159501cca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:48.591496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee80421-bc25-44e7-a72c-ff159501cca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:48.591970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee80421-bc25-44e7-a72c-ff159501cca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:48.592462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee80421-bc25-44e7-a72c-ff159501cca0 admin admin] PATH_INFO: `/v3/projects/45a1dd6e308a471d8df32a7caacfdb44/users/cea2e12107304c1aadf2872c125d84d7/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:48.598502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee80421-bc25-44e7-a72c-ff159501cca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a1dd6e308a471d8df32a7caacfdb44, user_id=cea2e12107304c1aadf2872c125d84d7, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:48.606378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee80421-bc25-44e7-a72c-ff159501cca0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:48.646567 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1077/2174] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:48 2021] PUT /identity/v3/projects/45a1dd6e308a471d8df32a7caacfdb44/users/cea2e12107304c1aadf2872c125d84d7/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:49.511393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f47d2-9810-4ec4-a5e4-c9e1ebd590d1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:49.514095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-334f47d2-9810-4ec4-a5e4-c9e1ebd590d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:49.531691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f47d2-9810-4ec4-a5e4-c9e1ebd590d1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:49.752490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57dbef-318a-4949-ab9c-581e29dd4316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:49.754181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57dbef-318a-4949-ab9c-581e29dd4316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:49.754502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57dbef-318a-4949-ab9c-581e29dd4316 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:49.754790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57dbef-318a-4949-ab9c-581e29dd4316 admin admin] PATH_INFO: `/v3/projects/d2b26001001846edad29d1588d2ddeb0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:49.756615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57dbef-318a-4949-ab9c-581e29dd4316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b26001001846edad29d1588d2ddeb0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:49.758573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57dbef-318a-4949-ab9c-581e29dd4316 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:49.853118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dc57dbef-318a-4949-ab9c-581e29dd4316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b26001001846edad29d1588d2ddeb0', 'request_id': 'req-dc57dbef-318a-4949-ab9c-581e29dd4316'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:49.860207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dc57dbef-318a-4949-ab9c-581e29dd4316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b26001001846edad29d1588d2ddeb0', 'request_id': 'req-dc57dbef-318a-4949-ab9c-581e29dd4316'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:49.870878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dc57dbef-318a-4949-ab9c-581e29dd4316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b26001001846edad29d1588d2ddeb0', 'request_id': 'req-dc57dbef-318a-4949-ab9c-581e29dd4316'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:49.889611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dc57dbef-318a-4949-ab9c-581e29dd4316 admin admin] The token cache is being invalidate because project d2b26001001846edad29d1588d2ddeb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:49.889831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dc57dbef-318a-4949-ab9c-581e29dd4316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:49.890551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dc57dbef-318a-4949-ab9c-581e29dd4316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:49.893224 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1098/2175] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:49 2021] DELETE /identity/v3/projects/d2b26001001846edad29d1588d2ddeb0 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:49.897015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee80421-bc25-44e7-a72c-ff159501cca0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:49.900280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-aee80421-bc25-44e7-a72c-ff159501cca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:49.914535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee80421-bc25-44e7-a72c-ff159501cca0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:50.031549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ac09a-11d4-4a1b-bbae-4d244ffb49d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:50.033067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ac09a-11d4-4a1b-bbae-4d244ffb49d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:50.033502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ac09a-11d4-4a1b-bbae-4d244ffb49d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:50.033941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ac09a-11d4-4a1b-bbae-4d244ffb49d0 admin admin] PATH_INFO: `/v3/users/d884a7dabb25458d96bed4f2e9828ef8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:50.036017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ac09a-11d4-4a1b-bbae-4d244ffb49d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d884a7dabb25458d96bed4f2e9828ef8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:50.038914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ac09a-11d4-4a1b-bbae-4d244ffb49d0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:50.124233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-375ac09a-11d4-4a1b-bbae-4d244ffb49d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd884a7dabb25458d96bed4f2e9828ef8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:50.136783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-375ac09a-11d4-4a1b-bbae-4d244ffb49d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd884a7dabb25458d96bed4f2e9828ef8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:50.153772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-375ac09a-11d4-4a1b-bbae-4d244ffb49d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd884a7dabb25458d96bed4f2e9828ef8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:50.159921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-375ac09a-11d4-4a1b-bbae-4d244ffb49d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd884a7dabb25458d96bed4f2e9828ef8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:50.174985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-375ac09a-11d4-4a1b-bbae-4d244ffb49d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd884a7dabb25458d96bed4f2e9828ef8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:50.213030 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1078/2176] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:49 2021] DELETE /identity/v3/users/d884a7dabb25458d96bed4f2e9828ef8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:51.044280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57dbef-318a-4949-ab9c-581e29dd4316 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:51.046404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dc57dbef-318a-4949-ab9c-581e29dd4316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:51.083482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57dbef-318a-4949-ab9c-581e29dd4316 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:51.243074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ac09a-11d4-4a1b-bbae-4d244ffb49d0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:51.245345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-375ac09a-11d4-4a1b-bbae-4d244ffb49d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:51.331978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c633d-5557-410b-b502-063fd03a5000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:51.333734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c633d-5557-410b-b502-063fd03a5000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:51.335213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c633d-5557-410b-b502-063fd03a5000 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:51.336358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c633d-5557-410b-b502-063fd03a5000 admin admin] PATH_INFO: `/v3/users/38872124d18947de9ea12c83e207715e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:51.339653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c633d-5557-410b-b502-063fd03a5000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38872124d18947de9ea12c83e207715e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:51.342300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c633d-5557-410b-b502-063fd03a5000 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:51.456925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ac09a-11d4-4a1b-bbae-4d244ffb49d0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:51.468840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b3a34-0533-4fc7-8965-11bdb74248fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:51.469198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2d9c633d-5557-410b-b502-063fd03a5000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38872124d18947de9ea12c83e207715e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:51.471561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b3a34-0533-4fc7-8965-11bdb74248fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:51.471858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b3a34-0533-4fc7-8965-11bdb74248fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:51.472138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b3a34-0533-4fc7-8965-11bdb74248fd admin admin] PATH_INFO: `/v3/projects/4da9bd9748b34df9b0b67c42cf929226` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:51.478060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b3a34-0533-4fc7-8965-11bdb74248fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da9bd9748b34df9b0b67c42cf929226)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:51.485488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b3a34-0533-4fc7-8965-11bdb74248fd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:51.486658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2d9c633d-5557-410b-b502-063fd03a5000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38872124d18947de9ea12c83e207715e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:51.488531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2d9c633d-5557-410b-b502-063fd03a5000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38872124d18947de9ea12c83e207715e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:51.518337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2d9c633d-5557-410b-b502-063fd03a5000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38872124d18947de9ea12c83e207715e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:51.529537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2d9c633d-5557-410b-b502-063fd03a5000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38872124d18947de9ea12c83e207715e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:51.562152 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1099/2177] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:51 2021] DELETE /identity/v3/users/38872124d18947de9ea12c83e207715e => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:51.575616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9835d3-ab8c-4a07-a65b-3e8dcc149775 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:51.576935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9835d3-ab8c-4a07-a65b-3e8dcc149775 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:51.577651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9835d3-ab8c-4a07-a65b-3e8dcc149775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:51.604521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c81b3a34-0533-4fc7-8965-11bdb74248fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da9bd9748b34df9b0b67c42cf929226', 'request_id': 'req-c81b3a34-0533-4fc7-8965-11bdb74248fd'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:51.618884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c81b3a34-0533-4fc7-8965-11bdb74248fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da9bd9748b34df9b0b67c42cf929226', 'request_id': 'req-c81b3a34-0533-4fc7-8965-11bdb74248fd'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:51.629017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0f9835d3-ab8c-4a07-a65b-3e8dcc149775 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:51.635062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0f9835d3-ab8c-4a07-a65b-3e8dcc149775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:51.635365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c81b3a34-0533-4fc7-8965-11bdb74248fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da9bd9748b34df9b0b67c42cf929226', 'request_id': 'req-c81b3a34-0533-4fc7-8965-11bdb74248fd'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:51.661578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c81b3a34-0533-4fc7-8965-11bdb74248fd admin admin] The token cache is being invalidate because project 4da9bd9748b34df9b0b67c42cf929226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:51.661877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c81b3a34-0533-4fc7-8965-11bdb74248fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:51.663197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c81b3a34-0533-4fc7-8965-11bdb74248fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:51.665329 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1079/2178] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:51 2021] DELETE /identity/v3/projects/4da9bd9748b34df9b0b67c42cf929226 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:51.672895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b3a34-0533-4fc7-8965-11bdb74248fd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:51.674595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c81b3a34-0533-4fc7-8965-11bdb74248fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:51.761422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b3a34-0533-4fc7-8965-11bdb74248fd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:51.768084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e476b-e6cf-4ae4-b066-70d91f09c148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:51.769583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e476b-e6cf-4ae4-b066-70d91f09c148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:51.769883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e476b-e6cf-4ae4-b066-70d91f09c148 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:51.770235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e476b-e6cf-4ae4-b066-70d91f09c148 admin admin] PATH_INFO: `/v3/users/6ca33f1148a04779aefd7b6315c8c66f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:51.772197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e476b-e6cf-4ae4-b066-70d91f09c148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca33f1148a04779aefd7b6315c8c66f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:51.775685 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1100/2179] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:51.778243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e476b-e6cf-4ae4-b066-70d91f09c148 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:51.800109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9835d3-ab8c-4a07-a65b-3e8dcc149775 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:51.802150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0f9835d3-ab8c-4a07-a65b-3e8dcc149775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:51.860308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-583e476b-e6cf-4ae4-b066-70d91f09c148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca33f1148a04779aefd7b6315c8c66f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:51.871901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-583e476b-e6cf-4ae4-b066-70d91f09c148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca33f1148a04779aefd7b6315c8c66f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:51.887201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-583e476b-e6cf-4ae4-b066-70d91f09c148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca33f1148a04779aefd7b6315c8c66f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:51.888093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-583e476b-e6cf-4ae4-b066-70d91f09c148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca33f1148a04779aefd7b6315c8c66f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:51.903031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-583e476b-e6cf-4ae4-b066-70d91f09c148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca33f1148a04779aefd7b6315c8c66f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:51.913604 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1080/2180] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:51 2021] DELETE /identity/v3/users/6ca33f1148a04779aefd7b6315c8c66f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:51.939703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9835d3-ab8c-4a07-a65b-3e8dcc149775 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:52.038455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5062e0-e63c-4d45-a680-ccb35f350e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:52.039331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5062e0-e63c-4d45-a680-ccb35f350e43 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:52.039731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5062e0-e63c-4d45-a680-ccb35f350e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:52.040005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5062e0-e63c-4d45-a680-ccb35f350e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:52.050782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4d5062e0-e63c-4d45-a680-ccb35f350e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:52.282851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5062e0-e63c-4d45-a680-ccb35f350e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:52.290669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5062e0-e63c-4d45-a680-ccb35f350e43 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:52.318770 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1101/2181] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:47:53.874033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e476b-e6cf-4ae4-b066-70d91f09c148 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:53.876360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-583e476b-e6cf-4ae4-b066-70d91f09c148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:53.904462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e476b-e6cf-4ae4-b066-70d91f09c148 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:53.914474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c344a-c98a-486e-8749-0c06f7ff9479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:53.917073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c344a-c98a-486e-8749-0c06f7ff9479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:53.918998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c344a-c98a-486e-8749-0c06f7ff9479 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:53.919356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c344a-c98a-486e-8749-0c06f7ff9479 admin admin] PATH_INFO: `/v3/projects/fd46334a58394a98a92a0d9dbcfcfe59` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:53.920898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c344a-c98a-486e-8749-0c06f7ff9479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd46334a58394a98a92a0d9dbcfcfe59)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:53.928693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c344a-c98a-486e-8749-0c06f7ff9479 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:54.047342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-781c344a-c98a-486e-8749-0c06f7ff9479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd46334a58394a98a92a0d9dbcfcfe59', 'request_id': 'req-781c344a-c98a-486e-8749-0c06f7ff9479'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:54.061030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-781c344a-c98a-486e-8749-0c06f7ff9479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd46334a58394a98a92a0d9dbcfcfe59', 'request_id': 'req-781c344a-c98a-486e-8749-0c06f7ff9479'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:54.075883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-781c344a-c98a-486e-8749-0c06f7ff9479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd46334a58394a98a92a0d9dbcfcfe59', 'request_id': 'req-781c344a-c98a-486e-8749-0c06f7ff9479'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:54.104561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-781c344a-c98a-486e-8749-0c06f7ff9479 admin admin] The token cache is being invalidate because project fd46334a58394a98a92a0d9dbcfcfe59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:54.104943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-781c344a-c98a-486e-8749-0c06f7ff9479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:54.105483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-781c344a-c98a-486e-8749-0c06f7ff9479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:54.110616 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1081/2182] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:53 2021] DELETE /identity/v3/projects/fd46334a58394a98a92a0d9dbcfcfe59 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:54.111418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5062e0-e63c-4d45-a680-ccb35f350e43 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:54.130471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5062e0-e63c-4d45-a680-ccb35f350e43 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:54.325835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3c7d3-21eb-43c8-80f9-794e3a9bf0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:54.331037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3c7d3-21eb-43c8-80f9-794e3a9bf0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:54.331539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3c7d3-21eb-43c8-80f9-794e3a9bf0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:54.331927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3c7d3-21eb-43c8-80f9-794e3a9bf0e7 admin admin] PATH_INFO: `/v3/users/0ffa6d8593f44030b4eb450653cc32a0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:54.335256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3c7d3-21eb-43c8-80f9-794e3a9bf0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ffa6d8593f44030b4eb450653cc32a0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:54.337348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3c7d3-21eb-43c8-80f9-794e3a9bf0e7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:54.438512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-83f3c7d3-21eb-43c8-80f9-794e3a9bf0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ffa6d8593f44030b4eb450653cc32a0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:54.452155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-83f3c7d3-21eb-43c8-80f9-794e3a9bf0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ffa6d8593f44030b4eb450653cc32a0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:54.453535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-83f3c7d3-21eb-43c8-80f9-794e3a9bf0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ffa6d8593f44030b4eb450653cc32a0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:54.478523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-83f3c7d3-21eb-43c8-80f9-794e3a9bf0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ffa6d8593f44030b4eb450653cc32a0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:54.507157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-83f3c7d3-21eb-43c8-80f9-794e3a9bf0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ffa6d8593f44030b4eb450653cc32a0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:54.525990 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1102/2183] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:54 2021] DELETE /identity/v3/users/0ffa6d8593f44030b4eb450653cc32a0 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:54.875192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c344a-c98a-486e-8749-0c06f7ff9479 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:54.876619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-781c344a-c98a-486e-8749-0c06f7ff9479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:54.906328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c344a-c98a-486e-8749-0c06f7ff9479 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:55.059102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c424757-4690-4748-a229-a43c67a99467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:55.061999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c424757-4690-4748-a229-a43c67a99467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:55.062514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c424757-4690-4748-a229-a43c67a99467 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:55.062966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c424757-4690-4748-a229-a43c67a99467 admin admin] PATH_INFO: `/v3/users/b9e4893e5d944bce9da0588758509af4` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:55.067173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c424757-4690-4748-a229-a43c67a99467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e4893e5d944bce9da0588758509af4)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:55.069895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c424757-4690-4748-a229-a43c67a99467 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:55.173610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6c424757-4690-4748-a229-a43c67a99467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e4893e5d944bce9da0588758509af4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:55.193366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6c424757-4690-4748-a229-a43c67a99467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e4893e5d944bce9da0588758509af4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:55.231056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6c424757-4690-4748-a229-a43c67a99467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e4893e5d944bce9da0588758509af4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:55.233449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6c424757-4690-4748-a229-a43c67a99467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e4893e5d944bce9da0588758509af4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:55.255309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6c424757-4690-4748-a229-a43c67a99467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e4893e5d944bce9da0588758509af4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:55.265488 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1082/2184] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:54 2021] DELETE /identity/v3/users/b9e4893e5d944bce9da0588758509af4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:55.269861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de57a2c-e7a6-4006-ba8c-97c2cb975e8c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:55.270412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de57a2c-e7a6-4006-ba8c-97c2cb975e8c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:55.270697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de57a2c-e7a6-4006-ba8c-97c2cb975e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:55.302036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c424757-4690-4748-a229-a43c67a99467 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:55.304244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6c424757-4690-4748-a229-a43c67a99467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:55.322804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3de57a2c-e7a6-4006-ba8c-97c2cb975e8c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:55.324034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3de57a2c-e7a6-4006-ba8c-97c2cb975e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:55.499604 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1103/2185] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:55.540932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c424757-4690-4748-a229-a43c67a99467 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:55.547980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de57a2c-e7a6-4006-ba8c-97c2cb975e8c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:55.549412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3de57a2c-e7a6-4006-ba8c-97c2cb975e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:55.555688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e047c2-b738-418c-8cdd-a747c90f8e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:55.557835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e047c2-b738-418c-8cdd-a747c90f8e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:55.559434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e047c2-b738-418c-8cdd-a747c90f8e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:55.559842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e047c2-b738-418c-8cdd-a747c90f8e06 admin admin] PATH_INFO: `/v3/projects/c140ea4d18ca492086b1d65b30864d5c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:55.564738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e047c2-b738-418c-8cdd-a747c90f8e06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c140ea4d18ca492086b1d65b30864d5c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:55.567815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e047c2-b738-418c-8cdd-a747c90f8e06 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:55.703763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de57a2c-e7a6-4006-ba8c-97c2cb975e8c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:55.714711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45e047c2-b738-418c-8cdd-a747c90f8e06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c140ea4d18ca492086b1d65b30864d5c', 'request_id': 'req-45e047c2-b738-418c-8cdd-a747c90f8e06'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:55.742626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45e047c2-b738-418c-8cdd-a747c90f8e06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c140ea4d18ca492086b1d65b30864d5c', 'request_id': 'req-45e047c2-b738-418c-8cdd-a747c90f8e06'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:55.764607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45e047c2-b738-418c-8cdd-a747c90f8e06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c140ea4d18ca492086b1d65b30864d5c', 'request_id': 'req-45e047c2-b738-418c-8cdd-a747c90f8e06'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:55.774800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4e658-b32d-4daf-ac3f-26f8e51d4de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:55.775598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4e658-b32d-4daf-ac3f-26f8e51d4de0 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:55.775792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4e658-b32d-4daf-ac3f-26f8e51d4de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:55.776077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4e658-b32d-4daf-ac3f-26f8e51d4de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:55.789959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45e047c2-b738-418c-8cdd-a747c90f8e06 admin admin] The token cache is being invalidate because project c140ea4d18ca492086b1d65b30864d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:55.789959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45e047c2-b738-418c-8cdd-a747c90f8e06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:55.799892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45e047c2-b738-418c-8cdd-a747c90f8e06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:55.811088 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1083/2186] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:55 2021] DELETE /identity/v3/projects/c140ea4d18ca492086b1d65b30864d5c => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:55.816467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcb20d-b49c-4cfb-8fc6-1cb6e7c86d83 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:55.817903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcb20d-b49c-4cfb-8fc6-1cb6e7c86d83 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:55.818759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcb20d-b49c-4cfb-8fc6-1cb6e7c86d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:55.855253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b3bcb20d-b49c-4cfb-8fc6-1cb6e7c86d83 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:55.856961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b3bcb20d-b49c-4cfb-8fc6-1cb6e7c86d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:55.902918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4e658-b32d-4daf-ac3f-26f8e51d4de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:55.904363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4e658-b32d-4daf-ac3f-26f8e51d4de0 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:55.931995 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1104/2187] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:47:55.953075 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1084/2188] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:55.953893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff838137-e092-4e1b-b1f4-d08d83b18103 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:55.954096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff838137-e092-4e1b-b1f4-d08d83b18103 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:55.954411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff838137-e092-4e1b-b1f4-d08d83b18103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:55.988680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ff838137-e092-4e1b-b1f4-d08d83b18103 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:55.989716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ff838137-e092-4e1b-b1f4-d08d83b18103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:56.012126 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1105/2189] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:56.019252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcb20d-b49c-4cfb-8fc6-1cb6e7c86d83 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:56.033193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcb20d-b49c-4cfb-8fc6-1cb6e7c86d83 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:56.056035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401e1a1-648f-467a-bd56-60e4a7e205d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:56.060313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401e1a1-648f-467a-bd56-60e4a7e205d9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:56.061997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401e1a1-648f-467a-bd56-60e4a7e205d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:56.063288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401e1a1-648f-467a-bd56-60e4a7e205d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:56.066135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401e1a1-648f-467a-bd56-60e4a7e205d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:47:56.067521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401e1a1-648f-467a-bd56-60e4a7e205d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:56.072710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401e1a1-648f-467a-bd56-60e4a7e205d9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:56.125856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff838137-e092-4e1b-b1f4-d08d83b18103 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:56.127297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ff838137-e092-4e1b-b1f4-d08d83b18103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:56.139680 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1085/2190] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:47:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:47:56.141131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401e1a1-648f-467a-bd56-60e4a7e205d9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:56.144517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff838137-e092-4e1b-b1f4-d08d83b18103 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:56.172043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879da732-691b-4375-a649-eb164c43182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:56.172912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879da732-691b-4375-a649-eb164c43182c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:56.173190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879da732-691b-4375-a649-eb164c43182c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:56.173469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879da732-691b-4375-a649-eb164c43182c admin admin] PATH_INFO: `/v3/projects/518803ba297043b9bab4a6bf6f6e254c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:56.182488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401e1a1-648f-467a-bd56-60e4a7e205d9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:56.184046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879da732-691b-4375-a649-eb164c43182c admin admin] RBAC: Authorizing `identity:delete_project(project_id=518803ba297043b9bab4a6bf6f6e254c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:56.190906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879da732-691b-4375-a649-eb164c43182c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:56.212259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b92b5b-f100-45ea-a60d-579ee563d6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:56.212816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b92b5b-f100-45ea-a60d-579ee563d6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:56.213687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b92b5b-f100-45ea-a60d-579ee563d6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:56.213687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b92b5b-f100-45ea-a60d-579ee563d6e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:56.214061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b92b5b-f100-45ea-a60d-579ee563d6e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:56.216000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b92b5b-f100-45ea-a60d-579ee563d6e4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:56.316807 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1086/2191] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:56 2021] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:56.326609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b92b5b-f100-45ea-a60d-579ee563d6e4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:56.382380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-879da732-691b-4375-a649-eb164c43182c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '518803ba297043b9bab4a6bf6f6e254c', 'request_id': 'req-879da732-691b-4375-a649-eb164c43182c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:56.415057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-879da732-691b-4375-a649-eb164c43182c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '518803ba297043b9bab4a6bf6f6e254c', 'request_id': 'req-879da732-691b-4375-a649-eb164c43182c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:56.436860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-879da732-691b-4375-a649-eb164c43182c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '518803ba297043b9bab4a6bf6f6e254c', 'request_id': 'req-879da732-691b-4375-a649-eb164c43182c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:56.470609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-879da732-691b-4375-a649-eb164c43182c admin admin] The token cache is being invalidate because project 518803ba297043b9bab4a6bf6f6e254c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:56.470933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-879da732-691b-4375-a649-eb164c43182c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:56.471929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-879da732-691b-4375-a649-eb164c43182c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:56.473882 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1106/2192] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:56 2021] DELETE /identity/v3/projects/518803ba297043b9bab4a6bf6f6e254c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:47:56.480108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24179ed-f5af-48ae-8ece-4cf5caca9d85 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:56.481415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24179ed-f5af-48ae-8ece-4cf5caca9d85 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:56.481708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24179ed-f5af-48ae-8ece-4cf5caca9d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:56.535558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e24179ed-f5af-48ae-8ece-4cf5caca9d85 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:56.540335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e24179ed-f5af-48ae-8ece-4cf5caca9d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:56.563134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b92b5b-f100-45ea-a60d-579ee563d6e4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:56.747755 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1107/2193] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:56.764747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a77f7-7fcb-4a26-bc6d-bf49843c6747 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:56.765036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a77f7-7fcb-4a26-bc6d-bf49843c6747 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:56.765305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a77f7-7fcb-4a26-bc6d-bf49843c6747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:56.815030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70a3a7-1009-4914-af2b-d1889490d129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:56.815719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70a3a7-1009-4914-af2b-d1889490d129 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:56.815999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70a3a7-1009-4914-af2b-d1889490d129 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:56.816279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70a3a7-1009-4914-af2b-d1889490d129 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:56.816984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70a3a7-1009-4914-af2b-d1889490d129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:56.839288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70a3a7-1009-4914-af2b-d1889490d129 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:56.868272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4b7a77f7-7fcb-4a26-bc6d-bf49843c6747 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:56.869415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4b7a77f7-7fcb-4a26-bc6d-bf49843c6747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:56.895617 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1087/2194] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:56 2021] POST /identity/v3/users => generated 287 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:56.898816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70a3a7-1009-4914-af2b-d1889490d129 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:56.902160 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1108/2195] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:56.904695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6e70a3a7-1009-4914-af2b-d1889490d129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:56.908606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a77f7-7fcb-4a26-bc6d-bf49843c6747 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:56.930125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a77f7-7fcb-4a26-bc6d-bf49843c6747 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:56.942904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1dbc4-60ab-41be-93a6-45a74692ffbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:56.944373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1dbc4-60ab-41be-93a6-45a74692ffbf admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:56.944661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1dbc4-60ab-41be-93a6-45a74692ffbf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:56.944938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1dbc4-60ab-41be-93a6-45a74692ffbf admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:56.945693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1dbc4-60ab-41be-93a6-45a74692ffbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:47:56.946011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1dbc4-60ab-41be-93a6-45a74692ffbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:56.947829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1dbc4-60ab-41be-93a6-45a74692ffbf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:56.948369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70a3a7-1009-4914-af2b-d1889490d129 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:56.957573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206257f5-4203-4aa3-a6a7-362ef60cb709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:56.958301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206257f5-4203-4aa3-a6a7-362ef60cb709 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:56.960494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206257f5-4203-4aa3-a6a7-362ef60cb709 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:56.960959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206257f5-4203-4aa3-a6a7-362ef60cb709 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:56.961744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206257f5-4203-4aa3-a6a7-362ef60cb709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:56.963642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206257f5-4203-4aa3-a6a7-362ef60cb709 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:56.964515 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1109/2196] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:47:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:47:56.967129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1dbc4-60ab-41be-93a6-45a74692ffbf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:56.985566 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1088/2197] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:56 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:56.988433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1dbc4-60ab-41be-93a6-45a74692ffbf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:56.989847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206257f5-4203-4aa3-a6a7-362ef60cb709 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:57.003764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff0da1-751e-4d0d-8e35-662c0e96beb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:57.004288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff0da1-751e-4d0d-8e35-662c0e96beb8 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:57.008043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff0da1-751e-4d0d-8e35-662c0e96beb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:57.008247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff0da1-751e-4d0d-8e35-662c0e96beb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:57.008884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff0da1-751e-4d0d-8e35-662c0e96beb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:57.010867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff0da1-751e-4d0d-8e35-662c0e96beb8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:57.019669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206257f5-4203-4aa3-a6a7-362ef60cb709 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:57.036999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65293b-a3ae-4219-a02f-490cb1cc4b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:57.036999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65293b-a3ae-4219-a02f-490cb1cc4b2e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:57.038730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65293b-a3ae-4219-a02f-490cb1cc4b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:57.039270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65293b-a3ae-4219-a02f-490cb1cc4b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:57.043266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65293b-a3ae-4219-a02f-490cb1cc4b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:57.044901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65293b-a3ae-4219-a02f-490cb1cc4b2e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:57.070177 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1089/2198] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:56 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:57.074141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65293b-a3ae-4219-a02f-490cb1cc4b2e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:57.089201 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1110/2199] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:56 2021] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:47:57.095064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff0da1-751e-4d0d-8e35-662c0e96beb8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:57.096099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65293b-a3ae-4219-a02f-490cb1cc4b2e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:57.199096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc2b4d-e926-4c97-bee8-6aea79679508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:57.200155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc2b4d-e926-4c97-bee8-6aea79679508 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:57.200447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc2b4d-e926-4c97-bee8-6aea79679508 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:57.200731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc2b4d-e926-4c97-bee8-6aea79679508 admin admin] PATH_INFO: `/v3/projects/7b7865c095884cf6afc93e3dd2d19259/users/76a2e67a2f1740b898dcc7d71f8de89c/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:57.218243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff0da1-751e-4d0d-8e35-662c0e96beb8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:57.221724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc2b4d-e926-4c97-bee8-6aea79679508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7865c095884cf6afc93e3dd2d19259, user_id=76a2e67a2f1740b898dcc7d71f8de89c, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:57.225133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc2b4d-e926-4c97-bee8-6aea79679508 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:57.231566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8e1bd-86e8-4a89-a4bb-a8ac80c71e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:57.232261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e1bd-86e8-4a89-a4bb-a8ac80c71e16 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:57.232727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e1bd-86e8-4a89-a4bb-a8ac80c71e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:57.233000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e1bd-86e8-4a89-a4bb-a8ac80c71e16 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:57.233867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8e1bd-86e8-4a89-a4bb-a8ac80c71e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:57.236099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8e1bd-86e8-4a89-a4bb-a8ac80c71e16 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:57.261081 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1090/2200] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:57 2021] PUT /identity/v3/projects/7b7865c095884cf6afc93e3dd2d19259/users/76a2e67a2f1740b898dcc7d71f8de89c/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:47:57.264837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a67565-3dd3-4441-a919-c0fe84f564b1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:57.265175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a67565-3dd3-4441-a919-c0fe84f564b1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:57.265412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a67565-3dd3-4441-a919-c0fe84f564b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:57.280854 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1111/2201] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:57 2021] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:57.285162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8e1bd-86e8-4a89-a4bb-a8ac80c71e16 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:57.303879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-15a67565-3dd3-4441-a919-c0fe84f564b1 None None] MFA Rules not processed for user `76a2e67a2f1740b898dcc7d71f8de89c`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:57.305359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-15a67565-3dd3-4441-a919-c0fe84f564b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:57.306860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8e1bd-86e8-4a89-a4bb-a8ac80c71e16 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:57.382659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10701916-c3e5-475a-a004-fa928c448e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:57.384170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10701916-c3e5-475a-a004-fa928c448e91 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:57.384649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10701916-c3e5-475a-a004-fa928c448e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:57.385118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10701916-c3e5-475a-a004-fa928c448e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:57.386061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10701916-c3e5-475a-a004-fa928c448e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:57.387914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10701916-c3e5-475a-a004-fa928c448e91 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:57.403738 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1112/2202] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:57 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:47:57.408324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10701916-c3e5-475a-a004-fa928c448e91 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:57.413879 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1091/2203] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:57 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:57.420016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a67565-3dd3-4441-a919-c0fe84f564b1 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:57.420771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10701916-c3e5-475a-a004-fa928c448e91 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:57.426110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45d8ef-bc25-49b8-9185-d9ad328bedae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:57.427128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45d8ef-bc25-49b8-9185-d9ad328bedae admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:57.427458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45d8ef-bc25-49b8-9185-d9ad328bedae admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:57.428449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45d8ef-bc25-49b8-9185-d9ad328bedae admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:57.435926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a67565-3dd3-4441-a919-c0fe84f564b1 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:57.441658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45d8ef-bc25-49b8-9185-d9ad328bedae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:57.446472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308eb6d-bbf3-4279-ac22-4ce4da344e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:57.446957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45d8ef-bc25-49b8-9185-d9ad328bedae admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:57.447729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308eb6d-bbf3-4279-ac22-4ce4da344e6d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:57.448023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308eb6d-bbf3-4279-ac22-4ce4da344e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:57.448303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308eb6d-bbf3-4279-ac22-4ce4da344e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:57.449235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308eb6d-bbf3-4279-ac22-4ce4da344e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:57.451440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308eb6d-bbf3-4279-ac22-4ce4da344e6d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:57.464743 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1113/2204] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:57 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:47:57.470538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45d8ef-bc25-49b8-9185-d9ad328bedae admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:57.484496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45d8ef-bc25-49b8-9185-d9ad328bedae admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:57.491779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c97e5-c7ce-4ab0-8ba0-d0b5d08a54f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:57.492958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c97e5-c7ce-4ab0-8ba0-d0b5d08a54f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:57.493395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c97e5-c7ce-4ab0-8ba0-d0b5d08a54f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:57.493972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c97e5-c7ce-4ab0-8ba0-d0b5d08a54f2 admin admin] PATH_INFO: `/v3/projects/72ac362813424dc0bbfad71db25ffb7f/users/afe8c6d9e3394799a65b4accad98d76a/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:57.516126 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1092/2205] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:57 2021] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:57.520948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308eb6d-bbf3-4279-ac22-4ce4da344e6d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:57.543483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c97e5-c7ce-4ab0-8ba0-d0b5d08a54f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ac362813424dc0bbfad71db25ffb7f, user_id=afe8c6d9e3394799a65b4accad98d76a, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:57.549846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c97e5-c7ce-4ab0-8ba0-d0b5d08a54f2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:57.580788 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1114/2206] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:57 2021] PUT /identity/v3/projects/72ac362813424dc0bbfad71db25ffb7f/users/afe8c6d9e3394799a65b4accad98d76a/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:47:57.593595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f80d7-b6ba-476d-b41c-c62e6a8494b2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:57.594120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f80d7-b6ba-476d-b41c-c62e6a8494b2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:57.594736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f80d7-b6ba-476d-b41c-c62e6a8494b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:57.676485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308eb6d-bbf3-4279-ac22-4ce4da344e6d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:57.697921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-690f80d7-b6ba-476d-b41c-c62e6a8494b2 None None] MFA Rules not processed for user `afe8c6d9e3394799a65b4accad98d76a`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:57.700574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-690f80d7-b6ba-476d-b41c-c62e6a8494b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:57.836306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cd660-1e7d-42c2-a1d0-d1922bba5ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:57.837191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cd660-1e7d-42c2-a1d0-d1922bba5ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:57.837472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cd660-1e7d-42c2-a1d0-d1922bba5ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:57.837809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cd660-1e7d-42c2-a1d0-d1922bba5ee4 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:57.838730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cd660-1e7d-42c2-a1d0-d1922bba5ee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:57.848393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cd660-1e7d-42c2-a1d0-d1922bba5ee4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:57.857190 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1115/2207] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:57 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:47:57.863329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f80d7-b6ba-476d-b41c-c62e6a8494b2 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:57.885512 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1093/2208] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:57 2021] POST /identity/v3/users => generated 294 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:57.889734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cd660-1e7d-42c2-a1d0-d1922bba5ee4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:57.891996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f80d7-b6ba-476d-b41c-c62e6a8494b2 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:57.906062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cd660-1e7d-42c2-a1d0-d1922bba5ee4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:57.907005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2763c-e695-4f05-a245-5a3da02d433b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:57.907742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2763c-e695-4f05-a245-5a3da02d433b admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:57.908030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2763c-e695-4f05-a245-5a3da02d433b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:57.908445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2763c-e695-4f05-a245-5a3da02d433b admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:57.909352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2763c-e695-4f05-a245-5a3da02d433b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:57.911574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2763c-e695-4f05-a245-5a3da02d433b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:57.936706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1456ab0-809c-4851-9233-c716512ee67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:57.937811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1456ab0-809c-4851-9233-c716512ee67d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:57.938426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1456ab0-809c-4851-9233-c716512ee67d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:57.938979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1456ab0-809c-4851-9233-c716512ee67d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:57.940136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1456ab0-809c-4851-9233-c716512ee67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:57.945337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1456ab0-809c-4851-9233-c716512ee67d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:57.949355 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1116/2209] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:47:57 2021] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:47:57.953208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2763c-e695-4f05-a245-5a3da02d433b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:57.964302 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1094/2210] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:57 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:57.968099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1456ab0-809c-4851-9233-c716512ee67d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:57.981143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1456ab0-809c-4851-9233-c716512ee67d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:58.049423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2763c-e695-4f05-a245-5a3da02d433b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:58.055954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea10b50-1d82-4352-b976-fcde47dd959f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:58.056739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea10b50-1d82-4352-b976-fcde47dd959f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:58.057225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea10b50-1d82-4352-b976-fcde47dd959f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:58.057798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea10b50-1d82-4352-b976-fcde47dd959f admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:58.058818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea10b50-1d82-4352-b976-fcde47dd959f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:58.061502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea10b50-1d82-4352-b976-fcde47dd959f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:58.073281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd877016-37e5-4366-9228-8ed2bfcde7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:58.074389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd877016-37e5-4366-9228-8ed2bfcde7e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:58.074517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd877016-37e5-4366-9228-8ed2bfcde7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:58.074776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd877016-37e5-4366-9228-8ed2bfcde7e2 admin admin] PATH_INFO: `/v3/projects/197ef4d87a3646d4a156c5a036c93adb/users/64340fc0066a484ea24c57b1c037e34c/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:58.092759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd877016-37e5-4366-9228-8ed2bfcde7e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=197ef4d87a3646d4a156c5a036c93adb, user_id=64340fc0066a484ea24c57b1c037e34c, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:58.094303 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1117/2211] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:47:57 2021] POST /identity/v3/users => generated 300 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:47:58.095619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd877016-37e5-4366-9228-8ed2bfcde7e2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:58.102355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea10b50-1d82-4352-b976-fcde47dd959f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:58.115079 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1095/2212] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:57 2021] PUT /identity/v3/projects/197ef4d87a3646d4a156c5a036c93adb/users/64340fc0066a484ea24c57b1c037e34c/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:58.119014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd877016-37e5-4366-9228-8ed2bfcde7e2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:58.120081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea10b50-1d82-4352-b976-fcde47dd959f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:58.229132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd877016-37e5-4366-9228-8ed2bfcde7e2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:58.237267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196294ab-24e2-41e7-bf9f-0b77a749e6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:58.237955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196294ab-24e2-41e7-bf9f-0b77a749e6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:58.238241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196294ab-24e2-41e7-bf9f-0b77a749e6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:58.238548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196294ab-24e2-41e7-bf9f-0b77a749e6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:58.239297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196294ab-24e2-41e7-bf9f-0b77a749e6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:58.241658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196294ab-24e2-41e7-bf9f-0b77a749e6c2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:58.245848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6b1f9-21d0-4ec4-9410-fd45a4364ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:58.246573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6b1f9-21d0-4ec4-9410-fd45a4364ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:58.246856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6b1f9-21d0-4ec4-9410-fd45a4364ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:58.247134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6b1f9-21d0-4ec4-9410-fd45a4364ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:58.247888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6b1f9-21d0-4ec4-9410-fd45a4364ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:58.249602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6b1f9-21d0-4ec4-9410-fd45a4364ad9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:58.270908 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1096/2213] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:58 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:47:58.272097 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1118/2214] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:58 2021] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:58.272680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6b1f9-21d0-4ec4-9410-fd45a4364ad9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:58.273019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196294ab-24e2-41e7-bf9f-0b77a749e6c2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:58.283805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196294ab-24e2-41e7-bf9f-0b77a749e6c2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:58.291196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6b1f9-21d0-4ec4-9410-fd45a4364ad9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:58.291382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bb25f-ff9c-4b0f-82b7-4acf90305069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:58.292345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bb25f-ff9c-4b0f-82b7-4acf90305069 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:58.292639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bb25f-ff9c-4b0f-82b7-4acf90305069 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:58.292924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bb25f-ff9c-4b0f-82b7-4acf90305069 admin admin] PATH_INFO: `/v3/projects/197ef4d87a3646d4a156c5a036c93adb/users/64340fc0066a484ea24c57b1c037e34c/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:58.298621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b382f4b-c713-4ed9-8b0a-b2c83ae55ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:58.299494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b382f4b-c713-4ed9-8b0a-b2c83ae55ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:58.299871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b382f4b-c713-4ed9-8b0a-b2c83ae55ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:58.300205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b382f4b-c713-4ed9-8b0a-b2c83ae55ac3 admin admin] PATH_INFO: `/v3/projects/6b1cffe364174f36b159963293f7014e/users/9f528e62e8e347928f5082b0fc19daa6/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:58.300311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bb25f-ff9c-4b0f-82b7-4acf90305069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=197ef4d87a3646d4a156c5a036c93adb, user_id=64340fc0066a484ea24c57b1c037e34c, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:58.303216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bb25f-ff9c-4b0f-82b7-4acf90305069 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:58.328408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b382f4b-c713-4ed9-8b0a-b2c83ae55ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1cffe364174f36b159963293f7014e, user_id=9f528e62e8e347928f5082b0fc19daa6, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:58.331796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b382f4b-c713-4ed9-8b0a-b2c83ae55ac3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:58.338313 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1119/2215] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:58 2021] PUT /identity/v3/projects/197ef4d87a3646d4a156c5a036c93adb/users/64340fc0066a484ea24c57b1c037e34c/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:58.345934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953def9c-a809-4b91-9abb-badc132cbbab None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:58.346418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953def9c-a809-4b91-9abb-badc132cbbab None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:58.346915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953def9c-a809-4b91-9abb-badc132cbbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:58.378810 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1097/2216] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:58 2021] PUT /identity/v3/projects/6b1cffe364174f36b159963293f7014e/users/9f528e62e8e347928f5082b0fc19daa6/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:58.379797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b382f4b-c713-4ed9-8b0a-b2c83ae55ac3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:58.391737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-953def9c-a809-4b91-9abb-badc132cbbab None None] MFA Rules not processed for user `64340fc0066a484ea24c57b1c037e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:58.394147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-953def9c-a809-4b91-9abb-badc132cbbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:58.536469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b382f4b-c713-4ed9-8b0a-b2c83ae55ac3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:58.551511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ab42d-eb11-4703-bf89-1a35f0ea9f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:58.552250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ab42d-eb11-4703-bf89-1a35f0ea9f31 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:58.552493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ab42d-eb11-4703-bf89-1a35f0ea9f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:58.554584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ab42d-eb11-4703-bf89-1a35f0ea9f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:58.554584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ab42d-eb11-4703-bf89-1a35f0ea9f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:58.558709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ab42d-eb11-4703-bf89-1a35f0ea9f31 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:58.578679 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1098/2217] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:47:58 2021] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:47:58.579720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ab42d-eb11-4703-bf89-1a35f0ea9f31 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:58.593153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ab42d-eb11-4703-bf89-1a35f0ea9f31 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:58.611727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10941d59-1dcc-4d55-b7f5-e4c2b53ba144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:58.612675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10941d59-1dcc-4d55-b7f5-e4c2b53ba144 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:58.612963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10941d59-1dcc-4d55-b7f5-e4c2b53ba144 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:58.613246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10941d59-1dcc-4d55-b7f5-e4c2b53ba144 admin admin] PATH_INFO: `/v3/projects/6b1cffe364174f36b159963293f7014e/users/9f528e62e8e347928f5082b0fc19daa6/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:58.617612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10941d59-1dcc-4d55-b7f5-e4c2b53ba144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1cffe364174f36b159963293f7014e, user_id=9f528e62e8e347928f5082b0fc19daa6, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:58.621706 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1120/2218] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:58 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:58.622075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10941d59-1dcc-4d55-b7f5-e4c2b53ba144 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:58.652718 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1099/2219] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:47:58 2021] PUT /identity/v3/projects/6b1cffe364174f36b159963293f7014e/users/9f528e62e8e347928f5082b0fc19daa6/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:58.663287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5722d4-aad9-4bb8-92c5-a56b3bb6fa85 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:58.663788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5722d4-aad9-4bb8-92c5-a56b3bb6fa85 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:58.664363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5722d4-aad9-4bb8-92c5-a56b3bb6fa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:58.706244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6a5722d4-aad9-4bb8-92c5-a56b3bb6fa85 None None] MFA Rules not processed for user `9f528e62e8e347928f5082b0fc19daa6`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:47:58.707503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6a5722d4-aad9-4bb8-92c5-a56b3bb6fa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:58.813653 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1121/2220] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:47:58 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:47:59.088961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10941d59-1dcc-4d55-b7f5-e4c2b53ba144 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:59.090689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-10941d59-1dcc-4d55-b7f5-e4c2b53ba144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:59.156225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10941d59-1dcc-4d55-b7f5-e4c2b53ba144 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:59.161151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16369c5b-ce90-4279-af9b-c4e91bfd39a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:59.162606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16369c5b-ce90-4279-af9b-c4e91bfd39a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:59.162922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16369c5b-ce90-4279-af9b-c4e91bfd39a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:59.163206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16369c5b-ce90-4279-af9b-c4e91bfd39a0 admin admin] PATH_INFO: `/v3/projects/1c1f758740e442a0829910680148236b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:59.164563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16369c5b-ce90-4279-af9b-c4e91bfd39a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1f758740e442a0829910680148236b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:59.166858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16369c5b-ce90-4279-af9b-c4e91bfd39a0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:59.222569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-16369c5b-ce90-4279-af9b-c4e91bfd39a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1f758740e442a0829910680148236b', 'request_id': 'req-16369c5b-ce90-4279-af9b-c4e91bfd39a0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:59.229791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-16369c5b-ce90-4279-af9b-c4e91bfd39a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1f758740e442a0829910680148236b', 'request_id': 'req-16369c5b-ce90-4279-af9b-c4e91bfd39a0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:59.237822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-16369c5b-ce90-4279-af9b-c4e91bfd39a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1f758740e442a0829910680148236b', 'request_id': 'req-16369c5b-ce90-4279-af9b-c4e91bfd39a0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:59.256845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-16369c5b-ce90-4279-af9b-c4e91bfd39a0 admin admin] The token cache is being invalidate because project 1c1f758740e442a0829910680148236b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:47:59.257135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-16369c5b-ce90-4279-af9b-c4e91bfd39a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:59.258019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-16369c5b-ce90-4279-af9b-c4e91bfd39a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:59.263177 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1100/2221] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:47:59 2021] DELETE /identity/v3/projects/1c1f758740e442a0829910680148236b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:47:59.263988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5722d4-aad9-4bb8-92c5-a56b3bb6fa85 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:59.279313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5722d4-aad9-4bb8-92c5-a56b3bb6fa85 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:59.342384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16369c5b-ce90-4279-af9b-c4e91bfd39a0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:59.344272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-16369c5b-ce90-4279-af9b-c4e91bfd39a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:59.351901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2942c24-7186-44e4-982a-165029633b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:59.353520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2942c24-7186-44e4-982a-165029633b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:59.353809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2942c24-7186-44e4-982a-165029633b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:59.354341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2942c24-7186-44e4-982a-165029633b07 admin admin] PATH_INFO: `/v3/users/f0cd779b29434fe69771becab092ee2d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:59.355666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2942c24-7186-44e4-982a-165029633b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0cd779b29434fe69771becab092ee2d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:59.357804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2942c24-7186-44e4-982a-165029633b07 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:59.418782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f2942c24-7186-44e4-982a-165029633b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0cd779b29434fe69771becab092ee2d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:59.425760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f2942c24-7186-44e4-982a-165029633b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0cd779b29434fe69771becab092ee2d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:59.426635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f2942c24-7186-44e4-982a-165029633b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0cd779b29434fe69771becab092ee2d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:59.433145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16369c5b-ce90-4279-af9b-c4e91bfd39a0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:59.440456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce43ac-d99c-4761-9bd7-0eeb8efee8ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:59.441315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce43ac-d99c-4761-9bd7-0eeb8efee8ae service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:59.441482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce43ac-d99c-4761-9bd7-0eeb8efee8ae service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:59.441900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce43ac-d99c-4761-9bd7-0eeb8efee8ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:59.443896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f2942c24-7186-44e4-982a-165029633b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0cd779b29434fe69771becab092ee2d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:59.444627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-81ce43ac-d99c-4761-9bd7-0eeb8efee8ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:59.458726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f2942c24-7186-44e4-982a-165029633b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0cd779b29434fe69771becab092ee2d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:47:59.472409 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1122/2222] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:47:59 2021] DELETE /identity/v3/users/f0cd779b29434fe69771becab092ee2d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:47:59.515183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce43ac-d99c-4761-9bd7-0eeb8efee8ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:59.516767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce43ac-d99c-4761-9bd7-0eeb8efee8ae service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:59.528024 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1101/2223] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:59 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:47:59.569023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2942c24-7186-44e4-982a-165029633b07 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:47:59.570478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f2942c24-7186-44e4-982a-165029633b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:59.648421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2942c24-7186-44e4-982a-165029633b07 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:47:59.654210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b21569-f8a5-4679-b510-7267e0b93d8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:47:59.655026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b21569-f8a5-4679-b510-7267e0b93d8c service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:47:59.655399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b21569-f8a5-4679-b510-7267e0b93d8c service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:47:59.655743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b21569-f8a5-4679-b510-7267e0b93d8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:47:59.657693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d3b21569-f8a5-4679-b510-7267e0b93d8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:47:59.722936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b21569-f8a5-4679-b510-7267e0b93d8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:47:59.724554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b21569-f8a5-4679-b510-7267e0b93d8c service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:47:59.735007 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1123/2224] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:47:59 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:00.090615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce43ac-d99c-4761-9bd7-0eeb8efee8ae service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:00.092770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-81ce43ac-d99c-4761-9bd7-0eeb8efee8ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:00.113821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce43ac-d99c-4761-9bd7-0eeb8efee8ae service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:00.172842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d0a1d-3101-41a8-a073-3aacf18947d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:00.173708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d0a1d-3101-41a8-a073-3aacf18947d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:00.174647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d0a1d-3101-41a8-a073-3aacf18947d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:00.174946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d0a1d-3101-41a8-a073-3aacf18947d4 admin admin] PATH_INFO: `/v3/projects/b2adf91e52aa4917b2b5cea4bc3e0bd3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:00.176234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d0a1d-3101-41a8-a073-3aacf18947d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2adf91e52aa4917b2b5cea4bc3e0bd3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:00.178240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d0a1d-3101-41a8-a073-3aacf18947d4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:00.227551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5a4d0a1d-3101-41a8-a073-3aacf18947d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2adf91e52aa4917b2b5cea4bc3e0bd3', 'request_id': 'req-5a4d0a1d-3101-41a8-a073-3aacf18947d4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:00.233738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5a4d0a1d-3101-41a8-a073-3aacf18947d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2adf91e52aa4917b2b5cea4bc3e0bd3', 'request_id': 'req-5a4d0a1d-3101-41a8-a073-3aacf18947d4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:00.239190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5a4d0a1d-3101-41a8-a073-3aacf18947d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2adf91e52aa4917b2b5cea4bc3e0bd3', 'request_id': 'req-5a4d0a1d-3101-41a8-a073-3aacf18947d4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:00.251751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5a4d0a1d-3101-41a8-a073-3aacf18947d4 admin admin] The token cache is being invalidate because project b2adf91e52aa4917b2b5cea4bc3e0bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:00.252063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5a4d0a1d-3101-41a8-a073-3aacf18947d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:00.252645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5a4d0a1d-3101-41a8-a073-3aacf18947d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:00.254221 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1102/2225] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:00 2021] DELETE /identity/v3/projects/b2adf91e52aa4917b2b5cea4bc3e0bd3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:00.260674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a86da3-aac3-4460-90b9-7696cccf5c00 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:00.261202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a86da3-aac3-4460-90b9-7696cccf5c00 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:00.262066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a86da3-aac3-4460-90b9-7696cccf5c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:00.282985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-85a86da3-aac3-4460-90b9-7696cccf5c00 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:00.283968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-85a86da3-aac3-4460-90b9-7696cccf5c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:00.321678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d0a1d-3101-41a8-a073-3aacf18947d4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:00.323447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5a4d0a1d-3101-41a8-a073-3aacf18947d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:00.348006 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1124/2226] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:00.356789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72b169-6200-4cda-8557-e27d50c72e2f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:00.357166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72b169-6200-4cda-8557-e27d50c72e2f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:00.357759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72b169-6200-4cda-8557-e27d50c72e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:00.392589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5c72b169-6200-4cda-8557-e27d50c72e2f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:00.394276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5c72b169-6200-4cda-8557-e27d50c72e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:00.405974 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1125/2227] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:00.410144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72b169-6200-4cda-8557-e27d50c72e2f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:00.425723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72b169-6200-4cda-8557-e27d50c72e2f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:00.431682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2afe8-7dfb-4c11-a282-41d642cff01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:00.432754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2afe8-7dfb-4c11-a282-41d642cff01c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:00.433220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2afe8-7dfb-4c11-a282-41d642cff01c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:00.433678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2afe8-7dfb-4c11-a282-41d642cff01c admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:00.434805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2afe8-7dfb-4c11-a282-41d642cff01c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:00.435327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2afe8-7dfb-4c11-a282-41d642cff01c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:00.437371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2afe8-7dfb-4c11-a282-41d642cff01c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:00.444678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d0a1d-3101-41a8-a073-3aacf18947d4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:00.453614 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1126/2228] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:00.457883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2afe8-7dfb-4c11-a282-41d642cff01c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:00.460676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde30ee-13d7-417d-b8a6-c62620e67cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:00.460819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde30ee-13d7-417d-b8a6-c62620e67cf2 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:00.461019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde30ee-13d7-417d-b8a6-c62620e67cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:00.461300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde30ee-13d7-417d-b8a6-c62620e67cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:00.463195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6dde30ee-13d7-417d-b8a6-c62620e67cf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:00.475325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2afe8-7dfb-4c11-a282-41d642cff01c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:00.484047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35902f-358a-4db5-9049-c4734401a232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:00.484756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35902f-358a-4db5-9049-c4734401a232 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:00.485018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35902f-358a-4db5-9049-c4734401a232 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:00.488546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35902f-358a-4db5-9049-c4734401a232 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:00.489533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35902f-358a-4db5-9049-c4734401a232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:00.493073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35902f-358a-4db5-9049-c4734401a232 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:00.531858 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1127/2229] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:00 2021] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:48:00.532774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35902f-358a-4db5-9049-c4734401a232 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:00.565428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde30ee-13d7-417d-b8a6-c62620e67cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:00.570655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde30ee-13d7-417d-b8a6-c62620e67cf2 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:00.595342 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1103/2230] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:00 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:00.635226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35902f-358a-4db5-9049-c4734401a232 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:00.641767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100c5eb-6dc1-465c-9878-1f9cc478baee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:00.642577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100c5eb-6dc1-465c-9878-1f9cc478baee admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:00.643007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100c5eb-6dc1-465c-9878-1f9cc478baee admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:00.643370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100c5eb-6dc1-465c-9878-1f9cc478baee admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:00.644924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100c5eb-6dc1-465c-9878-1f9cc478baee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:00.648050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100c5eb-6dc1-465c-9878-1f9cc478baee admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:00.695071 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1128/2231] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:00 2021] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:00.700025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde30ee-13d7-417d-b8a6-c62620e67cf2 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:00.719984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde30ee-13d7-417d-b8a6-c62620e67cf2 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:00.744449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dae908-7c79-4d59-85e1-532eed37933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:00.745190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dae908-7c79-4d59-85e1-532eed37933a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:00.745526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dae908-7c79-4d59-85e1-532eed37933a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:00.745753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dae908-7c79-4d59-85e1-532eed37933a admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:00.746994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dae908-7c79-4d59-85e1-532eed37933a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:00.748989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dae908-7c79-4d59-85e1-532eed37933a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:00.761070 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1104/2232] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:00 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:00.765754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100c5eb-6dc1-465c-9878-1f9cc478baee admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:00.777392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100c5eb-6dc1-465c-9878-1f9cc478baee admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:00.787483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72ade6-056f-4645-996a-6d05f92d8e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:00.788998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72ade6-056f-4645-996a-6d05f92d8e9e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:00.789633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72ade6-056f-4645-996a-6d05f92d8e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:00.790116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72ade6-056f-4645-996a-6d05f92d8e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:00.791102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72ade6-056f-4645-996a-6d05f92d8e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:00.792912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72ade6-056f-4645-996a-6d05f92d8e9e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:00.810570 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1129/2233] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:00 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:00.811964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dae908-7c79-4d59-85e1-532eed37933a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:00.825143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dae908-7c79-4d59-85e1-532eed37933a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:00.832293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea1c50-d185-4740-849e-689a32a575dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:00.833141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea1c50-d185-4740-849e-689a32a575dd admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:00.833433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea1c50-d185-4740-849e-689a32a575dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:00.834362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea1c50-d185-4740-849e-689a32a575dd admin admin] PATH_INFO: `/v3/projects/4dcf3c5f1734482aa4846eb77a17abdf/users/753730fe5830467c80a5f0842d89e3bf/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:00.856436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea1c50-d185-4740-849e-689a32a575dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dcf3c5f1734482aa4846eb77a17abdf, user_id=753730fe5830467c80a5f0842d89e3bf, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:00.859892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea1c50-d185-4740-849e-689a32a575dd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:00.883086 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1105/2234] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:00 2021] PUT /identity/v3/projects/4dcf3c5f1734482aa4846eb77a17abdf/users/753730fe5830467c80a5f0842d89e3bf/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:00.888875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bb1c6-3c35-4985-a08a-c10f8598026c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:00.889170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bb1c6-3c35-4985-a08a-c10f8598026c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:00.889844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bb1c6-3c35-4985-a08a-c10f8598026c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:00.920836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-971bb1c6-3c35-4985-a08a-c10f8598026c None None] MFA Rules not processed for user `753730fe5830467c80a5f0842d89e3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:00.922185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-971bb1c6-3c35-4985-a08a-c10f8598026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:01.005353 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1130/2235] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:00 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:01.007453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea1c50-d185-4740-849e-689a32a575dd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:01.078170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea1c50-d185-4740-849e-689a32a575dd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:01.083023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45ae59-cab7-4d01-a1df-d243fd3cf8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:01.084244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45ae59-cab7-4d01-a1df-d243fd3cf8be admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:01.084535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45ae59-cab7-4d01-a1df-d243fd3cf8be admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:01.084815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45ae59-cab7-4d01-a1df-d243fd3cf8be admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:01.085544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45ae59-cab7-4d01-a1df-d243fd3cf8be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:01.087461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45ae59-cab7-4d01-a1df-d243fd3cf8be admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:01.120270 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1106/2236] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:01 2021] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:01.124048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bb1c6-3c35-4985-a08a-c10f8598026c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:01.135087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bb1c6-3c35-4985-a08a-c10f8598026c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:01.218752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3cd05-4e5e-4921-a11f-89637d60e5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:01.219426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3cd05-4e5e-4921-a11f-89637d60e5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:01.219708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3cd05-4e5e-4921-a11f-89637d60e5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:01.219985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3cd05-4e5e-4921-a11f-89637d60e5a3 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:01.220702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3cd05-4e5e-4921-a11f-89637d60e5a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:01.222661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3cd05-4e5e-4921-a11f-89637d60e5a3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:01.252089 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1131/2237] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:01 2021] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:01.253389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45ae59-cab7-4d01-a1df-d243fd3cf8be admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:01.265960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45ae59-cab7-4d01-a1df-d243fd3cf8be admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:01.273691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b25438-d54e-4d63-8fc7-3ea82f677d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:01.275142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b25438-d54e-4d63-8fc7-3ea82f677d1c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:01.275616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b25438-d54e-4d63-8fc7-3ea82f677d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:01.275857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b25438-d54e-4d63-8fc7-3ea82f677d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:01.277253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b25438-d54e-4d63-8fc7-3ea82f677d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:01.278727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b25438-d54e-4d63-8fc7-3ea82f677d1c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:01.292266 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1107/2238] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:01 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:01.296475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3cd05-4e5e-4921-a11f-89637d60e5a3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:01.307543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3cd05-4e5e-4921-a11f-89637d60e5a3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:01.313298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878212b1-03b3-463c-a87e-83d60b93fe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:01.315185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878212b1-03b3-463c-a87e-83d60b93fe9b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:01.315702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878212b1-03b3-463c-a87e-83d60b93fe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:01.316123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878212b1-03b3-463c-a87e-83d60b93fe9b admin admin] PATH_INFO: `/v3/projects/d75970225ffe4928bfc3eabbc3bc24ed/users/c2168e77fd0249ab9eaa30de15642827/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:01.332920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878212b1-03b3-463c-a87e-83d60b93fe9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75970225ffe4928bfc3eabbc3bc24ed, user_id=c2168e77fd0249ab9eaa30de15642827, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:01.336589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878212b1-03b3-463c-a87e-83d60b93fe9b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:01.372858 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1132/2239] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:01 2021] PUT /identity/v3/projects/d75970225ffe4928bfc3eabbc3bc24ed/users/c2168e77fd0249ab9eaa30de15642827/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:01.374296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b25438-d54e-4d63-8fc7-3ea82f677d1c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:01.388546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b25438-d54e-4d63-8fc7-3ea82f677d1c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:01.481035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b68d98-2da6-499b-a19e-1337dd7f2bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:01.482442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b68d98-2da6-499b-a19e-1337dd7f2bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:01.482875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b68d98-2da6-499b-a19e-1337dd7f2bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:01.483165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b68d98-2da6-499b-a19e-1337dd7f2bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:01.486516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b68d98-2da6-499b-a19e-1337dd7f2bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:01.489110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b68d98-2da6-499b-a19e-1337dd7f2bb8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:01.509904 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1108/2240] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:01 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:01.514234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878212b1-03b3-463c-a87e-83d60b93fe9b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:01.525896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878212b1-03b3-463c-a87e-83d60b93fe9b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:01.532499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1e47f-6c94-461d-95d4-e48fc824fdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:01.533942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1e47f-6c94-461d-95d4-e48fc824fdd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:01.534564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1e47f-6c94-461d-95d4-e48fc824fdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:01.535121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1e47f-6c94-461d-95d4-e48fc824fdd1 admin admin] PATH_INFO: `/v3/projects/d75970225ffe4928bfc3eabbc3bc24ed/users/c2168e77fd0249ab9eaa30de15642827/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:01.537962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1e47f-6c94-461d-95d4-e48fc824fdd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75970225ffe4928bfc3eabbc3bc24ed, user_id=c2168e77fd0249ab9eaa30de15642827, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:01.541227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1e47f-6c94-461d-95d4-e48fc824fdd1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:01.561609 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1133/2241] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:01 2021] PUT /identity/v3/projects/d75970225ffe4928bfc3eabbc3bc24ed/users/c2168e77fd0249ab9eaa30de15642827/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:01.563802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d06c8-a9dd-46b4-98f0-25b1568bd8c9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:01.564231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d06c8-a9dd-46b4-98f0-25b1568bd8c9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:01.564386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d06c8-a9dd-46b4-98f0-25b1568bd8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:01.598650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-102d06c8-a9dd-46b4-98f0-25b1568bd8c9 None None] MFA Rules not processed for user `c2168e77fd0249ab9eaa30de15642827`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:01.600339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-102d06c8-a9dd-46b4-98f0-25b1568bd8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:01.722566 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1109/2242] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:01 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:01.729771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1e47f-6c94-461d-95d4-e48fc824fdd1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:01.743946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1e47f-6c94-461d-95d4-e48fc824fdd1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:01.753869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15813664-f043-40dc-a48f-74278b371f7d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:01.755106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813664-f043-40dc-a48f-74278b371f7d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:01.755681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813664-f043-40dc-a48f-74278b371f7d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:01.756148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813664-f043-40dc-a48f-74278b371f7d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:01.760362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15813664-f043-40dc-a48f-74278b371f7d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:01.760978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15813664-f043-40dc-a48f-74278b371f7d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:01.763269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15813664-f043-40dc-a48f-74278b371f7d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:01.788026 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1134/2243] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:01.790350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d06c8-a9dd-46b4-98f0-25b1568bd8c9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:01.806341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d06c8-a9dd-46b4-98f0-25b1568bd8c9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:01.814906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3372d6-2e9b-4e9e-a539-5a87d659df49 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:01.816418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3372d6-2e9b-4e9e-a539-5a87d659df49 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:01.817029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3372d6-2e9b-4e9e-a539-5a87d659df49 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:01.817383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3372d6-2e9b-4e9e-a539-5a87d659df49 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:01.818300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3372d6-2e9b-4e9e-a539-5a87d659df49 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:01.821189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3372d6-2e9b-4e9e-a539-5a87d659df49 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:01.872471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15813664-f043-40dc-a48f-74278b371f7d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:01.873506 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1110/2244] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:01 2021] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:01.885194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15813664-f043-40dc-a48f-74278b371f7d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:01.936550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3372d6-2e9b-4e9e-a539-5a87d659df49 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:02.020904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa0c6c-4893-4947-b70a-3be40d24e477 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:02.029413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa0c6c-4893-4947-b70a-3be40d24e477 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:02.029890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa0c6c-4893-4947-b70a-3be40d24e477 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:02.030684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa0c6c-4893-4947-b70a-3be40d24e477 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:02.032048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa0c6c-4893-4947-b70a-3be40d24e477 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:02.032500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa0c6c-4893-4947-b70a-3be40d24e477 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:02.034709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa0c6c-4893-4947-b70a-3be40d24e477 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:02.085810 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1135/2245] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:02.112869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3372d6-2e9b-4e9e-a539-5a87d659df49 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:02.126591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e479b98-4b13-45a8-8795-34e59036bd3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:02.127265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e479b98-4b13-45a8-8795-34e59036bd3b service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:02.127552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e479b98-4b13-45a8-8795-34e59036bd3b service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:02.127834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e479b98-4b13-45a8-8795-34e59036bd3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:02.134841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1e479b98-4b13-45a8-8795-34e59036bd3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:02.258724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e479b98-4b13-45a8-8795-34e59036bd3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:02.260360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e479b98-4b13-45a8-8795-34e59036bd3b service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:02.301462 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1111/2246] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:01 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:48:02.800792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa0c6c-4893-4947-b70a-3be40d24e477 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:02.804813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bfaa0c6c-4893-4947-b70a-3be40d24e477 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:02.828954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa0c6c-4893-4947-b70a-3be40d24e477 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:02.837851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33da38-0d0b-4446-b65a-dade7a9f9a0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:02.838671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33da38-0d0b-4446-b65a-dade7a9f9a0c service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:02.839002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33da38-0d0b-4446-b65a-dade7a9f9a0c service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:02.839443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33da38-0d0b-4446-b65a-dade7a9f9a0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:02.853039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33da38-0d0b-4446-b65a-dade7a9f9a0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:02.854771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33da38-0d0b-4446-b65a-dade7a9f9a0c service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:02.870697 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1136/2247] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:02 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:02.914516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282ae51-89f5-462b-8eeb-95fb6d3838df None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:02.915117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282ae51-89f5-462b-8eeb-95fb6d3838df None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:02.915478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8fb60-b08c-4ca9-a550-9a6501209cd2 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:02.915932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282ae51-89f5-462b-8eeb-95fb6d3838df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:02.916476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8fb60-b08c-4ca9-a550-9a6501209cd2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:02.917234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8fb60-b08c-4ca9-a550-9a6501209cd2 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:02.932052 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1112/2248] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:02 2021] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:48:02.933520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3426706-c81a-46aa-8089-4a285b897995 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:02.936064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3426706-c81a-46aa-8089-4a285b897995 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:02.936777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3426706-c81a-46aa-8089-4a285b897995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:02.974022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f3426706-c81a-46aa-8089-4a285b897995 None None] MFA Rules not processed for user `8042de28328d4b26b910f1be4b499879`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:02.976114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f3426706-c81a-46aa-8089-4a285b897995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:02.977251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2282ae51-89f5-462b-8eeb-95fb6d3838df None None] MFA Rules not processed for user `cea2e12107304c1aadf2872c125d84d7`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:02.983755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2282ae51-89f5-462b-8eeb-95fb6d3838df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:03.081322 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1113/2249] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:02 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:03.081322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3426706-c81a-46aa-8089-4a285b897995 None None] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:03.092544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3426706-c81a-46aa-8089-4a285b897995 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:03.105110 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1137/2250] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:02 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:03.107712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282ae51-89f5-462b-8eeb-95fb6d3838df None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:03.109788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2282ae51-89f5-462b-8eeb-95fb6d3838df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:03.115808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3426706-c81a-46aa-8089-4a285b897995 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:03.121909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8f97c-6f40-45bc-8ab7-dc45694cc79b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:03.123019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8f97c-6f40-45bc-8ab7-dc45694cc79b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:03.123448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8f97c-6f40-45bc-8ab7-dc45694cc79b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:03.123892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8f97c-6f40-45bc-8ab7-dc45694cc79b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/projects/18056e3f54074bac82a22bb83ad4dd6d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:03.126028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8f97c-6f40-45bc-8ab7-dc45694cc79b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:get_project(project_id=18056e3f54074bac82a22bb83ad4dd6d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:03.129176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8f97c-6f40-45bc-8ab7-dc45694cc79b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:03.144275 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1114/2251] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:03 2021] GET /identity/v3/projects/18056e3f54074bac82a22bb83ad4dd6d => generated 371 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:03.247137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282ae51-89f5-462b-8eeb-95fb6d3838df None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:03.255767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39f0ec-8d3f-4fc6-8f62-db7f3028c2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:03.257243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39f0ec-8d3f-4fc6-8f62-db7f3028c2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:03.257716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39f0ec-8d3f-4fc6-8f62-db7f3028c2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:03.258147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39f0ec-8d3f-4fc6-8f62-db7f3028c2a3 admin admin] PATH_INFO: `/v3/users/09e05995c6824c90ab707fca61caaf85` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:03.260449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39f0ec-8d3f-4fc6-8f62-db7f3028c2a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09e05995c6824c90ab707fca61caaf85)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:03.262882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39f0ec-8d3f-4fc6-8f62-db7f3028c2a3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:03.321560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1a39f0ec-8d3f-4fc6-8f62-db7f3028c2a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09e05995c6824c90ab707fca61caaf85'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:03.329533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1a39f0ec-8d3f-4fc6-8f62-db7f3028c2a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09e05995c6824c90ab707fca61caaf85'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:03.330703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1a39f0ec-8d3f-4fc6-8f62-db7f3028c2a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09e05995c6824c90ab707fca61caaf85'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:03.345271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1a39f0ec-8d3f-4fc6-8f62-db7f3028c2a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09e05995c6824c90ab707fca61caaf85'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:03.355185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1a39f0ec-8d3f-4fc6-8f62-db7f3028c2a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09e05995c6824c90ab707fca61caaf85'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:03.366351 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1138/2252] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:03 2021] DELETE /identity/v3/users/09e05995c6824c90ab707fca61caaf85 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:03.368257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033059f-9d1c-480f-b4f6-96fc96d2d6d5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:03.368845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033059f-9d1c-480f-b4f6-96fc96d2d6d5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:03.369296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033059f-9d1c-480f-b4f6-96fc96d2d6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:03.392127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3033059f-9d1c-480f-b4f6-96fc96d2d6d5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:03.393573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3033059f-9d1c-480f-b4f6-96fc96d2d6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:03.474968 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1115/2253] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:03.489921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39f0ec-8d3f-4fc6-8f62-db7f3028c2a3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:03.491863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1a39f0ec-8d3f-4fc6-8f62-db7f3028c2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:03.567761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39f0ec-8d3f-4fc6-8f62-db7f3028c2a3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:03.572996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616c45-833d-477d-8cd0-51da32984192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:03.573762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616c45-833d-477d-8cd0-51da32984192 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:03.574187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616c45-833d-477d-8cd0-51da32984192 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:03.574586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616c45-833d-477d-8cd0-51da32984192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:03.584610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c616c45-833d-477d-8cd0-51da32984192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:03.586685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c616c45-833d-477d-8cd0-51da32984192 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:03.597069 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1139/2254] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:03.810145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033059f-9d1c-480f-b4f6-96fc96d2d6d5 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:03.812724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3033059f-9d1c-480f-b4f6-96fc96d2d6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:03.842601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033059f-9d1c-480f-b4f6-96fc96d2d6d5 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:03.848463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028a90d-5fa8-463b-a2c8-1fef483a02e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:03.849251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a90d-5fa8-463b-a2c8-1fef483a02e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:03.849531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a90d-5fa8-463b-a2c8-1fef483a02e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:03.849808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a90d-5fa8-463b-a2c8-1fef483a02e9 admin admin] PATH_INFO: `/v3/projects/5a64115a8fdc4fd78580446ebb4622de` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:03.851443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028a90d-5fa8-463b-a2c8-1fef483a02e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a64115a8fdc4fd78580446ebb4622de)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:03.853424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028a90d-5fa8-463b-a2c8-1fef483a02e9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:03.934201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5028a90d-5fa8-463b-a2c8-1fef483a02e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a64115a8fdc4fd78580446ebb4622de', 'request_id': 'req-5028a90d-5fa8-463b-a2c8-1fef483a02e9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:03.944628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5028a90d-5fa8-463b-a2c8-1fef483a02e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a64115a8fdc4fd78580446ebb4622de', 'request_id': 'req-5028a90d-5fa8-463b-a2c8-1fef483a02e9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:03.953072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5028a90d-5fa8-463b-a2c8-1fef483a02e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a64115a8fdc4fd78580446ebb4622de', 'request_id': 'req-5028a90d-5fa8-463b-a2c8-1fef483a02e9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:03.975679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5028a90d-5fa8-463b-a2c8-1fef483a02e9 admin admin] The token cache is being invalidate because project 5a64115a8fdc4fd78580446ebb4622de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:03.975981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5028a90d-5fa8-463b-a2c8-1fef483a02e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:03.977802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5028a90d-5fa8-463b-a2c8-1fef483a02e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:03.983019 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1116/2255] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:03 2021] DELETE /identity/v3/projects/5a64115a8fdc4fd78580446ebb4622de => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:03.987229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616c45-833d-477d-8cd0-51da32984192 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:04.000921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616c45-833d-477d-8cd0-51da32984192 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:04.149948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e281a-8994-471d-bb55-882dc8253328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:04.151158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e281a-8994-471d-bb55-882dc8253328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:04.151691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e281a-8994-471d-bb55-882dc8253328 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:04.152628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e281a-8994-471d-bb55-882dc8253328 admin admin] PATH_INFO: `/v3/users/d5963a35bdf0484aa1ad4d7c584c2f38` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:04.156192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e281a-8994-471d-bb55-882dc8253328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5963a35bdf0484aa1ad4d7c584c2f38)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:04.159191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e281a-8994-471d-bb55-882dc8253328 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:04.232788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-362e281a-8994-471d-bb55-882dc8253328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5963a35bdf0484aa1ad4d7c584c2f38'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:04.244343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-362e281a-8994-471d-bb55-882dc8253328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5963a35bdf0484aa1ad4d7c584c2f38'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:04.245455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-362e281a-8994-471d-bb55-882dc8253328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5963a35bdf0484aa1ad4d7c584c2f38'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:04.258996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-362e281a-8994-471d-bb55-882dc8253328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5963a35bdf0484aa1ad4d7c584c2f38'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:04.270471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-362e281a-8994-471d-bb55-882dc8253328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5963a35bdf0484aa1ad4d7c584c2f38'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:04.282313 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1140/2256] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:03 2021] DELETE /identity/v3/users/d5963a35bdf0484aa1ad4d7c584c2f38 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:04.497026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028a90d-5fa8-463b-a2c8-1fef483a02e9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:04.498469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5028a90d-5fa8-463b-a2c8-1fef483a02e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:04.580725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e281a-8994-471d-bb55-882dc8253328 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:04.582404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-362e281a-8994-471d-bb55-882dc8253328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:04.673065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028a90d-5fa8-463b-a2c8-1fef483a02e9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:04.722026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e281a-8994-471d-bb55-882dc8253328 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:04.737829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adf822-b3d5-409c-a45d-5bbaf04c3341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:04.739412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adf822-b3d5-409c-a45d-5bbaf04c3341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:04.741844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adf822-b3d5-409c-a45d-5bbaf04c3341 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:04.742326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adf822-b3d5-409c-a45d-5bbaf04c3341 admin admin] PATH_INFO: `/v3/projects/5fc36a8f761c4e7882527a99234ee363` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:04.745339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adf822-b3d5-409c-a45d-5bbaf04c3341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc36a8f761c4e7882527a99234ee363)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:04.750837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adf822-b3d5-409c-a45d-5bbaf04c3341 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:04.832086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36403f85-31e5-47dd-bdde-5e635cec4d7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:04.832805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36403f85-31e5-47dd-bdde-5e635cec4d7b service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:04.833163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36403f85-31e5-47dd-bdde-5e635cec4d7b service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:04.834347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36403f85-31e5-47dd-bdde-5e635cec4d7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:04.837647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-36403f85-31e5-47dd-bdde-5e635cec4d7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:04.854937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3adf822-b3d5-409c-a45d-5bbaf04c3341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc36a8f761c4e7882527a99234ee363', 'request_id': 'req-d3adf822-b3d5-409c-a45d-5bbaf04c3341'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:04.863650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3adf822-b3d5-409c-a45d-5bbaf04c3341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc36a8f761c4e7882527a99234ee363', 'request_id': 'req-d3adf822-b3d5-409c-a45d-5bbaf04c3341'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:04.877247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3adf822-b3d5-409c-a45d-5bbaf04c3341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc36a8f761c4e7882527a99234ee363', 'request_id': 'req-d3adf822-b3d5-409c-a45d-5bbaf04c3341'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:04.898083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3adf822-b3d5-409c-a45d-5bbaf04c3341 admin admin] The token cache is being invalidate because project 5fc36a8f761c4e7882527a99234ee363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:04.900259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3adf822-b3d5-409c-a45d-5bbaf04c3341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:04.902334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3adf822-b3d5-409c-a45d-5bbaf04c3341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:04.905108 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1141/2257] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:04 2021] DELETE /identity/v3/projects/5fc36a8f761c4e7882527a99234ee363 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:04.914222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2601b21-7859-4448-99b5-6f71f2ade63b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:04.914697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2601b21-7859-4448-99b5-6f71f2ade63b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:04.916025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2601b21-7859-4448-99b5-6f71f2ade63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:04.954519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f2601b21-7859-4448-99b5-6f71f2ade63b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:04.956252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f2601b21-7859-4448-99b5-6f71f2ade63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:04.980798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36403f85-31e5-47dd-bdde-5e635cec4d7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:04.985953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36403f85-31e5-47dd-bdde-5e635cec4d7b service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:05.022923 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1117/2258] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:04 2021] GET /identity/v3/auth/tokens => generated 3270 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:05.060684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fa909-d791-407e-90bd-8fee5614f6e2 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:05.060988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fa909-d791-407e-90bd-8fee5614f6e2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:05.061524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fa909-d791-407e-90bd-8fee5614f6e2 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:05.064362 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1118/2259] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:48:05.069589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fa909-d791-407e-90bd-8fee5614f6e2 None None] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:05.071466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b82fa909-d791-407e-90bd-8fee5614f6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:05.142720 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1142/2260] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:05.144247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021d72c-3880-4ea4-a2ed-ab9c755b7b69 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:05.144535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021d72c-3880-4ea4-a2ed-ab9c755b7b69 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:05.144814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021d72c-3880-4ea4-a2ed-ab9c755b7b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:05.197759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4021d72c-3880-4ea4-a2ed-ab9c755b7b69 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:05.202450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4021d72c-3880-4ea4-a2ed-ab9c755b7b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:05.238384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fa909-d791-407e-90bd-8fee5614f6e2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:05.241310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b82fa909-d791-407e-90bd-8fee5614f6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:05.251413 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1143/2261] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:05.257138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021d72c-3880-4ea4-a2ed-ab9c755b7b69 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:05.293322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021d72c-3880-4ea4-a2ed-ab9c755b7b69 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:05.336310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111f280-4688-4a51-81d9-a47eaf07d9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:05.338391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f280-4688-4a51-81d9-a47eaf07d9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:05.339869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f280-4688-4a51-81d9-a47eaf07d9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:05.340578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f280-4688-4a51-81d9-a47eaf07d9f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:05.343226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111f280-4688-4a51-81d9-a47eaf07d9f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:05.343790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111f280-4688-4a51-81d9-a47eaf07d9f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:05.348392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111f280-4688-4a51-81d9-a47eaf07d9f0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:05.392337 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1144/2262] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:48:05.393738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111f280-4688-4a51-81d9-a47eaf07d9f0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:05.418857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111f280-4688-4a51-81d9-a47eaf07d9f0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:05.431344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192f14d-f74e-4745-8421-3b40f9e7cb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:05.432657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192f14d-f74e-4745-8421-3b40f9e7cb7c admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:05.433173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192f14d-f74e-4745-8421-3b40f9e7cb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:05.433624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192f14d-f74e-4745-8421-3b40f9e7cb7c admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:05.434590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192f14d-f74e-4745-8421-3b40f9e7cb7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:05.450756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192f14d-f74e-4745-8421-3b40f9e7cb7c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:05.454609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fa909-d791-407e-90bd-8fee5614f6e2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:05.467117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b62d3-73fc-40be-b376-93934564a6fd tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:05.468000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b62d3-73fc-40be-b376-93934564a6fd tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:05.468384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b62d3-73fc-40be-b376-93934564a6fd tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:05.468657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b62d3-73fc-40be-b376-93934564a6fd tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/projects/18056e3f54074bac82a22bb83ad4dd6d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:05.471028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b62d3-73fc-40be-b376-93934564a6fd tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:get_project(project_id=18056e3f54074bac82a22bb83ad4dd6d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:05.474149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b62d3-73fc-40be-b376-93934564a6fd tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:05.476663 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1119/2263] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:05 2021] GET /identity/v3/projects/18056e3f54074bac82a22bb83ad4dd6d => generated 371 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:05.536920 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1145/2264] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:05 2021] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:05.537835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b62d3-73fc-40be-b376-93934564a6fd tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:05.556889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b62d3-73fc-40be-b376-93934564a6fd tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:05.699640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb20d4-5def-4d5f-bb2c-a01e2fe5f960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:05.700644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb20d4-5def-4d5f-bb2c-a01e2fe5f960 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:05.701212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb20d4-5def-4d5f-bb2c-a01e2fe5f960 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:05.701715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb20d4-5def-4d5f-bb2c-a01e2fe5f960 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:05.702970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb20d4-5def-4d5f-bb2c-a01e2fe5f960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:05.705261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb20d4-5def-4d5f-bb2c-a01e2fe5f960 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:05.747499 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1120/2265] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:05 2021] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:48:05.748890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192f14d-f74e-4745-8421-3b40f9e7cb7c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:05.767686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192f14d-f74e-4745-8421-3b40f9e7cb7c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:05.784635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499b88e-11c8-4c1a-8066-df0425492983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:05.785590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499b88e-11c8-4c1a-8066-df0425492983 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:05.785973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499b88e-11c8-4c1a-8066-df0425492983 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:05.786701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499b88e-11c8-4c1a-8066-df0425492983 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:05.787548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499b88e-11c8-4c1a-8066-df0425492983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:05.789636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499b88e-11c8-4c1a-8066-df0425492983 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:05.829313 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1146/2266] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:05 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:05.830480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb20d4-5def-4d5f-bb2c-a01e2fe5f960 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:05.843120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb20d4-5def-4d5f-bb2c-a01e2fe5f960 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:05.848348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787397ba-328e-4f44-8695-b6d06363d3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:05.849720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787397ba-328e-4f44-8695-b6d06363d3ba admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:05.849720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787397ba-328e-4f44-8695-b6d06363d3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:05.849917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787397ba-328e-4f44-8695-b6d06363d3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:05.850650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787397ba-328e-4f44-8695-b6d06363d3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:05.852469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787397ba-328e-4f44-8695-b6d06363d3ba admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:05.863881 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1121/2267] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:05 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:05.868161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499b88e-11c8-4c1a-8066-df0425492983 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:05.879919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499b88e-11c8-4c1a-8066-df0425492983 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:05.890653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024016a9-b6fe-41da-933c-7db9a5e8211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:05.891953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024016a9-b6fe-41da-933c-7db9a5e8211c admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:05.892342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024016a9-b6fe-41da-933c-7db9a5e8211c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:05.892855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024016a9-b6fe-41da-933c-7db9a5e8211c admin admin] PATH_INFO: `/v3/projects/47584e2b5b674fc295b6a63ffe8df191/users/c971aa1884174ed0acec9d140f2eda87/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:05.939953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024016a9-b6fe-41da-933c-7db9a5e8211c admin admin] RBAC: Authorizing `identity:create_grant(project_id=47584e2b5b674fc295b6a63ffe8df191, user_id=c971aa1884174ed0acec9d140f2eda87, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:05.948793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024016a9-b6fe-41da-933c-7db9a5e8211c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:05.978002 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1147/2268] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:05 2021] PUT /identity/v3/projects/47584e2b5b674fc295b6a63ffe8df191/users/c971aa1884174ed0acec9d140f2eda87/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:05.983610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde60e5-c153-418c-bf71-f20b071c94aa None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:05.983979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde60e5-c153-418c-bf71-f20b071c94aa None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:05.984373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde60e5-c153-418c-bf71-f20b071c94aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:06.011701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-dcde60e5-c153-418c-bf71-f20b071c94aa None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:06.013357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-dcde60e5-c153-418c-bf71-f20b071c94aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:06.158343 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1122/2269] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:06.263796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024016a9-b6fe-41da-933c-7db9a5e8211c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:06.266231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-024016a9-b6fe-41da-933c-7db9a5e8211c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:06.393988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024016a9-b6fe-41da-933c-7db9a5e8211c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:06.402995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba42fe-de87-4d47-95e5-b7e9940d02f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:06.404313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba42fe-de87-4d47-95e5-b7e9940d02f8 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:06.404704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba42fe-de87-4d47-95e5-b7e9940d02f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:06.405176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba42fe-de87-4d47-95e5-b7e9940d02f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:06.419000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba42fe-de87-4d47-95e5-b7e9940d02f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:06.420596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba42fe-de87-4d47-95e5-b7e9940d02f8 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:06.432476 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1148/2270] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:06.510636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde60e5-c153-418c-bf71-f20b071c94aa None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:06.628693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde60e5-c153-418c-bf71-f20b071c94aa None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:06.639057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab6a31-426d-42c1-8a12-b2be790fe07e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:06.640501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab6a31-426d-42c1-8a12-b2be790fe07e service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:06.640795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab6a31-426d-42c1-8a12-b2be790fe07e service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:06.641131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab6a31-426d-42c1-8a12-b2be790fe07e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:06.643356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-43ab6a31-426d-42c1-8a12-b2be790fe07e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:06.777005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab6a31-426d-42c1-8a12-b2be790fe07e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:06.779140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab6a31-426d-42c1-8a12-b2be790fe07e service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:06.792115 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1123/2271] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:06 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:06.944802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba42fe-de87-4d47-95e5-b7e9940d02f8 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:06.946386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2eba42fe-de87-4d47-95e5-b7e9940d02f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:06.968616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba42fe-de87-4d47-95e5-b7e9940d02f8 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:06.988752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b32618-a0a9-46e3-854c-691c7888cdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:06.989695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32618-a0a9-46e3-854c-691c7888cdc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:06.989980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32618-a0a9-46e3-854c-691c7888cdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:06.990279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32618-a0a9-46e3-854c-691c7888cdc9 admin admin] PATH_INFO: `/v3/users/76a2e67a2f1740b898dcc7d71f8de89c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:06.991715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b32618-a0a9-46e3-854c-691c7888cdc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a2e67a2f1740b898dcc7d71f8de89c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:06.993850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b32618-a0a9-46e3-854c-691c7888cdc9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:06.997747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db867ce6-fe6d-4656-a32c-05397fcd4b9e None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:06.997920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db867ce6-fe6d-4656-a32c-05397fcd4b9e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:06.998275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db867ce6-fe6d-4656-a32c-05397fcd4b9e None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:07.000466 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1124/2272] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:48:07.012708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db867ce6-fe6d-4656-a32c-05397fcd4b9e None None] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:07.042626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db867ce6-fe6d-4656-a32c-05397fcd4b9e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:07.095299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0b32618-a0a9-46e3-854c-691c7888cdc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a2e67a2f1740b898dcc7d71f8de89c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:07.105423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0b32618-a0a9-46e3-854c-691c7888cdc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a2e67a2f1740b898dcc7d71f8de89c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:07.106603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0b32618-a0a9-46e3-854c-691c7888cdc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a2e67a2f1740b898dcc7d71f8de89c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:07.124077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0b32618-a0a9-46e3-854c-691c7888cdc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a2e67a2f1740b898dcc7d71f8de89c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:07.135080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0b32618-a0a9-46e3-854c-691c7888cdc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a2e67a2f1740b898dcc7d71f8de89c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:07.136775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db867ce6-fe6d-4656-a32c-05397fcd4b9e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:07.149488 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1149/2273] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:06 2021] DELETE /identity/v3/users/76a2e67a2f1740b898dcc7d71f8de89c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:07.150482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a2bb8-4d7b-444b-8480-4475e2432cc8 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:07.151968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2bb8-4d7b-444b-8480-4475e2432cc8 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:07.152345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2bb8-4d7b-444b-8480-4475e2432cc8 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:07.152694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2bb8-4d7b-444b-8480-4475e2432cc8 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/projects/18056e3f54074bac82a22bb83ad4dd6d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:07.153228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf342e-9dbe-4127-99fe-300fd3abf8fa None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:07.153712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf342e-9dbe-4127-99fe-300fd3abf8fa None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:07.154351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a2bb8-4d7b-444b-8480-4475e2432cc8 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:get_project(project_id=18056e3f54074bac82a22bb83ad4dd6d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:07.156399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf342e-9dbe-4127-99fe-300fd3abf8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:07.158753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a2bb8-4d7b-444b-8480-4475e2432cc8 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:07.162243 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1125/2274] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:07 2021] GET /identity/v3/projects/18056e3f54074bac82a22bb83ad4dd6d => generated 371 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:48:07.192146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a2bb8-4d7b-444b-8480-4475e2432cc8 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:07.194849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4d8a2bb8-4d7b-444b-8480-4475e2432cc8 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:07.206146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9ccf342e-9dbe-4127-99fe-300fd3abf8fa None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:07.209297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9ccf342e-9dbe-4127-99fe-300fd3abf8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:07.230821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a2bb8-4d7b-444b-8480-4475e2432cc8 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:07.331857 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1150/2275] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:07.373562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf342e-9dbe-4127-99fe-300fd3abf8fa None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:07.375100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9ccf342e-9dbe-4127-99fe-300fd3abf8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:07.390732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79318f1-1775-46c8-841b-9a6501299729 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:07.394034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79318f1-1775-46c8-841b-9a6501299729 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:07.396713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79318f1-1775-46c8-841b-9a6501299729 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:07.397032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79318f1-1775-46c8-841b-9a6501299729 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/projects/18056e3f54074bac82a22bb83ad4dd6d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:07.399110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79318f1-1775-46c8-841b-9a6501299729 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:delete_project(project_id=18056e3f54074bac82a22bb83ad4dd6d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:07.401613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79318f1-1775-46c8-841b-9a6501299729 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:07.461208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf342e-9dbe-4127-99fe-300fd3abf8fa None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:07.466797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0689e2-f879-4d22-af9b-26e85a5df1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:07.467554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0689e2-f879-4d22-af9b-26e85a5df1ed service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:07.468348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0689e2-f879-4d22-af9b-26e85a5df1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:07.468800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0689e2-f879-4d22-af9b-26e85a5df1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:07.482588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0689e2-f879-4d22-af9b-26e85a5df1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:07.484312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0689e2-f879-4d22-af9b-26e85a5df1ed service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:07.499381 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1151/2276] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:48:07.512699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c79318f1-1775-46c8-841b-9a6501299729 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18056e3f54074bac82a22bb83ad4dd6d', 'request_id': 'req-c79318f1-1775-46c8-841b-9a6501299729'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:07.528154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c79318f1-1775-46c8-841b-9a6501299729 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18056e3f54074bac82a22bb83ad4dd6d', 'request_id': 'req-c79318f1-1775-46c8-841b-9a6501299729'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:07.537818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c79318f1-1775-46c8-841b-9a6501299729 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18056e3f54074bac82a22bb83ad4dd6d', 'request_id': 'req-c79318f1-1775-46c8-841b-9a6501299729'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:07.555260 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c79318f1-1775-46c8-841b-9a6501299729 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] The token cache is being invalidate because project 18056e3f54074bac82a22bb83ad4dd6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:07.556076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c79318f1-1775-46c8-841b-9a6501299729 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:07.557040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c79318f1-1775-46c8-841b-9a6501299729 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:07.560655 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1126/2277] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:07 2021] DELETE /identity/v3/projects/18056e3f54074bac82a22bb83ad4dd6d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:08.278026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbefa53-58f3-4156-bbb3-9678929b01c4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:08.278198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbefa53-58f3-4156-bbb3-9678929b01c4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:08.278738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbefa53-58f3-4156-bbb3-9678929b01c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:08.376019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8cbefa53-58f3-4156-bbb3-9678929b01c4 None None] MFA Rules not processed for user `c971aa1884174ed0acec9d140f2eda87`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:08.378028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8cbefa53-58f3-4156-bbb3-9678929b01c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:08.484520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79318f1-1775-46c8-841b-9a6501299729 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:08.485046 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1152/2278] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:08 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:08.485944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c79318f1-1775-46c8-841b-9a6501299729 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:08.509403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81861cf0-fa4f-4109-a132-5a4db6d3229a None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:08.509972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81861cf0-fa4f-4109-a132-5a4db6d3229a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:08.510729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81861cf0-fa4f-4109-a132-5a4db6d3229a None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:08.513402 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1153/2279] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:08 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:48:08.522192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81861cf0-fa4f-4109-a132-5a4db6d3229a None None] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:08.525241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-81861cf0-fa4f-4109-a132-5a4db6d3229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:08.609411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79318f1-1775-46c8-841b-9a6501299729 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:08.615031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137ab56-4f14-4cc9-9cf0-910c642249ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:08.616747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137ab56-4f14-4cc9-9cf0-910c642249ba admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:08.617414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137ab56-4f14-4cc9-9cf0-910c642249ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:08.617845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137ab56-4f14-4cc9-9cf0-910c642249ba admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:08.619108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137ab56-4f14-4cc9-9cf0-910c642249ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:08.624042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137ab56-4f14-4cc9-9cf0-910c642249ba admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:08.658434 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1127/2280] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:08 2021] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:08.659761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137ab56-4f14-4cc9-9cf0-910c642249ba admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:08.670131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a137ab56-4f14-4cc9-9cf0-910c642249ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:08.697585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81861cf0-fa4f-4109-a132-5a4db6d3229a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:08.702047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-81861cf0-fa4f-4109-a132-5a4db6d3229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:08.767624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137ab56-4f14-4cc9-9cf0-910c642249ba admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:08.774961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3b135-6fb6-47e6-afec-b31445118492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:08.775897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3b135-6fb6-47e6-afec-b31445118492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:08.776324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3b135-6fb6-47e6-afec-b31445118492 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:08.776616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3b135-6fb6-47e6-afec-b31445118492 admin admin] PATH_INFO: `/v3/projects/7b7865c095884cf6afc93e3dd2d19259` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:08.777865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3b135-6fb6-47e6-afec-b31445118492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7865c095884cf6afc93e3dd2d19259)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:08.780406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3b135-6fb6-47e6-afec-b31445118492 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:08.861259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81861cf0-fa4f-4109-a132-5a4db6d3229a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:08.881755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0be3b135-6fb6-47e6-afec-b31445118492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7865c095884cf6afc93e3dd2d19259', 'request_id': 'req-0be3b135-6fb6-47e6-afec-b31445118492'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:08.895543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0be3b135-6fb6-47e6-afec-b31445118492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7865c095884cf6afc93e3dd2d19259', 'request_id': 'req-0be3b135-6fb6-47e6-afec-b31445118492'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:08.908175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0be3b135-6fb6-47e6-afec-b31445118492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7865c095884cf6afc93e3dd2d19259', 'request_id': 'req-0be3b135-6fb6-47e6-afec-b31445118492'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:08.936757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0be3b135-6fb6-47e6-afec-b31445118492 admin admin] The token cache is being invalidate because project 7b7865c095884cf6afc93e3dd2d19259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:08.937041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0be3b135-6fb6-47e6-afec-b31445118492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:08.937735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0be3b135-6fb6-47e6-afec-b31445118492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:08.942441 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1128/2281] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:08 2021] DELETE /identity/v3/projects/7b7865c095884cf6afc93e3dd2d19259 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:08.942441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3b135-6fb6-47e6-afec-b31445118492 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:08.944697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0be3b135-6fb6-47e6-afec-b31445118492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:08.987773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea36519-73c7-4737-bda9-e5a7428cd29c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:08.992860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea36519-73c7-4737-bda9-e5a7428cd29c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:08.993926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea36519-73c7-4737-bda9-e5a7428cd29c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:08.994338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea36519-73c7-4737-bda9-e5a7428cd29c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/projects/4dcf3c5f1734482aa4846eb77a17abdf` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:08.999922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea36519-73c7-4737-bda9-e5a7428cd29c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:get_project(project_id=4dcf3c5f1734482aa4846eb77a17abdf)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:09.001695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea36519-73c7-4737-bda9-e5a7428cd29c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:09.012976 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1154/2282] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:08 2021] GET /identity/v3/projects/4dcf3c5f1734482aa4846eb77a17abdf => generated 373 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:48:09.014153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea36519-73c7-4737-bda9-e5a7428cd29c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:09.017313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7ea36519-73c7-4737-bda9-e5a7428cd29c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:09.066230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3b135-6fb6-47e6-afec-b31445118492 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:09.080246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea27924-94bf-4319-9410-a342d6f2e69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:09.081044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea27924-94bf-4319-9410-a342d6f2e69c admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:09.081556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea27924-94bf-4319-9410-a342d6f2e69c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:09.081911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea27924-94bf-4319-9410-a342d6f2e69c admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:09.082735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea27924-94bf-4319-9410-a342d6f2e69c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:09.084780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea27924-94bf-4319-9410-a342d6f2e69c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:09.129466 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1129/2283] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:08 2021] POST /identity/v3/users => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:09.129639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea36519-73c7-4737-bda9-e5a7428cd29c tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:09.129827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea27924-94bf-4319-9410-a342d6f2e69c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:09.135437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-aea27924-94bf-4319-9410-a342d6f2e69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:09.140884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa137d-5404-4da1-8a27-a3685ecc8911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:09.142903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa137d-5404-4da1-8a27-a3685ecc8911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:09.144493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa137d-5404-4da1-8a27-a3685ecc8911 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:09.144791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa137d-5404-4da1-8a27-a3685ecc8911 admin admin] PATH_INFO: `/v3/users/64340fc0066a484ea24c57b1c037e34c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:09.157049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa137d-5404-4da1-8a27-a3685ecc8911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64340fc0066a484ea24c57b1c037e34c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:09.160772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa137d-5404-4da1-8a27-a3685ecc8911 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:09.165654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea27924-94bf-4319-9410-a342d6f2e69c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:09.198208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fe37c-a9f3-472f-b351-33226d973b0b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:09.198947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fe37c-a9f3-472f-b351-33226d973b0b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:09.199230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fe37c-a9f3-472f-b351-33226d973b0b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:09.199510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fe37c-a9f3-472f-b351-33226d973b0b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:09.200258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fe37c-a9f3-472f-b351-33226d973b0b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:09.200571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fe37c-a9f3-472f-b351-33226d973b0b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:09.202925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fe37c-a9f3-472f-b351-33226d973b0b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:09.236938 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1130/2284] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:09.241856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fe37c-a9f3-472f-b351-33226d973b0b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:09.263865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-46aa137d-5404-4da1-8a27-a3685ecc8911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64340fc0066a484ea24c57b1c037e34c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:09.282525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fe37c-a9f3-472f-b351-33226d973b0b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:09.285498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-46aa137d-5404-4da1-8a27-a3685ecc8911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64340fc0066a484ea24c57b1c037e34c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:09.290204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-46aa137d-5404-4da1-8a27-a3685ecc8911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64340fc0066a484ea24c57b1c037e34c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:09.303172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d7919-7e9c-4236-a562-f7b3ddd21ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:09.305052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d7919-7e9c-4236-a562-f7b3ddd21ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:09.305335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d7919-7e9c-4236-a562-f7b3ddd21ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:09.305633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d7919-7e9c-4236-a562-f7b3ddd21ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:09.307610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d7919-7e9c-4236-a562-f7b3ddd21ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:09.312723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d7919-7e9c-4236-a562-f7b3ddd21ea8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:09.324920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-46aa137d-5404-4da1-8a27-a3685ecc8911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64340fc0066a484ea24c57b1c037e34c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:09.336518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-46aa137d-5404-4da1-8a27-a3685ecc8911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64340fc0066a484ea24c57b1c037e34c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:09.343782 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1131/2285] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:09 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:09.344338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d7919-7e9c-4236-a562-f7b3ddd21ea8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:09.345305 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1155/2286] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:09 2021] DELETE /identity/v3/users/64340fc0066a484ea24c57b1c037e34c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:09.346087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa137d-5404-4da1-8a27-a3685ecc8911 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:09.347317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-46aa137d-5404-4da1-8a27-a3685ecc8911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:09.352835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e42d7919-7e9c-4236-a562-f7b3ddd21ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:09.370437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d7919-7e9c-4236-a562-f7b3ddd21ea8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:09.432567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa137d-5404-4da1-8a27-a3685ecc8911 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:09.438246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a3adb-eedd-44ec-8a86-c8e7de5c3387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:09.439317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a3adb-eedd-44ec-8a86-c8e7de5c3387 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:09.439609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a3adb-eedd-44ec-8a86-c8e7de5c3387 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:09.439889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a3adb-eedd-44ec-8a86-c8e7de5c3387 admin admin] PATH_INFO: `/v3/projects/2d09c7bbda564a1092cfe537f39e0a0b/users/b209cee416d043a7badbea4e52f44359/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:09.456419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a3adb-eedd-44ec-8a86-c8e7de5c3387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d09c7bbda564a1092cfe537f39e0a0b, user_id=b209cee416d043a7badbea4e52f44359, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:09.459167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c08c49-44fe-4fa3-b56e-18ef7f982fd9 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:09.459815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a3adb-eedd-44ec-8a86-c8e7de5c3387 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:09.460867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c08c49-44fe-4fa3-b56e-18ef7f982fd9 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:09.461373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c08c49-44fe-4fa3-b56e-18ef7f982fd9 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:09.461852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c08c49-44fe-4fa3-b56e-18ef7f982fd9 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:09.462976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c08c49-44fe-4fa3-b56e-18ef7f982fd9 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:09.466480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c08c49-44fe-4fa3-b56e-18ef7f982fd9 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:09.492384 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1156/2287] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:09 2021] PUT /identity/v3/projects/2d09c7bbda564a1092cfe537f39e0a0b/users/b209cee416d043a7badbea4e52f44359/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:09.497110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a3adb-eedd-44ec-8a86-c8e7de5c3387 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:09.533712 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1132/2288] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:09 2021] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:09.540069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c08c49-44fe-4fa3-b56e-18ef7f982fd9 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:09.656068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a3adb-eedd-44ec-8a86-c8e7de5c3387 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:09.749773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c08c49-44fe-4fa3-b56e-18ef7f982fd9 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:09.757270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcacb9-abc4-4883-9843-378a8d13e653 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:09.758646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcacb9-abc4-4883-9843-378a8d13e653 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:09.758943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcacb9-abc4-4883-9843-378a8d13e653 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:09.759223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcacb9-abc4-4883-9843-378a8d13e653 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:09.760091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcacb9-abc4-4883-9843-378a8d13e653 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:09.760408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcacb9-abc4-4883-9843-378a8d13e653 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:09.764191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcacb9-abc4-4883-9843-378a8d13e653 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:09.789580 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1133/2289] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:09.813667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070ff2d-4cac-417f-b724-97630f775571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:09.814074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070ff2d-4cac-417f-b724-97630f775571 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:09.814392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070ff2d-4cac-417f-b724-97630f775571 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:09.814673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070ff2d-4cac-417f-b724-97630f775571 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:09.818387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070ff2d-4cac-417f-b724-97630f775571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:09.818697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070ff2d-4cac-417f-b724-97630f775571 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:09.841657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcacb9-abc4-4883-9843-378a8d13e653 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:09.849922 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1157/2290] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:09 2021] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:09.856953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcacb9-abc4-4883-9843-378a8d13e653 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:09.864121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017f496-071d-4df0-8133-284a3963c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:09.865496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017f496-071d-4df0-8133-284a3963c89a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:09.865839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017f496-071d-4df0-8133-284a3963c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:09.869475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017f496-071d-4df0-8133-284a3963c89a admin admin] PATH_INFO: `/v3/projects/2d09c7bbda564a1092cfe537f39e0a0b/users/b209cee416d043a7badbea4e52f44359/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:09.872047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017f496-071d-4df0-8133-284a3963c89a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d09c7bbda564a1092cfe537f39e0a0b, user_id=b209cee416d043a7badbea4e52f44359, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:09.876122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017f496-071d-4df0-8133-284a3963c89a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:09.930334 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1134/2291] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:09 2021] PUT /identity/v3/projects/2d09c7bbda564a1092cfe537f39e0a0b/users/b209cee416d043a7badbea4e52f44359/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:10.112878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba2e49-77b0-4d0b-9d34-ad1ab096c3d6 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:10.113163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba2e49-77b0-4d0b-9d34-ad1ab096c3d6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:10.113444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba2e49-77b0-4d0b-9d34-ad1ab096c3d6 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:10.115795 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1158/2292] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:48:10.121469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017f496-071d-4df0-8133-284a3963c89a admin admin] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:10.123571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8017f496-071d-4df0-8133-284a3963c89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:10.238367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017f496-071d-4df0-8133-284a3963c89a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:10.351877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017f496-071d-4df0-8133-284a3963c89a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:10.358157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3b7bd-fb04-43d0-ab48-8635e314ab1d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:10.359216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3b7bd-fb04-43d0-ab48-8635e314ab1d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:10.359510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3b7bd-fb04-43d0-ab48-8635e314ab1d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:10.359840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3b7bd-fb04-43d0-ab48-8635e314ab1d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/projects/5f9d3ce5386447a58506a38417851181` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:10.361181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3b7bd-fb04-43d0-ab48-8635e314ab1d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:get_project(project_id=5f9d3ce5386447a58506a38417851181)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:10.363593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3b7bd-fb04-43d0-ab48-8635e314ab1d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:10.366441 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1135/2293] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:10 2021] GET /identity/v3/projects/5f9d3ce5386447a58506a38417851181 => generated 371 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:10.433526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba2e49-77b0-4d0b-9d34-ad1ab096c3d6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:10.435399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-19ba2e49-77b0-4d0b-9d34-ad1ab096c3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:10.496315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3b7bd-fb04-43d0-ab48-8635e314ab1d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:10.499403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a4e3b7bd-fb04-43d0-ab48-8635e314ab1d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:10.572314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba2e49-77b0-4d0b-9d34-ad1ab096c3d6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:10.577169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acea73-a136-487b-99dc-1996a304392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:10.578085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acea73-a136-487b-99dc-1996a304392c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:10.578404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acea73-a136-487b-99dc-1996a304392c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:10.578684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acea73-a136-487b-99dc-1996a304392c admin admin] PATH_INFO: `/v3/projects/197ef4d87a3646d4a156c5a036c93adb` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:10.580050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11acea73-a136-487b-99dc-1996a304392c admin admin] RBAC: Authorizing `identity:delete_project(project_id=197ef4d87a3646d4a156c5a036c93adb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:10.582654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11acea73-a136-487b-99dc-1996a304392c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:10.588861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3b7bd-fb04-43d0-ab48-8635e314ab1d tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:10.593940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a549c68-4cdb-41ce-998e-0f4daf744912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:10.595160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a549c68-4cdb-41ce-998e-0f4daf744912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:10.595274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a549c68-4cdb-41ce-998e-0f4daf744912 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:10.595613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a549c68-4cdb-41ce-998e-0f4daf744912 admin admin] PATH_INFO: `/v3/users/afe8c6d9e3394799a65b4accad98d76a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:10.597043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a549c68-4cdb-41ce-998e-0f4daf744912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe8c6d9e3394799a65b4accad98d76a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:10.600227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a549c68-4cdb-41ce-998e-0f4daf744912 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:10.650169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-11acea73-a136-487b-99dc-1996a304392c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197ef4d87a3646d4a156c5a036c93adb', 'request_id': 'req-11acea73-a136-487b-99dc-1996a304392c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:10.660343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-11acea73-a136-487b-99dc-1996a304392c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197ef4d87a3646d4a156c5a036c93adb', 'request_id': 'req-11acea73-a136-487b-99dc-1996a304392c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:10.672427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-11acea73-a136-487b-99dc-1996a304392c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197ef4d87a3646d4a156c5a036c93adb', 'request_id': 'req-11acea73-a136-487b-99dc-1996a304392c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:10.679753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1a549c68-4cdb-41ce-998e-0f4daf744912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe8c6d9e3394799a65b4accad98d76a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:10.688373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-11acea73-a136-487b-99dc-1996a304392c admin admin] The token cache is being invalidate because project 197ef4d87a3646d4a156c5a036c93adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:10.689669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-11acea73-a136-487b-99dc-1996a304392c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:10.689790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1a549c68-4cdb-41ce-998e-0f4daf744912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe8c6d9e3394799a65b4accad98d76a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:10.690328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-11acea73-a136-487b-99dc-1996a304392c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:10.696695 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1159/2294] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:10 2021] DELETE /identity/v3/projects/197ef4d87a3646d4a156c5a036c93adb => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:10.696695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba14918-bcf9-45aa-96bf-815c0daf85c7 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:10.696695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba14918-bcf9-45aa-96bf-815c0daf85c7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:10.697541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba14918-bcf9-45aa-96bf-815c0daf85c7 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:10.699832 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1160/2295] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:10 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:48:10.701358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14bd66-b169-44e3-b011-05c641fdfb58 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:10.701926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14bd66-b169-44e3-b011-05c641fdfb58 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:10.702211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14bd66-b169-44e3-b011-05c641fdfb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:10.708049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1a549c68-4cdb-41ce-998e-0f4daf744912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe8c6d9e3394799a65b4accad98d76a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:10.708867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1a549c68-4cdb-41ce-998e-0f4daf744912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe8c6d9e3394799a65b4accad98d76a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:10.720978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1a549c68-4cdb-41ce-998e-0f4daf744912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe8c6d9e3394799a65b4accad98d76a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:10.737302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8c14bd66-b169-44e3-b011-05c641fdfb58 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:10.737302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8c14bd66-b169-44e3-b011-05c641fdfb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:10.751850 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1136/2296] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:10 2021] DELETE /identity/v3/users/afe8c6d9e3394799a65b4accad98d76a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:10.753297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a549c68-4cdb-41ce-998e-0f4daf744912 admin admin] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:10.755165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1a549c68-4cdb-41ce-998e-0f4daf744912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:10.832404 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1161/2297] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:10.834998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33c3f4-64e0-4248-8b76-511e08b08ed7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:10.834998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33c3f4-64e0-4248-8b76-511e08b08ed7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:10.835724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33c3f4-64e0-4248-8b76-511e08b08ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:10.863494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1a33c3f4-64e0-4248-8b76-511e08b08ed7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:10.864861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1a33c3f4-64e0-4248-8b76-511e08b08ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:10.917144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a549c68-4cdb-41ce-998e-0f4daf744912 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:10.920078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1a549c68-4cdb-41ce-998e-0f4daf744912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:10.982977 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1162/2298] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:10.984784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1fddf-c2fa-4c25-bd94-1ce41d4c4ccc None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:10.985165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1fddf-c2fa-4c25-bd94-1ce41d4c4ccc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:10.985808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1fddf-c2fa-4c25-bd94-1ce41d4c4ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:11.019061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-47c1fddf-c2fa-4c25-bd94-1ce41d4c4ccc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:11.021876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-47c1fddf-c2fa-4c25-bd94-1ce41d4c4ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:11.037607 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1163/2299] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:11.042431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a549c68-4cdb-41ce-998e-0f4daf744912 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:11.051258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57add436-b147-44e2-ae61-88a0e9283744 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:11.052894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57add436-b147-44e2-ae61-88a0e9283744 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:11.052894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57add436-b147-44e2-ae61-88a0e9283744 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:11.053550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57add436-b147-44e2-ae61-88a0e9283744 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/projects/5f9d3ce5386447a58506a38417851181` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:11.055523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57add436-b147-44e2-ae61-88a0e9283744 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:get_project(project_id=5f9d3ce5386447a58506a38417851181)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:11.057584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57add436-b147-44e2-ae61-88a0e9283744 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:11.060311 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1137/2300] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:10 2021] GET /identity/v3/projects/5f9d3ce5386447a58506a38417851181 => generated 371 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:11.061451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57add436-b147-44e2-ae61-88a0e9283744 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:11.065509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1fddf-c2fa-4c25-bd94-1ce41d4c4ccc None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:11.072017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-47c1fddf-c2fa-4c25-bd94-1ce41d4c4ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:11.074147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57add436-b147-44e2-ae61-88a0e9283744 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:11.079824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f23f2-9ddc-4456-ac2a-c1590f54a726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:11.081701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f23f2-9ddc-4456-ac2a-c1590f54a726 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:11.081904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f23f2-9ddc-4456-ac2a-c1590f54a726 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:11.082344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f23f2-9ddc-4456-ac2a-c1590f54a726 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:11.083782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f23f2-9ddc-4456-ac2a-c1590f54a726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:11.084238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f23f2-9ddc-4456-ac2a-c1590f54a726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:11.085988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f23f2-9ddc-4456-ac2a-c1590f54a726 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:11.106884 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1138/2301] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:11.110776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f23f2-9ddc-4456-ac2a-c1590f54a726 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:11.156505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f23f2-9ddc-4456-ac2a-c1590f54a726 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:11.173141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff9e3a-6c23-4348-a56f-108cd57ec313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:11.176437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff9e3a-6c23-4348-a56f-108cd57ec313 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:11.177662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff9e3a-6c23-4348-a56f-108cd57ec313 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:11.178016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff9e3a-6c23-4348-a56f-108cd57ec313 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:11.179166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff9e3a-6c23-4348-a56f-108cd57ec313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:11.184597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff9e3a-6c23-4348-a56f-108cd57ec313 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:11.245211 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1139/2302] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:11 2021] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:48:11.246422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff9e3a-6c23-4348-a56f-108cd57ec313 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:11.246566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1fddf-c2fa-4c25-bd94-1ce41d4c4ccc None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:11.338195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ca03c-6f5d-4302-9795-818fbf7b9363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:11.339239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca03c-6f5d-4302-9795-818fbf7b9363 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:11.339543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca03c-6f5d-4302-9795-818fbf7b9363 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:11.339832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca03c-6f5d-4302-9795-818fbf7b9363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:11.340867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff9e3a-6c23-4348-a56f-108cd57ec313 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:11.346230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33ad88-740f-4f50-9690-907d3a9a6c9b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:11.347091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33ad88-740f-4f50-9690-907d3a9a6c9b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:11.347382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33ad88-740f-4f50-9690-907d3a9a6c9b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:11.347714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33ad88-740f-4f50-9690-907d3a9a6c9b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:11.349367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33ad88-740f-4f50-9690-907d3a9a6c9b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:11.349736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33ad88-740f-4f50-9690-907d3a9a6c9b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:11.351614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33ad88-740f-4f50-9690-907d3a9a6c9b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:11.365964 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1140/2303] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:11.366860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33ad88-740f-4f50-9690-907d3a9a6c9b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:11.441053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ca03c-6f5d-4302-9795-818fbf7b9363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:11.445627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ca03c-6f5d-4302-9795-818fbf7b9363 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:11.464336 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1164/2304] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:11.465344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ca03c-6f5d-4302-9795-818fbf7b9363 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:11.472159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33ad88-740f-4f50-9690-907d3a9a6c9b tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:11.485171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ca03c-6f5d-4302-9795-818fbf7b9363 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:11.493005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08241baf-67fc-4604-ad21-311ed234a752 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:11.494422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08241baf-67fc-4604-ad21-311ed234a752 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:11.494710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08241baf-67fc-4604-ad21-311ed234a752 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:11.494991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08241baf-67fc-4604-ad21-311ed234a752 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:11.496420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08241baf-67fc-4604-ad21-311ed234a752 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:11.497953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4935949-33ac-4485-948b-9567192a64bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:11.498542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08241baf-67fc-4604-ad21-311ed234a752 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:11.501278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4935949-33ac-4485-948b-9567192a64bb admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:11.501938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4935949-33ac-4485-948b-9567192a64bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:11.503309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4935949-33ac-4485-948b-9567192a64bb admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:11.506453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4935949-33ac-4485-948b-9567192a64bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:11.511787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4935949-33ac-4485-948b-9567192a64bb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:11.528455 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1165/2305] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:11 2021] POST /identity/v3/users => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:11.534215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08241baf-67fc-4604-ad21-311ed234a752 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:11.554099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08241baf-67fc-4604-ad21-311ed234a752 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:11.558932 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1141/2306] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:11 2021] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:11.559635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390ce12-d1d5-4cce-be5f-ca8690ac76fc tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:11.560434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390ce12-d1d5-4cce-be5f-ca8690ac76fc tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:11.561341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390ce12-d1d5-4cce-be5f-ca8690ac76fc tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:11.561725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390ce12-d1d5-4cce-be5f-ca8690ac76fc tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:11.562619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390ce12-d1d5-4cce-be5f-ca8690ac76fc tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:11.563053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390ce12-d1d5-4cce-be5f-ca8690ac76fc tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:11.563439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4935949-33ac-4485-948b-9567192a64bb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:11.565096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390ce12-d1d5-4cce-be5f-ca8690ac76fc tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:11.588650 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1166/2307] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:11.590973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4935949-33ac-4485-948b-9567192a64bb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:11.596701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66381b80-b388-4dce-b6a7-44c342db240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:11.597531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381b80-b388-4dce-b6a7-44c342db240e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:11.598046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381b80-b388-4dce-b6a7-44c342db240e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:11.598431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381b80-b388-4dce-b6a7-44c342db240e admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:11.599881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66381b80-b388-4dce-b6a7-44c342db240e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:11.601695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66381b80-b388-4dce-b6a7-44c342db240e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:11.613758 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1142/2308] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:11 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:11.617617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390ce12-d1d5-4cce-be5f-ca8690ac76fc tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:11.629326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390ce12-d1d5-4cce-be5f-ca8690ac76fc tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:11.634668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41b9ad-a56b-4179-8f3c-f83b40e19ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:11.635358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41b9ad-a56b-4179-8f3c-f83b40e19ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:11.635641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41b9ad-a56b-4179-8f3c-f83b40e19ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:11.635984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41b9ad-a56b-4179-8f3c-f83b40e19ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:11.636780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41b9ad-a56b-4179-8f3c-f83b40e19ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:11.638534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41b9ad-a56b-4179-8f3c-f83b40e19ad5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:11.651404 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1167/2309] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:11 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:11.655373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66381b80-b388-4dce-b6a7-44c342db240e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:11.667148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66381b80-b388-4dce-b6a7-44c342db240e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:11.672840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16866f09-d1d6-4882-8228-f155fabf9e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:11.673773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16866f09-d1d6-4882-8228-f155fabf9e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:11.674056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16866f09-d1d6-4882-8228-f155fabf9e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:11.674371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16866f09-d1d6-4882-8228-f155fabf9e9a admin admin] PATH_INFO: `/v3/projects/a1d6902ee72c479db1b2d30c1a019a7d/users/2b3dc790a5574ee094b534c3f371edc9/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:11.693517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16866f09-d1d6-4882-8228-f155fabf9e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d6902ee72c479db1b2d30c1a019a7d, user_id=2b3dc790a5574ee094b534c3f371edc9, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:11.696237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16866f09-d1d6-4882-8228-f155fabf9e9a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:11.720529 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1143/2310] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:11 2021] PUT /identity/v3/projects/a1d6902ee72c479db1b2d30c1a019a7d/users/2b3dc790a5574ee094b534c3f371edc9/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:11.732544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18546d54-3743-4a35-82df-9a962934ba32 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:11.732889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18546d54-3743-4a35-82df-9a962934ba32 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:11.733167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18546d54-3743-4a35-82df-9a962934ba32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:11.783754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-18546d54-3743-4a35-82df-9a962934ba32 None None] MFA Rules not processed for user `2b3dc790a5574ee094b534c3f371edc9`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:11.785518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-18546d54-3743-4a35-82df-9a962934ba32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:11.890437 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1168/2311] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:11 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:11.891092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16866f09-d1d6-4882-8228-f155fabf9e9a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:11.988841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16866f09-d1d6-4882-8228-f155fabf9e9a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:11.994489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e8894-660c-4984-a791-fa0788dc8242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:11.995315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e8894-660c-4984-a791-fa0788dc8242 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:11.995673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e8894-660c-4984-a791-fa0788dc8242 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:11.996659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e8894-660c-4984-a791-fa0788dc8242 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:11.997483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e8894-660c-4984-a791-fa0788dc8242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:11.999682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e8894-660c-4984-a791-fa0788dc8242 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:12.035915 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1144/2312] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:11 2021] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:48:12.039041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18546d54-3743-4a35-82df-9a962934ba32 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:12.055278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18546d54-3743-4a35-82df-9a962934ba32 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:12.135378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40011260-5062-43e0-9b31-778e7cc51e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:12.136726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40011260-5062-43e0-9b31-778e7cc51e96 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:12.137072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40011260-5062-43e0-9b31-778e7cc51e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:12.137417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40011260-5062-43e0-9b31-778e7cc51e96 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:12.138639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40011260-5062-43e0-9b31-778e7cc51e96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:12.140789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40011260-5062-43e0-9b31-778e7cc51e96 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:12.166748 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1169/2313] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:12 2021] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:12.171475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e8894-660c-4984-a791-fa0788dc8242 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:12.187020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e8894-660c-4984-a791-fa0788dc8242 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:12.195116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ef042-63e7-4377-9041-6055a4657239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:12.196166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef042-63e7-4377-9041-6055a4657239 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:12.196166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef042-63e7-4377-9041-6055a4657239 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:12.196631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef042-63e7-4377-9041-6055a4657239 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:12.197496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ef042-63e7-4377-9041-6055a4657239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:12.199338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ef042-63e7-4377-9041-6055a4657239 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:12.217382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40011260-5062-43e0-9b31-778e7cc51e96 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:12.217530 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1145/2314] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:12 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:12.228962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40011260-5062-43e0-9b31-778e7cc51e96 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:12.234142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c6538-23a8-473e-a651-ee78875b19ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:12.235165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c6538-23a8-473e-a651-ee78875b19ab admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:12.235565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c6538-23a8-473e-a651-ee78875b19ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:12.235959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c6538-23a8-473e-a651-ee78875b19ab admin admin] PATH_INFO: `/v3/projects/f8fcff759a8746df921652ec15e1f089/users/51bdbbdc83144d92aaa5771a238476f9/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:12.254008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c6538-23a8-473e-a651-ee78875b19ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8fcff759a8746df921652ec15e1f089, user_id=51bdbbdc83144d92aaa5771a238476f9, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:12.257969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c6538-23a8-473e-a651-ee78875b19ab admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:12.282282 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1170/2315] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:12 2021] PUT /identity/v3/projects/f8fcff759a8746df921652ec15e1f089/users/51bdbbdc83144d92aaa5771a238476f9/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:12.287194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ef042-63e7-4377-9041-6055a4657239 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:12.299531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ef042-63e7-4377-9041-6055a4657239 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:12.302935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b118c5-4321-41e3-b906-f9b02a19c649 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:12.303225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b118c5-4321-41e3-b906-f9b02a19c649 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:12.303502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b118c5-4321-41e3-b906-f9b02a19c649 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:12.308302 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1171/2316] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:12 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:48:12.331984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b118c5-4321-41e3-b906-f9b02a19c649 None None] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:12.388441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa479035-896d-4ef2-a43a-848249c084b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:12.389755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa479035-896d-4ef2-a43a-848249c084b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:12.390294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa479035-896d-4ef2-a43a-848249c084b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:12.390681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa479035-896d-4ef2-a43a-848249c084b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:12.392558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa479035-896d-4ef2-a43a-848249c084b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:12.395070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa479035-896d-4ef2-a43a-848249c084b5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:12.409954 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1146/2317] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:12 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:12.412238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48061b65-7a47-49ae-be55-8decb14f0193 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:12.412709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48061b65-7a47-49ae-be55-8decb14f0193 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:12.413909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48061b65-7a47-49ae-be55-8decb14f0193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:12.452272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-48061b65-7a47-49ae-be55-8decb14f0193 None None] MFA Rules not processed for user `b209cee416d043a7badbea4e52f44359`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:12.453831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-48061b65-7a47-49ae-be55-8decb14f0193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:12.493032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b118c5-4321-41e3-b906-f9b02a19c649 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:12.543515 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1147/2318] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:12 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:12.544583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48061b65-7a47-49ae-be55-8decb14f0193 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:12.565668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48061b65-7a47-49ae-be55-8decb14f0193 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:12.572405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edf9fc-60cb-4c97-9ef4-a2d59195283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:12.574876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edf9fc-60cb-4c97-9ef4-a2d59195283b admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:12.575522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edf9fc-60cb-4c97-9ef4-a2d59195283b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:12.576017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edf9fc-60cb-4c97-9ef4-a2d59195283b admin admin] PATH_INFO: `/v3/projects/f8fcff759a8746df921652ec15e1f089/users/51bdbbdc83144d92aaa5771a238476f9/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:12.579371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edf9fc-60cb-4c97-9ef4-a2d59195283b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8fcff759a8746df921652ec15e1f089, user_id=51bdbbdc83144d92aaa5771a238476f9, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:12.583848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edf9fc-60cb-4c97-9ef4-a2d59195283b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:12.600581 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1148/2319] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:12 2021] PUT /identity/v3/projects/f8fcff759a8746df921652ec15e1f089/users/51bdbbdc83144d92aaa5771a238476f9/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:12.603019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6101-d150-4519-960c-099afdf899f3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:12.603527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6101-d150-4519-960c-099afdf899f3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:12.604009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6101-d150-4519-960c-099afdf899f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:12.627233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-51fd6101-d150-4519-960c-099afdf899f3 None None] MFA Rules not processed for user `c971aa1884174ed0acec9d140f2eda87`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:12.629204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-51fd6101-d150-4519-960c-099afdf899f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:12.680409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b118c5-4321-41e3-b906-f9b02a19c649 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:12.740408 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1149/2320] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:12 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:12.742060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13117039-69a7-4628-b984-a64ed1f5e902 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:12.742378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13117039-69a7-4628-b984-a64ed1f5e902 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:12.742668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13117039-69a7-4628-b984-a64ed1f5e902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:12.754953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecaa55-7bac-46c3-9033-13e1cf47420a tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:12.756046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecaa55-7bac-46c3-9033-13e1cf47420a tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:12.756429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecaa55-7bac-46c3-9033-13e1cf47420a tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:12.756811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecaa55-7bac-46c3-9033-13e1cf47420a tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/projects/5f9d3ce5386447a58506a38417851181` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:12.758218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eecaa55-7bac-46c3-9033-13e1cf47420a tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:get_project(project_id=5f9d3ce5386447a58506a38417851181)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:12.760665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eecaa55-7bac-46c3-9033-13e1cf47420a tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:12.762946 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1172/2321] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:12 2021] GET /identity/v3/projects/5f9d3ce5386447a58506a38417851181 => generated 371 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:12.764142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecaa55-7bac-46c3-9033-13e1cf47420a tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:12.765902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3eecaa55-7bac-46c3-9033-13e1cf47420a tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:12.832377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-13117039-69a7-4628-b984-a64ed1f5e902 None None] MFA Rules not processed for user `51bdbbdc83144d92aaa5771a238476f9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:12.837234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-13117039-69a7-4628-b984-a64ed1f5e902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:12.905580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecaa55-7bac-46c3-9033-13e1cf47420a tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:12.924774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fb56a-7922-416e-b9bd-341823aedead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:12.925660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb56a-7922-416e-b9bd-341823aedead admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:12.925941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb56a-7922-416e-b9bd-341823aedead admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:12.926584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb56a-7922-416e-b9bd-341823aedead admin admin] PATH_INFO: `/v3/projects/72ac362813424dc0bbfad71db25ffb7f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:12.935139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fb56a-7922-416e-b9bd-341823aedead admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ac362813424dc0bbfad71db25ffb7f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:12.943521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fb56a-7922-416e-b9bd-341823aedead admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:13.029522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e4fb56a-7922-416e-b9bd-341823aedead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ac362813424dc0bbfad71db25ffb7f', 'request_id': 'req-3e4fb56a-7922-416e-b9bd-341823aedead'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:13.038083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e4fb56a-7922-416e-b9bd-341823aedead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ac362813424dc0bbfad71db25ffb7f', 'request_id': 'req-3e4fb56a-7922-416e-b9bd-341823aedead'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:13.041259 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1150/2322] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:12 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:13.046836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fade61e-4449-4725-82cd-150df30eff80 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:13.047546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fade61e-4449-4725-82cd-150df30eff80 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:13.048286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fade61e-4449-4725-82cd-150df30eff80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:13.051982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e4fb56a-7922-416e-b9bd-341823aedead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ac362813424dc0bbfad71db25ffb7f', 'request_id': 'req-3e4fb56a-7922-416e-b9bd-341823aedead'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:13.066519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e4fb56a-7922-416e-b9bd-341823aedead admin admin] The token cache is being invalidate because project 72ac362813424dc0bbfad71db25ffb7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:13.067072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e4fb56a-7922-416e-b9bd-341823aedead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:13.068421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e4fb56a-7922-416e-b9bd-341823aedead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:13.071187 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1173/2323] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:12 2021] DELETE /identity/v3/projects/72ac362813424dc0bbfad71db25ffb7f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:13.074834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fb56a-7922-416e-b9bd-341823aedead admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:13.077379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3e4fb56a-7922-416e-b9bd-341823aedead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:13.096152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1fade61e-4449-4725-82cd-150df30eff80 None None] MFA Rules not processed for user `c3e0c0d3dc8441968dafc98b902ab349`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:13.097726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1fade61e-4449-4725-82cd-150df30eff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:13.175223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fb56a-7922-416e-b9bd-341823aedead admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:13.181813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b9915-4981-4a59-8204-20153640f921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:13.182969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b9915-4981-4a59-8204-20153640f921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:13.183523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b9915-4981-4a59-8204-20153640f921 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:13.183955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b9915-4981-4a59-8204-20153640f921 admin admin] PATH_INFO: `/v3/users/9f528e62e8e347928f5082b0fc19daa6` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:13.185634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b9915-4981-4a59-8204-20153640f921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f528e62e8e347928f5082b0fc19daa6)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:13.188898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b9915-4981-4a59-8204-20153640f921 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:13.217164 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1151/2324] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:13 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:13.252295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-801b9915-4981-4a59-8204-20153640f921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f528e62e8e347928f5082b0fc19daa6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:13.259739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-801b9915-4981-4a59-8204-20153640f921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f528e62e8e347928f5082b0fc19daa6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:13.260451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-801b9915-4981-4a59-8204-20153640f921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f528e62e8e347928f5082b0fc19daa6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:13.276056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-801b9915-4981-4a59-8204-20153640f921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f528e62e8e347928f5082b0fc19daa6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:13.284424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-801b9915-4981-4a59-8204-20153640f921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f528e62e8e347928f5082b0fc19daa6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:13.292096 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1174/2325] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:13 2021] DELETE /identity/v3/users/9f528e62e8e347928f5082b0fc19daa6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:13.451178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fade61e-4449-4725-82cd-150df30eff80 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:13.452732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1fade61e-4449-4725-82cd-150df30eff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:13.547972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77b189-57f0-433a-ba17-f175d66c2211 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:13.548870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77b189-57f0-433a-ba17-f175d66c2211 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:13.549357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77b189-57f0-433a-ba17-f175d66c2211 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:13.552154 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1175/2326] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:48:13.558942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77b189-57f0-433a-ba17-f175d66c2211 None None] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:13.560692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8f77b189-57f0-433a-ba17-f175d66c2211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:13.611469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fade61e-4449-4725-82cd-150df30eff80 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:13.694070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77b189-57f0-433a-ba17-f175d66c2211 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:13.695640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8f77b189-57f0-433a-ba17-f175d66c2211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:13.740684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847203e-6391-4452-9550-8877f1fc8196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:13.741180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847203e-6391-4452-9550-8877f1fc8196 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:13.741614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847203e-6391-4452-9550-8877f1fc8196 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:13.742330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847203e-6391-4452-9550-8877f1fc8196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:13.745028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e847203e-6391-4452-9550-8877f1fc8196 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:13.803106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77b189-57f0-433a-ba17-f175d66c2211 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:13.808201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb32b54-282b-4b5d-85b1-00c4f21ec3d4 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:13.809061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb32b54-282b-4b5d-85b1-00c4f21ec3d4 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:13.809356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb32b54-282b-4b5d-85b1-00c4f21ec3d4 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:13.809690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb32b54-282b-4b5d-85b1-00c4f21ec3d4 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/projects/5f9d3ce5386447a58506a38417851181` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:13.812603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb32b54-282b-4b5d-85b1-00c4f21ec3d4 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:get_project(project_id=5f9d3ce5386447a58506a38417851181)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:13.814719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb32b54-282b-4b5d-85b1-00c4f21ec3d4 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:13.827086 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1176/2327] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:13 2021] GET /identity/v3/projects/5f9d3ce5386447a58506a38417851181 => generated 371 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:48:13.827976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb32b54-282b-4b5d-85b1-00c4f21ec3d4 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:13.832580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-eeb32b54-282b-4b5d-85b1-00c4f21ec3d4 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:13.833064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847203e-6391-4452-9550-8877f1fc8196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:13.837579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847203e-6391-4452-9550-8877f1fc8196 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:13.852152 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1152/2328] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:13 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:13.868436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847203e-6391-4452-9550-8877f1fc8196 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:13.896376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847203e-6391-4452-9550-8877f1fc8196 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:13.907854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e813f41-602d-486f-a605-ff34ff61ea08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:13.909796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e813f41-602d-486f-a605-ff34ff61ea08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:13.910192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e813f41-602d-486f-a605-ff34ff61ea08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:13.911345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e813f41-602d-486f-a605-ff34ff61ea08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/users/45dca67b2e16488d85798a7a79a74f90` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:13.939953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e813f41-602d-486f-a605-ff34ff61ea08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:delete_user(user_id=45dca67b2e16488d85798a7a79a74f90)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:13.945147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e813f41-602d-486f-a605-ff34ff61ea08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:13.997033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb32b54-282b-4b5d-85b1-00c4f21ec3d4 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:14.012288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2147c4-c6d5-4212-8750-968c1474decc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:14.013356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2147c4-c6d5-4212-8750-968c1474decc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:14.013356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2147c4-c6d5-4212-8750-968c1474decc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:14.013632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2147c4-c6d5-4212-8750-968c1474decc admin admin] PATH_INFO: `/v3/projects/6b1cffe364174f36b159963293f7014e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:14.018024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2147c4-c6d5-4212-8750-968c1474decc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1cffe364174f36b159963293f7014e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:14.020051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2147c4-c6d5-4212-8750-968c1474decc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:14.045987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1e813f41-602d-486f-a605-ff34ff61ea08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45dca67b2e16488d85798a7a79a74f90'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:14.069071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1e813f41-602d-486f-a605-ff34ff61ea08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45dca67b2e16488d85798a7a79a74f90'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:14.083322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1e813f41-602d-486f-a605-ff34ff61ea08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45dca67b2e16488d85798a7a79a74f90'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:14.084231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1e813f41-602d-486f-a605-ff34ff61ea08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45dca67b2e16488d85798a7a79a74f90'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:14.094456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1e813f41-602d-486f-a605-ff34ff61ea08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45dca67b2e16488d85798a7a79a74f90'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:14.107919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4a2147c4-c6d5-4212-8750-968c1474decc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1cffe364174f36b159963293f7014e', 'request_id': 'req-4a2147c4-c6d5-4212-8750-968c1474decc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:14.112544 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1153/2329] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:13 2021] DELETE /identity/v3/users/45dca67b2e16488d85798a7a79a74f90 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:14.116641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e813f41-602d-486f-a605-ff34ff61ea08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:14.120471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4a2147c4-c6d5-4212-8750-968c1474decc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1cffe364174f36b159963293f7014e', 'request_id': 'req-4a2147c4-c6d5-4212-8750-968c1474decc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:14.120741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1e813f41-602d-486f-a605-ff34ff61ea08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:14.131946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4a2147c4-c6d5-4212-8750-968c1474decc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1cffe364174f36b159963293f7014e', 'request_id': 'req-4a2147c4-c6d5-4212-8750-968c1474decc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:14.146888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4a2147c4-c6d5-4212-8750-968c1474decc admin admin] The token cache is being invalidate because project 6b1cffe364174f36b159963293f7014e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:14.147365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4a2147c4-c6d5-4212-8750-968c1474decc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:14.148264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4a2147c4-c6d5-4212-8750-968c1474decc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:14.155549 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1177/2330] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:13 2021] DELETE /identity/v3/projects/6b1cffe364174f36b159963293f7014e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:14.158817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633db4e-c24b-4d73-b06f-dba91f02f5c2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:14.159402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633db4e-c24b-4d73-b06f-dba91f02f5c2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:14.160684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633db4e-c24b-4d73-b06f-dba91f02f5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:14.195395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0633db4e-c24b-4d73-b06f-dba91f02f5c2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:14.197304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0633db4e-c24b-4d73-b06f-dba91f02f5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:14.225522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e813f41-602d-486f-a605-ff34ff61ea08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:14.232962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375857b-6ae0-4879-9ed7-3faa75991a08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:14.234106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375857b-6ae0-4879-9ed7-3faa75991a08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:14.234542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375857b-6ae0-4879-9ed7-3faa75991a08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:14.234927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375857b-6ae0-4879-9ed7-3faa75991a08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/projects/5f9d3ce5386447a58506a38417851181` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:14.237405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375857b-6ae0-4879-9ed7-3faa75991a08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5f9d3ce5386447a58506a38417851181)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:14.240359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375857b-6ae0-4879-9ed7-3faa75991a08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:14.291498 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1178/2331] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:14.300481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a02b12-4cac-4ac6-8a76-aac7febe361d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:14.301109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a02b12-4cac-4ac6-8a76-aac7febe361d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:14.301595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a02b12-4cac-4ac6-8a76-aac7febe361d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:14.309033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d375857b-6ae0-4879-9ed7-3faa75991a08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f9d3ce5386447a58506a38417851181', 'request_id': 'req-d375857b-6ae0-4879-9ed7-3faa75991a08'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:14.317933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d375857b-6ae0-4879-9ed7-3faa75991a08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f9d3ce5386447a58506a38417851181', 'request_id': 'req-d375857b-6ae0-4879-9ed7-3faa75991a08'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:14.326961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d375857b-6ae0-4879-9ed7-3faa75991a08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f9d3ce5386447a58506a38417851181', 'request_id': 'req-d375857b-6ae0-4879-9ed7-3faa75991a08'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:14.327598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-42a02b12-4cac-4ac6-8a76-aac7febe361d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:14.329327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-42a02b12-4cac-4ac6-8a76-aac7febe361d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:14.345167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d375857b-6ae0-4879-9ed7-3faa75991a08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] The token cache is being invalidate because project 5f9d3ce5386447a58506a38417851181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:14.346016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d375857b-6ae0-4879-9ed7-3faa75991a08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:14.347503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d375857b-6ae0-4879-9ed7-3faa75991a08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:14.350576 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1154/2332] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:14 2021] DELETE /identity/v3/projects/5f9d3ce5386447a58506a38417851181 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:14.407333 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1179/2333] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:14.409354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375857b-6ae0-4879-9ed7-3faa75991a08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:14.424653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375857b-6ae0-4879-9ed7-3faa75991a08 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:14.431395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38638b-7c39-409e-baf3-7a30711fcf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:14.432876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38638b-7c39-409e-baf3-7a30711fcf18 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:14.433273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38638b-7c39-409e-baf3-7a30711fcf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:14.433661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38638b-7c39-409e-baf3-7a30711fcf18 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:14.434647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38638b-7c39-409e-baf3-7a30711fcf18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:14.435063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38638b-7c39-409e-baf3-7a30711fcf18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:14.437290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38638b-7c39-409e-baf3-7a30711fcf18 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:14.466343 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1155/2334] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:14.467303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a02b12-4cac-4ac6-8a76-aac7febe361d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:14.478040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a02b12-4cac-4ac6-8a76-aac7febe361d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:14.483787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde53fa-30e6-4dfa-9d07-214399a931a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:14.484812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde53fa-30e6-4dfa-9d07-214399a931a9 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:14.485199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde53fa-30e6-4dfa-9d07-214399a931a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:14.485593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde53fa-30e6-4dfa-9d07-214399a931a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:14.486438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde53fa-30e6-4dfa-9d07-214399a931a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:14.488475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde53fa-30e6-4dfa-9d07-214399a931a9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:14.523819 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1180/2335] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:14 2021] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:14.525292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38638b-7c39-409e-baf3-7a30711fcf18 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:14.535035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38638b-7c39-409e-baf3-7a30711fcf18 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:14.602059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c2292-330b-4884-a093-dbde8e3568b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:14.602768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c2292-330b-4884-a093-dbde8e3568b0 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:14.603057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c2292-330b-4884-a093-dbde8e3568b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:14.603340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c2292-330b-4884-a093-dbde8e3568b0 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:14.604099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c2292-330b-4884-a093-dbde8e3568b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:14.605991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c2292-330b-4884-a093-dbde8e3568b0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:14.626710 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1156/2336] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:14 2021] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:48:14.631171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde53fa-30e6-4dfa-9d07-214399a931a9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:14.641713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde53fa-30e6-4dfa-9d07-214399a931a9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:14.647073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496dd5f-a939-4e36-8958-2ddd5224de8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:14.647709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496dd5f-a939-4e36-8958-2ddd5224de8b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:14.647987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496dd5f-a939-4e36-8958-2ddd5224de8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:14.648259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496dd5f-a939-4e36-8958-2ddd5224de8b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:14.649004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496dd5f-a939-4e36-8958-2ddd5224de8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:14.650589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496dd5f-a939-4e36-8958-2ddd5224de8b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:14.661998 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1181/2337] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:14.665599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c2292-330b-4884-a093-dbde8e3568b0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:14.676045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c2292-330b-4884-a093-dbde8e3568b0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:14.681267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e012b-ae55-4a8c-b76d-f1071f157150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:14.681957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e012b-ae55-4a8c-b76d-f1071f157150 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:14.682238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e012b-ae55-4a8c-b76d-f1071f157150 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:14.682711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e012b-ae55-4a8c-b76d-f1071f157150 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:14.683459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e012b-ae55-4a8c-b76d-f1071f157150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:14.685045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e012b-ae55-4a8c-b76d-f1071f157150 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:14.695930 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1157/2338] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:14.700052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496dd5f-a939-4e36-8958-2ddd5224de8b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:14.711054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496dd5f-a939-4e36-8958-2ddd5224de8b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:14.715667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f989f1-7bd7-45d1-a2a7-7fe3abbe3e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:14.716552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f989f1-7bd7-45d1-a2a7-7fe3abbe3e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:14.716835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f989f1-7bd7-45d1-a2a7-7fe3abbe3e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:14.717115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f989f1-7bd7-45d1-a2a7-7fe3abbe3e88 admin admin] PATH_INFO: `/v3/projects/7286e278b6294224b331fcb637118978/users/ca5eba837bd74068801f94e347a1d387/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:14.736897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f989f1-7bd7-45d1-a2a7-7fe3abbe3e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7286e278b6294224b331fcb637118978, user_id=ca5eba837bd74068801f94e347a1d387, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:14.741296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f989f1-7bd7-45d1-a2a7-7fe3abbe3e88 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:14.762866 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1182/2339] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:14 2021] PUT /identity/v3/projects/7286e278b6294224b331fcb637118978/users/ca5eba837bd74068801f94e347a1d387/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:14.773760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daf9f3-f5dd-4329-bf0b-a3e134e18688 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:14.774284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daf9f3-f5dd-4329-bf0b-a3e134e18688 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:14.774606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daf9f3-f5dd-4329-bf0b-a3e134e18688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:14.805475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-94daf9f3-f5dd-4329-bf0b-a3e134e18688 None None] MFA Rules not processed for user `ca5eba837bd74068801f94e347a1d387`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:14.810689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-94daf9f3-f5dd-4329-bf0b-a3e134e18688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:14.907262 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1158/2340] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:14 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:14.912517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f989f1-7bd7-45d1-a2a7-7fe3abbe3e88 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:15.013387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f989f1-7bd7-45d1-a2a7-7fe3abbe3e88 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:15.019254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f7904-57a2-4252-8897-6926b17f6132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:15.020076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f7904-57a2-4252-8897-6926b17f6132 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:15.020365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f7904-57a2-4252-8897-6926b17f6132 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:15.021201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f7904-57a2-4252-8897-6926b17f6132 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:15.021914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f7904-57a2-4252-8897-6926b17f6132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:15.023866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f7904-57a2-4252-8897-6926b17f6132 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:15.059853 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1183/2341] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:14 2021] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:15.063330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daf9f3-f5dd-4329-bf0b-a3e134e18688 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:15.083941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daf9f3-f5dd-4329-bf0b-a3e134e18688 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:15.210108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7cd47-eeed-4f12-bae9-1554f22e07a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:15.211761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7cd47-eeed-4f12-bae9-1554f22e07a2 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:15.212696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7cd47-eeed-4f12-bae9-1554f22e07a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:15.212696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7cd47-eeed-4f12-bae9-1554f22e07a2 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:15.213449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7cd47-eeed-4f12-bae9-1554f22e07a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:15.216567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7cd47-eeed-4f12-bae9-1554f22e07a2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:15.253978 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1159/2342] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:15 2021] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:48:15.256775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f7904-57a2-4252-8897-6926b17f6132 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:15.269710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525034bf-48ba-4c78-84c1-188abdcd0f65 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:15.271152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525034bf-48ba-4c78-84c1-188abdcd0f65 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:15.271786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525034bf-48ba-4c78-84c1-188abdcd0f65 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:15.280189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f7904-57a2-4252-8897-6926b17f6132 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:15.287539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b44aa-18d9-463e-b165-64a23635be44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:15.290618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b44aa-18d9-463e-b165-64a23635be44 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:15.291827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b44aa-18d9-463e-b165-64a23635be44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:15.292674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b44aa-18d9-463e-b165-64a23635be44 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:15.293006 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1160/2343] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:15 2021] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:48:15.294078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b44aa-18d9-463e-b165-64a23635be44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:15.296577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b44aa-18d9-463e-b165-64a23635be44 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:15.309728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525034bf-48ba-4c78-84c1-188abdcd0f65 None None] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:15.312227 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1184/2344] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:15 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:15.318395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-525034bf-48ba-4c78-84c1-188abdcd0f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:15.335445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b44aa-18d9-463e-b165-64a23635be44 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:15.373052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b44aa-18d9-463e-b165-64a23635be44 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:15.393699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfe93a-6ab7-4e14-a7d4-4d9f34e24059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:15.394967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfe93a-6ab7-4e14-a7d4-4d9f34e24059 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:15.395331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfe93a-6ab7-4e14-a7d4-4d9f34e24059 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:15.396218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfe93a-6ab7-4e14-a7d4-4d9f34e24059 admin admin] PATH_INFO: `/v3/projects/77ca7f8d9693423bab58b84815724382/users/e4c39ffd8cdf4111aebb8bf00c207cee/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:15.422182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfe93a-6ab7-4e14-a7d4-4d9f34e24059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ca7f8d9693423bab58b84815724382, user_id=e4c39ffd8cdf4111aebb8bf00c207cee, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:15.425761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfe93a-6ab7-4e14-a7d4-4d9f34e24059 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:15.434404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525034bf-48ba-4c78-84c1-188abdcd0f65 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:15.436334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-525034bf-48ba-4c78-84c1-188abdcd0f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:15.453044 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1185/2345] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:15 2021] PUT /identity/v3/projects/77ca7f8d9693423bab58b84815724382/users/e4c39ffd8cdf4111aebb8bf00c207cee/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:15.456680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfe93a-6ab7-4e14-a7d4-4d9f34e24059 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:15.550020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfe93a-6ab7-4e14-a7d4-4d9f34e24059 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:15.562760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9c1b3-2de2-4ad9-a0a8-61bfcd915d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:15.562760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c1b3-2de2-4ad9-a0a8-61bfcd915d57 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:15.562760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c1b3-2de2-4ad9-a0a8-61bfcd915d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:15.562760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c1b3-2de2-4ad9-a0a8-61bfcd915d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:15.563031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9c1b3-2de2-4ad9-a0a8-61bfcd915d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:15.563031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9c1b3-2de2-4ad9-a0a8-61bfcd915d57 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:15.575252 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1186/2346] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:15 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:15.579114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9c1b3-2de2-4ad9-a0a8-61bfcd915d57 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:15.590544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9c1b3-2de2-4ad9-a0a8-61bfcd915d57 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:15.591689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525034bf-48ba-4c78-84c1-188abdcd0f65 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:15.596917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7698d7-2026-43bc-8286-18c542e9dae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:15.597876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7698d7-2026-43bc-8286-18c542e9dae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:15.598227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7698d7-2026-43bc-8286-18c542e9dae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:15.598658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7698d7-2026-43bc-8286-18c542e9dae3 admin admin] PATH_INFO: `/v3/projects/77ca7f8d9693423bab58b84815724382/users/e4c39ffd8cdf4111aebb8bf00c207cee/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:15.601094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7698d7-2026-43bc-8286-18c542e9dae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ca7f8d9693423bab58b84815724382, user_id=e4c39ffd8cdf4111aebb8bf00c207cee, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:15.604567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7698d7-2026-43bc-8286-18c542e9dae3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:15.615895 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1187/2347] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:15 2021] PUT /identity/v3/projects/77ca7f8d9693423bab58b84815724382/users/e4c39ffd8cdf4111aebb8bf00c207cee/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:15.625771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a98e9-f3bd-4a10-a75d-cbe34f822078 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:15.626165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a98e9-f3bd-4a10-a75d-cbe34f822078 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:15.626480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a98e9-f3bd-4a10-a75d-cbe34f822078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:15.650025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70359f1-70f5-4b3c-9bc1-e8c7e52f6a7f tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:15.650981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70359f1-70f5-4b3c-9bc1-e8c7e52f6a7f tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:15.651276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70359f1-70f5-4b3c-9bc1-e8c7e52f6a7f tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:15.651560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70359f1-70f5-4b3c-9bc1-e8c7e52f6a7f tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/projects/4dcf3c5f1734482aa4846eb77a17abdf` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:15.652941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70359f1-70f5-4b3c-9bc1-e8c7e52f6a7f tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:get_project(project_id=4dcf3c5f1734482aa4846eb77a17abdf)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:15.653944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-818a98e9-f3bd-4a10-a75d-cbe34f822078 None None] MFA Rules not processed for user `e4c39ffd8cdf4111aebb8bf00c207cee`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:15.655027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70359f1-70f5-4b3c-9bc1-e8c7e52f6a7f tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:15.655179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-818a98e9-f3bd-4a10-a75d-cbe34f822078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:15.657025 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1161/2348] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:15 2021] GET /identity/v3/projects/4dcf3c5f1734482aa4846eb77a17abdf => generated 373 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:15.751122 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1188/2349] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:15 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:48:15.970827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef31cf-6225-4c7b-9c9c-bc9982233657 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:15.971191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef31cf-6225-4c7b-9c9c-bc9982233657 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:15.971573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef31cf-6225-4c7b-9c9c-bc9982233657 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:15.973340 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1162/2350] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:48:15.978561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a98e9-f3bd-4a10-a75d-cbe34f822078 None None] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:16.046378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a98e9-f3bd-4a10-a75d-cbe34f822078 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:16.104769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a98e9-f3bd-4a10-a75d-cbe34f822078 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:16.109711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09edbf-dcf9-4dd9-a8f3-8ef1d1826184 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:16.110633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09edbf-dcf9-4dd9-a8f3-8ef1d1826184 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:16.110917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09edbf-dcf9-4dd9-a8f3-8ef1d1826184 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:16.111193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09edbf-dcf9-4dd9-a8f3-8ef1d1826184 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/projects/4dcf3c5f1734482aa4846eb77a17abdf` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:16.112384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09edbf-dcf9-4dd9-a8f3-8ef1d1826184 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:get_project(project_id=4dcf3c5f1734482aa4846eb77a17abdf)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:16.114943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09edbf-dcf9-4dd9-a8f3-8ef1d1826184 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:16.116843 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1189/2351] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:15 2021] GET /identity/v3/projects/4dcf3c5f1734482aa4846eb77a17abdf => generated 373 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:16.403602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef31cf-6225-4c7b-9c9c-bc9982233657 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:16.418050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef31cf-6225-4c7b-9c9c-bc9982233657 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:16.423646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b1818-5399-4a21-b347-442479b61832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:16.424901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b1818-5399-4a21-b347-442479b61832 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:16.424901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b1818-5399-4a21-b347-442479b61832 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:16.424901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b1818-5399-4a21-b347-442479b61832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:16.434384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b1818-5399-4a21-b347-442479b61832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:16.436350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b1818-5399-4a21-b347-442479b61832 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:16.446826 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1163/2352] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:16 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:16.947675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e68fb6-e9bc-4e13-a5a2-4091b6136857 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:16.948199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e68fb6-e9bc-4e13-a5a2-4091b6136857 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:16.948433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e68fb6-e9bc-4e13-a5a2-4091b6136857 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:16.951504 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1190/2353] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:48:16.961263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b1818-5399-4a21-b347-442479b61832 service nova] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:16.977732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b1818-5399-4a21-b347-442479b61832 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:16.998042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b1818-5399-4a21-b347-442479b61832 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:17.004301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407908c-c17e-45c5-a22b-b115afdd24e1 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2168e77fd0249ab9eaa30de15642827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75970225ffe4928bfc3eabbc3bc24ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:17.005984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407908c-c17e-45c5-a22b-b115afdd24e1 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:17.006449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407908c-c17e-45c5-a22b-b115afdd24e1 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:17.006840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407908c-c17e-45c5-a22b-b115afdd24e1 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] PATH_INFO: `/v3/projects/4dcf3c5f1734482aa4846eb77a17abdf` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:17.008134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407908c-c17e-45c5-a22b-b115afdd24e1 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorizing `identity:get_project(project_id=4dcf3c5f1734482aa4846eb77a17abdf)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:17.010705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407908c-c17e-45c5-a22b-b115afdd24e1 tempest-QuotasAdminTestJSON-783478242 tempest-QuotasAdminTestJSON-783478242-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:17.012937 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1164/2354] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:16 2021] GET /identity/v3/projects/4dcf3c5f1734482aa4846eb77a17abdf => generated 373 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:17.440506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e68fb6-e9bc-4e13-a5a2-4091b6136857 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:17.443173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a4e68fb6-e9bc-4e13-a5a2-4091b6136857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:17.528487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e68fb6-e9bc-4e13-a5a2-4091b6136857 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:17.538507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f8267-6725-4c23-a10c-16039f41c373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:17.539849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f8267-6725-4c23-a10c-16039f41c373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:17.541572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f8267-6725-4c23-a10c-16039f41c373 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:17.542146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f8267-6725-4c23-a10c-16039f41c373 admin admin] PATH_INFO: `/v3/users/753730fe5830467c80a5f0842d89e3bf` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:17.548715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f8267-6725-4c23-a10c-16039f41c373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=753730fe5830467c80a5f0842d89e3bf)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:17.551794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f8267-6725-4c23-a10c-16039f41c373 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:17.645630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5c6f8267-6725-4c23-a10c-16039f41c373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '753730fe5830467c80a5f0842d89e3bf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:17.662074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5c6f8267-6725-4c23-a10c-16039f41c373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '753730fe5830467c80a5f0842d89e3bf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:17.664353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5c6f8267-6725-4c23-a10c-16039f41c373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '753730fe5830467c80a5f0842d89e3bf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:17.688650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5c6f8267-6725-4c23-a10c-16039f41c373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '753730fe5830467c80a5f0842d89e3bf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:17.701157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5c6f8267-6725-4c23-a10c-16039f41c373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '753730fe5830467c80a5f0842d89e3bf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:17.714361 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1191/2355] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:17 2021] DELETE /identity/v3/users/753730fe5830467c80a5f0842d89e3bf => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:17.714586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa34a2a-3563-47d2-aedd-3fb567b521b3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:17.714586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa34a2a-3563-47d2-aedd-3fb567b521b3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:17.715771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa34a2a-3563-47d2-aedd-3fb567b521b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:17.737690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1aa34a2a-3563-47d2-aedd-3fb567b521b3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:17.737690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1aa34a2a-3563-47d2-aedd-3fb567b521b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:17.798082 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1165/2356] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:17.820848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f8267-6725-4c23-a10c-16039f41c373 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:17.823329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5c6f8267-6725-4c23-a10c-16039f41c373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:17.933101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f8267-6725-4c23-a10c-16039f41c373 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:17.950610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ba699-3f6f-4a29-8046-2ac46b2fe257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:17.951543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ba699-3f6f-4a29-8046-2ac46b2fe257 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:17.952557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ba699-3f6f-4a29-8046-2ac46b2fe257 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:17.952837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ba699-3f6f-4a29-8046-2ac46b2fe257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:17.975418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ba699-3f6f-4a29-8046-2ac46b2fe257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:17.977333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ba699-3f6f-4a29-8046-2ac46b2fe257 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:17.993504 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1192/2357] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:19.041855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa34a2a-3563-47d2-aedd-3fb567b521b3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:19.043525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1aa34a2a-3563-47d2-aedd-3fb567b521b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:19.063943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa34a2a-3563-47d2-aedd-3fb567b521b3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:19.066392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ba699-3f6f-4a29-8046-2ac46b2fe257 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:19.070032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8c3ba699-3f6f-4a29-8046-2ac46b2fe257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:19.081516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8d47c-dfce-45e6-a199-516cdb19f687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:19.082610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8d47c-dfce-45e6-a199-516cdb19f687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:19.083630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8d47c-dfce-45e6-a199-516cdb19f687 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:19.084050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8d47c-dfce-45e6-a199-516cdb19f687 admin admin] PATH_INFO: `/v3/projects/4dcf3c5f1734482aa4846eb77a17abdf` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:19.086708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e8d47c-dfce-45e6-a199-516cdb19f687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dcf3c5f1734482aa4846eb77a17abdf)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:19.095270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e8d47c-dfce-45e6-a199-516cdb19f687 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:19.191234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ba699-3f6f-4a29-8046-2ac46b2fe257 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:19.234305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0e8d47c-dfce-45e6-a199-516cdb19f687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dcf3c5f1734482aa4846eb77a17abdf', 'request_id': 'req-d0e8d47c-dfce-45e6-a199-516cdb19f687'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:19.248142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0e8d47c-dfce-45e6-a199-516cdb19f687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dcf3c5f1734482aa4846eb77a17abdf', 'request_id': 'req-d0e8d47c-dfce-45e6-a199-516cdb19f687'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:19.257427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0e8d47c-dfce-45e6-a199-516cdb19f687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dcf3c5f1734482aa4846eb77a17abdf', 'request_id': 'req-d0e8d47c-dfce-45e6-a199-516cdb19f687'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:19.286613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0e8d47c-dfce-45e6-a199-516cdb19f687 admin admin] The token cache is being invalidate because project 4dcf3c5f1734482aa4846eb77a17abdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:19.287605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0e8d47c-dfce-45e6-a199-516cdb19f687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:19.289965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0e8d47c-dfce-45e6-a199-516cdb19f687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:19.292838 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1166/2358] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:19 2021] DELETE /identity/v3/projects/4dcf3c5f1734482aa4846eb77a17abdf => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:19.298053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8d47c-dfce-45e6-a199-516cdb19f687 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:19.311791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d0e8d47c-dfce-45e6-a199-516cdb19f687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:19.342464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb063a-e6ca-4b5c-bff2-aa3507bb61d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:19.343115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb063a-e6ca-4b5c-bff2-aa3507bb61d8 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:19.343394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb063a-e6ca-4b5c-bff2-aa3507bb61d8 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:19.343668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb063a-e6ca-4b5c-bff2-aa3507bb61d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:19.345489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-94fb063a-e6ca-4b5c-bff2-aa3507bb61d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:19.414655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8d47c-dfce-45e6-a199-516cdb19f687 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:19.419631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a19f1-444d-4dcb-8c35-4a6b161e5207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:19.420651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a19f1-444d-4dcb-8c35-4a6b161e5207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:19.420943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a19f1-444d-4dcb-8c35-4a6b161e5207 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:19.421146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb063a-e6ca-4b5c-bff2-aa3507bb61d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:19.422057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a19f1-444d-4dcb-8c35-4a6b161e5207 admin admin] PATH_INFO: `/v3/users/c2168e77fd0249ab9eaa30de15642827` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:19.423376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb063a-e6ca-4b5c-bff2-aa3507bb61d8 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:19.423490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a19f1-444d-4dcb-8c35-4a6b161e5207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2168e77fd0249ab9eaa30de15642827)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:19.425334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a19f1-444d-4dcb-8c35-4a6b161e5207 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:19.434718 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1193/2359] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:19 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:19.507767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-249a19f1-444d-4dcb-8c35-4a6b161e5207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2168e77fd0249ab9eaa30de15642827'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:19.518908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-249a19f1-444d-4dcb-8c35-4a6b161e5207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2168e77fd0249ab9eaa30de15642827'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:19.537853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-249a19f1-444d-4dcb-8c35-4a6b161e5207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2168e77fd0249ab9eaa30de15642827'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:19.538720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-249a19f1-444d-4dcb-8c35-4a6b161e5207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2168e77fd0249ab9eaa30de15642827'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:19.553297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-249a19f1-444d-4dcb-8c35-4a6b161e5207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2168e77fd0249ab9eaa30de15642827'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:19.563077 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1167/2360] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:19 2021] DELETE /identity/v3/users/c2168e77fd0249ab9eaa30de15642827 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:20.449543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb063a-e6ca-4b5c-bff2-aa3507bb61d8 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:20.466573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb063a-e6ca-4b5c-bff2-aa3507bb61d8 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:20.586140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd593989-3a92-4f2e-aebc-155da459ba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:20.587044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd593989-3a92-4f2e-aebc-155da459ba6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:20.587490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd593989-3a92-4f2e-aebc-155da459ba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:20.587935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd593989-3a92-4f2e-aebc-155da459ba6e admin admin] PATH_INFO: `/v3/projects/d75970225ffe4928bfc3eabbc3bc24ed` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:20.589559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd593989-3a92-4f2e-aebc-155da459ba6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d75970225ffe4928bfc3eabbc3bc24ed)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:20.591708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd593989-3a92-4f2e-aebc-155da459ba6e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:20.651017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dd593989-3a92-4f2e-aebc-155da459ba6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd75970225ffe4928bfc3eabbc3bc24ed', 'request_id': 'req-dd593989-3a92-4f2e-aebc-155da459ba6e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:20.659813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dd593989-3a92-4f2e-aebc-155da459ba6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd75970225ffe4928bfc3eabbc3bc24ed', 'request_id': 'req-dd593989-3a92-4f2e-aebc-155da459ba6e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:20.669538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dd593989-3a92-4f2e-aebc-155da459ba6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd75970225ffe4928bfc3eabbc3bc24ed', 'request_id': 'req-dd593989-3a92-4f2e-aebc-155da459ba6e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:20.690101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dd593989-3a92-4f2e-aebc-155da459ba6e admin admin] The token cache is being invalidate because project d75970225ffe4928bfc3eabbc3bc24ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:20.690337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dd593989-3a92-4f2e-aebc-155da459ba6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:20.691273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dd593989-3a92-4f2e-aebc-155da459ba6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:20.693488 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1194/2361] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:20 2021] DELETE /identity/v3/projects/d75970225ffe4928bfc3eabbc3bc24ed => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:20.700542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffe0bc-c225-467d-bdb1-9e0c2b415283 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:20.701085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffe0bc-c225-467d-bdb1-9e0c2b415283 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:20.701085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffe0bc-c225-467d-bdb1-9e0c2b415283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:20.720784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-cbffe0bc-c225-467d-bdb1-9e0c2b415283 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:20.722133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cbffe0bc-c225-467d-bdb1-9e0c2b415283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:20.790342 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1168/2362] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:20.792636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb76306-5b4a-4588-9bdd-d1056f5cdfbf None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:20.792996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb76306-5b4a-4588-9bdd-d1056f5cdfbf None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:20.793352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb76306-5b4a-4588-9bdd-d1056f5cdfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:20.813519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-adb76306-5b4a-4588-9bdd-d1056f5cdfbf None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:20.814857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-adb76306-5b4a-4588-9bdd-d1056f5cdfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:20.824688 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1195/2363] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:48:20.830109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffe0bc-c225-467d-bdb1-9e0c2b415283 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:20.849847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffe0bc-c225-467d-bdb1-9e0c2b415283 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:20.855730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239bdcc-6306-4895-a240-9cd48f06c348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:20.856543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239bdcc-6306-4895-a240-9cd48f06c348 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:20.856938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239bdcc-6306-4895-a240-9cd48f06c348 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:20.857348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239bdcc-6306-4895-a240-9cd48f06c348 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:20.858923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239bdcc-6306-4895-a240-9cd48f06c348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:20.859454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239bdcc-6306-4895-a240-9cd48f06c348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:20.861254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239bdcc-6306-4895-a240-9cd48f06c348 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:20.875122 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1169/2364] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:20.879467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb76306-5b4a-4588-9bdd-d1056f5cdfbf None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:20.891871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb76306-5b4a-4588-9bdd-d1056f5cdfbf None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:20.904243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8b43f-004a-4dd1-845f-4966d4199070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:20.904924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8b43f-004a-4dd1-845f-4966d4199070 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:20.905208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8b43f-004a-4dd1-845f-4966d4199070 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:20.905485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8b43f-004a-4dd1-845f-4966d4199070 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:20.906200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8b43f-004a-4dd1-845f-4966d4199070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:20.908637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8b43f-004a-4dd1-845f-4966d4199070 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:20.959028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239bdcc-6306-4895-a240-9cd48f06c348 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:20.966568 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1196/2365] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:20 2021] POST /identity/v3/projects => generated 409 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:20.971698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239bdcc-6306-4895-a240-9cd48f06c348 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:21.048943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d1661-f635-4eb2-ae99-0deba9cc6645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:21.049856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d1661-f635-4eb2-ae99-0deba9cc6645 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:21.054951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d1661-f635-4eb2-ae99-0deba9cc6645 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:21.055582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d1661-f635-4eb2-ae99-0deba9cc6645 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:21.056564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d1661-f635-4eb2-ae99-0deba9cc6645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:21.058720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d1661-f635-4eb2-ae99-0deba9cc6645 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:21.086310 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1170/2366] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:20 2021] POST /identity/v3/users => generated 305 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:48:21.088839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8b43f-004a-4dd1-845f-4966d4199070 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:21.102513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8b43f-004a-4dd1-845f-4966d4199070 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:21.109197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e7ce9-ccc4-49c1-8424-cefadc931f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:21.109939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e7ce9-ccc4-49c1-8424-cefadc931f21 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:21.110232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e7ce9-ccc4-49c1-8424-cefadc931f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:21.110605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e7ce9-ccc4-49c1-8424-cefadc931f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:21.111377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e7ce9-ccc4-49c1-8424-cefadc931f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:21.113325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e7ce9-ccc4-49c1-8424-cefadc931f21 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:21.124189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673605f-44bb-4bed-8bcf-4d1233cb9956 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:21.124491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673605f-44bb-4bed-8bcf-4d1233cb9956 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:21.124773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673605f-44bb-4bed-8bcf-4d1233cb9956 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:21.127470 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1171/2367] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:48:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:48:21.131821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169e0c5-93b9-4a7c-99d3-df8f7ab2ad31 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:21.132121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169e0c5-93b9-4a7c-99d3-df8f7ab2ad31 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:21.132402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169e0c5-93b9-4a7c-99d3-df8f7ab2ad31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:21.134302 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1197/2368] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:21 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:21.136269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e7ce9-ccc4-49c1-8424-cefadc931f21 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:21.146373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e7ce9-ccc4-49c1-8424-cefadc931f21 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:21.151164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8d846-b2a5-443f-a286-a278e1dd5f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:21.151816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8d846-b2a5-443f-a286-a278e1dd5f43 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:21.152270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8d846-b2a5-443f-a286-a278e1dd5f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:21.152494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a169e0c5-93b9-4a7c-99d3-df8f7ab2ad31 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:21.152611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8d846-b2a5-443f-a286-a278e1dd5f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:21.153327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8d846-b2a5-443f-a286-a278e1dd5f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:21.153713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a169e0c5-93b9-4a7c-99d3-df8f7ab2ad31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:21.154932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8d846-b2a5-443f-a286-a278e1dd5f43 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:21.167142 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1198/2369] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:21 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:21.172585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8d846-b2a5-443f-a286-a278e1dd5f43 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:21.183244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8d846-b2a5-443f-a286-a278e1dd5f43 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:21.189266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd4963-6ff5-4e84-a8f4-a0a747193566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:21.190580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd4963-6ff5-4e84-a8f4-a0a747193566 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:21.191030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd4963-6ff5-4e84-a8f4-a0a747193566 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:21.191457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd4963-6ff5-4e84-a8f4-a0a747193566 admin admin] PATH_INFO: `/v3/projects/2f5940d90e6d4f7082786af0b5fc9cc7/users/f0d2d087b0874db788dde81ed114d727/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:21.213783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd4963-6ff5-4e84-a8f4-a0a747193566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5940d90e6d4f7082786af0b5fc9cc7, user_id=f0d2d087b0874db788dde81ed114d727, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:21.231774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd4963-6ff5-4e84-a8f4-a0a747193566 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:21.248278 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1172/2370] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:48:21 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:21.251915 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1199/2371] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:21 2021] PUT /identity/v3/projects/2f5940d90e6d4f7082786af0b5fc9cc7/users/f0d2d087b0874db788dde81ed114d727/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:21.263383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c386bb-8ac0-4179-a2ca-c9d2d7628a8b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:21.263680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c386bb-8ac0-4179-a2ca-c9d2d7628a8b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:21.263964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c386bb-8ac0-4179-a2ca-c9d2d7628a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:21.275432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd4963-6ff5-4e84-a8f4-a0a747193566 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:21.277604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a8cd4963-6ff5-4e84-a8f4-a0a747193566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:21.294822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-54c386bb-8ac0-4179-a2ca-c9d2d7628a8b None None] MFA Rules not processed for user `f0d2d087b0874db788dde81ed114d727`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:21.296127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-54c386bb-8ac0-4179-a2ca-c9d2d7628a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:21.351935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd4963-6ff5-4e84-a8f4-a0a747193566 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:21.357162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26f3d-532e-4e59-9e3c-4e8e81c90aa5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:21.357952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26f3d-532e-4e59-9e3c-4e8e81c90aa5 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:21.358242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26f3d-532e-4e59-9e3c-4e8e81c90aa5 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:21.358549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26f3d-532e-4e59-9e3c-4e8e81c90aa5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:21.366629 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1173/2372] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:21 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:21.368309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea26f3d-532e-4e59-9e3c-4e8e81c90aa5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:21.369989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea26f3d-532e-4e59-9e3c-4e8e81c90aa5 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:21.370866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c386bb-8ac0-4179-a2ca-c9d2d7628a8b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:21.381531 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1200/2373] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:21 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:21.441044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c386bb-8ac0-4179-a2ca-c9d2d7628a8b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:21.446153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eb47d-e5aa-4091-adef-01050ab3968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:21.446872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eb47d-e5aa-4091-adef-01050ab3968d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:21.447332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eb47d-e5aa-4091-adef-01050ab3968d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:21.447625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eb47d-e5aa-4091-adef-01050ab3968d admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:21.448433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eb47d-e5aa-4091-adef-01050ab3968d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:21.450452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eb47d-e5aa-4091-adef-01050ab3968d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:21.480566 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1174/2374] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:21 2021] POST /identity/v3/projects => generated 407 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:48:21.485024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26f3d-532e-4e59-9e3c-4e8e81c90aa5 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:21.497119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26f3d-532e-4e59-9e3c-4e8e81c90aa5 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:21.564333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1453ad7-c3cd-4186-93a3-50a476a0a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:21.565015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1453ad7-c3cd-4186-93a3-50a476a0a632 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:21.565308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1453ad7-c3cd-4186-93a3-50a476a0a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:21.565584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1453ad7-c3cd-4186-93a3-50a476a0a632 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:21.566387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1453ad7-c3cd-4186-93a3-50a476a0a632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:21.568845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1453ad7-c3cd-4186-93a3-50a476a0a632 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:21.591489 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1201/2375] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:21 2021] POST /identity/v3/users => generated 310 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:21.595206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eb47d-e5aa-4091-adef-01050ab3968d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:21.605703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eb47d-e5aa-4091-adef-01050ab3968d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:21.610899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c80f7-9b60-4870-a996-3f916c4e0628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:21.611980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c80f7-9b60-4870-a996-3f916c4e0628 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:21.612293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c80f7-9b60-4870-a996-3f916c4e0628 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:21.612819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c80f7-9b60-4870-a996-3f916c4e0628 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:21.613698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c80f7-9b60-4870-a996-3f916c4e0628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:21.616514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c80f7-9b60-4870-a996-3f916c4e0628 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:21.631760 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1175/2376] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:21 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:21.633033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1453ad7-c3cd-4186-93a3-50a476a0a632 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:21.643757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1453ad7-c3cd-4186-93a3-50a476a0a632 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:21.649459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dde0d-193b-46d1-b616-8176bd3a5fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:21.650390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dde0d-193b-46d1-b616-8176bd3a5fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:21.650779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dde0d-193b-46d1-b616-8176bd3a5fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:21.651018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dde0d-193b-46d1-b616-8176bd3a5fc7 admin admin] PATH_INFO: `/v3/projects/a3c195d94b4b43c48e7b5fa9b810ecd5/users/5536996e2383479da0be20a669a75f55/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:21.669289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17dde0d-193b-46d1-b616-8176bd3a5fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c195d94b4b43c48e7b5fa9b810ecd5, user_id=5536996e2383479da0be20a669a75f55, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:21.671569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17dde0d-193b-46d1-b616-8176bd3a5fc7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:21.693057 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1202/2377] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:21 2021] PUT /identity/v3/projects/a3c195d94b4b43c48e7b5fa9b810ecd5/users/5536996e2383479da0be20a669a75f55/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:21.696797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c80f7-9b60-4870-a996-3f916c4e0628 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:21.708886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c80f7-9b60-4870-a996-3f916c4e0628 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:21.795162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68289f-d941-41be-82f6-78083c1895e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:21.795923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68289f-d941-41be-82f6-78083c1895e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:21.796277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68289f-d941-41be-82f6-78083c1895e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:21.796762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68289f-d941-41be-82f6-78083c1895e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:21.797603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68289f-d941-41be-82f6-78083c1895e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:21.799348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68289f-d941-41be-82f6-78083c1895e7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:21.814543 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1176/2378] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:21 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:21.815795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dde0d-193b-46d1-b616-8176bd3a5fc7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:21.835639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dde0d-193b-46d1-b616-8176bd3a5fc7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:21.842644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843fb99-2955-4764-9d94-eae63c7a1821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:21.843867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843fb99-2955-4764-9d94-eae63c7a1821 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:21.844161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843fb99-2955-4764-9d94-eae63c7a1821 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:21.844821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843fb99-2955-4764-9d94-eae63c7a1821 admin admin] PATH_INFO: `/v3/projects/a3c195d94b4b43c48e7b5fa9b810ecd5/users/5536996e2383479da0be20a669a75f55/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:21.847549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843fb99-2955-4764-9d94-eae63c7a1821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c195d94b4b43c48e7b5fa9b810ecd5, user_id=5536996e2383479da0be20a669a75f55, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:21.850676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843fb99-2955-4764-9d94-eae63c7a1821 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:21.866307 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1203/2379] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:21 2021] PUT /identity/v3/projects/a3c195d94b4b43c48e7b5fa9b810ecd5/users/5536996e2383479da0be20a669a75f55/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:21.875753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238d0d4-e518-46b8-b53c-9acd0b21cc4d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:21.876227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238d0d4-e518-46b8-b53c-9acd0b21cc4d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:21.876724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238d0d4-e518-46b8-b53c-9acd0b21cc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:21.906624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9238d0d4-e518-46b8-b53c-9acd0b21cc4d None None] MFA Rules not processed for user `5536996e2383479da0be20a669a75f55`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:21.907882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9238d0d4-e518-46b8-b53c-9acd0b21cc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:21.986225 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1177/2380] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:21 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:21.994285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843fb99-2955-4764-9d94-eae63c7a1821 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:22.056736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843fb99-2955-4764-9d94-eae63c7a1821 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:22.062025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c66c71-2ff5-487c-b2a9-a7372e03777e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:22.062964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c66c71-2ff5-487c-b2a9-a7372e03777e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:22.063273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c66c71-2ff5-487c-b2a9-a7372e03777e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:22.063551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c66c71-2ff5-487c-b2a9-a7372e03777e admin admin] PATH_INFO: `/v3/users/f0d2d087b0874db788dde81ed114d727` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:22.064992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c66c71-2ff5-487c-b2a9-a7372e03777e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d2d087b0874db788dde81ed114d727)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:22.066728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c66c71-2ff5-487c-b2a9-a7372e03777e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:22.111870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b8c66c71-2ff5-487c-b2a9-a7372e03777e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d2d087b0874db788dde81ed114d727'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:22.118590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b8c66c71-2ff5-487c-b2a9-a7372e03777e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d2d087b0874db788dde81ed114d727'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:22.119286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b8c66c71-2ff5-487c-b2a9-a7372e03777e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d2d087b0874db788dde81ed114d727'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:22.130628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b8c66c71-2ff5-487c-b2a9-a7372e03777e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d2d087b0874db788dde81ed114d727'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:22.138289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b8c66c71-2ff5-487c-b2a9-a7372e03777e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d2d087b0874db788dde81ed114d727'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:22.144645 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1204/2381] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:21 2021] DELETE /identity/v3/users/f0d2d087b0874db788dde81ed114d727 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:22.149961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa4e30-f887-49b1-93f7-91adf762a23c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:22.150272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa4e30-f887-49b1-93f7-91adf762a23c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:22.150700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa4e30-f887-49b1-93f7-91adf762a23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:22.170336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-92fa4e30-f887-49b1-93f7-91adf762a23c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:22.171692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-92fa4e30-f887-49b1-93f7-91adf762a23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:22.233438 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1178/2382] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:22.244068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c66c71-2ff5-487c-b2a9-a7372e03777e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:22.245479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b8c66c71-2ff5-487c-b2a9-a7372e03777e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:22.303716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c66c71-2ff5-487c-b2a9-a7372e03777e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:22.307493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907d478-a722-4a6e-8bb5-7d9ed60a0dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:22.308146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907d478-a722-4a6e-8bb5-7d9ed60a0dec service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:22.308430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907d478-a722-4a6e-8bb5-7d9ed60a0dec service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:22.308724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907d478-a722-4a6e-8bb5-7d9ed60a0dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:22.318357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907d478-a722-4a6e-8bb5-7d9ed60a0dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:22.319862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907d478-a722-4a6e-8bb5-7d9ed60a0dec service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:22.329265 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1205/2383] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:48:22.899052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa4e30-f887-49b1-93f7-91adf762a23c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:22.900466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-92fa4e30-f887-49b1-93f7-91adf762a23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:22.914629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa4e30-f887-49b1-93f7-91adf762a23c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:22.920530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01650b-6115-4405-bbd0-d39711d52742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:22.921641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01650b-6115-4405-bbd0-d39711d52742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:22.921869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01650b-6115-4405-bbd0-d39711d52742 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:22.922149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01650b-6115-4405-bbd0-d39711d52742 admin admin] PATH_INFO: `/v3/projects/2f5940d90e6d4f7082786af0b5fc9cc7` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:22.924036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01650b-6115-4405-bbd0-d39711d52742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f5940d90e6d4f7082786af0b5fc9cc7)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:22.925998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01650b-6115-4405-bbd0-d39711d52742 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:23.016605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2e01650b-6115-4405-bbd0-d39711d52742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f5940d90e6d4f7082786af0b5fc9cc7', 'request_id': 'req-2e01650b-6115-4405-bbd0-d39711d52742'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:23.025451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2e01650b-6115-4405-bbd0-d39711d52742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f5940d90e6d4f7082786af0b5fc9cc7', 'request_id': 'req-2e01650b-6115-4405-bbd0-d39711d52742'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:23.032480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2e01650b-6115-4405-bbd0-d39711d52742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f5940d90e6d4f7082786af0b5fc9cc7', 'request_id': 'req-2e01650b-6115-4405-bbd0-d39711d52742'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:23.048803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2e01650b-6115-4405-bbd0-d39711d52742 admin admin] The token cache is being invalidate because project 2f5940d90e6d4f7082786af0b5fc9cc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:23.049333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2e01650b-6115-4405-bbd0-d39711d52742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:23.050111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2e01650b-6115-4405-bbd0-d39711d52742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:23.052362 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1179/2384] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:22 2021] DELETE /identity/v3/projects/2f5940d90e6d4f7082786af0b5fc9cc7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:23.057041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907d478-a722-4a6e-8bb5-7d9ed60a0dec service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:23.072658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907d478-a722-4a6e-8bb5-7d9ed60a0dec service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:23.119577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01650b-6115-4405-bbd0-d39711d52742 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:23.121110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2e01650b-6115-4405-bbd0-d39711d52742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:23.160975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e2f1b-04f5-4953-9898-c999ed89e15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:23.161919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e2f1b-04f5-4953-9898-c999ed89e15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:23.162207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e2f1b-04f5-4953-9898-c999ed89e15e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:23.162550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e2f1b-04f5-4953-9898-c999ed89e15e admin admin] PATH_INFO: `/v3/users/5536996e2383479da0be20a669a75f55` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:23.164405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e2f1b-04f5-4953-9898-c999ed89e15e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5536996e2383479da0be20a669a75f55)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:23.167063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e2f1b-04f5-4953-9898-c999ed89e15e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:23.250130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e86e2f1b-04f5-4953-9898-c999ed89e15e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5536996e2383479da0be20a669a75f55'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:23.251590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01650b-6115-4405-bbd0-d39711d52742 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:23.267391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a6886-bd04-4ca0-9953-78e81d6143ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:23.269540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e86e2f1b-04f5-4953-9898-c999ed89e15e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5536996e2383479da0be20a669a75f55'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:23.270380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6886-bd04-4ca0-9953-78e81d6143ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:23.270592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e86e2f1b-04f5-4953-9898-c999ed89e15e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5536996e2383479da0be20a669a75f55'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:23.270808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6886-bd04-4ca0-9953-78e81d6143ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:23.272216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6886-bd04-4ca0-9953-78e81d6143ba admin admin] PATH_INFO: `/v3/users/2b3dc790a5574ee094b534c3f371edc9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:23.276856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a6886-bd04-4ca0-9953-78e81d6143ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3dc790a5574ee094b534c3f371edc9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:23.279038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a6886-bd04-4ca0-9953-78e81d6143ba admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:23.306930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e86e2f1b-04f5-4953-9898-c999ed89e15e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5536996e2383479da0be20a669a75f55'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:23.322516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e86e2f1b-04f5-4953-9898-c999ed89e15e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5536996e2383479da0be20a669a75f55'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:23.333978 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1206/2385] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:23 2021] DELETE /identity/v3/users/5536996e2383479da0be20a669a75f55 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:23.361176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-984a6886-bd04-4ca0-9953-78e81d6143ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3dc790a5574ee094b534c3f371edc9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:23.368941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-984a6886-bd04-4ca0-9953-78e81d6143ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3dc790a5574ee094b534c3f371edc9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:23.382966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-984a6886-bd04-4ca0-9953-78e81d6143ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3dc790a5574ee094b534c3f371edc9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:23.383806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-984a6886-bd04-4ca0-9953-78e81d6143ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3dc790a5574ee094b534c3f371edc9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:23.394559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-984a6886-bd04-4ca0-9953-78e81d6143ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3dc790a5574ee094b534c3f371edc9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:23.404947 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1180/2386] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:23 2021] DELETE /identity/v3/users/2b3dc790a5574ee094b534c3f371edc9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:23.406661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a648c2-f128-45fa-8ab8-437343f5acd8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:23.407225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a648c2-f128-45fa-8ab8-437343f5acd8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:23.407667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a648c2-f128-45fa-8ab8-437343f5acd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:23.430675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f9a648c2-f128-45fa-8ab8-437343f5acd8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:23.433234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f9a648c2-f128-45fa-8ab8-437343f5acd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:23.509480 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1207/2387] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:23.533661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a6886-bd04-4ca0-9953-78e81d6143ba admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:23.535443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-984a6886-bd04-4ca0-9953-78e81d6143ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:23.635544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a6886-bd04-4ca0-9953-78e81d6143ba admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:23.640741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c3487-d2ca-4116-9578-d44e750d1262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:23.641629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c3487-d2ca-4116-9578-d44e750d1262 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:23.642073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c3487-d2ca-4116-9578-d44e750d1262 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:23.642684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c3487-d2ca-4116-9578-d44e750d1262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:23.657369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c3487-d2ca-4116-9578-d44e750d1262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:23.659579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c3487-d2ca-4116-9578-d44e750d1262 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:23.673920 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1181/2388] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:24.359563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a648c2-f128-45fa-8ab8-437343f5acd8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:24.365969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f9a648c2-f128-45fa-8ab8-437343f5acd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:24.388835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a648c2-f128-45fa-8ab8-437343f5acd8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:24.397411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:24.398898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:24.399298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:24.399972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76 admin admin] PATH_INFO: `/v3/projects/a1d6902ee72c479db1b2d30c1a019a7d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:24.416827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d6902ee72c479db1b2d30c1a019a7d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:24.419486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:24.485816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d6902ee72c479db1b2d30c1a019a7d', 'request_id': 'req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:24.493909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d6902ee72c479db1b2d30c1a019a7d', 'request_id': 'req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:24.503681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d6902ee72c479db1b2d30c1a019a7d', 'request_id': 'req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:24.518609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76 admin admin] The token cache is being invalidate because project a1d6902ee72c479db1b2d30c1a019a7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:24.518997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:24.519726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:24.522330 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1208/2389] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:24 2021] DELETE /identity/v3/projects/a1d6902ee72c479db1b2d30c1a019a7d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:24.527797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c3487-d2ca-4116-9578-d44e750d1262 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:24.549507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c3487-d2ca-4116-9578-d44e750d1262 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:24.658469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9f002-c474-4470-a2a3-7c1ddd94785f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:24.659422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9f002-c474-4470-a2a3-7c1ddd94785f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:24.659946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9f002-c474-4470-a2a3-7c1ddd94785f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:24.660275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9f002-c474-4470-a2a3-7c1ddd94785f admin admin] PATH_INFO: `/v3/users/51bdbbdc83144d92aaa5771a238476f9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:24.661821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9f002-c474-4470-a2a3-7c1ddd94785f admin admin] RBAC: Authorizing `identity:delete_user(user_id=51bdbbdc83144d92aaa5771a238476f9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:24.664013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9f002-c474-4470-a2a3-7c1ddd94785f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:24.749596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c4e9f002-c474-4470-a2a3-7c1ddd94785f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51bdbbdc83144d92aaa5771a238476f9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:24.758415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c4e9f002-c474-4470-a2a3-7c1ddd94785f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51bdbbdc83144d92aaa5771a238476f9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:24.776811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c4e9f002-c474-4470-a2a3-7c1ddd94785f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51bdbbdc83144d92aaa5771a238476f9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:24.778002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c4e9f002-c474-4470-a2a3-7c1ddd94785f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51bdbbdc83144d92aaa5771a238476f9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:24.792619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c4e9f002-c474-4470-a2a3-7c1ddd94785f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51bdbbdc83144d92aaa5771a238476f9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:24.807633 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1182/2390] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:24 2021] DELETE /identity/v3/users/51bdbbdc83144d92aaa5771a238476f9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:24.906929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:24.908372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:24.926755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf27e3d-eee2-4437-a4e4-a66f213e8c76 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:24.997560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e3c58-c820-4520-b4f4-b5a06b7ea895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:24.999355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e3c58-c820-4520-b4f4-b5a06b7ea895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:24.999867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e3c58-c820-4520-b4f4-b5a06b7ea895 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:25.000301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e3c58-c820-4520-b4f4-b5a06b7ea895 admin admin] PATH_INFO: `/v3/projects/a3c195d94b4b43c48e7b5fa9b810ecd5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:25.001892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e3c58-c820-4520-b4f4-b5a06b7ea895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3c195d94b4b43c48e7b5fa9b810ecd5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:25.004921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e3c58-c820-4520-b4f4-b5a06b7ea895 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:25.070682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e96e3c58-c820-4520-b4f4-b5a06b7ea895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3c195d94b4b43c48e7b5fa9b810ecd5', 'request_id': 'req-e96e3c58-c820-4520-b4f4-b5a06b7ea895'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:25.078696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e96e3c58-c820-4520-b4f4-b5a06b7ea895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3c195d94b4b43c48e7b5fa9b810ecd5', 'request_id': 'req-e96e3c58-c820-4520-b4f4-b5a06b7ea895'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:25.088066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e96e3c58-c820-4520-b4f4-b5a06b7ea895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3c195d94b4b43c48e7b5fa9b810ecd5', 'request_id': 'req-e96e3c58-c820-4520-b4f4-b5a06b7ea895'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:25.099814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e96e3c58-c820-4520-b4f4-b5a06b7ea895 admin admin] The token cache is being invalidate because project a3c195d94b4b43c48e7b5fa9b810ecd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:25.100105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e96e3c58-c820-4520-b4f4-b5a06b7ea895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:25.100799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e96e3c58-c820-4520-b4f4-b5a06b7ea895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:25.102693 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1209/2391] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:24 2021] DELETE /identity/v3/projects/a3c195d94b4b43c48e7b5fa9b810ecd5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:25.109512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef469da-79b6-44e9-9146-234514a3ddcf None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:25.109807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef469da-79b6-44e9-9146-234514a3ddcf None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:25.110090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef469da-79b6-44e9-9146-234514a3ddcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:25.132552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5ef469da-79b6-44e9-9146-234514a3ddcf None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:25.133775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5ef469da-79b6-44e9-9146-234514a3ddcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:25.211025 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1183/2392] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:25.212880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5c1e2-ee96-42b4-adca-e310af11ce0a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:25.213241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5c1e2-ee96-42b4-adca-e310af11ce0a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:25.213556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5c1e2-ee96-42b4-adca-e310af11ce0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:25.234192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fbc5c1e2-ee96-42b4-adca-e310af11ce0a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:25.235451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fbc5c1e2-ee96-42b4-adca-e310af11ce0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:25.244127 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1210/2393] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:25.248476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef469da-79b6-44e9-9146-234514a3ddcf None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:25.259797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef469da-79b6-44e9-9146-234514a3ddcf None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:25.265344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4240349-175a-43c7-976e-54b58505fc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:25.266146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4240349-175a-43c7-976e-54b58505fc94 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:25.266567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4240349-175a-43c7-976e-54b58505fc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:25.266949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4240349-175a-43c7-976e-54b58505fc94 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:25.267827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4240349-175a-43c7-976e-54b58505fc94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:25.268247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4240349-175a-43c7-976e-54b58505fc94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:25.270283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4240349-175a-43c7-976e-54b58505fc94 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:25.283333 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1184/2394] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:25.287987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5c1e2-ee96-42b4-adca-e310af11ce0a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:25.297439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5c1e2-ee96-42b4-adca-e310af11ce0a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:25.303090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e97b1-8c26-4f0b-a0a8-6eaa640a2b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:25.303744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e97b1-8c26-4f0b-a0a8-6eaa640a2b23 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:25.304034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e97b1-8c26-4f0b-a0a8-6eaa640a2b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:25.304315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e97b1-8c26-4f0b-a0a8-6eaa640a2b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:25.305024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e97b1-8c26-4f0b-a0a8-6eaa640a2b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:25.307006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e97b1-8c26-4f0b-a0a8-6eaa640a2b23 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:25.337651 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1211/2395] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:25 2021] POST /identity/v3/projects => generated 395 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:25.342245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4240349-175a-43c7-976e-54b58505fc94 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:25.352800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4240349-175a-43c7-976e-54b58505fc94 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:25.412163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9730c0-27a2-4b0c-a93f-8a065bed66d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:25.412841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9730c0-27a2-4b0c-a93f-8a065bed66d5 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:25.413249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9730c0-27a2-4b0c-a93f-8a065bed66d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:25.413538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9730c0-27a2-4b0c-a93f-8a065bed66d5 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:25.414261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9730c0-27a2-4b0c-a93f-8a065bed66d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:25.416248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9730c0-27a2-4b0c-a93f-8a065bed66d5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:25.442586 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1185/2396] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:25 2021] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:25.443401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e97b1-8c26-4f0b-a0a8-6eaa640a2b23 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:25.458850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e97b1-8c26-4f0b-a0a8-6eaa640a2b23 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:25.464528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef3208-3428-43e1-a4d1-8845d0481206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:25.465229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef3208-3428-43e1-a4d1-8845d0481206 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:25.465626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef3208-3428-43e1-a4d1-8845d0481206 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:25.465833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef3208-3428-43e1-a4d1-8845d0481206 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:25.466576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef3208-3428-43e1-a4d1-8845d0481206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:25.468174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef3208-3428-43e1-a4d1-8845d0481206 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:25.480130 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1212/2397] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:25 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:25.484324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9730c0-27a2-4b0c-a93f-8a065bed66d5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:25.495121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9730c0-27a2-4b0c-a93f-8a065bed66d5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:25.513261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d76450-f89e-4f3b-ab21-a94c04c0642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:25.513931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d76450-f89e-4f3b-ab21-a94c04c0642d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:25.514225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d76450-f89e-4f3b-ab21-a94c04c0642d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:25.514572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d76450-f89e-4f3b-ab21-a94c04c0642d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:25.530539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d76450-f89e-4f3b-ab21-a94c04c0642d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:25.537658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d76450-f89e-4f3b-ab21-a94c04c0642d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:25.564082 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1186/2398] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:25 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:25.564220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef3208-3428-43e1-a4d1-8845d0481206 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:25.579349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef3208-3428-43e1-a4d1-8845d0481206 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:25.592291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ab45a-2128-46ff-9a2e-c6751127d46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:25.593197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab45a-2128-46ff-9a2e-c6751127d46c admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:25.593483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab45a-2128-46ff-9a2e-c6751127d46c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:25.593770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab45a-2128-46ff-9a2e-c6751127d46c admin admin] PATH_INFO: `/v3/projects/9b188787cdec4c93a20c443b630076f0/users/7e20aee17ac54455ac1d3e397fabe86e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:25.624622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ab45a-2128-46ff-9a2e-c6751127d46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b188787cdec4c93a20c443b630076f0, user_id=7e20aee17ac54455ac1d3e397fabe86e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:25.628459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ab45a-2128-46ff-9a2e-c6751127d46c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:25.675130 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1213/2399] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:25 2021] PUT /identity/v3/projects/9b188787cdec4c93a20c443b630076f0/users/7e20aee17ac54455ac1d3e397fabe86e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:25.679013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2f354-ccbc-47a7-8f1d-363bc83d3a17 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:25.679466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2f354-ccbc-47a7-8f1d-363bc83d3a17 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:25.680056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2f354-ccbc-47a7-8f1d-363bc83d3a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:25.718632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e1a2f354-ccbc-47a7-8f1d-363bc83d3a17 None None] MFA Rules not processed for user `7e20aee17ac54455ac1d3e397fabe86e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:25.722517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e1a2f354-ccbc-47a7-8f1d-363bc83d3a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:25.822852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ab45a-2128-46ff-9a2e-c6751127d46c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:25.826599 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1187/2400] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:25 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:25.955066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ab45a-2128-46ff-9a2e-c6751127d46c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:25.975291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8857375-3563-4984-ad69-432136773f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:25.977356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8857375-3563-4984-ad69-432136773f9b admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:25.977652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8857375-3563-4984-ad69-432136773f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:25.979312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8857375-3563-4984-ad69-432136773f9b admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:25.983295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2f354-ccbc-47a7-8f1d-363bc83d3a17 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:25.984939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e1a2f354-ccbc-47a7-8f1d-363bc83d3a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:25.989260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8857375-3563-4984-ad69-432136773f9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:26.002873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8857375-3563-4984-ad69-432136773f9b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:26.016213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2f354-ccbc-47a7-8f1d-363bc83d3a17 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:26.028769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb4b8c-c301-4762-a80d-9280723dd3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:26.029569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb4b8c-c301-4762-a80d-9280723dd3e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:26.030580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb4b8c-c301-4762-a80d-9280723dd3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:26.033024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb4b8c-c301-4762-a80d-9280723dd3e2 admin admin] PATH_INFO: `/v3/projects/f8fcff759a8746df921652ec15e1f089` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:26.035544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb4b8c-c301-4762-a80d-9280723dd3e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8fcff759a8746df921652ec15e1f089)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:26.048671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb4b8c-c301-4762-a80d-9280723dd3e2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:26.088457 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1214/2401] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:25 2021] POST /identity/v3/projects => generated 395 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:26.095410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8857375-3563-4984-ad69-432136773f9b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:26.195748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ddeb4b8c-c301-4762-a80d-9280723dd3e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8fcff759a8746df921652ec15e1f089', 'request_id': 'req-ddeb4b8c-c301-4762-a80d-9280723dd3e2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:26.204345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ddeb4b8c-c301-4762-a80d-9280723dd3e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8fcff759a8746df921652ec15e1f089', 'request_id': 'req-ddeb4b8c-c301-4762-a80d-9280723dd3e2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:26.217858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ddeb4b8c-c301-4762-a80d-9280723dd3e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8fcff759a8746df921652ec15e1f089', 'request_id': 'req-ddeb4b8c-c301-4762-a80d-9280723dd3e2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:26.244266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ddeb4b8c-c301-4762-a80d-9280723dd3e2 admin admin] The token cache is being invalidate because project f8fcff759a8746df921652ec15e1f089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:26.244592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ddeb4b8c-c301-4762-a80d-9280723dd3e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:26.245231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8857375-3563-4984-ad69-432136773f9b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:26.245344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ddeb4b8c-c301-4762-a80d-9280723dd3e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:26.246995 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1188/2402] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:25 2021] DELETE /identity/v3/projects/f8fcff759a8746df921652ec15e1f089 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:26.254991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5840243-ff85-4519-9644-fec4b9db51a1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:26.255351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5840243-ff85-4519-9644-fec4b9db51a1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:26.255641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5840243-ff85-4519-9644-fec4b9db51a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:26.291481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e5840243-ff85-4519-9644-fec4b9db51a1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:26.292703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e5840243-ff85-4519-9644-fec4b9db51a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:26.362305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf57d43-4cc1-4f81-8f7c-cd898bfd5309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:26.364179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf57d43-4cc1-4f81-8f7c-cd898bfd5309 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:26.364809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf57d43-4cc1-4f81-8f7c-cd898bfd5309 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:26.365745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf57d43-4cc1-4f81-8f7c-cd898bfd5309 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:26.367205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf57d43-4cc1-4f81-8f7c-cd898bfd5309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:26.369847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf57d43-4cc1-4f81-8f7c-cd898bfd5309 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:26.398099 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1189/2403] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:48:26.407291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac161332-80b9-4793-bcfc-7f5d806b0b60 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:26.407585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac161332-80b9-4793-bcfc-7f5d806b0b60 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:26.407888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac161332-80b9-4793-bcfc-7f5d806b0b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:26.413189 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1215/2404] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:26 2021] POST /identity/v3/users => generated 304 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:26.417930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf57d43-4cc1-4f81-8f7c-cd898bfd5309 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:26.423752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3bf57d43-4cc1-4f81-8f7c-cd898bfd5309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:26.448122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ac161332-80b9-4793-bcfc-7f5d806b0b60 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:26.449562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ac161332-80b9-4793-bcfc-7f5d806b0b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:26.471648 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1190/2405] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:48:26.482002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac161332-80b9-4793-bcfc-7f5d806b0b60 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:26.490286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf57d43-4cc1-4f81-8f7c-cd898bfd5309 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:26.523243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac161332-80b9-4793-bcfc-7f5d806b0b60 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:26.525047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f32a05-b342-4647-a087-7c8bf6a54e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:26.525888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f32a05-b342-4647-a087-7c8bf6a54e86 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:26.526451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f32a05-b342-4647-a087-7c8bf6a54e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:26.526937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f32a05-b342-4647-a087-7c8bf6a54e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:26.527969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f32a05-b342-4647-a087-7c8bf6a54e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:26.529948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f32a05-b342-4647-a087-7c8bf6a54e86 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:26.531245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc27d9-21a7-46b4-addd-9cbe0192eb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:26.533594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc27d9-21a7-46b4-addd-9cbe0192eb44 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:26.534389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc27d9-21a7-46b4-addd-9cbe0192eb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:26.534837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc27d9-21a7-46b4-addd-9cbe0192eb44 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:26.535862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc27d9-21a7-46b4-addd-9cbe0192eb44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:26.536335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc27d9-21a7-46b4-addd-9cbe0192eb44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:26.542363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc27d9-21a7-46b4-addd-9cbe0192eb44 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:26.555705 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1216/2406] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:26 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:26.559412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f32a05-b342-4647-a087-7c8bf6a54e86 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:26.568757 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1191/2407] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:26.569933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc27d9-21a7-46b4-addd-9cbe0192eb44 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:26.585471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f32a05-b342-4647-a087-7c8bf6a54e86 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:26.585703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc27d9-21a7-46b4-addd-9cbe0192eb44 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:26.597700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1357cf-f723-4c79-b174-086c0551fe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:26.598473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1357cf-f723-4c79-b174-086c0551fe41 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:26.598757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1357cf-f723-4c79-b174-086c0551fe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:26.599030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1357cf-f723-4c79-b174-086c0551fe41 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:26.599468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac1e96-3e04-4456-95e4-81d519b03671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:26.600374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac1e96-3e04-4456-95e4-81d519b03671 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:26.600656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac1e96-3e04-4456-95e4-81d519b03671 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:26.600939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac1e96-3e04-4456-95e4-81d519b03671 admin admin] PATH_INFO: `/v3/projects/cb88ac815a714d9da49120210b9edf24/users/0893fcb75f5c4650bd6bef2c0f313ceb/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:26.601100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1357cf-f723-4c79-b174-086c0551fe41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:26.603422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1357cf-f723-4c79-b174-086c0551fe41 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:26.644164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac1e96-3e04-4456-95e4-81d519b03671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb88ac815a714d9da49120210b9edf24, user_id=0893fcb75f5c4650bd6bef2c0f313ceb, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:26.649711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac1e96-3e04-4456-95e4-81d519b03671 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:26.654610 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1192/2408] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:26 2021] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:26.656087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1357cf-f723-4c79-b174-086c0551fe41 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:26.659829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-dd1357cf-f723-4c79-b174-086c0551fe41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:26.681477 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1217/2409] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:26 2021] PUT /identity/v3/projects/cb88ac815a714d9da49120210b9edf24/users/0893fcb75f5c4650bd6bef2c0f313ceb/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:26.684485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac1e96-3e04-4456-95e4-81d519b03671 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:26.807550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac1e96-3e04-4456-95e4-81d519b03671 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:26.815724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ace712-89b4-400d-828e-e8052ddd957c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:26.816504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ace712-89b4-400d-828e-e8052ddd957c admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:26.816990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ace712-89b4-400d-828e-e8052ddd957c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:26.817771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ace712-89b4-400d-828e-e8052ddd957c admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:26.819715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ace712-89b4-400d-828e-e8052ddd957c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:26.822297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ace712-89b4-400d-828e-e8052ddd957c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:26.829464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1357cf-f723-4c79-b174-086c0551fe41 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:26.840374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b5754-7b52-4cb2-80bf-07b997b2e714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:26.842302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b5754-7b52-4cb2-80bf-07b997b2e714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:26.842664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b5754-7b52-4cb2-80bf-07b997b2e714 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:26.843011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b5754-7b52-4cb2-80bf-07b997b2e714 admin admin] PATH_INFO: `/v3/users/ca5eba837bd74068801f94e347a1d387` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:26.844627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b5754-7b52-4cb2-80bf-07b997b2e714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5eba837bd74068801f94e347a1d387)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:26.846612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b5754-7b52-4cb2-80bf-07b997b2e714 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:26.850134 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1218/2410] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:26 2021] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:26.850134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ace712-89b4-400d-828e-e8052ddd957c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:26.860283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ace712-89b4-400d-828e-e8052ddd957c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:26.866322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88680248-2015-4cb9-bd82-f04f9efa93e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:26.867657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680248-2015-4cb9-bd82-f04f9efa93e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:26.867657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680248-2015-4cb9-bd82-f04f9efa93e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:26.867904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680248-2015-4cb9-bd82-f04f9efa93e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:26.868537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88680248-2015-4cb9-bd82-f04f9efa93e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:26.870060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88680248-2015-4cb9-bd82-f04f9efa93e4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:26.888381 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1219/2411] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:26 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:26.889896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88680248-2015-4cb9-bd82-f04f9efa93e4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:26.901379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88680248-2015-4cb9-bd82-f04f9efa93e4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:26.903552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9a3b5754-7b52-4cb2-80bf-07b997b2e714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5eba837bd74068801f94e347a1d387'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:26.907679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e006bf9-03de-4978-beef-d9183f428992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:26.908338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e006bf9-03de-4978-beef-d9183f428992 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:26.908616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e006bf9-03de-4978-beef-d9183f428992 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:26.909339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e006bf9-03de-4978-beef-d9183f428992 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:26.909633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e006bf9-03de-4978-beef-d9183f428992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:26.911311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e006bf9-03de-4978-beef-d9183f428992 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:26.913012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9a3b5754-7b52-4cb2-80bf-07b997b2e714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5eba837bd74068801f94e347a1d387'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:26.925485 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1220/2412] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:26 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:26.928337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e006bf9-03de-4978-beef-d9183f428992 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:26.932027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9a3b5754-7b52-4cb2-80bf-07b997b2e714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5eba837bd74068801f94e347a1d387'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:26.932917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9a3b5754-7b52-4cb2-80bf-07b997b2e714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5eba837bd74068801f94e347a1d387'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:26.938228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e006bf9-03de-4978-beef-d9183f428992 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:26.944043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f995a7-ee84-47e8-a49d-7b2026b0fb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:26.944283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9a3b5754-7b52-4cb2-80bf-07b997b2e714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5eba837bd74068801f94e347a1d387'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:26.944921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f995a7-ee84-47e8-a49d-7b2026b0fb0a admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:26.945196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f995a7-ee84-47e8-a49d-7b2026b0fb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:26.945467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f995a7-ee84-47e8-a49d-7b2026b0fb0a admin admin] PATH_INFO: `/v3/projects/cb88ac815a714d9da49120210b9edf24/users/0893fcb75f5c4650bd6bef2c0f313ceb/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:26.947463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f995a7-ee84-47e8-a49d-7b2026b0fb0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb88ac815a714d9da49120210b9edf24, user_id=0893fcb75f5c4650bd6bef2c0f313ceb, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:26.950068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f995a7-ee84-47e8-a49d-7b2026b0fb0a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:26.952829 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1193/2413] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:26 2021] DELETE /identity/v3/users/ca5eba837bd74068801f94e347a1d387 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:26.954463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b5754-7b52-4cb2-80bf-07b997b2e714 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:26.956065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9a3b5754-7b52-4cb2-80bf-07b997b2e714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:26.963733 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1221/2414] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:26 2021] PUT /identity/v3/projects/cb88ac815a714d9da49120210b9edf24/users/0893fcb75f5c4650bd6bef2c0f313ceb/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:26.964909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a3811-5f4a-447b-b22f-c25c0c368e77 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:26.965117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a3811-5f4a-447b-b22f-c25c0c368e77 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:26.965402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a3811-5f4a-447b-b22f-c25c0c368e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:26.996387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6b9a3811-5f4a-447b-b22f-c25c0c368e77 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:26.998024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6b9a3811-5f4a-447b-b22f-c25c0c368e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:27.032008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b5754-7b52-4cb2-80bf-07b997b2e714 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:27.062812 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1222/2415] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:27.068310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8880476-21bd-4592-8ad7-3fa457f8bdf9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:27.068705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8880476-21bd-4592-8ad7-3fa457f8bdf9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:27.069094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8880476-21bd-4592-8ad7-3fa457f8bdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:27.096742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3e03c-e7cc-47c6-9948-01584c80684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:27.097445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3e03c-e7cc-47c6-9948-01584c80684c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:27.097731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3e03c-e7cc-47c6-9948-01584c80684c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:27.098009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3e03c-e7cc-47c6-9948-01584c80684c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:27.098963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3e03c-e7cc-47c6-9948-01584c80684c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:27.100216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a8880476-21bd-4592-8ad7-3fa457f8bdf9 None None] MFA Rules not processed for user `0893fcb75f5c4650bd6bef2c0f313ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:27.100666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3e03c-e7cc-47c6-9948-01584c80684c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:27.101928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a8880476-21bd-4592-8ad7-3fa457f8bdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:27.111592 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1194/2416] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:26 2021] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:27.112423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3e03c-e7cc-47c6-9948-01584c80684c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:27.114929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-37f3e03c-e7cc-47c6-9948-01584c80684c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:27.182511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3e03c-e7cc-47c6-9948-01584c80684c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:27.189967 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1223/2417] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:27 2021] POST /identity/v3/auth/tokens => generated 3329 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:27.191195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8880476-21bd-4592-8ad7-3fa457f8bdf9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:27.199076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599852e7-ff08-4dad-81c5-d2d2e8ff776a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:27.200766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599852e7-ff08-4dad-81c5-d2d2e8ff776a service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:27.201074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599852e7-ff08-4dad-81c5-d2d2e8ff776a service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:27.201341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599852e7-ff08-4dad-81c5-d2d2e8ff776a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:27.208315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8880476-21bd-4592-8ad7-3fa457f8bdf9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:27.214220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599852e7-ff08-4dad-81c5-d2d2e8ff776a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:27.214920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0d478-d986-4348-88e8-3716c984b6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:27.215960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599852e7-ff08-4dad-81c5-d2d2e8ff776a service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:27.216097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0d478-d986-4348-88e8-3716c984b6f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:27.216486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0d478-d986-4348-88e8-3716c984b6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:27.216833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0d478-d986-4348-88e8-3716c984b6f3 admin admin] PATH_INFO: `/v3/projects/14b8df9c30264bf38f9d671b5f018ef9/users/a7d32a19e0c44459a1c8ac12fc7a0f9e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:27.233030 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1195/2418] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:27.238070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0d478-d986-4348-88e8-3716c984b6f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b8df9c30264bf38f9d671b5f018ef9, user_id=a7d32a19e0c44459a1c8ac12fc7a0f9e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:27.241875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0d478-d986-4348-88e8-3716c984b6f3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:27.260627 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1224/2419] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:27 2021] PUT /identity/v3/projects/14b8df9c30264bf38f9d671b5f018ef9/users/a7d32a19e0c44459a1c8ac12fc7a0f9e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:27.272489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd054a-f2c3-48af-be31-ddc216493c51 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:27.272802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd054a-f2c3-48af-be31-ddc216493c51 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:27.273169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd054a-f2c3-48af-be31-ddc216493c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:27.304911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9ddd054a-f2c3-48af-be31-ddc216493c51 None None] MFA Rules not processed for user `a7d32a19e0c44459a1c8ac12fc7a0f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:27.306539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9ddd054a-f2c3-48af-be31-ddc216493c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:27.387108 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1196/2420] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:27 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:27.391994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0d478-d986-4348-88e8-3716c984b6f3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:27.457752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd054a-f2c3-48af-be31-ddc216493c51 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:27.459768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0d478-d986-4348-88e8-3716c984b6f3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:27.459908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9ddd054a-f2c3-48af-be31-ddc216493c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:27.464728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d8141-416e-4dee-9d12-98d2880b1a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:27.465519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d8141-416e-4dee-9d12-98d2880b1a06 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:27.466373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d8141-416e-4dee-9d12-98d2880b1a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:27.466373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d8141-416e-4dee-9d12-98d2880b1a06 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:27.467113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d8141-416e-4dee-9d12-98d2880b1a06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:27.469113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d8141-416e-4dee-9d12-98d2880b1a06 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:27.501092 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1225/2421] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:27 2021] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:27.505833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d8141-416e-4dee-9d12-98d2880b1a06 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:27.543900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd054a-f2c3-48af-be31-ddc216493c51 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:27.580423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d8141-416e-4dee-9d12-98d2880b1a06 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:27.585594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265214e-a3ab-440b-9be1-b6c8d218d329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:27.586272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265214e-a3ab-440b-9be1-b6c8d218d329 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:27.586603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265214e-a3ab-440b-9be1-b6c8d218d329 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:27.586890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265214e-a3ab-440b-9be1-b6c8d218d329 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:27.587599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265214e-a3ab-440b-9be1-b6c8d218d329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:27.589552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265214e-a3ab-440b-9be1-b6c8d218d329 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:27.612354 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1226/2422] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:27 2021] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:27.616477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265214e-a3ab-440b-9be1-b6c8d218d329 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:27.620506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c753a-9eb3-4561-b5be-8d65b98fb940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:27.622495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c753a-9eb3-4561-b5be-8d65b98fb940 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:27.623269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c753a-9eb3-4561-b5be-8d65b98fb940 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:27.623802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c753a-9eb3-4561-b5be-8d65b98fb940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:27.630817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265214e-a3ab-440b-9be1-b6c8d218d329 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:27.638971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba9356-5b36-4931-8cf2-61b9ae555866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:27.639679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba9356-5b36-4931-8cf2-61b9ae555866 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:27.640121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba9356-5b36-4931-8cf2-61b9ae555866 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:27.640411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba9356-5b36-4931-8cf2-61b9ae555866 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:27.641163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba9356-5b36-4931-8cf2-61b9ae555866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:27.642958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba9356-5b36-4931-8cf2-61b9ae555866 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:27.659937 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1227/2423] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:27 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:27.665406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba9356-5b36-4931-8cf2-61b9ae555866 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:27.679630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba9356-5b36-4931-8cf2-61b9ae555866 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:27.689019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7c866-da84-4fae-b1c0-5800061665fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:27.690245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7c866-da84-4fae-b1c0-5800061665fd admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:27.694629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7c866-da84-4fae-b1c0-5800061665fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:27.695135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7c866-da84-4fae-b1c0-5800061665fd admin admin] PATH_INFO: `/v3/projects/afaf9df3d2d44c88a20ddca887b87f5e/users/649900fdab204629aa9e240284e8d27c/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:27.712846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7c866-da84-4fae-b1c0-5800061665fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=afaf9df3d2d44c88a20ddca887b87f5e, user_id=649900fdab204629aa9e240284e8d27c, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:27.716204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7c866-da84-4fae-b1c0-5800061665fd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:27.729161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c753a-9eb3-4561-b5be-8d65b98fb940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:27.731129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c753a-9eb3-4561-b5be-8d65b98fb940 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:27.743625 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1197/2424] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:27 2021] GET /identity/v3/auth/tokens => generated 3329 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:27.744623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c753a-9eb3-4561-b5be-8d65b98fb940 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:27.747233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-383c753a-9eb3-4561-b5be-8d65b98fb940 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:27.758787 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1228/2425] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:27 2021] PUT /identity/v3/projects/afaf9df3d2d44c88a20ddca887b87f5e/users/649900fdab204629aa9e240284e8d27c/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:27.764473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7c866-da84-4fae-b1c0-5800061665fd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:27.769100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c753a-9eb3-4561-b5be-8d65b98fb940 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:27.852936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861cfe3-63cf-439c-972f-9d170359dd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:27.853818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861cfe3-63cf-439c-972f-9d170359dd8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:27.854109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861cfe3-63cf-439c-972f-9d170359dd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:27.854425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861cfe3-63cf-439c-972f-9d170359dd8b admin admin] PATH_INFO: `/v3/projects/7286e278b6294224b331fcb637118978` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:27.856541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861cfe3-63cf-439c-972f-9d170359dd8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7286e278b6294224b331fcb637118978)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:27.859903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861cfe3-63cf-439c-972f-9d170359dd8b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:27.889435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7c866-da84-4fae-b1c0-5800061665fd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:27.894555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180e696-a339-4a99-98a3-b8596cd41be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:27.895851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180e696-a339-4a99-98a3-b8596cd41be3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:27.896137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180e696-a339-4a99-98a3-b8596cd41be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:27.896416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180e696-a339-4a99-98a3-b8596cd41be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:27.897291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180e696-a339-4a99-98a3-b8596cd41be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:27.898792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180e696-a339-4a99-98a3-b8596cd41be3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:27.912539 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1229/2426] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:27 2021] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:27.915881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180e696-a339-4a99-98a3-b8596cd41be3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:27.927733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180e696-a339-4a99-98a3-b8596cd41be3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:27.933656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720a904-404c-4e71-84ec-052dc8cfda44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:27.940647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720a904-404c-4e71-84ec-052dc8cfda44 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:27.943095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720a904-404c-4e71-84ec-052dc8cfda44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:27.943458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720a904-404c-4e71-84ec-052dc8cfda44 admin admin] PATH_INFO: `/v3/projects/afaf9df3d2d44c88a20ddca887b87f5e/users/649900fdab204629aa9e240284e8d27c/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:27.945789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720a904-404c-4e71-84ec-052dc8cfda44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afaf9df3d2d44c88a20ddca887b87f5e, user_id=649900fdab204629aa9e240284e8d27c, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:27.948659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720a904-404c-4e71-84ec-052dc8cfda44 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:27.970201 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1230/2427] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:27 2021] PUT /identity/v3/projects/afaf9df3d2d44c88a20ddca887b87f5e/users/649900fdab204629aa9e240284e8d27c/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:27.974981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2861cfe3-63cf-439c-972f-9d170359dd8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7286e278b6294224b331fcb637118978', 'request_id': 'req-2861cfe3-63cf-439c-972f-9d170359dd8b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:27.982522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c8fcb-198b-48df-9073-13a8bbe7e457 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:27.983015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c8fcb-198b-48df-9073-13a8bbe7e457 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:27.983459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c8fcb-198b-48df-9073-13a8bbe7e457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:27.983865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2861cfe3-63cf-439c-972f-9d170359dd8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7286e278b6294224b331fcb637118978', 'request_id': 'req-2861cfe3-63cf-439c-972f-9d170359dd8b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:27.991648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2861cfe3-63cf-439c-972f-9d170359dd8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7286e278b6294224b331fcb637118978', 'request_id': 'req-2861cfe3-63cf-439c-972f-9d170359dd8b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:28.018441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-079c8fcb-198b-48df-9073-13a8bbe7e457 None None] MFA Rules not processed for user `649900fdab204629aa9e240284e8d27c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:28.020762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2861cfe3-63cf-439c-972f-9d170359dd8b admin admin] The token cache is being invalidate because project 7286e278b6294224b331fcb637118978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:28.021316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-079c8fcb-198b-48df-9073-13a8bbe7e457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:28.021452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2861cfe3-63cf-439c-972f-9d170359dd8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:28.023467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2861cfe3-63cf-439c-972f-9d170359dd8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:28.031207 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1198/2428] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:27 2021] DELETE /identity/v3/projects/7286e278b6294224b331fcb637118978 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:28.036251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861cfe3-63cf-439c-972f-9d170359dd8b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:28.038668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2861cfe3-63cf-439c-972f-9d170359dd8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:28.144644 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1231/2429] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:27 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:28.178067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c8fcb-198b-48df-9073-13a8bbe7e457 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:28.180273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-079c8fcb-198b-48df-9073-13a8bbe7e457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:28.195882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861cfe3-63cf-439c-972f-9d170359dd8b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:28.299806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f6ce3-ebd2-4e5a-8f5a-05e3a3b05be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:28.300899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f6ce3-ebd2-4e5a-8f5a-05e3a3b05be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:28.301809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f6ce3-ebd2-4e5a-8f5a-05e3a3b05be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:28.302187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f6ce3-ebd2-4e5a-8f5a-05e3a3b05be7 admin admin] PATH_INFO: `/v3/users/e4c39ffd8cdf4111aebb8bf00c207cee` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:28.304346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f6ce3-ebd2-4e5a-8f5a-05e3a3b05be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c39ffd8cdf4111aebb8bf00c207cee)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:28.306910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f6ce3-ebd2-4e5a-8f5a-05e3a3b05be7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:28.308707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c8fcb-198b-48df-9073-13a8bbe7e457 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:28.316518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65a3de-1b42-4c4f-93f2-83bc65918d3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:28.317759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65a3de-1b42-4c4f-93f2-83bc65918d3e service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:28.318105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65a3de-1b42-4c4f-93f2-83bc65918d3e service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:28.318587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65a3de-1b42-4c4f-93f2-83bc65918d3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:28.330570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65a3de-1b42-4c4f-93f2-83bc65918d3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:28.333175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65a3de-1b42-4c4f-93f2-83bc65918d3e service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:28.346549 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1232/2430] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:28 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:48:28.368759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c633436-a6b9-43ba-acbf-806a38ccba9d None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:28.369202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c633436-a6b9-43ba-acbf-806a38ccba9d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:28.369792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c633436-a6b9-43ba-acbf-806a38ccba9d None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:28.373563 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1233/2431] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:28 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:48:28.380056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c633436-a6b9-43ba-acbf-806a38ccba9d None None] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:28.382244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2a4f6ce3-ebd2-4e5a-8f5a-05e3a3b05be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c39ffd8cdf4111aebb8bf00c207cee'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:28.392491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2a4f6ce3-ebd2-4e5a-8f5a-05e3a3b05be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c39ffd8cdf4111aebb8bf00c207cee'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:28.400841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c633436-a6b9-43ba-acbf-806a38ccba9d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:28.406604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2a4f6ce3-ebd2-4e5a-8f5a-05e3a3b05be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c39ffd8cdf4111aebb8bf00c207cee'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:28.407906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2a4f6ce3-ebd2-4e5a-8f5a-05e3a3b05be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c39ffd8cdf4111aebb8bf00c207cee'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:28.411502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c633436-a6b9-43ba-acbf-806a38ccba9d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:28.416881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a035bca-20c4-4b08-9f90-90fabf18b3c0 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '649900fdab204629aa9e240284e8d27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afaf9df3d2d44c88a20ddca887b87f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:28.417285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2a4f6ce3-ebd2-4e5a-8f5a-05e3a3b05be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c39ffd8cdf4111aebb8bf00c207cee'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:28.417848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a035bca-20c4-4b08-9f90-90fabf18b3c0 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:28.418171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a035bca-20c4-4b08-9f90-90fabf18b3c0 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:28.418489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a035bca-20c4-4b08-9f90-90fabf18b3c0 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] PATH_INFO: `/v3/projects/14b8df9c30264bf38f9d671b5f018ef9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:28.419849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a035bca-20c4-4b08-9f90-90fabf18b3c0 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorizing `identity:get_project(project_id=14b8df9c30264bf38f9d671b5f018ef9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:28.421781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a035bca-20c4-4b08-9f90-90fabf18b3c0 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:28.423671 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1234/2432] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:28 2021] GET /identity/v3/projects/14b8df9c30264bf38f9d671b5f018ef9 => generated 381 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:28.424863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e23c30-bc1d-4d41-9427-5750195ae7fe None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:28.425157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e23c30-bc1d-4d41-9427-5750195ae7fe None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:28.425437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e23c30-bc1d-4d41-9427-5750195ae7fe None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:28.427775 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1235/2433] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:48:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:48:28.431253 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1199/2434] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:28 2021] DELETE /identity/v3/users/e4c39ffd8cdf4111aebb8bf00c207cee => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:28.443448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae694e-4e00-4aed-8af5-856d994c2a55 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:28.443742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae694e-4e00-4aed-8af5-856d994c2a55 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:28.444025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae694e-4e00-4aed-8af5-856d994c2a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:28.465847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-faae694e-4e00-4aed-8af5-856d994c2a55 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:28.467112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-faae694e-4e00-4aed-8af5-856d994c2a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:28.542016 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1236/2435] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:48:28 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:28.563960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f6ce3-ebd2-4e5a-8f5a-05e3a3b05be7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:28.565495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2a4f6ce3-ebd2-4e5a-8f5a-05e3a3b05be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:28.581526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f6ce3-ebd2-4e5a-8f5a-05e3a3b05be7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:28.587905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf837d-c7a6-4843-bed3-fe41c1bc9db7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:28.588567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf837d-c7a6-4843-bed3-fe41c1bc9db7 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:28.589050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf837d-c7a6-4843-bed3-fe41c1bc9db7 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:28.589343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf837d-c7a6-4843-bed3-fe41c1bc9db7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:28.598936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf837d-c7a6-4843-bed3-fe41c1bc9db7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:28.600763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf837d-c7a6-4843-bed3-fe41c1bc9db7 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:28.611765 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1200/2436] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:28 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:28.818985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae694e-4e00-4aed-8af5-856d994c2a55 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:28.821781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-faae694e-4e00-4aed-8af5-856d994c2a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:28.903704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae694e-4e00-4aed-8af5-856d994c2a55 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:28.908688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eab0ae-3e8e-4332-bc7d-e32f6eef8e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:28.910190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eab0ae-3e8e-4332-bc7d-e32f6eef8e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:28.911112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eab0ae-3e8e-4332-bc7d-e32f6eef8e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:28.911464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eab0ae-3e8e-4332-bc7d-e32f6eef8e23 admin admin] PATH_INFO: `/v3/projects/77ca7f8d9693423bab58b84815724382` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:28.912746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eab0ae-3e8e-4332-bc7d-e32f6eef8e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ca7f8d9693423bab58b84815724382)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:28.916784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eab0ae-3e8e-4332-bc7d-e32f6eef8e23 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:28.935411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8500af0-a078-4064-a4dd-c7701795b0dd None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:28.935545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8500af0-a078-4064-a4dd-c7701795b0dd None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:28.935866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8500af0-a078-4064-a4dd-c7701795b0dd None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:28.938387 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1201/2437] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:48:28.949460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8500af0-a078-4064-a4dd-c7701795b0dd None None] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:28.951250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f8500af0-a078-4064-a4dd-c7701795b0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:28.970412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-25eab0ae-3e8e-4332-bc7d-e32f6eef8e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ca7f8d9693423bab58b84815724382', 'request_id': 'req-25eab0ae-3e8e-4332-bc7d-e32f6eef8e23'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:28.979114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-25eab0ae-3e8e-4332-bc7d-e32f6eef8e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ca7f8d9693423bab58b84815724382', 'request_id': 'req-25eab0ae-3e8e-4332-bc7d-e32f6eef8e23'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:28.993952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-25eab0ae-3e8e-4332-bc7d-e32f6eef8e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ca7f8d9693423bab58b84815724382', 'request_id': 'req-25eab0ae-3e8e-4332-bc7d-e32f6eef8e23'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:29.011701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-25eab0ae-3e8e-4332-bc7d-e32f6eef8e23 admin admin] The token cache is being invalidate because project 77ca7f8d9693423bab58b84815724382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:29.011701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-25eab0ae-3e8e-4332-bc7d-e32f6eef8e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:29.012787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-25eab0ae-3e8e-4332-bc7d-e32f6eef8e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:29.014587 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1237/2438] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:28 2021] DELETE /identity/v3/projects/77ca7f8d9693423bab58b84815724382 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:29.021805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202c42b-f0bf-4493-8812-d7aa85b53a5e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:29.022185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202c42b-f0bf-4493-8812-d7aa85b53a5e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:29.022473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202c42b-f0bf-4493-8812-d7aa85b53a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:29.040907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2202c42b-f0bf-4493-8812-d7aa85b53a5e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:29.042101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2202c42b-f0bf-4493-8812-d7aa85b53a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:29.049577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8500af0-a078-4064-a4dd-c7701795b0dd None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:29.050862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f8500af0-a078-4064-a4dd-c7701795b0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:29.103622 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1238/2439] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:29.112537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21fb80-84ca-4fdf-bbea-537f9e6498c4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:29.112820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21fb80-84ca-4fdf-bbea-537f9e6498c4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:29.113098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21fb80-84ca-4fdf-bbea-537f9e6498c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:29.125675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8500af0-a078-4064-a4dd-c7701795b0dd None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:29.130482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d434b2-06bb-4c12-835a-ecafcf14d664 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '649900fdab204629aa9e240284e8d27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afaf9df3d2d44c88a20ddca887b87f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:29.131293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0c21fb80-84ca-4fdf-bbea-537f9e6498c4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:29.131408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d434b2-06bb-4c12-835a-ecafcf14d664 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:29.131631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d434b2-06bb-4c12-835a-ecafcf14d664 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:29.132497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0c21fb80-84ca-4fdf-bbea-537f9e6498c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:29.132620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d434b2-06bb-4c12-835a-ecafcf14d664 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] PATH_INFO: `/v3/projects/14b8df9c30264bf38f9d671b5f018ef9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:29.133877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d434b2-06bb-4c12-835a-ecafcf14d664 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorizing `identity:get_project(project_id=14b8df9c30264bf38f9d671b5f018ef9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:29.136100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d434b2-06bb-4c12-835a-ecafcf14d664 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:29.137823 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1202/2440] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:28 2021] GET /identity/v3/projects/14b8df9c30264bf38f9d671b5f018ef9 => generated 381 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:48:29.141116 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1239/2441] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:29.145881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d434b2-06bb-4c12-835a-ecafcf14d664 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:29.156862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d434b2-06bb-4c12-835a-ecafcf14d664 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:29.162115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb98ae9-2504-4036-8b2d-5879a4465dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:29.162827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb98ae9-2504-4036-8b2d-5879a4465dcb admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:29.163113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb98ae9-2504-4036-8b2d-5879a4465dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:29.163403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb98ae9-2504-4036-8b2d-5879a4465dcb admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:29.164126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb98ae9-2504-4036-8b2d-5879a4465dcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:29.164520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb98ae9-2504-4036-8b2d-5879a4465dcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:29.165998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb98ae9-2504-4036-8b2d-5879a4465dcb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:29.179084 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1203/2442] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:48:29.185175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21fb80-84ca-4fdf-bbea-537f9e6498c4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:29.199115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21fb80-84ca-4fdf-bbea-537f9e6498c4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:29.204799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653773a3-08a6-4f4e-aeeb-8dea7a4422e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:29.205459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653773a3-08a6-4f4e-aeeb-8dea7a4422e1 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:29.205746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653773a3-08a6-4f4e-aeeb-8dea7a4422e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:29.206022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653773a3-08a6-4f4e-aeeb-8dea7a4422e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:29.206764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653773a3-08a6-4f4e-aeeb-8dea7a4422e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:29.209204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653773a3-08a6-4f4e-aeeb-8dea7a4422e1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:29.231308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401633eb-48ed-4e8d-bdc4-7e8bc6ba4ff8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:29.231970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401633eb-48ed-4e8d-bdc4-7e8bc6ba4ff8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:29.232614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401633eb-48ed-4e8d-bdc4-7e8bc6ba4ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:29.237635 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1240/2443] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:29 2021] POST /identity/v3/projects => generated 407 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:48:29.241741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653773a3-08a6-4f4e-aeeb-8dea7a4422e1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:29.255675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-401633eb-48ed-4e8d-bdc4-7e8bc6ba4ff8 None None] MFA Rules not processed for user `a7d32a19e0c44459a1c8ac12fc7a0f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:29.257389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-401633eb-48ed-4e8d-bdc4-7e8bc6ba4ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:29.321121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653773a3-08a6-4f4e-aeeb-8dea7a4422e1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:29.325830 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1204/2444] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:29 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:48:29.326936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109028b-0e6f-462a-b6c4-800ac8fe4287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:29.327818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109028b-0e6f-462a-b6c4-800ac8fe4287 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:29.328275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109028b-0e6f-462a-b6c4-800ac8fe4287 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:29.329091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109028b-0e6f-462a-b6c4-800ac8fe4287 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:29.330010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109028b-0e6f-462a-b6c4-800ac8fe4287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:29.332073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109028b-0e6f-462a-b6c4-800ac8fe4287 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:29.354286 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1241/2445] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:29 2021] POST /identity/v3/users => generated 304 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:29.358419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401633eb-48ed-4e8d-bdc4-7e8bc6ba4ff8 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:29.370335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401633eb-48ed-4e8d-bdc4-7e8bc6ba4ff8 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:29.375952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55661337-8e33-46f5-aed3-91053888301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:29.376628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55661337-8e33-46f5-aed3-91053888301c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:29.376908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55661337-8e33-46f5-aed3-91053888301c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:29.377289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55661337-8e33-46f5-aed3-91053888301c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:29.378132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55661337-8e33-46f5-aed3-91053888301c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:29.380423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55661337-8e33-46f5-aed3-91053888301c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:29.394082 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1205/2446] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:29 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:29.399242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109028b-0e6f-462a-b6c4-800ac8fe4287 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:29.409469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109028b-0e6f-462a-b6c4-800ac8fe4287 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:29.414333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46e33a-1a1e-4f3a-8cb4-85e5f48dfa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:29.414987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46e33a-1a1e-4f3a-8cb4-85e5f48dfa35 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:29.415267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46e33a-1a1e-4f3a-8cb4-85e5f48dfa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:29.415544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46e33a-1a1e-4f3a-8cb4-85e5f48dfa35 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:29.416441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46e33a-1a1e-4f3a-8cb4-85e5f48dfa35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:29.418017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46e33a-1a1e-4f3a-8cb4-85e5f48dfa35 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:29.431351 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1242/2447] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:29.432615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55661337-8e33-46f5-aed3-91053888301c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:29.443507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55661337-8e33-46f5-aed3-91053888301c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:29.448346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a3f1a-37d7-463c-a8c1-d74df3f545ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:29.449232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a3f1a-37d7-463c-a8c1-d74df3f545ec admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:29.449516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a3f1a-37d7-463c-a8c1-d74df3f545ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:29.449795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a3f1a-37d7-463c-a8c1-d74df3f545ec admin admin] PATH_INFO: `/v3/projects/ad7c907e3cc64b1d80a56d41b3a9dee0/users/809a6f3ba0674ba88afbf609ef0ab56b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:29.466750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a3f1a-37d7-463c-a8c1-d74df3f545ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad7c907e3cc64b1d80a56d41b3a9dee0, user_id=809a6f3ba0674ba88afbf609ef0ab56b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:29.470063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a3f1a-37d7-463c-a8c1-d74df3f545ec admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:29.484219 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1206/2448] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:29 2021] PUT /identity/v3/projects/ad7c907e3cc64b1d80a56d41b3a9dee0/users/809a6f3ba0674ba88afbf609ef0ab56b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:29.494771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c55ff-2e26-4ad2-8c5a-399152acbe10 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:29.495173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c55ff-2e26-4ad2-8c5a-399152acbe10 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:29.495545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c55ff-2e26-4ad2-8c5a-399152acbe10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:29.525281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7b0c55ff-2e26-4ad2-8c5a-399152acbe10 None None] MFA Rules not processed for user `809a6f3ba0674ba88afbf609ef0ab56b`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:29.526570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7b0c55ff-2e26-4ad2-8c5a-399152acbe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:29.593765 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1243/2449] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:29 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:29.598524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a3f1a-37d7-463c-a8c1-d74df3f545ec admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:29.662435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a3f1a-37d7-463c-a8c1-d74df3f545ec admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:29.668831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa97714-4977-4f24-a006-664aa48ca73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:29.670322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa97714-4977-4f24-a006-664aa48ca73a admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:29.670735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa97714-4977-4f24-a006-664aa48ca73a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:29.671265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa97714-4977-4f24-a006-664aa48ca73a admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:29.672100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa97714-4977-4f24-a006-664aa48ca73a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:29.674217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa97714-4977-4f24-a006-664aa48ca73a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:29.712385 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1207/2450] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:29 2021] POST /identity/v3/projects => generated 409 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:48:29.716282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c55ff-2e26-4ad2-8c5a-399152acbe10 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:29.731873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c55ff-2e26-4ad2-8c5a-399152acbe10 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:29.818780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c82057-174a-4d73-bccc-fa7cb2a27415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:29.820186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c82057-174a-4d73-bccc-fa7cb2a27415 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:29.820186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c82057-174a-4d73-bccc-fa7cb2a27415 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:29.820648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c82057-174a-4d73-bccc-fa7cb2a27415 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:29.821445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c82057-174a-4d73-bccc-fa7cb2a27415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:29.824604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c82057-174a-4d73-bccc-fa7cb2a27415 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:29.862000 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1244/2451] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:29 2021] POST /identity/v3/users => generated 311 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:29.866793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa97714-4977-4f24-a006-664aa48ca73a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:29.889406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa97714-4977-4f24-a006-664aa48ca73a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:29.900676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7fe64-3e7f-47ae-81e0-9ee2b113a17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:29.901453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7fe64-3e7f-47ae-81e0-9ee2b113a17b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:29.901777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7fe64-3e7f-47ae-81e0-9ee2b113a17b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:29.902054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7fe64-3e7f-47ae-81e0-9ee2b113a17b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:29.903819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7fe64-3e7f-47ae-81e0-9ee2b113a17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:29.905436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7fe64-3e7f-47ae-81e0-9ee2b113a17b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:29.918866 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1208/2452] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:29 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:29.923579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c82057-174a-4d73-bccc-fa7cb2a27415 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:29.939670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c82057-174a-4d73-bccc-fa7cb2a27415 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:29.952479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbfda6-bbc7-4117-98d0-67695e5d00c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:29.953776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbfda6-bbc7-4117-98d0-67695e5d00c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:29.954484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbfda6-bbc7-4117-98d0-67695e5d00c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:29.955362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbfda6-bbc7-4117-98d0-67695e5d00c3 admin admin] PATH_INFO: `/v3/projects/5fd59b1843a74105b22e9978f69ec229/users/7078208cefdd4e35bcec03ee633a6a8e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:29.975072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7fe64-3e7f-47ae-81e0-9ee2b113a17b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:29.977255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a0f7fe64-3e7f-47ae-81e0-9ee2b113a17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:29.991070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbfda6-bbc7-4117-98d0-67695e5d00c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd59b1843a74105b22e9978f69ec229, user_id=7078208cefdd4e35bcec03ee633a6a8e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:29.994871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbfda6-bbc7-4117-98d0-67695e5d00c3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:30.030420 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1245/2453] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:29 2021] PUT /identity/v3/projects/5fd59b1843a74105b22e9978f69ec229/users/7078208cefdd4e35bcec03ee633a6a8e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:30.034520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbfda6-bbc7-4117-98d0-67695e5d00c3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:30.136548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7fe64-3e7f-47ae-81e0-9ee2b113a17b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:30.155293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbfda6-bbc7-4117-98d0-67695e5d00c3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:30.175406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cfd99-76fb-48bb-93cb-91689b5ae680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:30.178553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cfd99-76fb-48bb-93cb-91689b5ae680 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:30.178553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cfd99-76fb-48bb-93cb-91689b5ae680 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:30.178553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cfd99-76fb-48bb-93cb-91689b5ae680 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:30.178553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cfd99-76fb-48bb-93cb-91689b5ae680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:30.180841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cfd99-76fb-48bb-93cb-91689b5ae680 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:30.207261 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1246/2454] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:30 2021] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:30.212158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cfd99-76fb-48bb-93cb-91689b5ae680 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:30.218524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01d3e5-7251-4a7d-969a-80d400195de1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:30.219185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01d3e5-7251-4a7d-969a-80d400195de1 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:30.219470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01d3e5-7251-4a7d-969a-80d400195de1 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:30.219746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01d3e5-7251-4a7d-969a-80d400195de1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:30.221758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6b01d3e5-7251-4a7d-969a-80d400195de1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:30.225194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cfd99-76fb-48bb-93cb-91689b5ae680 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:30.230465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149586bf-43ad-43ef-9ea3-b5952a1cea8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:30.231547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149586bf-43ad-43ef-9ea3-b5952a1cea8e admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:30.231547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149586bf-43ad-43ef-9ea3-b5952a1cea8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:30.231722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149586bf-43ad-43ef-9ea3-b5952a1cea8e admin admin] PATH_INFO: `/v3/projects/5fd59b1843a74105b22e9978f69ec229/users/7078208cefdd4e35bcec03ee633a6a8e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:30.233853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149586bf-43ad-43ef-9ea3-b5952a1cea8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd59b1843a74105b22e9978f69ec229, user_id=7078208cefdd4e35bcec03ee633a6a8e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:30.237129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149586bf-43ad-43ef-9ea3-b5952a1cea8e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:30.249384 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1247/2455] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:30 2021] PUT /identity/v3/projects/5fd59b1843a74105b22e9978f69ec229/users/7078208cefdd4e35bcec03ee633a6a8e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:30.261371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1c2e-cb95-4a75-b748-3de8c816ad04 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:30.261807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1c2e-cb95-4a75-b748-3de8c816ad04 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:30.262194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1c2e-cb95-4a75-b748-3de8c816ad04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:30.319238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-827f1c2e-cb95-4a75-b748-3de8c816ad04 None None] MFA Rules not processed for user `7078208cefdd4e35bcec03ee633a6a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:30.320468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-827f1c2e-cb95-4a75-b748-3de8c816ad04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:30.352187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01d3e5-7251-4a7d-969a-80d400195de1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:30.355253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01d3e5-7251-4a7d-969a-80d400195de1 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:30.377623 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1209/2456] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:29 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:30.431558 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1248/2457] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:30 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:48:31.467170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01d3e5-7251-4a7d-969a-80d400195de1 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:31.469475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6b01d3e5-7251-4a7d-969a-80d400195de1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:31.484502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01d3e5-7251-4a7d-969a-80d400195de1 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:31.554006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f400db-5d13-45d3-b09d-7161444c505e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:31.554479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f400db-5d13-45d3-b09d-7161444c505e service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:31.554766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f400db-5d13-45d3-b09d-7161444c505e service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:31.555053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f400db-5d13-45d3-b09d-7161444c505e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:31.564183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f400db-5d13-45d3-b09d-7161444c505e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:31.565756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f400db-5d13-45d3-b09d-7161444c505e service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:31.576161 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1210/2458] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:31 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:48:31.637345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d66697-3a27-45aa-92ba-9924a52e04b0 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:31.644297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d66697-3a27-45aa-92ba-9924a52e04b0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:31.644802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d66697-3a27-45aa-92ba-9924a52e04b0 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:31.648861 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1249/2459] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:31 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:48:31.656418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f400db-5d13-45d3-b09d-7161444c505e service nova] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:31.668543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f400db-5d13-45d3-b09d-7161444c505e service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:31.671620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f2f400db-5d13-45d3-b09d-7161444c505e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:31.760046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f400db-5d13-45d3-b09d-7161444c505e service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:31.767032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38376a1e-32d2-4e68-8766-c5609405fa0e tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '649900fdab204629aa9e240284e8d27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afaf9df3d2d44c88a20ddca887b87f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:31.768156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38376a1e-32d2-4e68-8766-c5609405fa0e tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:31.768531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38376a1e-32d2-4e68-8766-c5609405fa0e tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:31.768905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38376a1e-32d2-4e68-8766-c5609405fa0e tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] PATH_INFO: `/v3/projects/14b8df9c30264bf38f9d671b5f018ef9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:31.770396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38376a1e-32d2-4e68-8766-c5609405fa0e tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorizing `identity:get_project(project_id=14b8df9c30264bf38f9d671b5f018ef9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:31.772790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38376a1e-32d2-4e68-8766-c5609405fa0e tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:31.776010 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1211/2460] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:31 2021] GET /identity/v3/projects/14b8df9c30264bf38f9d671b5f018ef9 => generated 381 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:31.868690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d66697-3a27-45aa-92ba-9924a52e04b0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:31.883066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d66697-3a27-45aa-92ba-9924a52e04b0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:31.888529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a1db6-a61c-4150-9309-1243df2a7c03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:31.889160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a1db6-a61c-4150-9309-1243df2a7c03 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:31.889448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a1db6-a61c-4150-9309-1243df2a7c03 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:31.889722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a1db6-a61c-4150-9309-1243df2a7c03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:31.891891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a60a1db6-a61c-4150-9309-1243df2a7c03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:31.953615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a1db6-a61c-4150-9309-1243df2a7c03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:31.955420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a1db6-a61c-4150-9309-1243df2a7c03 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:31.966837 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1250/2461] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:31 2021] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:31.984329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38376a1e-32d2-4e68-8766-c5609405fa0e tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:31.991297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-38376a1e-32d2-4e68-8766-c5609405fa0e tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:31.996333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a1db6-a61c-4150-9309-1243df2a7c03 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:32.012925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a1db6-a61c-4150-9309-1243df2a7c03 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:32.022025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcb8ff-2743-4bd6-b04f-28dfa2e67ad4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:32.023529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcb8ff-2743-4bd6-b04f-28dfa2e67ad4 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:32.023845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcb8ff-2743-4bd6-b04f-28dfa2e67ad4 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:32.024456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcb8ff-2743-4bd6-b04f-28dfa2e67ad4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:32.095574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38376a1e-32d2-4e68-8766-c5609405fa0e tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:32.107776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a8ace-ea12-47ec-9dce-8164b2ad64bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:32.108659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a8ace-ea12-47ec-9dce-8164b2ad64bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:32.108949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a8ace-ea12-47ec-9dce-8164b2ad64bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:32.109228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a8ace-ea12-47ec-9dce-8164b2ad64bd admin admin] PATH_INFO: `/v3/users/7e20aee17ac54455ac1d3e397fabe86e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:32.110601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a8ace-ea12-47ec-9dce-8164b2ad64bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e20aee17ac54455ac1d3e397fabe86e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:32.110919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcb8ff-2743-4bd6-b04f-28dfa2e67ad4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:32.112400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a8ace-ea12-47ec-9dce-8164b2ad64bd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:32.113081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcb8ff-2743-4bd6-b04f-28dfa2e67ad4 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:32.131227 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1251/2462] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:31 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:48:32.165512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d103bdd-66cc-4685-a575-ca83ccd00c10 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:32.166023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d103bdd-66cc-4685-a575-ca83ccd00c10 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:32.166500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d103bdd-66cc-4685-a575-ca83ccd00c10 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:32.170366 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1252/2463] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:32 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:48:32.177655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d103bdd-66cc-4685-a575-ca83ccd00c10 None None] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:32.180212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-505a8ace-ea12-47ec-9dce-8164b2ad64bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e20aee17ac54455ac1d3e397fabe86e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:32.194492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-505a8ace-ea12-47ec-9dce-8164b2ad64bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e20aee17ac54455ac1d3e397fabe86e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:32.196285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d103bdd-66cc-4685-a575-ca83ccd00c10 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:32.209457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d103bdd-66cc-4685-a575-ca83ccd00c10 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:32.213714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-505a8ace-ea12-47ec-9dce-8164b2ad64bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e20aee17ac54455ac1d3e397fabe86e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:32.214903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294a5f3-96b3-4435-abd3-3eb7ee1591d1 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '649900fdab204629aa9e240284e8d27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afaf9df3d2d44c88a20ddca887b87f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:32.215808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a5f3-96b3-4435-abd3-3eb7ee1591d1 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:32.216028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-505a8ace-ea12-47ec-9dce-8164b2ad64bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e20aee17ac54455ac1d3e397fabe86e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:32.216131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a5f3-96b3-4435-abd3-3eb7ee1591d1 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:32.216352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a5f3-96b3-4435-abd3-3eb7ee1591d1 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] PATH_INFO: `/v3/projects/14b8df9c30264bf38f9d671b5f018ef9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:32.217617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294a5f3-96b3-4435-abd3-3eb7ee1591d1 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorizing `identity:get_project(project_id=14b8df9c30264bf38f9d671b5f018ef9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:32.221181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294a5f3-96b3-4435-abd3-3eb7ee1591d1 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:32.224697 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1253/2464] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:32 2021] GET /identity/v3/projects/14b8df9c30264bf38f9d671b5f018ef9 => generated 381 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:32.227780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-505a8ace-ea12-47ec-9dce-8164b2ad64bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e20aee17ac54455ac1d3e397fabe86e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:32.239355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428c8cc-d90d-4ab6-9d1e-5ca872dd9295 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:32.239640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428c8cc-d90d-4ab6-9d1e-5ca872dd9295 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:32.239915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428c8cc-d90d-4ab6-9d1e-5ca872dd9295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:32.241232 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1212/2465] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:31 2021] DELETE /identity/v3/users/7e20aee17ac54455ac1d3e397fabe86e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:32.266751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1428c8cc-d90d-4ab6-9d1e-5ca872dd9295 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:32.268060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1428c8cc-d90d-4ab6-9d1e-5ca872dd9295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:32.367774 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1254/2466] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:32.382442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a8ace-ea12-47ec-9dce-8164b2ad64bd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:32.383911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-505a8ace-ea12-47ec-9dce-8164b2ad64bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:32.482131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a8ace-ea12-47ec-9dce-8164b2ad64bd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:32.491637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf2c37-4ac5-4215-ae53-b37ae7086013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:32.492360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf2c37-4ac5-4215-ae53-b37ae7086013 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:32.492630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf2c37-4ac5-4215-ae53-b37ae7086013 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:32.492909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf2c37-4ac5-4215-ae53-b37ae7086013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:32.506318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf2c37-4ac5-4215-ae53-b37ae7086013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:32.507956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf2c37-4ac5-4215-ae53-b37ae7086013 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:32.521188 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1213/2467] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:32.581769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df40bea-759a-4410-b2d8-87eec4ac7596 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:32.582870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df40bea-759a-4410-b2d8-87eec4ac7596 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:32.583350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df40bea-759a-4410-b2d8-87eec4ac7596 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:32.585905 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1255/2468] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:32 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:48:32.592917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf2c37-4ac5-4215-ae53-b37ae7086013 service neutron] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:32.594788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b1bf2c37-4ac5-4215-ae53-b37ae7086013 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:32.748689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf2c37-4ac5-4215-ae53-b37ae7086013 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:32.750820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b1bf2c37-4ac5-4215-ae53-b37ae7086013 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:32.835728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf2c37-4ac5-4215-ae53-b37ae7086013 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:32.846243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cdca4-57a8-4bca-91b9-583002b3c26f tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '649900fdab204629aa9e240284e8d27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afaf9df3d2d44c88a20ddca887b87f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:32.850227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cdca4-57a8-4bca-91b9-583002b3c26f tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:32.854181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cdca4-57a8-4bca-91b9-583002b3c26f tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:32.854755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cdca4-57a8-4bca-91b9-583002b3c26f tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] PATH_INFO: `/v3/projects/14b8df9c30264bf38f9d671b5f018ef9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:32.856337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cdca4-57a8-4bca-91b9-583002b3c26f tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorizing `identity:get_project(project_id=14b8df9c30264bf38f9d671b5f018ef9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:32.861028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cdca4-57a8-4bca-91b9-583002b3c26f tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:32.864400 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1214/2469] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:32 2021] GET /identity/v3/projects/14b8df9c30264bf38f9d671b5f018ef9 => generated 381 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:32.979236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63058c7-1db7-4d5d-a549-063f09402a1a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:32.979704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63058c7-1db7-4d5d-a549-063f09402a1a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:32.979812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63058c7-1db7-4d5d-a549-063f09402a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:33.013994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f63058c7-1db7-4d5d-a549-063f09402a1a None None] MFA Rules not processed for user `a7d32a19e0c44459a1c8ac12fc7a0f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:33.017466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f63058c7-1db7-4d5d-a549-063f09402a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:33.125238 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1256/2470] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:32 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:33.241096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cdca4-57a8-4bca-91b9-583002b3c26f tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:33.242870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bc6cdca4-57a8-4bca-91b9-583002b3c26f tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:33.258088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cdca4-57a8-4bca-91b9-583002b3c26f tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:33.267043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291dd22-c75c-4ed6-a022-93d439241b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:33.268296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291dd22-c75c-4ed6-a022-93d439241b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:33.269779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291dd22-c75c-4ed6-a022-93d439241b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:33.272803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291dd22-c75c-4ed6-a022-93d439241b55 admin admin] PATH_INFO: `/v3/projects/9b188787cdec4c93a20c443b630076f0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:33.276143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291dd22-c75c-4ed6-a022-93d439241b55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b188787cdec4c93a20c443b630076f0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:33.296855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291dd22-c75c-4ed6-a022-93d439241b55 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:33.371886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a291dd22-c75c-4ed6-a022-93d439241b55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b188787cdec4c93a20c443b630076f0', 'request_id': 'req-a291dd22-c75c-4ed6-a022-93d439241b55'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:33.379808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a291dd22-c75c-4ed6-a022-93d439241b55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b188787cdec4c93a20c443b630076f0', 'request_id': 'req-a291dd22-c75c-4ed6-a022-93d439241b55'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:33.386523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a291dd22-c75c-4ed6-a022-93d439241b55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b188787cdec4c93a20c443b630076f0', 'request_id': 'req-a291dd22-c75c-4ed6-a022-93d439241b55'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:33.402873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a291dd22-c75c-4ed6-a022-93d439241b55 admin admin] The token cache is being invalidate because project 9b188787cdec4c93a20c443b630076f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:33.403215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a291dd22-c75c-4ed6-a022-93d439241b55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:33.403858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a291dd22-c75c-4ed6-a022-93d439241b55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:33.408940 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1215/2471] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:33 2021] DELETE /identity/v3/projects/9b188787cdec4c93a20c443b630076f0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:33.411788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63058c7-1db7-4d5d-a549-063f09402a1a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:33.423868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63058c7-1db7-4d5d-a549-063f09402a1a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:33.517300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c1b0a-d79c-433e-98ce-9c1bfd14b3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:33.518510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c1b0a-d79c-433e-98ce-9c1bfd14b3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:33.519036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c1b0a-d79c-433e-98ce-9c1bfd14b3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:33.519547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c1b0a-d79c-433e-98ce-9c1bfd14b3e0 admin admin] PATH_INFO: `/v3/users/0893fcb75f5c4650bd6bef2c0f313ceb` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:33.523178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c1b0a-d79c-433e-98ce-9c1bfd14b3e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0893fcb75f5c4650bd6bef2c0f313ceb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:33.526167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c1b0a-d79c-433e-98ce-9c1bfd14b3e0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:33.610888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5d2c1b0a-d79c-433e-98ce-9c1bfd14b3e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0893fcb75f5c4650bd6bef2c0f313ceb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:33.628627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5d2c1b0a-d79c-433e-98ce-9c1bfd14b3e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0893fcb75f5c4650bd6bef2c0f313ceb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:33.629400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5d2c1b0a-d79c-433e-98ce-9c1bfd14b3e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0893fcb75f5c4650bd6bef2c0f313ceb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:33.661490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5d2c1b0a-d79c-433e-98ce-9c1bfd14b3e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0893fcb75f5c4650bd6bef2c0f313ceb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:33.678851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5d2c1b0a-d79c-433e-98ce-9c1bfd14b3e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0893fcb75f5c4650bd6bef2c0f313ceb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:33.693124 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1257/2472] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:33 2021] DELETE /identity/v3/users/0893fcb75f5c4650bd6bef2c0f313ceb => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:34.211794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291dd22-c75c-4ed6-a022-93d439241b55 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:34.221408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a291dd22-c75c-4ed6-a022-93d439241b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:34.242011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291dd22-c75c-4ed6-a022-93d439241b55 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:34.354035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01a405-6bc5-482d-8759-48645c4b40dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:34.355153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01a405-6bc5-482d-8759-48645c4b40dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:34.355498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01a405-6bc5-482d-8759-48645c4b40dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:34.355996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01a405-6bc5-482d-8759-48645c4b40dc admin admin] PATH_INFO: `/v3/users/809a6f3ba0674ba88afbf609ef0ab56b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:34.357656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01a405-6bc5-482d-8759-48645c4b40dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=809a6f3ba0674ba88afbf609ef0ab56b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:34.359835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01a405-6bc5-482d-8759-48645c4b40dc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:34.428928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c1b0a-d79c-433e-98ce-9c1bfd14b3e0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:34.430615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5d2c1b0a-d79c-433e-98ce-9c1bfd14b3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:34.440095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ca01a405-6bc5-482d-8759-48645c4b40dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '809a6f3ba0674ba88afbf609ef0ab56b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:34.450099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c1b0a-d79c-433e-98ce-9c1bfd14b3e0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:34.453955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ca01a405-6bc5-482d-8759-48645c4b40dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '809a6f3ba0674ba88afbf609ef0ab56b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:34.456401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99558aae-b7ac-4865-8869-15e7f2762d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:34.458483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99558aae-b7ac-4865-8869-15e7f2762d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:34.459023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99558aae-b7ac-4865-8869-15e7f2762d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:34.459397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99558aae-b7ac-4865-8869-15e7f2762d9a admin admin] PATH_INFO: `/v3/projects/cb88ac815a714d9da49120210b9edf24` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:34.461058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99558aae-b7ac-4865-8869-15e7f2762d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb88ac815a714d9da49120210b9edf24)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:34.470873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99558aae-b7ac-4865-8869-15e7f2762d9a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:34.491436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ca01a405-6bc5-482d-8759-48645c4b40dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '809a6f3ba0674ba88afbf609ef0ab56b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:34.493540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ca01a405-6bc5-482d-8759-48645c4b40dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '809a6f3ba0674ba88afbf609ef0ab56b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:34.518538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ca01a405-6bc5-482d-8759-48645c4b40dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '809a6f3ba0674ba88afbf609ef0ab56b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:34.535679 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1216/2473] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:34 2021] DELETE /identity/v3/users/809a6f3ba0674ba88afbf609ef0ab56b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:34.540108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036dbe9-c129-4f45-b9e9-e3e38e7c8827 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:34.542499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036dbe9-c129-4f45-b9e9-e3e38e7c8827 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:34.542944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036dbe9-c129-4f45-b9e9-e3e38e7c8827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:34.551920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-99558aae-b7ac-4865-8869-15e7f2762d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb88ac815a714d9da49120210b9edf24', 'request_id': 'req-99558aae-b7ac-4865-8869-15e7f2762d9a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:34.562112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-99558aae-b7ac-4865-8869-15e7f2762d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb88ac815a714d9da49120210b9edf24', 'request_id': 'req-99558aae-b7ac-4865-8869-15e7f2762d9a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:34.579166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-99558aae-b7ac-4865-8869-15e7f2762d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb88ac815a714d9da49120210b9edf24', 'request_id': 'req-99558aae-b7ac-4865-8869-15e7f2762d9a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:34.601222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f036dbe9-c129-4f45-b9e9-e3e38e7c8827 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:34.602492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f036dbe9-c129-4f45-b9e9-e3e38e7c8827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:34.608559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-99558aae-b7ac-4865-8869-15e7f2762d9a admin admin] The token cache is being invalidate because project cb88ac815a714d9da49120210b9edf24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:34.610941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-99558aae-b7ac-4865-8869-15e7f2762d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:34.611753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-99558aae-b7ac-4865-8869-15e7f2762d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:34.615042 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1258/2474] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:34 2021] DELETE /identity/v3/projects/cb88ac815a714d9da49120210b9edf24 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:34.621113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debce6e-05d5-416a-a031-547823a4be3e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:34.621484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debce6e-05d5-416a-a031-547823a4be3e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:34.622440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debce6e-05d5-416a-a031-547823a4be3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:34.648887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2debce6e-05d5-416a-a031-547823a4be3e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:34.650494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2debce6e-05d5-416a-a031-547823a4be3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:34.726100 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1217/2475] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:34.727660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993a450-7780-405e-8b20-55549027ca2d None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:34.728315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993a450-7780-405e-8b20-55549027ca2d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:34.728445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993a450-7780-405e-8b20-55549027ca2d None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:34.731246 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1218/2476] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:48:34.738439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993a450-7780-405e-8b20-55549027ca2d None None] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:34.745388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3993a450-7780-405e-8b20-55549027ca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:34.794639 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1259/2477] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:34.795279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debce6e-05d5-416a-a031-547823a4be3e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:34.796992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2debce6e-05d5-416a-a031-547823a4be3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:34.901677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debce6e-05d5-416a-a031-547823a4be3e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:34.912232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f01308-fc65-4d90-ae80-7a18f1cb92db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:34.913131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f01308-fc65-4d90-ae80-7a18f1cb92db service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:34.913427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f01308-fc65-4d90-ae80-7a18f1cb92db service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:34.913753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f01308-fc65-4d90-ae80-7a18f1cb92db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:34.929514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993a450-7780-405e-8b20-55549027ca2d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:34.931199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3993a450-7780-405e-8b20-55549027ca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:34.931378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f01308-fc65-4d90-ae80-7a18f1cb92db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:34.933131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f01308-fc65-4d90-ae80-7a18f1cb92db service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:34.948262 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1260/2478] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:34.949563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede7355-ce05-42c2-8110-a321d57bbe53 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:34.949894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede7355-ce05-42c2-8110-a321d57bbe53 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:34.952878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede7355-ce05-42c2-8110-a321d57bbe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:34.977686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2ede7355-ce05-42c2-8110-a321d57bbe53 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:34.979255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2ede7355-ce05-42c2-8110-a321d57bbe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:34.991040 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1261/2479] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:34.996123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede7355-ce05-42c2-8110-a321d57bbe53 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:35.012973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede7355-ce05-42c2-8110-a321d57bbe53 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:35.020204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce667d3c-d009-41f3-a7a8-59d181e0b3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:35.022809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce667d3c-d009-41f3-a7a8-59d181e0b3db admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:35.023584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce667d3c-d009-41f3-a7a8-59d181e0b3db admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:35.023584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce667d3c-d009-41f3-a7a8-59d181e0b3db admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:35.024671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce667d3c-d009-41f3-a7a8-59d181e0b3db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:35.025012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce667d3c-d009-41f3-a7a8-59d181e0b3db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:35.027735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce667d3c-d009-41f3-a7a8-59d181e0b3db admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:35.053347 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1262/2480] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:35.054664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce667d3c-d009-41f3-a7a8-59d181e0b3db admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:35.068650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993a450-7780-405e-8b20-55549027ca2d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:35.072504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce667d3c-d009-41f3-a7a8-59d181e0b3db admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:35.077185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042082e9-7ce8-4c24-bd0d-7e81cc24e1f6 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '649900fdab204629aa9e240284e8d27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afaf9df3d2d44c88a20ddca887b87f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:35.078451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042082e9-7ce8-4c24-bd0d-7e81cc24e1f6 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:35.078845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042082e9-7ce8-4c24-bd0d-7e81cc24e1f6 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:35.079310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042082e9-7ce8-4c24-bd0d-7e81cc24e1f6 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] PATH_INFO: `/v3/projects/14b8df9c30264bf38f9d671b5f018ef9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:35.080909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042082e9-7ce8-4c24-bd0d-7e81cc24e1f6 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorizing `identity:get_project(project_id=14b8df9c30264bf38f9d671b5f018ef9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:35.083808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042082e9-7ce8-4c24-bd0d-7e81cc24e1f6 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:35.087953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff337a-22c8-49a0-a356-5408c1687c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:35.088624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff337a-22c8-49a0-a356-5408c1687c74 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:35.089357 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1219/2481] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:34 2021] GET /identity/v3/projects/14b8df9c30264bf38f9d671b5f018ef9 => generated 381 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:35.098942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff337a-22c8-49a0-a356-5408c1687c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:35.099491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff337a-22c8-49a0-a356-5408c1687c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:35.100461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff337a-22c8-49a0-a356-5408c1687c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:35.102961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff337a-22c8-49a0-a356-5408c1687c74 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:35.149307 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1263/2482] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:35 2021] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:35.153736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042082e9-7ce8-4c24-bd0d-7e81cc24e1f6 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:35.174377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042082e9-7ce8-4c24-bd0d-7e81cc24e1f6 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:35.267961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662c741-6568-4a74-a141-46a73b1a032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:35.269063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662c741-6568-4a74-a141-46a73b1a032d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:35.269517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662c741-6568-4a74-a141-46a73b1a032d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:35.270623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662c741-6568-4a74-a141-46a73b1a032d admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:35.271470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662c741-6568-4a74-a141-46a73b1a032d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:35.274414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662c741-6568-4a74-a141-46a73b1a032d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:35.306458 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1220/2483] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:35 2021] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:35.310140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff337a-22c8-49a0-a356-5408c1687c74 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:35.326536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff337a-22c8-49a0-a356-5408c1687c74 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:35.334673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4e1b3-cbc1-433f-a2ca-c304be30fadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:35.335636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4e1b3-cbc1-433f-a2ca-c304be30fadf admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:35.336031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4e1b3-cbc1-433f-a2ca-c304be30fadf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:35.336420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4e1b3-cbc1-433f-a2ca-c304be30fadf admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:35.337582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4e1b3-cbc1-433f-a2ca-c304be30fadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:35.340768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4e1b3-cbc1-433f-a2ca-c304be30fadf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:35.358653 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1264/2484] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:35 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:35.365740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662c741-6568-4a74-a141-46a73b1a032d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:35.378161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662c741-6568-4a74-a141-46a73b1a032d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:35.398199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a1559-4d93-4a0d-8533-45eae316d808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:35.398931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a1559-4d93-4a0d-8533-45eae316d808 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:35.399217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a1559-4d93-4a0d-8533-45eae316d808 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:35.399499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a1559-4d93-4a0d-8533-45eae316d808 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:35.400255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a1559-4d93-4a0d-8533-45eae316d808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:35.402444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a1559-4d93-4a0d-8533-45eae316d808 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:35.437223 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1221/2485] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:35 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:35.440649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4e1b3-cbc1-433f-a2ca-c304be30fadf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:35.451823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4e1b3-cbc1-433f-a2ca-c304be30fadf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:35.457821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf3983-ba2e-4606-ada9-00f1811f94df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:35.458910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf3983-ba2e-4606-ada9-00f1811f94df admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:35.459293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf3983-ba2e-4606-ada9-00f1811f94df admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:35.460114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf3983-ba2e-4606-ada9-00f1811f94df admin admin] PATH_INFO: `/v3/projects/2e459a051d234475b150b36857974efb/users/015a3244598f429fbe145939f9624206/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:35.477800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf3983-ba2e-4606-ada9-00f1811f94df admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e459a051d234475b150b36857974efb, user_id=015a3244598f429fbe145939f9624206, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:35.481477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf3983-ba2e-4606-ada9-00f1811f94df admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:35.510054 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1265/2486] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:35 2021] PUT /identity/v3/projects/2e459a051d234475b150b36857974efb/users/015a3244598f429fbe145939f9624206/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:35.512249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c411c4-9c4d-4c6c-82da-90ab54d8a803 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:35.512549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c411c4-9c4d-4c6c-82da-90ab54d8a803 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:35.512834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c411c4-9c4d-4c6c-82da-90ab54d8a803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:35.542025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d8c411c4-9c4d-4c6c-82da-90ab54d8a803 None None] MFA Rules not processed for user `015a3244598f429fbe145939f9624206`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:35.543454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d8c411c4-9c4d-4c6c-82da-90ab54d8a803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:35.628498 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1222/2487] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:35 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:35.630542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf3983-ba2e-4606-ada9-00f1811f94df admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:35.709864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf3983-ba2e-4606-ada9-00f1811f94df admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:35.720562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027284b-a772-44b9-a685-e8dec3ba2063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:35.721334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027284b-a772-44b9-a685-e8dec3ba2063 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:35.721621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027284b-a772-44b9-a685-e8dec3ba2063 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:35.721901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027284b-a772-44b9-a685-e8dec3ba2063 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:35.723314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027284b-a772-44b9-a685-e8dec3ba2063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:35.725780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027284b-a772-44b9-a685-e8dec3ba2063 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:35.779963 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1266/2488] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:35 2021] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:35.783298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c411c4-9c4d-4c6c-82da-90ab54d8a803 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:35.818395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c411c4-9c4d-4c6c-82da-90ab54d8a803 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:35.899926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fd33d-fb9a-400c-9d32-c17b2f1f4298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:35.900898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fd33d-fb9a-400c-9d32-c17b2f1f4298 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:35.901441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fd33d-fb9a-400c-9d32-c17b2f1f4298 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:35.901718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fd33d-fb9a-400c-9d32-c17b2f1f4298 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:35.903011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fd33d-fb9a-400c-9d32-c17b2f1f4298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:35.905217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fd33d-fb9a-400c-9d32-c17b2f1f4298 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:35.931575 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1223/2489] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:35 2021] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:35.938231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027284b-a772-44b9-a685-e8dec3ba2063 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:35.965360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027284b-a772-44b9-a685-e8dec3ba2063 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:35.970112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ada02-c3d6-4829-a587-1296a29f74ba None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:35.970454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ada02-c3d6-4829-a587-1296a29f74ba None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:35.970858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ada02-c3d6-4829-a587-1296a29f74ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:35.972278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ac2da-b81f-4bae-a05b-07ba40d7ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:35.973912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ac2da-b81f-4bae-a05b-07ba40d7ce22 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:35.975322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ac2da-b81f-4bae-a05b-07ba40d7ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:35.975869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ac2da-b81f-4bae-a05b-07ba40d7ce22 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:35.976916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ac2da-b81f-4bae-a05b-07ba40d7ce22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:35.978589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ac2da-b81f-4bae-a05b-07ba40d7ce22 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:35.995388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9f0ada02-c3d6-4829-a587-1296a29f74ba None None] MFA Rules not processed for user `5aaf1ced6baf4e1d9c940cfe96b2c254`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:35.998862 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1267/2490] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:35 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:35.998990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9f0ada02-c3d6-4829-a587-1296a29f74ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:35.999068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecafd8-47d9-4ef2-bda8-588f84977ab8 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:35.999068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecafd8-47d9-4ef2-bda8-588f84977ab8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:35.999247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecafd8-47d9-4ef2-bda8-588f84977ab8 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:36.001236 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1268/2491] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:48:36.001954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecafd8-47d9-4ef2-bda8-588f84977ab8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:36.021362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecafd8-47d9-4ef2-bda8-588f84977ab8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:36.029048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03074b79-6fd5-44ee-9f7f-553c0f24b55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:36.029547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03074b79-6fd5-44ee-9f7f-553c0f24b55a admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:36.029863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03074b79-6fd5-44ee-9f7f-553c0f24b55a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:36.030146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03074b79-6fd5-44ee-9f7f-553c0f24b55a admin admin] PATH_INFO: `/v3/projects/7423f37443734a178d77b89d719de8b9/users/2192096144f54d239339bfa8a5e5da02/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:36.054268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03074b79-6fd5-44ee-9f7f-553c0f24b55a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7423f37443734a178d77b89d719de8b9, user_id=2192096144f54d239339bfa8a5e5da02, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:36.057787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03074b79-6fd5-44ee-9f7f-553c0f24b55a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:36.085628 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1269/2492] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:36 2021] PUT /identity/v3/projects/7423f37443734a178d77b89d719de8b9/users/2192096144f54d239339bfa8a5e5da02/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:36.085628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03074b79-6fd5-44ee-9f7f-553c0f24b55a admin admin] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:36.088569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-03074b79-6fd5-44ee-9f7f-553c0f24b55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:36.124975 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1224/2493] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:35 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:48:36.128750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ada02-c3d6-4829-a587-1296a29f74ba None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:36.159495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ada02-c3d6-4829-a587-1296a29f74ba None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:36.195745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03074b79-6fd5-44ee-9f7f-553c0f24b55a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:36.237583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931298d-950a-42e0-bc28-bedfee3dd1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:36.239882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931298d-950a-42e0-bc28-bedfee3dd1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:36.240415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931298d-950a-42e0-bc28-bedfee3dd1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:36.241539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931298d-950a-42e0-bc28-bedfee3dd1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:36.242528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931298d-950a-42e0-bc28-bedfee3dd1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:36.244324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931298d-950a-42e0-bc28-bedfee3dd1d3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:36.258417 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1225/2494] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:36 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:36.262880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931298d-950a-42e0-bc28-bedfee3dd1d3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:36.280863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931298d-950a-42e0-bc28-bedfee3dd1d3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:36.289468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da15d20-0a81-423e-a447-7dd5e82c9a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:36.290954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da15d20-0a81-423e-a447-7dd5e82c9a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:36.291546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da15d20-0a81-423e-a447-7dd5e82c9a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:36.291920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da15d20-0a81-423e-a447-7dd5e82c9a23 admin admin] PATH_INFO: `/v3/projects/7423f37443734a178d77b89d719de8b9/users/2192096144f54d239339bfa8a5e5da02/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:36.295276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da15d20-0a81-423e-a447-7dd5e82c9a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7423f37443734a178d77b89d719de8b9, user_id=2192096144f54d239339bfa8a5e5da02, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:36.298697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da15d20-0a81-423e-a447-7dd5e82c9a23 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:36.322328 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1226/2495] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:36 2021] PUT /identity/v3/projects/7423f37443734a178d77b89d719de8b9/users/2192096144f54d239339bfa8a5e5da02/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:36.324678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03074b79-6fd5-44ee-9f7f-553c0f24b55a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:36.331738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e30c5-224e-4309-a42e-5c996ad329ba None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:36.333023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e30c5-224e-4309-a42e-5c996ad329ba None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:36.333491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e30c5-224e-4309-a42e-5c996ad329ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:36.402402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-473e30c5-224e-4309-a42e-5c996ad329ba None None] MFA Rules not processed for user `2192096144f54d239339bfa8a5e5da02`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:36.404956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-473e30c5-224e-4309-a42e-5c996ad329ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:36.493727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66802ff9-24c9-4b9e-afb8-5feaaea1e123 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '649900fdab204629aa9e240284e8d27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afaf9df3d2d44c88a20ddca887b87f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:36.494818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66802ff9-24c9-4b9e-afb8-5feaaea1e123 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:36.495210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66802ff9-24c9-4b9e-afb8-5feaaea1e123 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:36.495585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66802ff9-24c9-4b9e-afb8-5feaaea1e123 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] PATH_INFO: `/v3/projects/14b8df9c30264bf38f9d671b5f018ef9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:36.498327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66802ff9-24c9-4b9e-afb8-5feaaea1e123 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorizing `identity:get_project(project_id=14b8df9c30264bf38f9d671b5f018ef9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:36.503230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66802ff9-24c9-4b9e-afb8-5feaaea1e123 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:36.509790 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1270/2496] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:36 2021] GET /identity/v3/projects/14b8df9c30264bf38f9d671b5f018ef9 => generated 381 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:36.573800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66802ff9-24c9-4b9e-afb8-5feaaea1e123 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:36.575903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-66802ff9-24c9-4b9e-afb8-5feaaea1e123 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:36.640612 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1227/2497] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:36 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:36.653012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc853-a27f-4e36-b1f2-73a67eb5b44c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:36.653402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc853-a27f-4e36-b1f2-73a67eb5b44c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:36.654206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc853-a27f-4e36-b1f2-73a67eb5b44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:36.689620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8b3bc853-a27f-4e36-b1f2-73a67eb5b44c None None] MFA Rules not processed for user `015a3244598f429fbe145939f9624206`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:36.698023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8b3bc853-a27f-4e36-b1f2-73a67eb5b44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:36.756205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66802ff9-24c9-4b9e-afb8-5feaaea1e123 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:36.768689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:36.770503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:36.771222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:36.771656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1 admin admin] PATH_INFO: `/v3/projects/ad7c907e3cc64b1d80a56d41b3a9dee0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:36.773487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad7c907e3cc64b1d80a56d41b3a9dee0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:36.776524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:36.797302 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1228/2498] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:36 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:36.797302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46d024-ce5f-489e-b25c-e17916353c79 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:36.797302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46d024-ce5f-489e-b25c-e17916353c79 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:36.797302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46d024-ce5f-489e-b25c-e17916353c79 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:36.812409 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1229/2499] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:36 2021] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:48:36.813494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46d024-ce5f-489e-b25c-e17916353c79 None None] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:36.914010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad7c907e3cc64b1d80a56d41b3a9dee0', 'request_id': 'req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:36.931394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad7c907e3cc64b1d80a56d41b3a9dee0', 'request_id': 'req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:36.945201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad7c907e3cc64b1d80a56d41b3a9dee0', 'request_id': 'req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:36.948889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46d024-ce5f-489e-b25c-e17916353c79 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:36.961437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1 admin admin] The token cache is being invalidate because project ad7c907e3cc64b1d80a56d41b3a9dee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:36.962020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:36.963171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:36.965837 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1271/2500] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:36 2021] DELETE /identity/v3/projects/ad7c907e3cc64b1d80a56d41b3a9dee0 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:36.969717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:36.971888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:36.975444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46d024-ce5f-489e-b25c-e17916353c79 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:37.086396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd874888-f2d7-42d5-b534-a2fdf2bdc050 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '649900fdab204629aa9e240284e8d27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afaf9df3d2d44c88a20ddca887b87f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:37.087281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd874888-f2d7-42d5-b534-a2fdf2bdc050 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:37.087602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd874888-f2d7-42d5-b534-a2fdf2bdc050 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:37.087880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd874888-f2d7-42d5-b534-a2fdf2bdc050 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] PATH_INFO: `/v3/projects/14b8df9c30264bf38f9d671b5f018ef9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:37.091180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd874888-f2d7-42d5-b534-a2fdf2bdc050 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorizing `identity:get_project(project_id=14b8df9c30264bf38f9d671b5f018ef9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:37.093251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd874888-f2d7-42d5-b534-a2fdf2bdc050 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:37.109182 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1230/2501] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:36 2021] GET /identity/v3/projects/14b8df9c30264bf38f9d671b5f018ef9 => generated 381 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:37.131366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3a336-fbe5-42ef-98f5-f35e8d13f6e1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:37.148175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce456ae-3c7c-481f-bb82-7df44c7d3098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:37.148981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce456ae-3c7c-481f-bb82-7df44c7d3098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:37.149265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce456ae-3c7c-481f-bb82-7df44c7d3098 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:37.149546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce456ae-3c7c-481f-bb82-7df44c7d3098 admin admin] PATH_INFO: `/v3/users/7078208cefdd4e35bcec03ee633a6a8e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:37.150934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce456ae-3c7c-481f-bb82-7df44c7d3098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7078208cefdd4e35bcec03ee633a6a8e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:37.154474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce456ae-3c7c-481f-bb82-7df44c7d3098 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:37.202108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd874888-f2d7-42d5-b534-a2fdf2bdc050 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:37.204264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cd874888-f2d7-42d5-b534-a2fdf2bdc050 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:37.242528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5ce456ae-3c7c-481f-bb82-7df44c7d3098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7078208cefdd4e35bcec03ee633a6a8e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:37.263084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5ce456ae-3c7c-481f-bb82-7df44c7d3098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7078208cefdd4e35bcec03ee633a6a8e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:37.263862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5ce456ae-3c7c-481f-bb82-7df44c7d3098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7078208cefdd4e35bcec03ee633a6a8e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:37.286956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5ce456ae-3c7c-481f-bb82-7df44c7d3098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7078208cefdd4e35bcec03ee633a6a8e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:37.298210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd874888-f2d7-42d5-b534-a2fdf2bdc050 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:37.302583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5ce456ae-3c7c-481f-bb82-7df44c7d3098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7078208cefdd4e35bcec03ee633a6a8e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:37.308429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d67db-d642-4ba5-a5c3-fe46dfa6fa9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:37.308631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d67db-d642-4ba5-a5c3-fe46dfa6fa9b service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:37.308895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d67db-d642-4ba5-a5c3-fe46dfa6fa9b service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:37.309125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d67db-d642-4ba5-a5c3-fe46dfa6fa9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:37.312408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3a9d67db-d642-4ba5-a5c3-fe46dfa6fa9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:37.313767 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1272/2502] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:36 2021] DELETE /identity/v3/users/7078208cefdd4e35bcec03ee633a6a8e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:37.315444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0c456-87e8-41aa-a06d-e99fabaa70b3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:37.318977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0c456-87e8-41aa-a06d-e99fabaa70b3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:37.322392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0c456-87e8-41aa-a06d-e99fabaa70b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:37.365926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9dc0c456-87e8-41aa-a06d-e99fabaa70b3 None None] MFA Rules not processed for user `a7d32a19e0c44459a1c8ac12fc7a0f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:37.367189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9dc0c456-87e8-41aa-a06d-e99fabaa70b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:37.441531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d67db-d642-4ba5-a5c3-fe46dfa6fa9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:37.441531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d67db-d642-4ba5-a5c3-fe46dfa6fa9b service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:37.453310 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1231/2503] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:37 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:37.469985 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1273/2504] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:37 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:37.699231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d67db-d642-4ba5-a5c3-fe46dfa6fa9b service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:37.702177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3a9d67db-d642-4ba5-a5c3-fe46dfa6fa9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:37.726716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d67db-d642-4ba5-a5c3-fe46dfa6fa9b service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:37.843206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0fea1-60c8-46b1-b49a-dec0d76a726a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:37.844270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0fea1-60c8-46b1-b49a-dec0d76a726a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:37.844560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0fea1-60c8-46b1-b49a-dec0d76a726a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:37.844839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0fea1-60c8-46b1-b49a-dec0d76a726a admin admin] PATH_INFO: `/v3/projects/5fd59b1843a74105b22e9978f69ec229` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:37.847069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0fea1-60c8-46b1-b49a-dec0d76a726a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fd59b1843a74105b22e9978f69ec229)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:37.852262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0fea1-60c8-46b1-b49a-dec0d76a726a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:37.990675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-afd0fea1-60c8-46b1-b49a-dec0d76a726a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fd59b1843a74105b22e9978f69ec229', 'request_id': 'req-afd0fea1-60c8-46b1-b49a-dec0d76a726a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:38.007937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-afd0fea1-60c8-46b1-b49a-dec0d76a726a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fd59b1843a74105b22e9978f69ec229', 'request_id': 'req-afd0fea1-60c8-46b1-b49a-dec0d76a726a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:38.017213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-afd0fea1-60c8-46b1-b49a-dec0d76a726a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fd59b1843a74105b22e9978f69ec229', 'request_id': 'req-afd0fea1-60c8-46b1-b49a-dec0d76a726a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:38.055581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-afd0fea1-60c8-46b1-b49a-dec0d76a726a admin admin] The token cache is being invalidate because project 5fd59b1843a74105b22e9978f69ec229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:38.055876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-afd0fea1-60c8-46b1-b49a-dec0d76a726a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:38.062002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-afd0fea1-60c8-46b1-b49a-dec0d76a726a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:38.067293 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1232/2505] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:37 2021] DELETE /identity/v3/projects/5fd59b1843a74105b22e9978f69ec229 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:38.073057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24056ce6-2090-4046-aff6-42cb331ce8a7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:38.073876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24056ce6-2090-4046-aff6-42cb331ce8a7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:38.074335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24056ce6-2090-4046-aff6-42cb331ce8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:38.104869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-24056ce6-2090-4046-aff6-42cb331ce8a7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:38.106457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-24056ce6-2090-4046-aff6-42cb331ce8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:38.286492 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1274/2506] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:38.287608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a09517-10c2-40ee-b94b-09a389a30508 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:38.287855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a09517-10c2-40ee-b94b-09a389a30508 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:38.288112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a09517-10c2-40ee-b94b-09a389a30508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:38.337873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e8a09517-10c2-40ee-b94b-09a389a30508 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:38.341178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e8a09517-10c2-40ee-b94b-09a389a30508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:38.391193 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1233/2507] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:48:38.396158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24056ce6-2090-4046-aff6-42cb331ce8a7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:38.426750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24056ce6-2090-4046-aff6-42cb331ce8a7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:38.443035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba8ba4-35fc-4e42-87d1-b501e80c340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:38.443725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba8ba4-35fc-4e42-87d1-b501e80c340d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:38.444009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba8ba4-35fc-4e42-87d1-b501e80c340d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:38.444288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba8ba4-35fc-4e42-87d1-b501e80c340d admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:38.445039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba8ba4-35fc-4e42-87d1-b501e80c340d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:38.445413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba8ba4-35fc-4e42-87d1-b501e80c340d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:38.447054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba8ba4-35fc-4e42-87d1-b501e80c340d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:38.487272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a09517-10c2-40ee-b94b-09a389a30508 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:38.497810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a09517-10c2-40ee-b94b-09a389a30508 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:38.498702 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1275/2508] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:38.511215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d0830-6603-46a5-a5d0-e7fbed46525a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:38.511913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d0830-6603-46a5-a5d0-e7fbed46525a admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:38.512206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d0830-6603-46a5-a5d0-e7fbed46525a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:38.512497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d0830-6603-46a5-a5d0-e7fbed46525a admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:38.513230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d0830-6603-46a5-a5d0-e7fbed46525a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:38.515232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d0830-6603-46a5-a5d0-e7fbed46525a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:38.611535 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1234/2509] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:38 2021] POST /identity/v3/projects => generated 393 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:38.615685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba8ba4-35fc-4e42-87d1-b501e80c340d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:38.626709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba8ba4-35fc-4e42-87d1-b501e80c340d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:38.805401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf9f76-2f56-459f-8c76-0eb6ae2a5033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:38.806097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9f76-2f56-459f-8c76-0eb6ae2a5033 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:38.808470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9f76-2f56-459f-8c76-0eb6ae2a5033 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:38.809123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9f76-2f56-459f-8c76-0eb6ae2a5033 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:38.810069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf9f76-2f56-459f-8c76-0eb6ae2a5033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:38.813653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf9f76-2f56-459f-8c76-0eb6ae2a5033 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:38.862669 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1276/2510] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:38 2021] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:48:38.863996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d0830-6603-46a5-a5d0-e7fbed46525a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:38.882704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d0830-6603-46a5-a5d0-e7fbed46525a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:38.908481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968e884-aa52-4fe3-b594-f1ac4988b068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:38.911840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968e884-aa52-4fe3-b594-f1ac4988b068 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:38.913216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968e884-aa52-4fe3-b594-f1ac4988b068 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:38.914471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968e884-aa52-4fe3-b594-f1ac4988b068 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:38.915468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968e884-aa52-4fe3-b594-f1ac4988b068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:38.923078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968e884-aa52-4fe3-b594-f1ac4988b068 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:38.988565 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1235/2511] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:38 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:38.988872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf9f76-2f56-459f-8c76-0eb6ae2a5033 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:39.006109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf9f76-2f56-459f-8c76-0eb6ae2a5033 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:39.029545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6968ca0-3694-480c-9e65-acbc05a87574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:39.031498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6968ca0-3694-480c-9e65-acbc05a87574 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:39.031981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6968ca0-3694-480c-9e65-acbc05a87574 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:39.033106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6968ca0-3694-480c-9e65-acbc05a87574 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:39.034167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6968ca0-3694-480c-9e65-acbc05a87574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:39.039802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6968ca0-3694-480c-9e65-acbc05a87574 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:39.055408 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1277/2512] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:38 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:39.061418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968e884-aa52-4fe3-b594-f1ac4988b068 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:39.082153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968e884-aa52-4fe3-b594-f1ac4988b068 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:39.104105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ceafe-3846-4664-ac9f-b7e1039bbb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:39.110263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ceafe-3846-4664-ac9f-b7e1039bbb04 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:39.111827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ceafe-3846-4664-ac9f-b7e1039bbb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:39.112236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ceafe-3846-4664-ac9f-b7e1039bbb04 admin admin] PATH_INFO: `/v3/projects/c8fb5105f28441f697c0466af742db93/users/8eb445230fae4fc3b2f30535671906d9/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:39.165654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ceafe-3846-4664-ac9f-b7e1039bbb04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fb5105f28441f697c0466af742db93, user_id=8eb445230fae4fc3b2f30535671906d9, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:39.169830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ceafe-3846-4664-ac9f-b7e1039bbb04 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:39.220039 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1236/2513] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:39 2021] PUT /identity/v3/projects/c8fb5105f28441f697c0466af742db93/users/8eb445230fae4fc3b2f30535671906d9/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:39.221073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c700d84-07d3-4785-b2ac-e93282e0f09c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:39.221562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c700d84-07d3-4785-b2ac-e93282e0f09c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:39.221667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c700d84-07d3-4785-b2ac-e93282e0f09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:39.313418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0c700d84-07d3-4785-b2ac-e93282e0f09c None None] MFA Rules not processed for user `8eb445230fae4fc3b2f30535671906d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:39.320943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0c700d84-07d3-4785-b2ac-e93282e0f09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:39.423395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ceafe-3846-4664-ac9f-b7e1039bbb04 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:39.427662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4b0ceafe-3846-4664-ac9f-b7e1039bbb04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:39.437456 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1278/2514] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:39 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:39.451149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c700d84-07d3-4785-b2ac-e93282e0f09c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:39.523649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ceafe-3846-4664-ac9f-b7e1039bbb04 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:39.531349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bb6ce-4c76-4749-b3df-cea8e5e4d31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:39.532678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bb6ce-4c76-4749-b3df-cea8e5e4d31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:39.532987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bb6ce-4c76-4749-b3df-cea8e5e4d31d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:39.533269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bb6ce-4c76-4749-b3df-cea8e5e4d31d admin admin] PATH_INFO: `/v3/users/6992d255e81c499a8373dd4c727e1f41` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:39.534598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85bb6ce-4c76-4749-b3df-cea8e5e4d31d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6992d255e81c499a8373dd4c727e1f41)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:39.537144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85bb6ce-4c76-4749-b3df-cea8e5e4d31d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:39.548746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c700d84-07d3-4785-b2ac-e93282e0f09c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:39.554348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbf626-23ad-4b9c-b6dc-3a637abd94ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:39.555012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbf626-23ad-4b9c-b6dc-3a637abd94ba admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:39.555288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbf626-23ad-4b9c-b6dc-3a637abd94ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:39.556448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbf626-23ad-4b9c-b6dc-3a637abd94ba admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:39.557309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbf626-23ad-4b9c-b6dc-3a637abd94ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:39.559222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbf626-23ad-4b9c-b6dc-3a637abd94ba admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:39.602432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b85bb6ce-4c76-4749-b3df-cea8e5e4d31d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6992d255e81c499a8373dd4c727e1f41'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:39.602983 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1279/2515] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:39 2021] POST /identity/v3/projects => generated 393 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:48:39.604189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbf626-23ad-4b9c-b6dc-3a637abd94ba admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:39.606304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-47cbf626-23ad-4b9c-b6dc-3a637abd94ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:39.613318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b85bb6ce-4c76-4749-b3df-cea8e5e4d31d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6992d255e81c499a8373dd4c727e1f41'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:39.625669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b85bb6ce-4c76-4749-b3df-cea8e5e4d31d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6992d255e81c499a8373dd4c727e1f41'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:39.626476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b85bb6ce-4c76-4749-b3df-cea8e5e4d31d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6992d255e81c499a8373dd4c727e1f41'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:39.634504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b85bb6ce-4c76-4749-b3df-cea8e5e4d31d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6992d255e81c499a8373dd4c727e1f41'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:39.640954 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1237/2516] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:39 2021] DELETE /identity/v3/users/6992d255e81c499a8373dd4c727e1f41 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:39.642493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218b877-f818-45c6-9213-c13832e0bcb7 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:39.642493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218b877-f818-45c6-9213-c13832e0bcb7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:39.642906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218b877-f818-45c6-9213-c13832e0bcb7 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:39.645674 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1238/2517] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:48:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:48:39.651631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218b877-f818-45c6-9213-c13832e0bcb7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:39.654126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f218b877-f818-45c6-9213-c13832e0bcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:39.696835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbf626-23ad-4b9c-b6dc-3a637abd94ba admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:39.728716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218b877-f818-45c6-9213-c13832e0bcb7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:39.740900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911c6a3-c270-43c9-9e84-7e2b17e8ee48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:39.741648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911c6a3-c270-43c9-9e84-7e2b17e8ee48 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:39.741946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911c6a3-c270-43c9-9e84-7e2b17e8ee48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:39.742230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911c6a3-c270-43c9-9e84-7e2b17e8ee48 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:39.742987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911c6a3-c270-43c9-9e84-7e2b17e8ee48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:39.744944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911c6a3-c270-43c9-9e84-7e2b17e8ee48 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:39.766373 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1239/2518] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:39 2021] POST /identity/v3/users => generated 303 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:39.767363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911c6a3-c270-43c9-9e84-7e2b17e8ee48 admin admin] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:48:39.769147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2911c6a3-c270-43c9-9e84-7e2b17e8ee48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:39.776552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e7a46-d896-486b-ad7d-b02b67238fa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:39.777452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7a46-d896-486b-ad7d-b02b67238fa1 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:39.777743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7a46-d896-486b-ad7d-b02b67238fa1 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:39.778023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7a46-d896-486b-ad7d-b02b67238fa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:39.780642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e37e7a46-d896-486b-ad7d-b02b67238fa1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:39.787626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911c6a3-c270-43c9-9e84-7e2b17e8ee48 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:39.789222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2911c6a3-c270-43c9-9e84-7e2b17e8ee48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:39.854946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e7a46-d896-486b-ad7d-b02b67238fa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:39.857363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e7a46-d896-486b-ad7d-b02b67238fa1 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:39.868263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911c6a3-c270-43c9-9e84-7e2b17e8ee48 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:39.870354 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1280/2519] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:39 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:39.871296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e7a46-d896-486b-ad7d-b02b67238fa1 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:39.884292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e7a46-d896-486b-ad7d-b02b67238fa1 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:39.889312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8035e25-5f3b-4910-bf7c-d38759993a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:39.890056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8035e25-5f3b-4910-bf7c-d38759993a3b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:39.890803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8035e25-5f3b-4910-bf7c-d38759993a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:39.891151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8035e25-5f3b-4910-bf7c-d38759993a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:39.891591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c1034-a714-4aa7-b3f7-85f431990614 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '649900fdab204629aa9e240284e8d27c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afaf9df3d2d44c88a20ddca887b87f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:39.892022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8035e25-5f3b-4910-bf7c-d38759993a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:39.892949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c1034-a714-4aa7-b3f7-85f431990614 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:39.893378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c1034-a714-4aa7-b3f7-85f431990614 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:39.893818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8035e25-5f3b-4910-bf7c-d38759993a3b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:39.894166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c1034-a714-4aa7-b3f7-85f431990614 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] PATH_INFO: `/v3/projects/14b8df9c30264bf38f9d671b5f018ef9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:39.901421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c1034-a714-4aa7-b3f7-85f431990614 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorizing `identity:get_project(project_id=14b8df9c30264bf38f9d671b5f018ef9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:39.906473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c1034-a714-4aa7-b3f7-85f431990614 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:39.906940 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1281/2520] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:39 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:39.911560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8035e25-5f3b-4910-bf7c-d38759993a3b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:39.923519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8035e25-5f3b-4910-bf7c-d38759993a3b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:39.925758 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1240/2521] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:48:39 2021] GET /identity/v3/projects/14b8df9c30264bf38f9d671b5f018ef9 => generated 381 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:39.929151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18144e-9554-4068-9e74-538a77eb97eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:39.930295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18144e-9554-4068-9e74-538a77eb97eb admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:39.930685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18144e-9554-4068-9e74-538a77eb97eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:39.931033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18144e-9554-4068-9e74-538a77eb97eb admin admin] PATH_INFO: `/v3/projects/dc8125250ed8412f9a62d735af0f198a/users/0a2959f663f3449199418ef054fc2d1d/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:39.952060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18144e-9554-4068-9e74-538a77eb97eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8125250ed8412f9a62d735af0f198a, user_id=0a2959f663f3449199418ef054fc2d1d, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:39.954820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18144e-9554-4068-9e74-538a77eb97eb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:39.986947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c1034-a714-4aa7-b3f7-85f431990614 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:39.987162 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1282/2522] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:39 2021] PUT /identity/v3/projects/dc8125250ed8412f9a62d735af0f198a/users/0a2959f663f3449199418ef054fc2d1d/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:40.005144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c1034-a714-4aa7-b3f7-85f431990614 tempest-QuotasAdminNegativeTest-1748641071 tempest-QuotasAdminNegativeTest-1748641071-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:40.095346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18144e-9554-4068-9e74-538a77eb97eb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:40.097612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1f18144e-9554-4068-9e74-538a77eb97eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:40.133674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6edad0-6d60-4348-8d1a-f4bb7f30c5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:40.135208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6edad0-6d60-4348-8d1a-f4bb7f30c5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:40.135700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6edad0-6d60-4348-8d1a-f4bb7f30c5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:40.136176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6edad0-6d60-4348-8d1a-f4bb7f30c5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:40.137142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6edad0-6d60-4348-8d1a-f4bb7f30c5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:40.139829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6edad0-6d60-4348-8d1a-f4bb7f30c5e3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:40.161449 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1241/2523] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:39 2021] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:40.167441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6edad0-6d60-4348-8d1a-f4bb7f30c5e3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:40.186287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6edad0-6d60-4348-8d1a-f4bb7f30c5e3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:40.191362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fa577-43e9-4af2-8e8f-a3afa7689038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:40.192963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fa577-43e9-4af2-8e8f-a3afa7689038 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:40.193356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fa577-43e9-4af2-8e8f-a3afa7689038 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:40.193828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fa577-43e9-4af2-8e8f-a3afa7689038 admin admin] PATH_INFO: `/v3/projects/dc8125250ed8412f9a62d735af0f198a/users/0a2959f663f3449199418ef054fc2d1d/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:40.197024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fa577-43e9-4af2-8e8f-a3afa7689038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8125250ed8412f9a62d735af0f198a, user_id=0a2959f663f3449199418ef054fc2d1d, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:40.200607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fa577-43e9-4af2-8e8f-a3afa7689038 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:40.222775 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1242/2524] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:40 2021] PUT /identity/v3/projects/dc8125250ed8412f9a62d735af0f198a/users/0a2959f663f3449199418ef054fc2d1d/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:40.224852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8160df-1c2e-4f4c-9695-4a7998a18ee0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:40.225015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8160df-1c2e-4f4c-9695-4a7998a18ee0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:40.225459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8160df-1c2e-4f4c-9695-4a7998a18ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:40.292070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18144e-9554-4068-9e74-538a77eb97eb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:40.305124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4c8160df-1c2e-4f4c-9695-4a7998a18ee0 None None] MFA Rules not processed for user `0a2959f663f3449199418ef054fc2d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:40.306466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4c8160df-1c2e-4f4c-9695-4a7998a18ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:40.424276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c2bcf-9f15-49a5-8685-0ebcb2921dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:40.425910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c2bcf-9f15-49a5-8685-0ebcb2921dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:40.426511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c2bcf-9f15-49a5-8685-0ebcb2921dce admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:40.426986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c2bcf-9f15-49a5-8685-0ebcb2921dce admin admin] PATH_INFO: `/v3/users/a7d32a19e0c44459a1c8ac12fc7a0f9e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:40.429169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c2bcf-9f15-49a5-8685-0ebcb2921dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d32a19e0c44459a1c8ac12fc7a0f9e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:40.439747 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1243/2525] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:40 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:40.439747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8160df-1c2e-4f4c-9695-4a7998a18ee0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:40.441559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4c8160df-1c2e-4f4c-9695-4a7998a18ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:40.448859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c2bcf-9f15-49a5-8685-0ebcb2921dce admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:40.455732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8160df-1c2e-4f4c-9695-4a7998a18ee0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:40.461929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f14c45-febb-40c9-8575-c0041a10d285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:40.462897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f14c45-febb-40c9-8575-c0041a10d285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:40.463252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f14c45-febb-40c9-8575-c0041a10d285 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:40.463601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f14c45-febb-40c9-8575-c0041a10d285 admin admin] PATH_INFO: `/v3/projects/e622a6218cdd40c8861466b0d36c1ffe` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:40.465003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f14c45-febb-40c9-8575-c0041a10d285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e622a6218cdd40c8861466b0d36c1ffe)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:40.467836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f14c45-febb-40c9-8575-c0041a10d285 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:40.546493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-90f14c45-febb-40c9-8575-c0041a10d285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e622a6218cdd40c8861466b0d36c1ffe', 'request_id': 'req-90f14c45-febb-40c9-8575-c0041a10d285'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:40.554164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-90f14c45-febb-40c9-8575-c0041a10d285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e622a6218cdd40c8861466b0d36c1ffe', 'request_id': 'req-90f14c45-febb-40c9-8575-c0041a10d285'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:40.561371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-90f14c45-febb-40c9-8575-c0041a10d285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e622a6218cdd40c8861466b0d36c1ffe', 'request_id': 'req-90f14c45-febb-40c9-8575-c0041a10d285'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:40.562008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-879c2bcf-9f15-49a5-8685-0ebcb2921dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d32a19e0c44459a1c8ac12fc7a0f9e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:40.578846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-90f14c45-febb-40c9-8575-c0041a10d285 admin admin] The token cache is being invalidate because project e622a6218cdd40c8861466b0d36c1ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:40.579185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-90f14c45-febb-40c9-8575-c0041a10d285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:40.580079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-90f14c45-febb-40c9-8575-c0041a10d285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:40.583336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-879c2bcf-9f15-49a5-8685-0ebcb2921dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d32a19e0c44459a1c8ac12fc7a0f9e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:40.584386 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1244/2526] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:40 2021] DELETE /identity/v3/projects/e622a6218cdd40c8861466b0d36c1ffe => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:40.591176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d400b3-f04c-4bf1-bf08-a1704953e5d2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:40.591470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d400b3-f04c-4bf1-bf08-a1704953e5d2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:40.591581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-879c2bcf-9f15-49a5-8685-0ebcb2921dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d32a19e0c44459a1c8ac12fc7a0f9e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:40.591810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d400b3-f04c-4bf1-bf08-a1704953e5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:40.608736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-879c2bcf-9f15-49a5-8685-0ebcb2921dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d32a19e0c44459a1c8ac12fc7a0f9e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:40.616057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-50d400b3-f04c-4bf1-bf08-a1704953e5d2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:40.617622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-50d400b3-f04c-4bf1-bf08-a1704953e5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:40.622828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-879c2bcf-9f15-49a5-8685-0ebcb2921dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d32a19e0c44459a1c8ac12fc7a0f9e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:40.634398 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1283/2527] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:40 2021] DELETE /identity/v3/users/a7d32a19e0c44459a1c8ac12fc7a0f9e => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:40.650613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c136b-497f-4b01-a81b-9ed94608781c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:40.652633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c136b-497f-4b01-a81b-9ed94608781c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:40.653109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c136b-497f-4b01-a81b-9ed94608781c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:40.710599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8e9c136b-497f-4b01-a81b-9ed94608781c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:40.712922 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1245/2528] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:40.713947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d400b3-f04c-4bf1-bf08-a1704953e5d2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:40.719488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-50d400b3-f04c-4bf1-bf08-a1704953e5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:40.720296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8e9c136b-497f-4b01-a81b-9ed94608781c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:40.886809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d400b3-f04c-4bf1-bf08-a1704953e5d2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:40.917728 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1284/2529] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:40.920143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7db2f-d1e9-4417-95e0-df16071e3ca7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:40.920669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7db2f-d1e9-4417-95e0-df16071e3ca7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:40.921157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7db2f-d1e9-4417-95e0-df16071e3ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:40.943108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-add7db2f-d1e9-4417-95e0-df16071e3ca7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:40.944606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-add7db2f-d1e9-4417-95e0-df16071e3ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:40.982067 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1285/2530] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:40.982067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7db2f-d1e9-4417-95e0-df16071e3ca7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:40.983312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-add7db2f-d1e9-4417-95e0-df16071e3ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:41.018458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a59c2-37ff-47a7-ad92-527909ee947a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:41.019136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a59c2-37ff-47a7-ad92-527909ee947a service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:41.019474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a59c2-37ff-47a7-ad92-527909ee947a service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:41.024915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a59c2-37ff-47a7-ad92-527909ee947a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:41.028885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d39a59c2-37ff-47a7-ad92-527909ee947a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:41.061686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7db2f-d1e9-4417-95e0-df16071e3ca7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:41.068509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c5b86-d982-4dda-8dd4-a8bd8a9042b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:41.069340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c5b86-d982-4dda-8dd4-a8bd8a9042b5 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:41.069697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c5b86-d982-4dda-8dd4-a8bd8a9042b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:41.070070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c5b86-d982-4dda-8dd4-a8bd8a9042b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:41.095659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c5b86-d982-4dda-8dd4-a8bd8a9042b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:41.099548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c5b86-d982-4dda-8dd4-a8bd8a9042b5 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:41.112688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a59c2-37ff-47a7-ad92-527909ee947a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:41.115180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a59c2-37ff-47a7-ad92-527909ee947a service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:41.120017 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1286/2531] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:41.121340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c5b86-d982-4dda-8dd4-a8bd8a9042b5 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:41.128108 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1246/2532] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:40 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:41.134393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c5b86-d982-4dda-8dd4-a8bd8a9042b5 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:41.140297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a863c-80d2-4695-937a-a96379bed562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:41.141164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a863c-80d2-4695-937a-a96379bed562 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:41.141597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a863c-80d2-4695-937a-a96379bed562 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:41.142015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a863c-80d2-4695-937a-a96379bed562 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:41.143677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a863c-80d2-4695-937a-a96379bed562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:41.144506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a863c-80d2-4695-937a-a96379bed562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:41.146658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a863c-80d2-4695-937a-a96379bed562 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:41.165252 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1287/2533] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:41.165970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a59c2-37ff-47a7-ad92-527909ee947a service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:41.184947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a59c2-37ff-47a7-ad92-527909ee947a service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:41.193295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473cb5d-d6a5-493c-b6ac-571f1435855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:41.194625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473cb5d-d6a5-493c-b6ac-571f1435855d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:41.194974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473cb5d-d6a5-493c-b6ac-571f1435855d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:41.195429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473cb5d-d6a5-493c-b6ac-571f1435855d admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:41.196302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473cb5d-d6a5-493c-b6ac-571f1435855d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:41.198683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473cb5d-d6a5-493c-b6ac-571f1435855d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:41.229242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a863c-80d2-4695-937a-a96379bed562 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:41.235020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cf0a863c-80d2-4695-937a-a96379bed562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:41.235143 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1247/2534] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:41 2021] POST /identity/v3/projects => generated 389 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:41.236236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473cb5d-d6a5-493c-b6ac-571f1435855d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:41.249069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a863c-80d2-4695-937a-a96379bed562 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:41.335784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473cb5d-d6a5-493c-b6ac-571f1435855d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:41.346493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65715231-a08b-47f3-a5af-fcde1f87484f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:41.347169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65715231-a08b-47f3-a5af-fcde1f87484f admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:41.347970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65715231-a08b-47f3-a5af-fcde1f87484f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:41.348254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65715231-a08b-47f3-a5af-fcde1f87484f admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:41.348955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65715231-a08b-47f3-a5af-fcde1f87484f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:41.352256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65715231-a08b-47f3-a5af-fcde1f87484f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:41.357972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc6478-679d-424e-8c71-53e16b578909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:41.358932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc6478-679d-424e-8c71-53e16b578909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:41.359201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc6478-679d-424e-8c71-53e16b578909 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:41.359472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc6478-679d-424e-8c71-53e16b578909 admin admin] PATH_INFO: `/v3/users/8eb445230fae4fc3b2f30535671906d9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:41.361036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc6478-679d-424e-8c71-53e16b578909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eb445230fae4fc3b2f30535671906d9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:41.362997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc6478-679d-424e-8c71-53e16b578909 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:41.394698 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1248/2535] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:41 2021] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:41.399688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65715231-a08b-47f3-a5af-fcde1f87484f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:41.428576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65715231-a08b-47f3-a5af-fcde1f87484f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:41.430407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dfbc6478-679d-424e-8c71-53e16b578909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eb445230fae4fc3b2f30535671906d9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:41.439761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dfbc6478-679d-424e-8c71-53e16b578909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eb445230fae4fc3b2f30535671906d9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:41.447562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388430e-aef7-4744-a99f-2932d4d63ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:41.448115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dfbc6478-679d-424e-8c71-53e16b578909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eb445230fae4fc3b2f30535671906d9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:41.449060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388430e-aef7-4744-a99f-2932d4d63ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:41.449549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388430e-aef7-4744-a99f-2932d4d63ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:41.450025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388430e-aef7-4744-a99f-2932d4d63ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:41.451039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388430e-aef7-4744-a99f-2932d4d63ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:41.453023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388430e-aef7-4744-a99f-2932d4d63ec1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:41.468814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dfbc6478-679d-424e-8c71-53e16b578909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eb445230fae4fc3b2f30535671906d9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:41.473291 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1249/2536] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:41 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:41.482555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388430e-aef7-4744-a99f-2932d4d63ec1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:41.483897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dfbc6478-679d-424e-8c71-53e16b578909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eb445230fae4fc3b2f30535671906d9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:41.497263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388430e-aef7-4744-a99f-2932d4d63ec1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:41.500385 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1288/2537] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:41 2021] DELETE /identity/v3/users/8eb445230fae4fc3b2f30535671906d9 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:41.502628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc13a5-008b-450f-be45-b85c963c6856 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:41.503079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc13a5-008b-450f-be45-b85c963c6856 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:41.503370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc13a5-008b-450f-be45-b85c963c6856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:41.553182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b9dc13a5-008b-450f-be45-b85c963c6856 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:41.555523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b9dc13a5-008b-450f-be45-b85c963c6856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:41.634050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0959ce5-3e22-469b-bbee-32e5e231306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:41.635158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0959ce5-3e22-469b-bbee-32e5e231306d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:41.635646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0959ce5-3e22-469b-bbee-32e5e231306d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:41.636124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0959ce5-3e22-469b-bbee-32e5e231306d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:41.637169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0959ce5-3e22-469b-bbee-32e5e231306d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:41.642957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0959ce5-3e22-469b-bbee-32e5e231306d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:41.662701 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1289/2538] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:41.663825 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1250/2539] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:41 2021] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:41.669727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc13a5-008b-450f-be45-b85c963c6856 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:41.672003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b9dc13a5-008b-450f-be45-b85c963c6856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:41.682288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0959ce5-3e22-469b-bbee-32e5e231306d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:41.684438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a0959ce5-3e22-469b-bbee-32e5e231306d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:41.688826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc13a5-008b-450f-be45-b85c963c6856 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:41.745526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a26ef-9c19-4847-9c0f-c9085c4c5899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:41.746993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a26ef-9c19-4847-9c0f-c9085c4c5899 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:41.749997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a26ef-9c19-4847-9c0f-c9085c4c5899 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:41.749997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a26ef-9c19-4847-9c0f-c9085c4c5899 admin admin] PATH_INFO: `/v3/projects/56fa7201c1544de18e58e91abddc3fe9/users/c95985ffa6b749e2a87b2af11cf1230b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:41.786436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0959ce5-3e22-469b-bbee-32e5e231306d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:41.798058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856a3c9-c9eb-420b-a9a5-28cfd38582e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:41.801774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856a3c9-c9eb-420b-a9a5-28cfd38582e9 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:41.802042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a26ef-9c19-4847-9c0f-c9085c4c5899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56fa7201c1544de18e58e91abddc3fe9, user_id=c95985ffa6b749e2a87b2af11cf1230b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:41.802195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856a3c9-c9eb-420b-a9a5-28cfd38582e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:41.802195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856a3c9-c9eb-420b-a9a5-28cfd38582e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:41.813266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a26ef-9c19-4847-9c0f-c9085c4c5899 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:41.838811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856a3c9-c9eb-420b-a9a5-28cfd38582e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:41.840415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856a3c9-c9eb-420b-a9a5-28cfd38582e9 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:41.862880 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1290/2540] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:41 2021] PUT /identity/v3/projects/56fa7201c1544de18e58e91abddc3fe9/users/c95985ffa6b749e2a87b2af11cf1230b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:41.863173 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1251/2541] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:48:41.864718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff7ef-62b8-4976-98cf-efab2c4c3ad3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:41.865064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff7ef-62b8-4976-98cf-efab2c4c3ad3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:41.865535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff7ef-62b8-4976-98cf-efab2c4c3ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:41.893750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8b4ff7ef-62b8-4976-98cf-efab2c4c3ad3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:41.896628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8b4ff7ef-62b8-4976-98cf-efab2c4c3ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:41.990290 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1291/2542] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:42.016109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856a3c9-c9eb-420b-a9a5-28cfd38582e9 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:42.033072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856a3c9-c9eb-420b-a9a5-28cfd38582e9 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:42.117473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfd4bc-f5bd-4e4f-82eb-4eb902d28e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:42.118308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfd4bc-f5bd-4e4f-82eb-4eb902d28e8d service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:42.118853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfd4bc-f5bd-4e4f-82eb-4eb902d28e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:42.119262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfd4bc-f5bd-4e4f-82eb-4eb902d28e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:42.133188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfd4bc-f5bd-4e4f-82eb-4eb902d28e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:42.135525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfd4bc-f5bd-4e4f-82eb-4eb902d28e8d service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:42.148380 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1252/2543] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:42.714542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ff7ef-62b8-4976-98cf-efab2c4c3ad3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:42.716185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8b4ff7ef-62b8-4976-98cf-efab2c4c3ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:42.732069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ff7ef-62b8-4976-98cf-efab2c4c3ad3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:42.745422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6632b42-cea9-412a-b61b-4058e7886718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:42.747531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6632b42-cea9-412a-b61b-4058e7886718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:42.755247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6632b42-cea9-412a-b61b-4058e7886718 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:42.756676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6632b42-cea9-412a-b61b-4058e7886718 admin admin] PATH_INFO: `/v3/projects/c8fb5105f28441f697c0466af742db93` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:42.760576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6632b42-cea9-412a-b61b-4058e7886718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8fb5105f28441f697c0466af742db93)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:42.765632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6632b42-cea9-412a-b61b-4058e7886718 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:42.854864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6632b42-cea9-412a-b61b-4058e7886718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8fb5105f28441f697c0466af742db93', 'request_id': 'req-c6632b42-cea9-412a-b61b-4058e7886718'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:42.868811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6632b42-cea9-412a-b61b-4058e7886718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8fb5105f28441f697c0466af742db93', 'request_id': 'req-c6632b42-cea9-412a-b61b-4058e7886718'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:42.881734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6632b42-cea9-412a-b61b-4058e7886718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8fb5105f28441f697c0466af742db93', 'request_id': 'req-c6632b42-cea9-412a-b61b-4058e7886718'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:42.900046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6632b42-cea9-412a-b61b-4058e7886718 admin admin] The token cache is being invalidate because project c8fb5105f28441f697c0466af742db93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:42.900046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6632b42-cea9-412a-b61b-4058e7886718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:42.901751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6632b42-cea9-412a-b61b-4058e7886718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:42.908425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfd4bc-f5bd-4e4f-82eb-4eb902d28e8d service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:42.909065 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1292/2544] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:42 2021] DELETE /identity/v3/projects/c8fb5105f28441f697c0466af742db93 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:42.920508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfd4bc-f5bd-4e4f-82eb-4eb902d28e8d service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:42.997427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3fcdf-dc96-4bce-809c-5e1a50a64814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:42.998473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3fcdf-dc96-4bce-809c-5e1a50a64814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:42.998894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3fcdf-dc96-4bce-809c-5e1a50a64814 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:42.999488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3fcdf-dc96-4bce-809c-5e1a50a64814 admin admin] PATH_INFO: `/v3/users/0a2959f663f3449199418ef054fc2d1d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:43.004704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3fcdf-dc96-4bce-809c-5e1a50a64814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2959f663f3449199418ef054fc2d1d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:43.008039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3fcdf-dc96-4bce-809c-5e1a50a64814 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:43.079386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6632b42-cea9-412a-b61b-4058e7886718 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:43.080943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c6632b42-cea9-412a-b61b-4058e7886718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:43.109770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6632b42-cea9-412a-b61b-4058e7886718 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:43.149384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:43.155969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:43.157839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:43.158218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2 admin admin] PATH_INFO: `/v3/projects/14b8df9c30264bf38f9d671b5f018ef9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:43.163094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14b8df9c30264bf38f9d671b5f018ef9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:43.164820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0bc3fcdf-dc96-4bce-809c-5e1a50a64814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2959f663f3449199418ef054fc2d1d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:43.168933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:43.182506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0bc3fcdf-dc96-4bce-809c-5e1a50a64814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2959f663f3449199418ef054fc2d1d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:43.219513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0bc3fcdf-dc96-4bce-809c-5e1a50a64814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2959f663f3449199418ef054fc2d1d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:43.221520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0bc3fcdf-dc96-4bce-809c-5e1a50a64814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2959f663f3449199418ef054fc2d1d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:43.237100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0bc3fcdf-dc96-4bce-809c-5e1a50a64814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2959f663f3449199418ef054fc2d1d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:43.257982 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1253/2545] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:42 2021] DELETE /identity/v3/users/0a2959f663f3449199418ef054fc2d1d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:43.321568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14b8df9c30264bf38f9d671b5f018ef9', 'request_id': 'req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:43.331639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14b8df9c30264bf38f9d671b5f018ef9', 'request_id': 'req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:43.344934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14b8df9c30264bf38f9d671b5f018ef9', 'request_id': 'req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:43.360481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2 admin admin] The token cache is being invalidate because project 14b8df9c30264bf38f9d671b5f018ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:43.360820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:43.361733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:43.364290 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1293/2546] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:43 2021] DELETE /identity/v3/projects/14b8df9c30264bf38f9d671b5f018ef9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:43.368076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3fcdf-dc96-4bce-809c-5e1a50a64814 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:43.369590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0bc3fcdf-dc96-4bce-809c-5e1a50a64814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:43.465574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3fcdf-dc96-4bce-809c-5e1a50a64814 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:43.542868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308efe7a-a1b0-4be6-b806-6c5c18762a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:43.544990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308efe7a-a1b0-4be6-b806-6c5c18762a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:43.545337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308efe7a-a1b0-4be6-b806-6c5c18762a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:43.545743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308efe7a-a1b0-4be6-b806-6c5c18762a86 admin admin] PATH_INFO: `/v3/users/649900fdab204629aa9e240284e8d27c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:43.547183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308efe7a-a1b0-4be6-b806-6c5c18762a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=649900fdab204629aa9e240284e8d27c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:43.548826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308efe7a-a1b0-4be6-b806-6c5c18762a86 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:43.613286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-308efe7a-a1b0-4be6-b806-6c5c18762a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '649900fdab204629aa9e240284e8d27c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:43.620665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-308efe7a-a1b0-4be6-b806-6c5c18762a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '649900fdab204629aa9e240284e8d27c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:43.644616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-308efe7a-a1b0-4be6-b806-6c5c18762a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '649900fdab204629aa9e240284e8d27c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:43.645472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-308efe7a-a1b0-4be6-b806-6c5c18762a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '649900fdab204629aa9e240284e8d27c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:43.656825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-308efe7a-a1b0-4be6-b806-6c5c18762a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '649900fdab204629aa9e240284e8d27c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:43.666053 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1254/2547] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:43 2021] DELETE /identity/v3/users/649900fdab204629aa9e240284e8d27c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:44.127534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:44.129890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:44.160985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb68ce-64cf-43cc-bc52-06fbb674d2a2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:44.244215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57065a0-070a-4e9d-889c-be9163268e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:44.245096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57065a0-070a-4e9d-889c-be9163268e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:44.245383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57065a0-070a-4e9d-889c-be9163268e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:44.245663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57065a0-070a-4e9d-889c-be9163268e3c admin admin] PATH_INFO: `/v3/projects/dc8125250ed8412f9a62d735af0f198a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:44.248317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57065a0-070a-4e9d-889c-be9163268e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8125250ed8412f9a62d735af0f198a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:44.250243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57065a0-070a-4e9d-889c-be9163268e3c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:44.327979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b57065a0-070a-4e9d-889c-be9163268e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8125250ed8412f9a62d735af0f198a', 'request_id': 'req-b57065a0-070a-4e9d-889c-be9163268e3c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:44.345549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b57065a0-070a-4e9d-889c-be9163268e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8125250ed8412f9a62d735af0f198a', 'request_id': 'req-b57065a0-070a-4e9d-889c-be9163268e3c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:44.359190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b57065a0-070a-4e9d-889c-be9163268e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8125250ed8412f9a62d735af0f198a', 'request_id': 'req-b57065a0-070a-4e9d-889c-be9163268e3c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:44.374417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b57065a0-070a-4e9d-889c-be9163268e3c admin admin] The token cache is being invalidate because project dc8125250ed8412f9a62d735af0f198a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:44.374984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b57065a0-070a-4e9d-889c-be9163268e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:44.375651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b57065a0-070a-4e9d-889c-be9163268e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:44.381831 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1294/2548] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:44 2021] DELETE /identity/v3/projects/dc8125250ed8412f9a62d735af0f198a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:44.384228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da5aa8-97b8-451c-aefd-d0659ffbad03 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:44.384667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da5aa8-97b8-451c-aefd-d0659ffbad03 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:44.384880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da5aa8-97b8-451c-aefd-d0659ffbad03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:44.451931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-11da5aa8-97b8-451c-aefd-d0659ffbad03 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:44.453202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-11da5aa8-97b8-451c-aefd-d0659ffbad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:44.562724 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1255/2549] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:44.571818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d10c1-5b1b-4759-bee5-9b9139512ce7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:44.572281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d10c1-5b1b-4759-bee5-9b9139512ce7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:44.572585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d10c1-5b1b-4759-bee5-9b9139512ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:44.606769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-238d10c1-5b1b-4759-bee5-9b9139512ce7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:44.608394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-238d10c1-5b1b-4759-bee5-9b9139512ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:44.628101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da5aa8-97b8-451c-aefd-d0659ffbad03 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:44.630122 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1295/2550] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:48:44.638914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da5aa8-97b8-451c-aefd-d0659ffbad03 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:44.644059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17051c77-abdf-4613-a646-f50513162549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:44.644877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17051c77-abdf-4613-a646-f50513162549 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:44.645240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17051c77-abdf-4613-a646-f50513162549 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:44.645596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17051c77-abdf-4613-a646-f50513162549 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:44.646469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17051c77-abdf-4613-a646-f50513162549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:44.646877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17051c77-abdf-4613-a646-f50513162549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:44.648647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17051c77-abdf-4613-a646-f50513162549 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:44.668099 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1256/2551] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:44.668919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d10c1-5b1b-4759-bee5-9b9139512ce7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:44.698569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d10c1-5b1b-4759-bee5-9b9139512ce7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:44.705215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ee17a-79e8-4f24-8026-2379a6d8c81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:44.706087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ee17a-79e8-4f24-8026-2379a6d8c81c admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:44.706429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ee17a-79e8-4f24-8026-2379a6d8c81c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:44.706746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ee17a-79e8-4f24-8026-2379a6d8c81c admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:44.707664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ee17a-79e8-4f24-8026-2379a6d8c81c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:44.710287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ee17a-79e8-4f24-8026-2379a6d8c81c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:44.750335 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1296/2552] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:44 2021] POST /identity/v3/projects => generated 389 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:48:44.756434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17051c77-abdf-4613-a646-f50513162549 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:44.770158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17051c77-abdf-4613-a646-f50513162549 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:44.884678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecc4d8-80ab-43a1-bb0c-1916aa9b57e1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:44.885151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecc4d8-80ab-43a1-bb0c-1916aa9b57e1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:44.885682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecc4d8-80ab-43a1-bb0c-1916aa9b57e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:44.918498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003308a-b91a-4772-9b31-e4f6003a1a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:44.920299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003308a-b91a-4772-9b31-e4f6003a1a5f admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:44.920918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003308a-b91a-4772-9b31-e4f6003a1a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:44.922333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003308a-b91a-4772-9b31-e4f6003a1a5f admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:44.924535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003308a-b91a-4772-9b31-e4f6003a1a5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:44.925009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-57ecc4d8-80ab-43a1-bb0c-1916aa9b57e1 None None] MFA Rules not processed for user `8042de28328d4b26b910f1be4b499879`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:44.927211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-57ecc4d8-80ab-43a1-bb0c-1916aa9b57e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:44.932399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003308a-b91a-4772-9b31-e4f6003a1a5f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:45.006344 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1257/2553] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:44 2021] POST /identity/v3/users => generated 295 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:45.011666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003308a-b91a-4772-9b31-e4f6003a1a5f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:45.024433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003308a-b91a-4772-9b31-e4f6003a1a5f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:45.031037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb87cf-c9e7-4799-8f54-da74afc169a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:45.032012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb87cf-c9e7-4799-8f54-da74afc169a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:45.035538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb87cf-c9e7-4799-8f54-da74afc169a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:45.036061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb87cf-c9e7-4799-8f54-da74afc169a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:45.037033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb87cf-c9e7-4799-8f54-da74afc169a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:45.041728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb87cf-c9e7-4799-8f54-da74afc169a3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:45.067343 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1258/2554] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:45 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:45.068432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb87cf-c9e7-4799-8f54-da74afc169a3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:45.094574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb87cf-c9e7-4799-8f54-da74afc169a3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:45.111192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1aa4a-2e34-489f-b40a-291419320968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:45.115175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1aa4a-2e34-489f-b40a-291419320968 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:45.127777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1aa4a-2e34-489f-b40a-291419320968 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:45.127777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1aa4a-2e34-489f-b40a-291419320968 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:45.128439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1aa4a-2e34-489f-b40a-291419320968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:45.141770 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1297/2555] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:44 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Dec 18 20:48:45.149060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1aa4a-2e34-489f-b40a-291419320968 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:45.163857 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1259/2556] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:45 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:45.167934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecc4d8-80ab-43a1-bb0c-1916aa9b57e1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:45.183519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecc4d8-80ab-43a1-bb0c-1916aa9b57e1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:45.189690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f578b-7706-42db-8628-1f4da58fe030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:45.190635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f578b-7706-42db-8628-1f4da58fe030 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:45.191112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f578b-7706-42db-8628-1f4da58fe030 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:45.191544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f578b-7706-42db-8628-1f4da58fe030 admin admin] PATH_INFO: `/v3/projects/1b7d2d4460044fee8f0b5dea668a3788/users/425a44c5b27b48548f2bc53c330ff144/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:45.214294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f578b-7706-42db-8628-1f4da58fe030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b7d2d4460044fee8f0b5dea668a3788, user_id=425a44c5b27b48548f2bc53c330ff144, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:45.217972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f578b-7706-42db-8628-1f4da58fe030 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:45.233904 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1298/2557] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:45 2021] PUT /identity/v3/projects/1b7d2d4460044fee8f0b5dea668a3788/users/425a44c5b27b48548f2bc53c330ff144/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:45.245266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daf32f-42cf-4928-a4f0-95357db222b1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:45.245266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daf32f-42cf-4928-a4f0-95357db222b1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:45.245266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daf32f-42cf-4928-a4f0-95357db222b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:45.282473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-22daf32f-42cf-4928-a4f0-95357db222b1 None None] MFA Rules not processed for user `425a44c5b27b48548f2bc53c330ff144`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:45.283902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-22daf32f-42cf-4928-a4f0-95357db222b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:45.285736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f578b-7706-42db-8628-1f4da58fe030 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:45.287569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3a5f578b-7706-42db-8628-1f4da58fe030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:45.404108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f578b-7706-42db-8628-1f4da58fe030 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:45.411236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ebb4f-e67e-4bc1-8a57-458a2ae2853c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:45.412206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ebb4f-e67e-4bc1-8a57-458a2ae2853c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:45.412943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ebb4f-e67e-4bc1-8a57-458a2ae2853c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:45.413302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ebb4f-e67e-4bc1-8a57-458a2ae2853c admin admin] PATH_INFO: `/v3/projects/afaf9df3d2d44c88a20ddca887b87f5e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:45.414801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ebb4f-e67e-4bc1-8a57-458a2ae2853c admin admin] RBAC: Authorizing `identity:delete_project(project_id=afaf9df3d2d44c88a20ddca887b87f5e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:45.416967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ebb4f-e67e-4bc1-8a57-458a2ae2853c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:45.461169 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1260/2558] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:45 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:45.463339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22daf32f-42cf-4928-a4f0-95357db222b1 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:45.487495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22daf32f-42cf-4928-a4f0-95357db222b1 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:45.509224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-608ebb4f-e67e-4bc1-8a57-458a2ae2853c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afaf9df3d2d44c88a20ddca887b87f5e', 'request_id': 'req-608ebb4f-e67e-4bc1-8a57-458a2ae2853c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:45.526886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-608ebb4f-e67e-4bc1-8a57-458a2ae2853c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afaf9df3d2d44c88a20ddca887b87f5e', 'request_id': 'req-608ebb4f-e67e-4bc1-8a57-458a2ae2853c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:45.545983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-608ebb4f-e67e-4bc1-8a57-458a2ae2853c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afaf9df3d2d44c88a20ddca887b87f5e', 'request_id': 'req-608ebb4f-e67e-4bc1-8a57-458a2ae2853c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:45.581243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-608ebb4f-e67e-4bc1-8a57-458a2ae2853c admin admin] The token cache is being invalidate because project afaf9df3d2d44c88a20ddca887b87f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:45.581578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-608ebb4f-e67e-4bc1-8a57-458a2ae2853c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:45.583310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-608ebb4f-e67e-4bc1-8a57-458a2ae2853c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:45.589775 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1299/2559] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:45 2021] DELETE /identity/v3/projects/afaf9df3d2d44c88a20ddca887b87f5e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:45.598587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596181db-9551-433a-8fda-3737db6d3149 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:45.598921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596181db-9551-433a-8fda-3737db6d3149 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:45.599166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596181db-9551-433a-8fda-3737db6d3149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:45.633262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-596181db-9551-433a-8fda-3737db6d3149 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:45.635236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-596181db-9551-433a-8fda-3737db6d3149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:45.638053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9845f4-c8d5-42c7-9fd7-95c1b2cff181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:45.638956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9845f4-c8d5-42c7-9fd7-95c1b2cff181 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:45.639996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9845f4-c8d5-42c7-9fd7-95c1b2cff181 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:45.639996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9845f4-c8d5-42c7-9fd7-95c1b2cff181 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:45.641211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9845f4-c8d5-42c7-9fd7-95c1b2cff181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:45.643634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9845f4-c8d5-42c7-9fd7-95c1b2cff181 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:45.649669 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1300/2560] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:45.661496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46711e6a-d278-4444-a751-2afe8a35d907 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:45.661989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46711e6a-d278-4444-a751-2afe8a35d907 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:45.662506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46711e6a-d278-4444-a751-2afe8a35d907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:45.702432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-46711e6a-d278-4444-a751-2afe8a35d907 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:45.706085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-46711e6a-d278-4444-a751-2afe8a35d907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:45.716640 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1261/2561] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:45 2021] POST /identity/v3/projects => generated 389 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:45.721455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9845f4-c8d5-42c7-9fd7-95c1b2cff181 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:45.724659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1e9845f4-c8d5-42c7-9fd7-95c1b2cff181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:45.899588 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1301/2562] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:45.904393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46711e6a-d278-4444-a751-2afe8a35d907 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:45.922218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9845f4-c8d5-42c7-9fd7-95c1b2cff181 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:45.937498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46711e6a-d278-4444-a751-2afe8a35d907 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:45.942313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c03f1-fc18-40c3-9350-400cb2d5549c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:45.945097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c03f1-fc18-40c3-9350-400cb2d5549c admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:45.945438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c03f1-fc18-40c3-9350-400cb2d5549c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:45.946337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c03f1-fc18-40c3-9350-400cb2d5549c admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:45.949357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c03f1-fc18-40c3-9350-400cb2d5549c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:45.955849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae707c14-9b61-4e29-83dd-e2dc7253eee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:45.956533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae707c14-9b61-4e29-83dd-e2dc7253eee1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:45.956856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae707c14-9b61-4e29-83dd-e2dc7253eee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:45.957133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae707c14-9b61-4e29-83dd-e2dc7253eee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:45.957905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae707c14-9b61-4e29-83dd-e2dc7253eee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:45.958175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae707c14-9b61-4e29-83dd-e2dc7253eee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:45.958517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c03f1-fc18-40c3-9350-400cb2d5549c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:45.976048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae707c14-9b61-4e29-83dd-e2dc7253eee1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:46.008430 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1302/2563] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:46.008628 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1262/2564] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:45 2021] POST /identity/v3/users => generated 301 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:46.009977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae707c14-9b61-4e29-83dd-e2dc7253eee1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:46.012809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c03f1-fc18-40c3-9350-400cb2d5549c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:46.030519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae707c14-9b61-4e29-83dd-e2dc7253eee1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:46.032894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c03f1-fc18-40c3-9350-400cb2d5549c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:46.041165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455223f2-3c6e-4ef5-8691-4a855baf21e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:46.042629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455223f2-3c6e-4ef5-8691-4a855baf21e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:46.044174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77416d3-3a0f-4662-9d29-8708d4a96813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:46.044405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455223f2-3c6e-4ef5-8691-4a855baf21e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:46.044405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455223f2-3c6e-4ef5-8691-4a855baf21e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:46.044986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77416d3-3a0f-4662-9d29-8708d4a96813 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:46.045676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455223f2-3c6e-4ef5-8691-4a855baf21e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:46.046156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77416d3-3a0f-4662-9d29-8708d4a96813 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:46.046663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77416d3-3a0f-4662-9d29-8708d4a96813 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:46.048356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455223f2-3c6e-4ef5-8691-4a855baf21e9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:46.049615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77416d3-3a0f-4662-9d29-8708d4a96813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:46.055222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77416d3-3a0f-4662-9d29-8708d4a96813 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:46.081377 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1303/2565] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:46 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:46.083448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455223f2-3c6e-4ef5-8691-4a855baf21e9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:46.099509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455223f2-3c6e-4ef5-8691-4a855baf21e9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:46.113507 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1263/2566] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:46 2021] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:46.118951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68135df7-1483-4e92-8b3f-78fee049d989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:46.119462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77416d3-3a0f-4662-9d29-8708d4a96813 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:46.120095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68135df7-1483-4e92-8b3f-78fee049d989 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:46.120479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68135df7-1483-4e92-8b3f-78fee049d989 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:46.120990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68135df7-1483-4e92-8b3f-78fee049d989 admin admin] PATH_INFO: `/v3/projects/7f9e14a39f70463c85748b537a594898/users/3ce5454d0f0344c9975bbd356528975b/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:46.167464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68135df7-1483-4e92-8b3f-78fee049d989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9e14a39f70463c85748b537a594898, user_id=3ce5454d0f0344c9975bbd356528975b, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:46.173652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68135df7-1483-4e92-8b3f-78fee049d989 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:46.211329 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1304/2567] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:46 2021] PUT /identity/v3/projects/7f9e14a39f70463c85748b537a594898/users/3ce5454d0f0344c9975bbd356528975b/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:46.215749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68135df7-1483-4e92-8b3f-78fee049d989 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:46.219703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77416d3-3a0f-4662-9d29-8708d4a96813 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:46.309376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fa83b-7b08-417d-9a00-fb0e9f94fb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:46.310597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fa83b-7b08-417d-9a00-fb0e9f94fb2c admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:46.311142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fa83b-7b08-417d-9a00-fb0e9f94fb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:46.313041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fa83b-7b08-417d-9a00-fb0e9f94fb2c admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:46.315641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265fa83b-7b08-417d-9a00-fb0e9f94fb2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:46.323743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265fa83b-7b08-417d-9a00-fb0e9f94fb2c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:46.331808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68135df7-1483-4e92-8b3f-78fee049d989 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:46.338339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f09f2-810a-4167-ba76-8a9ad53bed59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:46.339047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f09f2-810a-4167-ba76-8a9ad53bed59 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:46.339342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f09f2-810a-4167-ba76-8a9ad53bed59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:46.339655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f09f2-810a-4167-ba76-8a9ad53bed59 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:46.340509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f09f2-810a-4167-ba76-8a9ad53bed59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:46.342766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f09f2-810a-4167-ba76-8a9ad53bed59 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:46.361913 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1264/2568] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:46 2021] POST /identity/v3/users => generated 302 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:48:46.366767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fa83b-7b08-417d-9a00-fb0e9f94fb2c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:46.380170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fa83b-7b08-417d-9a00-fb0e9f94fb2c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:46.386207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e56e7f-3ff0-483a-a72e-6faf628ed679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:46.387229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e56e7f-3ff0-483a-a72e-6faf628ed679 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:46.387827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e56e7f-3ff0-483a-a72e-6faf628ed679 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:46.388289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e56e7f-3ff0-483a-a72e-6faf628ed679 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:46.389459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e56e7f-3ff0-483a-a72e-6faf628ed679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:46.394106 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1305/2569] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:46 2021] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:46.395324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f09f2-810a-4167-ba76-8a9ad53bed59 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:46.395851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e56e7f-3ff0-483a-a72e-6faf628ed679 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:46.415917 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1265/2570] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:46 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:46.419309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e56e7f-3ff0-483a-a72e-6faf628ed679 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:46.422295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f09f2-810a-4167-ba76-8a9ad53bed59 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:46.435029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e56e7f-3ff0-483a-a72e-6faf628ed679 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:46.437905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce968e69-505f-4d60-b477-91bc55058b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:46.438854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce968e69-505f-4d60-b477-91bc55058b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:46.439123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce968e69-505f-4d60-b477-91bc55058b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:46.439405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce968e69-505f-4d60-b477-91bc55058b5d admin admin] PATH_INFO: `/v3/projects/7f9e14a39f70463c85748b537a594898/users/3ce5454d0f0344c9975bbd356528975b/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:46.443811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce968e69-505f-4d60-b477-91bc55058b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9e14a39f70463c85748b537a594898, user_id=3ce5454d0f0344c9975bbd356528975b, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:46.443955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541ff1e-668e-4fc0-aae2-052b766a7754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:46.444850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541ff1e-668e-4fc0-aae2-052b766a7754 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:46.445376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541ff1e-668e-4fc0-aae2-052b766a7754 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:46.445836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541ff1e-668e-4fc0-aae2-052b766a7754 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:46.447007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541ff1e-668e-4fc0-aae2-052b766a7754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:46.449308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541ff1e-668e-4fc0-aae2-052b766a7754 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:46.452908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce968e69-505f-4d60-b477-91bc55058b5d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:46.462813 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1266/2571] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:46 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:46.467164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541ff1e-668e-4fc0-aae2-052b766a7754 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:46.487924 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1306/2572] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:46 2021] PUT /identity/v3/projects/7f9e14a39f70463c85748b537a594898/users/3ce5454d0f0344c9975bbd356528975b/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:46.488622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541ff1e-668e-4fc0-aae2-052b766a7754 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:46.490600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b6ab8-fd71-47da-a896-7b51055d9188 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:46.490915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b6ab8-fd71-47da-a896-7b51055d9188 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:46.491198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b6ab8-fd71-47da-a896-7b51055d9188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:46.557520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7b0b6ab8-fd71-47da-a896-7b51055d9188 None None] MFA Rules not processed for user `3ce5454d0f0344c9975bbd356528975b`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:46.558884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7b0b6ab8-fd71-47da-a896-7b51055d9188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:46.623158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398db20-d054-48fe-8bfa-e7659be01e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:46.625068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398db20-d054-48fe-8bfa-e7659be01e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:46.625595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398db20-d054-48fe-8bfa-e7659be01e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:46.626150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398db20-d054-48fe-8bfa-e7659be01e4a admin admin] PATH_INFO: `/v3/projects/f1bd8a61f8bf450290c7bacb16d71eb2/users/2adbe528b7b94299b0f06ea3e4654c82/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:46.655044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398db20-d054-48fe-8bfa-e7659be01e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bd8a61f8bf450290c7bacb16d71eb2, user_id=2adbe528b7b94299b0f06ea3e4654c82, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:46.661532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398db20-d054-48fe-8bfa-e7659be01e4a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:46.708116 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1267/2573] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:46 2021] PUT /identity/v3/projects/f1bd8a61f8bf450290c7bacb16d71eb2/users/2adbe528b7b94299b0f06ea3e4654c82/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:46.714576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb63df-3eb3-4abc-bcef-4a84bf855792 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:46.714576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb63df-3eb3-4abc-bcef-4a84bf855792 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:46.714576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb63df-3eb3-4abc-bcef-4a84bf855792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:46.813674 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1307/2574] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:46 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:48:46.828926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3bdb63df-3eb3-4abc-bcef-4a84bf855792 None None] MFA Rules not processed for user `2adbe528b7b94299b0f06ea3e4654c82`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:46.830802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3bdb63df-3eb3-4abc-bcef-4a84bf855792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:46.934953 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1268/2575] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:46 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:46.941504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b6ab8-fd71-47da-a896-7b51055d9188 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:46.961429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b6ab8-fd71-47da-a896-7b51055d9188 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:47.094685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004f98d-5476-4d16-806c-8899f5db9f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:47.095708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004f98d-5476-4d16-806c-8899f5db9f4d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:47.096115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004f98d-5476-4d16-806c-8899f5db9f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:47.096792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004f98d-5476-4d16-806c-8899f5db9f4d admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:47.097856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004f98d-5476-4d16-806c-8899f5db9f4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:47.100438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004f98d-5476-4d16-806c-8899f5db9f4d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:47.183831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb63df-3eb3-4abc-bcef-4a84bf855792 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:47.187624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3bdb63df-3eb3-4abc-bcef-4a84bf855792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:47.200381 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1308/2576] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:46 2021] POST /identity/v3/projects => generated 403 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:47.204246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004f98d-5476-4d16-806c-8899f5db9f4d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:47.400050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb63df-3eb3-4abc-bcef-4a84bf855792 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:47.545670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518a229-a4cd-4e98-99fa-de54cb17b94a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:47.546392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518a229-a4cd-4e98-99fa-de54cb17b94a service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:47.546669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518a229-a4cd-4e98-99fa-de54cb17b94a service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:47.547000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518a229-a4cd-4e98-99fa-de54cb17b94a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:47.551736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4518a229-a4cd-4e98-99fa-de54cb17b94a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:47.687518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518a229-a4cd-4e98-99fa-de54cb17b94a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:47.690352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518a229-a4cd-4e98-99fa-de54cb17b94a service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:47.705962 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1269/2577] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:47 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:47.722025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004f98d-5476-4d16-806c-8899f5db9f4d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:47.736956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b795a3-a8ca-4b94-95b0-dd2725af2f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:47.737531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b795a3-a8ca-4b94-95b0-dd2725af2f04 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:47.738386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b795a3-a8ca-4b94-95b0-dd2725af2f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:47.738677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b795a3-a8ca-4b94-95b0-dd2725af2f04 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:47.739403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b795a3-a8ca-4b94-95b0-dd2725af2f04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:47.741321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b795a3-a8ca-4b94-95b0-dd2725af2f04 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:47.782957 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1309/2578] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:47 2021] POST /identity/v3/users => generated 308 bytes in 579 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:47.784157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518a229-a4cd-4e98-99fa-de54cb17b94a service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:47.796666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518a229-a4cd-4e98-99fa-de54cb17b94a service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:47.809607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fecbe2f-9dc5-4aeb-b592-de4761e8cff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:47.810479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecbe2f-9dc5-4aeb-b592-de4761e8cff1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:47.812162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecbe2f-9dc5-4aeb-b592-de4761e8cff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:47.812162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecbe2f-9dc5-4aeb-b592-de4761e8cff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:47.815760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fecbe2f-9dc5-4aeb-b592-de4761e8cff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:47.818316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fecbe2f-9dc5-4aeb-b592-de4761e8cff1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:47.845585 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1270/2579] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:47 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:47.849933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b795a3-a8ca-4b94-95b0-dd2725af2f04 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:47.861443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b795a3-a8ca-4b94-95b0-dd2725af2f04 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:47.869607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3095b4-d3b1-453b-a061-cf65ea32e6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:47.870914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3095b4-d3b1-453b-a061-cf65ea32e6d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:47.871265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3095b4-d3b1-453b-a061-cf65ea32e6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:47.871605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3095b4-d3b1-453b-a061-cf65ea32e6d9 admin admin] PATH_INFO: `/v3/projects/b31d71e882964f1681fca82f8702d0b0/users/2cee3f5f15d3445d869a730aa0c17588/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:47.905643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3095b4-d3b1-453b-a061-cf65ea32e6d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31d71e882964f1681fca82f8702d0b0, user_id=2cee3f5f15d3445d869a730aa0c17588, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:47.914763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3095b4-d3b1-453b-a061-cf65ea32e6d9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:47.960557 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1310/2580] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:47 2021] PUT /identity/v3/projects/b31d71e882964f1681fca82f8702d0b0/users/2cee3f5f15d3445d869a730aa0c17588/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:47.964868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fecbe2f-9dc5-4aeb-b592-de4761e8cff1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:47.981715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fecbe2f-9dc5-4aeb-b592-de4761e8cff1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:48.075701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2713639-3091-4713-ab60-42bfbf8b920c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:48.076545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2713639-3091-4713-ab60-42bfbf8b920c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:48.076936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2713639-3091-4713-ab60-42bfbf8b920c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:48.078326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2713639-3091-4713-ab60-42bfbf8b920c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:48.079243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2713639-3091-4713-ab60-42bfbf8b920c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:48.081711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2713639-3091-4713-ab60-42bfbf8b920c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:48.100932 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1271/2581] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:47 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:48.101138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3095b4-d3b1-453b-a061-cf65ea32e6d9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:48.115259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3095b4-d3b1-453b-a061-cf65ea32e6d9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:48.122115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510069d-1dad-4b00-a73b-d3ea3bd3bf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:48.123832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510069d-1dad-4b00-a73b-d3ea3bd3bf9a admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:48.124222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510069d-1dad-4b00-a73b-d3ea3bd3bf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:48.124609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510069d-1dad-4b00-a73b-d3ea3bd3bf9a admin admin] PATH_INFO: `/v3/projects/b31d71e882964f1681fca82f8702d0b0/users/2cee3f5f15d3445d869a730aa0c17588/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:48.127487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510069d-1dad-4b00-a73b-d3ea3bd3bf9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31d71e882964f1681fca82f8702d0b0, user_id=2cee3f5f15d3445d869a730aa0c17588, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:48.132071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510069d-1dad-4b00-a73b-d3ea3bd3bf9a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:48.145207 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1311/2582] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:48 2021] PUT /identity/v3/projects/b31d71e882964f1681fca82f8702d0b0/users/2cee3f5f15d3445d869a730aa0c17588/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:48.157567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3369f-c695-4191-95b4-292050727e6a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:48.157861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3369f-c695-4191-95b4-292050727e6a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:48.158151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3369f-c695-4191-95b4-292050727e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:48.198517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-cfa3369f-c695-4191-95b4-292050727e6a None None] MFA Rules not processed for user `2cee3f5f15d3445d869a730aa0c17588`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:48.199757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cfa3369f-c695-4191-95b4-292050727e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:48.304260 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1272/2583] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:48 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:48:49.107535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510069d-1dad-4b00-a73b-d3ea3bd3bf9a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:49.248946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510069d-1dad-4b00-a73b-d3ea3bd3bf9a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:49.257787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc22c4d-1ec7-4bd5-8900-8c65ddb2d972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:49.261358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc22c4d-1ec7-4bd5-8900-8c65ddb2d972 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:49.261979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc22c4d-1ec7-4bd5-8900-8c65ddb2d972 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:49.262430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc22c4d-1ec7-4bd5-8900-8c65ddb2d972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:49.273929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc22c4d-1ec7-4bd5-8900-8c65ddb2d972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:49.276324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc22c4d-1ec7-4bd5-8900-8c65ddb2d972 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:49.306481 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1312/2584] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:49 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:49.961210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3369f-c695-4191-95b4-292050727e6a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:49.977425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3369f-c695-4191-95b4-292050727e6a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:49.991704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2fd2d-587d-4283-ba06-28bc91bffe8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:49.993513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2fd2d-587d-4283-ba06-28bc91bffe8d service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:49.993654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2fd2d-587d-4283-ba06-28bc91bffe8d service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:49.993906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2fd2d-587d-4283-ba06-28bc91bffe8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:50.089506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2fd2d-587d-4283-ba06-28bc91bffe8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:50.092577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2fd2d-587d-4283-ba06-28bc91bffe8d service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:50.108591 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1273/2585] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:49 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:50.984532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f401f6-cec8-41fd-962d-70a59b075e04 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:50.985868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f401f6-cec8-41fd-962d-70a59b075e04 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:50.986367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f401f6-cec8-41fd-962d-70a59b075e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:51.022425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-89f401f6-cec8-41fd-962d-70a59b075e04 None None] MFA Rules not processed for user `c95985ffa6b749e2a87b2af11cf1230b`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:51.024173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-89f401f6-cec8-41fd-962d-70a59b075e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:51.125244 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1313/2586] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:50 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:51.859694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2fd2d-587d-4283-ba06-28bc91bffe8d service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:51.872178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2fd2d-587d-4283-ba06-28bc91bffe8d service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:51.881094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c87f9c-31a6-4fd6-af4b-4123411b22fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:51.881915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c87f9c-31a6-4fd6-af4b-4123411b22fe service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:51.882342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c87f9c-31a6-4fd6-af4b-4123411b22fe service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:51.882718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c87f9c-31a6-4fd6-af4b-4123411b22fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:51.892251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c87f9c-31a6-4fd6-af4b-4123411b22fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:51.894107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c87f9c-31a6-4fd6-af4b-4123411b22fe service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:51.903763 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1274/2587] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:51 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:54.541853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f401f6-cec8-41fd-962d-70a59b075e04 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:54.543334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-89f401f6-cec8-41fd-962d-70a59b075e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:54.643133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f401f6-cec8-41fd-962d-70a59b075e04 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:54.656318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f311e-4716-4d17-a6f5-6f27087af160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:54.657390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f311e-4716-4d17-a6f5-6f27087af160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:54.657763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f311e-4716-4d17-a6f5-6f27087af160 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:54.658285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f311e-4716-4d17-a6f5-6f27087af160 admin admin] PATH_INFO: `/v3/users/c971aa1884174ed0acec9d140f2eda87` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:54.659646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f311e-4716-4d17-a6f5-6f27087af160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c971aa1884174ed0acec9d140f2eda87)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:54.661597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f311e-4716-4d17-a6f5-6f27087af160 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:54.742468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7f2f311e-4716-4d17-a6f5-6f27087af160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c971aa1884174ed0acec9d140f2eda87'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:54.749714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7f2f311e-4716-4d17-a6f5-6f27087af160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c971aa1884174ed0acec9d140f2eda87'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:54.750776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7f2f311e-4716-4d17-a6f5-6f27087af160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c971aa1884174ed0acec9d140f2eda87'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:54.764405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7f2f311e-4716-4d17-a6f5-6f27087af160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c971aa1884174ed0acec9d140f2eda87'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:54.776433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7f2f311e-4716-4d17-a6f5-6f27087af160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c971aa1884174ed0acec9d140f2eda87'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:54.783324 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1314/2588] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:54 2021] DELETE /identity/v3/users/c971aa1884174ed0acec9d140f2eda87 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:55.074246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c87f9c-31a6-4fd6-af4b-4123411b22fe service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:55.091481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f311e-4716-4d17-a6f5-6f27087af160 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:55.093237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7f2f311e-4716-4d17-a6f5-6f27087af160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:55.099173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c87f9c-31a6-4fd6-af4b-4123411b22fe service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:55.172529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f311e-4716-4d17-a6f5-6f27087af160 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:55.187052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82907e12-9a32-43d7-8dc2-4e5e2af9c905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:55.188201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82907e12-9a32-43d7-8dc2-4e5e2af9c905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:55.188792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82907e12-9a32-43d7-8dc2-4e5e2af9c905 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:55.189230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82907e12-9a32-43d7-8dc2-4e5e2af9c905 admin admin] PATH_INFO: `/v3/projects/47584e2b5b674fc295b6a63ffe8df191` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:55.190815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82907e12-9a32-43d7-8dc2-4e5e2af9c905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47584e2b5b674fc295b6a63ffe8df191)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:55.192918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82907e12-9a32-43d7-8dc2-4e5e2af9c905 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:55.215579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505a3fd-65d1-4c27-ab37-96c9e322541d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:55.216532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505a3fd-65d1-4c27-ab37-96c9e322541d service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:55.216979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505a3fd-65d1-4c27-ab37-96c9e322541d service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:55.217545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505a3fd-65d1-4c27-ab37-96c9e322541d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:55.221264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0505a3fd-65d1-4c27-ab37-96c9e322541d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:55.266651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-82907e12-9a32-43d7-8dc2-4e5e2af9c905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47584e2b5b674fc295b6a63ffe8df191', 'request_id': 'req-82907e12-9a32-43d7-8dc2-4e5e2af9c905'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.278701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-82907e12-9a32-43d7-8dc2-4e5e2af9c905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47584e2b5b674fc295b6a63ffe8df191', 'request_id': 'req-82907e12-9a32-43d7-8dc2-4e5e2af9c905'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.290906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-82907e12-9a32-43d7-8dc2-4e5e2af9c905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47584e2b5b674fc295b6a63ffe8df191', 'request_id': 'req-82907e12-9a32-43d7-8dc2-4e5e2af9c905'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.303776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505a3fd-65d1-4c27-ab37-96c9e322541d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:55.305893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505a3fd-65d1-4c27-ab37-96c9e322541d service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:55.308018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-82907e12-9a32-43d7-8dc2-4e5e2af9c905 admin admin] The token cache is being invalidate because project 47584e2b5b674fc295b6a63ffe8df191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:55.308425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-82907e12-9a32-43d7-8dc2-4e5e2af9c905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.309246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-82907e12-9a32-43d7-8dc2-4e5e2af9c905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.311747 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1315/2589] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:55 2021] DELETE /identity/v3/projects/47584e2b5b674fc295b6a63ffe8df191 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:55.315261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82907e12-9a32-43d7-8dc2-4e5e2af9c905 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:55.316781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-82907e12-9a32-43d7-8dc2-4e5e2af9c905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:55.318947 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1275/2590] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:55 2021] GET /identity/v3/auth/tokens => generated 3270 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:55.346047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505a3fd-65d1-4c27-ab37-96c9e322541d service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:55.349140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0505a3fd-65d1-4c27-ab37-96c9e322541d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:55.373149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505a3fd-65d1-4c27-ab37-96c9e322541d service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:55.405851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82907e12-9a32-43d7-8dc2-4e5e2af9c905 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:55.424328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff62a2-2c2c-4bfd-b803-70471674578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:55.425628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff62a2-2c2c-4bfd-b803-70471674578b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:55.426110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff62a2-2c2c-4bfd-b803-70471674578b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:55.426615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff62a2-2c2c-4bfd-b803-70471674578b admin admin] PATH_INFO: `/v3/users/b209cee416d043a7badbea4e52f44359` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:55.428192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff62a2-2c2c-4bfd-b803-70471674578b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b209cee416d043a7badbea4e52f44359)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:55.430394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff62a2-2c2c-4bfd-b803-70471674578b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:55.461100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2121e4-7c9e-468a-af9f-856ab0bb2b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:55.462658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2121e4-7c9e-468a-af9f-856ab0bb2b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:55.463734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2121e4-7c9e-468a-af9f-856ab0bb2b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:55.464101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2121e4-7c9e-468a-af9f-856ab0bb2b0b admin admin] PATH_INFO: `/v3/users/2adbe528b7b94299b0f06ea3e4654c82` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:55.466691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2121e4-7c9e-468a-af9f-856ab0bb2b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2adbe528b7b94299b0f06ea3e4654c82)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:55.469526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2121e4-7c9e-468a-af9f-856ab0bb2b0b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:55.498355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-32ff62a2-2c2c-4bfd-b803-70471674578b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b209cee416d043a7badbea4e52f44359'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.508620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-32ff62a2-2c2c-4bfd-b803-70471674578b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b209cee416d043a7badbea4e52f44359'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.509511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-32ff62a2-2c2c-4bfd-b803-70471674578b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b209cee416d043a7badbea4e52f44359'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.525770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-32ff62a2-2c2c-4bfd-b803-70471674578b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b209cee416d043a7badbea4e52f44359'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.532774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-df2121e4-7c9e-468a-af9f-856ab0bb2b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2adbe528b7b94299b0f06ea3e4654c82'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.534054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-32ff62a2-2c2c-4bfd-b803-70471674578b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b209cee416d043a7badbea4e52f44359'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.544649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-df2121e4-7c9e-468a-af9f-856ab0bb2b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2adbe528b7b94299b0f06ea3e4654c82'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.564728 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1316/2591] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:55 2021] DELETE /identity/v3/users/b209cee416d043a7badbea4e52f44359 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:55.568958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-df2121e4-7c9e-468a-af9f-856ab0bb2b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2adbe528b7b94299b0f06ea3e4654c82'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.570323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-df2121e4-7c9e-468a-af9f-856ab0bb2b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2adbe528b7b94299b0f06ea3e4654c82'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.583532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-df2121e4-7c9e-468a-af9f-856ab0bb2b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2adbe528b7b94299b0f06ea3e4654c82'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.598702 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1276/2592] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:55 2021] DELETE /identity/v3/users/2adbe528b7b94299b0f06ea3e4654c82 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:55.603046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711df10-7098-43f3-91ec-6496b2177c04 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:55.603602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711df10-7098-43f3-91ec-6496b2177c04 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:55.603957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711df10-7098-43f3-91ec-6496b2177c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:55.631765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d711df10-7098-43f3-91ec-6496b2177c04 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:55.634138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d711df10-7098-43f3-91ec-6496b2177c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:55.770622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2121e4-7c9e-468a-af9f-856ab0bb2b0b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:55.775093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-df2121e4-7c9e-468a-af9f-856ab0bb2b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:55.776333 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1317/2593] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:48:55.791354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2121e4-7c9e-468a-af9f-856ab0bb2b0b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:55.797492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711df10-7098-43f3-91ec-6496b2177c04 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:55.799102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d711df10-7098-43f3-91ec-6496b2177c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:55.806597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8124ad-7450-4669-a344-3f8c5f7b4f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:55.807952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8124ad-7450-4669-a344-3f8c5f7b4f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:55.808075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8124ad-7450-4669-a344-3f8c5f7b4f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:55.808732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8124ad-7450-4669-a344-3f8c5f7b4f35 admin admin] PATH_INFO: `/v3/projects/2d09c7bbda564a1092cfe537f39e0a0b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:55.810357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8124ad-7450-4669-a344-3f8c5f7b4f35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d09c7bbda564a1092cfe537f39e0a0b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:55.812474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8124ad-7450-4669-a344-3f8c5f7b4f35 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:55.904725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711df10-7098-43f3-91ec-6496b2177c04 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:55.916061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5a8124ad-7450-4669-a344-3f8c5f7b4f35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d09c7bbda564a1092cfe537f39e0a0b', 'request_id': 'req-5a8124ad-7450-4669-a344-3f8c5f7b4f35'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.927560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5a8124ad-7450-4669-a344-3f8c5f7b4f35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d09c7bbda564a1092cfe537f39e0a0b', 'request_id': 'req-5a8124ad-7450-4669-a344-3f8c5f7b4f35'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.938179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5a8124ad-7450-4669-a344-3f8c5f7b4f35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d09c7bbda564a1092cfe537f39e0a0b', 'request_id': 'req-5a8124ad-7450-4669-a344-3f8c5f7b4f35'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.960411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5a8124ad-7450-4669-a344-3f8c5f7b4f35 admin admin] The token cache is being invalidate because project 2d09c7bbda564a1092cfe537f39e0a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:55.960789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5a8124ad-7450-4669-a344-3f8c5f7b4f35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.961413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5a8124ad-7450-4669-a344-3f8c5f7b4f35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:55.967053 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1277/2594] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:55 2021] DELETE /identity/v3/projects/2d09c7bbda564a1092cfe537f39e0a0b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:55.969015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3d893-87a4-4c95-acc5-ecd80c905beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:55.969660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3d893-87a4-4c95-acc5-ecd80c905beb service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:55.969939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3d893-87a4-4c95-acc5-ecd80c905beb service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:55.970687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3d893-87a4-4c95-acc5-ecd80c905beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:55.971125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4822fbb-1749-473a-b433-c6ecceefb8b0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:55.971497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4822fbb-1749-473a-b433-c6ecceefb8b0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:55.971876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4822fbb-1749-473a-b433-c6ecceefb8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:55.973837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7ad3d893-87a4-4c95-acc5-ecd80c905beb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:55.992834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b4822fbb-1749-473a-b433-c6ecceefb8b0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:55.993957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b4822fbb-1749-473a-b433-c6ecceefb8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:56.084215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3d893-87a4-4c95-acc5-ecd80c905beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:56.086087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3d893-87a4-4c95-acc5-ecd80c905beb service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:56.088126 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1278/2595] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:48:56.089604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4822fbb-1749-473a-b433-c6ecceefb8b0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:56.091366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b4822fbb-1749-473a-b433-c6ecceefb8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:56.116150 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1318/2596] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:48:56.120664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97408a13-a721-44e0-b753-715075cec1d6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:56.121752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97408a13-a721-44e0-b753-715075cec1d6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:56.122135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97408a13-a721-44e0-b753-715075cec1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:56.162298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-97408a13-a721-44e0-b753-715075cec1d6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:56.164201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-97408a13-a721-44e0-b753-715075cec1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:56.175945 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1319/2597] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:56.180963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97408a13-a721-44e0-b753-715075cec1d6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:56.184468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4822fbb-1749-473a-b433-c6ecceefb8b0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:56.191072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a80836-7482-4acf-9c35-0f8a0d0ac00b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:56.191803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a80836-7482-4acf-9c35-0f8a0d0ac00b service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:56.192103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a80836-7482-4acf-9c35-0f8a0d0ac00b service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:56.192918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a80836-7482-4acf-9c35-0f8a0d0ac00b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:56.195364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c2a80836-7482-4acf-9c35-0f8a0d0ac00b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:56.199468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97408a13-a721-44e0-b753-715075cec1d6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:56.207956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b1c66-39f4-4675-9307-804643cf7669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:56.209051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b1c66-39f4-4675-9307-804643cf7669 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:56.209352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b1c66-39f4-4675-9307-804643cf7669 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:56.209666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b1c66-39f4-4675-9307-804643cf7669 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:56.213526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b1c66-39f4-4675-9307-804643cf7669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:56.213526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b1c66-39f4-4675-9307-804643cf7669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:56.214499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b1c66-39f4-4675-9307-804643cf7669 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:56.236266 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1320/2598] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:56.237170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b1c66-39f4-4675-9307-804643cf7669 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:56.249602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b1c66-39f4-4675-9307-804643cf7669 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:56.258763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16307c3-d5e9-4e69-808a-4acaabbc20a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:56.260958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16307c3-d5e9-4e69-808a-4acaabbc20a0 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:56.261249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16307c3-d5e9-4e69-808a-4acaabbc20a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:56.263969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16307c3-d5e9-4e69-808a-4acaabbc20a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:56.264742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16307c3-d5e9-4e69-808a-4acaabbc20a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:56.270080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16307c3-d5e9-4e69-808a-4acaabbc20a0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:56.290733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a80836-7482-4acf-9c35-0f8a0d0ac00b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:56.292730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a80836-7482-4acf-9c35-0f8a0d0ac00b service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:56.323449 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1279/2599] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:56 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:48:56.345743 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1321/2600] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:56 2021] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:56.346161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a80836-7482-4acf-9c35-0f8a0d0ac00b service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:56.358366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a80836-7482-4acf-9c35-0f8a0d0ac00b service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:56.434064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ad1b6-7284-4401-96b9-a8411318473b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:56.434790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ad1b6-7284-4401-96b9-a8411318473b admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:56.435081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ad1b6-7284-4401-96b9-a8411318473b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:56.435367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ad1b6-7284-4401-96b9-a8411318473b admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:56.436354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ad1b6-7284-4401-96b9-a8411318473b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:56.438530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ad1b6-7284-4401-96b9-a8411318473b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:56.470188 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1280/2601] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:56 2021] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:48:56.474411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16307c3-d5e9-4e69-808a-4acaabbc20a0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:56.489398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16307c3-d5e9-4e69-808a-4acaabbc20a0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:56.497369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc6643-2d4c-4050-ae8f-7fc0a4db411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:56.498211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc6643-2d4c-4050-ae8f-7fc0a4db411e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:56.498539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc6643-2d4c-4050-ae8f-7fc0a4db411e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:56.499035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc6643-2d4c-4050-ae8f-7fc0a4db411e admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:56.499788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc6643-2d4c-4050-ae8f-7fc0a4db411e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:56.501656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc6643-2d4c-4050-ae8f-7fc0a4db411e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:56.513431 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1322/2602] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:56 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:56.517213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ad1b6-7284-4401-96b9-a8411318473b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:56.528083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ad1b6-7284-4401-96b9-a8411318473b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:56.533239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe46db4-f4df-4f5c-aae0-8ebda4cfff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:56.533974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe46db4-f4df-4f5c-aae0-8ebda4cfff88 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:56.534337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe46db4-f4df-4f5c-aae0-8ebda4cfff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:56.534626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe46db4-f4df-4f5c-aae0-8ebda4cfff88 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:56.535402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe46db4-f4df-4f5c-aae0-8ebda4cfff88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:56.536983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe46db4-f4df-4f5c-aae0-8ebda4cfff88 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:56.547415 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1281/2603] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:56 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:56.551370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc6643-2d4c-4050-ae8f-7fc0a4db411e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:56.561550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc6643-2d4c-4050-ae8f-7fc0a4db411e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:56.567564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a931c-938b-4cc2-b3cd-e39f9ad32d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:56.568458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a931c-938b-4cc2-b3cd-e39f9ad32d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:56.568746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a931c-938b-4cc2-b3cd-e39f9ad32d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:56.569024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a931c-938b-4cc2-b3cd-e39f9ad32d45 admin admin] PATH_INFO: `/v3/projects/40883beddaf94dc0b620e5e05f5eb920/users/4a26523f1e0246f6b53903c63c5a79ca/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:56.585106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a931c-938b-4cc2-b3cd-e39f9ad32d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40883beddaf94dc0b620e5e05f5eb920, user_id=4a26523f1e0246f6b53903c63c5a79ca, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:56.587804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a931c-938b-4cc2-b3cd-e39f9ad32d45 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:56.602381 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1323/2604] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:56 2021] PUT /identity/v3/projects/40883beddaf94dc0b620e5e05f5eb920/users/4a26523f1e0246f6b53903c63c5a79ca/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:56.614499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e23a5d-878f-4bdf-819e-5e617f15e6cf None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:56.615075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e23a5d-878f-4bdf-819e-5e617f15e6cf None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:56.615557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e23a5d-878f-4bdf-819e-5e617f15e6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:56.644325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-49e23a5d-878f-4bdf-819e-5e617f15e6cf None None] MFA Rules not processed for user `4a26523f1e0246f6b53903c63c5a79ca`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:56.645543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-49e23a5d-878f-4bdf-819e-5e617f15e6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:56.742455 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1282/2605] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:56 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:56.967200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a931c-938b-4cc2-b3cd-e39f9ad32d45 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:56.969283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-600a931c-938b-4cc2-b3cd-e39f9ad32d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:57.098531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e23a5d-878f-4bdf-819e-5e617f15e6cf None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:57.116927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a931c-938b-4cc2-b3cd-e39f9ad32d45 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:57.122495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9888b9-c66c-415f-9820-30972fc2a986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:57.123356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9888b9-c66c-415f-9820-30972fc2a986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:57.123636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9888b9-c66c-415f-9820-30972fc2a986 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:57.124152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9888b9-c66c-415f-9820-30972fc2a986 admin admin] PATH_INFO: `/v3/projects/f1bd8a61f8bf450290c7bacb16d71eb2` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:57.125480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9888b9-c66c-415f-9820-30972fc2a986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1bd8a61f8bf450290c7bacb16d71eb2)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:57.127504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9888b9-c66c-415f-9820-30972fc2a986 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:57.182643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8a9888b9-c66c-415f-9820-30972fc2a986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1bd8a61f8bf450290c7bacb16d71eb2', 'request_id': 'req-8a9888b9-c66c-415f-9820-30972fc2a986'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:57.189130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8a9888b9-c66c-415f-9820-30972fc2a986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1bd8a61f8bf450290c7bacb16d71eb2', 'request_id': 'req-8a9888b9-c66c-415f-9820-30972fc2a986'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:57.191143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e23a5d-878f-4bdf-819e-5e617f15e6cf None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:57.198064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8a9888b9-c66c-415f-9820-30972fc2a986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1bd8a61f8bf450290c7bacb16d71eb2', 'request_id': 'req-8a9888b9-c66c-415f-9820-30972fc2a986'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:57.209091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8a9888b9-c66c-415f-9820-30972fc2a986 admin admin] The token cache is being invalidate because project f1bd8a61f8bf450290c7bacb16d71eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:57.209446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8a9888b9-c66c-415f-9820-30972fc2a986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:57.210177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8a9888b9-c66c-415f-9820-30972fc2a986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:57.212662 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1324/2606] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:56 2021] DELETE /identity/v3/projects/f1bd8a61f8bf450290c7bacb16d71eb2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:57.220838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9888b9-c66c-415f-9820-30972fc2a986 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:57.222904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8a9888b9-c66c-415f-9820-30972fc2a986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:57.267197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c44d44-d8f4-43b4-968e-28291d5f43dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:57.268173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c44d44-d8f4-43b4-968e-28291d5f43dd service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:57.268463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c44d44-d8f4-43b4-968e-28291d5f43dd service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:57.268788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c44d44-d8f4-43b4-968e-28291d5f43dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:57.270640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-14c44d44-d8f4-43b4-968e-28291d5f43dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:57.301691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9888b9-c66c-415f-9820-30972fc2a986 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:57.307202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47911ebd-96eb-4a88-aff6-bb309384c0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:57.308098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47911ebd-96eb-4a88-aff6-bb309384c0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:57.308378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47911ebd-96eb-4a88-aff6-bb309384c0af admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:57.308760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47911ebd-96eb-4a88-aff6-bb309384c0af admin admin] PATH_INFO: `/v3/users/2cee3f5f15d3445d869a730aa0c17588` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:57.310490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47911ebd-96eb-4a88-aff6-bb309384c0af admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cee3f5f15d3445d869a730aa0c17588)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:57.312683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47911ebd-96eb-4a88-aff6-bb309384c0af admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:57.338355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c44d44-d8f4-43b4-968e-28291d5f43dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:57.340906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c44d44-d8f4-43b4-968e-28291d5f43dd service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:57.351217 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1283/2607] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:57 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:48:57.383819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47911ebd-96eb-4a88-aff6-bb309384c0af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cee3f5f15d3445d869a730aa0c17588'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:57.392562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47911ebd-96eb-4a88-aff6-bb309384c0af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cee3f5f15d3445d869a730aa0c17588'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:57.394221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47911ebd-96eb-4a88-aff6-bb309384c0af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cee3f5f15d3445d869a730aa0c17588'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:57.408662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47911ebd-96eb-4a88-aff6-bb309384c0af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cee3f5f15d3445d869a730aa0c17588'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:57.419996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47911ebd-96eb-4a88-aff6-bb309384c0af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cee3f5f15d3445d869a730aa0c17588'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:57.432242 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1325/2608] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:57 2021] DELETE /identity/v3/users/2cee3f5f15d3445d869a730aa0c17588 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:57.493922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6a26d-936c-4a34-a254-343cb257d306 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:57.494484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6a26d-936c-4a34-a254-343cb257d306 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:57.494933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6a26d-936c-4a34-a254-343cb257d306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:57.556462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d9a6a26d-936c-4a34-a254-343cb257d306 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:57.558580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d9a6a26d-936c-4a34-a254-343cb257d306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:57.647696 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1284/2609] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:48:57 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:57.717334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47911ebd-96eb-4a88-aff6-bb309384c0af admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:57.720076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-47911ebd-96eb-4a88-aff6-bb309384c0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:57.834280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6a26d-936c-4a34-a254-343cb257d306 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:57.836340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d9a6a26d-936c-4a34-a254-343cb257d306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:57.866609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47911ebd-96eb-4a88-aff6-bb309384c0af admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:57.872560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d94c0-d461-499f-a117-91ede8f954be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:57.873333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d94c0-d461-499f-a117-91ede8f954be service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:57.873754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d94c0-d461-499f-a117-91ede8f954be service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:57.874131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d94c0-d461-499f-a117-91ede8f954be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:57.883953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d94c0-d461-499f-a117-91ede8f954be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:57.885679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d94c0-d461-499f-a117-91ede8f954be service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:57.921709 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1326/2610] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:48:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:48:57.991709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6a26d-936c-4a34-a254-343cb257d306 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:57.999593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc30d7d-021d-4bda-a182-5ef598c60846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:58.000471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30d7d-021d-4bda-a182-5ef598c60846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:58.000794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30d7d-021d-4bda-a182-5ef598c60846 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:58.001071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30d7d-021d-4bda-a182-5ef598c60846 admin admin] PATH_INFO: `/v3/projects/b31d71e882964f1681fca82f8702d0b0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:58.002886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc30d7d-021d-4bda-a182-5ef598c60846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b31d71e882964f1681fca82f8702d0b0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:58.008317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc30d7d-021d-4bda-a182-5ef598c60846 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:58.082067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5cc30d7d-021d-4bda-a182-5ef598c60846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b31d71e882964f1681fca82f8702d0b0', 'request_id': 'req-5cc30d7d-021d-4bda-a182-5ef598c60846'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:58.089137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5cc30d7d-021d-4bda-a182-5ef598c60846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b31d71e882964f1681fca82f8702d0b0', 'request_id': 'req-5cc30d7d-021d-4bda-a182-5ef598c60846'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:58.096778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5cc30d7d-021d-4bda-a182-5ef598c60846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b31d71e882964f1681fca82f8702d0b0', 'request_id': 'req-5cc30d7d-021d-4bda-a182-5ef598c60846'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:58.123113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5cc30d7d-021d-4bda-a182-5ef598c60846 admin admin] The token cache is being invalidate because project b31d71e882964f1681fca82f8702d0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:48:58.123761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5cc30d7d-021d-4bda-a182-5ef598c60846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:58.124173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5cc30d7d-021d-4bda-a182-5ef598c60846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:48:58.126072 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1285/2611] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:48:57 2021] DELETE /identity/v3/projects/b31d71e882964f1681fca82f8702d0b0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:58.136489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cd616-165a-418d-8f4c-a62678609698 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:58.136785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cd616-165a-418d-8f4c-a62678609698 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:58.137092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cd616-165a-418d-8f4c-a62678609698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:58.159610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6f6cd616-165a-418d-8f4c-a62678609698 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:58.160942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6f6cd616-165a-418d-8f4c-a62678609698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:58.208467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7208d2-f6df-42db-9c30-79b67fe00813 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:58.208838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7208d2-f6df-42db-9c30-79b67fe00813 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:58.209042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7208d2-f6df-42db-9c30-79b67fe00813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:58.227940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5a7208d2-f6df-42db-9c30-79b67fe00813 None None] MFA Rules not processed for user `4a26523f1e0246f6b53903c63c5a79ca`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:58.229431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5a7208d2-f6df-42db-9c30-79b67fe00813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:58.260600 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1327/2612] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:58.262229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb3528-554f-4f01-aabb-51cbddc1e35c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:58.262554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb3528-554f-4f01-aabb-51cbddc1e35c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:58.262829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb3528-554f-4f01-aabb-51cbddc1e35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:58.292142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-acdb3528-554f-4f01-aabb-51cbddc1e35c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:58.293515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-acdb3528-554f-4f01-aabb-51cbddc1e35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:58.310287 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1328/2613] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:58.312449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb3528-554f-4f01-aabb-51cbddc1e35c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:58.318161 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1286/2614] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:58 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:48:58.322932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb3528-554f-4f01-aabb-51cbddc1e35c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:58.328114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f91260-7202-404c-ba39-099667e05600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:58.328899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f91260-7202-404c-ba39-099667e05600 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:58.329095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f91260-7202-404c-ba39-099667e05600 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:58.329906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f91260-7202-404c-ba39-099667e05600 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:58.330037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f91260-7202-404c-ba39-099667e05600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:48:58.330379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f91260-7202-404c-ba39-099667e05600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:58.332524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f91260-7202-404c-ba39-099667e05600 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:58.344804 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1329/2615] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:48:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:48:58.351279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7208d2-f6df-42db-9c30-79b67fe00813 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:58.372402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7208d2-f6df-42db-9c30-79b67fe00813 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:58.377441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f634a9-efbd-44b7-b356-eec78a542f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:58.378207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f634a9-efbd-44b7-b356-eec78a542f73 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:58.378527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f634a9-efbd-44b7-b356-eec78a542f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:58.378869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f634a9-efbd-44b7-b356-eec78a542f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:58.379899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f634a9-efbd-44b7-b356-eec78a542f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:58.381760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f634a9-efbd-44b7-b356-eec78a542f73 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:58.446385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f91260-7202-404c-ba39-099667e05600 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:58.452806 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1287/2616] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:58 2021] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:58.458001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f91260-7202-404c-ba39-099667e05600 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:58.571846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2137b-fcef-478f-8aaa-133d53a1a97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:58.573305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2137b-fcef-478f-8aaa-133d53a1a97b admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:58.573804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2137b-fcef-478f-8aaa-133d53a1a97b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:58.574425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2137b-fcef-478f-8aaa-133d53a1a97b admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:58.575731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2137b-fcef-478f-8aaa-133d53a1a97b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:58.579524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2137b-fcef-478f-8aaa-133d53a1a97b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:58.616350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f634a9-efbd-44b7-b356-eec78a542f73 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:58.624935 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1330/2617] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:58 2021] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:58.630388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f634a9-efbd-44b7-b356-eec78a542f73 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:58.644286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea76f73-b22a-450c-ba14-ea221f2e0a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:58.645102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76f73-b22a-450c-ba14-ea221f2e0a71 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:58.645493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76f73-b22a-450c-ba14-ea221f2e0a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:58.646138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76f73-b22a-450c-ba14-ea221f2e0a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:58.647480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea76f73-b22a-450c-ba14-ea221f2e0a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:58.648989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea76f73-b22a-450c-ba14-ea221f2e0a71 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:58.664260 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1288/2618] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:58 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:58.665611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2137b-fcef-478f-8aaa-133d53a1a97b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:58.704597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2137b-fcef-478f-8aaa-133d53a1a97b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:58.724416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561705a1-44e8-4b6c-b32a-614adc5afa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:58.725161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561705a1-44e8-4b6c-b32a-614adc5afa95 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:58.725448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561705a1-44e8-4b6c-b32a-614adc5afa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:58.725734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561705a1-44e8-4b6c-b32a-614adc5afa95 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:58.726583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561705a1-44e8-4b6c-b32a-614adc5afa95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:58.728194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561705a1-44e8-4b6c-b32a-614adc5afa95 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:58.742922 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1331/2619] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:58 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:58.747219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea76f73-b22a-450c-ba14-ea221f2e0a71 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:58.759084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea76f73-b22a-450c-ba14-ea221f2e0a71 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:58.771543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00a012-54c7-4495-aed9-e7bff2f09593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:58.771543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00a012-54c7-4495-aed9-e7bff2f09593 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:58.771543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00a012-54c7-4495-aed9-e7bff2f09593 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:58.771543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00a012-54c7-4495-aed9-e7bff2f09593 admin admin] PATH_INFO: `/v3/projects/be2f5d36556d48e0bcdb394734abe821/users/766553a35835435f9d4daf760058b82d/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:58.795260 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00a012-54c7-4495-aed9-e7bff2f09593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2f5d36556d48e0bcdb394734abe821, user_id=766553a35835435f9d4daf760058b82d, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:58.799014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00a012-54c7-4495-aed9-e7bff2f09593 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:58.815028 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1289/2620] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:58 2021] PUT /identity/v3/projects/be2f5d36556d48e0bcdb394734abe821/users/766553a35835435f9d4daf760058b82d/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:58.825727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58abb36-d742-4d10-a73e-3b4c9819b776 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:58.826099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58abb36-d742-4d10-a73e-3b4c9819b776 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:58.826344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58abb36-d742-4d10-a73e-3b4c9819b776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:58.863807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d58abb36-d742-4d10-a73e-3b4c9819b776 None None] MFA Rules not processed for user `766553a35835435f9d4daf760058b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:58.865114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d58abb36-d742-4d10-a73e-3b4c9819b776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:58.928137 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1332/2621] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:58 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:58.932670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00a012-54c7-4495-aed9-e7bff2f09593 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:58.999295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00a012-54c7-4495-aed9-e7bff2f09593 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:59.005144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907844e-aa89-484d-a2b9-fdf6c5dbf35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:59.005898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907844e-aa89-484d-a2b9-fdf6c5dbf35b admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:59.006187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907844e-aa89-484d-a2b9-fdf6c5dbf35b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:59.006494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907844e-aa89-484d-a2b9-fdf6c5dbf35b admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:59.007216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907844e-aa89-484d-a2b9-fdf6c5dbf35b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:59.009102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907844e-aa89-484d-a2b9-fdf6c5dbf35b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:59.035367 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1290/2622] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:48:58 2021] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:48:59.039170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58abb36-d742-4d10-a73e-3b4c9819b776 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:59.049634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58abb36-d742-4d10-a73e-3b4c9819b776 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:59.108585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1167e-e7e3-4175-b7bb-5e058379c29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:59.109256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1167e-e7e3-4175-b7bb-5e058379c29a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:59.109541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1167e-e7e3-4175-b7bb-5e058379c29a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:59.109818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1167e-e7e3-4175-b7bb-5e058379c29a admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:59.110545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1167e-e7e3-4175-b7bb-5e058379c29a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:59.113058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1167e-e7e3-4175-b7bb-5e058379c29a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:59.136752 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1333/2623] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:48:59 2021] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:48:59.138153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907844e-aa89-484d-a2b9-fdf6c5dbf35b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:59.151762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907844e-aa89-484d-a2b9-fdf6c5dbf35b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:59.156464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c8303-ef48-4481-bf6f-3b3373fc14ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:59.157142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8303-ef48-4481-bf6f-3b3373fc14ed admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:59.157556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8303-ef48-4481-bf6f-3b3373fc14ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:59.158053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8303-ef48-4481-bf6f-3b3373fc14ed admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:59.158849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c8303-ef48-4481-bf6f-3b3373fc14ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:59.160472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c8303-ef48-4481-bf6f-3b3373fc14ed admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:59.176352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1167e-e7e3-4175-b7bb-5e058379c29a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:59.180943 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1291/2624] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:59 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:48:59.191033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1167e-e7e3-4175-b7bb-5e058379c29a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:59.197034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b843c8-82fe-465e-8de6-d264f9e37cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:59.198458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b843c8-82fe-465e-8de6-d264f9e37cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:59.198747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b843c8-82fe-465e-8de6-d264f9e37cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:59.199030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b843c8-82fe-465e-8de6-d264f9e37cb7 admin admin] PATH_INFO: `/v3/projects/b334131191924300ac60041ae609e0ec/users/cd31dbdb8904445faff748e630d01277/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:59.220376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b843c8-82fe-465e-8de6-d264f9e37cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b334131191924300ac60041ae609e0ec, user_id=cd31dbdb8904445faff748e630d01277, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:59.223804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b843c8-82fe-465e-8de6-d264f9e37cb7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:59.241720 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1334/2625] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:59 2021] PUT /identity/v3/projects/b334131191924300ac60041ae609e0ec/users/cd31dbdb8904445faff748e630d01277/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:48:59.245814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c8303-ef48-4481-bf6f-3b3373fc14ed admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:59.255857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479fdbc-cc3a-4cda-a44c-37337ee27a32 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:59.256340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c8303-ef48-4481-bf6f-3b3373fc14ed admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:59.256589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479fdbc-cc3a-4cda-a44c-37337ee27a32 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:59.257046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479fdbc-cc3a-4cda-a44c-37337ee27a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:59.285725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4479fdbc-cc3a-4cda-a44c-37337ee27a32 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:59.287357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4479fdbc-cc3a-4cda-a44c-37337ee27a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:59.368904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885535e-4c7f-4058-9abf-a971ebdf15b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:59.370720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885535e-4c7f-4058-9abf-a971ebdf15b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:59.370720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885535e-4c7f-4058-9abf-a971ebdf15b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:59.370720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885535e-4c7f-4058-9abf-a971ebdf15b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:59.371607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885535e-4c7f-4058-9abf-a971ebdf15b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:59.373582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885535e-4c7f-4058-9abf-a971ebdf15b7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:59.391964 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1292/2626] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:48:59 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:48:59.395001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885535e-4c7f-4058-9abf-a971ebdf15b7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:59.399046 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1335/2627] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:48:59 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:59.415101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479fdbc-cc3a-4cda-a44c-37337ee27a32 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:59.416792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4479fdbc-cc3a-4cda-a44c-37337ee27a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:59.419835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885535e-4c7f-4058-9abf-a971ebdf15b7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:59.426866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e983436-e9c1-4643-bf3e-dc7552021fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:59.429007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e983436-e9c1-4643-bf3e-dc7552021fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:59.429783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e983436-e9c1-4643-bf3e-dc7552021fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:59.430709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e983436-e9c1-4643-bf3e-dc7552021fe0 admin admin] PATH_INFO: `/v3/projects/b334131191924300ac60041ae609e0ec/users/cd31dbdb8904445faff748e630d01277/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:59.433969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e983436-e9c1-4643-bf3e-dc7552021fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b334131191924300ac60041ae609e0ec, user_id=cd31dbdb8904445faff748e630d01277, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:59.438674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e983436-e9c1-4643-bf3e-dc7552021fe0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:59.454080 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1293/2628] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:48:59 2021] PUT /identity/v3/projects/b334131191924300ac60041ae609e0ec/users/cd31dbdb8904445faff748e630d01277/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:48:59.465439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16995759-2550-4315-b23c-95d7294dc915 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:59.465966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16995759-2550-4315-b23c-95d7294dc915 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:59.466272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16995759-2550-4315-b23c-95d7294dc915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:59.500124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-16995759-2550-4315-b23c-95d7294dc915 None None] MFA Rules not processed for user `cd31dbdb8904445faff748e630d01277`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:48:59.501386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-16995759-2550-4315-b23c-95d7294dc915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:59.521054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479fdbc-cc3a-4cda-a44c-37337ee27a32 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:59.595695 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1294/2629] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:48:59 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:48:59.650359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec2790-eabc-48f9-9786-c2a260408513 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:59.651102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec2790-eabc-48f9-9786-c2a260408513 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:59.651350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec2790-eabc-48f9-9786-c2a260408513 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:59.651681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec2790-eabc-48f9-9786-c2a260408513 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:59.749871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec2790-eabc-48f9-9786-c2a260408513 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:59.751601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec2790-eabc-48f9-9786-c2a260408513 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:48:59.756116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16995759-2550-4315-b23c-95d7294dc915 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:59.759447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-16995759-2550-4315-b23c-95d7294dc915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:59.763483 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1336/2630] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:48:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 20:48:59.936172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec2790-eabc-48f9-9786-c2a260408513 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:48:59.937614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-02ec2790-eabc-48f9-9786-c2a260408513 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:48:59.939423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16995759-2550-4315-b23c-95d7294dc915 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:48:59.955405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c94600-8491-446c-8ef9-411c32d71fc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:48:59.956932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c94600-8491-446c-8ef9-411c32d71fc8 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:48:59.957742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c94600-8491-446c-8ef9-411c32d71fc8 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:48:59.957844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c94600-8491-446c-8ef9-411c32d71fc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:48:59.982897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c94600-8491-446c-8ef9-411c32d71fc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:48:59.984738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c94600-8491-446c-8ef9-411c32d71fc8 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:00.020022 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1295/2631] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:48:59 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:49:00.109305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec2790-eabc-48f9-9786-c2a260408513 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:00.118292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6c66e-fd75-4bd8-a0da-9872ffc8fbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:00.120009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6c66e-fd75-4bd8-a0da-9872ffc8fbe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:00.120481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6c66e-fd75-4bd8-a0da-9872ffc8fbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:00.120973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6c66e-fd75-4bd8-a0da-9872ffc8fbe8 admin admin] PATH_INFO: `/v3/users/4a26523f1e0246f6b53903c63c5a79ca` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:00.122960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6c66e-fd75-4bd8-a0da-9872ffc8fbe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a26523f1e0246f6b53903c63c5a79ca)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:00.125843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6c66e-fd75-4bd8-a0da-9872ffc8fbe8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:00.229005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e2d6c66e-fd75-4bd8-a0da-9872ffc8fbe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a26523f1e0246f6b53903c63c5a79ca'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:00.238963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e2d6c66e-fd75-4bd8-a0da-9872ffc8fbe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a26523f1e0246f6b53903c63c5a79ca'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:00.239713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e2d6c66e-fd75-4bd8-a0da-9872ffc8fbe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a26523f1e0246f6b53903c63c5a79ca'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:00.257890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e2d6c66e-fd75-4bd8-a0da-9872ffc8fbe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a26523f1e0246f6b53903c63c5a79ca'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:00.270079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e2d6c66e-fd75-4bd8-a0da-9872ffc8fbe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a26523f1e0246f6b53903c63c5a79ca'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:00.284930 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1337/2632] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:48:59 2021] DELETE /identity/v3/users/4a26523f1e0246f6b53903c63c5a79ca => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:00.285758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11772307-068c-4484-ae35-568b0cc13d91 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:00.286202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11772307-068c-4484-ae35-568b0cc13d91 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:00.286330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11772307-068c-4484-ae35-568b0cc13d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:00.311282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-11772307-068c-4484-ae35-568b0cc13d91 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:00.314149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-11772307-068c-4484-ae35-568b0cc13d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:00.439233 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1296/2633] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:00.453910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6c66e-fd75-4bd8-a0da-9872ffc8fbe8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:00.455566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e2d6c66e-fd75-4bd8-a0da-9872ffc8fbe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:00.530078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6c66e-fd75-4bd8-a0da-9872ffc8fbe8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:00.534115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6bebb-6410-4205-9b7b-629681153a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:00.535087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6bebb-6410-4205-9b7b-629681153a2e service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:00.535480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6bebb-6410-4205-9b7b-629681153a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:00.535855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6bebb-6410-4205-9b7b-629681153a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:00.557262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6bebb-6410-4205-9b7b-629681153a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:00.558817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6bebb-6410-4205-9b7b-629681153a2e service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:00.570456 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1338/2634] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:01.079217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11772307-068c-4484-ae35-568b0cc13d91 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:01.082619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-11772307-068c-4484-ae35-568b0cc13d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:01.110703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6bebb-6410-4205-9b7b-629681153a2e service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:01.112608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7da6bebb-6410-4205-9b7b-629681153a2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:01.136236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6bebb-6410-4205-9b7b-629681153a2e service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:01.147994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bd0af-651e-443f-ba3f-24ea16f319cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:01.149265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bd0af-651e-443f-ba3f-24ea16f319cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:01.149961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bd0af-651e-443f-ba3f-24ea16f319cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:01.150469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bd0af-651e-443f-ba3f-24ea16f319cd admin admin] PATH_INFO: `/v3/users/c95985ffa6b749e2a87b2af11cf1230b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:01.152099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bd0af-651e-443f-ba3f-24ea16f319cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c95985ffa6b749e2a87b2af11cf1230b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:01.154849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bd0af-651e-443f-ba3f-24ea16f319cd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:01.215630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11772307-068c-4484-ae35-568b0cc13d91 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:01.224198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56308c-abec-48ce-a59d-fc01ba308066 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:01.225036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56308c-abec-48ce-a59d-fc01ba308066 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:01.225399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56308c-abec-48ce-a59d-fc01ba308066 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:01.225783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56308c-abec-48ce-a59d-fc01ba308066 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:01.229839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4e56308c-abec-48ce-a59d-fc01ba308066 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:01.287201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4b8bd0af-651e-443f-ba3f-24ea16f319cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c95985ffa6b749e2a87b2af11cf1230b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:01.308754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4b8bd0af-651e-443f-ba3f-24ea16f319cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c95985ffa6b749e2a87b2af11cf1230b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:01.310456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4b8bd0af-651e-443f-ba3f-24ea16f319cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c95985ffa6b749e2a87b2af11cf1230b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:01.318561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56308c-abec-48ce-a59d-fc01ba308066 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:01.320480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56308c-abec-48ce-a59d-fc01ba308066 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:01.326632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4b8bd0af-651e-443f-ba3f-24ea16f319cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c95985ffa6b749e2a87b2af11cf1230b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:01.339179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4b8bd0af-651e-443f-ba3f-24ea16f319cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c95985ffa6b749e2a87b2af11cf1230b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:01.347534 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1297/2635] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:01 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:01.351284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56308c-abec-48ce-a59d-fc01ba308066 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:01.351429 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1339/2636] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:01 2021] DELETE /identity/v3/users/c95985ffa6b749e2a87b2af11cf1230b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:01.352349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bd0af-651e-443f-ba3f-24ea16f319cd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:01.358137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4b8bd0af-651e-443f-ba3f-24ea16f319cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:01.358285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4e56308c-abec-48ce-a59d-fc01ba308066 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:01.384901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56308c-abec-48ce-a59d-fc01ba308066 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:01.493876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bd0af-651e-443f-ba3f-24ea16f319cd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:01.499570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddf303-e037-4f61-b8da-b217bb537508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:01.501607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddf303-e037-4f61-b8da-b217bb537508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:01.501607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddf303-e037-4f61-b8da-b217bb537508 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:01.503730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddf303-e037-4f61-b8da-b217bb537508 admin admin] PATH_INFO: `/v3/users/766553a35835435f9d4daf760058b82d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:01.507992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cddf303-e037-4f61-b8da-b217bb537508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=766553a35835435f9d4daf760058b82d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:01.509945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cddf303-e037-4f61-b8da-b217bb537508 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:01.557035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4e496-b81d-45ab-848e-98b3ab437ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:01.558286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4e496-b81d-45ab-848e-98b3ab437ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:01.558945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4e496-b81d-45ab-848e-98b3ab437ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:01.568450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4e496-b81d-45ab-848e-98b3ab437ecc admin admin] PATH_INFO: `/v3/projects/40883beddaf94dc0b620e5e05f5eb920` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:01.570593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4e496-b81d-45ab-848e-98b3ab437ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=40883beddaf94dc0b620e5e05f5eb920)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:01.573297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4e496-b81d-45ab-848e-98b3ab437ecc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:01.605965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2cddf303-e037-4f61-b8da-b217bb537508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '766553a35835435f9d4daf760058b82d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:01.629125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2cddf303-e037-4f61-b8da-b217bb537508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '766553a35835435f9d4daf760058b82d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:01.630826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2cddf303-e037-4f61-b8da-b217bb537508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '766553a35835435f9d4daf760058b82d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:01.672114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2cddf303-e037-4f61-b8da-b217bb537508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '766553a35835435f9d4daf760058b82d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:01.692394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2cddf303-e037-4f61-b8da-b217bb537508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '766553a35835435f9d4daf760058b82d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:01.702417 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1340/2637] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:01 2021] DELETE /identity/v3/users/766553a35835435f9d4daf760058b82d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:01.710467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-56c4e496-b81d-45ab-848e-98b3ab437ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40883beddaf94dc0b620e5e05f5eb920', 'request_id': 'req-56c4e496-b81d-45ab-848e-98b3ab437ecc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:01.710909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d833b-0d73-4631-b998-5e91dc341023 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:01.710909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d833b-0d73-4631-b998-5e91dc341023 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:01.710909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d833b-0d73-4631-b998-5e91dc341023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:01.721484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-56c4e496-b81d-45ab-848e-98b3ab437ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40883beddaf94dc0b620e5e05f5eb920', 'request_id': 'req-56c4e496-b81d-45ab-848e-98b3ab437ecc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:01.731624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-56c4e496-b81d-45ab-848e-98b3ab437ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40883beddaf94dc0b620e5e05f5eb920', 'request_id': 'req-56c4e496-b81d-45ab-848e-98b3ab437ecc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:01.735893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-317d833b-0d73-4631-b998-5e91dc341023 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:01.737917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-317d833b-0d73-4631-b998-5e91dc341023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:01.763209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-56c4e496-b81d-45ab-848e-98b3ab437ecc admin admin] The token cache is being invalidate because project 40883beddaf94dc0b620e5e05f5eb920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:01.763491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-56c4e496-b81d-45ab-848e-98b3ab437ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:01.764369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-56c4e496-b81d-45ab-848e-98b3ab437ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:01.768852 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1298/2638] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:01 2021] DELETE /identity/v3/projects/40883beddaf94dc0b620e5e05f5eb920 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:01.769660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4e496-b81d-45ab-848e-98b3ab437ecc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:01.778157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-56c4e496-b81d-45ab-848e-98b3ab437ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:01.829512 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1341/2639] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:01.829512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf69cb-be0a-4534-9095-e0639ffdce36 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:01.829512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf69cb-be0a-4534-9095-e0639ffdce36 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:01.829512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf69cb-be0a-4534-9095-e0639ffdce36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:01.852924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-eaaf69cb-be0a-4534-9095-e0639ffdce36 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:01.854535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-eaaf69cb-be0a-4534-9095-e0639ffdce36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:01.865929 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1342/2640] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:01.866862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf69cb-be0a-4534-9095-e0639ffdce36 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:01.868245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-eaaf69cb-be0a-4534-9095-e0639ffdce36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:01.911120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4e496-b81d-45ab-848e-98b3ab437ecc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:01.917161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede0d29-7199-4e92-b42a-3b3f3db512c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:01.918066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede0d29-7199-4e92-b42a-3b3f3db512c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:01.918397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede0d29-7199-4e92-b42a-3b3f3db512c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:01.918682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede0d29-7199-4e92-b42a-3b3f3db512c1 admin admin] PATH_INFO: `/v3/projects/56fa7201c1544de18e58e91abddc3fe9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:01.919915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede0d29-7199-4e92-b42a-3b3f3db512c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56fa7201c1544de18e58e91abddc3fe9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:01.921867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede0d29-7199-4e92-b42a-3b3f3db512c1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:01.938867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf69cb-be0a-4534-9095-e0639ffdce36 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:01.942966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3655d-64d9-4076-8451-df0608639686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:01.943657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3655d-64d9-4076-8451-df0608639686 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:01.943939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3655d-64d9-4076-8451-df0608639686 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:01.944350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3655d-64d9-4076-8451-df0608639686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:01.957507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3655d-64d9-4076-8451-df0608639686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:01.959051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3655d-64d9-4076-8451-df0608639686 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:01.970429 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1343/2641] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:01.972551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf14fdf-d9a0-4ffb-be9b-062bf61902c7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:01.972841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf14fdf-d9a0-4ffb-be9b-062bf61902c7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:01.973117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf14fdf-d9a0-4ffb-be9b-062bf61902c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:02.005473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ede0d29-7199-4e92-b42a-3b3f3db512c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56fa7201c1544de18e58e91abddc3fe9', 'request_id': 'req-9ede0d29-7199-4e92-b42a-3b3f3db512c1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.013886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9cf14fdf-d9a0-4ffb-be9b-062bf61902c7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:02.015172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9cf14fdf-d9a0-4ffb-be9b-062bf61902c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:02.021160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ede0d29-7199-4e92-b42a-3b3f3db512c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56fa7201c1544de18e58e91abddc3fe9', 'request_id': 'req-9ede0d29-7199-4e92-b42a-3b3f3db512c1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.028768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ede0d29-7199-4e92-b42a-3b3f3db512c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56fa7201c1544de18e58e91abddc3fe9', 'request_id': 'req-9ede0d29-7199-4e92-b42a-3b3f3db512c1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.055296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ede0d29-7199-4e92-b42a-3b3f3db512c1 admin admin] The token cache is being invalidate because project 56fa7201c1544de18e58e91abddc3fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:02.055596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ede0d29-7199-4e92-b42a-3b3f3db512c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.056332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ede0d29-7199-4e92-b42a-3b3f3db512c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.059711 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1299/2642] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:01 2021] DELETE /identity/v3/projects/56fa7201c1544de18e58e91abddc3fe9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:02.067475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646d5b8-4c82-4452-a3de-9626529eaceb None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:02.068483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646d5b8-4c82-4452-a3de-9626529eaceb None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:02.068945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646d5b8-4c82-4452-a3de-9626529eaceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:02.110382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7646d5b8-4c82-4452-a3de-9626529eaceb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:02.114762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7646d5b8-4c82-4452-a3de-9626529eaceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:02.187942 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1344/2643] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:02.194012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf14fdf-d9a0-4ffb-be9b-062bf61902c7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:02.216377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf14fdf-d9a0-4ffb-be9b-062bf61902c7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:02.233491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddbd7e-e2d6-4fc2-b46f-c81fa9a9d9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:02.234220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddbd7e-e2d6-4fc2-b46f-c81fa9a9d9fe admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:02.234550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddbd7e-e2d6-4fc2-b46f-c81fa9a9d9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:02.234853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddbd7e-e2d6-4fc2-b46f-c81fa9a9d9fe admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:02.235604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddbd7e-e2d6-4fc2-b46f-c81fa9a9d9fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:49:02.235937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddbd7e-e2d6-4fc2-b46f-c81fa9a9d9fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:02.238246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddbd7e-e2d6-4fc2-b46f-c81fa9a9d9fe admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:02.261519 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1300/2644] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:49:02.262386 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1345/2645] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:49:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:49:02.265926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4b8c6-c1a9-4c8d-bdf6-799f684132a0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:02.265926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4b8c6-c1a9-4c8d-bdf6-799f684132a0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:02.265926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4b8c6-c1a9-4c8d-bdf6-799f684132a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:02.266709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddbd7e-e2d6-4fc2-b46f-c81fa9a9d9fe admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:02.283055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddbd7e-e2d6-4fc2-b46f-c81fa9a9d9fe admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:02.294298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44e32b-2857-40bb-a24f-f58d08c49cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:02.295057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44e32b-2857-40bb-a24f-f58d08c49cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:02.295338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44e32b-2857-40bb-a24f-f58d08c49cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:02.295805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44e32b-2857-40bb-a24f-f58d08c49cd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:02.296709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44e32b-2857-40bb-a24f-f58d08c49cd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:02.301191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44e32b-2857-40bb-a24f-f58d08c49cd0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:02.315689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b7c4b8c6-c1a9-4c8d-bdf6-799f684132a0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:02.316902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b7c4b8c6-c1a9-4c8d-bdf6-799f684132a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:02.342546 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1301/2646] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:02.348096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4b8c6-c1a9-4c8d-bdf6-799f684132a0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:02.361922 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1346/2647] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:49:02 2021] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:49:02.366837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44e32b-2857-40bb-a24f-f58d08c49cd0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:02.368479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4b8c6-c1a9-4c8d-bdf6-799f684132a0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:02.451867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b9bc8-2feb-45f9-919a-6fdaeb5afd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:02.452929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b9bc8-2feb-45f9-919a-6fdaeb5afd4c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:02.453688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b9bc8-2feb-45f9-919a-6fdaeb5afd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:02.454361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b9bc8-2feb-45f9-919a-6fdaeb5afd4c admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:02.456081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b9bc8-2feb-45f9-919a-6fdaeb5afd4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:49:02.458667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b9bc8-2feb-45f9-919a-6fdaeb5afd4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:02.462836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b9bc8-2feb-45f9-919a-6fdaeb5afd4c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:02.492247 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1302/2648] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:49:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:49:02.492615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b9bc8-2feb-45f9-919a-6fdaeb5afd4c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:02.495196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f10b9bc8-2feb-45f9-919a-6fdaeb5afd4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:02.521843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44e32b-2857-40bb-a24f-f58d08c49cd0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:02.526928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76f809-6188-43fc-b3f0-9a8c9d067c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:02.528289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76f809-6188-43fc-b3f0-9a8c9d067c8a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:02.528579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76f809-6188-43fc-b3f0-9a8c9d067c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:02.529932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76f809-6188-43fc-b3f0-9a8c9d067c8a admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:02.529932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76f809-6188-43fc-b3f0-9a8c9d067c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:02.531768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76f809-6188-43fc-b3f0-9a8c9d067c8a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:02.534724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b9bc8-2feb-45f9-919a-6fdaeb5afd4c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:02.540759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ae9d5-5b6d-4435-bd94-8c2e31f2fdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:02.542604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ae9d5-5b6d-4435-bd94-8c2e31f2fdd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:02.543088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ae9d5-5b6d-4435-bd94-8c2e31f2fdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:02.543574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ae9d5-5b6d-4435-bd94-8c2e31f2fdd9 admin admin] PATH_INFO: `/v3/users/425a44c5b27b48548f2bc53c330ff144` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:02.545498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ae9d5-5b6d-4435-bd94-8c2e31f2fdd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=425a44c5b27b48548f2bc53c330ff144)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:02.548415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ae9d5-5b6d-4435-bd94-8c2e31f2fdd9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:02.570628 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1347/2649] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:49:02 2021] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:49:02.572036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76f809-6188-43fc-b3f0-9a8c9d067c8a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:02.583453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cb76f809-6188-43fc-b3f0-9a8c9d067c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:02.598234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76f809-6188-43fc-b3f0-9a8c9d067c8a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:02.605827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:02.607005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:02.607363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:02.607742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3 admin admin] PATH_INFO: `/v3/projects/be2f5d36556d48e0bcdb394734abe821` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:02.609096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2f5d36556d48e0bcdb394734abe821)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:02.611254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:02.617558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5f5ae9d5-5b6d-4435-bd94-8c2e31f2fdd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '425a44c5b27b48548f2bc53c330ff144'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.626630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5f5ae9d5-5b6d-4435-bd94-8c2e31f2fdd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '425a44c5b27b48548f2bc53c330ff144'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.641832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5f5ae9d5-5b6d-4435-bd94-8c2e31f2fdd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '425a44c5b27b48548f2bc53c330ff144'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.642676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5f5ae9d5-5b6d-4435-bd94-8c2e31f2fdd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '425a44c5b27b48548f2bc53c330ff144'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.655007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5f5ae9d5-5b6d-4435-bd94-8c2e31f2fdd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '425a44c5b27b48548f2bc53c330ff144'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.664327 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1303/2650] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:02 2021] DELETE /identity/v3/users/425a44c5b27b48548f2bc53c330ff144 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:02.665884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ae9d5-5b6d-4435-bd94-8c2e31f2fdd9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:02.667473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5f5ae9d5-5b6d-4435-bd94-8c2e31f2fdd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:02.683838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2f5d36556d48e0bcdb394734abe821', 'request_id': 'req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.694757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2f5d36556d48e0bcdb394734abe821', 'request_id': 'req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.706566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2f5d36556d48e0bcdb394734abe821', 'request_id': 'req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.726775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3 admin admin] The token cache is being invalidate because project be2f5d36556d48e0bcdb394734abe821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:02.727306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.728668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.731464 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1348/2651] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:02 2021] DELETE /identity/v3/projects/be2f5d36556d48e0bcdb394734abe821 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:02.733166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:02.735544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:02.759958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ae9d5-5b6d-4435-bd94-8c2e31f2fdd9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:02.765578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219bfcd-315a-4028-997c-a8bc80a5a23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:02.766711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219bfcd-315a-4028-997c-a8bc80a5a23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:02.767096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219bfcd-315a-4028-997c-a8bc80a5a23c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:02.767467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219bfcd-315a-4028-997c-a8bc80a5a23c admin admin] PATH_INFO: `/v3/users/015a3244598f429fbe145939f9624206` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:02.769189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219bfcd-315a-4028-997c-a8bc80a5a23c admin admin] RBAC: Authorizing `identity:delete_user(user_id=015a3244598f429fbe145939f9624206)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:02.771235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219bfcd-315a-4028-997c-a8bc80a5a23c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:02.812567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b4e87-c571-45c8-90f8-fe07f3c812a3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:02.818658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7d4fd-b313-4b2f-8778-278eeff4024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:02.819505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d4fd-b313-4b2f-8778-278eeff4024d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:02.819791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d4fd-b313-4b2f-8778-278eeff4024d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:02.820077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d4fd-b313-4b2f-8778-278eeff4024d admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:02.820891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7d4fd-b313-4b2f-8778-278eeff4024d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:02.822898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7d4fd-b313-4b2f-8778-278eeff4024d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:02.827958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4219bfcd-315a-4028-997c-a8bc80a5a23c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '015a3244598f429fbe145939f9624206'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.836707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4219bfcd-315a-4028-997c-a8bc80a5a23c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '015a3244598f429fbe145939f9624206'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.851291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4219bfcd-315a-4028-997c-a8bc80a5a23c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '015a3244598f429fbe145939f9624206'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.852106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4219bfcd-315a-4028-997c-a8bc80a5a23c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '015a3244598f429fbe145939f9624206'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.861847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4219bfcd-315a-4028-997c-a8bc80a5a23c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '015a3244598f429fbe145939f9624206'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:02.864458 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1349/2652] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:49:02 2021] POST /identity/v3/projects => generated 399 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:02.865493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7d4fd-b313-4b2f-8778-278eeff4024d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:02.867426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-13f7d4fd-b313-4b2f-8778-278eeff4024d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:02.874129 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1304/2653] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:02 2021] DELETE /identity/v3/users/015a3244598f429fbe145939f9624206 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:02.874129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc9dc7-ad01-43e7-b678-5597a50b766d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:02.874129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc9dc7-ad01-43e7-b678-5597a50b766d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:02.874129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc9dc7-ad01-43e7-b678-5597a50b766d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:02.896205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9edc9dc7-ad01-43e7-b678-5597a50b766d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:02.898671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9edc9dc7-ad01-43e7-b678-5597a50b766d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:02.953591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7d4fd-b313-4b2f-8778-278eeff4024d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:02.962881 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1305/2654] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:02.963817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc9dc7-ad01-43e7-b678-5597a50b766d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:02.965258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9edc9dc7-ad01-43e7-b678-5597a50b766d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:02.978379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc9dc7-ad01-43e7-b678-5597a50b766d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:02.983971 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae8ba0-cc56-4cb5-b07e-ced29d8c8bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:02.985303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae8ba0-cc56-4cb5-b07e-ced29d8c8bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:02.985633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae8ba0-cc56-4cb5-b07e-ced29d8c8bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:02.989922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae8ba0-cc56-4cb5-b07e-ced29d8c8bc6 admin admin] PATH_INFO: `/v3/users/cd31dbdb8904445faff748e630d01277` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:02.991330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae8ba0-cc56-4cb5-b07e-ced29d8c8bc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd31dbdb8904445faff748e630d01277)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:03.005895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae8ba0-cc56-4cb5-b07e-ced29d8c8bc6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:03.038538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db2971-06b9-42a9-a949-d6db1da7a53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:03.039364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db2971-06b9-42a9-a949-d6db1da7a53e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:03.039665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db2971-06b9-42a9-a949-d6db1da7a53e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:03.039946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db2971-06b9-42a9-a949-d6db1da7a53e admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:03.040707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db2971-06b9-42a9-a949-d6db1da7a53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:03.042771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db2971-06b9-42a9-a949-d6db1da7a53e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:03.062570 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1350/2655] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:02 2021] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:03.063794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db2971-06b9-42a9-a949-d6db1da7a53e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:03.066727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c5db2971-06b9-42a9-a949-d6db1da7a53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:03.072597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-71ae8ba0-cc56-4cb5-b07e-ced29d8c8bc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd31dbdb8904445faff748e630d01277'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:03.082648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-71ae8ba0-cc56-4cb5-b07e-ced29d8c8bc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd31dbdb8904445faff748e630d01277'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:03.084891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db2971-06b9-42a9-a949-d6db1da7a53e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:03.089904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96413b-d490-440b-8f9a-63fd929b0d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:03.090600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96413b-d490-440b-8f9a-63fd929b0d7d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:03.090885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96413b-d490-440b-8f9a-63fd929b0d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:03.091161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96413b-d490-440b-8f9a-63fd929b0d7d admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:03.091913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96413b-d490-440b-8f9a-63fd929b0d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:03.093874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96413b-d490-440b-8f9a-63fd929b0d7d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:03.098130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-71ae8ba0-cc56-4cb5-b07e-ced29d8c8bc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd31dbdb8904445faff748e630d01277'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:03.099052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-71ae8ba0-cc56-4cb5-b07e-ced29d8c8bc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd31dbdb8904445faff748e630d01277'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:03.107740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-71ae8ba0-cc56-4cb5-b07e-ced29d8c8bc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd31dbdb8904445faff748e630d01277'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:03.116415 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1306/2656] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:02 2021] DELETE /identity/v3/users/cd31dbdb8904445faff748e630d01277 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:03.120582 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1351/2657] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:49:03 2021] POST /identity/v3/users => generated 300 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:03.120857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc490342-59a2-4c71-8bba-46e5f63dc72b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:03.121045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96413b-d490-440b-8f9a-63fd929b0d7d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:03.121171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc490342-59a2-4c71-8bba-46e5f63dc72b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:03.121416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc490342-59a2-4c71-8bba-46e5f63dc72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:03.122661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ba96413b-d490-440b-8f9a-63fd929b0d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:03.145407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-bc490342-59a2-4c71-8bba-46e5f63dc72b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:03.146745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bc490342-59a2-4c71-8bba-46e5f63dc72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:03.199572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96413b-d490-440b-8f9a-63fd929b0d7d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:03.242381 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1307/2658] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:03.244895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc490342-59a2-4c71-8bba-46e5f63dc72b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:03.248083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bc490342-59a2-4c71-8bba-46e5f63dc72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:03.273351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc490342-59a2-4c71-8bba-46e5f63dc72b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:03.288326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd93ab-6f47-4b6a-9e47-ba081abb08ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:03.289397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd93ab-6f47-4b6a-9e47-ba081abb08ed admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:03.289964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd93ab-6f47-4b6a-9e47-ba081abb08ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:03.290541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd93ab-6f47-4b6a-9e47-ba081abb08ed admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:03.291518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd93ab-6f47-4b6a-9e47-ba081abb08ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:03.295890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ba529-0a99-4220-a218-ea623d46fba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:03.296692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ba529-0a99-4220-a218-ea623d46fba0 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:03.297234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ba529-0a99-4220-a218-ea623d46fba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:03.297413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ba529-0a99-4220-a218-ea623d46fba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:03.299890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd93ab-6f47-4b6a-9e47-ba081abb08ed admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:03.300369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-456ba529-0a99-4220-a218-ea623d46fba0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:03.315126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ba529-0a99-4220-a218-ea623d46fba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:03.317168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ba529-0a99-4220-a218-ea623d46fba0 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:03.324309 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1308/2659] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:03 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:03.325578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd93ab-6f47-4b6a-9e47-ba081abb08ed admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:03.328948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-97fd93ab-6f47-4b6a-9e47-ba081abb08ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:03.333792 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1352/2660] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:03.334104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ba529-0a99-4220-a218-ea623d46fba0 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:03.345628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ba529-0a99-4220-a218-ea623d46fba0 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:03.349739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca004e26-295b-4a9f-94b6-372ea197a88a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:03.350583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca004e26-295b-4a9f-94b6-372ea197a88a service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:03.350840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd93ab-6f47-4b6a-9e47-ba081abb08ed admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:03.351312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca004e26-295b-4a9f-94b6-372ea197a88a service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:03.351312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca004e26-295b-4a9f-94b6-372ea197a88a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:03.368737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be6369-ba28-4d1d-aa92-4191a2a95a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:03.372654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be6369-ba28-4d1d-aa92-4191a2a95a91 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:03.373356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be6369-ba28-4d1d-aa92-4191a2a95a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:03.373356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be6369-ba28-4d1d-aa92-4191a2a95a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:03.374362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be6369-ba28-4d1d-aa92-4191a2a95a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:03.376468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be6369-ba28-4d1d-aa92-4191a2a95a91 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:03.391957 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1309/2661] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:03 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:03.393888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be6369-ba28-4d1d-aa92-4191a2a95a91 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:03.401692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca004e26-295b-4a9f-94b6-372ea197a88a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:03.403193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca004e26-295b-4a9f-94b6-372ea197a88a service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:03.406941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be6369-ba28-4d1d-aa92-4191a2a95a91 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:03.416550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f1c0c-c753-4d32-9c4b-8f45f03c5445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:03.418230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f1c0c-c753-4d32-9c4b-8f45f03c5445 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:03.418474 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1353/2662] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:03.419254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca004e26-295b-4a9f-94b6-372ea197a88a service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:03.422951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f1c0c-c753-4d32-9c4b-8f45f03c5445 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:03.424275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f1c0c-c753-4d32-9c4b-8f45f03c5445 admin admin] PATH_INFO: `/v3/projects/89a9543eaffc44858c8674e4b6f660cf/users/472035f568124561bde5223c47dd07be/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:03.429970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca004e26-295b-4a9f-94b6-372ea197a88a service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:03.437359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31d1be-ae3b-44ce-b701-45b88d228db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:03.438098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31d1be-ae3b-44ce-b701-45b88d228db1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:03.438505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31d1be-ae3b-44ce-b701-45b88d228db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:03.438883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31d1be-ae3b-44ce-b701-45b88d228db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:03.439645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31d1be-ae3b-44ce-b701-45b88d228db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:03.441937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31d1be-ae3b-44ce-b701-45b88d228db1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:03.454773 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1354/2663] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:03 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:03.460557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31d1be-ae3b-44ce-b701-45b88d228db1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:03.465659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f1c0c-c753-4d32-9c4b-8f45f03c5445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a9543eaffc44858c8674e4b6f660cf, user_id=472035f568124561bde5223c47dd07be, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:03.471911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31d1be-ae3b-44ce-b701-45b88d228db1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:03.474028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f1c0c-c753-4d32-9c4b-8f45f03c5445 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:03.477161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb621c-035d-4242-bb29-ffbc1bbdf319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:03.478037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb621c-035d-4242-bb29-ffbc1bbdf319 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:03.478500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb621c-035d-4242-bb29-ffbc1bbdf319 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:03.478786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb621c-035d-4242-bb29-ffbc1bbdf319 admin admin] PATH_INFO: `/v3/projects/cd3f58b92ce64d08bf7ab736674b66da/users/34ee9e750e1143faaae1e09783fbdcf7/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:03.500765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb621c-035d-4242-bb29-ffbc1bbdf319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3f58b92ce64d08bf7ab736674b66da, user_id=34ee9e750e1143faaae1e09783fbdcf7, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:03.504053 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1310/2664] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:03 2021] PUT /identity/v3/projects/89a9543eaffc44858c8674e4b6f660cf/users/472035f568124561bde5223c47dd07be/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:03.504753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb621c-035d-4242-bb29-ffbc1bbdf319 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:03.518449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378408e8-7ea4-46b9-8fb9-c15debced564 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:03.518449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378408e8-7ea4-46b9-8fb9-c15debced564 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:03.518449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378408e8-7ea4-46b9-8fb9-c15debced564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:03.539937 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1355/2665] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:03 2021] PUT /identity/v3/projects/cd3f58b92ce64d08bf7ab736674b66da/users/34ee9e750e1143faaae1e09783fbdcf7/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:03.544991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84ab2f-9e5c-4c5e-b426-d1dc8e3d28e0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:03.545633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84ab2f-9e5c-4c5e-b426-d1dc8e3d28e0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:03.545766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84ab2f-9e5c-4c5e-b426-d1dc8e3d28e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:03.569953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-378408e8-7ea4-46b9-8fb9-c15debced564 None None] MFA Rules not processed for user `472035f568124561bde5223c47dd07be`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:03.572173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-378408e8-7ea4-46b9-8fb9-c15debced564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:03.576135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3e84ab2f-9e5c-4c5e-b426-d1dc8e3d28e0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:03.578431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3e84ab2f-9e5c-4c5e-b426-d1dc8e3d28e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:03.723227 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1356/2666] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:03.724307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84ab2f-9e5c-4c5e-b426-d1dc8e3d28e0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:03.728296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3e84ab2f-9e5c-4c5e-b426-d1dc8e3d28e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:03.748254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84ab2f-9e5c-4c5e-b426-d1dc8e3d28e0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:03.753402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957577e-9103-4c5f-8f00-1c137ca75a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:03.754314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957577e-9103-4c5f-8f00-1c137ca75a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:03.754719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957577e-9103-4c5f-8f00-1c137ca75a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:03.754870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957577e-9103-4c5f-8f00-1c137ca75a72 admin admin] PATH_INFO: `/v3/projects/b334131191924300ac60041ae609e0ec` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:03.756055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957577e-9103-4c5f-8f00-1c137ca75a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b334131191924300ac60041ae609e0ec)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:03.757926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957577e-9103-4c5f-8f00-1c137ca75a72 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:03.769699 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1311/2667] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:03 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:03.770891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378408e8-7ea4-46b9-8fb9-c15debced564 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:03.772346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-378408e8-7ea4-46b9-8fb9-c15debced564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:03.786728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378408e8-7ea4-46b9-8fb9-c15debced564 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:03.792291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d3401-7421-4c8c-ad44-6891e2d59667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:03.793280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d3401-7421-4c8c-ad44-6891e2d59667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:03.793579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d3401-7421-4c8c-ad44-6891e2d59667 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:03.793858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d3401-7421-4c8c-ad44-6891e2d59667 admin admin] PATH_INFO: `/v3/projects/1b7d2d4460044fee8f0b5dea668a3788` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:03.795129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d3401-7421-4c8c-ad44-6891e2d59667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b7d2d4460044fee8f0b5dea668a3788)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:03.797053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d3401-7421-4c8c-ad44-6891e2d59667 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:03.807766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c957577e-9103-4c5f-8f00-1c137ca75a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b334131191924300ac60041ae609e0ec', 'request_id': 'req-c957577e-9103-4c5f-8f00-1c137ca75a72'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:03.813954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c957577e-9103-4c5f-8f00-1c137ca75a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b334131191924300ac60041ae609e0ec', 'request_id': 'req-c957577e-9103-4c5f-8f00-1c137ca75a72'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:03.821117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c957577e-9103-4c5f-8f00-1c137ca75a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b334131191924300ac60041ae609e0ec', 'request_id': 'req-c957577e-9103-4c5f-8f00-1c137ca75a72'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:03.831850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c957577e-9103-4c5f-8f00-1c137ca75a72 admin admin] The token cache is being invalidate because project b334131191924300ac60041ae609e0ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:03.832137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c957577e-9103-4c5f-8f00-1c137ca75a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:03.832771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c957577e-9103-4c5f-8f00-1c137ca75a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:03.834588 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1357/2668] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:03 2021] DELETE /identity/v3/projects/b334131191924300ac60041ae609e0ec => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:03.839196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957577e-9103-4c5f-8f00-1c137ca75a72 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:03.840563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c957577e-9103-4c5f-8f00-1c137ca75a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:03.843988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-255d3401-7421-4c8c-ad44-6891e2d59667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b7d2d4460044fee8f0b5dea668a3788', 'request_id': 'req-255d3401-7421-4c8c-ad44-6891e2d59667'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:03.850671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-255d3401-7421-4c8c-ad44-6891e2d59667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b7d2d4460044fee8f0b5dea668a3788', 'request_id': 'req-255d3401-7421-4c8c-ad44-6891e2d59667'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:03.856101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-255d3401-7421-4c8c-ad44-6891e2d59667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b7d2d4460044fee8f0b5dea668a3788', 'request_id': 'req-255d3401-7421-4c8c-ad44-6891e2d59667'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:03.868021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-255d3401-7421-4c8c-ad44-6891e2d59667 admin admin] The token cache is being invalidate because project 1b7d2d4460044fee8f0b5dea668a3788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:03.868312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-255d3401-7421-4c8c-ad44-6891e2d59667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:03.868946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-255d3401-7421-4c8c-ad44-6891e2d59667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:03.870524 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1312/2669] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:03 2021] DELETE /identity/v3/projects/1b7d2d4460044fee8f0b5dea668a3788 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:03.871410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d3401-7421-4c8c-ad44-6891e2d59667 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:03.872699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-255d3401-7421-4c8c-ad44-6891e2d59667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:03.903513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957577e-9103-4c5f-8f00-1c137ca75a72 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:03.929288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d3401-7421-4c8c-ad44-6891e2d59667 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:03.932932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe728cf7-acc6-4d24-97ee-772a6f961bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:03.933571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe728cf7-acc6-4d24-97ee-772a6f961bcf service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:03.933854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe728cf7-acc6-4d24-97ee-772a6f961bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:03.934129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe728cf7-acc6-4d24-97ee-772a6f961bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:03.936231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fe728cf7-acc6-4d24-97ee-772a6f961bcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:03.958148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e437a-88c7-4256-b726-9287c6979e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:03.959036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e437a-88c7-4256-b726-9287c6979e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:03.959319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e437a-88c7-4256-b726-9287c6979e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:03.959597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e437a-88c7-4256-b726-9287c6979e9c admin admin] PATH_INFO: `/v3/projects/2e459a051d234475b150b36857974efb` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:03.960790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e437a-88c7-4256-b726-9287c6979e9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e459a051d234475b150b36857974efb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:03.962721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e437a-88c7-4256-b726-9287c6979e9c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:03.998403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe728cf7-acc6-4d24-97ee-772a6f961bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:03.999780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe728cf7-acc6-4d24-97ee-772a6f961bcf service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:04.008112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5b8e437a-88c7-4256-b726-9287c6979e9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e459a051d234475b150b36857974efb', 'request_id': 'req-5b8e437a-88c7-4256-b726-9287c6979e9c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:04.009388 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1313/2670] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:04.010691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e912959-abc4-4434-9286-c6090dba6e54 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:04.010956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e912959-abc4-4434-9286-c6090dba6e54 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:04.011231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e912959-abc4-4434-9286-c6090dba6e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:04.014099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5b8e437a-88c7-4256-b726-9287c6979e9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e459a051d234475b150b36857974efb', 'request_id': 'req-5b8e437a-88c7-4256-b726-9287c6979e9c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:04.023095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5b8e437a-88c7-4256-b726-9287c6979e9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e459a051d234475b150b36857974efb', 'request_id': 'req-5b8e437a-88c7-4256-b726-9287c6979e9c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:04.029604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9e912959-abc4-4434-9286-c6090dba6e54 None None] MFA Rules not processed for user `472035f568124561bde5223c47dd07be`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:04.031052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9e912959-abc4-4434-9286-c6090dba6e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:04.041643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5b8e437a-88c7-4256-b726-9287c6979e9c admin admin] The token cache is being invalidate because project 2e459a051d234475b150b36857974efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:04.042372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5b8e437a-88c7-4256-b726-9287c6979e9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:04.042610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5b8e437a-88c7-4256-b726-9287c6979e9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:04.047061 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1358/2671] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:03 2021] DELETE /identity/v3/projects/2e459a051d234475b150b36857974efb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:04.047061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702e131-3deb-4c34-b094-3f7ddaa680e3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:04.047061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702e131-3deb-4c34-b094-3f7ddaa680e3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:04.047061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702e131-3deb-4c34-b094-3f7ddaa680e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:04.066756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4702e131-3deb-4c34-b094-3f7ddaa680e3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:04.068299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4702e131-3deb-4c34-b094-3f7ddaa680e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:04.098589 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1314/2672] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:04 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:04.099704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e912959-abc4-4434-9286-c6090dba6e54 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:04.101104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9e912959-abc4-4434-9286-c6090dba6e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:04.142571 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1359/2673] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:04.144040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702e131-3deb-4c34-b094-3f7ddaa680e3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:04.150342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4702e131-3deb-4c34-b094-3f7ddaa680e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:04.164716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702e131-3deb-4c34-b094-3f7ddaa680e3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:04.171439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60a0d6-6ca7-42f4-a9c9-64066e409d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:04.172424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60a0d6-6ca7-42f4-a9c9-64066e409d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:04.172707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60a0d6-6ca7-42f4-a9c9-64066e409d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:04.173042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60a0d6-6ca7-42f4-a9c9-64066e409d7c admin admin] PATH_INFO: `/v3/users/2192096144f54d239339bfa8a5e5da02` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:04.174335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60a0d6-6ca7-42f4-a9c9-64066e409d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2192096144f54d239339bfa8a5e5da02)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:04.176290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60a0d6-6ca7-42f4-a9c9-64066e409d7c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:04.206412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e912959-abc4-4434-9286-c6090dba6e54 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:04.213350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adce3e-99ae-47b6-8fb2-a87b6a71f802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:04.218725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adce3e-99ae-47b6-8fb2-a87b6a71f802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:04.219038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adce3e-99ae-47b6-8fb2-a87b6a71f802 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:04.219327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adce3e-99ae-47b6-8fb2-a87b6a71f802 admin admin] PATH_INFO: `/v3/users/3ce5454d0f0344c9975bbd356528975b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:04.220860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adce3e-99ae-47b6-8fb2-a87b6a71f802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce5454d0f0344c9975bbd356528975b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:04.223376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adce3e-99ae-47b6-8fb2-a87b6a71f802 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:04.235843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ee60a0d6-6ca7-42f4-a9c9-64066e409d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2192096144f54d239339bfa8a5e5da02'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:04.244438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ee60a0d6-6ca7-42f4-a9c9-64066e409d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2192096144f54d239339bfa8a5e5da02'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:04.245200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ee60a0d6-6ca7-42f4-a9c9-64066e409d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2192096144f54d239339bfa8a5e5da02'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:04.259927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ee60a0d6-6ca7-42f4-a9c9-64066e409d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2192096144f54d239339bfa8a5e5da02'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:04.268205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ee60a0d6-6ca7-42f4-a9c9-64066e409d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2192096144f54d239339bfa8a5e5da02'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:04.275807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-01adce3e-99ae-47b6-8fb2-a87b6a71f802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce5454d0f0344c9975bbd356528975b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:04.280532 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1360/2674] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:04 2021] DELETE /identity/v3/users/2192096144f54d239339bfa8a5e5da02 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:04.280532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60a0d6-6ca7-42f4-a9c9-64066e409d7c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:04.282469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ee60a0d6-6ca7-42f4-a9c9-64066e409d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:04.322277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-01adce3e-99ae-47b6-8fb2-a87b6a71f802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce5454d0f0344c9975bbd356528975b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:04.383455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-01adce3e-99ae-47b6-8fb2-a87b6a71f802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce5454d0f0344c9975bbd356528975b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:04.385564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60a0d6-6ca7-42f4-a9c9-64066e409d7c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:04.390858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-01adce3e-99ae-47b6-8fb2-a87b6a71f802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce5454d0f0344c9975bbd356528975b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:04.392166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1da44-1e1b-4717-9cbe-b111a09a150e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:04.394883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1da44-1e1b-4717-9cbe-b111a09a150e service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:04.395260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1da44-1e1b-4717-9cbe-b111a09a150e service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:04.395637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1da44-1e1b-4717-9cbe-b111a09a150e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:04.397780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bfc1da44-1e1b-4717-9cbe-b111a09a150e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:04.415506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-01adce3e-99ae-47b6-8fb2-a87b6a71f802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce5454d0f0344c9975bbd356528975b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:04.430309 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1315/2675] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:04 2021] DELETE /identity/v3/users/3ce5454d0f0344c9975bbd356528975b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:04.433719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5619c-6b6f-4ed6-9cd7-87d994b8cd4d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:04.433719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5619c-6b6f-4ed6-9cd7-87d994b8cd4d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:04.433719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5619c-6b6f-4ed6-9cd7-87d994b8cd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:04.483687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2eb5619c-6b6f-4ed6-9cd7-87d994b8cd4d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:04.487806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2eb5619c-6b6f-4ed6-9cd7-87d994b8cd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:04.489742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1da44-1e1b-4717-9cbe-b111a09a150e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:04.491749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1da44-1e1b-4717-9cbe-b111a09a150e service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:04.506032 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1361/2676] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:04 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:04.629624 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1316/2677] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:04.633718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1da44-1e1b-4717-9cbe-b111a09a150e service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:04.635502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bfc1da44-1e1b-4717-9cbe-b111a09a150e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:04.766804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1da44-1e1b-4717-9cbe-b111a09a150e service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:04.772427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57414da-7ddd-40d9-a5ba-ccc34aa24ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:04.773044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57414da-7ddd-40d9-a5ba-ccc34aa24ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:04.773339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57414da-7ddd-40d9-a5ba-ccc34aa24ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:04.773575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57414da-7ddd-40d9-a5ba-ccc34aa24ed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:04.774352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57414da-7ddd-40d9-a5ba-ccc34aa24ed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:49:04.774662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57414da-7ddd-40d9-a5ba-ccc34aa24ed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:04.776255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57414da-7ddd-40d9-a5ba-ccc34aa24ed8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:04.791112 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1362/2678] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:49:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:49:04.795233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5619c-6b6f-4ed6-9cd7-87d994b8cd4d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:04.807701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5619c-6b6f-4ed6-9cd7-87d994b8cd4d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:04.821955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed856e-dc00-45e0-925c-31dd07cd8738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:04.823088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed856e-dc00-45e0-925c-31dd07cd8738 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:04.823518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed856e-dc00-45e0-925c-31dd07cd8738 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:04.823980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed856e-dc00-45e0-925c-31dd07cd8738 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:04.824964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed856e-dc00-45e0-925c-31dd07cd8738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:04.826986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed856e-dc00-45e0-925c-31dd07cd8738 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:04.859630 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1317/2679] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:49:04 2021] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:04.864992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57414da-7ddd-40d9-a5ba-ccc34aa24ed8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:04.894780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57414da-7ddd-40d9-a5ba-ccc34aa24ed8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:05.045894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93221a8d-0ee2-49aa-8ce6-b48d4b2ef357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:05.046831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93221a8d-0ee2-49aa-8ce6-b48d4b2ef357 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:05.047192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93221a8d-0ee2-49aa-8ce6-b48d4b2ef357 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:05.047542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93221a8d-0ee2-49aa-8ce6-b48d4b2ef357 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:05.048501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93221a8d-0ee2-49aa-8ce6-b48d4b2ef357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:05.050525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93221a8d-0ee2-49aa-8ce6-b48d4b2ef357 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:05.084395 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1363/2680] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:49:04 2021] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:05.088708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed856e-dc00-45e0-925c-31dd07cd8738 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:05.102622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed856e-dc00-45e0-925c-31dd07cd8738 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:05.111410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d7ac6-765e-4907-a820-b0e383421c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:05.113293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7ac6-765e-4907-a820-b0e383421c72 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:05.113763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7ac6-765e-4907-a820-b0e383421c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:05.114222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7ac6-765e-4907-a820-b0e383421c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:05.115400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d7ac6-765e-4907-a820-b0e383421c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:05.118056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d7ac6-765e-4907-a820-b0e383421c72 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:05.143320 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1318/2681] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:05 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:49:05.160278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93221a8d-0ee2-49aa-8ce6-b48d4b2ef357 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:05.162764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93221a8d-0ee2-49aa-8ce6-b48d4b2ef357 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:05.169388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46ad10-ec41-4200-8518-2a01fc61bb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:05.170113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46ad10-ec41-4200-8518-2a01fc61bb36 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:05.170605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46ad10-ec41-4200-8518-2a01fc61bb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:05.171009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46ad10-ec41-4200-8518-2a01fc61bb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:05.172909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46ad10-ec41-4200-8518-2a01fc61bb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:05.175709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46ad10-ec41-4200-8518-2a01fc61bb36 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:05.197817 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1364/2682] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:05 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:05.202880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d7ac6-765e-4907-a820-b0e383421c72 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:05.215283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46ad10-ec41-4200-8518-2a01fc61bb36 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:05.223091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cf46ad10-ec41-4200-8518-2a01fc61bb36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:05.230275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d7ac6-765e-4907-a820-b0e383421c72 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:05.244160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9ec08-986d-48f5-b280-d5e9ebce03d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:05.245973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9ec08-986d-48f5-b280-d5e9ebce03d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:05.246321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9ec08-986d-48f5-b280-d5e9ebce03d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:05.248541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9ec08-986d-48f5-b280-d5e9ebce03d4 admin admin] PATH_INFO: `/v3/projects/29a831462611445ebb7256a4c8b657a0/users/ea2400b9f82c494584a5226d1d74177e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:05.260228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46ad10-ec41-4200-8518-2a01fc61bb36 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:05.265760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b08cf9-2b75-4cba-9567-35668036bbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:05.267424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b08cf9-2b75-4cba-9567-35668036bbbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:05.268163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b08cf9-2b75-4cba-9567-35668036bbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:05.269260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b08cf9-2b75-4cba-9567-35668036bbbe admin admin] PATH_INFO: `/v3/projects/7423f37443734a178d77b89d719de8b9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:05.271439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b08cf9-2b75-4cba-9567-35668036bbbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7423f37443734a178d77b89d719de8b9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:05.273982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b08cf9-2b75-4cba-9567-35668036bbbe admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:05.292285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9ec08-986d-48f5-b280-d5e9ebce03d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a831462611445ebb7256a4c8b657a0, user_id=ea2400b9f82c494584a5226d1d74177e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:05.296420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9ec08-986d-48f5-b280-d5e9ebce03d4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:05.334059 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1319/2683] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:05 2021] PUT /identity/v3/projects/29a831462611445ebb7256a4c8b657a0/users/ea2400b9f82c494584a5226d1d74177e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:05.334982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9ec08-986d-48f5-b280-d5e9ebce03d4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:05.337089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c9b9ec08-986d-48f5-b280-d5e9ebce03d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:05.392846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8b08cf9-2b75-4cba-9567-35668036bbbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7423f37443734a178d77b89d719de8b9', 'request_id': 'req-d8b08cf9-2b75-4cba-9567-35668036bbbe'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:05.400524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8b08cf9-2b75-4cba-9567-35668036bbbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7423f37443734a178d77b89d719de8b9', 'request_id': 'req-d8b08cf9-2b75-4cba-9567-35668036bbbe'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:05.427078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8b08cf9-2b75-4cba-9567-35668036bbbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7423f37443734a178d77b89d719de8b9', 'request_id': 'req-d8b08cf9-2b75-4cba-9567-35668036bbbe'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:05.471248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9ec08-986d-48f5-b280-d5e9ebce03d4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:05.476037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8b08cf9-2b75-4cba-9567-35668036bbbe admin admin] The token cache is being invalidate because project 7423f37443734a178d77b89d719de8b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:05.476322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8b08cf9-2b75-4cba-9567-35668036bbbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:05.477912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8b08cf9-2b75-4cba-9567-35668036bbbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:05.487765 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1365/2684] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:05 2021] DELETE /identity/v3/projects/7423f37443734a178d77b89d719de8b9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:05.490841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e739-e761-424c-8165-93ca803bd335 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:05.492679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e739-e761-424c-8165-93ca803bd335 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:05.492679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e739-e761-424c-8165-93ca803bd335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:05.535447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c0b9e739-e761-424c-8165-93ca803bd335 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:05.542319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c0b9e739-e761-424c-8165-93ca803bd335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:05.608667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b210c6-64e6-4803-bf55-a9ef73531adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:05.609845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b210c6-64e6-4803-bf55-a9ef73531adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:05.610369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b210c6-64e6-4803-bf55-a9ef73531adb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:05.610857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b210c6-64e6-4803-bf55-a9ef73531adb admin admin] PATH_INFO: `/v3/projects/7f9e14a39f70463c85748b537a594898` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:05.614836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b210c6-64e6-4803-bf55-a9ef73531adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9e14a39f70463c85748b537a594898)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:05.617301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b210c6-64e6-4803-bf55-a9ef73531adb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:05.700258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45b210c6-64e6-4803-bf55-a9ef73531adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9e14a39f70463c85748b537a594898', 'request_id': 'req-45b210c6-64e6-4803-bf55-a9ef73531adb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:05.705776 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1366/2685] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:05.713318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05d438-2cf7-45c1-8094-4d0f2a94937f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:05.713875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05d438-2cf7-45c1-8094-4d0f2a94937f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:05.715652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05d438-2cf7-45c1-8094-4d0f2a94937f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:05.725067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45b210c6-64e6-4803-bf55-a9ef73531adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9e14a39f70463c85748b537a594898', 'request_id': 'req-45b210c6-64e6-4803-bf55-a9ef73531adb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:05.739677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45b210c6-64e6-4803-bf55-a9ef73531adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9e14a39f70463c85748b537a594898', 'request_id': 'req-45b210c6-64e6-4803-bf55-a9ef73531adb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:05.769997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45b210c6-64e6-4803-bf55-a9ef73531adb admin admin] The token cache is being invalidate because project 7f9e14a39f70463c85748b537a594898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:05.770696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-de05d438-2cf7-45c1-8094-4d0f2a94937f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:05.772071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-de05d438-2cf7-45c1-8094-4d0f2a94937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:05.772469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45b210c6-64e6-4803-bf55-a9ef73531adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:05.774009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45b210c6-64e6-4803-bf55-a9ef73531adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:05.781904 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1320/2686] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:05 2021] DELETE /identity/v3/projects/7f9e14a39f70463c85748b537a594898 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:05.784854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b210c6-64e6-4803-bf55-a9ef73531adb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:05.790772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-45b210c6-64e6-4803-bf55-a9ef73531adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:05.894204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b210c6-64e6-4803-bf55-a9ef73531adb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:05.901885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e67dee-3f2b-4c2b-9491-dcc9c333f371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:05.903815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e67dee-3f2b-4c2b-9491-dcc9c333f371 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:05.904502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e67dee-3f2b-4c2b-9491-dcc9c333f371 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:05.905492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e67dee-3f2b-4c2b-9491-dcc9c333f371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:05.909564 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1367/2687] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:05.910536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-82e67dee-3f2b-4c2b-9491-dcc9c333f371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:05.913399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e7ec7-c72f-4a48-8dad-ec2de56464f1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:05.914510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e7ec7-c72f-4a48-8dad-ec2de56464f1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:05.915499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e7ec7-c72f-4a48-8dad-ec2de56464f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:05.937152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e67dee-3f2b-4c2b-9491-dcc9c333f371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:05.940980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e67dee-3f2b-4c2b-9491-dcc9c333f371 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:05.958114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2d0e7ec7-c72f-4a48-8dad-ec2de56464f1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:05.961724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2d0e7ec7-c72f-4a48-8dad-ec2de56464f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:05.967034 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1321/2688] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:05.968441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9f259-7bc2-4b52-bfc9-d19ea8701360 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:05.968903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9f259-7bc2-4b52-bfc9-d19ea8701360 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:05.969930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9f259-7bc2-4b52-bfc9-d19ea8701360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:05.990074 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1368/2689] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:05.991665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a288114-a650-4a17-828e-00f5e4dcbb9f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:05.992953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a288114-a650-4a17-828e-00f5e4dcbb9f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:05.994243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a288114-a650-4a17-828e-00f5e4dcbb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:06.050672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a2e9f259-7bc2-4b52-bfc9-d19ea8701360 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:06.059357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a2e9f259-7bc2-4b52-bfc9-d19ea8701360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:06.097884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3a288114-a650-4a17-828e-00f5e4dcbb9f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:06.102768 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1322/2690] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:06.103199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3a288114-a650-4a17-828e-00f5e4dcbb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:06.107525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9f259-7bc2-4b52-bfc9-d19ea8701360 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:06.152830 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1369/2691] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:06.156507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9f259-7bc2-4b52-bfc9-d19ea8701360 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:06.159163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a288114-a650-4a17-828e-00f5e4dcbb9f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:06.178574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc106f14-1878-4735-86c4-db56d6a979f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:06.182581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc106f14-1878-4735-86c4-db56d6a979f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:06.184137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc106f14-1878-4735-86c4-db56d6a979f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:06.184898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc106f14-1878-4735-86c4-db56d6a979f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:06.188012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc106f14-1878-4735-86c4-db56d6a979f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:49:06.188969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc106f14-1878-4735-86c4-db56d6a979f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:06.194624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc106f14-1878-4735-86c4-db56d6a979f8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:06.195383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a288114-a650-4a17-828e-00f5e4dcbb9f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:06.210547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdedf36-81c1-49c8-b482-d120da8297da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:06.212141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdedf36-81c1-49c8-b482-d120da8297da admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:06.214399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdedf36-81c1-49c8-b482-d120da8297da admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:06.215841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdedf36-81c1-49c8-b482-d120da8297da admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:06.216824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdedf36-81c1-49c8-b482-d120da8297da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:49:06.218394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdedf36-81c1-49c8-b482-d120da8297da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:06.222575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdedf36-81c1-49c8-b482-d120da8297da admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:06.240843 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1370/2692] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:49:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:49:06.245921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdedf36-81c1-49c8-b482-d120da8297da admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:06.251700 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1323/2693] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:49:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:49:06.253268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc106f14-1878-4735-86c4-db56d6a979f8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:06.267414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdedf36-81c1-49c8-b482-d120da8297da admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:06.277651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc106f14-1878-4735-86c4-db56d6a979f8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:06.282322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216a0c4-1362-4fde-9e7a-26602232ccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:06.283463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216a0c4-1362-4fde-9e7a-26602232ccd8 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:06.283953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216a0c4-1362-4fde-9e7a-26602232ccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:06.284592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216a0c4-1362-4fde-9e7a-26602232ccd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:06.285745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216a0c4-1362-4fde-9e7a-26602232ccd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:06.290513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216a0c4-1362-4fde-9e7a-26602232ccd8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:06.291439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7b821-eb05-4ed7-aa95-99ca0cf12c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:06.292271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7b821-eb05-4ed7-aa95-99ca0cf12c04 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:06.292705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7b821-eb05-4ed7-aa95-99ca0cf12c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:06.293074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7b821-eb05-4ed7-aa95-99ca0cf12c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:06.294997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7b821-eb05-4ed7-aa95-99ca0cf12c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:06.298358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7b821-eb05-4ed7-aa95-99ca0cf12c04 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:06.333129 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1371/2694] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:49:06 2021] POST /identity/v3/projects => generated 381 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:06.337233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216a0c4-1362-4fde-9e7a-26602232ccd8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:06.394657 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1324/2695] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:49:06 2021] POST /identity/v3/projects => generated 361 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:06.399410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7b821-eb05-4ed7-aa95-99ca0cf12c04 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:06.476658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216a0c4-1362-4fde-9e7a-26602232ccd8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:06.552314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468b6cc-0701-4a91-a625-7df1393890c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:06.553110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468b6cc-0701-4a91-a625-7df1393890c7 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:06.553845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468b6cc-0701-4a91-a625-7df1393890c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:06.554386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468b6cc-0701-4a91-a625-7df1393890c7 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:06.557134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468b6cc-0701-4a91-a625-7df1393890c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:06.561117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468b6cc-0701-4a91-a625-7df1393890c7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:06.570117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7b821-eb05-4ed7-aa95-99ca0cf12c04 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:06.585727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548cb2a-0fc1-4f0e-aafd-65dc62ecb594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:06.587404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548cb2a-0fc1-4f0e-aafd-65dc62ecb594 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:06.597621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548cb2a-0fc1-4f0e-aafd-65dc62ecb594 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:06.597621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548cb2a-0fc1-4f0e-aafd-65dc62ecb594 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:06.597621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548cb2a-0fc1-4f0e-aafd-65dc62ecb594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:06.615735 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1372/2696] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:49:06 2021] POST /identity/v3/users => generated 291 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:06.617803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548cb2a-0fc1-4f0e-aafd-65dc62ecb594 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:06.620031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468b6cc-0701-4a91-a625-7df1393890c7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:06.638929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468b6cc-0701-4a91-a625-7df1393890c7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:06.661425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb2986-912c-4d88-a8d9-ee9dd5ec236f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:06.662109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb2986-912c-4d88-a8d9-ee9dd5ec236f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:06.662437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb2986-912c-4d88-a8d9-ee9dd5ec236f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:06.662890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb2986-912c-4d88-a8d9-ee9dd5ec236f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:06.663560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb2986-912c-4d88-a8d9-ee9dd5ec236f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:06.668297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb2986-912c-4d88-a8d9-ee9dd5ec236f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:06.687303 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1325/2697] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:49:06 2021] POST /identity/v3/users => generated 281 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:06.700122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548cb2a-0fc1-4f0e-aafd-65dc62ecb594 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:06.710885 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1373/2698] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:06 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:49:06.721215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548cb2a-0fc1-4f0e-aafd-65dc62ecb594 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:06.722333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb2986-912c-4d88-a8d9-ee9dd5ec236f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:06.740222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9ca58-83f2-4c77-93e2-a99251981aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:06.741091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ca58-83f2-4c77-93e2-a99251981aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:06.741449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ca58-83f2-4c77-93e2-a99251981aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:06.741762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ca58-83f2-4c77-93e2-a99251981aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:06.742821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9ca58-83f2-4c77-93e2-a99251981aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:06.744683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9ca58-83f2-4c77-93e2-a99251981aa0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:06.758737 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1326/2699] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:06 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:49:06.774978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9ca58-83f2-4c77-93e2-a99251981aa0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:06.785189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb2986-912c-4d88-a8d9-ee9dd5ec236f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:06.794964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8c772-fb92-496d-963c-7c4e0b9f138c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:06.797719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8c772-fb92-496d-963c-7c4e0b9f138c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:06.798009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8c772-fb92-496d-963c-7c4e0b9f138c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:06.798442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8c772-fb92-496d-963c-7c4e0b9f138c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:06.800116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8c772-fb92-496d-963c-7c4e0b9f138c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:06.801973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8c772-fb92-496d-963c-7c4e0b9f138c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:06.819584 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1374/2700] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:06 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:06.821400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8c772-fb92-496d-963c-7c4e0b9f138c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:06.824502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9ca58-83f2-4c77-93e2-a99251981aa0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:06.851469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8c772-fb92-496d-963c-7c4e0b9f138c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:06.854300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fbdc2-d0ad-423f-bdbc-96a263bcbc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:06.855595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fbdc2-d0ad-423f-bdbc-96a263bcbc08 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:06.856097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fbdc2-d0ad-423f-bdbc-96a263bcbc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:06.856575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fbdc2-d0ad-423f-bdbc-96a263bcbc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:06.857516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fbdc2-d0ad-423f-bdbc-96a263bcbc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:06.859375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fbdc2-d0ad-423f-bdbc-96a263bcbc08 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:06.868336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b4cce-02d7-4d2a-a74e-754ddf9477e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:06.869906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b4cce-02d7-4d2a-a74e-754ddf9477e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:06.870195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b4cce-02d7-4d2a-a74e-754ddf9477e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:06.870503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b4cce-02d7-4d2a-a74e-754ddf9477e1 admin admin] PATH_INFO: `/v3/projects/9ce640720b084b84a86f590d354dad25/users/231f078b4f4e4fdc9dcf0c6248f17551/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:06.882330 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1327/2701] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:06 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:06.886638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fbdc2-d0ad-423f-bdbc-96a263bcbc08 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:06.899912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fbdc2-d0ad-423f-bdbc-96a263bcbc08 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:06.905653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff4763-61fc-401d-9f32-87b7aa5169d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:06.907018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff4763-61fc-401d-9f32-87b7aa5169d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:06.907535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff4763-61fc-401d-9f32-87b7aa5169d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:06.908150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff4763-61fc-401d-9f32-87b7aa5169d3 admin admin] PATH_INFO: `/v3/projects/756fe344de8d4bbeaa9cfa6236f16a7e/users/42e170a419ef4e1992942c7c44194500/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:06.911361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b4cce-02d7-4d2a-a74e-754ddf9477e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce640720b084b84a86f590d354dad25, user_id=231f078b4f4e4fdc9dcf0c6248f17551, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:06.914190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b4cce-02d7-4d2a-a74e-754ddf9477e1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:06.933651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff4763-61fc-401d-9f32-87b7aa5169d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756fe344de8d4bbeaa9cfa6236f16a7e, user_id=42e170a419ef4e1992942c7c44194500, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:06.934203 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1375/2702] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:06 2021] PUT /identity/v3/projects/9ce640720b084b84a86f590d354dad25/users/231f078b4f4e4fdc9dcf0c6248f17551/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:06.947724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff4763-61fc-401d-9f32-87b7aa5169d3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:06.947978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b376d61-1608-4487-8755-c92211dc4881 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:06.948252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b376d61-1608-4487-8755-c92211dc4881 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:06.948606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b376d61-1608-4487-8755-c92211dc4881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:06.987052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9b376d61-1608-4487-8755-c92211dc4881 None None] MFA Rules not processed for user `231f078b4f4e4fdc9dcf0c6248f17551`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:06.989118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9b376d61-1608-4487-8755-c92211dc4881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:07.001557 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1328/2703] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:06 2021] PUT /identity/v3/projects/756fe344de8d4bbeaa9cfa6236f16a7e/users/42e170a419ef4e1992942c7c44194500/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:07.010847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9de9b5-ec2d-4c9c-986f-63892c25d9ca None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:07.011186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9de9b5-ec2d-4c9c-986f-63892c25d9ca None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:07.011497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9de9b5-ec2d-4c9c-986f-63892c25d9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:07.081170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0b9de9b5-ec2d-4c9c-986f-63892c25d9ca None None] MFA Rules not processed for user `42e170a419ef4e1992942c7c44194500`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:07.085383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0b9de9b5-ec2d-4c9c-986f-63892c25d9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:07.088291 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1376/2704] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:06 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:07.092809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b376d61-1608-4487-8755-c92211dc4881 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:07.235845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b376d61-1608-4487-8755-c92211dc4881 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:07.241016 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1329/2705] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:07 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:07.253490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a89425-d776-4b72-ab1d-6963304e33ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:07.254717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a89425-d776-4b72-ab1d-6963304e33ec admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:07.255770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a89425-d776-4b72-ab1d-6963304e33ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:07.256430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a89425-d776-4b72-ab1d-6963304e33ec admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:07.257768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a89425-d776-4b72-ab1d-6963304e33ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:07.259914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a89425-d776-4b72-ab1d-6963304e33ec admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:07.298148 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1377/2706] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:49:07 2021] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:49:07.316525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9de9b5-ec2d-4c9c-986f-63892c25d9ca None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:07.323600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a89425-d776-4b72-ab1d-6963304e33ec admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:07.325311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e2a89425-d776-4b72-ab1d-6963304e33ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:07.342329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9de9b5-ec2d-4c9c-986f-63892c25d9ca None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:07.454580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bcd1b-394a-49c4-a13b-23f8fbf5b282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:07.456943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bcd1b-394a-49c4-a13b-23f8fbf5b282 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:07.457242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bcd1b-394a-49c4-a13b-23f8fbf5b282 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:07.457535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bcd1b-394a-49c4-a13b-23f8fbf5b282 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:07.459853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bcd1b-394a-49c4-a13b-23f8fbf5b282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:07.461822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bcd1b-394a-49c4-a13b-23f8fbf5b282 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:07.507908 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1330/2707] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:49:07 2021] POST /identity/v3/users => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:07.512075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bcd1b-394a-49c4-a13b-23f8fbf5b282 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:07.518539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a89425-d776-4b72-ab1d-6963304e33ec admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:07.525345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bcd1b-394a-49c4-a13b-23f8fbf5b282 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:07.533319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a0cc6-1cec-4f3c-b66f-3e1f680e4575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:07.534995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a0cc6-1cec-4f3c-b66f-3e1f680e4575 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:07.535515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a0cc6-1cec-4f3c-b66f-3e1f680e4575 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:07.536259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a0cc6-1cec-4f3c-b66f-3e1f680e4575 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:07.537347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a0cc6-1cec-4f3c-b66f-3e1f680e4575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:07.539575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a0cc6-1cec-4f3c-b66f-3e1f680e4575 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:07.548897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0971a6-011c-41b9-bcf9-91b5002c6ee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:07.550315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0971a6-011c-41b9-bcf9-91b5002c6ee2 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:07.550918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0971a6-011c-41b9-bcf9-91b5002c6ee2 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:07.551056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0971a6-011c-41b9-bcf9-91b5002c6ee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:07.559924 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1331/2708] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:07 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:07.561571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a0cc6-1cec-4f3c-b66f-3e1f680e4575 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:07.572786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a0cc6-1cec-4f3c-b66f-3e1f680e4575 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:07.580551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fcb26-0fa2-4284-b6bd-0201378e9928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:07.581738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fcb26-0fa2-4284-b6bd-0201378e9928 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:07.582799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fcb26-0fa2-4284-b6bd-0201378e9928 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:07.583256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fcb26-0fa2-4284-b6bd-0201378e9928 admin admin] PATH_INFO: `/v3/projects/787c898fed2d4859aa691909910bd6a8/users/44fc09c26148424b807bd6e3ff4f6e92/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:07.602339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15fcb26-0fa2-4284-b6bd-0201378e9928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=787c898fed2d4859aa691909910bd6a8, user_id=44fc09c26148424b807bd6e3ff4f6e92, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:07.605205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15fcb26-0fa2-4284-b6bd-0201378e9928 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:07.631263 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1332/2709] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:07 2021] PUT /identity/v3/projects/787c898fed2d4859aa691909910bd6a8/users/44fc09c26148424b807bd6e3ff4f6e92/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:07.632554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fcb26-0fa2-4284-b6bd-0201378e9928 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:07.663650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0971a6-011c-41b9-bcf9-91b5002c6ee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:07.664957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0971a6-011c-41b9-bcf9-91b5002c6ee2 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:07.689139 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1378/2710] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:07 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:07.691636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a70da7-66df-498f-8968-2aeb314349e1 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:07.692099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a70da7-66df-498f-8968-2aeb314349e1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:07.692526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a70da7-66df-498f-8968-2aeb314349e1 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:07.695843 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1379/2711] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:49:07 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:49:07.702856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f2431-1c6b-4b43-911d-46e26d4ecef3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:07.703138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f2431-1c6b-4b43-911d-46e26d4ecef3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:07.703415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f2431-1c6b-4b43-911d-46e26d4ecef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:07.754915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d89f2431-1c6b-4b43-911d-46e26d4ecef3 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:07.756121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d89f2431-1c6b-4b43-911d-46e26d4ecef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:07.842968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fcb26-0fa2-4284-b6bd-0201378e9928 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:07.863251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bef53-f7ca-47dc-8f86-12be38c760e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:07.864502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bef53-f7ca-47dc-8f86-12be38c760e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:07.864900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bef53-f7ca-47dc-8f86-12be38c760e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:07.865325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bef53-f7ca-47dc-8f86-12be38c760e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:07.869269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bef53-f7ca-47dc-8f86-12be38c760e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:07.871791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bef53-f7ca-47dc-8f86-12be38c760e2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:07.905113 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1333/2712] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:07 2021] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:07.905846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bef53-f7ca-47dc-8f86-12be38c760e2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:07.909594 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1380/2713] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:49:07 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:07.910816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f2431-1c6b-4b43-911d-46e26d4ecef3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:07.943086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f2431-1c6b-4b43-911d-46e26d4ecef3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:07.947765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bef53-f7ca-47dc-8f86-12be38c760e2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:07.961797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbfeac5-fa9f-4e22-ae7f-45b59cb17d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:07.964511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfeac5-fa9f-4e22-ae7f-45b59cb17d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:07.964812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfeac5-fa9f-4e22-ae7f-45b59cb17d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:07.965097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfeac5-fa9f-4e22-ae7f-45b59cb17d80 admin admin] PATH_INFO: `/v3/users/42e170a419ef4e1992942c7c44194500` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:07.968790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfeac5-fa9f-4e22-ae7f-45b59cb17d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e170a419ef4e1992942c7c44194500)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:07.969620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8f5a6-daca-443b-ba0b-6528519446a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:07.975508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f5a6-daca-443b-ba0b-6528519446a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:07.975719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfeac5-fa9f-4e22-ae7f-45b59cb17d80 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:07.976217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f5a6-daca-443b-ba0b-6528519446a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:07.977532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f5a6-daca-443b-ba0b-6528519446a7 admin admin] PATH_INFO: `/v3/projects/787c898fed2d4859aa691909910bd6a8/users/44fc09c26148424b807bd6e3ff4f6e92/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:07.984866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8f5a6-daca-443b-ba0b-6528519446a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=787c898fed2d4859aa691909910bd6a8, user_id=44fc09c26148424b807bd6e3ff4f6e92, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:07.991873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8f5a6-daca-443b-ba0b-6528519446a7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:08.025310 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1381/2714] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:07 2021] PUT /identity/v3/projects/787c898fed2d4859aa691909910bd6a8/users/44fc09c26148424b807bd6e3ff4f6e92/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:08.026570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8f5a6-daca-443b-ba0b-6528519446a7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:08.037721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-aed8f5a6-daca-443b-ba0b-6528519446a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:08.090075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8dbfeac5-fa9f-4e22-ae7f-45b59cb17d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e170a419ef4e1992942c7c44194500'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:08.101231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8dbfeac5-fa9f-4e22-ae7f-45b59cb17d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e170a419ef4e1992942c7c44194500'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:08.119538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8dbfeac5-fa9f-4e22-ae7f-45b59cb17d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e170a419ef4e1992942c7c44194500'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:08.120456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8dbfeac5-fa9f-4e22-ae7f-45b59cb17d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e170a419ef4e1992942c7c44194500'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:08.131348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8dbfeac5-fa9f-4e22-ae7f-45b59cb17d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e170a419ef4e1992942c7c44194500'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:08.142587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8f5a6-daca-443b-ba0b-6528519446a7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:08.144968 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1334/2715] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:07 2021] DELETE /identity/v3/users/42e170a419ef4e1992942c7c44194500 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:08.146633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9579c2-3014-44d2-bf2e-0dc367106d3f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:08.147293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9579c2-3014-44d2-bf2e-0dc367106d3f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:08.147627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9579c2-3014-44d2-bf2e-0dc367106d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:08.180862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7d9579c2-3014-44d2-bf2e-0dc367106d3f None None] MFA Rules not processed for user `44fc09c26148424b807bd6e3ff4f6e92`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:08.182148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7d9579c2-3014-44d2-bf2e-0dc367106d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:08.233042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e929c-73e1-40d1-a58f-780250d15d61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:08.234071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e929c-73e1-40d1-a58f-780250d15d61 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:08.234531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e929c-73e1-40d1-a58f-780250d15d61 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:08.234956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e929c-73e1-40d1-a58f-780250d15d61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:08.237140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-846e929c-73e1-40d1-a58f-780250d15d61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:08.250970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e929c-73e1-40d1-a58f-780250d15d61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:08.254340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e929c-73e1-40d1-a58f-780250d15d61 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:08.266884 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1382/2716] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:08.269187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adfc54-b502-4122-866c-15f7b9639a79 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:08.269647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adfc54-b502-4122-866c-15f7b9639a79 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:08.270126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adfc54-b502-4122-866c-15f7b9639a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:08.307502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-38adfc54-b502-4122-866c-15f7b9639a79 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:08.309774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-38adfc54-b502-4122-866c-15f7b9639a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:08.386828 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1335/2717] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:08 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:08.397848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8b230-cfc1-4225-9129-5b6f32580757 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:08.398420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8b230-cfc1-4225-9129-5b6f32580757 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:08.398906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8b230-cfc1-4225-9129-5b6f32580757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:08.424621 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1383/2718] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:08.457882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-60d8b230-cfc1-4225-9129-5b6f32580757 None None] MFA Rules not processed for user `231f078b4f4e4fdc9dcf0c6248f17551`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:08.462121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adfc54-b502-4122-866c-15f7b9639a79 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:08.462399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-60d8b230-cfc1-4225-9129-5b6f32580757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:08.463653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-38adfc54-b502-4122-866c-15f7b9639a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:08.584127 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1336/2719] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:08 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:08.628898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adfc54-b502-4122-866c-15f7b9639a79 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:08.633257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2cd4c-7754-478f-9304-fd3c6d63d287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:08.634549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2cd4c-7754-478f-9304-fd3c6d63d287 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:08.634549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2cd4c-7754-478f-9304-fd3c6d63d287 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:08.634549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2cd4c-7754-478f-9304-fd3c6d63d287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:08.646726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2cd4c-7754-478f-9304-fd3c6d63d287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:08.654453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2cd4c-7754-478f-9304-fd3c6d63d287 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:08.669362 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1384/2720] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:49:09.051252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8b230-cfc1-4225-9129-5b6f32580757 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:09.052682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-60d8b230-cfc1-4225-9129-5b6f32580757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:09.157587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8b230-cfc1-4225-9129-5b6f32580757 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:09.164937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cbf67-f0f1-42a4-86b0-eb62a74d6599 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:09.165732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cbf67-f0f1-42a4-86b0-eb62a74d6599 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:09.166116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cbf67-f0f1-42a4-86b0-eb62a74d6599 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:09.166522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cbf67-f0f1-42a4-86b0-eb62a74d6599 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:09.170848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b75cbf67-f0f1-42a4-86b0-eb62a74d6599 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:09.186011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cbf67-f0f1-42a4-86b0-eb62a74d6599 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:09.187986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cbf67-f0f1-42a4-86b0-eb62a74d6599 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:09.200270 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1337/2721] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:09 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:09.882449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2cd4c-7754-478f-9304-fd3c6d63d287 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:09.883909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0fa2cd4c-7754-478f-9304-fd3c6d63d287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:09.900920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2cd4c-7754-478f-9304-fd3c6d63d287 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:09.908944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc9a06-4538-4fdc-a561-1970a9b9803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:09.910357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc9a06-4538-4fdc-a561-1970a9b9803d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:09.910881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc9a06-4538-4fdc-a561-1970a9b9803d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:09.920122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc9a06-4538-4fdc-a561-1970a9b9803d admin admin] PATH_INFO: `/v3/projects/756fe344de8d4bbeaa9cfa6236f16a7e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:09.922011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc9a06-4538-4fdc-a561-1970a9b9803d admin admin] RBAC: Authorizing `identity:delete_project(project_id=756fe344de8d4bbeaa9cfa6236f16a7e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:09.925738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc9a06-4538-4fdc-a561-1970a9b9803d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:10.036217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cefc9a06-4538-4fdc-a561-1970a9b9803d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '756fe344de8d4bbeaa9cfa6236f16a7e', 'request_id': 'req-cefc9a06-4538-4fdc-a561-1970a9b9803d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:10.045547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cefc9a06-4538-4fdc-a561-1970a9b9803d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '756fe344de8d4bbeaa9cfa6236f16a7e', 'request_id': 'req-cefc9a06-4538-4fdc-a561-1970a9b9803d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:10.058900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cefc9a06-4538-4fdc-a561-1970a9b9803d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '756fe344de8d4bbeaa9cfa6236f16a7e', 'request_id': 'req-cefc9a06-4538-4fdc-a561-1970a9b9803d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:10.074221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cefc9a06-4538-4fdc-a561-1970a9b9803d admin admin] The token cache is being invalidate because project 756fe344de8d4bbeaa9cfa6236f16a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:10.074653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cefc9a06-4538-4fdc-a561-1970a9b9803d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:10.075423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cefc9a06-4538-4fdc-a561-1970a9b9803d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:10.082520 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1385/2722] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:09 2021] DELETE /identity/v3/projects/756fe344de8d4bbeaa9cfa6236f16a7e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:10.084113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfb100-97d6-4109-bb5b-071384471f45 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:10.084655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfb100-97d6-4109-bb5b-071384471f45 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:10.084874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfb100-97d6-4109-bb5b-071384471f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:10.142826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-59bfb100-97d6-4109-bb5b-071384471f45 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:10.144581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-59bfb100-97d6-4109-bb5b-071384471f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:10.261676 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1338/2723] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:49:10.270130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192feb7-4595-450f-9631-cf999830c04c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:10.270556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192feb7-4595-450f-9631-cf999830c04c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:10.270854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192feb7-4595-450f-9631-cf999830c04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:10.316913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2192feb7-4595-450f-9631-cf999830c04c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:10.318432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2192feb7-4595-450f-9631-cf999830c04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:10.350498 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1386/2724] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:10.356427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfb100-97d6-4109-bb5b-071384471f45 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:10.385083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfb100-97d6-4109-bb5b-071384471f45 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:10.401896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af85bbd-24fc-4571-b3b7-82952d4a9a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:10.402924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af85bbd-24fc-4571-b3b7-82952d4a9a65 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:10.403381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af85bbd-24fc-4571-b3b7-82952d4a9a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:10.403869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af85bbd-24fc-4571-b3b7-82952d4a9a65 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:10.405214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af85bbd-24fc-4571-b3b7-82952d4a9a65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:49:10.406112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af85bbd-24fc-4571-b3b7-82952d4a9a65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:10.411756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af85bbd-24fc-4571-b3b7-82952d4a9a65 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:10.453813 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1339/2725] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:49:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:49:10.454068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192feb7-4595-450f-9631-cf999830c04c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:10.467743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192feb7-4595-450f-9631-cf999830c04c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:10.486303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e7f4a-a6c2-4cbb-b17f-b70a4e1a46a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:10.486303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e7f4a-a6c2-4cbb-b17f-b70a4e1a46a6 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:10.486303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e7f4a-a6c2-4cbb-b17f-b70a4e1a46a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:10.486303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e7f4a-a6c2-4cbb-b17f-b70a4e1a46a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:10.487409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e7f4a-a6c2-4cbb-b17f-b70a4e1a46a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:10.488599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e7f4a-a6c2-4cbb-b17f-b70a4e1a46a6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:10.568328 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1387/2726] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:49:10 2021] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:49:10.572904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af85bbd-24fc-4571-b3b7-82952d4a9a65 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:10.587672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af85bbd-24fc-4571-b3b7-82952d4a9a65 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:10.707697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf76d0-5ef3-464b-8e5a-9308dae89f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:10.708707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf76d0-5ef3-464b-8e5a-9308dae89f4e admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:10.709607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf76d0-5ef3-464b-8e5a-9308dae89f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:10.710281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf76d0-5ef3-464b-8e5a-9308dae89f4e admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:10.711600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf76d0-5ef3-464b-8e5a-9308dae89f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:10.714157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf76d0-5ef3-464b-8e5a-9308dae89f4e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:10.768427 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1340/2727] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:49:10 2021] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:10.768889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e7f4a-a6c2-4cbb-b17f-b70a4e1a46a6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:10.785222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e7f4a-a6c2-4cbb-b17f-b70a4e1a46a6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:10.802592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efb959-a318-4b63-a488-6473ca9db4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:10.803377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efb959-a318-4b63-a488-6473ca9db4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:10.803556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efb959-a318-4b63-a488-6473ca9db4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:10.803929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efb959-a318-4b63-a488-6473ca9db4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:10.804743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efb959-a318-4b63-a488-6473ca9db4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:10.807280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efb959-a318-4b63-a488-6473ca9db4e0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:10.855516 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1388/2728] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:10 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:10.858402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf76d0-5ef3-464b-8e5a-9308dae89f4e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:10.876076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf76d0-5ef3-464b-8e5a-9308dae89f4e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:10.893764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b39dc-e6d8-4662-9d33-c4e47fe71d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:10.895213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b39dc-e6d8-4662-9d33-c4e47fe71d37 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:10.896118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b39dc-e6d8-4662-9d33-c4e47fe71d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:10.897250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b39dc-e6d8-4662-9d33-c4e47fe71d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:10.899069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b39dc-e6d8-4662-9d33-c4e47fe71d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:10.900469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b39dc-e6d8-4662-9d33-c4e47fe71d37 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:10.941426 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1341/2729] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:10 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:10.942000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efb959-a318-4b63-a488-6473ca9db4e0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:10.956387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efb959-a318-4b63-a488-6473ca9db4e0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:10.969708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9963a33-2820-4b1f-9e91-0f400b107620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:10.970716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9963a33-2820-4b1f-9e91-0f400b107620 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:10.971000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9963a33-2820-4b1f-9e91-0f400b107620 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:10.971821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9963a33-2820-4b1f-9e91-0f400b107620 admin admin] PATH_INFO: `/v3/projects/738d51b548fb479f889bd3bb54ca33d5/users/e2857cd622364f4db1c1bc7b6065f9ba/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:11.014736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9963a33-2820-4b1f-9e91-0f400b107620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=738d51b548fb479f889bd3bb54ca33d5, user_id=e2857cd622364f4db1c1bc7b6065f9ba, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:11.017431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9963a33-2820-4b1f-9e91-0f400b107620 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:11.041031 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1389/2730] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:10 2021] PUT /identity/v3/projects/738d51b548fb479f889bd3bb54ca33d5/users/e2857cd622364f4db1c1bc7b6065f9ba/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:11.048849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7239cd-460a-4e30-b175-8870102fddfa None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:11.049336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7239cd-460a-4e30-b175-8870102fddfa None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:11.049762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7239cd-460a-4e30-b175-8870102fddfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:11.116440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8b7239cd-460a-4e30-b175-8870102fddfa None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:11.118361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8b7239cd-460a-4e30-b175-8870102fddfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:11.267178 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1342/2731] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:11.308015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9963a33-2820-4b1f-9e91-0f400b107620 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:11.310446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f9963a33-2820-4b1f-9e91-0f400b107620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:11.463545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9963a33-2820-4b1f-9e91-0f400b107620 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:11.473163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bee21f-e22d-4d33-9fd0-596073343af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:11.474317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bee21f-e22d-4d33-9fd0-596073343af2 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:11.475171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bee21f-e22d-4d33-9fd0-596073343af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:11.475616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bee21f-e22d-4d33-9fd0-596073343af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:11.494962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bee21f-e22d-4d33-9fd0-596073343af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:11.497501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bee21f-e22d-4d33-9fd0-596073343af2 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:11.512609 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1390/2732] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:49:11.842429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b9471-6b5d-4f29-8aa7-77e23bbec79b None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:11.844321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b9471-6b5d-4f29-8aa7-77e23bbec79b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:11.844796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b9471-6b5d-4f29-8aa7-77e23bbec79b None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:11.850692 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1343/2733] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:49:11 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:49:11.863170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dd25b-648f-45d1-ad54-a0dc9f3c3882 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:11.863964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dd25b-648f-45d1-ad54-a0dc9f3c3882 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:11.864483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dd25b-648f-45d1-ad54-a0dc9f3c3882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:11.916168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9a8dd25b-648f-45d1-ad54-a0dc9f3c3882 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:11.917412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9a8dd25b-648f-45d1-ad54-a0dc9f3c3882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:12.074175 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1391/2734] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:49:11 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:12.087845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b9471-6b5d-4f29-8aa7-77e23bbec79b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:12.089754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-946b9471-6b5d-4f29-8aa7-77e23bbec79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:12.144244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b9471-6b5d-4f29-8aa7-77e23bbec79b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:12.152188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a56dd-6c96-4358-b53f-ff818fa2278e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:12.153618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a56dd-6c96-4358-b53f-ff818fa2278e service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:12.154113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a56dd-6c96-4358-b53f-ff818fa2278e service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:12.154810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a56dd-6c96-4358-b53f-ff818fa2278e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:12.166938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a56dd-6c96-4358-b53f-ff818fa2278e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:12.168918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a56dd-6c96-4358-b53f-ff818fa2278e service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:12.184131 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1344/2735] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:12 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:12.622393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaa9ed-bb8a-49fa-ad4c-03b099c530fd None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:12.622777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaa9ed-bb8a-49fa-ad4c-03b099c530fd None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:12.623068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaa9ed-bb8a-49fa-ad4c-03b099c530fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:12.684391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1ffaa9ed-bb8a-49fa-ad4c-03b099c530fd None None] MFA Rules not processed for user `34ee9e750e1143faaae1e09783fbdcf7`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:12.685871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1ffaa9ed-bb8a-49fa-ad4c-03b099c530fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:12.798879 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1392/2736] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:12 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:13.189210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568611e7-9e70-4482-ba87-a8983aa8f61e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:13.189708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568611e7-9e70-4482-ba87-a8983aa8f61e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:13.190780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568611e7-9e70-4482-ba87-a8983aa8f61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:13.230940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-568611e7-9e70-4482-ba87-a8983aa8f61e None None] MFA Rules not processed for user `e2857cd622364f4db1c1bc7b6065f9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:13.232536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-568611e7-9e70-4482-ba87-a8983aa8f61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:13.405387 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1345/2737] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:13 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:13.415170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72447aba-2ce1-4632-b1a9-cffede8a16a9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:13.416674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72447aba-2ce1-4632-b1a9-cffede8a16a9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:13.417104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72447aba-2ce1-4632-b1a9-cffede8a16a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:13.441725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-72447aba-2ce1-4632-b1a9-cffede8a16a9 None None] MFA Rules not processed for user `e2857cd622364f4db1c1bc7b6065f9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:13.443407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-72447aba-2ce1-4632-b1a9-cffede8a16a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:13.453148 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1393/2738] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:13 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:49:13.786708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568611e7-9e70-4482-ba87-a8983aa8f61e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:13.788431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-568611e7-9e70-4482-ba87-a8983aa8f61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:13.933748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568611e7-9e70-4482-ba87-a8983aa8f61e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:13.951554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10d46a-5036-44d2-9d64-572fe6f64a3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:13.952334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10d46a-5036-44d2-9d64-572fe6f64a3e service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:13.952855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10d46a-5036-44d2-9d64-572fe6f64a3e service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:13.953326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10d46a-5036-44d2-9d64-572fe6f64a3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:13.963554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10d46a-5036-44d2-9d64-572fe6f64a3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:13.965491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10d46a-5036-44d2-9d64-572fe6f64a3e service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:13.977279 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1346/2739] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:13 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:14.336974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72447aba-2ce1-4632-b1a9-cffede8a16a9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:14.357084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72447aba-2ce1-4632-b1a9-cffede8a16a9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:14.364383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143d6da-a664-4f84-9973-2c876031a38f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:14.365248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143d6da-a664-4f84-9973-2c876031a38f service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:14.365713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143d6da-a664-4f84-9973-2c876031a38f service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:14.366201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143d6da-a664-4f84-9973-2c876031a38f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:14.375390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143d6da-a664-4f84-9973-2c876031a38f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:14.377331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143d6da-a664-4f84-9973-2c876031a38f service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:14.389127 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1394/2740] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:14 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:18.968986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10d46a-5036-44d2-9d64-572fe6f64a3e service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:18.993155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10d46a-5036-44d2-9d64-572fe6f64a3e service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:19.010490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44b334-ca4c-446a-ab08-7cf46bc69b02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:19.014287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44b334-ca4c-446a-ab08-7cf46bc69b02 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:19.015477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44b334-ca4c-446a-ab08-7cf46bc69b02 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:19.016240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44b334-ca4c-446a-ab08-7cf46bc69b02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:19.045918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3e44b334-ca4c-446a-ab08-7cf46bc69b02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:19.068808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44b334-ca4c-446a-ab08-7cf46bc69b02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:19.070617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44b334-ca4c-446a-ab08-7cf46bc69b02 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:19.095053 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1347/2741] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:18 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:21.133372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143d6da-a664-4f84-9973-2c876031a38f service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:21.135112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3143d6da-a664-4f84-9973-2c876031a38f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:21.188122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143d6da-a664-4f84-9973-2c876031a38f service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:21.201312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c1c31-522b-4c26-98d0-76008d67bf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:21.202196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c1c31-522b-4c26-98d0-76008d67bf11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:21.202507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c1c31-522b-4c26-98d0-76008d67bf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:21.202781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c1c31-522b-4c26-98d0-76008d67bf11 admin admin] PATH_INFO: `/v3/users/34ee9e750e1143faaae1e09783fbdcf7` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:21.206443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c1c31-522b-4c26-98d0-76008d67bf11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ee9e750e1143faaae1e09783fbdcf7)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:21.208360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c1c31-522b-4c26-98d0-76008d67bf11 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:21.287630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e82c1c31-522b-4c26-98d0-76008d67bf11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ee9e750e1143faaae1e09783fbdcf7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:21.299404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e82c1c31-522b-4c26-98d0-76008d67bf11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ee9e750e1143faaae1e09783fbdcf7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:21.300666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e82c1c31-522b-4c26-98d0-76008d67bf11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ee9e750e1143faaae1e09783fbdcf7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:21.315592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e82c1c31-522b-4c26-98d0-76008d67bf11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ee9e750e1143faaae1e09783fbdcf7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:21.325813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e82c1c31-522b-4c26-98d0-76008d67bf11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ee9e750e1143faaae1e09783fbdcf7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:21.337825 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1395/2742] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:21 2021] DELETE /identity/v3/users/34ee9e750e1143faaae1e09783fbdcf7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:22.293692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44b334-ca4c-446a-ab08-7cf46bc69b02 service placement] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:22.328044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44b334-ca4c-446a-ab08-7cf46bc69b02 service placement] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:22.439034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef20a4-5fb4-4506-80e5-c12631bbcadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:22.441537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef20a4-5fb4-4506-80e5-c12631bbcadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:22.442020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef20a4-5fb4-4506-80e5-c12631bbcadb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:22.444177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef20a4-5fb4-4506-80e5-c12631bbcadb admin admin] PATH_INFO: `/v3/projects/cd3f58b92ce64d08bf7ab736674b66da` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:22.448808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef20a4-5fb4-4506-80e5-c12631bbcadb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd3f58b92ce64d08bf7ab736674b66da)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:22.449552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef20a4-5fb4-4506-80e5-c12631bbcadb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:22.554015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-feef20a4-5fb4-4506-80e5-c12631bbcadb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd3f58b92ce64d08bf7ab736674b66da', 'request_id': 'req-feef20a4-5fb4-4506-80e5-c12631bbcadb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:22.564161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-feef20a4-5fb4-4506-80e5-c12631bbcadb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd3f58b92ce64d08bf7ab736674b66da', 'request_id': 'req-feef20a4-5fb4-4506-80e5-c12631bbcadb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:22.600065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-feef20a4-5fb4-4506-80e5-c12631bbcadb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd3f58b92ce64d08bf7ab736674b66da', 'request_id': 'req-feef20a4-5fb4-4506-80e5-c12631bbcadb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:22.632653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-feef20a4-5fb4-4506-80e5-c12631bbcadb admin admin] The token cache is being invalidate because project cd3f58b92ce64d08bf7ab736674b66da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:22.632954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-feef20a4-5fb4-4506-80e5-c12631bbcadb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:22.633694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-feef20a4-5fb4-4506-80e5-c12631bbcadb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:22.635907 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1348/2743] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:22 2021] DELETE /identity/v3/projects/cd3f58b92ce64d08bf7ab736674b66da => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:22.641371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e729a-72b3-4f8f-8e45-9a1b6ca5d17f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:22.641866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e729a-72b3-4f8f-8e45-9a1b6ca5d17f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:22.641963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e729a-72b3-4f8f-8e45-9a1b6ca5d17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:22.675560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d91e729a-72b3-4f8f-8e45-9a1b6ca5d17f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:22.676816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d91e729a-72b3-4f8f-8e45-9a1b6ca5d17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:22.840360 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1396/2744] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:22.849085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e05d5-a4de-4851-8fe5-ffb42ef6be85 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:22.849610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e05d5-a4de-4851-8fe5-ffb42ef6be85 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:22.850202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e05d5-a4de-4851-8fe5-ffb42ef6be85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:22.885661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ab2e05d5-a4de-4851-8fe5-ffb42ef6be85 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:22.889584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ab2e05d5-a4de-4851-8fe5-ffb42ef6be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:22.911070 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1349/2745] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:22.915391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e729a-72b3-4f8f-8e45-9a1b6ca5d17f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:22.929393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e729a-72b3-4f8f-8e45-9a1b6ca5d17f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:22.942870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a749846-60eb-44d0-9f29-015320776dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:22.943759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a749846-60eb-44d0-9f29-015320776dec admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:22.944194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a749846-60eb-44d0-9f29-015320776dec admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:22.944647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a749846-60eb-44d0-9f29-015320776dec admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:22.945626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a749846-60eb-44d0-9f29-015320776dec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:49:22.946243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a749846-60eb-44d0-9f29-015320776dec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:22.948068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a749846-60eb-44d0-9f29-015320776dec admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:22.975476 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1397/2746] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:49:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:49:22.980045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e05d5-a4de-4851-8fe5-ffb42ef6be85 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:22.995884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e05d5-a4de-4851-8fe5-ffb42ef6be85 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:23.013353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d973b-ce34-4299-9001-629d431eee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:23.014225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d973b-ce34-4299-9001-629d431eee49 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:23.014557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d973b-ce34-4299-9001-629d431eee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:23.014840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d973b-ce34-4299-9001-629d431eee49 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:23.015554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d973b-ce34-4299-9001-629d431eee49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:23.017527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d973b-ce34-4299-9001-629d431eee49 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:23.076871 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1350/2747] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:49:22 2021] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:23.081121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a749846-60eb-44d0-9f29-015320776dec admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:23.094281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a749846-60eb-44d0-9f29-015320776dec admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:23.219714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7916af-6735-48e0-be55-2217bed115d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:23.221594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7916af-6735-48e0-be55-2217bed115d8 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:23.222033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7916af-6735-48e0-be55-2217bed115d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:23.222649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7916af-6735-48e0-be55-2217bed115d8 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:23.224544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7916af-6735-48e0-be55-2217bed115d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:23.227685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7916af-6735-48e0-be55-2217bed115d8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:23.271944 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1398/2748] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:49:23 2021] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:23.276430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d973b-ce34-4299-9001-629d431eee49 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:23.290519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d973b-ce34-4299-9001-629d431eee49 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:23.296720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69d228-5d5b-4120-8114-e303ad35cd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:23.298166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69d228-5d5b-4120-8114-e303ad35cd9c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:23.298760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69d228-5d5b-4120-8114-e303ad35cd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:23.299747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69d228-5d5b-4120-8114-e303ad35cd9c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:23.300692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69d228-5d5b-4120-8114-e303ad35cd9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:23.302524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69d228-5d5b-4120-8114-e303ad35cd9c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:23.453382 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1351/2749] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:23 2021] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:23.454819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7916af-6735-48e0-be55-2217bed115d8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:23.471369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7916af-6735-48e0-be55-2217bed115d8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:23.479303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82b04d-b9bc-4341-9542-9d7e880566ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:23.480334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82b04d-b9bc-4341-9542-9d7e880566ae admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:23.480853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82b04d-b9bc-4341-9542-9d7e880566ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:23.481482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82b04d-b9bc-4341-9542-9d7e880566ae admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:23.482502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82b04d-b9bc-4341-9542-9d7e880566ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:23.484594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82b04d-b9bc-4341-9542-9d7e880566ae admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:23.505393 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1399/2750] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:23 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:23.506139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69d228-5d5b-4120-8114-e303ad35cd9c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:23.516840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69d228-5d5b-4120-8114-e303ad35cd9c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:23.535042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc1fb6-3e9e-4243-9f6b-76ae096fbc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:23.535956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc1fb6-3e9e-4243-9f6b-76ae096fbc7c admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:23.536244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc1fb6-3e9e-4243-9f6b-76ae096fbc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:23.536521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc1fb6-3e9e-4243-9f6b-76ae096fbc7c admin admin] PATH_INFO: `/v3/projects/793496da99a5486eb25d932d07db3d24/users/40c68504c8154342905e4601809509df/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:23.573738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc1fb6-3e9e-4243-9f6b-76ae096fbc7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=793496da99a5486eb25d932d07db3d24, user_id=40c68504c8154342905e4601809509df, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:23.581664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc1fb6-3e9e-4243-9f6b-76ae096fbc7c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:23.614954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d8ac0-7a9c-4e1f-a7d2-aa614345f64f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:23.615311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d8ac0-7a9c-4e1f-a7d2-aa614345f64f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:23.615755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d8ac0-7a9c-4e1f-a7d2-aa614345f64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:23.616922 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1352/2751] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:23 2021] PUT /identity/v3/projects/793496da99a5486eb25d932d07db3d24/users/40c68504c8154342905e4601809509df/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:23.650514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7c8d8ac0-7a9c-4e1f-a7d2-aa614345f64f None None] MFA Rules not processed for user `40c68504c8154342905e4601809509df`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:23.652788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7c8d8ac0-7a9c-4e1f-a7d2-aa614345f64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:23.740388 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1400/2752] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:23 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:24.051488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc1fb6-3e9e-4243-9f6b-76ae096fbc7c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:24.054413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-44bc1fb6-3e9e-4243-9f6b-76ae096fbc7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:24.139550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc1fb6-3e9e-4243-9f6b-76ae096fbc7c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:24.146232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53960256-bd88-4237-aa42-63adabee2c1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:24.146950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53960256-bd88-4237-aa42-63adabee2c1b service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:24.147237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53960256-bd88-4237-aa42-63adabee2c1b service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:24.147519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53960256-bd88-4237-aa42-63adabee2c1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:24.156254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53960256-bd88-4237-aa42-63adabee2c1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:24.157843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53960256-bd88-4237-aa42-63adabee2c1b service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:24.167375 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1353/2753] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:24 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:25.753359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ec38b-ad7f-46ce-9154-0106eadda12f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:25.753798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ec38b-ad7f-46ce-9154-0106eadda12f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:25.754192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ec38b-ad7f-46ce-9154-0106eadda12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:25.821378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0d3ec38b-ad7f-46ce-9154-0106eadda12f None None] MFA Rules not processed for user `ea2400b9f82c494584a5226d1d74177e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:25.822719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0d3ec38b-ad7f-46ce-9154-0106eadda12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:25.955609 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1401/2754] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:25 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:26.259334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53960256-bd88-4237-aa42-63adabee2c1b service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:26.280915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ec38b-ad7f-46ce-9154-0106eadda12f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:26.285017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0d3ec38b-ad7f-46ce-9154-0106eadda12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:26.304841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53960256-bd88-4237-aa42-63adabee2c1b service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:26.328437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c16574-d6e5-4b3e-8aad-bf5058d6a567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:26.329358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c16574-d6e5-4b3e-8aad-bf5058d6a567 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:26.329894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c16574-d6e5-4b3e-8aad-bf5058d6a567 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:26.334372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c16574-d6e5-4b3e-8aad-bf5058d6a567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:26.355327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c16574-d6e5-4b3e-8aad-bf5058d6a567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:26.359544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c16574-d6e5-4b3e-8aad-bf5058d6a567 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:26.379728 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1354/2755] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:26 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:26.406898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ec38b-ad7f-46ce-9154-0106eadda12f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:26.412745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04fedb-290e-4f81-99de-597fe784c167 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:26.413687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04fedb-290e-4f81-99de-597fe784c167 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:26.414181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04fedb-290e-4f81-99de-597fe784c167 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:26.414759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04fedb-290e-4f81-99de-597fe784c167 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:26.417077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-af04fedb-290e-4f81-99de-597fe784c167 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:26.430040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04fedb-290e-4f81-99de-597fe784c167 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:26.432161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04fedb-290e-4f81-99de-597fe784c167 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:26.448576 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1402/2756] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:26 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:32.966116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c16574-d6e5-4b3e-8aad-bf5058d6a567 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:33.050952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c16574-d6e5-4b3e-8aad-bf5058d6a567 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:33.055424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c76f96-907b-4926-94fe-cc79f9a07f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:33.056296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c76f96-907b-4926-94fe-cc79f9a07f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:33.056582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c76f96-907b-4926-94fe-cc79f9a07f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:33.056858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c76f96-907b-4926-94fe-cc79f9a07f4b admin admin] PATH_INFO: `/v3/users/40c68504c8154342905e4601809509df` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:33.058088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c76f96-907b-4926-94fe-cc79f9a07f4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=40c68504c8154342905e4601809509df)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:33.060010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c76f96-907b-4926-94fe-cc79f9a07f4b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:33.106427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a1c76f96-907b-4926-94fe-cc79f9a07f4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40c68504c8154342905e4601809509df'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:33.113399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a1c76f96-907b-4926-94fe-cc79f9a07f4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40c68504c8154342905e4601809509df'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:33.124888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a1c76f96-907b-4926-94fe-cc79f9a07f4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40c68504c8154342905e4601809509df'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:33.125538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a1c76f96-907b-4926-94fe-cc79f9a07f4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40c68504c8154342905e4601809509df'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:33.133521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a1c76f96-907b-4926-94fe-cc79f9a07f4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40c68504c8154342905e4601809509df'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:33.139571 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1355/2757] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:32 2021] DELETE /identity/v3/users/40c68504c8154342905e4601809509df => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:33.145037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2189d-d996-44ca-8181-c29de570738c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:33.145550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2189d-d996-44ca-8181-c29de570738c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:33.145661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2189d-d996-44ca-8181-c29de570738c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:33.169402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b4b2189d-d996-44ca-8181-c29de570738c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:33.170670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b4b2189d-d996-44ca-8181-c29de570738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:33.234332 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1403/2758] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:33.244604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c76f96-907b-4926-94fe-cc79f9a07f4b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:33.246035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a1c76f96-907b-4926-94fe-cc79f9a07f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:33.306778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c76f96-907b-4926-94fe-cc79f9a07f4b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:33.310698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41325d89-79a0-4e80-82a9-e6f9948e4c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:33.311372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41325d89-79a0-4e80-82a9-e6f9948e4c31 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:33.311659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41325d89-79a0-4e80-82a9-e6f9948e4c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:33.311964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41325d89-79a0-4e80-82a9-e6f9948e4c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:33.322305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41325d89-79a0-4e80-82a9-e6f9948e4c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:33.323778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41325d89-79a0-4e80-82a9-e6f9948e4c31 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:33.334312 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1356/2759] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:49:33.604511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2189d-d996-44ca-8181-c29de570738c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:33.605988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b4b2189d-d996-44ca-8181-c29de570738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:33.619572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2189d-d996-44ca-8181-c29de570738c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:33.625467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e71689-3666-494c-a9f4-2862afe390ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:33.626640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e71689-3666-494c-a9f4-2862afe390ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:33.627095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e71689-3666-494c-a9f4-2862afe390ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:33.627523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e71689-3666-494c-a9f4-2862afe390ac admin admin] PATH_INFO: `/v3/projects/793496da99a5486eb25d932d07db3d24` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:33.628946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e71689-3666-494c-a9f4-2862afe390ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=793496da99a5486eb25d932d07db3d24)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:33.631604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e71689-3666-494c-a9f4-2862afe390ac admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:33.692296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-81e71689-3666-494c-a9f4-2862afe390ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793496da99a5486eb25d932d07db3d24', 'request_id': 'req-81e71689-3666-494c-a9f4-2862afe390ac'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:33.701545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-81e71689-3666-494c-a9f4-2862afe390ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793496da99a5486eb25d932d07db3d24', 'request_id': 'req-81e71689-3666-494c-a9f4-2862afe390ac'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:33.714957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-81e71689-3666-494c-a9f4-2862afe390ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793496da99a5486eb25d932d07db3d24', 'request_id': 'req-81e71689-3666-494c-a9f4-2862afe390ac'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:33.732389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-81e71689-3666-494c-a9f4-2862afe390ac admin admin] The token cache is being invalidate because project 793496da99a5486eb25d932d07db3d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:33.732811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-81e71689-3666-494c-a9f4-2862afe390ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:33.733480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-81e71689-3666-494c-a9f4-2862afe390ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:33.735847 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1404/2760] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:33 2021] DELETE /identity/v3/projects/793496da99a5486eb25d932d07db3d24 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:33.741654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87b94d-d59e-42d8-a329-c23cc9f1b362 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:33.742291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87b94d-d59e-42d8-a329-c23cc9f1b362 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:33.742746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87b94d-d59e-42d8-a329-c23cc9f1b362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:33.767992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ce87b94d-d59e-42d8-a329-c23cc9f1b362 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:33.769247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ce87b94d-d59e-42d8-a329-c23cc9f1b362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:33.831173 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1357/2761] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:33.839589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c05e-ccc3-4a29-8a24-09203cdab77f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:33.839873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c05e-ccc3-4a29-8a24-09203cdab77f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:33.840149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c05e-ccc3-4a29-8a24-09203cdab77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:33.860593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8a11c05e-ccc3-4a29-8a24-09203cdab77f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:33.861834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8a11c05e-ccc3-4a29-8a24-09203cdab77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:33.873289 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1405/2762] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:49:33.874546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87b94d-d59e-42d8-a329-c23cc9f1b362 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:33.884957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87b94d-d59e-42d8-a329-c23cc9f1b362 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:33.890499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0787357-9b63-4fec-a199-ade0835f2384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:33.890934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0787357-9b63-4fec-a199-ade0835f2384 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:33.891218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0787357-9b63-4fec-a199-ade0835f2384 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:33.891495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0787357-9b63-4fec-a199-ade0835f2384 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:33.892916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0787357-9b63-4fec-a199-ade0835f2384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:49:33.893222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0787357-9b63-4fec-a199-ade0835f2384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:33.894815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0787357-9b63-4fec-a199-ade0835f2384 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:33.909910 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1358/2763] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:49:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:49:33.911242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11c05e-ccc3-4a29-8a24-09203cdab77f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:33.920620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11c05e-ccc3-4a29-8a24-09203cdab77f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:33.927102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323efd1a-3bac-4f15-ba3a-77a85c8747f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:33.928400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323efd1a-3bac-4f15-ba3a-77a85c8747f1 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:33.928907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323efd1a-3bac-4f15-ba3a-77a85c8747f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:33.929193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323efd1a-3bac-4f15-ba3a-77a85c8747f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:33.929896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323efd1a-3bac-4f15-ba3a-77a85c8747f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:33.931921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323efd1a-3bac-4f15-ba3a-77a85c8747f1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:33.962310 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1406/2764] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:49:33 2021] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:49:33.968880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0787357-9b63-4fec-a199-ade0835f2384 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:33.983593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0787357-9b63-4fec-a199-ade0835f2384 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:34.116747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c74c83-7799-4947-8856-fce05f2d28a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:34.117549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c74c83-7799-4947-8856-fce05f2d28a9 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:34.121428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c74c83-7799-4947-8856-fce05f2d28a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:34.121428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c74c83-7799-4947-8856-fce05f2d28a9 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:34.121428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c74c83-7799-4947-8856-fce05f2d28a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:34.128456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c74c83-7799-4947-8856-fce05f2d28a9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:34.168003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323efd1a-3bac-4f15-ba3a-77a85c8747f1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:34.169872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-323efd1a-3bac-4f15-ba3a-77a85c8747f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:34.187278 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1359/2765] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:49:33 2021] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:34.192663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c74c83-7799-4947-8856-fce05f2d28a9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:34.211983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c74c83-7799-4947-8856-fce05f2d28a9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:34.220935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d99f5f-dfbe-440e-85ca-5850b9cc659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:34.223473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d99f5f-dfbe-440e-85ca-5850b9cc659b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:34.224333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d99f5f-dfbe-440e-85ca-5850b9cc659b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:34.224782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d99f5f-dfbe-440e-85ca-5850b9cc659b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:34.226301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d99f5f-dfbe-440e-85ca-5850b9cc659b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:34.228970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d99f5f-dfbe-440e-85ca-5850b9cc659b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:34.250535 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1360/2766] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:34 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:34.255458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d99f5f-dfbe-440e-85ca-5850b9cc659b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:34.266897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d99f5f-dfbe-440e-85ca-5850b9cc659b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:34.272197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f2652-bb1b-46ef-92c9-a8b1696e7e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:34.273266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f2652-bb1b-46ef-92c9-a8b1696e7e5b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:34.273574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f2652-bb1b-46ef-92c9-a8b1696e7e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:34.277035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f2652-bb1b-46ef-92c9-a8b1696e7e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:34.278878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f2652-bb1b-46ef-92c9-a8b1696e7e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:34.283024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f2652-bb1b-46ef-92c9-a8b1696e7e5b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:34.300421 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1361/2767] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:34 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:34.304755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f2652-bb1b-46ef-92c9-a8b1696e7e5b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:34.319262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f2652-bb1b-46ef-92c9-a8b1696e7e5b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:34.319464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323efd1a-3bac-4f15-ba3a-77a85c8747f1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:34.325218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78473f6-7cf6-4774-bd33-ca7ec020d741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:34.327193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78473f6-7cf6-4774-bd33-ca7ec020d741 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:34.327727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78473f6-7cf6-4774-bd33-ca7ec020d741 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:34.328230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78473f6-7cf6-4774-bd33-ca7ec020d741 admin admin] PATH_INFO: `/v3/projects/b1c3c6cad11948f58170343d52ca3439/users/80d2fe33b7664991a494b98128a3f98b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:34.339327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56a16b-5b58-4dc8-b5f3-ab70ce897ad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:34.340176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56a16b-5b58-4dc8-b5f3-ab70ce897ad6 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:34.340469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56a16b-5b58-4dc8-b5f3-ab70ce897ad6 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:34.340750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56a16b-5b58-4dc8-b5f3-ab70ce897ad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:34.348034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5c56a16b-5b58-4dc8-b5f3-ab70ce897ad6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:34.363017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78473f6-7cf6-4774-bd33-ca7ec020d741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c3c6cad11948f58170343d52ca3439, user_id=80d2fe33b7664991a494b98128a3f98b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:34.365725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78473f6-7cf6-4774-bd33-ca7ec020d741 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:34.393135 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1362/2768] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:34 2021] PUT /identity/v3/projects/b1c3c6cad11948f58170343d52ca3439/users/80d2fe33b7664991a494b98128a3f98b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:49:34.404301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927f843-c41e-4061-965a-97b8170d9566 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:34.404542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927f843-c41e-4061-965a-97b8170d9566 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:34.405001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927f843-c41e-4061-965a-97b8170d9566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:34.442306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3927f843-c41e-4061-965a-97b8170d9566 None None] MFA Rules not processed for user `80d2fe33b7664991a494b98128a3f98b`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:34.445184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56a16b-5b58-4dc8-b5f3-ab70ce897ad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:34.445320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3927f843-c41e-4061-965a-97b8170d9566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:34.446916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56a16b-5b58-4dc8-b5f3-ab70ce897ad6 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:34.457399 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1407/2769] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:34 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:34.556188 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1363/2770] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:34 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:49:35.025866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56a16b-5b58-4dc8-b5f3-ab70ce897ad6 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:35.027597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5c56a16b-5b58-4dc8-b5f3-ab70ce897ad6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:35.043218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56a16b-5b58-4dc8-b5f3-ab70ce897ad6 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:35.113465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757c2d1-1853-4359-9fd5-be471e9a1c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:35.114219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757c2d1-1853-4359-9fd5-be471e9a1c65 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:35.114669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757c2d1-1853-4359-9fd5-be471e9a1c65 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:35.115016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757c2d1-1853-4359-9fd5-be471e9a1c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:35.124753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757c2d1-1853-4359-9fd5-be471e9a1c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:35.127078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757c2d1-1853-4359-9fd5-be471e9a1c65 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:35.137397 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1408/2771] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:35 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:35.560052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e99d92-8780-430b-8e90-61a49f6547df None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:35.560741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e99d92-8780-430b-8e90-61a49f6547df None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:35.560741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e99d92-8780-430b-8e90-61a49f6547df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:35.581343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-38e99d92-8780-430b-8e90-61a49f6547df None None] MFA Rules not processed for user `231f078b4f4e4fdc9dcf0c6248f17551`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:35.583207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-38e99d92-8780-430b-8e90-61a49f6547df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:35.670519 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1364/2772] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:35 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:37.163676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757c2d1-1853-4359-9fd5-be471e9a1c65 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:37.168335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3757c2d1-1853-4359-9fd5-be471e9a1c65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:37.276427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757c2d1-1853-4359-9fd5-be471e9a1c65 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:37.284815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d342ed6-1cff-4b1a-8de4-825e99fe3651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:37.285842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d342ed6-1cff-4b1a-8de4-825e99fe3651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:37.286169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d342ed6-1cff-4b1a-8de4-825e99fe3651 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:37.286798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d342ed6-1cff-4b1a-8de4-825e99fe3651 admin admin] PATH_INFO: `/v3/users/472035f568124561bde5223c47dd07be` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:37.288711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d342ed6-1cff-4b1a-8de4-825e99fe3651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=472035f568124561bde5223c47dd07be)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:37.291580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d342ed6-1cff-4b1a-8de4-825e99fe3651 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:37.356574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6d342ed6-1cff-4b1a-8de4-825e99fe3651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '472035f568124561bde5223c47dd07be'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:37.365415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6d342ed6-1cff-4b1a-8de4-825e99fe3651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '472035f568124561bde5223c47dd07be'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:37.366142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6d342ed6-1cff-4b1a-8de4-825e99fe3651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '472035f568124561bde5223c47dd07be'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:37.381228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6d342ed6-1cff-4b1a-8de4-825e99fe3651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '472035f568124561bde5223c47dd07be'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:37.392830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6d342ed6-1cff-4b1a-8de4-825e99fe3651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '472035f568124561bde5223c47dd07be'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:37.411340 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1409/2773] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:37 2021] DELETE /identity/v3/users/472035f568124561bde5223c47dd07be => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:49:37.415418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08855905-30a1-4bb7-9bae-fd1b25a57834 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:37.416821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08855905-30a1-4bb7-9bae-fd1b25a57834 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:37.417104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08855905-30a1-4bb7-9bae-fd1b25a57834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:37.434988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-08855905-30a1-4bb7-9bae-fd1b25a57834 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:37.437013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-08855905-30a1-4bb7-9bae-fd1b25a57834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:37.506605 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1365/2774] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:49:37.518286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d342ed6-1cff-4b1a-8de4-825e99fe3651 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:37.521128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6d342ed6-1cff-4b1a-8de4-825e99fe3651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:37.601786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d342ed6-1cff-4b1a-8de4-825e99fe3651 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:37.607673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e147d29-5685-4ca9-a158-a0b846f69d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:37.613350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e147d29-5685-4ca9-a158-a0b846f69d89 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:37.613350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e147d29-5685-4ca9-a158-a0b846f69d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:37.615296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e147d29-5685-4ca9-a158-a0b846f69d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:37.637497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e147d29-5685-4ca9-a158-a0b846f69d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:37.639732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e147d29-5685-4ca9-a158-a0b846f69d89 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:37.655993 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1410/2775] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:37.765657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a4d84-94d0-406a-97de-268fc5ca6e92 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:37.765959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a4d84-94d0-406a-97de-268fc5ca6e92 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:37.766511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a4d84-94d0-406a-97de-268fc5ca6e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:37.796549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-955a4d84-94d0-406a-97de-268fc5ca6e92 None None] MFA Rules not processed for user `5aaf1ced6baf4e1d9c940cfe96b2c254`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:37.798672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-955a4d84-94d0-406a-97de-268fc5ca6e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:37.924072 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1366/2776] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:37 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:37.952263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e147d29-5685-4ca9-a158-a0b846f69d89 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:37.954131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5e147d29-5685-4ca9-a158-a0b846f69d89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:37.972319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e147d29-5685-4ca9-a158-a0b846f69d89 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:37.977911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a043a7-83a9-497a-961e-4ab15ab3130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:37.978932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a043a7-83a9-497a-961e-4ab15ab3130a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:37.979285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a043a7-83a9-497a-961e-4ab15ab3130a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:37.979605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a043a7-83a9-497a-961e-4ab15ab3130a admin admin] PATH_INFO: `/v3/projects/89a9543eaffc44858c8674e4b6f660cf` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:37.980872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a043a7-83a9-497a-961e-4ab15ab3130a admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a9543eaffc44858c8674e4b6f660cf)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:37.983057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a043a7-83a9-497a-961e-4ab15ab3130a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:38.079767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-77a043a7-83a9-497a-961e-4ab15ab3130a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a9543eaffc44858c8674e4b6f660cf', 'request_id': 'req-77a043a7-83a9-497a-961e-4ab15ab3130a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:38.095972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-77a043a7-83a9-497a-961e-4ab15ab3130a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a9543eaffc44858c8674e4b6f660cf', 'request_id': 'req-77a043a7-83a9-497a-961e-4ab15ab3130a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:38.108365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-77a043a7-83a9-497a-961e-4ab15ab3130a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a9543eaffc44858c8674e4b6f660cf', 'request_id': 'req-77a043a7-83a9-497a-961e-4ab15ab3130a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:38.143010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-77a043a7-83a9-497a-961e-4ab15ab3130a admin admin] The token cache is being invalidate because project 89a9543eaffc44858c8674e4b6f660cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:38.143314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-77a043a7-83a9-497a-961e-4ab15ab3130a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:38.148470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-77a043a7-83a9-497a-961e-4ab15ab3130a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:38.162323 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1411/2777] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:37 2021] DELETE /identity/v3/projects/89a9543eaffc44858c8674e4b6f660cf => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:38.169398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76fcd4-9619-44ed-bff3-9245dfb4c470 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:38.169717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76fcd4-9619-44ed-bff3-9245dfb4c470 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:38.170019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76fcd4-9619-44ed-bff3-9245dfb4c470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:38.218023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3a76fcd4-9619-44ed-bff3-9245dfb4c470 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:38.227562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3a76fcd4-9619-44ed-bff3-9245dfb4c470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:38.318050 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1367/2778] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:38.320301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314c4b2-cbcb-4377-8529-5eb2d4b5a209 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:38.320752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314c4b2-cbcb-4377-8529-5eb2d4b5a209 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:38.320888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314c4b2-cbcb-4377-8529-5eb2d4b5a209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:38.353964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7314c4b2-cbcb-4377-8529-5eb2d4b5a209 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:38.360687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7314c4b2-cbcb-4377-8529-5eb2d4b5a209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:38.371692 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1412/2779] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:49:38.378443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76fcd4-9619-44ed-bff3-9245dfb4c470 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:38.392672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76fcd4-9619-44ed-bff3-9245dfb4c470 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:38.398369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d3a23-8d68-4c55-87b2-038174d44e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:38.399811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d3a23-8d68-4c55-87b2-038174d44e20 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:38.400320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d3a23-8d68-4c55-87b2-038174d44e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:38.401062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d3a23-8d68-4c55-87b2-038174d44e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:38.402192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d3a23-8d68-4c55-87b2-038174d44e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:49:38.402713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d3a23-8d68-4c55-87b2-038174d44e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:38.404492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d3a23-8d68-4c55-87b2-038174d44e20 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:38.424215 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1368/2780] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:49:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:49:38.425472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314c4b2-cbcb-4377-8529-5eb2d4b5a209 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:38.437689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314c4b2-cbcb-4377-8529-5eb2d4b5a209 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:38.474505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f88dad-e10c-485b-8ac2-3feb53195aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:38.477224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f88dad-e10c-485b-8ac2-3feb53195aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:38.478545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f88dad-e10c-485b-8ac2-3feb53195aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:38.481271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f88dad-e10c-485b-8ac2-3feb53195aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:38.482273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f88dad-e10c-485b-8ac2-3feb53195aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:38.492933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f88dad-e10c-485b-8ac2-3feb53195aa5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:38.558001 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1413/2781] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:49:38 2021] POST /identity/v3/projects => generated 401 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:38.562676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d3a23-8d68-4c55-87b2-038174d44e20 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:38.575558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d3a23-8d68-4c55-87b2-038174d44e20 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:38.722091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87892347-f5c4-45ff-aeb5-d352e1645646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:38.723384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87892347-f5c4-45ff-aeb5-d352e1645646 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:38.723733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87892347-f5c4-45ff-aeb5-d352e1645646 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:38.724024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87892347-f5c4-45ff-aeb5-d352e1645646 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:38.726936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87892347-f5c4-45ff-aeb5-d352e1645646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:38.732833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87892347-f5c4-45ff-aeb5-d352e1645646 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:38.786434 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1369/2782] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:49:38 2021] POST /identity/v3/users => generated 301 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:49:38.791350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f88dad-e10c-485b-8ac2-3feb53195aa5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:38.819607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f88dad-e10c-485b-8ac2-3feb53195aa5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:38.842163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5fb16-7079-47aa-bb46-7dce97f6dc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:38.842889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5fb16-7079-47aa-bb46-7dce97f6dc05 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:38.843173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5fb16-7079-47aa-bb46-7dce97f6dc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:38.843599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5fb16-7079-47aa-bb46-7dce97f6dc05 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:38.844349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5fb16-7079-47aa-bb46-7dce97f6dc05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:38.846039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5fb16-7079-47aa-bb46-7dce97f6dc05 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:38.878390 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1414/2783] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:38 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:38.882125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87892347-f5c4-45ff-aeb5-d352e1645646 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:38.897045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87892347-f5c4-45ff-aeb5-d352e1645646 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:38.911326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4139ffb-56b4-4dd6-9718-5cf28067367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:38.911915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4139ffb-56b4-4dd6-9718-5cf28067367b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:38.912200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4139ffb-56b4-4dd6-9718-5cf28067367b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:38.912476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4139ffb-56b4-4dd6-9718-5cf28067367b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:38.913219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4139ffb-56b4-4dd6-9718-5cf28067367b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:38.914857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4139ffb-56b4-4dd6-9718-5cf28067367b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:38.930360 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1370/2784] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:38 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:38.934527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5fb16-7079-47aa-bb46-7dce97f6dc05 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:38.952424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5fb16-7079-47aa-bb46-7dce97f6dc05 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:38.959601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129d7d1-b6d1-4956-98f8-8b7f3d7fbeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:38.960631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129d7d1-b6d1-4956-98f8-8b7f3d7fbeac admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:38.961012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129d7d1-b6d1-4956-98f8-8b7f3d7fbeac admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:38.961634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129d7d1-b6d1-4956-98f8-8b7f3d7fbeac admin admin] PATH_INFO: `/v3/projects/4350ab76ff334917b362c5937d808f56/users/9d5379bd998840179ee97187d9f53788/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:38.979104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129d7d1-b6d1-4956-98f8-8b7f3d7fbeac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4350ab76ff334917b362c5937d808f56, user_id=9d5379bd998840179ee97187d9f53788, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:38.981808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129d7d1-b6d1-4956-98f8-8b7f3d7fbeac admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:39.004669 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1415/2785] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:38 2021] PUT /identity/v3/projects/4350ab76ff334917b362c5937d808f56/users/9d5379bd998840179ee97187d9f53788/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:49:39.092846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7146c28-ae3e-4caf-a8d2-41317f9ac667 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:39.093137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7146c28-ae3e-4caf-a8d2-41317f9ac667 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:39.093423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7146c28-ae3e-4caf-a8d2-41317f9ac667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:39.167669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c7146c28-ae3e-4caf-a8d2-41317f9ac667 None None] MFA Rules not processed for user `9d5379bd998840179ee97187d9f53788`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:39.172717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c7146c28-ae3e-4caf-a8d2-41317f9ac667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:39.383865 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1371/2786] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:39 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:39.547884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129d7d1-b6d1-4956-98f8-8b7f3d7fbeac admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:39.550850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e129d7d1-b6d1-4956-98f8-8b7f3d7fbeac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:39.660861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70434d59-366c-422b-861b-c24d567714bd None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:39.661372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70434d59-366c-422b-861b-c24d567714bd None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:39.661484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70434d59-366c-422b-861b-c24d567714bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:39.687217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-70434d59-366c-422b-861b-c24d567714bd None None] MFA Rules not processed for user `8042de28328d4b26b910f1be4b499879`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:39.690363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-70434d59-366c-422b-861b-c24d567714bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:39.779645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129d7d1-b6d1-4956-98f8-8b7f3d7fbeac admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:39.782941 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1372/2787] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:39 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:49:39.800641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd6abc-d927-4fbe-bd2a-cbf3b2f6f51e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:39.801317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd6abc-d927-4fbe-bd2a-cbf3b2f6f51e service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:39.801605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd6abc-d927-4fbe-bd2a-cbf3b2f6f51e service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:39.801884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd6abc-d927-4fbe-bd2a-cbf3b2f6f51e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:39.837188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd6abc-d927-4fbe-bd2a-cbf3b2f6f51e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:39.841009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd6abc-d927-4fbe-bd2a-cbf3b2f6f51e service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:39.883436 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1416/2788] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:39 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:39.920896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70434d59-366c-422b-861b-c24d567714bd None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:40.071726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70434d59-366c-422b-861b-c24d567714bd None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:40.085652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6213564-55ef-4a46-b741-62723926d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:40.086813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6213564-55ef-4a46-b741-62723926d29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:40.088486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6213564-55ef-4a46-b741-62723926d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:40.088882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6213564-55ef-4a46-b741-62723926d29b admin admin] PATH_INFO: `/v3/users/9d5379bd998840179ee97187d9f53788` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:40.091725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6213564-55ef-4a46-b741-62723926d29b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5379bd998840179ee97187d9f53788)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:40.098284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6213564-55ef-4a46-b741-62723926d29b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:40.201080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b6213564-55ef-4a46-b741-62723926d29b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5379bd998840179ee97187d9f53788'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:40.218339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b6213564-55ef-4a46-b741-62723926d29b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5379bd998840179ee97187d9f53788'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:40.255999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b6213564-55ef-4a46-b741-62723926d29b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5379bd998840179ee97187d9f53788'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:40.257374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b6213564-55ef-4a46-b741-62723926d29b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5379bd998840179ee97187d9f53788'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:40.291364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b6213564-55ef-4a46-b741-62723926d29b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5379bd998840179ee97187d9f53788'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:40.307940 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1373/2789] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:39 2021] DELETE /identity/v3/users/9d5379bd998840179ee97187d9f53788 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:40.312963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867147c0-42f4-4c0d-907b-e3df2731bd45 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:40.314044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867147c0-42f4-4c0d-907b-e3df2731bd45 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:40.314442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867147c0-42f4-4c0d-907b-e3df2731bd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:40.354192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-867147c0-42f4-4c0d-907b-e3df2731bd45 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:40.355920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-867147c0-42f4-4c0d-907b-e3df2731bd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:40.577564 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1417/2790] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:49:40.628265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6213564-55ef-4a46-b741-62723926d29b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:40.630549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b6213564-55ef-4a46-b741-62723926d29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:40.761304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6213564-55ef-4a46-b741-62723926d29b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:40.767691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6b4d1-dc09-45cf-911d-0037515b310c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:40.768571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6b4d1-dc09-45cf-911d-0037515b310c service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:40.769643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6b4d1-dc09-45cf-911d-0037515b310c service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:40.770093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6b4d1-dc09-45cf-911d-0037515b310c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:40.781211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6b4d1-dc09-45cf-911d-0037515b310c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:40.783018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6b4d1-dc09-45cf-911d-0037515b310c service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:40.802779 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1374/2791] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:41.479724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867147c0-42f4-4c0d-907b-e3df2731bd45 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:41.481555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-867147c0-42f4-4c0d-907b-e3df2731bd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:41.527335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867147c0-42f4-4c0d-907b-e3df2731bd45 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:41.543116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5826b-e939-4ee5-b854-e6a44e3f7eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:41.545980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5826b-e939-4ee5-b854-e6a44e3f7eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:41.549128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5826b-e939-4ee5-b854-e6a44e3f7eac admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:41.549535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5826b-e939-4ee5-b854-e6a44e3f7eac admin admin] PATH_INFO: `/v3/projects/4350ab76ff334917b362c5937d808f56` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:41.558433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5826b-e939-4ee5-b854-e6a44e3f7eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4350ab76ff334917b362c5937d808f56)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:41.560767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5826b-e939-4ee5-b854-e6a44e3f7eac admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:41.652312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4ed5826b-e939-4ee5-b854-e6a44e3f7eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4350ab76ff334917b362c5937d808f56', 'request_id': 'req-4ed5826b-e939-4ee5-b854-e6a44e3f7eac'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:41.678097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4ed5826b-e939-4ee5-b854-e6a44e3f7eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4350ab76ff334917b362c5937d808f56', 'request_id': 'req-4ed5826b-e939-4ee5-b854-e6a44e3f7eac'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:41.702487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4ed5826b-e939-4ee5-b854-e6a44e3f7eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4350ab76ff334917b362c5937d808f56', 'request_id': 'req-4ed5826b-e939-4ee5-b854-e6a44e3f7eac'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:41.729462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4ed5826b-e939-4ee5-b854-e6a44e3f7eac admin admin] The token cache is being invalidate because project 4350ab76ff334917b362c5937d808f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:41.729753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4ed5826b-e939-4ee5-b854-e6a44e3f7eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:41.738807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4ed5826b-e939-4ee5-b854-e6a44e3f7eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:41.741022 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1418/2792] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:41 2021] DELETE /identity/v3/projects/4350ab76ff334917b362c5937d808f56 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:41.752378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36dfe8-a286-4d32-949c-619af19fe4de None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:41.753447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36dfe8-a286-4d32-949c-619af19fe4de None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:41.754468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36dfe8-a286-4d32-949c-619af19fe4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:41.791866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1c36dfe8-a286-4d32-949c-619af19fe4de None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:41.794619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1c36dfe8-a286-4d32-949c-619af19fe4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:41.961455 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1375/2793] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:41.969659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bb769-03a0-42e6-a29f-6f147e8e7f85 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:41.974935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bb769-03a0-42e6-a29f-6f147e8e7f85 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:41.975438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bb769-03a0-42e6-a29f-6f147e8e7f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:42.020269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ab9bb769-03a0-42e6-a29f-6f147e8e7f85 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:42.021816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ab9bb769-03a0-42e6-a29f-6f147e8e7f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:42.037279 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1419/2794] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:42.041200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36dfe8-a286-4d32-949c-619af19fe4de None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:42.053129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36dfe8-a286-4d32-949c-619af19fe4de None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:42.073642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e366546-9865-4173-95e7-a66090cbe06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:42.075021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e366546-9865-4173-95e7-a66090cbe06d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:42.075869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e366546-9865-4173-95e7-a66090cbe06d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:42.076478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e366546-9865-4173-95e7-a66090cbe06d admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:42.077592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e366546-9865-4173-95e7-a66090cbe06d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:49:42.078403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e366546-9865-4173-95e7-a66090cbe06d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:42.081496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e366546-9865-4173-95e7-a66090cbe06d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:42.112872 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1376/2795] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:49:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:49:42.116932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bb769-03a0-42e6-a29f-6f147e8e7f85 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:42.134022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bb769-03a0-42e6-a29f-6f147e8e7f85 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:42.156552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a577e-43b8-4405-ba41-73224bd07b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:42.158304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a577e-43b8-4405-ba41-73224bd07b82 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:42.159474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a577e-43b8-4405-ba41-73224bd07b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:42.160004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a577e-43b8-4405-ba41-73224bd07b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:42.161538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a577e-43b8-4405-ba41-73224bd07b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:42.164302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a577e-43b8-4405-ba41-73224bd07b82 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:42.261116 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1420/2796] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:49:42 2021] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:42.263383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e366546-9865-4173-95e7-a66090cbe06d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:42.285156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e366546-9865-4173-95e7-a66090cbe06d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:42.455221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2b711-9dce-4ce6-b41e-8426ab9c3b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:42.456169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2b711-9dce-4ce6-b41e-8426ab9c3b16 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:42.456470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2b711-9dce-4ce6-b41e-8426ab9c3b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:42.457340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2b711-9dce-4ce6-b41e-8426ab9c3b16 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:42.458168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2b711-9dce-4ce6-b41e-8426ab9c3b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:42.460515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2b711-9dce-4ce6-b41e-8426ab9c3b16 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:42.500120 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1377/2797] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:49:42 2021] POST /identity/v3/users => generated 290 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:42.505647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a577e-43b8-4405-ba41-73224bd07b82 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:42.527495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a577e-43b8-4405-ba41-73224bd07b82 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:42.547271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283dde6-e4ce-41db-acee-2e6997f39e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:42.552964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283dde6-e4ce-41db-acee-2e6997f39e5f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:42.553302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283dde6-e4ce-41db-acee-2e6997f39e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:42.555130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283dde6-e4ce-41db-acee-2e6997f39e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:42.555961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283dde6-e4ce-41db-acee-2e6997f39e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:42.560135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283dde6-e4ce-41db-acee-2e6997f39e5f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:42.579248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2b711-9dce-4ce6-b41e-8426ab9c3b16 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:42.581004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a0d2b711-9dce-4ce6-b41e-8426ab9c3b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:42.608453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2b711-9dce-4ce6-b41e-8426ab9c3b16 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:42.620586 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1421/2798] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:42 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:42.623099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283dde6-e4ce-41db-acee-2e6997f39e5f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:42.627112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caad85c-3041-43e8-a5b7-b28ad3c47811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:42.631593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caad85c-3041-43e8-a5b7-b28ad3c47811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:42.632090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caad85c-3041-43e8-a5b7-b28ad3c47811 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:42.633675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caad85c-3041-43e8-a5b7-b28ad3c47811 admin admin] PATH_INFO: `/v3/users/80d2fe33b7664991a494b98128a3f98b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:42.637891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caad85c-3041-43e8-a5b7-b28ad3c47811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80d2fe33b7664991a494b98128a3f98b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:42.644743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caad85c-3041-43e8-a5b7-b28ad3c47811 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:42.661679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283dde6-e4ce-41db-acee-2e6997f39e5f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:42.684863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74830ddc-c324-4dcc-bd37-8f9b442c50dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:42.685983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74830ddc-c324-4dcc-bd37-8f9b442c50dd admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:42.686985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74830ddc-c324-4dcc-bd37-8f9b442c50dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:42.687612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74830ddc-c324-4dcc-bd37-8f9b442c50dd admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:42.691115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74830ddc-c324-4dcc-bd37-8f9b442c50dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:42.697288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74830ddc-c324-4dcc-bd37-8f9b442c50dd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:42.736832 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1422/2799] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:42 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:42.752438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74830ddc-c324-4dcc-bd37-8f9b442c50dd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:42.792588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74830ddc-c324-4dcc-bd37-8f9b442c50dd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:42.804382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2caad85c-3041-43e8-a5b7-b28ad3c47811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80d2fe33b7664991a494b98128a3f98b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:42.810895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea30cad-6bc3-4f4f-a059-67951c6c7307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:42.812026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea30cad-6bc3-4f4f-a059-67951c6c7307 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:42.812325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea30cad-6bc3-4f4f-a059-67951c6c7307 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:42.812650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea30cad-6bc3-4f4f-a059-67951c6c7307 admin admin] PATH_INFO: `/v3/projects/426ef0ab98e5456dbf3a7946e36bd65b/users/6c53046e6cd6479a9a925545c1690117/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:42.834636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea30cad-6bc3-4f4f-a059-67951c6c7307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=426ef0ab98e5456dbf3a7946e36bd65b, user_id=6c53046e6cd6479a9a925545c1690117, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:42.835095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2caad85c-3041-43e8-a5b7-b28ad3c47811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80d2fe33b7664991a494b98128a3f98b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:42.846854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea30cad-6bc3-4f4f-a059-67951c6c7307 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:42.870089 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1423/2800] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:42 2021] PUT /identity/v3/projects/426ef0ab98e5456dbf3a7946e36bd65b/users/6c53046e6cd6479a9a925545c1690117/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:49:42.882324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825ed06-314a-4650-a228-bcc8a270f57f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:42.882657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825ed06-314a-4650-a228-bcc8a270f57f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:42.882948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825ed06-314a-4650-a228-bcc8a270f57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:42.904366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2caad85c-3041-43e8-a5b7-b28ad3c47811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80d2fe33b7664991a494b98128a3f98b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:42.906356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2caad85c-3041-43e8-a5b7-b28ad3c47811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80d2fe33b7664991a494b98128a3f98b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:42.928156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2caad85c-3041-43e8-a5b7-b28ad3c47811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80d2fe33b7664991a494b98128a3f98b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:42.949385 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1378/2801] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:42 2021] DELETE /identity/v3/users/80d2fe33b7664991a494b98128a3f98b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:42.955073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b0736-6e09-45eb-aa9a-4678a0b8e6d5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:42.955392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b0736-6e09-45eb-aa9a-4678a0b8e6d5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:42.955653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b0736-6e09-45eb-aa9a-4678a0b8e6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:42.979324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8825ed06-314a-4650-a228-bcc8a270f57f None None] MFA Rules not processed for user `6c53046e6cd6479a9a925545c1690117`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:42.984408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8825ed06-314a-4650-a228-bcc8a270f57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:43.025503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8d3b0736-6e09-45eb-aa9a-4678a0b8e6d5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:43.030742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8d3b0736-6e09-45eb-aa9a-4678a0b8e6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:43.209286 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1424/2802] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:42 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:43.222145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825ed06-314a-4650-a228-bcc8a270f57f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:43.229283 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1379/2803] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:43.231366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8825ed06-314a-4650-a228-bcc8a270f57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:43.255250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b0736-6e09-45eb-aa9a-4678a0b8e6d5 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:43.257558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8d3b0736-6e09-45eb-aa9a-4678a0b8e6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:43.369111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b0736-6e09-45eb-aa9a-4678a0b8e6d5 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:43.391972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fda8d4-08c4-4837-bf2a-fa468af60ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:43.392795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fda8d4-08c4-4837-bf2a-fa468af60ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:43.393235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fda8d4-08c4-4837-bf2a-fa468af60ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:43.393537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fda8d4-08c4-4837-bf2a-fa468af60ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:43.417975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fda8d4-08c4-4837-bf2a-fa468af60ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:43.420761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fda8d4-08c4-4837-bf2a-fa468af60ec6 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:43.421383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825ed06-314a-4650-a228-bcc8a270f57f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:43.439402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3325d34-2d3e-4611-8290-c9b23df2a038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:43.440335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3325d34-2d3e-4611-8290-c9b23df2a038 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:43.440618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3325d34-2d3e-4611-8290-c9b23df2a038 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:43.440900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3325d34-2d3e-4611-8290-c9b23df2a038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:43.446420 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1380/2804] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:43.454615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3325d34-2d3e-4611-8290-c9b23df2a038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:43.456355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3325d34-2d3e-4611-8290-c9b23df2a038 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:43.486681 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1425/2805] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:43 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:43.551784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fda8d4-08c4-4837-bf2a-fa468af60ec6 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:43.554557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-48fda8d4-08c4-4837-bf2a-fa468af60ec6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:43.599638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fda8d4-08c4-4837-bf2a-fa468af60ec6 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:43.614959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e95e49-6925-47c0-8fb6-0479ed6e4be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:43.619051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e95e49-6925-47c0-8fb6-0479ed6e4be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:43.619285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e95e49-6925-47c0-8fb6-0479ed6e4be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:43.622400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e95e49-6925-47c0-8fb6-0479ed6e4be2 admin admin] PATH_INFO: `/v3/users/6c53046e6cd6479a9a925545c1690117` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:43.627555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e95e49-6925-47c0-8fb6-0479ed6e4be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c53046e6cd6479a9a925545c1690117)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:43.629515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e95e49-6925-47c0-8fb6-0479ed6e4be2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:43.762341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-69e95e49-6925-47c0-8fb6-0479ed6e4be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c53046e6cd6479a9a925545c1690117'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:43.774925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-69e95e49-6925-47c0-8fb6-0479ed6e4be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c53046e6cd6479a9a925545c1690117'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:43.838739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-69e95e49-6925-47c0-8fb6-0479ed6e4be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c53046e6cd6479a9a925545c1690117'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:43.840105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-69e95e49-6925-47c0-8fb6-0479ed6e4be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c53046e6cd6479a9a925545c1690117'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:43.866203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-69e95e49-6925-47c0-8fb6-0479ed6e4be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c53046e6cd6479a9a925545c1690117'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:43.876659 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1381/2806] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:43 2021] DELETE /identity/v3/users/6c53046e6cd6479a9a925545c1690117 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:43.881055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a567e-0300-4898-b8ef-9a6c3fdbfcf2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:43.881603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a567e-0300-4898-b8ef-9a6c3fdbfcf2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:43.881603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a567e-0300-4898-b8ef-9a6c3fdbfcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:43.923956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2d1a567e-0300-4898-b8ef-9a6c3fdbfcf2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:43.936016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2d1a567e-0300-4898-b8ef-9a6c3fdbfcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:44.085270 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1426/2807] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:44.169240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e95e49-6925-47c0-8fb6-0479ed6e4be2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:44.171242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-69e95e49-6925-47c0-8fb6-0479ed6e4be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:44.467322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e95e49-6925-47c0-8fb6-0479ed6e4be2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:44.472751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf9426-6fae-4bc3-8e3f-71fb6e287923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:44.474637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf9426-6fae-4bc3-8e3f-71fb6e287923 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:44.475158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf9426-6fae-4bc3-8e3f-71fb6e287923 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:44.475655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf9426-6fae-4bc3-8e3f-71fb6e287923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:44.513361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf9426-6fae-4bc3-8e3f-71fb6e287923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:44.515908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf9426-6fae-4bc3-8e3f-71fb6e287923 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:44.545999 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1382/2808] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:44.892108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a567e-0300-4898-b8ef-9a6c3fdbfcf2 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:44.893539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2d1a567e-0300-4898-b8ef-9a6c3fdbfcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:44.931657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a567e-0300-4898-b8ef-9a6c3fdbfcf2 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:44.960612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff094f-ad34-4cd0-b0d0-b7e09c921987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:44.961516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff094f-ad34-4cd0-b0d0-b7e09c921987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:44.961796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff094f-ad34-4cd0-b0d0-b7e09c921987 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:44.962067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff094f-ad34-4cd0-b0d0-b7e09c921987 admin admin] PATH_INFO: `/v3/projects/b1c3c6cad11948f58170343d52ca3439` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:44.963852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff094f-ad34-4cd0-b0d0-b7e09c921987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1c3c6cad11948f58170343d52ca3439)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:44.965766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff094f-ad34-4cd0-b0d0-b7e09c921987 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:45.135122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-deff094f-ad34-4cd0-b0d0-b7e09c921987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c3c6cad11948f58170343d52ca3439', 'request_id': 'req-deff094f-ad34-4cd0-b0d0-b7e09c921987'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:45.150832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-deff094f-ad34-4cd0-b0d0-b7e09c921987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c3c6cad11948f58170343d52ca3439', 'request_id': 'req-deff094f-ad34-4cd0-b0d0-b7e09c921987'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:45.174749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-deff094f-ad34-4cd0-b0d0-b7e09c921987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c3c6cad11948f58170343d52ca3439', 'request_id': 'req-deff094f-ad34-4cd0-b0d0-b7e09c921987'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:45.201729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-deff094f-ad34-4cd0-b0d0-b7e09c921987 admin admin] The token cache is being invalidate because project b1c3c6cad11948f58170343d52ca3439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:45.202153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-deff094f-ad34-4cd0-b0d0-b7e09c921987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:45.203552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-deff094f-ad34-4cd0-b0d0-b7e09c921987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:45.207876 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1427/2809] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:44 2021] DELETE /identity/v3/projects/b1c3c6cad11948f58170343d52ca3439 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:45.215463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e40df-2ace-475d-90a8-ef5d4d4674d4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:45.216048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e40df-2ace-475d-90a8-ef5d4d4674d4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:45.216221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e40df-2ace-475d-90a8-ef5d4d4674d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:45.246787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d80e40df-2ace-475d-90a8-ef5d4d4674d4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:45.248030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d80e40df-2ace-475d-90a8-ef5d4d4674d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:45.426345 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1383/2810] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:45.434202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7687c41-8f07-4ff9-8646-0a6b590a6a49 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:45.435974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7687c41-8f07-4ff9-8646-0a6b590a6a49 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:45.436265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7687c41-8f07-4ff9-8646-0a6b590a6a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:45.484173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b7687c41-8f07-4ff9-8646-0a6b590a6a49 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:45.485940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b7687c41-8f07-4ff9-8646-0a6b590a6a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:45.508764 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1428/2811] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:45.512702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e40df-2ace-475d-90a8-ef5d4d4674d4 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:45.529891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e40df-2ace-475d-90a8-ef5d4d4674d4 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:45.546384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b64dbf-cb12-4134-9c0f-4c329579111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:45.547312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b64dbf-cb12-4134-9c0f-4c329579111f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:45.548351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b64dbf-cb12-4134-9c0f-4c329579111f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:45.549010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b64dbf-cb12-4134-9c0f-4c329579111f admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:45.550053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b64dbf-cb12-4134-9c0f-4c329579111f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:49:45.551032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b64dbf-cb12-4134-9c0f-4c329579111f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:45.553628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b64dbf-cb12-4134-9c0f-4c329579111f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:45.599158 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1384/2812] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:49:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:49:45.602444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7687c41-8f07-4ff9-8646-0a6b590a6a49 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:45.617444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7687c41-8f07-4ff9-8646-0a6b590a6a49 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:45.650184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ac507-9237-42dc-868d-38bf4d029777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:45.650932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ac507-9237-42dc-868d-38bf4d029777 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:45.651222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ac507-9237-42dc-868d-38bf4d029777 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:45.651735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ac507-9237-42dc-868d-38bf4d029777 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:45.652476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ac507-9237-42dc-868d-38bf4d029777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:45.654433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ac507-9237-42dc-868d-38bf4d029777 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:45.667665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b64dbf-cb12-4134-9c0f-4c329579111f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:45.676362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-34b64dbf-cb12-4134-9c0f-4c329579111f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:45.714235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b64dbf-cb12-4134-9c0f-4c329579111f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:45.724643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe30a3f-a589-4ff5-872d-f94533d1cd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:45.726868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe30a3f-a589-4ff5-872d-f94533d1cd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:45.727407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe30a3f-a589-4ff5-872d-f94533d1cd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:45.728153 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1429/2813] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:49:45 2021] POST /identity/v3/projects => generated 397 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:45.728969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe30a3f-a589-4ff5-872d-f94533d1cd99 admin admin] PATH_INFO: `/v3/users/ea2400b9f82c494584a5226d1d74177e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:45.733277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe30a3f-a589-4ff5-872d-f94533d1cd99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2400b9f82c494584a5226d1d74177e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:45.736374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ac507-9237-42dc-868d-38bf4d029777 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:45.736809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe30a3f-a589-4ff5-872d-f94533d1cd99 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:45.839564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6fe30a3f-a589-4ff5-872d-f94533d1cd99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2400b9f82c494584a5226d1d74177e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:45.874367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6fe30a3f-a589-4ff5-872d-f94533d1cd99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2400b9f82c494584a5226d1d74177e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:45.905062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ac507-9237-42dc-868d-38bf4d029777 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:45.911133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6fe30a3f-a589-4ff5-872d-f94533d1cd99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2400b9f82c494584a5226d1d74177e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:45.914930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ecbcf-6724-42d9-8946-11634aa2305d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:45.915747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ecbcf-6724-42d9-8946-11634aa2305d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:45.916043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ecbcf-6724-42d9-8946-11634aa2305d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:45.916325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ecbcf-6724-42d9-8946-11634aa2305d admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:45.917301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ecbcf-6724-42d9-8946-11634aa2305d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:45.917468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6fe30a3f-a589-4ff5-872d-f94533d1cd99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2400b9f82c494584a5226d1d74177e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:45.920093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ecbcf-6724-42d9-8946-11634aa2305d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:45.941325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6fe30a3f-a589-4ff5-872d-f94533d1cd99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2400b9f82c494584a5226d1d74177e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:45.952214 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1385/2814] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:45 2021] DELETE /identity/v3/users/ea2400b9f82c494584a5226d1d74177e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:45.974780 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1430/2815] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:49:45 2021] POST /identity/v3/users => generated 299 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:45.978900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe30a3f-a589-4ff5-872d-f94533d1cd99 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:45.981043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6fe30a3f-a589-4ff5-872d-f94533d1cd99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:46.135980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ecbcf-6724-42d9-8946-11634aa2305d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:46.141146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cb0ecbcf-6724-42d9-8946-11634aa2305d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:46.155968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe30a3f-a589-4ff5-872d-f94533d1cd99 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:46.172572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ecbcf-6724-42d9-8946-11634aa2305d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:46.199163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa518b-e51c-4e91-94b1-d50c5ec4db88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:46.199855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa518b-e51c-4e91-94b1-d50c5ec4db88 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:46.200145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa518b-e51c-4e91-94b1-d50c5ec4db88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:46.200424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa518b-e51c-4e91-94b1-d50c5ec4db88 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:46.201140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caf805-e9f4-4cf8-93cc-103f8f322279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:46.201281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa518b-e51c-4e91-94b1-d50c5ec4db88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:46.202782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa518b-e51c-4e91-94b1-d50c5ec4db88 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:46.203171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caf805-e9f4-4cf8-93cc-103f8f322279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:46.205275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caf805-e9f4-4cf8-93cc-103f8f322279 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:46.205793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caf805-e9f4-4cf8-93cc-103f8f322279 admin admin] PATH_INFO: `/v3/projects/426ef0ab98e5456dbf3a7946e36bd65b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:46.209891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50caf805-e9f4-4cf8-93cc-103f8f322279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=426ef0ab98e5456dbf3a7946e36bd65b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:46.212238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50caf805-e9f4-4cf8-93cc-103f8f322279 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:46.228966 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1386/2816] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:45 2021] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:46.232841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa518b-e51c-4e91-94b1-d50c5ec4db88 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:46.253511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa518b-e51c-4e91-94b1-d50c5ec4db88 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:46.260737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afe761-d003-42cc-88cd-5df7aa2c7f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:46.261634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afe761-d003-42cc-88cd-5df7aa2c7f7f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:46.261929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afe761-d003-42cc-88cd-5df7aa2c7f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:46.262213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afe761-d003-42cc-88cd-5df7aa2c7f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:46.263696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afe761-d003-42cc-88cd-5df7aa2c7f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:46.265845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afe761-d003-42cc-88cd-5df7aa2c7f7f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:46.292314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-50caf805-e9f4-4cf8-93cc-103f8f322279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426ef0ab98e5456dbf3a7946e36bd65b', 'request_id': 'req-50caf805-e9f4-4cf8-93cc-103f8f322279'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:46.307480 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1387/2817] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:46 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:46.311058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afe761-d003-42cc-88cd-5df7aa2c7f7f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:46.312323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-50caf805-e9f4-4cf8-93cc-103f8f322279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426ef0ab98e5456dbf3a7946e36bd65b', 'request_id': 'req-50caf805-e9f4-4cf8-93cc-103f8f322279'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:46.323827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-50caf805-e9f4-4cf8-93cc-103f8f322279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426ef0ab98e5456dbf3a7946e36bd65b', 'request_id': 'req-50caf805-e9f4-4cf8-93cc-103f8f322279'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:46.348321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afe761-d003-42cc-88cd-5df7aa2c7f7f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:46.372252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-50caf805-e9f4-4cf8-93cc-103f8f322279 admin admin] The token cache is being invalidate because project 426ef0ab98e5456dbf3a7946e36bd65b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:46.373990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-50caf805-e9f4-4cf8-93cc-103f8f322279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:46.374830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-50caf805-e9f4-4cf8-93cc-103f8f322279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:46.376724 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1431/2818] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:46 2021] DELETE /identity/v3/projects/426ef0ab98e5456dbf3a7946e36bd65b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:49:46.378492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caf805-e9f4-4cf8-93cc-103f8f322279 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:46.380807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-50caf805-e9f4-4cf8-93cc-103f8f322279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:46.499229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caf805-e9f4-4cf8-93cc-103f8f322279 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:46.506235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e4901-e3e0-497d-9160-b355099c8ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:46.507850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e4901-e3e0-497d-9160-b355099c8ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:46.508297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e4901-e3e0-497d-9160-b355099c8ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:46.508739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e4901-e3e0-497d-9160-b355099c8ff6 admin admin] PATH_INFO: `/v3/projects/29a831462611445ebb7256a4c8b657a0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:46.511099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e4901-e3e0-497d-9160-b355099c8ff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29a831462611445ebb7256a4c8b657a0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:46.514168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e4901-e3e0-497d-9160-b355099c8ff6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:46.524081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfb80f-35df-4166-a825-9554f5d90fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:46.525837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfb80f-35df-4166-a825-9554f5d90fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:46.526937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfb80f-35df-4166-a825-9554f5d90fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:46.528114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfb80f-35df-4166-a825-9554f5d90fc8 admin admin] PATH_INFO: `/v3/projects/bae2790bf06f4bf2850c2d3868a968e5/users/48a3ba54e8544d1b8145b4299cbbb9b2/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:46.562332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfb80f-35df-4166-a825-9554f5d90fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae2790bf06f4bf2850c2d3868a968e5, user_id=48a3ba54e8544d1b8145b4299cbbb9b2, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:46.569313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfb80f-35df-4166-a825-9554f5d90fc8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:46.585749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2b0e4901-e3e0-497d-9160-b355099c8ff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29a831462611445ebb7256a4c8b657a0', 'request_id': 'req-2b0e4901-e3e0-497d-9160-b355099c8ff6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:46.595662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2b0e4901-e3e0-497d-9160-b355099c8ff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29a831462611445ebb7256a4c8b657a0', 'request_id': 'req-2b0e4901-e3e0-497d-9160-b355099c8ff6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:46.605503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2b0e4901-e3e0-497d-9160-b355099c8ff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29a831462611445ebb7256a4c8b657a0', 'request_id': 'req-2b0e4901-e3e0-497d-9160-b355099c8ff6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:46.608447 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1388/2819] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:46 2021] PUT /identity/v3/projects/bae2790bf06f4bf2850c2d3868a968e5/users/48a3ba54e8544d1b8145b4299cbbb9b2/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:49:46.610640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2142b-2e64-4ac8-bc72-4d60a0ff95dc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:46.611133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2142b-2e64-4ac8-bc72-4d60a0ff95dc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:46.611610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2142b-2e64-4ac8-bc72-4d60a0ff95dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:46.638175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2b0e4901-e3e0-497d-9160-b355099c8ff6 admin admin] The token cache is being invalidate because project 29a831462611445ebb7256a4c8b657a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:46.638787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2b0e4901-e3e0-497d-9160-b355099c8ff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:46.640077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2b0e4901-e3e0-497d-9160-b355099c8ff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:46.641172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6fa2142b-2e64-4ac8-bc72-4d60a0ff95dc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:46.643820 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1432/2820] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:46 2021] DELETE /identity/v3/projects/29a831462611445ebb7256a4c8b657a0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:46.645129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b657d55-cf75-444a-9e6d-7939761c8deb None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:46.645396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b657d55-cf75-444a-9e6d-7939761c8deb None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:46.645671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b657d55-cf75-444a-9e6d-7939761c8deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:46.648789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6fa2142b-2e64-4ac8-bc72-4d60a0ff95dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:46.707934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4b657d55-cf75-444a-9e6d-7939761c8deb None None] MFA Rules not processed for user `48a3ba54e8544d1b8145b4299cbbb9b2`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:46.711902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4b657d55-cf75-444a-9e6d-7939761c8deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:46.830778 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1389/2821] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:46.832350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2df040-fa20-4491-8224-6c276f165884 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:46.832797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2df040-fa20-4491-8224-6c276f165884 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:46.833074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2df040-fa20-4491-8224-6c276f165884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:46.877900 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1433/2822] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:46 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:46.879347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c0619-7959-40d4-8f40-da15e87e70ce None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:46.879635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c0619-7959-40d4-8f40-da15e87e70ce None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:46.879915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c0619-7959-40d4-8f40-da15e87e70ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:46.880644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fd2df040-fa20-4491-8224-6c276f165884 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:46.881990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fd2df040-fa20-4491-8224-6c276f165884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:46.902614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0c6c0619-7959-40d4-8f40-da15e87e70ce None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:46.904057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0c6c0619-7959-40d4-8f40-da15e87e70ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:46.911124 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1390/2823] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:46.912627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219aa588-2c3d-4d92-b92d-a25de320579d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:46.912919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219aa588-2c3d-4d92-b92d-a25de320579d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:46.913201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219aa588-2c3d-4d92-b92d-a25de320579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:46.914705 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1434/2824] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:46.916366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c8cf0-24af-4ec1-a753-83dc109d8180 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:46.916750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c8cf0-24af-4ec1-a753-83dc109d8180 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:46.917173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c8cf0-24af-4ec1-a753-83dc109d8180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:46.941882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b86c8cf0-24af-4ec1-a753-83dc109d8180 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:46.948367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b86c8cf0-24af-4ec1-a753-83dc109d8180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:46.952916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-219aa588-2c3d-4d92-b92d-a25de320579d None None] MFA Rules not processed for user `48a3ba54e8544d1b8145b4299cbbb9b2`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:46.954191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-219aa588-2c3d-4d92-b92d-a25de320579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:46.958203 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1435/2825] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:46.959322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c8cf0-24af-4ec1-a753-83dc109d8180 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:46.972887 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1391/2826] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:46 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:46.974015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219aa588-2c3d-4d92-b92d-a25de320579d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:46.993243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c8cf0-24af-4ec1-a753-83dc109d8180 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:46.998312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219aa588-2c3d-4d92-b92d-a25de320579d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:47.005949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b43ea-f520-43bd-9dbe-9a093789595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:47.006815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b43ea-f520-43bd-9dbe-9a093789595d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:47.007197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b43ea-f520-43bd-9dbe-9a093789595d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:47.007571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b43ea-f520-43bd-9dbe-9a093789595d admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:47.008436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b43ea-f520-43bd-9dbe-9a093789595d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:49:47.008858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b43ea-f520-43bd-9dbe-9a093789595d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:47.011054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b43ea-f520-43bd-9dbe-9a093789595d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:47.019869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51679957-7cc4-4625-af22-b3f1a7a1ece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:47.020839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51679957-7cc4-4625-af22-b3f1a7a1ece5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:47.021277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51679957-7cc4-4625-af22-b3f1a7a1ece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:47.021715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51679957-7cc4-4625-af22-b3f1a7a1ece5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:47.022498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51679957-7cc4-4625-af22-b3f1a7a1ece5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:49:47.022809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51679957-7cc4-4625-af22-b3f1a7a1ece5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:47.024437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51679957-7cc4-4625-af22-b3f1a7a1ece5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:47.025754 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1436/2827] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:49:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:49:47.026931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b43ea-f520-43bd-9dbe-9a093789595d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:47.028751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a54b43ea-f520-43bd-9dbe-9a093789595d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:47.050567 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1392/2828] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:49:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:49:47.055262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51679957-7cc4-4625-af22-b3f1a7a1ece5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:47.089793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51679957-7cc4-4625-af22-b3f1a7a1ece5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:47.099901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116c00c-e164-4ce3-a556-3f152f93dddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:47.100918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116c00c-e164-4ce3-a556-3f152f93dddd admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:47.101215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116c00c-e164-4ce3-a556-3f152f93dddd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:47.102035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116c00c-e164-4ce3-a556-3f152f93dddd admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:47.103169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116c00c-e164-4ce3-a556-3f152f93dddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:47.105088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116c00c-e164-4ce3-a556-3f152f93dddd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:47.142802 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1393/2829] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:49:47 2021] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:47.143823 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116c00c-e164-4ce3-a556-3f152f93dddd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:47.177097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b43ea-f520-43bd-9dbe-9a093789595d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:47.287678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116c00c-e164-4ce3-a556-3f152f93dddd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:47.296820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783c0ea-2eef-4fdd-b9de-81d38e082b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:47.297738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783c0ea-2eef-4fdd-b9de-81d38e082b4d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:47.300023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783c0ea-2eef-4fdd-b9de-81d38e082b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:47.300023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783c0ea-2eef-4fdd-b9de-81d38e082b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:47.300023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783c0ea-2eef-4fdd-b9de-81d38e082b4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:47.308293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783c0ea-2eef-4fdd-b9de-81d38e082b4d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:47.331541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9ab0c-5149-4550-8bf5-4a26da0f92d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:47.332325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9ab0c-5149-4550-8bf5-4a26da0f92d5 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:47.333435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9ab0c-5149-4550-8bf5-4a26da0f92d5 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:47.333832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9ab0c-5149-4550-8bf5-4a26da0f92d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:47.363056 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1394/2830] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:49:47 2021] POST /identity/v3/projects => generated 397 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:47.364719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783c0ea-2eef-4fdd-b9de-81d38e082b4d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:47.419458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9ab0c-5149-4550-8bf5-4a26da0f92d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:47.424320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9ab0c-5149-4550-8bf5-4a26da0f92d5 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:47.451152 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1437/2831] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:47 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:47.452032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9ab0c-5149-4550-8bf5-4a26da0f92d5 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:47.477851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9ab0c-5149-4550-8bf5-4a26da0f92d5 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:47.510362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783c0ea-2eef-4fdd-b9de-81d38e082b4d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:47.516604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4015d2a-e502-45e8-a803-4cec455ee984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:47.517514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4015d2a-e502-45e8-a803-4cec455ee984 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:47.517957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4015d2a-e502-45e8-a803-4cec455ee984 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:47.518452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4015d2a-e502-45e8-a803-4cec455ee984 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:47.519557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4015d2a-e502-45e8-a803-4cec455ee984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:47.524680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4015d2a-e502-45e8-a803-4cec455ee984 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:47.584069 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1395/2832] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:49:47 2021] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:47.586997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c7790-16ec-4640-b67e-48cd2e64736e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:47.587531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c7790-16ec-4640-b67e-48cd2e64736e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:47.588320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c7790-16ec-4640-b67e-48cd2e64736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:47.616977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6169fe0-208b-47c7-93c5-908840a6251c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:47.617651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6169fe0-208b-47c7-93c5-908840a6251c admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:47.617951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6169fe0-208b-47c7-93c5-908840a6251c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:47.618203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6169fe0-208b-47c7-93c5-908840a6251c admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:47.618959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6169fe0-208b-47c7-93c5-908840a6251c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:47.621021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6169fe0-208b-47c7-93c5-908840a6251c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:47.626855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ac0c7790-16ec-4640-b67e-48cd2e64736e None None] MFA Rules not processed for user `48a3ba54e8544d1b8145b4299cbbb9b2`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:47.628323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ac0c7790-16ec-4640-b67e-48cd2e64736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:47.650683 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1438/2833] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:49:47 2021] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:47.651963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6169fe0-208b-47c7-93c5-908840a6251c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:47.663050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6169fe0-208b-47c7-93c5-908840a6251c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:47.670433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2746e0-58ef-4b7a-84c5-9b3fda3a83ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:47.671292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2746e0-58ef-4b7a-84c5-9b3fda3a83ad admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:47.671582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2746e0-58ef-4b7a-84c5-9b3fda3a83ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:47.671865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2746e0-58ef-4b7a-84c5-9b3fda3a83ad admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:47.673155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2746e0-58ef-4b7a-84c5-9b3fda3a83ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:47.675583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2746e0-58ef-4b7a-84c5-9b3fda3a83ad admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:47.698405 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1439/2834] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:47 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:47.702938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2746e0-58ef-4b7a-84c5-9b3fda3a83ad admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:47.721178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2746e0-58ef-4b7a-84c5-9b3fda3a83ad admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:47.737363 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1396/2835] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:47 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:47.737363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c7790-16ec-4640-b67e-48cd2e64736e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:47.747014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d72b45-1e51-43e4-becf-6c393ed7d762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:47.747693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d72b45-1e51-43e4-becf-6c393ed7d762 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:47.748946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d72b45-1e51-43e4-becf-6c393ed7d762 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:47.749231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d72b45-1e51-43e4-becf-6c393ed7d762 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:47.750039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d72b45-1e51-43e4-becf-6c393ed7d762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:47.756367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c7790-16ec-4640-b67e-48cd2e64736e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:47.758597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d72b45-1e51-43e4-becf-6c393ed7d762 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:47.769443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd4c2f-a04a-48c3-b34c-40418a0550e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:47.771026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd4c2f-a04a-48c3-b34c-40418a0550e6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:47.771297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd4c2f-a04a-48c3-b34c-40418a0550e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:47.771590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd4c2f-a04a-48c3-b34c-40418a0550e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:47.772332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd4c2f-a04a-48c3-b34c-40418a0550e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:47.774768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd4c2f-a04a-48c3-b34c-40418a0550e6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:47.799635 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1440/2836] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:47 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:47.801260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ce99c-e26a-4b96-ab26-c4a76ad1372e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:47.802163 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1397/2837] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:47 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:47.804978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ce99c-e26a-4b96-ab26-c4a76ad1372e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:47.805419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ce99c-e26a-4b96-ab26-c4a76ad1372e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:47.806634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd4c2f-a04a-48c3-b34c-40418a0550e6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:47.819570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd4c2f-a04a-48c3-b34c-40418a0550e6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:47.828598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3b3bb-dba7-4d84-ba16-2e9c35e20472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:47.829909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3b3bb-dba7-4d84-ba16-2e9c35e20472 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:47.830277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3b3bb-dba7-4d84-ba16-2e9c35e20472 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:47.830681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3b3bb-dba7-4d84-ba16-2e9c35e20472 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:47.831493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3b3bb-dba7-4d84-ba16-2e9c35e20472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:47.833312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3b3bb-dba7-4d84-ba16-2e9c35e20472 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:47.846273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-510ce99c-e26a-4b96-ab26-c4a76ad1372e None None] MFA Rules not processed for user `48a3ba54e8544d1b8145b4299cbbb9b2`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:47.847362 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1398/2838] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:47 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:47.848266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3b3bb-dba7-4d84-ba16-2e9c35e20472 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:47.850878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-510ce99c-e26a-4b96-ab26-c4a76ad1372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:47.859413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3b3bb-dba7-4d84-ba16-2e9c35e20472 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:47.865031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f83a4c-8702-42d3-a6bb-0675576a83af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:47.865993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83a4c-8702-42d3-a6bb-0675576a83af admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:47.866824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83a4c-8702-42d3-a6bb-0675576a83af admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:47.867194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83a4c-8702-42d3-a6bb-0675576a83af admin admin] PATH_INFO: `/v3/projects/260f5423c9c44b499073e360e0e66264/users/8cf273e7f6d646c4a6c46bc7a197c6a3/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:47.870920 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1441/2839] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:47 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:47.871814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ce99c-e26a-4b96-ab26-c4a76ad1372e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:47.889122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f83a4c-8702-42d3-a6bb-0675576a83af admin admin] RBAC: Authorizing `identity:create_grant(project_id=260f5423c9c44b499073e360e0e66264, user_id=8cf273e7f6d646c4a6c46bc7a197c6a3, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:47.893860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f83a4c-8702-42d3-a6bb-0675576a83af admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:47.894388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ce99c-e26a-4b96-ab26-c4a76ad1372e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:47.902525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba624ed-85e9-4c29-9e5e-24314b4f5a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:47.905696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba624ed-85e9-4c29-9e5e-24314b4f5a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:47.906168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba624ed-85e9-4c29-9e5e-24314b4f5a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:47.906696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba624ed-85e9-4c29-9e5e-24314b4f5a4e admin admin] PATH_INFO: `/v3/projects/5ae570bf047a422aa4397c0eb9b70183/users/e5b80a8a653e4d3ebd71679179f8c678/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:47.926607 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1399/2840] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:47 2021] PUT /identity/v3/projects/260f5423c9c44b499073e360e0e66264/users/8cf273e7f6d646c4a6c46bc7a197c6a3/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:47.932923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4a23c-657c-47c5-80bd-9f2eaa1ae1f4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:47.933387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4a23c-657c-47c5-80bd-9f2eaa1ae1f4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:47.933807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4a23c-657c-47c5-80bd-9f2eaa1ae1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:47.936712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba624ed-85e9-4c29-9e5e-24314b4f5a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae570bf047a422aa4397c0eb9b70183, user_id=e5b80a8a653e4d3ebd71679179f8c678, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:47.940827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba624ed-85e9-4c29-9e5e-24314b4f5a4e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:47.970383 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1442/2841] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:47 2021] PUT /identity/v3/projects/5ae570bf047a422aa4397c0eb9b70183/users/e5b80a8a653e4d3ebd71679179f8c678/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:47.971717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fe220-9edf-4227-9ff2-5e3bc763ad56 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:47.972010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fe220-9edf-4227-9ff2-5e3bc763ad56 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:47.972288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fe220-9edf-4227-9ff2-5e3bc763ad56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:47.974456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-adf4a23c-657c-47c5-80bd-9f2eaa1ae1f4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:47.977781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-adf4a23c-657c-47c5-80bd-9f2eaa1ae1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:47.994219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-424fe220-9edf-4227-9ff2-5e3bc763ad56 None None] MFA Rules not processed for user `48a3ba54e8544d1b8145b4299cbbb9b2`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:47.995179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-424fe220-9edf-4227-9ff2-5e3bc763ad56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:48.072662 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1400/2842] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:48.074243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d416a-19f7-4599-9699-62cfe72aa439 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:48.074803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d416a-19f7-4599-9699-62cfe72aa439 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:48.075091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d416a-19f7-4599-9699-62cfe72aa439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:48.080233 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1443/2843] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:47 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:48.088169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fe220-9edf-4227-9ff2-5e3bc763ad56 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:48.089949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-424fe220-9edf-4227-9ff2-5e3bc763ad56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:48.119548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ef0d416a-19f7-4599-9699-62cfe72aa439 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:48.121275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ef0d416a-19f7-4599-9699-62cfe72aa439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:48.132459 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1401/2844] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:48.133823 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191b3ba-3ebb-4c7d-84c0-c0f3c7c12654 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:48.134115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191b3ba-3ebb-4c7d-84c0-c0f3c7c12654 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:48.134427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191b3ba-3ebb-4c7d-84c0-c0f3c7c12654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:48.163546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6191b3ba-3ebb-4c7d-84c0-c0f3c7c12654 None None] MFA Rules not processed for user `48a3ba54e8544d1b8145b4299cbbb9b2`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:48.164810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6191b3ba-3ebb-4c7d-84c0-c0f3c7c12654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:48.187282 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1402/2845] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:48 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:48.187477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fe220-9edf-4227-9ff2-5e3bc763ad56 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:48.187565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191b3ba-3ebb-4c7d-84c0-c0f3c7c12654 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:48.191032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1fc74-dc2c-4900-a361-665cd52f386c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:48.191693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1fc74-dc2c-4900-a361-665cd52f386c service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:48.191974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1fc74-dc2c-4900-a361-665cd52f386c service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:48.192250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1fc74-dc2c-4900-a361-665cd52f386c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:48.212422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1fc74-dc2c-4900-a361-665cd52f386c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:48.215491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1fc74-dc2c-4900-a361-665cd52f386c service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:48.217292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191b3ba-3ebb-4c7d-84c0-c0f3c7c12654 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:48.221329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82f448-2dc1-453e-a771-85824b204b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:48.224230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82f448-2dc1-453e-a771-85824b204b93 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:48.224230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82f448-2dc1-453e-a771-85824b204b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:48.224230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82f448-2dc1-453e-a771-85824b204b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:48.233458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82f448-2dc1-453e-a771-85824b204b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:48.234972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82f448-2dc1-453e-a771-85824b204b93 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:48.235969 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1444/2846] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:48.237273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1fc74-dc2c-4900-a361-665cd52f386c service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:48.239008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d7d1fc74-dc2c-4900-a361-665cd52f386c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:48.262439 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1403/2847] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:48.264837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1fc74-dc2c-4900-a361-665cd52f386c service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:48.272957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbecc7-07b0-45b6-8502-0e1b507f2076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:48.274339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbecc7-07b0-45b6-8502-0e1b507f2076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:48.274725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbecc7-07b0-45b6-8502-0e1b507f2076 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:48.275600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbecc7-07b0-45b6-8502-0e1b507f2076 admin admin] PATH_INFO: `/v3/users/48a3ba54e8544d1b8145b4299cbbb9b2` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:48.280588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbecc7-07b0-45b6-8502-0e1b507f2076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48a3ba54e8544d1b8145b4299cbbb9b2)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:48.284383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbecc7-07b0-45b6-8502-0e1b507f2076 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:48.375482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-77cbecc7-07b0-45b6-8502-0e1b507f2076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48a3ba54e8544d1b8145b4299cbbb9b2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:48.391632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-77cbecc7-07b0-45b6-8502-0e1b507f2076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48a3ba54e8544d1b8145b4299cbbb9b2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:48.392812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-77cbecc7-07b0-45b6-8502-0e1b507f2076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48a3ba54e8544d1b8145b4299cbbb9b2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:48.420625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-77cbecc7-07b0-45b6-8502-0e1b507f2076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48a3ba54e8544d1b8145b4299cbbb9b2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:48.438951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-77cbecc7-07b0-45b6-8502-0e1b507f2076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48a3ba54e8544d1b8145b4299cbbb9b2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:48.448895 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1445/2848] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:48 2021] DELETE /identity/v3/users/48a3ba54e8544d1b8145b4299cbbb9b2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:48.453767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ca4d4-3159-4804-823f-76dab12fa98b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:48.454490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ca4d4-3159-4804-823f-76dab12fa98b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:48.454650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ca4d4-3159-4804-823f-76dab12fa98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:48.479911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e01ca4d4-3159-4804-823f-76dab12fa98b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:48.481314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e01ca4d4-3159-4804-823f-76dab12fa98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:48.569800 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1404/2849] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:48.609834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbecc7-07b0-45b6-8502-0e1b507f2076 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:48.611285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-77cbecc7-07b0-45b6-8502-0e1b507f2076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:48.751842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbecc7-07b0-45b6-8502-0e1b507f2076 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:48.757448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a376d-848c-44b1-8e97-99516037c6a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:48.758432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a376d-848c-44b1-8e97-99516037c6a8 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:48.758927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a376d-848c-44b1-8e97-99516037c6a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:48.759397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a376d-848c-44b1-8e97-99516037c6a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:48.786062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a376d-848c-44b1-8e97-99516037c6a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:48.789369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a376d-848c-44b1-8e97-99516037c6a8 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:48.806882 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1446/2850] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:49.794884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ca4d4-3159-4804-823f-76dab12fa98b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:49.796741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e01ca4d4-3159-4804-823f-76dab12fa98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:49.838840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ca4d4-3159-4804-823f-76dab12fa98b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:49.855078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aba68-e273-4e32-a50b-271e8bac52c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:49.856831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aba68-e273-4e32-a50b-271e8bac52c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:49.857579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aba68-e273-4e32-a50b-271e8bac52c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:49.859754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aba68-e273-4e32-a50b-271e8bac52c9 admin admin] PATH_INFO: `/v3/projects/bae2790bf06f4bf2850c2d3868a968e5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:49.862591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aba68-e273-4e32-a50b-271e8bac52c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bae2790bf06f4bf2850c2d3868a968e5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:49.863830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade42b47-555c-44fc-b376-1018dcbea2b0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:49.864939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade42b47-555c-44fc-b376-1018dcbea2b0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:49.865397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade42b47-555c-44fc-b376-1018dcbea2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:49.866959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aba68-e273-4e32-a50b-271e8bac52c9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:49.942471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ade42b47-555c-44fc-b376-1018dcbea2b0 None None] MFA Rules not processed for user `e5b80a8a653e4d3ebd71679179f8c678`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:49.944196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ade42b47-555c-44fc-b376-1018dcbea2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:49.960297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4f3aba68-e273-4e32-a50b-271e8bac52c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bae2790bf06f4bf2850c2d3868a968e5', 'request_id': 'req-4f3aba68-e273-4e32-a50b-271e8bac52c9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:49.971968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4f3aba68-e273-4e32-a50b-271e8bac52c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bae2790bf06f4bf2850c2d3868a968e5', 'request_id': 'req-4f3aba68-e273-4e32-a50b-271e8bac52c9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:49.980844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4f3aba68-e273-4e32-a50b-271e8bac52c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bae2790bf06f4bf2850c2d3868a968e5', 'request_id': 'req-4f3aba68-e273-4e32-a50b-271e8bac52c9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:50.010056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4f3aba68-e273-4e32-a50b-271e8bac52c9 admin admin] The token cache is being invalidate because project bae2790bf06f4bf2850c2d3868a968e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:50.010460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4f3aba68-e273-4e32-a50b-271e8bac52c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:50.012538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4f3aba68-e273-4e32-a50b-271e8bac52c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:50.022374 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1405/2851] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:49 2021] DELETE /identity/v3/projects/bae2790bf06f4bf2850c2d3868a968e5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:50.026222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418030d-44f6-45ea-b381-eaa2ca5c6442 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:50.028711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418030d-44f6-45ea-b381-eaa2ca5c6442 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:50.028877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418030d-44f6-45ea-b381-eaa2ca5c6442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:50.081248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f418030d-44f6-45ea-b381-eaa2ca5c6442 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:50.083378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f418030d-44f6-45ea-b381-eaa2ca5c6442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:50.086903 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1447/2852] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:49 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:50.102938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade42b47-555c-44fc-b376-1018dcbea2b0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:50.104366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ade42b47-555c-44fc-b376-1018dcbea2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:50.209897 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1406/2853] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:49:50.217392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564aa0-1cca-4e9c-a76e-4a29882d5594 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:50.217828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564aa0-1cca-4e9c-a76e-4a29882d5594 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:50.218208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564aa0-1cca-4e9c-a76e-4a29882d5594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:50.242185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5d564aa0-1cca-4e9c-a76e-4a29882d5594 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:50.243606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5d564aa0-1cca-4e9c-a76e-4a29882d5594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:50.255119 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1407/2854] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:50.259094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d564aa0-1cca-4e9c-a76e-4a29882d5594 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:50.270684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d564aa0-1cca-4e9c-a76e-4a29882d5594 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:50.277476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ba053-3191-45da-9683-9de332d7b6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:50.279022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ba053-3191-45da-9683-9de332d7b6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:50.279229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade42b47-555c-44fc-b376-1018dcbea2b0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:50.279461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ba053-3191-45da-9683-9de332d7b6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:50.279862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ba053-3191-45da-9683-9de332d7b6f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:50.280818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ba053-3191-45da-9683-9de332d7b6f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:49:50.281368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ba053-3191-45da-9683-9de332d7b6f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:50.283435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ba053-3191-45da-9683-9de332d7b6f1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:50.291037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c989e-8dfa-477b-b4bd-5da54264f9bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:50.291759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c989e-8dfa-477b-b4bd-5da54264f9bc service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:50.292042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c989e-8dfa-477b-b4bd-5da54264f9bc service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:50.292353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c989e-8dfa-477b-b4bd-5da54264f9bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:50.304186 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1408/2855] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:49:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:49:50.309080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ba053-3191-45da-9683-9de332d7b6f1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:50.316912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c989e-8dfa-477b-b4bd-5da54264f9bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:50.318591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c989e-8dfa-477b-b4bd-5da54264f9bc service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:50.322820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ba053-3191-45da-9683-9de332d7b6f1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:50.330748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8434e-b108-49ef-a44e-abd635ed6515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:50.331902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8434e-b108-49ef-a44e-abd635ed6515 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:50.332293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8434e-b108-49ef-a44e-abd635ed6515 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:50.332849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8434e-b108-49ef-a44e-abd635ed6515 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:50.333803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8434e-b108-49ef-a44e-abd635ed6515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:50.338538 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1448/2856] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:50 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:50.338994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8434e-b108-49ef-a44e-abd635ed6515 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:50.402394 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1409/2857] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:49:50 2021] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:49:50.412808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c989e-8dfa-477b-b4bd-5da54264f9bc service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:50.433214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c989e-8dfa-477b-b4bd-5da54264f9bc service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:50.605973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc04d55-938f-4de6-91e5-e218f6b43575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:50.607171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc04d55-938f-4de6-91e5-e218f6b43575 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:50.607471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc04d55-938f-4de6-91e5-e218f6b43575 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:50.607844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc04d55-938f-4de6-91e5-e218f6b43575 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:50.608566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc04d55-938f-4de6-91e5-e218f6b43575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:50.612210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc04d55-938f-4de6-91e5-e218f6b43575 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:50.647147 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1449/2858] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:49:50 2021] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:50.650937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8434e-b108-49ef-a44e-abd635ed6515 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:50.664144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8434e-b108-49ef-a44e-abd635ed6515 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:50.672085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647770e0-0e47-45a5-85e6-e57a73221bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:50.673449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647770e0-0e47-45a5-85e6-e57a73221bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:50.674677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647770e0-0e47-45a5-85e6-e57a73221bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:50.675370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647770e0-0e47-45a5-85e6-e57a73221bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:50.677136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647770e0-0e47-45a5-85e6-e57a73221bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:50.679649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647770e0-0e47-45a5-85e6-e57a73221bb4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:50.701369 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1410/2859] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:50 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:50.706072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc04d55-938f-4de6-91e5-e218f6b43575 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:50.721888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc04d55-938f-4de6-91e5-e218f6b43575 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:50.734539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57284901-bff7-432f-b6bb-a50f89937000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:50.737432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57284901-bff7-432f-b6bb-a50f89937000 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:50.738434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57284901-bff7-432f-b6bb-a50f89937000 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:50.739527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57284901-bff7-432f-b6bb-a50f89937000 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:50.740655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57284901-bff7-432f-b6bb-a50f89937000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:50.748490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57284901-bff7-432f-b6bb-a50f89937000 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:50.775469 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1450/2860] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:50 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:50.779666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647770e0-0e47-45a5-85e6-e57a73221bb4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:50.800019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647770e0-0e47-45a5-85e6-e57a73221bb4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:50.821338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f88614-fd9b-4445-87e2-77545c8dc317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:50.822109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f88614-fd9b-4445-87e2-77545c8dc317 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:50.822422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f88614-fd9b-4445-87e2-77545c8dc317 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:50.822703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f88614-fd9b-4445-87e2-77545c8dc317 admin admin] PATH_INFO: `/v3/projects/0793f7505c664b34adc128f8bd38e5b6/users/1fe3e4b89a9d489783a83b38a7a70c8b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:50.872462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f88614-fd9b-4445-87e2-77545c8dc317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0793f7505c664b34adc128f8bd38e5b6, user_id=1fe3e4b89a9d489783a83b38a7a70c8b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:50.875749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f88614-fd9b-4445-87e2-77545c8dc317 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:50.905200 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1411/2861] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:50 2021] PUT /identity/v3/projects/0793f7505c664b34adc128f8bd38e5b6/users/1fe3e4b89a9d489783a83b38a7a70c8b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:50.911502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f125f-acbc-40c9-bab5-c027d9d452df None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:50.912148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f125f-acbc-40c9-bab5-c027d9d452df None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:50.912755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f125f-acbc-40c9-bab5-c027d9d452df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:50.959095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-846f125f-acbc-40c9-bab5-c027d9d452df None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:50.960473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-846f125f-acbc-40c9-bab5-c027d9d452df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:51.113015 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1451/2862] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:51.123630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f88614-fd9b-4445-87e2-77545c8dc317 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:51.127242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-13f88614-fd9b-4445-87e2-77545c8dc317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:51.323605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f88614-fd9b-4445-87e2-77545c8dc317 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:51.327408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ca3a4-10e4-4802-b714-be9e6257f05f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:51.328074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ca3a4-10e4-4802-b714-be9e6257f05f service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:51.328360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ca3a4-10e4-4802-b714-be9e6257f05f service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:51.328642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ca3a4-10e4-4802-b714-be9e6257f05f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:51.341391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ca3a4-10e4-4802-b714-be9e6257f05f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:51.343385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ca3a4-10e4-4802-b714-be9e6257f05f service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:51.357587 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1412/2863] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:53.100030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f125f-acbc-40c9-bab5-c027d9d452df None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:53.102111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-846f125f-acbc-40c9-bab5-c027d9d452df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:53.121568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f125f-acbc-40c9-bab5-c027d9d452df None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:53.133174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22089451-9179-4a7e-adb4-bd28d7fa5c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:53.133966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089451-9179-4a7e-adb4-bd28d7fa5c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:53.134246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089451-9179-4a7e-adb4-bd28d7fa5c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:53.134857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089451-9179-4a7e-adb4-bd28d7fa5c00 admin admin] PATH_INFO: `/v3/users/e5b80a8a653e4d3ebd71679179f8c678` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:53.135837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22089451-9179-4a7e-adb4-bd28d7fa5c00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5b80a8a653e4d3ebd71679179f8c678)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:53.138354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22089451-9179-4a7e-adb4-bd28d7fa5c00 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:53.230863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-22089451-9179-4a7e-adb4-bd28d7fa5c00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5b80a8a653e4d3ebd71679179f8c678'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:53.245446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-22089451-9179-4a7e-adb4-bd28d7fa5c00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5b80a8a653e4d3ebd71679179f8c678'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:53.248284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-22089451-9179-4a7e-adb4-bd28d7fa5c00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5b80a8a653e4d3ebd71679179f8c678'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:53.277035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-22089451-9179-4a7e-adb4-bd28d7fa5c00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5b80a8a653e4d3ebd71679179f8c678'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:53.283677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ca3a4-10e4-4802-b714-be9e6257f05f service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:53.285304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-540ca3a4-10e4-4802-b714-be9e6257f05f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:53.302758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-22089451-9179-4a7e-adb4-bd28d7fa5c00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5b80a8a653e4d3ebd71679179f8c678'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:53.306355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ca3a4-10e4-4802-b714-be9e6257f05f service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:53.313529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7c2d3-9f4f-4fee-bf77-299e99761c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:53.314551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7c2d3-9f4f-4fee-bf77-299e99761c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:53.314903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7c2d3-9f4f-4fee-bf77-299e99761c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:53.315250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7c2d3-9f4f-4fee-bf77-299e99761c1c admin admin] PATH_INFO: `/v3/users/e2857cd622364f4db1c1bc7b6065f9ba` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:53.318513 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1452/2864] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:53 2021] DELETE /identity/v3/users/e5b80a8a653e4d3ebd71679179f8c678 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:53.318648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7c2d3-9f4f-4fee-bf77-299e99761c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2857cd622364f4db1c1bc7b6065f9ba)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:53.318648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7c2d3-9f4f-4fee-bf77-299e99761c1c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:53.391357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4ac7c2d3-9f4f-4fee-bf77-299e99761c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2857cd622364f4db1c1bc7b6065f9ba'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:53.399542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4ac7c2d3-9f4f-4fee-bf77-299e99761c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2857cd622364f4db1c1bc7b6065f9ba'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:53.421452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4ac7c2d3-9f4f-4fee-bf77-299e99761c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2857cd622364f4db1c1bc7b6065f9ba'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:53.423236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4ac7c2d3-9f4f-4fee-bf77-299e99761c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2857cd622364f4db1c1bc7b6065f9ba'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:53.439659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4ac7c2d3-9f4f-4fee-bf77-299e99761c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2857cd622364f4db1c1bc7b6065f9ba'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:53.450977 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1413/2865] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:49:53 2021] DELETE /identity/v3/users/e2857cd622364f4db1c1bc7b6065f9ba => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:49:53.700907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7c2d3-9f4f-4fee-bf77-299e99761c1c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:53.702876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54846099-ad0c-4c79-9fbe-4b8764e037c6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:53.704772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4ac7c2d3-9f4f-4fee-bf77-299e99761c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:53.705091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54846099-ad0c-4c79-9fbe-4b8764e037c6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:53.705522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54846099-ad0c-4c79-9fbe-4b8764e037c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:53.783371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-54846099-ad0c-4c79-9fbe-4b8764e037c6 None None] MFA Rules not processed for user `1fe3e4b89a9d489783a83b38a7a70c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:53.785322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-54846099-ad0c-4c79-9fbe-4b8764e037c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:53.881449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7c2d3-9f4f-4fee-bf77-299e99761c1c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:53.887681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e77ce1-434e-4ad1-ac73-677bc2de4533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:53.888745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e77ce1-434e-4ad1-ac73-677bc2de4533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:53.889213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e77ce1-434e-4ad1-ac73-677bc2de4533 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:53.890245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e77ce1-434e-4ad1-ac73-677bc2de4533 admin admin] PATH_INFO: `/v3/projects/5ae570bf047a422aa4397c0eb9b70183` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:53.892358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e77ce1-434e-4ad1-ac73-677bc2de4533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae570bf047a422aa4397c0eb9b70183)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:53.894711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e77ce1-434e-4ad1-ac73-677bc2de4533 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:53.932296 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1453/2866] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:53 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:53.943567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54846099-ad0c-4c79-9fbe-4b8764e037c6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:53.945927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-54846099-ad0c-4c79-9fbe-4b8764e037c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:53.983092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-49e77ce1-434e-4ad1-ac73-677bc2de4533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae570bf047a422aa4397c0eb9b70183', 'request_id': 'req-49e77ce1-434e-4ad1-ac73-677bc2de4533'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:54.013670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-49e77ce1-434e-4ad1-ac73-677bc2de4533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae570bf047a422aa4397c0eb9b70183', 'request_id': 'req-49e77ce1-434e-4ad1-ac73-677bc2de4533'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:54.031726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-49e77ce1-434e-4ad1-ac73-677bc2de4533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae570bf047a422aa4397c0eb9b70183', 'request_id': 'req-49e77ce1-434e-4ad1-ac73-677bc2de4533'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:54.064067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-49e77ce1-434e-4ad1-ac73-677bc2de4533 admin admin] The token cache is being invalidate because project 5ae570bf047a422aa4397c0eb9b70183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:54.064680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-49e77ce1-434e-4ad1-ac73-677bc2de4533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:54.069618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-49e77ce1-434e-4ad1-ac73-677bc2de4533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:54.078701 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1414/2867] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:53 2021] DELETE /identity/v3/projects/5ae570bf047a422aa4397c0eb9b70183 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:54.085161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966598a0-8e9b-4962-a75e-fa2f34231d4f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:54.086651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966598a0-8e9b-4962-a75e-fa2f34231d4f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:54.087772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966598a0-8e9b-4962-a75e-fa2f34231d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:54.140280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-966598a0-8e9b-4962-a75e-fa2f34231d4f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:54.147001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-966598a0-8e9b-4962-a75e-fa2f34231d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:54.148121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54846099-ad0c-4c79-9fbe-4b8764e037c6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:54.290115 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1415/2868] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:49:54.298102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357911b-d626-449c-a7da-5bcec5752948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:54.298809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357911b-d626-449c-a7da-5bcec5752948 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:54.299107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357911b-d626-449c-a7da-5bcec5752948 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:54.299371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357911b-d626-449c-a7da-5bcec5752948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:54.299825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b73e63-a19e-4af5-9526-98adfa553d16 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:54.300304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b73e63-a19e-4af5-9526-98adfa553d16 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:54.300797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b73e63-a19e-4af5-9526-98adfa553d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:54.301670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b357911b-d626-449c-a7da-5bcec5752948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:54.356552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c5b73e63-a19e-4af5-9526-98adfa553d16 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:54.358052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c5b73e63-a19e-4af5-9526-98adfa553d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:54.367897 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1416/2869] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:54.371890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b73e63-a19e-4af5-9526-98adfa553d16 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:54.381547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357911b-d626-449c-a7da-5bcec5752948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:54.383188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357911b-d626-449c-a7da-5bcec5752948 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:54.384661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b73e63-a19e-4af5-9526-98adfa553d16 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:54.391017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6550f6-2d4f-4452-b74f-767c6d2aa2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:54.392411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6550f6-2d4f-4452-b74f-767c6d2aa2db admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:54.392870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6550f6-2d4f-4452-b74f-767c6d2aa2db admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:54.393304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6550f6-2d4f-4452-b74f-767c6d2aa2db admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:54.394394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6550f6-2d4f-4452-b74f-767c6d2aa2db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:49:54.394858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6550f6-2d4f-4452-b74f-767c6d2aa2db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:54.397473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6550f6-2d4f-4452-b74f-767c6d2aa2db admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:54.402882 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1454/2870] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:53 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:54.416642 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1417/2871] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:49:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:49:54.420541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357911b-d626-449c-a7da-5bcec5752948 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:54.436345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357911b-d626-449c-a7da-5bcec5752948 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:54.446855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3eb90-de0c-4be7-b9ef-6a9279ad2df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:54.447542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3eb90-de0c-4be7-b9ef-6a9279ad2df1 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:54.447823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3eb90-de0c-4be7-b9ef-6a9279ad2df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:54.448103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3eb90-de0c-4be7-b9ef-6a9279ad2df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:54.452005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3eb90-de0c-4be7-b9ef-6a9279ad2df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:54.459030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3eb90-de0c-4be7-b9ef-6a9279ad2df1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:54.546075 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1455/2872] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:49:54 2021] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:54.549934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6550f6-2d4f-4452-b74f-767c6d2aa2db admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:54.568949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6550f6-2d4f-4452-b74f-767c6d2aa2db admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:54.627346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3eb90-de0c-4be7-b9ef-6a9279ad2df1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:54.629372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6cf3eb90-de0c-4be7-b9ef-6a9279ad2df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:54.808338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440e3b8-e403-4c59-8ab1-cb2c18fdb156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:54.812622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440e3b8-e403-4c59-8ab1-cb2c18fdb156 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:54.817120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440e3b8-e403-4c59-8ab1-cb2c18fdb156 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:54.817548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440e3b8-e403-4c59-8ab1-cb2c18fdb156 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:54.818695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440e3b8-e403-4c59-8ab1-cb2c18fdb156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:54.824713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440e3b8-e403-4c59-8ab1-cb2c18fdb156 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:54.855690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3eb90-de0c-4be7-b9ef-6a9279ad2df1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:54.887932 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1418/2873] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:49:54 2021] POST /identity/v3/users => generated 292 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:54.889363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbfdea-6df5-4df5-a061-d9bcb9077e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:54.890868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbfdea-6df5-4df5-a061-d9bcb9077e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:54.892500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440e3b8-e403-4c59-8ab1-cb2c18fdb156 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:54.892874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbfdea-6df5-4df5-a061-d9bcb9077e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:54.896200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbfdea-6df5-4df5-a061-d9bcb9077e43 admin admin] PATH_INFO: `/v3/projects/738d51b548fb479f889bd3bb54ca33d5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:54.897891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbfdea-6df5-4df5-a061-d9bcb9077e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=738d51b548fb479f889bd3bb54ca33d5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:54.911846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbfdea-6df5-4df5-a061-d9bcb9077e43 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:54.933719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440e3b8-e403-4c59-8ab1-cb2c18fdb156 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:54.941421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e824f-733c-40f2-bd4b-cc36816a4b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:54.942371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e824f-733c-40f2-bd4b-cc36816a4b72 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:54.942587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e824f-733c-40f2-bd4b-cc36816a4b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:54.942949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e824f-733c-40f2-bd4b-cc36816a4b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:54.944561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e824f-733c-40f2-bd4b-cc36816a4b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:54.946568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e824f-733c-40f2-bd4b-cc36816a4b72 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:54.960277 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1419/2874] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:54 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:54.966101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e824f-733c-40f2-bd4b-cc36816a4b72 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:54.989014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e824f-733c-40f2-bd4b-cc36816a4b72 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:55.012704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18086db7-84fb-41f0-a587-82c1f311c7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:55.015901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18086db7-84fb-41f0-a587-82c1f311c7cd admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:55.021062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18086db7-84fb-41f0-a587-82c1f311c7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:55.021400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18086db7-84fb-41f0-a587-82c1f311c7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:55.022173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18086db7-84fb-41f0-a587-82c1f311c7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:55.028106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18086db7-84fb-41f0-a587-82c1f311c7cd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:55.048661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-79bbfdea-6df5-4df5-a061-d9bcb9077e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '738d51b548fb479f889bd3bb54ca33d5', 'request_id': 'req-79bbfdea-6df5-4df5-a061-d9bcb9077e43'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:55.051673 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1420/2875] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:54 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:55.056858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18086db7-84fb-41f0-a587-82c1f311c7cd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:55.063969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-79bbfdea-6df5-4df5-a061-d9bcb9077e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '738d51b548fb479f889bd3bb54ca33d5', 'request_id': 'req-79bbfdea-6df5-4df5-a061-d9bcb9077e43'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:55.072146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18086db7-84fb-41f0-a587-82c1f311c7cd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:55.080033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-79bbfdea-6df5-4df5-a061-d9bcb9077e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '738d51b548fb479f889bd3bb54ca33d5', 'request_id': 'req-79bbfdea-6df5-4df5-a061-d9bcb9077e43'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:55.097178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-79bbfdea-6df5-4df5-a061-d9bcb9077e43 admin admin] The token cache is being invalidate because project 738d51b548fb479f889bd3bb54ca33d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:49:55.098871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-79bbfdea-6df5-4df5-a061-d9bcb9077e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:55.099754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-79bbfdea-6df5-4df5-a061-d9bcb9077e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:49:55.101878 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1456/2876] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:49:54 2021] DELETE /identity/v3/projects/738d51b548fb479f889bd3bb54ca33d5 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:49:55.107561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b701efe-1b50-405b-bb14-1cc6f42a524b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:55.108302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b701efe-1b50-405b-bb14-1cc6f42a524b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:55.108579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b701efe-1b50-405b-bb14-1cc6f42a524b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:55.138998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2b701efe-1b50-405b-bb14-1cc6f42a524b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:55.141260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2b701efe-1b50-405b-bb14-1cc6f42a524b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:55.178068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec00b0-da6b-4d13-b010-073cc7e0dc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:55.179500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec00b0-da6b-4d13-b010-073cc7e0dc07 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:55.179784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec00b0-da6b-4d13-b010-073cc7e0dc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:55.180470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec00b0-da6b-4d13-b010-073cc7e0dc07 admin admin] PATH_INFO: `/v3/projects/835793f458834c0387829e418f6e3b4c/users/1906a27b85764875af7fe46c07b32595/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:55.203235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec00b0-da6b-4d13-b010-073cc7e0dc07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=835793f458834c0387829e418f6e3b4c, user_id=1906a27b85764875af7fe46c07b32595, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:55.206019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec00b0-da6b-4d13-b010-073cc7e0dc07 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:55.236579 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1421/2877] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:55 2021] PUT /identity/v3/projects/835793f458834c0387829e418f6e3b4c/users/1906a27b85764875af7fe46c07b32595/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:49:55.238054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112def6-1254-46e4-8e59-8371eb9b6ea7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:55.238375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112def6-1254-46e4-8e59-8371eb9b6ea7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:55.238650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112def6-1254-46e4-8e59-8371eb9b6ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:55.270000 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1457/2878] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:49:55.278909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c26725-cff6-4e74-a387-380234c2f13b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:55.279213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c26725-cff6-4e74-a387-380234c2f13b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:55.279484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c26725-cff6-4e74-a387-380234c2f13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:55.288953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f112def6-1254-46e4-8e59-8371eb9b6ea7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:55.290221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f112def6-1254-46e4-8e59-8371eb9b6ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:55.331423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e5c26725-cff6-4e74-a387-380234c2f13b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:55.332935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e5c26725-cff6-4e74-a387-380234c2f13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:55.443255 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1422/2879] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:55.454365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112def6-1254-46e4-8e59-8371eb9b6ea7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:55.459119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f112def6-1254-46e4-8e59-8371eb9b6ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:55.478198 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1458/2880] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:55.481909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c26725-cff6-4e74-a387-380234c2f13b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:55.496087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c26725-cff6-4e74-a387-380234c2f13b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:55.505585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11baa972-b467-4016-a392-c63ce974983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:55.506362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baa972-b467-4016-a392-c63ce974983f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:55.506652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baa972-b467-4016-a392-c63ce974983f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:55.506936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baa972-b467-4016-a392-c63ce974983f admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:55.507679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11baa972-b467-4016-a392-c63ce974983f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:49:55.507989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11baa972-b467-4016-a392-c63ce974983f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:55.509604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11baa972-b467-4016-a392-c63ce974983f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:55.537551 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1459/2881] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:49:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:49:55.541792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11baa972-b467-4016-a392-c63ce974983f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:55.566970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11baa972-b467-4016-a392-c63ce974983f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:55.573249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112def6-1254-46e4-8e59-8371eb9b6ea7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:55.573564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d469e-0bc8-43b7-ba7f-37bdb02bf045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:55.574239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d469e-0bc8-43b7-ba7f-37bdb02bf045 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:55.574549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d469e-0bc8-43b7-ba7f-37bdb02bf045 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:55.574830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d469e-0bc8-43b7-ba7f-37bdb02bf045 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:55.575533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d469e-0bc8-43b7-ba7f-37bdb02bf045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:55.577438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d469e-0bc8-43b7-ba7f-37bdb02bf045 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:55.593023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4399180-90ab-4c1e-b0d4-7480b90535d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:55.594791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4399180-90ab-4c1e-b0d4-7480b90535d9 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:55.594991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4399180-90ab-4c1e-b0d4-7480b90535d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:55.595275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4399180-90ab-4c1e-b0d4-7480b90535d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:55.628093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4399180-90ab-4c1e-b0d4-7480b90535d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:55.631219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4399180-90ab-4c1e-b0d4-7480b90535d9 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:55.635579 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1460/2882] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:49:55 2021] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:49:55.639596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d469e-0bc8-43b7-ba7f-37bdb02bf045 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:55.666345 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1423/2883] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:49:55.771984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d469e-0bc8-43b7-ba7f-37bdb02bf045 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:55.787516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04d18d-9ad1-4eea-aa47-753ef8b8f8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:55.788230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04d18d-9ad1-4eea-aa47-753ef8b8f8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:55.788518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04d18d-9ad1-4eea-aa47-753ef8b8f8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:55.788874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04d18d-9ad1-4eea-aa47-753ef8b8f8c9 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:55.789596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04d18d-9ad1-4eea-aa47-753ef8b8f8c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:55.791546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04d18d-9ad1-4eea-aa47-753ef8b8f8c9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:55.834753 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1461/2884] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:49:55 2021] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:49:55.839032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4399180-90ab-4c1e-b0d4-7480b90535d9 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:55.853921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4399180-90ab-4c1e-b0d4-7480b90535d9 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:55.866905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900cc6a-d0d2-44b0-b4d1-f374930ebb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:55.867416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900cc6a-d0d2-44b0-b4d1-f374930ebb90 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:55.867703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900cc6a-d0d2-44b0-b4d1-f374930ebb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:55.867985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900cc6a-d0d2-44b0-b4d1-f374930ebb90 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:55.868729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900cc6a-d0d2-44b0-b4d1-f374930ebb90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:55.871500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900cc6a-d0d2-44b0-b4d1-f374930ebb90 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:55.899835 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1424/2885] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:55 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:55.902058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04d18d-9ad1-4eea-aa47-753ef8b8f8c9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:55.914066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04d18d-9ad1-4eea-aa47-753ef8b8f8c9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:55.936345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731aa217-f60c-43ac-ae8f-2ad9f4bde059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:55.937396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aa217-f60c-43ac-ae8f-2ad9f4bde059 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:55.943039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aa217-f60c-43ac-ae8f-2ad9f4bde059 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:55.944224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aa217-f60c-43ac-ae8f-2ad9f4bde059 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:55.946822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731aa217-f60c-43ac-ae8f-2ad9f4bde059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:55.949803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731aa217-f60c-43ac-ae8f-2ad9f4bde059 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:55.990298 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1462/2886] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:49:55 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:49:55.994576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900cc6a-d0d2-44b0-b4d1-f374930ebb90 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:56.007350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900cc6a-d0d2-44b0-b4d1-f374930ebb90 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:56.022001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aee065-5273-41d5-b0ae-086be6308bb0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:56.023860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aee065-5273-41d5-b0ae-086be6308bb0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:56.024175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aee065-5273-41d5-b0ae-086be6308bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:56.033879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c0b5e-4361-4a1a-8304-e8201fd2b199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:56.040565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c0b5e-4361-4a1a-8304-e8201fd2b199 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:56.041275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c0b5e-4361-4a1a-8304-e8201fd2b199 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:56.041571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c0b5e-4361-4a1a-8304-e8201fd2b199 admin admin] PATH_INFO: `/v3/projects/69de37deec2a49ff9eaad9cbb7c48f31/users/ebd83848fe8d4e7284291660eb51da51/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:56.077652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f9aee065-5273-41d5-b0ae-086be6308bb0 None None] MFA Rules not processed for user `1fe3e4b89a9d489783a83b38a7a70c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:56.082355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f9aee065-5273-41d5-b0ae-086be6308bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:56.115931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c0b5e-4361-4a1a-8304-e8201fd2b199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69de37deec2a49ff9eaad9cbb7c48f31, user_id=ebd83848fe8d4e7284291660eb51da51, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:56.130444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c0b5e-4361-4a1a-8304-e8201fd2b199 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:56.181769 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1425/2887] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:49:55 2021] PUT /identity/v3/projects/69de37deec2a49ff9eaad9cbb7c48f31/users/ebd83848fe8d4e7284291660eb51da51/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:49:56.196001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e9fef-a59b-4eab-b7ec-01222ccf4379 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:56.196301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e9fef-a59b-4eab-b7ec-01222ccf4379 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:56.197557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e9fef-a59b-4eab-b7ec-01222ccf4379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:56.258977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-eb0e9fef-a59b-4eab-b7ec-01222ccf4379 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:56.260214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eb0e9fef-a59b-4eab-b7ec-01222ccf4379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:56.344527 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1463/2888] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:56 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:56.477590 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1426/2889] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:56.485789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aee065-5273-41d5-b0ae-086be6308bb0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:56.629732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aee065-5273-41d5-b0ae-086be6308bb0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:56.746064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ee2c1-dbf5-4111-8755-9359a9c4b17f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:56.747029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ee2c1-dbf5-4111-8755-9359a9c4b17f service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:56.747313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ee2c1-dbf5-4111-8755-9359a9c4b17f service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:56.749019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ee2c1-dbf5-4111-8755-9359a9c4b17f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:56.777375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ee2c1-dbf5-4111-8755-9359a9c4b17f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:56.785276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ee2c1-dbf5-4111-8755-9359a9c4b17f service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:56.812221 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1464/2890] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:49:57.603353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538f37d-cb3e-41fc-9a86-b90e80157a82 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:57.604323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538f37d-cb3e-41fc-9a86-b90e80157a82 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:57.604768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538f37d-cb3e-41fc-9a86-b90e80157a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:57.647492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3538f37d-cb3e-41fc-9a86-b90e80157a82 None None] MFA Rules not processed for user `8cf273e7f6d646c4a6c46bc7a197c6a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:57.649980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3538f37d-cb3e-41fc-9a86-b90e80157a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:57.691075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb1b65-f4dd-4a83-a7a6-93e7202e9d34 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:57.691639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb1b65-f4dd-4a83-a7a6-93e7202e9d34 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:57.691752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb1b65-f4dd-4a83-a7a6-93e7202e9d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:57.776586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e8fb1b65-f4dd-4a83-a7a6-93e7202e9d34 None None] MFA Rules not processed for user `1906a27b85764875af7fe46c07b32595`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:57.786723 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1427/2891] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:57 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:57.786892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e8fb1b65-f4dd-4a83-a7a6-93e7202e9d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:57.798627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538f37d-cb3e-41fc-9a86-b90e80157a82 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:57.801290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3538f37d-cb3e-41fc-9a86-b90e80157a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:57.815944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538f37d-cb3e-41fc-9a86-b90e80157a82 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:57.820258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e11044-af46-4be7-82a2-b1ff41a79d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:57.821085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e11044-af46-4be7-82a2-b1ff41a79d7c service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:57.821237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e11044-af46-4be7-82a2-b1ff41a79d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:57.821446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e11044-af46-4be7-82a2-b1ff41a79d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:57.840288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e11044-af46-4be7-82a2-b1ff41a79d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:57.843008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e11044-af46-4be7-82a2-b1ff41a79d7c service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:57.876408 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1428/2892] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:57 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:49:57.946508 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1465/2893] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:57 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:57.957310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf7b49-3e04-469d-8073-cfc5c5c23805 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:57.957597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf7b49-3e04-469d-8073-cfc5c5c23805 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:57.957940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf7b49-3e04-469d-8073-cfc5c5c23805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:58.000999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f2cf7b49-3e04-469d-8073-cfc5c5c23805 None None] MFA Rules not processed for user `1906a27b85764875af7fe46c07b32595`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:49:58.003418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f2cf7b49-3e04-469d-8073-cfc5c5c23805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:58.022849 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1429/2894] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:49:57 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:49:58.080620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb1b65-f4dd-4a83-a7a6-93e7202e9d34 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:49:58.082370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e8fb1b65-f4dd-4a83-a7a6-93e7202e9d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:49:58.257178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb1b65-f4dd-4a83-a7a6-93e7202e9d34 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:49:58.264725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd338ee5-9dd3-47f4-b579-9dfae0efafa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:49:58.265631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd338ee5-9dd3-47f4-b579-9dfae0efafa6 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:49:58.267256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd338ee5-9dd3-47f4-b579-9dfae0efafa6 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:49:58.268122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd338ee5-9dd3-47f4-b579-9dfae0efafa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:49:58.280320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd338ee5-9dd3-47f4-b579-9dfae0efafa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:49:58.285637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd338ee5-9dd3-47f4-b579-9dfae0efafa6 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:49:58.348143 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1466/2895] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:49:58 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:50:01.487056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb351-0c9d-4ff2-a310-1ceba98aef56 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:01.488540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb351-0c9d-4ff2-a310-1ceba98aef56 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:01.489420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb351-0c9d-4ff2-a310-1ceba98aef56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:01.554908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-149eb351-0c9d-4ff2-a310-1ceba98aef56 None None] MFA Rules not processed for user `8cf273e7f6d646c4a6c46bc7a197c6a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:01.561337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-149eb351-0c9d-4ff2-a310-1ceba98aef56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:01.591797 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1430/2896] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:01 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:09.636012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7158b-ca9f-4b32-944f-d94db64e36d2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:09.637042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7158b-ca9f-4b32-944f-d94db64e36d2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:09.637637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7158b-ca9f-4b32-944f-d94db64e36d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:09.683093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b1a7158b-ca9f-4b32-944f-d94db64e36d2 None None] MFA Rules not processed for user `231f078b4f4e4fdc9dcf0c6248f17551`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:09.684766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b1a7158b-ca9f-4b32-944f-d94db64e36d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:09.820973 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1467/2897] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:09 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:11.760669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884bbe3-74d4-4165-a9fd-168abfa098c3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:11.761210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884bbe3-74d4-4165-a9fd-168abfa098c3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:11.761210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884bbe3-74d4-4165-a9fd-168abfa098c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:11.874911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2884bbe3-74d4-4165-a9fd-168abfa098c3 None None] MFA Rules not processed for user `ebd83848fe8d4e7284291660eb51da51`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:11.876462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2884bbe3-74d4-4165-a9fd-168abfa098c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:12.099029 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1431/2898] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:11 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:12.311588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7158b-ca9f-4b32-944f-d94db64e36d2 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:12.369483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7158b-ca9f-4b32-944f-d94db64e36d2 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:12.405217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86825153-3f61-45de-ae60-8ad022482741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:12.408010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86825153-3f61-45de-ae60-8ad022482741 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:12.409546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86825153-3f61-45de-ae60-8ad022482741 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:12.410042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86825153-3f61-45de-ae60-8ad022482741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:12.429765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86825153-3f61-45de-ae60-8ad022482741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:12.433502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86825153-3f61-45de-ae60-8ad022482741 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:12.455190 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1468/2899] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:50:12 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:50:15.533237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe238a1a-20d1-4462-b717-1c96fd45131a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:15.534785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe238a1a-20d1-4462-b717-1c96fd45131a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:15.535289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe238a1a-20d1-4462-b717-1c96fd45131a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:15.581329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fe238a1a-20d1-4462-b717-1c96fd45131a None None] MFA Rules not processed for user `c3e0c0d3dc8441968dafc98b902ab349`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:15.586979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fe238a1a-20d1-4462-b717-1c96fd45131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:15.710868 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1432/2900] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:15 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:22.138541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849a2a-c83a-448e-a606-f92543c22f35 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:22.139095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849a2a-c83a-448e-a606-f92543c22f35 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:22.139275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849a2a-c83a-448e-a606-f92543c22f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:22.165459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-87849a2a-c83a-448e-a606-f92543c22f35 None None] MFA Rules not processed for user `ebd83848fe8d4e7284291660eb51da51`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:22.167375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-87849a2a-c83a-448e-a606-f92543c22f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:22.184476 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1469/2901] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:22 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:37.525074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa90fc-6012-4e29-91a9-17952726892c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:37.527130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa90fc-6012-4e29-91a9-17952726892c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:37.527652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa90fc-6012-4e29-91a9-17952726892c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:37.552848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e1fa90fc-6012-4e29-91a9-17952726892c None None] MFA Rules not processed for user `231f078b4f4e4fdc9dcf0c6248f17551`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:37.554368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e1fa90fc-6012-4e29-91a9-17952726892c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:37.566542 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1433/2902] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:37 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:37.760198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87849a2a-c83a-448e-a606-f92543c22f35 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:37.761711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-87849a2a-c83a-448e-a606-f92543c22f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:37.778990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87849a2a-c83a-448e-a606-f92543c22f35 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:37.784894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64055b9d-62d0-4572-8604-eb299cb3f50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:37.785772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64055b9d-62d0-4572-8604-eb299cb3f50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:37.786057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64055b9d-62d0-4572-8604-eb299cb3f50f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:37.786373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64055b9d-62d0-4572-8604-eb299cb3f50f admin admin] PATH_INFO: `/v3/users/1fe3e4b89a9d489783a83b38a7a70c8b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:37.787878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64055b9d-62d0-4572-8604-eb299cb3f50f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe3e4b89a9d489783a83b38a7a70c8b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:37.790824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64055b9d-62d0-4572-8604-eb299cb3f50f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:37.850584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-64055b9d-62d0-4572-8604-eb299cb3f50f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe3e4b89a9d489783a83b38a7a70c8b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:37.859701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-64055b9d-62d0-4572-8604-eb299cb3f50f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe3e4b89a9d489783a83b38a7a70c8b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:37.860941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-64055b9d-62d0-4572-8604-eb299cb3f50f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe3e4b89a9d489783a83b38a7a70c8b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:37.875888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-64055b9d-62d0-4572-8604-eb299cb3f50f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe3e4b89a9d489783a83b38a7a70c8b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:37.884064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-64055b9d-62d0-4572-8604-eb299cb3f50f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe3e4b89a9d489783a83b38a7a70c8b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:37.892630 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1470/2903] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:50:37 2021] DELETE /identity/v3/users/1fe3e4b89a9d489783a83b38a7a70c8b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:50:38.090683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa90fc-6012-4e29-91a9-17952726892c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:38.107250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa90fc-6012-4e29-91a9-17952726892c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:38.168560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2221d5-449d-4535-8f1c-a75dc2d6d1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:38.169416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2221d5-449d-4535-8f1c-a75dc2d6d1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:38.169700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2221d5-449d-4535-8f1c-a75dc2d6d1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:38.169978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2221d5-449d-4535-8f1c-a75dc2d6d1f6 admin admin] PATH_INFO: `/v3/projects/0793f7505c664b34adc128f8bd38e5b6` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:38.171242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2221d5-449d-4535-8f1c-a75dc2d6d1f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0793f7505c664b34adc128f8bd38e5b6)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:38.173155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2221d5-449d-4535-8f1c-a75dc2d6d1f6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:38.221091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6e2221d5-449d-4535-8f1c-a75dc2d6d1f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0793f7505c664b34adc128f8bd38e5b6', 'request_id': 'req-6e2221d5-449d-4535-8f1c-a75dc2d6d1f6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:38.227713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6e2221d5-449d-4535-8f1c-a75dc2d6d1f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0793f7505c664b34adc128f8bd38e5b6', 'request_id': 'req-6e2221d5-449d-4535-8f1c-a75dc2d6d1f6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:38.236548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6e2221d5-449d-4535-8f1c-a75dc2d6d1f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0793f7505c664b34adc128f8bd38e5b6', 'request_id': 'req-6e2221d5-449d-4535-8f1c-a75dc2d6d1f6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:38.253607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6e2221d5-449d-4535-8f1c-a75dc2d6d1f6 admin admin] The token cache is being invalidate because project 0793f7505c664b34adc128f8bd38e5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:50:38.253903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6e2221d5-449d-4535-8f1c-a75dc2d6d1f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:38.254572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6e2221d5-449d-4535-8f1c-a75dc2d6d1f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:38.256106 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1434/2904] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:50:38 2021] DELETE /identity/v3/projects/0793f7505c664b34adc128f8bd38e5b6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:50:38.263915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbff53d-3679-4db0-9146-3b904dc7b05f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:38.264815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbff53d-3679-4db0-9146-3b904dc7b05f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:38.265108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbff53d-3679-4db0-9146-3b904dc7b05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:38.293617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-dcbff53d-3679-4db0-9146-3b904dc7b05f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:38.294887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dcbff53d-3679-4db0-9146-3b904dc7b05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:38.365931 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1471/2905] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:50:38.377495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7c8ce-7e33-40ee-b0a6-a9462e247ce1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:38.378219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7c8ce-7e33-40ee-b0a6-a9462e247ce1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:38.378926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7c8ce-7e33-40ee-b0a6-a9462e247ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:38.399934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0cd7c8ce-7e33-40ee-b0a6-a9462e247ce1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:38.401139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0cd7c8ce-7e33-40ee-b0a6-a9462e247ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:38.410539 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1435/2906] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:38.414709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbff53d-3679-4db0-9146-3b904dc7b05f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:38.424505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbff53d-3679-4db0-9146-3b904dc7b05f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:38.430708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50c973-c508-4741-8862-b7c54f9d172f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:38.432137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50c973-c508-4741-8862-b7c54f9d172f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:38.432598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50c973-c508-4741-8862-b7c54f9d172f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:38.433278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50c973-c508-4741-8862-b7c54f9d172f admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:38.434202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50c973-c508-4741-8862-b7c54f9d172f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:50:38.434749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50c973-c508-4741-8862-b7c54f9d172f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:38.437143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50c973-c508-4741-8862-b7c54f9d172f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:38.458825 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1472/2907] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:50:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:50:38.459012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7c8ce-7e33-40ee-b0a6-a9462e247ce1 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:38.468123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7c8ce-7e33-40ee-b0a6-a9462e247ce1 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:38.474411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f31e0-86f5-4026-8acf-4dcdd79e4ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:38.475202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f31e0-86f5-4026-8acf-4dcdd79e4ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:38.475455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f31e0-86f5-4026-8acf-4dcdd79e4ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:38.475803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f31e0-86f5-4026-8acf-4dcdd79e4ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:38.476581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f31e0-86f5-4026-8acf-4dcdd79e4ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:38.478603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f31e0-86f5-4026-8acf-4dcdd79e4ef2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:38.525762 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1436/2908] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:50:38 2021] POST /identity/v3/projects => generated 405 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:50:38.527844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50c973-c508-4741-8862-b7c54f9d172f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:38.541127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50c973-c508-4741-8862-b7c54f9d172f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:38.620239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f970d-0534-4c1f-83b3-33edf96f251e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:38.620657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f970d-0534-4c1f-83b3-33edf96f251e admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:38.620938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f970d-0534-4c1f-83b3-33edf96f251e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:38.621212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f970d-0534-4c1f-83b3-33edf96f251e admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:38.622179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f970d-0534-4c1f-83b3-33edf96f251e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:38.625244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f970d-0534-4c1f-83b3-33edf96f251e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:38.652851 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1473/2909] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:50:38 2021] POST /identity/v3/users => generated 303 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:50:38.657424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f31e0-86f5-4026-8acf-4dcdd79e4ef2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:38.676594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f31e0-86f5-4026-8acf-4dcdd79e4ef2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:38.678799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c3b44-3359-4344-ab4d-96aa50245feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:38.679725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c3b44-3359-4344-ab4d-96aa50245feb admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:38.679932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c3b44-3359-4344-ab4d-96aa50245feb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:38.681406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c3b44-3359-4344-ab4d-96aa50245feb admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:38.682163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c3b44-3359-4344-ab4d-96aa50245feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:38.683847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c3b44-3359-4344-ab4d-96aa50245feb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:38.695670 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1437/2910] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:50:38 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:50:38.699613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f970d-0534-4c1f-83b3-33edf96f251e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:38.722573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f970d-0534-4c1f-83b3-33edf96f251e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:38.727912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f290a1e-ef48-4156-9b14-48c7629ca70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:38.728578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f290a1e-ef48-4156-9b14-48c7629ca70f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:38.728860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f290a1e-ef48-4156-9b14-48c7629ca70f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:38.729306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f290a1e-ef48-4156-9b14-48c7629ca70f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:38.730048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f290a1e-ef48-4156-9b14-48c7629ca70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:38.731802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f290a1e-ef48-4156-9b14-48c7629ca70f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:38.746294 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1474/2911] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:50:38 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:50:38.749851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c3b44-3359-4344-ab4d-96aa50245feb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:38.762035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c3b44-3359-4344-ab4d-96aa50245feb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:38.768720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf8feb-bc47-4a3f-b097-6e286877e382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:38.769905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf8feb-bc47-4a3f-b097-6e286877e382 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:38.770312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf8feb-bc47-4a3f-b097-6e286877e382 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:38.770695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf8feb-bc47-4a3f-b097-6e286877e382 admin admin] PATH_INFO: `/v3/projects/bb6f0b624038403284d782c3c726279c/users/2808986334b647068ea9777af124fe32/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:38.790231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf8feb-bc47-4a3f-b097-6e286877e382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6f0b624038403284d782c3c726279c, user_id=2808986334b647068ea9777af124fe32, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:38.793437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf8feb-bc47-4a3f-b097-6e286877e382 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:38.817133 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1438/2912] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:50:38 2021] PUT /identity/v3/projects/bb6f0b624038403284d782c3c726279c/users/2808986334b647068ea9777af124fe32/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:50:38.822444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f491c-eba4-4689-abcc-bfc2aa5b7bfc None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:38.822933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f491c-eba4-4689-abcc-bfc2aa5b7bfc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:38.823033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f491c-eba4-4689-abcc-bfc2aa5b7bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:38.848872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-681f491c-eba4-4689-abcc-bfc2aa5b7bfc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:38.850783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-681f491c-eba4-4689-abcc-bfc2aa5b7bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:38.924652 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1475/2913] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:38.936785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf8feb-bc47-4a3f-b097-6e286877e382 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:38.938906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4fdf8feb-bc47-4a3f-b097-6e286877e382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:39.006530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf8feb-bc47-4a3f-b097-6e286877e382 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:39.013185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee144a1a-5feb-4139-b269-f02b6d7c4b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:39.014612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee144a1a-5feb-4139-b269-f02b6d7c4b98 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:39.014902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee144a1a-5feb-4139-b269-f02b6d7c4b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:39.015227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee144a1a-5feb-4139-b269-f02b6d7c4b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:39.026513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee144a1a-5feb-4139-b269-f02b6d7c4b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:39.028084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee144a1a-5feb-4139-b269-f02b6d7c4b98 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:39.042183 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1439/2914] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:50:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:50:40.179628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f491c-eba4-4689-abcc-bfc2aa5b7bfc None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:40.181741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-681f491c-eba4-4689-abcc-bfc2aa5b7bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:40.198908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f491c-eba4-4689-abcc-bfc2aa5b7bfc None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:40.208843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42079ece-92ec-4623-a6c8-e9230f4cbcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:40.209867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42079ece-92ec-4623-a6c8-e9230f4cbcd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:40.210246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42079ece-92ec-4623-a6c8-e9230f4cbcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:40.210655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42079ece-92ec-4623-a6c8-e9230f4cbcd9 admin admin] PATH_INFO: `/v3/users/1906a27b85764875af7fe46c07b32595` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:40.211967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42079ece-92ec-4623-a6c8-e9230f4cbcd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1906a27b85764875af7fe46c07b32595)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:40.214335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42079ece-92ec-4623-a6c8-e9230f4cbcd9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:40.276420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-42079ece-92ec-4623-a6c8-e9230f4cbcd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1906a27b85764875af7fe46c07b32595'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:40.284714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-42079ece-92ec-4623-a6c8-e9230f4cbcd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1906a27b85764875af7fe46c07b32595'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:40.285613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-42079ece-92ec-4623-a6c8-e9230f4cbcd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1906a27b85764875af7fe46c07b32595'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:40.303478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-42079ece-92ec-4623-a6c8-e9230f4cbcd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1906a27b85764875af7fe46c07b32595'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:40.313238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-42079ece-92ec-4623-a6c8-e9230f4cbcd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1906a27b85764875af7fe46c07b32595'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:40.327043 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1476/2915] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:50:40 2021] DELETE /identity/v3/users/1906a27b85764875af7fe46c07b32595 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:50:40.782944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596d865-11e8-4654-b0d9-d78632e2c5f5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:40.783844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596d865-11e8-4654-b0d9-d78632e2c5f5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:40.784357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596d865-11e8-4654-b0d9-d78632e2c5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:40.835738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3596d865-11e8-4654-b0d9-d78632e2c5f5 None None] MFA Rules not processed for user `2808986334b647068ea9777af124fe32`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:40.837652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3596d865-11e8-4654-b0d9-d78632e2c5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:40.936981 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1440/2916] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:40 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:40.937392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42079ece-92ec-4623-a6c8-e9230f4cbcd9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:40.939409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-42079ece-92ec-4623-a6c8-e9230f4cbcd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:41.026047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42079ece-92ec-4623-a6c8-e9230f4cbcd9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:41.032471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f0c5a-5535-4d22-abdc-67040e348f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:41.033875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f0c5a-5535-4d22-abdc-67040e348f90 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:41.034403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f0c5a-5535-4d22-abdc-67040e348f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:41.034868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f0c5a-5535-4d22-abdc-67040e348f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:41.036406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f0c5a-5535-4d22-abdc-67040e348f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:41.039027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f0c5a-5535-4d22-abdc-67040e348f90 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:41.071510 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1477/2917] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:50:40 2021] POST /identity/v3/projects => generated 403 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:50:41.075454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596d865-11e8-4654-b0d9-d78632e2c5f5 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:41.100610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596d865-11e8-4654-b0d9-d78632e2c5f5 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:41.108885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f0c5a-5535-4d22-abdc-67040e348f90 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:41.110908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2a0f0c5a-5535-4d22-abdc-67040e348f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:41.204263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1257c-f373-473a-be38-3d252d4877ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:41.205359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1257c-f373-473a-be38-3d252d4877ef admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:41.205867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1257c-f373-473a-be38-3d252d4877ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:41.206434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1257c-f373-473a-be38-3d252d4877ef admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:41.207400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1257c-f373-473a-be38-3d252d4877ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:41.209679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1257c-f373-473a-be38-3d252d4877ef admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:41.223638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f0c5a-5535-4d22-abdc-67040e348f90 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:41.228747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf06267-fe1c-4aa1-9c3e-52bbe1b5037e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:41.229850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf06267-fe1c-4aa1-9c3e-52bbe1b5037e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:41.230337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf06267-fe1c-4aa1-9c3e-52bbe1b5037e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:41.230781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf06267-fe1c-4aa1-9c3e-52bbe1b5037e admin admin] PATH_INFO: `/v3/projects/835793f458834c0387829e418f6e3b4c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:41.232376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf06267-fe1c-4aa1-9c3e-52bbe1b5037e admin admin] RBAC: Authorizing `identity:delete_project(project_id=835793f458834c0387829e418f6e3b4c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:41.237225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf06267-fe1c-4aa1-9c3e-52bbe1b5037e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:41.242840 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1441/2918] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:50:41 2021] POST /identity/v3/users => generated 302 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:50:41.244468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1257c-f373-473a-be38-3d252d4877ef admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:41.257308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1257c-f373-473a-be38-3d252d4877ef admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:41.262622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf26b21-d3cc-418f-b5b7-a210d1c77f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:41.263407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf26b21-d3cc-418f-b5b7-a210d1c77f86 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:41.263963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf26b21-d3cc-418f-b5b7-a210d1c77f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:41.264876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf26b21-d3cc-418f-b5b7-a210d1c77f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:41.265751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf26b21-d3cc-418f-b5b7-a210d1c77f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:41.267494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf26b21-d3cc-418f-b5b7-a210d1c77f86 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:41.283134 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1442/2919] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:50:41 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:50:41.287900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf26b21-d3cc-418f-b5b7-a210d1c77f86 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:41.297316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebf06267-fe1c-4aa1-9c3e-52bbe1b5037e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '835793f458834c0387829e418f6e3b4c', 'request_id': 'req-ebf06267-fe1c-4aa1-9c3e-52bbe1b5037e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:41.301561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf26b21-d3cc-418f-b5b7-a210d1c77f86 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:41.304507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebf06267-fe1c-4aa1-9c3e-52bbe1b5037e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '835793f458834c0387829e418f6e3b4c', 'request_id': 'req-ebf06267-fe1c-4aa1-9c3e-52bbe1b5037e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:41.317920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebf06267-fe1c-4aa1-9c3e-52bbe1b5037e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '835793f458834c0387829e418f6e3b4c', 'request_id': 'req-ebf06267-fe1c-4aa1-9c3e-52bbe1b5037e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:41.332533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebf06267-fe1c-4aa1-9c3e-52bbe1b5037e admin admin] The token cache is being invalidate because project 835793f458834c0387829e418f6e3b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:50:41.333369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebf06267-fe1c-4aa1-9c3e-52bbe1b5037e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:41.335393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebf06267-fe1c-4aa1-9c3e-52bbe1b5037e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:50:41.338333 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1478/2920] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:50:41 2021] DELETE /identity/v3/projects/835793f458834c0387829e418f6e3b4c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:50:41.344487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920eb99d-3f47-47cf-be18-7f5fa14c1b6f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:41.345041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920eb99d-3f47-47cf-be18-7f5fa14c1b6f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:41.345792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920eb99d-3f47-47cf-be18-7f5fa14c1b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:41.373049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-920eb99d-3f47-47cf-be18-7f5fa14c1b6f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:41.375666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-920eb99d-3f47-47cf-be18-7f5fa14c1b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:41.393077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f905c-4aa0-4210-9777-b734bf72a818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:41.395733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f905c-4aa0-4210-9777-b734bf72a818 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:41.396277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f905c-4aa0-4210-9777-b734bf72a818 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:41.397454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f905c-4aa0-4210-9777-b734bf72a818 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:41.399931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f905c-4aa0-4210-9777-b734bf72a818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:41.403607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f905c-4aa0-4210-9777-b734bf72a818 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:41.430954 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1443/2921] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:50:41 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:50:41.435516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f905c-4aa0-4210-9777-b734bf72a818 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:41.439618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-063f905c-4aa0-4210-9777-b734bf72a818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:41.470658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f905c-4aa0-4210-9777-b734bf72a818 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:41.475303 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1479/2922] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:50:41.485168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e169d-157d-43c7-b471-c5dd6f90651a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:41.486464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e169d-157d-43c7-b471-c5dd6f90651a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:41.486969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e169d-157d-43c7-b471-c5dd6f90651a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:41.487535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e169d-157d-43c7-b471-c5dd6f90651a admin admin] PATH_INFO: `/v3/projects/1ed51129f61f4c7d886923057530f6d8/users/5ab3350ab5f74e7a8139e1bb149e620e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:41.518478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e169d-157d-43c7-b471-c5dd6f90651a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed51129f61f4c7d886923057530f6d8, user_id=5ab3350ab5f74e7a8139e1bb149e620e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:41.531336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e169d-157d-43c7-b471-c5dd6f90651a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:41.544826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea9574-14c7-4ca9-9267-03f44dc36921 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:41.545206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea9574-14c7-4ca9-9267-03f44dc36921 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:41.545517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea9574-14c7-4ca9-9267-03f44dc36921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:41.557996 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1444/2923] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:50:41 2021] PUT /identity/v3/projects/1ed51129f61f4c7d886923057530f6d8/users/5ab3350ab5f74e7a8139e1bb149e620e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:50:41.573381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2cea9574-14c7-4ca9-9267-03f44dc36921 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:41.574635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2cea9574-14c7-4ca9-9267-03f44dc36921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:41.708700 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1480/2924] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:41.713265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e169d-157d-43c7-b471-c5dd6f90651a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:41.737141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e169d-157d-43c7-b471-c5dd6f90651a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:41.745032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44682ea2-12cb-468f-81a0-87bf17f09e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:41.749486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44682ea2-12cb-468f-81a0-87bf17f09e90 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:41.750072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44682ea2-12cb-468f-81a0-87bf17f09e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:41.750887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44682ea2-12cb-468f-81a0-87bf17f09e90 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:41.752415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44682ea2-12cb-468f-81a0-87bf17f09e90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:50:41.753608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44682ea2-12cb-468f-81a0-87bf17f09e90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:41.757831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44682ea2-12cb-468f-81a0-87bf17f09e90 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:41.778355 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1445/2925] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:50:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:50:41.782916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea9574-14c7-4ca9-9267-03f44dc36921 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:41.802801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea9574-14c7-4ca9-9267-03f44dc36921 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:41.825052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232179d-3eb3-499c-925b-e3af25c8ac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:41.829641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232179d-3eb3-499c-925b-e3af25c8ac36 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:41.830011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232179d-3eb3-499c-925b-e3af25c8ac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:41.830382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232179d-3eb3-499c-925b-e3af25c8ac36 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:41.833144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232179d-3eb3-499c-925b-e3af25c8ac36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:41.841860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232179d-3eb3-499c-925b-e3af25c8ac36 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:41.932297 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1481/2926] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:50:41 2021] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:50:41.937704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44682ea2-12cb-468f-81a0-87bf17f09e90 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:41.953512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44682ea2-12cb-468f-81a0-87bf17f09e90 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:42.052301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4898ad9-b9de-4191-bd51-d6abbc692f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:42.053545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898ad9-b9de-4191-bd51-d6abbc692f6d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:42.054038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898ad9-b9de-4191-bd51-d6abbc692f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:42.054804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898ad9-b9de-4191-bd51-d6abbc692f6d admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:42.055867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4898ad9-b9de-4191-bd51-d6abbc692f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:42.058507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4898ad9-b9de-4191-bd51-d6abbc692f6d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:42.100913 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1446/2927] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:50:41 2021] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:50:42.105239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232179d-3eb3-499c-925b-e3af25c8ac36 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:42.122309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232179d-3eb3-499c-925b-e3af25c8ac36 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:42.133417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d4e57-a584-4bb5-b853-a32fbcc502db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:42.134101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d4e57-a584-4bb5-b853-a32fbcc502db admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:42.145555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d4e57-a584-4bb5-b853-a32fbcc502db admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:42.145555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d4e57-a584-4bb5-b853-a32fbcc502db admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:42.145555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d4e57-a584-4bb5-b853-a32fbcc502db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:42.145555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d4e57-a584-4bb5-b853-a32fbcc502db admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:42.164755 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1482/2928] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:50:42 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:50:42.168648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4898ad9-b9de-4191-bd51-d6abbc692f6d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:42.181811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4898ad9-b9de-4191-bd51-d6abbc692f6d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:42.189313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e8398-14dd-45d3-8a9b-ee92026a10e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:42.190176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e8398-14dd-45d3-8a9b-ee92026a10e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:42.190933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e8398-14dd-45d3-8a9b-ee92026a10e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:42.191318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e8398-14dd-45d3-8a9b-ee92026a10e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:42.192171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e8398-14dd-45d3-8a9b-ee92026a10e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:42.194754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e8398-14dd-45d3-8a9b-ee92026a10e4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:42.208472 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1447/2929] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:50:42 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:50:42.212358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d4e57-a584-4bb5-b853-a32fbcc502db admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:42.224956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d4e57-a584-4bb5-b853-a32fbcc502db admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:42.234328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1684a4-c78e-406a-8025-a0fd919686af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:42.235753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1684a4-c78e-406a-8025-a0fd919686af admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:42.236142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1684a4-c78e-406a-8025-a0fd919686af admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:42.236522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1684a4-c78e-406a-8025-a0fd919686af admin admin] PATH_INFO: `/v3/projects/7f74319f4d954cea9418c30afd53b213/users/0184005bc5c34c038fd140564572807e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:42.273345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1684a4-c78e-406a-8025-a0fd919686af admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f74319f4d954cea9418c30afd53b213, user_id=0184005bc5c34c038fd140564572807e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:42.277358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1684a4-c78e-406a-8025-a0fd919686af admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:42.304774 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1483/2930] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:50:42 2021] PUT /identity/v3/projects/7f74319f4d954cea9418c30afd53b213/users/0184005bc5c34c038fd140564572807e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:50:42.309538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e8337-432f-481f-9a68-e9b0b10642a5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:42.309825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e8337-432f-481f-9a68-e9b0b10642a5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:42.311914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e8337-432f-481f-9a68-e9b0b10642a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:42.347769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5c4e8337-432f-481f-9a68-e9b0b10642a5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:42.349343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5c4e8337-432f-481f-9a68-e9b0b10642a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:42.453486 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1448/2931] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:42.466481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1684a4-c78e-406a-8025-a0fd919686af admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:42.470468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ad1684a4-c78e-406a-8025-a0fd919686af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:42.590246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1684a4-c78e-406a-8025-a0fd919686af admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:42.595381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87aa46-436a-4e6f-ab6b-97fb0f8b7f70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:42.596050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87aa46-436a-4e6f-ab6b-97fb0f8b7f70 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:42.596340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87aa46-436a-4e6f-ab6b-97fb0f8b7f70 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:42.596623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87aa46-436a-4e6f-ab6b-97fb0f8b7f70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:42.607070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87aa46-436a-4e6f-ab6b-97fb0f8b7f70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:42.609041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87aa46-436a-4e6f-ab6b-97fb0f8b7f70 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:42.620328 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1484/2932] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:50:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:50:42.768641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea029343-eb16-4dec-b6b9-008c713b1247 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:42.769897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea029343-eb16-4dec-b6b9-008c713b1247 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:42.770445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea029343-eb16-4dec-b6b9-008c713b1247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:42.829848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ea029343-eb16-4dec-b6b9-008c713b1247 None None] MFA Rules not processed for user `5ab3350ab5f74e7a8139e1bb149e620e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:42.832653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ea029343-eb16-4dec-b6b9-008c713b1247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:43.018621 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1449/2933] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:42 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:43.033708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa04bc9-0d96-48d6-b17f-4afa3aed3dfb None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:43.034488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa04bc9-0d96-48d6-b17f-4afa3aed3dfb None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:43.035688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa04bc9-0d96-48d6-b17f-4afa3aed3dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:43.065412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-caa04bc9-0d96-48d6-b17f-4afa3aed3dfb None None] MFA Rules not processed for user `2808986334b647068ea9777af124fe32`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:43.068125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-caa04bc9-0d96-48d6-b17f-4afa3aed3dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:43.202997 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1485/2934] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:43 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:43.368018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459439e-d8d8-44e8-a318-9834bd2e7c5c None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:43.368631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459439e-d8d8-44e8-a318-9834bd2e7c5c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:43.369395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459439e-d8d8-44e8-a318-9834bd2e7c5c None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:43.372029 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1450/2935] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:50:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:50:43.379186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aeef5-81ea-46eb-8061-f99e58749290 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:43.381213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aeef5-81ea-46eb-8061-f99e58749290 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:43.381680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aeef5-81ea-46eb-8061-f99e58749290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:43.403385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b12cdd-dfdc-4f14-8aa1-6148d5d30ad7 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:43.403711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b12cdd-dfdc-4f14-8aa1-6148d5d30ad7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:43.403999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b12cdd-dfdc-4f14-8aa1-6148d5d30ad7 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:43.408205 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1451/2936] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:50:43 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:50:43.413634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c48aeef5-81ea-46eb-8061-f99e58749290 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:43.416516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c48aeef5-81ea-46eb-8061-f99e58749290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:43.419629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb014213-3b96-43fb-ac30-c7f1b0600443 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:43.419977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb014213-3b96-43fb-ac30-c7f1b0600443 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:43.420325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb014213-3b96-43fb-ac30-c7f1b0600443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:43.450130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fb014213-3b96-43fb-ac30-c7f1b0600443 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:43.453077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fb014213-3b96-43fb-ac30-c7f1b0600443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:43.508152 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1486/2937] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:50:43 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:43.537648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48aeef5-81ea-46eb-8061-f99e58749290 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:43.539472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c48aeef5-81ea-46eb-8061-f99e58749290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:43.571988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48aeef5-81ea-46eb-8061-f99e58749290 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:43.586758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b767877-29ea-406e-90d5-53359d8ea630 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:43.587279 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1452/2938] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:50:43 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:50:43.592323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b767877-29ea-406e-90d5-53359d8ea630 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:43.592833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b767877-29ea-406e-90d5-53359d8ea630 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:43.593034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b767877-29ea-406e-90d5-53359d8ea630 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:43.624598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b767877-29ea-406e-90d5-53359d8ea630 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:43.625247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb014213-3b96-43fb-ac30-c7f1b0600443 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:43.627211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fb014213-3b96-43fb-ac30-c7f1b0600443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:43.627353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b767877-29ea-406e-90d5-53359d8ea630 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:43.644360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb014213-3b96-43fb-ac30-c7f1b0600443 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:43.657995 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1487/2939] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:50:43 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:50:43.660700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c32d37-26c2-4940-a86e-9941f7726bb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:43.661366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32d37-26c2-4940-a86e-9941f7726bb7 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:43.661650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32d37-26c2-4940-a86e-9941f7726bb7 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:43.661932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32d37-26c2-4940-a86e-9941f7726bb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:43.672500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c32d37-26c2-4940-a86e-9941f7726bb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:43.673582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c32d37-26c2-4940-a86e-9941f7726bb7 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:43.692375 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1453/2940] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:50:43 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:50:43.991809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f8769-f460-4cf6-89e2-44f6d47d8e3f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:43.992173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f8769-f460-4cf6-89e2-44f6d47d8e3f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:43.992529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f8769-f460-4cf6-89e2-44f6d47d8e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:44.053380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d63f8769-f460-4cf6-89e2-44f6d47d8e3f None None] MFA Rules not processed for user `0184005bc5c34c038fd140564572807e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:44.055678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d63f8769-f460-4cf6-89e2-44f6d47d8e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:44.276048 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1488/2941] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:43 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:44.286118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb37a9-8f89-47b7-a95f-9747b900d396 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:44.286741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb37a9-8f89-47b7-a95f-9747b900d396 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:44.287161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb37a9-8f89-47b7-a95f-9747b900d396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:44.317943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-23bb37a9-8f89-47b7-a95f-9747b900d396 None None] MFA Rules not processed for user `0184005bc5c34c038fd140564572807e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:44.319876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-23bb37a9-8f89-47b7-a95f-9747b900d396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:44.343403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc554d76-c948-4491-9149-634f9fdf8abe None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:44.343972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc554d76-c948-4491-9149-634f9fdf8abe None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:44.344653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc554d76-c948-4491-9149-634f9fdf8abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:44.345605 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1454/2942] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:44 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:44.375172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-cc554d76-c948-4491-9149-634f9fdf8abe None None] MFA Rules not processed for user `0184005bc5c34c038fd140564572807e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:44.377312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cc554d76-c948-4491-9149-634f9fdf8abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:44.389816 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1489/2943] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:44 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:45.949842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb37a9-8f89-47b7-a95f-9747b900d396 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:45.951984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-23bb37a9-8f89-47b7-a95f-9747b900d396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:46.060259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb37a9-8f89-47b7-a95f-9747b900d396 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:46.066781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c6479-6075-492c-92ce-b7d184c907d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:46.067698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c6479-6075-492c-92ce-b7d184c907d9 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:46.068220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c6479-6075-492c-92ce-b7d184c907d9 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:46.068649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c6479-6075-492c-92ce-b7d184c907d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:46.071882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e88c6479-6075-492c-92ce-b7d184c907d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:46.087201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c6479-6075-492c-92ce-b7d184c907d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:46.088957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c6479-6075-492c-92ce-b7d184c907d9 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:46.099600 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1455/2944] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:50:45 2021] GET /identity/v3/auth/tokens => generated 3272 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:50:47.543702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc554d76-c948-4491-9149-634f9fdf8abe None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:50:47.545788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cc554d76-c948-4491-9149-634f9fdf8abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:47.563070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc554d76-c948-4491-9149-634f9fdf8abe None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:50:47.570081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8429c-c435-4d8b-8d1e-1faca60124a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:50:47.571035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8429c-c435-4d8b-8d1e-1faca60124a7 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:47.571530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8429c-c435-4d8b-8d1e-1faca60124a7 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:47.572141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8429c-c435-4d8b-8d1e-1faca60124a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:47.583691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8429c-c435-4d8b-8d1e-1faca60124a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:50:47.585644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8429c-c435-4d8b-8d1e-1faca60124a7 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:50:47.598208 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1490/2945] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:50:47 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:50:49.322336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fc0d1-80a0-44e1-8c39-0014a0824a7a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:49.323277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fc0d1-80a0-44e1-8c39-0014a0824a7a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:49.323775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fc0d1-80a0-44e1-8c39-0014a0824a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:49.366539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-400fc0d1-80a0-44e1-8c39-0014a0824a7a None None] MFA Rules not processed for user `0184005bc5c34c038fd140564572807e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:49.370535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-400fc0d1-80a0-44e1-8c39-0014a0824a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:49.395042 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1456/2946] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:49 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:50.979687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701041-93b5-4063-afa4-1b5495acb766 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:50.980790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701041-93b5-4063-afa4-1b5495acb766 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:50.981071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701041-93b5-4063-afa4-1b5495acb766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:51.017677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d5701041-93b5-4063-afa4-1b5495acb766 None None] MFA Rules not processed for user `0184005bc5c34c038fd140564572807e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:51.018905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d5701041-93b5-4063-afa4-1b5495acb766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:51.038273 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1491/2947] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:50 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:50:57.265585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e16970-d495-4215-9e9a-4ec0e1f73101 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:50:57.266487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e16970-d495-4215-9e9a-4ec0e1f73101 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:50:57.266487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e16970-d495-4215-9e9a-4ec0e1f73101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:50:57.292680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c9e16970-d495-4215-9e9a-4ec0e1f73101 None None] MFA Rules not processed for user `231f078b4f4e4fdc9dcf0c6248f17551`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:50:57.294067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c9e16970-d495-4215-9e9a-4ec0e1f73101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:50:57.445119 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1457/2948] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:50:57 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:02.527736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b798d34-332f-4fb3-86c9-b0fa929d1a2f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:02.528237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b798d34-332f-4fb3-86c9-b0fa929d1a2f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:02.528374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b798d34-332f-4fb3-86c9-b0fa929d1a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:02.589404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2b798d34-332f-4fb3-86c9-b0fa929d1a2f None None] MFA Rules not processed for user `8cf273e7f6d646c4a6c46bc7a197c6a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:02.591202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2b798d34-332f-4fb3-86c9-b0fa929d1a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:02.731560 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1492/2949] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:02 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:06.399254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e16970-d495-4215-9e9a-4ec0e1f73101 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:06.417320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e16970-d495-4215-9e9a-4ec0e1f73101 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:06.424471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2322b-10b2-437e-9177-572fe371e256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:06.425797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2322b-10b2-437e-9177-572fe371e256 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:06.426543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2322b-10b2-437e-9177-572fe371e256 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:06.428535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2322b-10b2-437e-9177-572fe371e256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:06.457736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2322b-10b2-437e-9177-572fe371e256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:06.461194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2322b-10b2-437e-9177-572fe371e256 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:06.477055 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1458/2950] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:06 2021] GET /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:51:14.278177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b798d34-332f-4fb3-86c9-b0fa929d1a2f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:14.300834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b798d34-332f-4fb3-86c9-b0fa929d1a2f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:14.315164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8459d-5bdf-49bc-8e3c-d15a93f26208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:14.318809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8459d-5bdf-49bc-8e3c-d15a93f26208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:14.319167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8459d-5bdf-49bc-8e3c-d15a93f26208 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:14.319460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8459d-5bdf-49bc-8e3c-d15a93f26208 admin admin] PATH_INFO: `/v3/users/2808986334b647068ea9777af124fe32` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:14.321111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8459d-5bdf-49bc-8e3c-d15a93f26208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2808986334b647068ea9777af124fe32)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:14.330068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8459d-5bdf-49bc-8e3c-d15a93f26208 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:14.414551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9ef8459d-5bdf-49bc-8e3c-d15a93f26208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2808986334b647068ea9777af124fe32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:14.423071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9ef8459d-5bdf-49bc-8e3c-d15a93f26208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2808986334b647068ea9777af124fe32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:14.424092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9ef8459d-5bdf-49bc-8e3c-d15a93f26208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2808986334b647068ea9777af124fe32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:14.441239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9ef8459d-5bdf-49bc-8e3c-d15a93f26208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2808986334b647068ea9777af124fe32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:14.452149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9ef8459d-5bdf-49bc-8e3c-d15a93f26208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2808986334b647068ea9777af124fe32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:14.461420 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1493/2951] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:14 2021] DELETE /identity/v3/users/2808986334b647068ea9777af124fe32 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:14.999314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2322b-10b2-437e-9177-572fe371e256 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:15.045178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2322b-10b2-437e-9177-572fe371e256 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:15.218435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1fb0d-37ef-4966-9cae-2b360697d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:15.219323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1fb0d-37ef-4966-9cae-2b360697d19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:15.219661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1fb0d-37ef-4966-9cae-2b360697d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:15.219948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1fb0d-37ef-4966-9cae-2b360697d19d admin admin] PATH_INFO: `/v3/projects/bb6f0b624038403284d782c3c726279c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:15.221676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1fb0d-37ef-4966-9cae-2b360697d19d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb6f0b624038403284d782c3c726279c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:15.223765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1fb0d-37ef-4966-9cae-2b360697d19d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:15.343016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9fa1fb0d-37ef-4966-9cae-2b360697d19d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb6f0b624038403284d782c3c726279c', 'request_id': 'req-9fa1fb0d-37ef-4966-9cae-2b360697d19d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:15.352304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9fa1fb0d-37ef-4966-9cae-2b360697d19d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb6f0b624038403284d782c3c726279c', 'request_id': 'req-9fa1fb0d-37ef-4966-9cae-2b360697d19d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:15.377933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9fa1fb0d-37ef-4966-9cae-2b360697d19d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb6f0b624038403284d782c3c726279c', 'request_id': 'req-9fa1fb0d-37ef-4966-9cae-2b360697d19d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:15.396230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9fa1fb0d-37ef-4966-9cae-2b360697d19d admin admin] The token cache is being invalidate because project bb6f0b624038403284d782c3c726279c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:15.396570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9fa1fb0d-37ef-4966-9cae-2b360697d19d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:15.397464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9fa1fb0d-37ef-4966-9cae-2b360697d19d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:15.404944 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1459/2952] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:14 2021] DELETE /identity/v3/projects/bb6f0b624038403284d782c3c726279c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:15.405099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8459d-5bdf-49bc-8e3c-d15a93f26208 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:15.406803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9ef8459d-5bdf-49bc-8e3c-d15a93f26208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:15.423105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8459d-5bdf-49bc-8e3c-d15a93f26208 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:15.496580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463bbe8-7de8-48b6-a8e2-5f1b95121be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:15.499410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463bbe8-7de8-48b6-a8e2-5f1b95121be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:15.499875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463bbe8-7de8-48b6-a8e2-5f1b95121be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:15.500335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463bbe8-7de8-48b6-a8e2-5f1b95121be2 admin admin] PATH_INFO: `/v3/users/5ab3350ab5f74e7a8139e1bb149e620e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:15.501640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463bbe8-7de8-48b6-a8e2-5f1b95121be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab3350ab5f74e7a8139e1bb149e620e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:15.503791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463bbe8-7de8-48b6-a8e2-5f1b95121be2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:15.561995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7463bbe8-7de8-48b6-a8e2-5f1b95121be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab3350ab5f74e7a8139e1bb149e620e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:15.569527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7463bbe8-7de8-48b6-a8e2-5f1b95121be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab3350ab5f74e7a8139e1bb149e620e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:15.570154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7463bbe8-7de8-48b6-a8e2-5f1b95121be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab3350ab5f74e7a8139e1bb149e620e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:15.582076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7463bbe8-7de8-48b6-a8e2-5f1b95121be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab3350ab5f74e7a8139e1bb149e620e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:15.595631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7463bbe8-7de8-48b6-a8e2-5f1b95121be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab3350ab5f74e7a8139e1bb149e620e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:15.603593 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1494/2953] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:15 2021] DELETE /identity/v3/users/5ab3350ab5f74e7a8139e1bb149e620e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:15.816483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1fb0d-37ef-4966-9cae-2b360697d19d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:15.818201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9fa1fb0d-37ef-4966-9cae-2b360697d19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:15.838726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1fb0d-37ef-4966-9cae-2b360697d19d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:15.905058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad1aaf-24c2-450b-ac32-f2ff65149cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:15.905922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad1aaf-24c2-450b-ac32-f2ff65149cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:15.906208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad1aaf-24c2-450b-ac32-f2ff65149cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:15.906529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad1aaf-24c2-450b-ac32-f2ff65149cb4 admin admin] PATH_INFO: `/v3/projects/1ed51129f61f4c7d886923057530f6d8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:15.907723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad1aaf-24c2-450b-ac32-f2ff65149cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed51129f61f4c7d886923057530f6d8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:15.909798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad1aaf-24c2-450b-ac32-f2ff65149cb4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:15.959737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-baad1aaf-24c2-450b-ac32-f2ff65149cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed51129f61f4c7d886923057530f6d8', 'request_id': 'req-baad1aaf-24c2-450b-ac32-f2ff65149cb4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:15.966407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-baad1aaf-24c2-450b-ac32-f2ff65149cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed51129f61f4c7d886923057530f6d8', 'request_id': 'req-baad1aaf-24c2-450b-ac32-f2ff65149cb4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:15.971884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-baad1aaf-24c2-450b-ac32-f2ff65149cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed51129f61f4c7d886923057530f6d8', 'request_id': 'req-baad1aaf-24c2-450b-ac32-f2ff65149cb4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:15.985080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-baad1aaf-24c2-450b-ac32-f2ff65149cb4 admin admin] The token cache is being invalidate because project 1ed51129f61f4c7d886923057530f6d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:15.985386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-baad1aaf-24c2-450b-ac32-f2ff65149cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:15.985985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-baad1aaf-24c2-450b-ac32-f2ff65149cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:15.987545 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1460/2954] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:15 2021] DELETE /identity/v3/projects/1ed51129f61f4c7d886923057530f6d8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:16.002762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69238da9-b43a-429b-9e69-75034c1d89d1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:16.003062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69238da9-b43a-429b-9e69-75034c1d89d1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:16.003369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69238da9-b43a-429b-9e69-75034c1d89d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:16.021373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-69238da9-b43a-429b-9e69-75034c1d89d1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:16.022636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-69238da9-b43a-429b-9e69-75034c1d89d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:16.082953 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1495/2955] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:16.091281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eda7a2-44eb-4e32-ada9-68eae40b74d7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:16.091789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eda7a2-44eb-4e32-ada9-68eae40b74d7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:16.091894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eda7a2-44eb-4e32-ada9-68eae40b74d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:16.110175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-56eda7a2-44eb-4e32-ada9-68eae40b74d7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:16.111430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-56eda7a2-44eb-4e32-ada9-68eae40b74d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:16.119608 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1461/2956] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:16.124339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69238da9-b43a-429b-9e69-75034c1d89d1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:16.137305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69238da9-b43a-429b-9e69-75034c1d89d1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:16.140456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955c367-272d-4b90-bc25-f5efd6e44b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:16.141229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c367-272d-4b90-bc25-f5efd6e44b4a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:16.141616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c367-272d-4b90-bc25-f5efd6e44b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:16.141995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c367-272d-4b90-bc25-f5efd6e44b4a admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:16.143111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955c367-272d-4b90-bc25-f5efd6e44b4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:16.143592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955c367-272d-4b90-bc25-f5efd6e44b4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:16.145282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955c367-272d-4b90-bc25-f5efd6e44b4a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:16.158957 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1496/2957] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:51:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:16.163227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eda7a2-44eb-4e32-ada9-68eae40b74d7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:16.173342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eda7a2-44eb-4e32-ada9-68eae40b74d7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:16.179067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839254cb-5681-4803-ab60-c277946afed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:16.179843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839254cb-5681-4803-ab60-c277946afed2 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:16.180225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839254cb-5681-4803-ab60-c277946afed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:16.180610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839254cb-5681-4803-ab60-c277946afed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:16.181572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839254cb-5681-4803-ab60-c277946afed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:16.183600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839254cb-5681-4803-ab60-c277946afed2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:16.232347 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1462/2958] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:16 2021] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:16.236577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955c367-272d-4b90-bc25-f5efd6e44b4a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:16.249714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955c367-272d-4b90-bc25-f5efd6e44b4a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:16.317397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114a5d9-df73-4094-b3f1-5361962a5f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:16.318151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114a5d9-df73-4094-b3f1-5361962a5f2c admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:16.318531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114a5d9-df73-4094-b3f1-5361962a5f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:16.318879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114a5d9-df73-4094-b3f1-5361962a5f2c admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:16.319748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114a5d9-df73-4094-b3f1-5361962a5f2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:16.321931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114a5d9-df73-4094-b3f1-5361962a5f2c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:16.347528 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1497/2959] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:16 2021] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:16.351650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839254cb-5681-4803-ab60-c277946afed2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:16.361900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839254cb-5681-4803-ab60-c277946afed2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:16.367317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c532c-d943-4b3f-bcc1-0c18febcfb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:16.368163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c532c-d943-4b3f-bcc1-0c18febcfb1a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:16.368603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c532c-d943-4b3f-bcc1-0c18febcfb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:16.369049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c532c-d943-4b3f-bcc1-0c18febcfb1a admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:16.369931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c532c-d943-4b3f-bcc1-0c18febcfb1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:16.371885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c532c-d943-4b3f-bcc1-0c18febcfb1a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:16.384448 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1463/2960] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:16 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:16.388542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114a5d9-df73-4094-b3f1-5361962a5f2c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:16.399195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114a5d9-df73-4094-b3f1-5361962a5f2c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:16.404886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163ddd8-b845-4405-b5ee-6d086af01af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:16.405550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163ddd8-b845-4405-b5ee-6d086af01af0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:16.406119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163ddd8-b845-4405-b5ee-6d086af01af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:16.406119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163ddd8-b845-4405-b5ee-6d086af01af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:16.407768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163ddd8-b845-4405-b5ee-6d086af01af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:16.409172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163ddd8-b845-4405-b5ee-6d086af01af0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:16.420263 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1498/2961] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:16 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:51:16.424004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c532c-d943-4b3f-bcc1-0c18febcfb1a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:16.433950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c532c-d943-4b3f-bcc1-0c18febcfb1a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:16.438942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579bc66-dd71-44a0-9f3b-e481143d75c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:16.439896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579bc66-dd71-44a0-9f3b-e481143d75c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:16.440186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579bc66-dd71-44a0-9f3b-e481143d75c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:16.440464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579bc66-dd71-44a0-9f3b-e481143d75c3 admin admin] PATH_INFO: `/v3/projects/87106c9e017a47a7bb1e39ca88aa483a/users/61cc84a74d01474980aaf66eba0be5e4/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:16.458595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579bc66-dd71-44a0-9f3b-e481143d75c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87106c9e017a47a7bb1e39ca88aa483a, user_id=61cc84a74d01474980aaf66eba0be5e4, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:16.461451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579bc66-dd71-44a0-9f3b-e481143d75c3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:16.476403 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1464/2962] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:16 2021] PUT /identity/v3/projects/87106c9e017a47a7bb1e39ca88aa483a/users/61cc84a74d01474980aaf66eba0be5e4/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:16.491697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2569716-cb03-4a58-ab6f-d22ed819a1d8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:16.491995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2569716-cb03-4a58-ab6f-d22ed819a1d8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:16.492281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2569716-cb03-4a58-ab6f-d22ed819a1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:16.521046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c2569716-cb03-4a58-ab6f-d22ed819a1d8 None None] MFA Rules not processed for user `61cc84a74d01474980aaf66eba0be5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:16.522515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c2569716-cb03-4a58-ab6f-d22ed819a1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:16.592985 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1499/2963] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:16 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:16.597625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579bc66-dd71-44a0-9f3b-e481143d75c3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:16.658467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579bc66-dd71-44a0-9f3b-e481143d75c3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:16.663262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9949b-4b6c-4caf-982b-5e3d00d20ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:16.663921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9949b-4b6c-4caf-982b-5e3d00d20ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:16.664206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9949b-4b6c-4caf-982b-5e3d00d20ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:16.664485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9949b-4b6c-4caf-982b-5e3d00d20ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:16.665195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9949b-4b6c-4caf-982b-5e3d00d20ae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:16.667127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9949b-4b6c-4caf-982b-5e3d00d20ae1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:16.696417 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1465/2964] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:16 2021] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:16.701515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2569716-cb03-4a58-ab6f-d22ed819a1d8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:16.713439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2569716-cb03-4a58-ab6f-d22ed819a1d8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:16.727739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94562282-9779-4225-bc0c-7efa312df914 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:16.728285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94562282-9779-4225-bc0c-7efa312df914 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:16.728778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94562282-9779-4225-bc0c-7efa312df914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:16.751651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-94562282-9779-4225-bc0c-7efa312df914 None None] MFA Rules not processed for user `231f078b4f4e4fdc9dcf0c6248f17551`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:16.753184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-94562282-9779-4225-bc0c-7efa312df914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:16.799124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c8672-b06f-4c48-a188-ae8b69f12a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:16.801665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c8672-b06f-4c48-a188-ae8b69f12a1e admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:16.801957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c8672-b06f-4c48-a188-ae8b69f12a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:16.802242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c8672-b06f-4c48-a188-ae8b69f12a1e admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:16.802976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c8672-b06f-4c48-a188-ae8b69f12a1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:16.804933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c8672-b06f-4c48-a188-ae8b69f12a1e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:16.822036 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1466/2965] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:16 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:16.835165 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1500/2966] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:16 2021] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:16.836955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94562282-9779-4225-bc0c-7efa312df914 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:16.848413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94562282-9779-4225-bc0c-7efa312df914 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:16.853196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7135f9b-e49c-4b08-b558-6d75d869e731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:16.854072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7135f9b-e49c-4b08-b558-6d75d869e731 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:16.854553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7135f9b-e49c-4b08-b558-6d75d869e731 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:16.855014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7135f9b-e49c-4b08-b558-6d75d869e731 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:16.856052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7135f9b-e49c-4b08-b558-6d75d869e731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:16.858317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7135f9b-e49c-4b08-b558-6d75d869e731 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:16.868952 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1467/2967] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:16 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:16.874417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c8672-b06f-4c48-a188-ae8b69f12a1e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:16.888239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c8672-b06f-4c48-a188-ae8b69f12a1e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:16.893693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56823d7b-5675-47d0-823e-0d51d0e2bf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:16.894833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823d7b-5675-47d0-823e-0d51d0e2bf8f admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:16.895146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823d7b-5675-47d0-823e-0d51d0e2bf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:16.895381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823d7b-5675-47d0-823e-0d51d0e2bf8f admin admin] PATH_INFO: `/v3/projects/2625d7ce5de74f19ab91b2ed6c441082/users/2df66d8d4ff94b7dbf36a0ff981fb971/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:16.915303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56823d7b-5675-47d0-823e-0d51d0e2bf8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2625d7ce5de74f19ab91b2ed6c441082, user_id=2df66d8d4ff94b7dbf36a0ff981fb971, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:16.920378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56823d7b-5675-47d0-823e-0d51d0e2bf8f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:16.945582 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1501/2968] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:16 2021] PUT /identity/v3/projects/2625d7ce5de74f19ab91b2ed6c441082/users/2df66d8d4ff94b7dbf36a0ff981fb971/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:16.946679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7135f9b-e49c-4b08-b558-6d75d869e731 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:16.957463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7135f9b-e49c-4b08-b558-6d75d869e731 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:17.016485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a61b96-7b64-4044-a9a2-4cb808a79a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:17.017176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a61b96-7b64-4044-a9a2-4cb808a79a91 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:17.018171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a61b96-7b64-4044-a9a2-4cb808a79a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:17.018495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a61b96-7b64-4044-a9a2-4cb808a79a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:17.019238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a61b96-7b64-4044-a9a2-4cb808a79a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:17.020922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a61b96-7b64-4044-a9a2-4cb808a79a91 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:17.033970 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1468/2969] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:16 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:17.035139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56823d7b-5675-47d0-823e-0d51d0e2bf8f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:17.046775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56823d7b-5675-47d0-823e-0d51d0e2bf8f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:17.052103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51799c97-c1fe-40bf-a5ee-dcf90bd80e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:17.052477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51799c97-c1fe-40bf-a5ee-dcf90bd80e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:17.052756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51799c97-c1fe-40bf-a5ee-dcf90bd80e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:17.053032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51799c97-c1fe-40bf-a5ee-dcf90bd80e1b admin admin] PATH_INFO: `/v3/projects/2625d7ce5de74f19ab91b2ed6c441082/users/2df66d8d4ff94b7dbf36a0ff981fb971/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:17.055726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51799c97-c1fe-40bf-a5ee-dcf90bd80e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2625d7ce5de74f19ab91b2ed6c441082, user_id=2df66d8d4ff94b7dbf36a0ff981fb971, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:17.058939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51799c97-c1fe-40bf-a5ee-dcf90bd80e1b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:17.074357 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1502/2970] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:17 2021] PUT /identity/v3/projects/2625d7ce5de74f19ab91b2ed6c441082/users/2df66d8d4ff94b7dbf36a0ff981fb971/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:51:17.082746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b63f84-13c4-47ae-bc4f-5ba09416a372 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:17.083038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b63f84-13c4-47ae-bc4f-5ba09416a372 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:17.083317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b63f84-13c4-47ae-bc4f-5ba09416a372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:17.130613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-54b63f84-13c4-47ae-bc4f-5ba09416a372 None None] MFA Rules not processed for user `2df66d8d4ff94b7dbf36a0ff981fb971`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:17.132500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-54b63f84-13c4-47ae-bc4f-5ba09416a372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:17.218970 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1469/2971] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:17 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:17.223869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51799c97-c1fe-40bf-a5ee-dcf90bd80e1b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:17.235165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51799c97-c1fe-40bf-a5ee-dcf90bd80e1b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:17.265160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626803e-33eb-4a80-b254-ada80883d383 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df66d8d4ff94b7dbf36a0ff981fb971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2625d7ce5de74f19ab91b2ed6c441082', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:17.266068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626803e-33eb-4a80-b254-ada80883d383 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:17.266386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626803e-33eb-4a80-b254-ada80883d383 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:17.266664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626803e-33eb-4a80-b254-ada80883d383 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:17.271827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626803e-33eb-4a80-b254-ada80883d383 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:17.276200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626803e-33eb-4a80-b254-ada80883d383 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:17.307350 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1503/2972] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 20:51:17 2021] POST /identity/v3/domains => generated 245 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:17.311774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b63f84-13c4-47ae-bc4f-5ba09416a372 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:17.332514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b63f84-13c4-47ae-bc4f-5ba09416a372 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:17.410622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf0e75-2996-4bb9-86f6-b6788120fb2d tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df66d8d4ff94b7dbf36a0ff981fb971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2625d7ce5de74f19ab91b2ed6c441082', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:17.411362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf0e75-2996-4bb9-86f6-b6788120fb2d tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:17.411845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf0e75-2996-4bb9-86f6-b6788120fb2d tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:17.412332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf0e75-2996-4bb9-86f6-b6788120fb2d tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:17.413224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf0e75-2996-4bb9-86f6-b6788120fb2d tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:17.415180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf0e75-2996-4bb9-86f6-b6788120fb2d tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:17.483752 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1470/2973] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:17 2021] POST /identity/v3/projects => generated 409 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:17.485030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626803e-33eb-4a80-b254-ada80883d383 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:17.498346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626803e-33eb-4a80-b254-ada80883d383 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:17.592834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c04240-2f1f-44fc-bda7-4aa98b198c3b tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df66d8d4ff94b7dbf36a0ff981fb971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2625d7ce5de74f19ab91b2ed6c441082', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:17.593623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c04240-2f1f-44fc-bda7-4aa98b198c3b tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:17.594004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c04240-2f1f-44fc-bda7-4aa98b198c3b tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:17.594516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c04240-2f1f-44fc-bda7-4aa98b198c3b tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:17.595451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c04240-2f1f-44fc-bda7-4aa98b198c3b tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:17.598757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c04240-2f1f-44fc-bda7-4aa98b198c3b tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:17.645974 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1504/2974] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:17 2021] POST /identity/v3/users => generated 347 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:17.650185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf0e75-2996-4bb9-86f6-b6788120fb2d tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:17.674869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf0e75-2996-4bb9-86f6-b6788120fb2d tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:17.692495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c56544-6ea7-498a-8f00-403e76098f4a tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df66d8d4ff94b7dbf36a0ff981fb971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2625d7ce5de74f19ab91b2ed6c441082', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:17.693428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c56544-6ea7-498a-8f00-403e76098f4a tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:17.693859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c56544-6ea7-498a-8f00-403e76098f4a tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:17.694384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c56544-6ea7-498a-8f00-403e76098f4a tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:17.695770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c56544-6ea7-498a-8f00-403e76098f4a tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:17.698678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c56544-6ea7-498a-8f00-403e76098f4a tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:17.730854 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1471/2975] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:17 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:17.735408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c04240-2f1f-44fc-bda7-4aa98b198c3b tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:17.748756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c04240-2f1f-44fc-bda7-4aa98b198c3b tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:17.755003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b5e4f-a2fe-4710-9d7d-0c5dc5225266 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df66d8d4ff94b7dbf36a0ff981fb971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2625d7ce5de74f19ab91b2ed6c441082', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:17.756153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b5e4f-a2fe-4710-9d7d-0c5dc5225266 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:17.756609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b5e4f-a2fe-4710-9d7d-0c5dc5225266 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:17.757050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b5e4f-a2fe-4710-9d7d-0c5dc5225266 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] PATH_INFO: `/v3/projects/5a7c5863f54d415f8959fbdb74302ac3/users/95bbd75af07045ccb9b2f58ace294bd1/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:17.793352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b5e4f-a2fe-4710-9d7d-0c5dc5225266 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5a7c5863f54d415f8959fbdb74302ac3, user_id=95bbd75af07045ccb9b2f58ace294bd1, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:17.803107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b5e4f-a2fe-4710-9d7d-0c5dc5225266 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:17.836746 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1505/2976] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:17 2021] PUT /identity/v3/projects/5a7c5863f54d415f8959fbdb74302ac3/users/95bbd75af07045ccb9b2f58ace294bd1/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:17.841090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a04e9-b00e-4d1d-89d7-8c5984aa7acf None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:17.841488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a04e9-b00e-4d1d-89d7-8c5984aa7acf None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:17.841860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a04e9-b00e-4d1d-89d7-8c5984aa7acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:18.069235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-507a04e9-b00e-4d1d-89d7-8c5984aa7acf None None] MFA Rules not processed for user `95bbd75af07045ccb9b2f58ace294bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:18.071015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-507a04e9-b00e-4d1d-89d7-8c5984aa7acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:18.101290 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1472/2977] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:17 2021] POST /identity/v3/auth/tokens => generated 3349 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:18.111896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30672e1-1b8e-4620-8ac2-4aeba9a6598b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:18.112370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30672e1-1b8e-4620-8ac2-4aeba9a6598b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:18.112724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30672e1-1b8e-4620-8ac2-4aeba9a6598b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:18.141829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d30672e1-1b8e-4620-8ac2-4aeba9a6598b None None] MFA Rules not processed for user `95bbd75af07045ccb9b2f58ace294bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:18.146116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d30672e1-1b8e-4620-8ac2-4aeba9a6598b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:18.158186 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1506/2978] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:18 2021] POST /identity/v3/auth/tokens => generated 3349 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:18.162170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a04e9-b00e-4d1d-89d7-8c5984aa7acf None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:18.176394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a04e9-b00e-4d1d-89d7-8c5984aa7acf None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:18.181860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8dde5-c633-4b66-9020-8aa50a5d8a4d tempest-test_project-226509273 tempest-user-474891344] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bbd75af07045ccb9b2f58ace294bd1', 'user_domain_id': '43b43fa23eb54b52b580c041079a15ea', 'system_scope': None, 'project_id': '5a7c5863f54d415f8959fbdb74302ac3', 'project_domain_id': '43b43fa23eb54b52b580c041079a15ea', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:18.182554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8dde5-c633-4b66-9020-8aa50a5d8a4d tempest-test_project-226509273 tempest-user-474891344] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:18.182843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8dde5-c633-4b66-9020-8aa50a5d8a4d tempest-test_project-226509273 tempest-user-474891344] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:18.183186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8dde5-c633-4b66-9020-8aa50a5d8a4d tempest-test_project-226509273 tempest-user-474891344] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:18.193155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8dde5-c633-4b66-9020-8aa50a5d8a4d tempest-test_project-226509273 tempest-user-474891344] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:18.195504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8dde5-c633-4b66-9020-8aa50a5d8a4d tempest-test_project-226509273 tempest-user-474891344] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:18.209499 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1473/2979] 10.222.0.13 () {56 vars in 1283 bytes} [Sat Dec 18 20:51:18 2021] GET /identity/v3/auth/tokens => generated 3349 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:51:18.214905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30672e1-1b8e-4620-8ac2-4aeba9a6598b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:18.288030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30672e1-1b8e-4620-8ac2-4aeba9a6598b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:18.294062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac44cd6-99c1-45d7-b9c5-e76f042bfdcf tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df66d8d4ff94b7dbf36a0ff981fb971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2625d7ce5de74f19ab91b2ed6c441082', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:18.295135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac44cd6-99c1-45d7-b9c5-e76f042bfdcf tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:18.295429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac44cd6-99c1-45d7-b9c5-e76f042bfdcf tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:18.295692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac44cd6-99c1-45d7-b9c5-e76f042bfdcf tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] PATH_INFO: `/v3/users/95bbd75af07045ccb9b2f58ace294bd1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:18.296985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac44cd6-99c1-45d7-b9c5-e76f042bfdcf tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorizing `identity:delete_user(user_id=95bbd75af07045ccb9b2f58ace294bd1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:18.299014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac44cd6-99c1-45d7-b9c5-e76f042bfdcf tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:18.377514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0ac44cd6-99c1-45d7-b9c5-e76f042bfdcf tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95bbd75af07045ccb9b2f58ace294bd1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:18.386577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0ac44cd6-99c1-45d7-b9c5-e76f042bfdcf tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95bbd75af07045ccb9b2f58ace294bd1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:18.387865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0ac44cd6-99c1-45d7-b9c5-e76f042bfdcf tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95bbd75af07045ccb9b2f58ace294bd1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:18.412274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0ac44cd6-99c1-45d7-b9c5-e76f042bfdcf tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95bbd75af07045ccb9b2f58ace294bd1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:18.424610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0ac44cd6-99c1-45d7-b9c5-e76f042bfdcf tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95bbd75af07045ccb9b2f58ace294bd1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:18.438019 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1507/2980] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:18 2021] DELETE /identity/v3/users/95bbd75af07045ccb9b2f58ace294bd1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:18.442701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8dde5-c633-4b66-9020-8aa50a5d8a4d tempest-test_project-226509273 tempest-user-474891344] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:18.474076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8dde5-c633-4b66-9020-8aa50a5d8a4d tempest-test_project-226509273 tempest-user-474891344] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:18.627777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e014000-4932-4572-920f-c02bbe6a3dd1 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df66d8d4ff94b7dbf36a0ff981fb971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2625d7ce5de74f19ab91b2ed6c441082', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:18.628997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e014000-4932-4572-920f-c02bbe6a3dd1 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:18.629527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e014000-4932-4572-920f-c02bbe6a3dd1 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:18.629957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e014000-4932-4572-920f-c02bbe6a3dd1 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] PATH_INFO: `/v3/projects/5a7c5863f54d415f8959fbdb74302ac3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:18.632096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e014000-4932-4572-920f-c02bbe6a3dd1 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5a7c5863f54d415f8959fbdb74302ac3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:18.635405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e014000-4932-4572-920f-c02bbe6a3dd1 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:18.723865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6e014000-4932-4572-920f-c02bbe6a3dd1 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a7c5863f54d415f8959fbdb74302ac3', 'request_id': 'req-6e014000-4932-4572-920f-c02bbe6a3dd1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:18.730168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6e014000-4932-4572-920f-c02bbe6a3dd1 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a7c5863f54d415f8959fbdb74302ac3', 'request_id': 'req-6e014000-4932-4572-920f-c02bbe6a3dd1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:18.737350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6e014000-4932-4572-920f-c02bbe6a3dd1 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a7c5863f54d415f8959fbdb74302ac3', 'request_id': 'req-6e014000-4932-4572-920f-c02bbe6a3dd1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:18.754464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6e014000-4932-4572-920f-c02bbe6a3dd1 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] The token cache is being invalidate because project 5a7c5863f54d415f8959fbdb74302ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:18.754760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6e014000-4932-4572-920f-c02bbe6a3dd1 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:18.755431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6e014000-4932-4572-920f-c02bbe6a3dd1 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:18.757033 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1474/2981] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:18 2021] DELETE /identity/v3/projects/5a7c5863f54d415f8959fbdb74302ac3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:18.761300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac44cd6-99c1-45d7-b9c5-e76f042bfdcf tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:18.763529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0ac44cd6-99c1-45d7-b9c5-e76f042bfdcf tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:18.779872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac44cd6-99c1-45d7-b9c5-e76f042bfdcf tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:18.849284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94abd3-d326-4b39-b762-5bddc0030598 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df66d8d4ff94b7dbf36a0ff981fb971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2625d7ce5de74f19ab91b2ed6c441082', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:18.850698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94abd3-d326-4b39-b762-5bddc0030598 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:18.850987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94abd3-d326-4b39-b762-5bddc0030598 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:18.851275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94abd3-d326-4b39-b762-5bddc0030598 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] PATH_INFO: `/v3/domains/43b43fa23eb54b52b580c041079a15ea` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:18.852691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94abd3-d326-4b39-b762-5bddc0030598 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=43b43fa23eb54b52b580c041079a15ea)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:18.853843 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-2f94abd3-d326-4b39-b762-5bddc0030598 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:18.853843 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:51:18.853843 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:51:18.854757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94abd3-d326-4b39-b762-5bddc0030598 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:18.880132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f94abd3-d326-4b39-b762-5bddc0030598 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '43b43fa23eb54b52b580c041079a15ea'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:18.881145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f94abd3-d326-4b39-b762-5bddc0030598 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '43b43fa23eb54b52b580c041079a15ea'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:18.913179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f94abd3-d326-4b39-b762-5bddc0030598 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '43b43fa23eb54b52b580c041079a15ea'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:18.913179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f94abd3-d326-4b39-b762-5bddc0030598 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '43b43fa23eb54b52b580c041079a15ea'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:18.925981 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1508/2982] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 20:51:18 2021] PATCH /identity/v3/domains/43b43fa23eb54b52b580c041079a15ea => generated 246 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:18.929994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e014000-4932-4572-920f-c02bbe6a3dd1 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:18.931733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6e014000-4932-4572-920f-c02bbe6a3dd1 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:18.953269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e014000-4932-4572-920f-c02bbe6a3dd1 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:19.027516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df66d8d4ff94b7dbf36a0ff981fb971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2625d7ce5de74f19ab91b2ed6c441082', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:19.028922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:19.029202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:19.029495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] PATH_INFO: `/v3/domains/43b43fa23eb54b52b580c041079a15ea` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:19.045462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=43b43fa23eb54b52b580c041079a15ea)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:19.046544 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:19.046544 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:51:19.046544 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:51:19.047760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:19.075369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '43b43fa23eb54b52b580c041079a15ea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:19.081872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '43b43fa23eb54b52b580c041079a15ea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:19.159917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b43fa23eb54b52b580c041079a15ea', 'request_id': 'req-8046dc65-dcdc-475d-9078-6a63db869490'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:19.169210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b43fa23eb54b52b580c041079a15ea', 'request_id': 'req-8046dc65-dcdc-475d-9078-6a63db869490'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:19.175459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b43fa23eb54b52b580c041079a15ea', 'request_id': 'req-8046dc65-dcdc-475d-9078-6a63db869490'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:19.194284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] The token cache is being invalidate because project 43b43fa23eb54b52b580c041079a15ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:19.194516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:19.195141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:19.214681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '43b43fa23eb54b52b580c041079a15ea', 'request_id': 'req-8046dc65-dcdc-475d-9078-6a63db869490'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:19.220297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '43b43fa23eb54b52b580c041079a15ea', 'request_id': 'req-8046dc65-dcdc-475d-9078-6a63db869490'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:19.221050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8046dc65-dcdc-475d-9078-6a63db869490 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '43b43fa23eb54b52b580c041079a15ea', 'request_id': 'req-8046dc65-dcdc-475d-9078-6a63db869490'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:19.227359 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1475/2983] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 20:51:18 2021] DELETE /identity/v3/domains/43b43fa23eb54b52b580c041079a15ea => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:19.233001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94abd3-d326-4b39-b762-5bddc0030598 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:19.234613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2f94abd3-d326-4b39-b762-5bddc0030598 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:19.340919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94abd3-d326-4b39-b762-5bddc0030598 tempest-TestDefaultProjectId-2057194875 tempest-TestDefaultProjectId-2057194875-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:19.407044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907fd3f-e8e9-4b02-8304-7086b7d0e4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:19.408245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907fd3f-e8e9-4b02-8304-7086b7d0e4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:19.408658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907fd3f-e8e9-4b02-8304-7086b7d0e4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:19.409039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907fd3f-e8e9-4b02-8304-7086b7d0e4d3 admin admin] PATH_INFO: `/v3/users/61cc84a74d01474980aaf66eba0be5e4` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:19.410499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907fd3f-e8e9-4b02-8304-7086b7d0e4d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61cc84a74d01474980aaf66eba0be5e4)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:19.412551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907fd3f-e8e9-4b02-8304-7086b7d0e4d3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:19.482377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e907fd3f-e8e9-4b02-8304-7086b7d0e4d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61cc84a74d01474980aaf66eba0be5e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:19.492107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e907fd3f-e8e9-4b02-8304-7086b7d0e4d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61cc84a74d01474980aaf66eba0be5e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:19.494966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e907fd3f-e8e9-4b02-8304-7086b7d0e4d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61cc84a74d01474980aaf66eba0be5e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:19.516191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e907fd3f-e8e9-4b02-8304-7086b7d0e4d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61cc84a74d01474980aaf66eba0be5e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:19.529327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e907fd3f-e8e9-4b02-8304-7086b7d0e4d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61cc84a74d01474980aaf66eba0be5e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:19.549733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807ff73-1ee7-446b-9233-dfe71bf65779 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:19.550034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807ff73-1ee7-446b-9233-dfe71bf65779 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:19.550381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807ff73-1ee7-446b-9233-dfe71bf65779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:19.550620 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1509/2984] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:19 2021] DELETE /identity/v3/users/61cc84a74d01474980aaf66eba0be5e4 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:19.584620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9807ff73-1ee7-446b-9233-dfe71bf65779 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:19.591618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9807ff73-1ee7-446b-9233-dfe71bf65779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:19.700852 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1476/2985] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:19.707289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907fd3f-e8e9-4b02-8304-7086b7d0e4d3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:19.709199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e907fd3f-e8e9-4b02-8304-7086b7d0e4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:19.789823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907fd3f-e8e9-4b02-8304-7086b7d0e4d3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:19.795371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e37f8-3f4e-4523-9def-e6a227911a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:19.796349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e37f8-3f4e-4523-9def-e6a227911a7b service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:19.796728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e37f8-3f4e-4523-9def-e6a227911a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:19.797101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e37f8-3f4e-4523-9def-e6a227911a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:19.807362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e37f8-3f4e-4523-9def-e6a227911a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:19.808987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e37f8-3f4e-4523-9def-e6a227911a7b service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:19.821787 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1510/2986] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:51:20.595215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807ff73-1ee7-446b-9233-dfe71bf65779 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:20.596701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9807ff73-1ee7-446b-9233-dfe71bf65779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:20.610117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807ff73-1ee7-446b-9233-dfe71bf65779 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:20.616082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa356a5a-f272-4985-82f0-65641a3236a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:20.616952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa356a5a-f272-4985-82f0-65641a3236a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:20.617311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa356a5a-f272-4985-82f0-65641a3236a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:20.617503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa356a5a-f272-4985-82f0-65641a3236a7 admin admin] PATH_INFO: `/v3/projects/87106c9e017a47a7bb1e39ca88aa483a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:20.619171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa356a5a-f272-4985-82f0-65641a3236a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87106c9e017a47a7bb1e39ca88aa483a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:20.621339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa356a5a-f272-4985-82f0-65641a3236a7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:20.720266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-fa356a5a-f272-4985-82f0-65641a3236a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87106c9e017a47a7bb1e39ca88aa483a', 'request_id': 'req-fa356a5a-f272-4985-82f0-65641a3236a7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:20.742222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-fa356a5a-f272-4985-82f0-65641a3236a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87106c9e017a47a7bb1e39ca88aa483a', 'request_id': 'req-fa356a5a-f272-4985-82f0-65641a3236a7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:20.749833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-fa356a5a-f272-4985-82f0-65641a3236a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87106c9e017a47a7bb1e39ca88aa483a', 'request_id': 'req-fa356a5a-f272-4985-82f0-65641a3236a7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:20.766715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-fa356a5a-f272-4985-82f0-65641a3236a7 admin admin] The token cache is being invalidate because project 87106c9e017a47a7bb1e39ca88aa483a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:20.767131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-fa356a5a-f272-4985-82f0-65641a3236a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:20.767978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-fa356a5a-f272-4985-82f0-65641a3236a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:20.773639 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1477/2987] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:20 2021] DELETE /identity/v3/projects/87106c9e017a47a7bb1e39ca88aa483a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:20.774029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e37f8-3f4e-4523-9def-e6a227911a7b service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:20.796027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e37f8-3f4e-4523-9def-e6a227911a7b service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:20.935476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db32baa-63df-4fee-92fd-a1600cc60f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:20.936370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db32baa-63df-4fee-92fd-a1600cc60f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:20.936650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db32baa-63df-4fee-92fd-a1600cc60f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:20.936925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db32baa-63df-4fee-92fd-a1600cc60f70 admin admin] PATH_INFO: `/v3/users/2df66d8d4ff94b7dbf36a0ff981fb971` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:20.939329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db32baa-63df-4fee-92fd-a1600cc60f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df66d8d4ff94b7dbf36a0ff981fb971)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:20.942711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db32baa-63df-4fee-92fd-a1600cc60f70 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:21.049312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0db32baa-63df-4fee-92fd-a1600cc60f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df66d8d4ff94b7dbf36a0ff981fb971'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:21.065768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0db32baa-63df-4fee-92fd-a1600cc60f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df66d8d4ff94b7dbf36a0ff981fb971'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:21.068711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0db32baa-63df-4fee-92fd-a1600cc60f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df66d8d4ff94b7dbf36a0ff981fb971'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:21.101899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0db32baa-63df-4fee-92fd-a1600cc60f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df66d8d4ff94b7dbf36a0ff981fb971'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:21.117567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0db32baa-63df-4fee-92fd-a1600cc60f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df66d8d4ff94b7dbf36a0ff981fb971'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:21.128575 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1511/2988] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:20 2021] DELETE /identity/v3/users/2df66d8d4ff94b7dbf36a0ff981fb971 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:21.657599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa356a5a-f272-4985-82f0-65641a3236a7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:21.660351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fa356a5a-f272-4985-82f0-65641a3236a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:21.694912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa356a5a-f272-4985-82f0-65641a3236a7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:21.788483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c625757-0dc3-4fef-be34-f3f7d363baf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:21.789853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c625757-0dc3-4fef-be34-f3f7d363baf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:21.790379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c625757-0dc3-4fef-be34-f3f7d363baf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:21.790868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c625757-0dc3-4fef-be34-f3f7d363baf0 admin admin] PATH_INFO: `/v3/projects/2625d7ce5de74f19ab91b2ed6c441082` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:21.792920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c625757-0dc3-4fef-be34-f3f7d363baf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2625d7ce5de74f19ab91b2ed6c441082)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:21.796054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c625757-0dc3-4fef-be34-f3f7d363baf0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:21.863830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6c625757-0dc3-4fef-be34-f3f7d363baf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2625d7ce5de74f19ab91b2ed6c441082', 'request_id': 'req-6c625757-0dc3-4fef-be34-f3f7d363baf0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:21.872219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6c625757-0dc3-4fef-be34-f3f7d363baf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2625d7ce5de74f19ab91b2ed6c441082', 'request_id': 'req-6c625757-0dc3-4fef-be34-f3f7d363baf0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:21.878475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6c625757-0dc3-4fef-be34-f3f7d363baf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2625d7ce5de74f19ab91b2ed6c441082', 'request_id': 'req-6c625757-0dc3-4fef-be34-f3f7d363baf0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:21.896984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6c625757-0dc3-4fef-be34-f3f7d363baf0 admin admin] The token cache is being invalidate because project 2625d7ce5de74f19ab91b2ed6c441082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:21.897545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6c625757-0dc3-4fef-be34-f3f7d363baf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:21.898576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6c625757-0dc3-4fef-be34-f3f7d363baf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:21.901784 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1478/2989] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:21 2021] DELETE /identity/v3/projects/2625d7ce5de74f19ab91b2ed6c441082 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:21.907935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9d27e-6687-44c3-9c89-8eb7e97d12da None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:21.908398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9d27e-6687-44c3-9c89-8eb7e97d12da None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:21.908601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9d27e-6687-44c3-9c89-8eb7e97d12da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:21.928341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6ec9d27e-6687-44c3-9c89-8eb7e97d12da None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:21.929734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6ec9d27e-6687-44c3-9c89-8eb7e97d12da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:22.030286 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1512/2990] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:22.039468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e07f82-10bc-4d5d-8bfe-f81a0ed494b4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:22.039766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e07f82-10bc-4d5d-8bfe-f81a0ed494b4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:22.040048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e07f82-10bc-4d5d-8bfe-f81a0ed494b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:22.063443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-08e07f82-10bc-4d5d-8bfe-f81a0ed494b4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:22.065435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-08e07f82-10bc-4d5d-8bfe-f81a0ed494b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:22.076397 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1479/2991] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:22.082655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9d27e-6687-44c3-9c89-8eb7e97d12da None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:22.094585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9d27e-6687-44c3-9c89-8eb7e97d12da None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:22.104281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236d135-79d8-4a44-89a6-482b71e84712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:22.106287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236d135-79d8-4a44-89a6-482b71e84712 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:22.106988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236d135-79d8-4a44-89a6-482b71e84712 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:22.107725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236d135-79d8-4a44-89a6-482b71e84712 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:22.109805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236d135-79d8-4a44-89a6-482b71e84712 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:22.110754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236d135-79d8-4a44-89a6-482b71e84712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:22.114202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236d135-79d8-4a44-89a6-482b71e84712 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:22.132699 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1513/2992] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:51:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:22.134650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e07f82-10bc-4d5d-8bfe-f81a0ed494b4 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:22.147665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e07f82-10bc-4d5d-8bfe-f81a0ed494b4 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:22.155163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73a079-0a8d-41d6-a30a-9cbfba98ad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:22.156279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73a079-0a8d-41d6-a30a-9cbfba98ad72 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:22.156990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73a079-0a8d-41d6-a30a-9cbfba98ad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:22.157486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73a079-0a8d-41d6-a30a-9cbfba98ad72 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:22.159318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73a079-0a8d-41d6-a30a-9cbfba98ad72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:22.162164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73a079-0a8d-41d6-a30a-9cbfba98ad72 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:22.208044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236d135-79d8-4a44-89a6-482b71e84712 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:22.208800 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1480/2993] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:22 2021] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:22.219234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236d135-79d8-4a44-89a6-482b71e84712 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:22.289464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d500a7-2e69-4f07-b212-1db4a0d8316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:22.290901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d500a7-2e69-4f07-b212-1db4a0d8316f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:22.291337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d500a7-2e69-4f07-b212-1db4a0d8316f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:22.291807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d500a7-2e69-4f07-b212-1db4a0d8316f admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:22.293370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d500a7-2e69-4f07-b212-1db4a0d8316f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:22.296111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d500a7-2e69-4f07-b212-1db4a0d8316f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:22.328525 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1514/2994] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:22 2021] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:22.333605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73a079-0a8d-41d6-a30a-9cbfba98ad72 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:22.347360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73a079-0a8d-41d6-a30a-9cbfba98ad72 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:22.353380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e8adf-bf2a-4e57-84e7-ce498578c307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:22.354181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e8adf-bf2a-4e57-84e7-ce498578c307 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:22.354519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e8adf-bf2a-4e57-84e7-ce498578c307 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:22.354806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e8adf-bf2a-4e57-84e7-ce498578c307 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:22.355553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e8adf-bf2a-4e57-84e7-ce498578c307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:22.357313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e8adf-bf2a-4e57-84e7-ce498578c307 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:22.369166 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1481/2995] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:22 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:22.372986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d500a7-2e69-4f07-b212-1db4a0d8316f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:22.383637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d500a7-2e69-4f07-b212-1db4a0d8316f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:22.390417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c5cbe-0788-4562-9400-db0cca77c74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:22.391218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c5cbe-0788-4562-9400-db0cca77c74a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:22.391835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c5cbe-0788-4562-9400-db0cca77c74a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:22.392168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c5cbe-0788-4562-9400-db0cca77c74a admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:22.392982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c5cbe-0788-4562-9400-db0cca77c74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:22.402703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c5cbe-0788-4562-9400-db0cca77c74a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:22.419487 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1515/2996] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:22 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:22.424298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e8adf-bf2a-4e57-84e7-ce498578c307 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:22.438858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e8adf-bf2a-4e57-84e7-ce498578c307 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:22.447679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1eef74-a10e-4763-b688-19a8197ef99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:22.450650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eef74-a10e-4763-b688-19a8197ef99d admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:22.450900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eef74-a10e-4763-b688-19a8197ef99d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:22.451176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eef74-a10e-4763-b688-19a8197ef99d admin admin] PATH_INFO: `/v3/projects/8d711e53609d424c9efffc944bbbb15b/users/bc4992fc60df4af5a776a234ff89199c/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:22.469088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1eef74-a10e-4763-b688-19a8197ef99d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d711e53609d424c9efffc944bbbb15b, user_id=bc4992fc60df4af5a776a234ff89199c, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:22.472476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1eef74-a10e-4763-b688-19a8197ef99d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:22.507080 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1482/2997] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:22 2021] PUT /identity/v3/projects/8d711e53609d424c9efffc944bbbb15b/users/bc4992fc60df4af5a776a234ff89199c/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:22.520846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d41553-9bbf-42cf-b5a7-253295a738d8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:22.521469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d41553-9bbf-42cf-b5a7-253295a738d8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:22.521899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d41553-9bbf-42cf-b5a7-253295a738d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:22.586719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e9d41553-9bbf-42cf-b5a7-253295a738d8 None None] MFA Rules not processed for user `bc4992fc60df4af5a776a234ff89199c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:22.588941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e9d41553-9bbf-42cf-b5a7-253295a738d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:22.696938 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1516/2998] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:22 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:22.702518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1eef74-a10e-4763-b688-19a8197ef99d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:22.778409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1eef74-a10e-4763-b688-19a8197ef99d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:22.788276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9b1ec-0f22-4959-8ac7-fc4c61f3c2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:22.789253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9b1ec-0f22-4959-8ac7-fc4c61f3c2fb admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:22.789539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9b1ec-0f22-4959-8ac7-fc4c61f3c2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:22.790045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9b1ec-0f22-4959-8ac7-fc4c61f3c2fb admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:22.791010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9b1ec-0f22-4959-8ac7-fc4c61f3c2fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:22.793146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9b1ec-0f22-4959-8ac7-fc4c61f3c2fb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:22.827697 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1483/2999] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:22 2021] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:22.831267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d41553-9bbf-42cf-b5a7-253295a738d8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:22.844074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d41553-9bbf-42cf-b5a7-253295a738d8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:22.925929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eff9f3-40f0-4eb1-8064-12d9cb9a1d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:22.927403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eff9f3-40f0-4eb1-8064-12d9cb9a1d46 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:22.927781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eff9f3-40f0-4eb1-8064-12d9cb9a1d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:22.928154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eff9f3-40f0-4eb1-8064-12d9cb9a1d46 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:22.928984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eff9f3-40f0-4eb1-8064-12d9cb9a1d46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:22.931021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eff9f3-40f0-4eb1-8064-12d9cb9a1d46 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:22.957257 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1517/3000] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:22 2021] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:22.961714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9b1ec-0f22-4959-8ac7-fc4c61f3c2fb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:22.998585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9b1ec-0f22-4959-8ac7-fc4c61f3c2fb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:23.006376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31e26a-3b10-4a7c-be02-cbc7a14db7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:23.007060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31e26a-3b10-4a7c-be02-cbc7a14db7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:23.007347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31e26a-3b10-4a7c-be02-cbc7a14db7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:23.007629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31e26a-3b10-4a7c-be02-cbc7a14db7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:23.008366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31e26a-3b10-4a7c-be02-cbc7a14db7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:23.009964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31e26a-3b10-4a7c-be02-cbc7a14db7b4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:23.023354 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1484/3001] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:22 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:23.027806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eff9f3-40f0-4eb1-8064-12d9cb9a1d46 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:23.041695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eff9f3-40f0-4eb1-8064-12d9cb9a1d46 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:23.050691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b15b82-3a4e-4058-8762-81860c1e46a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:23.051826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b15b82-3a4e-4058-8762-81860c1e46a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:23.052132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b15b82-3a4e-4058-8762-81860c1e46a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:23.052475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b15b82-3a4e-4058-8762-81860c1e46a1 admin admin] PATH_INFO: `/v3/projects/8d5701f27bd942c0ba52d769b8193c4c/users/4731907dcd1f4573a51ffda9ad7aed54/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:23.084227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b15b82-3a4e-4058-8762-81860c1e46a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d5701f27bd942c0ba52d769b8193c4c, user_id=4731907dcd1f4573a51ffda9ad7aed54, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:23.088231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b15b82-3a4e-4058-8762-81860c1e46a1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:23.106869 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1518/3002] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:23 2021] PUT /identity/v3/projects/8d5701f27bd942c0ba52d769b8193c4c/users/4731907dcd1f4573a51ffda9ad7aed54/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:23.111564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31e26a-3b10-4a7c-be02-cbc7a14db7b4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:23.125929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31e26a-3b10-4a7c-be02-cbc7a14db7b4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:23.230484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5369df9-be8c-4176-9603-dbe01a183b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:23.231948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5369df9-be8c-4176-9603-dbe01a183b00 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:23.232247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5369df9-be8c-4176-9603-dbe01a183b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:23.232533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5369df9-be8c-4176-9603-dbe01a183b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:23.233382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5369df9-be8c-4176-9603-dbe01a183b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:23.239240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5369df9-be8c-4176-9603-dbe01a183b00 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:23.263088 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1485/3003] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:23 2021] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:23.266933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b15b82-3a4e-4058-8762-81860c1e46a1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:23.279451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b15b82-3a4e-4058-8762-81860c1e46a1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:23.284546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8a03d-3c83-4bd3-a624-36fdd0a7de43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:23.285590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8a03d-3c83-4bd3-a624-36fdd0a7de43 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:23.286059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8a03d-3c83-4bd3-a624-36fdd0a7de43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:23.286431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8a03d-3c83-4bd3-a624-36fdd0a7de43 admin admin] PATH_INFO: `/v3/projects/8d5701f27bd942c0ba52d769b8193c4c/users/4731907dcd1f4573a51ffda9ad7aed54/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:23.288905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8a03d-3c83-4bd3-a624-36fdd0a7de43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d5701f27bd942c0ba52d769b8193c4c, user_id=4731907dcd1f4573a51ffda9ad7aed54, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:23.291899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8a03d-3c83-4bd3-a624-36fdd0a7de43 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:23.306043 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1519/3004] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:23 2021] PUT /identity/v3/projects/8d5701f27bd942c0ba52d769b8193c4c/users/4731907dcd1f4573a51ffda9ad7aed54/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:23.317438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894563e0-6216-479f-8046-0795e9ce5109 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:23.319995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894563e0-6216-479f-8046-0795e9ce5109 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:23.321319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894563e0-6216-479f-8046-0795e9ce5109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:23.360013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-894563e0-6216-479f-8046-0795e9ce5109 None None] MFA Rules not processed for user `4731907dcd1f4573a51ffda9ad7aed54`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:23.362300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-894563e0-6216-479f-8046-0795e9ce5109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:23.443468 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1486/3005] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:23 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:23.448094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8a03d-3c83-4bd3-a624-36fdd0a7de43 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:23.459296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8a03d-3c83-4bd3-a624-36fdd0a7de43 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:23.464591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec342d-f825-438d-ad87-b7b6627a5109 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:23.465795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec342d-f825-438d-ad87-b7b6627a5109 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:23.466083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec342d-f825-438d-ad87-b7b6627a5109 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:23.466403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec342d-f825-438d-ad87-b7b6627a5109 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:23.467176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec342d-f825-438d-ad87-b7b6627a5109 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:23.468872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec342d-f825-438d-ad87-b7b6627a5109 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:23.487929 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1520/3006] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 20:51:23 2021] POST /identity/v3/domains => generated 276 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:23.491895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894563e0-6216-479f-8046-0795e9ce5109 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:23.501409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894563e0-6216-479f-8046-0795e9ce5109 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:23.570087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd444923-3a51-4ac0-90a7-85af3554241e tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:23.570960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd444923-3a51-4ac0-90a7-85af3554241e tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:23.571569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd444923-3a51-4ac0-90a7-85af3554241e tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:23.571962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd444923-3a51-4ac0-90a7-85af3554241e tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:23.572791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd444923-3a51-4ac0-90a7-85af3554241e tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:23.575920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd444923-3a51-4ac0-90a7-85af3554241e tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:23.623529 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1487/3007] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:23 2021] POST /identity/v3/projects => generated 402 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:23.624576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec342d-f825-438d-ad87-b7b6627a5109 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:23.636520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec342d-f825-438d-ad87-b7b6627a5109 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:23.699260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0b2d3-06c1-458a-89ca-b4d8c149afac tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:23.700543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0b2d3-06c1-458a-89ca-b4d8c149afac tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:23.700939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0b2d3-06c1-458a-89ca-b4d8c149afac tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:23.701294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0b2d3-06c1-458a-89ca-b4d8c149afac tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/groups` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:23.702065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0b2d3-06c1-458a-89ca-b4d8c149afac tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:23.704141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0b2d3-06c1-458a-89ca-b4d8c149afac tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:23.734748 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1521/3008] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 20:51:23 2021] POST /identity/v3/groups => generated 302 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:23.747737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd444923-3a51-4ac0-90a7-85af3554241e tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:23.759820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd444923-3a51-4ac0-90a7-85af3554241e tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:23.765400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff1c02-769d-4daa-978e-f9613a6842c4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:23.766399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff1c02-769d-4daa-978e-f9613a6842c4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:23.766799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff1c02-769d-4daa-978e-f9613a6842c4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:23.767252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff1c02-769d-4daa-978e-f9613a6842c4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:23.768091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff1c02-769d-4daa-978e-f9613a6842c4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:23.769872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff1c02-769d-4daa-978e-f9613a6842c4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:23.791486 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1488/3009] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:23 2021] POST /identity/v3/users => generated 442 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:23.796351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0b2d3-06c1-458a-89ca-b4d8c149afac tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:23.813520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0b2d3-06c1-458a-89ca-b4d8c149afac tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:23.822695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0fcca-1af8-4270-98a8-13f16bd0e5e8 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:23.823689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0fcca-1af8-4270-98a8-13f16bd0e5e8 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:23.824010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0fcca-1af8-4270-98a8-13f16bd0e5e8 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:23.824395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0fcca-1af8-4270-98a8-13f16bd0e5e8 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:23.825991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0fcca-1af8-4270-98a8-13f16bd0e5e8 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:23.828365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0fcca-1af8-4270-98a8-13f16bd0e5e8 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:23.858984 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1522/3010] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 20:51:23 2021] POST /identity/v3/roles => generated 239 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:23.860923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff1c02-769d-4daa-978e-f9613a6842c4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:23.872224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff1c02-769d-4daa-978e-f9613a6842c4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:23.878165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc453f95-3c4b-4254-b5ba-81e7c16751c6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:23.879237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc453f95-3c4b-4254-b5ba-81e7c16751c6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:23.879593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc453f95-3c4b-4254-b5ba-81e7c16751c6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:23.880001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc453f95-3c4b-4254-b5ba-81e7c16751c6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/ef3f3e6b51c84f0aaa26e28b9330a39e/groups/a3cf60d80e654b30802a62e5af8af5f9/roles/92d9693d6235443d9ecda029e788fc74/inherited_to_projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:23.887772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc453f95-3c4b-4254-b5ba-81e7c16751c6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ef3f3e6b51c84f0aaa26e28b9330a39e, group_id=a3cf60d80e654b30802a62e5af8af5f9, role_id=92d9693d6235443d9ecda029e788fc74)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:23.890796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc453f95-3c4b-4254-b5ba-81e7c16751c6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:23.905114 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1489/3011] 10.222.0.13 () {60 vars in 1584 bytes} [Sat Dec 18 20:51:23 2021] PUT /identity/v3/OS-INHERIT/projects/ef3f3e6b51c84f0aaa26e28b9330a39e/groups/a3cf60d80e654b30802a62e5af8af5f9/roles/92d9693d6235443d9ecda029e788fc74/inherited_to_projects => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:51:23.909435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0fcca-1af8-4270-98a8-13f16bd0e5e8 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:23.926708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0fcca-1af8-4270-98a8-13f16bd0e5e8 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:24.002794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf09c1d-451d-4c34-a4eb-5e31296982f9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:24.003763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf09c1d-451d-4c34-a4eb-5e31296982f9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:24.004144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf09c1d-451d-4c34-a4eb-5e31296982f9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:24.004778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf09c1d-451d-4c34-a4eb-5e31296982f9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/ef3f3e6b51c84f0aaa26e28b9330a39e/groups/a3cf60d80e654b30802a62e5af8af5f9/roles/92d9693d6235443d9ecda029e788fc74/inherited_to_projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:24.008637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf09c1d-451d-4c34-a4eb-5e31296982f9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:check_grant(project_id=ef3f3e6b51c84f0aaa26e28b9330a39e, group_id=a3cf60d80e654b30802a62e5af8af5f9, role_id=92d9693d6235443d9ecda029e788fc74)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:24.010063 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-aaf09c1d-451d-4c34-a4eb-5e31296982f9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:24.010063 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:51:24.010063 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:51:24.013124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf09c1d-451d-4c34-a4eb-5e31296982f9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:24.026356 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1523/3012] 10.222.0.13 () {58 vars in 1566 bytes} [Sat Dec 18 20:51:23 2021] HEAD /identity/v3/OS-INHERIT/projects/ef3f3e6b51c84f0aaa26e28b9330a39e/groups/a3cf60d80e654b30802a62e5af8af5f9/roles/92d9693d6235443d9ecda029e788fc74/inherited_to_projects => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:24.030720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc453f95-3c4b-4254-b5ba-81e7c16751c6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:24.043637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc453f95-3c4b-4254-b5ba-81e7c16751c6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:24.049623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf64c3-4b5b-4685-a62a-23591bbddf68 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:24.050581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf64c3-4b5b-4685-a62a-23591bbddf68 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:24.050951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf64c3-4b5b-4685-a62a-23591bbddf68 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:24.051301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf64c3-4b5b-4685-a62a-23591bbddf68 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/ef3f3e6b51c84f0aaa26e28b9330a39e/groups/a3cf60d80e654b30802a62e5af8af5f9/roles/92d9693d6235443d9ecda029e788fc74/inherited_to_projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:24.054494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf64c3-4b5b-4685-a62a-23591bbddf68 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=ef3f3e6b51c84f0aaa26e28b9330a39e, group_id=a3cf60d80e654b30802a62e5af8af5f9, role_id=92d9693d6235443d9ecda029e788fc74)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:24.056178 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-aadf64c3-4b5b-4685-a62a-23591bbddf68 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:24.056178 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:51:24.056178 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:51:24.059417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf64c3-4b5b-4685-a62a-23591bbddf68 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:24.066775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-aadf64c3-4b5b-4685-a62a-23591bbddf68 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invalidating the token cache because role 92d9693d6235443d9ecda029e788fc74 was removed from group a3cf60d80e654b30802a62e5af8af5f9 on project ef3f3e6b51c84f0aaa26e28b9330a39e. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:24.067200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-aadf64c3-4b5b-4685-a62a-23591bbddf68 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:24.067937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-aadf64c3-4b5b-4685-a62a-23591bbddf68 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:24.082626 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1490/3013] 10.222.0.13 () {58 vars in 1568 bytes} [Sat Dec 18 20:51:24 2021] DELETE /identity/v3/OS-INHERIT/projects/ef3f3e6b51c84f0aaa26e28b9330a39e/groups/a3cf60d80e654b30802a62e5af8af5f9/roles/92d9693d6235443d9ecda029e788fc74/inherited_to_projects => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:24.086364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf09c1d-451d-4c34-a4eb-5e31296982f9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:24.088195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-aaf09c1d-451d-4c34-a4eb-5e31296982f9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:24.100774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf09c1d-451d-4c34-a4eb-5e31296982f9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:24.160403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cf2d2-2a10-48be-a939-c93f2481a5de tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:24.161514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cf2d2-2a10-48be-a939-c93f2481a5de tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:24.161879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cf2d2-2a10-48be-a939-c93f2481a5de tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:24.162237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cf2d2-2a10-48be-a939-c93f2481a5de tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/roles/92d9693d6235443d9ecda029e788fc74` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:24.164146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cf2d2-2a10-48be-a939-c93f2481a5de tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:delete_role(role_id=92d9693d6235443d9ecda029e788fc74)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:24.165263 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-183cf2d2-2a10-48be-a939-c93f2481a5de tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:24.165263 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:51:24.165263 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:51:24.166956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cf2d2-2a10-48be-a939-c93f2481a5de tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:24.209542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-183cf2d2-2a10-48be-a939-c93f2481a5de tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invalidating the token cache because role 92d9693d6235443d9ecda029e788fc74 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:24.209930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-183cf2d2-2a10-48be-a939-c93f2481a5de tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:24.210896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-183cf2d2-2a10-48be-a939-c93f2481a5de tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:24.213109 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1524/3014] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:24 2021] DELETE /identity/v3/roles/92d9693d6235443d9ecda029e788fc74 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:24.217906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf64c3-4b5b-4685-a62a-23591bbddf68 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:24.229280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf64c3-4b5b-4685-a62a-23591bbddf68 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:24.312296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ba33-3e2d-4b9d-8c4a-d349b314e1c8 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:24.313002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ba33-3e2d-4b9d-8c4a-d349b314e1c8 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:24.313293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ba33-3e2d-4b9d-8c4a-d349b314e1c8 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:24.313576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ba33-3e2d-4b9d-8c4a-d349b314e1c8 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:24.314376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0ba33-3e2d-4b9d-8c4a-d349b314e1c8 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:24.315998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0ba33-3e2d-4b9d-8c4a-d349b314e1c8 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:24.329956 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1491/3015] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 20:51:24 2021] POST /identity/v3/roles => generated 239 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:24.334270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cf2d2-2a10-48be-a939-c93f2481a5de tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:24.335770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-183cf2d2-2a10-48be-a939-c93f2481a5de tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:24.348848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cf2d2-2a10-48be-a939-c93f2481a5de tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:24.358586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050a8a2-6f55-4f93-aa2f-f129af344281 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:24.359439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050a8a2-6f55-4f93-aa2f-f129af344281 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:24.359725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050a8a2-6f55-4f93-aa2f-f129af344281 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:24.360061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050a8a2-6f55-4f93-aa2f-f129af344281 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/ef3f3e6b51c84f0aaa26e28b9330a39e/users/81277ee082ac48b189e945c8febf31c9/roles/b02e4f9c3cb2475885a04b06681e1eb3/inherited_to_projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:24.381196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050a8a2-6f55-4f93-aa2f-f129af344281 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ef3f3e6b51c84f0aaa26e28b9330a39e, user_id=81277ee082ac48b189e945c8febf31c9, role_id=b02e4f9c3cb2475885a04b06681e1eb3)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:24.385901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050a8a2-6f55-4f93-aa2f-f129af344281 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:24.408854 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1525/3016] 10.222.0.13 () {60 vars in 1581 bytes} [Sat Dec 18 20:51:24 2021] PUT /identity/v3/OS-INHERIT/projects/ef3f3e6b51c84f0aaa26e28b9330a39e/users/81277ee082ac48b189e945c8febf31c9/roles/b02e4f9c3cb2475885a04b06681e1eb3/inherited_to_projects => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:24.413400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ba33-3e2d-4b9d-8c4a-d349b314e1c8 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:24.455378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ba33-3e2d-4b9d-8c4a-d349b314e1c8 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:24.523015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280ee85-0252-4b62-a0a2-0749843df4d0 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:24.524451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280ee85-0252-4b62-a0a2-0749843df4d0 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:24.524814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280ee85-0252-4b62-a0a2-0749843df4d0 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:24.525141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280ee85-0252-4b62-a0a2-0749843df4d0 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/ef3f3e6b51c84f0aaa26e28b9330a39e/users/81277ee082ac48b189e945c8febf31c9/roles/b02e4f9c3cb2475885a04b06681e1eb3/inherited_to_projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:24.527785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280ee85-0252-4b62-a0a2-0749843df4d0 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:check_grant(project_id=ef3f3e6b51c84f0aaa26e28b9330a39e, user_id=81277ee082ac48b189e945c8febf31c9, role_id=b02e4f9c3cb2475885a04b06681e1eb3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:24.528813 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-9280ee85-0252-4b62-a0a2-0749843df4d0 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:24.528813 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:51:24.528813 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:51:24.530972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280ee85-0252-4b62-a0a2-0749843df4d0 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:24.538194 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1492/3017] 10.222.0.13 () {58 vars in 1563 bytes} [Sat Dec 18 20:51:24 2021] HEAD /identity/v3/OS-INHERIT/projects/ef3f3e6b51c84f0aaa26e28b9330a39e/users/81277ee082ac48b189e945c8febf31c9/roles/b02e4f9c3cb2475885a04b06681e1eb3/inherited_to_projects => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:24.543888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050a8a2-6f55-4f93-aa2f-f129af344281 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:24.558909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050a8a2-6f55-4f93-aa2f-f129af344281 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:24.575147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948d6fd-313d-4033-8ec8-0fdcdf5679ff tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:24.576284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948d6fd-313d-4033-8ec8-0fdcdf5679ff tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:24.576568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948d6fd-313d-4033-8ec8-0fdcdf5679ff tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:24.576956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948d6fd-313d-4033-8ec8-0fdcdf5679ff tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/ef3f3e6b51c84f0aaa26e28b9330a39e/users/81277ee082ac48b189e945c8febf31c9/roles/b02e4f9c3cb2475885a04b06681e1eb3/inherited_to_projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:24.579320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948d6fd-313d-4033-8ec8-0fdcdf5679ff tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=ef3f3e6b51c84f0aaa26e28b9330a39e, user_id=81277ee082ac48b189e945c8febf31c9, role_id=b02e4f9c3cb2475885a04b06681e1eb3)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:24.581571 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-c948d6fd-313d-4033-8ec8-0fdcdf5679ff tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:24.581571 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:51:24.581571 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:51:24.582831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948d6fd-313d-4033-8ec8-0fdcdf5679ff tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:24.588876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c948d6fd-313d-4033-8ec8-0fdcdf5679ff tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invalidating the token cache because role b02e4f9c3cb2475885a04b06681e1eb3 was removed from user 81277ee082ac48b189e945c8febf31c9 on project ef3f3e6b51c84f0aaa26e28b9330a39e. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:24.589192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c948d6fd-313d-4033-8ec8-0fdcdf5679ff tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:24.590068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c948d6fd-313d-4033-8ec8-0fdcdf5679ff tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:24.607988 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1526/3018] 10.222.0.13 () {58 vars in 1565 bytes} [Sat Dec 18 20:51:24 2021] DELETE /identity/v3/OS-INHERIT/projects/ef3f3e6b51c84f0aaa26e28b9330a39e/users/81277ee082ac48b189e945c8febf31c9/roles/b02e4f9c3cb2475885a04b06681e1eb3/inherited_to_projects => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:24.609221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280ee85-0252-4b62-a0a2-0749843df4d0 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:24.611087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9280ee85-0252-4b62-a0a2-0749843df4d0 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:24.625105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280ee85-0252-4b62-a0a2-0749843df4d0 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:24.698446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2b889-6c23-49d6-bf09-d249a2a365c1 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:24.699512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2b889-6c23-49d6-bf09-d249a2a365c1 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:24.699872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2b889-6c23-49d6-bf09-d249a2a365c1 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:24.700243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2b889-6c23-49d6-bf09-d249a2a365c1 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/roles/b02e4f9c3cb2475885a04b06681e1eb3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:24.701809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2b889-6c23-49d6-bf09-d249a2a365c1 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b02e4f9c3cb2475885a04b06681e1eb3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:24.702927 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-2ad2b889-6c23-49d6-bf09-d249a2a365c1 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:24.702927 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:51:24.702927 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:51:24.703832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2b889-6c23-49d6-bf09-d249a2a365c1 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:24.746511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2ad2b889-6c23-49d6-bf09-d249a2a365c1 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invalidating the token cache because role b02e4f9c3cb2475885a04b06681e1eb3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:24.746898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2ad2b889-6c23-49d6-bf09-d249a2a365c1 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:24.747704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2ad2b889-6c23-49d6-bf09-d249a2a365c1 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:24.749764 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1493/3019] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:24 2021] DELETE /identity/v3/roles/b02e4f9c3cb2475885a04b06681e1eb3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:24.754981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948d6fd-313d-4033-8ec8-0fdcdf5679ff tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:24.765696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948d6fd-313d-4033-8ec8-0fdcdf5679ff tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:24.822896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138f776-2819-4f65-a9e5-2d938b838697 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:24.823556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138f776-2819-4f65-a9e5-2d938b838697 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:24.823848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138f776-2819-4f65-a9e5-2d938b838697 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:24.824125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138f776-2819-4f65-a9e5-2d938b838697 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:24.824906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138f776-2819-4f65-a9e5-2d938b838697 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:24.826524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138f776-2819-4f65-a9e5-2d938b838697 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:24.844881 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1527/3020] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 20:51:24 2021] POST /identity/v3/roles => generated 239 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:24.846004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2b889-6c23-49d6-bf09-d249a2a365c1 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:24.847444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2ad2b889-6c23-49d6-bf09-d249a2a365c1 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:24.860170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2b889-6c23-49d6-bf09-d249a2a365c1 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:24.864770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec700ab-5e43-49e8-b580-d08549aed431 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:24.865607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec700ab-5e43-49e8-b580-d08549aed431 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:24.865895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec700ab-5e43-49e8-b580-d08549aed431 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:24.866171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec700ab-5e43-49e8-b580-d08549aed431 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/groups/a3cf60d80e654b30802a62e5af8af5f9/roles/34110bb5c39145b18f58e1fb70b80006/inherited_to_projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:24.868505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec700ab-5e43-49e8-b580-d08549aed431 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=01ea4e737bd740458321b918d365a9cc, group_id=a3cf60d80e654b30802a62e5af8af5f9, role_id=34110bb5c39145b18f58e1fb70b80006)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:24.871169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec700ab-5e43-49e8-b580-d08549aed431 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:24.883201 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1494/3021] 10.222.0.13 () {60 vars in 1581 bytes} [Sat Dec 18 20:51:24 2021] PUT /identity/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/groups/a3cf60d80e654b30802a62e5af8af5f9/roles/34110bb5c39145b18f58e1fb70b80006/inherited_to_projects => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:24.887382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138f776-2819-4f65-a9e5-2d938b838697 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:24.897256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138f776-2819-4f65-a9e5-2d938b838697 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:24.953503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478affb1-6bbb-41e7-ac85-108299d95eb5 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:24.954495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478affb1-6bbb-41e7-ac85-108299d95eb5 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:24.954781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478affb1-6bbb-41e7-ac85-108299d95eb5 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:24.955061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478affb1-6bbb-41e7-ac85-108299d95eb5 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/groups/a3cf60d80e654b30802a62e5af8af5f9/roles/inherited_to_projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:24.956830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478affb1-6bbb-41e7-ac85-108299d95eb5 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=01ea4e737bd740458321b918d365a9cc, group_id=a3cf60d80e654b30802a62e5af8af5f9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:24.957847 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-478affb1-6bbb-41e7-ac85-108299d95eb5 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:24.957847 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:51:24.957847 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:51:24.959682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478affb1-6bbb-41e7-ac85-108299d95eb5 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:24.974929 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1528/3022] 10.222.0.13 () {58 vars in 1463 bytes} [Sat Dec 18 20:51:24 2021] GET /identity/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/groups/a3cf60d80e654b30802a62e5af8af5f9/roles/inherited_to_projects => generated 447 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:51:24.980164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec700ab-5e43-49e8-b580-d08549aed431 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:24.995033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec700ab-5e43-49e8-b580-d08549aed431 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:25.000044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832c900-c18f-4ffb-86b1-bbe069d19383 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:25.001087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832c900-c18f-4ffb-86b1-bbe069d19383 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:25.001377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832c900-c18f-4ffb-86b1-bbe069d19383 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:25.001659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832c900-c18f-4ffb-86b1-bbe069d19383 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/groups/a3cf60d80e654b30802a62e5af8af5f9/roles/34110bb5c39145b18f58e1fb70b80006/inherited_to_projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:25.003940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832c900-c18f-4ffb-86b1-bbe069d19383 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=01ea4e737bd740458321b918d365a9cc, group_id=a3cf60d80e654b30802a62e5af8af5f9, role_id=34110bb5c39145b18f58e1fb70b80006)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:25.006609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832c900-c18f-4ffb-86b1-bbe069d19383 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:25.012371 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1495/3023] 10.222.0.13 () {58 vars in 1563 bytes} [Sat Dec 18 20:51:24 2021] HEAD /identity/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/groups/a3cf60d80e654b30802a62e5af8af5f9/roles/34110bb5c39145b18f58e1fb70b80006/inherited_to_projects => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:25.016526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478affb1-6bbb-41e7-ac85-108299d95eb5 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:25.027212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478affb1-6bbb-41e7-ac85-108299d95eb5 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:25.032044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e0707-aa51-49e1-bbd6-83c3af0dc790 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:25.033226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e0707-aa51-49e1-bbd6-83c3af0dc790 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:25.033226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e0707-aa51-49e1-bbd6-83c3af0dc790 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:25.033431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e0707-aa51-49e1-bbd6-83c3af0dc790 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/groups/a3cf60d80e654b30802a62e5af8af5f9/roles/34110bb5c39145b18f58e1fb70b80006/inherited_to_projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:25.035678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e0707-aa51-49e1-bbd6-83c3af0dc790 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=01ea4e737bd740458321b918d365a9cc, group_id=a3cf60d80e654b30802a62e5af8af5f9, role_id=34110bb5c39145b18f58e1fb70b80006)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:25.038344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e0707-aa51-49e1-bbd6-83c3af0dc790 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:25.045490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-674e0707-aa51-49e1-bbd6-83c3af0dc790 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invalidating the token cache because role 34110bb5c39145b18f58e1fb70b80006 was removed from group a3cf60d80e654b30802a62e5af8af5f9 on domain 01ea4e737bd740458321b918d365a9cc. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:25.045885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-674e0707-aa51-49e1-bbd6-83c3af0dc790 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.046661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-674e0707-aa51-49e1-bbd6-83c3af0dc790 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.060860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832c900-c18f-4ffb-86b1-bbe069d19383 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:25.062999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c832c900-c18f-4ffb-86b1-bbe069d19383 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:25.066743 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1529/3024] 10.222.0.13 () {58 vars in 1565 bytes} [Sat Dec 18 20:51:25 2021] DELETE /identity/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/groups/a3cf60d80e654b30802a62e5af8af5f9/roles/34110bb5c39145b18f58e1fb70b80006/inherited_to_projects => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:25.067904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e0707-aa51-49e1-bbd6-83c3af0dc790 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:25.070109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-674e0707-aa51-49e1-bbd6-83c3af0dc790 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:25.128034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832c900-c18f-4ffb-86b1-bbe069d19383 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:25.132146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e0707-aa51-49e1-bbd6-83c3af0dc790 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:25.138644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0fa40-a0e6-4c5c-8e4d-55fbc903475b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:25.139508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0fa40-a0e6-4c5c-8e4d-55fbc903475b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:25.139791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0fa40-a0e6-4c5c-8e4d-55fbc903475b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:25.140066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0fa40-a0e6-4c5c-8e4d-55fbc903475b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/roles/34110bb5c39145b18f58e1fb70b80006` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:25.141942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0fa40-a0e6-4c5c-8e4d-55fbc903475b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:delete_role(role_id=34110bb5c39145b18f58e1fb70b80006)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:25.144413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0fa40-a0e6-4c5c-8e4d-55fbc903475b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:25.188721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4ee0fa40-a0e6-4c5c-8e4d-55fbc903475b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invalidating the token cache because role 34110bb5c39145b18f58e1fb70b80006 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:25.188721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4ee0fa40-a0e6-4c5c-8e4d-55fbc903475b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.189252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4ee0fa40-a0e6-4c5c-8e4d-55fbc903475b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.191625 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1530/3025] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:25 2021] DELETE /identity/v3/roles/34110bb5c39145b18f58e1fb70b80006 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:25.196170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0fa40-a0e6-4c5c-8e4d-55fbc903475b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:25.199384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4ee0fa40-a0e6-4c5c-8e4d-55fbc903475b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:25.205222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189387d6-354b-4d28-bc0e-3e2f871f2df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:25.206467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189387d6-354b-4d28-bc0e-3e2f871f2df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:25.206708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189387d6-354b-4d28-bc0e-3e2f871f2df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:25.206990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189387d6-354b-4d28-bc0e-3e2f871f2df1 admin admin] PATH_INFO: `/v3/users/5aaf1ced6baf4e1d9c940cfe96b2c254` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:25.208961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189387d6-354b-4d28-bc0e-3e2f871f2df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aaf1ced6baf4e1d9c940cfe96b2c254)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:25.211454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189387d6-354b-4d28-bc0e-3e2f871f2df1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:25.286894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-189387d6-354b-4d28-bc0e-3e2f871f2df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aaf1ced6baf4e1d9c940cfe96b2c254'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.288204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0fa40-a0e6-4c5c-8e4d-55fbc903475b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:25.296098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c887cc-4100-4f4f-8d38-1fea20d7e59b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:25.296837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-189387d6-354b-4d28-bc0e-3e2f871f2df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aaf1ced6baf4e1d9c940cfe96b2c254'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.296964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c887cc-4100-4f4f-8d38-1fea20d7e59b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:25.297247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c887cc-4100-4f4f-8d38-1fea20d7e59b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:25.297567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c887cc-4100-4f4f-8d38-1fea20d7e59b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:25.298538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c887cc-4100-4f4f-8d38-1fea20d7e59b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:25.300447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c887cc-4100-4f4f-8d38-1fea20d7e59b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:25.320567 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1531/3026] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 20:51:25 2021] POST /identity/v3/roles => generated 240 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:25.320753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-189387d6-354b-4d28-bc0e-3e2f871f2df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aaf1ced6baf4e1d9c940cfe96b2c254'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.321496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-189387d6-354b-4d28-bc0e-3e2f871f2df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aaf1ced6baf4e1d9c940cfe96b2c254'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.323983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c887cc-4100-4f4f-8d38-1fea20d7e59b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:25.333820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-189387d6-354b-4d28-bc0e-3e2f871f2df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aaf1ced6baf4e1d9c940cfe96b2c254'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.342289 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1496/3027] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:25 2021] DELETE /identity/v3/users/5aaf1ced6baf4e1d9c940cfe96b2c254 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:25.357530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c887cc-4100-4f4f-8d38-1fea20d7e59b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:25.432759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0604937-ec0d-40aa-9b4b-33e0df2e8db2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:25.433821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0604937-ec0d-40aa-9b4b-33e0df2e8db2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:25.434302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0604937-ec0d-40aa-9b4b-33e0df2e8db2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:25.434911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0604937-ec0d-40aa-9b4b-33e0df2e8db2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/users/81277ee082ac48b189e945c8febf31c9/roles/be56c7a5b4fd43f2b59860da5e45bff9/inherited_to_projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:25.438086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0604937-ec0d-40aa-9b4b-33e0df2e8db2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=01ea4e737bd740458321b918d365a9cc, user_id=81277ee082ac48b189e945c8febf31c9, role_id=be56c7a5b4fd43f2b59860da5e45bff9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:25.442359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0604937-ec0d-40aa-9b4b-33e0df2e8db2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:25.470890 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1532/3028] 10.222.0.13 () {60 vars in 1578 bytes} [Sat Dec 18 20:51:25 2021] PUT /identity/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/users/81277ee082ac48b189e945c8febf31c9/roles/be56c7a5b4fd43f2b59860da5e45bff9/inherited_to_projects => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:25.473654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189387d6-354b-4d28-bc0e-3e2f871f2df1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:25.477541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-189387d6-354b-4d28-bc0e-3e2f871f2df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:25.497625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189387d6-354b-4d28-bc0e-3e2f871f2df1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:25.577015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19ace2-2324-4ffd-b229-f3a3bf04ff0b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:25.578104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19ace2-2324-4ffd-b229-f3a3bf04ff0b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:25.578582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19ace2-2324-4ffd-b229-f3a3bf04ff0b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:25.579032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19ace2-2324-4ffd-b229-f3a3bf04ff0b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/users/81277ee082ac48b189e945c8febf31c9/roles/inherited_to_projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:25.584426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19ace2-2324-4ffd-b229-f3a3bf04ff0b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=01ea4e737bd740458321b918d365a9cc, user_id=81277ee082ac48b189e945c8febf31c9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:25.585695 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-3c19ace2-2324-4ffd-b229-f3a3bf04ff0b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:25.585695 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:51:25.585695 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:51:25.588070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19ace2-2324-4ffd-b229-f3a3bf04ff0b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:25.612591 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1497/3029] 10.222.0.13 () {58 vars in 1460 bytes} [Sat Dec 18 20:51:25 2021] GET /identity/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/users/81277ee082ac48b189e945c8febf31c9/roles/inherited_to_projects => generated 447 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:25.617531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0604937-ec0d-40aa-9b4b-33e0df2e8db2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:25.640180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0604937-ec0d-40aa-9b4b-33e0df2e8db2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:25.646955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5858eb-31b1-4c66-b1b8-b193d02c8c69 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:25.647984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5858eb-31b1-4c66-b1b8-b193d02c8c69 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:25.648353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5858eb-31b1-4c66-b1b8-b193d02c8c69 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:25.648917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5858eb-31b1-4c66-b1b8-b193d02c8c69 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/users/81277ee082ac48b189e945c8febf31c9/roles/be56c7a5b4fd43f2b59860da5e45bff9/inherited_to_projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:25.652395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5858eb-31b1-4c66-b1b8-b193d02c8c69 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=01ea4e737bd740458321b918d365a9cc, user_id=81277ee082ac48b189e945c8febf31c9, role_id=be56c7a5b4fd43f2b59860da5e45bff9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:25.655365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5858eb-31b1-4c66-b1b8-b193d02c8c69 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:25.663682 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1533/3030] 10.222.0.13 () {58 vars in 1560 bytes} [Sat Dec 18 20:51:25 2021] HEAD /identity/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/users/81277ee082ac48b189e945c8febf31c9/roles/be56c7a5b4fd43f2b59860da5e45bff9/inherited_to_projects => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:25.667692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19ace2-2324-4ffd-b229-f3a3bf04ff0b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:25.680436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19ace2-2324-4ffd-b229-f3a3bf04ff0b tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:25.686379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567a241-6e28-4e76-b3e1-a94d3299c20a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:25.687359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567a241-6e28-4e76-b3e1-a94d3299c20a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:25.687768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567a241-6e28-4e76-b3e1-a94d3299c20a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:25.688158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567a241-6e28-4e76-b3e1-a94d3299c20a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/users/81277ee082ac48b189e945c8febf31c9/roles/be56c7a5b4fd43f2b59860da5e45bff9/inherited_to_projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:25.690603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567a241-6e28-4e76-b3e1-a94d3299c20a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=01ea4e737bd740458321b918d365a9cc, user_id=81277ee082ac48b189e945c8febf31c9, role_id=be56c7a5b4fd43f2b59860da5e45bff9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:25.694071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567a241-6e28-4e76-b3e1-a94d3299c20a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:25.702748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5858eb-31b1-4c66-b1b8-b193d02c8c69 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:25.704645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fa5858eb-31b1-4c66-b1b8-b193d02c8c69 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:25.704774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0567a241-6e28-4e76-b3e1-a94d3299c20a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invalidating the token cache because role be56c7a5b4fd43f2b59860da5e45bff9 was removed from user 81277ee082ac48b189e945c8febf31c9 on domain 01ea4e737bd740458321b918d365a9cc. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:25.705001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0567a241-6e28-4e76-b3e1-a94d3299c20a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.706122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0567a241-6e28-4e76-b3e1-a94d3299c20a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.756059 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1498/3031] 10.222.0.13 () {58 vars in 1562 bytes} [Sat Dec 18 20:51:25 2021] DELETE /identity/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/users/81277ee082ac48b189e945c8febf31c9/roles/be56c7a5b4fd43f2b59860da5e45bff9/inherited_to_projects => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:25.761247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567a241-6e28-4e76-b3e1-a94d3299c20a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:25.763902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0567a241-6e28-4e76-b3e1-a94d3299c20a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:25.798049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5858eb-31b1-4c66-b1b8-b193d02c8c69 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:25.852079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567a241-6e28-4e76-b3e1-a94d3299c20a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:25.858075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d1886-7984-47d6-9312-a7f08acabc2a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:25.860301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d1886-7984-47d6-9312-a7f08acabc2a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:25.862112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d1886-7984-47d6-9312-a7f08acabc2a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:25.862430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d1886-7984-47d6-9312-a7f08acabc2a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/roles/be56c7a5b4fd43f2b59860da5e45bff9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:25.865265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d1886-7984-47d6-9312-a7f08acabc2a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:delete_role(role_id=be56c7a5b4fd43f2b59860da5e45bff9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:25.867018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d1886-7984-47d6-9312-a7f08acabc2a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:25.872751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804879b-2c69-418f-b7d1-7b5ec487e8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:25.873844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804879b-2c69-418f-b7d1-7b5ec487e8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:25.874157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804879b-2c69-418f-b7d1-7b5ec487e8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:25.874532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804879b-2c69-418f-b7d1-7b5ec487e8b3 admin admin] PATH_INFO: `/v3/projects/0870e14bc2934bae9138d4818b260729` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:25.875815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804879b-2c69-418f-b7d1-7b5ec487e8b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0870e14bc2934bae9138d4818b260729)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:25.877826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804879b-2c69-418f-b7d1-7b5ec487e8b3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:25.913221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0b8d1886-7984-47d6-9312-a7f08acabc2a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invalidating the token cache because role be56c7a5b4fd43f2b59860da5e45bff9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:25.913451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0b8d1886-7984-47d6-9312-a7f08acabc2a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.914197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0b8d1886-7984-47d6-9312-a7f08acabc2a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.916165 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1499/3032] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:25 2021] DELETE /identity/v3/roles/be56c7a5b4fd43f2b59860da5e45bff9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:25.921745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d1886-7984-47d6-9312-a7f08acabc2a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:25.923582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0b8d1886-7984-47d6-9312-a7f08acabc2a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:25.937021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e804879b-2c69-418f-b7d1-7b5ec487e8b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0870e14bc2934bae9138d4818b260729', 'request_id': 'req-e804879b-2c69-418f-b7d1-7b5ec487e8b3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.943713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e804879b-2c69-418f-b7d1-7b5ec487e8b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0870e14bc2934bae9138d4818b260729', 'request_id': 'req-e804879b-2c69-418f-b7d1-7b5ec487e8b3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.952713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e804879b-2c69-418f-b7d1-7b5ec487e8b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0870e14bc2934bae9138d4818b260729', 'request_id': 'req-e804879b-2c69-418f-b7d1-7b5ec487e8b3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.966524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e804879b-2c69-418f-b7d1-7b5ec487e8b3 admin admin] The token cache is being invalidate because project 0870e14bc2934bae9138d4818b260729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:25.967149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e804879b-2c69-418f-b7d1-7b5ec487e8b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.967458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e804879b-2c69-418f-b7d1-7b5ec487e8b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:25.969655 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1534/3033] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:25 2021] DELETE /identity/v3/projects/0870e14bc2934bae9138d4818b260729 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:25.973559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804879b-2c69-418f-b7d1-7b5ec487e8b3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:25.975020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e804879b-2c69-418f-b7d1-7b5ec487e8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:25.994005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d1886-7984-47d6-9312-a7f08acabc2a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:25.999142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7046969-f724-4523-b08d-74860ad768a6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:25.999880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046969-f724-4523-b08d-74860ad768a6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:26.000242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046969-f724-4523-b08d-74860ad768a6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:26.000699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046969-f724-4523-b08d-74860ad768a6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:26.001459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7046969-f724-4523-b08d-74860ad768a6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:26.003076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7046969-f724-4523-b08d-74860ad768a6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:26.020308 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1500/3034] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 20:51:25 2021] POST /identity/v3/roles => generated 239 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:26.021634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7046969-f724-4523-b08d-74860ad768a6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:26.023370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a7046969-f724-4523-b08d-74860ad768a6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:26.036943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7046969-f724-4523-b08d-74860ad768a6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:26.042079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9c534-e561-4202-9205-36c116b702e6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:26.042769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9c534-e561-4202-9205-36c116b702e6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:26.042949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804879b-2c69-418f-b7d1-7b5ec487e8b3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:26.043055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9c534-e561-4202-9205-36c116b702e6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:26.043358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9c534-e561-4202-9205-36c116b702e6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:26.044072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9c534-e561-4202-9205-36c116b702e6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:26.045957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9c534-e561-4202-9205-36c116b702e6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:26.105629 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1501/3035] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:26 2021] POST /identity/v3/projects => generated 410 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:26.107193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9c534-e561-4202-9205-36c116b702e6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:26.118885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc4382-e760-4889-aad2-0ebea1f2fde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:26.120162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc4382-e760-4889-aad2-0ebea1f2fde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:26.120543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc4382-e760-4889-aad2-0ebea1f2fde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:26.120926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc4382-e760-4889-aad2-0ebea1f2fde7 admin admin] PATH_INFO: `/v3/users/c1531140d045456cb091602f4660e2e8` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:26.122523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc4382-e760-4889-aad2-0ebea1f2fde7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1531140d045456cb091602f4660e2e8)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:26.124683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc4382-e760-4889-aad2-0ebea1f2fde7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:26.191731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9c534-e561-4202-9205-36c116b702e6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:26.191874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4fc4382-e760-4889-aad2-0ebea1f2fde7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1531140d045456cb091602f4660e2e8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:26.197281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839cb1c-9964-44d2-ac4d-cbe2fe6a8999 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:26.198662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839cb1c-9964-44d2-ac4d-cbe2fe6a8999 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:26.199046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4fc4382-e760-4889-aad2-0ebea1f2fde7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1531140d045456cb091602f4660e2e8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:26.199941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839cb1c-9964-44d2-ac4d-cbe2fe6a8999 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:26.200254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4fc4382-e760-4889-aad2-0ebea1f2fde7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1531140d045456cb091602f4660e2e8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:26.200662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839cb1c-9964-44d2-ac4d-cbe2fe6a8999 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/users/81277ee082ac48b189e945c8febf31c9/roles/e7731ac807d84abc8a0bb0d9a70a50ca/inherited_to_projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:26.204262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839cb1c-9964-44d2-ac4d-cbe2fe6a8999 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=01ea4e737bd740458321b918d365a9cc, user_id=81277ee082ac48b189e945c8febf31c9, role_id=e7731ac807d84abc8a0bb0d9a70a50ca)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:26.207991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839cb1c-9964-44d2-ac4d-cbe2fe6a8999 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:26.213326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4fc4382-e760-4889-aad2-0ebea1f2fde7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1531140d045456cb091602f4660e2e8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:26.232857 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1502/3036] 10.222.0.13 () {60 vars in 1578 bytes} [Sat Dec 18 20:51:26 2021] PUT /identity/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/users/81277ee082ac48b189e945c8febf31c9/roles/e7731ac807d84abc8a0bb0d9a70a50ca/inherited_to_projects => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:26.234448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4fc4382-e760-4889-aad2-0ebea1f2fde7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1531140d045456cb091602f4660e2e8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:26.235143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839cb1c-9964-44d2-ac4d-cbe2fe6a8999 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:26.239937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d839cb1c-9964-44d2-ac4d-cbe2fe6a8999 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:26.244024 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1535/3037] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:25 2021] DELETE /identity/v3/users/c1531140d045456cb091602f4660e2e8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:26.324045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839cb1c-9964-44d2-ac4d-cbe2fe6a8999 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:26.398236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ed23d-7a2e-4682-8ecb-4ac84df840ba tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:26.399058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ed23d-7a2e-4682-8ecb-4ac84df840ba tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:26.399493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ed23d-7a2e-4682-8ecb-4ac84df840ba tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:26.399834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ed23d-7a2e-4682-8ecb-4ac84df840ba tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:26.400825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ed23d-7a2e-4682-8ecb-4ac84df840ba tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Adding query filter params (scope.project.id=ef3f3e6b51c84f0aaa26e28b9330a39e, user.id=81277ee082ac48b189e945c8febf31c9) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:26.401148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ed23d-7a2e-4682-8ecb-4ac84df840ba tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:26.403293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ed23d-7a2e-4682-8ecb-4ac84df840ba tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:26.468553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc4382-e760-4889-aad2-0ebea1f2fde7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:26.470050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e4fc4382-e760-4889-aad2-0ebea1f2fde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:26.473267 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1503/3038] 10.222.0.13 () {58 vars in 1355 bytes} [Sat Dec 18 20:51:26 2021] GET /identity/v3/role_assignments?scope.project.id=ef3f3e6b51c84f0aaa26e28b9330a39e&user.id=81277ee082ac48b189e945c8febf31c9&effective => generated 648 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:26.477940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ed23d-7a2e-4682-8ecb-4ac84df840ba tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:26.504728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ed23d-7a2e-4682-8ecb-4ac84df840ba tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:26.511274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbf91e-1c1f-43c5-b4a0-ff75551a23b4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:26.512952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbf91e-1c1f-43c5-b4a0-ff75551a23b4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:26.513336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbf91e-1c1f-43c5-b4a0-ff75551a23b4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:26.513818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbf91e-1c1f-43c5-b4a0-ff75551a23b4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:26.515278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbf91e-1c1f-43c5-b4a0-ff75551a23b4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Adding query filter params (scope.project.id=3030f9a2e97a4ddfbfdacd2063e95067, user.id=81277ee082ac48b189e945c8febf31c9) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:26.515674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbf91e-1c1f-43c5-b4a0-ff75551a23b4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:26.517782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbf91e-1c1f-43c5-b4a0-ff75551a23b4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:26.549749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc4382-e760-4889-aad2-0ebea1f2fde7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:26.554882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bc918-ae28-49ee-837e-e73fd7f711c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:26.555747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc918-ae28-49ee-837e-e73fd7f711c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:26.556035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc918-ae28-49ee-837e-e73fd7f711c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:26.556309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc918-ae28-49ee-837e-e73fd7f711c1 admin admin] PATH_INFO: `/v3/projects/5f8e3b51044244cca78d83ab1ecb036d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:26.558145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bc918-ae28-49ee-837e-e73fd7f711c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8e3b51044244cca78d83ab1ecb036d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:26.560949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bc918-ae28-49ee-837e-e73fd7f711c1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:26.619486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2d3bc918-ae28-49ee-837e-e73fd7f711c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8e3b51044244cca78d83ab1ecb036d', 'request_id': 'req-2d3bc918-ae28-49ee-837e-e73fd7f711c1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:26.620034 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1504/3039] 10.222.0.13 () {58 vars in 1355 bytes} [Sat Dec 18 20:51:26 2021] GET /identity/v3/role_assignments?scope.project.id=3030f9a2e97a4ddfbfdacd2063e95067&user.id=81277ee082ac48b189e945c8febf31c9&effective => generated 648 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:26.621028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbf91e-1c1f-43c5-b4a0-ff75551a23b4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:26.625383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a5bbf91e-1c1f-43c5-b4a0-ff75551a23b4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:26.631719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2d3bc918-ae28-49ee-837e-e73fd7f711c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8e3b51044244cca78d83ab1ecb036d', 'request_id': 'req-2d3bc918-ae28-49ee-837e-e73fd7f711c1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:26.641417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2d3bc918-ae28-49ee-837e-e73fd7f711c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8e3b51044244cca78d83ab1ecb036d', 'request_id': 'req-2d3bc918-ae28-49ee-837e-e73fd7f711c1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:26.642407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbf91e-1c1f-43c5-b4a0-ff75551a23b4 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:26.657653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2d3bc918-ae28-49ee-837e-e73fd7f711c1 admin admin] The token cache is being invalidate because project 5f8e3b51044244cca78d83ab1ecb036d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:26.658004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2d3bc918-ae28-49ee-837e-e73fd7f711c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:26.660056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2d3bc918-ae28-49ee-837e-e73fd7f711c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:26.667699 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1536/3040] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:26 2021] DELETE /identity/v3/projects/5f8e3b51044244cca78d83ab1ecb036d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:26.667699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bc918-ae28-49ee-837e-e73fd7f711c1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:26.670401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2d3bc918-ae28-49ee-837e-e73fd7f711c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:26.720452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe40fe8-5cc8-4007-add8-84b8288549ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:26.721959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe40fe8-5cc8-4007-add8-84b8288549ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:26.722281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe40fe8-5cc8-4007-add8-84b8288549ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:26.722567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe40fe8-5cc8-4007-add8-84b8288549ed admin admin] PATH_INFO: `/v3/users/8042de28328d4b26b910f1be4b499879` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:26.723844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe40fe8-5cc8-4007-add8-84b8288549ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=8042de28328d4b26b910f1be4b499879)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:26.727099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe40fe8-5cc8-4007-add8-84b8288549ed admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:26.767254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bc918-ae28-49ee-837e-e73fd7f711c1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:26.773084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68be372-043b-4f68-a1ab-9558fae7f28a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:26.774128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68be372-043b-4f68-a1ab-9558fae7f28a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:26.774614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68be372-043b-4f68-a1ab-9558fae7f28a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:26.774900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68be372-043b-4f68-a1ab-9558fae7f28a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/users/81277ee082ac48b189e945c8febf31c9/roles/e7731ac807d84abc8a0bb0d9a70a50ca/inherited_to_projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:26.777222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68be372-043b-4f68-a1ab-9558fae7f28a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=01ea4e737bd740458321b918d365a9cc, user_id=81277ee082ac48b189e945c8febf31c9, role_id=e7731ac807d84abc8a0bb0d9a70a50ca)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:26.779964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68be372-043b-4f68-a1ab-9558fae7f28a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:26.784560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bfe40fe8-5cc8-4007-add8-84b8288549ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8042de28328d4b26b910f1be4b499879'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:26.785682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e68be372-043b-4f68-a1ab-9558fae7f28a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invalidating the token cache because role e7731ac807d84abc8a0bb0d9a70a50ca was removed from user 81277ee082ac48b189e945c8febf31c9 on domain 01ea4e737bd740458321b918d365a9cc. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:26.785980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e68be372-043b-4f68-a1ab-9558fae7f28a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:26.788385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e68be372-043b-4f68-a1ab-9558fae7f28a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:26.792641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bfe40fe8-5cc8-4007-add8-84b8288549ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8042de28328d4b26b910f1be4b499879'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:26.803631 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1537/3041] 10.222.0.13 () {58 vars in 1562 bytes} [Sat Dec 18 20:51:26 2021] DELETE /identity/v3/OS-INHERIT/domains/01ea4e737bd740458321b918d365a9cc/users/81277ee082ac48b189e945c8febf31c9/roles/e7731ac807d84abc8a0bb0d9a70a50ca/inherited_to_projects => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:26.805716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bfe40fe8-5cc8-4007-add8-84b8288549ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8042de28328d4b26b910f1be4b499879'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:26.805964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71429d57-d871-41de-8be2-99527eb92a0b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:26.806465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71429d57-d871-41de-8be2-99527eb92a0b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:26.806589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bfe40fe8-5cc8-4007-add8-84b8288549ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8042de28328d4b26b910f1be4b499879'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:26.806842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71429d57-d871-41de-8be2-99527eb92a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:26.815918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bfe40fe8-5cc8-4007-add8-84b8288549ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8042de28328d4b26b910f1be4b499879'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:26.826746 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1505/3042] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:26 2021] DELETE /identity/v3/users/8042de28328d4b26b910f1be4b499879 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:26.827095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-71429d57-d871-41de-8be2-99527eb92a0b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:26.827643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe40fe8-5cc8-4007-add8-84b8288549ed admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:26.828472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-71429d57-d871-41de-8be2-99527eb92a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:26.830826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bfe40fe8-5cc8-4007-add8-84b8288549ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:26.908146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe40fe8-5cc8-4007-add8-84b8288549ed admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:26.914448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4e426-889e-4d55-ad52-b04287dba6b3 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:26.915254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4e426-889e-4d55-ad52-b04287dba6b3 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:26.915620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4e426-889e-4d55-ad52-b04287dba6b3 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:26.916126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4e426-889e-4d55-ad52-b04287dba6b3 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:26.917030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4e426-889e-4d55-ad52-b04287dba6b3 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Adding query filter params (scope.project.id=ef3f3e6b51c84f0aaa26e28b9330a39e, user.id=81277ee082ac48b189e945c8febf31c9) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:26.917413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4e426-889e-4d55-ad52-b04287dba6b3 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:26.919542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4e426-889e-4d55-ad52-b04287dba6b3 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:26.946424 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1538/3043] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:26.950379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cc1e8-199d-4c8b-aa45-eaaa777bfee9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:26.950845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cc1e8-199d-4c8b-aa45-eaaa777bfee9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:26.951275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cc1e8-199d-4c8b-aa45-eaaa777bfee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:26.970939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-488cc1e8-199d-4c8b-aa45-eaaa777bfee9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:26.985517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-488cc1e8-199d-4c8b-aa45-eaaa777bfee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:26.995210 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1539/3044] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:27.000295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cc1e8-199d-4c8b-aa45-eaaa777bfee9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:27.001919 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1506/3045] 10.222.0.13 () {58 vars in 1355 bytes} [Sat Dec 18 20:51:26 2021] GET /identity/v3/role_assignments?scope.project.id=ef3f3e6b51c84f0aaa26e28b9330a39e&user.id=81277ee082ac48b189e945c8febf31c9&effective => generated 228 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:27.005994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4e426-889e-4d55-ad52-b04287dba6b3 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:27.015265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cc1e8-199d-4c8b-aa45-eaaa777bfee9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:27.021430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df237bf-5a65-4265-b98a-746b52d1c790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:27.022114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df237bf-5a65-4265-b98a-746b52d1c790 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:27.022433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df237bf-5a65-4265-b98a-746b52d1c790 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:27.022716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df237bf-5a65-4265-b98a-746b52d1c790 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:27.023457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df237bf-5a65-4265-b98a-746b52d1c790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:27.023765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df237bf-5a65-4265-b98a-746b52d1c790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:27.024511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4e426-889e-4d55-ad52-b04287dba6b3 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:27.025448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df237bf-5a65-4265-b98a-746b52d1c790 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:27.036281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb588b2-76d2-442d-a87f-12d760f6d96a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:27.036954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb588b2-76d2-442d-a87f-12d760f6d96a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:27.037241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb588b2-76d2-442d-a87f-12d760f6d96a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:27.037523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb588b2-76d2-442d-a87f-12d760f6d96a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:27.038465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb588b2-76d2-442d-a87f-12d760f6d96a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Adding query filter params (scope.project.id=3030f9a2e97a4ddfbfdacd2063e95067, user.id=81277ee082ac48b189e945c8febf31c9) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:27.038786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb588b2-76d2-442d-a87f-12d760f6d96a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:27.040903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb588b2-76d2-442d-a87f-12d760f6d96a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:27.042434 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1540/3046] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:51:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:51:27.046621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df237bf-5a65-4265-b98a-746b52d1c790 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:27.076327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df237bf-5a65-4265-b98a-746b52d1c790 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:27.085018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37293a-18b8-41e0-a02c-50b330d3e707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:27.085679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37293a-18b8-41e0-a02c-50b330d3e707 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:27.086107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37293a-18b8-41e0-a02c-50b330d3e707 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:27.086449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37293a-18b8-41e0-a02c-50b330d3e707 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:27.087209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37293a-18b8-41e0-a02c-50b330d3e707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:27.089309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37293a-18b8-41e0-a02c-50b330d3e707 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:27.121080 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1507/3047] 10.222.0.13 () {58 vars in 1355 bytes} [Sat Dec 18 20:51:27 2021] GET /identity/v3/role_assignments?scope.project.id=3030f9a2e97a4ddfbfdacd2063e95067&user.id=81277ee082ac48b189e945c8febf31c9&effective => generated 228 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:51:27.121080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb588b2-76d2-442d-a87f-12d760f6d96a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:27.121983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1cb588b2-76d2-442d-a87f-12d760f6d96a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:27.129944 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1541/3048] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:27 2021] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:27.130657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37293a-18b8-41e0-a02c-50b330d3e707 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:27.137718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb588b2-76d2-442d-a87f-12d760f6d96a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:27.199451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37293a-18b8-41e0-a02c-50b330d3e707 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:27.202859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fc9ee-76c1-4555-9120-fa0b5da06e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:27.203799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fc9ee-76c1-4555-9120-fa0b5da06e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:27.204150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fc9ee-76c1-4555-9120-fa0b5da06e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:27.204501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fc9ee-76c1-4555-9120-fa0b5da06e35 admin admin] PATH_INFO: `/v3/projects/a84b125f83d34481adc5617b5ca62e2e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:27.204912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec8b07-32a5-4f40-8d96-aebef238f18a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:27.206446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec8b07-32a5-4f40-8d96-aebef238f18a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:27.206586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fc9ee-76c1-4555-9120-fa0b5da06e35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a84b125f83d34481adc5617b5ca62e2e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:27.206683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec8b07-32a5-4f40-8d96-aebef238f18a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:27.206683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec8b07-32a5-4f40-8d96-aebef238f18a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/projects/3030f9a2e97a4ddfbfdacd2063e95067` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:27.207995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec8b07-32a5-4f40-8d96-aebef238f18a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3030f9a2e97a4ddfbfdacd2063e95067)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:27.208363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fc9ee-76c1-4555-9120-fa0b5da06e35 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:27.210640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec8b07-32a5-4f40-8d96-aebef238f18a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:27.254702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da0fc9ee-76c1-4555-9120-fa0b5da06e35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a84b125f83d34481adc5617b5ca62e2e', 'request_id': 'req-da0fc9ee-76c1-4555-9120-fa0b5da06e35'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:27.256960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0ec8b07-32a5-4f40-8d96-aebef238f18a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3030f9a2e97a4ddfbfdacd2063e95067', 'request_id': 'req-d0ec8b07-32a5-4f40-8d96-aebef238f18a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:27.260831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da0fc9ee-76c1-4555-9120-fa0b5da06e35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a84b125f83d34481adc5617b5ca62e2e', 'request_id': 'req-da0fc9ee-76c1-4555-9120-fa0b5da06e35'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:27.263553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0ec8b07-32a5-4f40-8d96-aebef238f18a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3030f9a2e97a4ddfbfdacd2063e95067', 'request_id': 'req-d0ec8b07-32a5-4f40-8d96-aebef238f18a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:27.267038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da0fc9ee-76c1-4555-9120-fa0b5da06e35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a84b125f83d34481adc5617b5ca62e2e', 'request_id': 'req-da0fc9ee-76c1-4555-9120-fa0b5da06e35'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:27.270512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0ec8b07-32a5-4f40-8d96-aebef238f18a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3030f9a2e97a4ddfbfdacd2063e95067', 'request_id': 'req-d0ec8b07-32a5-4f40-8d96-aebef238f18a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:27.278670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da0fc9ee-76c1-4555-9120-fa0b5da06e35 admin admin] The token cache is being invalidate because project a84b125f83d34481adc5617b5ca62e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:27.278954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da0fc9ee-76c1-4555-9120-fa0b5da06e35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:27.279662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da0fc9ee-76c1-4555-9120-fa0b5da06e35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:27.280887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0ec8b07-32a5-4f40-8d96-aebef238f18a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] The token cache is being invalidate because project 3030f9a2e97a4ddfbfdacd2063e95067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:27.281176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0ec8b07-32a5-4f40-8d96-aebef238f18a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:27.284241 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1508/3049] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:27 2021] DELETE /identity/v3/projects/a84b125f83d34481adc5617b5ca62e2e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:27.284404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0ec8b07-32a5-4f40-8d96-aebef238f18a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:27.284509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fc9ee-76c1-4555-9120-fa0b5da06e35 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:27.284604 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1542/3050] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:27 2021] DELETE /identity/v3/projects/3030f9a2e97a4ddfbfdacd2063e95067 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:27.284694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-da0fc9ee-76c1-4555-9120-fa0b5da06e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:27.285508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec8b07-32a5-4f40-8d96-aebef238f18a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:27.287068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d0ec8b07-32a5-4f40-8d96-aebef238f18a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:27.350045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fc9ee-76c1-4555-9120-fa0b5da06e35 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:27.355587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed063aa4-3d36-453b-b7c9-605858f14c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:27.356881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed063aa4-3d36-453b-b7c9-605858f14c00 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:27.357251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed063aa4-3d36-453b-b7c9-605858f14c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:27.357615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed063aa4-3d36-453b-b7c9-605858f14c00 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:27.358432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed063aa4-3d36-453b-b7c9-605858f14c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:27.358574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec8b07-32a5-4f40-8d96-aebef238f18a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:27.360473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed063aa4-3d36-453b-b7c9-605858f14c00 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:27.363709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac890c-8b55-4337-b6d9-6c58d31b5825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:27.364657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac890c-8b55-4337-b6d9-6c58d31b5825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:27.365011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac890c-8b55-4337-b6d9-6c58d31b5825 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:27.365363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac890c-8b55-4337-b6d9-6c58d31b5825 admin admin] PATH_INFO: `/v3/users/4fa66b6ec8904baab2ec5e337d241dc0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:27.366821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac890c-8b55-4337-b6d9-6c58d31b5825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa66b6ec8904baab2ec5e337d241dc0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:27.368828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac890c-8b55-4337-b6d9-6c58d31b5825 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:27.385017 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1509/3051] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:27 2021] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:27.385017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed063aa4-3d36-453b-b7c9-605858f14c00 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:27.385017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ed063aa4-3d36-453b-b7c9-605858f14c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:27.420567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fcac890c-8b55-4337-b6d9-6c58d31b5825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa66b6ec8904baab2ec5e337d241dc0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:27.428500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fcac890c-8b55-4337-b6d9-6c58d31b5825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa66b6ec8904baab2ec5e337d241dc0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:27.429372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fcac890c-8b55-4337-b6d9-6c58d31b5825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa66b6ec8904baab2ec5e337d241dc0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:27.442722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fcac890c-8b55-4337-b6d9-6c58d31b5825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa66b6ec8904baab2ec5e337d241dc0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:27.450725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fcac890c-8b55-4337-b6d9-6c58d31b5825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa66b6ec8904baab2ec5e337d241dc0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:27.452826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed063aa4-3d36-453b-b7c9-605858f14c00 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:27.458181 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1543/3052] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:27 2021] DELETE /identity/v3/users/4fa66b6ec8904baab2ec5e337d241dc0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:51:27.459198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac890c-8b55-4337-b6d9-6c58d31b5825 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:27.459427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdce4f-6185-4231-ab15-b346d75f1978 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:27.460479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdce4f-6185-4231-ab15-b346d75f1978 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:27.460771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdce4f-6185-4231-ab15-b346d75f1978 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:27.460901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fcac890c-8b55-4337-b6d9-6c58d31b5825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:27.461043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdce4f-6185-4231-ab15-b346d75f1978 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/roles/e7731ac807d84abc8a0bb0d9a70a50ca` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:27.463649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdce4f-6185-4231-ab15-b346d75f1978 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e7731ac807d84abc8a0bb0d9a70a50ca)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:27.465874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdce4f-6185-4231-ab15-b346d75f1978 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:27.515610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-40cdce4f-6185-4231-ab15-b346d75f1978 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invalidating the token cache because role e7731ac807d84abc8a0bb0d9a70a50ca has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:27.516021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-40cdce4f-6185-4231-ab15-b346d75f1978 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:27.517125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-40cdce4f-6185-4231-ab15-b346d75f1978 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:27.522753 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1510/3053] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:27 2021] DELETE /identity/v3/roles/e7731ac807d84abc8a0bb0d9a70a50ca => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:27.525804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdce4f-6185-4231-ab15-b346d75f1978 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:27.527749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-40cdce4f-6185-4231-ab15-b346d75f1978 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:27.546927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac890c-8b55-4337-b6d9-6c58d31b5825 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:27.612905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdce4f-6185-4231-ab15-b346d75f1978 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:27.618977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce36f7-8048-4f1f-ac3d-318464dcc704 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:27.623217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce36f7-8048-4f1f-ac3d-318464dcc704 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:27.623626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce36f7-8048-4f1f-ac3d-318464dcc704 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:27.624008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce36f7-8048-4f1f-ac3d-318464dcc704 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:27.625783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce36f7-8048-4f1f-ac3d-318464dcc704 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:27.627591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce36f7-8048-4f1f-ac3d-318464dcc704 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:27.628779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08db3d6-a434-4692-919f-f4248341dba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:27.629938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08db3d6-a434-4692-919f-f4248341dba7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:27.630601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08db3d6-a434-4692-919f-f4248341dba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:27.631231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08db3d6-a434-4692-919f-f4248341dba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:27.632139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08db3d6-a434-4692-919f-f4248341dba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:27.634051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08db3d6-a434-4692-919f-f4248341dba7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:27.650431 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1544/3054] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:27 2021] GET /identity/v3/roles => generated 1651 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:27.653850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08db3d6-a434-4692-919f-f4248341dba7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:27.655679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f08db3d6-a434-4692-919f-f4248341dba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:27.656139 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1511/3055] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 20:51:27 2021] POST /identity/v3/roles => generated 240 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:27.659914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce36f7-8048-4f1f-ac3d-318464dcc704 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:27.680638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08db3d6-a434-4692-919f-f4248341dba7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:27.686574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2400ad-4f0b-49de-9493-48afd012dac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:27.687259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2400ad-4f0b-49de-9493-48afd012dac1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:27.687546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2400ad-4f0b-49de-9493-48afd012dac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:27.687829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2400ad-4f0b-49de-9493-48afd012dac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:27.688315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce36f7-8048-4f1f-ac3d-318464dcc704 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:27.689289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2400ad-4f0b-49de-9493-48afd012dac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:27.691485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2400ad-4f0b-49de-9493-48afd012dac1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:27.697811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7c3a2-e9aa-43e0-967f-b335cee77f7f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:27.698709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7c3a2-e9aa-43e0-967f-b335cee77f7f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:27.699097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7c3a2-e9aa-43e0-967f-b335cee77f7f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:27.700150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7c3a2-e9aa-43e0-967f-b335cee77f7f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:27.700969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7c3a2-e9aa-43e0-967f-b335cee77f7f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:27.703055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7c3a2-e9aa-43e0-967f-b335cee77f7f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:27.723052 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1545/3056] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:27 2021] GET /identity/v3/roles => generated 1651 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:51:27.724798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2400ad-4f0b-49de-9493-48afd012dac1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:27.745125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2400ad-4f0b-49de-9493-48afd012dac1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:27.752406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93f233-0840-40a7-8b73-38cde0f6decb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:27.753374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93f233-0840-40a7-8b73-38cde0f6decb admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:27.753731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93f233-0840-40a7-8b73-38cde0f6decb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:27.754015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93f233-0840-40a7-8b73-38cde0f6decb admin admin] PATH_INFO: `/v3/projects/47afd4144d59401db03d83c3501ca32e/users/cbcc1bab9ea04489a5d1d0ed7cf32fd9/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:27.773943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93f233-0840-40a7-8b73-38cde0f6decb admin admin] RBAC: Authorizing `identity:create_grant(project_id=47afd4144d59401db03d83c3501ca32e, user_id=cbcc1bab9ea04489a5d1d0ed7cf32fd9, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:27.777552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93f233-0840-40a7-8b73-38cde0f6decb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:27.781058 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1512/3057] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:27 2021] POST /identity/v3/projects => generated 410 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:27.781961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7c3a2-e9aa-43e0-967f-b335cee77f7f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:27.784151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0bc7c3a2-e9aa-43e0-967f-b335cee77f7f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:27.797355 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1546/3058] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:27 2021] PUT /identity/v3/projects/47afd4144d59401db03d83c3501ca32e/users/cbcc1bab9ea04489a5d1d0ed7cf32fd9/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:27.803257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93f233-0840-40a7-8b73-38cde0f6decb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:27.875951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7c3a2-e9aa-43e0-967f-b335cee77f7f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:27.884286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93f233-0840-40a7-8b73-38cde0f6decb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:27.889747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b98a59-37bd-40f1-a151-15f8e3b3b6c2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:27.890650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b98a59-37bd-40f1-a151-15f8e3b3b6c2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:27.890922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b98a59-37bd-40f1-a151-15f8e3b3b6c2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:27.891202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b98a59-37bd-40f1-a151-15f8e3b3b6c2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/ef3f3e6b51c84f0aaa26e28b9330a39e/users/81277ee082ac48b189e945c8febf31c9/roles/7b6e167a2404412e890ff79a1f8797e2/inherited_to_projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:27.893456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b98a59-37bd-40f1-a151-15f8e3b3b6c2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ef3f3e6b51c84f0aaa26e28b9330a39e, user_id=81277ee082ac48b189e945c8febf31c9, role_id=7b6e167a2404412e890ff79a1f8797e2)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:27.896140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b98a59-37bd-40f1-a151-15f8e3b3b6c2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:27.909845 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1547/3059] 10.222.0.13 () {60 vars in 1581 bytes} [Sat Dec 18 20:51:27 2021] PUT /identity/v3/OS-INHERIT/projects/ef3f3e6b51c84f0aaa26e28b9330a39e/users/81277ee082ac48b189e945c8febf31c9/roles/7b6e167a2404412e890ff79a1f8797e2/inherited_to_projects => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:27.911304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85a3ab-5410-4b8e-aacd-576cb0014756 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:27.911960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85a3ab-5410-4b8e-aacd-576cb0014756 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:27.912243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85a3ab-5410-4b8e-aacd-576cb0014756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:27.939215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca786e-5638-4a38-86e6-346af7649cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:27.940069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca786e-5638-4a38-86e6-346af7649cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:27.940349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca786e-5638-4a38-86e6-346af7649cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:27.940662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca786e-5638-4a38-86e6-346af7649cb1 admin admin] PATH_INFO: `/v3/projects/96bbc9ed26984947a2211c73165f2ca5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:27.941488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8e85a3ab-5410-4b8e-aacd-576cb0014756 None None] MFA Rules not processed for user `cbcc1bab9ea04489a5d1d0ed7cf32fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:27.941815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca786e-5638-4a38-86e6-346af7649cb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96bbc9ed26984947a2211c73165f2ca5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:27.942746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8e85a3ab-5410-4b8e-aacd-576cb0014756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:27.943944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca786e-5638-4a38-86e6-346af7649cb1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:28.002858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6cca786e-5638-4a38-86e6-346af7649cb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96bbc9ed26984947a2211c73165f2ca5', 'request_id': 'req-6cca786e-5638-4a38-86e6-346af7649cb1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:28.009436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6cca786e-5638-4a38-86e6-346af7649cb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96bbc9ed26984947a2211c73165f2ca5', 'request_id': 'req-6cca786e-5638-4a38-86e6-346af7649cb1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:28.017166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6cca786e-5638-4a38-86e6-346af7649cb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96bbc9ed26984947a2211c73165f2ca5', 'request_id': 'req-6cca786e-5638-4a38-86e6-346af7649cb1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:28.019388 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1548/3060] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:27 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:28.021000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85a3ab-5410-4b8e-aacd-576cb0014756 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:28.047189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6cca786e-5638-4a38-86e6-346af7649cb1 admin admin] The token cache is being invalidate because project 96bbc9ed26984947a2211c73165f2ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:28.047567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6cca786e-5638-4a38-86e6-346af7649cb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:28.048136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6cca786e-5638-4a38-86e6-346af7649cb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:28.050322 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1513/3061] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:27 2021] DELETE /identity/v3/projects/96bbc9ed26984947a2211c73165f2ca5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:28.050868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca786e-5638-4a38-86e6-346af7649cb1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:28.052216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6cca786e-5638-4a38-86e6-346af7649cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:28.091200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85a3ab-5410-4b8e-aacd-576cb0014756 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:28.124446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca786e-5638-4a38-86e6-346af7649cb1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:28.131402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21d21b-94c7-4453-a3ee-c121c8d2c182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:28.132180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21d21b-94c7-4453-a3ee-c121c8d2c182 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:28.132536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21d21b-94c7-4453-a3ee-c121c8d2c182 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:28.133072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21d21b-94c7-4453-a3ee-c121c8d2c182 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:28.133857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21d21b-94c7-4453-a3ee-c121c8d2c182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:28.136470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21d21b-94c7-4453-a3ee-c121c8d2c182 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:28.163052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860c0d4-c518-4519-b226-6bc4bd0ac1c9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:28.163721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860c0d4-c518-4519-b226-6bc4bd0ac1c9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:28.164005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860c0d4-c518-4519-b226-6bc4bd0ac1c9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:28.164287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860c0d4-c518-4519-b226-6bc4bd0ac1c9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:28.165150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860c0d4-c518-4519-b226-6bc4bd0ac1c9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Adding query filter params (scope.project.id=e1bb918b66234bc987ce787ea6321eda, user.id=81277ee082ac48b189e945c8febf31c9) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:28.165517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860c0d4-c518-4519-b226-6bc4bd0ac1c9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:28.167356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860c0d4-c518-4519-b226-6bc4bd0ac1c9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:28.174155 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1514/3062] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:28 2021] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:28.176191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95a3c2-a3be-4a4e-96c0-d6d459eb3532 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:28.176479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95a3c2-a3be-4a4e-96c0-d6d459eb3532 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:28.176760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95a3c2-a3be-4a4e-96c0-d6d459eb3532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:28.198474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8a95a3c2-a3be-4a4e-96c0-d6d459eb3532 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:28.199988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8a95a3c2-a3be-4a4e-96c0-d6d459eb3532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:28.227600 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1549/3063] 10.222.0.13 () {58 vars in 1355 bytes} [Sat Dec 18 20:51:28 2021] GET /identity/v3/role_assignments?scope.project.id=e1bb918b66234bc987ce787ea6321eda&user.id=81277ee082ac48b189e945c8febf31c9&effective => generated 649 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:28.229045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860c0d4-c518-4519-b226-6bc4bd0ac1c9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:28.241741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860c0d4-c518-4519-b226-6bc4bd0ac1c9 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:28.272951 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1515/3064] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:28.273644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95a3c2-a3be-4a4e-96c0-d6d459eb3532 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:28.275067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8a95a3c2-a3be-4a4e-96c0-d6d459eb3532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:28.309225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8d3f4-3b09-4e77-81c0-a0ae45200cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:28.310143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d3f4-3b09-4e77-81c0-a0ae45200cbc admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:28.310455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d3f4-3b09-4e77-81c0-a0ae45200cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:28.310758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d3f4-3b09-4e77-81c0-a0ae45200cbc admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:28.311441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8d3f4-3b09-4e77-81c0-a0ae45200cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:28.313333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8d3f4-3b09-4e77-81c0-a0ae45200cbc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:28.333459 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1550/3065] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:28 2021] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:28.334773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50446e01-3c8a-4b22-8c9e-b2582094cc15 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:28.335059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50446e01-3c8a-4b22-8c9e-b2582094cc15 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:28.335348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50446e01-3c8a-4b22-8c9e-b2582094cc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:28.346759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95a3c2-a3be-4a4e-96c0-d6d459eb3532 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:28.351598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc5d65-2484-4309-bccd-109460bc8e0a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:28.352449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc5d65-2484-4309-bccd-109460bc8e0a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:28.352741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc5d65-2484-4309-bccd-109460bc8e0a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:28.353022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc5d65-2484-4309-bccd-109460bc8e0a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/ef3f3e6b51c84f0aaa26e28b9330a39e/users/81277ee082ac48b189e945c8febf31c9/roles/7b6e167a2404412e890ff79a1f8797e2/inherited_to_projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:28.355277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc5d65-2484-4309-bccd-109460bc8e0a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=ef3f3e6b51c84f0aaa26e28b9330a39e, user_id=81277ee082ac48b189e945c8febf31c9, role_id=7b6e167a2404412e890ff79a1f8797e2)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:28.355425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-50446e01-3c8a-4b22-8c9e-b2582094cc15 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:28.356507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-50446e01-3c8a-4b22-8c9e-b2582094cc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:28.357884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc5d65-2484-4309-bccd-109460bc8e0a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:28.363130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d6cc5d65-2484-4309-bccd-109460bc8e0a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invalidating the token cache because role 7b6e167a2404412e890ff79a1f8797e2 was removed from user 81277ee082ac48b189e945c8febf31c9 on project ef3f3e6b51c84f0aaa26e28b9330a39e. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:28.363423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d6cc5d65-2484-4309-bccd-109460bc8e0a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:28.364076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d6cc5d65-2484-4309-bccd-109460bc8e0a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:28.368929 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1551/3066] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:28.368929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50446e01-3c8a-4b22-8c9e-b2582094cc15 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:28.377650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50446e01-3c8a-4b22-8c9e-b2582094cc15 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:28.381385 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1516/3067] 10.222.0.13 () {58 vars in 1565 bytes} [Sat Dec 18 20:51:28 2021] DELETE /identity/v3/OS-INHERIT/projects/ef3f3e6b51c84f0aaa26e28b9330a39e/users/81277ee082ac48b189e945c8febf31c9/roles/7b6e167a2404412e890ff79a1f8797e2/inherited_to_projects => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:28.382790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc5d65-2484-4309-bccd-109460bc8e0a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:28.384537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d6cc5d65-2484-4309-bccd-109460bc8e0a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:28.444493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd25ae-57d0-4411-ba98-dc62c88f25f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:28.445087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd25ae-57d0-4411-ba98-dc62c88f25f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:28.445375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd25ae-57d0-4411-ba98-dc62c88f25f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:28.445656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd25ae-57d0-4411-ba98-dc62c88f25f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:28.446474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd25ae-57d0-4411-ba98-dc62c88f25f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:28.448105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd25ae-57d0-4411-ba98-dc62c88f25f9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:28.454266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc5d65-2484-4309-bccd-109460bc8e0a tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:28.458999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ff66b-e777-4dfa-8361-1f99c669cbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:28.459726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ff66b-e777-4dfa-8361-1f99c669cbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:28.459883 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1552/3068] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:28 2021] GET /identity/v3/roles => generated 1651 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:28.460245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ff66b-e777-4dfa-8361-1f99c669cbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:28.460486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ff66b-e777-4dfa-8361-1f99c669cbf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:28.461400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ff66b-e777-4dfa-8361-1f99c669cbf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:28.461777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ff66b-e777-4dfa-8361-1f99c669cbf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:28.464036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ff66b-e777-4dfa-8361-1f99c669cbf0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:28.464162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd25ae-57d0-4411-ba98-dc62c88f25f9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:28.466221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dbcd25ae-57d0-4411-ba98-dc62c88f25f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:28.479691 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1517/3069] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:51:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:28.479691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ff66b-e777-4dfa-8361-1f99c669cbf0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:28.479691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fa1ff66b-e777-4dfa-8361-1f99c669cbf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:28.491772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ff66b-e777-4dfa-8361-1f99c669cbf0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:28.497141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962f162-1323-4cb0-ba7a-0bacde6cf99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:28.498017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962f162-1323-4cb0-ba7a-0bacde6cf99b admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:28.498501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962f162-1323-4cb0-ba7a-0bacde6cf99b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:28.499166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962f162-1323-4cb0-ba7a-0bacde6cf99b admin admin] PATH_INFO: `/v3/projects/f145ee84f2f04ba6a0a2415cf3d45502/users/26b992eb80024f5ab8ff581d9f39b465/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:28.515721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962f162-1323-4cb0-ba7a-0bacde6cf99b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f145ee84f2f04ba6a0a2415cf3d45502, user_id=26b992eb80024f5ab8ff581d9f39b465, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:28.518609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962f162-1323-4cb0-ba7a-0bacde6cf99b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:28.536475 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1518/3070] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:28 2021] PUT /identity/v3/projects/f145ee84f2f04ba6a0a2415cf3d45502/users/26b992eb80024f5ab8ff581d9f39b465/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:28.536733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962f162-1323-4cb0-ba7a-0bacde6cf99b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:28.565384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd25ae-57d0-4411-ba98-dc62c88f25f9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:28.644709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962f162-1323-4cb0-ba7a-0bacde6cf99b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:28.654979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bbbb5-b517-4ac2-a953-142606165dd2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:28.656064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bbbb5-b517-4ac2-a953-142606165dd2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:28.656209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9e6f3-8ded-48bd-a773-80e61ec2e701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:28.656714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bbbb5-b517-4ac2-a953-142606165dd2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:28.657198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bbbb5-b517-4ac2-a953-142606165dd2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:28.658576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bbbb5-b517-4ac2-a953-142606165dd2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Adding query filter params (scope.project.id=e1bb918b66234bc987ce787ea6321eda, user.id=81277ee082ac48b189e945c8febf31c9) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:28.658694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9e6f3-8ded-48bd-a773-80e61ec2e701 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:28.658983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9e6f3-8ded-48bd-a773-80e61ec2e701 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:28.659268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9e6f3-8ded-48bd-a773-80e61ec2e701 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:28.659781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bbbb5-b517-4ac2-a953-142606165dd2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:28.660908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9e6f3-8ded-48bd-a773-80e61ec2e701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:28.662619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bbbb5-b517-4ac2-a953-142606165dd2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:28.665238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9e6f3-8ded-48bd-a773-80e61ec2e701 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:28.713924 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1519/3071] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:28 2021] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:28.715179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9e6f3-8ded-48bd-a773-80e61ec2e701 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:28.759196 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1553/3072] 10.222.0.13 () {58 vars in 1355 bytes} [Sat Dec 18 20:51:28 2021] GET /identity/v3/role_assignments?scope.project.id=e1bb918b66234bc987ce787ea6321eda&user.id=81277ee082ac48b189e945c8febf31c9&effective => generated 228 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:28.760033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bbbb5-b517-4ac2-a953-142606165dd2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:28.773572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bbbb5-b517-4ac2-a953-142606165dd2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:28.799364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9e6f3-8ded-48bd-a773-80e61ec2e701 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:28.804244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bc446-9d7a-4283-87f2-f5c5c8273de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:28.804914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bc446-9d7a-4283-87f2-f5c5c8273de5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:28.805196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bc446-9d7a-4283-87f2-f5c5c8273de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:28.805472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bc446-9d7a-4283-87f2-f5c5c8273de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:28.806203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bc446-9d7a-4283-87f2-f5c5c8273de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:28.807804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bc446-9d7a-4283-87f2-f5c5c8273de5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:28.818670 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1520/3073] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:28 2021] GET /identity/v3/roles => generated 1651 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:28.819533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bc446-9d7a-4283-87f2-f5c5c8273de5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:28.829208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c392fc-8f36-4c14-bc98-809319e3675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:28.830002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c392fc-8f36-4c14-bc98-809319e3675a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:28.830314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c392fc-8f36-4c14-bc98-809319e3675a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:28.830588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c392fc-8f36-4c14-bc98-809319e3675a admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:28.831285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c392fc-8f36-4c14-bc98-809319e3675a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:28.833185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c392fc-8f36-4c14-bc98-809319e3675a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:28.853996 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1554/3074] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:28 2021] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:28.854836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c392fc-8f36-4c14-bc98-809319e3675a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:28.864617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c392fc-8f36-4c14-bc98-809319e3675a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:28.869533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a6124-f87b-4265-a9f2-b1c311551b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:28.870651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a6124-f87b-4265-a9f2-b1c311551b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:28.870960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a6124-f87b-4265-a9f2-b1c311551b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:28.871287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a6124-f87b-4265-a9f2-b1c311551b9b admin admin] PATH_INFO: `/v3/projects/f145ee84f2f04ba6a0a2415cf3d45502/users/26b992eb80024f5ab8ff581d9f39b465/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:28.873877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a6124-f87b-4265-a9f2-b1c311551b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f145ee84f2f04ba6a0a2415cf3d45502, user_id=26b992eb80024f5ab8ff581d9f39b465, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:28.876577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a6124-f87b-4265-a9f2-b1c311551b9b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:28.884683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bc446-9d7a-4283-87f2-f5c5c8273de5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:28.887302 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1555/3075] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:28 2021] PUT /identity/v3/projects/f145ee84f2f04ba6a0a2415cf3d45502/users/26b992eb80024f5ab8ff581d9f39b465/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:28.897103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a6124-f87b-4265-a9f2-b1c311551b9b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:28.938856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103dc183-5d87-48de-a2d9-dff061d353b2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:28.939709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103dc183-5d87-48de-a2d9-dff061d353b2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:28.939997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103dc183-5d87-48de-a2d9-dff061d353b2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:28.940283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103dc183-5d87-48de-a2d9-dff061d353b2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/projects/e1bb918b66234bc987ce787ea6321eda` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:28.941499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103dc183-5d87-48de-a2d9-dff061d353b2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e1bb918b66234bc987ce787ea6321eda)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:28.943412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103dc183-5d87-48de-a2d9-dff061d353b2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:28.957119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a6124-f87b-4265-a9f2-b1c311551b9b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:28.961807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dacd81-110f-4eb5-bb61-8f6f191b78cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:28.962497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dacd81-110f-4eb5-bb61-8f6f191b78cd admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:28.962785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dacd81-110f-4eb5-bb61-8f6f191b78cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:28.963079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dacd81-110f-4eb5-bb61-8f6f191b78cd admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:28.963790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dacd81-110f-4eb5-bb61-8f6f191b78cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:28.965465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dacd81-110f-4eb5-bb61-8f6f191b78cd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:28.975735 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1556/3076] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:28 2021] GET /identity/v3/roles => generated 1651 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:28.977056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d556606-122d-437f-97a4-2824d7455c8b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:28.977342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d556606-122d-437f-97a4-2824d7455c8b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:28.977622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d556606-122d-437f-97a4-2824d7455c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:28.993435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-103dc183-5d87-48de-a2d9-dff061d353b2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1bb918b66234bc987ce787ea6321eda', 'request_id': 'req-103dc183-5d87-48de-a2d9-dff061d353b2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:29.000461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-103dc183-5d87-48de-a2d9-dff061d353b2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1bb918b66234bc987ce787ea6321eda', 'request_id': 'req-103dc183-5d87-48de-a2d9-dff061d353b2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:29.005821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6d556606-122d-437f-97a4-2824d7455c8b None None] MFA Rules not processed for user `26b992eb80024f5ab8ff581d9f39b465`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:29.006114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-103dc183-5d87-48de-a2d9-dff061d353b2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1bb918b66234bc987ce787ea6321eda', 'request_id': 'req-103dc183-5d87-48de-a2d9-dff061d353b2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:29.007125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6d556606-122d-437f-97a4-2824d7455c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:29.018446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-103dc183-5d87-48de-a2d9-dff061d353b2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] The token cache is being invalidate because project e1bb918b66234bc987ce787ea6321eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:29.018738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-103dc183-5d87-48de-a2d9-dff061d353b2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:29.019489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-103dc183-5d87-48de-a2d9-dff061d353b2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:29.021021 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1521/3077] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:28 2021] DELETE /identity/v3/projects/e1bb918b66234bc987ce787ea6321eda => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:29.021782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103dc183-5d87-48de-a2d9-dff061d353b2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:29.023113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-103dc183-5d87-48de-a2d9-dff061d353b2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:29.087773 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1557/3078] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:28 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:29.088693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d556606-122d-437f-97a4-2824d7455c8b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:29.090162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6d556606-122d-437f-97a4-2824d7455c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:29.107215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103dc183-5d87-48de-a2d9-dff061d353b2 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:29.113161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d9407-8f81-4759-90cd-95e7f42abc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:29.113909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9407-8f81-4759-90cd-95e7f42abc14 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:29.114394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9407-8f81-4759-90cd-95e7f42abc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:29.114687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9407-8f81-4759-90cd-95e7f42abc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:29.115497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d9407-8f81-4759-90cd-95e7f42abc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:29.117565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d9407-8f81-4759-90cd-95e7f42abc14 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:29.133666 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1522/3079] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:29 2021] GET /identity/v3/roles => generated 1651 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:29.134694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d9407-8f81-4759-90cd-95e7f42abc14 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:29.145963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d9407-8f81-4759-90cd-95e7f42abc14 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:29.151223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cca22b-6253-4c41-b075-20f3dae7b1eb tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b992eb80024f5ab8ff581d9f39b465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f145ee84f2f04ba6a0a2415cf3d45502', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:29.151887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cca22b-6253-4c41-b075-20f3dae7b1eb tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:29.152448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cca22b-6253-4c41-b075-20f3dae7b1eb tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:29.152568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cca22b-6253-4c41-b075-20f3dae7b1eb tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:29.153281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cca22b-6253-4c41-b075-20f3dae7b1eb tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:29.153698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cca22b-6253-4c41-b075-20f3dae7b1eb tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:29.155336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cca22b-6253-4c41-b075-20f3dae7b1eb tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:29.167592 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1523/3080] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:51:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:29.168928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cca22b-6253-4c41-b075-20f3dae7b1eb tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:29.169877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d556606-122d-437f-97a4-2824d7455c8b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:29.176411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34b3a2-202b-4b36-a865-0ec9ef33e419 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:29.177511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34b3a2-202b-4b36-a865-0ec9ef33e419 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:29.177802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34b3a2-202b-4b36-a865-0ec9ef33e419 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:29.178085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34b3a2-202b-4b36-a865-0ec9ef33e419 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/roles/7b6e167a2404412e890ff79a1f8797e2` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:29.179755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cca22b-6253-4c41-b075-20f3dae7b1eb tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:29.179878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34b3a2-202b-4b36-a865-0ec9ef33e419 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7b6e167a2404412e890ff79a1f8797e2)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:29.181417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34b3a2-202b-4b36-a865-0ec9ef33e419 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:29.186352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab2fe9-ac88-476e-9237-3fb6affd5541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:29.187242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab2fe9-ac88-476e-9237-3fb6affd5541 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:29.188095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab2fe9-ac88-476e-9237-3fb6affd5541 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:29.190711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab2fe9-ac88-476e-9237-3fb6affd5541 admin admin] PATH_INFO: `/v3/projects/f15c3e2ec1194924bee37b0161adc237/users/09d32c08216a4035907c888a3c8cd70f/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:29.218913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab2fe9-ac88-476e-9237-3fb6affd5541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15c3e2ec1194924bee37b0161adc237, user_id=09d32c08216a4035907c888a3c8cd70f, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:29.222152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab2fe9-ac88-476e-9237-3fb6affd5541 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:29.242173 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1524/3081] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:29 2021] PUT /identity/v3/projects/f15c3e2ec1194924bee37b0161adc237/users/09d32c08216a4035907c888a3c8cd70f/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:29.246481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5e34b3a2-202b-4b36-a865-0ec9ef33e419 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invalidating the token cache because role 7b6e167a2404412e890ff79a1f8797e2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:29.247006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5e34b3a2-202b-4b36-a865-0ec9ef33e419 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:29.247495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab2fe9-ac88-476e-9237-3fb6affd5541 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:29.248527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5e34b3a2-202b-4b36-a865-0ec9ef33e419 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:29.250596 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1558/3082] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:29 2021] DELETE /identity/v3/roles/7b6e167a2404412e890ff79a1f8797e2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:29.255911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2886a9-d729-46bf-a9e1-153d3ab6f33d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:29.256207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2886a9-d729-46bf-a9e1-153d3ab6f33d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:29.256482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2886a9-d729-46bf-a9e1-153d3ab6f33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:29.283740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8b2886a9-d729-46bf-a9e1-153d3ab6f33d None None] MFA Rules not processed for user `09d32c08216a4035907c888a3c8cd70f`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:29.285085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8b2886a9-d729-46bf-a9e1-153d3ab6f33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:29.316335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab2fe9-ac88-476e-9237-3fb6affd5541 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:29.368047 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1559/3083] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:29 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:29.369355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2886a9-d729-46bf-a9e1-153d3ab6f33d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:29.373392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8b2886a9-d729-46bf-a9e1-153d3ab6f33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:29.395882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648185a-5b2b-46f5-975e-cfc574ed117f tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b992eb80024f5ab8ff581d9f39b465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f145ee84f2f04ba6a0a2415cf3d45502', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:29.396828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648185a-5b2b-46f5-975e-cfc574ed117f tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:29.397300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648185a-5b2b-46f5-975e-cfc574ed117f tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:29.398046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648185a-5b2b-46f5-975e-cfc574ed117f tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:29.399166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648185a-5b2b-46f5-975e-cfc574ed117f tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:29.401383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648185a-5b2b-46f5-975e-cfc574ed117f tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:29.445835 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1525/3084] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:29 2021] POST /identity/v3/projects => generated 371 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:29.446804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648185a-5b2b-46f5-975e-cfc574ed117f tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:29.450244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2648185a-5b2b-46f5-975e-cfc574ed117f tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:29.455255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2886a9-d729-46bf-a9e1-153d3ab6f33d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:29.522496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648185a-5b2b-46f5-975e-cfc574ed117f tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:29.524825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfa68a-6ca3-4fbf-923b-4f11c11e11d6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:29.525714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfa68a-6ca3-4fbf-923b-4f11c11e11d6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:29.526001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfa68a-6ca3-4fbf-923b-4f11c11e11d6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:29.526307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfa68a-6ca3-4fbf-923b-4f11c11e11d6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/users/81277ee082ac48b189e945c8febf31c9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:29.527235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756f58b-b6c0-417e-99cf-0c2d4b9f805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:29.528057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfa68a-6ca3-4fbf-923b-4f11c11e11d6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:delete_user(user_id=81277ee082ac48b189e945c8febf31c9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:29.528420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756f58b-b6c0-417e-99cf-0c2d4b9f805f admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:29.528734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756f58b-b6c0-417e-99cf-0c2d4b9f805f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:29.529014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756f58b-b6c0-417e-99cf-0c2d4b9f805f admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:29.529720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756f58b-b6c0-417e-99cf-0c2d4b9f805f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:29.530028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfa68a-6ca3-4fbf-923b-4f11c11e11d6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:29.531765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756f58b-b6c0-417e-99cf-0c2d4b9f805f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:29.559091 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1526/3085] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:29 2021] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:29.560304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756f58b-b6c0-417e-99cf-0c2d4b9f805f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:29.562416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7756f58b-b6c0-417e-99cf-0c2d4b9f805f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:29.576852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-42dfa68a-6ca3-4fbf-923b-4f11c11e11d6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81277ee082ac48b189e945c8febf31c9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:29.583705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-42dfa68a-6ca3-4fbf-923b-4f11c11e11d6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81277ee082ac48b189e945c8febf31c9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:29.584661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-42dfa68a-6ca3-4fbf-923b-4f11c11e11d6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81277ee082ac48b189e945c8febf31c9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:29.596884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-42dfa68a-6ca3-4fbf-923b-4f11c11e11d6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81277ee082ac48b189e945c8febf31c9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:29.606912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-42dfa68a-6ca3-4fbf-923b-4f11c11e11d6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81277ee082ac48b189e945c8febf31c9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:29.613405 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1560/3086] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:29 2021] DELETE /identity/v3/users/81277ee082ac48b189e945c8febf31c9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:29.614441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfa68a-6ca3-4fbf-923b-4f11c11e11d6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:29.616003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-42dfa68a-6ca3-4fbf-923b-4f11c11e11d6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:29.626940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756f58b-b6c0-417e-99cf-0c2d4b9f805f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:29.699883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9aa52-77bf-446a-b353-cae5db67ef95 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b992eb80024f5ab8ff581d9f39b465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f145ee84f2f04ba6a0a2415cf3d45502', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:29.700564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9aa52-77bf-446a-b353-cae5db67ef95 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:29.700853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9aa52-77bf-446a-b353-cae5db67ef95 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:29.701140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9aa52-77bf-446a-b353-cae5db67ef95 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:29.701883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9aa52-77bf-446a-b353-cae5db67ef95 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:29.702011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfa68a-6ca3-4fbf-923b-4f11c11e11d6 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:29.702200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9aa52-77bf-446a-b353-cae5db67ef95 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:29.704492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9aa52-77bf-446a-b353-cae5db67ef95 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:29.707766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e77bd-933d-4027-9433-fff2578747a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:29.708089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e77bd-933d-4027-9433-fff2578747a2 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:29.709329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e77bd-933d-4027-9433-fff2578747a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:29.709848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e77bd-933d-4027-9433-fff2578747a2 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:29.710637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e77bd-933d-4027-9433-fff2578747a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:29.712761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e77bd-933d-4027-9433-fff2578747a2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:29.724665 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1527/3087] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:51:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:29.724665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9aa52-77bf-446a-b353-cae5db67ef95 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:29.724665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f0a9aa52-77bf-446a-b353-cae5db67ef95 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:29.750224 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1561/3088] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:29 2021] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:29.751201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e77bd-933d-4027-9433-fff2578747a2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:29.752911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-946e77bd-933d-4027-9433-fff2578747a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:29.824924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9aa52-77bf-446a-b353-cae5db67ef95 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:29.830173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778b212-5487-401c-b155-605d71f60dee tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:29.831173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778b212-5487-401c-b155-605d71f60dee tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:29.832473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778b212-5487-401c-b155-605d71f60dee tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:29.832847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778b212-5487-401c-b155-605d71f60dee tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/groups/a3cf60d80e654b30802a62e5af8af5f9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:29.834366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778b212-5487-401c-b155-605d71f60dee tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a3cf60d80e654b30802a62e5af8af5f9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:29.835500 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-e778b212-5487-401c-b155-605d71f60dee tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:29.835500 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:51:29.835500 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:51:29.836931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778b212-5487-401c-b155-605d71f60dee tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:29.841004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e77bd-933d-4027-9433-fff2578747a2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:29.847314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236644c-f2cf-41a3-9654-d7467c1f3e9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:29.847985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236644c-f2cf-41a3-9654-d7467c1f3e9e service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:29.848275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236644c-f2cf-41a3-9654-d7467c1f3e9e service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:29.848560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236644c-f2cf-41a3-9654-d7467c1f3e9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:29.850576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2236644c-f2cf-41a3-9654-d7467c1f3e9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:29.862790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236644c-f2cf-41a3-9654-d7467c1f3e9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:29.864444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236644c-f2cf-41a3-9654-d7467c1f3e9e service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:29.878884 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1562/3089] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:29 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:51:29.880042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236644c-f2cf-41a3-9654-d7467c1f3e9e service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:29.906109 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1528/3090] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 20:51:29 2021] DELETE /identity/v3/groups/a3cf60d80e654b30802a62e5af8af5f9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:29.907723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4222e-5295-43a2-a41e-78445c473a90 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:29.908024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4222e-5295-43a2-a41e-78445c473a90 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:29.908312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4222e-5295-43a2-a41e-78445c473a90 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:29.910322 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1529/3091] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:51:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:51:29.910870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4222e-5295-43a2-a41e-78445c473a90 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:29.915122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236644c-f2cf-41a3-9654-d7467c1f3e9e service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:29.982693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd302e2-5412-4a1a-9134-860a45842135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:29.983670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd302e2-5412-4a1a-9134-860a45842135 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:29.983957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd302e2-5412-4a1a-9134-860a45842135 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:29.984244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd302e2-5412-4a1a-9134-860a45842135 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:29.985002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd302e2-5412-4a1a-9134-860a45842135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:29.986797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd302e2-5412-4a1a-9134-860a45842135 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:30.001588 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1563/3092] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:29 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:30.001588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd302e2-5412-4a1a-9134-860a45842135 admin admin] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:51:30.009253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4222e-5295-43a2-a41e-78445c473a90 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:30.015869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198c232-a232-4018-b45a-6e1d262e3e36 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:30.016989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198c232-a232-4018-b45a-6e1d262e3e36 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:30.017353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198c232-a232-4018-b45a-6e1d262e3e36 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:30.017691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198c232-a232-4018-b45a-6e1d262e3e36 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/projects/ef3f3e6b51c84f0aaa26e28b9330a39e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:30.019298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198c232-a232-4018-b45a-6e1d262e3e36 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ef3f3e6b51c84f0aaa26e28b9330a39e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:30.021447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198c232-a232-4018-b45a-6e1d262e3e36 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:30.079086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd302e2-5412-4a1a-9134-860a45842135 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:30.079888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4198c232-a232-4018-b45a-6e1d262e3e36 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef3f3e6b51c84f0aaa26e28b9330a39e', 'request_id': 'req-4198c232-a232-4018-b45a-6e1d262e3e36'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.090244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4198c232-a232-4018-b45a-6e1d262e3e36 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef3f3e6b51c84f0aaa26e28b9330a39e', 'request_id': 'req-4198c232-a232-4018-b45a-6e1d262e3e36'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.096171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4198c232-a232-4018-b45a-6e1d262e3e36 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef3f3e6b51c84f0aaa26e28b9330a39e', 'request_id': 'req-4198c232-a232-4018-b45a-6e1d262e3e36'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.111440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4198c232-a232-4018-b45a-6e1d262e3e36 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] The token cache is being invalidate because project ef3f3e6b51c84f0aaa26e28b9330a39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:30.111736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4198c232-a232-4018-b45a-6e1d262e3e36 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.112375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4198c232-a232-4018-b45a-6e1d262e3e36 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.114206 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1530/3093] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:29 2021] DELETE /identity/v3/projects/ef3f3e6b51c84f0aaa26e28b9330a39e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:30.117747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198c232-a232-4018-b45a-6e1d262e3e36 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:30.119183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4198c232-a232-4018-b45a-6e1d262e3e36 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:30.147297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd302e2-5412-4a1a-9134-860a45842135 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:30.191324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198c232-a232-4018-b45a-6e1d262e3e36 tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:30.200213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3371ed-7562-4dac-a962-1facd5a27cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:30.201105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3371ed-7562-4dac-a962-1facd5a27cda admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:30.201387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3371ed-7562-4dac-a962-1facd5a27cda admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:30.201661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3371ed-7562-4dac-a962-1facd5a27cda admin admin] PATH_INFO: `/v3/projects/cc853b43346c4b80a888930d782d7bbc/users/2f2372afe520416386d5e961633ba6dc/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:30.208504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ab36c-6ba6-41b5-931a-c7313c6db0a6 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b992eb80024f5ab8ff581d9f39b465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f145ee84f2f04ba6a0a2415cf3d45502', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:30.209368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ab36c-6ba6-41b5-931a-c7313c6db0a6 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:30.209657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ab36c-6ba6-41b5-931a-c7313c6db0a6 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:30.209938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ab36c-6ba6-41b5-931a-c7313c6db0a6 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] PATH_INFO: `/v3/projects/990335d293cf442680060ab40558015c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:30.211315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ab36c-6ba6-41b5-931a-c7313c6db0a6 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorizing `identity:get_project(project_id=990335d293cf442680060ab40558015c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:30.213348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ab36c-6ba6-41b5-931a-c7313c6db0a6 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:30.215168 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1564/3094] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:51:29 2021] GET /identity/v3/projects/990335d293cf442680060ab40558015c => generated 371 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:30.215920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ab36c-6ba6-41b5-931a-c7313c6db0a6 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:30.216883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3371ed-7562-4dac-a962-1facd5a27cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc853b43346c4b80a888930d782d7bbc, user_id=2f2372afe520416386d5e961633ba6dc, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:30.217813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e82ab36c-6ba6-41b5-931a-c7313c6db0a6 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:30.219717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3371ed-7562-4dac-a962-1facd5a27cda admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:30.238339 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1531/3095] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:30 2021] PUT /identity/v3/projects/cc853b43346c4b80a888930d782d7bbc/users/2f2372afe520416386d5e961633ba6dc/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:30.238984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3371ed-7562-4dac-a962-1facd5a27cda admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:30.295940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ab36c-6ba6-41b5-931a-c7313c6db0a6 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:30.354546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3371ed-7562-4dac-a962-1facd5a27cda admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:30.359561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220dcf6-279a-4aa8-90ca-74b7c63f000f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:30.359915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a3997-80a0-4c5a-bc32-9b6f8d0ac722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:30.360435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220dcf6-279a-4aa8-90ca-74b7c63f000f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:30.360684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a3997-80a0-4c5a-bc32-9b6f8d0ac722 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:30.360790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220dcf6-279a-4aa8-90ca-74b7c63f000f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:30.360976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a3997-80a0-4c5a-bc32-9b6f8d0ac722 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:30.361078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220dcf6-279a-4aa8-90ca-74b7c63f000f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/domains/01ea4e737bd740458321b918d365a9cc` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:30.361246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a3997-80a0-4c5a-bc32-9b6f8d0ac722 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:30.361977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a3997-80a0-4c5a-bc32-9b6f8d0ac722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:30.362417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220dcf6-279a-4aa8-90ca-74b7c63f000f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=01ea4e737bd740458321b918d365a9cc)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:30.363590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a3997-80a0-4c5a-bc32-9b6f8d0ac722 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:30.364359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220dcf6-279a-4aa8-90ca-74b7c63f000f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:30.375502 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1532/3096] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:30 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:30.377405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201265e-b434-4f40-9270-a105d9291588 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:30.377765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201265e-b434-4f40-9270-a105d9291588 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:30.378183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201265e-b434-4f40-9270-a105d9291588 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:30.380298 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1533/3097] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:51:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:51:30.381163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201265e-b434-4f40-9270-a105d9291588 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:30.391646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5220dcf6-279a-4aa8-90ca-74b7c63f000f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '01ea4e737bd740458321b918d365a9cc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.392318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5220dcf6-279a-4aa8-90ca-74b7c63f000f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '01ea4e737bd740458321b918d365a9cc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.395041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201265e-b434-4f40-9270-a105d9291588 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:30.420334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5220dcf6-279a-4aa8-90ca-74b7c63f000f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '01ea4e737bd740458321b918d365a9cc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.420988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5220dcf6-279a-4aa8-90ca-74b7c63f000f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '01ea4e737bd740458321b918d365a9cc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.423874 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1565/3098] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 20:51:30 2021] PATCH /identity/v3/domains/01ea4e737bd740458321b918d365a9cc => generated 277 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:30.425175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220dcf6-279a-4aa8-90ca-74b7c63f000f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:51:30.426840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5220dcf6-279a-4aa8-90ca-74b7c63f000f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:30.465833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafe2df-07ce-48e2-9ae8-d865c88aa838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:30.467059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafe2df-07ce-48e2-9ae8-d865c88aa838 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:30.467059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafe2df-07ce-48e2-9ae8-d865c88aa838 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:30.467314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafe2df-07ce-48e2-9ae8-d865c88aa838 admin admin] PATH_INFO: `/v3/projects/cc853b43346c4b80a888930d782d7bbc/users/2f2372afe520416386d5e961633ba6dc/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:30.469809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafe2df-07ce-48e2-9ae8-d865c88aa838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc853b43346c4b80a888930d782d7bbc, user_id=2f2372afe520416386d5e961633ba6dc, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:30.472616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafe2df-07ce-48e2-9ae8-d865c88aa838 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:30.484438 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1534/3099] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:30 2021] PUT /identity/v3/projects/cc853b43346c4b80a888930d782d7bbc/users/2f2372afe520416386d5e961633ba6dc/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:30.485391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafe2df-07ce-48e2-9ae8-d865c88aa838 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:30.492047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-daafe2df-07ce-48e2-9ae8-d865c88aa838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:30.508438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220dcf6-279a-4aa8-90ca-74b7c63f000f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:30.509780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5220dcf6-279a-4aa8-90ca-74b7c63f000f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:30.591033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220dcf6-279a-4aa8-90ca-74b7c63f000f tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:30.626009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafe2df-07ce-48e2-9ae8-d865c88aa838 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:30.636828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef14cd9-a88c-460d-b672-d12a08abf1cc tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4731907dcd1f4573a51ffda9ad7aed54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d5701f27bd942c0ba52d769b8193c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:30.638329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef14cd9-a88c-460d-b672-d12a08abf1cc tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:30.638644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef14cd9-a88c-460d-b672-d12a08abf1cc tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:30.639079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef14cd9-a88c-460d-b672-d12a08abf1cc tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] PATH_INFO: `/v3/domains/01ea4e737bd740458321b918d365a9cc` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:30.656098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef14cd9-a88c-460d-b672-d12a08abf1cc tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=01ea4e737bd740458321b918d365a9cc)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:30.659038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef14cd9-a88c-460d-b672-d12a08abf1cc tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:30.663911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72897cf4-f2e4-424e-adc6-402929194ab7 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b992eb80024f5ab8ff581d9f39b465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f145ee84f2f04ba6a0a2415cf3d45502', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:30.664836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72897cf4-f2e4-424e-adc6-402929194ab7 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:30.665220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72897cf4-f2e4-424e-adc6-402929194ab7 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:30.665598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72897cf4-f2e4-424e-adc6-402929194ab7 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] PATH_INFO: `/v3/projects/990335d293cf442680060ab40558015c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:30.667164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72897cf4-f2e4-424e-adc6-402929194ab7 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorizing `identity:get_project(project_id=990335d293cf442680060ab40558015c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:30.669886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72897cf4-f2e4-424e-adc6-402929194ab7 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:30.672250 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1566/3100] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:51:30 2021] GET /identity/v3/projects/990335d293cf442680060ab40558015c => generated 371 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:30.673423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8becc7b-9964-4d3a-93d3-b4e2edce3e12 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:30.673805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8becc7b-9964-4d3a-93d3-b4e2edce3e12 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:30.674196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8becc7b-9964-4d3a-93d3-b4e2edce3e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:30.720302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ef14cd9-a88c-460d-b672-d12a08abf1cc tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '01ea4e737bd740458321b918d365a9cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.725048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d8becc7b-9964-4d3a-93d3-b4e2edce3e12 None None] MFA Rules not processed for user `2f2372afe520416386d5e961633ba6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:30.726284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d8becc7b-9964-4d3a-93d3-b4e2edce3e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:30.729392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ef14cd9-a88c-460d-b672-d12a08abf1cc tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '01ea4e737bd740458321b918d365a9cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.818754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ef14cd9-a88c-460d-b672-d12a08abf1cc tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ea4e737bd740458321b918d365a9cc', 'request_id': 'req-9ef14cd9-a88c-460d-b672-d12a08abf1cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.827319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ef14cd9-a88c-460d-b672-d12a08abf1cc tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ea4e737bd740458321b918d365a9cc', 'request_id': 'req-9ef14cd9-a88c-460d-b672-d12a08abf1cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.835493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ef14cd9-a88c-460d-b672-d12a08abf1cc tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ea4e737bd740458321b918d365a9cc', 'request_id': 'req-9ef14cd9-a88c-460d-b672-d12a08abf1cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.843125 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1567/3101] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:30 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:30.844307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8becc7b-9964-4d3a-93d3-b4e2edce3e12 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:30.859293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ef14cd9-a88c-460d-b672-d12a08abf1cc tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] The token cache is being invalidate because project 01ea4e737bd740458321b918d365a9cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:30.859589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ef14cd9-a88c-460d-b672-d12a08abf1cc tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.860261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ef14cd9-a88c-460d-b672-d12a08abf1cc tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.864303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8becc7b-9964-4d3a-93d3-b4e2edce3e12 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:30.869318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ef14cd9-a88c-460d-b672-d12a08abf1cc tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '01ea4e737bd740458321b918d365a9cc', 'request_id': 'req-9ef14cd9-a88c-460d-b672-d12a08abf1cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.874166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ef14cd9-a88c-460d-b672-d12a08abf1cc tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '01ea4e737bd740458321b918d365a9cc', 'request_id': 'req-9ef14cd9-a88c-460d-b672-d12a08abf1cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.874398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ef14cd9-a88c-460d-b672-d12a08abf1cc tempest-InheritsV3TestJSON-1093174484 tempest-InheritsV3TestJSON-1093174484-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '01ea4e737bd740458321b918d365a9cc', 'request_id': 'req-9ef14cd9-a88c-460d-b672-d12a08abf1cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:30.883261 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1535/3102] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 20:51:30 2021] DELETE /identity/v3/domains/01ea4e737bd740458321b918d365a9cc => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:30.883261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961b4f6-871e-44dc-8cfc-ecb8f4f8268f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:30.883261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961b4f6-871e-44dc-8cfc-ecb8f4f8268f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:30.883261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961b4f6-871e-44dc-8cfc-ecb8f4f8268f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:30.905930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5961b4f6-871e-44dc-8cfc-ecb8f4f8268f None None] MFA Rules not processed for user `09d32c08216a4035907c888a3c8cd70f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:30.906908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5961b4f6-871e-44dc-8cfc-ecb8f4f8268f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:30.940288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a1cf7-fa20-4956-bc32-424dd9237a37 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b992eb80024f5ab8ff581d9f39b465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f145ee84f2f04ba6a0a2415cf3d45502', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:30.941521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a1cf7-fa20-4956-bc32-424dd9237a37 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:30.941969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a1cf7-fa20-4956-bc32-424dd9237a37 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:30.942886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a1cf7-fa20-4956-bc32-424dd9237a37 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:30.944043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a1cf7-fa20-4956-bc32-424dd9237a37 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:30.944563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a1cf7-fa20-4956-bc32-424dd9237a37 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:30.947955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a1cf7-fa20-4956-bc32-424dd9237a37 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:30.977277 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1536/3103] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:30 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:30.992163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961b4f6-871e-44dc-8cfc-ecb8f4f8268f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:30.993303 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1568/3104] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:51:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:30.994686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a1cf7-fa20-4956-bc32-424dd9237a37 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:30.996975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8c9a1cf7-fa20-4956-bc32-424dd9237a37 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:30.997115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5961b4f6-871e-44dc-8cfc-ecb8f4f8268f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:31.012254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a1cf7-fa20-4956-bc32-424dd9237a37 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:31.017498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48649586-7f72-47ba-b8d2-3d801a0cac46 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b992eb80024f5ab8ff581d9f39b465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f145ee84f2f04ba6a0a2415cf3d45502', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:31.018138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48649586-7f72-47ba-b8d2-3d801a0cac46 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:31.018461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48649586-7f72-47ba-b8d2-3d801a0cac46 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:31.018742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48649586-7f72-47ba-b8d2-3d801a0cac46 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:31.019465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48649586-7f72-47ba-b8d2-3d801a0cac46 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:31.021374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48649586-7f72-47ba-b8d2-3d801a0cac46 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:31.051070 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1569/3105] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:30 2021] POST /identity/v3/users => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:31.052082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48649586-7f72-47ba-b8d2-3d801a0cac46 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:31.068651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48649586-7f72-47ba-b8d2-3d801a0cac46 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:31.079953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7bb05-5f54-41d7-93b7-29d62adc47f9 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b992eb80024f5ab8ff581d9f39b465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f145ee84f2f04ba6a0a2415cf3d45502', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:31.080878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7bb05-5f54-41d7-93b7-29d62adc47f9 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:31.081172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7bb05-5f54-41d7-93b7-29d62adc47f9 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:31.081460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7bb05-5f54-41d7-93b7-29d62adc47f9 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:31.083082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7bb05-5f54-41d7-93b7-29d62adc47f9 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:31.083402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7bb05-5f54-41d7-93b7-29d62adc47f9 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:31.085064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7bb05-5f54-41d7-93b7-29d62adc47f9 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:31.103163 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1570/3106] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:51:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:31.103902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7bb05-5f54-41d7-93b7-29d62adc47f9 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:31.111764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b5a7bb05-5f54-41d7-93b7-29d62adc47f9 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:31.113152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961b4f6-871e-44dc-8cfc-ecb8f4f8268f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:31.120102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57308db2-fc47-42a5-9c9e-8fe430525ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:31.122120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57308db2-fc47-42a5-9c9e-8fe430525ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:31.122643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57308db2-fc47-42a5-9c9e-8fe430525ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:31.123402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57308db2-fc47-42a5-9c9e-8fe430525ffc admin admin] PATH_INFO: `/v3/users/bc4992fc60df4af5a776a234ff89199c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:31.125274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57308db2-fc47-42a5-9c9e-8fe430525ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc4992fc60df4af5a776a234ff89199c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:31.127571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57308db2-fc47-42a5-9c9e-8fe430525ffc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:31.182788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-57308db2-fc47-42a5-9c9e-8fe430525ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc4992fc60df4af5a776a234ff89199c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:31.191002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-57308db2-fc47-42a5-9c9e-8fe430525ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc4992fc60df4af5a776a234ff89199c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:31.203835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-57308db2-fc47-42a5-9c9e-8fe430525ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc4992fc60df4af5a776a234ff89199c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:31.204670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-57308db2-fc47-42a5-9c9e-8fe430525ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc4992fc60df4af5a776a234ff89199c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:31.205083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7bb05-5f54-41d7-93b7-29d62adc47f9 tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:31.213044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-57308db2-fc47-42a5-9c9e-8fe430525ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc4992fc60df4af5a776a234ff89199c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:31.214072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d1f43-4651-4485-a54a-03790012be1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:31.214775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d1f43-4651-4485-a54a-03790012be1a service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:31.215121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d1f43-4651-4485-a54a-03790012be1a service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:31.215843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d1f43-4651-4485-a54a-03790012be1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:31.217992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-327d1f43-4651-4485-a54a-03790012be1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:31.220468 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1537/3107] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:30 2021] DELETE /identity/v3/users/bc4992fc60df4af5a776a234ff89199c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:31.224964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea873ee-c8e9-4435-899e-cc67eea53dc3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:31.225404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea873ee-c8e9-4435-899e-cc67eea53dc3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:31.225587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea873ee-c8e9-4435-899e-cc67eea53dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:31.231702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d1f43-4651-4485-a54a-03790012be1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:31.233515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d1f43-4651-4485-a54a-03790012be1a service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:31.259722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-dea873ee-c8e9-4435-899e-cc67eea53dc3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:31.259900 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1571/3108] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:31 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:51:31.261540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-dea873ee-c8e9-4435-899e-cc67eea53dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:31.364200 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1538/3109] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:31.380383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d1f43-4651-4485-a54a-03790012be1a service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:31.382076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-327d1f43-4651-4485-a54a-03790012be1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:31.416009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f36f9-104b-46c5-acfe-5fab0d7886f7 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:31.416474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f36f9-104b-46c5-acfe-5fab0d7886f7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:31.417014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f36f9-104b-46c5-acfe-5fab0d7886f7 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:31.419721 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1539/3110] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:51:31 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:51:31.425169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f36f9-104b-46c5-acfe-5fab0d7886f7 None None] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:51:31.427497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7f7f36f9-104b-46c5-acfe-5fab0d7886f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:31.494400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d1f43-4651-4485-a54a-03790012be1a service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:31.533734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f36f9-104b-46c5-acfe-5fab0d7886f7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:31.535048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7f7f36f9-104b-46c5-acfe-5fab0d7886f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:31.550431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c745a-d75f-463e-af10-a11a4f9c55e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:31.551090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c745a-d75f-463e-af10-a11a4f9c55e1 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:31.551372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c745a-d75f-463e-af10-a11a4f9c55e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:31.551652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c745a-d75f-463e-af10-a11a4f9c55e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:31.562995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c745a-d75f-463e-af10-a11a4f9c55e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:31.564129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c745a-d75f-463e-af10-a11a4f9c55e1 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:31.574339 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1572/3111] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:51:31.603831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f36f9-104b-46c5-acfe-5fab0d7886f7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:31.609519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189979-a64c-48d1-b90c-3c957c478e4e tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b992eb80024f5ab8ff581d9f39b465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f145ee84f2f04ba6a0a2415cf3d45502', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:31.610518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189979-a64c-48d1-b90c-3c957c478e4e tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:31.610880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189979-a64c-48d1-b90c-3c957c478e4e tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:31.611238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189979-a64c-48d1-b90c-3c957c478e4e tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] PATH_INFO: `/v3/projects/990335d293cf442680060ab40558015c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:31.612601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48189979-a64c-48d1-b90c-3c957c478e4e tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorizing `identity:get_project(project_id=990335d293cf442680060ab40558015c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:31.614921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48189979-a64c-48d1-b90c-3c957c478e4e tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:31.616857 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1540/3112] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:51:31 2021] GET /identity/v3/projects/990335d293cf442680060ab40558015c => generated 371 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:51:31.948252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffba95-27f9-47fb-860c-1474ebbfb4c9 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:31.948569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffba95-27f9-47fb-860c-1474ebbfb4c9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:31.948824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffba95-27f9-47fb-860c-1474ebbfb4c9 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:31.951710 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1573/3113] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:51:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:51:31.960492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189979-a64c-48d1-b90c-3c957c478e4e tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:51:31.983237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffba95-27f9-47fb-860c-1474ebbfb4c9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:31.985438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-66ffba95-27f9-47fb-860c-1474ebbfb4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:31.985700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189979-a64c-48d1-b90c-3c957c478e4e tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:32.003317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffba95-27f9-47fb-860c-1474ebbfb4c9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:32.007598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189979-a64c-48d1-b90c-3c957c478e4e tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:32.008750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f04ba-0622-4fa9-8f0e-f97e6410045f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:32.009674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f04ba-0622-4fa9-8f0e-f97e6410045f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:32.010022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f04ba-0622-4fa9-8f0e-f97e6410045f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:32.010419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f04ba-0622-4fa9-8f0e-f97e6410045f admin admin] PATH_INFO: `/v3/projects/8d711e53609d424c9efffc944bbbb15b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:32.012533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f04ba-0622-4fa9-8f0e-f97e6410045f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d711e53609d424c9efffc944bbbb15b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:32.016070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f04ba-0622-4fa9-8f0e-f97e6410045f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:32.018614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77fe32-53f9-4983-b667-22a169e6d35a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b992eb80024f5ab8ff581d9f39b465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f145ee84f2f04ba6a0a2415cf3d45502', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:32.020069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77fe32-53f9-4983-b667-22a169e6d35a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:32.020520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77fe32-53f9-4983-b667-22a169e6d35a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:32.021195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77fe32-53f9-4983-b667-22a169e6d35a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] PATH_INFO: `/v3/projects/990335d293cf442680060ab40558015c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:32.023445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77fe32-53f9-4983-b667-22a169e6d35a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorizing `identity:get_project(project_id=990335d293cf442680060ab40558015c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:32.026478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77fe32-53f9-4983-b667-22a169e6d35a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:32.030949 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1541/3114] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:51:31 2021] GET /identity/v3/projects/990335d293cf442680060ab40558015c => generated 371 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:32.083946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77fe32-53f9-4983-b667-22a169e6d35a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:32.087047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-798f04ba-0622-4fa9-8f0e-f97e6410045f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d711e53609d424c9efffc944bbbb15b', 'request_id': 'req-798f04ba-0622-4fa9-8f0e-f97e6410045f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.095159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-798f04ba-0622-4fa9-8f0e-f97e6410045f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d711e53609d424c9efffc944bbbb15b', 'request_id': 'req-798f04ba-0622-4fa9-8f0e-f97e6410045f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.104222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77fe32-53f9-4983-b667-22a169e6d35a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:32.109217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-798f04ba-0622-4fa9-8f0e-f97e6410045f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d711e53609d424c9efffc944bbbb15b', 'request_id': 'req-798f04ba-0622-4fa9-8f0e-f97e6410045f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.136410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-798f04ba-0622-4fa9-8f0e-f97e6410045f admin admin] The token cache is being invalidate because project 8d711e53609d424c9efffc944bbbb15b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:32.137662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-798f04ba-0622-4fa9-8f0e-f97e6410045f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.138670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-798f04ba-0622-4fa9-8f0e-f97e6410045f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.140976 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1574/3115] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:31 2021] DELETE /identity/v3/projects/8d711e53609d424c9efffc944bbbb15b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:32.146147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f04ba-0622-4fa9-8f0e-f97e6410045f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:32.147740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-798f04ba-0622-4fa9-8f0e-f97e6410045f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:32.194186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad574444-9e75-48ab-81fd-d45f225377cf tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b992eb80024f5ab8ff581d9f39b465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f145ee84f2f04ba6a0a2415cf3d45502', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:32.195248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad574444-9e75-48ab-81fd-d45f225377cf tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:32.195554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad574444-9e75-48ab-81fd-d45f225377cf tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:32.195909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad574444-9e75-48ab-81fd-d45f225377cf tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] PATH_INFO: `/v3/users/efcce724748d44089fd96d2e8f669512` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:32.224958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad574444-9e75-48ab-81fd-d45f225377cf tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorizing `identity:delete_user(user_id=efcce724748d44089fd96d2e8f669512)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:32.228033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad574444-9e75-48ab-81fd-d45f225377cf tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:32.230486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f04ba-0622-4fa9-8f0e-f97e6410045f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:32.235936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78018b9-585d-4bb8-a3a7-318770392367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:32.237558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78018b9-585d-4bb8-a3a7-318770392367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:32.237558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78018b9-585d-4bb8-a3a7-318770392367 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:32.237558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78018b9-585d-4bb8-a3a7-318770392367 admin admin] PATH_INFO: `/v3/users/4731907dcd1f4573a51ffda9ad7aed54` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:32.239016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78018b9-585d-4bb8-a3a7-318770392367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4731907dcd1f4573a51ffda9ad7aed54)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:32.241174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78018b9-585d-4bb8-a3a7-318770392367 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:32.298634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ad574444-9e75-48ab-81fd-d45f225377cf tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efcce724748d44089fd96d2e8f669512'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.315269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f78018b9-585d-4bb8-a3a7-318770392367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4731907dcd1f4573a51ffda9ad7aed54'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.324904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f78018b9-585d-4bb8-a3a7-318770392367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4731907dcd1f4573a51ffda9ad7aed54'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.325557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f78018b9-585d-4bb8-a3a7-318770392367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4731907dcd1f4573a51ffda9ad7aed54'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.336963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ad574444-9e75-48ab-81fd-d45f225377cf tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efcce724748d44089fd96d2e8f669512'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.338970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f78018b9-585d-4bb8-a3a7-318770392367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4731907dcd1f4573a51ffda9ad7aed54'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.349674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f78018b9-585d-4bb8-a3a7-318770392367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4731907dcd1f4573a51ffda9ad7aed54'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.368738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ad574444-9e75-48ab-81fd-d45f225377cf tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efcce724748d44089fd96d2e8f669512'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.369657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ad574444-9e75-48ab-81fd-d45f225377cf tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efcce724748d44089fd96d2e8f669512'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.369842 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1575/3116] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:32 2021] DELETE /identity/v3/users/4731907dcd1f4573a51ffda9ad7aed54 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:32.385043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ad574444-9e75-48ab-81fd-d45f225377cf tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efcce724748d44089fd96d2e8f669512'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.395432 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1542/3117] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:32 2021] DELETE /identity/v3/users/efcce724748d44089fd96d2e8f669512 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:32.399871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78018b9-585d-4bb8-a3a7-318770392367 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:32.401372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f78018b9-585d-4bb8-a3a7-318770392367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:32.489078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78018b9-585d-4bb8-a3a7-318770392367 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:32.555106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b992eb80024f5ab8ff581d9f39b465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f145ee84f2f04ba6a0a2415cf3d45502', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:32.556060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:32.556421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:32.556811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] PATH_INFO: `/v3/projects/990335d293cf442680060ab40558015c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:32.558185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorizing `identity:delete_project(project_id=990335d293cf442680060ab40558015c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:32.561360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:32.620705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990335d293cf442680060ab40558015c', 'request_id': 'req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.628939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990335d293cf442680060ab40558015c', 'request_id': 'req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.637230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990335d293cf442680060ab40558015c', 'request_id': 'req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.647397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] The token cache is being invalidate because project 990335d293cf442680060ab40558015c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:32.647686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.648339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.650102 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1576/3118] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:32 2021] DELETE /identity/v3/projects/990335d293cf442680060ab40558015c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:32.655665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad574444-9e75-48ab-81fd-d45f225377cf tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:32.657102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ad574444-9e75-48ab-81fd-d45f225377cf tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:32.700430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:32.701929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:32.744389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad574444-9e75-48ab-81fd-d45f225377cf tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:32.772453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d450ae7-9b5b-4fea-b3d3-ceadceaa8a7a tempest-QuotasAdminTestV236-1816938813 tempest-QuotasAdminTestV236-1816938813-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:32.777156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c989c-ae88-4c3e-8d56-847d75cac3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:32.778037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c989c-ae88-4c3e-8d56-847d75cac3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:32.778356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c989c-ae88-4c3e-8d56-847d75cac3df admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:32.778639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c989c-ae88-4c3e-8d56-847d75cac3df admin admin] PATH_INFO: `/v3/projects/8d5701f27bd942c0ba52d769b8193c4c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:32.779857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c989c-ae88-4c3e-8d56-847d75cac3df admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d5701f27bd942c0ba52d769b8193c4c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:32.781764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c989c-ae88-4c3e-8d56-847d75cac3df admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:32.800526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2ed45-0d0f-46dc-bd46-84dfc3c329a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:32.801328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2ed45-0d0f-46dc-bd46-84dfc3c329a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:32.801707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2ed45-0d0f-46dc-bd46-84dfc3c329a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:32.801990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2ed45-0d0f-46dc-bd46-84dfc3c329a0 admin admin] PATH_INFO: `/v3/users/cbcc1bab9ea04489a5d1d0ed7cf32fd9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:32.803270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2ed45-0d0f-46dc-bd46-84dfc3c329a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbcc1bab9ea04489a5d1d0ed7cf32fd9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:32.805217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2ed45-0d0f-46dc-bd46-84dfc3c329a0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:32.829028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c52c989c-ae88-4c3e-8d56-847d75cac3df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d5701f27bd942c0ba52d769b8193c4c', 'request_id': 'req-c52c989c-ae88-4c3e-8d56-847d75cac3df'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.836261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c52c989c-ae88-4c3e-8d56-847d75cac3df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d5701f27bd942c0ba52d769b8193c4c', 'request_id': 'req-c52c989c-ae88-4c3e-8d56-847d75cac3df'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.843501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c52c989c-ae88-4c3e-8d56-847d75cac3df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d5701f27bd942c0ba52d769b8193c4c', 'request_id': 'req-c52c989c-ae88-4c3e-8d56-847d75cac3df'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.851011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f7b2ed45-0d0f-46dc-bd46-84dfc3c329a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbcc1bab9ea04489a5d1d0ed7cf32fd9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.854159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c52c989c-ae88-4c3e-8d56-847d75cac3df admin admin] The token cache is being invalidate because project 8d5701f27bd942c0ba52d769b8193c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:32.854494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c52c989c-ae88-4c3e-8d56-847d75cac3df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.856152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c52c989c-ae88-4c3e-8d56-847d75cac3df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.858068 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1577/3119] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:32 2021] DELETE /identity/v3/projects/8d5701f27bd942c0ba52d769b8193c4c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:32.859406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f7b2ed45-0d0f-46dc-bd46-84dfc3c329a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbcc1bab9ea04489a5d1d0ed7cf32fd9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.863230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a2f3-6de3-4c29-832a-4decb489c80a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:32.863515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a2f3-6de3-4c29-832a-4decb489c80a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:32.863795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a2f3-6de3-4c29-832a-4decb489c80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:32.871097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f7b2ed45-0d0f-46dc-bd46-84dfc3c329a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbcc1bab9ea04489a5d1d0ed7cf32fd9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.872260 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f7b2ed45-0d0f-46dc-bd46-84dfc3c329a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbcc1bab9ea04489a5d1d0ed7cf32fd9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.879593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f7b2ed45-0d0f-46dc-bd46-84dfc3c329a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbcc1bab9ea04489a5d1d0ed7cf32fd9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:32.883971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0728a2f3-6de3-4c29-832a-4decb489c80a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:32.885205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0728a2f3-6de3-4c29-832a-4decb489c80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:32.888435 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1543/3120] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:32 2021] DELETE /identity/v3/users/cbcc1bab9ea04489a5d1d0ed7cf32fd9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:32.890559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd07b28-8af6-4279-90be-70d000675f51 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:32.890902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd07b28-8af6-4279-90be-70d000675f51 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:32.891284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd07b28-8af6-4279-90be-70d000675f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:32.910572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fcd07b28-8af6-4279-90be-70d000675f51 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:32.911815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fcd07b28-8af6-4279-90be-70d000675f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:32.962157 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1578/3121] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:32.971700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36b6c6-c380-4308-bd45-b2516cf47abe None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:32.974823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36b6c6-c380-4308-bd45-b2516cf47abe None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:32.975334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36b6c6-c380-4308-bd45-b2516cf47abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:32.981550 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1544/3122] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:32.995195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd07b28-8af6-4279-90be-70d000675f51 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:32.996986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fcd07b28-8af6-4279-90be-70d000675f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:33.015213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1d36b6c6-c380-4308-bd45-b2516cf47abe None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:33.016439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1d36b6c6-c380-4308-bd45-b2516cf47abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:33.029191 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1579/3123] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:33.034649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36b6c6-c380-4308-bd45-b2516cf47abe None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:33.047901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36b6c6-c380-4308-bd45-b2516cf47abe None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:33.056244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734908e-770c-4e98-bdbe-b3e7b9984f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:33.056933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734908e-770c-4e98-bdbe-b3e7b9984f2a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:33.057276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734908e-770c-4e98-bdbe-b3e7b9984f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:33.057712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734908e-770c-4e98-bdbe-b3e7b9984f2a admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:33.058890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734908e-770c-4e98-bdbe-b3e7b9984f2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:33.059207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734908e-770c-4e98-bdbe-b3e7b9984f2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:33.061138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734908e-770c-4e98-bdbe-b3e7b9984f2a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:33.079272 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1580/3124] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:51:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:33.080160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734908e-770c-4e98-bdbe-b3e7b9984f2a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:33.092100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734908e-770c-4e98-bdbe-b3e7b9984f2a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:33.097033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f92e3-f1d3-43a2-b33a-60127d0f79f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:33.097691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f92e3-f1d3-43a2-b33a-60127d0f79f1 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:33.097978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f92e3-f1d3-43a2-b33a-60127d0f79f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:33.098283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f92e3-f1d3-43a2-b33a-60127d0f79f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:33.099224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f92e3-f1d3-43a2-b33a-60127d0f79f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:33.101253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f92e3-f1d3-43a2-b33a-60127d0f79f1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:33.116117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd07b28-8af6-4279-90be-70d000675f51 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:33.125025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e40d55-4849-49db-8b9d-0dea6ef711fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:33.126281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e40d55-4849-49db-8b9d-0dea6ef711fc service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:33.127163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e40d55-4849-49db-8b9d-0dea6ef711fc service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:33.127457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e40d55-4849-49db-8b9d-0dea6ef711fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:33.138715 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1581/3125] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:33 2021] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:33.138973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e40d55-4849-49db-8b9d-0dea6ef711fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:33.140903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e40d55-4849-49db-8b9d-0dea6ef711fc service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:33.143165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f92e3-f1d3-43a2-b33a-60127d0f79f1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:33.156673 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1545/3126] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:51:33.239442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f92e3-f1d3-43a2-b33a-60127d0f79f1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:33.245302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab355e-4b43-49e7-b189-0bafbb811383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:33.246007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab355e-4b43-49e7-b189-0bafbb811383 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:33.246418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab355e-4b43-49e7-b189-0bafbb811383 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:33.246606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab355e-4b43-49e7-b189-0bafbb811383 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:33.247351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab355e-4b43-49e7-b189-0bafbb811383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:33.249371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab355e-4b43-49e7-b189-0bafbb811383 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:33.268956 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1582/3127] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:33 2021] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:33.273121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e40d55-4849-49db-8b9d-0dea6ef711fc service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:33.284653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e40d55-4849-49db-8b9d-0dea6ef711fc service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:33.295029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063a641-9bc7-4aeb-a6b2-bcaad0233472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:33.295707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063a641-9bc7-4aeb-a6b2-bcaad0233472 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:33.296028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063a641-9bc7-4aeb-a6b2-bcaad0233472 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:33.296288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063a641-9bc7-4aeb-a6b2-bcaad0233472 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:33.297061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063a641-9bc7-4aeb-a6b2-bcaad0233472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:33.298967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063a641-9bc7-4aeb-a6b2-bcaad0233472 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:33.309443 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1546/3128] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:33 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:33.313769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab355e-4b43-49e7-b189-0bafbb811383 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:33.324010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab355e-4b43-49e7-b189-0bafbb811383 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:33.329654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239c8c0-7f81-4832-9562-d67e675f42e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:33.330724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239c8c0-7f81-4832-9562-d67e675f42e8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:33.331106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239c8c0-7f81-4832-9562-d67e675f42e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:33.331593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239c8c0-7f81-4832-9562-d67e675f42e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:33.332411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239c8c0-7f81-4832-9562-d67e675f42e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:33.334076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239c8c0-7f81-4832-9562-d67e675f42e8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:33.368865 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1583/3129] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:33 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:33.373219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063a641-9bc7-4aeb-a6b2-bcaad0233472 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:33.393189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063a641-9bc7-4aeb-a6b2-bcaad0233472 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:33.405422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46ac77-374c-4651-9324-ba3b51e1df01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:33.408608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46ac77-374c-4651-9324-ba3b51e1df01 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:33.409077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46ac77-374c-4651-9324-ba3b51e1df01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:33.409697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46ac77-374c-4651-9324-ba3b51e1df01 admin admin] PATH_INFO: `/v3/projects/8edf6f46090c4778a09bc28a3ad42378/users/18deade944ac44049c4de5470925b65b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:33.429889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46ac77-374c-4651-9324-ba3b51e1df01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8edf6f46090c4778a09bc28a3ad42378, user_id=18deade944ac44049c4de5470925b65b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:33.433091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46ac77-374c-4651-9324-ba3b51e1df01 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:33.455223 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1547/3130] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:33 2021] PUT /identity/v3/projects/8edf6f46090c4778a09bc28a3ad42378/users/18deade944ac44049c4de5470925b65b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:51:33.466065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeedea7-8057-4f9e-b762-5b2c6634c0a6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:33.466406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeedea7-8057-4f9e-b762-5b2c6634c0a6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:33.466653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeedea7-8057-4f9e-b762-5b2c6634c0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:33.500483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bdeedea7-8057-4f9e-b762-5b2c6634c0a6 None None] MFA Rules not processed for user `18deade944ac44049c4de5470925b65b`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:33.503150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bdeedea7-8057-4f9e-b762-5b2c6634c0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:33.593795 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1584/3131] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:33 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:33.601425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46ac77-374c-4651-9324-ba3b51e1df01 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:33.678164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46ac77-374c-4651-9324-ba3b51e1df01 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:33.683315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63652f4d-2abc-4500-aff2-ea5fa7b7b529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:33.683937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63652f4d-2abc-4500-aff2-ea5fa7b7b529 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:33.684872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63652f4d-2abc-4500-aff2-ea5fa7b7b529 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:33.684872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63652f4d-2abc-4500-aff2-ea5fa7b7b529 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:33.685513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63652f4d-2abc-4500-aff2-ea5fa7b7b529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:33.687529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63652f4d-2abc-4500-aff2-ea5fa7b7b529 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:33.755153 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1548/3132] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:33 2021] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:33.757038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeedea7-8057-4f9e-b762-5b2c6634c0a6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:33.775466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeedea7-8057-4f9e-b762-5b2c6634c0a6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:33.917214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826a644-b766-49d4-8e52-46cafadde467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:33.931217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826a644-b766-49d4-8e52-46cafadde467 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:33.931744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826a644-b766-49d4-8e52-46cafadde467 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:33.932069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826a644-b766-49d4-8e52-46cafadde467 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:33.933025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826a644-b766-49d4-8e52-46cafadde467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:33.941641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826a644-b766-49d4-8e52-46cafadde467 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:33.975796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63652f4d-2abc-4500-aff2-ea5fa7b7b529 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:33.977850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-63652f4d-2abc-4500-aff2-ea5fa7b7b529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:33.981597 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1585/3133] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:33 2021] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:33.987400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826a644-b766-49d4-8e52-46cafadde467 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:34.002936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63652f4d-2abc-4500-aff2-ea5fa7b7b529 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:34.008288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de165c1-cd10-46ec-86b0-68aa8d44f276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:34.009268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de165c1-cd10-46ec-86b0-68aa8d44f276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:34.009670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de165c1-cd10-46ec-86b0-68aa8d44f276 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:34.010022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de165c1-cd10-46ec-86b0-68aa8d44f276 admin admin] PATH_INFO: `/v3/projects/47afd4144d59401db03d83c3501ca32e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:34.011357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de165c1-cd10-46ec-86b0-68aa8d44f276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47afd4144d59401db03d83c3501ca32e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:34.011744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826a644-b766-49d4-8e52-46cafadde467 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:34.015221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de165c1-cd10-46ec-86b0-68aa8d44f276 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:34.028602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee0db0-c19f-40fe-aa58-ebcd61f42d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:34.030530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee0db0-c19f-40fe-aa58-ebcd61f42d83 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:34.030945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee0db0-c19f-40fe-aa58-ebcd61f42d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:34.031358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee0db0-c19f-40fe-aa58-ebcd61f42d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:34.032207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee0db0-c19f-40fe-aa58-ebcd61f42d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:34.034379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee0db0-c19f-40fe-aa58-ebcd61f42d83 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:34.058006 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1586/3134] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:33 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:51:34.063169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee0db0-c19f-40fe-aa58-ebcd61f42d83 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:34.077009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee0db0-c19f-40fe-aa58-ebcd61f42d83 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:34.080936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4de165c1-cd10-46ec-86b0-68aa8d44f276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47afd4144d59401db03d83c3501ca32e', 'request_id': 'req-4de165c1-cd10-46ec-86b0-68aa8d44f276'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:34.093269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4de165c1-cd10-46ec-86b0-68aa8d44f276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47afd4144d59401db03d83c3501ca32e', 'request_id': 'req-4de165c1-cd10-46ec-86b0-68aa8d44f276'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:34.106635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4de165c1-cd10-46ec-86b0-68aa8d44f276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47afd4144d59401db03d83c3501ca32e', 'request_id': 'req-4de165c1-cd10-46ec-86b0-68aa8d44f276'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:34.124055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4de165c1-cd10-46ec-86b0-68aa8d44f276 admin admin] The token cache is being invalidate because project 47afd4144d59401db03d83c3501ca32e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:34.124850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4de165c1-cd10-46ec-86b0-68aa8d44f276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:34.125719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4de165c1-cd10-46ec-86b0-68aa8d44f276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:34.128939 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1549/3135] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:33 2021] DELETE /identity/v3/projects/47afd4144d59401db03d83c3501ca32e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:51:34.133174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de165c1-cd10-46ec-86b0-68aa8d44f276 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:34.135034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4de165c1-cd10-46ec-86b0-68aa8d44f276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:34.199324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e4303-155e-4d69-a374-adb6aebb7d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:34.200228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e4303-155e-4d69-a374-adb6aebb7d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:34.200521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e4303-155e-4d69-a374-adb6aebb7d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:34.200810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e4303-155e-4d69-a374-adb6aebb7d3b admin admin] PATH_INFO: `/v3/projects/13944d83b834485a8d459cbd11056352/users/ad32749a92524924a7b66b850da0c6af/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:34.234167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e4303-155e-4d69-a374-adb6aebb7d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=13944d83b834485a8d459cbd11056352, user_id=ad32749a92524924a7b66b850da0c6af, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:34.237441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e4303-155e-4d69-a374-adb6aebb7d3b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:34.261351 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1587/3136] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:34 2021] PUT /identity/v3/projects/13944d83b834485a8d459cbd11056352/users/ad32749a92524924a7b66b850da0c6af/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:34.265589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e4303-155e-4d69-a374-adb6aebb7d3b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:34.272043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7f2e4303-155e-4d69-a374-adb6aebb7d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:34.316403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de165c1-cd10-46ec-86b0-68aa8d44f276 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:34.425756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e4303-155e-4d69-a374-adb6aebb7d3b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:34.432839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f89ff-ace6-435d-b8da-52438267fcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:34.435109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f89ff-ace6-435d-b8da-52438267fcd4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:34.435579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f89ff-ace6-435d-b8da-52438267fcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:34.436016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f89ff-ace6-435d-b8da-52438267fcd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:34.436943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f89ff-ace6-435d-b8da-52438267fcd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:34.453785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f89ff-ace6-435d-b8da-52438267fcd4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:34.474548 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1588/3137] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:34 2021] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:34.480207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f89ff-ace6-435d-b8da-52438267fcd4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:34.495985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1541ca-4aab-4766-84bc-f46eaae54dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:34.496933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1541ca-4aab-4766-84bc-f46eaae54dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:34.497327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1541ca-4aab-4766-84bc-f46eaae54dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:34.497503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1541ca-4aab-4766-84bc-f46eaae54dc5 admin admin] PATH_INFO: `/v3/users/26b992eb80024f5ab8ff581d9f39b465` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:34.504502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1541ca-4aab-4766-84bc-f46eaae54dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26b992eb80024f5ab8ff581d9f39b465)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:34.508675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1541ca-4aab-4766-84bc-f46eaae54dc5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:34.515274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f89ff-ace6-435d-b8da-52438267fcd4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:34.526115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e2f12-7e92-46fe-a429-5c72d053a8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:34.527145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e2f12-7e92-46fe-a429-5c72d053a8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:34.528319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e2f12-7e92-46fe-a429-5c72d053a8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:34.528608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e2f12-7e92-46fe-a429-5c72d053a8e0 admin admin] PATH_INFO: `/v3/projects/13944d83b834485a8d459cbd11056352/users/ad32749a92524924a7b66b850da0c6af/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:34.531369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e2f12-7e92-46fe-a429-5c72d053a8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13944d83b834485a8d459cbd11056352, user_id=ad32749a92524924a7b66b850da0c6af, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:34.534809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e2f12-7e92-46fe-a429-5c72d053a8e0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:34.548238 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1589/3138] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:34 2021] PUT /identity/v3/projects/13944d83b834485a8d459cbd11056352/users/ad32749a92524924a7b66b850da0c6af/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:51:34.560733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cc578-83fd-4715-a525-3e9d7a50075d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:34.561679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cc578-83fd-4715-a525-3e9d7a50075d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:34.562320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cc578-83fd-4715-a525-3e9d7a50075d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:34.606176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7c1541ca-4aab-4766-84bc-f46eaae54dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26b992eb80024f5ab8ff581d9f39b465'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:34.610610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1b2cc578-83fd-4715-a525-3e9d7a50075d None None] MFA Rules not processed for user `ad32749a92524924a7b66b850da0c6af`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:34.612534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1b2cc578-83fd-4715-a525-3e9d7a50075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:34.616838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7c1541ca-4aab-4766-84bc-f46eaae54dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26b992eb80024f5ab8ff581d9f39b465'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:34.634830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7c1541ca-4aab-4766-84bc-f46eaae54dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26b992eb80024f5ab8ff581d9f39b465'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:34.635627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7c1541ca-4aab-4766-84bc-f46eaae54dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26b992eb80024f5ab8ff581d9f39b465'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:34.648370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7c1541ca-4aab-4766-84bc-f46eaae54dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26b992eb80024f5ab8ff581d9f39b465'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:34.664711 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1550/3139] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:34 2021] DELETE /identity/v3/users/26b992eb80024f5ab8ff581d9f39b465 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:34.709703 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1590/3140] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:34 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:34.713965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1541ca-4aab-4766-84bc-f46eaae54dc5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:34.876380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1541ca-4aab-4766-84bc-f46eaae54dc5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:34.883652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684b1f8-8fce-493c-8821-3a2242663545 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad32749a92524924a7b66b850da0c6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13944d83b834485a8d459cbd11056352', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:34.884656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b1f8-8fce-493c-8821-3a2242663545 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:34.885115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b1f8-8fce-493c-8821-3a2242663545 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:34.885494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b1f8-8fce-493c-8821-3a2242663545 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:34.893531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684b1f8-8fce-493c-8821-3a2242663545 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:34.893531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684b1f8-8fce-493c-8821-3a2242663545 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:34.936563 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1551/3141] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:34 2021] POST /identity/v3/projects => generated 333 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:34.936771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cc578-83fd-4715-a525-3e9d7a50075d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:34.949716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cc578-83fd-4715-a525-3e9d7a50075d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:35.083073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cea19d-31d4-4977-8142-8b11ded166de tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad32749a92524924a7b66b850da0c6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13944d83b834485a8d459cbd11056352', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:35.083777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cea19d-31d4-4977-8142-8b11ded166de tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:35.084071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cea19d-31d4-4977-8142-8b11ded166de tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:35.084360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cea19d-31d4-4977-8142-8b11ded166de tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:35.085076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cea19d-31d4-4977-8142-8b11ded166de tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:35.087191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cea19d-31d4-4977-8142-8b11ded166de tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:35.149819 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1591/3142] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 20:51:34 2021] POST /identity/v3/projects => generated 332 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:35.151648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684b1f8-8fce-493c-8821-3a2242663545 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:35.168684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684b1f8-8fce-493c-8821-3a2242663545 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:35.353514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bac3b-ccf3-410d-9ebb-2e42137deb21 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad32749a92524924a7b66b850da0c6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13944d83b834485a8d459cbd11056352', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:35.354478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bac3b-ccf3-410d-9ebb-2e42137deb21 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:35.355156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bac3b-ccf3-410d-9ebb-2e42137deb21 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:35.356237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bac3b-ccf3-410d-9ebb-2e42137deb21 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:35.356963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bac3b-ccf3-410d-9ebb-2e42137deb21 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:35.359476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bac3b-ccf3-410d-9ebb-2e42137deb21 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:35.423924 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1552/3143] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:35 2021] POST /identity/v3/projects => generated 357 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:35.428280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cea19d-31d4-4977-8142-8b11ded166de tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:35.450830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cea19d-31d4-4977-8142-8b11ded166de tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:35.579415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbc3c0-320f-473f-9153-d68c0d64e52e tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad32749a92524924a7b66b850da0c6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13944d83b834485a8d459cbd11056352', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:35.580106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbc3c0-320f-473f-9153-d68c0d64e52e tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:35.580400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbc3c0-320f-473f-9153-d68c0d64e52e tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:35.580682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbc3c0-320f-473f-9153-d68c0d64e52e tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:35.581961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbc3c0-320f-473f-9153-d68c0d64e52e tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:35.583864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbc3c0-320f-473f-9153-d68c0d64e52e tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:35.615451 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1592/3144] 10.222.0.13 () {58 vars in 1130 bytes} [Sat Dec 18 20:51:35 2021] GET /identity/v3/projects => generated 7979 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:35.620241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bac3b-ccf3-410d-9ebb-2e42137deb21 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:35.636099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bac3b-ccf3-410d-9ebb-2e42137deb21 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:35.651587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064079c-d5e9-4b94-bad6-16faa81e3f9c tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad32749a92524924a7b66b850da0c6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13944d83b834485a8d459cbd11056352', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:35.652875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064079c-d5e9-4b94-bad6-16faa81e3f9c tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:35.653252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064079c-d5e9-4b94-bad6-16faa81e3f9c tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:35.653751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064079c-d5e9-4b94-bad6-16faa81e3f9c tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:35.654729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064079c-d5e9-4b94-bad6-16faa81e3f9c tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:35.655055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064079c-d5e9-4b94-bad6-16faa81e3f9c tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:35.659569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064079c-d5e9-4b94-bad6-16faa81e3f9c tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:35.682451 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1553/3145] 10.222.0.13 () {58 vars in 1157 bytes} [Sat Dec 18 20:51:35 2021] GET /identity/v3/projects?enabled=False => generated 444 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:35.687619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbc3c0-320f-473f-9153-d68c0d64e52e tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:35.701288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbc3c0-320f-473f-9153-d68c0d64e52e tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:35.707545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064079c-d5e9-4b94-bad6-16faa81e3f9c tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:35.710214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2064079c-d5e9-4b94-bad6-16faa81e3f9c tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:35.715918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f2f9f-ca6a-4ad1-8f7b-325a5956672a tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad32749a92524924a7b66b850da0c6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13944d83b834485a8d459cbd11056352', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:35.716611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f2f9f-ca6a-4ad1-8f7b-325a5956672a tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:35.716900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f2f9f-ca6a-4ad1-8f7b-325a5956672a tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:35.717186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f2f9f-ca6a-4ad1-8f7b-325a5956672a tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:35.718122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f2f9f-ca6a-4ad1-8f7b-325a5956672a tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Adding query filter params (parent_id=a4666f9b97df4697a6b80d2f1775c594) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:35.718456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f2f9f-ca6a-4ad1-8f7b-325a5956672a tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:35.720344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f2f9f-ca6a-4ad1-8f7b-325a5956672a tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:35.759756 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1593/3146] 10.222.0.13 () {58 vars in 1215 bytes} [Sat Dec 18 20:51:35 2021] GET /identity/v3/projects?parent_id=a4666f9b97df4697a6b80d2f1775c594 => generated 497 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:35.765275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f2f9f-ca6a-4ad1-8f7b-325a5956672a tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:35.787294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f2f9f-ca6a-4ad1-8f7b-325a5956672a tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:35.799840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6667585-4dae-44c7-bbf0-938bedbc94bd tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad32749a92524924a7b66b850da0c6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13944d83b834485a8d459cbd11056352', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:35.801186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6667585-4dae-44c7-bbf0-938bedbc94bd tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:35.801186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6667585-4dae-44c7-bbf0-938bedbc94bd tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:35.801424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6667585-4dae-44c7-bbf0-938bedbc94bd tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] PATH_INFO: `/v3/projects/b365e45934384fda81b93ee46d65879a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:35.805164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6667585-4dae-44c7-bbf0-938bedbc94bd tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b365e45934384fda81b93ee46d65879a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:35.807851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6667585-4dae-44c7-bbf0-938bedbc94bd tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:35.877300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064079c-d5e9-4b94-bad6-16faa81e3f9c tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:35.884360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafdf45-ac44-4c9b-9dc8-9a76e8677622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:35.885244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafdf45-ac44-4c9b-9dc8-9a76e8677622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:35.885577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafdf45-ac44-4c9b-9dc8-9a76e8677622 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:35.885907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafdf45-ac44-4c9b-9dc8-9a76e8677622 admin admin] PATH_INFO: `/v3/projects/f145ee84f2f04ba6a0a2415cf3d45502` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:35.887811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffafdf45-ac44-4c9b-9dc8-9a76e8677622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f145ee84f2f04ba6a0a2415cf3d45502)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:35.889733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffafdf45-ac44-4c9b-9dc8-9a76e8677622 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:35.905555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d6667585-4dae-44c7-bbf0-938bedbc94bd tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b365e45934384fda81b93ee46d65879a', 'request_id': 'req-d6667585-4dae-44c7-bbf0-938bedbc94bd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:35.914357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d6667585-4dae-44c7-bbf0-938bedbc94bd tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b365e45934384fda81b93ee46d65879a', 'request_id': 'req-d6667585-4dae-44c7-bbf0-938bedbc94bd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:35.924253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d6667585-4dae-44c7-bbf0-938bedbc94bd tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b365e45934384fda81b93ee46d65879a', 'request_id': 'req-d6667585-4dae-44c7-bbf0-938bedbc94bd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:35.943357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d6667585-4dae-44c7-bbf0-938bedbc94bd tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] The token cache is being invalidate because project b365e45934384fda81b93ee46d65879a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:35.943654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d6667585-4dae-44c7-bbf0-938bedbc94bd tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:35.945704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d6667585-4dae-44c7-bbf0-938bedbc94bd tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:35.948014 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1594/3147] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:35 2021] DELETE /identity/v3/projects/b365e45934384fda81b93ee46d65879a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:35.953711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6667585-4dae-44c7-bbf0-938bedbc94bd tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:35.956989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d6667585-4dae-44c7-bbf0-938bedbc94bd tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:35.963068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ffafdf45-ac44-4c9b-9dc8-9a76e8677622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f145ee84f2f04ba6a0a2415cf3d45502', 'request_id': 'req-ffafdf45-ac44-4c9b-9dc8-9a76e8677622'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:35.971574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ffafdf45-ac44-4c9b-9dc8-9a76e8677622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f145ee84f2f04ba6a0a2415cf3d45502', 'request_id': 'req-ffafdf45-ac44-4c9b-9dc8-9a76e8677622'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:35.977481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ffafdf45-ac44-4c9b-9dc8-9a76e8677622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f145ee84f2f04ba6a0a2415cf3d45502', 'request_id': 'req-ffafdf45-ac44-4c9b-9dc8-9a76e8677622'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:35.994899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ffafdf45-ac44-4c9b-9dc8-9a76e8677622 admin admin] The token cache is being invalidate because project f145ee84f2f04ba6a0a2415cf3d45502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:35.995191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ffafdf45-ac44-4c9b-9dc8-9a76e8677622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:35.996812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ffafdf45-ac44-4c9b-9dc8-9a76e8677622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:36.002537 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1554/3148] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:35 2021] DELETE /identity/v3/projects/f145ee84f2f04ba6a0a2415cf3d45502 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:36.008456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75dde7-7410-46b7-9b45-0f240cf9f39f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:36.008764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75dde7-7410-46b7-9b45-0f240cf9f39f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:36.009876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75dde7-7410-46b7-9b45-0f240cf9f39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:36.038524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-bf75dde7-7410-46b7-9b45-0f240cf9f39f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:36.040345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bf75dde7-7410-46b7-9b45-0f240cf9f39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:36.051049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6667585-4dae-44c7-bbf0-938bedbc94bd tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:36.178342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ae46a-a9a3-40da-84a1-74986ed75f19 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad32749a92524924a7b66b850da0c6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13944d83b834485a8d459cbd11056352', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:36.179372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ae46a-a9a3-40da-84a1-74986ed75f19 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:36.179669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ae46a-a9a3-40da-84a1-74986ed75f19 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:36.179950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ae46a-a9a3-40da-84a1-74986ed75f19 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] PATH_INFO: `/v3/projects/a4666f9b97df4697a6b80d2f1775c594` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:36.181485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ae46a-a9a3-40da-84a1-74986ed75f19 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a4666f9b97df4697a6b80d2f1775c594)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:36.188818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ae46a-a9a3-40da-84a1-74986ed75f19 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:36.228550 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1555/3149] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:36.233054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8650333-ed9a-4f9c-a37e-c1fdfdc24685 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:36.233054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8650333-ed9a-4f9c-a37e-c1fdfdc24685 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:36.233054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8650333-ed9a-4f9c-a37e-c1fdfdc24685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:36.280569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a8650333-ed9a-4f9c-a37e-c1fdfdc24685 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:36.283987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a8650333-ed9a-4f9c-a37e-c1fdfdc24685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:36.343093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b58ae46a-a9a3-40da-84a1-74986ed75f19 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4666f9b97df4697a6b80d2f1775c594', 'request_id': 'req-b58ae46a-a9a3-40da-84a1-74986ed75f19'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:36.359460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b58ae46a-a9a3-40da-84a1-74986ed75f19 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4666f9b97df4697a6b80d2f1775c594', 'request_id': 'req-b58ae46a-a9a3-40da-84a1-74986ed75f19'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:36.373142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b58ae46a-a9a3-40da-84a1-74986ed75f19 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4666f9b97df4697a6b80d2f1775c594', 'request_id': 'req-b58ae46a-a9a3-40da-84a1-74986ed75f19'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:36.393483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b58ae46a-a9a3-40da-84a1-74986ed75f19 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] The token cache is being invalidate because project a4666f9b97df4697a6b80d2f1775c594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:36.393824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b58ae46a-a9a3-40da-84a1-74986ed75f19 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:36.394701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b58ae46a-a9a3-40da-84a1-74986ed75f19 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:36.406734 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1595/3150] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:35 2021] DELETE /identity/v3/projects/a4666f9b97df4697a6b80d2f1775c594 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:36.409047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ae46a-a9a3-40da-84a1-74986ed75f19 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:36.411298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b58ae46a-a9a3-40da-84a1-74986ed75f19 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:36.469437 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1556/3151] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:36.473344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8650333-ed9a-4f9c-a37e-c1fdfdc24685 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:36.496289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8650333-ed9a-4f9c-a37e-c1fdfdc24685 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:36.521273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c9b78-73fc-4372-ae71-ab5371a89749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:36.521964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c9b78-73fc-4372-ae71-ab5371a89749 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:36.522287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c9b78-73fc-4372-ae71-ab5371a89749 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:36.522569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c9b78-73fc-4372-ae71-ab5371a89749 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:36.523799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c9b78-73fc-4372-ae71-ab5371a89749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:36.523799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c9b78-73fc-4372-ae71-ab5371a89749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:36.525212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c9b78-73fc-4372-ae71-ab5371a89749 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:36.526407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ae46a-a9a3-40da-84a1-74986ed75f19 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:36.534704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad32749a92524924a7b66b850da0c6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13944d83b834485a8d459cbd11056352', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:36.535669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:36.536136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:36.536479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] PATH_INFO: `/v3/projects/0a0f59adea3745d08363e0185aa039c2` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:36.537802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0a0f59adea3745d08363e0185aa039c2)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:36.540318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:36.556142 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1557/3152] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:51:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:36.557238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c9b78-73fc-4372-ae71-ab5371a89749 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:36.580450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c9b78-73fc-4372-ae71-ab5371a89749 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:36.590637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767089a7-5069-4e22-8ad3-d5f8315288b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:36.591691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767089a7-5069-4e22-8ad3-d5f8315288b2 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:36.591831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767089a7-5069-4e22-8ad3-d5f8315288b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:36.592013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767089a7-5069-4e22-8ad3-d5f8315288b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:36.592731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767089a7-5069-4e22-8ad3-d5f8315288b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:36.594677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767089a7-5069-4e22-8ad3-d5f8315288b2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:36.602376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0f59adea3745d08363e0185aa039c2', 'request_id': 'req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:36.610129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0f59adea3745d08363e0185aa039c2', 'request_id': 'req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:36.619401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0f59adea3745d08363e0185aa039c2', 'request_id': 'req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:36.639058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] The token cache is being invalidate because project 0a0f59adea3745d08363e0185aa039c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:36.639633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:36.640532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:36.647106 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1596/3153] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:36 2021] DELETE /identity/v3/projects/0a0f59adea3745d08363e0185aa039c2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:36.652117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:36.658368 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1558/3154] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:36 2021] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:36.659719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:36.662241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767089a7-5069-4e22-8ad3-d5f8315288b2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:36.665329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-767089a7-5069-4e22-8ad3-d5f8315288b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:36.812012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767089a7-5069-4e22-8ad3-d5f8315288b2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:36.819692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7502c-4ac7-4b03-8f27-beec7a244fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:36.820926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7502c-4ac7-4b03-8f27-beec7a244fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:36.821216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7502c-4ac7-4b03-8f27-beec7a244fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:36.823234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7502c-4ac7-4b03-8f27-beec7a244fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:36.824095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7502c-4ac7-4b03-8f27-beec7a244fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:36.826772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7502c-4ac7-4b03-8f27-beec7a244fc3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:36.842108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d3db-f90b-4dc5-9e0e-1f322f922d62 tempest-ListProjectsTestJSON-724484080 tempest-ListProjectsTestJSON-724484080-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:36.854996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be173539-4b3e-403a-b5f9-fa6234614085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:36.855931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be173539-4b3e-403a-b5f9-fa6234614085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:36.856219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be173539-4b3e-403a-b5f9-fa6234614085 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:36.856500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be173539-4b3e-403a-b5f9-fa6234614085 admin admin] PATH_INFO: `/v3/users/18deade944ac44049c4de5470925b65b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:36.858894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be173539-4b3e-403a-b5f9-fa6234614085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18deade944ac44049c4de5470925b65b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:36.863847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be173539-4b3e-403a-b5f9-fa6234614085 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:36.866681 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1559/3155] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:36 2021] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:36.876528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7502c-4ac7-4b03-8f27-beec7a244fc3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:36.896800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7502c-4ac7-4b03-8f27-beec7a244fc3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:36.908927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a74a4-7e72-4443-99f8-b00b72b09216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:36.910045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a74a4-7e72-4443-99f8-b00b72b09216 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:36.910580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a74a4-7e72-4443-99f8-b00b72b09216 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:36.911274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a74a4-7e72-4443-99f8-b00b72b09216 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:36.912960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a74a4-7e72-4443-99f8-b00b72b09216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:36.915920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a74a4-7e72-4443-99f8-b00b72b09216 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:36.930707 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1560/3156] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:36 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:36.935889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a74a4-7e72-4443-99f8-b00b72b09216 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:36.971881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a74a4-7e72-4443-99f8-b00b72b09216 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:36.976378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-be173539-4b3e-403a-b5f9-fa6234614085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18deade944ac44049c4de5470925b65b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:36.989045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5a1df-2f73-4592-9abd-f02472b31314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:36.989727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5a1df-2f73-4592-9abd-f02472b31314 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:36.990015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5a1df-2f73-4592-9abd-f02472b31314 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:36.990334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5a1df-2f73-4592-9abd-f02472b31314 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:36.991077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5a1df-2f73-4592-9abd-f02472b31314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:36.992684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5a1df-2f73-4592-9abd-f02472b31314 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:36.994987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-be173539-4b3e-403a-b5f9-fa6234614085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18deade944ac44049c4de5470925b65b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:36.998309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-be173539-4b3e-403a-b5f9-fa6234614085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18deade944ac44049c4de5470925b65b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:37.011173 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1561/3157] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:36 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:37.023491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5a1df-2f73-4592-9abd-f02472b31314 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:37.025682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-be173539-4b3e-403a-b5f9-fa6234614085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18deade944ac44049c4de5470925b65b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:37.039989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5a1df-2f73-4592-9abd-f02472b31314 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:37.049204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-be173539-4b3e-403a-b5f9-fa6234614085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18deade944ac44049c4de5470925b65b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:37.062679 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1597/3158] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:36 2021] DELETE /identity/v3/users/18deade944ac44049c4de5470925b65b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:37.064953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a605ae3-868e-4cf4-8f67-3d94608f372c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:37.065467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a605ae3-868e-4cf4-8f67-3d94608f372c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:37.065654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f46f64-fac5-4ffa-bbb7-deec6708a513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:37.066175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a605ae3-868e-4cf4-8f67-3d94608f372c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:37.066578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f46f64-fac5-4ffa-bbb7-deec6708a513 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:37.066862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f46f64-fac5-4ffa-bbb7-deec6708a513 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:37.067138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f46f64-fac5-4ffa-bbb7-deec6708a513 admin admin] PATH_INFO: `/v3/projects/09f464a0dbea408cb3f43c2c96bdaaac/users/ca309394563d45ea9b911c14c5f7625f/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:37.088869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f46f64-fac5-4ffa-bbb7-deec6708a513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f464a0dbea408cb3f43c2c96bdaaac, user_id=ca309394563d45ea9b911c14c5f7625f, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:37.092652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5a605ae3-868e-4cf4-8f67-3d94608f372c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:37.094158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5a605ae3-868e-4cf4-8f67-3d94608f372c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:37.101715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f46f64-fac5-4ffa-bbb7-deec6708a513 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:37.134444 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1562/3159] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:37 2021] PUT /identity/v3/projects/09f464a0dbea408cb3f43c2c96bdaaac/users/ca309394563d45ea9b911c14c5f7625f/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:37.149305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4e216-0dee-44c0-a67d-fe27e1f73dff None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:37.149685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4e216-0dee-44c0-a67d-fe27e1f73dff None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:37.149975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4e216-0dee-44c0-a67d-fe27e1f73dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:37.218125 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1598/3160] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:37.231600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a605ae3-868e-4cf4-8f67-3d94608f372c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:37.232274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2df4e216-0dee-44c0-a67d-fe27e1f73dff None None] MFA Rules not processed for user `ca309394563d45ea9b911c14c5f7625f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:37.233498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2df4e216-0dee-44c0-a67d-fe27e1f73dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:37.235061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5a605ae3-868e-4cf4-8f67-3d94608f372c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:37.321572 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1563/3161] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:37 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:37.327571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4e216-0dee-44c0-a67d-fe27e1f73dff None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:37.329937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2df4e216-0dee-44c0-a67d-fe27e1f73dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:37.356662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a605ae3-868e-4cf4-8f67-3d94608f372c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:37.430518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c8ed2-e46a-42bd-bbf6-213ce522a944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:37.431456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c8ed2-e46a-42bd-bbf6-213ce522a944 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:37.431814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c8ed2-e46a-42bd-bbf6-213ce522a944 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:37.432164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c8ed2-e46a-42bd-bbf6-213ce522a944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:37.498405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4e216-0dee-44c0-a67d-fe27e1f73dff None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:37.507050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22225406-f038-4cd0-88ec-a20f41be3d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:37.507719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22225406-f038-4cd0-88ec-a20f41be3d88 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:37.507999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22225406-f038-4cd0-88ec-a20f41be3d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:37.508273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22225406-f038-4cd0-88ec-a20f41be3d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:37.508980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22225406-f038-4cd0-88ec-a20f41be3d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:37.511115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22225406-f038-4cd0-88ec-a20f41be3d88 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:37.549577 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1564/3162] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:37 2021] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:37.553223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22225406-f038-4cd0-88ec-a20f41be3d88 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:37.573606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c8ed2-e46a-42bd-bbf6-213ce522a944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:37.575151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c8ed2-e46a-42bd-bbf6-213ce522a944 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:37.586385 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1599/3163] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:51:37.631677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22225406-f038-4cd0-88ec-a20f41be3d88 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:37.637720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9f58c-0f5c-4303-a1c3-06209b3eac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:37.638447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9f58c-0f5c-4303-a1c3-06209b3eac71 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:37.638848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9f58c-0f5c-4303-a1c3-06209b3eac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:37.639196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9f58c-0f5c-4303-a1c3-06209b3eac71 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:37.640088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9f58c-0f5c-4303-a1c3-06209b3eac71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:37.642234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9f58c-0f5c-4303-a1c3-06209b3eac71 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:37.669629 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1565/3164] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:37 2021] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:37.670854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c8ed2-e46a-42bd-bbf6-213ce522a944 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:37.692060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c8ed2-e46a-42bd-bbf6-213ce522a944 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:37.698064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c022a-01b8-4e86-a55b-c644e2fbc476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:37.698778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c022a-01b8-4e86-a55b-c644e2fbc476 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:37.699091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c022a-01b8-4e86-a55b-c644e2fbc476 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:37.699370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c022a-01b8-4e86-a55b-c644e2fbc476 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:37.700099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c022a-01b8-4e86-a55b-c644e2fbc476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:37.701690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c022a-01b8-4e86-a55b-c644e2fbc476 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:37.719253 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1600/3165] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:37 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:37.723215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9f58c-0f5c-4303-a1c3-06209b3eac71 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:37.740882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9f58c-0f5c-4303-a1c3-06209b3eac71 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:37.745918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281e64b-507c-49b2-b071-32a00464f421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:37.746842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281e64b-507c-49b2-b071-32a00464f421 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:37.747124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281e64b-507c-49b2-b071-32a00464f421 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:37.747404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281e64b-507c-49b2-b071-32a00464f421 admin admin] PATH_INFO: `/v3/projects/c48df72b525b42219b13f6145223684e/users/3ed71cb735fd4bb1802b5ee2f937c40d/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:37.763244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281e64b-507c-49b2-b071-32a00464f421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48df72b525b42219b13f6145223684e, user_id=3ed71cb735fd4bb1802b5ee2f937c40d, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:37.765999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281e64b-507c-49b2-b071-32a00464f421 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:37.780767 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1566/3166] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:37 2021] PUT /identity/v3/projects/c48df72b525b42219b13f6145223684e/users/3ed71cb735fd4bb1802b5ee2f937c40d/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:51:37.784435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c022a-01b8-4e86-a55b-c644e2fbc476 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:37.796876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c022a-01b8-4e86-a55b-c644e2fbc476 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:37.860197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825fb8e-02e0-4019-9241-ba1627f6c7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:37.860872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825fb8e-02e0-4019-9241-ba1627f6c7ec admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:37.861158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825fb8e-02e0-4019-9241-ba1627f6c7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:37.861438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825fb8e-02e0-4019-9241-ba1627f6c7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:37.862171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825fb8e-02e0-4019-9241-ba1627f6c7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:37.863813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825fb8e-02e0-4019-9241-ba1627f6c7ec admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:37.876703 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1601/3167] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:37 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:37.880828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281e64b-507c-49b2-b071-32a00464f421 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:37.897709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281e64b-507c-49b2-b071-32a00464f421 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:37.903662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af4f57-ae4d-4d29-a340-c4ea32f4375a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:37.905102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af4f57-ae4d-4d29-a340-c4ea32f4375a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:37.905388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af4f57-ae4d-4d29-a340-c4ea32f4375a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:37.905666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af4f57-ae4d-4d29-a340-c4ea32f4375a admin admin] PATH_INFO: `/v3/projects/c48df72b525b42219b13f6145223684e/users/3ed71cb735fd4bb1802b5ee2f937c40d/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:37.907788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af4f57-ae4d-4d29-a340-c4ea32f4375a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48df72b525b42219b13f6145223684e, user_id=3ed71cb735fd4bb1802b5ee2f937c40d, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:37.910592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af4f57-ae4d-4d29-a340-c4ea32f4375a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:37.923751 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1567/3168] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:37 2021] PUT /identity/v3/projects/c48df72b525b42219b13f6145223684e/users/3ed71cb735fd4bb1802b5ee2f937c40d/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:51:37.940394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e2a16-af56-4c3b-81bd-5308798ac45e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:37.940689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e2a16-af56-4c3b-81bd-5308798ac45e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:37.940972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e2a16-af56-4c3b-81bd-5308798ac45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:37.991466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-de5e2a16-af56-4c3b-81bd-5308798ac45e None None] MFA Rules not processed for user `3ed71cb735fd4bb1802b5ee2f937c40d`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:37.992770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-de5e2a16-af56-4c3b-81bd-5308798ac45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:38.080294 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1602/3169] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:37 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:38.092105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805de3f-0b93-48fa-9644-c376b3c7479c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:38.092397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805de3f-0b93-48fa-9644-c376b3c7479c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:38.092708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805de3f-0b93-48fa-9644-c376b3c7479c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:38.116322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b805de3f-0b93-48fa-9644-c376b3c7479c None None] MFA Rules not processed for user `ca309394563d45ea9b911c14c5f7625f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:38.117749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b805de3f-0b93-48fa-9644-c376b3c7479c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:38.156189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e2a16-af56-4c3b-81bd-5308798ac45e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:38.159314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-de5e2a16-af56-4c3b-81bd-5308798ac45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:38.206791 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1568/3170] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:38 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:38.295455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e2a16-af56-4c3b-81bd-5308798ac45e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:38.301887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868850f4-1b51-4da3-8173-1d811b92b712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:38.303091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868850f4-1b51-4da3-8173-1d811b92b712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:38.303562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868850f4-1b51-4da3-8173-1d811b92b712 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:38.304008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868850f4-1b51-4da3-8173-1d811b92b712 admin admin] PATH_INFO: `/v3/projects/8edf6f46090c4778a09bc28a3ad42378` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:38.305533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868850f4-1b51-4da3-8173-1d811b92b712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8edf6f46090c4778a09bc28a3ad42378)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:38.307726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868850f4-1b51-4da3-8173-1d811b92b712 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:38.375775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-868850f4-1b51-4da3-8173-1d811b92b712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8edf6f46090c4778a09bc28a3ad42378', 'request_id': 'req-868850f4-1b51-4da3-8173-1d811b92b712'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:38.382617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-868850f4-1b51-4da3-8173-1d811b92b712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8edf6f46090c4778a09bc28a3ad42378', 'request_id': 'req-868850f4-1b51-4da3-8173-1d811b92b712'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:38.392450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-868850f4-1b51-4da3-8173-1d811b92b712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8edf6f46090c4778a09bc28a3ad42378', 'request_id': 'req-868850f4-1b51-4da3-8173-1d811b92b712'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:38.411725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-868850f4-1b51-4da3-8173-1d811b92b712 admin admin] The token cache is being invalidate because project 8edf6f46090c4778a09bc28a3ad42378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:38.412034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-868850f4-1b51-4da3-8173-1d811b92b712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:38.413557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-868850f4-1b51-4da3-8173-1d811b92b712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:38.416956 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1603/3171] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:38 2021] DELETE /identity/v3/projects/8edf6f46090c4778a09bc28a3ad42378 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:38.420887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805de3f-0b93-48fa-9644-c376b3c7479c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:38.441078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805de3f-0b93-48fa-9644-c376b3c7479c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:38.442498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868850f4-1b51-4da3-8173-1d811b92b712 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:38.444863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-868850f4-1b51-4da3-8173-1d811b92b712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:38.524483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868850f4-1b51-4da3-8173-1d811b92b712 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:38.535982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9c335-8394-4d31-92c0-b35b6e5c7362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:38.536723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9c335-8394-4d31-92c0-b35b6e5c7362 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:38.537082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9c335-8394-4d31-92c0-b35b6e5c7362 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:38.537498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9c335-8394-4d31-92c0-b35b6e5c7362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:38.540501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdd1ea-8795-4387-aacb-5fa4848d27a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:38.541563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdd1ea-8795-4387-aacb-5fa4848d27a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:38.542041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8bf9c335-8394-4d31-92c0-b35b6e5c7362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:38.542234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdd1ea-8795-4387-aacb-5fa4848d27a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:38.542720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdd1ea-8795-4387-aacb-5fa4848d27a8 admin admin] PATH_INFO: `/v3/users/ad32749a92524924a7b66b850da0c6af` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:38.544382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdd1ea-8795-4387-aacb-5fa4848d27a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad32749a92524924a7b66b850da0c6af)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:38.546677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdd1ea-8795-4387-aacb-5fa4848d27a8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:38.629430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-10fdd1ea-8795-4387-aacb-5fa4848d27a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad32749a92524924a7b66b850da0c6af'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:38.642125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-10fdd1ea-8795-4387-aacb-5fa4848d27a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad32749a92524924a7b66b850da0c6af'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:38.648569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9c335-8394-4d31-92c0-b35b6e5c7362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:38.650498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9c335-8394-4d31-92c0-b35b6e5c7362 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:38.660249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-10fdd1ea-8795-4387-aacb-5fa4848d27a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad32749a92524924a7b66b850da0c6af'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:38.661337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-10fdd1ea-8795-4387-aacb-5fa4848d27a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad32749a92524924a7b66b850da0c6af'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:38.663950 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1604/3172] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:51:38.664847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9c335-8394-4d31-92c0-b35b6e5c7362 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:38.666270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8bf9c335-8394-4d31-92c0-b35b6e5c7362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:38.673637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-10fdd1ea-8795-4387-aacb-5fa4848d27a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad32749a92524924a7b66b850da0c6af'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:38.683001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9c335-8394-4d31-92c0-b35b6e5c7362 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:38.685330 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1569/3173] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:38 2021] DELETE /identity/v3/users/ad32749a92524924a7b66b850da0c6af => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:38.775743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd54da-e29d-4aa7-b197-3d17965cd758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:38.776868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd54da-e29d-4aa7-b197-3d17965cd758 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:38.777190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd54da-e29d-4aa7-b197-3d17965cd758 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:38.777519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd54da-e29d-4aa7-b197-3d17965cd758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:38.779689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1dbd54da-e29d-4aa7-b197-3d17965cd758 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:38.904411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd54da-e29d-4aa7-b197-3d17965cd758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:38.906164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd54da-e29d-4aa7-b197-3d17965cd758 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:38.919747 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1605/3174] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:38 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:51:39.306928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdd1ea-8795-4387-aacb-5fa4848d27a8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:39.309791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-10fdd1ea-8795-4387-aacb-5fa4848d27a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:39.414705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdd1ea-8795-4387-aacb-5fa4848d27a8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:39.420822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb33af6-2886-4afb-9cb7-9c35b5257949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:39.421775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb33af6-2886-4afb-9cb7-9c35b5257949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:39.422371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb33af6-2886-4afb-9cb7-9c35b5257949 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:39.422371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb33af6-2886-4afb-9cb7-9c35b5257949 admin admin] PATH_INFO: `/v3/projects/13944d83b834485a8d459cbd11056352` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:39.423555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb33af6-2886-4afb-9cb7-9c35b5257949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13944d83b834485a8d459cbd11056352)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:39.425731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb33af6-2886-4afb-9cb7-9c35b5257949 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:39.481074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ffb33af6-2886-4afb-9cb7-9c35b5257949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13944d83b834485a8d459cbd11056352', 'request_id': 'req-ffb33af6-2886-4afb-9cb7-9c35b5257949'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:39.488022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ffb33af6-2886-4afb-9cb7-9c35b5257949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13944d83b834485a8d459cbd11056352', 'request_id': 'req-ffb33af6-2886-4afb-9cb7-9c35b5257949'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:39.495309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ffb33af6-2886-4afb-9cb7-9c35b5257949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13944d83b834485a8d459cbd11056352', 'request_id': 'req-ffb33af6-2886-4afb-9cb7-9c35b5257949'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:39.512201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ffb33af6-2886-4afb-9cb7-9c35b5257949 admin admin] The token cache is being invalidate because project 13944d83b834485a8d459cbd11056352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:39.512930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ffb33af6-2886-4afb-9cb7-9c35b5257949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:39.513406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ffb33af6-2886-4afb-9cb7-9c35b5257949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:39.515491 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1570/3175] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:39 2021] DELETE /identity/v3/projects/13944d83b834485a8d459cbd11056352 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:39.521009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e0b9d-1f61-4349-a92a-cfca445fac4f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:39.523201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e0b9d-1f61-4349-a92a-cfca445fac4f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:39.523565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e0b9d-1f61-4349-a92a-cfca445fac4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:39.546805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-800e0b9d-1f61-4349-a92a-cfca445fac4f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:39.548333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-800e0b9d-1f61-4349-a92a-cfca445fac4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:39.617558 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1606/3176] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:39.625115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d873684-7c23-405c-88ce-e1f845101440 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:39.625633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d873684-7c23-405c-88ce-e1f845101440 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:39.626077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d873684-7c23-405c-88ce-e1f845101440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:39.651625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7d873684-7c23-405c-88ce-e1f845101440 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:39.654529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7d873684-7c23-405c-88ce-e1f845101440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:39.670301 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1571/3177] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:39.672033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e0b9d-1f61-4349-a92a-cfca445fac4f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:39.682457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e0b9d-1f61-4349-a92a-cfca445fac4f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:39.687611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88b20b-940c-4298-a99f-08c29e7500ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:39.688287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88b20b-940c-4298-a99f-08c29e7500ca admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:39.688577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88b20b-940c-4298-a99f-08c29e7500ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:39.688992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88b20b-940c-4298-a99f-08c29e7500ca admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:39.689742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88b20b-940c-4298-a99f-08c29e7500ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:39.690055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88b20b-940c-4298-a99f-08c29e7500ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:39.692030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88b20b-940c-4298-a99f-08c29e7500ca admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:39.719799 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1607/3178] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:51:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:39.720296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d873684-7c23-405c-88ce-e1f845101440 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:39.731649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d873684-7c23-405c-88ce-e1f845101440 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:39.738316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066a963-6694-4711-a8a7-70531557eef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:39.744023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066a963-6694-4711-a8a7-70531557eef1 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:39.744649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066a963-6694-4711-a8a7-70531557eef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:39.748435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066a963-6694-4711-a8a7-70531557eef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:39.748435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066a963-6694-4711-a8a7-70531557eef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:39.753619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066a963-6694-4711-a8a7-70531557eef1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:39.807902 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1572/3179] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:39 2021] POST /identity/v3/projects => generated 365 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:39.812819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88b20b-940c-4298-a99f-08c29e7500ca admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:39.823711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88b20b-940c-4298-a99f-08c29e7500ca admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:39.919977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed821ed-93bd-41ad-93d5-3d96b839b530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:39.920856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed821ed-93bd-41ad-93d5-3d96b839b530 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:39.921322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed821ed-93bd-41ad-93d5-3d96b839b530 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:39.921601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed821ed-93bd-41ad-93d5-3d96b839b530 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:39.922345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed821ed-93bd-41ad-93d5-3d96b839b530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:39.924296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed821ed-93bd-41ad-93d5-3d96b839b530 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:39.956171 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1608/3180] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:39 2021] POST /identity/v3/users => generated 283 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:39.959082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066a963-6694-4711-a8a7-70531557eef1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:39.974899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066a963-6694-4711-a8a7-70531557eef1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:39.982955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e8383-21d6-437d-a2cc-cd6a2ee73d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:39.983752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e8383-21d6-437d-a2cc-cd6a2ee73d06 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:39.984110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e8383-21d6-437d-a2cc-cd6a2ee73d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:39.984467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e8383-21d6-437d-a2cc-cd6a2ee73d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:39.990170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e8383-21d6-437d-a2cc-cd6a2ee73d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:39.992464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e8383-21d6-437d-a2cc-cd6a2ee73d06 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:40.004862 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1573/3181] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:39 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:40.009708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed821ed-93bd-41ad-93d5-3d96b839b530 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:40.024842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed821ed-93bd-41ad-93d5-3d96b839b530 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:40.031517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb417630-6f05-476e-b41f-7ecf06479304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:40.032313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb417630-6f05-476e-b41f-7ecf06479304 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:40.032595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb417630-6f05-476e-b41f-7ecf06479304 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:40.032868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb417630-6f05-476e-b41f-7ecf06479304 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:40.033764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb417630-6f05-476e-b41f-7ecf06479304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:40.035528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb417630-6f05-476e-b41f-7ecf06479304 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:40.048956 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1609/3182] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:40 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:40.052804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e8383-21d6-437d-a2cc-cd6a2ee73d06 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:40.069256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e8383-21d6-437d-a2cc-cd6a2ee73d06 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:40.078524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72e2ed-ca8b-4018-8623-6219f456df38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:40.079566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72e2ed-ca8b-4018-8623-6219f456df38 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:40.079862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72e2ed-ca8b-4018-8623-6219f456df38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:40.080259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72e2ed-ca8b-4018-8623-6219f456df38 admin admin] PATH_INFO: `/v3/projects/cd729ecccf9a45c089d0008aa750baff/users/e45fc427bd5a4fa883dd857147b0b95e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:40.104372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72e2ed-ca8b-4018-8623-6219f456df38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd729ecccf9a45c089d0008aa750baff, user_id=e45fc427bd5a4fa883dd857147b0b95e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:40.108114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72e2ed-ca8b-4018-8623-6219f456df38 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:40.129731 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1574/3183] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:40 2021] PUT /identity/v3/projects/cd729ecccf9a45c089d0008aa750baff/users/e45fc427bd5a4fa883dd857147b0b95e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:40.141960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a3b90-f5f5-44b6-827c-b06027e11e27 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:40.142244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a3b90-f5f5-44b6-827c-b06027e11e27 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:40.142559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a3b90-f5f5-44b6-827c-b06027e11e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:40.166400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d55ea8-98aa-4c68-af7c-19c2caf8a7cc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:40.166702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d55ea8-98aa-4c68-af7c-19c2caf8a7cc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:40.166986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d55ea8-98aa-4c68-af7c-19c2caf8a7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:40.187322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-18d55ea8-98aa-4c68-af7c-19c2caf8a7cc None None] MFA Rules not processed for user `ca309394563d45ea9b911c14c5f7625f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:40.188554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-18d55ea8-98aa-4c68-af7c-19c2caf8a7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:40.195219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-681a3b90-f5f5-44b6-827c-b06027e11e27 None None] MFA Rules not processed for user `e45fc427bd5a4fa883dd857147b0b95e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:40.196505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-681a3b90-f5f5-44b6-827c-b06027e11e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:40.266333 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1575/3184] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:40 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:40.267277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d55ea8-98aa-4c68-af7c-19c2caf8a7cc None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:40.268781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-18d55ea8-98aa-4c68-af7c-19c2caf8a7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:40.300009 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1610/3185] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:40 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:40.302376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a3b90-f5f5-44b6-827c-b06027e11e27 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:40.383193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d55ea8-98aa-4c68-af7c-19c2caf8a7cc None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:40.384474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a3b90-f5f5-44b6-827c-b06027e11e27 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:40.390233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9b61a-5afe-4955-9685-47f271da7f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:40.391074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9b61a-5afe-4955-9685-47f271da7f4a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:40.391501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9b61a-5afe-4955-9685-47f271da7f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:40.392155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9b61a-5afe-4955-9685-47f271da7f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:40.392688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9b61a-5afe-4955-9685-47f271da7f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:40.395021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9b61a-5afe-4955-9685-47f271da7f4a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:40.396901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e5dfb-1673-4364-88b9-34116df1e4f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:40.397937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e5dfb-1673-4364-88b9-34116df1e4f3 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:40.398421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e5dfb-1673-4364-88b9-34116df1e4f3 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:40.399486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e5dfb-1673-4364-88b9-34116df1e4f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:40.402557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d25e5dfb-1673-4364-88b9-34116df1e4f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:40.415970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e5dfb-1673-4364-88b9-34116df1e4f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:40.418091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e5dfb-1673-4364-88b9-34116df1e4f3 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:40.430934 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1576/3186] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:40 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:51:40.438767 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1611/3187] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:40 2021] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:40.442350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e5dfb-1673-4364-88b9-34116df1e4f3 service placement] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:40.453396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e5dfb-1673-4364-88b9-34116df1e4f3 service placement] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:40.544435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76972007-cb57-4a94-b43a-845225d43338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:40.546820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76972007-cb57-4a94-b43a-845225d43338 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:40.547255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76972007-cb57-4a94-b43a-845225d43338 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:40.547638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76972007-cb57-4a94-b43a-845225d43338 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:40.548631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76972007-cb57-4a94-b43a-845225d43338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:40.550884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76972007-cb57-4a94-b43a-845225d43338 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:40.614737 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1577/3188] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:40 2021] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:40.615501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9b61a-5afe-4955-9685-47f271da7f4a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:40.627849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9b61a-5afe-4955-9685-47f271da7f4a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:40.640104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2e8ca-3904-4d0c-b10b-e3342b4a58b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:40.640325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2e8ca-3904-4d0c-b10b-e3342b4a58b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:40.641507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2e8ca-3904-4d0c-b10b-e3342b4a58b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:40.641796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2e8ca-3904-4d0c-b10b-e3342b4a58b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:40.648157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2e8ca-3904-4d0c-b10b-e3342b4a58b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:40.649956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2e8ca-3904-4d0c-b10b-e3342b4a58b1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:40.667395 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1612/3189] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:40 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:51:40.672007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76972007-cb57-4a94-b43a-845225d43338 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:40.688069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76972007-cb57-4a94-b43a-845225d43338 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:40.694147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03899f8-32b0-4f91-b795-2389d1a8920e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:40.695813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03899f8-32b0-4f91-b795-2389d1a8920e admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:40.696208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03899f8-32b0-4f91-b795-2389d1a8920e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:40.696758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03899f8-32b0-4f91-b795-2389d1a8920e admin admin] PATH_INFO: `/v3/projects/09ee069539d945268a3e6e8be8254e5e/users/e9bdc8cd95aa4228b26a9b9ddea2565c/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:40.723762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03899f8-32b0-4f91-b795-2389d1a8920e admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ee069539d945268a3e6e8be8254e5e, user_id=e9bdc8cd95aa4228b26a9b9ddea2565c, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:40.726630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03899f8-32b0-4f91-b795-2389d1a8920e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:40.749946 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1578/3190] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:40 2021] PUT /identity/v3/projects/09ee069539d945268a3e6e8be8254e5e/users/e9bdc8cd95aa4228b26a9b9ddea2565c/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:40.754306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2e8ca-3904-4d0c-b10b-e3342b4a58b1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:40.766224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2e8ca-3904-4d0c-b10b-e3342b4a58b1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:40.863366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48fa06-56a5-45b2-a4d3-8225a4a1e178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:40.864274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48fa06-56a5-45b2-a4d3-8225a4a1e178 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:40.864697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48fa06-56a5-45b2-a4d3-8225a4a1e178 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:40.865348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48fa06-56a5-45b2-a4d3-8225a4a1e178 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:40.866358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48fa06-56a5-45b2-a4d3-8225a4a1e178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:40.868619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48fa06-56a5-45b2-a4d3-8225a4a1e178 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:40.882768 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1613/3191] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:40 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:40.886952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03899f8-32b0-4f91-b795-2389d1a8920e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:40.904105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03899f8-32b0-4f91-b795-2389d1a8920e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:40.909963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627fe91-3211-43e6-8dc4-c067f77874c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:40.911051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627fe91-3211-43e6-8dc4-c067f77874c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:40.911180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627fe91-3211-43e6-8dc4-c067f77874c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:40.911458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627fe91-3211-43e6-8dc4-c067f77874c7 admin admin] PATH_INFO: `/v3/projects/09ee069539d945268a3e6e8be8254e5e/users/e9bdc8cd95aa4228b26a9b9ddea2565c/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:40.913765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627fe91-3211-43e6-8dc4-c067f77874c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ee069539d945268a3e6e8be8254e5e, user_id=e9bdc8cd95aa4228b26a9b9ddea2565c, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:40.916580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627fe91-3211-43e6-8dc4-c067f77874c7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:40.929773 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1579/3192] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:40 2021] PUT /identity/v3/projects/09ee069539d945268a3e6e8be8254e5e/users/e9bdc8cd95aa4228b26a9b9ddea2565c/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:51:40.941753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dee8e5-a83f-49f4-8ad0-bba88ccbacd7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:40.942503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dee8e5-a83f-49f4-8ad0-bba88ccbacd7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:40.942642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dee8e5-a83f-49f4-8ad0-bba88ccbacd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:40.977483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-07dee8e5-a83f-49f4-8ad0-bba88ccbacd7 None None] MFA Rules not processed for user `e9bdc8cd95aa4228b26a9b9ddea2565c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:40.979119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-07dee8e5-a83f-49f4-8ad0-bba88ccbacd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:41.103779 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1614/3193] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:40 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:41.105472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627fe91-3211-43e6-8dc4-c067f77874c7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:41.119582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627fe91-3211-43e6-8dc4-c067f77874c7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:41.130664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8ca64-bd22-4805-9a4e-a51790e4a737 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bdc8cd95aa4228b26a9b9ddea2565c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ee069539d945268a3e6e8be8254e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:41.131614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8ca64-bd22-4805-9a4e-a51790e4a737 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:41.132673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8ca64-bd22-4805-9a4e-a51790e4a737 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:41.132994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8ca64-bd22-4805-9a4e-a51790e4a737 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] PATH_INFO: `/v3/regions` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:41.137750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8ca64-bd22-4805-9a4e-a51790e4a737 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:41.141431 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-30a8ca64-bd22-4805-9a4e-a51790e4a737 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:41.141431 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:51:41.141431 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:51:41.143510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8ca64-bd22-4805-9a4e-a51790e4a737 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:41.192842 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1580/3194] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 20:51:41 2021] POST /identity/v3/regions => generated 223 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:41.195504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dee8e5-a83f-49f4-8ad0-bba88ccbacd7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:41.210913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dee8e5-a83f-49f4-8ad0-bba88ccbacd7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:41.237409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ae073-6221-4182-b314-72b9aeb3a86a tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bdc8cd95aa4228b26a9b9ddea2565c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ee069539d945268a3e6e8be8254e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:41.254441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ae073-6221-4182-b314-72b9aeb3a86a tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:41.254761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ae073-6221-4182-b314-72b9aeb3a86a tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:41.255078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ae073-6221-4182-b314-72b9aeb3a86a tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] PATH_INFO: `/v3/regions` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:41.259777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ae073-6221-4182-b314-72b9aeb3a86a tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:41.262605 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-239ae073-6221-4182-b314-72b9aeb3a86a tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:41.262605 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:51:41.262605 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:51:41.263887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ae073-6221-4182-b314-72b9aeb3a86a tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:41.320796 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1615/3195] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 20:51:41 2021] POST /identity/v3/regions => generated 224 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:41.327847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8ca64-bd22-4805-9a4e-a51790e4a737 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:41.353023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8ca64-bd22-4805-9a4e-a51790e4a737 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:41.397827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50619c7-0351-4845-a5e4-e80ab6b7601d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bdc8cd95aa4228b26a9b9ddea2565c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ee069539d945268a3e6e8be8254e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:41.399936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50619c7-0351-4845-a5e4-e80ab6b7601d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:41.400231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50619c7-0351-4845-a5e4-e80ab6b7601d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:41.401669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50619c7-0351-4845-a5e4-e80ab6b7601d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] PATH_INFO: `/v3/regions/0f46c3dd-264d-4355-a048-089ef4b04db0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:41.403697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50619c7-0351-4845-a5e4-e80ab6b7601d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorizing `identity:create_region(region_id=0f46c3dd-264d-4355-a048-089ef4b04db0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:41.408721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50619c7-0351-4845-a5e4-e80ab6b7601d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:41.470279 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1581/3196] 10.222.0.13 () {60 vars in 1258 bytes} [Sat Dec 18 20:51:41 2021] PUT /identity/v3/regions/0f46c3dd-264d-4355-a048-089ef4b04db0 => generated 232 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:41.472313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ae073-6221-4182-b314-72b9aeb3a86a tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:41.486908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ae073-6221-4182-b314-72b9aeb3a86a tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:41.506223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787fea1-ac1e-4670-9cc0-75c73edd037b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bdc8cd95aa4228b26a9b9ddea2565c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ee069539d945268a3e6e8be8254e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:41.507114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787fea1-ac1e-4670-9cc0-75c73edd037b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:41.507399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787fea1-ac1e-4670-9cc0-75c73edd037b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:41.507675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787fea1-ac1e-4670-9cc0-75c73edd037b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] PATH_INFO: `/v3/regions/0f46c3dd-264d-4355-a048-089ef4b04db0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:41.508341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787fea1-ac1e-4670-9cc0-75c73edd037b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorizing `identity:delete_region(region_id=0f46c3dd-264d-4355-a048-089ef4b04db0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:41.509353 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-2787fea1-ac1e-4670-9cc0-75c73edd037b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:41.509353 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:51:41.509353 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:51:41.510242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787fea1-ac1e-4670-9cc0-75c73edd037b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:41.551013 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1616/3197] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Dec 18 20:51:41 2021] DELETE /identity/v3/regions/0f46c3dd-264d-4355-a048-089ef4b04db0 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:41.555954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50619c7-0351-4845-a5e4-e80ab6b7601d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:41.568536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50619c7-0351-4845-a5e4-e80ab6b7601d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:41.589172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452abfa9-a478-4e97-987b-5990daa186c6 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bdc8cd95aa4228b26a9b9ddea2565c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ee069539d945268a3e6e8be8254e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:41.589811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452abfa9-a478-4e97-987b-5990daa186c6 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:41.590318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452abfa9-a478-4e97-987b-5990daa186c6 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:41.590927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452abfa9-a478-4e97-987b-5990daa186c6 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] PATH_INFO: `/v3/regions` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:41.591773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452abfa9-a478-4e97-987b-5990daa186c6 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:41.593479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452abfa9-a478-4e97-987b-5990daa186c6 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:41.622894 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1582/3198] 10.222.0.13 () {60 vars in 1149 bytes} [Sat Dec 18 20:51:41 2021] POST /identity/v3/regions => generated 253 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:41.626746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787fea1-ac1e-4670-9cc0-75c73edd037b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:41.642323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787fea1-ac1e-4670-9cc0-75c73edd037b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:41.663955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ded17-28a4-4729-99b5-1035a9e3b314 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bdc8cd95aa4228b26a9b9ddea2565c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ee069539d945268a3e6e8be8254e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:41.665419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ded17-28a4-4729-99b5-1035a9e3b314 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:41.665810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ded17-28a4-4729-99b5-1035a9e3b314 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:41.666459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ded17-28a4-4729-99b5-1035a9e3b314 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] PATH_INFO: `/v3/regions/8199c7b2fe2b40bfa041ad38802aeb88` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:41.673995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ded17-28a4-4729-99b5-1035a9e3b314 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorizing `identity:update_region(region_id=8199c7b2fe2b40bfa041ad38802aeb88)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:41.675485 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-c02ded17-28a4-4729-99b5-1035a9e3b314 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:41.675485 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 20:51:41.675485 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 20:51:41.676650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ded17-28a4-4729-99b5-1035a9e3b314 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:41.711975 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1617/3199] 10.222.0.13 () {60 vars in 1249 bytes} [Sat Dec 18 20:51:41 2021] PATCH /identity/v3/regions/8199c7b2fe2b40bfa041ad38802aeb88 => generated 254 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:51:41.716412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452abfa9-a478-4e97-987b-5990daa186c6 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:41.732457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452abfa9-a478-4e97-987b-5990daa186c6 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:41.752468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710fd7f-d0bf-40b1-9a75-c41db8344638 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bdc8cd95aa4228b26a9b9ddea2565c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ee069539d945268a3e6e8be8254e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:41.753483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710fd7f-d0bf-40b1-9a75-c41db8344638 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:41.754096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710fd7f-d0bf-40b1-9a75-c41db8344638 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:41.754446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710fd7f-d0bf-40b1-9a75-c41db8344638 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] PATH_INFO: `/v3/regions/8199c7b2fe2b40bfa041ad38802aeb88` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:41.755343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710fd7f-d0bf-40b1-9a75-c41db8344638 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorizing `identity:get_region(region_id=8199c7b2fe2b40bfa041ad38802aeb88)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:41.756913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710fd7f-d0bf-40b1-9a75-c41db8344638 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:41.770093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ded17-28a4-4729-99b5-1035a9e3b314 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:41.794938 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1583/3200] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 20:51:41 2021] GET /identity/v3/regions/8199c7b2fe2b40bfa041ad38802aeb88 => generated 254 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:51:41.798981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ded17-28a4-4729-99b5-1035a9e3b314 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:41.820770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7100405-5458-4e61-9c38-9cc19d0b82d3 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bdc8cd95aa4228b26a9b9ddea2565c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ee069539d945268a3e6e8be8254e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:41.822067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7100405-5458-4e61-9c38-9cc19d0b82d3 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:41.822587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7100405-5458-4e61-9c38-9cc19d0b82d3 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:41.822876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7100405-5458-4e61-9c38-9cc19d0b82d3 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] PATH_INFO: `/v3/regions/8199c7b2fe2b40bfa041ad38802aeb88` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:41.825566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7100405-5458-4e61-9c38-9cc19d0b82d3 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorizing `identity:delete_region(region_id=8199c7b2fe2b40bfa041ad38802aeb88)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:41.831034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7100405-5458-4e61-9c38-9cc19d0b82d3 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:41.873110 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1618/3201] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 20:51:41 2021] DELETE /identity/v3/regions/8199c7b2fe2b40bfa041ad38802aeb88 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:41.877226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710fd7f-d0bf-40b1-9a75-c41db8344638 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:41.888416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710fd7f-d0bf-40b1-9a75-c41db8344638 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:41.922589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575c4c4-9cbf-490a-9fd4-00bab46a48a8 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bdc8cd95aa4228b26a9b9ddea2565c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ee069539d945268a3e6e8be8254e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:41.923485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575c4c4-9cbf-490a-9fd4-00bab46a48a8 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:41.923693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575c4c4-9cbf-490a-9fd4-00bab46a48a8 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:41.923978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575c4c4-9cbf-490a-9fd4-00bab46a48a8 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] PATH_INFO: `/v3/regions` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:41.924706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575c4c4-9cbf-490a-9fd4-00bab46a48a8 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:41.926069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575c4c4-9cbf-490a-9fd4-00bab46a48a8 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:41.946056 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1584/3202] 10.222.0.13 () {58 vars in 1127 bytes} [Sat Dec 18 20:51:41 2021] GET /identity/v3/regions => generated 669 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:51:41.950837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7100405-5458-4e61-9c38-9cc19d0b82d3 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:41.967321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7100405-5458-4e61-9c38-9cc19d0b82d3 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:41.986009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11b4c7-08c5-4b5a-8a71-51123c6dec4c tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bdc8cd95aa4228b26a9b9ddea2565c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ee069539d945268a3e6e8be8254e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:41.986957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11b4c7-08c5-4b5a-8a71-51123c6dec4c tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:41.987245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11b4c7-08c5-4b5a-8a71-51123c6dec4c tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:41.992382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11b4c7-08c5-4b5a-8a71-51123c6dec4c tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] PATH_INFO: `/v3/regions/8199c7b2fe2b40bfa041ad38802aeb88` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:41.993404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11b4c7-08c5-4b5a-8a71-51123c6dec4c tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorizing `identity:delete_region(region_id=8199c7b2fe2b40bfa041ad38802aeb88)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:41.995445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11b4c7-08c5-4b5a-8a71-51123c6dec4c tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:42.015137 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-3a11b4c7-08c5-4b5a-8a71-51123c6dec4c tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Could not find region: 8199c7b2fe2b40bfa041ad38802aeb88.: keystone.exception.RegionNotFound: Could not find region: 8199c7b2fe2b40bfa041ad38802aeb88. Dec 18 20:51:42.016966 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1619/3203] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 20:51:41 2021] DELETE /identity/v3/regions/8199c7b2fe2b40bfa041ad38802aeb88 => generated 112 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 20:51:42.023933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575c4c4-9cbf-490a-9fd4-00bab46a48a8 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:42.048902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575c4c4-9cbf-490a-9fd4-00bab46a48a8 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:42.078627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76701825-6682-4760-bd2d-1f8803e03de9 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bdc8cd95aa4228b26a9b9ddea2565c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ee069539d945268a3e6e8be8254e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:42.079525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76701825-6682-4760-bd2d-1f8803e03de9 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:42.079988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76701825-6682-4760-bd2d-1f8803e03de9 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:42.080424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76701825-6682-4760-bd2d-1f8803e03de9 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] PATH_INFO: `/v3/regions` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:42.081286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76701825-6682-4760-bd2d-1f8803e03de9 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:42.082585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76701825-6682-4760-bd2d-1f8803e03de9 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:42.093925 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1585/3204] 10.222.0.13 () {58 vars in 1127 bytes} [Sat Dec 18 20:51:42 2021] GET /identity/v3/regions => generated 669 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:42.098370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11b4c7-08c5-4b5a-8a71-51123c6dec4c tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:42.109715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11b4c7-08c5-4b5a-8a71-51123c6dec4c tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:42.116779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b0a5b-7b95-4368-8d2c-fb47f0343a4d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bdc8cd95aa4228b26a9b9ddea2565c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ee069539d945268a3e6e8be8254e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:42.118463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b0a5b-7b95-4368-8d2c-fb47f0343a4d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:42.118909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b0a5b-7b95-4368-8d2c-fb47f0343a4d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:42.119443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b0a5b-7b95-4368-8d2c-fb47f0343a4d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] PATH_INFO: `/v3/regions` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:42.120399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b0a5b-7b95-4368-8d2c-fb47f0343a4d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:42.123245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b0a5b-7b95-4368-8d2c-fb47f0343a4d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:42.152622 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1620/3205] 10.222.0.13 () {60 vars in 1149 bytes} [Sat Dec 18 20:51:42 2021] POST /identity/v3/regions => generated 254 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:42.157106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76701825-6682-4760-bd2d-1f8803e03de9 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:42.172834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76701825-6682-4760-bd2d-1f8803e03de9 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:42.192666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b1114-62d0-4591-bce2-eca0047c1e7d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bdc8cd95aa4228b26a9b9ddea2565c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ee069539d945268a3e6e8be8254e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:42.193512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b1114-62d0-4591-bce2-eca0047c1e7d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:42.193929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b1114-62d0-4591-bce2-eca0047c1e7d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:42.194351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b1114-62d0-4591-bce2-eca0047c1e7d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] PATH_INFO: `/v3/regions` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:42.195178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b1114-62d0-4591-bce2-eca0047c1e7d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Adding query filter params (parent_region_id=c9c3bc7c21504d41a120e8812ed1661d) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:42.195828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b1114-62d0-4591-bce2-eca0047c1e7d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:42.197637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b1114-62d0-4591-bce2-eca0047c1e7d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:42.207764 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1586/3206] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 20:51:42 2021] GET /identity/v3/regions?parent_region_id=c9c3bc7c21504d41a120e8812ed1661d => generated 400 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:42.211160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b0a5b-7b95-4368-8d2c-fb47f0343a4d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:42.226129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b0a5b-7b95-4368-8d2c-fb47f0343a4d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:42.231125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee333a45-02dd-4d6a-8e7e-5672afb7b546 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bdc8cd95aa4228b26a9b9ddea2565c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ee069539d945268a3e6e8be8254e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:42.232082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee333a45-02dd-4d6a-8e7e-5672afb7b546 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:42.232437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee333a45-02dd-4d6a-8e7e-5672afb7b546 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:42.233156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee333a45-02dd-4d6a-8e7e-5672afb7b546 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] PATH_INFO: `/v3/regions/70a2ad91c5db4abcb33d74712fb02170` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:42.233557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee333a45-02dd-4d6a-8e7e-5672afb7b546 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorizing `identity:delete_region(region_id=70a2ad91c5db4abcb33d74712fb02170)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:42.235239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee333a45-02dd-4d6a-8e7e-5672afb7b546 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:42.258969 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1621/3207] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 20:51:42 2021] DELETE /identity/v3/regions/70a2ad91c5db4abcb33d74712fb02170 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:42.264557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b1114-62d0-4591-bce2-eca0047c1e7d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:42.276157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b1114-62d0-4591-bce2-eca0047c1e7d tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:42.295654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a7647-31ca-400d-9df5-c822929c644b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bdc8cd95aa4228b26a9b9ddea2565c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ee069539d945268a3e6e8be8254e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:42.296858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a7647-31ca-400d-9df5-c822929c644b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:42.297424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a7647-31ca-400d-9df5-c822929c644b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:42.297799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a7647-31ca-400d-9df5-c822929c644b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] PATH_INFO: `/v3/regions/5e4c6137d8df437cb73a7171a3b04993` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:42.299723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a7647-31ca-400d-9df5-c822929c644b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorizing `identity:delete_region(region_id=5e4c6137d8df437cb73a7171a3b04993)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:42.300996 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-271a7647-31ca-400d-9df5-c822929c644b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 20:51:42.300996 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 20:51:42.300996 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 20:51:42.302385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a7647-31ca-400d-9df5-c822929c644b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:42.334855 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1587/3208] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 20:51:42 2021] DELETE /identity/v3/regions/5e4c6137d8df437cb73a7171a3b04993 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:42.339762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee333a45-02dd-4d6a-8e7e-5672afb7b546 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:42.355672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee333a45-02dd-4d6a-8e7e-5672afb7b546 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:42.382068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df5a57-3e61-45e7-be0a-27fece327245 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9bdc8cd95aa4228b26a9b9ddea2565c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ee069539d945268a3e6e8be8254e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:42.383142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df5a57-3e61-45e7-be0a-27fece327245 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:42.383434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df5a57-3e61-45e7-be0a-27fece327245 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:42.384094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df5a57-3e61-45e7-be0a-27fece327245 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] PATH_INFO: `/v3/regions/c9c3bc7c21504d41a120e8812ed1661d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:42.384557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df5a57-3e61-45e7-be0a-27fece327245 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorizing `identity:delete_region(region_id=c9c3bc7c21504d41a120e8812ed1661d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:42.386946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df5a57-3e61-45e7-be0a-27fece327245 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:42.429249 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1622/3209] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 20:51:42 2021] DELETE /identity/v3/regions/c9c3bc7c21504d41a120e8812ed1661d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:42.429524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a7647-31ca-400d-9df5-c822929c644b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:42.534063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a7647-31ca-400d-9df5-c822929c644b tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:42.552934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84675fe2-bdc1-4c5b-8731-177a8ec3c0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:42.553838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84675fe2-bdc1-4c5b-8731-177a8ec3c0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:42.554300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84675fe2-bdc1-4c5b-8731-177a8ec3c0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:42.554784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84675fe2-bdc1-4c5b-8731-177a8ec3c0a0 admin admin] PATH_INFO: `/v3/users/e45fc427bd5a4fa883dd857147b0b95e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:42.556545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84675fe2-bdc1-4c5b-8731-177a8ec3c0a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45fc427bd5a4fa883dd857147b0b95e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:42.560461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84675fe2-bdc1-4c5b-8731-177a8ec3c0a0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:42.648883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-84675fe2-bdc1-4c5b-8731-177a8ec3c0a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45fc427bd5a4fa883dd857147b0b95e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:42.678645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-84675fe2-bdc1-4c5b-8731-177a8ec3c0a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45fc427bd5a4fa883dd857147b0b95e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:42.706309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-84675fe2-bdc1-4c5b-8731-177a8ec3c0a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45fc427bd5a4fa883dd857147b0b95e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:42.719232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-84675fe2-bdc1-4c5b-8731-177a8ec3c0a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45fc427bd5a4fa883dd857147b0b95e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:42.739318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df5a57-3e61-45e7-be0a-27fece327245 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:42.741532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-75df5a57-3e61-45e7-be0a-27fece327245 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:42.750545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-84675fe2-bdc1-4c5b-8731-177a8ec3c0a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45fc427bd5a4fa883dd857147b0b95e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:42.772320 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1588/3210] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:42 2021] DELETE /identity/v3/users/e45fc427bd5a4fa883dd857147b0b95e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:51:42.776788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515bb87-177a-4715-80c9-6bf22ca2d091 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:42.777604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515bb87-177a-4715-80c9-6bf22ca2d091 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:42.777882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515bb87-177a-4715-80c9-6bf22ca2d091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:42.819180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4515bb87-177a-4715-80c9-6bf22ca2d091 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:42.823902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4515bb87-177a-4715-80c9-6bf22ca2d091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:42.877302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df5a57-3e61-45e7-be0a-27fece327245 tempest-RegionsTestJSON-1070053730 tempest-RegionsTestJSON-1070053730-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:42.941827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65cd7e-0851-4b6d-8500-1c7b0ed19ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:42.942525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65cd7e-0851-4b6d-8500-1c7b0ed19ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:42.942807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65cd7e-0851-4b6d-8500-1c7b0ed19ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:42.943079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65cd7e-0851-4b6d-8500-1c7b0ed19ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:42.944588 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1589/3211] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:42.945503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6d65cd7e-0851-4b6d-8500-1c7b0ed19ed0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:43.019894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515bb87-177a-4715-80c9-6bf22ca2d091 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:43.020117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4515bb87-177a-4715-80c9-6bf22ca2d091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:43.046565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515bb87-177a-4715-80c9-6bf22ca2d091 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:43.062983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91e07b-9cc1-483f-a4e2-938bc02dbb50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:43.063928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91e07b-9cc1-483f-a4e2-938bc02dbb50 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:43.064862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91e07b-9cc1-483f-a4e2-938bc02dbb50 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:43.064862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91e07b-9cc1-483f-a4e2-938bc02dbb50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:43.082908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65cd7e-0851-4b6d-8500-1c7b0ed19ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:43.085362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65cd7e-0851-4b6d-8500-1c7b0ed19ed0 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:43.090454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91e07b-9cc1-483f-a4e2-938bc02dbb50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:43.092351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91e07b-9cc1-483f-a4e2-938bc02dbb50 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:43.105823 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1590/3212] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:51:43.138826 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1623/3213] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:42 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:51:43.955469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91e07b-9cc1-483f-a4e2-938bc02dbb50 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:43.957498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bc91e07b-9cc1-483f-a4e2-938bc02dbb50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:43.987020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91e07b-9cc1-483f-a4e2-938bc02dbb50 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:43.992703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b26373-240f-45f5-bb60-478d247f3f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:43.993857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b26373-240f-45f5-bb60-478d247f3f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:43.994392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b26373-240f-45f5-bb60-478d247f3f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:43.995055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b26373-240f-45f5-bb60-478d247f3f40 admin admin] PATH_INFO: `/v3/projects/cd729ecccf9a45c089d0008aa750baff` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:44.007739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b26373-240f-45f5-bb60-478d247f3f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd729ecccf9a45c089d0008aa750baff)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:44.015569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b26373-240f-45f5-bb60-478d247f3f40 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:44.119271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-80b26373-240f-45f5-bb60-478d247f3f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd729ecccf9a45c089d0008aa750baff', 'request_id': 'req-80b26373-240f-45f5-bb60-478d247f3f40'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:44.133731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-80b26373-240f-45f5-bb60-478d247f3f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd729ecccf9a45c089d0008aa750baff', 'request_id': 'req-80b26373-240f-45f5-bb60-478d247f3f40'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:44.146314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-80b26373-240f-45f5-bb60-478d247f3f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd729ecccf9a45c089d0008aa750baff', 'request_id': 'req-80b26373-240f-45f5-bb60-478d247f3f40'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:44.169657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-80b26373-240f-45f5-bb60-478d247f3f40 admin admin] The token cache is being invalidate because project cd729ecccf9a45c089d0008aa750baff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:44.170540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-80b26373-240f-45f5-bb60-478d247f3f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:44.171275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-80b26373-240f-45f5-bb60-478d247f3f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:44.177626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65cd7e-0851-4b6d-8500-1c7b0ed19ed0 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:44.178229 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1591/3214] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:43 2021] DELETE /identity/v3/projects/cd729ecccf9a45c089d0008aa750baff => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:44.193357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65cd7e-0851-4b6d-8500-1c7b0ed19ed0 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:44.321033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5fbce-2afd-4547-8236-f1ef364119c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:44.325160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5fbce-2afd-4547-8236-f1ef364119c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:44.328764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5fbce-2afd-4547-8236-f1ef364119c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:44.329657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5fbce-2afd-4547-8236-f1ef364119c6 admin admin] PATH_INFO: `/v3/users/e9bdc8cd95aa4228b26a9b9ddea2565c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:44.335096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5fbce-2afd-4547-8236-f1ef364119c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9bdc8cd95aa4228b26a9b9ddea2565c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:44.341131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5fbce-2afd-4547-8236-f1ef364119c6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:44.455632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-55e5fbce-2afd-4547-8236-f1ef364119c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9bdc8cd95aa4228b26a9b9ddea2565c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:44.472703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-55e5fbce-2afd-4547-8236-f1ef364119c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9bdc8cd95aa4228b26a9b9ddea2565c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:44.473463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-55e5fbce-2afd-4547-8236-f1ef364119c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9bdc8cd95aa4228b26a9b9ddea2565c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:44.511077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-55e5fbce-2afd-4547-8236-f1ef364119c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9bdc8cd95aa4228b26a9b9ddea2565c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:44.532872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-55e5fbce-2afd-4547-8236-f1ef364119c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9bdc8cd95aa4228b26a9b9ddea2565c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:44.539926 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1624/3215] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:44 2021] DELETE /identity/v3/users/e9bdc8cd95aa4228b26a9b9ddea2565c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:45.161201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b26373-240f-45f5-bb60-478d247f3f40 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:45.162663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-80b26373-240f-45f5-bb60-478d247f3f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:45.178630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b26373-240f-45f5-bb60-478d247f3f40 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:45.263682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fca69e-6e0c-40aa-906b-227c0db94fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:45.266272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fca69e-6e0c-40aa-906b-227c0db94fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:45.266272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fca69e-6e0c-40aa-906b-227c0db94fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:45.266568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fca69e-6e0c-40aa-906b-227c0db94fd6 admin admin] PATH_INFO: `/v3/users/8cf273e7f6d646c4a6c46bc7a197c6a3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:45.275320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fca69e-6e0c-40aa-906b-227c0db94fd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf273e7f6d646c4a6c46bc7a197c6a3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:45.279139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fca69e-6e0c-40aa-906b-227c0db94fd6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:45.352238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5fbce-2afd-4547-8236-f1ef364119c6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:45.352807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-07fca69e-6e0c-40aa-906b-227c0db94fd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf273e7f6d646c4a6c46bc7a197c6a3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:45.354604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-55e5fbce-2afd-4547-8236-f1ef364119c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:45.361539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-07fca69e-6e0c-40aa-906b-227c0db94fd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf273e7f6d646c4a6c46bc7a197c6a3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:45.377473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-07fca69e-6e0c-40aa-906b-227c0db94fd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf273e7f6d646c4a6c46bc7a197c6a3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:45.378801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-07fca69e-6e0c-40aa-906b-227c0db94fd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf273e7f6d646c4a6c46bc7a197c6a3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:45.393097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-07fca69e-6e0c-40aa-906b-227c0db94fd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf273e7f6d646c4a6c46bc7a197c6a3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:45.402545 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1592/3216] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:45 2021] DELETE /identity/v3/users/8cf273e7f6d646c4a6c46bc7a197c6a3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:45.496289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5fbce-2afd-4547-8236-f1ef364119c6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:45.634519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f009f-eb43-4197-8511-bca7e5a0553f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:45.635140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f009f-eb43-4197-8511-bca7e5a0553f service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:45.635434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f009f-eb43-4197-8511-bca7e5a0553f service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:45.635717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f009f-eb43-4197-8511-bca7e5a0553f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:45.639438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8f5f009f-eb43-4197-8511-bca7e5a0553f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:45.717780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f009f-eb43-4197-8511-bca7e5a0553f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:45.731123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f009f-eb43-4197-8511-bca7e5a0553f service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:45.787116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fca69e-6e0c-40aa-906b-227c0db94fd6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:45.788608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-07fca69e-6e0c-40aa-906b-227c0db94fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:45.795494 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1625/3217] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:45 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:51:45.810521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f009f-eb43-4197-8511-bca7e5a0553f service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:45.812277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8f5f009f-eb43-4197-8511-bca7e5a0553f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:45.910442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f009f-eb43-4197-8511-bca7e5a0553f service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:45.915296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4415-11db-49f0-9bf5-988cafbf2874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:45.915990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4415-11db-49f0-9bf5-988cafbf2874 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:45.916365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4415-11db-49f0-9bf5-988cafbf2874 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:45.916654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4415-11db-49f0-9bf5-988cafbf2874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:45.919550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bffa4415-11db-49f0-9bf5-988cafbf2874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:45.933966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4415-11db-49f0-9bf5-988cafbf2874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:45.936736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4415-11db-49f0-9bf5-988cafbf2874 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:45.944170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fca69e-6e0c-40aa-906b-227c0db94fd6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:45.953287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da312851-fd78-4f9f-bed1-bb259e4e53e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:45.954492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da312851-fd78-4f9f-bed1-bb259e4e53e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:45.955239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da312851-fd78-4f9f-bed1-bb259e4e53e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:45.955239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da312851-fd78-4f9f-bed1-bb259e4e53e8 admin admin] PATH_INFO: `/v3/projects/260f5423c9c44b499073e360e0e66264` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:45.956613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da312851-fd78-4f9f-bed1-bb259e4e53e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=260f5423c9c44b499073e360e0e66264)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:45.960680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da312851-fd78-4f9f-bed1-bb259e4e53e8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:45.970660 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1626/3218] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:45 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:51:46.040576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da312851-fd78-4f9f-bed1-bb259e4e53e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260f5423c9c44b499073e360e0e66264', 'request_id': 'req-da312851-fd78-4f9f-bed1-bb259e4e53e8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:46.047481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da312851-fd78-4f9f-bed1-bb259e4e53e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260f5423c9c44b499073e360e0e66264', 'request_id': 'req-da312851-fd78-4f9f-bed1-bb259e4e53e8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:46.055052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da312851-fd78-4f9f-bed1-bb259e4e53e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260f5423c9c44b499073e360e0e66264', 'request_id': 'req-da312851-fd78-4f9f-bed1-bb259e4e53e8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:46.070000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da312851-fd78-4f9f-bed1-bb259e4e53e8 admin admin] The token cache is being invalidate because project 260f5423c9c44b499073e360e0e66264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:46.070700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da312851-fd78-4f9f-bed1-bb259e4e53e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:46.071565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da312851-fd78-4f9f-bed1-bb259e4e53e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:46.073432 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1593/3219] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:45 2021] DELETE /identity/v3/projects/260f5423c9c44b499073e360e0e66264 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:46.079847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd2c45-4498-49d5-947b-c0b922466831 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:46.080147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd2c45-4498-49d5-947b-c0b922466831 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:46.080443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd2c45-4498-49d5-947b-c0b922466831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:46.098602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c6fd2c45-4498-49d5-947b-c0b922466831 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:46.099862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c6fd2c45-4498-49d5-947b-c0b922466831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:46.177032 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1627/3220] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:46.178689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44af5c1-747c-43c2-9821-e04d3c89f47d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:46.180162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44af5c1-747c-43c2-9821-e04d3c89f47d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:46.180625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44af5c1-747c-43c2-9821-e04d3c89f47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:46.204790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d44af5c1-747c-43c2-9821-e04d3c89f47d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:46.206114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d44af5c1-747c-43c2-9821-e04d3c89f47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:46.218314 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1594/3221] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:46.219711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd2c45-4498-49d5-947b-c0b922466831 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:46.230741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd2c45-4498-49d5-947b-c0b922466831 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:46.236291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890706ee-fd8f-48e4-8126-b982c557e0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:46.236964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890706ee-fd8f-48e4-8126-b982c557e0ca admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:46.237319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890706ee-fd8f-48e4-8126-b982c557e0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:46.237606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890706ee-fd8f-48e4-8126-b982c557e0ca admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:46.238380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890706ee-fd8f-48e4-8126-b982c557e0ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:46.238689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890706ee-fd8f-48e4-8126-b982c557e0ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:46.240297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890706ee-fd8f-48e4-8126-b982c557e0ca admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:46.254744 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1628/3222] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:51:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:46.259606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44af5c1-747c-43c2-9821-e04d3c89f47d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:46.272130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44af5c1-747c-43c2-9821-e04d3c89f47d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:46.278136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc4791-40b9-4851-a08d-963d6b4a5bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:46.279687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc4791-40b9-4851-a08d-963d6b4a5bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:46.280356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc4791-40b9-4851-a08d-963d6b4a5bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:46.280356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc4791-40b9-4851-a08d-963d6b4a5bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:46.281258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc4791-40b9-4851-a08d-963d6b4a5bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:46.283512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc4791-40b9-4851-a08d-963d6b4a5bd1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:46.324402 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1595/3223] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:46 2021] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:46.325252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890706ee-fd8f-48e4-8126-b982c557e0ca admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:46.339482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890706ee-fd8f-48e4-8126-b982c557e0ca admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:46.485632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bfd4b-aa11-44dd-bb97-ee546a0157d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:46.486404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bfd4b-aa11-44dd-bb97-ee546a0157d0 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:46.488145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bfd4b-aa11-44dd-bb97-ee546a0157d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:46.488488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bfd4b-aa11-44dd-bb97-ee546a0157d0 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:46.489201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bfd4b-aa11-44dd-bb97-ee546a0157d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:46.491613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bfd4b-aa11-44dd-bb97-ee546a0157d0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:46.525041 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1629/3224] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:46 2021] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:46.527794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc4791-40b9-4851-a08d-963d6b4a5bd1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:46.546598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bfd4b-aa11-44dd-bb97-ee546a0157d0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:46.548886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-040bfd4b-aa11-44dd-bb97-ee546a0157d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:46.552027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc4791-40b9-4851-a08d-963d6b4a5bd1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:46.565411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b6395-6684-4687-b870-aad612075fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:46.566742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b6395-6684-4687-b870-aad612075fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:46.567198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b6395-6684-4687-b870-aad612075fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:46.568441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b6395-6684-4687-b870-aad612075fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:46.569642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b6395-6684-4687-b870-aad612075fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:46.571116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bfd4b-aa11-44dd-bb97-ee546a0157d0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:46.571706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b6395-6684-4687-b870-aad612075fe9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:46.578629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfb188-2829-46f0-a505-c33b4ec0e477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:46.579583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfb188-2829-46f0-a505-c33b4ec0e477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:46.579965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfb188-2829-46f0-a505-c33b4ec0e477 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:46.580426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfb188-2829-46f0-a505-c33b4ec0e477 admin admin] PATH_INFO: `/v3/projects/09ee069539d945268a3e6e8be8254e5e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:46.581769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfb188-2829-46f0-a505-c33b4ec0e477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09ee069539d945268a3e6e8be8254e5e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:46.584283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfb188-2829-46f0-a505-c33b4ec0e477 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:46.635837 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1596/3225] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:46 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:46.636869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b6395-6684-4687-b870-aad612075fe9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:46.657563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b6395-6684-4687-b870-aad612075fe9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:46.662722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3302043-8bee-4fb2-8f6f-3417b69b0e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:46.663597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3302043-8bee-4fb2-8f6f-3417b69b0e01 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:46.664075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3302043-8bee-4fb2-8f6f-3417b69b0e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:46.664533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3302043-8bee-4fb2-8f6f-3417b69b0e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:46.665443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3302043-8bee-4fb2-8f6f-3417b69b0e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:46.667962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3302043-8bee-4fb2-8f6f-3417b69b0e01 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:46.703325 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1597/3226] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:46 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:46.713721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3302043-8bee-4fb2-8f6f-3417b69b0e01 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:46.730657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3302043-8bee-4fb2-8f6f-3417b69b0e01 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:46.744904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-11dfb188-2829-46f0-a505-c33b4ec0e477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09ee069539d945268a3e6e8be8254e5e', 'request_id': 'req-11dfb188-2829-46f0-a505-c33b4ec0e477'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:46.757684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-11dfb188-2829-46f0-a505-c33b4ec0e477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09ee069539d945268a3e6e8be8254e5e', 'request_id': 'req-11dfb188-2829-46f0-a505-c33b4ec0e477'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:46.767510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-11dfb188-2829-46f0-a505-c33b4ec0e477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09ee069539d945268a3e6e8be8254e5e', 'request_id': 'req-11dfb188-2829-46f0-a505-c33b4ec0e477'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:46.782569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-11dfb188-2829-46f0-a505-c33b4ec0e477 admin admin] The token cache is being invalidate because project 09ee069539d945268a3e6e8be8254e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:46.782569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-11dfb188-2829-46f0-a505-c33b4ec0e477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:46.783904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-11dfb188-2829-46f0-a505-c33b4ec0e477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:46.791017 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1630/3227] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:46 2021] DELETE /identity/v3/projects/09ee069539d945268a3e6e8be8254e5e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:46.795423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41d17f-f606-4703-ad68-02a8ebebb77a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:46.795787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41d17f-f606-4703-ad68-02a8ebebb77a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:46.796217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41d17f-f606-4703-ad68-02a8ebebb77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:46.816649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8a41d17f-f606-4703-ad68-02a8ebebb77a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:46.817877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8a41d17f-f606-4703-ad68-02a8ebebb77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:46.853355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6be70-39ea-44a7-90a0-b489ea08b8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:46.854773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6be70-39ea-44a7-90a0-b489ea08b8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:46.855251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6be70-39ea-44a7-90a0-b489ea08b8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:46.855631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6be70-39ea-44a7-90a0-b489ea08b8cd admin admin] PATH_INFO: `/v3/projects/405bfbeb7b7d47c48b706aa32c6702bf/users/9073865992504246b9d1699da089c86f/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:46.877495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6be70-39ea-44a7-90a0-b489ea08b8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=405bfbeb7b7d47c48b706aa32c6702bf, user_id=9073865992504246b9d1699da089c86f, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:46.882644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6be70-39ea-44a7-90a0-b489ea08b8cd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:46.907111 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1598/3228] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:46 2021] PUT /identity/v3/projects/405bfbeb7b7d47c48b706aa32c6702bf/users/9073865992504246b9d1699da089c86f/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:46.912286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a49959-5883-42ad-99eb-75067f4d7357 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:46.913093 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1631/3229] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:46.918475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a49959-5883-42ad-99eb-75067f4d7357 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:46.918475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a49959-5883-42ad-99eb-75067f4d7357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:46.921980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582d3cc-90ae-4d6f-a449-bf6f324c14ba None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:46.922308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582d3cc-90ae-4d6f-a449-bf6f324c14ba None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:46.922611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582d3cc-90ae-4d6f-a449-bf6f324c14ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:46.943284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0582d3cc-90ae-4d6f-a449-bf6f324c14ba None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:46.944553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0582d3cc-90ae-4d6f-a449-bf6f324c14ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:46.946411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e1a49959-5883-42ad-99eb-75067f4d7357 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:46.949622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e1a49959-5883-42ad-99eb-75067f4d7357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:47.041425 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1632/3230] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:47.042438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582d3cc-90ae-4d6f-a449-bf6f324c14ba None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:47.054363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582d3cc-90ae-4d6f-a449-bf6f324c14ba None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:47.061219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6046e79-f4b1-4654-923f-e57818d219d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:47.062192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6046e79-f4b1-4654-923f-e57818d219d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:47.062715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6046e79-f4b1-4654-923f-e57818d219d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:47.063003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6046e79-f4b1-4654-923f-e57818d219d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:47.063946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6046e79-f4b1-4654-923f-e57818d219d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:47.064262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6046e79-f4b1-4654-923f-e57818d219d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:47.066162 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1599/3231] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:47.071134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6046e79-f4b1-4654-923f-e57818d219d1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:47.092477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a49959-5883-42ad-99eb-75067f4d7357 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:47.093973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e1a49959-5883-42ad-99eb-75067f4d7357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:47.112264 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1633/3232] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:51:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:47.115151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6046e79-f4b1-4654-923f-e57818d219d1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:47.134994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6046e79-f4b1-4654-923f-e57818d219d1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:47.141935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0c5e6-72ca-4287-93fb-83f7464f4495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:47.143146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0c5e6-72ca-4287-93fb-83f7464f4495 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:47.143533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0c5e6-72ca-4287-93fb-83f7464f4495 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:47.143912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0c5e6-72ca-4287-93fb-83f7464f4495 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:47.144739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0c5e6-72ca-4287-93fb-83f7464f4495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:47.146977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0c5e6-72ca-4287-93fb-83f7464f4495 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:47.197645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a49959-5883-42ad-99eb-75067f4d7357 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:47.204258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ce295-3dc4-4f9a-83b8-f9623a6e877c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:47.205986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce295-3dc4-4f9a-83b8-f9623a6e877c service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:47.206444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce295-3dc4-4f9a-83b8-f9623a6e877c service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:47.206797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce295-3dc4-4f9a-83b8-f9623a6e877c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:47.217609 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1634/3233] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:47 2021] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:47.219622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469df31-5b76-4350-bf8f-93f58f54d49b None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:47.219622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469df31-5b76-4350-bf8f-93f58f54d49b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:47.219622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469df31-5b76-4350-bf8f-93f58f54d49b None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:47.224900 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1635/3234] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:51:47 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:51:47.226227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ce295-3dc4-4f9a-83b8-f9623a6e877c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:47.228499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469df31-5b76-4350-bf8f-93f58f54d49b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:47.229338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ce295-3dc4-4f9a-83b8-f9623a6e877c service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:47.249315 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1600/3235] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:51:47.253160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35a2dc-f199-40bf-a611-8cd5139720c8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:47.253160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35a2dc-f199-40bf-a611-8cd5139720c8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:47.255420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35a2dc-f199-40bf-a611-8cd5139720c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:47.292308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9f35a2dc-f199-40bf-a611-8cd5139720c8 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:47.293611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9f35a2dc-f199-40bf-a611-8cd5139720c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:47.357632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469df31-5b76-4350-bf8f-93f58f54d49b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:47.372987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a499fc-7234-45b3-a59f-20dac6285947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:47.373987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a499fc-7234-45b3-a59f-20dac6285947 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:47.374336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a499fc-7234-45b3-a59f-20dac6285947 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:47.374708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a499fc-7234-45b3-a59f-20dac6285947 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:47.375577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a499fc-7234-45b3-a59f-20dac6285947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:47.378638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a499fc-7234-45b3-a59f-20dac6285947 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:47.431933 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1636/3236] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:47 2021] POST /identity/v3/users => generated 291 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:47.437725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a499fc-7234-45b3-a59f-20dac6285947 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:47.442591 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1601/3237] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:51:47 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:47.452138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a499fc-7234-45b3-a59f-20dac6285947 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:47.457134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d66a9-8438-4e79-b417-00a0ed06837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:47.457879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d66a9-8438-4e79-b417-00a0ed06837f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:47.458237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d66a9-8438-4e79-b417-00a0ed06837f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:47.458787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d66a9-8438-4e79-b417-00a0ed06837f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:47.459599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d66a9-8438-4e79-b417-00a0ed06837f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:47.461303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d66a9-8438-4e79-b417-00a0ed06837f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:47.478839 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1637/3238] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:47 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:47.482449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35a2dc-f199-40bf-a611-8cd5139720c8 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:47.482853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d66a9-8438-4e79-b417-00a0ed06837f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:47.484788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9f35a2dc-f199-40bf-a611-8cd5139720c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:47.496971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d66a9-8438-4e79-b417-00a0ed06837f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:47.505070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d71453-1895-434d-96f3-8e944f46a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:47.505747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d71453-1895-434d-96f3-8e944f46a059 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:47.506039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d71453-1895-434d-96f3-8e944f46a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:47.506371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d71453-1895-434d-96f3-8e944f46a059 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:47.507609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d71453-1895-434d-96f3-8e944f46a059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:47.508817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d71453-1895-434d-96f3-8e944f46a059 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:47.513203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35a2dc-f199-40bf-a611-8cd5139720c8 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:47.524798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8e4f2-2d56-444d-87af-75dd7b1aab48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:47.525189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8e4f2-2d56-444d-87af-75dd7b1aab48 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:47.525805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8e4f2-2d56-444d-87af-75dd7b1aab48 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:47.525805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8e4f2-2d56-444d-87af-75dd7b1aab48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:47.532597 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1638/3239] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:47 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:51:47.534320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d71453-1895-434d-96f3-8e944f46a059 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:47.545051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d71453-1895-434d-96f3-8e944f46a059 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:47.552205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dd41e-8b62-49ab-81bb-4dc586fc5c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:47.552805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8e4f2-2d56-444d-87af-75dd7b1aab48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:47.553395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dd41e-8b62-49ab-81bb-4dc586fc5c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:47.554392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dd41e-8b62-49ab-81bb-4dc586fc5c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:47.554728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dd41e-8b62-49ab-81bb-4dc586fc5c7a admin admin] PATH_INFO: `/v3/projects/c34be471588b488abdc545428c8564ba/users/cf2ae5017a434b10967f5b1df767dcdb/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:47.557648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8e4f2-2d56-444d-87af-75dd7b1aab48 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:47.574117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dd41e-8b62-49ab-81bb-4dc586fc5c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34be471588b488abdc545428c8564ba, user_id=cf2ae5017a434b10967f5b1df767dcdb, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:47.578293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dd41e-8b62-49ab-81bb-4dc586fc5c7a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:47.578525 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1602/3240] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:47 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:51:47.610316 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1639/3241] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:47 2021] PUT /identity/v3/projects/c34be471588b488abdc545428c8564ba/users/cf2ae5017a434b10967f5b1df767dcdb/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:47.619551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8dc4e-916c-4325-b5c0-b09d96d67a9d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:47.619831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8dc4e-916c-4325-b5c0-b09d96d67a9d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:47.620169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8dc4e-916c-4325-b5c0-b09d96d67a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:47.665010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-93d8dc4e-916c-4325-b5c0-b09d96d67a9d None None] MFA Rules not processed for user `cf2ae5017a434b10967f5b1df767dcdb`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:47.667148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-93d8dc4e-916c-4325-b5c0-b09d96d67a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:47.904221 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1603/3242] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:47 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:47.909109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dd41e-8b62-49ab-81bb-4dc586fc5c7a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:47.993344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dd41e-8b62-49ab-81bb-4dc586fc5c7a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:47.999153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40857-4348-4879-b5fa-be16ef5a7433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:48.000120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40857-4348-4879-b5fa-be16ef5a7433 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:48.000404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40857-4348-4879-b5fa-be16ef5a7433 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:48.000681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40857-4348-4879-b5fa-be16ef5a7433 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:48.001430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e40857-4348-4879-b5fa-be16ef5a7433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:48.003403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e40857-4348-4879-b5fa-be16ef5a7433 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:48.031382 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1640/3243] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:47 2021] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:48.035343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8dc4e-916c-4325-b5c0-b09d96d67a9d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:48.046865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8dc4e-916c-4325-b5c0-b09d96d67a9d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:48.122009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b85ac9-691d-46f2-a061-0173ae5072fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:48.122797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b85ac9-691d-46f2-a061-0173ae5072fc admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:48.123162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b85ac9-691d-46f2-a061-0173ae5072fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:48.123602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b85ac9-691d-46f2-a061-0173ae5072fc admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:48.124728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b85ac9-691d-46f2-a061-0173ae5072fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:48.126865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b85ac9-691d-46f2-a061-0173ae5072fc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:48.155702 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1604/3244] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:48 2021] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:48.158196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40857-4348-4879-b5fa-be16ef5a7433 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:48.172603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40857-4348-4879-b5fa-be16ef5a7433 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:48.183452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b0fcb-82bf-4ee0-b1d4-24af378e5ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:48.184300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b0fcb-82bf-4ee0-b1d4-24af378e5ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:48.184839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b0fcb-82bf-4ee0-b1d4-24af378e5ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:48.185152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b0fcb-82bf-4ee0-b1d4-24af378e5ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:48.186011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b0fcb-82bf-4ee0-b1d4-24af378e5ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:48.187647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b0fcb-82bf-4ee0-b1d4-24af378e5ad7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:48.202622 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1641/3245] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:48 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:48.207589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b85ac9-691d-46f2-a061-0173ae5072fc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:48.219420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b85ac9-691d-46f2-a061-0173ae5072fc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:48.225734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810f229-fe71-4c65-9611-1ae37ad7912d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:48.226461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810f229-fe71-4c65-9611-1ae37ad7912d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:48.226856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810f229-fe71-4c65-9611-1ae37ad7912d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:48.227148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810f229-fe71-4c65-9611-1ae37ad7912d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:48.228091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810f229-fe71-4c65-9611-1ae37ad7912d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:48.230618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810f229-fe71-4c65-9611-1ae37ad7912d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:48.247633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b0fcb-82bf-4ee0-b1d4-24af378e5ad7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:48.250379 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1605/3246] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:48 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:48.252331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3de70c-e6cf-4cc5-a9fe-f118540573be None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:48.252795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3de70c-e6cf-4cc5-a9fe-f118540573be None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:48.253092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3de70c-e6cf-4cc5-a9fe-f118540573be None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:48.258458 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1606/3247] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:51:48 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:51:48.259236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b0fcb-82bf-4ee0-b1d4-24af378e5ad7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:48.261828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442c967-5c60-4a06-9b85-4a5f258280e6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:48.262131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442c967-5c60-4a06-9b85-4a5f258280e6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:48.262504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442c967-5c60-4a06-9b85-4a5f258280e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:48.265336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d50eec-82dc-40ba-954e-924f979265ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:48.266843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d50eec-82dc-40ba-954e-924f979265ec admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:48.267418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d50eec-82dc-40ba-954e-924f979265ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:48.267885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d50eec-82dc-40ba-954e-924f979265ec admin admin] PATH_INFO: `/v3/projects/8bea86f9af124c4aae294f7c0f5b6cf2/users/11244e26f558496fb9da334e092f4117/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:48.293180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d50eec-82dc-40ba-954e-924f979265ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bea86f9af124c4aae294f7c0f5b6cf2, user_id=11244e26f558496fb9da334e092f4117, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:48.294827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b442c967-5c60-4a06-9b85-4a5f258280e6 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:48.296939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b442c967-5c60-4a06-9b85-4a5f258280e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:48.301316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d50eec-82dc-40ba-954e-924f979265ec admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:48.336113 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1642/3248] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:48 2021] PUT /identity/v3/projects/8bea86f9af124c4aae294f7c0f5b6cf2/users/11244e26f558496fb9da334e092f4117/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:48.338152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2595c6-a752-46bf-a475-198faf3eb406 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:48.339468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2595c6-a752-46bf-a475-198faf3eb406 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:48.339930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2595c6-a752-46bf-a475-198faf3eb406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:48.372233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9a2595c6-a752-46bf-a475-198faf3eb406 None None] MFA Rules not processed for user `11244e26f558496fb9da334e092f4117`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:48.373913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9a2595c6-a752-46bf-a475-198faf3eb406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:48.407384 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1607/3249] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:51:48 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:48.435300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442c967-5c60-4a06-9b85-4a5f258280e6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:48.457846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442c967-5c60-4a06-9b85-4a5f258280e6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:48.531773 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1643/3250] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:48 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:48.537832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2595c6-a752-46bf-a475-198faf3eb406 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:48.593930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1fd9b7-bc42-4d14-8de5-0232d4dd43bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:48.594623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fd9b7-bc42-4d14-8de5-0232d4dd43bc service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:48.594908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fd9b7-bc42-4d14-8de5-0232d4dd43bc service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:48.595185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fd9b7-bc42-4d14-8de5-0232d4dd43bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:48.617506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1fd9b7-bc42-4d14-8de5-0232d4dd43bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:48.619124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1fd9b7-bc42-4d14-8de5-0232d4dd43bc service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:48.642571 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1608/3251] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:48 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:51:48.659198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2595c6-a752-46bf-a475-198faf3eb406 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:48.679209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10784850-8a16-47a5-b2f2-30774a4bfafc tempest-IdentityV3ProjectsTest-2007218842 tempest-IdentityV3ProjectsTest-2007218842-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ae5017a434b10967f5b1df767dcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34be471588b488abdc545428c8564ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:48.687147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10784850-8a16-47a5-b2f2-30774a4bfafc tempest-IdentityV3ProjectsTest-2007218842 tempest-IdentityV3ProjectsTest-2007218842-project] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:48.687147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10784850-8a16-47a5-b2f2-30774a4bfafc tempest-IdentityV3ProjectsTest-2007218842 tempest-IdentityV3ProjectsTest-2007218842-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:48.687800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10784850-8a16-47a5-b2f2-30774a4bfafc tempest-IdentityV3ProjectsTest-2007218842 tempest-IdentityV3ProjectsTest-2007218842-project] PATH_INFO: `/v3/users/cf2ae5017a434b10967f5b1df767dcdb/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:48.691412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10784850-8a16-47a5-b2f2-30774a4bfafc tempest-IdentityV3ProjectsTest-2007218842 tempest-IdentityV3ProjectsTest-2007218842-project] RBAC: Authorizing `identity:list_user_projects(user_id=cf2ae5017a434b10967f5b1df767dcdb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:48.697883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10784850-8a16-47a5-b2f2-30774a4bfafc tempest-IdentityV3ProjectsTest-2007218842 tempest-IdentityV3ProjectsTest-2007218842-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:48.821398 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1644/3252] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 20:51:48 2021] GET /identity/v3/users/cf2ae5017a434b10967f5b1df767dcdb/projects => generated 517 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:48.827914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574c084-0df0-4965-9773-f164caa6ca83 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:48.828417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574c084-0df0-4965-9773-f164caa6ca83 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:48.829753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574c084-0df0-4965-9773-f164caa6ca83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:48.877178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e574c084-0df0-4965-9773-f164caa6ca83 None None] MFA Rules not processed for user `cf2ae5017a434b10967f5b1df767dcdb`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:48.879189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e574c084-0df0-4965-9773-f164caa6ca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:48.895830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b750a-10e6-41dc-a05a-d7ca4621138d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:48.896262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b750a-10e6-41dc-a05a-d7ca4621138d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:48.896643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b750a-10e6-41dc-a05a-d7ca4621138d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:48.906477 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1609/3253] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:48 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:48.926406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-231b750a-10e6-41dc-a05a-d7ca4621138d None None] MFA Rules not processed for user `cf2ae5017a434b10967f5b1df767dcdb`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:48.929282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-231b750a-10e6-41dc-a05a-d7ca4621138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:49.032927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.models.token_model [None req-231b750a-10e6-41dc-a05a-d7ca4621138d None None] User cf2ae5017a434b10967f5b1df767dcdb has no access to project 8bea86f9af124c4aae294f7c0f5b6cf2 {{(pid=96646) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Dec 18 20:51:49.037444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574c084-0df0-4965-9773-f164caa6ca83 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:49.039011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e574c084-0df0-4965-9773-f164caa6ca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:49.039506 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-231b750a-10e6-41dc-a05a-d7ca4621138d None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Dec 18 20:51:49.050634 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1645/3254] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:48 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 156 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Dec 18 20:51:49.051634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b750a-10e6-41dc-a05a-d7ca4621138d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:49.183620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b750a-10e6-41dc-a05a-d7ca4621138d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:49.194813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fb38d-d7a5-4a1f-bfcd-f28c2a9e3b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:49.195829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fb38d-d7a5-4a1f-bfcd-f28c2a9e3b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:49.197755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fb38d-d7a5-4a1f-bfcd-f28c2a9e3b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:49.198157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fb38d-d7a5-4a1f-bfcd-f28c2a9e3b63 admin admin] PATH_INFO: `/v3/users/cf2ae5017a434b10967f5b1df767dcdb` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:49.201220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fb38d-d7a5-4a1f-bfcd-f28c2a9e3b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2ae5017a434b10967f5b1df767dcdb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:49.204586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fb38d-d7a5-4a1f-bfcd-f28c2a9e3b63 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:49.212634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574c084-0df0-4965-9773-f164caa6ca83 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:49.228582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1aac6-d3d0-405b-9ce0-4cb9cb06e282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:49.229263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1aac6-d3d0-405b-9ce0-4cb9cb06e282 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:49.229549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1aac6-d3d0-405b-9ce0-4cb9cb06e282 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:49.229873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1aac6-d3d0-405b-9ce0-4cb9cb06e282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:49.232950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8ef1aac6-d3d0-405b-9ce0-4cb9cb06e282 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:49.256787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1aac6-d3d0-405b-9ce0-4cb9cb06e282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:49.263852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1aac6-d3d0-405b-9ce0-4cb9cb06e282 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:49.292820 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1610/3255] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:49 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:51:49.294227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5e1fb38d-d7a5-4a1f-bfcd-f28c2a9e3b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2ae5017a434b10967f5b1df767dcdb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:49.302002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5e1fb38d-d7a5-4a1f-bfcd-f28c2a9e3b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2ae5017a434b10967f5b1df767dcdb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:49.302841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5e1fb38d-d7a5-4a1f-bfcd-f28c2a9e3b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2ae5017a434b10967f5b1df767dcdb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:49.317607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5e1fb38d-d7a5-4a1f-bfcd-f28c2a9e3b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2ae5017a434b10967f5b1df767dcdb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:49.338895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5e1fb38d-d7a5-4a1f-bfcd-f28c2a9e3b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2ae5017a434b10967f5b1df767dcdb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:49.346141 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1646/3256] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:49 2021] DELETE /identity/v3/users/cf2ae5017a434b10967f5b1df767dcdb => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:49.350734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca061b-96c8-4349-81bd-7e147da2a411 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:49.351029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca061b-96c8-4349-81bd-7e147da2a411 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:49.351309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca061b-96c8-4349-81bd-7e147da2a411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:49.371022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-05ca061b-96c8-4349-81bd-7e147da2a411 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:49.372688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-05ca061b-96c8-4349-81bd-7e147da2a411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:49.516611 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1611/3257] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:49.536228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fb38d-d7a5-4a1f-bfcd-f28c2a9e3b63 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:49.537827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5e1fb38d-d7a5-4a1f-bfcd-f28c2a9e3b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:49.722098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fb38d-d7a5-4a1f-bfcd-f28c2a9e3b63 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:49.742515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f74ad2-667f-4358-93f2-1c80536806f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:49.753287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f74ad2-667f-4358-93f2-1c80536806f6 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:49.753962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f74ad2-667f-4358-93f2-1c80536806f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:49.754793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f74ad2-667f-4358-93f2-1c80536806f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:49.771897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f74ad2-667f-4358-93f2-1c80536806f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:49.774324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f74ad2-667f-4358-93f2-1c80536806f6 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:49.797995 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1647/3258] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:51:50.461277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca061b-96c8-4349-81bd-7e147da2a411 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:50.464045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-05ca061b-96c8-4349-81bd-7e147da2a411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:50.483085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca061b-96c8-4349-81bd-7e147da2a411 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:50.497923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:50.503749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:50.505333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:50.505333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1 admin admin] PATH_INFO: `/v3/projects/c34be471588b488abdc545428c8564ba` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:50.508258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34be471588b488abdc545428c8564ba)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:50.537147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:50.651166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34be471588b488abdc545428c8564ba', 'request_id': 'req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:50.660952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34be471588b488abdc545428c8564ba', 'request_id': 'req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:50.666588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34be471588b488abdc545428c8564ba', 'request_id': 'req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:50.686470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1 admin admin] The token cache is being invalidate because project c34be471588b488abdc545428c8564ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:50.686766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:50.687496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:50.690218 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1612/3259] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:50 2021] DELETE /identity/v3/projects/c34be471588b488abdc545428c8564ba => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:50.694322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f74ad2-667f-4358-93f2-1c80536806f6 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:50.706645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f74ad2-667f-4358-93f2-1c80536806f6 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:50.795155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b5905-757b-4a1a-939c-9731db746669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:50.796005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b5905-757b-4a1a-939c-9731db746669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:50.796431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b5905-757b-4a1a-939c-9731db746669 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:50.796714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b5905-757b-4a1a-939c-9731db746669 admin admin] PATH_INFO: `/v3/users/11244e26f558496fb9da334e092f4117` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:50.810073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b5905-757b-4a1a-939c-9731db746669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11244e26f558496fb9da334e092f4117)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:50.812074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b5905-757b-4a1a-939c-9731db746669 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:50.889922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-976b5905-757b-4a1a-939c-9731db746669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11244e26f558496fb9da334e092f4117'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:50.899769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-976b5905-757b-4a1a-939c-9731db746669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11244e26f558496fb9da334e092f4117'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:50.912470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-976b5905-757b-4a1a-939c-9731db746669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11244e26f558496fb9da334e092f4117'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:50.936379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-976b5905-757b-4a1a-939c-9731db746669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11244e26f558496fb9da334e092f4117'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:50.949470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-976b5905-757b-4a1a-939c-9731db746669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11244e26f558496fb9da334e092f4117'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:50.959566 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1648/3260] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:50 2021] DELETE /identity/v3/users/11244e26f558496fb9da334e092f4117 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:51:52.301767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:52.304873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:52.320806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d2878-8aaf-4a8b-a22e-5f78f14c39e1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:52.449676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb8cc5-c6c5-4087-92f4-a6ce08a4b24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:52.450617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb8cc5-c6c5-4087-92f4-a6ce08a4b24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:52.450904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb8cc5-c6c5-4087-92f4-a6ce08a4b24e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:52.451550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb8cc5-c6c5-4087-92f4-a6ce08a4b24e admin admin] PATH_INFO: `/v3/projects/8bea86f9af124c4aae294f7c0f5b6cf2` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:52.455411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb8cc5-c6c5-4087-92f4-a6ce08a4b24e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bea86f9af124c4aae294f7c0f5b6cf2)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:52.457677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb8cc5-c6c5-4087-92f4-a6ce08a4b24e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:52.666442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0fbb8cc5-c6c5-4087-92f4-a6ce08a4b24e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bea86f9af124c4aae294f7c0f5b6cf2', 'request_id': 'req-0fbb8cc5-c6c5-4087-92f4-a6ce08a4b24e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:52.686744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0fbb8cc5-c6c5-4087-92f4-a6ce08a4b24e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bea86f9af124c4aae294f7c0f5b6cf2', 'request_id': 'req-0fbb8cc5-c6c5-4087-92f4-a6ce08a4b24e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:52.702589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0fbb8cc5-c6c5-4087-92f4-a6ce08a4b24e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bea86f9af124c4aae294f7c0f5b6cf2', 'request_id': 'req-0fbb8cc5-c6c5-4087-92f4-a6ce08a4b24e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:52.753292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0fbb8cc5-c6c5-4087-92f4-a6ce08a4b24e admin admin] The token cache is being invalidate because project 8bea86f9af124c4aae294f7c0f5b6cf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:51:52.754281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0fbb8cc5-c6c5-4087-92f4-a6ce08a4b24e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:52.757130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0fbb8cc5-c6c5-4087-92f4-a6ce08a4b24e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:52.768078 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1613/3261] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:51:52 2021] DELETE /identity/v3/projects/8bea86f9af124c4aae294f7c0f5b6cf2 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:52.768943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c846e-f099-4567-9a0e-f441b04d6163 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:52.769728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c846e-f099-4567-9a0e-f441b04d6163 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:52.770203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c846e-f099-4567-9a0e-f441b04d6163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:52.811568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e42c846e-f099-4567-9a0e-f441b04d6163 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:52.812748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e42c846e-f099-4567-9a0e-f441b04d6163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:52.924167 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1649/3262] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:52.933777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36298ea4-7371-4846-b284-550d7228a905 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:52.934766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36298ea4-7371-4846-b284-550d7228a905 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:52.935045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36298ea4-7371-4846-b284-550d7228a905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:52.969014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-36298ea4-7371-4846-b284-550d7228a905 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:52.969965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-36298ea4-7371-4846-b284-550d7228a905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:52.982072 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1614/3263] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:52.986212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c846e-f099-4567-9a0e-f441b04d6163 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:53.002895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c846e-f099-4567-9a0e-f441b04d6163 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:53.018794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffe926-781c-4604-96b6-c7699c18e407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:53.021047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffe926-781c-4604-96b6-c7699c18e407 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:53.021348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffe926-781c-4604-96b6-c7699c18e407 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:53.021628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffe926-781c-4604-96b6-c7699c18e407 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:53.024519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffe926-781c-4604-96b6-c7699c18e407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:51:53.024835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffe926-781c-4604-96b6-c7699c18e407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:53.027562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffe926-781c-4604-96b6-c7699c18e407 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:53.053788 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1650/3264] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:51:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:51:53.058459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36298ea4-7371-4846-b284-550d7228a905 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:53.073605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36298ea4-7371-4846-b284-550d7228a905 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:53.085600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d704c-aca9-4eb6-a377-0dfd0cdbacb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:53.086402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d704c-aca9-4eb6-a377-0dfd0cdbacb3 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:53.086776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d704c-aca9-4eb6-a377-0dfd0cdbacb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:53.087104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d704c-aca9-4eb6-a377-0dfd0cdbacb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:53.087904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d704c-aca9-4eb6-a377-0dfd0cdbacb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:53.090193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d704c-aca9-4eb6-a377-0dfd0cdbacb3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:53.152576 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1615/3265] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:53 2021] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:53.157117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffe926-781c-4604-96b6-c7699c18e407 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:53.177988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffe926-781c-4604-96b6-c7699c18e407 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:53.270084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b42f6-b839-4030-8464-7cd20f4ece1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:53.270084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b42f6-b839-4030-8464-7cd20f4ece1f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:53.270084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b42f6-b839-4030-8464-7cd20f4ece1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:53.270084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b42f6-b839-4030-8464-7cd20f4ece1f admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:53.270542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b42f6-b839-4030-8464-7cd20f4ece1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:53.270542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b42f6-b839-4030-8464-7cd20f4ece1f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:53.298461 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1651/3266] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:53 2021] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:53.302745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d704c-aca9-4eb6-a377-0dfd0cdbacb3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:53.320969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d704c-aca9-4eb6-a377-0dfd0cdbacb3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:53.327558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d4992-faa2-4507-b5c8-3d273de77ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:53.328256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d4992-faa2-4507-b5c8-3d273de77ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:53.328619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d4992-faa2-4507-b5c8-3d273de77ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:53.328973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d4992-faa2-4507-b5c8-3d273de77ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:53.329795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d4992-faa2-4507-b5c8-3d273de77ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:53.332573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d4992-faa2-4507-b5c8-3d273de77ee3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:53.361192 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1616/3267] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:53 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:51:53.362580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b42f6-b839-4030-8464-7cd20f4ece1f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:53.378982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b42f6-b839-4030-8464-7cd20f4ece1f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:53.387788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b62fea-9127-4699-b083-d503d791251e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:53.404651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b62fea-9127-4699-b083-d503d791251e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:53.405009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b62fea-9127-4699-b083-d503d791251e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:53.405301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b62fea-9127-4699-b083-d503d791251e admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:53.406122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b62fea-9127-4699-b083-d503d791251e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:53.414579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b62fea-9127-4699-b083-d503d791251e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:53.443142 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1652/3268] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:53 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:53.446470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d4992-faa2-4507-b5c8-3d273de77ee3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:53.465672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d4992-faa2-4507-b5c8-3d273de77ee3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:53.484091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce524b5-ee2c-4619-9046-4a0f3588dc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:53.485127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce524b5-ee2c-4619-9046-4a0f3588dc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:53.485415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce524b5-ee2c-4619-9046-4a0f3588dc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:53.485738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce524b5-ee2c-4619-9046-4a0f3588dc1e admin admin] PATH_INFO: `/v3/projects/1094352abf294f22bda41c1216d137d8/users/dcae82bce09b41f09318d910a8fb48cc/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:53.531725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce524b5-ee2c-4619-9046-4a0f3588dc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1094352abf294f22bda41c1216d137d8, user_id=dcae82bce09b41f09318d910a8fb48cc, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:53.539139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce524b5-ee2c-4619-9046-4a0f3588dc1e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:53.598181 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1617/3269] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:53 2021] PUT /identity/v3/projects/1094352abf294f22bda41c1216d137d8/users/dcae82bce09b41f09318d910a8fb48cc/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:53.610452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7200c4-5061-4fdb-a2b3-10d689b319be None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:53.611366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7200c4-5061-4fdb-a2b3-10d689b319be None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:53.613100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7200c4-5061-4fdb-a2b3-10d689b319be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:53.663371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fa7200c4-5061-4fdb-a2b3-10d689b319be None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:53.678350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fa7200c4-5061-4fdb-a2b3-10d689b319be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:53.788986 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1653/3270] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:53 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:53.793543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce524b5-ee2c-4619-9046-4a0f3588dc1e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:53.812242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce524b5-ee2c-4619-9046-4a0f3588dc1e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:53.823952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbea337-8d45-4dff-a95e-6c747a1efb7c tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcae82bce09b41f09318d910a8fb48cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1094352abf294f22bda41c1216d137d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:53.824959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbea337-8d45-4dff-a95e-6c747a1efb7c tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:53.825362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbea337-8d45-4dff-a95e-6c747a1efb7c tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:53.825770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbea337-8d45-4dff-a95e-6c747a1efb7c tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] PATH_INFO: `/v3/users/dcae82bce09b41f09318d910a8fb48cc/password` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:53.920109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8bbea337-8d45-4dff-a95e-6c747a1efb7c tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dcae82bce09b41f09318d910a8fb48cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:53.932622 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1618/3271] 10.222.0.13 () {60 vars in 1268 bytes} [Sat Dec 18 20:51:53 2021] POST /identity/v3/users/dcae82bce09b41f09318d910a8fb48cc/password => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:54.937599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa725a-dc27-4eff-8f9d-04fbae52456c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:54.938564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa725a-dc27-4eff-8f9d-04fbae52456c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:54.939036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa725a-dc27-4eff-8f9d-04fbae52456c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:54.982169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7efa725a-dc27-4eff-8f9d-04fbae52456c None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:54.984333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7efa725a-dc27-4eff-8f9d-04fbae52456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:55.000667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f209f-308d-4b8d-a444-d84f7206364d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:55.001498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f209f-308d-4b8d-a444-d84f7206364d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:55.001934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f209f-308d-4b8d-a444-d84f7206364d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:55.011605 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1654/3272] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:54 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:55.050565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8e1f209f-308d-4b8d-a444-d84f7206364d None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:55.054273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8e1f209f-308d-4b8d-a444-d84f7206364d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:55.078198 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1619/3273] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:54 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:55.079560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa725a-dc27-4eff-8f9d-04fbae52456c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:55.107453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa725a-dc27-4eff-8f9d-04fbae52456c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:55.128657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0f1e2-9de2-4fcf-8712-fe34c13ea289 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcae82bce09b41f09318d910a8fb48cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1094352abf294f22bda41c1216d137d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:55.129696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0f1e2-9de2-4fcf-8712-fe34c13ea289 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:55.130190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0f1e2-9de2-4fcf-8712-fe34c13ea289 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:55.131018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0f1e2-9de2-4fcf-8712-fe34c13ea289 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] PATH_INFO: `/v3/users/dcae82bce09b41f09318d910a8fb48cc/password` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:55.224184 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-dec0f1e2-9de2-4fcf-8712-fe34c13ea289 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Dec 18 20:51:55.230980 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1655/3274] 10.222.0.13 () {60 vars in 1268 bytes} [Sat Dec 18 20:51:55 2021] POST /identity/v3/users/dcae82bce09b41f09318d910a8fb48cc/password => generated 188 bytes in 152 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 18 20:51:55.235865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f209f-308d-4b8d-a444-d84f7206364d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:55.246978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f209f-308d-4b8d-a444-d84f7206364d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:55.260261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42619c4e-dc64-4153-a92b-26bddab36563 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcae82bce09b41f09318d910a8fb48cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1094352abf294f22bda41c1216d137d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:55.261387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42619c4e-dc64-4153-a92b-26bddab36563 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:55.262104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42619c4e-dc64-4153-a92b-26bddab36563 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:55.262576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42619c4e-dc64-4153-a92b-26bddab36563 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] PATH_INFO: `/v3/users/dcae82bce09b41f09318d910a8fb48cc/password` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:55.349621 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-42619c4e-dc64-4153-a92b-26bddab36563 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Dec 18 20:51:55.357694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0f1e2-9de2-4fcf-8712-fe34c13ea289 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:55.362844 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1620/3275] 10.222.0.13 () {60 vars in 1268 bytes} [Sat Dec 18 20:51:55 2021] POST /identity/v3/users/dcae82bce09b41f09318d910a8fb48cc/password => generated 188 bytes in 127 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 18 20:51:55.392990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0f1e2-9de2-4fcf-8712-fe34c13ea289 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:55.405295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c14f83-a098-4942-88d9-02280c0b0f9c tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcae82bce09b41f09318d910a8fb48cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1094352abf294f22bda41c1216d137d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:55.406743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c14f83-a098-4942-88d9-02280c0b0f9c tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:55.407048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c14f83-a098-4942-88d9-02280c0b0f9c tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:55.407334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c14f83-a098-4942-88d9-02280c0b0f9c tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] PATH_INFO: `/v3/users/dcae82bce09b41f09318d910a8fb48cc/password` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:55.502409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-32c14f83-a098-4942-88d9-02280c0b0f9c tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dcae82bce09b41f09318d910a8fb48cc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:55.523878 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1656/3276] 10.222.0.13 () {60 vars in 1268 bytes} [Sat Dec 18 20:51:55 2021] POST /identity/v3/users/dcae82bce09b41f09318d910a8fb48cc/password => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:56.527974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089c3d3-be2c-4e05-a603-c2013be2ed1d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:56.528428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089c3d3-be2c-4e05-a603-c2013be2ed1d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:56.528511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089c3d3-be2c-4e05-a603-c2013be2ed1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:56.556435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d089c3d3-be2c-4e05-a603-c2013be2ed1d None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:56.558741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d089c3d3-be2c-4e05-a603-c2013be2ed1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:56.564470 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1621/3277] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:56 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:56.568051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f9164-f196-4c71-9aaa-cd7edfccc1f8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:56.568929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f9164-f196-4c71-9aaa-cd7edfccc1f8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:56.569380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f9164-f196-4c71-9aaa-cd7edfccc1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:56.595271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-267f9164-f196-4c71-9aaa-cd7edfccc1f8 None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:56.596611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-267f9164-f196-4c71-9aaa-cd7edfccc1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:56.603827 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1657/3278] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:56 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:56.608661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089c3d3-be2c-4e05-a603-c2013be2ed1d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:56.620643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089c3d3-be2c-4e05-a603-c2013be2ed1d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:56.624957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0057a-31f9-41be-906a-144affda49b6 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcae82bce09b41f09318d910a8fb48cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1094352abf294f22bda41c1216d137d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:56.625808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0057a-31f9-41be-906a-144affda49b6 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:56.626097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0057a-31f9-41be-906a-144affda49b6 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:56.626415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0057a-31f9-41be-906a-144affda49b6 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] PATH_INFO: `/v3/users/dcae82bce09b41f09318d910a8fb48cc/password` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:56.669315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e7f0057a-31f9-41be-906a-144affda49b6 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dcae82bce09b41f09318d910a8fb48cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:56.677455 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1622/3279] 10.222.0.13 () {60 vars in 1268 bytes} [Sat Dec 18 20:51:56 2021] POST /identity/v3/users/dcae82bce09b41f09318d910a8fb48cc/password => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:57.682790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dcea5-60d9-40bf-a2d6-8d3ffeb905d7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:57.683872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dcea5-60d9-40bf-a2d6-8d3ffeb905d7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:57.685397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dcea5-60d9-40bf-a2d6-8d3ffeb905d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:57.704439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2c9dcea5-60d9-40bf-a2d6-8d3ffeb905d7 None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:57.705961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2c9dcea5-60d9-40bf-a2d6-8d3ffeb905d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:57.709120 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1658/3280] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:57 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:57.714889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367060c-4ee3-48ee-945b-04b2b182f669 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:57.715758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367060c-4ee3-48ee-945b-04b2b182f669 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:57.716047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367060c-4ee3-48ee-945b-04b2b182f669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:57.735350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4367060c-4ee3-48ee-945b-04b2b182f669 None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:57.736774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4367060c-4ee3-48ee-945b-04b2b182f669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:57.746665 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1623/3281] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:57 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:57.750544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dcea5-60d9-40bf-a2d6-8d3ffeb905d7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:57.769715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dcea5-60d9-40bf-a2d6-8d3ffeb905d7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:57.788758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3126d-e889-4ddb-849b-d72f32f53cd6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:57.788944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fffcd-b9bd-4ee3-91ad-8165eacd0365 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcae82bce09b41f09318d910a8fb48cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1094352abf294f22bda41c1216d137d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:57.789064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3126d-e889-4ddb-849b-d72f32f53cd6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:57.789648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fffcd-b9bd-4ee3-91ad-8165eacd0365 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:57.789980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fffcd-b9bd-4ee3-91ad-8165eacd0365 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:57.790165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3126d-e889-4ddb-849b-d72f32f53cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:57.790373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fffcd-b9bd-4ee3-91ad-8165eacd0365 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] PATH_INFO: `/v3/users/dcae82bce09b41f09318d910a8fb48cc/password` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:57.839099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a9d3126d-e889-4ddb-849b-d72f32f53cd6 None None] MFA Rules not processed for user `9073865992504246b9d1699da089c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:57.840368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a9d3126d-e889-4ddb-849b-d72f32f53cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:57.844105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7b7fffcd-b9bd-4ee3-91ad-8165eacd0365 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dcae82bce09b41f09318d910a8fb48cc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:57.857040 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1659/3282] 10.222.0.13 () {60 vars in 1268 bytes} [Sat Dec 18 20:51:57 2021] POST /identity/v3/users/dcae82bce09b41f09318d910a8fb48cc/password => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:51:57.921824 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1624/3283] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:57 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:57.926560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fffcd-b9bd-4ee3-91ad-8165eacd0365 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:57.928470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7b7fffcd-b9bd-4ee3-91ad-8165eacd0365 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:58.002001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fffcd-b9bd-4ee3-91ad-8165eacd0365 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:58.008071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4eb6e-8398-483e-ae5e-320b624e3e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:58.009336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4eb6e-8398-483e-ae5e-320b624e3e6f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:58.009336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4eb6e-8398-483e-ae5e-320b624e3e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:58.009520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4eb6e-8398-483e-ae5e-320b624e3e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:58.010209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4eb6e-8398-483e-ae5e-320b624e3e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:58.019972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4eb6e-8398-483e-ae5e-320b624e3e6f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:58.083870 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1660/3284] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:51:57 2021] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:51:58.090940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3126d-e889-4ddb-849b-d72f32f53cd6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:58.118989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3126d-e889-4ddb-849b-d72f32f53cd6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:58.199018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29800836-6b9c-448b-ad69-c2a8448f911d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:58.200273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29800836-6b9c-448b-ad69-c2a8448f911d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:58.200939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29800836-6b9c-448b-ad69-c2a8448f911d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:58.201377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29800836-6b9c-448b-ad69-c2a8448f911d admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:58.202287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29800836-6b9c-448b-ad69-c2a8448f911d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:58.213566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29800836-6b9c-448b-ad69-c2a8448f911d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:58.272444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4eb6e-8398-483e-ae5e-320b624e3e6f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:58.288796 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1625/3285] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:51:58 2021] POST /identity/v3/users => generated 295 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:51:58.290091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4eb6e-8398-483e-ae5e-320b624e3e6f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:58.304705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9c675-1167-48e8-a97f-72616e28f896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:58.305195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9c675-1167-48e8-a97f-72616e28f896 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:58.305416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9c675-1167-48e8-a97f-72616e28f896 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:58.305722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9c675-1167-48e8-a97f-72616e28f896 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:58.312525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9c675-1167-48e8-a97f-72616e28f896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:58.314197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9c675-1167-48e8-a97f-72616e28f896 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:58.349553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de8704-bfd4-43de-b214-48a4fc200ff2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:58.349872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de8704-bfd4-43de-b214-48a4fc200ff2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:58.350120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de8704-bfd4-43de-b214-48a4fc200ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:58.366890 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1661/3286] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:58 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:58.374170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9c675-1167-48e8-a97f-72616e28f896 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:58.384773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-39de8704-bfd4-43de-b214-48a4fc200ff2 None None] MFA Rules not processed for user `ca309394563d45ea9b911c14c5f7625f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:58.387468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-39de8704-bfd4-43de-b214-48a4fc200ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:58.414934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9c675-1167-48e8-a97f-72616e28f896 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:58.435294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaaab4a-7695-47a1-b2d4-f5fb75eec6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:58.439443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaab4a-7695-47a1-b2d4-f5fb75eec6a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:58.440947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaab4a-7695-47a1-b2d4-f5fb75eec6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:58.443360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaab4a-7695-47a1-b2d4-f5fb75eec6a2 admin admin] PATH_INFO: `/v3/projects/30d11e8b908541bea484c5b90e60d4dd/users/7fb502e539054c5f80754303e233aaf9/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:58.503418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaaab4a-7695-47a1-b2d4-f5fb75eec6a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d11e8b908541bea484c5b90e60d4dd, user_id=7fb502e539054c5f80754303e233aaf9, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:58.513001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaaab4a-7695-47a1-b2d4-f5fb75eec6a2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:58.551657 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1662/3287] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:58 2021] PUT /identity/v3/projects/30d11e8b908541bea484c5b90e60d4dd/users/7fb502e539054c5f80754303e233aaf9/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:51:58.555180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaaab4a-7695-47a1-b2d4-f5fb75eec6a2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:58.604035 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1626/3288] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:58 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:58.662717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaaab4a-7695-47a1-b2d4-f5fb75eec6a2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:58.670558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f33f22-c560-4f82-9881-7b8d7a0a1c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:58.671463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f33f22-c560-4f82-9881-7b8d7a0a1c03 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:58.672078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f33f22-c560-4f82-9881-7b8d7a0a1c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:58.672550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f33f22-c560-4f82-9881-7b8d7a0a1c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:58.673372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f33f22-c560-4f82-9881-7b8d7a0a1c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:58.675456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f33f22-c560-4f82-9881-7b8d7a0a1c03 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:58.690098 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1663/3289] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:51:58 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:51:58.694333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de8704-bfd4-43de-b214-48a4fc200ff2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:58.711648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de8704-bfd4-43de-b214-48a4fc200ff2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:58.717357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a787aa-575c-4fbe-9d8e-c4fb8329730c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:58.718548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a787aa-575c-4fbe-9d8e-c4fb8329730c admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:58.718913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a787aa-575c-4fbe-9d8e-c4fb8329730c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:58.719197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a787aa-575c-4fbe-9d8e-c4fb8329730c admin admin] PATH_INFO: `/v3/projects/30d11e8b908541bea484c5b90e60d4dd/users/7fb502e539054c5f80754303e233aaf9/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:58.721289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a787aa-575c-4fbe-9d8e-c4fb8329730c admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d11e8b908541bea484c5b90e60d4dd, user_id=7fb502e539054c5f80754303e233aaf9, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:58.724139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a787aa-575c-4fbe-9d8e-c4fb8329730c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:58.735502 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1627/3290] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:51:58 2021] PUT /identity/v3/projects/30d11e8b908541bea484c5b90e60d4dd/users/7fb502e539054c5f80754303e233aaf9/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:51:58.863667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f24bfc-826c-4767-b203-01fe83690747 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:58.864628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f24bfc-826c-4767-b203-01fe83690747 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:58.865150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f24bfc-826c-4767-b203-01fe83690747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:58.935328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c6f24bfc-826c-4767-b203-01fe83690747 None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:58.936849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c6f24bfc-826c-4767-b203-01fe83690747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:58.942078 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1664/3291] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:58 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 18 20:51:58.946603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5f23-d25b-4c9c-8f8b-b5548dfec6da None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:58.947125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5f23-d25b-4c9c-8f8b-b5548dfec6da None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:58.947615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5f23-d25b-4c9c-8f8b-b5548dfec6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:58.991390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6dbd5f23-d25b-4c9c-8f8b-b5548dfec6da None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:58.998919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6dbd5f23-d25b-4c9c-8f8b-b5548dfec6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:59.093857 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1628/3292] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:58 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:51:59.098164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f24bfc-826c-4767-b203-01fe83690747 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:59.111794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f24bfc-826c-4767-b203-01fe83690747 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:59.119569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376f791-04a8-4a52-8cf9-eb092af72a88 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcae82bce09b41f09318d910a8fb48cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1094352abf294f22bda41c1216d137d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:59.123007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376f791-04a8-4a52-8cf9-eb092af72a88 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:59.123666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376f791-04a8-4a52-8cf9-eb092af72a88 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:59.124130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376f791-04a8-4a52-8cf9-eb092af72a88 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] PATH_INFO: `/v3/users/dcae82bce09b41f09318d910a8fb48cc/password` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:59.207053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8376f791-04a8-4a52-8cf9-eb092af72a88 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dcae82bce09b41f09318d910a8fb48cc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:59.240551 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1665/3293] 10.222.0.13 () {60 vars in 1268 bytes} [Sat Dec 18 20:51:59 2021] POST /identity/v3/users/dcae82bce09b41f09318d910a8fb48cc/password => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:59.325455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd5f23-d25b-4c9c-8f8b-b5548dfec6da None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:59.326923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6dbd5f23-d25b-4c9c-8f8b-b5548dfec6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:59.471200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd5f23-d25b-4c9c-8f8b-b5548dfec6da None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:59.476204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b48a49-33a4-4b74-9b8a-007dc61b0980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:59.477081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b48a49-33a4-4b74-9b8a-007dc61b0980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:59.478029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b48a49-33a4-4b74-9b8a-007dc61b0980 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:59.478378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b48a49-33a4-4b74-9b8a-007dc61b0980 admin admin] PATH_INFO: `/v3/users/231f078b4f4e4fdc9dcf0c6248f17551` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:59.480975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b48a49-33a4-4b74-9b8a-007dc61b0980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=231f078b4f4e4fdc9dcf0c6248f17551)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:59.483243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b48a49-33a4-4b74-9b8a-007dc61b0980 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:59.587861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-09b48a49-33a4-4b74-9b8a-007dc61b0980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231f078b4f4e4fdc9dcf0c6248f17551'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:59.596869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-09b48a49-33a4-4b74-9b8a-007dc61b0980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231f078b4f4e4fdc9dcf0c6248f17551'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:59.617125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-09b48a49-33a4-4b74-9b8a-007dc61b0980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231f078b4f4e4fdc9dcf0c6248f17551'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:59.618613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-09b48a49-33a4-4b74-9b8a-007dc61b0980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231f078b4f4e4fdc9dcf0c6248f17551'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:59.636064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-09b48a49-33a4-4b74-9b8a-007dc61b0980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231f078b4f4e4fdc9dcf0c6248f17551'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:51:59.649607 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1629/3294] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:51:59 2021] DELETE /identity/v3/users/231f078b4f4e4fdc9dcf0c6248f17551 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:51:59.650827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5a0eb-bc51-466c-9617-b82d9320d9c8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:59.651174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5a0eb-bc51-466c-9617-b82d9320d9c8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:59.651459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5a0eb-bc51-466c-9617-b82d9320d9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:59.687298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-07d5a0eb-bc51-466c-9617-b82d9320d9c8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:51:59.689156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-07d5a0eb-bc51-466c-9617-b82d9320d9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:59.765801 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1666/3295] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:51:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:51:59.773837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b48a49-33a4-4b74-9b8a-007dc61b0980 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:51:59.777082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-09b48a49-33a4-4b74-9b8a-007dc61b0980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:51:59.856704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b48a49-33a4-4b74-9b8a-007dc61b0980 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:51:59.862114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f79268-8806-4757-a72c-9f5d19f36a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:51:59.863157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f79268-8806-4757-a72c-9f5d19f36a03 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:51:59.863544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f79268-8806-4757-a72c-9f5d19f36a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:51:59.863970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f79268-8806-4757-a72c-9f5d19f36a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:51:59.879420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f79268-8806-4757-a72c-9f5d19f36a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:51:59.882717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f79268-8806-4757-a72c-9f5d19f36a03 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:51:59.907879 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1630/3296] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:51:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:52:00.248310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc878809-a0f3-49c9-a746-6d920b8ca1bd None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:00.248954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc878809-a0f3-49c9-a746-6d920b8ca1bd None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:00.249244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc878809-a0f3-49c9-a746-6d920b8ca1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:00.258745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f79268-8806-4757-a72c-9f5d19f36a03 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:00.260295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-60f79268-8806-4757-a72c-9f5d19f36a03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:00.284197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f79268-8806-4757-a72c-9f5d19f36a03 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:00.291227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fc878809-a0f3-49c9-a746-6d920b8ca1bd None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:00.293848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fc878809-a0f3-49c9-a746-6d920b8ca1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:00.298638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed8e89-017a-4549-aff4-f1125145eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:00.299792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed8e89-017a-4549-aff4-f1125145eeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:00.300390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed8e89-017a-4549-aff4-f1125145eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:00.301402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed8e89-017a-4549-aff4-f1125145eeae admin admin] PATH_INFO: `/v3/projects/9ce640720b084b84a86f590d354dad25` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:00.303723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed8e89-017a-4549-aff4-f1125145eeae admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ce640720b084b84a86f590d354dad25)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:00.307108 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1667/3297] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:00 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 18 20:52:00.308647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed8e89-017a-4549-aff4-f1125145eeae admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:00.383839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0ed8e89-017a-4549-aff4-f1125145eeae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ce640720b084b84a86f590d354dad25', 'request_id': 'req-d0ed8e89-017a-4549-aff4-f1125145eeae'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:00.396029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0ed8e89-017a-4549-aff4-f1125145eeae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ce640720b084b84a86f590d354dad25', 'request_id': 'req-d0ed8e89-017a-4549-aff4-f1125145eeae'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:00.408626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0ed8e89-017a-4549-aff4-f1125145eeae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ce640720b084b84a86f590d354dad25', 'request_id': 'req-d0ed8e89-017a-4549-aff4-f1125145eeae'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:00.446037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0ed8e89-017a-4549-aff4-f1125145eeae admin admin] The token cache is being invalidate because project 9ce640720b084b84a86f590d354dad25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:52:00.446432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0ed8e89-017a-4549-aff4-f1125145eeae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:00.447153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0ed8e89-017a-4549-aff4-f1125145eeae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:00.450297 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1631/3298] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:52:00 2021] DELETE /identity/v3/projects/9ce640720b084b84a86f590d354dad25 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:00.453561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc878809-a0f3-49c9-a746-6d920b8ca1bd None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:00.558175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc878809-a0f3-49c9-a746-6d920b8ca1bd None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:00.565119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48075-6d70-4f19-a86c-11b44e6283b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:00.566844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48075-6d70-4f19-a86c-11b44e6283b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:00.567182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48075-6d70-4f19-a86c-11b44e6283b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:00.567469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48075-6d70-4f19-a86c-11b44e6283b0 admin admin] PATH_INFO: `/v3/users/44fc09c26148424b807bd6e3ff4f6e92` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:00.568875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de48075-6d70-4f19-a86c-11b44e6283b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44fc09c26148424b807bd6e3ff4f6e92)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:00.571680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de48075-6d70-4f19-a86c-11b44e6283b0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:00.648856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8de48075-6d70-4f19-a86c-11b44e6283b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44fc09c26148424b807bd6e3ff4f6e92'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:00.657008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8de48075-6d70-4f19-a86c-11b44e6283b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44fc09c26148424b807bd6e3ff4f6e92'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:00.657873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8de48075-6d70-4f19-a86c-11b44e6283b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44fc09c26148424b807bd6e3ff4f6e92'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:00.670450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8de48075-6d70-4f19-a86c-11b44e6283b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44fc09c26148424b807bd6e3ff4f6e92'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:00.681666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8de48075-6d70-4f19-a86c-11b44e6283b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44fc09c26148424b807bd6e3ff4f6e92'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:00.691188 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1668/3299] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:52:00 2021] DELETE /identity/v3/users/44fc09c26148424b807bd6e3ff4f6e92 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:01.141637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed8e89-017a-4549-aff4-f1125145eeae admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:01.143228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d0ed8e89-017a-4549-aff4-f1125145eeae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:01.165106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed8e89-017a-4549-aff4-f1125145eeae admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:01.299844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644ae1d-6daf-4d95-aa81-b8268333c31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:01.301148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644ae1d-6daf-4d95-aa81-b8268333c31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:01.301443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644ae1d-6daf-4d95-aa81-b8268333c31d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:01.302022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644ae1d-6daf-4d95-aa81-b8268333c31d admin admin] PATH_INFO: `/v3/projects/787c898fed2d4859aa691909910bd6a8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:01.304104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644ae1d-6daf-4d95-aa81-b8268333c31d admin admin] RBAC: Authorizing `identity:delete_project(project_id=787c898fed2d4859aa691909910bd6a8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:01.309919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644ae1d-6daf-4d95-aa81-b8268333c31d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:01.313324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57f25d-5594-48e0-b676-f4c1462c3d66 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:01.313796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57f25d-5594-48e0-b676-f4c1462c3d66 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:01.313894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57f25d-5594-48e0-b676-f4c1462c3d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:01.362424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3c57f25d-5594-48e0-b676-f4c1462c3d66 None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:01.363561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3c57f25d-5594-48e0-b676-f4c1462c3d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:01.415466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6644ae1d-6daf-4d95-aa81-b8268333c31d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '787c898fed2d4859aa691909910bd6a8', 'request_id': 'req-6644ae1d-6daf-4d95-aa81-b8268333c31d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:01.475619 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1669/3300] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:01 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:52:01.475822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6644ae1d-6daf-4d95-aa81-b8268333c31d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '787c898fed2d4859aa691909910bd6a8', 'request_id': 'req-6644ae1d-6daf-4d95-aa81-b8268333c31d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:01.478863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1f5ef-9db4-418f-8f6e-ff79c2cc7db4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:01.479235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1f5ef-9db4-418f-8f6e-ff79c2cc7db4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:01.479520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1f5ef-9db4-418f-8f6e-ff79c2cc7db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:01.488569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6644ae1d-6daf-4d95-aa81-b8268333c31d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '787c898fed2d4859aa691909910bd6a8', 'request_id': 'req-6644ae1d-6daf-4d95-aa81-b8268333c31d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:01.504595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bdf1f5ef-9db4-418f-8f6e-ff79c2cc7db4 None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:01.508850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bdf1f5ef-9db4-418f-8f6e-ff79c2cc7db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:01.516244 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1670/3301] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:01 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 18 20:52:01.516403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6644ae1d-6daf-4d95-aa81-b8268333c31d admin admin] The token cache is being invalidate because project 787c898fed2d4859aa691909910bd6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:52:01.516512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6644ae1d-6daf-4d95-aa81-b8268333c31d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:01.517135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6644ae1d-6daf-4d95-aa81-b8268333c31d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:01.520271 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1632/3302] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:52:01 2021] DELETE /identity/v3/projects/787c898fed2d4859aa691909910bd6a8 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:01.520498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851adaa-19e7-448d-b67f-e585d6be3400 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:01.520795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851adaa-19e7-448d-b67f-e585d6be3400 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:01.521086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851adaa-19e7-448d-b67f-e585d6be3400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:01.532254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89813e2d-144d-42a8-ae77-ba0a3b4ededf None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:01.532552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89813e2d-144d-42a8-ae77-ba0a3b4ededf None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:01.532837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89813e2d-144d-42a8-ae77-ba0a3b4ededf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:01.587122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-89813e2d-144d-42a8-ae77-ba0a3b4ededf None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:01.589341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-89813e2d-144d-42a8-ae77-ba0a3b4ededf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:01.655548 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-e851adaa-19e7-448d-b67f-e585d6be3400 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Dec 18 20:52:01.661168 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1671/3303] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:01 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 142 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Dec 18 20:52:01.663837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49d39a-2320-481d-a243-090503d2f973 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:01.664523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49d39a-2320-481d-a243-090503d2f973 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:01.665015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49d39a-2320-481d-a243-090503d2f973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:01.741104 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1633/3304] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:52:01.742652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758edda-f8b0-4b55-b887-b1968a87eb54 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:01.743126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758edda-f8b0-4b55-b887-b1968a87eb54 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:01.743417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758edda-f8b0-4b55-b887-b1968a87eb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:01.766118 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-2d49d39a-2320-481d-a243-090503d2f973 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Dec 18 20:52:01.768850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c758edda-f8b0-4b55-b887-b1968a87eb54 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:01.770154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c758edda-f8b0-4b55-b887-b1968a87eb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:01.771856 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1672/3305] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:01 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 110 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Dec 18 20:52:01.778515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd43b-d4c7-445f-99be-c48056c200ca None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:01.778805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd43b-d4c7-445f-99be-c48056c200ca None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:01.779090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd43b-d4c7-445f-99be-c48056c200ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:01.785971 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1634/3306] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:01.792431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758edda-f8b0-4b55-b887-b1968a87eb54 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:01.809926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758edda-f8b0-4b55-b887-b1968a87eb54 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:01.820869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841f3e0-9887-4715-b17b-aafea7546cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:01.825671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841f3e0-9887-4715-b17b-aafea7546cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:01.826013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841f3e0-9887-4715-b17b-aafea7546cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:01.826314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841f3e0-9887-4715-b17b-aafea7546cd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:01.827094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841f3e0-9887-4715-b17b-aafea7546cd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:52:01.827405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841f3e0-9887-4715-b17b-aafea7546cd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:01.831932 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-cd9dd43b-d4c7-445f-99be-c48056c200ca None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Dec 18 20:52:01.832837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841f3e0-9887-4715-b17b-aafea7546cd1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:01.834565 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1673/3307] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:01 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 59 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Dec 18 20:52:01.852876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dd43b-d4c7-445f-99be-c48056c200ca None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:01.857093 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1635/3308] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:52:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:52:01.867711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dd43b-d4c7-445f-99be-c48056c200ca None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:01.873617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cc3a9-1a73-4fe6-8720-7097e7d29e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:01.874394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cc3a9-1a73-4fe6-8720-7097e7d29e48 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:01.874750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cc3a9-1a73-4fe6-8720-7097e7d29e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:01.875138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cc3a9-1a73-4fe6-8720-7097e7d29e48 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:01.876401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cc3a9-1a73-4fe6-8720-7097e7d29e48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:01.878551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cc3a9-1a73-4fe6-8720-7097e7d29e48 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:01.929692 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1674/3309] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:52:01 2021] POST /identity/v3/projects => generated 413 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:52:01.933468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841f3e0-9887-4715-b17b-aafea7546cd1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:01.946098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841f3e0-9887-4715-b17b-aafea7546cd1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:02.090079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6f712-1814-4e7c-9f65-9753c24c94da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:02.090800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6f712-1814-4e7c-9f65-9753c24c94da admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:02.091085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6f712-1814-4e7c-9f65-9753c24c94da admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:02.091379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6f712-1814-4e7c-9f65-9753c24c94da admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:02.092113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6f712-1814-4e7c-9f65-9753c24c94da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:02.094046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6f712-1814-4e7c-9f65-9753c24c94da admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:02.132753 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1636/3310] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:52:01 2021] POST /identity/v3/users => generated 307 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:52:02.135666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cc3a9-1a73-4fe6-8720-7097e7d29e48 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:02.152646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cc3a9-1a73-4fe6-8720-7097e7d29e48 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:02.162728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce963d-6083-4252-8f4f-cae9f5e5430b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:02.163407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce963d-6083-4252-8f4f-cae9f5e5430b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:02.163841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce963d-6083-4252-8f4f-cae9f5e5430b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:02.164125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce963d-6083-4252-8f4f-cae9f5e5430b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:02.164980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce963d-6083-4252-8f4f-cae9f5e5430b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:02.167571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce963d-6083-4252-8f4f-cae9f5e5430b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:02.180516 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1675/3311] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:52:02 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:52:02.185647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6f712-1814-4e7c-9f65-9753c24c94da admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:02.201451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6f712-1814-4e7c-9f65-9753c24c94da admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:02.210558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7699e-f741-4cf1-86bd-02c37c6e2135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:02.212331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7699e-f741-4cf1-86bd-02c37c6e2135 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:02.212955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7699e-f741-4cf1-86bd-02c37c6e2135 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:02.213952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7699e-f741-4cf1-86bd-02c37c6e2135 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:02.214997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7699e-f741-4cf1-86bd-02c37c6e2135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:02.217110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7699e-f741-4cf1-86bd-02c37c6e2135 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:02.230001 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1637/3312] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:52:02 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:52:02.234240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce963d-6083-4252-8f4f-cae9f5e5430b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:02.297250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce963d-6083-4252-8f4f-cae9f5e5430b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:02.307721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c4fe6-36ed-4546-9cfc-3f9641c51ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:02.308893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c4fe6-36ed-4546-9cfc-3f9641c51ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:02.313052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c4fe6-36ed-4546-9cfc-3f9641c51ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:02.313539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c4fe6-36ed-4546-9cfc-3f9641c51ed0 admin admin] PATH_INFO: `/v3/projects/47e94e03944844ccb90b9a5818d00856/users/24ceebd647214518a032847eadef041f/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:02.333669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c4fe6-36ed-4546-9cfc-3f9641c51ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e94e03944844ccb90b9a5818d00856, user_id=24ceebd647214518a032847eadef041f, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:02.345282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c4fe6-36ed-4546-9cfc-3f9641c51ed0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:02.375084 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1676/3313] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:52:02 2021] PUT /identity/v3/projects/47e94e03944844ccb90b9a5818d00856/users/24ceebd647214518a032847eadef041f/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:02.380957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fec29-f6bc-4534-808e-aae12678206f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:02.381500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fec29-f6bc-4534-808e-aae12678206f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:02.381933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fec29-f6bc-4534-808e-aae12678206f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:02.415066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-de5fec29-f6bc-4534-808e-aae12678206f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:02.417790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-de5fec29-f6bc-4534-808e-aae12678206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:02.551458 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1638/3314] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:02.561847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c4fe6-36ed-4546-9cfc-3f9641c51ed0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:02.564321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ef2c4fe6-36ed-4546-9cfc-3f9641c51ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:02.636303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c4fe6-36ed-4546-9cfc-3f9641c51ed0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:02.641123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35865f-143f-4603-ae9e-c165db5cacf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:02.641608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35865f-143f-4603-ae9e-c165db5cacf2 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:02.642129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35865f-143f-4603-ae9e-c165db5cacf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:02.642541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35865f-143f-4603-ae9e-c165db5cacf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:02.655571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35865f-143f-4603-ae9e-c165db5cacf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:02.657110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35865f-143f-4603-ae9e-c165db5cacf2 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:02.668231 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1677/3315] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:52:07.474161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fec29-f6bc-4534-808e-aae12678206f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:07.479806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-de5fec29-f6bc-4534-808e-aae12678206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:07.621566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fec29-f6bc-4534-808e-aae12678206f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:07.630594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a163c-981b-4dca-af3e-e7449838fbdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:07.631593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a163c-981b-4dca-af3e-e7449838fbdb service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:07.631966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a163c-981b-4dca-af3e-e7449838fbdb service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:07.632852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a163c-981b-4dca-af3e-e7449838fbdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:07.638820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c81a163c-981b-4dca-af3e-e7449838fbdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:07.658867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a163c-981b-4dca-af3e-e7449838fbdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:07.660421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a163c-981b-4dca-af3e-e7449838fbdb service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:07.678940 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1639/3316] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:52:09.529979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5508c-2bb5-445c-bab3-87f357db025d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:09.530920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5508c-2bb5-445c-bab3-87f357db025d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:09.531411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5508c-2bb5-445c-bab3-87f357db025d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:09.586434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5ac5508c-2bb5-445c-bab3-87f357db025d None None] MFA Rules not processed for user `24ceebd647214518a032847eadef041f`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:09.587830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5ac5508c-2bb5-445c-bab3-87f357db025d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:09.672677 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1678/3317] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:09 2021] POST /identity/v3/auth/tokens => generated 3280 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:09.690861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399f0aa-b917-4590-92ea-808f47a59808 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:09.691819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399f0aa-b917-4590-92ea-808f47a59808 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:09.692109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399f0aa-b917-4590-92ea-808f47a59808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:09.718125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f399f0aa-b917-4590-92ea-808f47a59808 None None] MFA Rules not processed for user `24ceebd647214518a032847eadef041f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:09.721514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f399f0aa-b917-4590-92ea-808f47a59808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:09.734348 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1640/3318] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:09 2021] POST /identity/v3/auth/tokens => generated 3280 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:10.147980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5508c-2bb5-445c-bab3-87f357db025d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:10.149601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5ac5508c-2bb5-445c-bab3-87f357db025d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:10.187212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5508c-2bb5-445c-bab3-87f357db025d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:10.193796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550137d9-88a6-4a7e-868c-61bd660b6bcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:10.194590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550137d9-88a6-4a7e-868c-61bd660b6bcd service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:10.194970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550137d9-88a6-4a7e-868c-61bd660b6bcd service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:10.195342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550137d9-88a6-4a7e-868c-61bd660b6bcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:10.205798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550137d9-88a6-4a7e-868c-61bd660b6bcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:10.207585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550137d9-88a6-4a7e-868c-61bd660b6bcd service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:10.218305 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1679/3319] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:10 2021] GET /identity/v3/auth/tokens => generated 3280 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:52:10.433533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141aaea-2fe3-4f3c-98ff-95df5d7486f7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:10.435439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141aaea-2fe3-4f3c-98ff-95df5d7486f7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:10.436047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141aaea-2fe3-4f3c-98ff-95df5d7486f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:10.480678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4141aaea-2fe3-4f3c-98ff-95df5d7486f7 None None] MFA Rules not processed for user `7fb502e539054c5f80754303e233aaf9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:10.482564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4141aaea-2fe3-4f3c-98ff-95df5d7486f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:10.579484 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1641/3320] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:10 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:10.589672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f03392-4093-4ad6-acb3-394f1a5c0251 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:10.590192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f03392-4093-4ad6-acb3-394f1a5c0251 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:10.590334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f03392-4093-4ad6-acb3-394f1a5c0251 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:10.592438 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1680/3321] 10.222.0.13 () {54 vars in 963 bytes} [Sat Dec 18 20:52:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:52:10.599210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aed37f-39d3-4e4e-a8fe-e6dcb8c7ccb0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:10.599503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aed37f-39d3-4e4e-a8fe-e6dcb8c7ccb0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:10.599782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aed37f-39d3-4e4e-a8fe-e6dcb8c7ccb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:10.609571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f03392-4093-4ad6-acb3-394f1a5c0251 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:10.611537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-92f03392-4093-4ad6-acb3-394f1a5c0251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:10.627413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f03392-4093-4ad6-acb3-394f1a5c0251 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:10.632095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfac37-b0af-4d3c-9596-c99caf4f50aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:10.632978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfac37-b0af-4d3c-9596-c99caf4f50aa service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:10.633264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfac37-b0af-4d3c-9596-c99caf4f50aa service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:10.633796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfac37-b0af-4d3c-9596-c99caf4f50aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:10.637102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-69bfac37-b0af-4d3c-9596-c99caf4f50aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:10.650295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfac37-b0af-4d3c-9596-c99caf4f50aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:10.652306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfac37-b0af-4d3c-9596-c99caf4f50aa service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:10.668155 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1681/3322] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:10 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:52:10.676137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-43aed37f-39d3-4e4e-a8fe-e6dcb8c7ccb0 None None] MFA Rules not processed for user `62bd53b4d64643d28ac7f4ea0ea45f90`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:10.679274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-43aed37f-39d3-4e4e-a8fe-e6dcb8c7ccb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:10.787542 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1642/3323] 10.222.0.13 () {58 vars in 1060 bytes} [Sat Dec 18 20:52:10 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:10.796008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfac37-b0af-4d3c-9596-c99caf4f50aa service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:10.811834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfac37-b0af-4d3c-9596-c99caf4f50aa service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:10.828826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b0e99-fba2-4347-8691-7de8e1917ae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:10.829504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b0e99-fba2-4347-8691-7de8e1917ae5 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:10.829789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b0e99-fba2-4347-8691-7de8e1917ae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:10.830069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b0e99-fba2-4347-8691-7de8e1917ae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:10.838597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-983b0e99-fba2-4347-8691-7de8e1917ae5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:10.933068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b0e99-fba2-4347-8691-7de8e1917ae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:10.936419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b0e99-fba2-4347-8691-7de8e1917ae5 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:11.006593 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1682/3324] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:10 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:52:12.849794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be315728-c670-4463-b5a1-6f1599fbd8f5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:12.851354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be315728-c670-4463-b5a1-6f1599fbd8f5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:12.851864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be315728-c670-4463-b5a1-6f1599fbd8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:12.950241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-be315728-c670-4463-b5a1-6f1599fbd8f5 None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:12.951887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-be315728-c670-4463-b5a1-6f1599fbd8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:12.955682 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1643/3325] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:12 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 18 20:52:12.960745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b0e99-fba2-4347-8691-7de8e1917ae5 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:12.962245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-983b0e99-fba2-4347-8691-7de8e1917ae5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:13.105974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b0e99-fba2-4347-8691-7de8e1917ae5 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:13.116006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba48958-ba3b-4116-a8a7-bc0b12e54e8b tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcae82bce09b41f09318d910a8fb48cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1094352abf294f22bda41c1216d137d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:13.117018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba48958-ba3b-4116-a8a7-bc0b12e54e8b tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:13.121735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba48958-ba3b-4116-a8a7-bc0b12e54e8b tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:13.121959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba48958-ba3b-4116-a8a7-bc0b12e54e8b tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] PATH_INFO: `/v3/users/dcae82bce09b41f09318d910a8fb48cc/password` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:13.195509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5ba48958-ba3b-4116-a8a7-bc0b12e54e8b tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dcae82bce09b41f09318d910a8fb48cc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:13.225582 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1683/3326] 10.222.0.13 () {60 vars in 1268 bytes} [Sat Dec 18 20:52:12 2021] POST /identity/v3/users/dcae82bce09b41f09318d910a8fb48cc/password => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:14.231175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804f0f6-9325-4199-9e15-f6d3c925f76d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:14.231675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804f0f6-9325-4199-9e15-f6d3c925f76d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:14.231800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804f0f6-9325-4199-9e15-f6d3c925f76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:14.267994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e804f0f6-9325-4199-9e15-f6d3c925f76d None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:14.269286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e804f0f6-9325-4199-9e15-f6d3c925f76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:14.279221 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1644/3327] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:14 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 18 20:52:14.285492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb14a3-772d-4e4b-a144-18c26f808a6c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:14.286879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb14a3-772d-4e4b-a144-18c26f808a6c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:14.287168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb14a3-772d-4e4b-a144-18c26f808a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:14.340680 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-76cb14a3-772d-4e4b-a144-18c26f808a6c None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Dec 18 20:52:14.345282 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1684/3328] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:14 2021] POST /identity/v3/auth/tokens => generated 80 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 20:52:14.348105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8d0b-e45d-408b-b45a-226541fc8d96 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:14.348420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8d0b-e45d-408b-b45a-226541fc8d96 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:14.348671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8d0b-e45d-408b-b45a-226541fc8d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:14.448824 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-733c8d0b-e45d-408b-b45a-226541fc8d96 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Dec 18 20:52:14.456260 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1645/3329] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:14 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 106 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Dec 18 20:52:14.458451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8cdf4-b16c-43e3-92fc-5b53fbebf9f9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:14.463050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8cdf4-b16c-43e3-92fc-5b53fbebf9f9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:14.463430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8cdf4-b16c-43e3-92fc-5b53fbebf9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:14.539888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-dca8cdf4-b16c-43e3-92fc-5b53fbebf9f9 None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:14.541504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dca8cdf4-b16c-43e3-92fc-5b53fbebf9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:14.561314 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1685/3330] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:14 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:52:14.566607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8d0b-e45d-408b-b45a-226541fc8d96 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:14.584321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8d0b-e45d-408b-b45a-226541fc8d96 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:14.608319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66a6aa-7574-400e-a2e8-74474ab9a710 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcae82bce09b41f09318d910a8fb48cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1094352abf294f22bda41c1216d137d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:14.609448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66a6aa-7574-400e-a2e8-74474ab9a710 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:14.609829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66a6aa-7574-400e-a2e8-74474ab9a710 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:14.611427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66a6aa-7574-400e-a2e8-74474ab9a710 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] PATH_INFO: `/v3/users/dcae82bce09b41f09318d910a8fb48cc/password` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:14.672041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8cdf4-b16c-43e3-92fc-5b53fbebf9f9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:14.686915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8cdf4-b16c-43e3-92fc-5b53fbebf9f9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:14.699924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb8b49-9ec6-4ac5-8914-99fc04b7c4c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:14.700675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb8b49-9ec6-4ac5-8914-99fc04b7c4c3 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:14.700949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb8b49-9ec6-4ac5-8914-99fc04b7c4c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:14.701257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb8b49-9ec6-4ac5-8914-99fc04b7c4c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:14.704478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-42bb8b49-9ec6-4ac5-8914-99fc04b7c4c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:14.732455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2d66a6aa-7574-400e-a2e8-74474ab9a710 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dcae82bce09b41f09318d910a8fb48cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:14.743394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb8b49-9ec6-4ac5-8914-99fc04b7c4c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:14.745418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb8b49-9ec6-4ac5-8914-99fc04b7c4c3 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:14.758741 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1646/3331] 10.222.0.13 () {60 vars in 1268 bytes} [Sat Dec 18 20:52:14 2021] POST /identity/v3/users/dcae82bce09b41f09318d910a8fb48cc/password => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:14.758741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66a6aa-7574-400e-a2e8-74474ab9a710 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:14.782350 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1686/3332] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:14 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:52:14.797931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66a6aa-7574-400e-a2e8-74474ab9a710 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:14.816702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b842f14-8092-40e5-b4c0-c33eccb2add1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:14.817377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b842f14-8092-40e5-b4c0-c33eccb2add1 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:14.822414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b842f14-8092-40e5-b4c0-c33eccb2add1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:14.822775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b842f14-8092-40e5-b4c0-c33eccb2add1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:14.851038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b842f14-8092-40e5-b4c0-c33eccb2add1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:14.852504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b842f14-8092-40e5-b4c0-c33eccb2add1 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:14.893026 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1647/3333] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:14 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:52:15.752152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb8b49-9ec6-4ac5-8914-99fc04b7c4c3 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:15.764606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e31fdb-31dc-42d7-bae7-49c4d9490a82 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:15.765430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e31fdb-31dc-42d7-bae7-49c4d9490a82 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:15.765882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e31fdb-31dc-42d7-bae7-49c4d9490a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:15.782783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb8b49-9ec6-4ac5-8914-99fc04b7c4c3 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:15.800226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-83e31fdb-31dc-42d7-bae7-49c4d9490a82 None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:15.801887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1404e-a93b-452e-ae45-51fe29866884 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:15.802573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1404e-a93b-452e-ae45-51fe29866884 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:15.803055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-83e31fdb-31dc-42d7-bae7-49c4d9490a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:15.803185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1404e-a93b-452e-ae45-51fe29866884 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:15.803599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1404e-a93b-452e-ae45-51fe29866884 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:15.805588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9ff1404e-a93b-452e-ae45-51fe29866884 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:15.813836 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1648/3334] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:15 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Dec 18 20:52:15.817379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3fcdf-f9c6-47e9-a885-721ba30ffd87 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:15.817668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3fcdf-f9c6-47e9-a885-721ba30ffd87 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:15.820318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3fcdf-f9c6-47e9-a885-721ba30ffd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:15.833845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1404e-a93b-452e-ae45-51fe29866884 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:15.835499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1404e-a93b-452e-ae45-51fe29866884 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:15.864799 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1687/3335] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:52:15.867518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1fb3fcdf-f9c6-47e9-a885-721ba30ffd87 None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:15.871674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1fb3fcdf-f9c6-47e9-a885-721ba30ffd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:15.886876 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1649/3336] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:15 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:15.887868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1404e-a93b-452e-ae45-51fe29866884 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:15.903794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1404e-a93b-452e-ae45-51fe29866884 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:15.926833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16403400-c838-495e-97f6-3f72f1982976 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcae82bce09b41f09318d910a8fb48cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1094352abf294f22bda41c1216d137d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:15.928385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16403400-c838-495e-97f6-3f72f1982976 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:15.930084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16403400-c838-495e-97f6-3f72f1982976 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:15.930570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16403400-c838-495e-97f6-3f72f1982976 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] PATH_INFO: `/v3/users/dcae82bce09b41f09318d910a8fb48cc/password` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:16.046146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-16403400-c838-495e-97f6-3f72f1982976 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dcae82bce09b41f09318d910a8fb48cc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:16.069299 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1688/3337] 10.222.0.13 () {60 vars in 1268 bytes} [Sat Dec 18 20:52:15 2021] POST /identity/v3/users/dcae82bce09b41f09318d910a8fb48cc/password => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:17.075697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb56c8-1ccc-4c6a-ba0b-ee2eb92fa4e9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:17.076259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb56c8-1ccc-4c6a-ba0b-ee2eb92fa4e9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:17.076259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb56c8-1ccc-4c6a-ba0b-ee2eb92fa4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:17.116332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f2bb56c8-1ccc-4c6a-ba0b-ee2eb92fa4e9 None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:17.117737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f2bb56c8-1ccc-4c6a-ba0b-ee2eb92fa4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:17.132491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb89a4-6996-483a-8d55-8a8e815385b6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:17.133025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb89a4-6996-483a-8d55-8a8e815385b6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:17.133025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb89a4-6996-483a-8d55-8a8e815385b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:17.134448 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1650/3338] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:17 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 18 20:52:17.163160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0acb89a4-6996-483a-8d55-8a8e815385b6 None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:17.167722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0acb89a4-6996-483a-8d55-8a8e815385b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:17.190813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb56c8-1ccc-4c6a-ba0b-ee2eb92fa4e9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:17.202469 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1689/3339] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:17 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:17.210874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb56c8-1ccc-4c6a-ba0b-ee2eb92fa4e9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:17.234640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4f460-152c-436c-8dfd-29461839b618 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcae82bce09b41f09318d910a8fb48cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1094352abf294f22bda41c1216d137d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:17.235751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4f460-152c-436c-8dfd-29461839b618 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:17.236201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4f460-152c-436c-8dfd-29461839b618 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:17.236659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4f460-152c-436c-8dfd-29461839b618 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] PATH_INFO: `/v3/users/dcae82bce09b41f09318d910a8fb48cc/password` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:17.428578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-71d4f460-152c-436c-8dfd-29461839b618 tempest-IdentityV3UsersTest-406034139 tempest-IdentityV3UsersTest-406034139-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dcae82bce09b41f09318d910a8fb48cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:17.478101 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1651/3340] 10.222.0.13 () {60 vars in 1268 bytes} [Sat Dec 18 20:52:17 2021] POST /identity/v3/users/dcae82bce09b41f09318d910a8fb48cc/password => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:18.484130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d77b5b-0a09-414c-96b0-e14e54638720 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:18.484593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d77b5b-0a09-414c-96b0-e14e54638720 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:18.484708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d77b5b-0a09-414c-96b0-e14e54638720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:18.544522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f9d77b5b-0a09-414c-96b0-e14e54638720 None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:18.549774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f9d77b5b-0a09-414c-96b0-e14e54638720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:18.558867 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1690/3341] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:18 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 18 20:52:19.566219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de31074-3fe1-41f0-be14-e2919133afce None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:19.566774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de31074-3fe1-41f0-be14-e2919133afce None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:19.566894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de31074-3fe1-41f0-be14-e2919133afce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:19.569843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d77b5b-0a09-414c-96b0-e14e54638720 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:19.571953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f9d77b5b-0a09-414c-96b0-e14e54638720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:19.591151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4de31074-3fe1-41f0-be14-e2919133afce None None] MFA Rules not processed for user `dcae82bce09b41f09318d910a8fb48cc`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:19.592629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4de31074-3fe1-41f0-be14-e2919133afce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:19.595228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d77b5b-0a09-414c-96b0-e14e54638720 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:19.600219 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1652/3342] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:19 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:19.606984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6389b-6c41-4f80-b09b-96c2229c9283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:19.607169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de31074-3fe1-41f0-be14-e2919133afce None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:19.608449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6389b-6c41-4f80-b09b-96c2229c9283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:19.608584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4de31074-3fe1-41f0-be14-e2919133afce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:19.608731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6389b-6c41-4f80-b09b-96c2229c9283 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:19.609184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6389b-6c41-4f80-b09b-96c2229c9283 admin admin] PATH_INFO: `/v3/users/0184005bc5c34c038fd140564572807e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:19.610510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6389b-6c41-4f80-b09b-96c2229c9283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0184005bc5c34c038fd140564572807e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:19.612442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6389b-6c41-4f80-b09b-96c2229c9283 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:19.622784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de31074-3fe1-41f0-be14-e2919133afce None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:19.638452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620fb4f-dafd-4052-8613-eed693addc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:19.639427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620fb4f-dafd-4052-8613-eed693addc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:19.639922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620fb4f-dafd-4052-8613-eed693addc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:19.640405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620fb4f-dafd-4052-8613-eed693addc4e admin admin] PATH_INFO: `/v3/users/dcae82bce09b41f09318d910a8fb48cc` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:19.641921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620fb4f-dafd-4052-8613-eed693addc4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcae82bce09b41f09318d910a8fb48cc)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:19.644319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620fb4f-dafd-4052-8613-eed693addc4e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:19.701077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47a6389b-6c41-4f80-b09b-96c2229c9283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0184005bc5c34c038fd140564572807e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:19.716125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47a6389b-6c41-4f80-b09b-96c2229c9283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0184005bc5c34c038fd140564572807e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:19.719459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c620fb4f-dafd-4052-8613-eed693addc4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcae82bce09b41f09318d910a8fb48cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:19.723229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47a6389b-6c41-4f80-b09b-96c2229c9283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0184005bc5c34c038fd140564572807e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:19.734852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c620fb4f-dafd-4052-8613-eed693addc4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcae82bce09b41f09318d910a8fb48cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:19.753209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47a6389b-6c41-4f80-b09b-96c2229c9283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0184005bc5c34c038fd140564572807e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:19.757410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c620fb4f-dafd-4052-8613-eed693addc4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcae82bce09b41f09318d910a8fb48cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:19.758593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c620fb4f-dafd-4052-8613-eed693addc4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcae82bce09b41f09318d910a8fb48cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:19.769093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47a6389b-6c41-4f80-b09b-96c2229c9283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0184005bc5c34c038fd140564572807e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:19.778761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c620fb4f-dafd-4052-8613-eed693addc4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcae82bce09b41f09318d910a8fb48cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:19.792146 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1691/3343] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:52:19 2021] DELETE /identity/v3/users/0184005bc5c34c038fd140564572807e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:19.796635 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1653/3344] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:52:19 2021] DELETE /identity/v3/users/dcae82bce09b41f09318d910a8fb48cc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:19.801617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2bf5-2f72-49b3-b101-b828a7fa4e19 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:19.802665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2bf5-2f72-49b3-b101-b828a7fa4e19 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:19.803124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2bf5-2f72-49b3-b101-b828a7fa4e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:19.882381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-871f2bf5-2f72-49b3-b101-b828a7fa4e19 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:19.883644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-871f2bf5-2f72-49b3-b101-b828a7fa4e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:20.046703 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1692/3345] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:20.088679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620fb4f-dafd-4052-8613-eed693addc4e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:20.099679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c620fb4f-dafd-4052-8613-eed693addc4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:20.104041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f2bf5-2f72-49b3-b101-b828a7fa4e19 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:20.107568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-871f2bf5-2f72-49b3-b101-b828a7fa4e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:20.188867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f2bf5-2f72-49b3-b101-b828a7fa4e19 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:20.203037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e324ae3-6812-44da-a611-275d3145b2ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:20.204206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e324ae3-6812-44da-a611-275d3145b2ef service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:20.204716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e324ae3-6812-44da-a611-275d3145b2ef service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:20.205196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e324ae3-6812-44da-a611-275d3145b2ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:20.230968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e324ae3-6812-44da-a611-275d3145b2ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:20.234493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e324ae3-6812-44da-a611-275d3145b2ef service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:20.260583 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1693/3346] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:52:20.262913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620fb4f-dafd-4052-8613-eed693addc4e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:20.268587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5765d-c68a-4a33-bd96-118e25a9e551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:20.269382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5765d-c68a-4a33-bd96-118e25a9e551 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:20.269676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5765d-c68a-4a33-bd96-118e25a9e551 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:20.269960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5765d-c68a-4a33-bd96-118e25a9e551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:20.272802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b5c5765d-c68a-4a33-bd96-118e25a9e551 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:20.411873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5765d-c68a-4a33-bd96-118e25a9e551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:20.414748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5765d-c68a-4a33-bd96-118e25a9e551 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:20.454393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e324ae3-6812-44da-a611-275d3145b2ef service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:20.456180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0e324ae3-6812-44da-a611-275d3145b2ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:20.465320 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1654/3347] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:20 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:52:20.476932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e324ae3-6812-44da-a611-275d3145b2ef service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:20.486581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c04f29-dcc7-45f1-a830-42ffaa9ab289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:20.490493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c04f29-dcc7-45f1-a830-42ffaa9ab289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:20.491275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c04f29-dcc7-45f1-a830-42ffaa9ab289 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:20.491791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c04f29-dcc7-45f1-a830-42ffaa9ab289 admin admin] PATH_INFO: `/v3/projects/7f74319f4d954cea9418c30afd53b213` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:20.493785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c04f29-dcc7-45f1-a830-42ffaa9ab289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f74319f4d954cea9418c30afd53b213)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:20.497980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c04f29-dcc7-45f1-a830-42ffaa9ab289 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:20.581004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-36c04f29-dcc7-45f1-a830-42ffaa9ab289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f74319f4d954cea9418c30afd53b213', 'request_id': 'req-36c04f29-dcc7-45f1-a830-42ffaa9ab289'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:20.608673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-36c04f29-dcc7-45f1-a830-42ffaa9ab289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f74319f4d954cea9418c30afd53b213', 'request_id': 'req-36c04f29-dcc7-45f1-a830-42ffaa9ab289'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:20.643646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-36c04f29-dcc7-45f1-a830-42ffaa9ab289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f74319f4d954cea9418c30afd53b213', 'request_id': 'req-36c04f29-dcc7-45f1-a830-42ffaa9ab289'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:20.667491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-36c04f29-dcc7-45f1-a830-42ffaa9ab289 admin admin] The token cache is being invalidate because project 7f74319f4d954cea9418c30afd53b213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:52:20.668132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-36c04f29-dcc7-45f1-a830-42ffaa9ab289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:20.672304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-36c04f29-dcc7-45f1-a830-42ffaa9ab289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:20.674307 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1694/3348] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:52:20 2021] DELETE /identity/v3/projects/7f74319f4d954cea9418c30afd53b213 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:52:20.679982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decd032-b7e7-428f-b65e-adfe450c75f4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:20.680502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decd032-b7e7-428f-b65e-adfe450c75f4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:20.680589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decd032-b7e7-428f-b65e-adfe450c75f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:20.708703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1decd032-b7e7-428f-b65e-adfe450c75f4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:20.710402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1decd032-b7e7-428f-b65e-adfe450c75f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:20.795014 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1655/3349] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:20.802635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fac42-3725-4571-a124-ded0b9e68549 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:20.803152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fac42-3725-4571-a124-ded0b9e68549 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:20.803584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fac42-3725-4571-a124-ded0b9e68549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:20.860133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-675fac42-3725-4571-a124-ded0b9e68549 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:20.861963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-675fac42-3725-4571-a124-ded0b9e68549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:20.880652 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1695/3350] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:20.883706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decd032-b7e7-428f-b65e-adfe450c75f4 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:20.903960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decd032-b7e7-428f-b65e-adfe450c75f4 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:20.920495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc35c98-7259-4b08-8dc3-aa5102d4c6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:20.921508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc35c98-7259-4b08-8dc3-aa5102d4c6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:20.921987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc35c98-7259-4b08-8dc3-aa5102d4c6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:20.922370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc35c98-7259-4b08-8dc3-aa5102d4c6f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:20.923190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc35c98-7259-4b08-8dc3-aa5102d4c6f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:52:20.923569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc35c98-7259-4b08-8dc3-aa5102d4c6f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:20.926387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc35c98-7259-4b08-8dc3-aa5102d4c6f0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:20.960676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fac42-3725-4571-a124-ded0b9e68549 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:20.968264 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1656/3351] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:52:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:52:20.976978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fac42-3725-4571-a124-ded0b9e68549 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:20.995216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5beaeab-0121-4591-9aa2-63103b26c7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:20.995968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beaeab-0121-4591-9aa2-63103b26c7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:20.997098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beaeab-0121-4591-9aa2-63103b26c7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:21.000163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beaeab-0121-4591-9aa2-63103b26c7e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:21.000999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5beaeab-0121-4591-9aa2-63103b26c7e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:21.003228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5beaeab-0121-4591-9aa2-63103b26c7e2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:21.070984 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1696/3352] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:52:20 2021] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:52:21.075731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc35c98-7259-4b08-8dc3-aa5102d4c6f0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:21.094913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc35c98-7259-4b08-8dc3-aa5102d4c6f0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:21.220421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a881f-ff16-44a9-a0f5-c0b58a188e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:21.221557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a881f-ff16-44a9-a0f5-c0b58a188e34 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:21.222230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a881f-ff16-44a9-a0f5-c0b58a188e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:21.222923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a881f-ff16-44a9-a0f5-c0b58a188e34 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:21.223938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a881f-ff16-44a9-a0f5-c0b58a188e34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:21.226799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a881f-ff16-44a9-a0f5-c0b58a188e34 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:21.257787 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1657/3353] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:52:21 2021] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:52:21.262077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5beaeab-0121-4591-9aa2-63103b26c7e2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:21.276604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5beaeab-0121-4591-9aa2-63103b26c7e2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:21.282827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63d006-4db0-4539-abd2-4fa70267c4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:21.284117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63d006-4db0-4539-abd2-4fa70267c4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:21.284558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63d006-4db0-4539-abd2-4fa70267c4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:21.285184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63d006-4db0-4539-abd2-4fa70267c4d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:21.287017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63d006-4db0-4539-abd2-4fa70267c4d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:21.289058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63d006-4db0-4539-abd2-4fa70267c4d1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:21.324787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a881f-ff16-44a9-a0f5-c0b58a188e34 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:21.341750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a881f-ff16-44a9-a0f5-c0b58a188e34 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:21.344018 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1697/3354] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:52:21 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:52:21.351746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bc4e8-8d47-4be5-b763-3928461d7cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:21.352758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bc4e8-8d47-4be5-b763-3928461d7cdc admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:21.353199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bc4e8-8d47-4be5-b763-3928461d7cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:21.354200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bc4e8-8d47-4be5-b763-3928461d7cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:21.355383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9bc4e8-8d47-4be5-b763-3928461d7cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:21.358273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9bc4e8-8d47-4be5-b763-3928461d7cdc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:21.380786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63d006-4db0-4539-abd2-4fa70267c4d1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:21.382437 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1658/3355] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:52:21 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:52:21.395325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63d006-4db0-4539-abd2-4fa70267c4d1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:21.401236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf9f4e-0630-4d7b-9fcc-ea05501e0448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:21.402871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf9f4e-0630-4d7b-9fcc-ea05501e0448 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:21.403218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf9f4e-0630-4d7b-9fcc-ea05501e0448 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:21.403505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf9f4e-0630-4d7b-9fcc-ea05501e0448 admin admin] PATH_INFO: `/v3/projects/1a0744714bbf4779a774d5d0d8fc18d7/users/05a9edc0cd6b4eaababe6d74aa697bc5/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:21.422390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf9f4e-0630-4d7b-9fcc-ea05501e0448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a0744714bbf4779a774d5d0d8fc18d7, user_id=05a9edc0cd6b4eaababe6d74aa697bc5, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:21.426453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf9f4e-0630-4d7b-9fcc-ea05501e0448 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:21.452620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc1a23-9fc8-4678-bbb1-c6687e33fe79 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:21.453194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc1a23-9fc8-4678-bbb1-c6687e33fe79 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:21.453649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc1a23-9fc8-4678-bbb1-c6687e33fe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:21.453845 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1698/3356] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:52:21 2021] PUT /identity/v3/projects/1a0744714bbf4779a774d5d0d8fc18d7/users/05a9edc0cd6b4eaababe6d74aa697bc5/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:21.496382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-60dc1a23-9fc8-4678-bbb1-c6687e33fe79 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:21.497767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-60dc1a23-9fc8-4678-bbb1-c6687e33fe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:21.589480 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1659/3357] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:21.693286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf9f4e-0630-4d7b-9fcc-ea05501e0448 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:21.695903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-aecf9f4e-0630-4d7b-9fcc-ea05501e0448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:21.801683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf9f4e-0630-4d7b-9fcc-ea05501e0448 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:21.809995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293f95d-4c5a-494e-b58f-865be7606a51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:21.811248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293f95d-4c5a-494e-b58f-865be7606a51 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:21.811836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293f95d-4c5a-494e-b58f-865be7606a51 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:21.812346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293f95d-4c5a-494e-b58f-865be7606a51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:21.829602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293f95d-4c5a-494e-b58f-865be7606a51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:21.831517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293f95d-4c5a-494e-b58f-865be7606a51 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:21.848566 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1699/3358] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:52:21.891546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc1a23-9fc8-4678-bbb1-c6687e33fe79 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:21.894019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-60dc1a23-9fc8-4678-bbb1-c6687e33fe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:21.912825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc1a23-9fc8-4678-bbb1-c6687e33fe79 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:21.925889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd544e71-0a9c-45fc-b6ea-66dd6d4a730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:21.927900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd544e71-0a9c-45fc-b6ea-66dd6d4a730a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:21.928594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd544e71-0a9c-45fc-b6ea-66dd6d4a730a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:21.929065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd544e71-0a9c-45fc-b6ea-66dd6d4a730a admin admin] PATH_INFO: `/v3/projects/1094352abf294f22bda41c1216d137d8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:21.931167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd544e71-0a9c-45fc-b6ea-66dd6d4a730a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1094352abf294f22bda41c1216d137d8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:21.936137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd544e71-0a9c-45fc-b6ea-66dd6d4a730a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:22.047003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cd544e71-0a9c-45fc-b6ea-66dd6d4a730a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1094352abf294f22bda41c1216d137d8', 'request_id': 'req-cd544e71-0a9c-45fc-b6ea-66dd6d4a730a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:22.057118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cd544e71-0a9c-45fc-b6ea-66dd6d4a730a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1094352abf294f22bda41c1216d137d8', 'request_id': 'req-cd544e71-0a9c-45fc-b6ea-66dd6d4a730a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:22.064110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cd544e71-0a9c-45fc-b6ea-66dd6d4a730a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1094352abf294f22bda41c1216d137d8', 'request_id': 'req-cd544e71-0a9c-45fc-b6ea-66dd6d4a730a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:22.118061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cd544e71-0a9c-45fc-b6ea-66dd6d4a730a admin admin] The token cache is being invalidate because project 1094352abf294f22bda41c1216d137d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:52:22.118494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cd544e71-0a9c-45fc-b6ea-66dd6d4a730a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:22.119650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cd544e71-0a9c-45fc-b6ea-66dd6d4a730a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:22.129447 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1660/3359] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:52:21 2021] DELETE /identity/v3/projects/1094352abf294f22bda41c1216d137d8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:22.131125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e61cb-c53b-4281-a7f5-0b3064d280c5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:22.131586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e61cb-c53b-4281-a7f5-0b3064d280c5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:22.132018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e61cb-c53b-4281-a7f5-0b3064d280c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:22.159431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-318e61cb-c53b-4281-a7f5-0b3064d280c5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:22.161548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-318e61cb-c53b-4281-a7f5-0b3064d280c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:22.322149 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1700/3360] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:22.331201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aef0b1-5b4c-4ac5-b3fa-45a18bff1cec None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:22.331628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aef0b1-5b4c-4ac5-b3fa-45a18bff1cec None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:22.332020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aef0b1-5b4c-4ac5-b3fa-45a18bff1cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:22.373430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-48aef0b1-5b4c-4ac5-b3fa-45a18bff1cec None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:22.376661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-48aef0b1-5b4c-4ac5-b3fa-45a18bff1cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:22.405783 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1661/3361] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:22.410424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e61cb-c53b-4281-a7f5-0b3064d280c5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:22.430596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e61cb-c53b-4281-a7f5-0b3064d280c5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:22.459268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1674e4-b753-4086-96a2-37040c104bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:22.459953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1674e4-b753-4086-96a2-37040c104bfb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:22.460236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1674e4-b753-4086-96a2-37040c104bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:22.460514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1674e4-b753-4086-96a2-37040c104bfb admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:22.461259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1674e4-b753-4086-96a2-37040c104bfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:52:22.461565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1674e4-b753-4086-96a2-37040c104bfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:22.472246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1674e4-b753-4086-96a2-37040c104bfb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:22.501553 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1701/3362] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:52:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:52:22.506028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aef0b1-5b4c-4ac5-b3fa-45a18bff1cec None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:22.526736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aef0b1-5b4c-4ac5-b3fa-45a18bff1cec None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:22.534484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d38aa2-b293-46e4-bc5c-1fb71537ba4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:22.535625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d38aa2-b293-46e4-bc5c-1fb71537ba4c admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:22.536094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d38aa2-b293-46e4-bc5c-1fb71537ba4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:22.536533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d38aa2-b293-46e4-bc5c-1fb71537ba4c admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:22.537418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d38aa2-b293-46e4-bc5c-1fb71537ba4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:22.539742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d38aa2-b293-46e4-bc5c-1fb71537ba4c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:22.576410 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1662/3363] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:52:22 2021] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:52:22.582135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1674e4-b753-4086-96a2-37040c104bfb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:22.600883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1674e4-b753-4086-96a2-37040c104bfb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:22.752969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acabdeb-b0b9-40c5-b27a-d6aeb236f872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:22.754777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acabdeb-b0b9-40c5-b27a-d6aeb236f872 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:22.755382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acabdeb-b0b9-40c5-b27a-d6aeb236f872 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:22.755876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acabdeb-b0b9-40c5-b27a-d6aeb236f872 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:22.756838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acabdeb-b0b9-40c5-b27a-d6aeb236f872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:22.759544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acabdeb-b0b9-40c5-b27a-d6aeb236f872 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:22.795884 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1702/3364] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:52:22 2021] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:52:22.800481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d38aa2-b293-46e4-bc5c-1fb71537ba4c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:22.827055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d38aa2-b293-46e4-bc5c-1fb71537ba4c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:22.841349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977c965-3591-4df2-8cf5-39f0b9ad5719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:22.842206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977c965-3591-4df2-8cf5-39f0b9ad5719 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:22.847917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977c965-3591-4df2-8cf5-39f0b9ad5719 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:22.848394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977c965-3591-4df2-8cf5-39f0b9ad5719 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:22.850360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977c965-3591-4df2-8cf5-39f0b9ad5719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:22.869896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977c965-3591-4df2-8cf5-39f0b9ad5719 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:22.890471 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1663/3365] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:52:22 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:52:22.898852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acabdeb-b0b9-40c5-b27a-d6aeb236f872 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:22.929228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acabdeb-b0b9-40c5-b27a-d6aeb236f872 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:22.936345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a04c46-3c00-45da-9007-746131217fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:22.937390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04c46-3c00-45da-9007-746131217fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:22.937888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04c46-3c00-45da-9007-746131217fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:22.938492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04c46-3c00-45da-9007-746131217fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:22.939683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a04c46-3c00-45da-9007-746131217fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:22.941529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a04c46-3c00-45da-9007-746131217fe7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:22.967348 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1703/3366] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:52:22 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:52:22.971427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977c965-3591-4df2-8cf5-39f0b9ad5719 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:22.985838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977c965-3591-4df2-8cf5-39f0b9ad5719 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:22.991312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ced9a-0f06-44b3-ac67-934995d61fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:22.993149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ced9a-0f06-44b3-ac67-934995d61fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:22.993670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ced9a-0f06-44b3-ac67-934995d61fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:22.995230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ced9a-0f06-44b3-ac67-934995d61fe3 admin admin] PATH_INFO: `/v3/projects/07bce02fee24475fab38d05b208d1f2f/users/9cd2bda390a64f19a8352c272ded3341/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:23.045035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ced9a-0f06-44b3-ac67-934995d61fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bce02fee24475fab38d05b208d1f2f, user_id=9cd2bda390a64f19a8352c272ded3341, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:23.050330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ced9a-0f06-44b3-ac67-934995d61fe3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:23.095500 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1664/3367] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:52:22 2021] PUT /identity/v3/projects/07bce02fee24475fab38d05b208d1f2f/users/9cd2bda390a64f19a8352c272ded3341/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:23.120415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565cb1e-cf23-4498-b22a-e5965f51ce0f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:23.120712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565cb1e-cf23-4498-b22a-e5965f51ce0f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:23.121073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565cb1e-cf23-4498-b22a-e5965f51ce0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:23.178352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4565cb1e-cf23-4498-b22a-e5965f51ce0f None None] MFA Rules not processed for user `9cd2bda390a64f19a8352c272ded3341`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:23.179617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4565cb1e-cf23-4498-b22a-e5965f51ce0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:23.297598 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1704/3368] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:23 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:23.328475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ced9a-0f06-44b3-ac67-934995d61fe3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:23.332132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ed2ced9a-0f06-44b3-ac67-934995d61fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:23.502811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ced9a-0f06-44b3-ac67-934995d61fe3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:23.507179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd84cd9-1c00-47b8-bc9d-a00810b48910 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:23.508064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd84cd9-1c00-47b8-bc9d-a00810b48910 service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:23.508628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd84cd9-1c00-47b8-bc9d-a00810b48910 service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:23.508919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd84cd9-1c00-47b8-bc9d-a00810b48910 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:23.544850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd84cd9-1c00-47b8-bc9d-a00810b48910 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:23.547110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd84cd9-1c00-47b8-bc9d-a00810b48910 service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:23.598607 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1665/3369] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:23 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:52:23.821233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24076590-0cef-4aac-b784-10909beea052 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:23.821769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24076590-0cef-4aac-b784-10909beea052 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:23.822090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24076590-0cef-4aac-b784-10909beea052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:23.862962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-24076590-0cef-4aac-b784-10909beea052 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:23.867771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-24076590-0cef-4aac-b784-10909beea052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:23.992823 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03bb66-462b-4cfc-b7f2-0cf770d1b294 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:23.993396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03bb66-462b-4cfc-b7f2-0cf770d1b294 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:23.993396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03bb66-462b-4cfc-b7f2-0cf770d1b294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:24.034995 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1705/3370] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:52:23 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:24.045494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5f03bb66-462b-4cfc-b7f2-0cf770d1b294 None None] MFA Rules not processed for user `05a9edc0cd6b4eaababe6d74aa697bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:24.048859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5f03bb66-462b-4cfc-b7f2-0cf770d1b294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:24.124818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24076590-0cef-4aac-b784-10909beea052 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:24.126226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-24076590-0cef-4aac-b784-10909beea052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:24.135065 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1666/3371] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:23 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:52:24.151770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244cd0-254c-4aa7-a438-2815c2b81181 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:24.152276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244cd0-254c-4aa7-a438-2815c2b81181 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:24.152780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244cd0-254c-4aa7-a438-2815c2b81181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:24.210631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0b244cd0-254c-4aa7-a438-2815c2b81181 None None] MFA Rules not processed for user `05a9edc0cd6b4eaababe6d74aa697bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:24.213581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0b244cd0-254c-4aa7-a438-2815c2b81181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:24.240259 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1667/3372] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:24 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:24.300903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b244cd0-254c-4aa7-a438-2815c2b81181 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:24.302592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0b244cd0-254c-4aa7-a438-2815c2b81181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:24.387015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24076590-0cef-4aac-b784-10909beea052 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:24.405062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fff3fd-a2e6-445a-82d2-7971e07bc41f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:24.408401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fff3fd-a2e6-445a-82d2-7971e07bc41f service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:24.411421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fff3fd-a2e6-445a-82d2-7971e07bc41f service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:24.411934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fff3fd-a2e6-445a-82d2-7971e07bc41f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:24.481458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fff3fd-a2e6-445a-82d2-7971e07bc41f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:24.483632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fff3fd-a2e6-445a-82d2-7971e07bc41f service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:24.503436 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1706/3373] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:52:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 20:52:24.545369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b244cd0-254c-4aa7-a438-2815c2b81181 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:24.568633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b776b1-fafc-4b33-b7ad-3f17824a14ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:24.569637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b776b1-fafc-4b33-b7ad-3f17824a14ee service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:24.570387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b776b1-fafc-4b33-b7ad-3f17824a14ee service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:24.573463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b776b1-fafc-4b33-b7ad-3f17824a14ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:24.608601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b776b1-fafc-4b33-b7ad-3f17824a14ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:24.610573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b776b1-fafc-4b33-b7ad-3f17824a14ee service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:24.644185 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1668/3374] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:24 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:52:25.002292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472736-ed9c-4c22-b53a-b881f473d1a7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:25.002839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472736-ed9c-4c22-b53a-b881f473d1a7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:25.002839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472736-ed9c-4c22-b53a-b881f473d1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:25.045244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-cc472736-ed9c-4c22-b53a-b881f473d1a7 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:25.049290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cc472736-ed9c-4c22-b53a-b881f473d1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:25.079507 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1707/3375] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:52:25 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:25.097672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b776b1-fafc-4b33-b7ad-3f17824a14ee service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:25.120241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b776b1-fafc-4b33-b7ad-3f17824a14ee service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:25.141609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3ff73-8514-4eb7-9d84-90454b3a5d5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:25.142350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3ff73-8514-4eb7-9d84-90454b3a5d5f service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:25.152588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3ff73-8514-4eb7-9d84-90454b3a5d5f service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:25.152952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3ff73-8514-4eb7-9d84-90454b3a5d5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:25.180725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc472736-ed9c-4c22-b53a-b881f473d1a7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:25.183375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cc472736-ed9c-4c22-b53a-b881f473d1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:25.206064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3ff73-8514-4eb7-9d84-90454b3a5d5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:25.207827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3ff73-8514-4eb7-9d84-90454b3a5d5f service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:25.240377 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1669/3376] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:52:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:52:25.301942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc472736-ed9c-4c22-b53a-b881f473d1a7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:25.311867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ec0dc-c763-4efa-8ec6-35f03117fcd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:25.312605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ec0dc-c763-4efa-8ec6-35f03117fcd3 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:25.313071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ec0dc-c763-4efa-8ec6-35f03117fcd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:25.313512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ec0dc-c763-4efa-8ec6-35f03117fcd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:25.315926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2c4ec0dc-c763-4efa-8ec6-35f03117fcd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:25.329082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ec0dc-c763-4efa-8ec6-35f03117fcd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:25.339085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ec0dc-c763-4efa-8ec6-35f03117fcd3 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:25.351512 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1708/3377] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:25 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:52:25.734009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b0726-7f49-4071-b5ae-4b2f7a6104ec None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:25.734326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b0726-7f49-4071-b5ae-4b2f7a6104ec None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:25.735132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b0726-7f49-4071-b5ae-4b2f7a6104ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:25.757746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-525b0726-7f49-4071-b5ae-4b2f7a6104ec None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:25.759513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-525b0726-7f49-4071-b5ae-4b2f7a6104ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:25.770673 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1670/3378] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:52:25 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:25.790431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ec0dc-c763-4efa-8ec6-35f03117fcd3 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:25.813633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ec0dc-c763-4efa-8ec6-35f03117fcd3 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:25.822793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a71be-1c37-4410-8058-35a4f65f09de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:25.824292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a71be-1c37-4410-8058-35a4f65f09de service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:25.824801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a71be-1c37-4410-8058-35a4f65f09de service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:25.825976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a71be-1c37-4410-8058-35a4f65f09de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:25.839131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a71be-1c37-4410-8058-35a4f65f09de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:25.841163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a71be-1c37-4410-8058-35a4f65f09de service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:25.851522 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1709/3379] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:52:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:52:26.289872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557740c-9939-46b4-be42-82945cbcd5f1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:26.291449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557740c-9939-46b4-be42-82945cbcd5f1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:26.291740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557740c-9939-46b4-be42-82945cbcd5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:26.341884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8557740c-9939-46b4-be42-82945cbcd5f1 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:26.345497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8557740c-9939-46b4-be42-82945cbcd5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:26.365808 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1671/3380] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:52:26 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:26.385816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a71be-1c37-4410-8058-35a4f65f09de service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:26.403879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a71be-1c37-4410-8058-35a4f65f09de service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:26.419815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b1f73-50de-48eb-b64e-f5d5468ba024 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:26.420579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b1f73-50de-48eb-b64e-f5d5468ba024 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:26.420967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b1f73-50de-48eb-b64e-f5d5468ba024 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:26.421348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b1f73-50de-48eb-b64e-f5d5468ba024 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:26.441534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b1f73-50de-48eb-b64e-f5d5468ba024 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:26.443224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b1f73-50de-48eb-b64e-f5d5468ba024 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:26.481250 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1710/3381] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:52:26 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:52:26.968097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a6c63-40bc-4c36-893c-73ee85b11e61 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:26.968280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a6c63-40bc-4c36-893c-73ee85b11e61 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:26.969561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a6c63-40bc-4c36-893c-73ee85b11e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:27.034007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-706a6c63-40bc-4c36-893c-73ee85b11e61 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:27.036093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-706a6c63-40bc-4c36-893c-73ee85b11e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:27.065763 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1672/3382] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:52:26 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:27.085752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b1f73-50de-48eb-b64e-f5d5468ba024 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:27.125575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b1f73-50de-48eb-b64e-f5d5468ba024 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:27.136982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed19105-702e-49e5-a67d-7678e6ba40ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:27.138487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed19105-702e-49e5-a67d-7678e6ba40ed service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:27.139121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed19105-702e-49e5-a67d-7678e6ba40ed service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:27.139801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed19105-702e-49e5-a67d-7678e6ba40ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:27.159891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed19105-702e-49e5-a67d-7678e6ba40ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:27.165069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed19105-702e-49e5-a67d-7678e6ba40ed service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:27.184412 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1711/3383] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:52:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 20:52:27.789238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f39dd-6091-4b90-a34c-f6520283f0a3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:27.789799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f39dd-6091-4b90-a34c-f6520283f0a3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:27.789799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f39dd-6091-4b90-a34c-f6520283f0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:27.830616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-322f39dd-6091-4b90-a34c-f6520283f0a3 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:27.832277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-322f39dd-6091-4b90-a34c-f6520283f0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:27.853101 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1673/3384] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:52:27 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:27.879488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed19105-702e-49e5-a67d-7678e6ba40ed service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:27.907157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed19105-702e-49e5-a67d-7678e6ba40ed service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:27.913965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c1a0f-8ba3-4006-984a-04e8aaae785e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:27.914910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c1a0f-8ba3-4006-984a-04e8aaae785e service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:27.915376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c1a0f-8ba3-4006-984a-04e8aaae785e service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:27.915854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c1a0f-8ba3-4006-984a-04e8aaae785e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:27.926600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c1a0f-8ba3-4006-984a-04e8aaae785e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:27.930191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c1a0f-8ba3-4006-984a-04e8aaae785e service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:27.952868 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1712/3385] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:52:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:52:28.356389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce0ea-1186-4abe-a560-215c54549060 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:28.356790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce0ea-1186-4abe-a560-215c54549060 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:28.357149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce0ea-1186-4abe-a560-215c54549060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:28.400952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-dabce0ea-1186-4abe-a560-215c54549060 None None] MFA Rules not processed for user `09d32c08216a4035907c888a3c8cd70f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:28.402632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-dabce0ea-1186-4abe-a560-215c54549060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:28.544209 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1674/3386] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:28 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:28.598515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a47456-bee1-4919-99ee-0323c83bc60a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:28.598845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a47456-bee1-4919-99ee-0323c83bc60a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:28.599334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a47456-bee1-4919-99ee-0323c83bc60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:28.629397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-36a47456-bee1-4919-99ee-0323c83bc60a None None] MFA Rules not processed for user `9073865992504246b9d1699da089c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:28.632063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-36a47456-bee1-4919-99ee-0323c83bc60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:28.860862 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1713/3387] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:28 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:28.874545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f8c0e-aac7-44a5-ad5e-cc20c126fda7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:28.876578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f8c0e-aac7-44a5-ad5e-cc20c126fda7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:28.877308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f8c0e-aac7-44a5-ad5e-cc20c126fda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:28.914704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-978f8c0e-aac7-44a5-ad5e-cc20c126fda7 None None] MFA Rules not processed for user `9073865992504246b9d1699da089c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:28.916079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-978f8c0e-aac7-44a5-ad5e-cc20c126fda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:28.939884 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1675/3388] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:28 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:29.546184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919812a6-e6d9-4dd4-b9cc-a2d472d66c42 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:29.547380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919812a6-e6d9-4dd4-b9cc-a2d472d66c42 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:29.547873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919812a6-e6d9-4dd4-b9cc-a2d472d66c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:29.572801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-919812a6-e6d9-4dd4-b9cc-a2d472d66c42 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:29.573978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-919812a6-e6d9-4dd4-b9cc-a2d472d66c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:29.581603 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1714/3389] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:52:29 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:29.598955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f8c0e-aac7-44a5-ad5e-cc20c126fda7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:29.614775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f8c0e-aac7-44a5-ad5e-cc20c126fda7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:29.620174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea348ad-7993-4ab6-bbd9-cf5e8c6b06a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:29.621798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea348ad-7993-4ab6-bbd9-cf5e8c6b06a4 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:29.622269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea348ad-7993-4ab6-bbd9-cf5e8c6b06a4 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:29.622737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea348ad-7993-4ab6-bbd9-cf5e8c6b06a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:29.634935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea348ad-7993-4ab6-bbd9-cf5e8c6b06a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:29.636786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea348ad-7993-4ab6-bbd9-cf5e8c6b06a4 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:29.648828 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1676/3390] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:52:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:52:29.890312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd64d6-6372-4b1d-ae25-e95f8bbc48d4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:29.890687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd64d6-6372-4b1d-ae25-e95f8bbc48d4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:29.892053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd64d6-6372-4b1d-ae25-e95f8bbc48d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:29.924062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-cddd64d6-6372-4b1d-ae25-e95f8bbc48d4 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:29.925991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cddd64d6-6372-4b1d-ae25-e95f8bbc48d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:29.948600 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1715/3391] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:52:29 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:29.966045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea348ad-7993-4ab6-bbd9-cf5e8c6b06a4 service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:29.977405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea348ad-7993-4ab6-bbd9-cf5e8c6b06a4 service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:29.996389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c55d12-235e-4f8e-bf3b-de661c35170a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:29.997134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c55d12-235e-4f8e-bf3b-de661c35170a service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:29.997430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c55d12-235e-4f8e-bf3b-de661c35170a service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:29.997712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c55d12-235e-4f8e-bf3b-de661c35170a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:30.008781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c55d12-235e-4f8e-bf3b-de661c35170a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:30.010972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c55d12-235e-4f8e-bf3b-de661c35170a service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:30.037022 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1677/3392] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:52:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:52:30.224347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bbee2-7ac8-43ed-ae67-a3c972764c42 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:30.224890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bbee2-7ac8-43ed-ae67-a3c972764c42 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:30.225195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bbee2-7ac8-43ed-ae67-a3c972764c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:30.244672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c64bbee2-7ac8-43ed-ae67-a3c972764c42 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:30.245890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c64bbee2-7ac8-43ed-ae67-a3c972764c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:30.255027 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1716/3393] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:52:30 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:30.268895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c55d12-235e-4f8e-bf3b-de661c35170a service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:30.286086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c55d12-235e-4f8e-bf3b-de661c35170a service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:30.291863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d6cf5-0854-42dc-ba44-78c002224f03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:30.292543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d6cf5-0854-42dc-ba44-78c002224f03 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:30.292946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d6cf5-0854-42dc-ba44-78c002224f03 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:30.293215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d6cf5-0854-42dc-ba44-78c002224f03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:30.301940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d6cf5-0854-42dc-ba44-78c002224f03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:30.303699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d6cf5-0854-42dc-ba44-78c002224f03 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:30.313961 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1678/3394] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:52:30 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:52:30.498136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755e32a-20e1-4a73-9711-c54fd0d424df None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:30.498471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755e32a-20e1-4a73-9711-c54fd0d424df None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:30.498760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755e32a-20e1-4a73-9711-c54fd0d424df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:30.518688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1755e32a-20e1-4a73-9711-c54fd0d424df None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:30.519909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1755e32a-20e1-4a73-9711-c54fd0d424df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:30.527688 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1717/3395] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:52:30 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:30.545263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d6cf5-0854-42dc-ba44-78c002224f03 service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:30.556236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d6cf5-0854-42dc-ba44-78c002224f03 service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:30.562638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb351d1b-1222-4b29-a042-e89cac21bdf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:30.563303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb351d1b-1222-4b29-a042-e89cac21bdf6 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:30.563592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb351d1b-1222-4b29-a042-e89cac21bdf6 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:30.563900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb351d1b-1222-4b29-a042-e89cac21bdf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:30.573227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb351d1b-1222-4b29-a042-e89cac21bdf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:30.574888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb351d1b-1222-4b29-a042-e89cac21bdf6 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:30.583642 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1679/3396] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:52:30 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:52:30.731775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98c885-b037-47b9-956f-d1176b8ba246 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:30.732278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98c885-b037-47b9-956f-d1176b8ba246 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:30.732364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98c885-b037-47b9-956f-d1176b8ba246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:30.751744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fd98c885-b037-47b9-956f-d1176b8ba246 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:30.752982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fd98c885-b037-47b9-956f-d1176b8ba246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:30.760844 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1718/3397] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:52:30 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:30.774956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb351d1b-1222-4b29-a042-e89cac21bdf6 service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:30.787820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb351d1b-1222-4b29-a042-e89cac21bdf6 service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:30.793943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98841f2b-f5b7-4232-b0d1-394891e27fd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:30.794764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98841f2b-f5b7-4232-b0d1-394891e27fd5 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:30.795029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98841f2b-f5b7-4232-b0d1-394891e27fd5 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:30.795506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98841f2b-f5b7-4232-b0d1-394891e27fd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:30.805708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98841f2b-f5b7-4232-b0d1-394891e27fd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:30.807447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98841f2b-f5b7-4232-b0d1-394891e27fd5 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:30.817570 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1680/3398] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:52:30 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:52:31.013777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a164-50f8-4a90-afe0-e7a9098d1879 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:31.014062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a164-50f8-4a90-afe0-e7a9098d1879 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:31.014676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a164-50f8-4a90-afe0-e7a9098d1879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:31.034284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9705a164-50f8-4a90-afe0-e7a9098d1879 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:31.035530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9705a164-50f8-4a90-afe0-e7a9098d1879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:31.046411 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1719/3399] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:52:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:31.060011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98841f2b-f5b7-4232-b0d1-394891e27fd5 service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:31.071567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98841f2b-f5b7-4232-b0d1-394891e27fd5 service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:31.077470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddab7e6-579c-42be-861c-6e2f46ede149 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:31.078126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddab7e6-579c-42be-861c-6e2f46ede149 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:31.078516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddab7e6-579c-42be-861c-6e2f46ede149 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:31.078806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddab7e6-579c-42be-861c-6e2f46ede149 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:31.088983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddab7e6-579c-42be-861c-6e2f46ede149 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:31.090635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddab7e6-579c-42be-861c-6e2f46ede149 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:31.106212 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1681/3400] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:52:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:52:31.235592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705a164-50f8-4a90-afe0-e7a9098d1879 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:31.326568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705a164-50f8-4a90-afe0-e7a9098d1879 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:31.331399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044d6f6-78b0-43e2-a219-d5ffc92ecefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:31.332487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044d6f6-78b0-43e2-a219-d5ffc92ecefe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:31.332775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044d6f6-78b0-43e2-a219-d5ffc92ecefe admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:31.333057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044d6f6-78b0-43e2-a219-d5ffc92ecefe admin admin] PATH_INFO: `/v3/users/9cd2bda390a64f19a8352c272ded3341` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:31.334578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044d6f6-78b0-43e2-a219-d5ffc92ecefe admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd2bda390a64f19a8352c272ded3341)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:31.336974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044d6f6-78b0-43e2-a219-d5ffc92ecefe admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:31.399195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5044d6f6-78b0-43e2-a219-d5ffc92ecefe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd2bda390a64f19a8352c272ded3341'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:31.409778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5044d6f6-78b0-43e2-a219-d5ffc92ecefe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd2bda390a64f19a8352c272ded3341'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:31.410659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5044d6f6-78b0-43e2-a219-d5ffc92ecefe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd2bda390a64f19a8352c272ded3341'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:31.427637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5044d6f6-78b0-43e2-a219-d5ffc92ecefe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd2bda390a64f19a8352c272ded3341'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:31.436850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5044d6f6-78b0-43e2-a219-d5ffc92ecefe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd2bda390a64f19a8352c272ded3341'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:31.443849 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1720/3401] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:52:31 2021] DELETE /identity/v3/users/9cd2bda390a64f19a8352c272ded3341 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:31.449109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdfb95-0ac4-4728-9e82-10640de28c46 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:31.449546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdfb95-0ac4-4728-9e82-10640de28c46 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:31.449928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdfb95-0ac4-4728-9e82-10640de28c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:31.472563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6bbdfb95-0ac4-4728-9e82-10640de28c46 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:31.474087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6bbdfb95-0ac4-4728-9e82-10640de28c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:31.552369 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1682/3402] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:52:31.572575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044d6f6-78b0-43e2-a219-d5ffc92ecefe admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:31.574272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5044d6f6-78b0-43e2-a219-d5ffc92ecefe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:31.695502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044d6f6-78b0-43e2-a219-d5ffc92ecefe admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:31.708995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c38cf1-1911-43ba-a5da-2b15c88c8b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:31.709999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c38cf1-1911-43ba-a5da-2b15c88c8b57 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:31.710523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c38cf1-1911-43ba-a5da-2b15c88c8b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:31.711456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c38cf1-1911-43ba-a5da-2b15c88c8b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:31.730072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c38cf1-1911-43ba-a5da-2b15c88c8b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:31.732076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c38cf1-1911-43ba-a5da-2b15c88c8b57 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:31.747080 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1721/3403] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:52:32.375021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdfb95-0ac4-4728-9e82-10640de28c46 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:32.378003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6bbdfb95-0ac4-4728-9e82-10640de28c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:32.427446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdfb95-0ac4-4728-9e82-10640de28c46 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:32.451095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007251c7-cc04-4b1d-a935-39520ee7f894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:32.457820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007251c7-cc04-4b1d-a935-39520ee7f894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:32.458344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007251c7-cc04-4b1d-a935-39520ee7f894 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:32.458783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007251c7-cc04-4b1d-a935-39520ee7f894 admin admin] PATH_INFO: `/v3/projects/07bce02fee24475fab38d05b208d1f2f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:32.464305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007251c7-cc04-4b1d-a935-39520ee7f894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07bce02fee24475fab38d05b208d1f2f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:32.466482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007251c7-cc04-4b1d-a935-39520ee7f894 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:32.544550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-007251c7-cc04-4b1d-a935-39520ee7f894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07bce02fee24475fab38d05b208d1f2f', 'request_id': 'req-007251c7-cc04-4b1d-a935-39520ee7f894'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:32.560209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-007251c7-cc04-4b1d-a935-39520ee7f894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07bce02fee24475fab38d05b208d1f2f', 'request_id': 'req-007251c7-cc04-4b1d-a935-39520ee7f894'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:32.569250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-007251c7-cc04-4b1d-a935-39520ee7f894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07bce02fee24475fab38d05b208d1f2f', 'request_id': 'req-007251c7-cc04-4b1d-a935-39520ee7f894'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:32.588427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-007251c7-cc04-4b1d-a935-39520ee7f894 admin admin] The token cache is being invalidate because project 07bce02fee24475fab38d05b208d1f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:52:32.589101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-007251c7-cc04-4b1d-a935-39520ee7f894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:32.590228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-007251c7-cc04-4b1d-a935-39520ee7f894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:32.593609 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1683/3404] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:52:32 2021] DELETE /identity/v3/projects/07bce02fee24475fab38d05b208d1f2f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:32.599059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590af6e-d2c4-4d4d-93bf-a7f4ff034aae None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:32.599572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590af6e-d2c4-4d4d-93bf-a7f4ff034aae None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:32.600118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590af6e-d2c4-4d4d-93bf-a7f4ff034aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:32.623862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a590af6e-d2c4-4d4d-93bf-a7f4ff034aae None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:32.625626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a590af6e-d2c4-4d4d-93bf-a7f4ff034aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:32.725899 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1722/3405] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:52:32.734301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122fc27-75bd-4ffb-98a4-64447149b390 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:32.734301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122fc27-75bd-4ffb-98a4-64447149b390 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:32.734301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122fc27-75bd-4ffb-98a4-64447149b390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:32.761091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3122fc27-75bd-4ffb-98a4-64447149b390 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:32.763271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3122fc27-75bd-4ffb-98a4-64447149b390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:32.777386 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1684/3406] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:32.781157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590af6e-d2c4-4d4d-93bf-a7f4ff034aae None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:32.792777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590af6e-d2c4-4d4d-93bf-a7f4ff034aae None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:32.810323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c219ed-7e71-467c-b77b-124d44242c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:32.811270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c219ed-7e71-467c-b77b-124d44242c59 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:32.813208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c219ed-7e71-467c-b77b-124d44242c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:32.813892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c219ed-7e71-467c-b77b-124d44242c59 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:32.816763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c219ed-7e71-467c-b77b-124d44242c59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:52:32.818111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c219ed-7e71-467c-b77b-124d44242c59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:32.820160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c219ed-7e71-467c-b77b-124d44242c59 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:32.839129 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1723/3407] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:52:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:52:32.843413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122fc27-75bd-4ffb-98a4-64447149b390 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:32.857821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122fc27-75bd-4ffb-98a4-64447149b390 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:32.863482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080d5c6-366d-48f3-9b10-f8b3692252a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:32.864388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080d5c6-366d-48f3-9b10-f8b3692252a8 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:32.864862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080d5c6-366d-48f3-9b10-f8b3692252a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:32.865317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080d5c6-366d-48f3-9b10-f8b3692252a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:32.866194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080d5c6-366d-48f3-9b10-f8b3692252a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:32.868466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080d5c6-366d-48f3-9b10-f8b3692252a8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:32.905950 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1685/3408] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:52:32 2021] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:52:32.909805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c219ed-7e71-467c-b77b-124d44242c59 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:32.922148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c219ed-7e71-467c-b77b-124d44242c59 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:32.983353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde8183-a1d3-479c-b5ab-ee8f23be5640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:32.984323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde8183-a1d3-479c-b5ab-ee8f23be5640 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:32.984792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde8183-a1d3-479c-b5ab-ee8f23be5640 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:32.985219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde8183-a1d3-479c-b5ab-ee8f23be5640 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:32.986072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde8183-a1d3-479c-b5ab-ee8f23be5640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:32.988198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde8183-a1d3-479c-b5ab-ee8f23be5640 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:33.013691 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1724/3409] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:52:32 2021] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:52:33.017402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080d5c6-366d-48f3-9b10-f8b3692252a8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:33.028155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080d5c6-366d-48f3-9b10-f8b3692252a8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:33.033069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c532951-a500-4c1b-966b-0e6df15036c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:33.033760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c532951-a500-4c1b-966b-0e6df15036c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:33.034050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c532951-a500-4c1b-966b-0e6df15036c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:33.034371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c532951-a500-4c1b-966b-0e6df15036c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:33.035121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c532951-a500-4c1b-966b-0e6df15036c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:33.036732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c532951-a500-4c1b-966b-0e6df15036c0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:33.048163 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1686/3410] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:52:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:52:33.052116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde8183-a1d3-479c-b5ab-ee8f23be5640 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:33.065015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde8183-a1d3-479c-b5ab-ee8f23be5640 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:33.071309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab90a9d-1b35-40c1-a91f-b56fc0692b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:33.072575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab90a9d-1b35-40c1-a91f-b56fc0692b89 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:33.073014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab90a9d-1b35-40c1-a91f-b56fc0692b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:33.073294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab90a9d-1b35-40c1-a91f-b56fc0692b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:33.074029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab90a9d-1b35-40c1-a91f-b56fc0692b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:33.075686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab90a9d-1b35-40c1-a91f-b56fc0692b89 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:33.086524 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1725/3411] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:52:33 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:52:33.090850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c532951-a500-4c1b-966b-0e6df15036c0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:33.101651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c532951-a500-4c1b-966b-0e6df15036c0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:33.108074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718579a-1284-4b01-ae26-33f6e6bc47dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:33.109146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718579a-1284-4b01-ae26-33f6e6bc47dd admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:33.109554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718579a-1284-4b01-ae26-33f6e6bc47dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:33.109929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718579a-1284-4b01-ae26-33f6e6bc47dd admin admin] PATH_INFO: `/v3/projects/d26846dd77cd46c3a5372d262ab306e6/users/14b41be2d0e049bf9518de5d42bbe619/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:33.129424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718579a-1284-4b01-ae26-33f6e6bc47dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26846dd77cd46c3a5372d262ab306e6, user_id=14b41be2d0e049bf9518de5d42bbe619, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:33.132343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718579a-1284-4b01-ae26-33f6e6bc47dd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:33.148376 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1687/3412] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:52:33 2021] PUT /identity/v3/projects/d26846dd77cd46c3a5372d262ab306e6/users/14b41be2d0e049bf9518de5d42bbe619/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:33.159030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cbc61-6f28-4d6c-af08-513e01c5f0fd None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:33.159388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cbc61-6f28-4d6c-af08-513e01c5f0fd None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:33.159863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cbc61-6f28-4d6c-af08-513e01c5f0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:33.189353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-eb0cbc61-6f28-4d6c-af08-513e01c5f0fd None None] MFA Rules not processed for user `14b41be2d0e049bf9518de5d42bbe619`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:33.190620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-eb0cbc61-6f28-4d6c-af08-513e01c5f0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:33.256368 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1726/3413] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:33 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:33.269790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718579a-1284-4b01-ae26-33f6e6bc47dd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:33.271549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3718579a-1284-4b01-ae26-33f6e6bc47dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:33.330932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718579a-1284-4b01-ae26-33f6e6bc47dd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:33.334879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740906f-95ce-4bda-b236-37fc74532feb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:33.335521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740906f-95ce-4bda-b236-37fc74532feb service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:33.335802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740906f-95ce-4bda-b236-37fc74532feb service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:33.336080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740906f-95ce-4bda-b236-37fc74532feb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:33.344533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740906f-95ce-4bda-b236-37fc74532feb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:33.345945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740906f-95ce-4bda-b236-37fc74532feb service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:33.355081 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1688/3414] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:33 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:52:33.456284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0cbc61-6f28-4d6c-af08-513e01c5f0fd None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:33.518991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0cbc61-6f28-4d6c-af08-513e01c5f0fd None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:33.523579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0133b6-e925-485d-94da-6860be9d2bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:33.524537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0133b6-e925-485d-94da-6860be9d2bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:33.525241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0133b6-e925-485d-94da-6860be9d2bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:33.525532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0133b6-e925-485d-94da-6860be9d2bf3 admin admin] PATH_INFO: `/v3/users/14b41be2d0e049bf9518de5d42bbe619` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:33.526794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0133b6-e925-485d-94da-6860be9d2bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b41be2d0e049bf9518de5d42bbe619)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:33.528887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0133b6-e925-485d-94da-6860be9d2bf3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:33.577803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fd0133b6-e925-485d-94da-6860be9d2bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b41be2d0e049bf9518de5d42bbe619'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:33.584399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fd0133b6-e925-485d-94da-6860be9d2bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b41be2d0e049bf9518de5d42bbe619'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:33.585054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fd0133b6-e925-485d-94da-6860be9d2bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b41be2d0e049bf9518de5d42bbe619'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:33.597697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fd0133b6-e925-485d-94da-6860be9d2bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b41be2d0e049bf9518de5d42bbe619'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:33.606664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fd0133b6-e925-485d-94da-6860be9d2bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b41be2d0e049bf9518de5d42bbe619'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:33.612658 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1727/3415] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:52:33 2021] DELETE /identity/v3/users/14b41be2d0e049bf9518de5d42bbe619 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:33.617266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4747c8e-340c-422c-b114-84fbe2e099dd None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:33.617744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4747c8e-340c-422c-b114-84fbe2e099dd None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:33.617843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4747c8e-340c-422c-b114-84fbe2e099dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:33.635905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f4747c8e-340c-422c-b114-84fbe2e099dd None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:33.637114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f4747c8e-340c-422c-b114-84fbe2e099dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:33.696586 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1689/3416] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:33.706869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0133b6-e925-485d-94da-6860be9d2bf3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:33.708752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fd0133b6-e925-485d-94da-6860be9d2bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:33.768958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0133b6-e925-485d-94da-6860be9d2bf3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:33.772797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd054464-962e-4031-8267-6cf4b3a1aefe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:33.773432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd054464-962e-4031-8267-6cf4b3a1aefe service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:33.773726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd054464-962e-4031-8267-6cf4b3a1aefe service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:33.773987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd054464-962e-4031-8267-6cf4b3a1aefe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:33.783963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd054464-962e-4031-8267-6cf4b3a1aefe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:33.785387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd054464-962e-4031-8267-6cf4b3a1aefe service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:33.796400 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1728/3417] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:52:34.083415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4747c8e-340c-422c-b114-84fbe2e099dd None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:34.085167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f4747c8e-340c-422c-b114-84fbe2e099dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:34.105777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4747c8e-340c-422c-b114-84fbe2e099dd None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:34.111730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313643da-0d4f-462b-b79c-4900d801c0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:34.112438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313643da-0d4f-462b-b79c-4900d801c0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:34.112719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313643da-0d4f-462b-b79c-4900d801c0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:34.112996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313643da-0d4f-462b-b79c-4900d801c0ba admin admin] PATH_INFO: `/v3/projects/d26846dd77cd46c3a5372d262ab306e6` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:34.123433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313643da-0d4f-462b-b79c-4900d801c0ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26846dd77cd46c3a5372d262ab306e6)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:34.125368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313643da-0d4f-462b-b79c-4900d801c0ba admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:34.174934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-313643da-0d4f-462b-b79c-4900d801c0ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26846dd77cd46c3a5372d262ab306e6', 'request_id': 'req-313643da-0d4f-462b-b79c-4900d801c0ba'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:34.181335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-313643da-0d4f-462b-b79c-4900d801c0ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26846dd77cd46c3a5372d262ab306e6', 'request_id': 'req-313643da-0d4f-462b-b79c-4900d801c0ba'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:34.188136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-313643da-0d4f-462b-b79c-4900d801c0ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26846dd77cd46c3a5372d262ab306e6', 'request_id': 'req-313643da-0d4f-462b-b79c-4900d801c0ba'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:34.201919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-313643da-0d4f-462b-b79c-4900d801c0ba admin admin] The token cache is being invalidate because project d26846dd77cd46c3a5372d262ab306e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:52:34.202134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-313643da-0d4f-462b-b79c-4900d801c0ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:34.202923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-313643da-0d4f-462b-b79c-4900d801c0ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:52:34.204466 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1690/3418] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:52:34 2021] DELETE /identity/v3/projects/d26846dd77cd46c3a5372d262ab306e6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:34.210061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebb212-5c81-464b-a887-231d8c11043a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:34.210401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebb212-5c81-464b-a887-231d8c11043a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:34.210697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebb212-5c81-464b-a887-231d8c11043a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:34.229773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-cfebb212-5c81-464b-a887-231d8c11043a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:34.231036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cfebb212-5c81-464b-a887-231d8c11043a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:34.291956 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1729/3419] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:34.299894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f67e06-8e65-4466-8015-b38bdb393846 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:34.300182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f67e06-8e65-4466-8015-b38bdb393846 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:34.300481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f67e06-8e65-4466-8015-b38bdb393846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:34.321715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-47f67e06-8e65-4466-8015-b38bdb393846 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:34.322987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-47f67e06-8e65-4466-8015-b38bdb393846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:34.330810 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1691/3420] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:52:34.345821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebb212-5c81-464b-a887-231d8c11043a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:34.357606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebb212-5c81-464b-a887-231d8c11043a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:34.363015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb7011-4cae-4e1c-a66d-06da15a0ad8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:34.363750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb7011-4cae-4e1c-a66d-06da15a0ad8a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:34.364102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb7011-4cae-4e1c-a66d-06da15a0ad8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:34.364446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb7011-4cae-4e1c-a66d-06da15a0ad8a admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:34.365275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb7011-4cae-4e1c-a66d-06da15a0ad8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:52:34.365651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb7011-4cae-4e1c-a66d-06da15a0ad8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:34.367462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb7011-4cae-4e1c-a66d-06da15a0ad8a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:34.380714 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1730/3421] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:52:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:52:34.385227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f67e06-8e65-4466-8015-b38bdb393846 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:34.396364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f67e06-8e65-4466-8015-b38bdb393846 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:34.401893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e671ce-bc02-425f-a132-c0c9be339b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:34.402900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e671ce-bc02-425f-a132-c0c9be339b89 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:34.403266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e671ce-bc02-425f-a132-c0c9be339b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:34.403614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e671ce-bc02-425f-a132-c0c9be339b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:34.404521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e671ce-bc02-425f-a132-c0c9be339b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:34.407089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e671ce-bc02-425f-a132-c0c9be339b89 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:34.439373 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1692/3422] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:52:34 2021] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:52:34.443507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb7011-4cae-4e1c-a66d-06da15a0ad8a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:34.453974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb7011-4cae-4e1c-a66d-06da15a0ad8a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:34.514562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacd5b4-1e28-4ec7-bb6d-4fc5a74c1705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:34.515362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacd5b4-1e28-4ec7-bb6d-4fc5a74c1705 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:34.515713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacd5b4-1e28-4ec7-bb6d-4fc5a74c1705 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:34.516124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacd5b4-1e28-4ec7-bb6d-4fc5a74c1705 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:34.516898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacd5b4-1e28-4ec7-bb6d-4fc5a74c1705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:34.518910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacd5b4-1e28-4ec7-bb6d-4fc5a74c1705 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:34.543692 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1731/3423] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:52:34 2021] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:52:34.544883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e671ce-bc02-425f-a132-c0c9be339b89 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:34.555137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e671ce-bc02-425f-a132-c0c9be339b89 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:34.560624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e75ee-3aae-4b79-96d7-130ca251bfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:34.561199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e75ee-3aae-4b79-96d7-130ca251bfb8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:34.561517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e75ee-3aae-4b79-96d7-130ca251bfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:34.561887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e75ee-3aae-4b79-96d7-130ca251bfb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:34.562940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e75ee-3aae-4b79-96d7-130ca251bfb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:34.564642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e75ee-3aae-4b79-96d7-130ca251bfb8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:34.576673 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1693/3424] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:52:34 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:52:34.580493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacd5b4-1e28-4ec7-bb6d-4fc5a74c1705 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:34.592326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacd5b4-1e28-4ec7-bb6d-4fc5a74c1705 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:34.597190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f6865-5d5d-4a29-bdb6-5567212e9a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:34.597960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f6865-5d5d-4a29-bdb6-5567212e9a12 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:34.598306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f6865-5d5d-4a29-bdb6-5567212e9a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:34.598588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f6865-5d5d-4a29-bdb6-5567212e9a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:34.599319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f6865-5d5d-4a29-bdb6-5567212e9a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:34.600889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f6865-5d5d-4a29-bdb6-5567212e9a12 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:34.614627 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1732/3425] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:52:34 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:52:34.616121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e75ee-3aae-4b79-96d7-130ca251bfb8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:34.626406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e75ee-3aae-4b79-96d7-130ca251bfb8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:34.632708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4139c9-f7b8-405f-b57a-eafda6f2fc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:34.633631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4139c9-f7b8-405f-b57a-eafda6f2fc7c admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:34.633918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4139c9-f7b8-405f-b57a-eafda6f2fc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:34.634197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4139c9-f7b8-405f-b57a-eafda6f2fc7c admin admin] PATH_INFO: `/v3/projects/e6db5c53936c43c1955b27d55e7c15c3/users/824c76a1402b45068b252e66864fb6d0/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:34.649329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4139c9-f7b8-405f-b57a-eafda6f2fc7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6db5c53936c43c1955b27d55e7c15c3, user_id=824c76a1402b45068b252e66864fb6d0, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:34.652622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4139c9-f7b8-405f-b57a-eafda6f2fc7c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:34.666780 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1694/3426] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:52:34 2021] PUT /identity/v3/projects/e6db5c53936c43c1955b27d55e7c15c3/users/824c76a1402b45068b252e66864fb6d0/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:52:34.683022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a689c73-3e27-4cb1-b97c-67d1b458090d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:34.683319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a689c73-3e27-4cb1-b97c-67d1b458090d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:34.683601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a689c73-3e27-4cb1-b97c-67d1b458090d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:34.716258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0a689c73-3e27-4cb1-b97c-67d1b458090d None None] MFA Rules not processed for user `824c76a1402b45068b252e66864fb6d0`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:34.718190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0a689c73-3e27-4cb1-b97c-67d1b458090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:34.793331 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1733/3427] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:34 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:34.805314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4139c9-f7b8-405f-b57a-eafda6f2fc7c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:34.807165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ed4139c9-f7b8-405f-b57a-eafda6f2fc7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:34.866670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4139c9-f7b8-405f-b57a-eafda6f2fc7c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:34.870413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6a9db-d812-45b3-9c96-137c1d91155f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:34.871200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6a9db-d812-45b3-9c96-137c1d91155f service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:34.871483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6a9db-d812-45b3-9c96-137c1d91155f service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:34.871762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6a9db-d812-45b3-9c96-137c1d91155f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:34.880930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6a9db-d812-45b3-9c96-137c1d91155f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:34.882890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6a9db-d812-45b3-9c96-137c1d91155f service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:34.894412 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1695/3428] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:34 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:52:44.227267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c39ef-e4b7-4ddc-bd1c-9c9187d753b3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:44.227820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c39ef-e4b7-4ddc-bd1c-9c9187d753b3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:44.228198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c39ef-e4b7-4ddc-bd1c-9c9187d753b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:44.256945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-196c39ef-e4b7-4ddc-bd1c-9c9187d753b3 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:44.276172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-196c39ef-e4b7-4ddc-bd1c-9c9187d753b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:44.367975 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1734/3429] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:52:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:52:44.393464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6a9db-d812-45b3-9c96-137c1d91155f service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:44.395024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bbb6a9db-d812-45b3-9c96-137c1d91155f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:44.490895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6a9db-d812-45b3-9c96-137c1d91155f service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:44.501308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfa701-9e73-4ba6-83a5-5a413952f9f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:44.502360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfa701-9e73-4ba6-83a5-5a413952f9f0 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:44.502901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfa701-9e73-4ba6-83a5-5a413952f9f0 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:44.503845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfa701-9e73-4ba6-83a5-5a413952f9f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:44.520341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfa701-9e73-4ba6-83a5-5a413952f9f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:44.522293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfa701-9e73-4ba6-83a5-5a413952f9f0 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:44.550898 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1696/3430] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:52:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:52:49.934349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac7ac9-39e1-4d1b-abc3-c98bcddc508e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:49.934349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac7ac9-39e1-4d1b-abc3-c98bcddc508e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:49.934349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac7ac9-39e1-4d1b-abc3-c98bcddc508e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:49.984984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9dac7ac9-39e1-4d1b-abc3-c98bcddc508e None None] MFA Rules not processed for user `05a9edc0cd6b4eaababe6d74aa697bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:49.989920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9dac7ac9-39e1-4d1b-abc3-c98bcddc508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:50.166591 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1735/3431] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:52:49 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:52:51.725840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfa701-9e73-4ba6-83a5-5a413952f9f0 service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:51.728393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-98bfa701-9e73-4ba6-83a5-5a413952f9f0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:51.772225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfa701-9e73-4ba6-83a5-5a413952f9f0 service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:51.776788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490ecbf-853e-437a-8929-8345ad05bef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:51.777697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490ecbf-853e-437a-8929-8345ad05bef7 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:51.778657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490ecbf-853e-437a-8929-8345ad05bef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:51.780602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490ecbf-853e-437a-8929-8345ad05bef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:51.784131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9490ecbf-853e-437a-8929-8345ad05bef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:51.805228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490ecbf-853e-437a-8929-8345ad05bef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:51.829339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490ecbf-853e-437a-8929-8345ad05bef7 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:51.842777 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1697/3432] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:51 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:52:52.763193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509d991-bd26-4da4-9ad6-bd01a0674f53 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:52.763683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509d991-bd26-4da4-9ad6-bd01a0674f53 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:52.763985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509d991-bd26-4da4-9ad6-bd01a0674f53 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:52.768216 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1736/3433] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:52:52 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:52:52.792136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86de31-7639-404e-b1e6-b2f23d25c358 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:52.792614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86de31-7639-404e-b1e6-b2f23d25c358 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:52.792781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86de31-7639-404e-b1e6-b2f23d25c358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:52.825101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1e86de31-7639-404e-b1e6-b2f23d25c358 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:52:52.826831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1e86de31-7639-404e-b1e6-b2f23d25c358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:52.981328 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1698/3434] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:52:52 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:52:53.008306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509d991-bd26-4da4-9ad6-bd01a0674f53 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:52:53.010607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3509d991-bd26-4da4-9ad6-bd01a0674f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:52:53.044351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509d991-bd26-4da4-9ad6-bd01a0674f53 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:52:53.051452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bf3ed-8caa-4437-ac8a-ababc705b7ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:52:53.052343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bf3ed-8caa-4437-ac8a-ababc705b7ee service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:52:53.053498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bf3ed-8caa-4437-ac8a-ababc705b7ee service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:52:53.057989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bf3ed-8caa-4437-ac8a-ababc705b7ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:52:53.079204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0bf3ed-8caa-4437-ac8a-ababc705b7ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:52:53.081505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0bf3ed-8caa-4437-ac8a-ababc705b7ee service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:52:53.098370 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1737/3435] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:52:53 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:02.180353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86de31-7639-404e-b1e6-b2f23d25c358 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:02.316081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86de31-7639-404e-b1e6-b2f23d25c358 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:02.334096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c2dfa-0d6f-41ca-ae26-01d7221ae522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:02.339886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c2dfa-0d6f-41ca-ae26-01d7221ae522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:02.340085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c2dfa-0d6f-41ca-ae26-01d7221ae522 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:02.342457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c2dfa-0d6f-41ca-ae26-01d7221ae522 admin admin] PATH_INFO: `/v3/users/824c76a1402b45068b252e66864fb6d0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:02.346399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c2dfa-0d6f-41ca-ae26-01d7221ae522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=824c76a1402b45068b252e66864fb6d0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:02.349921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c2dfa-0d6f-41ca-ae26-01d7221ae522 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:02.445709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4a1c2dfa-0d6f-41ca-ae26-01d7221ae522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '824c76a1402b45068b252e66864fb6d0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:02.459599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4a1c2dfa-0d6f-41ca-ae26-01d7221ae522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '824c76a1402b45068b252e66864fb6d0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:02.477041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4a1c2dfa-0d6f-41ca-ae26-01d7221ae522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '824c76a1402b45068b252e66864fb6d0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:02.478663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4a1c2dfa-0d6f-41ca-ae26-01d7221ae522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '824c76a1402b45068b252e66864fb6d0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:02.493956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4a1c2dfa-0d6f-41ca-ae26-01d7221ae522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '824c76a1402b45068b252e66864fb6d0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:02.501989 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1699/3436] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:53:02 2021] DELETE /identity/v3/users/824c76a1402b45068b252e66864fb6d0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:02.506730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457809cd-b7ab-45e3-806b-4f0a71e54827 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:02.507540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457809cd-b7ab-45e3-806b-4f0a71e54827 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:02.508003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457809cd-b7ab-45e3-806b-4f0a71e54827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:02.543070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-457809cd-b7ab-45e3-806b-4f0a71e54827 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:02.549455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-457809cd-b7ab-45e3-806b-4f0a71e54827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:02.638204 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1738/3437] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:02.685527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c2dfa-0d6f-41ca-ae26-01d7221ae522 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:02.687512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4a1c2dfa-0d6f-41ca-ae26-01d7221ae522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:02.846812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c2dfa-0d6f-41ca-ae26-01d7221ae522 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:02.856653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292885a5-c800-4286-94f1-15da812bba45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:02.857723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292885a5-c800-4286-94f1-15da812bba45 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:02.860764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292885a5-c800-4286-94f1-15da812bba45 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:02.861176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292885a5-c800-4286-94f1-15da812bba45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:02.879288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292885a5-c800-4286-94f1-15da812bba45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:02.881120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292885a5-c800-4286-94f1-15da812bba45 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:02.941973 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1700/3438] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:04.043975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457809cd-b7ab-45e3-806b-4f0a71e54827 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:04.045755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-457809cd-b7ab-45e3-806b-4f0a71e54827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:04.088668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457809cd-b7ab-45e3-806b-4f0a71e54827 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:04.098012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aaac7e-3790-419d-b5e9-4350c1ce2b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:04.099285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaac7e-3790-419d-b5e9-4350c1ce2b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:04.099754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaac7e-3790-419d-b5e9-4350c1ce2b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:04.100256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaac7e-3790-419d-b5e9-4350c1ce2b00 admin admin] PATH_INFO: `/v3/projects/e6db5c53936c43c1955b27d55e7c15c3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:04.103239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aaac7e-3790-419d-b5e9-4350c1ce2b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6db5c53936c43c1955b27d55e7c15c3)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:04.106806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aaac7e-3790-419d-b5e9-4350c1ce2b00 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:04.235266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6aaac7e-3790-419d-b5e9-4350c1ce2b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6db5c53936c43c1955b27d55e7c15c3', 'request_id': 'req-c6aaac7e-3790-419d-b5e9-4350c1ce2b00'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:04.247341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6aaac7e-3790-419d-b5e9-4350c1ce2b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6db5c53936c43c1955b27d55e7c15c3', 'request_id': 'req-c6aaac7e-3790-419d-b5e9-4350c1ce2b00'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:04.268146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6aaac7e-3790-419d-b5e9-4350c1ce2b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6db5c53936c43c1955b27d55e7c15c3', 'request_id': 'req-c6aaac7e-3790-419d-b5e9-4350c1ce2b00'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:04.287816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6aaac7e-3790-419d-b5e9-4350c1ce2b00 admin admin] The token cache is being invalidate because project e6db5c53936c43c1955b27d55e7c15c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:53:04.288115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6aaac7e-3790-419d-b5e9-4350c1ce2b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:04.291046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6aaac7e-3790-419d-b5e9-4350c1ce2b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:04.293072 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1739/3439] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:53:04 2021] DELETE /identity/v3/projects/e6db5c53936c43c1955b27d55e7c15c3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:04.299875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f536df-1043-4d07-b8f8-82afbbd5f124 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:04.300894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f536df-1043-4d07-b8f8-82afbbd5f124 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:04.301363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f536df-1043-4d07-b8f8-82afbbd5f124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:04.334621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a1f536df-1043-4d07-b8f8-82afbbd5f124 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:04.336855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a1f536df-1043-4d07-b8f8-82afbbd5f124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:04.572133 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1701/3440] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:04.579449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cba15-ef8c-41a4-9d98-70b71793b7e3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:04.579737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cba15-ef8c-41a4-9d98-70b71793b7e3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:04.583068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cba15-ef8c-41a4-9d98-70b71793b7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:04.625251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-766cba15-ef8c-41a4-9d98-70b71793b7e3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:04.629757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-766cba15-ef8c-41a4-9d98-70b71793b7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:04.655964 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1740/3441] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:04.663722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f536df-1043-4d07-b8f8-82afbbd5f124 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:04.695776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f536df-1043-4d07-b8f8-82afbbd5f124 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:04.744425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3d30f-6ef8-4f33-976c-6bf9dfa42e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:04.745162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3d30f-6ef8-4f33-976c-6bf9dfa42e86 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:04.745525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3d30f-6ef8-4f33-976c-6bf9dfa42e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:04.745720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3d30f-6ef8-4f33-976c-6bf9dfa42e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:04.749440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3d30f-6ef8-4f33-976c-6bf9dfa42e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:53:04.750523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3d30f-6ef8-4f33-976c-6bf9dfa42e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:04.755502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3d30f-6ef8-4f33-976c-6bf9dfa42e86 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:04.787606 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1702/3442] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:53:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:53:04.793083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cba15-ef8c-41a4-9d98-70b71793b7e3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:04.804911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cba15-ef8c-41a4-9d98-70b71793b7e3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:04.815012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835702e-d412-4cc0-856c-3bad776d1a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:04.815935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835702e-d412-4cc0-856c-3bad776d1a41 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:04.816433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835702e-d412-4cc0-856c-3bad776d1a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:04.817624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835702e-d412-4cc0-856c-3bad776d1a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:04.818542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835702e-d412-4cc0-856c-3bad776d1a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:04.820856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835702e-d412-4cc0-856c-3bad776d1a41 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:04.905691 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1741/3443] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:53:04 2021] POST /identity/v3/projects => generated 361 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:04.909270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3d30f-6ef8-4f33-976c-6bf9dfa42e86 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:04.935850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3d30f-6ef8-4f33-976c-6bf9dfa42e86 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:05.111450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835702e-d412-4cc0-856c-3bad776d1a41 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:05.114497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b835702e-d412-4cc0-856c-3bad776d1a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:05.193835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cde3c-6b06-45b8-aaf7-b8edcc67a003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:05.194859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cde3c-6b06-45b8-aaf7-b8edcc67a003 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:05.195422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cde3c-6b06-45b8-aaf7-b8edcc67a003 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:05.195864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cde3c-6b06-45b8-aaf7-b8edcc67a003 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:05.197449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cde3c-6b06-45b8-aaf7-b8edcc67a003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:05.201541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cde3c-6b06-45b8-aaf7-b8edcc67a003 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:05.229086 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1703/3444] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:53:04 2021] POST /identity/v3/users => generated 281 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:05.245061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cde3c-6b06-45b8-aaf7-b8edcc67a003 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:05.290902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cde3c-6b06-45b8-aaf7-b8edcc67a003 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:05.305502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08aab52-543a-4eeb-ba91-60bc18b4d4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:05.307822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aab52-543a-4eeb-ba91-60bc18b4d4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:05.309472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aab52-543a-4eeb-ba91-60bc18b4d4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:05.309791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aab52-543a-4eeb-ba91-60bc18b4d4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:05.311038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08aab52-543a-4eeb-ba91-60bc18b4d4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:05.319431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08aab52-543a-4eeb-ba91-60bc18b4d4f4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:05.329383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835702e-d412-4cc0-856c-3bad776d1a41 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:05.336594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b539b-7b9e-48af-80e0-dec3c279ab82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:05.338999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b539b-7b9e-48af-80e0-dec3c279ab82 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:05.339481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b539b-7b9e-48af-80e0-dec3c279ab82 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:05.339966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b539b-7b9e-48af-80e0-dec3c279ab82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:05.342139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c21b539b-7b9e-48af-80e0-dec3c279ab82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:05.347507 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1704/3445] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:05 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:05.363381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08aab52-543a-4eeb-ba91-60bc18b4d4f4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:05.381281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08aab52-543a-4eeb-ba91-60bc18b4d4f4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:05.391771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5664dc6-c0b0-484a-a2b6-fd57d2b26448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:05.392627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5664dc6-c0b0-484a-a2b6-fd57d2b26448 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:05.392936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5664dc6-c0b0-484a-a2b6-fd57d2b26448 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:05.393204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5664dc6-c0b0-484a-a2b6-fd57d2b26448 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:05.393961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5664dc6-c0b0-484a-a2b6-fd57d2b26448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:05.395602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5664dc6-c0b0-484a-a2b6-fd57d2b26448 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:05.436297 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1705/3446] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:05 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:05.440620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5664dc6-c0b0-484a-a2b6-fd57d2b26448 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:05.454011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5664dc6-c0b0-484a-a2b6-fd57d2b26448 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:05.459161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e3b77-3de5-49fa-b92b-5d83ddf233b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:05.460160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e3b77-3de5-49fa-b92b-5d83ddf233b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:05.460448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e3b77-3de5-49fa-b92b-5d83ddf233b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:05.460731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e3b77-3de5-49fa-b92b-5d83ddf233b3 admin admin] PATH_INFO: `/v3/projects/76b2df85c79f4fb198e8337010cb606b/users/91814ecd4d6e44efab348dca4f35878c/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:05.461728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b539b-7b9e-48af-80e0-dec3c279ab82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:05.465500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b539b-7b9e-48af-80e0-dec3c279ab82 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:05.483104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e3b77-3de5-49fa-b92b-5d83ddf233b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b2df85c79f4fb198e8337010cb606b, user_id=91814ecd4d6e44efab348dca4f35878c, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:05.491642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e3b77-3de5-49fa-b92b-5d83ddf233b3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:05.507724 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1742/3447] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:05 2021] GET /identity/v3/auth/tokens => generated 3270 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:05.514196 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1706/3448] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:53:05 2021] PUT /identity/v3/projects/76b2df85c79f4fb198e8337010cb606b/users/91814ecd4d6e44efab348dca4f35878c/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:05.611212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2a039-6f63-44d0-9ebb-c028d876d7b6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:05.611445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2a039-6f63-44d0-9ebb-c028d876d7b6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:05.612568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2a039-6f63-44d0-9ebb-c028d876d7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:05.666869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-79a2a039-6f63-44d0-9ebb-c028d876d7b6 None None] MFA Rules not processed for user `91814ecd4d6e44efab348dca4f35878c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:05.669139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-79a2a039-6f63-44d0-9ebb-c028d876d7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:05.781601 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1743/3449] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:05 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:05.799737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e3b77-3de5-49fa-b92b-5d83ddf233b3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:05.802805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-572e3b77-3de5-49fa-b92b-5d83ddf233b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:05.919224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e3b77-3de5-49fa-b92b-5d83ddf233b3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:05.926839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b13fae-8428-4b52-8286-4b8f5a2b3952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:05.928354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b13fae-8428-4b52-8286-4b8f5a2b3952 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:05.928838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b13fae-8428-4b52-8286-4b8f5a2b3952 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:05.930302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b13fae-8428-4b52-8286-4b8f5a2b3952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:05.949655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b13fae-8428-4b52-8286-4b8f5a2b3952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:05.955742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b13fae-8428-4b52-8286-4b8f5a2b3952 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:05.971731 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1707/3450] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:05 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:53:07.842926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2a039-6f63-44d0-9ebb-c028d876d7b6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:07.862029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2a039-6f63-44d0-9ebb-c028d876d7b6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:07.873137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac196a31-fc83-456e-bbee-1166db7ef539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:07.876486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac196a31-fc83-456e-bbee-1166db7ef539 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:07.877735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac196a31-fc83-456e-bbee-1166db7ef539 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:07.880217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac196a31-fc83-456e-bbee-1166db7ef539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:07.884965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ac196a31-fc83-456e-bbee-1166db7ef539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:08.010118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac196a31-fc83-456e-bbee-1166db7ef539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:08.011926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac196a31-fc83-456e-bbee-1166db7ef539 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:08.028551 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1744/3451] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:12.820126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b40111-bb9f-4d97-a1df-c54e206a4579 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:12.820961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b40111-bb9f-4d97-a1df-c54e206a4579 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:12.821590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b40111-bb9f-4d97-a1df-c54e206a4579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:12.843163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-52b40111-bb9f-4d97-a1df-c54e206a4579 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:12.844893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-52b40111-bb9f-4d97-a1df-c54e206a4579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:12.922149 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1708/3452] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:53:12 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:12.937009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac196a31-fc83-456e-bbee-1166db7ef539 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:12.939422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ac196a31-fc83-456e-bbee-1166db7ef539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:13.025259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac196a31-fc83-456e-bbee-1166db7ef539 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:13.031519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24fe99-ff04-4799-919b-52a63fbb5e3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:13.032619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24fe99-ff04-4799-919b-52a63fbb5e3e service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:13.033087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24fe99-ff04-4799-919b-52a63fbb5e3e service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:13.033530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24fe99-ff04-4799-919b-52a63fbb5e3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:13.045063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24fe99-ff04-4799-919b-52a63fbb5e3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:13.049097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24fe99-ff04-4799-919b-52a63fbb5e3e service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:13.077047 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1745/3453] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:53:12 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:53:26.855421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b40111-bb9f-4d97-a1df-c54e206a4579 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:26.857326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-52b40111-bb9f-4d97-a1df-c54e206a4579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:26.897371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b40111-bb9f-4d97-a1df-c54e206a4579 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:26.903607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae487c-3486-49b8-a7a6-c5fad508110d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:26.905170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae487c-3486-49b8-a7a6-c5fad508110d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:26.905752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae487c-3486-49b8-a7a6-c5fad508110d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:26.906662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae487c-3486-49b8-a7a6-c5fad508110d admin admin] PATH_INFO: `/v3/users/c3e0c0d3dc8441968dafc98b902ab349` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:26.908604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae487c-3486-49b8-a7a6-c5fad508110d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3e0c0d3dc8441968dafc98b902ab349)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:26.912660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae487c-3486-49b8-a7a6-c5fad508110d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:27.019107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a3ae487c-3486-49b8-a7a6-c5fad508110d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3e0c0d3dc8441968dafc98b902ab349'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:27.037878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a3ae487c-3486-49b8-a7a6-c5fad508110d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3e0c0d3dc8441968dafc98b902ab349'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:27.078778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a3ae487c-3486-49b8-a7a6-c5fad508110d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3e0c0d3dc8441968dafc98b902ab349'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:27.081765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a3ae487c-3486-49b8-a7a6-c5fad508110d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3e0c0d3dc8441968dafc98b902ab349'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:27.098817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a3ae487c-3486-49b8-a7a6-c5fad508110d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3e0c0d3dc8441968dafc98b902ab349'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:27.115692 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1709/3454] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:53:26 2021] DELETE /identity/v3/users/c3e0c0d3dc8441968dafc98b902ab349 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:28.090028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24fe99-ff04-4799-919b-52a63fbb5e3e service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:28.136683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24fe99-ff04-4799-919b-52a63fbb5e3e service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:28.263100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:28.264296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:28.264745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:28.265183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f admin admin] PATH_INFO: `/v3/projects/b48e95c75c9444f2a0d2cb6704727346` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:28.266821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b48e95c75c9444f2a0d2cb6704727346)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:28.269130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:28.340113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae487c-3486-49b8-a7a6-c5fad508110d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:28.341691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a3ae487c-3486-49b8-a7a6-c5fad508110d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:28.370628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae487c-3486-49b8-a7a6-c5fad508110d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:28.518720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b48e95c75c9444f2a0d2cb6704727346', 'request_id': 'req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:28.538784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b48e95c75c9444f2a0d2cb6704727346', 'request_id': 'req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:28.568055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b48e95c75c9444f2a0d2cb6704727346', 'request_id': 'req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:28.594817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f admin admin] The token cache is being invalidate because project b48e95c75c9444f2a0d2cb6704727346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:53:28.599195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:28.601896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:28.623848 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1746/3455] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:53:28 2021] DELETE /identity/v3/projects/b48e95c75c9444f2a0d2cb6704727346 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:28.634664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:28.636582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648f698-468a-4685-a86b-635a6e26bc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:28.647054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:28.649377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648f698-468a-4685-a86b-635a6e26bc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:28.649995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648f698-468a-4685-a86b-635a6e26bc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:28.650481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648f698-468a-4685-a86b-635a6e26bc7c admin admin] PATH_INFO: `/v3/users/24ceebd647214518a032847eadef041f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:28.653408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648f698-468a-4685-a86b-635a6e26bc7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ceebd647214518a032847eadef041f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:28.656105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648f698-468a-4685-a86b-635a6e26bc7c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:28.715570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39eb360-a8da-4b9b-82e4-cf4a33a9c07f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:28.731322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b0c4b-11f8-4a1b-85f7-f67f6fd864d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:28.738008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0c4b-11f8-4a1b-85f7-f67f6fd864d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:28.738732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0c4b-11f8-4a1b-85f7-f67f6fd864d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:28.739219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0c4b-11f8-4a1b-85f7-f67f6fd864d6 admin admin] PATH_INFO: `/v3/users/cea2e12107304c1aadf2872c125d84d7` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:28.744243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b0c4b-11f8-4a1b-85f7-f67f6fd864d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea2e12107304c1aadf2872c125d84d7)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:28.749332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b0c4b-11f8-4a1b-85f7-f67f6fd864d6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:28.823062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a648f698-468a-4685-a86b-635a6e26bc7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ceebd647214518a032847eadef041f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:28.842615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a648f698-468a-4685-a86b-635a6e26bc7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ceebd647214518a032847eadef041f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:28.871487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a648f698-468a-4685-a86b-635a6e26bc7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ceebd647214518a032847eadef041f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:28.874392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a648f698-468a-4685-a86b-635a6e26bc7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ceebd647214518a032847eadef041f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:28.897098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a648f698-468a-4685-a86b-635a6e26bc7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ceebd647214518a032847eadef041f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:28.906199 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1710/3456] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:53:28 2021] DELETE /identity/v3/users/24ceebd647214518a032847eadef041f => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:28.908910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a38b0c4b-11f8-4a1b-85f7-f67f6fd864d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea2e12107304c1aadf2872c125d84d7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:28.925947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a38b0c4b-11f8-4a1b-85f7-f67f6fd864d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea2e12107304c1aadf2872c125d84d7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:28.930199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a38b0c4b-11f8-4a1b-85f7-f67f6fd864d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea2e12107304c1aadf2872c125d84d7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:28.955052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a38b0c4b-11f8-4a1b-85f7-f67f6fd864d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea2e12107304c1aadf2872c125d84d7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:28.971279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a38b0c4b-11f8-4a1b-85f7-f67f6fd864d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea2e12107304c1aadf2872c125d84d7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:28.983968 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1747/3457] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:53:28 2021] DELETE /identity/v3/users/cea2e12107304c1aadf2872c125d84d7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:29.291433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648f698-468a-4685-a86b-635a6e26bc7c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:29.293615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a648f698-468a-4685-a86b-635a6e26bc7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:29.414810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648f698-468a-4685-a86b-635a6e26bc7c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:29.487785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e3faa-1e9a-4b81-aca4-593dd5c655e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:29.489623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e3faa-1e9a-4b81-aca4-593dd5c655e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:29.490343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e3faa-1e9a-4b81-aca4-593dd5c655e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:29.490855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e3faa-1e9a-4b81-aca4-593dd5c655e4 admin admin] PATH_INFO: `/v3/projects/45a1dd6e308a471d8df32a7caacfdb44` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:29.492453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e3faa-1e9a-4b81-aca4-593dd5c655e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a1dd6e308a471d8df32a7caacfdb44)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:29.495344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e3faa-1e9a-4b81-aca4-593dd5c655e4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:29.581676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9b4e3faa-1e9a-4b81-aca4-593dd5c655e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a1dd6e308a471d8df32a7caacfdb44', 'request_id': 'req-9b4e3faa-1e9a-4b81-aca4-593dd5c655e4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:29.615279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9b4e3faa-1e9a-4b81-aca4-593dd5c655e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a1dd6e308a471d8df32a7caacfdb44', 'request_id': 'req-9b4e3faa-1e9a-4b81-aca4-593dd5c655e4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:29.634452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9b4e3faa-1e9a-4b81-aca4-593dd5c655e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a1dd6e308a471d8df32a7caacfdb44', 'request_id': 'req-9b4e3faa-1e9a-4b81-aca4-593dd5c655e4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:29.658012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9b4e3faa-1e9a-4b81-aca4-593dd5c655e4 admin admin] The token cache is being invalidate because project 45a1dd6e308a471d8df32a7caacfdb44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:53:29.658402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9b4e3faa-1e9a-4b81-aca4-593dd5c655e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:29.662710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9b4e3faa-1e9a-4b81-aca4-593dd5c655e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:29.664324 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1711/3458] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:53:29 2021] DELETE /identity/v3/projects/45a1dd6e308a471d8df32a7caacfdb44 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:29.670698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c498a-f899-4b95-a8c2-97f52a3fb788 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:29.671231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c498a-f899-4b95-a8c2-97f52a3fb788 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:29.671231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c498a-f899-4b95-a8c2-97f52a3fb788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:29.723352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-755c498a-f899-4b95-a8c2-97f52a3fb788 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:29.728831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-755c498a-f899-4b95-a8c2-97f52a3fb788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:29.989942 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1748/3459] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:29.991502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7d369-c9eb-4bfa-a219-1d84df81baeb None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:29.991940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7d369-c9eb-4bfa-a219-1d84df81baeb None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:29.992076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7d369-c9eb-4bfa-a219-1d84df81baeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:30.050715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-45d7d369-c9eb-4bfa-a219-1d84df81baeb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:30.056691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-45d7d369-c9eb-4bfa-a219-1d84df81baeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:30.090586 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1712/3460] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:53:30.094830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c498a-f899-4b95-a8c2-97f52a3fb788 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:30.116271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c498a-f899-4b95-a8c2-97f52a3fb788 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:30.124067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7d369-c9eb-4bfa-a219-1d84df81baeb None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:30.126747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-45d7d369-c9eb-4bfa-a219-1d84df81baeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:30.134890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92e6de-547c-4243-b35f-306a08e8b0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:30.135716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92e6de-547c-4243-b35f-306a08e8b0dd admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:30.136012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92e6de-547c-4243-b35f-306a08e8b0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:30.141066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92e6de-547c-4243-b35f-306a08e8b0dd admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:30.141878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92e6de-547c-4243-b35f-306a08e8b0dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:53:30.142201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92e6de-547c-4243-b35f-306a08e8b0dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:30.143904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92e6de-547c-4243-b35f-306a08e8b0dd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:30.151396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7d369-c9eb-4bfa-a219-1d84df81baeb None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:30.166191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a0610-c41b-4840-bc2c-9c5893d52aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:30.167188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a0610-c41b-4840-bc2c-9c5893d52aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:30.167550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a0610-c41b-4840-bc2c-9c5893d52aee admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:30.167935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a0610-c41b-4840-bc2c-9c5893d52aee admin admin] PATH_INFO: `/v3/projects/47e94e03944844ccb90b9a5818d00856` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:30.174810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a0610-c41b-4840-bc2c-9c5893d52aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=47e94e03944844ccb90b9a5818d00856)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:30.176773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a0610-c41b-4840-bc2c-9c5893d52aee admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:30.252722 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1749/3461] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:53:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:53:30.256137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92e6de-547c-4243-b35f-306a08e8b0dd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:30.284155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d59a0610-c41b-4840-bc2c-9c5893d52aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47e94e03944844ccb90b9a5818d00856', 'request_id': 'req-d59a0610-c41b-4840-bc2c-9c5893d52aee'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:30.295397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d59a0610-c41b-4840-bc2c-9c5893d52aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47e94e03944844ccb90b9a5818d00856', 'request_id': 'req-d59a0610-c41b-4840-bc2c-9c5893d52aee'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:30.306430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92e6de-547c-4243-b35f-306a08e8b0dd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:30.311111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d59a0610-c41b-4840-bc2c-9c5893d52aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47e94e03944844ccb90b9a5818d00856', 'request_id': 'req-d59a0610-c41b-4840-bc2c-9c5893d52aee'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:30.338892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d59a0610-c41b-4840-bc2c-9c5893d52aee admin admin] The token cache is being invalidate because project 47e94e03944844ccb90b9a5818d00856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:53:30.339379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d59a0610-c41b-4840-bc2c-9c5893d52aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:30.340178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d59a0610-c41b-4840-bc2c-9c5893d52aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:30.341940 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1713/3462] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:53:30 2021] DELETE /identity/v3/projects/47e94e03944844ccb90b9a5818d00856 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:30.348099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62c241-7e5f-4bd1-9556-8a8992580255 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:30.348508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62c241-7e5f-4bd1-9556-8a8992580255 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:30.348883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62c241-7e5f-4bd1-9556-8a8992580255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:30.406830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6e62c241-7e5f-4bd1-9556-8a8992580255 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:30.408454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6e62c241-7e5f-4bd1-9556-8a8992580255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:30.515220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239935d-a22d-45c5-b892-9c5b60f3b4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:30.516175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239935d-a22d-45c5-b892-9c5b60f3b4ca admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:30.516758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239935d-a22d-45c5-b892-9c5b60f3b4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:30.517064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239935d-a22d-45c5-b892-9c5b60f3b4ca admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:30.517753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239935d-a22d-45c5-b892-9c5b60f3b4ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:30.526989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239935d-a22d-45c5-b892-9c5b60f3b4ca admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:30.550233 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1714/3463] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:30.562774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7118de-569b-440b-b897-87881bed7969 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:30.563394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7118de-569b-440b-b897-87881bed7969 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:30.563899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7118de-569b-440b-b897-87881bed7969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:30.615604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-bf7118de-569b-440b-b897-87881bed7969 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:30.618147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bf7118de-569b-440b-b897-87881bed7969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:30.628129 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1715/3464] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:30.629755 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1750/3465] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:53:30 2021] POST /identity/v3/projects => generated 393 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:30.636127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7118de-569b-440b-b897-87881bed7969 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:30.637871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239935d-a22d-45c5-b892-9c5b60f3b4ca admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:30.637999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bf7118de-569b-440b-b897-87881bed7969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:30.652058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7118de-569b-440b-b897-87881bed7969 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:30.750116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7e402-a025-4da8-b9a1-855ad9c65c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:30.750923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7e402-a025-4da8-b9a1-855ad9c65c9e admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:30.751212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7e402-a025-4da8-b9a1-855ad9c65c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:30.751621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7e402-a025-4da8-b9a1-855ad9c65c9e admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:30.752382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7e402-a025-4da8-b9a1-855ad9c65c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:30.756062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7e402-a025-4da8-b9a1-855ad9c65c9e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:30.821837 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1716/3466] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:53:30 2021] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:30.823019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7e402-a025-4da8-b9a1-855ad9c65c9e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:30.839118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7e402-a025-4da8-b9a1-855ad9c65c9e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:30.859346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69aa6f-c850-4e41-ae46-db4dbe86a29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:30.860328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69aa6f-c850-4e41-ae46-db4dbe86a29c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:30.861624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69aa6f-c850-4e41-ae46-db4dbe86a29c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:30.862098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69aa6f-c850-4e41-ae46-db4dbe86a29c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:30.863290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69aa6f-c850-4e41-ae46-db4dbe86a29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:30.865125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69aa6f-c850-4e41-ae46-db4dbe86a29c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:30.872238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239935d-a22d-45c5-b892-9c5b60f3b4ca admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:30.877955 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1717/3467] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:30 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:30.882004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69aa6f-c850-4e41-ae46-db4dbe86a29c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:30.893116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69aa6f-c850-4e41-ae46-db4dbe86a29c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:30.897490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b53757-eb38-4cfa-9d4f-8e91c7ec7bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:30.899752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b53757-eb38-4cfa-9d4f-8e91c7ec7bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:30.905198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b53757-eb38-4cfa-9d4f-8e91c7ec7bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:30.906806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b53757-eb38-4cfa-9d4f-8e91c7ec7bf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:30.908476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b53757-eb38-4cfa-9d4f-8e91c7ec7bf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:53:30.911183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b53757-eb38-4cfa-9d4f-8e91c7ec7bf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:30.917608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b53757-eb38-4cfa-9d4f-8e91c7ec7bf9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:30.939709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b1c5d-056c-4476-b194-54f1b7a22690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:30.940437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b1c5d-056c-4476-b194-54f1b7a22690 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:30.940736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b1c5d-056c-4476-b194-54f1b7a22690 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:30.941024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b1c5d-056c-4476-b194-54f1b7a22690 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:30.947244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b1c5d-056c-4476-b194-54f1b7a22690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:30.950449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b1c5d-056c-4476-b194-54f1b7a22690 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:30.972104 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1718/3468] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:30 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:30.975806 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1751/3469] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:53:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:53:30.975942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b1c5d-056c-4476-b194-54f1b7a22690 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:30.978280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b53757-eb38-4cfa-9d4f-8e91c7ec7bf9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:30.986948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b1c5d-056c-4476-b194-54f1b7a22690 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:30.991925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c55aa-1284-4fc7-acd3-002ae53bb00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:30.999587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c55aa-1284-4fc7-acd3-002ae53bb00f admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:31.000089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c55aa-1284-4fc7-acd3-002ae53bb00f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:31.000577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c55aa-1284-4fc7-acd3-002ae53bb00f admin admin] PATH_INFO: `/v3/projects/cadccefde1f949d7a072bea19110a311/users/85c0b0a07d1a4aa88f5c6ff4534cb97d/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:31.021986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b53757-eb38-4cfa-9d4f-8e91c7ec7bf9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:31.023237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c55aa-1284-4fc7-acd3-002ae53bb00f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cadccefde1f949d7a072bea19110a311, user_id=85c0b0a07d1a4aa88f5c6ff4534cb97d, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:31.026283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c55aa-1284-4fc7-acd3-002ae53bb00f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:31.034693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816a7eb-86fa-4a03-a683-ec28d0daf73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:31.035714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a7eb-86fa-4a03-a683-ec28d0daf73f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:31.036183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a7eb-86fa-4a03-a683-ec28d0daf73f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:31.036511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a7eb-86fa-4a03-a683-ec28d0daf73f admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:31.037292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816a7eb-86fa-4a03-a683-ec28d0daf73f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:31.041806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816a7eb-86fa-4a03-a683-ec28d0daf73f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:31.057972 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1719/3470] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:53:30 2021] PUT /identity/v3/projects/cadccefde1f949d7a072bea19110a311/users/85c0b0a07d1a4aa88f5c6ff4534cb97d/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:31.059061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c55aa-1284-4fc7-acd3-002ae53bb00f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:31.061172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8c9c55aa-1284-4fc7-acd3-002ae53bb00f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:31.120273 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1752/3471] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:53:30 2021] POST /identity/v3/projects => generated 397 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:31.123002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850efa35-c67f-41ff-885a-be7da2c53d93 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:31.124650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850efa35-c67f-41ff-885a-be7da2c53d93 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:31.125121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850efa35-c67f-41ff-885a-be7da2c53d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:31.184379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-850efa35-c67f-41ff-885a-be7da2c53d93 None None] MFA Rules not processed for user `85c0b0a07d1a4aa88f5c6ff4534cb97d`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:31.185788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-850efa35-c67f-41ff-885a-be7da2c53d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:31.201940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c55aa-1284-4fc7-acd3-002ae53bb00f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:31.328133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed9694-26c4-4454-bc22-b14776be5091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:31.329008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed9694-26c4-4454-bc22-b14776be5091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:31.329227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed9694-26c4-4454-bc22-b14776be5091 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:31.329682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed9694-26c4-4454-bc22-b14776be5091 admin admin] PATH_INFO: `/v3/users/05a9edc0cd6b4eaababe6d74aa697bc5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:31.333207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed9694-26c4-4454-bc22-b14776be5091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a9edc0cd6b4eaababe6d74aa697bc5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:31.346964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed9694-26c4-4454-bc22-b14776be5091 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:31.356464 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1753/3472] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:31 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:31.357667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850efa35-c67f-41ff-885a-be7da2c53d93 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:31.385066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850efa35-c67f-41ff-885a-be7da2c53d93 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:31.413483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fece6b-6a9b-4e9d-9020-2090fe284e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:31.414179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fece6b-6a9b-4e9d-9020-2090fe284e86 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:31.420043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fece6b-6a9b-4e9d-9020-2090fe284e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:31.420357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fece6b-6a9b-4e9d-9020-2090fe284e86 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:31.421346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fece6b-6a9b-4e9d-9020-2090fe284e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:31.423628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fece6b-6a9b-4e9d-9020-2090fe284e86 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:31.427803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-01ed9694-26c4-4454-bc22-b14776be5091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a9edc0cd6b4eaababe6d74aa697bc5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:31.437025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-01ed9694-26c4-4454-bc22-b14776be5091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a9edc0cd6b4eaababe6d74aa697bc5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:31.449651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-01ed9694-26c4-4454-bc22-b14776be5091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a9edc0cd6b4eaababe6d74aa697bc5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:31.451401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-01ed9694-26c4-4454-bc22-b14776be5091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a9edc0cd6b4eaababe6d74aa697bc5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:31.463850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-01ed9694-26c4-4454-bc22-b14776be5091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a9edc0cd6b4eaababe6d74aa697bc5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:31.477110 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1720/3473] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:53:31 2021] DELETE /identity/v3/users/05a9edc0cd6b4eaababe6d74aa697bc5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:31.483570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed9694-26c4-4454-bc22-b14776be5091 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:31.486009 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1754/3474] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:53:31 2021] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:31.488304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-01ed9694-26c4-4454-bc22-b14776be5091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:31.490194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fece6b-6a9b-4e9d-9020-2090fe284e86 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:31.494033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-35fece6b-6a9b-4e9d-9020-2090fe284e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:31.506408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fece6b-6a9b-4e9d-9020-2090fe284e86 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:31.579195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed9694-26c4-4454-bc22-b14776be5091 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:31.589885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e35c09-7617-4f7a-a830-11d450d46a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:31.590861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e35c09-7617-4f7a-a830-11d450d46a8c admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:31.591574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e35c09-7617-4f7a-a830-11d450d46a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:31.592019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e35c09-7617-4f7a-a830-11d450d46a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:31.592925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e35c09-7617-4f7a-a830-11d450d46a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:31.595256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e35c09-7617-4f7a-a830-11d450d46a8c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:31.623115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3140318-9408-4425-a079-86b5fa9cd8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:31.625314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3140318-9408-4425-a079-86b5fa9cd8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:31.625559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3140318-9408-4425-a079-86b5fa9cd8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:31.625962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3140318-9408-4425-a079-86b5fa9cd8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:31.627372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3140318-9408-4425-a079-86b5fa9cd8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:31.629440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3140318-9408-4425-a079-86b5fa9cd8c6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:31.655301 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1755/3475] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:31 2021] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:31.657405 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1721/3476] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:53:31 2021] POST /identity/v3/projects => generated 391 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:31.662816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3140318-9408-4425-a079-86b5fa9cd8c6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:31.688035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3140318-9408-4425-a079-86b5fa9cd8c6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:31.709545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e35c09-7617-4f7a-a830-11d450d46a8c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:31.786443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bfcf3-3d2a-4584-88b0-d87ba1a2b4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:31.788783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bfcf3-3d2a-4584-88b0-d87ba1a2b4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:31.788783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bfcf3-3d2a-4584-88b0-d87ba1a2b4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:31.788783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bfcf3-3d2a-4584-88b0-d87ba1a2b4b7 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:31.788783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7bfcf3-3d2a-4584-88b0-d87ba1a2b4b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:31.791744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7bfcf3-3d2a-4584-88b0-d87ba1a2b4b7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:31.820268 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1756/3477] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:53:31 2021] POST /identity/v3/users => generated 302 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:31.826194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bfcf3-3d2a-4584-88b0-d87ba1a2b4b7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:31.847717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bfcf3-3d2a-4584-88b0-d87ba1a2b4b7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:31.855890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e35c09-7617-4f7a-a830-11d450d46a8c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:31.862892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383521d-ce38-4559-a39a-4c5c4a1f1586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:31.863785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383521d-ce38-4559-a39a-4c5c4a1f1586 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:31.864081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383521d-ce38-4559-a39a-4c5c4a1f1586 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:31.864346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383521d-ce38-4559-a39a-4c5c4a1f1586 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:31.865092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383521d-ce38-4559-a39a-4c5c4a1f1586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:31.866827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383521d-ce38-4559-a39a-4c5c4a1f1586 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:31.870403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61b691-b683-4fce-a375-557758c03f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:31.871466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61b691-b683-4fce-a375-557758c03f9b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:31.874190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61b691-b683-4fce-a375-557758c03f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:31.874809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61b691-b683-4fce-a375-557758c03f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:31.875791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61b691-b683-4fce-a375-557758c03f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:31.878625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61b691-b683-4fce-a375-557758c03f9b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:31.881819 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1722/3478] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:31 2021] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:31.886235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383521d-ce38-4559-a39a-4c5c4a1f1586 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:31.924601 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1757/3479] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:31 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:31.933472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61b691-b683-4fce-a375-557758c03f9b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:31.938315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383521d-ce38-4559-a39a-4c5c4a1f1586 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:31.961188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa7127-475e-4c14-a53c-b444b0a211b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:31.963651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa7127-475e-4c14-a53c-b444b0a211b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:31.964110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa7127-475e-4c14-a53c-b444b0a211b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:31.964300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61b691-b683-4fce-a375-557758c03f9b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:31.965209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa7127-475e-4c14-a53c-b444b0a211b7 admin admin] PATH_INFO: `/v3/projects/96d02082884044bfb5912676913a785a/users/7632a00badb141cfa71c9cdc1e467fec/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:31.979719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180284e1-ceed-4b28-bd04-5cdcd87f1bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:31.980610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180284e1-ceed-4b28-bd04-5cdcd87f1bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:31.980898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180284e1-ceed-4b28-bd04-5cdcd87f1bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:31.981181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180284e1-ceed-4b28-bd04-5cdcd87f1bcf admin admin] PATH_INFO: `/v3/projects/5edcb0e034dc4a6ba8b8bfd92b92b727/users/4951e05f637141b984590dde9da73ca1/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:31.991088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa7127-475e-4c14-a53c-b444b0a211b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d02082884044bfb5912676913a785a, user_id=7632a00badb141cfa71c9cdc1e467fec, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:31.994267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa7127-475e-4c14-a53c-b444b0a211b7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:32.015189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180284e1-ceed-4b28-bd04-5cdcd87f1bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5edcb0e034dc4a6ba8b8bfd92b92b727, user_id=4951e05f637141b984590dde9da73ca1, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:32.017861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180284e1-ceed-4b28-bd04-5cdcd87f1bcf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:32.038038 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1723/3480] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:53:31 2021] PUT /identity/v3/projects/96d02082884044bfb5912676913a785a/users/7632a00badb141cfa71c9cdc1e467fec/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:32.040788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa7127-475e-4c14-a53c-b444b0a211b7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:32.046916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-55fa7127-475e-4c14-a53c-b444b0a211b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:32.058167 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1758/3481] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:53:31 2021] PUT /identity/v3/projects/5edcb0e034dc4a6ba8b8bfd92b92b727/users/4951e05f637141b984590dde9da73ca1/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:32.058167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef37a8-ff5a-4024-8709-5424db932d1c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:32.058167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef37a8-ff5a-4024-8709-5424db932d1c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:32.058167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef37a8-ff5a-4024-8709-5424db932d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:32.116659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-68ef37a8-ff5a-4024-8709-5424db932d1c None None] MFA Rules not processed for user `7632a00badb141cfa71c9cdc1e467fec`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:32.117912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-68ef37a8-ff5a-4024-8709-5424db932d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:32.197613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa7127-475e-4c14-a53c-b444b0a211b7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:32.265231 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1759/3482] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:32 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:32.265231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef37a8-ff5a-4024-8709-5424db932d1c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:32.289287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e4b0e-137e-421f-85d1-2fc8c803655d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:32.294451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e4b0e-137e-421f-85d1-2fc8c803655d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:32.294737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e4b0e-137e-421f-85d1-2fc8c803655d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:32.296507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e4b0e-137e-421f-85d1-2fc8c803655d admin admin] PATH_INFO: `/v3/projects/1a0744714bbf4779a774d5d0d8fc18d7` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:32.300535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e4b0e-137e-421f-85d1-2fc8c803655d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a0744714bbf4779a774d5d0d8fc18d7)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:32.308144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e4b0e-137e-421f-85d1-2fc8c803655d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:32.427768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f93e4b0e-137e-421f-85d1-2fc8c803655d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a0744714bbf4779a774d5d0d8fc18d7', 'request_id': 'req-f93e4b0e-137e-421f-85d1-2fc8c803655d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:32.448836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef37a8-ff5a-4024-8709-5424db932d1c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:32.459052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f93e4b0e-137e-421f-85d1-2fc8c803655d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a0744714bbf4779a774d5d0d8fc18d7', 'request_id': 'req-f93e4b0e-137e-421f-85d1-2fc8c803655d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:32.484380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f93e4b0e-137e-421f-85d1-2fc8c803655d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a0744714bbf4779a774d5d0d8fc18d7', 'request_id': 'req-f93e4b0e-137e-421f-85d1-2fc8c803655d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:32.522698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f93e4b0e-137e-421f-85d1-2fc8c803655d admin admin] The token cache is being invalidate because project 1a0744714bbf4779a774d5d0d8fc18d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:53:32.528435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f93e4b0e-137e-421f-85d1-2fc8c803655d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:32.530153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f93e4b0e-137e-421f-85d1-2fc8c803655d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:32.532022 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1724/3483] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:53:32 2021] DELETE /identity/v3/projects/1a0744714bbf4779a774d5d0d8fc18d7 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:32.548788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4933f-0e78-4652-a274-368f10bda8ea None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:32.549875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4933f-0e78-4652-a274-368f10bda8ea None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:32.550438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4933f-0e78-4652-a274-368f10bda8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:32.619891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e7f4933f-0e78-4652-a274-368f10bda8ea None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:32.621093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11154463-1496-4657-8393-daa5c12e9703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:32.622021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11154463-1496-4657-8393-daa5c12e9703 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:32.622764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11154463-1496-4657-8393-daa5c12e9703 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:32.623231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11154463-1496-4657-8393-daa5c12e9703 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:32.624270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e7f4933f-0e78-4652-a274-368f10bda8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:32.624931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11154463-1496-4657-8393-daa5c12e9703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:32.629559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11154463-1496-4657-8393-daa5c12e9703 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:32.655813 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1760/3484] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:32 2021] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:32.657023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11154463-1496-4657-8393-daa5c12e9703 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:32.657813 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1725/3485] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:32.661750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4933f-0e78-4652-a274-368f10bda8ea None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:32.665826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-11154463-1496-4657-8393-daa5c12e9703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:32.666879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e7f4933f-0e78-4652-a274-368f10bda8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:32.703726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4933f-0e78-4652-a274-368f10bda8ea None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:32.719918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bb92c-de31-4d3e-a056-01288a64b9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:32.723094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bb92c-de31-4d3e-a056-01288a64b9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:32.723414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bb92c-de31-4d3e-a056-01288a64b9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:32.725316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bb92c-de31-4d3e-a056-01288a64b9ed admin admin] PATH_INFO: `/v3/projects/5edcb0e034dc4a6ba8b8bfd92b92b727/users/4951e05f637141b984590dde9da73ca1/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:32.734341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bb92c-de31-4d3e-a056-01288a64b9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5edcb0e034dc4a6ba8b8bfd92b92b727, user_id=4951e05f637141b984590dde9da73ca1, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:32.752797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bb92c-de31-4d3e-a056-01288a64b9ed admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:32.787761 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1726/3486] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:53:32 2021] PUT /identity/v3/projects/5edcb0e034dc4a6ba8b8bfd92b92b727/users/4951e05f637141b984590dde9da73ca1/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:32.798993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe538c61-da01-4401-9aa5-0df508195bd2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:32.799486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe538c61-da01-4401-9aa5-0df508195bd2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:32.799803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe538c61-da01-4401-9aa5-0df508195bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:32.828190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fe538c61-da01-4401-9aa5-0df508195bd2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:32.829629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fe538c61-da01-4401-9aa5-0df508195bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:32.874375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11154463-1496-4657-8393-daa5c12e9703 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:32.987444 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1727/3487] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:32.992188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa05a63-5303-40ed-a5e9-1e6e5de9de39 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:32.997299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa05a63-5303-40ed-a5e9-1e6e5de9de39 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:32.997680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa05a63-5303-40ed-a5e9-1e6e5de9de39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:33.025602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fedaa3-2589-491b-bcd2-8b1aea18954d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:33.026812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fedaa3-2589-491b-bcd2-8b1aea18954d service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:33.027288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fedaa3-2589-491b-bcd2-8b1aea18954d service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:33.027723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fedaa3-2589-491b-bcd2-8b1aea18954d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:33.034342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-73fedaa3-2589-491b-bcd2-8b1aea18954d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:33.071761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7aa05a63-5303-40ed-a5e9-1e6e5de9de39 None None] MFA Rules not processed for user `4951e05f637141b984590dde9da73ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:33.078962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7aa05a63-5303-40ed-a5e9-1e6e5de9de39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:33.172756 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1728/3488] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:32 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:33.173588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa05a63-5303-40ed-a5e9-1e6e5de9de39 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:33.186089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa05a63-5303-40ed-a5e9-1e6e5de9de39 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:33.191550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fedaa3-2589-491b-bcd2-8b1aea18954d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:33.193832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52664d5-f4eb-4a53-af74-b0866fcdf5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:33.193832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52664d5-f4eb-4a53-af74-b0866fcdf5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:33.193832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52664d5-f4eb-4a53-af74-b0866fcdf5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:33.193832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52664d5-f4eb-4a53-af74-b0866fcdf5b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:33.194350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52664d5-f4eb-4a53-af74-b0866fcdf5b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:53:33.194674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52664d5-f4eb-4a53-af74-b0866fcdf5b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:33.196393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52664d5-f4eb-4a53-af74-b0866fcdf5b4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:33.204483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fedaa3-2589-491b-bcd2-8b1aea18954d service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:33.212195 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1729/3489] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:53:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:53:33.216117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52664d5-f4eb-4a53-af74-b0866fcdf5b4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:33.229231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52664d5-f4eb-4a53-af74-b0866fcdf5b4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:33.234423 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1761/3490] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:32 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:33.247774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9c1cd-0d4f-44f8-b262-eb72f1ba81f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:33.248595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9c1cd-0d4f-44f8-b262-eb72f1ba81f7 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:33.249959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9c1cd-0d4f-44f8-b262-eb72f1ba81f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:33.251507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9c1cd-0d4f-44f8-b262-eb72f1ba81f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:33.252251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9c1cd-0d4f-44f8-b262-eb72f1ba81f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:33.255312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9c1cd-0d4f-44f8-b262-eb72f1ba81f7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:33.286795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fedaa3-2589-491b-bcd2-8b1aea18954d service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:33.310335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fedaa3-2589-491b-bcd2-8b1aea18954d service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:33.320268 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1730/3491] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:53:33 2021] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:33.325702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9c1cd-0d4f-44f8-b262-eb72f1ba81f7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:33.329402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bc714-2ae0-43bd-ab40-f83f8d92b44c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:33.331025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bc714-2ae0-43bd-ab40-f83f8d92b44c service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:33.331624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bc714-2ae0-43bd-ab40-f83f8d92b44c service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:33.332210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bc714-2ae0-43bd-ab40-f83f8d92b44c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:33.346630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bc714-2ae0-43bd-ab40-f83f8d92b44c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:33.349940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bc714-2ae0-43bd-ab40-f83f8d92b44c service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:33.373196 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1762/3492] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:33 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:33.545398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9c1cd-0d4f-44f8-b262-eb72f1ba81f7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:33.557550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf22026-9322-4188-b234-f2d147db28a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:33.558556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf22026-9322-4188-b234-f2d147db28a7 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:33.558847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf22026-9322-4188-b234-f2d147db28a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:33.559294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf22026-9322-4188-b234-f2d147db28a7 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:33.559856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf22026-9322-4188-b234-f2d147db28a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:33.580553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf22026-9322-4188-b234-f2d147db28a7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:33.580800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bc714-2ae0-43bd-ab40-f83f8d92b44c service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:33.582649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b08bc714-2ae0-43bd-ab40-f83f8d92b44c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:33.615440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bc714-2ae0-43bd-ab40-f83f8d92b44c service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:33.631967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3641e7-e4d0-4058-8ede-5aac80c27162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:33.636016 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1731/3493] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:53:33 2021] POST /identity/v3/users => generated 288 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:33.637199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf22026-9322-4188-b234-f2d147db28a7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:33.641811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3641e7-e4d0-4058-8ede-5aac80c27162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:33.642711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3641e7-e4d0-4058-8ede-5aac80c27162 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:33.643102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3641e7-e4d0-4058-8ede-5aac80c27162 admin admin] PATH_INFO: `/v3/users/7632a00badb141cfa71c9cdc1e467fec` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:33.647489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3641e7-e4d0-4058-8ede-5aac80c27162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7632a00badb141cfa71c9cdc1e467fec)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:33.650700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3641e7-e4d0-4058-8ede-5aac80c27162 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:33.669656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf22026-9322-4188-b234-f2d147db28a7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:33.689510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571b058-cacd-41b2-aa0f-75ecdaac9d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:33.690091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571b058-cacd-41b2-aa0f-75ecdaac9d04 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:33.690416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571b058-cacd-41b2-aa0f-75ecdaac9d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:33.690702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571b058-cacd-41b2-aa0f-75ecdaac9d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:33.691454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571b058-cacd-41b2-aa0f-75ecdaac9d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:33.693669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571b058-cacd-41b2-aa0f-75ecdaac9d04 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:33.745960 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1732/3494] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:33 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:33.746972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571b058-cacd-41b2-aa0f-75ecdaac9d04 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:33.762762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-da3641e7-e4d0-4058-8ede-5aac80c27162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7632a00badb141cfa71c9cdc1e467fec'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:33.776550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571b058-cacd-41b2-aa0f-75ecdaac9d04 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:33.780570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-da3641e7-e4d0-4058-8ede-5aac80c27162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7632a00badb141cfa71c9cdc1e467fec'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:33.782730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-da3641e7-e4d0-4058-8ede-5aac80c27162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7632a00badb141cfa71c9cdc1e467fec'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:33.793055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f865a-a5e3-4a45-91e0-5c57b2be7aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:33.793769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f865a-a5e3-4a45-91e0-5c57b2be7aed admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:33.794063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f865a-a5e3-4a45-91e0-5c57b2be7aed admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:33.794373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f865a-a5e3-4a45-91e0-5c57b2be7aed admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:33.795133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f865a-a5e3-4a45-91e0-5c57b2be7aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:33.796747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f865a-a5e3-4a45-91e0-5c57b2be7aed admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:33.821674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-da3641e7-e4d0-4058-8ede-5aac80c27162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7632a00badb141cfa71c9cdc1e467fec'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:33.837887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-da3641e7-e4d0-4058-8ede-5aac80c27162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7632a00badb141cfa71c9cdc1e467fec'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:33.844070 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1733/3495] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:33 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:33.848537 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1763/3496] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:53:33 2021] DELETE /identity/v3/users/7632a00badb141cfa71c9cdc1e467fec => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:53:33.848812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f865a-a5e3-4a45-91e0-5c57b2be7aed admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:33.852896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a9996-b839-43f5-b5e5-74d06689d6e3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:33.853182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a9996-b839-43f5-b5e5-74d06689d6e3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:33.853509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a9996-b839-43f5-b5e5-74d06689d6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:33.856840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-548f865a-a5e3-4a45-91e0-5c57b2be7aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:33.884365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f865a-a5e3-4a45-91e0-5c57b2be7aed admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:33.897724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-170a9996-b839-43f5-b5e5-74d06689d6e3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:33.901024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-170a9996-b839-43f5-b5e5-74d06689d6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:33.976338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a97a4-24e4-4a5e-87a0-f466e0dd1af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:33.978473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a97a4-24e4-4a5e-87a0-f466e0dd1af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:33.979110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a97a4-24e4-4a5e-87a0-f466e0dd1af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:33.979693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a97a4-24e4-4a5e-87a0-f466e0dd1af9 admin admin] PATH_INFO: `/v3/projects/eaf2a3560d8e4c1993aa5a1dfdac5b4e/users/ad564476e1cf4a0b87fef4e3d08e6726/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:33.999486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a97a4-24e4-4a5e-87a0-f466e0dd1af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaf2a3560d8e4c1993aa5a1dfdac5b4e, user_id=ad564476e1cf4a0b87fef4e3d08e6726, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:34.003807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a97a4-24e4-4a5e-87a0-f466e0dd1af9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:34.030991 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1734/3497] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:53:33 2021] PUT /identity/v3/projects/eaf2a3560d8e4c1993aa5a1dfdac5b4e/users/ad564476e1cf4a0b87fef4e3d08e6726/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:34.030991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a97a4-24e4-4a5e-87a0-f466e0dd1af9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:34.030991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-184a97a4-24e4-4a5e-87a0-f466e0dd1af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:34.040944 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1764/3498] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:34.042385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d90a6-022c-402d-8c33-e53268ca3039 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:34.042677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d90a6-022c-402d-8c33-e53268ca3039 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:34.042957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d90a6-022c-402d-8c33-e53268ca3039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:34.085090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-596d90a6-022c-402d-8c33-e53268ca3039 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:34.086337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-596d90a6-022c-402d-8c33-e53268ca3039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:34.164090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a97a4-24e4-4a5e-87a0-f466e0dd1af9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:34.171274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8efe39-0c43-4077-8301-ee5bfabff233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:34.172490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8efe39-0c43-4077-8301-ee5bfabff233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:34.172782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8efe39-0c43-4077-8301-ee5bfabff233 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:34.173066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8efe39-0c43-4077-8301-ee5bfabff233 admin admin] PATH_INFO: `/v3/users/85c0b0a07d1a4aa88f5c6ff4534cb97d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:34.174877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8efe39-0c43-4077-8301-ee5bfabff233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c0b0a07d1a4aa88f5c6ff4534cb97d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:34.177538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8efe39-0c43-4077-8301-ee5bfabff233 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:34.210099 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1765/3499] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:34.210099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d90a6-022c-402d-8c33-e53268ca3039 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:34.214376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-596d90a6-022c-402d-8c33-e53268ca3039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:34.273521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7a8efe39-0c43-4077-8301-ee5bfabff233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c0b0a07d1a4aa88f5c6ff4534cb97d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:34.289362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7a8efe39-0c43-4077-8301-ee5bfabff233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c0b0a07d1a4aa88f5c6ff4534cb97d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:34.317988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7a8efe39-0c43-4077-8301-ee5bfabff233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c0b0a07d1a4aa88f5c6ff4534cb97d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:34.319432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7a8efe39-0c43-4077-8301-ee5bfabff233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c0b0a07d1a4aa88f5c6ff4534cb97d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:34.337532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7a8efe39-0c43-4077-8301-ee5bfabff233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c0b0a07d1a4aa88f5c6ff4534cb97d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:34.344776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d90a6-022c-402d-8c33-e53268ca3039 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:34.348030 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1735/3500] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:53:34 2021] DELETE /identity/v3/users/85c0b0a07d1a4aa88f5c6ff4534cb97d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:34.351281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8efe39-0c43-4077-8301-ee5bfabff233 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:34.353780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7a8efe39-0c43-4077-8301-ee5bfabff233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:34.478679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f95e95-3288-4ff5-bf36-c18688105135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:34.479344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f95e95-3288-4ff5-bf36-c18688105135 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:34.480878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f95e95-3288-4ff5-bf36-c18688105135 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:34.481165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f95e95-3288-4ff5-bf36-c18688105135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:34.494385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-84f95e95-3288-4ff5-bf36-c18688105135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:34.508319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8efe39-0c43-4077-8301-ee5bfabff233 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:34.524602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39a66e-9a98-410e-9b43-a587a1923e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:34.525229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39a66e-9a98-410e-9b43-a587a1923e6f service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:34.525513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39a66e-9a98-410e-9b43-a587a1923e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:34.525798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39a66e-9a98-410e-9b43-a587a1923e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:34.533497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fa39a66e-9a98-410e-9b43-a587a1923e6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:34.667909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f95e95-3288-4ff5-bf36-c18688105135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:34.669377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f95e95-3288-4ff5-bf36-c18688105135 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:34.691788 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1766/3501] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:34.693339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86772a8b-a52b-4b6e-bf01-508d98fcf911 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:34.693627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86772a8b-a52b-4b6e-bf01-508d98fcf911 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:34.694854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39a66e-9a98-410e-9b43-a587a1923e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:34.697422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39a66e-9a98-410e-9b43-a587a1923e6f service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:34.701719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86772a8b-a52b-4b6e-bf01-508d98fcf911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:34.775795 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1736/3502] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:34.776416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-86772a8b-a52b-4b6e-bf01-508d98fcf911 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:34.777723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-86772a8b-a52b-4b6e-bf01-508d98fcf911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:34.878699 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1767/3503] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:34.924021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39a66e-9a98-410e-9b43-a587a1923e6f service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:34.933442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fa39a66e-9a98-410e-9b43-a587a1923e6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:34.950201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39a66e-9a98-410e-9b43-a587a1923e6f service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:34.955060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94ab9e-c3c1-43ca-9b2b-94b3eeea25e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:34.955759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94ab9e-c3c1-43ca-9b2b-94b3eeea25e5 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:34.956055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94ab9e-c3c1-43ca-9b2b-94b3eeea25e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:34.956339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94ab9e-c3c1-43ca-9b2b-94b3eeea25e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:34.982095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94ab9e-c3c1-43ca-9b2b-94b3eeea25e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:34.984532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94ab9e-c3c1-43ca-9b2b-94b3eeea25e5 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:35.007973 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1737/3504] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:35.334404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cd10a-29bd-4571-8b2c-f910ad4c12ec None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:35.335011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cd10a-29bd-4571-8b2c-f910ad4c12ec None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:35.335011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cd10a-29bd-4571-8b2c-f910ad4c12ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:35.405156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3b4cd10a-29bd-4571-8b2c-f910ad4c12ec None None] MFA Rules not processed for user `09d32c08216a4035907c888a3c8cd70f`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:35.411920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3b4cd10a-29bd-4571-8b2c-f910ad4c12ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:35.598891 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1768/3505] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:35 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:36.332289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94ab9e-c3c1-43ca-9b2b-94b3eeea25e5 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:36.333708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ef94ab9e-c3c1-43ca-9b2b-94b3eeea25e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:36.355928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94ab9e-c3c1-43ca-9b2b-94b3eeea25e5 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:36.374224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34380f7b-6925-4b18-82fb-b78ecb36502a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:36.375138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34380f7b-6925-4b18-82fb-b78ecb36502a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:36.375430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34380f7b-6925-4b18-82fb-b78ecb36502a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:36.375711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34380f7b-6925-4b18-82fb-b78ecb36502a admin admin] PATH_INFO: `/v3/projects/96d02082884044bfb5912676913a785a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:36.382299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34380f7b-6925-4b18-82fb-b78ecb36502a admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d02082884044bfb5912676913a785a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:36.382999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34380f7b-6925-4b18-82fb-b78ecb36502a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:36.487005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-34380f7b-6925-4b18-82fb-b78ecb36502a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d02082884044bfb5912676913a785a', 'request_id': 'req-34380f7b-6925-4b18-82fb-b78ecb36502a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:36.497639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-34380f7b-6925-4b18-82fb-b78ecb36502a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d02082884044bfb5912676913a785a', 'request_id': 'req-34380f7b-6925-4b18-82fb-b78ecb36502a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:36.505830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-34380f7b-6925-4b18-82fb-b78ecb36502a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d02082884044bfb5912676913a785a', 'request_id': 'req-34380f7b-6925-4b18-82fb-b78ecb36502a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:36.534965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-34380f7b-6925-4b18-82fb-b78ecb36502a admin admin] The token cache is being invalidate because project 96d02082884044bfb5912676913a785a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:53:36.536280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-34380f7b-6925-4b18-82fb-b78ecb36502a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:36.538147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-34380f7b-6925-4b18-82fb-b78ecb36502a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:36.547894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cd10a-29bd-4571-8b2c-f910ad4c12ec None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:36.548514 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1738/3506] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:53:36 2021] DELETE /identity/v3/projects/96d02082884044bfb5912676913a785a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:36.549707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3b4cd10a-29bd-4571-8b2c-f910ad4c12ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:36.559597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f377d-d46d-40e4-9e6b-9a204e25a76a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:36.561536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f377d-d46d-40e4-9e6b-9a204e25a76a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:36.562620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f377d-d46d-40e4-9e6b-9a204e25a76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:36.576739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cd10a-29bd-4571-8b2c-f910ad4c12ec None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:36.612757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d72f377d-d46d-40e4-9e6b-9a204e25a76a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:36.614608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d72f377d-d46d-40e4-9e6b-9a204e25a76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:36.684633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:36.686779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:36.687143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:36.687495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0 admin admin] PATH_INFO: `/v3/projects/cadccefde1f949d7a072bea19110a311` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:36.688925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cadccefde1f949d7a072bea19110a311)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:36.691373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:36.743298 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1739/3507] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:36.753199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6000b9-10f2-495f-832a-077d8c0f7a1f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:36.754134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6000b9-10f2-495f-832a-077d8c0f7a1f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:36.754752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6000b9-10f2-495f-832a-077d8c0f7a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:36.785437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1a6000b9-10f2-495f-832a-077d8c0f7a1f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:36.787722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1a6000b9-10f2-495f-832a-077d8c0f7a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:36.807539 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1740/3508] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:36.809794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6000b9-10f2-495f-832a-077d8c0f7a1f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:36.850041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cadccefde1f949d7a072bea19110a311', 'request_id': 'req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:36.860457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6000b9-10f2-495f-832a-077d8c0f7a1f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:36.864075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cadccefde1f949d7a072bea19110a311', 'request_id': 'req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:36.877698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cadccefde1f949d7a072bea19110a311', 'request_id': 'req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:36.893869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0 admin admin] The token cache is being invalidate because project cadccefde1f949d7a072bea19110a311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:53:36.894246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:36.895213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:36.898231 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1769/3509] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:53:36 2021] DELETE /identity/v3/projects/cadccefde1f949d7a072bea19110a311 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:36.903418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:36.905271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:37.010758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafbff4-c064-43fd-857f-70778a12e78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:37.011435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafbff4-c064-43fd-857f-70778a12e78e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:37.011718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafbff4-c064-43fd-857f-70778a12e78e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:37.011995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafbff4-c064-43fd-857f-70778a12e78e admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:37.012753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafbff4-c064-43fd-857f-70778a12e78e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:53:37.013038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafbff4-c064-43fd-857f-70778a12e78e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:37.018442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafbff4-c064-43fd-857f-70778a12e78e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:37.050238 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1741/3510] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:53:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:53:37.054087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafbff4-c064-43fd-857f-70778a12e78e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:37.057757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7cafbff4-c064-43fd-857f-70778a12e78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:37.084290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafbff4-c064-43fd-857f-70778a12e78e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:37.095816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66438f-c8f1-419a-ad27-eedaed56ba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:37.096647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66438f-c8f1-419a-ad27-eedaed56ba27 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:37.096935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66438f-c8f1-419a-ad27-eedaed56ba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:37.097218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66438f-c8f1-419a-ad27-eedaed56ba27 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:37.097935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66438f-c8f1-419a-ad27-eedaed56ba27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:37.102621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66438f-c8f1-419a-ad27-eedaed56ba27 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:37.145346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc76fd-4f88-49dd-bd47-5dcac1f055b0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:37.169825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebba81e-9295-484c-adde-787739cebd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:37.171005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebba81e-9295-484c-adde-787739cebd1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:37.171397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebba81e-9295-484c-adde-787739cebd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:37.171695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebba81e-9295-484c-adde-787739cebd1e admin admin] PATH_INFO: `/v3/users/4951e05f637141b984590dde9da73ca1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:37.175261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebba81e-9295-484c-adde-787739cebd1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4951e05f637141b984590dde9da73ca1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:37.181844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebba81e-9295-484c-adde-787739cebd1e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:37.187805 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1742/3511] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:53:37 2021] POST /identity/v3/projects => generated 393 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:37.190535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66438f-c8f1-419a-ad27-eedaed56ba27 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:37.295381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bebba81e-9295-484c-adde-787739cebd1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4951e05f637141b984590dde9da73ca1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:37.314823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bebba81e-9295-484c-adde-787739cebd1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4951e05f637141b984590dde9da73ca1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:37.318307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bebba81e-9295-484c-adde-787739cebd1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4951e05f637141b984590dde9da73ca1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:37.376838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bebba81e-9295-484c-adde-787739cebd1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4951e05f637141b984590dde9da73ca1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:37.377200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66438f-c8f1-419a-ad27-eedaed56ba27 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:37.394671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bebba81e-9295-484c-adde-787739cebd1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4951e05f637141b984590dde9da73ca1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:37.400146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873811e-28e0-48e3-a971-3c521d92b33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:37.402437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873811e-28e0-48e3-a971-3c521d92b33d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:37.406997 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1770/3512] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:53:36 2021] DELETE /identity/v3/users/4951e05f637141b984590dde9da73ca1 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:37.407262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873811e-28e0-48e3-a971-3c521d92b33d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:37.407262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873811e-28e0-48e3-a971-3c521d92b33d admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:37.407262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873811e-28e0-48e3-a971-3c521d92b33d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:37.413554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873811e-28e0-48e3-a971-3c521d92b33d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:37.494297 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1743/3513] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:53:37 2021] POST /identity/v3/users => generated 297 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:53:37.498363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebba81e-9295-484c-adde-787739cebd1e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:37.500156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bebba81e-9295-484c-adde-787739cebd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:37.684458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebba81e-9295-484c-adde-787739cebd1e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:37.690575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccd507-a86d-4e06-a2bd-2b7742f6ac98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:37.691590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccd507-a86d-4e06-a2bd-2b7742f6ac98 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:37.692058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccd507-a86d-4e06-a2bd-2b7742f6ac98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:37.692506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccd507-a86d-4e06-a2bd-2b7742f6ac98 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:37.699352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccd507-a86d-4e06-a2bd-2b7742f6ac98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:37.701338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccd507-a86d-4e06-a2bd-2b7742f6ac98 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:37.725307 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1771/3514] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:37 2021] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:37.729577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873811e-28e0-48e3-a971-3c521d92b33d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:37.744222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873811e-28e0-48e3-a971-3c521d92b33d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:37.761729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b82ff-a1c7-403f-975e-37d8381df01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:37.762462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b82ff-a1c7-403f-975e-37d8381df01e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:37.762958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b82ff-a1c7-403f-975e-37d8381df01e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:37.763246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b82ff-a1c7-403f-975e-37d8381df01e admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:37.764002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b82ff-a1c7-403f-975e-37d8381df01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:37.768291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b82ff-a1c7-403f-975e-37d8381df01e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:37.790358 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1744/3515] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:37 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:37.794666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccd507-a86d-4e06-a2bd-2b7742f6ac98 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:37.810642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccd507-a86d-4e06-a2bd-2b7742f6ac98 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:37.825662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b326d-5949-42a4-8b91-b9ab75e986b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:37.826983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b326d-5949-42a4-8b91-b9ab75e986b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:37.827145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b326d-5949-42a4-8b91-b9ab75e986b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:37.827971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b326d-5949-42a4-8b91-b9ab75e986b5 admin admin] PATH_INFO: `/v3/projects/96f1afe3c99a4bcaab29cb7dfdf411b1/users/d009eb12e31749bb9976eb267dd23456/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:37.874160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b326d-5949-42a4-8b91-b9ab75e986b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f1afe3c99a4bcaab29cb7dfdf411b1, user_id=d009eb12e31749bb9976eb267dd23456, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:37.881578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b326d-5949-42a4-8b91-b9ab75e986b5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:37.912057 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1772/3516] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:53:37 2021] PUT /identity/v3/projects/96f1afe3c99a4bcaab29cb7dfdf411b1/users/d009eb12e31749bb9976eb267dd23456/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:37.923503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4a10f-f07b-45fd-b57b-6f403c250763 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:37.923815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4a10f-f07b-45fd-b57b-6f403c250763 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:37.924073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4a10f-f07b-45fd-b57b-6f403c250763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:37.982487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c5a4a10f-f07b-45fd-b57b-6f403c250763 None None] MFA Rules not processed for user `d009eb12e31749bb9976eb267dd23456`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:37.984160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c5a4a10f-f07b-45fd-b57b-6f403c250763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:38.163855 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1745/3517] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:37 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:38.200056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b326d-5949-42a4-8b91-b9ab75e986b5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:38.202018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ea3b326d-5949-42a4-8b91-b9ab75e986b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:38.399842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b326d-5949-42a4-8b91-b9ab75e986b5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:38.422167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d5a8e-6780-4baa-a26f-40db92211f40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:38.422883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d5a8e-6780-4baa-a26f-40db92211f40 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:38.423163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d5a8e-6780-4baa-a26f-40db92211f40 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:38.423560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d5a8e-6780-4baa-a26f-40db92211f40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:38.451647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d5a8e-6780-4baa-a26f-40db92211f40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:38.455351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d5a8e-6780-4baa-a26f-40db92211f40 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:38.483691 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1773/3518] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:38 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:38.879796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4a10f-f07b-45fd-b57b-6f403c250763 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:39.033594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4a10f-f07b-45fd-b57b-6f403c250763 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:39.040542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1517a9-3f61-41d9-9e6e-948d292448bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:39.042207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1517a9-3f61-41d9-9e6e-948d292448bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:39.044424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1517a9-3f61-41d9-9e6e-948d292448bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:39.044975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1517a9-3f61-41d9-9e6e-948d292448bc admin admin] PATH_INFO: `/v3/users/d009eb12e31749bb9976eb267dd23456` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:39.047712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1517a9-3f61-41d9-9e6e-948d292448bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d009eb12e31749bb9976eb267dd23456)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:39.050490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1517a9-3f61-41d9-9e6e-948d292448bc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:39.172413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6f1517a9-3f61-41d9-9e6e-948d292448bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd009eb12e31749bb9976eb267dd23456'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:39.182301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6f1517a9-3f61-41d9-9e6e-948d292448bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd009eb12e31749bb9976eb267dd23456'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:39.215734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6f1517a9-3f61-41d9-9e6e-948d292448bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd009eb12e31749bb9976eb267dd23456'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:39.216649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6f1517a9-3f61-41d9-9e6e-948d292448bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd009eb12e31749bb9976eb267dd23456'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:39.229202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6f1517a9-3f61-41d9-9e6e-948d292448bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd009eb12e31749bb9976eb267dd23456'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:39.244526 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1746/3519] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:53:38 2021] DELETE /identity/v3/users/d009eb12e31749bb9976eb267dd23456 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:39.246497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e1ec-1dfb-48fb-873e-480de2184e51 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:39.247025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e1ec-1dfb-48fb-873e-480de2184e51 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:39.247025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e1ec-1dfb-48fb-873e-480de2184e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:39.293277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-af96e1ec-1dfb-48fb-873e-480de2184e51 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:39.297007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-af96e1ec-1dfb-48fb-873e-480de2184e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:39.394021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1517a9-3f61-41d9-9e6e-948d292448bc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:39.395739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6f1517a9-3f61-41d9-9e6e-948d292448bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:39.543266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1517a9-3f61-41d9-9e6e-948d292448bc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:39.557422 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1774/3520] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:39.563905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d26154-3aa4-4ccf-b0e4-cc1e900ca510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:39.564887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d26154-3aa4-4ccf-b0e4-cc1e900ca510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:39.565269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d26154-3aa4-4ccf-b0e4-cc1e900ca510 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:39.565657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d26154-3aa4-4ccf-b0e4-cc1e900ca510 admin admin] PATH_INFO: `/v3/projects/5edcb0e034dc4a6ba8b8bfd92b92b727` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:39.567377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d26154-3aa4-4ccf-b0e4-cc1e900ca510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5edcb0e034dc4a6ba8b8bfd92b92b727)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:39.568072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96e1ec-1dfb-48fb-873e-480de2184e51 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:39.569466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d26154-3aa4-4ccf-b0e4-cc1e900ca510 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:39.569996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-af96e1ec-1dfb-48fb-873e-480de2184e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:39.667878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-85d26154-3aa4-4ccf-b0e4-cc1e900ca510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5edcb0e034dc4a6ba8b8bfd92b92b727', 'request_id': 'req-85d26154-3aa4-4ccf-b0e4-cc1e900ca510'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:39.678533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-85d26154-3aa4-4ccf-b0e4-cc1e900ca510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5edcb0e034dc4a6ba8b8bfd92b92b727', 'request_id': 'req-85d26154-3aa4-4ccf-b0e4-cc1e900ca510'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:39.686299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-85d26154-3aa4-4ccf-b0e4-cc1e900ca510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5edcb0e034dc4a6ba8b8bfd92b92b727', 'request_id': 'req-85d26154-3aa4-4ccf-b0e4-cc1e900ca510'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:39.692906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96e1ec-1dfb-48fb-873e-480de2184e51 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:39.708684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-85d26154-3aa4-4ccf-b0e4-cc1e900ca510 admin admin] The token cache is being invalidate because project 5edcb0e034dc4a6ba8b8bfd92b92b727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:53:39.708973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-85d26154-3aa4-4ccf-b0e4-cc1e900ca510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:39.720721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-85d26154-3aa4-4ccf-b0e4-cc1e900ca510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:39.730083 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1747/3521] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:53:39 2021] DELETE /identity/v3/projects/5edcb0e034dc4a6ba8b8bfd92b92b727 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:53:39.732275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f1fbe-3567-4f3f-8191-046ddb238f3b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:39.733109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f1fbe-3567-4f3f-8191-046ddb238f3b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:39.733408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f1fbe-3567-4f3f-8191-046ddb238f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:39.772263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-488f1fbe-3567-4f3f-8191-046ddb238f3b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:39.775787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-488f1fbe-3567-4f3f-8191-046ddb238f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:39.785365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908afbf-94f1-44b0-805e-b883a7fddd2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:39.786138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908afbf-94f1-44b0-805e-b883a7fddd2d service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:39.787674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908afbf-94f1-44b0-805e-b883a7fddd2d service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:39.788427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908afbf-94f1-44b0-805e-b883a7fddd2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:39.793365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2908afbf-94f1-44b0-805e-b883a7fddd2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:39.893615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908afbf-94f1-44b0-805e-b883a7fddd2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:39.897460 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1748/3522] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:39.899102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908afbf-94f1-44b0-805e-b883a7fddd2d service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:39.906852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6008b90-c71c-46db-a6fe-9052db724a35 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:39.907139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6008b90-c71c-46db-a6fe-9052db724a35 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:39.907413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6008b90-c71c-46db-a6fe-9052db724a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:39.923957 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1775/3523] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:53:39.934333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a6008b90-c71c-46db-a6fe-9052db724a35 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:39.935778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a6008b90-c71c-46db-a6fe-9052db724a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:39.949964 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1749/3524] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:53:39.951436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908afbf-94f1-44b0-805e-b883a7fddd2d service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:39.965025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908afbf-94f1-44b0-805e-b883a7fddd2d service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:39.971179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d27a45-dcc2-435c-b37a-2f347728286d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:39.971849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27a45-dcc2-435c-b37a-2f347728286d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:39.972180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27a45-dcc2-435c-b37a-2f347728286d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:39.972512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27a45-dcc2-435c-b37a-2f347728286d admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:39.973275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d27a45-dcc2-435c-b37a-2f347728286d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:53:39.973581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d27a45-dcc2-435c-b37a-2f347728286d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:39.976427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d27a45-dcc2-435c-b37a-2f347728286d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:40.000689 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1776/3525] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:53:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:53:40.002437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6008b90-c71c-46db-a6fe-9052db724a35 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:40.017162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6008b90-c71c-46db-a6fe-9052db724a35 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:40.024755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80882ac-834c-4718-a311-d037d15289f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:40.026016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80882ac-834c-4718-a311-d037d15289f7 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:40.026016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80882ac-834c-4718-a311-d037d15289f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:40.026428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80882ac-834c-4718-a311-d037d15289f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:40.027243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80882ac-834c-4718-a311-d037d15289f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:40.029330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80882ac-834c-4718-a311-d037d15289f7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:40.062374 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1750/3526] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:53:40 2021] POST /identity/v3/projects => generated 399 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:53:40.066114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d27a45-dcc2-435c-b37a-2f347728286d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:40.078660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d27a45-dcc2-435c-b37a-2f347728286d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:40.166822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b75a3-6b5e-4dd1-8eb5-d917496652d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:40.168511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b75a3-6b5e-4dd1-8eb5-d917496652d3 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:40.169448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b75a3-6b5e-4dd1-8eb5-d917496652d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:40.170821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b75a3-6b5e-4dd1-8eb5-d917496652d3 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:40.171954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b75a3-6b5e-4dd1-8eb5-d917496652d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:40.176854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b75a3-6b5e-4dd1-8eb5-d917496652d3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:40.220405 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1777/3527] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:53:40 2021] POST /identity/v3/users => generated 300 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:40.221666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80882ac-834c-4718-a311-d037d15289f7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:40.244625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80882ac-834c-4718-a311-d037d15289f7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:40.257271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c0005-be7e-40b0-92aa-51c3481f18e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:40.259354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c0005-be7e-40b0-92aa-51c3481f18e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:40.260477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c0005-be7e-40b0-92aa-51c3481f18e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:40.260885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c0005-be7e-40b0-92aa-51c3481f18e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:40.263069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c0005-be7e-40b0-92aa-51c3481f18e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:40.267468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c0005-be7e-40b0-92aa-51c3481f18e7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:40.292463 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1751/3528] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:40 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:40.296584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b75a3-6b5e-4dd1-8eb5-d917496652d3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:40.314074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b75a3-6b5e-4dd1-8eb5-d917496652d3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:40.339869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52bc21-46ba-4563-b742-1e3610962e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:40.340792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52bc21-46ba-4563-b742-1e3610962e0a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:40.341236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52bc21-46ba-4563-b742-1e3610962e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:40.341669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52bc21-46ba-4563-b742-1e3610962e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:40.342564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52bc21-46ba-4563-b742-1e3610962e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:40.344330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52bc21-46ba-4563-b742-1e3610962e0a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:40.375334 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1778/3529] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:40 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:40.381138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c0005-be7e-40b0-92aa-51c3481f18e7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:40.396484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c0005-be7e-40b0-92aa-51c3481f18e7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:40.409768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cf24f-c5ac-48ea-b307-e1737770caa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:40.411579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cf24f-c5ac-48ea-b307-e1737770caa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:40.411919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cf24f-c5ac-48ea-b307-e1737770caa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:40.412255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cf24f-c5ac-48ea-b307-e1737770caa7 admin admin] PATH_INFO: `/v3/projects/3d4aa5709616446a9905f1a6c0e382da/users/d317a283bbf34206b63932b746332826/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:40.436546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52bc21-46ba-4563-b742-1e3610962e0a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:40.438936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9b52bc21-46ba-4563-b742-1e3610962e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:40.466046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cf24f-c5ac-48ea-b307-e1737770caa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4aa5709616446a9905f1a6c0e382da, user_id=d317a283bbf34206b63932b746332826, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:40.469332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cf24f-c5ac-48ea-b307-e1737770caa7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:40.471121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52bc21-46ba-4563-b742-1e3610962e0a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:40.480577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7d466-64f1-47fa-9c71-8f842bdb14c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:40.482009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d466-64f1-47fa-9c71-8f842bdb14c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:40.484289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d466-64f1-47fa-9c71-8f842bdb14c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:40.485241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d466-64f1-47fa-9c71-8f842bdb14c3 admin admin] PATH_INFO: `/v3/projects/96f1afe3c99a4bcaab29cb7dfdf411b1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:40.501936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7d466-64f1-47fa-9c71-8f842bdb14c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f1afe3c99a4bcaab29cb7dfdf411b1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:40.502948 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1752/3530] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:53:40 2021] PUT /identity/v3/projects/3d4aa5709616446a9905f1a6c0e382da/users/d317a283bbf34206b63932b746332826/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:40.504438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7d466-64f1-47fa-9c71-8f842bdb14c3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:40.515607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e3e2d-529e-48a8-8a37-1f77e94efb7f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:40.515607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e3e2d-529e-48a8-8a37-1f77e94efb7f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:40.515607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e3e2d-529e-48a8-8a37-1f77e94efb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:40.565404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-137e3e2d-529e-48a8-8a37-1f77e94efb7f None None] MFA Rules not processed for user `d317a283bbf34206b63932b746332826`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:40.567424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-137e3e2d-529e-48a8-8a37-1f77e94efb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:40.640036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4cf7d466-64f1-47fa-9c71-8f842bdb14c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f1afe3c99a4bcaab29cb7dfdf411b1', 'request_id': 'req-4cf7d466-64f1-47fa-9c71-8f842bdb14c3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:40.658651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4cf7d466-64f1-47fa-9c71-8f842bdb14c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f1afe3c99a4bcaab29cb7dfdf411b1', 'request_id': 'req-4cf7d466-64f1-47fa-9c71-8f842bdb14c3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:40.674787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4cf7d466-64f1-47fa-9c71-8f842bdb14c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f1afe3c99a4bcaab29cb7dfdf411b1', 'request_id': 'req-4cf7d466-64f1-47fa-9c71-8f842bdb14c3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:40.694054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4cf7d466-64f1-47fa-9c71-8f842bdb14c3 admin admin] The token cache is being invalidate because project 96f1afe3c99a4bcaab29cb7dfdf411b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:53:40.694413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4cf7d466-64f1-47fa-9c71-8f842bdb14c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:40.695290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4cf7d466-64f1-47fa-9c71-8f842bdb14c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:40.698782 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1779/3531] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:53:40 2021] DELETE /identity/v3/projects/96f1afe3c99a4bcaab29cb7dfdf411b1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:40.705508 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1753/3532] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:40 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:40.707156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45aa54-b504-4329-b6a0-74e3c472c776 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:40.707511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45aa54-b504-4329-b6a0-74e3c472c776 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:40.707865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45aa54-b504-4329-b6a0-74e3c472c776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:40.715394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e3e2d-529e-48a8-8a37-1f77e94efb7f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:40.752007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ca45aa54-b504-4329-b6a0-74e3c472c776 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:40.755497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ca45aa54-b504-4329-b6a0-74e3c472c776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:40.878982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e3e2d-529e-48a8-8a37-1f77e94efb7f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:40.927655 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1780/3533] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:40.935494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfa027-8b48-4894-9b7d-056bb3968ce8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:40.937666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfa027-8b48-4894-9b7d-056bb3968ce8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:40.938160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfa027-8b48-4894-9b7d-056bb3968ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:40.956834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19465dc7-6928-459f-b6c7-f99dea3f3c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:40.957450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19465dc7-6928-459f-b6c7-f99dea3f3c18 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:40.957704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19465dc7-6928-459f-b6c7-f99dea3f3c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:40.957960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19465dc7-6928-459f-b6c7-f99dea3f3c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:40.958947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19465dc7-6928-459f-b6c7-f99dea3f3c18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:40.960849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19465dc7-6928-459f-b6c7-f99dea3f3c18 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:41.001950 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1754/3534] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:53:40 2021] POST /identity/v3/projects => generated 397 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:41.002790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-99dfa027-8b48-4894-9b7d-056bb3968ce8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:41.003033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19465dc7-6928-459f-b6c7-f99dea3f3c18 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:41.005076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-99dfa027-8b48-4894-9b7d-056bb3968ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:41.005415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-19465dc7-6928-459f-b6c7-f99dea3f3c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:41.085492 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1781/3535] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:41.092123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfa027-8b48-4894-9b7d-056bb3968ce8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:41.102536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19465dc7-6928-459f-b6c7-f99dea3f3c18 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:41.108758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfa027-8b48-4894-9b7d-056bb3968ce8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:41.109552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd577b9e-a8ad-42cb-b4f6-f3ea89e6e792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:41.111643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd577b9e-a8ad-42cb-b4f6-f3ea89e6e792 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:41.111643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd577b9e-a8ad-42cb-b4f6-f3ea89e6e792 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:41.111921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd577b9e-a8ad-42cb-b4f6-f3ea89e6e792 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:41.112714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd577b9e-a8ad-42cb-b4f6-f3ea89e6e792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:41.115259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd577b9e-a8ad-42cb-b4f6-f3ea89e6e792 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:41.120992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d719d1c-39f9-4b8a-901d-ab0a5f53f3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:41.123912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d719d1c-39f9-4b8a-901d-ab0a5f53f3dc admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:41.134677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d719d1c-39f9-4b8a-901d-ab0a5f53f3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:41.135061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d719d1c-39f9-4b8a-901d-ab0a5f53f3dc admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:41.137553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d719d1c-39f9-4b8a-901d-ab0a5f53f3dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:53:41.137553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d719d1c-39f9-4b8a-901d-ab0a5f53f3dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:41.142185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d719d1c-39f9-4b8a-901d-ab0a5f53f3dc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:41.144475 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1755/3536] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:53:41 2021] POST /identity/v3/users => generated 305 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:53:41.148561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd577b9e-a8ad-42cb-b4f6-f3ea89e6e792 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:41.171832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd577b9e-a8ad-42cb-b4f6-f3ea89e6e792 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:41.176913 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1782/3537] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:53:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:53:41.182494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d719d1c-39f9-4b8a-901d-ab0a5f53f3dc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:41.183337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86461b-da3a-4ded-89a5-1c78f270f956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:41.184204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86461b-da3a-4ded-89a5-1c78f270f956 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:41.184533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86461b-da3a-4ded-89a5-1c78f270f956 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:41.184812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86461b-da3a-4ded-89a5-1c78f270f956 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:41.185557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86461b-da3a-4ded-89a5-1c78f270f956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:41.187701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86461b-da3a-4ded-89a5-1c78f270f956 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:41.205262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d719d1c-39f9-4b8a-901d-ab0a5f53f3dc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:41.206960 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1756/3538] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:41 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:41.208199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86461b-da3a-4ded-89a5-1c78f270f956 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:41.220720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86461b-da3a-4ded-89a5-1c78f270f956 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:41.221578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fdb31-d317-4025-aca9-c6383623eb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:41.222483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fdb31-d317-4025-aca9-c6383623eb12 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:41.222978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fdb31-d317-4025-aca9-c6383623eb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:41.223382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fdb31-d317-4025-aca9-c6383623eb12 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:41.225265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fdb31-d317-4025-aca9-c6383623eb12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:41.231245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fdb31-d317-4025-aca9-c6383623eb12 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:41.234303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9331193-a929-47dd-b6e0-dca6ab152dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:41.235533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9331193-a929-47dd-b6e0-dca6ab152dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:41.236193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9331193-a929-47dd-b6e0-dca6ab152dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:41.236477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9331193-a929-47dd-b6e0-dca6ab152dc0 admin admin] PATH_INFO: `/v3/projects/3372cf5fd3fd4d0486b403b89e00fce2/users/e27face416ec4a2db2bc30f9b68c2321/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:41.256762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9331193-a929-47dd-b6e0-dca6ab152dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3372cf5fd3fd4d0486b403b89e00fce2, user_id=e27face416ec4a2db2bc30f9b68c2321, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:41.259897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9331193-a929-47dd-b6e0-dca6ab152dc0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:41.279763 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1757/3539] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:53:41 2021] PUT /identity/v3/projects/3372cf5fd3fd4d0486b403b89e00fce2/users/e27face416ec4a2db2bc30f9b68c2321/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:41.284470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9331193-a929-47dd-b6e0-dca6ab152dc0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:41.305615 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1783/3540] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:53:41 2021] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:41.309698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fdb31-d317-4025-aca9-c6383623eb12 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:41.443557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9331193-a929-47dd-b6e0-dca6ab152dc0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:41.467850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fdb31-d317-4025-aca9-c6383623eb12 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:41.475534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cbf95-de0d-4f97-9d6a-0959384fb5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:41.476524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cbf95-de0d-4f97-9d6a-0959384fb5fd admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:41.480245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cbf95-de0d-4f97-9d6a-0959384fb5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:41.480689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cbf95-de0d-4f97-9d6a-0959384fb5fd admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:41.481603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cbf95-de0d-4f97-9d6a-0959384fb5fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:41.483904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cbf95-de0d-4f97-9d6a-0959384fb5fd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:41.515149 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1784/3541] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:53:41 2021] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:41.521850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cbf95-de0d-4f97-9d6a-0959384fb5fd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:41.541401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cbf95-de0d-4f97-9d6a-0959384fb5fd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:41.559522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd2748-9b86-43c4-a7c7-9696ae4d7de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:41.560402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd2748-9b86-43c4-a7c7-9696ae4d7de3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:41.560698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd2748-9b86-43c4-a7c7-9696ae4d7de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:41.562603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd2748-9b86-43c4-a7c7-9696ae4d7de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:41.563220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd2748-9b86-43c4-a7c7-9696ae4d7de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:41.567158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd2748-9b86-43c4-a7c7-9696ae4d7de3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:41.576891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726a599-1a6e-40f4-8269-8938ace0fe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:41.577581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726a599-1a6e-40f4-8269-8938ace0fe71 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:41.578023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726a599-1a6e-40f4-8269-8938ace0fe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:41.578345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726a599-1a6e-40f4-8269-8938ace0fe71 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:41.579169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726a599-1a6e-40f4-8269-8938ace0fe71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:41.581596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726a599-1a6e-40f4-8269-8938ace0fe71 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:41.593825 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1785/3542] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:41 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:41.595303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd2748-9b86-43c4-a7c7-9696ae4d7de3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:41.596660 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1758/3543] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:41 2021] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:41.600711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726a599-1a6e-40f4-8269-8938ace0fe71 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:41.622991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd2748-9b86-43c4-a7c7-9696ae4d7de3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:41.627711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726a599-1a6e-40f4-8269-8938ace0fe71 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:41.638157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04d726-ddfd-4139-bc80-632106a04395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:41.639338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04d726-ddfd-4139-bc80-632106a04395 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:41.642288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04d726-ddfd-4139-bc80-632106a04395 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:41.643117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04d726-ddfd-4139-bc80-632106a04395 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:41.643348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04d726-ddfd-4139-bc80-632106a04395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:41.645532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab57f1-026d-4e56-80fe-78c1537feece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:41.647472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab57f1-026d-4e56-80fe-78c1537feece admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:41.647767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab57f1-026d-4e56-80fe-78c1537feece admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:41.648200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab57f1-026d-4e56-80fe-78c1537feece admin admin] PATH_INFO: `/v3/projects/3372cf5fd3fd4d0486b403b89e00fce2/users/e27face416ec4a2db2bc30f9b68c2321/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:41.651795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab57f1-026d-4e56-80fe-78c1537feece admin admin] RBAC: Authorizing `identity:create_grant(project_id=3372cf5fd3fd4d0486b403b89e00fce2, user_id=e27face416ec4a2db2bc30f9b68c2321, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:41.653192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04d726-ddfd-4139-bc80-632106a04395 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:41.654599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab57f1-026d-4e56-80fe-78c1537feece admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:41.687877 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1759/3544] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:53:41 2021] PUT /identity/v3/projects/3372cf5fd3fd4d0486b403b89e00fce2/users/e27face416ec4a2db2bc30f9b68c2321/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:53:41.688270 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1786/3545] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:41 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:41.688403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab57f1-026d-4e56-80fe-78c1537feece admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:41.692899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc9b6d-0f71-47a7-8d6b-0dac2ef0c2ba None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:41.693252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc9b6d-0f71-47a7-8d6b-0dac2ef0c2ba None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:41.693543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc9b6d-0f71-47a7-8d6b-0dac2ef0c2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:41.771725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-effc9b6d-0f71-47a7-8d6b-0dac2ef0c2ba None None] MFA Rules not processed for user `e27face416ec4a2db2bc30f9b68c2321`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:41.775083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-effc9b6d-0f71-47a7-8d6b-0dac2ef0c2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:41.848340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab57f1-026d-4e56-80fe-78c1537feece admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:41.856185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe45432-b539-4403-9c1b-3b8eb50d38a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:41.857142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe45432-b539-4403-9c1b-3b8eb50d38a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:41.857431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe45432-b539-4403-9c1b-3b8eb50d38a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:41.858047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe45432-b539-4403-9c1b-3b8eb50d38a6 admin admin] PATH_INFO: `/v3/projects/de0a59b4d888450a8a5dbe7491a1f79d/users/d65560600d2840f79a05fde797b5f588/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:41.879981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe45432-b539-4403-9c1b-3b8eb50d38a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0a59b4d888450a8a5dbe7491a1f79d, user_id=d65560600d2840f79a05fde797b5f588, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:41.882861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe45432-b539-4403-9c1b-3b8eb50d38a6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:41.926465 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1787/3546] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:41 2021] POST /identity/v3/auth/tokens => generated 3331 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:41.938063 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1760/3547] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:53:41 2021] PUT /identity/v3/projects/de0a59b4d888450a8a5dbe7491a1f79d/users/d65560600d2840f79a05fde797b5f588/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:53:41.938317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc9b6d-0f71-47a7-8d6b-0dac2ef0c2ba None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:41.949038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-effc9b6d-0f71-47a7-8d6b-0dac2ef0c2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:41.951239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed83b1-adac-4885-a168-9b19d369af27 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:41.951539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed83b1-adac-4885-a168-9b19d369af27 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:41.962390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed83b1-adac-4885-a168-9b19d369af27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:42.021930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8eed83b1-adac-4885-a168-9b19d369af27 None None] MFA Rules not processed for user `d65560600d2840f79a05fde797b5f588`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:42.025929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8eed83b1-adac-4885-a168-9b19d369af27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:42.119822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc9b6d-0f71-47a7-8d6b-0dac2ef0c2ba None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:42.191171 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1761/3548] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:41 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:42.205346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed83b1-adac-4885-a168-9b19d369af27 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:42.206995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8eed83b1-adac-4885-a168-9b19d369af27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:42.303258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d5994-029b-4aa3-a75d-8ce9283d93ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:42.306621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d5994-029b-4aa3-a75d-8ce9283d93ca service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:42.307713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d5994-029b-4aa3-a75d-8ce9283d93ca service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:42.308182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d5994-029b-4aa3-a75d-8ce9283d93ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:42.312611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-134d5994-029b-4aa3-a75d-8ce9283d93ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:42.365126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed83b1-adac-4885-a168-9b19d369af27 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:42.379623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6be2b-f5a4-41cf-9a88-ff13d925ce30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:42.380310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6be2b-f5a4-41cf-9a88-ff13d925ce30 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:42.380729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6be2b-f5a4-41cf-9a88-ff13d925ce30 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:42.381156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6be2b-f5a4-41cf-9a88-ff13d925ce30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:42.396117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6be2b-f5a4-41cf-9a88-ff13d925ce30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:42.400191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6be2b-f5a4-41cf-9a88-ff13d925ce30 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:42.412372 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1762/3549] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:42 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:53:42.449106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d5994-029b-4aa3-a75d-8ce9283d93ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:42.450886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d5994-029b-4aa3-a75d-8ce9283d93ca service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:42.475204 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1788/3550] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:41 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:53:42.721245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6be2b-f5a4-41cf-9a88-ff13d925ce30 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:42.725831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d5994-029b-4aa3-a75d-8ce9283d93ca service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:42.749707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d5994-029b-4aa3-a75d-8ce9283d93ca service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:42.767068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21ff57-f3a2-48af-b3c3-f9b080e4f9b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:42.768577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21ff57-f3a2-48af-b3c3-f9b080e4f9b4 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:42.770101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21ff57-f3a2-48af-b3c3-f9b080e4f9b4 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:42.770515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21ff57-f3a2-48af-b3c3-f9b080e4f9b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:42.802640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6be2b-f5a4-41cf-9a88-ff13d925ce30 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:42.809307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed5ea2-5b74-4b4e-80c4-04910fac0c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:42.812127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed5ea2-5b74-4b4e-80c4-04910fac0c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:42.812127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed5ea2-5b74-4b4e-80c4-04910fac0c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:42.812353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed5ea2-5b74-4b4e-80c4-04910fac0c60 admin admin] PATH_INFO: `/v3/users/d65560600d2840f79a05fde797b5f588` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:42.813758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed5ea2-5b74-4b4e-80c4-04910fac0c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d65560600d2840f79a05fde797b5f588)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:42.815910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed5ea2-5b74-4b4e-80c4-04910fac0c60 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:42.881764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dfed5ea2-5b74-4b4e-80c4-04910fac0c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd65560600d2840f79a05fde797b5f588'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:42.891780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dfed5ea2-5b74-4b4e-80c4-04910fac0c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd65560600d2840f79a05fde797b5f588'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:42.906927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dfed5ea2-5b74-4b4e-80c4-04910fac0c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd65560600d2840f79a05fde797b5f588'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:42.908439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dfed5ea2-5b74-4b4e-80c4-04910fac0c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd65560600d2840f79a05fde797b5f588'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:42.908749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21ff57-f3a2-48af-b3c3-f9b080e4f9b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:42.918431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21ff57-f3a2-48af-b3c3-f9b080e4f9b4 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:42.921622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dfed5ea2-5b74-4b4e-80c4-04910fac0c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd65560600d2840f79a05fde797b5f588'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:42.934514 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1789/3551] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:42 2021] GET /identity/v3/auth/tokens => generated 3331 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:42.940536 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1763/3552] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:53:42 2021] DELETE /identity/v3/users/d65560600d2840f79a05fde797b5f588 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:42.945688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8072fc8-393f-421a-8f69-88e3245793b0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:42.946068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8072fc8-393f-421a-8f69-88e3245793b0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:42.946492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8072fc8-393f-421a-8f69-88e3245793b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:42.990915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a8072fc8-393f-421a-8f69-88e3245793b0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:42.993487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a8072fc8-393f-421a-8f69-88e3245793b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:43.119393 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1790/3553] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:53:43.208448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed5ea2-5b74-4b4e-80c4-04910fac0c60 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:43.209955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-dfed5ea2-5b74-4b4e-80c4-04910fac0c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:43.363974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed5ea2-5b74-4b4e-80c4-04910fac0c60 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:43.385985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513daef-4228-4a79-aa17-73c0dbc03a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:43.386824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513daef-4228-4a79-aa17-73c0dbc03a06 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:43.388348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513daef-4228-4a79-aa17-73c0dbc03a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:43.388716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513daef-4228-4a79-aa17-73c0dbc03a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:43.423777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513daef-4228-4a79-aa17-73c0dbc03a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:43.426198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513daef-4228-4a79-aa17-73c0dbc03a06 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:43.449862 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1764/3554] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:44.111826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8072fc8-393f-421a-8f69-88e3245793b0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:44.113498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a8072fc8-393f-421a-8f69-88e3245793b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:44.133088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8072fc8-393f-421a-8f69-88e3245793b0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:44.146191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb460d99-7b6d-41b9-baa1-01a59883fe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:44.147194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb460d99-7b6d-41b9-baa1-01a59883fe3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:44.147594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb460d99-7b6d-41b9-baa1-01a59883fe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:44.147967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb460d99-7b6d-41b9-baa1-01a59883fe3b admin admin] PATH_INFO: `/v3/projects/de0a59b4d888450a8a5dbe7491a1f79d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:44.150821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb460d99-7b6d-41b9-baa1-01a59883fe3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0a59b4d888450a8a5dbe7491a1f79d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:44.152827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb460d99-7b6d-41b9-baa1-01a59883fe3b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:44.254995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb460d99-7b6d-41b9-baa1-01a59883fe3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0a59b4d888450a8a5dbe7491a1f79d', 'request_id': 'req-cb460d99-7b6d-41b9-baa1-01a59883fe3b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:44.273067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb460d99-7b6d-41b9-baa1-01a59883fe3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0a59b4d888450a8a5dbe7491a1f79d', 'request_id': 'req-cb460d99-7b6d-41b9-baa1-01a59883fe3b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:44.285131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb460d99-7b6d-41b9-baa1-01a59883fe3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0a59b4d888450a8a5dbe7491a1f79d', 'request_id': 'req-cb460d99-7b6d-41b9-baa1-01a59883fe3b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:44.360250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb460d99-7b6d-41b9-baa1-01a59883fe3b admin admin] The token cache is being invalidate because project de0a59b4d888450a8a5dbe7491a1f79d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:53:44.362599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb460d99-7b6d-41b9-baa1-01a59883fe3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:44.367360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb460d99-7b6d-41b9-baa1-01a59883fe3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:44.380647 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1791/3555] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:53:44 2021] DELETE /identity/v3/projects/de0a59b4d888450a8a5dbe7491a1f79d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:44.381924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbeb929-c48c-46b6-a6c4-f48f35623052 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:44.383056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbeb929-c48c-46b6-a6c4-f48f35623052 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:44.384059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbeb929-c48c-46b6-a6c4-f48f35623052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:44.436808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3fbeb929-c48c-46b6-a6c4-f48f35623052 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:44.441155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3fbeb929-c48c-46b6-a6c4-f48f35623052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:44.562030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb460d99-7b6d-41b9-baa1-01a59883fe3b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:44.566067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cb460d99-7b6d-41b9-baa1-01a59883fe3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:44.615669 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1765/3556] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:44.627249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc21dd9-cd54-4c71-9d44-944425800923 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:44.627539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc21dd9-cd54-4c71-9d44-944425800923 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:44.627853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc21dd9-cd54-4c71-9d44-944425800923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:44.669686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9bc21dd9-cd54-4c71-9d44-944425800923 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:44.671321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9bc21dd9-cd54-4c71-9d44-944425800923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:44.697920 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1766/3557] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:53:44.705801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc21dd9-cd54-4c71-9d44-944425800923 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:44.728684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc21dd9-cd54-4c71-9d44-944425800923 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:44.742225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5afb7d-3f16-4cc8-bf4f-55cfe775c5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:44.744192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5afb7d-3f16-4cc8-bf4f-55cfe775c5ba admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:44.745517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5afb7d-3f16-4cc8-bf4f-55cfe775c5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:44.747393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5afb7d-3f16-4cc8-bf4f-55cfe775c5ba admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:44.750429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5afb7d-3f16-4cc8-bf4f-55cfe775c5ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:53:44.750931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5afb7d-3f16-4cc8-bf4f-55cfe775c5ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:44.755784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5afb7d-3f16-4cc8-bf4f-55cfe775c5ba admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:44.770851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb460d99-7b6d-41b9-baa1-01a59883fe3b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:44.784064 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1767/3558] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:53:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:53:44.786284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b16bf-918c-4e2f-9a6c-e9a2caefd95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:44.787635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b16bf-918c-4e2f-9a6c-e9a2caefd95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:44.787927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b16bf-918c-4e2f-9a6c-e9a2caefd95c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:44.790627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5afb7d-3f16-4cc8-bf4f-55cfe775c5ba admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:44.790792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b16bf-918c-4e2f-9a6c-e9a2caefd95c admin admin] PATH_INFO: `/v3/users/d317a283bbf34206b63932b746332826` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:44.791966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b16bf-918c-4e2f-9a6c-e9a2caefd95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d317a283bbf34206b63932b746332826)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:44.793866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b16bf-918c-4e2f-9a6c-e9a2caefd95c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:44.818295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5afb7d-3f16-4cc8-bf4f-55cfe775c5ba admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:44.828320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c7364-854d-46f0-851e-4d95cdf967b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:44.829426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c7364-854d-46f0-851e-4d95cdf967b4 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:44.830702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c7364-854d-46f0-851e-4d95cdf967b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:44.831516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c7364-854d-46f0-851e-4d95cdf967b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:44.833528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c7364-854d-46f0-851e-4d95cdf967b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:44.835892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c7364-854d-46f0-851e-4d95cdf967b4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:44.896313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-997b16bf-918c-4e2f-9a6c-e9a2caefd95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd317a283bbf34206b63932b746332826'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:44.904579 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1768/3559] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:53:44 2021] POST /identity/v3/projects => generated 397 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:44.909380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c7364-854d-46f0-851e-4d95cdf967b4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:44.911730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-997b16bf-918c-4e2f-9a6c-e9a2caefd95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd317a283bbf34206b63932b746332826'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:44.912452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-997b16bf-918c-4e2f-9a6c-e9a2caefd95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd317a283bbf34206b63932b746332826'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:44.932040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-997b16bf-918c-4e2f-9a6c-e9a2caefd95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd317a283bbf34206b63932b746332826'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:44.948837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-997b16bf-918c-4e2f-9a6c-e9a2caefd95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd317a283bbf34206b63932b746332826'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:44.958600 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1792/3560] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:53:44 2021] DELETE /identity/v3/users/d317a283bbf34206b63932b746332826 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:53:44.958600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac94b9-523b-44e2-89b7-ce6a430a8ea6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:44.958600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac94b9-523b-44e2-89b7-ce6a430a8ea6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:44.958979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac94b9-523b-44e2-89b7-ce6a430a8ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:44.982315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-49ac94b9-523b-44e2-89b7-ce6a430a8ea6 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:44.983548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-49ac94b9-523b-44e2-89b7-ce6a430a8ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:45.010610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c7364-854d-46f0-851e-4d95cdf967b4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:45.074377 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1793/3561] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:53:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:45.076055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7e248-bc5b-4e79-8ecd-c31cfdfa5a1c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:45.076347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7e248-bc5b-4e79-8ecd-c31cfdfa5a1c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:45.076629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7e248-bc5b-4e79-8ecd-c31cfdfa5a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:45.106199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-31e7e248-bc5b-4e79-8ecd-c31cfdfa5a1c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:45.107621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-31e7e248-bc5b-4e79-8ecd-c31cfdfa5a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:45.189789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51162cc-791d-44c6-96e4-8d42abe89a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:45.199762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51162cc-791d-44c6-96e4-8d42abe89a97 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:45.200073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51162cc-791d-44c6-96e4-8d42abe89a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:45.201464 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1794/3562] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:45.202288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7e248-bc5b-4e79-8ecd-c31cfdfa5a1c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:45.205812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51162cc-791d-44c6-96e4-8d42abe89a97 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:45.206043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-31e7e248-bc5b-4e79-8ecd-c31cfdfa5a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:45.206643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51162cc-791d-44c6-96e4-8d42abe89a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:45.215466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51162cc-791d-44c6-96e4-8d42abe89a97 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:45.264231 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1769/3563] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:53:44 2021] POST /identity/v3/users => generated 299 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:45.265079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51162cc-791d-44c6-96e4-8d42abe89a97 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:45.271863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b51162cc-791d-44c6-96e4-8d42abe89a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:45.404146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51162cc-791d-44c6-96e4-8d42abe89a97 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:45.423116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c39c2d-f127-420d-a523-4d64bdcde83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:45.423803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c39c2d-f127-420d-a523-4d64bdcde83e service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:45.424092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c39c2d-f127-420d-a523-4d64bdcde83e service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:45.424377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c39c2d-f127-420d-a523-4d64bdcde83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:45.424564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7e248-bc5b-4e79-8ecd-c31cfdfa5a1c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:45.440079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c39c2d-f127-420d-a523-4d64bdcde83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:45.442554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c39c2d-f127-420d-a523-4d64bdcde83e service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:45.447991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d095d27-7207-4613-9d2e-e6eea1f9acb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:45.448660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d095d27-7207-4613-9d2e-e6eea1f9acb7 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:45.449582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d095d27-7207-4613-9d2e-e6eea1f9acb7 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:45.449924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d095d27-7207-4613-9d2e-e6eea1f9acb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:45.464384 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1770/3564] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:45.465245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c39c2d-f127-420d-a523-4d64bdcde83e service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:45.466756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d095d27-7207-4613-9d2e-e6eea1f9acb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:45.469101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d095d27-7207-4613-9d2e-e6eea1f9acb7 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:45.474946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-50c39c2d-f127-420d-a523-4d64bdcde83e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:45.484814 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1795/3565] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:53:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:53:45.494546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c39c2d-f127-420d-a523-4d64bdcde83e service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:45.531752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56874870-545f-4855-bfcf-af7ffd3cd342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:45.532447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874870-545f-4855-bfcf-af7ffd3cd342 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:45.532805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874870-545f-4855-bfcf-af7ffd3cd342 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:45.533008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874870-545f-4855-bfcf-af7ffd3cd342 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:45.533941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56874870-545f-4855-bfcf-af7ffd3cd342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:45.535626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56874870-545f-4855-bfcf-af7ffd3cd342 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:45.557253 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1771/3566] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:45 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:45.561340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d095d27-7207-4613-9d2e-e6eea1f9acb7 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:45.580053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d095d27-7207-4613-9d2e-e6eea1f9acb7 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:45.590847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080eb1f8-da29-4f31-9a06-074c7020b17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:45.591842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eb1f8-da29-4f31-9a06-074c7020b17a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:45.592294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eb1f8-da29-4f31-9a06-074c7020b17a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:45.592728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eb1f8-da29-4f31-9a06-074c7020b17a admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:45.593631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080eb1f8-da29-4f31-9a06-074c7020b17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:45.598573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080eb1f8-da29-4f31-9a06-074c7020b17a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:45.627369 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1796/3567] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:45 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:45.633171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56874870-545f-4855-bfcf-af7ffd3cd342 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:45.648675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56874870-545f-4855-bfcf-af7ffd3cd342 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:45.662533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775cf9f-b1cf-4171-b0f6-aeb244a8bd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:45.663709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775cf9f-b1cf-4171-b0f6-aeb244a8bd94 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:45.664166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775cf9f-b1cf-4171-b0f6-aeb244a8bd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:45.664658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775cf9f-b1cf-4171-b0f6-aeb244a8bd94 admin admin] PATH_INFO: `/v3/projects/5db81427f59c428288ece836e66da2b9/users/0b0d70afb7634afa8474c5e430ba681b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:45.702993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775cf9f-b1cf-4171-b0f6-aeb244a8bd94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db81427f59c428288ece836e66da2b9, user_id=0b0d70afb7634afa8474c5e430ba681b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:45.705742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775cf9f-b1cf-4171-b0f6-aeb244a8bd94 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:45.740962 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1772/3568] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:53:45 2021] PUT /identity/v3/projects/5db81427f59c428288ece836e66da2b9/users/0b0d70afb7634afa8474c5e430ba681b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:45.752126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaed22-8fe1-415a-b371-da1e44a811a7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:45.752661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaed22-8fe1-415a-b371-da1e44a811a7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:45.753116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaed22-8fe1-415a-b371-da1e44a811a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:45.810380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-39eaed22-8fe1-415a-b371-da1e44a811a7 None None] MFA Rules not processed for user `0b0d70afb7634afa8474c5e430ba681b`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:45.811862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-39eaed22-8fe1-415a-b371-da1e44a811a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:45.972077 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1797/3569] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:45 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:46.068980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775cf9f-b1cf-4171-b0f6-aeb244a8bd94 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:46.071595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a775cf9f-b1cf-4171-b0f6-aeb244a8bd94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:46.231715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775cf9f-b1cf-4171-b0f6-aeb244a8bd94 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:46.237864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1681873-d8d5-4237-bde1-d88366313061 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:46.238774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1681873-d8d5-4237-bde1-d88366313061 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:46.239249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1681873-d8d5-4237-bde1-d88366313061 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:46.239692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1681873-d8d5-4237-bde1-d88366313061 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:46.258586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1681873-d8d5-4237-bde1-d88366313061 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:46.260454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1681873-d8d5-4237-bde1-d88366313061 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:46.290077 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1773/3570] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:46 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:46.384557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ff348-7691-4123-aef9-3a3f433ce45a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:46.385033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ff348-7691-4123-aef9-3a3f433ce45a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:46.385152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ff348-7691-4123-aef9-3a3f433ce45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:46.429735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b64ff348-7691-4123-aef9-3a3f433ce45a None None] MFA Rules not processed for user `0b0d70afb7634afa8474c5e430ba681b`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:46.437973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b64ff348-7691-4123-aef9-3a3f433ce45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:46.439012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1681873-d8d5-4237-bde1-d88366313061 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:46.441115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e1681873-d8d5-4237-bde1-d88366313061 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:46.469681 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1798/3571] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:46 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:46.652609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1681873-d8d5-4237-bde1-d88366313061 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:46.668300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dfd9c-3356-441d-b8dd-90259af626ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:46.685875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dfd9c-3356-441d-b8dd-90259af626ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:46.686848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dfd9c-3356-441d-b8dd-90259af626ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:46.688139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dfd9c-3356-441d-b8dd-90259af626ba admin admin] PATH_INFO: `/v3/projects/3d4aa5709616446a9905f1a6c0e382da` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:46.692235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dfd9c-3356-441d-b8dd-90259af626ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d4aa5709616446a9905f1a6c0e382da)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:46.696389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dfd9c-3356-441d-b8dd-90259af626ba admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:46.839705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0d0dfd9c-3356-441d-b8dd-90259af626ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d4aa5709616446a9905f1a6c0e382da', 'request_id': 'req-0d0dfd9c-3356-441d-b8dd-90259af626ba'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:46.846849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0d0dfd9c-3356-441d-b8dd-90259af626ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d4aa5709616446a9905f1a6c0e382da', 'request_id': 'req-0d0dfd9c-3356-441d-b8dd-90259af626ba'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:46.859731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0d0dfd9c-3356-441d-b8dd-90259af626ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d4aa5709616446a9905f1a6c0e382da', 'request_id': 'req-0d0dfd9c-3356-441d-b8dd-90259af626ba'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:46.880676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0d0dfd9c-3356-441d-b8dd-90259af626ba admin admin] The token cache is being invalidate because project 3d4aa5709616446a9905f1a6c0e382da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:53:46.881034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0d0dfd9c-3356-441d-b8dd-90259af626ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:46.890780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0d0dfd9c-3356-441d-b8dd-90259af626ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:46.892554 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1774/3572] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:53:46 2021] DELETE /identity/v3/projects/3d4aa5709616446a9905f1a6c0e382da => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:53:46.896935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ff348-7691-4123-aef9-3a3f433ce45a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:46.912469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ff348-7691-4123-aef9-3a3f433ce45a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:47.131169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c32bc-32ad-4a1c-8b70-b2d28625f2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:47.134657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c32bc-32ad-4a1c-8b70-b2d28625f2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:47.135443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c32bc-32ad-4a1c-8b70-b2d28625f2de admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:47.135934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c32bc-32ad-4a1c-8b70-b2d28625f2de admin admin] PATH_INFO: `/v3/users/e27face416ec4a2db2bc30f9b68c2321` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:47.140433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c32bc-32ad-4a1c-8b70-b2d28625f2de admin admin] RBAC: Authorizing `identity:delete_user(user_id=e27face416ec4a2db2bc30f9b68c2321)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:47.144435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c32bc-32ad-4a1c-8b70-b2d28625f2de admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:47.262888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-647c32bc-32ad-4a1c-8b70-b2d28625f2de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e27face416ec4a2db2bc30f9b68c2321'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:47.280543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-647c32bc-32ad-4a1c-8b70-b2d28625f2de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e27face416ec4a2db2bc30f9b68c2321'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:47.283223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-647c32bc-32ad-4a1c-8b70-b2d28625f2de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e27face416ec4a2db2bc30f9b68c2321'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:47.326614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-647c32bc-32ad-4a1c-8b70-b2d28625f2de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e27face416ec4a2db2bc30f9b68c2321'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:47.345998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-647c32bc-32ad-4a1c-8b70-b2d28625f2de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e27face416ec4a2db2bc30f9b68c2321'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:47.353603 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1799/3573] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:53:46 2021] DELETE /identity/v3/users/e27face416ec4a2db2bc30f9b68c2321 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:47.578097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dfd9c-3356-441d-b8dd-90259af626ba admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:47.584454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0d0dfd9c-3356-441d-b8dd-90259af626ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:47.609527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dfd9c-3356-441d-b8dd-90259af626ba admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:47.756257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c84ae-86a8-417b-90f0-04b84e76eff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:47.757506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c84ae-86a8-417b-90f0-04b84e76eff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:47.766768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c84ae-86a8-417b-90f0-04b84e76eff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:47.767507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c84ae-86a8-417b-90f0-04b84e76eff9 admin admin] PATH_INFO: `/v3/users/0b0d70afb7634afa8474c5e430ba681b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:47.770593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c84ae-86a8-417b-90f0-04b84e76eff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b0d70afb7634afa8474c5e430ba681b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:47.772787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c84ae-86a8-417b-90f0-04b84e76eff9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:47.900948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b51c84ae-86a8-417b-90f0-04b84e76eff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b0d70afb7634afa8474c5e430ba681b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:47.927704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b51c84ae-86a8-417b-90f0-04b84e76eff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b0d70afb7634afa8474c5e430ba681b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:47.951639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b51c84ae-86a8-417b-90f0-04b84e76eff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b0d70afb7634afa8474c5e430ba681b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:47.952448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b51c84ae-86a8-417b-90f0-04b84e76eff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b0d70afb7634afa8474c5e430ba681b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:47.967946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b51c84ae-86a8-417b-90f0-04b84e76eff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b0d70afb7634afa8474c5e430ba681b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:47.984524 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1775/3574] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:53:47 2021] DELETE /identity/v3/users/0b0d70afb7634afa8474c5e430ba681b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:47.986360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb34ef0-cea6-43ff-b9d5-f2d9a88ae90d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:47.987219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb34ef0-cea6-43ff-b9d5-f2d9a88ae90d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:47.987748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb34ef0-cea6-43ff-b9d5-f2d9a88ae90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:48.036448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bbb34ef0-cea6-43ff-b9d5-f2d9a88ae90d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:48.037942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bbb34ef0-cea6-43ff-b9d5-f2d9a88ae90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:48.277914 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1800/3575] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:53:48.324590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c84ae-86a8-417b-90f0-04b84e76eff9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:48.326515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b51c84ae-86a8-417b-90f0-04b84e76eff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:48.555240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c84ae-86a8-417b-90f0-04b84e76eff9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:48.560752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cea286-e444-487a-b9bf-addb14534561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:48.562089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cea286-e444-487a-b9bf-addb14534561 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:48.562089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cea286-e444-487a-b9bf-addb14534561 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:48.562706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cea286-e444-487a-b9bf-addb14534561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:48.583788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cea286-e444-487a-b9bf-addb14534561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:48.585239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cea286-e444-487a-b9bf-addb14534561 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:48.619569 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1776/3576] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:49.815329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb34ef0-cea6-43ff-b9d5-f2d9a88ae90d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:49.817621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bbb34ef0-cea6-43ff-b9d5-f2d9a88ae90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:49.837477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb34ef0-cea6-43ff-b9d5-f2d9a88ae90d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:49.851961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcd78a-25d9-4430-90c6-eb821a3db91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:49.852612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcd78a-25d9-4430-90c6-eb821a3db91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:49.852903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcd78a-25d9-4430-90c6-eb821a3db91e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:49.853183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcd78a-25d9-4430-90c6-eb821a3db91e admin admin] PATH_INFO: `/v3/projects/3372cf5fd3fd4d0486b403b89e00fce2` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:49.855986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcd78a-25d9-4430-90c6-eb821a3db91e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3372cf5fd3fd4d0486b403b89e00fce2)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:49.861407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcd78a-25d9-4430-90c6-eb821a3db91e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:49.987408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-02fcd78a-25d9-4430-90c6-eb821a3db91e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3372cf5fd3fd4d0486b403b89e00fce2', 'request_id': 'req-02fcd78a-25d9-4430-90c6-eb821a3db91e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:50.006321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-02fcd78a-25d9-4430-90c6-eb821a3db91e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3372cf5fd3fd4d0486b403b89e00fce2', 'request_id': 'req-02fcd78a-25d9-4430-90c6-eb821a3db91e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:50.021433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-02fcd78a-25d9-4430-90c6-eb821a3db91e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3372cf5fd3fd4d0486b403b89e00fce2', 'request_id': 'req-02fcd78a-25d9-4430-90c6-eb821a3db91e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:50.054013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-02fcd78a-25d9-4430-90c6-eb821a3db91e admin admin] The token cache is being invalidate because project 3372cf5fd3fd4d0486b403b89e00fce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:53:50.054442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-02fcd78a-25d9-4430-90c6-eb821a3db91e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:50.056330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-02fcd78a-25d9-4430-90c6-eb821a3db91e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:50.060480 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1801/3577] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:53:49 2021] DELETE /identity/v3/projects/3372cf5fd3fd4d0486b403b89e00fce2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:50.069737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969900ff-3c52-4d47-89c4-ea47d3edf2da None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:50.071361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969900ff-3c52-4d47-89c4-ea47d3edf2da None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:50.071842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969900ff-3c52-4d47-89c4-ea47d3edf2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:50.073135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcd78a-25d9-4430-90c6-eb821a3db91e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:50.078099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-02fcd78a-25d9-4430-90c6-eb821a3db91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:50.132535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-969900ff-3c52-4d47-89c4-ea47d3edf2da None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:50.149400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-969900ff-3c52-4d47-89c4-ea47d3edf2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:50.289918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcd78a-25d9-4430-90c6-eb821a3db91e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:50.307012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7971c-b353-40b0-8730-e72d6d9b4dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:50.308553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7971c-b353-40b0-8730-e72d6d9b4dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:50.309071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7971c-b353-40b0-8730-e72d6d9b4dff admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:50.309610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7971c-b353-40b0-8730-e72d6d9b4dff admin admin] PATH_INFO: `/v3/projects/5db81427f59c428288ece836e66da2b9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:50.315304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7971c-b353-40b0-8730-e72d6d9b4dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db81427f59c428288ece836e66da2b9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:50.317940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7971c-b353-40b0-8730-e72d6d9b4dff admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:50.325910 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1777/3578] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:50.328614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67b868-ad07-4228-8ae9-eb80ed89a569 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:50.328943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67b868-ad07-4228-8ae9-eb80ed89a569 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:50.329230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67b868-ad07-4228-8ae9-eb80ed89a569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:50.400543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0d67b868-ad07-4228-8ae9-eb80ed89a569 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:50.401884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0d67b868-ad07-4228-8ae9-eb80ed89a569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:50.424402 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1778/3579] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:50.428777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67b868-ad07-4228-8ae9-eb80ed89a569 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:50.448041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e3c7971c-b353-40b0-8730-e72d6d9b4dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db81427f59c428288ece836e66da2b9', 'request_id': 'req-e3c7971c-b353-40b0-8730-e72d6d9b4dff'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:50.458536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67b868-ad07-4228-8ae9-eb80ed89a569 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:50.464262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e3c7971c-b353-40b0-8730-e72d6d9b4dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db81427f59c428288ece836e66da2b9', 'request_id': 'req-e3c7971c-b353-40b0-8730-e72d6d9b4dff'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:50.478891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e3c7971c-b353-40b0-8730-e72d6d9b4dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db81427f59c428288ece836e66da2b9', 'request_id': 'req-e3c7971c-b353-40b0-8730-e72d6d9b4dff'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:50.498344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e3c7971c-b353-40b0-8730-e72d6d9b4dff admin admin] The token cache is being invalidate because project 5db81427f59c428288ece836e66da2b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:53:50.498795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e3c7971c-b353-40b0-8730-e72d6d9b4dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:50.500468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e3c7971c-b353-40b0-8730-e72d6d9b4dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:53:50.526312 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1802/3580] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:53:50 2021] DELETE /identity/v3/projects/5db81427f59c428288ece836e66da2b9 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:50.529272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597631e6-a53b-4c58-b5f2-7a661f3b9262 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:50.529689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597631e6-a53b-4c58-b5f2-7a661f3b9262 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:50.530074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597631e6-a53b-4c58-b5f2-7a661f3b9262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:50.584834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-597631e6-a53b-4c58-b5f2-7a661f3b9262 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:50.592866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-597631e6-a53b-4c58-b5f2-7a661f3b9262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:50.670445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af402c3-0e3b-461d-a573-453eb78994d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:50.671453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af402c3-0e3b-461d-a573-453eb78994d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:50.672012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af402c3-0e3b-461d-a573-453eb78994d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:50.672559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af402c3-0e3b-461d-a573-453eb78994d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:50.673319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af402c3-0e3b-461d-a573-453eb78994d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:53:50.673689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af402c3-0e3b-461d-a573-453eb78994d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:50.675419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af402c3-0e3b-461d-a573-453eb78994d0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:50.705302 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1779/3581] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:53:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:53:50.719416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af402c3-0e3b-461d-a573-453eb78994d0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:50.721209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2af402c3-0e3b-461d-a573-453eb78994d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:50.748848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af402c3-0e3b-461d-a573-453eb78994d0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:50.766131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9efbf0-cb06-4d72-b1ea-45f63f515286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:50.766908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9efbf0-cb06-4d72-b1ea-45f63f515286 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:50.767272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9efbf0-cb06-4d72-b1ea-45f63f515286 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:50.767561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9efbf0-cb06-4d72-b1ea-45f63f515286 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:50.768286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9efbf0-cb06-4d72-b1ea-45f63f515286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:50.770681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9efbf0-cb06-4d72-b1ea-45f63f515286 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:50.777251 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1803/3582] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:53:50.788201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3893267-a05c-430f-97f6-59e56fe2cd37 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:50.790393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3893267-a05c-430f-97f6-59e56fe2cd37 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:50.792124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3893267-a05c-430f-97f6-59e56fe2cd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:50.875688 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1780/3583] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:53:50 2021] POST /identity/v3/projects => generated 403 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:50.880723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9efbf0-cb06-4d72-b1ea-45f63f515286 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:50.886210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e3893267-a05c-430f-97f6-59e56fe2cd37 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:50.887934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e3893267-a05c-430f-97f6-59e56fe2cd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:51.055203 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1804/3584] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:51.060310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3893267-a05c-430f-97f6-59e56fe2cd37 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:51.067227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9efbf0-cb06-4d72-b1ea-45f63f515286 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:51.090328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dba618-4332-4919-9344-89bb64129be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:51.094135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dba618-4332-4919-9344-89bb64129be6 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:51.095937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dba618-4332-4919-9344-89bb64129be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:51.097025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dba618-4332-4919-9344-89bb64129be6 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:51.099992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dba618-4332-4919-9344-89bb64129be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:51.103855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3893267-a05c-430f-97f6-59e56fe2cd37 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:51.108447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dba618-4332-4919-9344-89bb64129be6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:51.127194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8555b38-28f0-487d-b756-46e4dabd270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:51.127636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8555b38-28f0-487d-b756-46e4dabd270c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:51.127919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8555b38-28f0-487d-b756-46e4dabd270c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:51.128198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8555b38-28f0-487d-b756-46e4dabd270c admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:51.129130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8555b38-28f0-487d-b756-46e4dabd270c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:53:51.129562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8555b38-28f0-487d-b756-46e4dabd270c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:51.131517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8555b38-28f0-487d-b756-46e4dabd270c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:51.156172 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1781/3585] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:53:50 2021] POST /identity/v3/users => generated 302 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:51.165458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dba618-4332-4919-9344-89bb64129be6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:51.182987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dba618-4332-4919-9344-89bb64129be6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:51.192588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3342f8-b1dc-4d89-8042-c55b2dbb129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:51.193557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3342f8-b1dc-4d89-8042-c55b2dbb129e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:51.194012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3342f8-b1dc-4d89-8042-c55b2dbb129e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:51.194668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3342f8-b1dc-4d89-8042-c55b2dbb129e admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:51.195630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3342f8-b1dc-4d89-8042-c55b2dbb129e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:51.197808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3342f8-b1dc-4d89-8042-c55b2dbb129e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:51.199828 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1805/3586] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:53:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:53:51.203182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8555b38-28f0-487d-b756-46e4dabd270c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:51.214738 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1782/3587] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:51 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:51.218753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3342f8-b1dc-4d89-8042-c55b2dbb129e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:51.233141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3342f8-b1dc-4d89-8042-c55b2dbb129e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:51.235118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8555b38-28f0-487d-b756-46e4dabd270c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:51.239772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84e197-1f8d-4269-8093-ad4b790eb6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:51.240725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84e197-1f8d-4269-8093-ad4b790eb6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:51.241217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84e197-1f8d-4269-8093-ad4b790eb6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:51.241792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84e197-1f8d-4269-8093-ad4b790eb6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:51.243667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84e197-1f8d-4269-8093-ad4b790eb6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:51.245747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84e197-1f8d-4269-8093-ad4b790eb6b2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:51.252410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32792d4-cd6a-4063-abdc-6a0aebb56f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:51.253121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32792d4-cd6a-4063-abdc-6a0aebb56f39 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:51.253536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32792d4-cd6a-4063-abdc-6a0aebb56f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:51.253915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32792d4-cd6a-4063-abdc-6a0aebb56f39 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:51.254764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32792d4-cd6a-4063-abdc-6a0aebb56f39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:51.258896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32792d4-cd6a-4063-abdc-6a0aebb56f39 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:51.260936 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1783/3588] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:51 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:53:51.266215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84e197-1f8d-4269-8093-ad4b790eb6b2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:51.301744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84e197-1f8d-4269-8093-ad4b790eb6b2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:51.314660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c94fcc-d5c6-4642-9ff2-d5e2a5ed8627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:51.317185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c94fcc-d5c6-4642-9ff2-d5e2a5ed8627 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:51.317540 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1806/3589] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:53:51 2021] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:51.317701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c94fcc-d5c6-4642-9ff2-d5e2a5ed8627 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:51.318069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c94fcc-d5c6-4642-9ff2-d5e2a5ed8627 admin admin] PATH_INFO: `/v3/projects/8ea04e2bc8a847c6b805251f862536af/users/fcb16838e32542a3a7eeedf9c5fde393/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:51.322918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32792d4-cd6a-4063-abdc-6a0aebb56f39 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:51.366918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c94fcc-d5c6-4642-9ff2-d5e2a5ed8627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea04e2bc8a847c6b805251f862536af, user_id=fcb16838e32542a3a7eeedf9c5fde393, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:51.369651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c94fcc-d5c6-4642-9ff2-d5e2a5ed8627 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:51.403509 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1784/3590] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:53:51 2021] PUT /identity/v3/projects/8ea04e2bc8a847c6b805251f862536af/users/fcb16838e32542a3a7eeedf9c5fde393/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:51.408740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523a54-9e14-4316-9bbc-0dba187ea59e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:51.409037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523a54-9e14-4316-9bbc-0dba187ea59e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:51.409347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523a54-9e14-4316-9bbc-0dba187ea59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:51.463349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9c523a54-9e14-4316-9bbc-0dba187ea59e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:51.466961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9c523a54-9e14-4316-9bbc-0dba187ea59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:51.472886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32792d4-cd6a-4063-abdc-6a0aebb56f39 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:51.741813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26b594-452d-4443-b353-80d25dd7eeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:51.743631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26b594-452d-4443-b353-80d25dd7eeb3 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:51.743918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26b594-452d-4443-b353-80d25dd7eeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:51.744200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26b594-452d-4443-b353-80d25dd7eeb3 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:51.744923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26b594-452d-4443-b353-80d25dd7eeb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:51.747388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26b594-452d-4443-b353-80d25dd7eeb3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:51.795072 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1807/3591] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:53:51 2021] POST /identity/v3/users => generated 294 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:53:51.797107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfab3e3-bff3-4205-8097-0d5a3d036314 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:51.797576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfab3e3-bff3-4205-8097-0d5a3d036314 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:51.798038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfab3e3-bff3-4205-8097-0d5a3d036314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:51.822919 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1785/3592] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:51.826566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c523a54-9e14-4316-9bbc-0dba187ea59e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:51.846899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5cfab3e3-bff3-4205-8097-0d5a3d036314 None None] MFA Rules not processed for user `ad564476e1cf4a0b87fef4e3d08e6726`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:51.847867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c523a54-9e14-4316-9bbc-0dba187ea59e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:51.848659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5cfab3e3-bff3-4205-8097-0d5a3d036314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:51.861090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae778042-b22f-4ea2-8f2b-c1cd458337a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:51.861801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae778042-b22f-4ea2-8f2b-c1cd458337a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:51.862101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae778042-b22f-4ea2-8f2b-c1cd458337a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:51.862411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae778042-b22f-4ea2-8f2b-c1cd458337a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:51.867286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae778042-b22f-4ea2-8f2b-c1cd458337a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:51.872268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae778042-b22f-4ea2-8f2b-c1cd458337a6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:51.907768 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1786/3593] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:51 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:51.917707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae778042-b22f-4ea2-8f2b-c1cd458337a6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:51.924051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ae778042-b22f-4ea2-8f2b-c1cd458337a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:51.959975 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1808/3594] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:51 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:51.975232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfab3e3-bff3-4205-8097-0d5a3d036314 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:51.994571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfab3e3-bff3-4205-8097-0d5a3d036314 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:52.000110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5ca00-5a30-4255-b889-c2565bff3f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:52.000765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5ca00-5a30-4255-b889-c2565bff3f28 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:52.001054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5ca00-5a30-4255-b889-c2565bff3f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:52.001336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5ca00-5a30-4255-b889-c2565bff3f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:52.002374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5ca00-5a30-4255-b889-c2565bff3f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:52.004087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5ca00-5a30-4255-b889-c2565bff3f28 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:52.022917 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1809/3595] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:51 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:52.024528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb31aa-23e0-43c6-8d99-c91291191bda None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:52.024910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb31aa-23e0-43c6-8d99-c91291191bda None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:52.025194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb31aa-23e0-43c6-8d99-c91291191bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:52.047478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-abbb31aa-23e0-43c6-8d99-c91291191bda None None] MFA Rules not processed for user `ad564476e1cf4a0b87fef4e3d08e6726`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:52.048719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-abbb31aa-23e0-43c6-8d99-c91291191bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:52.055636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae778042-b22f-4ea2-8f2b-c1cd458337a6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:52.057752 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1810/3596] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:52 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:52.058700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb31aa-23e0-43c6-8d99-c91291191bda None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:52.065921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f4a88-26f9-40ce-b021-46ba8c7a5e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:52.066707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f4a88-26f9-40ce-b021-46ba8c7a5e9c service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:52.066999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f4a88-26f9-40ce-b021-46ba8c7a5e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:52.067416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f4a88-26f9-40ce-b021-46ba8c7a5e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:52.082750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f4a88-26f9-40ce-b021-46ba8c7a5e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:52.084633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f4a88-26f9-40ce-b021-46ba8c7a5e9c service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:52.086415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb31aa-23e0-43c6-8d99-c91291191bda None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:52.091593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630b9e0-8a2f-4d73-add4-9f16a8eba6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:52.092489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630b9e0-8a2f-4d73-add4-9f16a8eba6b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:52.092777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630b9e0-8a2f-4d73-add4-9f16a8eba6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:52.093061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630b9e0-8a2f-4d73-add4-9f16a8eba6b6 admin admin] PATH_INFO: `/v3/projects/8efd6d0e0ed74857b4b6265fdacc68cc/users/0ee5b92caab2431f97702541033df654/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:52.110583 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1787/3597] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:52.111492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f4a88-26f9-40ce-b021-46ba8c7a5e9c service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:52.117221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c72f4a88-26f9-40ce-b021-46ba8c7a5e9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:52.118683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630b9e0-8a2f-4d73-add4-9f16a8eba6b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8efd6d0e0ed74857b4b6265fdacc68cc, user_id=0ee5b92caab2431f97702541033df654, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:52.121949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630b9e0-8a2f-4d73-add4-9f16a8eba6b6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:52.144046 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1811/3598] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:53:52 2021] PUT /identity/v3/projects/8efd6d0e0ed74857b4b6265fdacc68cc/users/0ee5b92caab2431f97702541033df654/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:52.150540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ccb51-d692-4672-9389-405d24e90d81 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:52.151798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ccb51-d692-4672-9389-405d24e90d81 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:52.151798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ccb51-d692-4672-9389-405d24e90d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:52.213346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fa9ccb51-d692-4672-9389-405d24e90d81 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:52.215719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fa9ccb51-d692-4672-9389-405d24e90d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:52.234018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f4a88-26f9-40ce-b021-46ba8c7a5e9c service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:52.336300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db93fc5-09ce-4c33-9cff-80cf9dc8318f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:52.337308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db93fc5-09ce-4c33-9cff-80cf9dc8318f service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:52.337678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db93fc5-09ce-4c33-9cff-80cf9dc8318f service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:52.338337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db93fc5-09ce-4c33-9cff-80cf9dc8318f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:52.358797 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1812/3599] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:52.374480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ccb51-d692-4672-9389-405d24e90d81 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:52.497362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ccb51-d692-4672-9389-405d24e90d81 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:52.506434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2cc0f-7400-45fb-bdc6-a12cc88fa58a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:52.507246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2cc0f-7400-45fb-bdc6-a12cc88fa58a service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:52.507630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2cc0f-7400-45fb-bdc6-a12cc88fa58a service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:52.508030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2cc0f-7400-45fb-bdc6-a12cc88fa58a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:52.526995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2cc0f-7400-45fb-bdc6-a12cc88fa58a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:52.528570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2cc0f-7400-45fb-bdc6-a12cc88fa58a service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:52.535925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db93fc5-09ce-4c33-9cff-80cf9dc8318f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:52.543921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db93fc5-09ce-4c33-9cff-80cf9dc8318f service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:52.552740 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1813/3600] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:52.584603 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1788/3601] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:53:52 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:53:54.504325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c35e8-2c4a-4364-81a2-9d9265014617 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:54.504886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c35e8-2c4a-4364-81a2-9d9265014617 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:54.504886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c35e8-2c4a-4364-81a2-9d9265014617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:54.584774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-986c35e8-2c4a-4364-81a2-9d9265014617 None None] MFA Rules not processed for user `fcb16838e32542a3a7eeedf9c5fde393`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:54.586514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-986c35e8-2c4a-4364-81a2-9d9265014617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:54.765477 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1814/3602] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:54 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:53:54.770052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db93fc5-09ce-4c33-9cff-80cf9dc8318f service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:54.810426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db93fc5-09ce-4c33-9cff-80cf9dc8318f service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:54.840730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdd08a-08b8-4e7b-add9-406af33ecc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:54.841411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdd08a-08b8-4e7b-add9-406af33ecc33 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:54.841707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdd08a-08b8-4e7b-add9-406af33ecc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:54.841993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdd08a-08b8-4e7b-add9-406af33ecc33 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:54.850145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdd08a-08b8-4e7b-add9-406af33ecc33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:54.863848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdd08a-08b8-4e7b-add9-406af33ecc33 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:54.967980 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1789/3603] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:53:54 2021] POST /identity/v3/projects => generated 403 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:54.972957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c35e8-2c4a-4364-81a2-9d9265014617 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:54.997357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c35e8-2c4a-4364-81a2-9d9265014617 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:55.256015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86194570-214c-45d1-9223-995d5d2e7401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:55.257217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86194570-214c-45d1-9223-995d5d2e7401 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:55.257803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86194570-214c-45d1-9223-995d5d2e7401 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:55.259577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86194570-214c-45d1-9223-995d5d2e7401 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:55.260811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86194570-214c-45d1-9223-995d5d2e7401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:55.268166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86194570-214c-45d1-9223-995d5d2e7401 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:55.319593 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1815/3604] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:53:54 2021] POST /identity/v3/users => generated 308 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:53:55.331026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdd08a-08b8-4e7b-add9-406af33ecc33 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:55.352515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdd08a-08b8-4e7b-add9-406af33ecc33 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:55.367933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd091fcf-f037-4ecd-8471-04ce6d7128a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:55.369293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd091fcf-f037-4ecd-8471-04ce6d7128a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:55.369692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd091fcf-f037-4ecd-8471-04ce6d7128a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:55.370127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd091fcf-f037-4ecd-8471-04ce6d7128a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:55.371025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd091fcf-f037-4ecd-8471-04ce6d7128a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:55.376841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd091fcf-f037-4ecd-8471-04ce6d7128a5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:55.444763 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1790/3605] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:55 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:55.448834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86194570-214c-45d1-9223-995d5d2e7401 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:55.471441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86194570-214c-45d1-9223-995d5d2e7401 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:55.498058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63131821-4fc1-4319-8a06-31f34a0393a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:55.498999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63131821-4fc1-4319-8a06-31f34a0393a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:55.499306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63131821-4fc1-4319-8a06-31f34a0393a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:55.499646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63131821-4fc1-4319-8a06-31f34a0393a8 admin admin] PATH_INFO: `/v3/projects/e4f15ceefec749f28ffe7196f07be860/users/13e154b816e24ba8a77cf6bf08af73ad/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:55.551177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63131821-4fc1-4319-8a06-31f34a0393a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4f15ceefec749f28ffe7196f07be860, user_id=13e154b816e24ba8a77cf6bf08af73ad, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:55.577747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63131821-4fc1-4319-8a06-31f34a0393a8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:55.609644 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1816/3606] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:53:55 2021] PUT /identity/v3/projects/e4f15ceefec749f28ffe7196f07be860/users/13e154b816e24ba8a77cf6bf08af73ad/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:55.613315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd091fcf-f037-4ecd-8471-04ce6d7128a5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:55.628003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd091fcf-f037-4ecd-8471-04ce6d7128a5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:55.848456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76197b62-73b1-4d36-bf83-064ec006584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:55.854769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76197b62-73b1-4d36-bf83-064ec006584b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:55.855818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76197b62-73b1-4d36-bf83-064ec006584b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:55.856812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76197b62-73b1-4d36-bf83-064ec006584b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:55.858427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76197b62-73b1-4d36-bf83-064ec006584b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:55.860574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76197b62-73b1-4d36-bf83-064ec006584b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:55.894409 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1791/3607] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:53:55 2021] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:53:55.894929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63131821-4fc1-4319-8a06-31f34a0393a8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:53:55.917435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63131821-4fc1-4319-8a06-31f34a0393a8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:53:55.928643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b18d54-b953-428d-8884-ca3a15a43206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:53:55.929853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b18d54-b953-428d-8884-ca3a15a43206 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:55.930365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b18d54-b953-428d-8884-ca3a15a43206 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:55.930687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b18d54-b953-428d-8884-ca3a15a43206 admin admin] PATH_INFO: `/v3/projects/e4f15ceefec749f28ffe7196f07be860/users/13e154b816e24ba8a77cf6bf08af73ad/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:55.932882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b18d54-b953-428d-8884-ca3a15a43206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4f15ceefec749f28ffe7196f07be860, user_id=13e154b816e24ba8a77cf6bf08af73ad, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:53:55.940082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b18d54-b953-428d-8884-ca3a15a43206 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:53:55.965909 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1817/3608] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:53:55 2021] PUT /identity/v3/projects/e4f15ceefec749f28ffe7196f07be860/users/13e154b816e24ba8a77cf6bf08af73ad/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:53:58.833409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf785d07-57bd-4000-a415-485c5d08f779 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:53:58.833997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf785d07-57bd-4000-a415-485c5d08f779 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:53:58.834205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf785d07-57bd-4000-a415-485c5d08f779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:53:58.927034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-bf785d07-57bd-4000-a415-485c5d08f779 None None] MFA Rules not processed for user `13e154b816e24ba8a77cf6bf08af73ad`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:53:58.931106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bf785d07-57bd-4000-a415-485c5d08f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:53:59.223317 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1792/3609] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:53:58 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:04.234588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b18d54-b953-428d-8884-ca3a15a43206 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:04.237158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-15b18d54-b953-428d-8884-ca3a15a43206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:04.455500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b18d54-b953-428d-8884-ca3a15a43206 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:04.473475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8ecd5-3c9b-4e90-a90c-b5e92e13f985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:04.491385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8ecd5-3c9b-4e90-a90c-b5e92e13f985 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:04.495558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8ecd5-3c9b-4e90-a90c-b5e92e13f985 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:04.497251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8ecd5-3c9b-4e90-a90c-b5e92e13f985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:04.500174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-eed8ecd5-3c9b-4e90-a90c-b5e92e13f985 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:04.535735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8ecd5-3c9b-4e90-a90c-b5e92e13f985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:04.537095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8ecd5-3c9b-4e90-a90c-b5e92e13f985 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:04.558736 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1818/3610] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:04 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:54:04.812308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beab0be-eb44-43cf-8dab-6ef7730504ea None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:04.813694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beab0be-eb44-43cf-8dab-6ef7730504ea None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:04.814281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beab0be-eb44-43cf-8dab-6ef7730504ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:04.884730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3beab0be-eb44-43cf-8dab-6ef7730504ea None None] MFA Rules not processed for user `0ee5b92caab2431f97702541033df654`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:04.886336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3beab0be-eb44-43cf-8dab-6ef7730504ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:05.136003 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1793/3611] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:04 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:05.295212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba2f96-97b9-4fa8-bbaf-c8a2b47ff2ea None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:05.296140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba2f96-97b9-4fa8-bbaf-c8a2b47ff2ea None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:05.297984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba2f96-97b9-4fa8-bbaf-c8a2b47ff2ea None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:05.303283 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1819/3612] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:54:05 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:54:05.323219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128a109-11a5-4f14-bf30-fffba5a96bf4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:05.323560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128a109-11a5-4f14-bf30-fffba5a96bf4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:05.323903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128a109-11a5-4f14-bf30-fffba5a96bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:05.374205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a128a109-11a5-4f14-bf30-fffba5a96bf4 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:05.383398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a128a109-11a5-4f14-bf30-fffba5a96bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:05.567079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba2f96-97b9-4fa8-bbaf-c8a2b47ff2ea None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:05.640104 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1794/3613] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:54:05 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:05.678977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128a109-11a5-4f14-bf30-fffba5a96bf4 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:05.680589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a128a109-11a5-4f14-bf30-fffba5a96bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:05.721031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128a109-11a5-4f14-bf30-fffba5a96bf4 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:05.737909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c4927-d550-4bf0-b4c7-7a1cdd3262e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:05.739548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c4927-d550-4bf0-b4c7-7a1cdd3262e9 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:05.740404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c4927-d550-4bf0-b4c7-7a1cdd3262e9 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:05.740716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c4927-d550-4bf0-b4c7-7a1cdd3262e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:05.772045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c4927-d550-4bf0-b4c7-7a1cdd3262e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:05.774206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c4927-d550-4bf0-b4c7-7a1cdd3262e9 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:05.808398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba2f96-97b9-4fa8-bbaf-c8a2b47ff2ea None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:05.833343 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1795/3614] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:05 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:54:05.834153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6597e-e34f-4ec2-bdf2-a5a82197d995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:05.835080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6597e-e34f-4ec2-bdf2-a5a82197d995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:05.835387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6597e-e34f-4ec2-bdf2-a5a82197d995 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:05.835670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6597e-e34f-4ec2-bdf2-a5a82197d995 admin admin] PATH_INFO: `/v3/users/fcb16838e32542a3a7eeedf9c5fde393` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:05.839118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c4927-d550-4bf0-b4c7-7a1cdd3262e9 service placement] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:05.840974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a99c4927-d550-4bf0-b4c7-7a1cdd3262e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:05.850024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6597e-e34f-4ec2-bdf2-a5a82197d995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb16838e32542a3a7eeedf9c5fde393)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:05.853768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6597e-e34f-4ec2-bdf2-a5a82197d995 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:06.027881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6da6597e-e34f-4ec2-bdf2-a5a82197d995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb16838e32542a3a7eeedf9c5fde393'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:06.038804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6da6597e-e34f-4ec2-bdf2-a5a82197d995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb16838e32542a3a7eeedf9c5fde393'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:06.039697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6da6597e-e34f-4ec2-bdf2-a5a82197d995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb16838e32542a3a7eeedf9c5fde393'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:06.062878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6da6597e-e34f-4ec2-bdf2-a5a82197d995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb16838e32542a3a7eeedf9c5fde393'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:06.075512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6da6597e-e34f-4ec2-bdf2-a5a82197d995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb16838e32542a3a7eeedf9c5fde393'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:06.080302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c4927-d550-4bf0-b4c7-7a1cdd3262e9 service placement] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:06.097210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4bff5-e2f1-44d7-abef-987b3225eea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:06.097993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4bff5-e2f1-44d7-abef-987b3225eea7 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:06.098334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4bff5-e2f1-44d7-abef-987b3225eea7 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:06.098668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4bff5-e2f1-44d7-abef-987b3225eea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:06.109613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eee4bff5-e2f1-44d7-abef-987b3225eea7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:06.112366 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1820/3615] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:54:05 2021] DELETE /identity/v3/users/fcb16838e32542a3a7eeedf9c5fde393 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:06.129635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4bff5-e2f1-44d7-abef-987b3225eea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:06.131687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4bff5-e2f1-44d7-abef-987b3225eea7 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:06.144930 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1796/3616] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:05 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:54:08.795435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6597e-e34f-4ec2-bdf2-a5a82197d995 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:08.797880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6da6597e-e34f-4ec2-bdf2-a5a82197d995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:08.983317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6597e-e34f-4ec2-bdf2-a5a82197d995 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:08.990805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f8dc4-ce57-4066-b450-c1c619982053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:08.992052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f8dc4-ce57-4066-b450-c1c619982053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:08.993221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f8dc4-ce57-4066-b450-c1c619982053 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:08.993756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f8dc4-ce57-4066-b450-c1c619982053 admin admin] PATH_INFO: `/v3/projects/8ea04e2bc8a847c6b805251f862536af` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:08.995280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f8dc4-ce57-4066-b450-c1c619982053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea04e2bc8a847c6b805251f862536af)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:08.999700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f8dc4-ce57-4066-b450-c1c619982053 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:09.173335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f18f8dc4-ce57-4066-b450-c1c619982053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea04e2bc8a847c6b805251f862536af', 'request_id': 'req-f18f8dc4-ce57-4066-b450-c1c619982053'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:09.192039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f18f8dc4-ce57-4066-b450-c1c619982053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea04e2bc8a847c6b805251f862536af', 'request_id': 'req-f18f8dc4-ce57-4066-b450-c1c619982053'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:09.209935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f18f8dc4-ce57-4066-b450-c1c619982053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea04e2bc8a847c6b805251f862536af', 'request_id': 'req-f18f8dc4-ce57-4066-b450-c1c619982053'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:09.240889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f18f8dc4-ce57-4066-b450-c1c619982053 admin admin] The token cache is being invalidate because project 8ea04e2bc8a847c6b805251f862536af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:54:09.241273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f18f8dc4-ce57-4066-b450-c1c619982053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:09.246650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f18f8dc4-ce57-4066-b450-c1c619982053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:09.258940 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1821/3617] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:08 2021] DELETE /identity/v3/projects/8ea04e2bc8a847c6b805251f862536af => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:09.262684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4bff5-e2f1-44d7-abef-987b3225eea7 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:09.280405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4bff5-e2f1-44d7-abef-987b3225eea7 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:09.474388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1c58f-d569-4aa0-963a-1e108d06ed3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:09.475018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1c58f-d569-4aa0-963a-1e108d06ed3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:09.475321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1c58f-d569-4aa0-963a-1e108d06ed3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:09.475620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1c58f-d569-4aa0-963a-1e108d06ed3c admin admin] PATH_INFO: `/v3/users/13e154b816e24ba8a77cf6bf08af73ad` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:09.478111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1c58f-d569-4aa0-963a-1e108d06ed3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=13e154b816e24ba8a77cf6bf08af73ad)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:09.489053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1c58f-d569-4aa0-963a-1e108d06ed3c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:09.636194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bed1c58f-d569-4aa0-963a-1e108d06ed3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13e154b816e24ba8a77cf6bf08af73ad'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:09.658411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bed1c58f-d569-4aa0-963a-1e108d06ed3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13e154b816e24ba8a77cf6bf08af73ad'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:09.679323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bed1c58f-d569-4aa0-963a-1e108d06ed3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13e154b816e24ba8a77cf6bf08af73ad'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:09.691506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bed1c58f-d569-4aa0-963a-1e108d06ed3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13e154b816e24ba8a77cf6bf08af73ad'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:09.710379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bed1c58f-d569-4aa0-963a-1e108d06ed3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13e154b816e24ba8a77cf6bf08af73ad'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:09.733210 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1797/3618] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:54:09 2021] DELETE /identity/v3/users/13e154b816e24ba8a77cf6bf08af73ad => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:54:10.670158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f8dc4-ce57-4066-b450-c1c619982053 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:10.671820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f18f8dc4-ce57-4066-b450-c1c619982053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:10.716786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f8dc4-ce57-4066-b450-c1c619982053 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:10.826374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87aef08-cb7a-474b-a7a2-3e3a6ef7c004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:10.828231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87aef08-cb7a-474b-a7a2-3e3a6ef7c004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:10.828685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87aef08-cb7a-474b-a7a2-3e3a6ef7c004 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:10.829205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87aef08-cb7a-474b-a7a2-3e3a6ef7c004 admin admin] PATH_INFO: `/v3/projects/e4f15ceefec749f28ffe7196f07be860` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:10.834620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87aef08-cb7a-474b-a7a2-3e3a6ef7c004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4f15ceefec749f28ffe7196f07be860)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:10.837734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87aef08-cb7a-474b-a7a2-3e3a6ef7c004 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:10.938935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e87aef08-cb7a-474b-a7a2-3e3a6ef7c004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4f15ceefec749f28ffe7196f07be860', 'request_id': 'req-e87aef08-cb7a-474b-a7a2-3e3a6ef7c004'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:10.968064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e87aef08-cb7a-474b-a7a2-3e3a6ef7c004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4f15ceefec749f28ffe7196f07be860', 'request_id': 'req-e87aef08-cb7a-474b-a7a2-3e3a6ef7c004'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:10.984490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e87aef08-cb7a-474b-a7a2-3e3a6ef7c004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4f15ceefec749f28ffe7196f07be860', 'request_id': 'req-e87aef08-cb7a-474b-a7a2-3e3a6ef7c004'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:11.013717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e87aef08-cb7a-474b-a7a2-3e3a6ef7c004 admin admin] The token cache is being invalidate because project e4f15ceefec749f28ffe7196f07be860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:54:11.014374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e87aef08-cb7a-474b-a7a2-3e3a6ef7c004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:11.015650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e87aef08-cb7a-474b-a7a2-3e3a6ef7c004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:11.020100 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1822/3619] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:10 2021] DELETE /identity/v3/projects/e4f15ceefec749f28ffe7196f07be860 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:11.025577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2db9b2-d66d-4f81-a0ad-aaa0a0be0ff8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:11.026140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2db9b2-d66d-4f81-a0ad-aaa0a0be0ff8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:11.026140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2db9b2-d66d-4f81-a0ad-aaa0a0be0ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:11.053212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9f2db9b2-d66d-4f81-a0ad-aaa0a0be0ff8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:11.056000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9f2db9b2-d66d-4f81-a0ad-aaa0a0be0ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:11.420141 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1798/3620] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:11.431240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad7e46-d28c-41a9-a03a-3c43663d2bf9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:11.433408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad7e46-d28c-41a9-a03a-3c43663d2bf9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:11.433735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad7e46-d28c-41a9-a03a-3c43663d2bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:11.493800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6bad7e46-d28c-41a9-a03a-3c43663d2bf9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:11.496249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6bad7e46-d28c-41a9-a03a-3c43663d2bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:11.514434 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1823/3621] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:11.517068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2db9b2-d66d-4f81-a0ad-aaa0a0be0ff8 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:11.533575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2db9b2-d66d-4f81-a0ad-aaa0a0be0ff8 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:11.557777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187bfe9-886f-4b6e-beac-651ad90890f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:11.558537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187bfe9-886f-4b6e-beac-651ad90890f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:11.558995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187bfe9-886f-4b6e-beac-651ad90890f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:11.559416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187bfe9-886f-4b6e-beac-651ad90890f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:11.560195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187bfe9-886f-4b6e-beac-651ad90890f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:54:11.560645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187bfe9-886f-4b6e-beac-651ad90890f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:11.562504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187bfe9-886f-4b6e-beac-651ad90890f3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:11.612132 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1799/3622] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:54:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:54:11.616436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad7e46-d28c-41a9-a03a-3c43663d2bf9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:11.629688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad7e46-d28c-41a9-a03a-3c43663d2bf9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:11.648717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653092c-ddb9-487b-b083-12055fae240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:11.649335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653092c-ddb9-487b-b083-12055fae240a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:11.651680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653092c-ddb9-487b-b083-12055fae240a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:11.651975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653092c-ddb9-487b-b083-12055fae240a admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:11.654026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653092c-ddb9-487b-b083-12055fae240a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:11.662860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653092c-ddb9-487b-b083-12055fae240a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:11.757810 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1824/3623] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:54:11 2021] POST /identity/v3/projects => generated 361 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:54:11.759284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187bfe9-886f-4b6e-beac-651ad90890f3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:11.779110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187bfe9-886f-4b6e-beac-651ad90890f3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:11.923160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954ae1d-86c8-4bd2-8bad-547324db7061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:11.925123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954ae1d-86c8-4bd2-8bad-547324db7061 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:11.925404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954ae1d-86c8-4bd2-8bad-547324db7061 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:11.925730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954ae1d-86c8-4bd2-8bad-547324db7061 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:11.927631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954ae1d-86c8-4bd2-8bad-547324db7061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:11.929500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954ae1d-86c8-4bd2-8bad-547324db7061 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:11.979428 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1800/3624] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:54:11 2021] POST /identity/v3/users => generated 281 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:54:11.983240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653092c-ddb9-487b-b083-12055fae240a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:11.997144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653092c-ddb9-487b-b083-12055fae240a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:12.027685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadff87c-1bc2-4399-a0c5-36b4965ab72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:12.032388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadff87c-1bc2-4399-a0c5-36b4965ab72f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:12.033162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadff87c-1bc2-4399-a0c5-36b4965ab72f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:12.033162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadff87c-1bc2-4399-a0c5-36b4965ab72f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:12.037564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadff87c-1bc2-4399-a0c5-36b4965ab72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:12.043704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadff87c-1bc2-4399-a0c5-36b4965ab72f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:12.115163 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1825/3625] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:11 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:54:12.118743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954ae1d-86c8-4bd2-8bad-547324db7061 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:12.135027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954ae1d-86c8-4bd2-8bad-547324db7061 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:12.153285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980f93e-adc6-4950-aa66-246a7bd147e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:12.154289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980f93e-adc6-4950-aa66-246a7bd147e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:12.157038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980f93e-adc6-4950-aa66-246a7bd147e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:12.158552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980f93e-adc6-4950-aa66-246a7bd147e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:12.160904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980f93e-adc6-4950-aa66-246a7bd147e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:12.167259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980f93e-adc6-4950-aa66-246a7bd147e7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:12.203766 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1801/3626] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:12 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:54:12.205011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadff87c-1bc2-4399-a0c5-36b4965ab72f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:12.219962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadff87c-1bc2-4399-a0c5-36b4965ab72f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:12.242139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f0cf6-b55c-4b4b-81b8-7c9cfffc843e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:12.248406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f0cf6-b55c-4b4b-81b8-7c9cfffc843e admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:12.251282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f0cf6-b55c-4b4b-81b8-7c9cfffc843e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:12.251702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f0cf6-b55c-4b4b-81b8-7c9cfffc843e admin admin] PATH_INFO: `/v3/projects/7bdce0291eff4201843a5ae27068d47e/users/8661dcb9ce8c47aca0e55af87f4adeb7/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:12.312810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f0cf6-b55c-4b4b-81b8-7c9cfffc843e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bdce0291eff4201843a5ae27068d47e, user_id=8661dcb9ce8c47aca0e55af87f4adeb7, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:12.336691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f0cf6-b55c-4b4b-81b8-7c9cfffc843e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:12.396860 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1826/3627] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:54:12 2021] PUT /identity/v3/projects/7bdce0291eff4201843a5ae27068d47e/users/8661dcb9ce8c47aca0e55af87f4adeb7/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:12.407794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeae475-ecad-4d6e-8e35-e16a7079bd86 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:12.408227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeae475-ecad-4d6e-8e35-e16a7079bd86 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:12.408582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeae475-ecad-4d6e-8e35-e16a7079bd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:12.499512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7aeae475-ecad-4d6e-8e35-e16a7079bd86 None None] MFA Rules not processed for user `8661dcb9ce8c47aca0e55af87f4adeb7`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:12.500763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7aeae475-ecad-4d6e-8e35-e16a7079bd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:12.640233 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1802/3628] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:12 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:54:12.644913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f0cf6-b55c-4b4b-81b8-7c9cfffc843e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:12.801928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f0cf6-b55c-4b4b-81b8-7c9cfffc843e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:12.827913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254253d-03a7-4cb2-b1c7-1e6556ba8377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:12.828457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254253d-03a7-4cb2-b1c7-1e6556ba8377 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:12.828747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254253d-03a7-4cb2-b1c7-1e6556ba8377 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:12.829156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254253d-03a7-4cb2-b1c7-1e6556ba8377 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:12.839305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254253d-03a7-4cb2-b1c7-1e6556ba8377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:12.846316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254253d-03a7-4cb2-b1c7-1e6556ba8377 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:12.943659 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1827/3629] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:54:12 2021] POST /identity/v3/projects => generated 359 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:54:12.948676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeae475-ecad-4d6e-8e35-e16a7079bd86 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:12.963580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeae475-ecad-4d6e-8e35-e16a7079bd86 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:13.098135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52555ae0-5fbd-4f76-896b-fe12b2730ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:13.099008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52555ae0-5fbd-4f76-896b-fe12b2730ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:13.099300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52555ae0-5fbd-4f76-896b-fe12b2730ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:13.099811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52555ae0-5fbd-4f76-896b-fe12b2730ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:13.100722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52555ae0-5fbd-4f76-896b-fe12b2730ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:13.105377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52555ae0-5fbd-4f76-896b-fe12b2730ff5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:13.152644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254253d-03a7-4cb2-b1c7-1e6556ba8377 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:13.158205 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1803/3630] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:54:12 2021] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:54:13.185536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254253d-03a7-4cb2-b1c7-1e6556ba8377 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:13.192587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436a8e2-8539-4951-8b49-15aebc7f8efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:13.193558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436a8e2-8539-4951-8b49-15aebc7f8efb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:13.194120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436a8e2-8539-4951-8b49-15aebc7f8efb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:13.195966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436a8e2-8539-4951-8b49-15aebc7f8efb admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:13.197189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436a8e2-8539-4951-8b49-15aebc7f8efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:13.199229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436a8e2-8539-4951-8b49-15aebc7f8efb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:13.236969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52555ae0-5fbd-4f76-896b-fe12b2730ff5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:13.250658 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1828/3631] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:13 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:54:13.254730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52555ae0-5fbd-4f76-896b-fe12b2730ff5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:13.269287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12767c4b-5d34-474e-bab3-4d68b0b464a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:13.272635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12767c4b-5d34-474e-bab3-4d68b0b464a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:13.273166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12767c4b-5d34-474e-bab3-4d68b0b464a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:13.273728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12767c4b-5d34-474e-bab3-4d68b0b464a3 admin admin] PATH_INFO: `/v3/projects/3ffea93572a9481ea4cee0eec425aabe/users/96b39d49ddcc47e2b7ba459bd3f1740d/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:13.410795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12767c4b-5d34-474e-bab3-4d68b0b464a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ffea93572a9481ea4cee0eec425aabe, user_id=96b39d49ddcc47e2b7ba459bd3f1740d, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:13.425889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12767c4b-5d34-474e-bab3-4d68b0b464a3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:13.497007 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1804/3632] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:54:13 2021] PUT /identity/v3/projects/3ffea93572a9481ea4cee0eec425aabe/users/96b39d49ddcc47e2b7ba459bd3f1740d/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:13.500575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436a8e2-8539-4951-8b49-15aebc7f8efb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:13.518162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436a8e2-8539-4951-8b49-15aebc7f8efb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:13.683609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5d3be-bc79-44ca-9dba-3c3a075bf2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:13.684721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5d3be-bc79-44ca-9dba-3c3a075bf2cd admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:13.685193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5d3be-bc79-44ca-9dba-3c3a075bf2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:13.685816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5d3be-bc79-44ca-9dba-3c3a075bf2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:13.687266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5d3be-bc79-44ca-9dba-3c3a075bf2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:13.692534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5d3be-bc79-44ca-9dba-3c3a075bf2cd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:13.722224 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1829/3633] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:13 2021] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:54:13.725704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12767c4b-5d34-474e-bab3-4d68b0b464a3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:13.754790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12767c4b-5d34-474e-bab3-4d68b0b464a3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:13.788132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30feb7-d38b-46b1-b1b6-49654e271aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:13.794827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30feb7-d38b-46b1-b1b6-49654e271aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:13.795521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30feb7-d38b-46b1-b1b6-49654e271aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:13.796051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30feb7-d38b-46b1-b1b6-49654e271aa2 admin admin] PATH_INFO: `/v3/projects/3ffea93572a9481ea4cee0eec425aabe/users/96b39d49ddcc47e2b7ba459bd3f1740d/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:13.803533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30feb7-d38b-46b1-b1b6-49654e271aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ffea93572a9481ea4cee0eec425aabe, user_id=96b39d49ddcc47e2b7ba459bd3f1740d, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:13.813104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30feb7-d38b-46b1-b1b6-49654e271aa2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:13.874532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b11f39-3912-4539-aa80-81b0377e47fb None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:13.875119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b11f39-3912-4539-aa80-81b0377e47fb None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:13.875386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b11f39-3912-4539-aa80-81b0377e47fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:13.876995 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1805/3634] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:54:13 2021] PUT /identity/v3/projects/3ffea93572a9481ea4cee0eec425aabe/users/96b39d49ddcc47e2b7ba459bd3f1740d/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:13.910518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30feb7-d38b-46b1-b1b6-49654e271aa2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:13.914756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6e30feb7-d38b-46b1-b1b6-49654e271aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:13.996992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c8b11f39-3912-4539-aa80-81b0377e47fb None None] MFA Rules not processed for user `96b39d49ddcc47e2b7ba459bd3f1740d`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:13.998404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c8b11f39-3912-4539-aa80-81b0377e47fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:14.122619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30feb7-d38b-46b1-b1b6-49654e271aa2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:14.137403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff4719-da30-486d-8d7e-5698969a0177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:14.138775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff4719-da30-486d-8d7e-5698969a0177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:14.139232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff4719-da30-486d-8d7e-5698969a0177 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:14.139698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff4719-da30-486d-8d7e-5698969a0177 admin admin] PATH_INFO: `/v3/users/ca309394563d45ea9b911c14c5f7625f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:14.143049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff4719-da30-486d-8d7e-5698969a0177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca309394563d45ea9b911c14c5f7625f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:14.147493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff4719-da30-486d-8d7e-5698969a0177 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:14.267614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9cff4719-da30-486d-8d7e-5698969a0177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca309394563d45ea9b911c14c5f7625f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:14.291815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9cff4719-da30-486d-8d7e-5698969a0177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca309394563d45ea9b911c14c5f7625f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:14.319458 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1830/3635] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:13 2021] POST /identity/v3/auth/tokens => generated 3293 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:14.328147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9cff4719-da30-486d-8d7e-5698969a0177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca309394563d45ea9b911c14c5f7625f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:14.330216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9cff4719-da30-486d-8d7e-5698969a0177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca309394563d45ea9b911c14c5f7625f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:14.332962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b11f39-3912-4539-aa80-81b0377e47fb None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:14.334989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c8b11f39-3912-4539-aa80-81b0377e47fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:14.351757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9cff4719-da30-486d-8d7e-5698969a0177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca309394563d45ea9b911c14c5f7625f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:14.367692 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1806/3636] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:54:13 2021] DELETE /identity/v3/users/ca309394563d45ea9b911c14c5f7625f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:14.369599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba9e10-8166-4258-a90e-e7042729c4fc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:14.369900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba9e10-8166-4258-a90e-e7042729c4fc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:14.370187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba9e10-8166-4258-a90e-e7042729c4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:14.414969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ddba9e10-8166-4258-a90e-e7042729c4fc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:14.416266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ddba9e10-8166-4258-a90e-e7042729c4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:14.545854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b11f39-3912-4539-aa80-81b0377e47fb None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:14.661228 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1807/3637] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:14.719885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba9e10-8166-4258-a90e-e7042729c4fc None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:14.722278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ddba9e10-8166-4258-a90e-e7042729c4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:14.738169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ea2b3-9ca3-4946-be49-856661bed3d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:14.738169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ea2b3-9ca3-4946-be49-856661bed3d2 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:14.738409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ea2b3-9ca3-4946-be49-856661bed3d2 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:14.738575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ea2b3-9ca3-4946-be49-856661bed3d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:14.748549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-364ea2b3-9ca3-4946-be49-856661bed3d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:14.866533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba9e10-8166-4258-a90e-e7042729c4fc None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:14.880159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa42fe6-b51c-4129-be13-9ddc07584444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:14.880850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa42fe6-b51c-4129-be13-9ddc07584444 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:14.883128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa42fe6-b51c-4129-be13-9ddc07584444 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:14.883499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa42fe6-b51c-4129-be13-9ddc07584444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:14.909861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa42fe6-b51c-4129-be13-9ddc07584444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:14.915872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa42fe6-b51c-4129-be13-9ddc07584444 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:14.944052 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1808/3638] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:54:15.131237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ea2b3-9ca3-4946-be49-856661bed3d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:15.136902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ea2b3-9ca3-4946-be49-856661bed3d2 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:15.161986 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1831/3639] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:14 2021] GET /identity/v3/auth/tokens => generated 3293 bytes in 829 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:54:15.741296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63680e3-6bbf-443d-a215-93711a986b30 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:15.741765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63680e3-6bbf-443d-a215-93711a986b30 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:15.741882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63680e3-6bbf-443d-a215-93711a986b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:15.799047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a63680e3-6bbf-443d-a215-93711a986b30 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:15.802867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a63680e3-6bbf-443d-a215-93711a986b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:15.864228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ea2b3-9ca3-4946-be49-856661bed3d2 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:15.866621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-364ea2b3-9ca3-4946-be49-856661bed3d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:15.907508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ea2b3-9ca3-4946-be49-856661bed3d2 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:15.942971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a86b3-4f83-49f1-8f89-f901a617e2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:15.946659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a86b3-4f83-49f1-8f89-f901a617e2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:15.949582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a86b3-4f83-49f1-8f89-f901a617e2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:15.951928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a86b3-4f83-49f1-8f89-f901a617e2a9 admin admin] PATH_INFO: `/v3/projects/09f464a0dbea408cb3f43c2c96bdaaac` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:15.960706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a86b3-4f83-49f1-8f89-f901a617e2a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f464a0dbea408cb3f43c2c96bdaaac)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:15.966951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a86b3-4f83-49f1-8f89-f901a617e2a9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:16.068619 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1809/3640] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:54:15 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:16.086034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63680e3-6bbf-443d-a215-93711a986b30 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:16.088513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a63680e3-6bbf-443d-a215-93711a986b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:16.167099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba2a86b3-4f83-49f1-8f89-f901a617e2a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f464a0dbea408cb3f43c2c96bdaaac', 'request_id': 'req-ba2a86b3-4f83-49f1-8f89-f901a617e2a9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:16.184112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba2a86b3-4f83-49f1-8f89-f901a617e2a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f464a0dbea408cb3f43c2c96bdaaac', 'request_id': 'req-ba2a86b3-4f83-49f1-8f89-f901a617e2a9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:16.201330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba2a86b3-4f83-49f1-8f89-f901a617e2a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f464a0dbea408cb3f43c2c96bdaaac', 'request_id': 'req-ba2a86b3-4f83-49f1-8f89-f901a617e2a9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:16.216017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba2a86b3-4f83-49f1-8f89-f901a617e2a9 admin admin] The token cache is being invalidate because project 09f464a0dbea408cb3f43c2c96bdaaac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:54:16.216307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba2a86b3-4f83-49f1-8f89-f901a617e2a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:16.217191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba2a86b3-4f83-49f1-8f89-f901a617e2a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:16.220808 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1832/3641] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:15 2021] DELETE /identity/v3/projects/09f464a0dbea408cb3f43c2c96bdaaac => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:54:16.222310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4bcac-ea35-44db-b2d8-7d6755166f39 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:16.222971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4bcac-ea35-44db-b2d8-7d6755166f39 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:16.223360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4bcac-ea35-44db-b2d8-7d6755166f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:16.238558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63680e3-6bbf-443d-a215-93711a986b30 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:16.255212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-cfa4bcac-ea35-44db-b2d8-7d6755166f39 None None] MFA Rules not processed for user `0ee5b92caab2431f97702541033df654`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:16.257566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cfa4bcac-ea35-44db-b2d8-7d6755166f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:16.362365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7934c-9e27-4b31-a2b8-69ceecc882e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:16.363063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7934c-9e27-4b31-a2b8-69ceecc882e3 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:16.363348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7934c-9e27-4b31-a2b8-69ceecc882e3 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:16.363629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7934c-9e27-4b31-a2b8-69ceecc882e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:16.365570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-01f7934c-9e27-4b31-a2b8-69ceecc882e3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:16.426375 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1833/3642] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:16 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:16.426375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4bcac-ea35-44db-b2d8-7d6755166f39 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:16.431759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cfa4bcac-ea35-44db-b2d8-7d6755166f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:16.504893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7934c-9e27-4b31-a2b8-69ceecc882e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:16.513242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7934c-9e27-4b31-a2b8-69ceecc882e3 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:16.534423 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1810/3643] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:54:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:54:16.536776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7934c-9e27-4b31-a2b8-69ceecc882e3 service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:16.538382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4bcac-ea35-44db-b2d8-7d6755166f39 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:16.541121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-01f7934c-9e27-4b31-a2b8-69ceecc882e3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:16.546577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a730294-f3e2-4910-a736-4b6a00a082ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:16.548672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a730294-f3e2-4910-a736-4b6a00a082ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:16.549172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a730294-f3e2-4910-a736-4b6a00a082ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:16.549549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a730294-f3e2-4910-a736-4b6a00a082ec admin admin] PATH_INFO: `/v3/users/3ed71cb735fd4bb1802b5ee2f937c40d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:16.551309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a730294-f3e2-4910-a736-4b6a00a082ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed71cb735fd4bb1802b5ee2f937c40d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:16.553663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a730294-f3e2-4910-a736-4b6a00a082ec admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:16.564238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7934c-9e27-4b31-a2b8-69ceecc882e3 service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:16.575006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cc166-a19f-4c52-8ee8-30d2c6647541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:16.576251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cc166-a19f-4c52-8ee8-30d2c6647541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:16.576546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cc166-a19f-4c52-8ee8-30d2c6647541 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:16.577170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cc166-a19f-4c52-8ee8-30d2c6647541 admin admin] PATH_INFO: `/v3/users/8661dcb9ce8c47aca0e55af87f4adeb7` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:16.578411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7cc166-a19f-4c52-8ee8-30d2c6647541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8661dcb9ce8c47aca0e55af87f4adeb7)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:16.580767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7cc166-a19f-4c52-8ee8-30d2c6647541 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:16.688421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4a730294-f3e2-4910-a736-4b6a00a082ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed71cb735fd4bb1802b5ee2f937c40d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:16.707354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5f7cc166-a19f-4c52-8ee8-30d2c6647541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8661dcb9ce8c47aca0e55af87f4adeb7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:16.719290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4a730294-f3e2-4910-a736-4b6a00a082ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed71cb735fd4bb1802b5ee2f937c40d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:16.720053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4a730294-f3e2-4910-a736-4b6a00a082ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed71cb735fd4bb1802b5ee2f937c40d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:16.748827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4a730294-f3e2-4910-a736-4b6a00a082ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed71cb735fd4bb1802b5ee2f937c40d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:16.758570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5f7cc166-a19f-4c52-8ee8-30d2c6647541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8661dcb9ce8c47aca0e55af87f4adeb7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:16.779921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4a730294-f3e2-4910-a736-4b6a00a082ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed71cb735fd4bb1802b5ee2f937c40d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:16.788018 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1834/3644] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:54:16 2021] DELETE /identity/v3/users/3ed71cb735fd4bb1802b5ee2f937c40d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:16.789744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a730294-f3e2-4910-a736-4b6a00a082ec admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:16.807574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5f7cc166-a19f-4c52-8ee8-30d2c6647541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8661dcb9ce8c47aca0e55af87f4adeb7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:16.808402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5f7cc166-a19f-4c52-8ee8-30d2c6647541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8661dcb9ce8c47aca0e55af87f4adeb7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:16.808904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4a730294-f3e2-4910-a736-4b6a00a082ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:16.860926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5f7cc166-a19f-4c52-8ee8-30d2c6647541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8661dcb9ce8c47aca0e55af87f4adeb7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:16.891311 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1811/3645] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:54:16 2021] DELETE /identity/v3/users/8661dcb9ce8c47aca0e55af87f4adeb7 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:16.901060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0142b15-30aa-4040-9af6-61bdf1da7c94 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:16.902203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0142b15-30aa-4040-9af6-61bdf1da7c94 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:16.903368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0142b15-30aa-4040-9af6-61bdf1da7c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:16.968798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a730294-f3e2-4910-a736-4b6a00a082ec admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:16.986925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d0142b15-30aa-4040-9af6-61bdf1da7c94 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:16.991694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d0142b15-30aa-4040-9af6-61bdf1da7c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:17.116884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0036b2-878a-4292-b7f3-a71d28a9b24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:17.118199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0036b2-878a-4292-b7f3-a71d28a9b24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:17.118806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0036b2-878a-4292-b7f3-a71d28a9b24f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:17.119061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0036b2-878a-4292-b7f3-a71d28a9b24f admin admin] PATH_INFO: `/v3/users/91814ecd4d6e44efab348dca4f35878c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:17.121758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0036b2-878a-4292-b7f3-a71d28a9b24f admin admin] RBAC: Authorizing `identity:delete_user(user_id=91814ecd4d6e44efab348dca4f35878c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:17.123905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0036b2-878a-4292-b7f3-a71d28a9b24f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:17.183418 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1812/3646] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:17.194405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0142b15-30aa-4040-9af6-61bdf1da7c94 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:17.199293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d0142b15-30aa-4040-9af6-61bdf1da7c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:17.226473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2d0036b2-878a-4292-b7f3-a71d28a9b24f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91814ecd4d6e44efab348dca4f35878c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:17.251861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2d0036b2-878a-4292-b7f3-a71d28a9b24f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91814ecd4d6e44efab348dca4f35878c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:17.253872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2d0036b2-878a-4292-b7f3-a71d28a9b24f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91814ecd4d6e44efab348dca4f35878c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:17.305632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2d0036b2-878a-4292-b7f3-a71d28a9b24f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91814ecd4d6e44efab348dca4f35878c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:17.313478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2d0036b2-878a-4292-b7f3-a71d28a9b24f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91814ecd4d6e44efab348dca4f35878c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:17.323242 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1835/3647] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:54:16 2021] DELETE /identity/v3/users/91814ecd4d6e44efab348dca4f35878c => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:17.324583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0036b2-878a-4292-b7f3-a71d28a9b24f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:17.326622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2d0036b2-878a-4292-b7f3-a71d28a9b24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:17.381186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0142b15-30aa-4040-9af6-61bdf1da7c94 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:17.427149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0036b2-878a-4292-b7f3-a71d28a9b24f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:17.436507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b11b9c-98ac-464e-95a6-01ede2a5f5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:17.437647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b11b9c-98ac-464e-95a6-01ede2a5f5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:17.438000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b11b9c-98ac-464e-95a6-01ede2a5f5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:17.438301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b11b9c-98ac-464e-95a6-01ede2a5f5e8 admin admin] PATH_INFO: `/v3/projects/c48df72b525b42219b13f6145223684e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:17.441734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b11b9c-98ac-464e-95a6-01ede2a5f5e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48df72b525b42219b13f6145223684e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:17.444183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b11b9c-98ac-464e-95a6-01ede2a5f5e8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:17.453513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a6b53-03d7-4797-8f9b-addf91b32b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:17.453513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a6b53-03d7-4797-8f9b-addf91b32b35 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:17.453513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a6b53-03d7-4797-8f9b-addf91b32b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:17.453513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a6b53-03d7-4797-8f9b-addf91b32b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:17.455695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-853a6b53-03d7-4797-8f9b-addf91b32b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:17.470945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a6b53-03d7-4797-8f9b-addf91b32b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:17.472377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a6b53-03d7-4797-8f9b-addf91b32b35 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:17.483389 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1813/3648] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:54:17.497749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b08c7e-cc88-4c2a-8803-0921f98505fb None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:17.498333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b08c7e-cc88-4c2a-8803-0921f98505fb None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:17.498641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b08c7e-cc88-4c2a-8803-0921f98505fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:17.527205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6b11b9c-98ac-464e-95a6-01ede2a5f5e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48df72b525b42219b13f6145223684e', 'request_id': 'req-c6b11b9c-98ac-464e-95a6-01ede2a5f5e8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:17.536020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6b11b9c-98ac-464e-95a6-01ede2a5f5e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48df72b525b42219b13f6145223684e', 'request_id': 'req-c6b11b9c-98ac-464e-95a6-01ede2a5f5e8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:17.547135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6b11b9c-98ac-464e-95a6-01ede2a5f5e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48df72b525b42219b13f6145223684e', 'request_id': 'req-c6b11b9c-98ac-464e-95a6-01ede2a5f5e8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:17.547709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-95b08c7e-cc88-4c2a-8803-0921f98505fb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:17.552648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-95b08c7e-cc88-4c2a-8803-0921f98505fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:17.562593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6b11b9c-98ac-464e-95a6-01ede2a5f5e8 admin admin] The token cache is being invalidate because project c48df72b525b42219b13f6145223684e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:54:17.562901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6b11b9c-98ac-464e-95a6-01ede2a5f5e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:17.563585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6b11b9c-98ac-464e-95a6-01ede2a5f5e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:17.567469 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1836/3649] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:17 2021] DELETE /identity/v3/projects/c48df72b525b42219b13f6145223684e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:17.576388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf9d88-6422-4ad7-83a1-206a8cd8a382 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:17.576676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf9d88-6422-4ad7-83a1-206a8cd8a382 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:17.576959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf9d88-6422-4ad7-83a1-206a8cd8a382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:17.628592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-eccf9d88-6422-4ad7-83a1-206a8cd8a382 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:17.629816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-eccf9d88-6422-4ad7-83a1-206a8cd8a382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:17.654980 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1814/3650] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:17.677864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b08c7e-cc88-4c2a-8803-0921f98505fb None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:17.682447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-95b08c7e-cc88-4c2a-8803-0921f98505fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:17.737127 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1837/3651] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:17.745148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb70dd-6a32-4220-90bc-781f64118b64 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:17.745444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb70dd-6a32-4220-90bc-781f64118b64 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:17.745719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb70dd-6a32-4220-90bc-781f64118b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:17.771296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e1cb70dd-6a32-4220-90bc-781f64118b64 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:17.772384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e1cb70dd-6a32-4220-90bc-781f64118b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:17.790160 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1838/3652] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:17.792041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb70dd-6a32-4220-90bc-781f64118b64 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:17.806632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb70dd-6a32-4220-90bc-781f64118b64 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:17.829655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f718752-1356-4fbf-900b-5fd1ab17aceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:17.836385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b08c7e-cc88-4c2a-8803-0921f98505fb None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:17.840081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f718752-1356-4fbf-900b-5fd1ab17aceb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:17.840822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f718752-1356-4fbf-900b-5fd1ab17aceb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:17.841889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f718752-1356-4fbf-900b-5fd1ab17aceb admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:17.843034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f718752-1356-4fbf-900b-5fd1ab17aceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:54:17.843682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f718752-1356-4fbf-900b-5fd1ab17aceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:17.845335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f718752-1356-4fbf-900b-5fd1ab17aceb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:17.847477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa57ca0-b01b-42b6-92f1-c58f3adbf6ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:17.854097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa57ca0-b01b-42b6-92f1-c58f3adbf6ce service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:17.854732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa57ca0-b01b-42b6-92f1-c58f3adbf6ce service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:17.855241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa57ca0-b01b-42b6-92f1-c58f3adbf6ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:17.867853 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1839/3653] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:54:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:54:17.871828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f718752-1356-4fbf-900b-5fd1ab17aceb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:17.885238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f718752-1356-4fbf-900b-5fd1ab17aceb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:17.885620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa57ca0-b01b-42b6-92f1-c58f3adbf6ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:17.889349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa57ca0-b01b-42b6-92f1-c58f3adbf6ce service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:17.894564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8279b-5b54-4692-9fb1-a42e8f14117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:17.897711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8279b-5b54-4692-9fb1-a42e8f14117d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:17.898148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8279b-5b54-4692-9fb1-a42e8f14117d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:17.898921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8279b-5b54-4692-9fb1-a42e8f14117d admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:17.899652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8279b-5b54-4692-9fb1-a42e8f14117d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:17.901577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8279b-5b54-4692-9fb1-a42e8f14117d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:17.906933 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1815/3654] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:54:17.936509 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1840/3655] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:54:17 2021] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:54:17.940951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa57ca0-b01b-42b6-92f1-c58f3adbf6ce service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:17.956181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa57ca0-b01b-42b6-92f1-c58f3adbf6ce service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:18.058218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedfe74-94f8-45ae-b452-8dbb7c4b18a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:18.059651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedfe74-94f8-45ae-b452-8dbb7c4b18a9 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:18.060003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedfe74-94f8-45ae-b452-8dbb7c4b18a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:18.060319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedfe74-94f8-45ae-b452-8dbb7c4b18a9 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:18.061447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedfe74-94f8-45ae-b452-8dbb7c4b18a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:18.064176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedfe74-94f8-45ae-b452-8dbb7c4b18a9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:18.072467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8279b-5b54-4692-9fb1-a42e8f14117d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:18.077462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-acb8279b-5b54-4692-9fb1-a42e8f14117d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:18.094545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8279b-5b54-4692-9fb1-a42e8f14117d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:18.099555 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1816/3656] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:54:17 2021] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:54:18.101393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedfe74-94f8-45ae-b452-8dbb7c4b18a9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:18.105472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e7e69-3b66-480e-b993-80da399f603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:18.107253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e7e69-3b66-480e-b993-80da399f603e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:18.107598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e7e69-3b66-480e-b993-80da399f603e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:18.108136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e7e69-3b66-480e-b993-80da399f603e admin admin] PATH_INFO: `/v3/projects/7bdce0291eff4201843a5ae27068d47e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:18.110396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e7e69-3b66-480e-b993-80da399f603e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bdce0291eff4201843a5ae27068d47e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:18.112578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e7e69-3b66-480e-b993-80da399f603e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:18.133944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedfe74-94f8-45ae-b452-8dbb7c4b18a9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:18.145512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef8567-31fb-415e-ad57-0e35058fffcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:18.146885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef8567-31fb-415e-ad57-0e35058fffcb admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:18.147283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef8567-31fb-415e-ad57-0e35058fffcb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:18.147617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef8567-31fb-415e-ad57-0e35058fffcb admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:18.149057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef8567-31fb-415e-ad57-0e35058fffcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:18.151037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef8567-31fb-415e-ad57-0e35058fffcb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:18.172969 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1817/3657] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:18 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:54:18.178148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef8567-31fb-415e-ad57-0e35058fffcb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:18.215612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef8567-31fb-415e-ad57-0e35058fffcb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:18.252589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8d3e7e69-3b66-480e-b993-80da399f603e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bdce0291eff4201843a5ae27068d47e', 'request_id': 'req-8d3e7e69-3b66-480e-b993-80da399f603e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:18.272415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8d3e7e69-3b66-480e-b993-80da399f603e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bdce0291eff4201843a5ae27068d47e', 'request_id': 'req-8d3e7e69-3b66-480e-b993-80da399f603e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:18.287003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8d3e7e69-3b66-480e-b993-80da399f603e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bdce0291eff4201843a5ae27068d47e', 'request_id': 'req-8d3e7e69-3b66-480e-b993-80da399f603e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:18.309739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8d3e7e69-3b66-480e-b993-80da399f603e admin admin] The token cache is being invalidate because project 7bdce0291eff4201843a5ae27068d47e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:54:18.312503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8d3e7e69-3b66-480e-b993-80da399f603e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:18.314088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8d3e7e69-3b66-480e-b993-80da399f603e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:18.316199 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1841/3658] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:18 2021] DELETE /identity/v3/projects/7bdce0291eff4201843a5ae27068d47e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:18.318515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e7e69-3b66-480e-b993-80da399f603e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:18.321853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8d3e7e69-3b66-480e-b993-80da399f603e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:18.343166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b38e9-dc44-415c-baaa-2579cdd6d002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:18.345104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b38e9-dc44-415c-baaa-2579cdd6d002 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:18.347082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b38e9-dc44-415c-baaa-2579cdd6d002 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:18.347396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b38e9-dc44-415c-baaa-2579cdd6d002 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:18.348202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b38e9-dc44-415c-baaa-2579cdd6d002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:18.350897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b38e9-dc44-415c-baaa-2579cdd6d002 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:18.375175 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1818/3659] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:18 2021] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:54:18.387180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9457d6-4842-4636-acf3-89177000ecf0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:18.387180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9457d6-4842-4636-acf3-89177000ecf0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:18.387180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9457d6-4842-4636-acf3-89177000ecf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:18.412350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ca9457d6-4842-4636-acf3-89177000ecf0 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:18.418518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ca9457d6-4842-4636-acf3-89177000ecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:18.424495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e7e69-3b66-480e-b993-80da399f603e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:18.429600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52038cf-7378-46f1-88e3-89198033d727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:18.430572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52038cf-7378-46f1-88e3-89198033d727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:18.430862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52038cf-7378-46f1-88e3-89198033d727 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:18.431143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52038cf-7378-46f1-88e3-89198033d727 admin admin] PATH_INFO: `/v3/projects/76b2df85c79f4fb198e8337010cb606b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:18.432914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52038cf-7378-46f1-88e3-89198033d727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b2df85c79f4fb198e8337010cb606b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:18.434296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52038cf-7378-46f1-88e3-89198033d727 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:18.498709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a52038cf-7378-46f1-88e3-89198033d727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b2df85c79f4fb198e8337010cb606b', 'request_id': 'req-a52038cf-7378-46f1-88e3-89198033d727'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:18.505567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a52038cf-7378-46f1-88e3-89198033d727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b2df85c79f4fb198e8337010cb606b', 'request_id': 'req-a52038cf-7378-46f1-88e3-89198033d727'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:18.513693 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1819/3660] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:54:18 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:18.514728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9457d6-4842-4636-acf3-89177000ecf0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:18.516422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ca9457d6-4842-4636-acf3-89177000ecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:18.517598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a52038cf-7378-46f1-88e3-89198033d727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b2df85c79f4fb198e8337010cb606b', 'request_id': 'req-a52038cf-7378-46f1-88e3-89198033d727'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:18.533575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9457d6-4842-4636-acf3-89177000ecf0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:18.535629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a52038cf-7378-46f1-88e3-89198033d727 admin admin] The token cache is being invalidate because project 76b2df85c79f4fb198e8337010cb606b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:54:18.536879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a52038cf-7378-46f1-88e3-89198033d727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:18.537790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a52038cf-7378-46f1-88e3-89198033d727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:18.545159 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1842/3661] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:18 2021] DELETE /identity/v3/projects/76b2df85c79f4fb198e8337010cb606b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:18.546318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52038cf-7378-46f1-88e3-89198033d727 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:18.549468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a52038cf-7378-46f1-88e3-89198033d727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:18.622314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557676bc-0cc3-4d86-aa01-73375b8f227a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:18.623353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557676bc-0cc3-4d86-aa01-73375b8f227a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:18.623718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557676bc-0cc3-4d86-aa01-73375b8f227a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:18.624107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557676bc-0cc3-4d86-aa01-73375b8f227a admin admin] PATH_INFO: `/v3/users/96b39d49ddcc47e2b7ba459bd3f1740d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:18.625580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557676bc-0cc3-4d86-aa01-73375b8f227a admin admin] RBAC: Authorizing `identity:delete_user(user_id=96b39d49ddcc47e2b7ba459bd3f1740d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:18.628019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557676bc-0cc3-4d86-aa01-73375b8f227a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:18.657959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52038cf-7378-46f1-88e3-89198033d727 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:18.664173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79d535-e7fb-42b5-a138-81d3b0122631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:18.665085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79d535-e7fb-42b5-a138-81d3b0122631 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:18.665348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79d535-e7fb-42b5-a138-81d3b0122631 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:18.665629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79d535-e7fb-42b5-a138-81d3b0122631 admin admin] PATH_INFO: `/v3/projects/c0137551df8b4152946bfeeb726bec69/users/cdb721e9b80b4c70b1c2b234bfb5f3ef/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:18.683127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79d535-e7fb-42b5-a138-81d3b0122631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0137551df8b4152946bfeeb726bec69, user_id=cdb721e9b80b4c70b1c2b234bfb5f3ef, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:18.685806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79d535-e7fb-42b5-a138-81d3b0122631 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:18.689404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-557676bc-0cc3-4d86-aa01-73375b8f227a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96b39d49ddcc47e2b7ba459bd3f1740d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:18.698573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-557676bc-0cc3-4d86-aa01-73375b8f227a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96b39d49ddcc47e2b7ba459bd3f1740d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:18.704727 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1843/3662] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:54:18 2021] PUT /identity/v3/projects/c0137551df8b4152946bfeeb726bec69/users/cdb721e9b80b4c70b1c2b234bfb5f3ef/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:18.705279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79d535-e7fb-42b5-a138-81d3b0122631 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:18.706877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3a79d535-e7fb-42b5-a138-81d3b0122631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:18.714702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-557676bc-0cc3-4d86-aa01-73375b8f227a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96b39d49ddcc47e2b7ba459bd3f1740d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:18.719082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-557676bc-0cc3-4d86-aa01-73375b8f227a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96b39d49ddcc47e2b7ba459bd3f1740d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:18.730596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-557676bc-0cc3-4d86-aa01-73375b8f227a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96b39d49ddcc47e2b7ba459bd3f1740d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:18.742739 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1820/3663] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:54:18 2021] DELETE /identity/v3/users/96b39d49ddcc47e2b7ba459bd3f1740d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:18.744978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5cb3b-f6a2-4541-b132-386bee7d9dbe None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:18.745385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5cb3b-f6a2-4541-b132-386bee7d9dbe None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:18.745790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5cb3b-f6a2-4541-b132-386bee7d9dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:18.771532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-47d5cb3b-f6a2-4541-b132-386bee7d9dbe None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:18.773055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-47d5cb3b-f6a2-4541-b132-386bee7d9dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:18.824981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79d535-e7fb-42b5-a138-81d3b0122631 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:18.850106 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1821/3664] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:18.860843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5afcde-0b6f-404e-aee1-37ffe29bff44 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:18.861245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5afcde-0b6f-404e-aee1-37ffe29bff44 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:18.861632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5afcde-0b6f-404e-aee1-37ffe29bff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:18.896288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5b5afcde-0b6f-404e-aee1-37ffe29bff44 None None] MFA Rules not processed for user `cdb721e9b80b4c70b1c2b234bfb5f3ef`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:18.897681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5b5afcde-0b6f-404e-aee1-37ffe29bff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:18.904318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a95739-eb39-4796-919a-2fe7f3e0c1a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:18.904993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a95739-eb39-4796-919a-2fe7f3e0c1a9 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:18.905557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a95739-eb39-4796-919a-2fe7f3e0c1a9 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:18.905847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a95739-eb39-4796-919a-2fe7f3e0c1a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:18.907830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a3a95739-eb39-4796-919a-2fe7f3e0c1a9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:18.996046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a95739-eb39-4796-919a-2fe7f3e0c1a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:18.997969 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1822/3665] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:18 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:18.998514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a95739-eb39-4796-919a-2fe7f3e0c1a9 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:18.999845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03785d-d7f4-4771-a662-8d6ba2bc7b0b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:19.000245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03785d-d7f4-4771-a662-8d6ba2bc7b0b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:19.000630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03785d-d7f4-4771-a662-8d6ba2bc7b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:19.018338 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1844/3666] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:54:18 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:54:19.019012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a95739-eb39-4796-919a-2fe7f3e0c1a9 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:19.020497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a3a95739-eb39-4796-919a-2fe7f3e0c1a9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:19.083564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-cc03785d-d7f4-4771-a662-8d6ba2bc7b0b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:19.085783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cc03785d-d7f4-4771-a662-8d6ba2bc7b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:19.120835 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1823/3667] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:19.124973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03785d-d7f4-4771-a662-8d6ba2bc7b0b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:19.127874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a95739-eb39-4796-919a-2fe7f3e0c1a9 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:19.133480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68609bf-0d86-4c41-8ea9-eb13ca63fccf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:19.133769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68609bf-0d86-4c41-8ea9-eb13ca63fccf service glance] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:19.134006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68609bf-0d86-4c41-8ea9-eb13ca63fccf service glance] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:19.134311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68609bf-0d86-4c41-8ea9-eb13ca63fccf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:19.143984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03785d-d7f4-4771-a662-8d6ba2bc7b0b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:19.147231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68609bf-0d86-4c41-8ea9-eb13ca63fccf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:19.149003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68609bf-0d86-4c41-8ea9-eb13ca63fccf service glance] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:19.152714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dd2c3-0c96-4ddf-831a-ca9a51e964ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:19.153430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dd2c3-0c96-4ddf-831a-ca9a51e964ce admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:19.153677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dd2c3-0c96-4ddf-831a-ca9a51e964ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:19.153950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dd2c3-0c96-4ddf-831a-ca9a51e964ce admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:19.154806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010dd2c3-0c96-4ddf-831a-ca9a51e964ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:54:19.155148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010dd2c3-0c96-4ddf-831a-ca9a51e964ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:19.158840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010dd2c3-0c96-4ddf-831a-ca9a51e964ce admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:19.161205 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1845/3668] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:19 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:54:19.204565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68609bf-0d86-4c41-8ea9-eb13ca63fccf service glance] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:19.210011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f68609bf-0d86-4c41-8ea9-eb13ca63fccf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:19.220054 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1824/3669] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:54:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:54:19.221545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dd2c3-0c96-4ddf-831a-ca9a51e964ce admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:19.254197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dd2c3-0c96-4ddf-831a-ca9a51e964ce admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:19.265238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68609bf-0d86-4c41-8ea9-eb13ca63fccf service glance] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:19.270354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0792f-4d49-4f23-bc35-ccb0c2a4f9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:19.271139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0792f-4d49-4f23-bc35-ccb0c2a4f9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:19.271485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0792f-4d49-4f23-bc35-ccb0c2a4f9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:19.271992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0792f-4d49-4f23-bc35-ccb0c2a4f9c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:19.272581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0792f-4d49-4f23-bc35-ccb0c2a4f9c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:19.276414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0792f-4d49-4f23-bc35-ccb0c2a4f9c7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:19.278941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffa45b-a966-4db6-89c9-1e588f8bca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:19.279970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffa45b-a966-4db6-89c9-1e588f8bca8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:19.280280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffa45b-a966-4db6-89c9-1e588f8bca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:19.280550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffa45b-a966-4db6-89c9-1e588f8bca8f admin admin] PATH_INFO: `/v3/projects/3ffea93572a9481ea4cee0eec425aabe` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:19.282514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffa45b-a966-4db6-89c9-1e588f8bca8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ffea93572a9481ea4cee0eec425aabe)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:19.286280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffa45b-a966-4db6-89c9-1e588f8bca8f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:19.342027 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1825/3670] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:54:19 2021] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:54:19.347512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0792f-4d49-4f23-bc35-ccb0c2a4f9c7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:19.386944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6ffa45b-a966-4db6-89c9-1e588f8bca8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ffea93572a9481ea4cee0eec425aabe', 'request_id': 'req-c6ffa45b-a966-4db6-89c9-1e588f8bca8f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:19.408031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6ffa45b-a966-4db6-89c9-1e588f8bca8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ffea93572a9481ea4cee0eec425aabe', 'request_id': 'req-c6ffa45b-a966-4db6-89c9-1e588f8bca8f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:19.434595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6ffa45b-a966-4db6-89c9-1e588f8bca8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ffea93572a9481ea4cee0eec425aabe', 'request_id': 'req-c6ffa45b-a966-4db6-89c9-1e588f8bca8f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:19.455929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6ffa45b-a966-4db6-89c9-1e588f8bca8f admin admin] The token cache is being invalidate because project 3ffea93572a9481ea4cee0eec425aabe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:54:19.456453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6ffa45b-a966-4db6-89c9-1e588f8bca8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:19.457347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6ffa45b-a966-4db6-89c9-1e588f8bca8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:19.466839 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1846/3671] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:19 2021] DELETE /identity/v3/projects/3ffea93572a9481ea4cee0eec425aabe => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:19.469236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f670d81-5dd9-4a92-b72d-884248d1135d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:19.469570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f670d81-5dd9-4a92-b72d-884248d1135d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:19.469901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f670d81-5dd9-4a92-b72d-884248d1135d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:19.508884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0f670d81-5dd9-4a92-b72d-884248d1135d None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:19.510241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0f670d81-5dd9-4a92-b72d-884248d1135d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:19.525160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0792f-4d49-4f23-bc35-ccb0c2a4f9c7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:19.595058 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1847/3672] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:54:19 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:19.595884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6119d6-c2f7-4362-b872-ea364b6ba3ca None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:19.596180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6119d6-c2f7-4362-b872-ea364b6ba3ca None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:19.596452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6119d6-c2f7-4362-b872-ea364b6ba3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:19.618290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ae6119d6-c2f7-4362-b872-ea364b6ba3ca None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:19.620753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ae6119d6-c2f7-4362-b872-ea364b6ba3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:19.621324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c83f0-2e87-4c2c-b6c0-0ab5200ab170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:19.622174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c83f0-2e87-4c2c-b6c0-0ab5200ab170 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:19.622352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c83f0-2e87-4c2c-b6c0-0ab5200ab170 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:19.622616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c83f0-2e87-4c2c-b6c0-0ab5200ab170 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:19.624064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c83f0-2e87-4c2c-b6c0-0ab5200ab170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:19.625620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c83f0-2e87-4c2c-b6c0-0ab5200ab170 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:19.629339 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1848/3673] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:19.637658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99423709-930d-4ee3-879c-722eb976a4a5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:19.638313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99423709-930d-4ee3-879c-722eb976a4a5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:19.638452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99423709-930d-4ee3-879c-722eb976a4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:19.649966 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1826/3674] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:54:19 2021] POST /identity/v3/users => generated 292 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:54:19.651517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c83f0-2e87-4c2c-b6c0-0ab5200ab170 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:19.654423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bb0c83f0-2e87-4c2c-b6c0-0ab5200ab170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:19.664706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-99423709-930d-4ee3-879c-722eb976a4a5 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:19.666543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-99423709-930d-4ee3-879c-722eb976a4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:19.676316 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1849/3675] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:54:19 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:19.677367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde4363-92e9-4f10-8d72-56f916fad428 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:19.677823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde4363-92e9-4f10-8d72-56f916fad428 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:19.678371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde4363-92e9-4f10-8d72-56f916fad428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:19.713019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2cde4363-92e9-4f10-8d72-56f916fad428 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:19.714285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2cde4363-92e9-4f10-8d72-56f916fad428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:19.730339 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1850/3676] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:19.731373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde4363-92e9-4f10-8d72-56f916fad428 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:19.737190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2cde4363-92e9-4f10-8d72-56f916fad428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:19.749960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde4363-92e9-4f10-8d72-56f916fad428 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:19.755497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d7492-17ee-44b4-94e0-60161c195826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:19.756253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d7492-17ee-44b4-94e0-60161c195826 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:19.756538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d7492-17ee-44b4-94e0-60161c195826 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:19.756822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d7492-17ee-44b4-94e0-60161c195826 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:19.757609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d7492-17ee-44b4-94e0-60161c195826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:19.759374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d7492-17ee-44b4-94e0-60161c195826 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:19.768052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c83f0-2e87-4c2c-b6c0-0ab5200ab170 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:19.774185 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1851/3677] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:19 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:54:19.776277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365a6cc-cf7f-44ae-afa3-74f399f46e42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:19.776742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d7492-17ee-44b4-94e0-60161c195826 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:19.777654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365a6cc-cf7f-44ae-afa3-74f399f46e42 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:19.778037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365a6cc-cf7f-44ae-afa3-74f399f46e42 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:19.778646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365a6cc-cf7f-44ae-afa3-74f399f46e42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:19.789733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365a6cc-cf7f-44ae-afa3-74f399f46e42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:19.792212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365a6cc-cf7f-44ae-afa3-74f399f46e42 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:19.794652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d7492-17ee-44b4-94e0-60161c195826 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:19.802151 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1827/3678] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:54:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:54:19.803202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365a6cc-cf7f-44ae-afa3-74f399f46e42 service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:19.818569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365a6cc-cf7f-44ae-afa3-74f399f46e42 service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:19.823163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39694e-b551-49e0-8fb0-b68caffaf792 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:19.824095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39694e-b551-49e0-8fb0-b68caffaf792 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:19.824469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39694e-b551-49e0-8fb0-b68caffaf792 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:19.825509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e026c-799e-4561-a1ae-4ab5cc60f023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:19.825765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39694e-b551-49e0-8fb0-b68caffaf792 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:19.826609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e026c-799e-4561-a1ae-4ab5cc60f023 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:19.826990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e026c-799e-4561-a1ae-4ab5cc60f023 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:19.827390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e026c-799e-4561-a1ae-4ab5cc60f023 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:19.828229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e026c-799e-4561-a1ae-4ab5cc60f023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:54:19.828676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e026c-799e-4561-a1ae-4ab5cc60f023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:19.830615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e026c-799e-4561-a1ae-4ab5cc60f023 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:19.847818 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1828/3679] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:54:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:54:19.849145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e026c-799e-4561-a1ae-4ab5cc60f023 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:19.863500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e026c-799e-4561-a1ae-4ab5cc60f023 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:19.868930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c13738-b77b-49d3-876e-e384d299f4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:19.869930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c13738-b77b-49d3-876e-e384d299f4ea admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:19.870473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c13738-b77b-49d3-876e-e384d299f4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:19.870967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c13738-b77b-49d3-876e-e384d299f4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:19.871921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c13738-b77b-49d3-876e-e384d299f4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:19.874022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c13738-b77b-49d3-876e-e384d299f4ea admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:19.878998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39694e-b551-49e0-8fb0-b68caffaf792 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:19.881338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39694e-b551-49e0-8fb0-b68caffaf792 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:19.890014 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1829/3680] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:19 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:54:19.892491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c13738-b77b-49d3-876e-e384d299f4ea admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:19.913961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c13738-b77b-49d3-876e-e384d299f4ea admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:19.920504 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1852/3681] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:54:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:54:19.925513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39694e-b551-49e0-8fb0-b68caffaf792 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:19.928157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d8761-fbca-4f1f-948c-021166413e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:19.929188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d8761-fbca-4f1f-948c-021166413e90 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:19.929816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d8761-fbca-4f1f-948c-021166413e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:19.930480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d8761-fbca-4f1f-948c-021166413e90 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:19.931947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d8761-fbca-4f1f-948c-021166413e90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:19.935222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d8761-fbca-4f1f-948c-021166413e90 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:19.964148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39694e-b551-49e0-8fb0-b68caffaf792 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:19.979046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83827434-acb6-43c5-ad37-a5057c310038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:19.983667 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1830/3682] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:54:19 2021] POST /identity/v3/projects => generated 395 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:54:19.983667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d8761-fbca-4f1f-948c-021166413e90 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:19.985886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fe1d8761-fbca-4f1f-948c-021166413e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:19.997148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83827434-acb6-43c5-ad37-a5057c310038 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:19.997448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83827434-acb6-43c5-ad37-a5057c310038 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:19.997840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83827434-acb6-43c5-ad37-a5057c310038 admin admin] PATH_INFO: `/v3/projects/8c26f38bcba94792a6ef9daa3c1f8bf3/users/aec1515c18534e8f9dc2e21d5f670ff3/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:20.042714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83827434-acb6-43c5-ad37-a5057c310038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c26f38bcba94792a6ef9daa3c1f8bf3, user_id=aec1515c18534e8f9dc2e21d5f670ff3, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:20.046585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83827434-acb6-43c5-ad37-a5057c310038 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:20.086976 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1853/3683] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:54:19 2021] PUT /identity/v3/projects/8c26f38bcba94792a6ef9daa3c1f8bf3/users/aec1515c18534e8f9dc2e21d5f670ff3/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:20.094717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83827434-acb6-43c5-ad37-a5057c310038 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:20.137206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d8761-fbca-4f1f-948c-021166413e90 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:20.248583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24140918-faad-43e5-9211-e9fadcc592b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:20.249521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24140918-faad-43e5-9211-e9fadcc592b7 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:20.250132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24140918-faad-43e5-9211-e9fadcc592b7 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:20.250817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24140918-faad-43e5-9211-e9fadcc592b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:20.253289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-24140918-faad-43e5-9211-e9fadcc592b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:20.270766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24140918-faad-43e5-9211-e9fadcc592b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:20.276115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24140918-faad-43e5-9211-e9fadcc592b7 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:20.296228 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1831/3684] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:19 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:54:20.297254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83827434-acb6-43c5-ad37-a5057c310038 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:20.298875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb48775-ba79-449c-87a7-6f547bc67637 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:20.299592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb48775-ba79-449c-87a7-6f547bc67637 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:20.300162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb48775-ba79-449c-87a7-6f547bc67637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:20.311399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12403bc2-8346-49f8-9161-2fa91bb2d829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:20.313129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12403bc2-8346-49f8-9161-2fa91bb2d829 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:20.313418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12403bc2-8346-49f8-9161-2fa91bb2d829 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:20.313701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12403bc2-8346-49f8-9161-2fa91bb2d829 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:20.315811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12403bc2-8346-49f8-9161-2fa91bb2d829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:20.319022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12403bc2-8346-49f8-9161-2fa91bb2d829 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:20.349626 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1854/3685] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:54:20 2021] POST /identity/v3/users => generated 298 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:54:20.357009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12403bc2-8346-49f8-9161-2fa91bb2d829 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:20.380242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12403bc2-8346-49f8-9161-2fa91bb2d829 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:20.384581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fcb48775-ba79-449c-87a7-6f547bc67637 None None] MFA Rules not processed for user `aec1515c18534e8f9dc2e21d5f670ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:20.387026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fcb48775-ba79-449c-87a7-6f547bc67637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:20.391331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40135274-dd4f-4f49-9d53-33cf2f58c931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:20.394230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40135274-dd4f-4f49-9d53-33cf2f58c931 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:20.396687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40135274-dd4f-4f49-9d53-33cf2f58c931 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:20.397132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40135274-dd4f-4f49-9d53-33cf2f58c931 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:20.398110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40135274-dd4f-4f49-9d53-33cf2f58c931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:20.402562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40135274-dd4f-4f49-9d53-33cf2f58c931 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:20.428636 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1855/3686] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:20 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:54:20.434415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40135274-dd4f-4f49-9d53-33cf2f58c931 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:20.456127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40135274-dd4f-4f49-9d53-33cf2f58c931 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:20.467457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab482d3-d251-40a0-a57b-e1aed4bc8106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:20.468135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab482d3-d251-40a0-a57b-e1aed4bc8106 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:20.469050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab482d3-d251-40a0-a57b-e1aed4bc8106 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:20.469050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab482d3-d251-40a0-a57b-e1aed4bc8106 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:20.469479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab482d3-d251-40a0-a57b-e1aed4bc8106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:20.475353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab482d3-d251-40a0-a57b-e1aed4bc8106 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:20.493588 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1856/3687] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:20 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:54:20.508751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab482d3-d251-40a0-a57b-e1aed4bc8106 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:20.538949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab482d3-d251-40a0-a57b-e1aed4bc8106 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:20.555709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f142c3-7eb4-415b-abe2-3f2efbb9c0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:20.557077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f142c3-7eb4-415b-abe2-3f2efbb9c0ae admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:20.557541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f142c3-7eb4-415b-abe2-3f2efbb9c0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:20.559019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f142c3-7eb4-415b-abe2-3f2efbb9c0ae admin admin] PATH_INFO: `/v3/projects/6af640d59dee48c59f1f191bc541829d/users/753e7daa3b814c789fd6451101113666/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:20.563558 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1832/3688] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:20 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:20.578100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb48775-ba79-449c-87a7-6f547bc67637 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:20.581389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fcb48775-ba79-449c-87a7-6f547bc67637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:20.599692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f142c3-7eb4-415b-abe2-3f2efbb9c0ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af640d59dee48c59f1f191bc541829d, user_id=753e7daa3b814c789fd6451101113666, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:20.604879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f142c3-7eb4-415b-abe2-3f2efbb9c0ae admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:20.649816 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1857/3689] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:54:20 2021] PUT /identity/v3/projects/6af640d59dee48c59f1f191bc541829d/users/753e7daa3b814c789fd6451101113666/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:20.670290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb48775-ba79-449c-87a7-6f547bc67637 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:20.670717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc3c4b-874a-4609-a644-69bd8fde3c63 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:20.673973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc3c4b-874a-4609-a644-69bd8fde3c63 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:20.674282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc3c4b-874a-4609-a644-69bd8fde3c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:20.796089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e016d-3c6d-44a7-b873-28830b64d037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:20.797342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e016d-3c6d-44a7-b873-28830b64d037 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:20.797810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e016d-3c6d-44a7-b873-28830b64d037 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:20.798265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e016d-3c6d-44a7-b873-28830b64d037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:20.815777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-56fc3c4b-874a-4609-a644-69bd8fde3c63 None None] MFA Rules not processed for user `753e7daa3b814c789fd6451101113666`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:20.817582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-56fc3c4b-874a-4609-a644-69bd8fde3c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:20.910692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e016d-3c6d-44a7-b873-28830b64d037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:20.913718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e016d-3c6d-44a7-b873-28830b64d037 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:20.925539 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1833/3690] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:20 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:54:21.004802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e016d-3c6d-44a7-b873-28830b64d037 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:21.006678 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1858/3691] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:20 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:21.165978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e016d-3c6d-44a7-b873-28830b64d037 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:21.177675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c66181-0d67-4f82-b6fc-e960e1a4678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:21.178832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c66181-0d67-4f82-b6fc-e960e1a4678a admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:21.179120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c66181-0d67-4f82-b6fc-e960e1a4678a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:21.180276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c66181-0d67-4f82-b6fc-e960e1a4678a admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:21.181009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c66181-0d67-4f82-b6fc-e960e1a4678a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:21.184130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c66181-0d67-4f82-b6fc-e960e1a4678a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:21.226046 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1834/3692] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:54:21 2021] POST /identity/v3/projects => generated 395 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:54:21.231353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc3c4b-874a-4609-a644-69bd8fde3c63 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:21.247321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc3c4b-874a-4609-a644-69bd8fde3c63 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:21.437146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e3588-51f1-49a8-9458-6e9f4d3457a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:21.437856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e3588-51f1-49a8-9458-6e9f4d3457a5 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:21.438110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e3588-51f1-49a8-9458-6e9f4d3457a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:21.438443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e3588-51f1-49a8-9458-6e9f4d3457a5 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:21.439288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e3588-51f1-49a8-9458-6e9f4d3457a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:21.441313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e3588-51f1-49a8-9458-6e9f4d3457a5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:21.488877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c66181-0d67-4f82-b6fc-e960e1a4678a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:21.501816 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1859/3693] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:54:21 2021] POST /identity/v3/users => generated 304 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:54:21.508691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e3588-51f1-49a8-9458-6e9f4d3457a5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:21.512824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c66181-0d67-4f82-b6fc-e960e1a4678a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:21.520349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56140fe5-9bdc-4fc1-8e1d-7fd4a93fd40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:21.521432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56140fe5-9bdc-4fc1-8e1d-7fd4a93fd40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:21.521803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56140fe5-9bdc-4fc1-8e1d-7fd4a93fd40f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:21.522147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56140fe5-9bdc-4fc1-8e1d-7fd4a93fd40f admin admin] PATH_INFO: `/v3/users/aec1515c18534e8f9dc2e21d5f670ff3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:21.523873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56140fe5-9bdc-4fc1-8e1d-7fd4a93fd40f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec1515c18534e8f9dc2e21d5f670ff3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:21.526462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56140fe5-9bdc-4fc1-8e1d-7fd4a93fd40f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:21.530999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e3588-51f1-49a8-9458-6e9f4d3457a5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:21.536854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c3fd0-1a5c-46c8-8a3f-242de2bd1cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:21.537181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c3fd0-1a5c-46c8-8a3f-242de2bd1cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:21.537466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c3fd0-1a5c-46c8-8a3f-242de2bd1cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:21.537744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c3fd0-1a5c-46c8-8a3f-242de2bd1cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:21.538612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c3fd0-1a5c-46c8-8a3f-242de2bd1cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:21.540799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c3fd0-1a5c-46c8-8a3f-242de2bd1cb6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:21.562783 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1860/3694] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:21 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:54:21.564517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c3fd0-1a5c-46c8-8a3f-242de2bd1cb6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:21.584762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c3fd0-1a5c-46c8-8a3f-242de2bd1cb6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:21.594990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-56140fe5-9bdc-4fc1-8e1d-7fd4a93fd40f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec1515c18534e8f9dc2e21d5f670ff3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:21.604016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2005a6-f9f9-40b7-b337-c54f61674824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:21.604992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2005a6-f9f9-40b7-b337-c54f61674824 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:21.605508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2005a6-f9f9-40b7-b337-c54f61674824 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:21.606133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-56140fe5-9bdc-4fc1-8e1d-7fd4a93fd40f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec1515c18534e8f9dc2e21d5f670ff3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:21.607619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2005a6-f9f9-40b7-b337-c54f61674824 admin admin] PATH_INFO: `/v3/projects/af2f2fadd9324bc08b19f434524b3bbf/users/f4db91e4589742c78d201d64fd6627c8/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:21.633296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-56140fe5-9bdc-4fc1-8e1d-7fd4a93fd40f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec1515c18534e8f9dc2e21d5f670ff3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:21.634084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-56140fe5-9bdc-4fc1-8e1d-7fd4a93fd40f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec1515c18534e8f9dc2e21d5f670ff3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:21.638244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2005a6-f9f9-40b7-b337-c54f61674824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2f2fadd9324bc08b19f434524b3bbf, user_id=f4db91e4589742c78d201d64fd6627c8, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:21.643375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2005a6-f9f9-40b7-b337-c54f61674824 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:21.650262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-56140fe5-9bdc-4fc1-8e1d-7fd4a93fd40f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec1515c18534e8f9dc2e21d5f670ff3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:21.661242 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1835/3695] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:54:21 2021] DELETE /identity/v3/users/aec1515c18534e8f9dc2e21d5f670ff3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:21.662749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfc9ce-2059-49ee-b880-68e20d254713 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:21.663041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfc9ce-2059-49ee-b880-68e20d254713 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:21.663323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfc9ce-2059-49ee-b880-68e20d254713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:21.675600 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1861/3696] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:54:21 2021] PUT /identity/v3/projects/af2f2fadd9324bc08b19f434524b3bbf/users/f4db91e4589742c78d201d64fd6627c8/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:21.680755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2005a6-f9f9-40b7-b337-c54f61674824 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:21.682978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bb2005a6-f9f9-40b7-b337-c54f61674824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:21.725179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-efcfc9ce-2059-49ee-b880-68e20d254713 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:21.727519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-efcfc9ce-2059-49ee-b880-68e20d254713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:21.818608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2005a6-f9f9-40b7-b337-c54f61674824 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:21.825276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5673812-946b-4990-bced-3273992a68b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:21.826137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5673812-946b-4990-bced-3273992a68b2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:21.826723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5673812-946b-4990-bced-3273992a68b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:21.827011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5673812-946b-4990-bced-3273992a68b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:21.829399 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1836/3697] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:54:21.837610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5673812-946b-4990-bced-3273992a68b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:21.839506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5673812-946b-4990-bced-3273992a68b2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:21.839702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfc9ce-2059-49ee-b880-68e20d254713 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:21.841666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-efcfc9ce-2059-49ee-b880-68e20d254713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:21.858616 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1862/3698] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:21 2021] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:54:21.859530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5673812-946b-4990-bced-3273992a68b2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:21.872821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5673812-946b-4990-bced-3273992a68b2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:21.880420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbc990-3ce3-4edf-8e87-fc33c26de409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:21.882341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbc990-3ce3-4edf-8e87-fc33c26de409 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:21.882675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbc990-3ce3-4edf-8e87-fc33c26de409 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:21.883030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbc990-3ce3-4edf-8e87-fc33c26de409 admin admin] PATH_INFO: `/v3/projects/af2f2fadd9324bc08b19f434524b3bbf/users/f4db91e4589742c78d201d64fd6627c8/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:21.885818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbc990-3ce3-4edf-8e87-fc33c26de409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2f2fadd9324bc08b19f434524b3bbf, user_id=f4db91e4589742c78d201d64fd6627c8, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:21.890425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbc990-3ce3-4edf-8e87-fc33c26de409 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:21.920228 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1863/3699] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:54:21 2021] PUT /identity/v3/projects/af2f2fadd9324bc08b19f434524b3bbf/users/f4db91e4589742c78d201d64fd6627c8/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:21.922839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9efdc4-d147-4170-90d2-a55453b62ec0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:21.923133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9efdc4-d147-4170-90d2-a55453b62ec0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:21.923601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9efdc4-d147-4170-90d2-a55453b62ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:21.966754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfc9ce-2059-49ee-b880-68e20d254713 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:21.977452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1d9efdc4-d147-4170-90d2-a55453b62ec0 None None] MFA Rules not processed for user `f4db91e4589742c78d201d64fd6627c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:21.980109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1d9efdc4-d147-4170-90d2-a55453b62ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:22.056436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019cd79-be4c-4121-90e5-9b73969496ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:22.057104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019cd79-be4c-4121-90e5-9b73969496ea service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:22.057390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019cd79-be4c-4121-90e5-9b73969496ea service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:22.057666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019cd79-be4c-4121-90e5-9b73969496ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:22.132412 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1864/3700] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:21 2021] POST /identity/v3/auth/tokens => generated 3329 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:22.142935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de78f-2ca5-4b4b-928d-57f25bbaa1c3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:22.143547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de78f-2ca5-4b4b-928d-57f25bbaa1c3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:22.144027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de78f-2ca5-4b4b-928d-57f25bbaa1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:22.191749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-268de78f-2ca5-4b4b-928d-57f25bbaa1c3 None None] MFA Rules not processed for user `753e7daa3b814c789fd6451101113666`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:22.194039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-268de78f-2ca5-4b4b-928d-57f25bbaa1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:22.244929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019cd79-be4c-4121-90e5-9b73969496ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:22.246551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019cd79-be4c-4121-90e5-9b73969496ea service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:22.259600 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1837/3701] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:54:22.297653 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1865/3702] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:22 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:54:22.658336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019cd79-be4c-4121-90e5-9b73969496ea service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:22.660034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c019cd79-be4c-4121-90e5-9b73969496ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:22.717594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268de78f-2ca5-4b4b-928d-57f25bbaa1c3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:22.720556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-268de78f-2ca5-4b4b-928d-57f25bbaa1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:22.757136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268de78f-2ca5-4b4b-928d-57f25bbaa1c3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:22.764730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770882b0-83a7-47f0-99b6-1f604f9470d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:22.766013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770882b0-83a7-47f0-99b6-1f604f9470d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:22.766319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770882b0-83a7-47f0-99b6-1f604f9470d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:22.766606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770882b0-83a7-47f0-99b6-1f604f9470d9 admin admin] PATH_INFO: `/v3/projects/8c26f38bcba94792a6ef9daa3c1f8bf3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:22.771074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770882b0-83a7-47f0-99b6-1f604f9470d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c26f38bcba94792a6ef9daa3c1f8bf3)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:22.773002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770882b0-83a7-47f0-99b6-1f604f9470d9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:22.785507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019cd79-be4c-4121-90e5-9b73969496ea service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:22.794214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8a622-398b-4a27-a5ce-fdd246aabca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:22.795075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8a622-398b-4a27-a5ce-fdd246aabca0 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:22.795664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8a622-398b-4a27-a5ce-fdd246aabca0 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:22.796169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8a622-398b-4a27-a5ce-fdd246aabca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:22.799489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-abe8a622-398b-4a27-a5ce-fdd246aabca0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:22.814068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8a622-398b-4a27-a5ce-fdd246aabca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:22.816607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8a622-398b-4a27-a5ce-fdd246aabca0 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:22.831226 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1838/3703] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:22 2021] GET /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:54:22.843933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-770882b0-83a7-47f0-99b6-1f604f9470d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c26f38bcba94792a6ef9daa3c1f8bf3', 'request_id': 'req-770882b0-83a7-47f0-99b6-1f604f9470d9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:22.854309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-770882b0-83a7-47f0-99b6-1f604f9470d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c26f38bcba94792a6ef9daa3c1f8bf3', 'request_id': 'req-770882b0-83a7-47f0-99b6-1f604f9470d9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:22.866545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-770882b0-83a7-47f0-99b6-1f604f9470d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c26f38bcba94792a6ef9daa3c1f8bf3', 'request_id': 'req-770882b0-83a7-47f0-99b6-1f604f9470d9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:22.881620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-770882b0-83a7-47f0-99b6-1f604f9470d9 admin admin] The token cache is being invalidate because project 8c26f38bcba94792a6ef9daa3c1f8bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:54:22.882050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-770882b0-83a7-47f0-99b6-1f604f9470d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:22.883596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-770882b0-83a7-47f0-99b6-1f604f9470d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:22.886736 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1866/3704] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:22 2021] DELETE /identity/v3/projects/8c26f38bcba94792a6ef9daa3c1f8bf3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:22.892087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d1a5b-6f3f-46c1-9090-16e028e4545a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:22.892561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d1a5b-6f3f-46c1-9090-16e028e4545a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:22.893012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d1a5b-6f3f-46c1-9090-16e028e4545a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:22.924699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-376d1a5b-6f3f-46c1-9090-16e028e4545a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:22.925905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-376d1a5b-6f3f-46c1-9090-16e028e4545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:23.020546 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1839/3705] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:23.030135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfaef3-0727-4a1d-8254-89d00b7383e7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:23.031332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfaef3-0727-4a1d-8254-89d00b7383e7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:23.031865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfaef3-0727-4a1d-8254-89d00b7383e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:23.056850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c4dfaef3-0727-4a1d-8254-89d00b7383e7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:23.058343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c4dfaef3-0727-4a1d-8254-89d00b7383e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:23.072579 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1867/3706] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:23.075542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d1a5b-6f3f-46c1-9090-16e028e4545a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:23.098762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d1a5b-6f3f-46c1-9090-16e028e4545a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:23.105898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e01f5-3a18-49a8-8774-997506a8b2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:23.107585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e01f5-3a18-49a8-8774-997506a8b2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:23.109246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e01f5-3a18-49a8-8774-997506a8b2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:23.109689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e01f5-3a18-49a8-8774-997506a8b2b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:23.113294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e01f5-3a18-49a8-8774-997506a8b2b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:54:23.113843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e01f5-3a18-49a8-8774-997506a8b2b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:23.116546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e01f5-3a18-49a8-8774-997506a8b2b6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:23.152488 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1840/3707] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:54:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:54:23.154009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfaef3-0727-4a1d-8254-89d00b7383e7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:23.176495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfaef3-0727-4a1d-8254-89d00b7383e7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:23.188735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee27448-ad2a-48d0-aa3c-5528df4faf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:23.189507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee27448-ad2a-48d0-aa3c-5528df4faf92 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:23.189794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee27448-ad2a-48d0-aa3c-5528df4faf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:23.190480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee27448-ad2a-48d0-aa3c-5528df4faf92 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:23.191377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee27448-ad2a-48d0-aa3c-5528df4faf92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:23.196776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee27448-ad2a-48d0-aa3c-5528df4faf92 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:23.236054 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1868/3708] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:54:23 2021] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:54:23.240929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e01f5-3a18-49a8-8774-997506a8b2b6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:23.260015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e01f5-3a18-49a8-8774-997506a8b2b6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:23.329931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858833c-f1c7-4b25-b3a2-ace13321082b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:23.331541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858833c-f1c7-4b25-b3a2-ace13321082b admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:23.331937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858833c-f1c7-4b25-b3a2-ace13321082b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:23.332297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858833c-f1c7-4b25-b3a2-ace13321082b admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:23.333722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858833c-f1c7-4b25-b3a2-ace13321082b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:23.336456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858833c-f1c7-4b25-b3a2-ace13321082b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:23.361692 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1841/3709] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:54:23 2021] POST /identity/v3/users => generated 285 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:54:23.366000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee27448-ad2a-48d0-aa3c-5528df4faf92 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:23.380654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee27448-ad2a-48d0-aa3c-5528df4faf92 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:23.388664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79e096-fb2f-42c9-8fb5-ff38c35ae9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:23.389511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79e096-fb2f-42c9-8fb5-ff38c35ae9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:23.389908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79e096-fb2f-42c9-8fb5-ff38c35ae9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:23.390335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79e096-fb2f-42c9-8fb5-ff38c35ae9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:23.391105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79e096-fb2f-42c9-8fb5-ff38c35ae9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:23.393112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79e096-fb2f-42c9-8fb5-ff38c35ae9d5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:23.414140 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1869/3710] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:23 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:54:23.427228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858833c-f1c7-4b25-b3a2-ace13321082b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:23.447204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858833c-f1c7-4b25-b3a2-ace13321082b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:23.455179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e28b6b-f8ed-4584-a2f6-4180c5faf5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:23.456916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e28b6b-f8ed-4584-a2f6-4180c5faf5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:23.457341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e28b6b-f8ed-4584-a2f6-4180c5faf5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:23.457631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e28b6b-f8ed-4584-a2f6-4180c5faf5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:23.459761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e28b6b-f8ed-4584-a2f6-4180c5faf5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:23.463379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e28b6b-f8ed-4584-a2f6-4180c5faf5d1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:23.479231 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1842/3711] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:23 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:54:23.484455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79e096-fb2f-42c9-8fb5-ff38c35ae9d5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:23.502685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79e096-fb2f-42c9-8fb5-ff38c35ae9d5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:23.511400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd66ded-da7e-4bf9-b413-af715b9032f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:23.511400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd66ded-da7e-4bf9-b413-af715b9032f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:23.511400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd66ded-da7e-4bf9-b413-af715b9032f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:23.511400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd66ded-da7e-4bf9-b413-af715b9032f1 admin admin] PATH_INFO: `/v3/projects/ed6e45b689fc4b15afe7d5ba12fe9fa3/users/650adb96560b4df88f6c73f97a25d524/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:23.544865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd66ded-da7e-4bf9-b413-af715b9032f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6e45b689fc4b15afe7d5ba12fe9fa3, user_id=650adb96560b4df88f6c73f97a25d524, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:23.550729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd66ded-da7e-4bf9-b413-af715b9032f1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:23.578744 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1870/3712] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:54:23 2021] PUT /identity/v3/projects/ed6e45b689fc4b15afe7d5ba12fe9fa3/users/650adb96560b4df88f6c73f97a25d524/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:23.591610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f64f6a-d062-4ab0-b80f-100ea30cff28 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:23.591960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f64f6a-d062-4ab0-b80f-100ea30cff28 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:23.592189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f64f6a-d062-4ab0-b80f-100ea30cff28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:23.634359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-46f64f6a-d062-4ab0-b80f-100ea30cff28 None None] MFA Rules not processed for user `650adb96560b4df88f6c73f97a25d524`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:23.635075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-46f64f6a-d062-4ab0-b80f-100ea30cff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:23.760397 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1843/3713] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:23 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:23.771733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd66ded-da7e-4bf9-b413-af715b9032f1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:23.776050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cbd66ded-da7e-4bf9-b413-af715b9032f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:23.916175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd66ded-da7e-4bf9-b413-af715b9032f1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:23.931457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe6c59-84d7-47ec-8874-c770e63d196e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:23.932340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6c59-84d7-47ec-8874-c770e63d196e service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:23.932649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6c59-84d7-47ec-8874-c770e63d196e service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:23.932886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6c59-84d7-47ec-8874-c770e63d196e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:23.948174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe6c59-84d7-47ec-8874-c770e63d196e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:23.951604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe6c59-84d7-47ec-8874-c770e63d196e service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:23.971507 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1871/3714] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:23 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:54:27.245185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cae395-cd1b-4221-b8c6-c0c39d21278e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:27.245773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cae395-cd1b-4221-b8c6-c0c39d21278e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:27.245880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cae395-cd1b-4221-b8c6-c0c39d21278e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:27.297818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a1cae395-cd1b-4221-b8c6-c0c39d21278e None None] MFA Rules not processed for user `ebd83848fe8d4e7284291660eb51da51`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:27.299521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a1cae395-cd1b-4221-b8c6-c0c39d21278e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:27.495314 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1844/3715] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:27 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:31.582965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe6c59-84d7-47ec-8874-c770e63d196e service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:31.585215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8bbe6c59-84d7-47ec-8874-c770e63d196e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:31.701465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe6c59-84d7-47ec-8874-c770e63d196e service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:31.707418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58634938-a243-4889-9130-962254a67afa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:31.708628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58634938-a243-4889-9130-962254a67afa service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:31.708869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58634938-a243-4889-9130-962254a67afa service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:31.709159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58634938-a243-4889-9130-962254a67afa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:31.715304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-58634938-a243-4889-9130-962254a67afa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:31.725964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58634938-a243-4889-9130-962254a67afa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:31.727834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58634938-a243-4889-9130-962254a67afa service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:31.746486 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1872/3716] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:31 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:54:33.069653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fa44d-6263-4b08-9942-d1082c56fa3b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:33.070243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fa44d-6263-4b08-9942-d1082c56fa3b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:33.070243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fa44d-6263-4b08-9942-d1082c56fa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:33.101862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-904fa44d-6263-4b08-9942-d1082c56fa3b None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:33.103181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-904fa44d-6263-4b08-9942-d1082c56fa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:33.199959 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1845/3717] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:54:33 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:54:33.215009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58634938-a243-4889-9130-962254a67afa service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:33.217600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-58634938-a243-4889-9130-962254a67afa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:33.357594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58634938-a243-4889-9130-962254a67afa service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:33.368204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e91d5-2b93-44d6-9d8a-17a730dd33b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:33.369224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e91d5-2b93-44d6-9d8a-17a730dd33b1 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:33.369224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e91d5-2b93-44d6-9d8a-17a730dd33b1 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:33.369589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e91d5-2b93-44d6-9d8a-17a730dd33b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:33.380468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e91d5-2b93-44d6-9d8a-17a730dd33b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:33.382885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e91d5-2b93-44d6-9d8a-17a730dd33b1 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:33.392042 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1873/3718] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:54:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:54:33.679974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fa44d-6263-4b08-9942-d1082c56fa3b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:33.682599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-904fa44d-6263-4b08-9942-d1082c56fa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:33.816766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fa44d-6263-4b08-9942-d1082c56fa3b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:33.826727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769fdfe-184c-4764-9655-1fae108433fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:33.829026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769fdfe-184c-4764-9655-1fae108433fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:33.829026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769fdfe-184c-4764-9655-1fae108433fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:33.829659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769fdfe-184c-4764-9655-1fae108433fc admin admin] PATH_INFO: `/v3/users/cdb721e9b80b4c70b1c2b234bfb5f3ef` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:33.832077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769fdfe-184c-4764-9655-1fae108433fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb721e9b80b4c70b1c2b234bfb5f3ef)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:33.833917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769fdfe-184c-4764-9655-1fae108433fc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:33.920949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8769fdfe-184c-4764-9655-1fae108433fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb721e9b80b4c70b1c2b234bfb5f3ef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:33.935568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8769fdfe-184c-4764-9655-1fae108433fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb721e9b80b4c70b1c2b234bfb5f3ef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:33.997467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8769fdfe-184c-4764-9655-1fae108433fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb721e9b80b4c70b1c2b234bfb5f3ef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:34.001522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8769fdfe-184c-4764-9655-1fae108433fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb721e9b80b4c70b1c2b234bfb5f3ef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:34.021751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8769fdfe-184c-4764-9655-1fae108433fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb721e9b80b4c70b1c2b234bfb5f3ef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:34.034901 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1846/3719] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:54:33 2021] DELETE /identity/v3/users/cdb721e9b80b4c70b1c2b234bfb5f3ef => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:34.040077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab085e-c9bb-462a-a062-77068759fedd None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:34.040749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab085e-c9bb-462a-a062-77068759fedd None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:34.041268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab085e-c9bb-462a-a062-77068759fedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:34.082296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3bab085e-c9bb-462a-a062-77068759fedd None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:34.083884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3bab085e-c9bb-462a-a062-77068759fedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:34.245823 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1874/3720] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:34.266338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769fdfe-184c-4764-9655-1fae108433fc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:34.268466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8769fdfe-184c-4764-9655-1fae108433fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:34.453720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769fdfe-184c-4764-9655-1fae108433fc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:34.459673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d844f-39e1-4357-b466-675f86cb8251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:34.460166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d844f-39e1-4357-b466-675f86cb8251 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:34.460345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d844f-39e1-4357-b466-675f86cb8251 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:34.461488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d844f-39e1-4357-b466-675f86cb8251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:34.485484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d844f-39e1-4357-b466-675f86cb8251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:34.488475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d844f-39e1-4357-b466-675f86cb8251 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:34.528811 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1847/3721] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:54:35.020758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab085e-c9bb-462a-a062-77068759fedd None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:35.022604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3bab085e-c9bb-462a-a062-77068759fedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:35.051503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab085e-c9bb-462a-a062-77068759fedd None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:35.068204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9d3e0-5e1f-441a-acf6-d2b5330003b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:35.069242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9d3e0-5e1f-441a-acf6-d2b5330003b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:35.069550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9d3e0-5e1f-441a-acf6-d2b5330003b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:35.070157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9d3e0-5e1f-441a-acf6-d2b5330003b8 admin admin] PATH_INFO: `/v3/projects/c0137551df8b4152946bfeeb726bec69` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:35.072064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9d3e0-5e1f-441a-acf6-d2b5330003b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0137551df8b4152946bfeeb726bec69)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:35.075211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9d3e0-5e1f-441a-acf6-d2b5330003b8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:35.153489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-59b9d3e0-5e1f-441a-acf6-d2b5330003b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0137551df8b4152946bfeeb726bec69', 'request_id': 'req-59b9d3e0-5e1f-441a-acf6-d2b5330003b8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:35.164875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-59b9d3e0-5e1f-441a-acf6-d2b5330003b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0137551df8b4152946bfeeb726bec69', 'request_id': 'req-59b9d3e0-5e1f-441a-acf6-d2b5330003b8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:35.197364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-59b9d3e0-5e1f-441a-acf6-d2b5330003b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0137551df8b4152946bfeeb726bec69', 'request_id': 'req-59b9d3e0-5e1f-441a-acf6-d2b5330003b8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:35.227967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-59b9d3e0-5e1f-441a-acf6-d2b5330003b8 admin admin] The token cache is being invalidate because project c0137551df8b4152946bfeeb726bec69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:54:35.228587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-59b9d3e0-5e1f-441a-acf6-d2b5330003b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:35.229712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-59b9d3e0-5e1f-441a-acf6-d2b5330003b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:35.232242 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1875/3722] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:35 2021] DELETE /identity/v3/projects/c0137551df8b4152946bfeeb726bec69 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:35.241091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddc07a-90ca-4681-a457-754608163701 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:35.241390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddc07a-90ca-4681-a457-754608163701 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:35.242659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddc07a-90ca-4681-a457-754608163701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:35.278783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1eddc07a-90ca-4681-a457-754608163701 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:35.281505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1eddc07a-90ca-4681-a457-754608163701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:35.388995 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1848/3723] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:35.398613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a153c-cef4-4977-b880-7a0bce2052de None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:35.399458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a153c-cef4-4977-b880-7a0bce2052de None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:35.399458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a153c-cef4-4977-b880-7a0bce2052de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:35.424006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b72a153c-cef4-4977-b880-7a0bce2052de None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:35.425931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b72a153c-cef4-4977-b880-7a0bce2052de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:35.438415 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1876/3724] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:35.442670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddc07a-90ca-4681-a457-754608163701 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:35.455081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddc07a-90ca-4681-a457-754608163701 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:35.464856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a18a5-ac54-45e5-b48b-86a72db938aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:35.465563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a18a5-ac54-45e5-b48b-86a72db938aa admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:35.466037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a18a5-ac54-45e5-b48b-86a72db938aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:35.466530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a18a5-ac54-45e5-b48b-86a72db938aa admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:35.467625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a18a5-ac54-45e5-b48b-86a72db938aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:54:35.468111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a18a5-ac54-45e5-b48b-86a72db938aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:35.469913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a18a5-ac54-45e5-b48b-86a72db938aa admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:35.491671 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1849/3725] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:54:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:54:35.495236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a153c-cef4-4977-b880-7a0bce2052de None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:35.512234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a153c-cef4-4977-b880-7a0bce2052de None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:35.525138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2f1de-2606-47ef-a013-783983447809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:35.527030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2f1de-2606-47ef-a013-783983447809 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:35.527319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2f1de-2606-47ef-a013-783983447809 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:35.527604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2f1de-2606-47ef-a013-783983447809 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:35.528324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2f1de-2606-47ef-a013-783983447809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:35.530429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2f1de-2606-47ef-a013-783983447809 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:35.570743 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1877/3726] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:54:35 2021] POST /identity/v3/projects => generated 363 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:54:35.574805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a18a5-ac54-45e5-b48b-86a72db938aa admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:35.591897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a18a5-ac54-45e5-b48b-86a72db938aa admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:35.689914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f312bb-babf-4503-bc73-0efa75796265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:35.690332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f312bb-babf-4503-bc73-0efa75796265 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:35.690651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f312bb-babf-4503-bc73-0efa75796265 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:35.690857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f312bb-babf-4503-bc73-0efa75796265 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:35.691591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f312bb-babf-4503-bc73-0efa75796265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:35.694058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f312bb-babf-4503-bc73-0efa75796265 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:35.728392 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1850/3727] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:54:35 2021] POST /identity/v3/users => generated 282 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:54:35.731717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2f1de-2606-47ef-a013-783983447809 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:35.745623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2f1de-2606-47ef-a013-783983447809 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:35.753134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb6adc-34de-452c-8d88-29f92d81844b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:35.754799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb6adc-34de-452c-8d88-29f92d81844b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:35.755231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb6adc-34de-452c-8d88-29f92d81844b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:35.755713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb6adc-34de-452c-8d88-29f92d81844b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:35.757944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb6adc-34de-452c-8d88-29f92d81844b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:35.760393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb6adc-34de-452c-8d88-29f92d81844b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:35.786001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f312bb-babf-4503-bc73-0efa75796265 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:35.787701 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1878/3728] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:35 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:54:35.800012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f312bb-babf-4503-bc73-0efa75796265 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:35.810628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f3ed3-b1d7-462e-b50f-383d42cdcf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:35.811642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f3ed3-b1d7-462e-b50f-383d42cdcf3e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:35.812271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f3ed3-b1d7-462e-b50f-383d42cdcf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:35.813073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f3ed3-b1d7-462e-b50f-383d42cdcf3e admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:35.814204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f3ed3-b1d7-462e-b50f-383d42cdcf3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:35.816998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f3ed3-b1d7-462e-b50f-383d42cdcf3e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:35.839947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb6adc-34de-452c-8d88-29f92d81844b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:35.841551 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1851/3729] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:35 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:54:35.854168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb6adc-34de-452c-8d88-29f92d81844b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:35.862562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47ef95-8c47-4471-b37c-ab51ca251f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:35.864268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47ef95-8c47-4471-b37c-ab51ca251f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:35.864715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47ef95-8c47-4471-b37c-ab51ca251f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:35.866606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47ef95-8c47-4471-b37c-ab51ca251f2e admin admin] PATH_INFO: `/v3/projects/8d45c473a485472791e742964660e7e9/users/216cd2c0d4b249e797990918152b4749/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:35.909544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47ef95-8c47-4471-b37c-ab51ca251f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d45c473a485472791e742964660e7e9, user_id=216cd2c0d4b249e797990918152b4749, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:35.913193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47ef95-8c47-4471-b37c-ab51ca251f2e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:35.958070 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1879/3730] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:54:35 2021] PUT /identity/v3/projects/8d45c473a485472791e742964660e7e9/users/216cd2c0d4b249e797990918152b4749/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:35.961401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bf22e-33de-4446-9b71-9e759d2d831e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:35.961742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bf22e-33de-4446-9b71-9e759d2d831e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:35.961982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bf22e-33de-4446-9b71-9e759d2d831e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:35.999858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-724bf22e-33de-4446-9b71-9e759d2d831e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:36.004549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-724bf22e-33de-4446-9b71-9e759d2d831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:36.093742 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1852/3731] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:36.105686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47ef95-8c47-4471-b37c-ab51ca251f2e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:36.108300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dd47ef95-8c47-4471-b37c-ab51ca251f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:36.179745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47ef95-8c47-4471-b37c-ab51ca251f2e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:36.183684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d56ee-801d-4c50-8543-cd8680168561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:36.184481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d56ee-801d-4c50-8543-cd8680168561 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:36.184816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d56ee-801d-4c50-8543-cd8680168561 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:36.185205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d56ee-801d-4c50-8543-cd8680168561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:36.195159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d56ee-801d-4c50-8543-cd8680168561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:36.196593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d56ee-801d-4c50-8543-cd8680168561 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:36.207108 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1880/3732] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:54:37.533736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de43ec-f166-4ab6-828b-b20a3eee0294 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:37.534440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de43ec-f166-4ab6-828b-b20a3eee0294 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:37.534672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de43ec-f166-4ab6-828b-b20a3eee0294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:37.587102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-31de43ec-f166-4ab6-828b-b20a3eee0294 None None] MFA Rules not processed for user `216cd2c0d4b249e797990918152b4749`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:37.589734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-31de43ec-f166-4ab6-828b-b20a3eee0294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:37.708604 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1853/3733] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:37 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:37.722089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942faf88-d277-4266-84b3-1d9dadf973da None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:37.722698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942faf88-d277-4266-84b3-1d9dadf973da None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:37.722698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942faf88-d277-4266-84b3-1d9dadf973da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:37.746114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-942faf88-d277-4266-84b3-1d9dadf973da None None] MFA Rules not processed for user `216cd2c0d4b249e797990918152b4749`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:37.747409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-942faf88-d277-4266-84b3-1d9dadf973da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:37.756369 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1881/3734] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:37 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:38.594150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de43ec-f166-4ab6-828b-b20a3eee0294 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:38.595677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-31de43ec-f166-4ab6-828b-b20a3eee0294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:38.713459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de43ec-f166-4ab6-828b-b20a3eee0294 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:38.725295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fe090-308a-4a5c-9c96-5d7d0e478d0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:38.727741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe090-308a-4a5c-9c96-5d7d0e478d0f service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:38.728144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe090-308a-4a5c-9c96-5d7d0e478d0f service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:38.728635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe090-308a-4a5c-9c96-5d7d0e478d0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:38.744784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fe090-308a-4a5c-9c96-5d7d0e478d0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:38.747020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fe090-308a-4a5c-9c96-5d7d0e478d0f service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:38.782822 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1854/3735] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:38 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:54:47.286288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ef44f-c092-43f5-b966-4f3abaf30550 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:47.287005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ef44f-c092-43f5-b966-4f3abaf30550 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:47.287296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ef44f-c092-43f5-b966-4f3abaf30550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:47.319286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7d5ef44f-c092-43f5-b966-4f3abaf30550 None None] MFA Rules not processed for user `09d32c08216a4035907c888a3c8cd70f`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:47.320796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7d5ef44f-c092-43f5-b966-4f3abaf30550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:47.402039 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1882/3736] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:47 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:48.674728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbc119-2a04-4db3-9827-2483b1c6b5fb None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:48.675840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbc119-2a04-4db3-9827-2483b1c6b5fb None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:48.676311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbc119-2a04-4db3-9827-2483b1c6b5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:48.696329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ef44f-c092-43f5-b966-4f3abaf30550 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:48.698040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7d5ef44f-c092-43f5-b966-4f3abaf30550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:48.707168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-17dbc119-2a04-4db3-9827-2483b1c6b5fb None None] MFA Rules not processed for user `ad564476e1cf4a0b87fef4e3d08e6726`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:48.715049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ef44f-c092-43f5-b966-4f3abaf30550 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:48.719861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-17dbc119-2a04-4db3-9827-2483b1c6b5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:48.720124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d34c7e-032b-42fd-88ef-f9e331310b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:48.721464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d34c7e-032b-42fd-88ef-f9e331310b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:48.721973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d34c7e-032b-42fd-88ef-f9e331310b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:48.722486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d34c7e-032b-42fd-88ef-f9e331310b41 admin admin] PATH_INFO: `/v3/users/753e7daa3b814c789fd6451101113666` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:48.724141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d34c7e-032b-42fd-88ef-f9e331310b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=753e7daa3b814c789fd6451101113666)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:48.727803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d34c7e-032b-42fd-88ef-f9e331310b41 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:48.792516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-37d34c7e-032b-42fd-88ef-f9e331310b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '753e7daa3b814c789fd6451101113666'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:48.802418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-37d34c7e-032b-42fd-88ef-f9e331310b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '753e7daa3b814c789fd6451101113666'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:48.803837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-37d34c7e-032b-42fd-88ef-f9e331310b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '753e7daa3b814c789fd6451101113666'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:48.818986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-37d34c7e-032b-42fd-88ef-f9e331310b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '753e7daa3b814c789fd6451101113666'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:48.829211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-37d34c7e-032b-42fd-88ef-f9e331310b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '753e7daa3b814c789fd6451101113666'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:48.832976 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1855/3737] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:48 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:48.840181 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1883/3738] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:54:48 2021] DELETE /identity/v3/users/753e7daa3b814c789fd6451101113666 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:48.844444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a348fa8-9114-41f3-8af9-5a7859398452 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:48.844937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a348fa8-9114-41f3-8af9-5a7859398452 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:48.845645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a348fa8-9114-41f3-8af9-5a7859398452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:48.875454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2a348fa8-9114-41f3-8af9-5a7859398452 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:48.878924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2a348fa8-9114-41f3-8af9-5a7859398452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:48.963064 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1856/3739] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:48.973691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d34c7e-032b-42fd-88ef-f9e331310b41 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:48.977416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-37d34c7e-032b-42fd-88ef-f9e331310b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:49.048190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d34c7e-032b-42fd-88ef-f9e331310b41 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:49.053044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dde1d-e53e-4ae6-87f2-717069f3374e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:49.054211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dde1d-e53e-4ae6-87f2-717069f3374e service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:49.054211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dde1d-e53e-4ae6-87f2-717069f3374e service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:49.054544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dde1d-e53e-4ae6-87f2-717069f3374e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:49.066246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dde1d-e53e-4ae6-87f2-717069f3374e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:49.067786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dde1d-e53e-4ae6-87f2-717069f3374e service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:49.080764 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1884/3740] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:54:49.466481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a348fa8-9114-41f3-8af9-5a7859398452 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:49.468859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2a348fa8-9114-41f3-8af9-5a7859398452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:49.483867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a348fa8-9114-41f3-8af9-5a7859398452 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:49.504523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bc1a2-aafc-4b12-9490-4d014ff923a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:49.507669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bc1a2-aafc-4b12-9490-4d014ff923a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:49.508730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bc1a2-aafc-4b12-9490-4d014ff923a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:49.509363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bc1a2-aafc-4b12-9490-4d014ff923a9 admin admin] PATH_INFO: `/v3/projects/6af640d59dee48c59f1f191bc541829d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:49.512222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bc1a2-aafc-4b12-9490-4d014ff923a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af640d59dee48c59f1f191bc541829d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:49.515225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bc1a2-aafc-4b12-9490-4d014ff923a9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:49.626200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-839bc1a2-aafc-4b12-9490-4d014ff923a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af640d59dee48c59f1f191bc541829d', 'request_id': 'req-839bc1a2-aafc-4b12-9490-4d014ff923a9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:49.639401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-839bc1a2-aafc-4b12-9490-4d014ff923a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af640d59dee48c59f1f191bc541829d', 'request_id': 'req-839bc1a2-aafc-4b12-9490-4d014ff923a9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:49.645857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-839bc1a2-aafc-4b12-9490-4d014ff923a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af640d59dee48c59f1f191bc541829d', 'request_id': 'req-839bc1a2-aafc-4b12-9490-4d014ff923a9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:49.681562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-839bc1a2-aafc-4b12-9490-4d014ff923a9 admin admin] The token cache is being invalidate because project 6af640d59dee48c59f1f191bc541829d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:54:49.683547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-839bc1a2-aafc-4b12-9490-4d014ff923a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:49.684388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-839bc1a2-aafc-4b12-9490-4d014ff923a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:49.689816 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1857/3741] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:49 2021] DELETE /identity/v3/projects/6af640d59dee48c59f1f191bc541829d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:49.691136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dde1d-e53e-4ae6-87f2-717069f3374e service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:49.723362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dde1d-e53e-4ae6-87f2-717069f3374e service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:49.820758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd222d94-80c5-456b-9525-57e6223fb334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:49.821569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd222d94-80c5-456b-9525-57e6223fb334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:49.821849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd222d94-80c5-456b-9525-57e6223fb334 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:49.822126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd222d94-80c5-456b-9525-57e6223fb334 admin admin] PATH_INFO: `/v3/users/f4db91e4589742c78d201d64fd6627c8` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:49.824882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd222d94-80c5-456b-9525-57e6223fb334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4db91e4589742c78d201d64fd6627c8)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:49.829554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd222d94-80c5-456b-9525-57e6223fb334 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:49.951945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cd222d94-80c5-456b-9525-57e6223fb334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4db91e4589742c78d201d64fd6627c8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:49.969626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cd222d94-80c5-456b-9525-57e6223fb334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4db91e4589742c78d201d64fd6627c8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:49.970681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cd222d94-80c5-456b-9525-57e6223fb334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4db91e4589742c78d201d64fd6627c8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:50.016831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cd222d94-80c5-456b-9525-57e6223fb334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4db91e4589742c78d201d64fd6627c8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:50.035021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cd222d94-80c5-456b-9525-57e6223fb334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4db91e4589742c78d201d64fd6627c8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:50.060506 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1885/3742] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:54:49 2021] DELETE /identity/v3/users/f4db91e4589742c78d201d64fd6627c8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:54:50.817142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bc1a2-aafc-4b12-9490-4d014ff923a9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:50.818659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-839bc1a2-aafc-4b12-9490-4d014ff923a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:50.847250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bc1a2-aafc-4b12-9490-4d014ff923a9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:50.980824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e85682-778c-4682-9d8c-5bc91ada4d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:50.981954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e85682-778c-4682-9d8c-5bc91ada4d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:50.982272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e85682-778c-4682-9d8c-5bc91ada4d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:50.982752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e85682-778c-4682-9d8c-5bc91ada4d6f admin admin] PATH_INFO: `/v3/projects/af2f2fadd9324bc08b19f434524b3bbf` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:50.984022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e85682-778c-4682-9d8c-5bc91ada4d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=af2f2fadd9324bc08b19f434524b3bbf)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:50.987934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e85682-778c-4682-9d8c-5bc91ada4d6f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:51.139214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d4e85682-778c-4682-9d8c-5bc91ada4d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af2f2fadd9324bc08b19f434524b3bbf', 'request_id': 'req-d4e85682-778c-4682-9d8c-5bc91ada4d6f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:51.169893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d4e85682-778c-4682-9d8c-5bc91ada4d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af2f2fadd9324bc08b19f434524b3bbf', 'request_id': 'req-d4e85682-778c-4682-9d8c-5bc91ada4d6f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:51.178695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d4e85682-778c-4682-9d8c-5bc91ada4d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af2f2fadd9324bc08b19f434524b3bbf', 'request_id': 'req-d4e85682-778c-4682-9d8c-5bc91ada4d6f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:51.204185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d4e85682-778c-4682-9d8c-5bc91ada4d6f admin admin] The token cache is being invalidate because project af2f2fadd9324bc08b19f434524b3bbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:54:51.205019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d4e85682-778c-4682-9d8c-5bc91ada4d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:51.205992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d4e85682-778c-4682-9d8c-5bc91ada4d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:54:51.212268 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1858/3743] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:54:50 2021] DELETE /identity/v3/projects/af2f2fadd9324bc08b19f434524b3bbf => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:51.220572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c2247-3df4-46f2-b6a0-eebcac9c3b75 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:51.222418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c2247-3df4-46f2-b6a0-eebcac9c3b75 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:51.223099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c2247-3df4-46f2-b6a0-eebcac9c3b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:51.299391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d90c2247-3df4-46f2-b6a0-eebcac9c3b75 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:51.306585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d90c2247-3df4-46f2-b6a0-eebcac9c3b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:51.464285 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1886/3744] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:51.473393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144b385-aa51-4be2-8f31-3bf887a08b63 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:51.474068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144b385-aa51-4be2-8f31-3bf887a08b63 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:51.474577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144b385-aa51-4be2-8f31-3bf887a08b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:51.536170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7144b385-aa51-4be2-8f31-3bf887a08b63 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:51.542916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7144b385-aa51-4be2-8f31-3bf887a08b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:51.591913 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1859/3745] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:51.592827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c2247-3df4-46f2-b6a0-eebcac9c3b75 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:51.622389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c2247-3df4-46f2-b6a0-eebcac9c3b75 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:51.637579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f0555-8ca9-4140-b0b8-e4c52ac4aa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:51.638527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f0555-8ca9-4140-b0b8-e4c52ac4aa06 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:51.639164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f0555-8ca9-4140-b0b8-e4c52ac4aa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:51.639617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f0555-8ca9-4140-b0b8-e4c52ac4aa06 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:51.641364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f0555-8ca9-4140-b0b8-e4c52ac4aa06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:54:51.641862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f0555-8ca9-4140-b0b8-e4c52ac4aa06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:51.644005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f0555-8ca9-4140-b0b8-e4c52ac4aa06 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:51.671620 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1887/3746] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:54:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:54:51.675859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144b385-aa51-4be2-8f31-3bf887a08b63 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:51.686873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144b385-aa51-4be2-8f31-3bf887a08b63 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:51.693725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd700a60-d6bb-4f39-9a07-8755a0975cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:51.694893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd700a60-d6bb-4f39-9a07-8755a0975cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:51.695353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd700a60-d6bb-4f39-9a07-8755a0975cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:51.695788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd700a60-d6bb-4f39-9a07-8755a0975cc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:51.696651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd700a60-d6bb-4f39-9a07-8755a0975cc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:51.698880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd700a60-d6bb-4f39-9a07-8755a0975cc1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:51.751827 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1860/3747] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:54:51 2021] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:54:51.752656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f0555-8ca9-4140-b0b8-e4c52ac4aa06 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:51.767962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f0555-8ca9-4140-b0b8-e4c52ac4aa06 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:51.933721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ead6b-7a90-402a-bd92-f5fbf3cf3f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:51.935276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ead6b-7a90-402a-bd92-f5fbf3cf3f73 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:51.936615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ead6b-7a90-402a-bd92-f5fbf3cf3f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:51.937795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ead6b-7a90-402a-bd92-f5fbf3cf3f73 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:51.939483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ead6b-7a90-402a-bd92-f5fbf3cf3f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:51.946596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ead6b-7a90-402a-bd92-f5fbf3cf3f73 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:52.004227 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1888/3748] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:54:51 2021] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:54:52.009178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd700a60-d6bb-4f39-9a07-8755a0975cc1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:52.028418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd700a60-d6bb-4f39-9a07-8755a0975cc1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:52.040715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0f009-b7c3-42bb-86b8-d79fb84138d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:52.043239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0f009-b7c3-42bb-86b8-d79fb84138d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:52.044929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0f009-b7c3-42bb-86b8-d79fb84138d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:52.045403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0f009-b7c3-42bb-86b8-d79fb84138d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:52.047724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0f009-b7c3-42bb-86b8-d79fb84138d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:52.052467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0f009-b7c3-42bb-86b8-d79fb84138d1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:52.080493 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1861/3749] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:52 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:54:52.082142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ead6b-7a90-402a-bd92-f5fbf3cf3f73 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:52.095199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ead6b-7a90-402a-bd92-f5fbf3cf3f73 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:52.101449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315502c-82c4-45c5-9602-c589b7fabc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:52.103100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315502c-82c4-45c5-9602-c589b7fabc36 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:52.103718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315502c-82c4-45c5-9602-c589b7fabc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:52.104227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315502c-82c4-45c5-9602-c589b7fabc36 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:52.105301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315502c-82c4-45c5-9602-c589b7fabc36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:52.107385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315502c-82c4-45c5-9602-c589b7fabc36 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:52.125733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0f009-b7c3-42bb-86b8-d79fb84138d1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:52.127446 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1889/3750] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:54:52 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:54:52.140069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0f009-b7c3-42bb-86b8-d79fb84138d1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:52.152650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1b47a-ebd9-477c-921c-b2039064ebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:52.155505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1b47a-ebd9-477c-921c-b2039064ebfa admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:52.156544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1b47a-ebd9-477c-921c-b2039064ebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:52.157111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1b47a-ebd9-477c-921c-b2039064ebfa admin admin] PATH_INFO: `/v3/projects/3c3cfd30b80f46d798958d02e20cb5fd/users/b46b47b65699443083a47a2c8bab63cf/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:52.183068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1b47a-ebd9-477c-921c-b2039064ebfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c3cfd30b80f46d798958d02e20cb5fd, user_id=b46b47b65699443083a47a2c8bab63cf, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:52.188006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1b47a-ebd9-477c-921c-b2039064ebfa admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:52.214942 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1862/3751] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:54:52 2021] PUT /identity/v3/projects/3c3cfd30b80f46d798958d02e20cb5fd/users/b46b47b65699443083a47a2c8bab63cf/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:54:52.230308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448a57e-692c-4f38-8e03-2d8502bdad66 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:52.233915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448a57e-692c-4f38-8e03-2d8502bdad66 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:52.235211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448a57e-692c-4f38-8e03-2d8502bdad66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:52.268722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0448a57e-692c-4f38-8e03-2d8502bdad66 None None] MFA Rules not processed for user `b46b47b65699443083a47a2c8bab63cf`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:52.270411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0448a57e-692c-4f38-8e03-2d8502bdad66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:52.457827 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1890/3752] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:52 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:52.480195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1b47a-ebd9-477c-921c-b2039064ebfa admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:52.483309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4cb1b47a-ebd9-477c-921c-b2039064ebfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:52.617862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1b47a-ebd9-477c-921c-b2039064ebfa admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:52.627976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc42bc-a3b8-4d14-88de-160989bd16eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:52.629285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc42bc-a3b8-4d14-88de-160989bd16eb service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:52.629815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc42bc-a3b8-4d14-88de-160989bd16eb service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:52.630477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc42bc-a3b8-4d14-88de-160989bd16eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:52.644949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc42bc-a3b8-4d14-88de-160989bd16eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:52.647400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc42bc-a3b8-4d14-88de-160989bd16eb service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:52.663661 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1863/3753] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:54:52 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:54:53.903823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93988146-c12c-4f96-9d3a-0931a5e5bb3a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:53.904843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93988146-c12c-4f96-9d3a-0931a5e5bb3a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:53.905356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93988146-c12c-4f96-9d3a-0931a5e5bb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:53.927768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-93988146-c12c-4f96-9d3a-0931a5e5bb3a None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:53.930154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-93988146-c12c-4f96-9d3a-0931a5e5bb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:54.013857 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1891/3754] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:54:53 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:54.028940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc42bc-a3b8-4d14-88de-160989bd16eb service glance] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:54.030566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6ffc42bc-a3b8-4d14-88de-160989bd16eb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:54.128994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc42bc-a3b8-4d14-88de-160989bd16eb service glance] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:54.137547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffa9b3-95c7-4019-a942-bac15c674236 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:54.138449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffa9b3-95c7-4019-a942-bac15c674236 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:54.138711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffa9b3-95c7-4019-a942-bac15c674236 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:54.139195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffa9b3-95c7-4019-a942-bac15c674236 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:54.149087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffa9b3-95c7-4019-a942-bac15c674236 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:54.150720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffa9b3-95c7-4019-a942-bac15c674236 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:54.160492 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1864/3755] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:54:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:54:56.315915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc0db-c9bb-4a8b-9077-261a7fcddbf1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:56.316456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc0db-c9bb-4a8b-9077-261a7fcddbf1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:56.316456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc0db-c9bb-4a8b-9077-261a7fcddbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:56.358744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-dd6bc0db-c9bb-4a8b-9077-261a7fcddbf1 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:56.366547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dd6bc0db-c9bb-4a8b-9077-261a7fcddbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:56.378751 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1892/3756] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:54:56 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:56.392211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffa9b3-95c7-4019-a942-bac15c674236 service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:56.410497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffa9b3-95c7-4019-a942-bac15c674236 service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:56.424278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f52b9-38ef-44f5-abe9-955a1a55337e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:56.425184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f52b9-38ef-44f5-abe9-955a1a55337e service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:56.425650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f52b9-38ef-44f5-abe9-955a1a55337e service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:56.426097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f52b9-38ef-44f5-abe9-955a1a55337e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:56.436159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f52b9-38ef-44f5-abe9-955a1a55337e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:56.438495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f52b9-38ef-44f5-abe9-955a1a55337e service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:56.448706 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1865/3757] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:54:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:54:57.926237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b16caa-7fdd-42e6-a0e3-9129f62cf82d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:57.926843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b16caa-7fdd-42e6-a0e3-9129f62cf82d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:57.926843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b16caa-7fdd-42e6-a0e3-9129f62cf82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:57.948167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a3b16caa-7fdd-42e6-a0e3-9129f62cf82d None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:57.949551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a3b16caa-7fdd-42e6-a0e3-9129f62cf82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:57.966490 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1893/3758] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:54:57 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:57.975007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f52b9-38ef-44f5-abe9-955a1a55337e service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:54:57.993210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f52b9-38ef-44f5-abe9-955a1a55337e service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:54:57.999465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4437d0-7d5d-4e43-9758-3f090014d34b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:54:58.008363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4437d0-7d5d-4e43-9758-3f090014d34b service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:58.009042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4437d0-7d5d-4e43-9758-3f090014d34b service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:58.009621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4437d0-7d5d-4e43-9758-3f090014d34b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:58.026607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4437d0-7d5d-4e43-9758-3f090014d34b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:54:58.028346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4437d0-7d5d-4e43-9758-3f090014d34b service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:54:58.039250 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1866/3759] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:54:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:54:58.453292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9848a7c-f1a1-4291-8581-7e1a59fea5a8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:58.453839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9848a7c-f1a1-4291-8581-7e1a59fea5a8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:58.454357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9848a7c-f1a1-4291-8581-7e1a59fea5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:58.486684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c9848a7c-f1a1-4291-8581-7e1a59fea5a8 None None] MFA Rules not processed for user `b46b47b65699443083a47a2c8bab63cf`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:58.488308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c9848a7c-f1a1-4291-8581-7e1a59fea5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:58.498723 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1894/3760] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:58 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:54:59.093384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f7218-8b81-4102-8010-bb2b5811cca3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:54:59.093845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f7218-8b81-4102-8010-bb2b5811cca3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:54:59.094186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f7218-8b81-4102-8010-bb2b5811cca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:54:59.145682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b32f7218-8b81-4102-8010-bb2b5811cca3 None None] MFA Rules not processed for user `b46b47b65699443083a47a2c8bab63cf`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:54:59.159625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b32f7218-8b81-4102-8010-bb2b5811cca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:54:59.182836 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1867/3761] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:54:59 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:55:03.833819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577475e-8539-449f-8b29-1b44dc216593 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:03.833819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577475e-8539-449f-8b29-1b44dc216593 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:03.835752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577475e-8539-449f-8b29-1b44dc216593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:03.892974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f577475e-8539-449f-8b29-1b44dc216593 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:55:03.896249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f577475e-8539-449f-8b29-1b44dc216593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:03.914982 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1895/3762] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:55:03 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:55:03.950797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f7218-8b81-4102-8010-bb2b5811cca3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:55:03.973322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f7218-8b81-4102-8010-bb2b5811cca3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:55:03.984824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecb09c-1e72-47d5-b1c6-e6ffdcb1933c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:55:03.987955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecb09c-1e72-47d5-b1c6-e6ffdcb1933c service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:03.989097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecb09c-1e72-47d5-b1c6-e6ffdcb1933c service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:03.989804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecb09c-1e72-47d5-b1c6-e6ffdcb1933c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:04.017699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecb09c-1e72-47d5-b1c6-e6ffdcb1933c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:55:04.021228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecb09c-1e72-47d5-b1c6-e6ffdcb1933c service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:55:04.045210 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1868/3763] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:55:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:55:08.392315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf196f-82de-4d1b-a877-fc411080cee4 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:08.393543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf196f-82de-4d1b-a877-fc411080cee4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:08.393855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf196f-82de-4d1b-a877-fc411080cee4 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:08.396058 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1896/3764] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:55:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:55:08.402777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56784827-6863-4ee2-8ca3-b918ff04901b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:08.403956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56784827-6863-4ee2-8ca3-b918ff04901b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:08.404526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56784827-6863-4ee2-8ca3-b918ff04901b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:08.448050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-56784827-6863-4ee2-8ca3-b918ff04901b None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:55:08.449793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-56784827-6863-4ee2-8ca3-b918ff04901b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:08.618590 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1869/3765] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:55:08 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:55:08.658268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf196f-82de-4d1b-a877-fc411080cee4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:55:08.660134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a4bf196f-82de-4d1b-a877-fc411080cee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:08.697884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf196f-82de-4d1b-a877-fc411080cee4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:55:08.714207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92f4d8-1630-4ce4-804d-8c0ae5faab04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:55:08.720503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92f4d8-1630-4ce4-804d-8c0ae5faab04 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:08.720800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92f4d8-1630-4ce4-804d-8c0ae5faab04 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:08.721084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92f4d8-1630-4ce4-804d-8c0ae5faab04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:08.743130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92f4d8-1630-4ce4-804d-8c0ae5faab04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:55:08.744655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92f4d8-1630-4ce4-804d-8c0ae5faab04 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:55:08.773755 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1897/3766] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:55:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:55:09.963551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2a3b-fb24-4a55-ab27-1c1e991cb32e None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:09.964120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2a3b-fb24-4a55-ab27-1c1e991cb32e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:09.964233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2a3b-fb24-4a55-ab27-1c1e991cb32e None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:09.966885 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1870/3767] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 20:55:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:55:09.982774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d2d7e-750a-40c5-b677-92a078f073af None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:09.983872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d2d7e-750a-40c5-b677-92a078f073af None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:09.984399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d2d7e-750a-40c5-b677-92a078f073af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:10.020196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-657d2d7e-750a-40c5-b677-92a078f073af None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:55:10.021827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-657d2d7e-750a-40c5-b677-92a078f073af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:10.047856 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1898/3768] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 20:55:09 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:55:10.072746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b2a3b-fb24-4a55-ab27-1c1e991cb32e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:55:10.105404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b2a3b-fb24-4a55-ab27-1c1e991cb32e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:55:10.120485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971321e-3f4f-4e1e-b51e-f823e0465ee2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:55:10.121177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971321e-3f4f-4e1e-b51e-f823e0465ee2 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:10.121461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971321e-3f4f-4e1e-b51e-f823e0465ee2 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:10.123289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971321e-3f4f-4e1e-b51e-f823e0465ee2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:10.144557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971321e-3f4f-4e1e-b51e-f823e0465ee2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:55:10.146656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971321e-3f4f-4e1e-b51e-f823e0465ee2 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:55:10.192984 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1871/3769] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:55:10 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:55:12.987006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d2d7e-750a-40c5-b677-92a078f073af None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:55:12.989801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-657d2d7e-750a-40c5-b677-92a078f073af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:13.224004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d2d7e-750a-40c5-b677-92a078f073af None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:55:13.249288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1bdcf-bc67-4f16-9a9f-324558761b8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:55:13.250338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1bdcf-bc67-4f16-9a9f-324558761b8b service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:13.252608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1bdcf-bc67-4f16-9a9f-324558761b8b service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:13.253029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1bdcf-bc67-4f16-9a9f-324558761b8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:13.265367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e6e1bdcf-bc67-4f16-9a9f-324558761b8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:13.488823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1bdcf-bc67-4f16-9a9f-324558761b8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:55:13.500657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1bdcf-bc67-4f16-9a9f-324558761b8b service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:55:13.528959 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1899/3770] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:55:12 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:55:20.531935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6cf79-c505-47af-99fe-1ac456ef0dd5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:20.532515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6cf79-c505-47af-99fe-1ac456ef0dd5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:20.532515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6cf79-c505-47af-99fe-1ac456ef0dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:20.572129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7ac6cf79-c505-47af-99fe-1ac456ef0dd5 None None] MFA Rules not processed for user `ebd83848fe8d4e7284291660eb51da51`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:55:20.573699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7ac6cf79-c505-47af-99fe-1ac456ef0dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:20.607441 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1872/3771] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:55:20 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:55:23.116858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d3b66-c6af-427a-8494-78df016d143a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:23.118054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d3b66-c6af-427a-8494-78df016d143a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:23.118533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d3b66-c6af-427a-8494-78df016d143a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:23.151475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c33d3b66-c6af-427a-8494-78df016d143a None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:55:23.152911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c33d3b66-c6af-427a-8494-78df016d143a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:23.172426 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1900/3772] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:55:23 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:55:23.184403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6cf79-c505-47af-99fe-1ac456ef0dd5 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:55:23.227306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6cf79-c505-47af-99fe-1ac456ef0dd5 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:55:23.247805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6ae73-19b3-4c0e-bc33-20fc89c35262 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:55:23.248496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6ae73-19b3-4c0e-bc33-20fc89c35262 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:23.248790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6ae73-19b3-4c0e-bc33-20fc89c35262 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:23.249076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6ae73-19b3-4c0e-bc33-20fc89c35262 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:23.264175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6ae73-19b3-4c0e-bc33-20fc89c35262 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:55:23.266076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6ae73-19b3-4c0e-bc33-20fc89c35262 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:55:23.284465 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1873/3773] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:55:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:55:24.206834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d5312-4dad-4ac3-8461-497a33d3bdcb None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:24.207789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d5312-4dad-4ac3-8461-497a33d3bdcb None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:24.208381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d5312-4dad-4ac3-8461-497a33d3bdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:24.251431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-903d5312-4dad-4ac3-8461-497a33d3bdcb None None] MFA Rules not processed for user `216cd2c0d4b249e797990918152b4749`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:55:24.252651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-903d5312-4dad-4ac3-8461-497a33d3bdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:24.342175 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1901/3774] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:55:24 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:55:29.390124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9db5af-c144-4ae4-a537-a2b349ceb95b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:29.391501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9db5af-c144-4ae4-a537-a2b349ceb95b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:29.392133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9db5af-c144-4ae4-a537-a2b349ceb95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:29.417727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5d9db5af-c144-4ae4-a537-a2b349ceb95b None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:55:29.421004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5d9db5af-c144-4ae4-a537-a2b349ceb95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:29.433388 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1874/3775] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:55:29 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:55:29.450899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d5312-4dad-4ac3-8461-497a33d3bdcb None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:55:29.464961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d5312-4dad-4ac3-8461-497a33d3bdcb None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:55:29.471860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c78e7e-bf3d-477d-9bd1-e741793c7f34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:55:29.472889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c78e7e-bf3d-477d-9bd1-e741793c7f34 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:29.473211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c78e7e-bf3d-477d-9bd1-e741793c7f34 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:29.473523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c78e7e-bf3d-477d-9bd1-e741793c7f34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:29.485917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c78e7e-bf3d-477d-9bd1-e741793c7f34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:55:29.487980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c78e7e-bf3d-477d-9bd1-e741793c7f34 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:55:29.500927 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1902/3776] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:55:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:55:52.607360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec7057-3262-4191-af16-b2ec818516d4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:52.608115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec7057-3262-4191-af16-b2ec818516d4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:52.608558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec7057-3262-4191-af16-b2ec818516d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:52.629151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-baec7057-3262-4191-af16-b2ec818516d4 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:55:52.632596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-baec7057-3262-4191-af16-b2ec818516d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:52.642386 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1875/3777] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:55:52 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:55:52.658953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c78e7e-bf3d-477d-9bd1-e741793c7f34 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:55:52.673104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c78e7e-bf3d-477d-9bd1-e741793c7f34 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:55:52.679603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e411f-a8d0-4bf0-8041-a269379d3a04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:55:52.680716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e411f-a8d0-4bf0-8041-a269379d3a04 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:52.681062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e411f-a8d0-4bf0-8041-a269379d3a04 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:52.681380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e411f-a8d0-4bf0-8041-a269379d3a04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:52.695454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e411f-a8d0-4bf0-8041-a269379d3a04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:55:52.697915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e411f-a8d0-4bf0-8041-a269379d3a04 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:55:52.719249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec7057-3262-4191-af16-b2ec818516d4 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:55:52.721404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-baec7057-3262-4191-af16-b2ec818516d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:52.722458 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1903/3778] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:55:52 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:55:52.867423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec7057-3262-4191-af16-b2ec818516d4 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:55:52.891314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93436663-8db4-4134-80b5-a609a8b864ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:55:52.893032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93436663-8db4-4134-80b5-a609a8b864ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:52.893535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93436663-8db4-4134-80b5-a609a8b864ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:52.894144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93436663-8db4-4134-80b5-a609a8b864ea admin admin] PATH_INFO: `/v3/users/650adb96560b4df88f6c73f97a25d524` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:52.895805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93436663-8db4-4134-80b5-a609a8b864ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=650adb96560b4df88f6c73f97a25d524)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:55:52.898384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93436663-8db4-4134-80b5-a609a8b864ea admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:55:52.985255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-93436663-8db4-4134-80b5-a609a8b864ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '650adb96560b4df88f6c73f97a25d524'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:55:53.005004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-93436663-8db4-4134-80b5-a609a8b864ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '650adb96560b4df88f6c73f97a25d524'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:55:53.028802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-93436663-8db4-4134-80b5-a609a8b864ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '650adb96560b4df88f6c73f97a25d524'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:55:53.030451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-93436663-8db4-4134-80b5-a609a8b864ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '650adb96560b4df88f6c73f97a25d524'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:55:53.043937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-93436663-8db4-4134-80b5-a609a8b864ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '650adb96560b4df88f6c73f97a25d524'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:55:53.058768 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1876/3779] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:55:52 2021] DELETE /identity/v3/users/650adb96560b4df88f6c73f97a25d524 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:55:53.060246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9f9b9-50e2-49df-af80-9ecace0445ab None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:53.060806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9f9b9-50e2-49df-af80-9ecace0445ab None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:53.061295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9f9b9-50e2-49df-af80-9ecace0445ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:53.095952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f5d9f9b9-50e2-49df-af80-9ecace0445ab None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:55:53.097921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f5d9f9b9-50e2-49df-af80-9ecace0445ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:53.216565 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1904/3780] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:55:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:55:53.226976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93436663-8db4-4134-80b5-a609a8b864ea admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:55:53.228688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-93436663-8db4-4134-80b5-a609a8b864ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:53.301357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93436663-8db4-4134-80b5-a609a8b864ea admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:55:53.307307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f185e3-c417-452c-86aa-7e0883a9c307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:55:53.308202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f185e3-c417-452c-86aa-7e0883a9c307 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:53.308689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f185e3-c417-452c-86aa-7e0883a9c307 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:53.309278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f185e3-c417-452c-86aa-7e0883a9c307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:53.322175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f185e3-c417-452c-86aa-7e0883a9c307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:55:53.323889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f185e3-c417-452c-86aa-7e0883a9c307 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:55:53.361083 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1877/3781] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:55:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:55:53.572986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9f9b9-50e2-49df-af80-9ecace0445ab None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:55:53.574854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f5d9f9b9-50e2-49df-af80-9ecace0445ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:53.597954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9f9b9-50e2-49df-af80-9ecace0445ab None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:55:53.617847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d59370-7ac4-4459-a87e-d376d08326ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:55:53.619386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d59370-7ac4-4459-a87e-d376d08326ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:53.619890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d59370-7ac4-4459-a87e-d376d08326ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:53.620388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d59370-7ac4-4459-a87e-d376d08326ab admin admin] PATH_INFO: `/v3/projects/ed6e45b689fc4b15afe7d5ba12fe9fa3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:53.622429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d59370-7ac4-4459-a87e-d376d08326ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed6e45b689fc4b15afe7d5ba12fe9fa3)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:55:53.625961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d59370-7ac4-4459-a87e-d376d08326ab admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:55:53.715123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4d59370-7ac4-4459-a87e-d376d08326ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed6e45b689fc4b15afe7d5ba12fe9fa3', 'request_id': 'req-e4d59370-7ac4-4459-a87e-d376d08326ab'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:55:53.723128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4d59370-7ac4-4459-a87e-d376d08326ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed6e45b689fc4b15afe7d5ba12fe9fa3', 'request_id': 'req-e4d59370-7ac4-4459-a87e-d376d08326ab'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:55:53.745769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4d59370-7ac4-4459-a87e-d376d08326ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed6e45b689fc4b15afe7d5ba12fe9fa3', 'request_id': 'req-e4d59370-7ac4-4459-a87e-d376d08326ab'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:55:53.769969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4d59370-7ac4-4459-a87e-d376d08326ab admin admin] The token cache is being invalidate because project ed6e45b689fc4b15afe7d5ba12fe9fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:55:53.770284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4d59370-7ac4-4459-a87e-d376d08326ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:55:53.772148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4d59370-7ac4-4459-a87e-d376d08326ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:55:53.774617 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1905/3782] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:55:53 2021] DELETE /identity/v3/projects/ed6e45b689fc4b15afe7d5ba12fe9fa3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:55:53.781814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a1506-67b5-4ec1-8182-cf44cd6e8fc1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:53.782302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a1506-67b5-4ec1-8182-cf44cd6e8fc1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:53.782460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a1506-67b5-4ec1-8182-cf44cd6e8fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:53.811793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-757a1506-67b5-4ec1-8182-cf44cd6e8fc1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:55:53.813845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-757a1506-67b5-4ec1-8182-cf44cd6e8fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:53.916618 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1878/3783] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:55:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:55:53.918389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f233110-819a-4c56-bc11-31507fac6aba None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:53.918684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f233110-819a-4c56-bc11-31507fac6aba None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:53.918969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f233110-819a-4c56-bc11-31507fac6aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:53.952916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1f233110-819a-4c56-bc11-31507fac6aba None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:55:53.955035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1f233110-819a-4c56-bc11-31507fac6aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:53.969769 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1906/3784] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:55:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:55:53.974010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a1506-67b5-4ec1-8182-cf44cd6e8fc1 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:55:54.003249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a1506-67b5-4ec1-8182-cf44cd6e8fc1 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:55:54.029265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ed544-3a29-4168-bb85-6bba61628eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:55:54.029957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ed544-3a29-4168-bb85-6bba61628eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:54.030244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ed544-3a29-4168-bb85-6bba61628eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:54.030548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ed544-3a29-4168-bb85-6bba61628eb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:54.031297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ed544-3a29-4168-bb85-6bba61628eb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:55:54.031609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ed544-3a29-4168-bb85-6bba61628eb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:55:54.035898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ed544-3a29-4168-bb85-6bba61628eb8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:55:54.062642 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1879/3785] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:55:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:55:54.064502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f233110-819a-4c56-bc11-31507fac6aba None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:55:54.078862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f233110-819a-4c56-bc11-31507fac6aba None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:55:54.097751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea2a36-57bf-472d-b7c5-eb31f1351d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:55:54.098452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea2a36-57bf-472d-b7c5-eb31f1351d45 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:54.098738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea2a36-57bf-472d-b7c5-eb31f1351d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:54.099019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea2a36-57bf-472d-b7c5-eb31f1351d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:54.099954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea2a36-57bf-472d-b7c5-eb31f1351d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:55:54.101755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea2a36-57bf-472d-b7c5-eb31f1351d45 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:55:54.180330 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1907/3786] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:55:54 2021] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:55:54.184382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ed544-3a29-4168-bb85-6bba61628eb8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:55:54.198893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ed544-3a29-4168-bb85-6bba61628eb8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:55:54.312171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67175eaa-12af-43ab-b7dd-df3e5a213480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:55:54.313508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67175eaa-12af-43ab-b7dd-df3e5a213480 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:54.313685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67175eaa-12af-43ab-b7dd-df3e5a213480 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:54.313969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67175eaa-12af-43ab-b7dd-df3e5a213480 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:54.316498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67175eaa-12af-43ab-b7dd-df3e5a213480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:55:54.320680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67175eaa-12af-43ab-b7dd-df3e5a213480 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:55:54.362172 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1880/3787] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:55:54 2021] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:55:54.366763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea2a36-57bf-472d-b7c5-eb31f1351d45 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:55:54.383038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea2a36-57bf-472d-b7c5-eb31f1351d45 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:55:54.388824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d468e13-82d4-4e87-bb7c-809603977b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:55:54.390001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d468e13-82d4-4e87-bb7c-809603977b91 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:54.390755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d468e13-82d4-4e87-bb7c-809603977b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:54.391239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d468e13-82d4-4e87-bb7c-809603977b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:54.392632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d468e13-82d4-4e87-bb7c-809603977b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:55:54.394927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d468e13-82d4-4e87-bb7c-809603977b91 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:55:54.411200 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1908/3788] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:55:54 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:55:54.417218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67175eaa-12af-43ab-b7dd-df3e5a213480 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:55:54.442201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67175eaa-12af-43ab-b7dd-df3e5a213480 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:55:54.450466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada3e43-5501-4bf5-912d-57de8de0c1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:55:54.450466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada3e43-5501-4bf5-912d-57de8de0c1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:54.450466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada3e43-5501-4bf5-912d-57de8de0c1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:54.451719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada3e43-5501-4bf5-912d-57de8de0c1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:54.452868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada3e43-5501-4bf5-912d-57de8de0c1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:55:54.454532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada3e43-5501-4bf5-912d-57de8de0c1d3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:55:54.483090 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1881/3789] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:55:54 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:55:54.484361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d468e13-82d4-4e87-bb7c-809603977b91 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:55:54.500686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d468e13-82d4-4e87-bb7c-809603977b91 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:55:54.510960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d754e-02d0-45e2-adb0-b43d774f04a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:55:54.511885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d754e-02d0-45e2-adb0-b43d774f04a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:54.512523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d754e-02d0-45e2-adb0-b43d774f04a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:54.513174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d754e-02d0-45e2-adb0-b43d774f04a6 admin admin] PATH_INFO: `/v3/projects/e714282bda974a68b3f22e10787fc062/users/a3a1f2601e924207a2a52bc20311ae83/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:54.557620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d754e-02d0-45e2-adb0-b43d774f04a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e714282bda974a68b3f22e10787fc062, user_id=a3a1f2601e924207a2a52bc20311ae83, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:55:54.560401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d754e-02d0-45e2-adb0-b43d774f04a6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:55:54.581341 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1909/3790] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:55:54 2021] PUT /identity/v3/projects/e714282bda974a68b3f22e10787fc062/users/a3a1f2601e924207a2a52bc20311ae83/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:55:54.595733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca636a-fbd5-4296-853c-0516ec140fbf None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:54.596611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca636a-fbd5-4296-853c-0516ec140fbf None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:54.597199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca636a-fbd5-4296-853c-0516ec140fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:54.635527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-abca636a-fbd5-4296-853c-0516ec140fbf None None] MFA Rules not processed for user `a3a1f2601e924207a2a52bc20311ae83`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:55:54.637648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-abca636a-fbd5-4296-853c-0516ec140fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:54.762321 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1882/3791] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:55:54 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:55:54.775203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d754e-02d0-45e2-adb0-b43d774f04a6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:55:54.777329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6b6d754e-02d0-45e2-adb0-b43d774f04a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:55:54.876163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d754e-02d0-45e2-adb0-b43d774f04a6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:55:54.880223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581a4fa-7d5c-4aa6-bc3f-dbe55e955393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:55:54.881132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581a4fa-7d5c-4aa6-bc3f-dbe55e955393 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:55:54.881422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581a4fa-7d5c-4aa6-bc3f-dbe55e955393 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:55:54.881710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581a4fa-7d5c-4aa6-bc3f-dbe55e955393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:55:54.890720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581a4fa-7d5c-4aa6-bc3f-dbe55e955393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:55:54.892421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581a4fa-7d5c-4aa6-bc3f-dbe55e955393 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:55:54.903773 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1910/3792] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:55:54 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:56:16.862651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca636a-fbd5-4296-853c-0516ec140fbf None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:16.865709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-abca636a-fbd5-4296-853c-0516ec140fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:16.961851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca636a-fbd5-4296-853c-0516ec140fbf None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:16.967470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39664a66-ef79-46f1-a21b-9e8e50c47ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:16.969325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39664a66-ef79-46f1-a21b-9e8e50c47ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:16.969547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39664a66-ef79-46f1-a21b-9e8e50c47ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:16.969875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39664a66-ef79-46f1-a21b-9e8e50c47ad6 admin admin] PATH_INFO: `/v3/users/ad564476e1cf4a0b87fef4e3d08e6726` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:16.971809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39664a66-ef79-46f1-a21b-9e8e50c47ad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad564476e1cf4a0b87fef4e3d08e6726)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:16.974820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39664a66-ef79-46f1-a21b-9e8e50c47ad6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:17.046789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-39664a66-ef79-46f1-a21b-9e8e50c47ad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad564476e1cf4a0b87fef4e3d08e6726'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:17.065433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-39664a66-ef79-46f1-a21b-9e8e50c47ad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad564476e1cf4a0b87fef4e3d08e6726'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:17.085481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-39664a66-ef79-46f1-a21b-9e8e50c47ad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad564476e1cf4a0b87fef4e3d08e6726'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:17.086828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-39664a66-ef79-46f1-a21b-9e8e50c47ad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad564476e1cf4a0b87fef4e3d08e6726'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:17.098155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-39664a66-ef79-46f1-a21b-9e8e50c47ad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad564476e1cf4a0b87fef4e3d08e6726'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:17.118347 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1883/3793] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:56:16 2021] DELETE /identity/v3/users/ad564476e1cf4a0b87fef4e3d08e6726 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:17.381493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581a4fa-7d5c-4aa6-bc3f-dbe55e955393 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:17.394448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581a4fa-7d5c-4aa6-bc3f-dbe55e955393 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:17.493072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f87a6-049f-4d1d-8be3-8bf82b0eb229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:17.494239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f87a6-049f-4d1d-8be3-8bf82b0eb229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:17.494779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f87a6-049f-4d1d-8be3-8bf82b0eb229 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:17.495204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f87a6-049f-4d1d-8be3-8bf82b0eb229 admin admin] PATH_INFO: `/v3/projects/eaf2a3560d8e4c1993aa5a1dfdac5b4e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:17.496712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f87a6-049f-4d1d-8be3-8bf82b0eb229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaf2a3560d8e4c1993aa5a1dfdac5b4e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:17.498897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f87a6-049f-4d1d-8be3-8bf82b0eb229 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:17.554198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-645f87a6-049f-4d1d-8be3-8bf82b0eb229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'request_id': 'req-645f87a6-049f-4d1d-8be3-8bf82b0eb229'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:17.561996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-645f87a6-049f-4d1d-8be3-8bf82b0eb229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'request_id': 'req-645f87a6-049f-4d1d-8be3-8bf82b0eb229'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:17.572614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-645f87a6-049f-4d1d-8be3-8bf82b0eb229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaf2a3560d8e4c1993aa5a1dfdac5b4e', 'request_id': 'req-645f87a6-049f-4d1d-8be3-8bf82b0eb229'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:17.589547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-645f87a6-049f-4d1d-8be3-8bf82b0eb229 admin admin] The token cache is being invalidate because project eaf2a3560d8e4c1993aa5a1dfdac5b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:56:17.589950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-645f87a6-049f-4d1d-8be3-8bf82b0eb229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:17.590571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-645f87a6-049f-4d1d-8be3-8bf82b0eb229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:17.592300 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1911/3794] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:17 2021] DELETE /identity/v3/projects/eaf2a3560d8e4c1993aa5a1dfdac5b4e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:17.601289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f891b3-52f7-4fa0-bed1-4b23ceaf92b8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:17.601787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f891b3-52f7-4fa0-bed1-4b23ceaf92b8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:17.602156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f891b3-52f7-4fa0-bed1-4b23ceaf92b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:17.627199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-64f891b3-52f7-4fa0-bed1-4b23ceaf92b8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:17.629304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-64f891b3-52f7-4fa0-bed1-4b23ceaf92b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:17.785766 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1884/3795] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:56:17.792909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16424f5a-db4f-48cb-a441-5786b2e92b8c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:17.793277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16424f5a-db4f-48cb-a441-5786b2e92b8c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:17.793634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16424f5a-db4f-48cb-a441-5786b2e92b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:17.816380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-16424f5a-db4f-48cb-a441-5786b2e92b8c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:17.819356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-16424f5a-db4f-48cb-a441-5786b2e92b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:17.830326 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1912/3796] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:17.836080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f891b3-52f7-4fa0-bed1-4b23ceaf92b8 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:17.851193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f891b3-52f7-4fa0-bed1-4b23ceaf92b8 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:17.862392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86789949-9a77-481d-a08d-6bed8daa4928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:17.864153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789949-9a77-481d-a08d-6bed8daa4928 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:17.865056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789949-9a77-481d-a08d-6bed8daa4928 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:17.865764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789949-9a77-481d-a08d-6bed8daa4928 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:17.867741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86789949-9a77-481d-a08d-6bed8daa4928 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:56:17.868595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86789949-9a77-481d-a08d-6bed8daa4928 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:17.874189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86789949-9a77-481d-a08d-6bed8daa4928 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:17.896324 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1885/3797] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:56:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:56:17.903251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16424f5a-db4f-48cb-a441-5786b2e92b8c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:17.920441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16424f5a-db4f-48cb-a441-5786b2e92b8c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:17.929726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35450e-a824-47cd-8a0b-352bae180bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:17.931385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35450e-a824-47cd-8a0b-352bae180bdb admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:17.932127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35450e-a824-47cd-8a0b-352bae180bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:17.932728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35450e-a824-47cd-8a0b-352bae180bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:17.936484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35450e-a824-47cd-8a0b-352bae180bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:17.940281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35450e-a824-47cd-8a0b-352bae180bdb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:18.001187 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1913/3798] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:56:17 2021] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:56:18.004404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86789949-9a77-481d-a08d-6bed8daa4928 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:18.017515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86789949-9a77-481d-a08d-6bed8daa4928 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:18.099284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8b6fb-49a3-4093-8eba-430bdc340895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:18.099977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8b6fb-49a3-4093-8eba-430bdc340895 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:18.100261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8b6fb-49a3-4093-8eba-430bdc340895 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:18.100597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8b6fb-49a3-4093-8eba-430bdc340895 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:18.101472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8b6fb-49a3-4093-8eba-430bdc340895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:18.103723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8b6fb-49a3-4093-8eba-430bdc340895 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:18.128376 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1886/3799] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:56:18 2021] POST /identity/v3/users => generated 297 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:56:18.132789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35450e-a824-47cd-8a0b-352bae180bdb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:18.145651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35450e-a824-47cd-8a0b-352bae180bdb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:18.151670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c3d3c-c1d0-4d30-ab69-103d95d08664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:18.152511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c3d3c-c1d0-4d30-ab69-103d95d08664 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:18.152998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c3d3c-c1d0-4d30-ab69-103d95d08664 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:18.153281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c3d3c-c1d0-4d30-ab69-103d95d08664 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:18.154027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c3d3c-c1d0-4d30-ab69-103d95d08664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:18.156233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c3d3c-c1d0-4d30-ab69-103d95d08664 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:18.170828 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1914/3800] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:56:18 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:56:18.176465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8b6fb-49a3-4093-8eba-430bdc340895 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:18.188414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8b6fb-49a3-4093-8eba-430bdc340895 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:18.196429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1e941-c10d-4a31-9858-b83dd817bd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:18.197404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1e941-c10d-4a31-9858-b83dd817bd64 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:18.198118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1e941-c10d-4a31-9858-b83dd817bd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:18.198118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1e941-c10d-4a31-9858-b83dd817bd64 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:18.199026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1e941-c10d-4a31-9858-b83dd817bd64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:18.201285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1e941-c10d-4a31-9858-b83dd817bd64 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:18.219007 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1887/3801] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:56:18 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:56:18.219445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c3d3c-c1d0-4d30-ab69-103d95d08664 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:18.247649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c3d3c-c1d0-4d30-ab69-103d95d08664 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:18.263750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c5e6a-0990-42a9-9f39-f347643f3e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:18.265931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c5e6a-0990-42a9-9f39-f347643f3e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:18.266347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c5e6a-0990-42a9-9f39-f347643f3e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:18.266723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c5e6a-0990-42a9-9f39-f347643f3e28 admin admin] PATH_INFO: `/v3/projects/c2aba7bee78744949dc3323cb4c7df55/users/4ceb4b626d5f479b9e28dd26702d9d1e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:18.298608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c5e6a-0990-42a9-9f39-f347643f3e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2aba7bee78744949dc3323cb4c7df55, user_id=4ceb4b626d5f479b9e28dd26702d9d1e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:18.310372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c5e6a-0990-42a9-9f39-f347643f3e28 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:18.346831 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1915/3802] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:56:18 2021] PUT /identity/v3/projects/c2aba7bee78744949dc3323cb4c7df55/users/4ceb4b626d5f479b9e28dd26702d9d1e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:56:18.349180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775d8d7-ef71-4479-988f-c8cb2c0fd4b9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:18.349523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775d8d7-ef71-4479-988f-c8cb2c0fd4b9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:18.349830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775d8d7-ef71-4479-988f-c8cb2c0fd4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:18.387493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6775d8d7-ef71-4479-988f-c8cb2c0fd4b9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:18.388753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6775d8d7-ef71-4479-988f-c8cb2c0fd4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:18.530312 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1888/3803] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:18.540349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c5e6a-0990-42a9-9f39-f347643f3e28 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:18.542489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-392c5e6a-0990-42a9-9f39-f347643f3e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:18.644954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c5e6a-0990-42a9-9f39-f347643f3e28 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:18.650885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc1590-7faf-4e6b-ae2c-5822e4005e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:18.652484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc1590-7faf-4e6b-ae2c-5822e4005e7b service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:18.652773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc1590-7faf-4e6b-ae2c-5822e4005e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:18.653265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc1590-7faf-4e6b-ae2c-5822e4005e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:18.670302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc1590-7faf-4e6b-ae2c-5822e4005e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:18.672868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc1590-7faf-4e6b-ae2c-5822e4005e7b service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:18.693291 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1916/3804] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:56:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:56:20.265829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8821a70-f7a8-4ce6-8450-ccf2c0be65a8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:20.266219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8821a70-f7a8-4ce6-8450-ccf2c0be65a8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:20.266429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8821a70-f7a8-4ce6-8450-ccf2c0be65a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:20.307436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e8821a70-f7a8-4ce6-8450-ccf2c0be65a8 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:20.313161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e8821a70-f7a8-4ce6-8450-ccf2c0be65a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:20.453594 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1889/3805] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:56:20 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:20.469327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc1590-7faf-4e6b-ae2c-5822e4005e7b service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:20.470832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-08dc1590-7faf-4e6b-ae2c-5822e4005e7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:20.633948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc1590-7faf-4e6b-ae2c-5822e4005e7b service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:20.649929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274546b-8c4d-45db-ab2c-3c5afe534cf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:20.651768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274546b-8c4d-45db-ab2c-3c5afe534cf3 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:20.653040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274546b-8c4d-45db-ab2c-3c5afe534cf3 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:20.654760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274546b-8c4d-45db-ab2c-3c5afe534cf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:20.678104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274546b-8c4d-45db-ab2c-3c5afe534cf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:20.680500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274546b-8c4d-45db-ab2c-3c5afe534cf3 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:20.740534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a6250-18f2-4ef3-9b1c-c0a0157b7256 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:20.741136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a6250-18f2-4ef3-9b1c-c0a0157b7256 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:20.741866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a6250-18f2-4ef3-9b1c-c0a0157b7256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:20.745036 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1917/3806] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:56:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:56:20.781653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a30a6250-18f2-4ef3-9b1c-c0a0157b7256 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:20.783248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a30a6250-18f2-4ef3-9b1c-c0a0157b7256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:20.810832 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1890/3807] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:56:20 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:20.878646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274546b-8c4d-45db-ab2c-3c5afe534cf3 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:20.904018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274546b-8c4d-45db-ab2c-3c5afe534cf3 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:20.921894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a05e56-6e6d-42ce-9f50-3d1b081a7a51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:20.924133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a05e56-6e6d-42ce-9f50-3d1b081a7a51 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:20.926440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a05e56-6e6d-42ce-9f50-3d1b081a7a51 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:20.926931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a05e56-6e6d-42ce-9f50-3d1b081a7a51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:20.945798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a05e56-6e6d-42ce-9f50-3d1b081a7a51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:20.951256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a05e56-6e6d-42ce-9f50-3d1b081a7a51 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:20.984114 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1918/3808] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:56:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:56:28.168806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a6250-18f2-4ef3-9b1c-c0a0157b7256 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:28.170290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a30a6250-18f2-4ef3-9b1c-c0a0157b7256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:28.197484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a6250-18f2-4ef3-9b1c-c0a0157b7256 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:28.211006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddc6d7-65b6-45d9-84f3-347b32b6b766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:28.211939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddc6d7-65b6-45d9-84f3-347b32b6b766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:28.212225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddc6d7-65b6-45d9-84f3-347b32b6b766 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:28.212502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddc6d7-65b6-45d9-84f3-347b32b6b766 admin admin] PATH_INFO: `/v3/users/a3a1f2601e924207a2a52bc20311ae83` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:28.213767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddc6d7-65b6-45d9-84f3-347b32b6b766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a1f2601e924207a2a52bc20311ae83)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:28.215719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddc6d7-65b6-45d9-84f3-347b32b6b766 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:28.322828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7eddc6d7-65b6-45d9-84f3-347b32b6b766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a1f2601e924207a2a52bc20311ae83'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:28.342437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7eddc6d7-65b6-45d9-84f3-347b32b6b766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a1f2601e924207a2a52bc20311ae83'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:28.386742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7eddc6d7-65b6-45d9-84f3-347b32b6b766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a1f2601e924207a2a52bc20311ae83'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:28.388779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7eddc6d7-65b6-45d9-84f3-347b32b6b766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a1f2601e924207a2a52bc20311ae83'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:28.404060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7eddc6d7-65b6-45d9-84f3-347b32b6b766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a1f2601e924207a2a52bc20311ae83'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:28.416366 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1891/3809] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:56:28 2021] DELETE /identity/v3/users/a3a1f2601e924207a2a52bc20311ae83 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:28.418018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215fc45-e593-4c9b-b1d9-c45c7fc8de39 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:28.418605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215fc45-e593-4c9b-b1d9-c45c7fc8de39 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:28.418854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215fc45-e593-4c9b-b1d9-c45c7fc8de39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:28.456226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f215fc45-e593-4c9b-b1d9-c45c7fc8de39 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:28.458693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f215fc45-e593-4c9b-b1d9-c45c7fc8de39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:28.593381 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1919/3810] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:28.608833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddc6d7-65b6-45d9-84f3-347b32b6b766 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:28.608833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7eddc6d7-65b6-45d9-84f3-347b32b6b766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:28.746983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddc6d7-65b6-45d9-84f3-347b32b6b766 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:28.752546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f177a25-cc92-4a59-82b4-c56fb2a0de15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:28.753219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f177a25-cc92-4a59-82b4-c56fb2a0de15 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:28.753503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f177a25-cc92-4a59-82b4-c56fb2a0de15 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:28.753783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f177a25-cc92-4a59-82b4-c56fb2a0de15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:28.777140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f177a25-cc92-4a59-82b4-c56fb2a0de15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:28.778618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f177a25-cc92-4a59-82b4-c56fb2a0de15 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:28.804577 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1892/3811] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:56:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:56:29.273765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215fc45-e593-4c9b-b1d9-c45c7fc8de39 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:29.275487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f215fc45-e593-4c9b-b1d9-c45c7fc8de39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:29.298601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215fc45-e593-4c9b-b1d9-c45c7fc8de39 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:29.304306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a29dc-cd39-4502-9ae0-3855ca6a767d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:29.306057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a29dc-cd39-4502-9ae0-3855ca6a767d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:29.307153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a29dc-cd39-4502-9ae0-3855ca6a767d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:29.307632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a29dc-cd39-4502-9ae0-3855ca6a767d admin admin] PATH_INFO: `/v3/projects/e714282bda974a68b3f22e10787fc062` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:29.309169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a29dc-cd39-4502-9ae0-3855ca6a767d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e714282bda974a68b3f22e10787fc062)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:29.311319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a29dc-cd39-4502-9ae0-3855ca6a767d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:29.421014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-db1a29dc-cd39-4502-9ae0-3855ca6a767d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e714282bda974a68b3f22e10787fc062', 'request_id': 'req-db1a29dc-cd39-4502-9ae0-3855ca6a767d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:29.435310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-db1a29dc-cd39-4502-9ae0-3855ca6a767d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e714282bda974a68b3f22e10787fc062', 'request_id': 'req-db1a29dc-cd39-4502-9ae0-3855ca6a767d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:29.452894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-db1a29dc-cd39-4502-9ae0-3855ca6a767d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e714282bda974a68b3f22e10787fc062', 'request_id': 'req-db1a29dc-cd39-4502-9ae0-3855ca6a767d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:29.478063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-db1a29dc-cd39-4502-9ae0-3855ca6a767d admin admin] The token cache is being invalidate because project e714282bda974a68b3f22e10787fc062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:56:29.478579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-db1a29dc-cd39-4502-9ae0-3855ca6a767d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:29.486744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529142-9b31-4d67-b4e6-203103fb019c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:29.487903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529142-9b31-4d67-b4e6-203103fb019c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:29.488403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529142-9b31-4d67-b4e6-203103fb019c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:29.493269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-db1a29dc-cd39-4502-9ae0-3855ca6a767d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:29.499240 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1920/3812] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:29 2021] DELETE /identity/v3/projects/e714282bda974a68b3f22e10787fc062 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:29.507413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc1cf2-ba72-430c-bc0e-6fbfe6888557 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:29.507701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc1cf2-ba72-430c-bc0e-6fbfe6888557 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:29.507986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc1cf2-ba72-430c-bc0e-6fbfe6888557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:29.536185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b8dc1cf2-ba72-430c-bc0e-6fbfe6888557 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:29.537650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b8dc1cf2-ba72-430c-bc0e-6fbfe6888557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:29.553509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-16529142-9b31-4d67-b4e6-203103fb019c None None] MFA Rules not processed for user `4ceb4b626d5f479b9e28dd26702d9d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:29.555403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-16529142-9b31-4d67-b4e6-203103fb019c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:29.717232 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1921/3813] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:29.729356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb699b1-bf98-4c28-a7a3-0547b7e2b17a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:29.729656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb699b1-bf98-4c28-a7a3-0547b7e2b17a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:29.729938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb699b1-bf98-4c28-a7a3-0547b7e2b17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:29.753643 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1893/3814] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:29 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:29.763174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcecb7-ba47-46fe-a40e-770cb5403de7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:29.763480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcecb7-ba47-46fe-a40e-770cb5403de7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:29.763807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcecb7-ba47-46fe-a40e-770cb5403de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:29.795044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-dbb699b1-bf98-4c28-a7a3-0547b7e2b17a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:29.798552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dbb699b1-bf98-4c28-a7a3-0547b7e2b17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:29.816333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-59fcecb7-ba47-46fe-a40e-770cb5403de7 None None] MFA Rules not processed for user `4ceb4b626d5f479b9e28dd26702d9d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:29.817662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-59fcecb7-ba47-46fe-a40e-770cb5403de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:29.825787 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1922/3815] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:29.832616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb699b1-bf98-4c28-a7a3-0547b7e2b17a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:29.850505 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1894/3816] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:29 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:56:29.856551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb699b1-bf98-4c28-a7a3-0547b7e2b17a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:29.875280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8a9ad-83d8-4e69-9057-261aa3161005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:29.876252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8a9ad-83d8-4e69-9057-261aa3161005 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:29.876797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8a9ad-83d8-4e69-9057-261aa3161005 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:29.877232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8a9ad-83d8-4e69-9057-261aa3161005 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:29.880914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8a9ad-83d8-4e69-9057-261aa3161005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:56:29.881438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8a9ad-83d8-4e69-9057-261aa3161005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:29.885768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8a9ad-83d8-4e69-9057-261aa3161005 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:29.914757 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1923/3817] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:56:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:56:29.917093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcecb7-ba47-46fe-a40e-770cb5403de7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:29.943253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcecb7-ba47-46fe-a40e-770cb5403de7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:29.954561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f805c-4d18-4c2c-af32-6d8b12f0618f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:29.955536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f805c-4d18-4c2c-af32-6d8b12f0618f admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:29.960290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f805c-4d18-4c2c-af32-6d8b12f0618f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:29.961613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f805c-4d18-4c2c-af32-6d8b12f0618f admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:29.964549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f805c-4d18-4c2c-af32-6d8b12f0618f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:29.969464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f805c-4d18-4c2c-af32-6d8b12f0618f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:30.028161 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1895/3818] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:56:29 2021] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:56:30.030475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8a9ad-83d8-4e69-9057-261aa3161005 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:30.053951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8a9ad-83d8-4e69-9057-261aa3161005 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:30.152777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20814ac-d514-427f-8f51-6ce1c4c0b6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:30.153822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20814ac-d514-427f-8f51-6ce1c4c0b6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:30.154409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20814ac-d514-427f-8f51-6ce1c4c0b6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:30.154841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20814ac-d514-427f-8f51-6ce1c4c0b6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:30.155857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20814ac-d514-427f-8f51-6ce1c4c0b6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:30.157942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20814ac-d514-427f-8f51-6ce1c4c0b6c8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:30.220186 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1924/3819] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:56:30 2021] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:56:30.221424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f805c-4d18-4c2c-af32-6d8b12f0618f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:30.238943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f805c-4d18-4c2c-af32-6d8b12f0618f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:30.256082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae4cde-b0bd-4be2-b019-126ee8b4a22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:30.256787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae4cde-b0bd-4be2-b019-126ee8b4a22a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:30.257076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae4cde-b0bd-4be2-b019-126ee8b4a22a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:30.257446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae4cde-b0bd-4be2-b019-126ee8b4a22a admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:30.261396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae4cde-b0bd-4be2-b019-126ee8b4a22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:30.263203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae4cde-b0bd-4be2-b019-126ee8b4a22a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:30.290937 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1896/3820] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:56:30 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:56:30.294711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20814ac-d514-427f-8f51-6ce1c4c0b6c8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:30.311233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20814ac-d514-427f-8f51-6ce1c4c0b6c8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:30.334795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66afe00-da53-44f1-9ced-1bdfb09af9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:30.335483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66afe00-da53-44f1-9ced-1bdfb09af9fb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:30.335773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66afe00-da53-44f1-9ced-1bdfb09af9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:30.336054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66afe00-da53-44f1-9ced-1bdfb09af9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:30.336801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66afe00-da53-44f1-9ced-1bdfb09af9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:30.338453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66afe00-da53-44f1-9ced-1bdfb09af9fb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:30.373483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae4cde-b0bd-4be2-b019-126ee8b4a22a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:30.382605 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1925/3821] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:56:30 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:56:30.392763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae4cde-b0bd-4be2-b019-126ee8b4a22a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:30.410594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd251515-8610-4c49-b889-bcbf00eedb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:30.412113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd251515-8610-4c49-b889-bcbf00eedb2e admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:30.412406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd251515-8610-4c49-b889-bcbf00eedb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:30.412686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd251515-8610-4c49-b889-bcbf00eedb2e admin admin] PATH_INFO: `/v3/projects/1acacc43a32d4cb8ae226b53cd78f92e/users/9b325974d7ea4b42bf73616257c08903/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:30.444156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd251515-8610-4c49-b889-bcbf00eedb2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1acacc43a32d4cb8ae226b53cd78f92e, user_id=9b325974d7ea4b42bf73616257c08903, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:30.446916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd251515-8610-4c49-b889-bcbf00eedb2e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:30.474632 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1897/3822] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:56:30 2021] PUT /identity/v3/projects/1acacc43a32d4cb8ae226b53cd78f92e/users/9b325974d7ea4b42bf73616257c08903/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:56:30.484549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f65a2c-e950-4320-9026-8316b58a45f7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:30.485175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f65a2c-e950-4320-9026-8316b58a45f7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:30.485175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f65a2c-e950-4320-9026-8316b58a45f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:30.543389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-07f65a2c-e950-4320-9026-8316b58a45f7 None None] MFA Rules not processed for user `9b325974d7ea4b42bf73616257c08903`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:30.544561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-07f65a2c-e950-4320-9026-8316b58a45f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:30.681141 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1926/3823] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:30 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:30.685789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd251515-8610-4c49-b889-bcbf00eedb2e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:30.753236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd251515-8610-4c49-b889-bcbf00eedb2e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:30.758389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d07152-505a-4979-bee5-9c6eb03f20b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:30.759219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d07152-505a-4979-bee5-9c6eb03f20b1 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:30.759649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d07152-505a-4979-bee5-9c6eb03f20b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:30.760099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d07152-505a-4979-bee5-9c6eb03f20b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:30.760973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d07152-505a-4979-bee5-9c6eb03f20b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:30.763047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d07152-505a-4979-bee5-9c6eb03f20b1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:30.816039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f65a2c-e950-4320-9026-8316b58a45f7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:30.824009 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1898/3824] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:56:30 2021] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:56:30.829776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f65a2c-e950-4320-9026-8316b58a45f7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:30.952433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9af7a2-85d7-40d2-8b85-59f6d4a16916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:30.953137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9af7a2-85d7-40d2-8b85-59f6d4a16916 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:30.953407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9af7a2-85d7-40d2-8b85-59f6d4a16916 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:30.953684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9af7a2-85d7-40d2-8b85-59f6d4a16916 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:30.954416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9af7a2-85d7-40d2-8b85-59f6d4a16916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:30.965111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9af7a2-85d7-40d2-8b85-59f6d4a16916 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:31.011438 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1927/3825] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:56:30 2021] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:56:31.012983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d07152-505a-4979-bee5-9c6eb03f20b1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:31.029937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d07152-505a-4979-bee5-9c6eb03f20b1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:31.055328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f7196-0b26-4722-b32a-771c35bba4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:31.056178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f7196-0b26-4722-b32a-771c35bba4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:31.056570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f7196-0b26-4722-b32a-771c35bba4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:31.056954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f7196-0b26-4722-b32a-771c35bba4c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:31.057806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f7196-0b26-4722-b32a-771c35bba4c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:31.059538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f7196-0b26-4722-b32a-771c35bba4c5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:31.090691 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1899/3826] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:56:31 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:56:31.095003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9af7a2-85d7-40d2-8b85-59f6d4a16916 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:31.110340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9af7a2-85d7-40d2-8b85-59f6d4a16916 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:31.135355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf4944-b8a9-4f2c-aaa5-317525d1091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:31.136273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4944-b8a9-4f2c-aaa5-317525d1091e admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:31.136558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4944-b8a9-4f2c-aaa5-317525d1091e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:31.136833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4944-b8a9-4f2c-aaa5-317525d1091e admin admin] PATH_INFO: `/v3/projects/20beec2212ad47b49e6a7cd985c81663/users/98302a54d7a7476dadf2356a8c82a57a/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:31.195249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf4944-b8a9-4f2c-aaa5-317525d1091e admin admin] RBAC: Authorizing `identity:create_grant(project_id=20beec2212ad47b49e6a7cd985c81663, user_id=98302a54d7a7476dadf2356a8c82a57a, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:31.198184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf4944-b8a9-4f2c-aaa5-317525d1091e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:31.280746 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1928/3827] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:56:31 2021] PUT /identity/v3/projects/20beec2212ad47b49e6a7cd985c81663/users/98302a54d7a7476dadf2356a8c82a57a/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:31.281788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f7196-0b26-4722-b32a-771c35bba4c5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:31.296237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f7196-0b26-4722-b32a-771c35bba4c5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:31.526141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8949e-46f1-4944-b7c5-6afcf99eb2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:31.526850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8949e-46f1-4944-b7c5-6afcf99eb2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:31.527555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8949e-46f1-4944-b7c5-6afcf99eb2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:31.527555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8949e-46f1-4944-b7c5-6afcf99eb2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:31.528451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8949e-46f1-4944-b7c5-6afcf99eb2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:31.529653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8949e-46f1-4944-b7c5-6afcf99eb2c2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:31.543973 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1900/3828] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:56:31 2021] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:56:31.548144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf4944-b8a9-4f2c-aaa5-317525d1091e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:31.565716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf4944-b8a9-4f2c-aaa5-317525d1091e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:31.571367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa01b22-85f6-4c11-a5b9-d6edb474c118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:31.572283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01b22-85f6-4c11-a5b9-d6edb474c118 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:31.572569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01b22-85f6-4c11-a5b9-d6edb474c118 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:31.572854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01b22-85f6-4c11-a5b9-d6edb474c118 admin admin] PATH_INFO: `/v3/projects/20beec2212ad47b49e6a7cd985c81663/users/98302a54d7a7476dadf2356a8c82a57a/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:31.574978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa01b22-85f6-4c11-a5b9-d6edb474c118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20beec2212ad47b49e6a7cd985c81663, user_id=98302a54d7a7476dadf2356a8c82a57a, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:31.578016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa01b22-85f6-4c11-a5b9-d6edb474c118 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:31.594281 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1929/3829] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:56:31 2021] PUT /identity/v3/projects/20beec2212ad47b49e6a7cd985c81663/users/98302a54d7a7476dadf2356a8c82a57a/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:31.601902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9fd16-fa6f-4318-9b00-6d2346197315 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:31.602874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9fd16-fa6f-4318-9b00-6d2346197315 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:31.603280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9fd16-fa6f-4318-9b00-6d2346197315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:31.640860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fff9fd16-fa6f-4318-9b00-6d2346197315 None None] MFA Rules not processed for user `98302a54d7a7476dadf2356a8c82a57a`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:31.642306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fff9fd16-fa6f-4318-9b00-6d2346197315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:31.785582 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1901/3830] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:31 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:31.797214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa01b22-85f6-4c11-a5b9-d6edb474c118 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:31.799949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0aa01b22-85f6-4c11-a5b9-d6edb474c118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:31.893843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa01b22-85f6-4c11-a5b9-d6edb474c118 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:31.908241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee944ad-31a7-46ca-a582-c58856756725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:31.908787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee944ad-31a7-46ca-a582-c58856756725 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:31.909142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee944ad-31a7-46ca-a582-c58856756725 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:31.909482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee944ad-31a7-46ca-a582-c58856756725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:31.940854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee944ad-31a7-46ca-a582-c58856756725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:31.942514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee944ad-31a7-46ca-a582-c58856756725 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:31.974682 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1930/3831] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:56:31 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:56:32.096534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9fd16-fa6f-4318-9b00-6d2346197315 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:32.116090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9fd16-fa6f-4318-9b00-6d2346197315 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:32.119843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6a027-33be-49de-b778-a1c7a80e65d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:32.120642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6a027-33be-49de-b778-a1c7a80e65d6 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:32.120931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6a027-33be-49de-b778-a1c7a80e65d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:32.121217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6a027-33be-49de-b778-a1c7a80e65d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:32.230925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6a027-33be-49de-b778-a1c7a80e65d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:32.232528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6a027-33be-49de-b778-a1c7a80e65d6 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:32.271544 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1902/3832] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:56:32 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:56:37.170151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee944ad-31a7-46ca-a582-c58856756725 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:37.172085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-eee944ad-31a7-46ca-a582-c58856756725 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:37.306098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee944ad-31a7-46ca-a582-c58856756725 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:37.313450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fa114-e655-4aa1-bd4e-4d225610a4ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:37.314654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fa114-e655-4aa1-bd4e-4d225610a4ae service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:37.317859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fa114-e655-4aa1-bd4e-4d225610a4ae service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:37.318336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fa114-e655-4aa1-bd4e-4d225610a4ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:37.324613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-769fa114-e655-4aa1-bd4e-4d225610a4ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:37.440278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fa114-e655-4aa1-bd4e-4d225610a4ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:37.442319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fa114-e655-4aa1-bd4e-4d225610a4ae service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:37.454579 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1931/3833] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:56:37 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:56:37.543203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6a027-33be-49de-b778-a1c7a80e65d6 service cinder] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:37.546901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0bf6a027-33be-49de-b778-a1c7a80e65d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:37.644506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fa114-e655-4aa1-bd4e-4d225610a4ae service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:37.651110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-769fa114-e655-4aa1-bd4e-4d225610a4ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:37.672398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fa114-e655-4aa1-bd4e-4d225610a4ae service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:37.682017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc365ec3-f78e-42b8-aa79-a3075cb69900 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:37.683038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc365ec3-f78e-42b8-aa79-a3075cb69900 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:37.683491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc365ec3-f78e-42b8-aa79-a3075cb69900 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:37.683927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc365ec3-f78e-42b8-aa79-a3075cb69900 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:37.722721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6a027-33be-49de-b778-a1c7a80e65d6 service cinder] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:37.731542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950649a-4289-4485-a556-2d7ba8cd3c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:37.738169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950649a-4289-4485-a556-2d7ba8cd3c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:37.742897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950649a-4289-4485-a556-2d7ba8cd3c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:37.743388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950649a-4289-4485-a556-2d7ba8cd3c8f admin admin] PATH_INFO: `/v3/users/09d32c08216a4035907c888a3c8cd70f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:37.745535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950649a-4289-4485-a556-2d7ba8cd3c8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d32c08216a4035907c888a3c8cd70f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:37.747768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950649a-4289-4485-a556-2d7ba8cd3c8f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:37.816346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc365ec3-f78e-42b8-aa79-a3075cb69900 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:37.820079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc365ec3-f78e-42b8-aa79-a3075cb69900 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:37.838977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c950649a-4289-4485-a556-2d7ba8cd3c8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d32c08216a4035907c888a3c8cd70f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:37.848701 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1932/3834] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:56:37 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:56:37.849928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc365ec3-f78e-42b8-aa79-a3075cb69900 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:37.856113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cc365ec3-f78e-42b8-aa79-a3075cb69900 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:37.857108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c950649a-4289-4485-a556-2d7ba8cd3c8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d32c08216a4035907c888a3c8cd70f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:37.900307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c950649a-4289-4485-a556-2d7ba8cd3c8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d32c08216a4035907c888a3c8cd70f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:37.901221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c950649a-4289-4485-a556-2d7ba8cd3c8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d32c08216a4035907c888a3c8cd70f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:37.910437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c950649a-4289-4485-a556-2d7ba8cd3c8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d32c08216a4035907c888a3c8cd70f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:37.920808 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1903/3835] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:56:37 2021] DELETE /identity/v3/users/09d32c08216a4035907c888a3c8cd70f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:37.922899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9259d-77cb-4df9-8a71-885620a987e2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:37.923237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9259d-77cb-4df9-8a71-885620a987e2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:37.923529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9259d-77cb-4df9-8a71-885620a987e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:37.948835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f8a9259d-77cb-4df9-8a71-885620a987e2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:37.950068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f8a9259d-77cb-4df9-8a71-885620a987e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:37.965308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc365ec3-f78e-42b8-aa79-a3075cb69900 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:38.022598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f25d9-87f2-4bdc-a0f4-606a1c2ca215 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:38.023719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f25d9-87f2-4bdc-a0f4-606a1c2ca215 service glance] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:38.025681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f25d9-87f2-4bdc-a0f4-606a1c2ca215 service glance] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:38.025974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f25d9-87f2-4bdc-a0f4-606a1c2ca215 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:38.028311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-530f25d9-87f2-4bdc-a0f4-606a1c2ca215 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:38.045046 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1904/3836] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:38.052624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9259d-77cb-4df9-8a71-885620a987e2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:38.054243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f8a9259d-77cb-4df9-8a71-885620a987e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:38.109353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f25d9-87f2-4bdc-a0f4-606a1c2ca215 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:38.111146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f25d9-87f2-4bdc-a0f4-606a1c2ca215 service glance] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:38.120549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9259d-77cb-4df9-8a71-885620a987e2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:38.123417 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1933/3837] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:56:37 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:56:38.124873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3022e8e-9b82-435a-89a2-ae3e23b55de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:38.125726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3022e8e-9b82-435a-89a2-ae3e23b55de1 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:38.126014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3022e8e-9b82-435a-89a2-ae3e23b55de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:38.126324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3022e8e-9b82-435a-89a2-ae3e23b55de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:38.137648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3022e8e-9b82-435a-89a2-ae3e23b55de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:38.139126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3022e8e-9b82-435a-89a2-ae3e23b55de1 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:38.149722 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1905/3838] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:56:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:56:38.339238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f25d9-87f2-4bdc-a0f4-606a1c2ca215 service glance] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:38.340955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-530f25d9-87f2-4bdc-a0f4-606a1c2ca215 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:38.367154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f25d9-87f2-4bdc-a0f4-606a1c2ca215 service glance] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:38.376855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c86b7-a6b3-48cf-ba7c-0feb7f9797c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:38.376855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c86b7-a6b3-48cf-ba7c-0feb7f9797c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:38.377564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c86b7-a6b3-48cf-ba7c-0feb7f9797c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:38.377564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c86b7-a6b3-48cf-ba7c-0feb7f9797c8 admin admin] PATH_INFO: `/v3/projects/f15c3e2ec1194924bee37b0161adc237` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:38.379044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c86b7-a6b3-48cf-ba7c-0feb7f9797c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f15c3e2ec1194924bee37b0161adc237)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:38.392679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c86b7-a6b3-48cf-ba7c-0feb7f9797c8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:38.499503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-207c86b7-a6b3-48cf-ba7c-0feb7f9797c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f15c3e2ec1194924bee37b0161adc237', 'request_id': 'req-207c86b7-a6b3-48cf-ba7c-0feb7f9797c8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:38.509610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-207c86b7-a6b3-48cf-ba7c-0feb7f9797c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f15c3e2ec1194924bee37b0161adc237', 'request_id': 'req-207c86b7-a6b3-48cf-ba7c-0feb7f9797c8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:38.523929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-207c86b7-a6b3-48cf-ba7c-0feb7f9797c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f15c3e2ec1194924bee37b0161adc237', 'request_id': 'req-207c86b7-a6b3-48cf-ba7c-0feb7f9797c8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:38.540563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-207c86b7-a6b3-48cf-ba7c-0feb7f9797c8 admin admin] The token cache is being invalidate because project f15c3e2ec1194924bee37b0161adc237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:56:38.540977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-207c86b7-a6b3-48cf-ba7c-0feb7f9797c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:38.541736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-207c86b7-a6b3-48cf-ba7c-0feb7f9797c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:38.545212 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1934/3839] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:38 2021] DELETE /identity/v3/projects/f15c3e2ec1194924bee37b0161adc237 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:38.548042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3022e8e-9b82-435a-89a2-ae3e23b55de1 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:38.582392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3022e8e-9b82-435a-89a2-ae3e23b55de1 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:38.630147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebd079-38b3-4bd4-85c8-d29bbdf04ac1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:38.630471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebd079-38b3-4bd4-85c8-d29bbdf04ac1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:38.630802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebd079-38b3-4bd4-85c8-d29bbdf04ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:38.651880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e5ebd079-38b3-4bd4-85c8-d29bbdf04ac1 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:38.653233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e5ebd079-38b3-4bd4-85c8-d29bbdf04ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:38.663876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0024d-9278-40fb-9d88-615033bfae29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:38.664954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0024d-9278-40fb-9d88-615033bfae29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:38.665328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0024d-9278-40fb-9d88-615033bfae29 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:38.665735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0024d-9278-40fb-9d88-615033bfae29 admin admin] PATH_INFO: `/v3/users/2f2372afe520416386d5e961633ba6dc` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:38.667621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0024d-9278-40fb-9d88-615033bfae29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f2372afe520416386d5e961633ba6dc)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:38.670007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0024d-9278-40fb-9d88-615033bfae29 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:38.728374 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1935/3840] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:56:38 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:38.743972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebd079-38b3-4bd4-85c8-d29bbdf04ac1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:38.746083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e5ebd079-38b3-4bd4-85c8-d29bbdf04ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:38.746667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8ca0024d-9278-40fb-9d88-615033bfae29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f2372afe520416386d5e961633ba6dc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:38.763685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8ca0024d-9278-40fb-9d88-615033bfae29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f2372afe520416386d5e961633ba6dc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:38.783035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8ca0024d-9278-40fb-9d88-615033bfae29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f2372afe520416386d5e961633ba6dc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:38.783882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8ca0024d-9278-40fb-9d88-615033bfae29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f2372afe520416386d5e961633ba6dc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:38.794070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8ca0024d-9278-40fb-9d88-615033bfae29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f2372afe520416386d5e961633ba6dc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:38.804756 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1906/3841] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:56:38 2021] DELETE /identity/v3/users/2f2372afe520416386d5e961633ba6dc => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:38.841300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebd079-38b3-4bd4-85c8-d29bbdf04ac1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:38.944638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f5923-009b-4f6e-87f5-83ef830395d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:38.945735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f5923-009b-4f6e-87f5-83ef830395d1 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:38.946208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f5923-009b-4f6e-87f5-83ef830395d1 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:38.946523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f5923-009b-4f6e-87f5-83ef830395d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:38.948396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e80f5923-009b-4f6e-87f5-83ef830395d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:39.027427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f5923-009b-4f6e-87f5-83ef830395d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:39.030673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f5923-009b-4f6e-87f5-83ef830395d1 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:39.041259 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1936/3842] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:56:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 20:56:39.054482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0024d-9278-40fb-9d88-615033bfae29 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:39.056177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8ca0024d-9278-40fb-9d88-615033bfae29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:39.216838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0024d-9278-40fb-9d88-615033bfae29 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:39.221848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c07e24-2984-4ff7-9948-c40d16e5324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:39.249403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbc752-7eca-4e34-8b2a-1c86701ab85b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:39.249749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbc752-7eca-4e34-8b2a-1c86701ab85b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:39.250042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbc752-7eca-4e34-8b2a-1c86701ab85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:39.252159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07e24-2984-4ff7-9948-c40d16e5324c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:39.252554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07e24-2984-4ff7-9948-c40d16e5324c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:39.252846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07e24-2984-4ff7-9948-c40d16e5324c admin admin] PATH_INFO: `/v3/projects/cc853b43346c4b80a888930d782d7bbc` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:39.256162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c07e24-2984-4ff7-9948-c40d16e5324c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc853b43346c4b80a888930d782d7bbc)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:39.259212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c07e24-2984-4ff7-9948-c40d16e5324c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:39.278713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-23bbc752-7eca-4e34-8b2a-1c86701ab85b None None] MFA Rules not processed for user `4ceb4b626d5f479b9e28dd26702d9d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:39.280371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-23bbc752-7eca-4e34-8b2a-1c86701ab85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:39.380712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a4c07e24-2984-4ff7-9948-c40d16e5324c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc853b43346c4b80a888930d782d7bbc', 'request_id': 'req-a4c07e24-2984-4ff7-9948-c40d16e5324c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:39.397844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a4c07e24-2984-4ff7-9948-c40d16e5324c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc853b43346c4b80a888930d782d7bbc', 'request_id': 'req-a4c07e24-2984-4ff7-9948-c40d16e5324c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:39.417603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a4c07e24-2984-4ff7-9948-c40d16e5324c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc853b43346c4b80a888930d782d7bbc', 'request_id': 'req-a4c07e24-2984-4ff7-9948-c40d16e5324c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:39.433253 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1937/3843] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:39 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:39.450455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a4c07e24-2984-4ff7-9948-c40d16e5324c admin admin] The token cache is being invalidate because project cc853b43346c4b80a888930d782d7bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:56:39.450836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a4c07e24-2984-4ff7-9948-c40d16e5324c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:39.451934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a4c07e24-2984-4ff7-9948-c40d16e5324c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:39.461634 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1907/3844] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:39 2021] DELETE /identity/v3/projects/cc853b43346c4b80a888930d782d7bbc => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:39.462518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefa436-92a3-456d-8b5c-48e6e7e76607 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:39.462807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefa436-92a3-456d-8b5c-48e6e7e76607 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:39.463097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefa436-92a3-456d-8b5c-48e6e7e76607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:39.509745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0cefa436-92a3-456d-8b5c-48e6e7e76607 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:39.509745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0cefa436-92a3-456d-8b5c-48e6e7e76607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:39.634573 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1938/3845] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:39.641048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f14f8-e2a2-4dea-82ab-ff62e9897dbf None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:39.641926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f14f8-e2a2-4dea-82ab-ff62e9897dbf None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:39.642433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f14f8-e2a2-4dea-82ab-ff62e9897dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:39.678325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-626f14f8-e2a2-4dea-82ab-ff62e9897dbf None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:39.679841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-626f14f8-e2a2-4dea-82ab-ff62e9897dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:39.700872 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1908/3846] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:39.705494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefa436-92a3-456d-8b5c-48e6e7e76607 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:39.722094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefa436-92a3-456d-8b5c-48e6e7e76607 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:39.729314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8d61c-1a2b-4313-9482-125b9efa54a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:39.730309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8d61c-1a2b-4313-9482-125b9efa54a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:39.730564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8d61c-1a2b-4313-9482-125b9efa54a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:39.731306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8d61c-1a2b-4313-9482-125b9efa54a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:39.732145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8d61c-1a2b-4313-9482-125b9efa54a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:56:39.732589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8d61c-1a2b-4313-9482-125b9efa54a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:39.734270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8d61c-1a2b-4313-9482-125b9efa54a6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:39.758797 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1939/3847] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:56:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:56:39.762324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f14f8-e2a2-4dea-82ab-ff62e9897dbf None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:39.773861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f14f8-e2a2-4dea-82ab-ff62e9897dbf None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:39.779925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18c11f-be54-46ae-b308-daf489f9896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:39.780978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18c11f-be54-46ae-b308-daf489f9896a admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:39.781410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18c11f-be54-46ae-b308-daf489f9896a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:39.781831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18c11f-be54-46ae-b308-daf489f9896a admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:39.782732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18c11f-be54-46ae-b308-daf489f9896a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:39.784994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18c11f-be54-46ae-b308-daf489f9896a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:39.824078 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1909/3848] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:56:39 2021] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:56:39.827422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8d61c-1a2b-4313-9482-125b9efa54a6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:39.847266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8d61c-1a2b-4313-9482-125b9efa54a6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:39.935283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43513ba-dd34-4cfc-8bf5-e8e13233b6ce None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:39.935643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43513ba-dd34-4cfc-8bf5-e8e13233b6ce None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:39.935867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43513ba-dd34-4cfc-8bf5-e8e13233b6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:39.974913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e43513ba-dd34-4cfc-8bf5-e8e13233b6ce None None] MFA Rules not processed for user `216cd2c0d4b249e797990918152b4749`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:39.976136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e43513ba-dd34-4cfc-8bf5-e8e13233b6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:40.000437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eae152-9e95-4757-806d-9bef6c8f2708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:40.002282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eae152-9e95-4757-806d-9bef6c8f2708 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:40.002282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eae152-9e95-4757-806d-9bef6c8f2708 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:40.002282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eae152-9e95-4757-806d-9bef6c8f2708 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:40.003541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eae152-9e95-4757-806d-9bef6c8f2708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:40.005027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eae152-9e95-4757-806d-9bef6c8f2708 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:40.035287 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1940/3849] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:56:39 2021] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:56:40.041069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eae152-9e95-4757-806d-9bef6c8f2708 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:40.056712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eae152-9e95-4757-806d-9bef6c8f2708 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:40.062048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9454d-54bc-4666-98eb-6bfed91ad5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:40.062756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9454d-54bc-4666-98eb-6bfed91ad5fe admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:40.063042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9454d-54bc-4666-98eb-6bfed91ad5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:40.063320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9454d-54bc-4666-98eb-6bfed91ad5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:40.064365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9454d-54bc-4666-98eb-6bfed91ad5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:40.066025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9454d-54bc-4666-98eb-6bfed91ad5fe admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:40.079231 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1941/3850] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:56:40 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:56:40.083730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9454d-54bc-4666-98eb-6bfed91ad5fe admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:40.094693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9454d-54bc-4666-98eb-6bfed91ad5fe admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:40.099074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3354c-de18-4176-9c22-8bea3e11e487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:40.100185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3354c-de18-4176-9c22-8bea3e11e487 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:40.100185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3354c-de18-4176-9c22-8bea3e11e487 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:40.100472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3354c-de18-4176-9c22-8bea3e11e487 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:40.101272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3354c-de18-4176-9c22-8bea3e11e487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:40.102959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3354c-de18-4176-9c22-8bea3e11e487 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:40.109939 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1910/3851] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:39 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:40.117598 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1942/3852] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:56:40 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:56:40.121374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43513ba-dd34-4cfc-8bf5-e8e13233b6ce None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:40.132662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43513ba-dd34-4cfc-8bf5-e8e13233b6ce None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:40.137433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5404104-b146-438f-8215-46a5fda4aff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:40.138345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5404104-b146-438f-8215-46a5fda4aff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:40.138637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5404104-b146-438f-8215-46a5fda4aff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:40.138920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5404104-b146-438f-8215-46a5fda4aff0 admin admin] PATH_INFO: `/v3/projects/a68dacd8cefc4cc6bba82d5eaa3a4617/users/c09976bc60c449a88031dafb17eebf74/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:40.154557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5404104-b146-438f-8215-46a5fda4aff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a68dacd8cefc4cc6bba82d5eaa3a4617, user_id=c09976bc60c449a88031dafb17eebf74, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:40.157374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5404104-b146-438f-8215-46a5fda4aff0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:40.174489 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1911/3853] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:56:40 2021] PUT /identity/v3/projects/a68dacd8cefc4cc6bba82d5eaa3a4617/users/c09976bc60c449a88031dafb17eebf74/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:56:40.184441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ce3c8-a52d-4f8c-ac33-2fdb9ff7c560 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:40.184767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ce3c8-a52d-4f8c-ac33-2fdb9ff7c560 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:40.185077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ce3c8-a52d-4f8c-ac33-2fdb9ff7c560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:40.216605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ba8ce3c8-a52d-4f8c-ac33-2fdb9ff7c560 None None] MFA Rules not processed for user `c09976bc60c449a88031dafb17eebf74`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:40.218244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ba8ce3c8-a52d-4f8c-ac33-2fdb9ff7c560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:40.304071 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1943/3854] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:40 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:40.308586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5404104-b146-438f-8215-46a5fda4aff0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:40.319314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ce3c8-a52d-4f8c-ac33-2fdb9ff7c560 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:40.324923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ba8ce3c8-a52d-4f8c-ac33-2fdb9ff7c560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:40.397040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5404104-b146-438f-8215-46a5fda4aff0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:40.409421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d169de-0797-42c0-bee6-fcd4f0fa9708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:40.411404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d169de-0797-42c0-bee6-fcd4f0fa9708 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:40.411926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d169de-0797-42c0-bee6-fcd4f0fa9708 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:40.412216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d169de-0797-42c0-bee6-fcd4f0fa9708 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:40.413120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d169de-0797-42c0-bee6-fcd4f0fa9708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:40.413988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ce3c8-a52d-4f8c-ac33-2fdb9ff7c560 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:40.417421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d169de-0797-42c0-bee6-fcd4f0fa9708 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:40.422552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525c0cb-5fe7-4fe4-b0ea-c07927fe382e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:40.423279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c0cb-5fe7-4fe4-b0ea-c07927fe382e service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:40.423742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c0cb-5fe7-4fe4-b0ea-c07927fe382e service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:40.424029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c0cb-5fe7-4fe4-b0ea-c07927fe382e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:40.436324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f525c0cb-5fe7-4fe4-b0ea-c07927fe382e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:40.453289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525c0cb-5fe7-4fe4-b0ea-c07927fe382e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:40.456570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525c0cb-5fe7-4fe4-b0ea-c07927fe382e service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:40.470227 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1944/3855] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:56:40 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:56:40.499526 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1912/3856] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:56:40 2021] POST /identity/v3/projects => generated 375 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:56:40.503767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525c0cb-5fe7-4fe4-b0ea-c07927fe382e service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:40.517108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525c0cb-5fe7-4fe4-b0ea-c07927fe382e service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:40.599791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772574c7-f662-4f61-90f5-08d1c1098936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:40.600877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772574c7-f662-4f61-90f5-08d1c1098936 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:40.601326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772574c7-f662-4f61-90f5-08d1c1098936 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:40.602421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772574c7-f662-4f61-90f5-08d1c1098936 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:40.603805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772574c7-f662-4f61-90f5-08d1c1098936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:40.608243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772574c7-f662-4f61-90f5-08d1c1098936 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:40.648468 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1945/3857] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:56:40 2021] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:56:40.650282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d169de-0797-42c0-bee6-fcd4f0fa9708 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:40.665792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d169de-0797-42c0-bee6-fcd4f0fa9708 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:40.692465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62675ce4-0ea9-4d42-992a-d78f4e6b0a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:40.693333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62675ce4-0ea9-4d42-992a-d78f4e6b0a7f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:40.693627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62675ce4-0ea9-4d42-992a-d78f4e6b0a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:40.693905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62675ce4-0ea9-4d42-992a-d78f4e6b0a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:40.700188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62675ce4-0ea9-4d42-992a-d78f4e6b0a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:40.704723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62675ce4-0ea9-4d42-992a-d78f4e6b0a7f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:40.741212 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1913/3858] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:56:40 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:56:40.745428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772574c7-f662-4f61-90f5-08d1c1098936 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:40.764324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772574c7-f662-4f61-90f5-08d1c1098936 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:40.769929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d376be-2f00-475d-bae7-fbe78c2958ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:40.771640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d376be-2f00-475d-bae7-fbe78c2958ab admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:40.771974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d376be-2f00-475d-bae7-fbe78c2958ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:40.772261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d376be-2f00-475d-bae7-fbe78c2958ab admin admin] PATH_INFO: `/v3/projects/c2f2a9187d5a41c48b39fedce3b16f25/users/4e8e5d8bb8db431789b60b22e5726432/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:40.804253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d376be-2f00-475d-bae7-fbe78c2958ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f2a9187d5a41c48b39fedce3b16f25, user_id=4e8e5d8bb8db431789b60b22e5726432, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:40.821969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d376be-2f00-475d-bae7-fbe78c2958ab admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:40.861593 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1946/3859] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:56:40 2021] PUT /identity/v3/projects/c2f2a9187d5a41c48b39fedce3b16f25/users/4e8e5d8bb8db431789b60b22e5726432/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:40.865025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62675ce4-0ea9-4d42-992a-d78f4e6b0a7f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:40.879825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62675ce4-0ea9-4d42-992a-d78f4e6b0a7f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:40.998156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119d4cf-d250-40b6-a04a-7f3f4fd78ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:41.002753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119d4cf-d250-40b6-a04a-7f3f4fd78ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:41.003094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119d4cf-d250-40b6-a04a-7f3f4fd78ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:41.004601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119d4cf-d250-40b6-a04a-7f3f4fd78ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:41.006295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119d4cf-d250-40b6-a04a-7f3f4fd78ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:41.010358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119d4cf-d250-40b6-a04a-7f3f4fd78ae4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:41.037290 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1914/3860] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:56:40 2021] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:56:41.041770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d376be-2f00-475d-bae7-fbe78c2958ab admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:41.057654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d376be-2f00-475d-bae7-fbe78c2958ab admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:41.072638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b1394-162e-4c0f-8db9-ff8e22bc655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:41.073619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b1394-162e-4c0f-8db9-ff8e22bc655a admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:41.074023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b1394-162e-4c0f-8db9-ff8e22bc655a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:41.074194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b1394-162e-4c0f-8db9-ff8e22bc655a admin admin] PATH_INFO: `/v3/projects/c2f2a9187d5a41c48b39fedce3b16f25/users/4e8e5d8bb8db431789b60b22e5726432/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:41.079748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b1394-162e-4c0f-8db9-ff8e22bc655a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f2a9187d5a41c48b39fedce3b16f25, user_id=4e8e5d8bb8db431789b60b22e5726432, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:41.086927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b1394-162e-4c0f-8db9-ff8e22bc655a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:41.123855 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1947/3861] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:56:41 2021] PUT /identity/v3/projects/c2f2a9187d5a41c48b39fedce3b16f25/users/4e8e5d8bb8db431789b60b22e5726432/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:41.134803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052717a2-e6b6-460a-b576-f2bdc30bf80e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:41.136738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052717a2-e6b6-460a-b576-f2bdc30bf80e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:41.137252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052717a2-e6b6-460a-b576-f2bdc30bf80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:41.170944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-052717a2-e6b6-460a-b576-f2bdc30bf80e None None] MFA Rules not processed for user `4e8e5d8bb8db431789b60b22e5726432`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:41.174299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-052717a2-e6b6-460a-b576-f2bdc30bf80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:41.436672 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1915/3862] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:41 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:41.441579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b1394-162e-4c0f-8db9-ff8e22bc655a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:41.461662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b1394-162e-4c0f-8db9-ff8e22bc655a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:41.491919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab5905-6f8f-4c7d-883a-c6b9dfc7a9b3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8e5d8bb8db431789b60b22e5726432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2f2a9187d5a41c48b39fedce3b16f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:41.492618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab5905-6f8f-4c7d-883a-c6b9dfc7a9b3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:41.492964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab5905-6f8f-4c7d-883a-c6b9dfc7a9b3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:41.493442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab5905-6f8f-4c7d-883a-c6b9dfc7a9b3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:41.494197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab5905-6f8f-4c7d-883a-c6b9dfc7a9b3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:56:41.494789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab5905-6f8f-4c7d-883a-c6b9dfc7a9b3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:41.507991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab5905-6f8f-4c7d-883a-c6b9dfc7a9b3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:41.564270 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1948/3863] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:56:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:56:41.568469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052717a2-e6b6-460a-b576-f2bdc30bf80e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:41.579395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052717a2-e6b6-460a-b576-f2bdc30bf80e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:41.585922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc5bec-e8ac-4ba2-882d-7729e3740050 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8e5d8bb8db431789b60b22e5726432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2f2a9187d5a41c48b39fedce3b16f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:41.586241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc5bec-e8ac-4ba2-882d-7729e3740050 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:41.586790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc5bec-e8ac-4ba2-882d-7729e3740050 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:41.587307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc5bec-e8ac-4ba2-882d-7729e3740050 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:41.589673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc5bec-e8ac-4ba2-882d-7729e3740050 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:41.590659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc5bec-e8ac-4ba2-882d-7729e3740050 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:41.636163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab5905-6f8f-4c7d-883a-c6b9dfc7a9b3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:41.639740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-76ab5905-6f8f-4c7d-883a-c6b9dfc7a9b3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:41.653241 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1916/3864] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:56:41 2021] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:56:41.657897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc5bec-e8ac-4ba2-882d-7729e3740050 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:41.790081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc5bec-e8ac-4ba2-882d-7729e3740050 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:41.803751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab14412-c23d-44ce-a568-1eecdc8a44a4 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8e5d8bb8db431789b60b22e5726432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2f2a9187d5a41c48b39fedce3b16f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:41.804906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab14412-c23d-44ce-a568-1eecdc8a44a4 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:41.805140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab5905-6f8f-4c7d-883a-c6b9dfc7a9b3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:41.805245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab14412-c23d-44ce-a568-1eecdc8a44a4 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:41.805732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab14412-c23d-44ce-a568-1eecdc8a44a4 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:41.806801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab14412-c23d-44ce-a568-1eecdc8a44a4 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:56:41.808238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab14412-c23d-44ce-a568-1eecdc8a44a4 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:41.811018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab14412-c23d-44ce-a568-1eecdc8a44a4 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:41.840731 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1917/3865] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:56:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:56:41.950269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31e20a-5443-49d6-a2e3-cbd49f3ab3b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:41.952167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31e20a-5443-49d6-a2e3-cbd49f3ab3b8 service glance] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:41.953508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31e20a-5443-49d6-a2e3-cbd49f3ab3b8 service glance] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:41.954805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31e20a-5443-49d6-a2e3-cbd49f3ab3b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:41.964528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2a31e20a-5443-49d6-a2e3-cbd49f3ab3b8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:41.986233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab14412-c23d-44ce-a568-1eecdc8a44a4 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:41.988352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-dab14412-c23d-44ce-a568-1eecdc8a44a4 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:42.123754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31e20a-5443-49d6-a2e3-cbd49f3ab3b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:42.127623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31e20a-5443-49d6-a2e3-cbd49f3ab3b8 service glance] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:42.161662 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1949/3866] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:56:41 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:56:42.181144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab14412-c23d-44ce-a568-1eecdc8a44a4 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:42.247218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ed08-53eb-44ee-9a33-9d17e6354628 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:42.247910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ed08-53eb-44ee-9a33-9d17e6354628 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:42.250394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ed08-53eb-44ee-9a33-9d17e6354628 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:42.250691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ed08-53eb-44ee-9a33-9d17e6354628 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:42.271360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944ed08-53eb-44ee-9a33-9d17e6354628 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:42.276418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944ed08-53eb-44ee-9a33-9d17e6354628 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:42.345650 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1918/3867] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:56:41 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:56:42.359868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2187a-c83b-4caa-879c-3e8f6b5c0fb3 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:42.360290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2187a-c83b-4caa-879c-3e8f6b5c0fb3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:42.360544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2187a-c83b-4caa-879c-3e8f6b5c0fb3 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:42.363238 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1950/3868] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:56:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:56:42.371378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ed08-53eb-44ee-9a33-9d17e6354628 service nova] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:56:42.395067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ed08-53eb-44ee-9a33-9d17e6354628 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:42.419104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ed08-53eb-44ee-9a33-9d17e6354628 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:42.459870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec1730-0862-4643-a8d5-8aec1c639fd5 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8e5d8bb8db431789b60b22e5726432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2f2a9187d5a41c48b39fedce3b16f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:42.464187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1730-0862-4643-a8d5-8aec1c639fd5 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:42.464447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1730-0862-4643-a8d5-8aec1c639fd5 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:42.464739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1730-0862-4643-a8d5-8aec1c639fd5 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] PATH_INFO: `/v3/projects/b8b76acc54bb48979644423c4aa71079` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:42.468723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec1730-0862-4643-a8d5-8aec1c639fd5 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorizing `identity:get_project(project_id=b8b76acc54bb48979644423c4aa71079)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:42.480523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec1730-0862-4643-a8d5-8aec1c639fd5 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:42.490244 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1919/3869] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:56:42 2021] GET /identity/v3/projects/b8b76acc54bb48979644423c4aa71079 => generated 371 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:56:42.732345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95963e3c-1db7-4bea-be0b-1c84061e238c None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:42.742967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95963e3c-1db7-4bea-be0b-1c84061e238c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:42.743595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95963e3c-1db7-4bea-be0b-1c84061e238c None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:42.745633 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1951/3870] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:56:42 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:56:42.758008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec1730-0862-4643-a8d5-8aec1c639fd5 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:56:42.780950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec1730-0862-4643-a8d5-8aec1c639fd5 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:42.793104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec1730-0862-4643-a8d5-8aec1c639fd5 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:42.801786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc9522-cd13-44c0-bac0-b19f1eec94c3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8e5d8bb8db431789b60b22e5726432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2f2a9187d5a41c48b39fedce3b16f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:42.803485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc9522-cd13-44c0-bac0-b19f1eec94c3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:42.803935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc9522-cd13-44c0-bac0-b19f1eec94c3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:42.804521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc9522-cd13-44c0-bac0-b19f1eec94c3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] PATH_INFO: `/v3/projects/b8b76acc54bb48979644423c4aa71079` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:42.807142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc9522-cd13-44c0-bac0-b19f1eec94c3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorizing `identity:get_project(project_id=b8b76acc54bb48979644423c4aa71079)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:42.810032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc9522-cd13-44c0-bac0-b19f1eec94c3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:42.818864 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1920/3871] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:56:42 2021] GET /identity/v3/projects/b8b76acc54bb48979644423c4aa71079 => generated 371 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:56:42.872840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95963e3c-1db7-4bea-be0b-1c84061e238c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:42.890375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95963e3c-1db7-4bea-be0b-1c84061e238c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:42.899494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde97a90-19e8-48a8-b1f2-e6837b4e272c tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8e5d8bb8db431789b60b22e5726432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2f2a9187d5a41c48b39fedce3b16f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:42.900855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde97a90-19e8-48a8-b1f2-e6837b4e272c tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:42.901146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde97a90-19e8-48a8-b1f2-e6837b4e272c tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:42.901432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde97a90-19e8-48a8-b1f2-e6837b4e272c tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:42.902182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde97a90-19e8-48a8-b1f2-e6837b4e272c tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:56:42.904730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde97a90-19e8-48a8-b1f2-e6837b4e272c tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:42.911670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde97a90-19e8-48a8-b1f2-e6837b4e272c tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:42.931661 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1952/3872] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:56:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:56:42.935827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc9522-cd13-44c0-bac0-b19f1eec94c3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:42.948638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc9522-cd13-44c0-bac0-b19f1eec94c3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:42.953959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d79bcf-e35d-44dd-8a01-d8adae2ee9f8 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8e5d8bb8db431789b60b22e5726432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2f2a9187d5a41c48b39fedce3b16f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:42.955015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d79bcf-e35d-44dd-8a01-d8adae2ee9f8 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:42.955449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d79bcf-e35d-44dd-8a01-d8adae2ee9f8 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:42.955874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d79bcf-e35d-44dd-8a01-d8adae2ee9f8 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:42.956765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d79bcf-e35d-44dd-8a01-d8adae2ee9f8 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:42.959400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d79bcf-e35d-44dd-8a01-d8adae2ee9f8 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:42.988221 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1921/3873] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:56:42 2021] POST /identity/v3/users => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:56:42.992575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde97a90-19e8-48a8-b1f2-e6837b4e272c tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:43.018559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde97a90-19e8-48a8-b1f2-e6837b4e272c tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:43.055613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324cf82-c3ea-45a8-93f3-7492e241f800 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8e5d8bb8db431789b60b22e5726432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2f2a9187d5a41c48b39fedce3b16f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:43.057955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324cf82-c3ea-45a8-93f3-7492e241f800 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:43.058764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324cf82-c3ea-45a8-93f3-7492e241f800 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:43.059424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324cf82-c3ea-45a8-93f3-7492e241f800 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:43.060505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324cf82-c3ea-45a8-93f3-7492e241f800 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:56:43.061296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324cf82-c3ea-45a8-93f3-7492e241f800 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:43.063585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324cf82-c3ea-45a8-93f3-7492e241f800 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:43.096116 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1953/3874] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:56:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:56:43.167392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e785fad-4b46-4e54-bb49-31560619b94a None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:43.167718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e785fad-4b46-4e54-bb49-31560619b94a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:43.168004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e785fad-4b46-4e54-bb49-31560619b94a None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:43.169816 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1922/3875] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:56:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:56:43.178422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324cf82-c3ea-45a8-93f3-7492e241f800 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:56:43.194739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324cf82-c3ea-45a8-93f3-7492e241f800 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:43.209339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324cf82-c3ea-45a8-93f3-7492e241f800 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:43.215975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf90cb6-0351-4ffc-85d1-88da78a0d9e3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8e5d8bb8db431789b60b22e5726432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2f2a9187d5a41c48b39fedce3b16f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:43.217213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf90cb6-0351-4ffc-85d1-88da78a0d9e3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:43.217651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf90cb6-0351-4ffc-85d1-88da78a0d9e3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:43.218041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf90cb6-0351-4ffc-85d1-88da78a0d9e3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] PATH_INFO: `/v3/projects/b8b76acc54bb48979644423c4aa71079` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:43.219757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf90cb6-0351-4ffc-85d1-88da78a0d9e3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorizing `identity:get_project(project_id=b8b76acc54bb48979644423c4aa71079)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:43.223739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf90cb6-0351-4ffc-85d1-88da78a0d9e3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:43.232899 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1954/3876] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:56:43 2021] GET /identity/v3/projects/b8b76acc54bb48979644423c4aa71079 => generated 371 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:56:43.291481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051184-b2f1-4c47-aff8-c97dd0b23c89 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:43.291883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051184-b2f1-4c47-aff8-c97dd0b23c89 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:43.292284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051184-b2f1-4c47-aff8-c97dd0b23c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:43.354614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-35051184-b2f1-4c47-aff8-c97dd0b23c89 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:43.357610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-35051184-b2f1-4c47-aff8-c97dd0b23c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:43.480783 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1923/3877] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:56:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:43.504565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf90cb6-0351-4ffc-85d1-88da78a0d9e3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:43.507699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-daf90cb6-0351-4ffc-85d1-88da78a0d9e3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:43.591779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015698e-088e-4876-ad33-c32d97d60839 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:43.592155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015698e-088e-4876-ad33-c32d97d60839 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:43.592344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015698e-088e-4876-ad33-c32d97d60839 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:43.594406 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1924/3878] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:56:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:56:43.601375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015698e-088e-4876-ad33-c32d97d60839 None None] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 20:56:43.622618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015698e-088e-4876-ad33-c32d97d60839 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:43.637540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015698e-088e-4876-ad33-c32d97d60839 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:43.644772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf90cb6-0351-4ffc-85d1-88da78a0d9e3 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:43.646538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06ef7a-e5fb-4c7e-be5d-018d7d934e0a tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8e5d8bb8db431789b60b22e5726432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2f2a9187d5a41c48b39fedce3b16f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:43.649763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06ef7a-e5fb-4c7e-be5d-018d7d934e0a tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:43.650096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06ef7a-e5fb-4c7e-be5d-018d7d934e0a tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:43.650532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06ef7a-e5fb-4c7e-be5d-018d7d934e0a tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] PATH_INFO: `/v3/projects/b8b76acc54bb48979644423c4aa71079` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:43.653334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06ef7a-e5fb-4c7e-be5d-018d7d934e0a tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorizing `identity:get_project(project_id=b8b76acc54bb48979644423c4aa71079)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:43.656928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06ef7a-e5fb-4c7e-be5d-018d7d934e0a tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:43.660152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71af02-6651-485b-8c29-cb5a07e9ff5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:43.662760 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1925/3879] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 20:56:43 2021] GET /identity/v3/projects/b8b76acc54bb48979644423c4aa71079 => generated 371 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:56:43.662879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71af02-6651-485b-8c29-cb5a07e9ff5b service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:43.663072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71af02-6651-485b-8c29-cb5a07e9ff5b service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:43.663571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71af02-6651-485b-8c29-cb5a07e9ff5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:43.686160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71af02-6651-485b-8c29-cb5a07e9ff5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:43.690207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71af02-6651-485b-8c29-cb5a07e9ff5b service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:43.704968 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1955/3880] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:56:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:56:43.734858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06ef7a-e5fb-4c7e-be5d-018d7d934e0a tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:43.755052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06ef7a-e5fb-4c7e-be5d-018d7d934e0a tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:43.774443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2867b2-53a3-40f4-9663-9063cc390e63 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8e5d8bb8db431789b60b22e5726432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2f2a9187d5a41c48b39fedce3b16f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:43.775832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2867b2-53a3-40f4-9663-9063cc390e63 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:43.776325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2867b2-53a3-40f4-9663-9063cc390e63 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:43.776903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2867b2-53a3-40f4-9663-9063cc390e63 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] PATH_INFO: `/v3/users/027ef9dc651d414fa9087d6167e2f84a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:43.809067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2867b2-53a3-40f4-9663-9063cc390e63 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorizing `identity:delete_user(user_id=027ef9dc651d414fa9087d6167e2f84a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:43.810993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2867b2-53a3-40f4-9663-9063cc390e63 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:43.909607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1e2867b2-53a3-40f4-9663-9063cc390e63 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '027ef9dc651d414fa9087d6167e2f84a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:43.920524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1e2867b2-53a3-40f4-9663-9063cc390e63 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '027ef9dc651d414fa9087d6167e2f84a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:43.936182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1e2867b2-53a3-40f4-9663-9063cc390e63 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '027ef9dc651d414fa9087d6167e2f84a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:43.937070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1e2867b2-53a3-40f4-9663-9063cc390e63 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '027ef9dc651d414fa9087d6167e2f84a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:43.951143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1e2867b2-53a3-40f4-9663-9063cc390e63 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '027ef9dc651d414fa9087d6167e2f84a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:43.972384 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1926/3881] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:56:43 2021] DELETE /identity/v3/users/027ef9dc651d414fa9087d6167e2f84a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:43.976182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71af02-6651-485b-8c29-cb5a07e9ff5b service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:43.994416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71af02-6651-485b-8c29-cb5a07e9ff5b service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:44.152815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4904f1-771e-4f30-8d51-36113cf07929 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8e5d8bb8db431789b60b22e5726432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2f2a9187d5a41c48b39fedce3b16f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:44.155048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4904f1-771e-4f30-8d51-36113cf07929 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:44.156709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4904f1-771e-4f30-8d51-36113cf07929 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:44.157173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4904f1-771e-4f30-8d51-36113cf07929 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] PATH_INFO: `/v3/projects/b8b76acc54bb48979644423c4aa71079` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:44.159624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4904f1-771e-4f30-8d51-36113cf07929 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b8b76acc54bb48979644423c4aa71079)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:44.166503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4904f1-771e-4f30-8d51-36113cf07929 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:44.269166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fc4904f1-771e-4f30-8d51-36113cf07929 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b76acc54bb48979644423c4aa71079', 'request_id': 'req-fc4904f1-771e-4f30-8d51-36113cf07929'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:44.279724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fc4904f1-771e-4f30-8d51-36113cf07929 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b76acc54bb48979644423c4aa71079', 'request_id': 'req-fc4904f1-771e-4f30-8d51-36113cf07929'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:44.292504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fc4904f1-771e-4f30-8d51-36113cf07929 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b76acc54bb48979644423c4aa71079', 'request_id': 'req-fc4904f1-771e-4f30-8d51-36113cf07929'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:44.310673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fc4904f1-771e-4f30-8d51-36113cf07929 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] The token cache is being invalidate because project b8b76acc54bb48979644423c4aa71079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:56:44.310975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fc4904f1-771e-4f30-8d51-36113cf07929 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:44.314578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fc4904f1-771e-4f30-8d51-36113cf07929 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:44.317022 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1956/3882] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:43 2021] DELETE /identity/v3/projects/b8b76acc54bb48979644423c4aa71079 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:44.323289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2867b2-53a3-40f4-9663-9063cc390e63 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:44.326751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1e2867b2-53a3-40f4-9663-9063cc390e63 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:44.415089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb28ce1-a0df-4de2-9020-ada1b6c22151 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:44.415553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb28ce1-a0df-4de2-9020-ada1b6c22151 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:44.416185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb28ce1-a0df-4de2-9020-ada1b6c22151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:44.470958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-cbb28ce1-a0df-4de2-9020-ada1b6c22151 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:44.472842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cbb28ce1-a0df-4de2-9020-ada1b6c22151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:44.487246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2867b2-53a3-40f4-9663-9063cc390e63 tempest-QuotasAdminTestV257-1819049046 tempest-QuotasAdminTestV257-1819049046-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:44.611100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa727c6-7114-4c71-9ccf-b921331fb896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:44.612161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa727c6-7114-4c71-9ccf-b921331fb896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:44.612596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa727c6-7114-4c71-9ccf-b921331fb896 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:44.613423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa727c6-7114-4c71-9ccf-b921331fb896 admin admin] PATH_INFO: `/v3/users/c09976bc60c449a88031dafb17eebf74` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:44.615794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa727c6-7114-4c71-9ccf-b921331fb896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c09976bc60c449a88031dafb17eebf74)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:44.617967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa727c6-7114-4c71-9ccf-b921331fb896 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:44.632259 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1957/3883] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:56:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:44.642164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb28ce1-a0df-4de2-9020-ada1b6c22151 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:44.645469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cbb28ce1-a0df-4de2-9020-ada1b6c22151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:44.713905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2aa727c6-7114-4c71-9ccf-b921331fb896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c09976bc60c449a88031dafb17eebf74'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:44.738472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2aa727c6-7114-4c71-9ccf-b921331fb896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c09976bc60c449a88031dafb17eebf74'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:44.772155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2aa727c6-7114-4c71-9ccf-b921331fb896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c09976bc60c449a88031dafb17eebf74'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:44.773406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2aa727c6-7114-4c71-9ccf-b921331fb896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c09976bc60c449a88031dafb17eebf74'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:44.789178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2aa727c6-7114-4c71-9ccf-b921331fb896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c09976bc60c449a88031dafb17eebf74'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:44.793319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb28ce1-a0df-4de2-9020-ada1b6c22151 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:44.805341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6a2f4-6952-4ac6-91dd-a5aac90cdd2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:44.806476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6a2f4-6952-4ac6-91dd-a5aac90cdd2a service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:44.806800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6a2f4-6952-4ac6-91dd-a5aac90cdd2a service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:44.807583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6a2f4-6952-4ac6-91dd-a5aac90cdd2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:44.812424 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1927/3884] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:56:44 2021] DELETE /identity/v3/users/c09976bc60c449a88031dafb17eebf74 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:44.813832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-84e6a2f4-6952-4ac6-91dd-a5aac90cdd2a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:44.815593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7626b5-90db-499f-973d-bf97b4ac7290 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:44.816225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7626b5-90db-499f-973d-bf97b4ac7290 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:44.816654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7626b5-90db-499f-973d-bf97b4ac7290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:44.856734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-bb7626b5-90db-499f-973d-bf97b4ac7290 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:44.857516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6a2f4-6952-4ac6-91dd-a5aac90cdd2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:44.859582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bb7626b5-90db-499f-973d-bf97b4ac7290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:44.873023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6a2f4-6952-4ac6-91dd-a5aac90cdd2a service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:44.886704 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1958/3885] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:56:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:56:44.987890 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1928/3886] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:45.016526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6a2f4-6952-4ac6-91dd-a5aac90cdd2a service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:45.018085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-84e6a2f4-6952-4ac6-91dd-a5aac90cdd2a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:45.102336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6a2f4-6952-4ac6-91dd-a5aac90cdd2a service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:45.200693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7626b5-90db-499f-973d-bf97b4ac7290 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:45.232494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ca5c6-b899-49e4-a502-9acef1c26054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:45.240090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ca5c6-b899-49e4-a502-9acef1c26054 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:45.240847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ca5c6-b899-49e4-a502-9acef1c26054 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:45.241372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ca5c6-b899-49e4-a502-9acef1c26054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:45.277044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7626b5-90db-499f-973d-bf97b4ac7290 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:45.285675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198f459-7fad-49dc-a852-7e231983005d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:45.286770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198f459-7fad-49dc-a852-7e231983005d service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:45.287230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198f459-7fad-49dc-a852-7e231983005d service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:45.287672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198f459-7fad-49dc-a852-7e231983005d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:45.290016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d198f459-7fad-49dc-a852-7e231983005d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:45.296964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ca5c6-b899-49e4-a502-9acef1c26054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:45.299056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ca5c6-b899-49e4-a502-9acef1c26054 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:45.315323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198f459-7fad-49dc-a852-7e231983005d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:45.316825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198f459-7fad-49dc-a852-7e231983005d service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:45.320264 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1959/3887] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:56:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:56:45.330290 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1929/3888] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:56:45 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:56:45.538555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b18cb8-ce9f-47e9-884e-9e8be5f5bab3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:45.539062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b18cb8-ce9f-47e9-884e-9e8be5f5bab3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:45.539389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b18cb8-ce9f-47e9-884e-9e8be5f5bab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:45.575159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e7b18cb8-ce9f-47e9-884e-9e8be5f5bab3 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:45.576439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e7b18cb8-ce9f-47e9-884e-9e8be5f5bab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:45.702084 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1960/3889] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:56:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:45.721564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198f459-7fad-49dc-a852-7e231983005d service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:45.722998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d198f459-7fad-49dc-a852-7e231983005d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:45.834635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198f459-7fad-49dc-a852-7e231983005d service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:45.859951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271a43f-e867-4d92-8de2-801101695d0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:45.862643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271a43f-e867-4d92-8de2-801101695d0e service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:45.863171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271a43f-e867-4d92-8de2-801101695d0e service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:45.865094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271a43f-e867-4d92-8de2-801101695d0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:45.882843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271a43f-e867-4d92-8de2-801101695d0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:45.885312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271a43f-e867-4d92-8de2-801101695d0e service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:45.902532 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1930/3890] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:56:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:56:46.475616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b18cb8-ce9f-47e9-884e-9e8be5f5bab3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:46.477463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e7b18cb8-ce9f-47e9-884e-9e8be5f5bab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:46.500108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b18cb8-ce9f-47e9-884e-9e8be5f5bab3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:46.523684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba949fa-e3aa-44da-b048-df3b9fcececa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:46.529022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba949fa-e3aa-44da-b048-df3b9fcececa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:46.529313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba949fa-e3aa-44da-b048-df3b9fcececa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:46.529594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba949fa-e3aa-44da-b048-df3b9fcececa admin admin] PATH_INFO: `/v3/projects/a68dacd8cefc4cc6bba82d5eaa3a4617` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:46.531450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba949fa-e3aa-44da-b048-df3b9fcececa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a68dacd8cefc4cc6bba82d5eaa3a4617)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:46.535903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba949fa-e3aa-44da-b048-df3b9fcececa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:46.595961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6ba949fa-e3aa-44da-b048-df3b9fcececa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a68dacd8cefc4cc6bba82d5eaa3a4617', 'request_id': 'req-6ba949fa-e3aa-44da-b048-df3b9fcececa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:46.604527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6ba949fa-e3aa-44da-b048-df3b9fcececa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a68dacd8cefc4cc6bba82d5eaa3a4617', 'request_id': 'req-6ba949fa-e3aa-44da-b048-df3b9fcececa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:46.614935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6ba949fa-e3aa-44da-b048-df3b9fcececa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a68dacd8cefc4cc6bba82d5eaa3a4617', 'request_id': 'req-6ba949fa-e3aa-44da-b048-df3b9fcececa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:46.630552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6ba949fa-e3aa-44da-b048-df3b9fcececa admin admin] The token cache is being invalidate because project a68dacd8cefc4cc6bba82d5eaa3a4617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:56:46.631584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6ba949fa-e3aa-44da-b048-df3b9fcececa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:46.632458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6ba949fa-e3aa-44da-b048-df3b9fcececa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:46.634772 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1961/3891] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:46 2021] DELETE /identity/v3/projects/a68dacd8cefc4cc6bba82d5eaa3a4617 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:46.638802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271a43f-e867-4d92-8de2-801101695d0e service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:46.649299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271a43f-e867-4d92-8de2-801101695d0e service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:46.721098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb31b6e-c127-41db-8647-0f93a558600e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:46.722482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb31b6e-c127-41db-8647-0f93a558600e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:46.723005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb31b6e-c127-41db-8647-0f93a558600e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:46.723482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb31b6e-c127-41db-8647-0f93a558600e admin admin] PATH_INFO: `/v3/users/4e8e5d8bb8db431789b60b22e5726432` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:46.724979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb31b6e-c127-41db-8647-0f93a558600e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8e5d8bb8db431789b60b22e5726432)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:46.727154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb31b6e-c127-41db-8647-0f93a558600e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:46.803723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-adb31b6e-c127-41db-8647-0f93a558600e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8e5d8bb8db431789b60b22e5726432'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:46.817936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-adb31b6e-c127-41db-8647-0f93a558600e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8e5d8bb8db431789b60b22e5726432'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:46.835337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-adb31b6e-c127-41db-8647-0f93a558600e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8e5d8bb8db431789b60b22e5726432'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:46.836877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-adb31b6e-c127-41db-8647-0f93a558600e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8e5d8bb8db431789b60b22e5726432'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:46.844659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-adb31b6e-c127-41db-8647-0f93a558600e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8e5d8bb8db431789b60b22e5726432'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:46.851429 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1931/3892] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:56:46 2021] DELETE /identity/v3/users/4e8e5d8bb8db431789b60b22e5726432 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:47.437708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba949fa-e3aa-44da-b048-df3b9fcececa admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:47.440027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6ba949fa-e3aa-44da-b048-df3b9fcececa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:47.456394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba949fa-e3aa-44da-b048-df3b9fcececa admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:47.547824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefa8cf-3780-4346-b70a-b13769bd373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:47.549429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefa8cf-3780-4346-b70a-b13769bd373d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:47.549890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefa8cf-3780-4346-b70a-b13769bd373d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:47.550358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefa8cf-3780-4346-b70a-b13769bd373d admin admin] PATH_INFO: `/v3/projects/c2f2a9187d5a41c48b39fedce3b16f25` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:47.552490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefa8cf-3780-4346-b70a-b13769bd373d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2f2a9187d5a41c48b39fedce3b16f25)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:47.554636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefa8cf-3780-4346-b70a-b13769bd373d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:47.610396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-feefa8cf-3780-4346-b70a-b13769bd373d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2f2a9187d5a41c48b39fedce3b16f25', 'request_id': 'req-feefa8cf-3780-4346-b70a-b13769bd373d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:47.617233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-feefa8cf-3780-4346-b70a-b13769bd373d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2f2a9187d5a41c48b39fedce3b16f25', 'request_id': 'req-feefa8cf-3780-4346-b70a-b13769bd373d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:47.625488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-feefa8cf-3780-4346-b70a-b13769bd373d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2f2a9187d5a41c48b39fedce3b16f25', 'request_id': 'req-feefa8cf-3780-4346-b70a-b13769bd373d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:47.636757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-feefa8cf-3780-4346-b70a-b13769bd373d admin admin] The token cache is being invalidate because project c2f2a9187d5a41c48b39fedce3b16f25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:56:47.637043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-feefa8cf-3780-4346-b70a-b13769bd373d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:47.637679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-feefa8cf-3780-4346-b70a-b13769bd373d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:47.639300 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1962/3893] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:47 2021] DELETE /identity/v3/projects/c2f2a9187d5a41c48b39fedce3b16f25 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:47.647166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beffcb9-5823-44c8-b36e-73d9d105b071 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:47.647455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beffcb9-5823-44c8-b36e-73d9d105b071 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:47.647733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beffcb9-5823-44c8-b36e-73d9d105b071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:47.664775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1beffcb9-5823-44c8-b36e-73d9d105b071 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:47.665959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1beffcb9-5823-44c8-b36e-73d9d105b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:47.726335 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1932/3894] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:47.736173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d017-1325-4c8c-81bb-9cf84325b972 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:47.736473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d017-1325-4c8c-81bb-9cf84325b972 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:47.736757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d017-1325-4c8c-81bb-9cf84325b972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:47.756003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1a94d017-1325-4c8c-81bb-9cf84325b972 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:47.757213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1a94d017-1325-4c8c-81bb-9cf84325b972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:47.765214 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1963/3895] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:47.769541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beffcb9-5823-44c8-b36e-73d9d105b071 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:47.779484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beffcb9-5823-44c8-b36e-73d9d105b071 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:47.784036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b1705-971e-4a87-a94b-dc47a9179125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:47.784894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b1705-971e-4a87-a94b-dc47a9179125 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:47.785179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b1705-971e-4a87-a94b-dc47a9179125 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:47.785487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b1705-971e-4a87-a94b-dc47a9179125 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:47.786213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b1705-971e-4a87-a94b-dc47a9179125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:56:47.786559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b1705-971e-4a87-a94b-dc47a9179125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:47.788137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b1705-971e-4a87-a94b-dc47a9179125 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:47.799347 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1933/3896] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:56:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:56:47.803642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94d017-1325-4c8c-81bb-9cf84325b972 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:47.813099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94d017-1325-4c8c-81bb-9cf84325b972 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:47.818723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732c91c-57f5-4846-8997-a2526afd79cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:47.819367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732c91c-57f5-4846-8997-a2526afd79cc admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:47.819674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732c91c-57f5-4846-8997-a2526afd79cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:47.820079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732c91c-57f5-4846-8997-a2526afd79cc admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:47.820787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732c91c-57f5-4846-8997-a2526afd79cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:47.822713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732c91c-57f5-4846-8997-a2526afd79cc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:47.852245 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1964/3897] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:56:47 2021] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:56:47.856213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b1705-971e-4a87-a94b-dc47a9179125 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:47.867153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b1705-971e-4a87-a94b-dc47a9179125 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:47.938473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba5c7b-6508-461b-9410-ea0bdf588231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:47.939569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba5c7b-6508-461b-9410-ea0bdf588231 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:47.939856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba5c7b-6508-461b-9410-ea0bdf588231 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:47.940136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba5c7b-6508-461b-9410-ea0bdf588231 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:47.940835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba5c7b-6508-461b-9410-ea0bdf588231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:47.943808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba5c7b-6508-461b-9410-ea0bdf588231 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:47.969886 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1934/3898] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:56:47 2021] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:56:47.970759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732c91c-57f5-4846-8997-a2526afd79cc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:47.982511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732c91c-57f5-4846-8997-a2526afd79cc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:47.989184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b13ac8-a6d8-4dc5-9b4e-b74fde348cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:47.989767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b13ac8-a6d8-4dc5-9b4e-b74fde348cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:47.990059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b13ac8-a6d8-4dc5-9b4e-b74fde348cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:47.990404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b13ac8-a6d8-4dc5-9b4e-b74fde348cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:47.991140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b13ac8-a6d8-4dc5-9b4e-b74fde348cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:47.992787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b13ac8-a6d8-4dc5-9b4e-b74fde348cf1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:48.013778 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1965/3899] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:56:47 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:56:48.017881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba5c7b-6508-461b-9410-ea0bdf588231 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:48.029382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba5c7b-6508-461b-9410-ea0bdf588231 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:48.034089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1b1ee-093f-41a5-9d6f-dc83616e2290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:48.034787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b1ee-093f-41a5-9d6f-dc83616e2290 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:48.035071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b1ee-093f-41a5-9d6f-dc83616e2290 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:48.035343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b1ee-093f-41a5-9d6f-dc83616e2290 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:48.036124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1b1ee-093f-41a5-9d6f-dc83616e2290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:48.037697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1b1ee-093f-41a5-9d6f-dc83616e2290 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:48.047602 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1935/3900] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:56:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:56:48.052853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b13ac8-a6d8-4dc5-9b4e-b74fde348cf1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:48.063006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b13ac8-a6d8-4dc5-9b4e-b74fde348cf1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:48.068634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da7f0d-e1a0-4f52-950d-e5d9fae1a988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:48.069507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da7f0d-e1a0-4f52-950d-e5d9fae1a988 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:48.069789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da7f0d-e1a0-4f52-950d-e5d9fae1a988 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:48.070098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da7f0d-e1a0-4f52-950d-e5d9fae1a988 admin admin] PATH_INFO: `/v3/projects/3f69c5059282455ca98cc9bff0fe1c94/users/baaead8443a7492db118aa577386a88b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:48.085949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da7f0d-e1a0-4f52-950d-e5d9fae1a988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f69c5059282455ca98cc9bff0fe1c94, user_id=baaead8443a7492db118aa577386a88b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:48.088736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da7f0d-e1a0-4f52-950d-e5d9fae1a988 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:48.101867 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1966/3901] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:56:48 2021] PUT /identity/v3/projects/3f69c5059282455ca98cc9bff0fe1c94/users/baaead8443a7492db118aa577386a88b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:56:48.107310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e61c3-c8f4-4c02-ba7a-8fc7dffe9b5b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:48.107625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e61c3-c8f4-4c02-ba7a-8fc7dffe9b5b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:48.107904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e61c3-c8f4-4c02-ba7a-8fc7dffe9b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:48.128795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a05e61c3-c8f4-4c02-ba7a-8fc7dffe9b5b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:48.130750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a05e61c3-c8f4-4c02-ba7a-8fc7dffe9b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:48.202236 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1936/3902] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:56:48.212131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da7f0d-e1a0-4f52-950d-e5d9fae1a988 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:48.214196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-82da7f0d-e1a0-4f52-950d-e5d9fae1a988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:48.270993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da7f0d-e1a0-4f52-950d-e5d9fae1a988 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:48.274814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b6b45-f970-4202-8058-b0ce6b5de1ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:48.275473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6b45-f970-4202-8058-b0ce6b5de1ae service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:48.275756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6b45-f970-4202-8058-b0ce6b5de1ae service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:48.276033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6b45-f970-4202-8058-b0ce6b5de1ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:48.284912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b6b45-f970-4202-8058-b0ce6b5de1ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:48.286396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b6b45-f970-4202-8058-b0ce6b5de1ae service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:48.303068 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1967/3903] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:56:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:56:49.275837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e61c3-c8f4-4c02-ba7a-8fc7dffe9b5b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:49.280817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a05e61c3-c8f4-4c02-ba7a-8fc7dffe9b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:49.421793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e61c3-c8f4-4c02-ba7a-8fc7dffe9b5b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:49.437780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07287de-8b7e-432a-81dd-993af598ca20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:49.439158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07287de-8b7e-432a-81dd-993af598ca20 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:49.439716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07287de-8b7e-432a-81dd-993af598ca20 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:49.439847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07287de-8b7e-432a-81dd-993af598ca20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:49.447512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d07287de-8b7e-432a-81dd-993af598ca20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:49.468375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07287de-8b7e-432a-81dd-993af598ca20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:49.470119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07287de-8b7e-432a-81dd-993af598ca20 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:49.484883 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1937/3904] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:56:49 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:56:54.594664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573defd-d4d5-4246-9a66-4ae98ce751f9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:54.598839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573defd-d4d5-4246-9a66-4ae98ce751f9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:54.598839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573defd-d4d5-4246-9a66-4ae98ce751f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:54.632740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a573defd-d4d5-4246-9a66-4ae98ce751f9 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:54.634106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a573defd-d4d5-4246-9a66-4ae98ce751f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:54.746750 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1968/3905] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:56:54 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:54.766638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07287de-8b7e-432a-81dd-993af598ca20 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:54.770491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d07287de-8b7e-432a-81dd-993af598ca20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:54.876698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07287de-8b7e-432a-81dd-993af598ca20 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:54.895260 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d1605-b1ab-4560-be1e-27f465e7ba52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:54.896368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d1605-b1ab-4560-be1e-27f465e7ba52 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:54.896829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d1605-b1ab-4560-be1e-27f465e7ba52 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:54.897274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d1605-b1ab-4560-be1e-27f465e7ba52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:54.908471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d1605-b1ab-4560-be1e-27f465e7ba52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:54.911285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d1605-b1ab-4560-be1e-27f465e7ba52 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:54.929770 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1938/3906] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:56:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:56:55.107956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ca927-ec03-4013-b7e8-043664f850df None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:55.108277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ca927-ec03-4013-b7e8-043664f850df None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:55.116762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ca927-ec03-4013-b7e8-043664f850df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:55.212847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2f0ca927-ec03-4013-b7e8-043664f850df None None] MFA Rules not processed for user `baaead8443a7492db118aa577386a88b`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:55.216230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2f0ca927-ec03-4013-b7e8-043664f850df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:55.383205 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1969/3907] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:55 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:55.391126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d1605-b1ab-4560-be1e-27f465e7ba52 service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:55.406504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d1605-b1ab-4560-be1e-27f465e7ba52 service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:55.421097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04ef8b-c051-4c10-b441-87e3146657dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:55.422110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ef8b-c051-4c10-b441-87e3146657dc admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:55.423762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ef8b-c051-4c10-b441-87e3146657dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:55.425240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ef8b-c051-4c10-b441-87e3146657dc admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:55.429005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04ef8b-c051-4c10-b441-87e3146657dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:55.430114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c34b5-559b-43c5-a0fb-fb9634ee0bfc None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:55.430453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c34b5-559b-43c5-a0fb-fb9634ee0bfc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:55.430738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c34b5-559b-43c5-a0fb-fb9634ee0bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:55.432905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04ef8b-c051-4c10-b441-87e3146657dc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:55.475120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-177c34b5-559b-43c5-a0fb-fb9634ee0bfc None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:55.476868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-177c34b5-559b-43c5-a0fb-fb9634ee0bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:55.494988 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1970/3908] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:56:55 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:55.499488 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1939/3909] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:56:55 2021] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:56:55.499812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c34b5-559b-43c5-a0fb-fb9634ee0bfc None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:55.516670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c34b5-559b-43c5-a0fb-fb9634ee0bfc None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:55.521634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04ef8b-c051-4c10-b441-87e3146657dc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:55.612003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37ce13-0d60-4106-89d8-7829b606d7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:55.614472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37ce13-0d60-4106-89d8-7829b606d7aa admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:55.614472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37ce13-0d60-4106-89d8-7829b606d7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:55.615048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37ce13-0d60-4106-89d8-7829b606d7aa admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:55.615959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37ce13-0d60-4106-89d8-7829b606d7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:55.619090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37ce13-0d60-4106-89d8-7829b606d7aa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:55.653108 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1971/3910] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:56:55 2021] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:56:55.657666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37ce13-0d60-4106-89d8-7829b606d7aa admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:55.672597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37ce13-0d60-4106-89d8-7829b606d7aa admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:55.704667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0746fa8-6a07-4a4e-aae2-749b700c03cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:55.706083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0746fa8-6a07-4a4e-aae2-749b700c03cb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:55.706083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0746fa8-6a07-4a4e-aae2-749b700c03cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:55.706083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0746fa8-6a07-4a4e-aae2-749b700c03cb admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:55.707596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0746fa8-6a07-4a4e-aae2-749b700c03cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:55.722565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0746fa8-6a07-4a4e-aae2-749b700c03cb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:55.729151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04ef8b-c051-4c10-b441-87e3146657dc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:55.748097 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1972/3911] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:56:55 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:56:55.756697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f705694-b3f2-4cf1-bcdd-5093ad7061e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:55.757324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705694-b3f2-4cf1-bcdd-5093ad7061e8 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:55.758148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0746fa8-6a07-4a4e-aae2-749b700c03cb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:55.760434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705694-b3f2-4cf1-bcdd-5093ad7061e8 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:55.763668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705694-b3f2-4cf1-bcdd-5093ad7061e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:55.783235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0746fa8-6a07-4a4e-aae2-749b700c03cb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:55.796459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3fb12-a30d-4cea-acc6-318efc46d4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:55.797630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3fb12-a30d-4cea-acc6-318efc46d4b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:55.797932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3fb12-a30d-4cea-acc6-318efc46d4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:55.798282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3fb12-a30d-4cea-acc6-318efc46d4b2 admin admin] PATH_INFO: `/v3/projects/3b97cde68fd24f27b4183d805abe8d27/users/d393be1d9c5841f8b23f37d4af9d75d6/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:55.827420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3fb12-a30d-4cea-acc6-318efc46d4b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b97cde68fd24f27b4183d805abe8d27, user_id=d393be1d9c5841f8b23f37d4af9d75d6, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:55.835479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3fb12-a30d-4cea-acc6-318efc46d4b2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:55.861197 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1973/3912] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:56:55 2021] PUT /identity/v3/projects/3b97cde68fd24f27b4183d805abe8d27/users/d393be1d9c5841f8b23f37d4af9d75d6/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:55.866889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3fb12-a30d-4cea-acc6-318efc46d4b2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:55.872992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f705694-b3f2-4cf1-bcdd-5093ad7061e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:55.875048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f705694-b3f2-4cf1-bcdd-5093ad7061e8 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:55.885807 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1940/3913] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:56:55 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:56:55.965151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3fb12-a30d-4cea-acc6-318efc46d4b2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:55.971100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e9823-4b3f-4e96-8ae7-1c72409dffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:55.971912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9823-4b3f-4e96-8ae7-1c72409dffa5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:55.972402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9823-4b3f-4e96-8ae7-1c72409dffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:55.972692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9823-4b3f-4e96-8ae7-1c72409dffa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:55.974067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e9823-4b3f-4e96-8ae7-1c72409dffa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:55.975595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e9823-4b3f-4e96-8ae7-1c72409dffa5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:55.992025 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1974/3914] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:56:55 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:56:55.996783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f705694-b3f2-4cf1-bcdd-5093ad7061e8 service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:56.009985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f705694-b3f2-4cf1-bcdd-5093ad7061e8 service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:56.018489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104e86f-ef9b-472f-b770-901f95f1d612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:56.021451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104e86f-ef9b-472f-b770-901f95f1d612 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:56.021913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104e86f-ef9b-472f-b770-901f95f1d612 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:56.022427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104e86f-ef9b-472f-b770-901f95f1d612 admin admin] PATH_INFO: `/v3/projects/3b97cde68fd24f27b4183d805abe8d27/users/d393be1d9c5841f8b23f37d4af9d75d6/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:56.026763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104e86f-ef9b-472f-b770-901f95f1d612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b97cde68fd24f27b4183d805abe8d27, user_id=d393be1d9c5841f8b23f37d4af9d75d6, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:56.030370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104e86f-ef9b-472f-b770-901f95f1d612 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:56.080880 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1941/3915] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:56:55 2021] PUT /identity/v3/projects/3b97cde68fd24f27b4183d805abe8d27/users/d393be1d9c5841f8b23f37d4af9d75d6/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:56.199530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee4760-5590-4646-a669-0a66d02e9990 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:56.199964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee4760-5590-4646-a669-0a66d02e9990 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:56.201455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee4760-5590-4646-a669-0a66d02e9990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:56.232884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-19ee4760-5590-4646-a669-0a66d02e9990 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:56.235083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-19ee4760-5590-4646-a669-0a66d02e9990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:56.342163 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1975/3916] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:56:56 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:56.361176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104e86f-ef9b-472f-b770-901f95f1d612 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:56.472081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104e86f-ef9b-472f-b770-901f95f1d612 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:56.479206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b945339-200d-446a-8b23-ac13da2a64fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:56.479882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b945339-200d-446a-8b23-ac13da2a64fc service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:56.480237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b945339-200d-446a-8b23-ac13da2a64fc service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:56.480770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b945339-200d-446a-8b23-ac13da2a64fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:56.493114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b945339-200d-446a-8b23-ac13da2a64fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:56.495101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b945339-200d-446a-8b23-ac13da2a64fc service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:56.506623 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1942/3917] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:56:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 20:56:56.683815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee4760-5590-4646-a669-0a66d02e9990 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:56.685850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-19ee4760-5590-4646-a669-0a66d02e9990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:56.798092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee4760-5590-4646-a669-0a66d02e9990 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:56.803818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d907f5-6e73-45b3-9ee3-5cf6bda35e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:56.804833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d907f5-6e73-45b3-9ee3-5cf6bda35e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:56.805289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d907f5-6e73-45b3-9ee3-5cf6bda35e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:56.805484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d907f5-6e73-45b3-9ee3-5cf6bda35e30 admin admin] PATH_INFO: `/v3/users/b46b47b65699443083a47a2c8bab63cf` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:56.808835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d907f5-6e73-45b3-9ee3-5cf6bda35e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46b47b65699443083a47a2c8bab63cf)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:56.810644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d907f5-6e73-45b3-9ee3-5cf6bda35e30 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:56.906864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-93d907f5-6e73-45b3-9ee3-5cf6bda35e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46b47b65699443083a47a2c8bab63cf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:56.916420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-93d907f5-6e73-45b3-9ee3-5cf6bda35e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46b47b65699443083a47a2c8bab63cf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:56.918767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-93d907f5-6e73-45b3-9ee3-5cf6bda35e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46b47b65699443083a47a2c8bab63cf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:56.944186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-93d907f5-6e73-45b3-9ee3-5cf6bda35e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46b47b65699443083a47a2c8bab63cf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:56.961894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-93d907f5-6e73-45b3-9ee3-5cf6bda35e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46b47b65699443083a47a2c8bab63cf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:56.978757 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1976/3918] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:56:56 2021] DELETE /identity/v3/users/b46b47b65699443083a47a2c8bab63cf => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:56.979220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01821105-d3bb-41c1-a0b9-d16cfbff147d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:56.979717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01821105-d3bb-41c1-a0b9-d16cfbff147d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:56.979946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01821105-d3bb-41c1-a0b9-d16cfbff147d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:57.012135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-01821105-d3bb-41c1-a0b9-d16cfbff147d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:57.013924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-01821105-d3bb-41c1-a0b9-d16cfbff147d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:57.157867 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1943/3919] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:57.177325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d907f5-6e73-45b3-9ee3-5cf6bda35e30 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:57.181048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-93d907f5-6e73-45b3-9ee3-5cf6bda35e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:57.309756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d907f5-6e73-45b3-9ee3-5cf6bda35e30 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:57.315733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5a8b8-17a3-4a07-b59a-41e19f33b78e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:57.318564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a8b8-17a3-4a07-b59a-41e19f33b78e service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:57.319061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a8b8-17a3-4a07-b59a-41e19f33b78e service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:57.319528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a8b8-17a3-4a07-b59a-41e19f33b78e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:57.334206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5a8b8-17a3-4a07-b59a-41e19f33b78e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:57.336434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5a8b8-17a3-4a07-b59a-41e19f33b78e service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:57.351556 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1977/3920] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:56:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:56:57.652753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01821105-d3bb-41c1-a0b9-d16cfbff147d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:57.655206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-01821105-d3bb-41c1-a0b9-d16cfbff147d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:57.687837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01821105-d3bb-41c1-a0b9-d16cfbff147d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:57.705458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9c487-0628-49e7-abc7-4ef277696bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:57.706640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9c487-0628-49e7-abc7-4ef277696bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:57.707852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9c487-0628-49e7-abc7-4ef277696bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:57.708309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9c487-0628-49e7-abc7-4ef277696bf6 admin admin] PATH_INFO: `/v3/projects/3c3cfd30b80f46d798958d02e20cb5fd` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:57.710477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9c487-0628-49e7-abc7-4ef277696bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c3cfd30b80f46d798958d02e20cb5fd)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:57.712395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9c487-0628-49e7-abc7-4ef277696bf6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:57.847557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-70b9c487-0628-49e7-abc7-4ef277696bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c3cfd30b80f46d798958d02e20cb5fd', 'request_id': 'req-70b9c487-0628-49e7-abc7-4ef277696bf6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:57.857344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-70b9c487-0628-49e7-abc7-4ef277696bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c3cfd30b80f46d798958d02e20cb5fd', 'request_id': 'req-70b9c487-0628-49e7-abc7-4ef277696bf6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:57.865672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-70b9c487-0628-49e7-abc7-4ef277696bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c3cfd30b80f46d798958d02e20cb5fd', 'request_id': 'req-70b9c487-0628-49e7-abc7-4ef277696bf6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:57.905047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-70b9c487-0628-49e7-abc7-4ef277696bf6 admin admin] The token cache is being invalidate because project 3c3cfd30b80f46d798958d02e20cb5fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:56:57.905962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-70b9c487-0628-49e7-abc7-4ef277696bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:57.908415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-70b9c487-0628-49e7-abc7-4ef277696bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:56:57.914297 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1944/3921] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:56:57 2021] DELETE /identity/v3/projects/3c3cfd30b80f46d798958d02e20cb5fd => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:57.920859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e562b8-58d1-4eb4-a180-d75b80eafec0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:57.921859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e562b8-58d1-4eb4-a180-d75b80eafec0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:57.922535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e562b8-58d1-4eb4-a180-d75b80eafec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:57.969524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f1e562b8-58d1-4eb4-a180-d75b80eafec0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:57.971174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f1e562b8-58d1-4eb4-a180-d75b80eafec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:58.095674 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1978/3922] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:58.103454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4a8ee-9225-477f-b1f0-665099678b88 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:58.103926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4a8ee-9225-477f-b1f0-665099678b88 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:58.104010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4a8ee-9225-477f-b1f0-665099678b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:58.135324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f8d4a8ee-9225-477f-b1f0-665099678b88 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:58.137702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f8d4a8ee-9225-477f-b1f0-665099678b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:58.155128 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1945/3923] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:58.157212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e562b8-58d1-4eb4-a180-d75b80eafec0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:58.175570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e562b8-58d1-4eb4-a180-d75b80eafec0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:58.198743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a81eb-77bf-4361-b455-e88e84d95254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:58.199743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a81eb-77bf-4361-b455-e88e84d95254 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:58.200038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a81eb-77bf-4361-b455-e88e84d95254 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:58.200422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a81eb-77bf-4361-b455-e88e84d95254 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:58.201264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a81eb-77bf-4361-b455-e88e84d95254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:56:58.201773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a81eb-77bf-4361-b455-e88e84d95254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:58.203587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a81eb-77bf-4361-b455-e88e84d95254 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:58.225196 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1979/3924] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:56:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:56:58.230336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4a8ee-9225-477f-b1f0-665099678b88 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:58.242939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4a8ee-9225-477f-b1f0-665099678b88 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:58.262932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045263d-646f-449e-9989-5f83e4e1d154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:58.264030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045263d-646f-449e-9989-5f83e4e1d154 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:58.264541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045263d-646f-449e-9989-5f83e4e1d154 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:58.266196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045263d-646f-449e-9989-5f83e4e1d154 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:58.272693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045263d-646f-449e-9989-5f83e4e1d154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:58.277482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045263d-646f-449e-9989-5f83e4e1d154 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:58.324631 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1946/3925] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:56:58 2021] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:56:58.329741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a81eb-77bf-4361-b455-e88e84d95254 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:58.345408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a81eb-77bf-4361-b455-e88e84d95254 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:58.432641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee4ace-136b-4ac5-97aa-c81609242132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:58.433626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee4ace-136b-4ac5-97aa-c81609242132 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:58.434035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee4ace-136b-4ac5-97aa-c81609242132 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:58.434503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee4ace-136b-4ac5-97aa-c81609242132 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:58.435326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee4ace-136b-4ac5-97aa-c81609242132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:58.437915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee4ace-136b-4ac5-97aa-c81609242132 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:58.477535 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1980/3926] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:56:58 2021] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:56:58.478694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045263d-646f-449e-9989-5f83e4e1d154 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:58.493569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045263d-646f-449e-9989-5f83e4e1d154 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:58.502214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e3f51-3e1c-4b96-a2ca-300655610732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:58.503410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e3f51-3e1c-4b96-a2ca-300655610732 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:58.503864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e3f51-3e1c-4b96-a2ca-300655610732 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:58.506451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e3f51-3e1c-4b96-a2ca-300655610732 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:58.507572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e3f51-3e1c-4b96-a2ca-300655610732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:58.510094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e3f51-3e1c-4b96-a2ca-300655610732 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:58.528202 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1947/3927] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:56:58 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:56:58.532495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee4ace-136b-4ac5-97aa-c81609242132 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:58.568450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee4ace-136b-4ac5-97aa-c81609242132 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:58.584773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a603b-eb03-4d8b-933a-2d5467201e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:58.586278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a603b-eb03-4d8b-933a-2d5467201e51 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:58.586996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a603b-eb03-4d8b-933a-2d5467201e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:58.586996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a603b-eb03-4d8b-933a-2d5467201e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:58.588151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a603b-eb03-4d8b-933a-2d5467201e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:58.590731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a603b-eb03-4d8b-933a-2d5467201e51 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:58.611611 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1981/3928] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:56:58 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:56:58.613213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e3f51-3e1c-4b96-a2ca-300655610732 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:58.635241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e3f51-3e1c-4b96-a2ca-300655610732 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:58.643677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de6bd9-3d6a-4779-8f59-62142fe4161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:58.644845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de6bd9-3d6a-4779-8f59-62142fe4161d admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:58.645234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de6bd9-3d6a-4779-8f59-62142fe4161d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:58.645459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de6bd9-3d6a-4779-8f59-62142fe4161d admin admin] PATH_INFO: `/v3/projects/1b12359736114d2eba905cf65df3d04e/users/4042244ff3d24f1b891680a791f193a8/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:58.668931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de6bd9-3d6a-4779-8f59-62142fe4161d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b12359736114d2eba905cf65df3d04e, user_id=4042244ff3d24f1b891680a791f193a8, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:58.672589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de6bd9-3d6a-4779-8f59-62142fe4161d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:58.708618 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1948/3929] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:56:58 2021] PUT /identity/v3/projects/1b12359736114d2eba905cf65df3d04e/users/4042244ff3d24f1b891680a791f193a8/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:56:58.786534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279135a6-33fc-4d00-80ae-cc86d62075f7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:58.786877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279135a6-33fc-4d00-80ae-cc86d62075f7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:58.787140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279135a6-33fc-4d00-80ae-cc86d62075f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:58.835155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-279135a6-33fc-4d00-80ae-cc86d62075f7 None None] MFA Rules not processed for user `4042244ff3d24f1b891680a791f193a8`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:56:58.838232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-279135a6-33fc-4d00-80ae-cc86d62075f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:59.070686 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1982/3930] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:56:58 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:56:59.116835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de6bd9-3d6a-4779-8f59-62142fe4161d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:56:59.119116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c2de6bd9-3d6a-4779-8f59-62142fe4161d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:56:59.389521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de6bd9-3d6a-4779-8f59-62142fe4161d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:56:59.409014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232daf40-50a1-4072-91d2-536a99a7cd8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:56:59.411629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232daf40-50a1-4072-91d2-536a99a7cd8c service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:56:59.413395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232daf40-50a1-4072-91d2-536a99a7cd8c service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:56:59.414175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232daf40-50a1-4072-91d2-536a99a7cd8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:56:59.440919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232daf40-50a1-4072-91d2-536a99a7cd8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:56:59.445521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232daf40-50a1-4072-91d2-536a99a7cd8c service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:56:59.487561 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1949/3931] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:56:59 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:02.759281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a96ac5-4ed6-4856-a1b0-bdc46f2cf47e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:02.759794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a96ac5-4ed6-4856-a1b0-bdc46f2cf47e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:02.759871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a96ac5-4ed6-4856-a1b0-bdc46f2cf47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:02.796553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-09a96ac5-4ed6-4856-a1b0-bdc46f2cf47e None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:02.798002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-09a96ac5-4ed6-4856-a1b0-bdc46f2cf47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:02.831668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232daf40-50a1-4072-91d2-536a99a7cd8c service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:02.972590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232daf40-50a1-4072-91d2-536a99a7cd8c service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:02.975529 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1983/3932] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:57:02 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:02.991533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a96ac5-4ed6-4856-a1b0-bdc46f2cf47e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:02.992434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fa412-a22f-4eaa-bb9e-2ce7e4b1dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:03.006715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-09a96ac5-4ed6-4856-a1b0-bdc46f2cf47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:03.008847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fa412-a22f-4eaa-bb9e-2ce7e4b1dd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:03.013061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fa412-a22f-4eaa-bb9e-2ce7e4b1dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:03.015394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fa412-a22f-4eaa-bb9e-2ce7e4b1dd25 admin admin] PATH_INFO: `/v3/users/4042244ff3d24f1b891680a791f193a8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:03.020288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fa412-a22f-4eaa-bb9e-2ce7e4b1dd25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4042244ff3d24f1b891680a791f193a8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:03.030934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fa412-a22f-4eaa-bb9e-2ce7e4b1dd25 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:03.206499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c35fa412-a22f-4eaa-bb9e-2ce7e4b1dd25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4042244ff3d24f1b891680a791f193a8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:03.223074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c35fa412-a22f-4eaa-bb9e-2ce7e4b1dd25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4042244ff3d24f1b891680a791f193a8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:03.236587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a96ac5-4ed6-4856-a1b0-bdc46f2cf47e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:03.246073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c35fa412-a22f-4eaa-bb9e-2ce7e4b1dd25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4042244ff3d24f1b891680a791f193a8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:03.247277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c35fa412-a22f-4eaa-bb9e-2ce7e4b1dd25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4042244ff3d24f1b891680a791f193a8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:03.255348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5433ba9-6190-4e8c-8e84-42f739764c36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:03.258082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5433ba9-6190-4e8c-8e84-42f739764c36 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:03.259388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c35fa412-a22f-4eaa-bb9e-2ce7e4b1dd25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4042244ff3d24f1b891680a791f193a8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:03.259632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5433ba9-6190-4e8c-8e84-42f739764c36 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:03.259949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5433ba9-6190-4e8c-8e84-42f739764c36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:03.267024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b5433ba9-6190-4e8c-8e84-42f739764c36 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:03.268331 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1950/3933] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:57:02 2021] DELETE /identity/v3/users/4042244ff3d24f1b891680a791f193a8 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:03.273728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93366b40-9c85-44ce-b25a-94b9caa417e4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:03.274403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93366b40-9c85-44ce-b25a-94b9caa417e4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:03.274657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93366b40-9c85-44ce-b25a-94b9caa417e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:03.296681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5433ba9-6190-4e8c-8e84-42f739764c36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:03.301742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5433ba9-6190-4e8c-8e84-42f739764c36 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:03.307183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-93366b40-9c85-44ce-b25a-94b9caa417e4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:03.308758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-93366b40-9c85-44ce-b25a-94b9caa417e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:03.326856 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1984/3934] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:57:02 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 20:57:03.477055 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1951/3935] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:03.491255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5433ba9-6190-4e8c-8e84-42f739764c36 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:03.493102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b5433ba9-6190-4e8c-8e84-42f739764c36 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:03.721370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5433ba9-6190-4e8c-8e84-42f739764c36 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:03.908415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463bbfd-7f3c-4eb9-81b7-2a0586b53515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:03.909718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463bbfd-7f3c-4eb9-81b7-2a0586b53515 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:03.910067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463bbfd-7f3c-4eb9-81b7-2a0586b53515 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:03.910894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463bbfd-7f3c-4eb9-81b7-2a0586b53515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:03.940393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463bbfd-7f3c-4eb9-81b7-2a0586b53515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:03.941928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463bbfd-7f3c-4eb9-81b7-2a0586b53515 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:03.957949 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1985/3936] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:04.667997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93366b40-9c85-44ce-b25a-94b9caa417e4 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:04.670422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-93366b40-9c85-44ce-b25a-94b9caa417e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:04.694500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93366b40-9c85-44ce-b25a-94b9caa417e4 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:04.709442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37adf8e-a3d6-43b8-ad94-3ee2ccb9fc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:04.710788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37adf8e-a3d6-43b8-ad94-3ee2ccb9fc96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:04.711731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37adf8e-a3d6-43b8-ad94-3ee2ccb9fc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:04.711731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37adf8e-a3d6-43b8-ad94-3ee2ccb9fc96 admin admin] PATH_INFO: `/v3/projects/1b12359736114d2eba905cf65df3d04e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:04.713377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37adf8e-a3d6-43b8-ad94-3ee2ccb9fc96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b12359736114d2eba905cf65df3d04e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:04.740924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37adf8e-a3d6-43b8-ad94-3ee2ccb9fc96 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:04.943703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c37adf8e-a3d6-43b8-ad94-3ee2ccb9fc96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b12359736114d2eba905cf65df3d04e', 'request_id': 'req-c37adf8e-a3d6-43b8-ad94-3ee2ccb9fc96'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:04.953295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c37adf8e-a3d6-43b8-ad94-3ee2ccb9fc96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b12359736114d2eba905cf65df3d04e', 'request_id': 'req-c37adf8e-a3d6-43b8-ad94-3ee2ccb9fc96'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:04.967781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c37adf8e-a3d6-43b8-ad94-3ee2ccb9fc96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b12359736114d2eba905cf65df3d04e', 'request_id': 'req-c37adf8e-a3d6-43b8-ad94-3ee2ccb9fc96'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:04.998233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c37adf8e-a3d6-43b8-ad94-3ee2ccb9fc96 admin admin] The token cache is being invalidate because project 1b12359736114d2eba905cf65df3d04e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:57:04.998752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c37adf8e-a3d6-43b8-ad94-3ee2ccb9fc96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:05.001637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c37adf8e-a3d6-43b8-ad94-3ee2ccb9fc96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:05.008241 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1952/3937] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:04 2021] DELETE /identity/v3/projects/1b12359736114d2eba905cf65df3d04e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:05.014212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5c338-f725-4053-b5de-4884ae7b49b4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:05.015262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5c338-f725-4053-b5de-4884ae7b49b4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:05.015761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5c338-f725-4053-b5de-4884ae7b49b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:05.055960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efb4fa-9f81-4a54-85ce-ac720c06eee1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:05.057558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efb4fa-9f81-4a54-85ce-ac720c06eee1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:05.058221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efb4fa-9f81-4a54-85ce-ac720c06eee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:05.080013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-03f5c338-f725-4053-b5de-4884ae7b49b4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:05.082994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-03f5c338-f725-4053-b5de-4884ae7b49b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:05.162074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-51efb4fa-9f81-4a54-85ce-ac720c06eee1 None None] MFA Rules not processed for user `d393be1d9c5841f8b23f37d4af9d75d6`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:05.163563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-51efb4fa-9f81-4a54-85ce-ac720c06eee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:05.197219 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1986/3938] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:05.205316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb915c7-52b7-4192-b781-a92b91370f03 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:05.205584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb915c7-52b7-4192-b781-a92b91370f03 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:05.206232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb915c7-52b7-4192-b781-a92b91370f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:05.249957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ebb915c7-52b7-4192-b781-a92b91370f03 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:05.251868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ebb915c7-52b7-4192-b781-a92b91370f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:05.265189 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1987/3939] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:57:05.276728 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1953/3940] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:05 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:05.278830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb915c7-52b7-4192-b781-a92b91370f03 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:05.291884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb915c7-52b7-4192-b781-a92b91370f03 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:05.300162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efb4fa-9f81-4a54-85ce-ac720c06eee1 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:05.301789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-51efb4fa-9f81-4a54-85ce-ac720c06eee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:05.304603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aaf61f-84e4-4a72-a3a0-4cbdc4cb5546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:05.306911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aaf61f-84e4-4a72-a3a0-4cbdc4cb5546 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:05.307243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aaf61f-84e4-4a72-a3a0-4cbdc4cb5546 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:05.307715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aaf61f-84e4-4a72-a3a0-4cbdc4cb5546 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:05.309519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aaf61f-84e4-4a72-a3a0-4cbdc4cb5546 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:57:05.309834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aaf61f-84e4-4a72-a3a0-4cbdc4cb5546 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:05.314424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aaf61f-84e4-4a72-a3a0-4cbdc4cb5546 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:05.353105 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1988/3941] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:57:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:57:05.360339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aaf61f-84e4-4a72-a3a0-4cbdc4cb5546 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:05.380600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aaf61f-84e4-4a72-a3a0-4cbdc4cb5546 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:05.390529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873af68-2181-4e99-b38c-cfa710120ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:05.391781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873af68-2181-4e99-b38c-cfa710120ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:05.392157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873af68-2181-4e99-b38c-cfa710120ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:05.392448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873af68-2181-4e99-b38c-cfa710120ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:05.394134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873af68-2181-4e99-b38c-cfa710120ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:05.398778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873af68-2181-4e99-b38c-cfa710120ec8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:05.437665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efb4fa-9f81-4a54-85ce-ac720c06eee1 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:05.449550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85400c2b-d0e8-4cbf-aa99-33dd16bea806 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:05.450573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400c2b-d0e8-4cbf-aa99-33dd16bea806 service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:05.451015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400c2b-d0e8-4cbf-aa99-33dd16bea806 service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:05.451471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400c2b-d0e8-4cbf-aa99-33dd16bea806 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:05.470111 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1989/3942] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:57:05 2021] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:57:05.472021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873af68-2181-4e99-b38c-cfa710120ec8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:05.474788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85400c2b-d0e8-4cbf-aa99-33dd16bea806 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:05.477630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85400c2b-d0e8-4cbf-aa99-33dd16bea806 service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:05.505056 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1954/3943] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:05 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:05.652588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873af68-2181-4e99-b38c-cfa710120ec8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:05.676997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd9ffc-b76f-4bde-a6a1-2ee4d5d2ce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:05.678686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd9ffc-b76f-4bde-a6a1-2ee4d5d2ce21 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:05.679111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd9ffc-b76f-4bde-a6a1-2ee4d5d2ce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:05.679524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd9ffc-b76f-4bde-a6a1-2ee4d5d2ce21 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:05.680560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd9ffc-b76f-4bde-a6a1-2ee4d5d2ce21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:05.683803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd9ffc-b76f-4bde-a6a1-2ee4d5d2ce21 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:05.725666 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1990/3944] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:57:05 2021] POST /identity/v3/users => generated 303 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:57:05.729963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85400c2b-d0e8-4cbf-aa99-33dd16bea806 service glance] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:05.750581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85400c2b-d0e8-4cbf-aa99-33dd16bea806 service glance] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:05.766066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d61b3-1592-410c-9a2a-7061e3e530a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:05.767229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d61b3-1592-410c-9a2a-7061e3e530a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:05.767817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d61b3-1592-410c-9a2a-7061e3e530a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:05.768300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d61b3-1592-410c-9a2a-7061e3e530a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:05.769398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d61b3-1592-410c-9a2a-7061e3e530a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:05.773319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d61b3-1592-410c-9a2a-7061e3e530a5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:05.809634 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1955/3945] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:05 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:57:05.814588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd9ffc-b76f-4bde-a6a1-2ee4d5d2ce21 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:05.855257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd9ffc-b76f-4bde-a6a1-2ee4d5d2ce21 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:05.873760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d52acc-c7b9-4fb9-b6fc-9500364e5206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:05.875395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d52acc-c7b9-4fb9-b6fc-9500364e5206 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:05.875899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d52acc-c7b9-4fb9-b6fc-9500364e5206 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:05.876340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d52acc-c7b9-4fb9-b6fc-9500364e5206 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:05.877723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d52acc-c7b9-4fb9-b6fc-9500364e5206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:05.880806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d52acc-c7b9-4fb9-b6fc-9500364e5206 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:05.915389 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1991/3946] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:05 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:57:05.919724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d61b3-1592-410c-9a2a-7061e3e530a5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:05.962026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d61b3-1592-410c-9a2a-7061e3e530a5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:05.992474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cf973-d134-45a9-a6c8-9632b44ec74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:05.993534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cf973-d134-45a9-a6c8-9632b44ec74a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:05.993946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cf973-d134-45a9-a6c8-9632b44ec74a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:05.994512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cf973-d134-45a9-a6c8-9632b44ec74a admin admin] PATH_INFO: `/v3/projects/8b7b9fe02fd74cec9da8f2663081823e/users/765637a4c5364aec877bbb4f0abfa558/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:06.026133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cf973-d134-45a9-a6c8-9632b44ec74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7b9fe02fd74cec9da8f2663081823e, user_id=765637a4c5364aec877bbb4f0abfa558, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:06.030797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cf973-d134-45a9-a6c8-9632b44ec74a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:06.056416 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1956/3947] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:57:05 2021] PUT /identity/v3/projects/8b7b9fe02fd74cec9da8f2663081823e/users/765637a4c5364aec877bbb4f0abfa558/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:06.058358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0995ce-262b-43ee-96a9-6697924705f2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:06.058902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0995ce-262b-43ee-96a9-6697924705f2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:06.059041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0995ce-262b-43ee-96a9-6697924705f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:06.086648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3f0995ce-262b-43ee-96a9-6697924705f2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:06.093086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3f0995ce-262b-43ee-96a9-6697924705f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:06.257717 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1992/3948] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:06.267985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cf973-d134-45a9-a6c8-9632b44ec74a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:06.269881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c92cf973-d134-45a9-a6c8-9632b44ec74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:06.428728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cf973-d134-45a9-a6c8-9632b44ec74a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:06.443122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c7116-e79c-4c3a-a8dc-34a6f58525e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:06.443815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c7116-e79c-4c3a-a8dc-34a6f58525e6 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:06.444105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c7116-e79c-4c3a-a8dc-34a6f58525e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:06.444394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c7116-e79c-4c3a-a8dc-34a6f58525e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:06.459889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c7116-e79c-4c3a-a8dc-34a6f58525e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:06.464084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c7116-e79c-4c3a-a8dc-34a6f58525e6 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:06.480407 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1957/3949] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:09.159679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de3578-0816-4723-b044-ce3a76b64080 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:09.160769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de3578-0816-4723-b044-ce3a76b64080 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:09.161376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de3578-0816-4723-b044-ce3a76b64080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:09.285549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-15de3578-0816-4723-b044-ce3a76b64080 None None] MFA Rules not processed for user `765637a4c5364aec877bbb4f0abfa558`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:09.288002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-15de3578-0816-4723-b044-ce3a76b64080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:09.677887 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1993/3950] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:09 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:09.695262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c7116-e79c-4c3a-a8dc-34a6f58525e6 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:09.697499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-842c7116-e79c-4c3a-a8dc-34a6f58525e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:10.124003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c7116-e79c-4c3a-a8dc-34a6f58525e6 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:10.146747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1903e-07d7-42b9-99da-712e92eaae1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:10.148566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1903e-07d7-42b9-99da-712e92eaae1b service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:10.149522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1903e-07d7-42b9-99da-712e92eaae1b service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:10.149825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1903e-07d7-42b9-99da-712e92eaae1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:10.186033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1903e-07d7-42b9-99da-712e92eaae1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:10.191509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1903e-07d7-42b9-99da-712e92eaae1b service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:10.239209 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1958/3951] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:09 2021] GET /identity/v3/auth/tokens => generated 3272 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:57:11.076161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de3578-0816-4723-b044-ce3a76b64080 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:11.121685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de3578-0816-4723-b044-ce3a76b64080 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:11.139352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffc4e5-3c2f-41d7-89b5-b8eb95b0c247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:11.140020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffc4e5-3c2f-41d7-89b5-b8eb95b0c247 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:11.140330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffc4e5-3c2f-41d7-89b5-b8eb95b0c247 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:11.140576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffc4e5-3c2f-41d7-89b5-b8eb95b0c247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:11.146285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-29ffc4e5-3c2f-41d7-89b5-b8eb95b0c247 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:11.279475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffc4e5-3c2f-41d7-89b5-b8eb95b0c247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:11.281805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffc4e5-3c2f-41d7-89b5-b8eb95b0c247 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:11.294159 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1994/3952] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:11 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:14.157677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1903e-07d7-42b9-99da-712e92eaae1b service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:14.160319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b2d1903e-07d7-42b9-99da-712e92eaae1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:14.248938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1903e-07d7-42b9-99da-712e92eaae1b service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:14.258746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634d5f9-dc3a-4be1-8fd0-ec458d76b0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:14.259638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634d5f9-dc3a-4be1-8fd0-ec458d76b0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:14.259930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634d5f9-dc3a-4be1-8fd0-ec458d76b0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:14.260216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634d5f9-dc3a-4be1-8fd0-ec458d76b0e1 admin admin] PATH_INFO: `/v3/users/9b325974d7ea4b42bf73616257c08903` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:14.266369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634d5f9-dc3a-4be1-8fd0-ec458d76b0e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b325974d7ea4b42bf73616257c08903)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:14.268631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634d5f9-dc3a-4be1-8fd0-ec458d76b0e1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:14.393438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3634d5f9-dc3a-4be1-8fd0-ec458d76b0e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b325974d7ea4b42bf73616257c08903'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:14.409273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3634d5f9-dc3a-4be1-8fd0-ec458d76b0e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b325974d7ea4b42bf73616257c08903'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:14.438500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3634d5f9-dc3a-4be1-8fd0-ec458d76b0e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b325974d7ea4b42bf73616257c08903'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:14.439519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3634d5f9-dc3a-4be1-8fd0-ec458d76b0e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b325974d7ea4b42bf73616257c08903'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:14.459624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3634d5f9-dc3a-4be1-8fd0-ec458d76b0e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b325974d7ea4b42bf73616257c08903'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:14.472741 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1959/3953] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:57:14 2021] DELETE /identity/v3/users/9b325974d7ea4b42bf73616257c08903 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:14.477002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fb095-6708-43a3-be79-2e3bc4a501ff None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:14.478070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fb095-6708-43a3-be79-2e3bc4a501ff None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:14.478687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fb095-6708-43a3-be79-2e3bc4a501ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:14.537122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b73fb095-6708-43a3-be79-2e3bc4a501ff None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:14.539223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b73fb095-6708-43a3-be79-2e3bc4a501ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:14.852216 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1995/3954] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:14.934544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634d5f9-dc3a-4be1-8fd0-ec458d76b0e1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:14.936160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3634d5f9-dc3a-4be1-8fd0-ec458d76b0e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:15.143307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634d5f9-dc3a-4be1-8fd0-ec458d76b0e1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:15.148847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a83dd-6ca8-46c1-b425-83b314fed0d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:15.150063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a83dd-6ca8-46c1-b425-83b314fed0d4 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:15.150602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a83dd-6ca8-46c1-b425-83b314fed0d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:15.151333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a83dd-6ca8-46c1-b425-83b314fed0d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:15.191373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a83dd-6ca8-46c1-b425-83b314fed0d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:15.195146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a83dd-6ca8-46c1-b425-83b314fed0d4 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:15.211704 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1960/3955] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:16.702346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fb095-6708-43a3-be79-2e3bc4a501ff None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:16.703924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b73fb095-6708-43a3-be79-2e3bc4a501ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:16.741815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fb095-6708-43a3-be79-2e3bc4a501ff None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:16.775636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:16.784425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:16.785685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:16.786126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc admin admin] PATH_INFO: `/v3/projects/1acacc43a32d4cb8ae226b53cd78f92e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:16.793358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1acacc43a32d4cb8ae226b53cd78f92e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:16.798106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:17.018888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1acacc43a32d4cb8ae226b53cd78f92e', 'request_id': 'req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:17.029776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1acacc43a32d4cb8ae226b53cd78f92e', 'request_id': 'req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:17.050768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1acacc43a32d4cb8ae226b53cd78f92e', 'request_id': 'req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:17.084096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc admin admin] The token cache is being invalidate because project 1acacc43a32d4cb8ae226b53cd78f92e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:57:17.084738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:17.087426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:17.105513 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1996/3956] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:16 2021] DELETE /identity/v3/projects/1acacc43a32d4cb8ae226b53cd78f92e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:57:17.110894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a83dd-6ca8-46c1-b425-83b314fed0d4 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:17.124828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a83dd-6ca8-46c1-b425-83b314fed0d4 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:17.314016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aacd5a-895d-4498-93ba-157e3f4823da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:17.315510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aacd5a-895d-4498-93ba-157e3f4823da admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:17.315989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aacd5a-895d-4498-93ba-157e3f4823da admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:17.316428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aacd5a-895d-4498-93ba-157e3f4823da admin admin] PATH_INFO: `/v3/users/98302a54d7a7476dadf2356a8c82a57a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:17.318607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aacd5a-895d-4498-93ba-157e3f4823da admin admin] RBAC: Authorizing `identity:delete_user(user_id=98302a54d7a7476dadf2356a8c82a57a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:17.320774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aacd5a-895d-4498-93ba-157e3f4823da admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:17.541518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-91aacd5a-895d-4498-93ba-157e3f4823da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98302a54d7a7476dadf2356a8c82a57a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:17.583102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-91aacd5a-895d-4498-93ba-157e3f4823da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98302a54d7a7476dadf2356a8c82a57a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:17.642977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-91aacd5a-895d-4498-93ba-157e3f4823da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98302a54d7a7476dadf2356a8c82a57a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:17.650193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-91aacd5a-895d-4498-93ba-157e3f4823da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98302a54d7a7476dadf2356a8c82a57a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:17.690822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-91aacd5a-895d-4498-93ba-157e3f4823da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98302a54d7a7476dadf2356a8c82a57a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:17.704454 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1961/3957] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:57:17 2021] DELETE /identity/v3/users/98302a54d7a7476dadf2356a8c82a57a => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:18.641601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:18.642933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:18.676406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0eba98-a9b9-4ba6-88cf-9f0adaa767bc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:18.831335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cebe4-c3ec-4e30-808a-9895a724d2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:18.834803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cebe4-c3ec-4e30-808a-9895a724d2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:18.835572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cebe4-c3ec-4e30-808a-9895a724d2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:18.836982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cebe4-c3ec-4e30-808a-9895a724d2b1 admin admin] PATH_INFO: `/v3/projects/20beec2212ad47b49e6a7cd985c81663` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:18.838974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cebe4-c3ec-4e30-808a-9895a724d2b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20beec2212ad47b49e6a7cd985c81663)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:18.841244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cebe4-c3ec-4e30-808a-9895a724d2b1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:19.047705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-570cebe4-c3ec-4e30-808a-9895a724d2b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20beec2212ad47b49e6a7cd985c81663', 'request_id': 'req-570cebe4-c3ec-4e30-808a-9895a724d2b1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:19.082281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-570cebe4-c3ec-4e30-808a-9895a724d2b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20beec2212ad47b49e6a7cd985c81663', 'request_id': 'req-570cebe4-c3ec-4e30-808a-9895a724d2b1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:19.116230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-570cebe4-c3ec-4e30-808a-9895a724d2b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20beec2212ad47b49e6a7cd985c81663', 'request_id': 'req-570cebe4-c3ec-4e30-808a-9895a724d2b1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:19.145124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-570cebe4-c3ec-4e30-808a-9895a724d2b1 admin admin] The token cache is being invalidate because project 20beec2212ad47b49e6a7cd985c81663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:57:19.145484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-570cebe4-c3ec-4e30-808a-9895a724d2b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:19.152482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-570cebe4-c3ec-4e30-808a-9895a724d2b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:19.164881 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1997/3958] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:18 2021] DELETE /identity/v3/projects/20beec2212ad47b49e6a7cd985c81663 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:57:19.168940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af970d47-4bae-4605-94e0-bc1227e1a174 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:19.168940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af970d47-4bae-4605-94e0-bc1227e1a174 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:19.168940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af970d47-4bae-4605-94e0-bc1227e1a174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:19.319755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-af970d47-4bae-4605-94e0-bc1227e1a174 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:19.331424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-af970d47-4bae-4605-94e0-bc1227e1a174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:19.538843 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1962/3959] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:19.547203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ea40e-80b2-4ab9-b10f-2a2c37c2b107 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:19.547485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ea40e-80b2-4ab9-b10f-2a2c37c2b107 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:19.547770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ea40e-80b2-4ab9-b10f-2a2c37c2b107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:19.585182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e27ea40e-80b2-4ab9-b10f-2a2c37c2b107 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:19.586857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e27ea40e-80b2-4ab9-b10f-2a2c37c2b107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:19.605680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af970d47-4bae-4605-94e0-bc1227e1a174 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:19.613317 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1998/3960] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:19.619805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af970d47-4bae-4605-94e0-bc1227e1a174 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:19.627107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e16c4d-ade2-4c2a-8ade-86c3398acbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:19.627925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e16c4d-ade2-4c2a-8ade-86c3398acbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:19.628317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e16c4d-ade2-4c2a-8ade-86c3398acbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:19.628743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e16c4d-ade2-4c2a-8ade-86c3398acbf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:19.629627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e16c4d-ade2-4c2a-8ade-86c3398acbf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:57:19.630041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e16c4d-ade2-4c2a-8ade-86c3398acbf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:19.632351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e16c4d-ade2-4c2a-8ade-86c3398acbf4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:19.635189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefed1c-6689-4d07-99a9-ebaeaa7e7fc8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:19.636042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefed1c-6689-4d07-99a9-ebaeaa7e7fc8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:19.636420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefed1c-6689-4d07-99a9-ebaeaa7e7fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:19.669994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2aefed1c-6689-4d07-99a9-ebaeaa7e7fc8 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:19.672846 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1963/3961] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:57:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:57:19.676893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e16c4d-ade2-4c2a-8ade-86c3398acbf4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:19.677816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2aefed1c-6689-4d07-99a9-ebaeaa7e7fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:19.688523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e16c4d-ade2-4c2a-8ade-86c3398acbf4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:19.696003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3ae01-504a-49f7-b4b8-1728e26305f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:19.697017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3ae01-504a-49f7-b4b8-1728e26305f0 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:19.697614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3ae01-504a-49f7-b4b8-1728e26305f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:19.698053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3ae01-504a-49f7-b4b8-1728e26305f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:19.698966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3ae01-504a-49f7-b4b8-1728e26305f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:19.701160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3ae01-504a-49f7-b4b8-1728e26305f0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:19.759072 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 1999/3962] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:57:19 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:19.774344 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1964/3963] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:57:19 2021] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:57:19.778896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefed1c-6689-4d07-99a9-ebaeaa7e7fc8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:19.792872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefed1c-6689-4d07-99a9-ebaeaa7e7fc8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:19.806661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3ae01-504a-49f7-b4b8-1728e26305f0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:19.811218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d4d3ae01-504a-49f7-b4b8-1728e26305f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:19.917618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3ae01-504a-49f7-b4b8-1728e26305f0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:19.924864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13deb47c-11e3-482c-9573-cb8da5db70f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:19.926069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13deb47c-11e3-482c-9573-cb8da5db70f1 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:19.926543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13deb47c-11e3-482c-9573-cb8da5db70f1 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:19.926790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13deb47c-11e3-482c-9573-cb8da5db70f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:19.976865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2f33f-67bf-4035-b668-0ae48f260f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:19.977560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2f33f-67bf-4035-b668-0ae48f260f51 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:19.983996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2f33f-67bf-4035-b668-0ae48f260f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:19.984338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2f33f-67bf-4035-b668-0ae48f260f51 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:19.985105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2f33f-67bf-4035-b668-0ae48f260f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:20.005532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2f33f-67bf-4035-b668-0ae48f260f51 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:20.031833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13deb47c-11e3-482c-9573-cb8da5db70f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:20.034594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13deb47c-11e3-482c-9573-cb8da5db70f1 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:20.044683 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1965/3964] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:57:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 20:57:20.078744 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2000/3965] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:57:19 2021] POST /identity/v3/users => generated 297 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:57:20.086031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13deb47c-11e3-482c-9573-cb8da5db70f1 service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:20.124920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13deb47c-11e3-482c-9573-cb8da5db70f1 service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:20.140079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994be58-5214-4d55-81d6-22c90a592c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:20.140811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994be58-5214-4d55-81d6-22c90a592c09 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:20.141116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994be58-5214-4d55-81d6-22c90a592c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:20.141397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994be58-5214-4d55-81d6-22c90a592c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:20.142155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994be58-5214-4d55-81d6-22c90a592c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:20.152020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994be58-5214-4d55-81d6-22c90a592c09 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:20.163770 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1966/3966] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:20 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:57:20.167777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2f33f-67bf-4035-b668-0ae48f260f51 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:20.183308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2f33f-67bf-4035-b668-0ae48f260f51 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:20.204100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff43b42-1b29-4dfd-9c9e-f4b78fa0fdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:20.204712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff43b42-1b29-4dfd-9c9e-f4b78fa0fdfb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:20.205005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff43b42-1b29-4dfd-9c9e-f4b78fa0fdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:20.205283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff43b42-1b29-4dfd-9c9e-f4b78fa0fdfb admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:20.208430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff43b42-1b29-4dfd-9c9e-f4b78fa0fdfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:20.210069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff43b42-1b29-4dfd-9c9e-f4b78fa0fdfb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:20.249550 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2001/3967] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:20 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:57:20.250155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994be58-5214-4d55-81d6-22c90a592c09 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:20.261243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994be58-5214-4d55-81d6-22c90a592c09 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:20.282697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adba828-c091-4514-a85b-80232488dc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:20.283743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adba828-c091-4514-a85b-80232488dc2f admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:20.284119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adba828-c091-4514-a85b-80232488dc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:20.284465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adba828-c091-4514-a85b-80232488dc2f admin admin] PATH_INFO: `/v3/projects/98128a4aa0b74995a96111645c40342e/users/357489c5c060461090a47c9f08de5037/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:20.334462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adba828-c091-4514-a85b-80232488dc2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=98128a4aa0b74995a96111645c40342e, user_id=357489c5c060461090a47c9f08de5037, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:20.337381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adba828-c091-4514-a85b-80232488dc2f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:20.399549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951a224-2544-4bc3-8aa9-079225c169b2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:20.399741 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1967/3968] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:57:20 2021] PUT /identity/v3/projects/98128a4aa0b74995a96111645c40342e/users/357489c5c060461090a47c9f08de5037/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:20.399854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951a224-2544-4bc3-8aa9-079225c169b2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:20.400113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951a224-2544-4bc3-8aa9-079225c169b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:20.442810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d951a224-2544-4bc3-8aa9-079225c169b2 None None] MFA Rules not processed for user `357489c5c060461090a47c9f08de5037`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:20.444302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d951a224-2544-4bc3-8aa9-079225c169b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:20.561472 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2002/3969] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:20 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:57:20.567671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adba828-c091-4514-a85b-80232488dc2f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:20.657483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adba828-c091-4514-a85b-80232488dc2f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:20.675657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e246d1-8189-46ba-8aa4-3e7ce22b16d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:20.676849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e246d1-8189-46ba-8aa4-3e7ce22b16d7 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:20.677360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e246d1-8189-46ba-8aa4-3e7ce22b16d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:20.677845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e246d1-8189-46ba-8aa4-3e7ce22b16d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:20.678804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e246d1-8189-46ba-8aa4-3e7ce22b16d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:20.681096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e246d1-8189-46ba-8aa4-3e7ce22b16d7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:20.722348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951a224-2544-4bc3-8aa9-079225c169b2 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:20.724629 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1968/3970] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:57:20 2021] POST /identity/v3/projects => generated 391 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:57:20.750863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951a224-2544-4bc3-8aa9-079225c169b2 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:20.828361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de03f8b-8d30-450b-b340-105e8306e811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:20.829436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de03f8b-8d30-450b-b340-105e8306e811 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:20.829937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de03f8b-8d30-450b-b340-105e8306e811 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:20.830973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de03f8b-8d30-450b-b340-105e8306e811 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:20.832472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de03f8b-8d30-450b-b340-105e8306e811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:20.835025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de03f8b-8d30-450b-b340-105e8306e811 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:20.865347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e246d1-8189-46ba-8aa4-3e7ce22b16d7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:20.876443 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2003/3971] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:57:20 2021] POST /identity/v3/users => generated 302 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:57:20.879113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e246d1-8189-46ba-8aa4-3e7ce22b16d7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:20.895577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d2f76-b39d-433e-bcbe-0d0da15bccc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:20.896780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d2f76-b39d-433e-bcbe-0d0da15bccc7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:20.897274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d2f76-b39d-433e-bcbe-0d0da15bccc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:20.897850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d2f76-b39d-433e-bcbe-0d0da15bccc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:20.899933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d2f76-b39d-433e-bcbe-0d0da15bccc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:20.902771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d2f76-b39d-433e-bcbe-0d0da15bccc7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:20.922398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de03f8b-8d30-450b-b340-105e8306e811 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:20.935321 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1969/3972] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:20 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:57:20.938226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de03f8b-8d30-450b-b340-105e8306e811 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:20.951137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5bb8b-83de-4f0b-a546-393893264fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:20.952806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5bb8b-83de-4f0b-a546-393893264fff admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:20.953472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5bb8b-83de-4f0b-a546-393893264fff admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:20.956026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5bb8b-83de-4f0b-a546-393893264fff admin admin] PATH_INFO: `/v3/projects/cf4146b2f2ec41f5a6d70e3f8968cadc/users/a0e440051f75472c87c4381b7b5afb61/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:20.977741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5bb8b-83de-4f0b-a546-393893264fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf4146b2f2ec41f5a6d70e3f8968cadc, user_id=a0e440051f75472c87c4381b7b5afb61, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:20.980629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5bb8b-83de-4f0b-a546-393893264fff admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:21.012935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d2f76-b39d-433e-bcbe-0d0da15bccc7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:21.013598 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2004/3973] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:57:20 2021] PUT /identity/v3/projects/cf4146b2f2ec41f5a6d70e3f8968cadc/users/a0e440051f75472c87c4381b7b5afb61/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:21.025489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d2f76-b39d-433e-bcbe-0d0da15bccc7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:21.193804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ab0a9-2a4b-4a38-8b16-01b42c516999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:21.194522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ab0a9-2a4b-4a38-8b16-01b42c516999 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:21.194815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ab0a9-2a4b-4a38-8b16-01b42c516999 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:21.195095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ab0a9-2a4b-4a38-8b16-01b42c516999 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:21.195843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ab0a9-2a4b-4a38-8b16-01b42c516999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:21.197424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ab0a9-2a4b-4a38-8b16-01b42c516999 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:21.232370 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1970/3974] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:21 2021] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:57:21.237332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5bb8b-83de-4f0b-a546-393893264fff admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:21.263130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5bb8b-83de-4f0b-a546-393893264fff admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:21.286511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e3299-835d-4ed2-b177-42b6904a8bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:21.287430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e3299-835d-4ed2-b177-42b6904a8bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:21.287717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e3299-835d-4ed2-b177-42b6904a8bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:21.288061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e3299-835d-4ed2-b177-42b6904a8bd1 admin admin] PATH_INFO: `/v3/projects/cf4146b2f2ec41f5a6d70e3f8968cadc/users/a0e440051f75472c87c4381b7b5afb61/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:21.299550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e3299-835d-4ed2-b177-42b6904a8bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf4146b2f2ec41f5a6d70e3f8968cadc, user_id=a0e440051f75472c87c4381b7b5afb61, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:21.314958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e3299-835d-4ed2-b177-42b6904a8bd1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:21.339362 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2005/3975] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:57:21 2021] PUT /identity/v3/projects/cf4146b2f2ec41f5a6d70e3f8968cadc/users/a0e440051f75472c87c4381b7b5afb61/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:21.341324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407099e-c164-4204-92e9-a42dd363daf3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:21.341796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407099e-c164-4204-92e9-a42dd363daf3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:21.341796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407099e-c164-4204-92e9-a42dd363daf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:21.401750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2407099e-c164-4204-92e9-a42dd363daf3 None None] MFA Rules not processed for user `a0e440051f75472c87c4381b7b5afb61`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:21.403211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2407099e-c164-4204-92e9-a42dd363daf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:21.572254 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1971/3976] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:21 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:57:21.583741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e3299-835d-4ed2-b177-42b6904a8bd1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:21.585550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-850e3299-835d-4ed2-b177-42b6904a8bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:21.717795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e3299-835d-4ed2-b177-42b6904a8bd1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:21.734779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d5e0d-c410-4023-8da2-c88908d7d09c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:21.740035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d5e0d-c410-4023-8da2-c88908d7d09c service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:21.740506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d5e0d-c410-4023-8da2-c88908d7d09c service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:21.740958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d5e0d-c410-4023-8da2-c88908d7d09c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:21.771327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d5e0d-c410-4023-8da2-c88908d7d09c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:21.773021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d5e0d-c410-4023-8da2-c88908d7d09c service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:21.801612 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2006/3977] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:21 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:21.902961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407099e-c164-4204-92e9-a42dd363daf3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:21.904565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2407099e-c164-4204-92e9-a42dd363daf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:21.945613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407099e-c164-4204-92e9-a42dd363daf3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:21.958328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5819f-227b-4d14-b2a8-b58b0af7455c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:21.958328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5819f-227b-4d14-b2a8-b58b0af7455c service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:21.958328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5819f-227b-4d14-b2a8-b58b0af7455c service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:21.958328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5819f-227b-4d14-b2a8-b58b0af7455c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:22.131246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5819f-227b-4d14-b2a8-b58b0af7455c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:22.132646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5819f-227b-4d14-b2a8-b58b0af7455c service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:22.156677 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1972/3978] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:21 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:22.706874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d5e0d-c410-4023-8da2-c88908d7d09c service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:22.708347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a94d5e0d-c410-4023-8da2-c88908d7d09c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:22.960527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d5e0d-c410-4023-8da2-c88908d7d09c service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:22.972859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e48c0-cfb6-44bc-896c-cfac470a0379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:22.973754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e48c0-cfb6-44bc-896c-cfac470a0379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:22.974030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e48c0-cfb6-44bc-896c-cfac470a0379 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:22.974874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e48c0-cfb6-44bc-896c-cfac470a0379 admin admin] PATH_INFO: `/v3/users/765637a4c5364aec877bbb4f0abfa558` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:22.975640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e48c0-cfb6-44bc-896c-cfac470a0379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=765637a4c5364aec877bbb4f0abfa558)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:22.982996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e48c0-cfb6-44bc-896c-cfac470a0379 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:23.156028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ce8e48c0-cfb6-44bc-896c-cfac470a0379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765637a4c5364aec877bbb4f0abfa558'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:23.202771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ce8e48c0-cfb6-44bc-896c-cfac470a0379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765637a4c5364aec877bbb4f0abfa558'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:23.204496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ce8e48c0-cfb6-44bc-896c-cfac470a0379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765637a4c5364aec877bbb4f0abfa558'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:23.257722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ce8e48c0-cfb6-44bc-896c-cfac470a0379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765637a4c5364aec877bbb4f0abfa558'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:23.289913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ce8e48c0-cfb6-44bc-896c-cfac470a0379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765637a4c5364aec877bbb4f0abfa558'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:23.310326 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2007/3979] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:57:22 2021] DELETE /identity/v3/users/765637a4c5364aec877bbb4f0abfa558 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:23.885425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5819f-227b-4d14-b2a8-b58b0af7455c service cinder] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:23.915606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5819f-227b-4d14-b2a8-b58b0af7455c service cinder] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:24.092075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fea605-958c-4759-894e-281b0d51befc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:24.092977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fea605-958c-4759-894e-281b0d51befc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:24.093305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fea605-958c-4759-894e-281b0d51befc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:24.093585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fea605-958c-4759-894e-281b0d51befc admin admin] PATH_INFO: `/v3/projects/8b7b9fe02fd74cec9da8f2663081823e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:24.097487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fea605-958c-4759-894e-281b0d51befc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7b9fe02fd74cec9da8f2663081823e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:24.099424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fea605-958c-4759-894e-281b0d51befc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:24.204425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-53fea605-958c-4759-894e-281b0d51befc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7b9fe02fd74cec9da8f2663081823e', 'request_id': 'req-53fea605-958c-4759-894e-281b0d51befc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:24.212012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-53fea605-958c-4759-894e-281b0d51befc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7b9fe02fd74cec9da8f2663081823e', 'request_id': 'req-53fea605-958c-4759-894e-281b0d51befc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:24.219006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-53fea605-958c-4759-894e-281b0d51befc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7b9fe02fd74cec9da8f2663081823e', 'request_id': 'req-53fea605-958c-4759-894e-281b0d51befc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:24.242880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-53fea605-958c-4759-894e-281b0d51befc admin admin] The token cache is being invalidate because project 8b7b9fe02fd74cec9da8f2663081823e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:57:24.243172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-53fea605-958c-4759-894e-281b0d51befc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:24.244142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-53fea605-958c-4759-894e-281b0d51befc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:24.252196 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1973/3980] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:23 2021] DELETE /identity/v3/projects/8b7b9fe02fd74cec9da8f2663081823e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:24.254486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00f097-d68f-4c6f-ac2c-21819e70ee5a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:24.254971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00f097-d68f-4c6f-ac2c-21819e70ee5a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:24.255049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00f097-d68f-4c6f-ac2c-21819e70ee5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:24.280501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-cf00f097-d68f-4c6f-ac2c-21819e70ee5a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:24.282204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cf00f097-d68f-4c6f-ac2c-21819e70ee5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:24.372295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5a1bf-964a-448e-b018-062a306dd776 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:24.373137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5a1bf-964a-448e-b018-062a306dd776 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:24.373631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5a1bf-964a-448e-b018-062a306dd776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:24.375788 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2008/3981] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:57:24.396281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1be5a1bf-964a-448e-b018-062a306dd776 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:24.397852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1be5a1bf-964a-448e-b018-062a306dd776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:24.412615 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1974/3982] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:24.413165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00f097-d68f-4c6f-ac2c-21819e70ee5a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:24.434245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00f097-d68f-4c6f-ac2c-21819e70ee5a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:24.440858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea51437-49ee-472d-8f99-a797762377b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:24.441563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea51437-49ee-472d-8f99-a797762377b2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:24.441822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea51437-49ee-472d-8f99-a797762377b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:24.442113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea51437-49ee-472d-8f99-a797762377b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:24.442912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea51437-49ee-472d-8f99-a797762377b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:57:24.443292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea51437-49ee-472d-8f99-a797762377b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:24.445098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea51437-49ee-472d-8f99-a797762377b2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:24.468251 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2009/3983] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:57:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:57:24.469745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5a1bf-964a-448e-b018-062a306dd776 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:24.480445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5a1bf-964a-448e-b018-062a306dd776 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:24.489246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bdbe5-d639-45ef-b3e9-f3cbf804af9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:24.490421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bdbe5-d639-45ef-b3e9-f3cbf804af9f admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:24.490877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bdbe5-d639-45ef-b3e9-f3cbf804af9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:24.491322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bdbe5-d639-45ef-b3e9-f3cbf804af9f admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:24.492281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140bdbe5-d639-45ef-b3e9-f3cbf804af9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:24.495430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140bdbe5-d639-45ef-b3e9-f3cbf804af9f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:24.584836 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1975/3984] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:57:24 2021] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:57:24.589352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea51437-49ee-472d-8f99-a797762377b2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:24.603690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea51437-49ee-472d-8f99-a797762377b2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:24.742714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e75afb-2f2e-4d2f-b967-13c9b616309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:24.743402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e75afb-2f2e-4d2f-b967-13c9b616309a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:24.743684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e75afb-2f2e-4d2f-b967-13c9b616309a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:24.743961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e75afb-2f2e-4d2f-b967-13c9b616309a admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:24.745024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e75afb-2f2e-4d2f-b967-13c9b616309a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:24.747646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e75afb-2f2e-4d2f-b967-13c9b616309a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:24.820967 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2010/3985] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:57:24 2021] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:57:24.825113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bdbe5-d639-45ef-b3e9-f3cbf804af9f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:24.837011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bdbe5-d639-45ef-b3e9-f3cbf804af9f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:24.863236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb42715-9585-47b2-a11c-ace3b7e42802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:24.865029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb42715-9585-47b2-a11c-ace3b7e42802 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:24.865487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb42715-9585-47b2-a11c-ace3b7e42802 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:24.865937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb42715-9585-47b2-a11c-ace3b7e42802 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:24.867677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb42715-9585-47b2-a11c-ace3b7e42802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:24.871154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb42715-9585-47b2-a11c-ace3b7e42802 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:24.922066 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1976/3986] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:24 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:57:24.929056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e75afb-2f2e-4d2f-b967-13c9b616309a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:24.958510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e75afb-2f2e-4d2f-b967-13c9b616309a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:24.972642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc354f-74b6-4b83-999f-dab140aa5570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:24.973393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc354f-74b6-4b83-999f-dab140aa5570 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:24.973530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc354f-74b6-4b83-999f-dab140aa5570 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:24.973749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc354f-74b6-4b83-999f-dab140aa5570 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:24.974837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc354f-74b6-4b83-999f-dab140aa5570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:24.976485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc354f-74b6-4b83-999f-dab140aa5570 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:25.005189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb42715-9585-47b2-a11c-ace3b7e42802 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:25.005933 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2011/3987] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:24 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:57:25.023266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb42715-9585-47b2-a11c-ace3b7e42802 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:25.045555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d6c8c-88a5-4966-b9a2-09ff1a4113e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:25.048157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d6c8c-88a5-4966-b9a2-09ff1a4113e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:25.049730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d6c8c-88a5-4966-b9a2-09ff1a4113e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:25.050890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d6c8c-88a5-4966-b9a2-09ff1a4113e9 admin admin] PATH_INFO: `/v3/projects/2ab34e83092a4610b03af4bfa353fb09/users/fba996171cc148a5b0fe75a937f59055/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:25.104955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d6c8c-88a5-4966-b9a2-09ff1a4113e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab34e83092a4610b03af4bfa353fb09, user_id=fba996171cc148a5b0fe75a937f59055, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:25.109261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d6c8c-88a5-4966-b9a2-09ff1a4113e9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:25.142592 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1977/3988] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:57:25 2021] PUT /identity/v3/projects/2ab34e83092a4610b03af4bfa353fb09/users/fba996171cc148a5b0fe75a937f59055/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:57:25.150935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b76fa4-6d05-4f0d-9d18-8f50f143bbf0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:25.151487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b76fa4-6d05-4f0d-9d18-8f50f143bbf0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:25.152550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b76fa4-6d05-4f0d-9d18-8f50f143bbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:25.221305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-33b76fa4-6d05-4f0d-9d18-8f50f143bbf0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:25.226590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-33b76fa4-6d05-4f0d-9d18-8f50f143bbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:25.467869 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2012/3989] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:25.483198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d6c8c-88a5-4966-b9a2-09ff1a4113e9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:25.487440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-509d6c8c-88a5-4966-b9a2-09ff1a4113e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:25.723565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d6c8c-88a5-4966-b9a2-09ff1a4113e9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:25.757142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada58eb8-3fdf-4905-98ce-1b9c7d18951e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:25.757740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada58eb8-3fdf-4905-98ce-1b9c7d18951e service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:25.758031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada58eb8-3fdf-4905-98ce-1b9c7d18951e service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:25.764251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada58eb8-3fdf-4905-98ce-1b9c7d18951e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:25.802156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada58eb8-3fdf-4905-98ce-1b9c7d18951e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:25.803392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada58eb8-3fdf-4905-98ce-1b9c7d18951e service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:25.856574 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1978/3990] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:26.927658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b76fa4-6d05-4f0d-9d18-8f50f143bbf0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:26.929803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-33b76fa4-6d05-4f0d-9d18-8f50f143bbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:26.950700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b76fa4-6d05-4f0d-9d18-8f50f143bbf0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:26.958412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc19a8f-b093-4022-bd2a-10eeb80bf84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:26.962196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc19a8f-b093-4022-bd2a-10eeb80bf84e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:26.963356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc19a8f-b093-4022-bd2a-10eeb80bf84e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:26.963906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc19a8f-b093-4022-bd2a-10eeb80bf84e admin admin] PATH_INFO: `/v3/users/357489c5c060461090a47c9f08de5037` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:26.965953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc19a8f-b093-4022-bd2a-10eeb80bf84e admin admin] RBAC: Authorizing `identity:delete_user(user_id=357489c5c060461090a47c9f08de5037)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:26.969647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc19a8f-b093-4022-bd2a-10eeb80bf84e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:27.147345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fbc19a8f-b093-4022-bd2a-10eeb80bf84e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '357489c5c060461090a47c9f08de5037'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:27.192052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fbc19a8f-b093-4022-bd2a-10eeb80bf84e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '357489c5c060461090a47c9f08de5037'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:27.196982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fbc19a8f-b093-4022-bd2a-10eeb80bf84e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '357489c5c060461090a47c9f08de5037'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:27.299880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fbc19a8f-b093-4022-bd2a-10eeb80bf84e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '357489c5c060461090a47c9f08de5037'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:27.328381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fbc19a8f-b093-4022-bd2a-10eeb80bf84e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '357489c5c060461090a47c9f08de5037'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:27.367397 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2013/3991] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:57:26 2021] DELETE /identity/v3/users/357489c5c060461090a47c9f08de5037 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:27.370182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59416bce-88f0-43ec-96dc-465cb2fd8753 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:27.370667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59416bce-88f0-43ec-96dc-465cb2fd8753 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:27.370812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59416bce-88f0-43ec-96dc-465cb2fd8753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:27.421634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-59416bce-88f0-43ec-96dc-465cb2fd8753 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:27.426858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-59416bce-88f0-43ec-96dc-465cb2fd8753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:27.611566 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1979/3992] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:27.642218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc19a8f-b093-4022-bd2a-10eeb80bf84e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:27.644573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fbc19a8f-b093-4022-bd2a-10eeb80bf84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:27.793282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc19a8f-b093-4022-bd2a-10eeb80bf84e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:27.797505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badb6e6-71f7-4f9b-aac7-22c5396161c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:27.800826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badb6e6-71f7-4f9b-aac7-22c5396161c8 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:27.800826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badb6e6-71f7-4f9b-aac7-22c5396161c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:27.800826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badb6e6-71f7-4f9b-aac7-22c5396161c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:27.811891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badb6e6-71f7-4f9b-aac7-22c5396161c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:27.822487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badb6e6-71f7-4f9b-aac7-22c5396161c8 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:27.860737 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2014/3993] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:28.548332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e638ac-df2c-40f6-ac99-3e4ff4693e4b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:28.548966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e638ac-df2c-40f6-ac99-3e4ff4693e4b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:28.548966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e638ac-df2c-40f6-ac99-3e4ff4693e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:28.597692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-36e638ac-df2c-40f6-ac99-3e4ff4693e4b None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:28.603282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-36e638ac-df2c-40f6-ac99-3e4ff4693e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:28.632929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badb6e6-71f7-4f9b-aac7-22c5396161c8 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:28.634499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1badb6e6-71f7-4f9b-aac7-22c5396161c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:28.658730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badb6e6-71f7-4f9b-aac7-22c5396161c8 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:28.676797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc26079-5395-4a7c-9c0a-436cbbec40cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:28.678130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc26079-5395-4a7c-9c0a-436cbbec40cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:28.681359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc26079-5395-4a7c-9c0a-436cbbec40cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:28.681858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc26079-5395-4a7c-9c0a-436cbbec40cd admin admin] PATH_INFO: `/v3/projects/98128a4aa0b74995a96111645c40342e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:28.685770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc26079-5395-4a7c-9c0a-436cbbec40cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=98128a4aa0b74995a96111645c40342e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:28.689713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc26079-5395-4a7c-9c0a-436cbbec40cd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:28.793669 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1980/3994] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:57:28 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:28.812870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e638ac-df2c-40f6-ac99-3e4ff4693e4b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:28.816794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-36e638ac-df2c-40f6-ac99-3e4ff4693e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:28.892742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3cc26079-5395-4a7c-9c0a-436cbbec40cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98128a4aa0b74995a96111645c40342e', 'request_id': 'req-3cc26079-5395-4a7c-9c0a-436cbbec40cd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:28.920941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3cc26079-5395-4a7c-9c0a-436cbbec40cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98128a4aa0b74995a96111645c40342e', 'request_id': 'req-3cc26079-5395-4a7c-9c0a-436cbbec40cd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:28.944925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3cc26079-5395-4a7c-9c0a-436cbbec40cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98128a4aa0b74995a96111645c40342e', 'request_id': 'req-3cc26079-5395-4a7c-9c0a-436cbbec40cd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:28.989841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3cc26079-5395-4a7c-9c0a-436cbbec40cd admin admin] The token cache is being invalidate because project 98128a4aa0b74995a96111645c40342e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:57:28.990220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3cc26079-5395-4a7c-9c0a-436cbbec40cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:28.995928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3cc26079-5395-4a7c-9c0a-436cbbec40cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:29.003029 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2015/3995] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:28 2021] DELETE /identity/v3/projects/98128a4aa0b74995a96111645c40342e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:29.008019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc26079-5395-4a7c-9c0a-436cbbec40cd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:29.010538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3cc26079-5395-4a7c-9c0a-436cbbec40cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:29.082704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e638ac-df2c-40f6-ac99-3e4ff4693e4b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:29.176529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc26079-5395-4a7c-9c0a-436cbbec40cd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:29.201169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbdd3b-7ba8-45bf-b246-0c8bae02931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:29.203542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbdd3b-7ba8-45bf-b246-0c8bae02931f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:29.203814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbdd3b-7ba8-45bf-b246-0c8bae02931f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:29.204098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbdd3b-7ba8-45bf-b246-0c8bae02931f admin admin] PATH_INFO: `/v3/users/a0e440051f75472c87c4381b7b5afb61` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:29.211088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbdd3b-7ba8-45bf-b246-0c8bae02931f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e440051f75472c87c4381b7b5afb61)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:29.216297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbdd3b-7ba8-45bf-b246-0c8bae02931f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:29.248751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73752a-67c2-485a-aaf1-f2e8ad9d0053 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:29.249418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73752a-67c2-485a-aaf1-f2e8ad9d0053 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:29.249700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73752a-67c2-485a-aaf1-f2e8ad9d0053 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:29.249975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73752a-67c2-485a-aaf1-f2e8ad9d0053 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:29.259998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0f73752a-67c2-485a-aaf1-f2e8ad9d0053 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:29.310396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-21bbdd3b-7ba8-45bf-b246-0c8bae02931f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e440051f75472c87c4381b7b5afb61'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:29.322479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-21bbdd3b-7ba8-45bf-b246-0c8bae02931f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e440051f75472c87c4381b7b5afb61'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:29.323739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-21bbdd3b-7ba8-45bf-b246-0c8bae02931f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e440051f75472c87c4381b7b5afb61'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:29.340526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-21bbdd3b-7ba8-45bf-b246-0c8bae02931f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e440051f75472c87c4381b7b5afb61'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:29.362826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-21bbdd3b-7ba8-45bf-b246-0c8bae02931f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e440051f75472c87c4381b7b5afb61'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:29.377043 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2016/3996] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:57:29 2021] DELETE /identity/v3/users/a0e440051f75472c87c4381b7b5afb61 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:29.417690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73752a-67c2-485a-aaf1-f2e8ad9d0053 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:29.419263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73752a-67c2-485a-aaf1-f2e8ad9d0053 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:29.479114 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1981/3997] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:57:28 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:57:29.984025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbdd3b-7ba8-45bf-b246-0c8bae02931f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:29.989899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-21bbdd3b-7ba8-45bf-b246-0c8bae02931f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:30.170798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbdd3b-7ba8-45bf-b246-0c8bae02931f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:30.188276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819aa606-019f-4c5f-a2c0-08abe2da54e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:30.189180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aa606-019f-4c5f-a2c0-08abe2da54e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:30.189721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aa606-019f-4c5f-a2c0-08abe2da54e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:30.189997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aa606-019f-4c5f-a2c0-08abe2da54e6 admin admin] PATH_INFO: `/v3/users/0ee5b92caab2431f97702541033df654` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:30.194321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819aa606-019f-4c5f-a2c0-08abe2da54e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee5b92caab2431f97702541033df654)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:30.196296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819aa606-019f-4c5f-a2c0-08abe2da54e6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:30.300707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-819aa606-019f-4c5f-a2c0-08abe2da54e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee5b92caab2431f97702541033df654'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:30.313651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-819aa606-019f-4c5f-a2c0-08abe2da54e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee5b92caab2431f97702541033df654'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:30.321825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-819aa606-019f-4c5f-a2c0-08abe2da54e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee5b92caab2431f97702541033df654'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:30.347590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-819aa606-019f-4c5f-a2c0-08abe2da54e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee5b92caab2431f97702541033df654'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:30.368882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-819aa606-019f-4c5f-a2c0-08abe2da54e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee5b92caab2431f97702541033df654'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:30.379753 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2017/3998] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:57:29 2021] DELETE /identity/v3/users/0ee5b92caab2431f97702541033df654 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:30.722608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e252054-a7a9-4bb7-b4b9-85ee6a2f3128 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:30.723130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e252054-a7a9-4bb7-b4b9-85ee6a2f3128 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:30.723224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e252054-a7a9-4bb7-b4b9-85ee6a2f3128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:30.737825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819aa606-019f-4c5f-a2c0-08abe2da54e6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:30.739928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-819aa606-019f-4c5f-a2c0-08abe2da54e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:30.779904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2e252054-a7a9-4bb7-b4b9-85ee6a2f3128 None None] MFA Rules not processed for user `ebd83848fe8d4e7284291660eb51da51`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:30.783602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2e252054-a7a9-4bb7-b4b9-85ee6a2f3128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:30.913929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819aa606-019f-4c5f-a2c0-08abe2da54e6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:30.927518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9181ee6-ca74-4449-87ad-b84ef7a92e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:30.935685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9181ee6-ca74-4449-87ad-b84ef7a92e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:30.937494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9181ee6-ca74-4449-87ad-b84ef7a92e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:30.937494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9181ee6-ca74-4449-87ad-b84ef7a92e1b admin admin] PATH_INFO: `/v3/projects/cf4146b2f2ec41f5a6d70e3f8968cadc` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:30.944824 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1982/3999] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:30 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:30.945890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9181ee6-ca74-4449-87ad-b84ef7a92e1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf4146b2f2ec41f5a6d70e3f8968cadc)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:30.948117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9181ee6-ca74-4449-87ad-b84ef7a92e1b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:30.968155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e252054-a7a9-4bb7-b4b9-85ee6a2f3128 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:30.969537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2e252054-a7a9-4bb7-b4b9-85ee6a2f3128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:30.987943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e252054-a7a9-4bb7-b4b9-85ee6a2f3128 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:31.010924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd14ea-0f2e-4ee3-b04b-d21519768cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:31.011834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd14ea-0f2e-4ee3-b04b-d21519768cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:31.012125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd14ea-0f2e-4ee3-b04b-d21519768cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:31.012429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd14ea-0f2e-4ee3-b04b-d21519768cbe admin admin] PATH_INFO: `/v3/projects/8efd6d0e0ed74857b4b6265fdacc68cc` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:31.015813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd14ea-0f2e-4ee3-b04b-d21519768cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8efd6d0e0ed74857b4b6265fdacc68cc)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:31.018072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd14ea-0f2e-4ee3-b04b-d21519768cbe admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:31.100679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b9181ee6-ca74-4449-87ad-b84ef7a92e1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf4146b2f2ec41f5a6d70e3f8968cadc', 'request_id': 'req-b9181ee6-ca74-4449-87ad-b84ef7a92e1b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:31.116404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b9181ee6-ca74-4449-87ad-b84ef7a92e1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf4146b2f2ec41f5a6d70e3f8968cadc', 'request_id': 'req-b9181ee6-ca74-4449-87ad-b84ef7a92e1b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:31.138797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b9181ee6-ca74-4449-87ad-b84ef7a92e1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf4146b2f2ec41f5a6d70e3f8968cadc', 'request_id': 'req-b9181ee6-ca74-4449-87ad-b84ef7a92e1b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:31.164882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b9181ee6-ca74-4449-87ad-b84ef7a92e1b admin admin] The token cache is being invalidate because project cf4146b2f2ec41f5a6d70e3f8968cadc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:57:31.166925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b9181ee6-ca74-4449-87ad-b84ef7a92e1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:31.168061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b9181ee6-ca74-4449-87ad-b84ef7a92e1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:31.173396 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2018/4000] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:30 2021] DELETE /identity/v3/projects/cf4146b2f2ec41f5a6d70e3f8968cadc => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:31.174802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd666a62-465c-43f3-bb99-78ac53fdbb52 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:31.175155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd666a62-465c-43f3-bb99-78ac53fdbb52 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:31.175431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd666a62-465c-43f3-bb99-78ac53fdbb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:31.183963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2fdd14ea-0f2e-4ee3-b04b-d21519768cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8efd6d0e0ed74857b4b6265fdacc68cc', 'request_id': 'req-2fdd14ea-0f2e-4ee3-b04b-d21519768cbe'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:31.202095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2fdd14ea-0f2e-4ee3-b04b-d21519768cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8efd6d0e0ed74857b4b6265fdacc68cc', 'request_id': 'req-2fdd14ea-0f2e-4ee3-b04b-d21519768cbe'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:31.230487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-dd666a62-465c-43f3-bb99-78ac53fdbb52 None None] MFA Rules not processed for user `216cd2c0d4b249e797990918152b4749`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:31.231126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2fdd14ea-0f2e-4ee3-b04b-d21519768cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8efd6d0e0ed74857b4b6265fdacc68cc', 'request_id': 'req-2fdd14ea-0f2e-4ee3-b04b-d21519768cbe'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:31.233275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dd666a62-465c-43f3-bb99-78ac53fdbb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:31.267322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2fdd14ea-0f2e-4ee3-b04b-d21519768cbe admin admin] The token cache is being invalidate because project 8efd6d0e0ed74857b4b6265fdacc68cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:57:31.267623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2fdd14ea-0f2e-4ee3-b04b-d21519768cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:31.286756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2fdd14ea-0f2e-4ee3-b04b-d21519768cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:31.289951 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1983/4001] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:30 2021] DELETE /identity/v3/projects/8efd6d0e0ed74857b4b6265fdacc68cc => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:31.294742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513351cf-8206-4d2b-a8cf-4e1b244a8b22 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:31.295121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513351cf-8206-4d2b-a8cf-4e1b244a8b22 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:31.295509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513351cf-8206-4d2b-a8cf-4e1b244a8b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:31.359609 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2019/4002] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:31 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:31.359609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f124e-7ffb-4a8b-b380-26ee1c35005a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:31.359609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f124e-7ffb-4a8b-b380-26ee1c35005a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:31.359609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f124e-7ffb-4a8b-b380-26ee1c35005a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:31.394983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-537f124e-7ffb-4a8b-b380-26ee1c35005a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:31.396900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-537f124e-7ffb-4a8b-b380-26ee1c35005a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:31.397513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-513351cf-8206-4d2b-a8cf-4e1b244a8b22 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:31.400415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-513351cf-8206-4d2b-a8cf-4e1b244a8b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:31.519872 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2020/4003] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:31.527615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d60d2d-1820-4508-8d83-04e02b15f117 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:31.527913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d60d2d-1820-4508-8d83-04e02b15f117 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:31.528305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d60d2d-1820-4508-8d83-04e02b15f117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:31.549721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-79d60d2d-1820-4508-8d83-04e02b15f117 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:31.551917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-79d60d2d-1820-4508-8d83-04e02b15f117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:31.564194 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2021/4004] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:57:31.569138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d60d2d-1820-4508-8d83-04e02b15f117 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:31.582911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d60d2d-1820-4508-8d83-04e02b15f117 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:31.595534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8818be-4fc4-41ab-bee4-3d3850947404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:31.596663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8818be-4fc4-41ab-bee4-3d3850947404 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:31.597145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8818be-4fc4-41ab-bee4-3d3850947404 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:31.597734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8818be-4fc4-41ab-bee4-3d3850947404 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:31.598802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8818be-4fc4-41ab-bee4-3d3850947404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:57:31.599266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8818be-4fc4-41ab-bee4-3d3850947404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:31.601478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8818be-4fc4-41ab-bee4-3d3850947404 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:31.617282 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2022/4005] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:57:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:57:31.623304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8818be-4fc4-41ab-bee4-3d3850947404 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:31.639172 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1984/4006] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:31.647685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff871851-3c5d-455f-bab4-04eb62fce1b9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:31.648003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff871851-3c5d-455f-bab4-04eb62fce1b9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:31.648288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff871851-3c5d-455f-bab4-04eb62fce1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:31.654504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8818be-4fc4-41ab-bee4-3d3850947404 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:31.660872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcfb0a-57ec-4dec-b611-012f1ad8faba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:31.661969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcfb0a-57ec-4dec-b611-012f1ad8faba admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:31.662484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcfb0a-57ec-4dec-b611-012f1ad8faba admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:31.662959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcfb0a-57ec-4dec-b611-012f1ad8faba admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:31.664844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcfb0a-57ec-4dec-b611-012f1ad8faba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:31.668434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcfb0a-57ec-4dec-b611-012f1ad8faba admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:31.688556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ff871851-3c5d-455f-bab4-04eb62fce1b9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:31.690145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ff871851-3c5d-455f-bab4-04eb62fce1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:31.708579 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2023/4007] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:57:31 2021] POST /identity/v3/projects => generated 365 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:57:31.713713 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1985/4008] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:31.719508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff871851-3c5d-455f-bab4-04eb62fce1b9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:31.721602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcfb0a-57ec-4dec-b611-012f1ad8faba admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:31.746527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff871851-3c5d-455f-bab4-04eb62fce1b9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:31.858132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcfb0a-57ec-4dec-b611-012f1ad8faba admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:31.864981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adee04-33a6-4731-888c-db33a13369f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:31.865824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adee04-33a6-4731-888c-db33a13369f2 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:31.866207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adee04-33a6-4731-888c-db33a13369f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:31.866605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adee04-33a6-4731-888c-db33a13369f2 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:31.867420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adee04-33a6-4731-888c-db33a13369f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:31.869932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adee04-33a6-4731-888c-db33a13369f2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:31.923137 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2024/4009] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:57:31 2021] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:57:31.927623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adee04-33a6-4731-888c-db33a13369f2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:31.958946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adee04-33a6-4731-888c-db33a13369f2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:31.966215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f403f-5fe9-45b8-ab7f-2f878ffb0fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:31.967625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd86ce0-bf03-496b-a4f2-d43199118296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:31.971476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd86ce0-bf03-496b-a4f2-d43199118296 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:31.971476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd86ce0-bf03-496b-a4f2-d43199118296 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:31.971476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd86ce0-bf03-496b-a4f2-d43199118296 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:31.971476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd86ce0-bf03-496b-a4f2-d43199118296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:57:31.974527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd86ce0-bf03-496b-a4f2-d43199118296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:31.978237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f403f-5fe9-45b8-ab7f-2f878ffb0fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:31.978562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f403f-5fe9-45b8-ab7f-2f878ffb0fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:31.978852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f403f-5fe9-45b8-ab7f-2f878ffb0fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:31.979637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f403f-5fe9-45b8-ab7f-2f878ffb0fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:31.981294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f403f-5fe9-45b8-ab7f-2f878ffb0fb9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:31.982066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd86ce0-bf03-496b-a4f2-d43199118296 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:32.005859 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1986/4010] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:57:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:57:32.012269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd86ce0-bf03-496b-a4f2-d43199118296 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:32.017922 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2025/4011] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:31 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:57:32.019566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f403f-5fe9-45b8-ab7f-2f878ffb0fb9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:32.037725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f403f-5fe9-45b8-ab7f-2f878ffb0fb9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:32.050674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615867a0-0c6d-4f2e-93e1-c9c65fa7dd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:32.051512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615867a0-0c6d-4f2e-93e1-c9c65fa7dd3a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:32.051809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615867a0-0c6d-4f2e-93e1-c9c65fa7dd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:32.052100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615867a0-0c6d-4f2e-93e1-c9c65fa7dd3a admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:32.052887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd86ce0-bf03-496b-a4f2-d43199118296 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:32.052999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615867a0-0c6d-4f2e-93e1-c9c65fa7dd3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:32.057176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615867a0-0c6d-4f2e-93e1-c9c65fa7dd3a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:32.075641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3effff-1d76-4621-b85c-6563484c2bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:32.076666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3effff-1d76-4621-b85c-6563484c2bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:32.077054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3effff-1d76-4621-b85c-6563484c2bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:32.077610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3effff-1d76-4621-b85c-6563484c2bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:32.082984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3effff-1d76-4621-b85c-6563484c2bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:32.085200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3effff-1d76-4621-b85c-6563484c2bd4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:32.104028 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1987/4012] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:32 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:57:32.108076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3effff-1d76-4621-b85c-6563484c2bd4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:32.120093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3effff-1d76-4621-b85c-6563484c2bd4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:32.125261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b258d-3cdf-4ee7-9d53-a0cf676a21de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:32.126532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b258d-3cdf-4ee7-9d53-a0cf676a21de admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:32.127043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b258d-3cdf-4ee7-9d53-a0cf676a21de admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:32.127925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b258d-3cdf-4ee7-9d53-a0cf676a21de admin admin] PATH_INFO: `/v3/projects/09cf6435c2a148c6998dd3b1d301da96/users/3166e271ba6f418d9c71cd661ef23226/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:32.138333 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2026/4013] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:57:32 2021] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:57:32.139252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615867a0-0c6d-4f2e-93e1-c9c65fa7dd3a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:32.152390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b258d-3cdf-4ee7-9d53-a0cf676a21de admin admin] RBAC: Authorizing `identity:create_grant(project_id=09cf6435c2a148c6998dd3b1d301da96, user_id=3166e271ba6f418d9c71cd661ef23226, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:32.155446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b258d-3cdf-4ee7-9d53-a0cf676a21de admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:32.181177 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1988/4014] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:57:32 2021] PUT /identity/v3/projects/09cf6435c2a148c6998dd3b1d301da96/users/3166e271ba6f418d9c71cd661ef23226/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:32.183047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b258d-3cdf-4ee7-9d53-a0cf676a21de admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:32.190653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cc9b258d-3cdf-4ee7-9d53-a0cf676a21de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:32.317009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615867a0-0c6d-4f2e-93e1-c9c65fa7dd3a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:32.318339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b258d-3cdf-4ee7-9d53-a0cf676a21de admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:32.329359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389a501-c193-4586-84d2-abe490bcf8be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:32.330135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389a501-c193-4586-84d2-abe490bcf8be service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:32.332509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389a501-c193-4586-84d2-abe490bcf8be service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:32.332879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389a501-c193-4586-84d2-abe490bcf8be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:32.340644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6389a501-c193-4586-84d2-abe490bcf8be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:32.361668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389a501-c193-4586-84d2-abe490bcf8be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:32.363605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389a501-c193-4586-84d2-abe490bcf8be service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:32.405954 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1989/4015] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:32 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:32.407060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389a501-c193-4586-84d2-abe490bcf8be service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:32.428532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389a501-c193-4586-84d2-abe490bcf8be service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:32.440200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5574a8-1591-40fe-954d-6b5440c7f575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:32.440983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5574a8-1591-40fe-954d-6b5440c7f575 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:32.449772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5574a8-1591-40fe-954d-6b5440c7f575 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:32.449980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5574a8-1591-40fe-954d-6b5440c7f575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:32.460940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3c5574a8-1591-40fe-954d-6b5440c7f575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:32.482932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5574a8-1591-40fe-954d-6b5440c7f575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:32.486611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5574a8-1591-40fe-954d-6b5440c7f575 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:32.496379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34cec3-62db-4053-93ca-5ed8fa6b3325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:32.497072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34cec3-62db-4053-93ca-5ed8fa6b3325 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:32.499145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34cec3-62db-4053-93ca-5ed8fa6b3325 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:32.501293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34cec3-62db-4053-93ca-5ed8fa6b3325 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:32.502111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34cec3-62db-4053-93ca-5ed8fa6b3325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:32.510972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34cec3-62db-4053-93ca-5ed8fa6b3325 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:32.513158 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1990/4016] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:32 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:32.516622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011fd31-9766-454a-9b23-ca6ea9e25a5f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:32.516989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011fd31-9766-454a-9b23-ca6ea9e25a5f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:32.517981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011fd31-9766-454a-9b23-ca6ea9e25a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:32.561982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0011fd31-9766-454a-9b23-ca6ea9e25a5f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:32.566599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0011fd31-9766-454a-9b23-ca6ea9e25a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:32.593541 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1991/4017] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:32.612339 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2027/4018] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:57:32 2021] POST /identity/v3/users => generated 291 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:57:32.616490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011fd31-9766-454a-9b23-ca6ea9e25a5f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:32.620668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34cec3-62db-4053-93ca-5ed8fa6b3325 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:32.627847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011fd31-9766-454a-9b23-ca6ea9e25a5f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:32.628548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ad34cec3-62db-4053-93ca-5ed8fa6b3325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:32.644862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6db414-238f-4dce-ad14-3a646391793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:32.645680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6db414-238f-4dce-ad14-3a646391793f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:32.646070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6db414-238f-4dce-ad14-3a646391793f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:32.646498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6db414-238f-4dce-ad14-3a646391793f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:32.647348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6db414-238f-4dce-ad14-3a646391793f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:32.649054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6db414-238f-4dce-ad14-3a646391793f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:32.667784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34cec3-62db-4053-93ca-5ed8fa6b3325 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:32.684732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5517b-91c0-4d1d-81aa-70aa25d308e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:32.685407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5517b-91c0-4d1d-81aa-70aa25d308e9 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:32.685693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5517b-91c0-4d1d-81aa-70aa25d308e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:32.685977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5517b-91c0-4d1d-81aa-70aa25d308e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:32.687020 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1992/4019] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:32 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:57:32.687950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6db414-238f-4dce-ad14-3a646391793f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:32.721292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5517b-91c0-4d1d-81aa-70aa25d308e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:32.722823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5517b-91c0-4d1d-81aa-70aa25d308e9 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:32.725312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6db414-238f-4dce-ad14-3a646391793f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:32.741306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8ba33-122f-49b9-ba76-02bc40df5c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:32.742005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8ba33-122f-49b9-ba76-02bc40df5c64 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:32.742317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8ba33-122f-49b9-ba76-02bc40df5c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:32.742606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8ba33-122f-49b9-ba76-02bc40df5c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:32.743358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8ba33-122f-49b9-ba76-02bc40df5c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:32.751624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8ba33-122f-49b9-ba76-02bc40df5c64 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:32.757093 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2028/4020] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:57:32.779292 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1993/4021] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:32 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:57:32.783507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5517b-91c0-4d1d-81aa-70aa25d308e9 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:32.797042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5517b-91c0-4d1d-81aa-70aa25d308e9 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:32.812451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7d662-ad05-4520-9257-a2bd35485b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:32.813494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7d662-ad05-4520-9257-a2bd35485b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:32.813786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7d662-ad05-4520-9257-a2bd35485b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:32.814071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7d662-ad05-4520-9257-a2bd35485b81 admin admin] PATH_INFO: `/v3/projects/8fef903d47c94905adbf98ad8a717ce9/users/b69b84227a10456b88c5fd874ae44814/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:32.847348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7d662-ad05-4520-9257-a2bd35485b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fef903d47c94905adbf98ad8a717ce9, user_id=b69b84227a10456b88c5fd874ae44814, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:32.850495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7d662-ad05-4520-9257-a2bd35485b81 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:32.875124 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2029/4022] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:57:32 2021] PUT /identity/v3/projects/8fef903d47c94905adbf98ad8a717ce9/users/b69b84227a10456b88c5fd874ae44814/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:32.886451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745f91-81df-44e9-8ad1-d600d5435dd8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:32.887007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745f91-81df-44e9-8ad1-d600d5435dd8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:32.887440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745f91-81df-44e9-8ad1-d600d5435dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:32.949575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0a745f91-81df-44e9-8ad1-d600d5435dd8 None None] MFA Rules not processed for user `b69b84227a10456b88c5fd874ae44814`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:32.951217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0a745f91-81df-44e9-8ad1-d600d5435dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:33.076783 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1994/4023] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:32 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:33.081470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7d662-ad05-4520-9257-a2bd35485b81 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:33.199261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7d662-ad05-4520-9257-a2bd35485b81 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:33.226392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4192a-3e41-4943-99c2-151a45dd3dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:33.227420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4192a-3e41-4943-99c2-151a45dd3dcd admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:33.229570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4192a-3e41-4943-99c2-151a45dd3dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:33.230085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4192a-3e41-4943-99c2-151a45dd3dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:33.231627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4192a-3e41-4943-99c2-151a45dd3dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:33.239090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4192a-3e41-4943-99c2-151a45dd3dcd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:33.363934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a745f91-81df-44e9-8ad1-d600d5435dd8 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:33.374292 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2030/4024] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:57:33 2021] POST /identity/v3/projects => generated 383 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:57:33.382604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a745f91-81df-44e9-8ad1-d600d5435dd8 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:33.744681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f936b-d0fc-4818-aa5a-d571e47d8be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:33.745397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f936b-d0fc-4818-aa5a-d571e47d8be7 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:33.745689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f936b-d0fc-4818-aa5a-d571e47d8be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:33.746080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f936b-d0fc-4818-aa5a-d571e47d8be7 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:33.746706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f936b-d0fc-4818-aa5a-d571e47d8be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:33.748639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f936b-d0fc-4818-aa5a-d571e47d8be7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:33.790930 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1995/4025] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:57:33 2021] POST /identity/v3/users => generated 298 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:57:33.793409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4192a-3e41-4943-99c2-151a45dd3dcd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:33.808770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4192a-3e41-4943-99c2-151a45dd3dcd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:33.826319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f74d69-091b-403d-9798-b50401542441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:33.827362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f74d69-091b-403d-9798-b50401542441 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:33.827885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f74d69-091b-403d-9798-b50401542441 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:33.828404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f74d69-091b-403d-9798-b50401542441 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:33.829362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f74d69-091b-403d-9798-b50401542441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:33.831822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f74d69-091b-403d-9798-b50401542441 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:33.836189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f936b-d0fc-4818-aa5a-d571e47d8be7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:33.840060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-615f936b-d0fc-4818-aa5a-d571e47d8be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:33.857864 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2031/4026] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:33 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:57:33.864289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f74d69-091b-403d-9798-b50401542441 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:33.887958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f74d69-091b-403d-9798-b50401542441 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:33.907083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31971a3-b5cd-4c48-bd61-01bbab17a8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:33.908258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31971a3-b5cd-4c48-bd61-01bbab17a8d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:33.913060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31971a3-b5cd-4c48-bd61-01bbab17a8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:33.913570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31971a3-b5cd-4c48-bd61-01bbab17a8d0 admin admin] PATH_INFO: `/v3/projects/4e3e45b458da4893a37a8acfe89f1d82/users/97dd112fb409435c88fb28fccbeca855/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:33.948472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31971a3-b5cd-4c48-bd61-01bbab17a8d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3e45b458da4893a37a8acfe89f1d82, user_id=97dd112fb409435c88fb28fccbeca855, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:33.953690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31971a3-b5cd-4c48-bd61-01bbab17a8d0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:33.987487 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2032/4027] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:57:33 2021] PUT /identity/v3/projects/4e3e45b458da4893a37a8acfe89f1d82/users/97dd112fb409435c88fb28fccbeca855/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:33.988749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31971a3-b5cd-4c48-bd61-01bbab17a8d0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:34.041635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f936b-d0fc-4818-aa5a-d571e47d8be7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:34.114377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31971a3-b5cd-4c48-bd61-01bbab17a8d0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:34.119752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ace837-73a9-4bb5-99b7-567f01c2e660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:34.120705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ace837-73a9-4bb5-99b7-567f01c2e660 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:34.121216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ace837-73a9-4bb5-99b7-567f01c2e660 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:34.121757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ace837-73a9-4bb5-99b7-567f01c2e660 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:34.122754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ace837-73a9-4bb5-99b7-567f01c2e660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:34.124599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ace837-73a9-4bb5-99b7-567f01c2e660 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:34.162473 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2033/4028] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:33 2021] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:57:34.163687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ace837-73a9-4bb5-99b7-567f01c2e660 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:34.200642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ace837-73a9-4bb5-99b7-567f01c2e660 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:34.219095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072c2f4-9646-432e-a52e-5a09d6c2cf05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:34.220242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072c2f4-9646-432e-a52e-5a09d6c2cf05 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:34.220761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072c2f4-9646-432e-a52e-5a09d6c2cf05 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:34.221239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072c2f4-9646-432e-a52e-5a09d6c2cf05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:34.229289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9072c2f4-9646-432e-a52e-5a09d6c2cf05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:34.234442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2977d14-d594-4c3d-9e7a-fa4d297112f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:34.236777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2977d14-d594-4c3d-9e7a-fa4d297112f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:34.239208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2977d14-d594-4c3d-9e7a-fa4d297112f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:34.239619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2977d14-d594-4c3d-9e7a-fa4d297112f0 admin admin] PATH_INFO: `/v3/projects/4e3e45b458da4893a37a8acfe89f1d82/users/97dd112fb409435c88fb28fccbeca855/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:34.248964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2977d14-d594-4c3d-9e7a-fa4d297112f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3e45b458da4893a37a8acfe89f1d82, user_id=97dd112fb409435c88fb28fccbeca855, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:34.257262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2977d14-d594-4c3d-9e7a-fa4d297112f0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:34.283089 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2034/4029] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:57:34 2021] PUT /identity/v3/projects/4e3e45b458da4893a37a8acfe89f1d82/users/97dd112fb409435c88fb28fccbeca855/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:34.294739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee93eb-304f-40f3-99cb-45dadbd7ae63 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:34.297461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee93eb-304f-40f3-99cb-45dadbd7ae63 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:34.299540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee93eb-304f-40f3-99cb-45dadbd7ae63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:34.320797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072c2f4-9646-432e-a52e-5a09d6c2cf05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:34.349140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072c2f4-9646-432e-a52e-5a09d6c2cf05 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:34.368367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1eee93eb-304f-40f3-99cb-45dadbd7ae63 None None] MFA Rules not processed for user `97dd112fb409435c88fb28fccbeca855`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:34.375513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1eee93eb-304f-40f3-99cb-45dadbd7ae63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:34.449629 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1996/4030] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:34.810229 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2035/4031] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:34 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:34.822575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072c2f4-9646-432e-a52e-5a09d6c2cf05 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:34.824615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9072c2f4-9646-432e-a52e-5a09d6c2cf05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:34.998463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072c2f4-9646-432e-a52e-5a09d6c2cf05 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:35.143871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa69168-842d-4582-91b1-3b64d612a7f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:35.144545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa69168-842d-4582-91b1-3b64d612a7f5 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:35.144834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa69168-842d-4582-91b1-3b64d612a7f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:35.145114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa69168-842d-4582-91b1-3b64d612a7f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:35.189772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa69168-842d-4582-91b1-3b64d612a7f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:35.191382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa69168-842d-4582-91b1-3b64d612a7f5 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:35.238137 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1997/4032] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:34 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:35.392233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee93eb-304f-40f3-99cb-45dadbd7ae63 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:35.409028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee93eb-304f-40f3-99cb-45dadbd7ae63 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:35.420434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b181a6-633f-44e9-841f-1d311857e456 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:35.421002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b181a6-633f-44e9-841f-1d311857e456 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:35.421457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b181a6-633f-44e9-841f-1d311857e456 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:35.421749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b181a6-633f-44e9-841f-1d311857e456 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:35.562598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b181a6-633f-44e9-841f-1d311857e456 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:35.564236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b181a6-633f-44e9-841f-1d311857e456 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:35.593475 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2036/4033] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:35 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:38.853457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c5f9e-0662-48bc-87d3-17299d6e0075 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:38.854653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c5f9e-0662-48bc-87d3-17299d6e0075 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:38.855083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c5f9e-0662-48bc-87d3-17299d6e0075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:38.988527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a04c5f9e-0662-48bc-87d3-17299d6e0075 None None] MFA Rules not processed for user `fba996171cc148a5b0fe75a937f59055`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:38.990858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a04c5f9e-0662-48bc-87d3-17299d6e0075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:39.110378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b181a6-633f-44e9-841f-1d311857e456 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:39.292763 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1998/4034] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:38 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:39.540369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c5f9e-0662-48bc-87d3-17299d6e0075 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:39.542014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a04c5f9e-0662-48bc-87d3-17299d6e0075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:39.547180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b181a6-633f-44e9-841f-1d311857e456 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:39.554067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556560d-7593-4fa9-b612-54b8c598968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:39.555352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556560d-7593-4fa9-b612-54b8c598968a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:39.556037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556560d-7593-4fa9-b612-54b8c598968a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:39.556464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556560d-7593-4fa9-b612-54b8c598968a admin admin] PATH_INFO: `/v3/users/b69b84227a10456b88c5fd874ae44814` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:39.557897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556560d-7593-4fa9-b612-54b8c598968a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b69b84227a10456b88c5fd874ae44814)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:39.560332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556560d-7593-4fa9-b612-54b8c598968a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:39.647769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4556560d-7593-4fa9-b612-54b8c598968a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b69b84227a10456b88c5fd874ae44814'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:39.665093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4556560d-7593-4fa9-b612-54b8c598968a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b69b84227a10456b88c5fd874ae44814'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:39.666108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4556560d-7593-4fa9-b612-54b8c598968a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b69b84227a10456b88c5fd874ae44814'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:39.729183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4556560d-7593-4fa9-b612-54b8c598968a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b69b84227a10456b88c5fd874ae44814'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:39.749201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4556560d-7593-4fa9-b612-54b8c598968a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b69b84227a10456b88c5fd874ae44814'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:39.770809 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2037/4035] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:57:39 2021] DELETE /identity/v3/users/b69b84227a10456b88c5fd874ae44814 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:39.773471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb8f2a-04d6-432f-988f-49fe766cb048 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:39.774039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb8f2a-04d6-432f-988f-49fe766cb048 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:39.774694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb8f2a-04d6-432f-988f-49fe766cb048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:39.805071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3dcb8f2a-04d6-432f-988f-49fe766cb048 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:39.806585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3dcb8f2a-04d6-432f-988f-49fe766cb048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:39.832273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c5f9e-0662-48bc-87d3-17299d6e0075 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:39.979812 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2038/4036] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:39.989869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb8f2a-04d6-432f-988f-49fe766cb048 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:39.994551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3dcb8f2a-04d6-432f-988f-49fe766cb048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:40.084559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fc38a-634f-46a8-a250-410b9e1f0387 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:40.085447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fc38a-634f-46a8-a250-410b9e1f0387 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:40.085839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fc38a-634f-46a8-a250-410b9e1f0387 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:40.093227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fc38a-634f-46a8-a250-410b9e1f0387 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:40.097635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-195fc38a-634f-46a8-a250-410b9e1f0387 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:40.188233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb8f2a-04d6-432f-988f-49fe766cb048 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:40.201592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcce9bb-f00c-4b93-8b13-2a7a01a08979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:40.202541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcce9bb-f00c-4b93-8b13-2a7a01a08979 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:40.202978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcce9bb-f00c-4b93-8b13-2a7a01a08979 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:40.203434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcce9bb-f00c-4b93-8b13-2a7a01a08979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:40.225380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcce9bb-f00c-4b93-8b13-2a7a01a08979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:40.229228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcce9bb-f00c-4b93-8b13-2a7a01a08979 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:40.253200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fc38a-634f-46a8-a250-410b9e1f0387 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:40.255075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fc38a-634f-46a8-a250-410b9e1f0387 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:40.264665 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2039/4037] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:40.274512 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 1999/4038] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:39 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:41.156923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcce9bb-f00c-4b93-8b13-2a7a01a08979 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:41.160234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8bcce9bb-f00c-4b93-8b13-2a7a01a08979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:41.182934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcce9bb-f00c-4b93-8b13-2a7a01a08979 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:41.195436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ca8c9-97c1-49a6-9577-40e150de5326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:41.197013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ca8c9-97c1-49a6-9577-40e150de5326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:41.197503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ca8c9-97c1-49a6-9577-40e150de5326 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:41.197932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ca8c9-97c1-49a6-9577-40e150de5326 admin admin] PATH_INFO: `/v3/projects/8fef903d47c94905adbf98ad8a717ce9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:41.203058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ca8c9-97c1-49a6-9577-40e150de5326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fef903d47c94905adbf98ad8a717ce9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:41.206866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ca8c9-97c1-49a6-9577-40e150de5326 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:41.326449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-937ca8c9-97c1-49a6-9577-40e150de5326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fef903d47c94905adbf98ad8a717ce9', 'request_id': 'req-937ca8c9-97c1-49a6-9577-40e150de5326'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:41.342480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-937ca8c9-97c1-49a6-9577-40e150de5326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fef903d47c94905adbf98ad8a717ce9', 'request_id': 'req-937ca8c9-97c1-49a6-9577-40e150de5326'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:41.363812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-937ca8c9-97c1-49a6-9577-40e150de5326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fef903d47c94905adbf98ad8a717ce9', 'request_id': 'req-937ca8c9-97c1-49a6-9577-40e150de5326'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:41.387796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-937ca8c9-97c1-49a6-9577-40e150de5326 admin admin] The token cache is being invalidate because project 8fef903d47c94905adbf98ad8a717ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:57:41.388231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-937ca8c9-97c1-49a6-9577-40e150de5326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:41.392476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-937ca8c9-97c1-49a6-9577-40e150de5326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:41.395248 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2040/4039] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:41 2021] DELETE /identity/v3/projects/8fef903d47c94905adbf98ad8a717ce9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:41.399012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fc38a-634f-46a8-a250-410b9e1f0387 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:41.423213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fc38a-634f-46a8-a250-410b9e1f0387 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:41.613590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c3f2a-17c6-4629-864f-018997a81491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:41.614935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c3f2a-17c6-4629-864f-018997a81491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:41.615436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c3f2a-17c6-4629-864f-018997a81491 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:41.615920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c3f2a-17c6-4629-864f-018997a81491 admin admin] PATH_INFO: `/v3/users/97dd112fb409435c88fb28fccbeca855` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:41.626975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c3f2a-17c6-4629-864f-018997a81491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97dd112fb409435c88fb28fccbeca855)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:41.629862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c3f2a-17c6-4629-864f-018997a81491 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:41.774798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d09c3f2a-17c6-4629-864f-018997a81491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97dd112fb409435c88fb28fccbeca855'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:41.796888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d09c3f2a-17c6-4629-864f-018997a81491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97dd112fb409435c88fb28fccbeca855'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:41.829113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d09c3f2a-17c6-4629-864f-018997a81491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97dd112fb409435c88fb28fccbeca855'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:41.831687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d09c3f2a-17c6-4629-864f-018997a81491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97dd112fb409435c88fb28fccbeca855'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:41.864424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d09c3f2a-17c6-4629-864f-018997a81491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97dd112fb409435c88fb28fccbeca855'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:41.881188 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2000/4040] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:57:41 2021] DELETE /identity/v3/users/97dd112fb409435c88fb28fccbeca855 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:42.323976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ca8c9-97c1-49a6-9577-40e150de5326 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:42.328646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-937ca8c9-97c1-49a6-9577-40e150de5326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:42.334903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c3f2a-17c6-4629-864f-018997a81491 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:42.336585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d09c3f2a-17c6-4629-864f-018997a81491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:42.505304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c3f2a-17c6-4629-864f-018997a81491 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:42.513846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba9040-dd31-4574-815d-b3bb608b1981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:42.514734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba9040-dd31-4574-815d-b3bb608b1981 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:42.515025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba9040-dd31-4574-815d-b3bb608b1981 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:42.515311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba9040-dd31-4574-815d-b3bb608b1981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:42.519715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7aba9040-dd31-4574-815d-b3bb608b1981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:42.543226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba9040-dd31-4574-815d-b3bb608b1981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:42.545869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba9040-dd31-4574-815d-b3bb608b1981 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:42.575096 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2001/4041] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:42 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:42.576089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ca8c9-97c1-49a6-9577-40e150de5326 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:42.593734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0e1b4-3370-4638-b5e0-9ef98f49d867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:42.594947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0e1b4-3370-4638-b5e0-9ef98f49d867 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:42.595391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0e1b4-3370-4638-b5e0-9ef98f49d867 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:42.597335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0e1b4-3370-4638-b5e0-9ef98f49d867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:42.611800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0e1b4-3370-4638-b5e0-9ef98f49d867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:42.616521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0e1b4-3370-4638-b5e0-9ef98f49d867 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:42.630940 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2041/4042] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:42 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:43.637625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba9040-dd31-4574-815d-b3bb608b1981 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:43.640926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7aba9040-dd31-4574-815d-b3bb608b1981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:43.734049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba9040-dd31-4574-815d-b3bb608b1981 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:43.746011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1957a-7038-4232-9464-b8865e06fae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:43.748298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1957a-7038-4232-9464-b8865e06fae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:43.749233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1957a-7038-4232-9464-b8865e06fae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:43.749743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1957a-7038-4232-9464-b8865e06fae9 admin admin] PATH_INFO: `/v3/projects/4e3e45b458da4893a37a8acfe89f1d82` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:43.751243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1957a-7038-4232-9464-b8865e06fae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3e45b458da4893a37a8acfe89f1d82)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:43.755418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1957a-7038-4232-9464-b8865e06fae9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:43.835670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1ff1957a-7038-4232-9464-b8865e06fae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3e45b458da4893a37a8acfe89f1d82', 'request_id': 'req-1ff1957a-7038-4232-9464-b8865e06fae9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:43.853269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1ff1957a-7038-4232-9464-b8865e06fae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3e45b458da4893a37a8acfe89f1d82', 'request_id': 'req-1ff1957a-7038-4232-9464-b8865e06fae9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:43.871461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1ff1957a-7038-4232-9464-b8865e06fae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3e45b458da4893a37a8acfe89f1d82', 'request_id': 'req-1ff1957a-7038-4232-9464-b8865e06fae9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:43.900497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1ff1957a-7038-4232-9464-b8865e06fae9 admin admin] The token cache is being invalidate because project 4e3e45b458da4893a37a8acfe89f1d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:57:43.900812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1ff1957a-7038-4232-9464-b8865e06fae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:43.901637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1ff1957a-7038-4232-9464-b8865e06fae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:57:43.903265 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2002/4043] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:57:43 2021] DELETE /identity/v3/projects/4e3e45b458da4893a37a8acfe89f1d82 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:43.909852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a7f79-809e-464f-8472-1cfb04d2ef67 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:43.910831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a7f79-809e-464f-8472-1cfb04d2ef67 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:43.911257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a7f79-809e-464f-8472-1cfb04d2ef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:43.954451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-116a7f79-809e-464f-8472-1cfb04d2ef67 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:43.956300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-116a7f79-809e-464f-8472-1cfb04d2ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:44.060964 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2042/4044] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:57:44.069337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b7ddb-04e4-4848-b73c-acaa4b3b4755 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:44.069635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b7ddb-04e4-4848-b73c-acaa4b3b4755 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:44.069913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b7ddb-04e4-4848-b73c-acaa4b3b4755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:44.108774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-486b7ddb-04e4-4848-b73c-acaa4b3b4755 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:44.110009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-486b7ddb-04e4-4848-b73c-acaa4b3b4755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:44.132278 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2003/4045] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:44.136825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a7f79-809e-464f-8472-1cfb04d2ef67 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:44.151814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a7f79-809e-464f-8472-1cfb04d2ef67 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:44.164594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e861ec-a122-4418-bfc4-64af1502a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:44.165656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e861ec-a122-4418-bfc4-64af1502a2ee admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:44.166357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e861ec-a122-4418-bfc4-64af1502a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:44.166847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e861ec-a122-4418-bfc4-64af1502a2ee admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:44.167789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e861ec-a122-4418-bfc4-64af1502a2ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:57:44.168298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e861ec-a122-4418-bfc4-64af1502a2ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:44.172700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e861ec-a122-4418-bfc4-64af1502a2ee admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:44.213617 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2043/4046] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:57:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:57:44.214073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b7ddb-04e4-4848-b73c-acaa4b3b4755 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:44.233839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b7ddb-04e4-4848-b73c-acaa4b3b4755 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:44.250755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c1719-44af-4f8c-88cb-4f16b73be056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:44.251437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c1719-44af-4f8c-88cb-4f16b73be056 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:44.251721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c1719-44af-4f8c-88cb-4f16b73be056 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:44.251998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c1719-44af-4f8c-88cb-4f16b73be056 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:44.252809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c1719-44af-4f8c-88cb-4f16b73be056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:44.254809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c1719-44af-4f8c-88cb-4f16b73be056 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:44.312456 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2004/4047] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:57:44 2021] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:57:44.317837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e861ec-a122-4418-bfc4-64af1502a2ee admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:44.338492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e861ec-a122-4418-bfc4-64af1502a2ee admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:44.544875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3eb6e-dbb0-40f8-8775-83d1c09239c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:44.545970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3eb6e-dbb0-40f8-8775-83d1c09239c3 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:44.546328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3eb6e-dbb0-40f8-8775-83d1c09239c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:44.546747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3eb6e-dbb0-40f8-8775-83d1c09239c3 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:44.547565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3eb6e-dbb0-40f8-8775-83d1c09239c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:44.553197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3eb6e-dbb0-40f8-8775-83d1c09239c3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:44.600342 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2044/4048] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:57:44 2021] POST /identity/v3/users => generated 292 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:57:44.600928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c1719-44af-4f8c-88cb-4f16b73be056 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:44.620086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c1719-44af-4f8c-88cb-4f16b73be056 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:44.632066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee7ba4-88e4-4c5e-bfa5-a50a80fdc65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:44.632775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee7ba4-88e4-4c5e-bfa5-a50a80fdc65f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:44.633061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee7ba4-88e4-4c5e-bfa5-a50a80fdc65f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:44.633338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee7ba4-88e4-4c5e-bfa5-a50a80fdc65f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:44.634083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee7ba4-88e4-4c5e-bfa5-a50a80fdc65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:44.636046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee7ba4-88e4-4c5e-bfa5-a50a80fdc65f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:44.678577 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2005/4049] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:44 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:57:44.682532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3eb6e-dbb0-40f8-8775-83d1c09239c3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:44.708443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3eb6e-dbb0-40f8-8775-83d1c09239c3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:44.741016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584c685-6da9-4d6b-99a0-f0c463bd43cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:44.741779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584c685-6da9-4d6b-99a0-f0c463bd43cb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:44.742061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584c685-6da9-4d6b-99a0-f0c463bd43cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:44.742363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584c685-6da9-4d6b-99a0-f0c463bd43cb admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:44.743114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584c685-6da9-4d6b-99a0-f0c463bd43cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:44.751716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584c685-6da9-4d6b-99a0-f0c463bd43cb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:44.798003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee7ba4-88e4-4c5e-bfa5-a50a80fdc65f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:44.801708 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2045/4050] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:44 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:57:44.829190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee7ba4-88e4-4c5e-bfa5-a50a80fdc65f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:44.853601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e1102-6756-4a79-af5a-8080975cd840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:44.855089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e1102-6756-4a79-af5a-8080975cd840 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:44.862754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e1102-6756-4a79-af5a-8080975cd840 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:44.863524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e1102-6756-4a79-af5a-8080975cd840 admin admin] PATH_INFO: `/v3/projects/80a85b7775474a3ea11c992e707ac5cc/users/56e6eb2cd17747939217b9a03e1ca1b5/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:44.938464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e1102-6756-4a79-af5a-8080975cd840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a85b7775474a3ea11c992e707ac5cc, user_id=56e6eb2cd17747939217b9a03e1ca1b5, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:44.953947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e1102-6756-4a79-af5a-8080975cd840 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:44.993737 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2006/4051] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:57:44 2021] PUT /identity/v3/projects/80a85b7775474a3ea11c992e707ac5cc/users/56e6eb2cd17747939217b9a03e1ca1b5/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:57:45.004694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb44ce-7472-4f7f-b339-956d6be13fa0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:45.005242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb44ce-7472-4f7f-b339-956d6be13fa0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:45.005242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb44ce-7472-4f7f-b339-956d6be13fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:45.078686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1edb44ce-7472-4f7f-b339-956d6be13fa0 None None] MFA Rules not processed for user `56e6eb2cd17747939217b9a03e1ca1b5`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:45.079927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1edb44ce-7472-4f7f-b339-956d6be13fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:45.213011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92a906-7267-4b61-a24f-d26f70408f92 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:45.213467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92a906-7267-4b61-a24f-d26f70408f92 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:45.213602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92a906-7267-4b61-a24f-d26f70408f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:45.233854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6f92a906-7267-4b61-a24f-d26f70408f92 None None] MFA Rules not processed for user `baaead8443a7492db118aa577386a88b`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:45.235102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6f92a906-7267-4b61-a24f-d26f70408f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:45.245773 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2046/4052] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:45 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:45.250317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb44ce-7472-4f7f-b339-956d6be13fa0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:45.375633 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2007/4053] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:45 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:57:45.387540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92a906-7267-4b61-a24f-d26f70408f92 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:45.389075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6f92a906-7267-4b61-a24f-d26f70408f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:45.401049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb44ce-7472-4f7f-b339-956d6be13fa0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:45.414821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da0105-1ab5-4675-947e-f566149102c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:45.415544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da0105-1ab5-4675-947e-f566149102c4 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:45.415823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da0105-1ab5-4675-947e-f566149102c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:45.416100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da0105-1ab5-4675-947e-f566149102c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:45.417111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da0105-1ab5-4675-947e-f566149102c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:45.419027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da0105-1ab5-4675-947e-f566149102c4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:45.484607 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2047/4054] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:57:45 2021] POST /identity/v3/projects => generated 379 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:57:45.489796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da0105-1ab5-4675-947e-f566149102c4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:45.550204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92a906-7267-4b61-a24f-d26f70408f92 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:45.636530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da0105-1ab5-4675-947e-f566149102c4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:45.645264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5254c81-7ea8-426e-b036-a73746e6c1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:45.646131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254c81-7ea8-426e-b036-a73746e6c1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:45.646644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254c81-7ea8-426e-b036-a73746e6c1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:45.647120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254c81-7ea8-426e-b036-a73746e6c1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:45.648353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5254c81-7ea8-426e-b036-a73746e6c1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:45.651231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5254c81-7ea8-426e-b036-a73746e6c1b3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:45.693176 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2048/4055] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:57:45 2021] POST /identity/v3/users => generated 296 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:57:45.695369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5254c81-7ea8-426e-b036-a73746e6c1b3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:45.708623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5254c81-7ea8-426e-b036-a73746e6c1b3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:45.718833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bf62b-0301-4a76-be0f-6c25a8f998da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:45.720067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bf62b-0301-4a76-be0f-6c25a8f998da service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:45.720551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bf62b-0301-4a76-be0f-6c25a8f998da service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:45.721093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bf62b-0301-4a76-be0f-6c25a8f998da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:45.723813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b31bf62b-0301-4a76-be0f-6c25a8f998da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:45.737475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582783b1-4b5d-4bdd-be70-12ac8747be29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:45.738156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582783b1-4b5d-4bdd-be70-12ac8747be29 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:45.738488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582783b1-4b5d-4bdd-be70-12ac8747be29 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:45.738778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582783b1-4b5d-4bdd-be70-12ac8747be29 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:45.739825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582783b1-4b5d-4bdd-be70-12ac8747be29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:45.754728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582783b1-4b5d-4bdd-be70-12ac8747be29 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:45.770238 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2049/4056] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:45 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:57:45.774758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582783b1-4b5d-4bdd-be70-12ac8747be29 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:45.800137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582783b1-4b5d-4bdd-be70-12ac8747be29 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:45.806147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3b997-805a-4598-b5a7-f71816af32bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:45.807594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3b997-805a-4598-b5a7-f71816af32bb admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:45.808587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3b997-805a-4598-b5a7-f71816af32bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:45.809071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3b997-805a-4598-b5a7-f71816af32bb admin admin] PATH_INFO: `/v3/projects/9aa9f456ca964ee29177046fc12794a3/users/8221b4536a1a432c9c74c5b389f8cb6e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:45.828728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bf62b-0301-4a76-be0f-6c25a8f998da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:45.830527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bf62b-0301-4a76-be0f-6c25a8f998da service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:45.833584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3b997-805a-4598-b5a7-f71816af32bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa9f456ca964ee29177046fc12794a3, user_id=8221b4536a1a432c9c74c5b389f8cb6e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:45.836795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3b997-805a-4598-b5a7-f71816af32bb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:45.848692 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2008/4057] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:45 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:45.886969 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2050/4058] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:57:45 2021] PUT /identity/v3/projects/9aa9f456ca964ee29177046fc12794a3/users/8221b4536a1a432c9c74c5b389f8cb6e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:45.890972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bf62b-0301-4a76-be0f-6c25a8f998da service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:45.922560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bf62b-0301-4a76-be0f-6c25a8f998da service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:46.085931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359b972-fde8-488b-8eae-1d2f61af01f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:46.087190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359b972-fde8-488b-8eae-1d2f61af01f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:46.088201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359b972-fde8-488b-8eae-1d2f61af01f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:46.088633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359b972-fde8-488b-8eae-1d2f61af01f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:46.089751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359b972-fde8-488b-8eae-1d2f61af01f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:46.091943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359b972-fde8-488b-8eae-1d2f61af01f0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:46.113103 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2009/4059] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:57:45 2021] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:57:46.117227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3b997-805a-4598-b5a7-f71816af32bb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:46.151937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3b997-805a-4598-b5a7-f71816af32bb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:46.165545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6a2ad-d816-4b0f-8f76-ea28b0af90c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:46.168072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6a2ad-d816-4b0f-8f76-ea28b0af90c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:46.168550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6a2ad-d816-4b0f-8f76-ea28b0af90c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:46.168981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6a2ad-d816-4b0f-8f76-ea28b0af90c8 admin admin] PATH_INFO: `/v3/projects/9aa9f456ca964ee29177046fc12794a3/users/8221b4536a1a432c9c74c5b389f8cb6e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:46.172076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6a2ad-d816-4b0f-8f76-ea28b0af90c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa9f456ca964ee29177046fc12794a3, user_id=8221b4536a1a432c9c74c5b389f8cb6e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:46.175347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6a2ad-d816-4b0f-8f76-ea28b0af90c8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:46.187661 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2051/4060] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:57:46 2021] PUT /identity/v3/projects/9aa9f456ca964ee29177046fc12794a3/users/8221b4536a1a432c9c74c5b389f8cb6e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:57:46.201535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1707887-1aa1-4427-82ba-43e354b75c14 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:46.202727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1707887-1aa1-4427-82ba-43e354b75c14 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:46.203197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1707887-1aa1-4427-82ba-43e354b75c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:46.250109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c1707887-1aa1-4427-82ba-43e354b75c14 None None] MFA Rules not processed for user `8221b4536a1a432c9c74c5b389f8cb6e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:46.251564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c1707887-1aa1-4427-82ba-43e354b75c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:46.505582 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2010/4061] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:46 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:46.513121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6a2ad-d816-4b0f-8f76-ea28b0af90c8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:46.515737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4cc6a2ad-d816-4b0f-8f76-ea28b0af90c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:46.666192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6a2ad-d816-4b0f-8f76-ea28b0af90c8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:46.678227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f4e36-2cf4-4a7e-a646-29ce8bbe8980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:46.678931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f4e36-2cf4-4a7e-a646-29ce8bbe8980 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:46.679215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f4e36-2cf4-4a7e-a646-29ce8bbe8980 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:46.679496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f4e36-2cf4-4a7e-a646-29ce8bbe8980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:46.805561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f4e36-2cf4-4a7e-a646-29ce8bbe8980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:46.807356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f4e36-2cf4-4a7e-a646-29ce8bbe8980 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:46.827703 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2052/4062] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:46 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:57:48.627711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f53756-9c04-4d52-a710-5a69dcf2e775 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:48.628206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f53756-9c04-4d52-a710-5a69dcf2e775 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:48.628294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f53756-9c04-4d52-a710-5a69dcf2e775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:48.672934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a3f53756-9c04-4d52-a710-5a69dcf2e775 None None] MFA Rules not processed for user `fba996171cc148a5b0fe75a937f59055`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:48.674184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a3f53756-9c04-4d52-a710-5a69dcf2e775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:48.806109 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2011/4063] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:48 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:49.374493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a91655-8a07-4e9c-a1bb-263fd5f3c2e5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:49.375082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a91655-8a07-4e9c-a1bb-263fd5f3c2e5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:49.375082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a91655-8a07-4e9c-a1bb-263fd5f3c2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:49.437224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c0a91655-8a07-4e9c-a1bb-263fd5f3c2e5 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:49.438729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c0a91655-8a07-4e9c-a1bb-263fd5f3c2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:49.535467 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2053/4064] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:57:49 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:49.553436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f53756-9c04-4d52-a710-5a69dcf2e775 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:49.555111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a3f53756-9c04-4d52-a710-5a69dcf2e775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:49.744009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f53756-9c04-4d52-a710-5a69dcf2e775 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:49.760268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8ca03-f617-4065-ab99-7fad7d03987e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:49.761036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8ca03-f617-4065-ab99-7fad7d03987e service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:49.761393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8ca03-f617-4065-ab99-7fad7d03987e service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:49.761741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8ca03-f617-4065-ab99-7fad7d03987e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:49.779581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8ca03-f617-4065-ab99-7fad7d03987e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:49.783983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8ca03-f617-4065-ab99-7fad7d03987e service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:49.811159 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2012/4065] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:57:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:57:51.206276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7c5c0-8889-4156-a92e-7914cd40dcc7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:51.207262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7c5c0-8889-4156-a92e-7914cd40dcc7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:51.207691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7c5c0-8889-4156-a92e-7914cd40dcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:51.253305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c5d7c5c0-8889-4156-a92e-7914cd40dcc7 None None] MFA Rules not processed for user `3166e271ba6f418d9c71cd661ef23226`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:57:51.255450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c5d7c5c0-8889-4156-a92e-7914cd40dcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:57:51.362370 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2054/4066] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:57:51 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:57:51.956120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8ca03-f617-4065-ab99-7fad7d03987e service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:57:52.123052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8ca03-f617-4065-ab99-7fad7d03987e service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:57:52.136910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4dd4f-2776-4e28-818f-cea17c6f27df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:57:52.137857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4dd4f-2776-4e28-818f-cea17c6f27df service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:57:52.138354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4dd4f-2776-4e28-818f-cea17c6f27df service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:57:52.138965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4dd4f-2776-4e28-818f-cea17c6f27df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:57:52.161099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4dd4f-2776-4e28-818f-cea17c6f27df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:57:52.181246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4dd4f-2776-4e28-818f-cea17c6f27df service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:57:52.224109 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2013/4067] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:57:51 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:58:00.170909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b4647-2333-4e60-b854-f982642ca95d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:00.172038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b4647-2333-4e60-b854-f982642ca95d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:00.172403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b4647-2333-4e60-b854-f982642ca95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:00.209874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-788b4647-2333-4e60-b854-f982642ca95d None None] MFA Rules not processed for user `3166e271ba6f418d9c71cd661ef23226`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:00.211367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-788b4647-2333-4e60-b854-f982642ca95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:00.219283 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2055/4068] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:00 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:01.276628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4dd4f-2776-4e28-818f-cea17c6f27df service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:01.278058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8ec4dd4f-2776-4e28-818f-cea17c6f27df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:01.293628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4dd4f-2776-4e28-818f-cea17c6f27df service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:01.299305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a62014-cb1b-441b-8d5e-9dbffc28eb4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:01.300310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a62014-cb1b-441b-8d5e-9dbffc28eb4f service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:01.300762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a62014-cb1b-441b-8d5e-9dbffc28eb4f service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:01.301320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a62014-cb1b-441b-8d5e-9dbffc28eb4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:01.303371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-47a62014-cb1b-441b-8d5e-9dbffc28eb4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:01.317841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a62014-cb1b-441b-8d5e-9dbffc28eb4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:01.319843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a62014-cb1b-441b-8d5e-9dbffc28eb4f service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:01.350088 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2014/4069] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:58:01 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:58:02.288939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b4647-2333-4e60-b854-f982642ca95d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:02.290598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-788b4647-2333-4e60-b854-f982642ca95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:02.307194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b4647-2333-4e60-b854-f982642ca95d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:02.316766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2839c8-49cf-4b31-bed8-f058ac31ae2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:02.317587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2839c8-49cf-4b31-bed8-f058ac31ae2d service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:02.318018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2839c8-49cf-4b31-bed8-f058ac31ae2d service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:02.318480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2839c8-49cf-4b31-bed8-f058ac31ae2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:02.340854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2839c8-49cf-4b31-bed8-f058ac31ae2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:02.344061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2839c8-49cf-4b31-bed8-f058ac31ae2d service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:02.357692 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2056/4070] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:58:02 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:58:03.376356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ba4dc-bd00-4100-95bd-4f25aef8e670 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:03.376750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ba4dc-bd00-4100-95bd-4f25aef8e670 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:03.377097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ba4dc-bd00-4100-95bd-4f25aef8e670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:03.414353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-558ba4dc-bd00-4100-95bd-4f25aef8e670 None None] MFA Rules not processed for user `ebd83848fe8d4e7284291660eb51da51`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:03.416032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-558ba4dc-bd00-4100-95bd-4f25aef8e670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:03.517622 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2015/4071] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:03 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:12.834744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2839c8-49cf-4b31-bed8-f058ac31ae2d service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:12.836355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6f2839c8-49cf-4b31-bed8-f058ac31ae2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:12.943572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2839c8-49cf-4b31-bed8-f058ac31ae2d service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:12.949689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980f0ff-0b37-44f3-9ff4-dcff96d5813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:12.950869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980f0ff-0b37-44f3-9ff4-dcff96d5813f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:12.951364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980f0ff-0b37-44f3-9ff4-dcff96d5813f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:12.951871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980f0ff-0b37-44f3-9ff4-dcff96d5813f admin admin] PATH_INFO: `/v3/users/216cd2c0d4b249e797990918152b4749` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:12.953246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980f0ff-0b37-44f3-9ff4-dcff96d5813f admin admin] RBAC: Authorizing `identity:delete_user(user_id=216cd2c0d4b249e797990918152b4749)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:12.955945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980f0ff-0b37-44f3-9ff4-dcff96d5813f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:13.021733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4980f0ff-0b37-44f3-9ff4-dcff96d5813f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '216cd2c0d4b249e797990918152b4749'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:13.028480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4980f0ff-0b37-44f3-9ff4-dcff96d5813f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '216cd2c0d4b249e797990918152b4749'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:13.029181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4980f0ff-0b37-44f3-9ff4-dcff96d5813f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '216cd2c0d4b249e797990918152b4749'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:13.041983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4980f0ff-0b37-44f3-9ff4-dcff96d5813f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '216cd2c0d4b249e797990918152b4749'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:13.050806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4980f0ff-0b37-44f3-9ff4-dcff96d5813f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '216cd2c0d4b249e797990918152b4749'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:13.057371 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2057/4072] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:58:12 2021] DELETE /identity/v3/users/216cd2c0d4b249e797990918152b4749 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:58:13.251515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ba4dc-bd00-4100-95bd-4f25aef8e670 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:13.271097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ba4dc-bd00-4100-95bd-4f25aef8e670 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:13.349777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45133cca-8ffb-482c-b0a8-b4d29b7c0da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:13.350671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45133cca-8ffb-482c-b0a8-b4d29b7c0da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:13.350954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45133cca-8ffb-482c-b0a8-b4d29b7c0da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:13.351232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45133cca-8ffb-482c-b0a8-b4d29b7c0da5 admin admin] PATH_INFO: `/v3/projects/8d45c473a485472791e742964660e7e9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:13.352447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45133cca-8ffb-482c-b0a8-b4d29b7c0da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d45c473a485472791e742964660e7e9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:13.354471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45133cca-8ffb-482c-b0a8-b4d29b7c0da5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:13.408943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45133cca-8ffb-482c-b0a8-b4d29b7c0da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d45c473a485472791e742964660e7e9', 'request_id': 'req-45133cca-8ffb-482c-b0a8-b4d29b7c0da5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:13.416034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45133cca-8ffb-482c-b0a8-b4d29b7c0da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d45c473a485472791e742964660e7e9', 'request_id': 'req-45133cca-8ffb-482c-b0a8-b4d29b7c0da5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:13.422270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45133cca-8ffb-482c-b0a8-b4d29b7c0da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d45c473a485472791e742964660e7e9', 'request_id': 'req-45133cca-8ffb-482c-b0a8-b4d29b7c0da5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:13.443761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45133cca-8ffb-482c-b0a8-b4d29b7c0da5 admin admin] The token cache is being invalidate because project 8d45c473a485472791e742964660e7e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:58:13.444232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45133cca-8ffb-482c-b0a8-b4d29b7c0da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:13.445501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-45133cca-8ffb-482c-b0a8-b4d29b7c0da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:13.447533 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2016/4073] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:13 2021] DELETE /identity/v3/projects/8d45c473a485472791e742964660e7e9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:58:13.453712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f5e2a-1cfb-4c25-ae64-ec566b8da34a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:13.454357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f5e2a-1cfb-4c25-ae64-ec566b8da34a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:13.454949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f5e2a-1cfb-4c25-ae64-ec566b8da34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:13.478335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-686f5e2a-1cfb-4c25-ae64-ec566b8da34a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:13.480114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-686f5e2a-1cfb-4c25-ae64-ec566b8da34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:13.569663 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2058/4074] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:13.571659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8a1ad-a4a3-4a2a-9477-a96e47bc0ec3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:13.571993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8a1ad-a4a3-4a2a-9477-a96e47bc0ec3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:13.572279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8a1ad-a4a3-4a2a-9477-a96e47bc0ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:13.604174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-aae8a1ad-a4a3-4a2a-9477-a96e47bc0ec3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:13.605949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-aae8a1ad-a4a3-4a2a-9477-a96e47bc0ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:13.616151 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2017/4075] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:13.623060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f5e2a-1cfb-4c25-ae64-ec566b8da34a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:13.635061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f5e2a-1cfb-4c25-ae64-ec566b8da34a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:13.641910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff8ac6-ddbc-4bb8-a84f-5fa7e212f320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:13.642858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff8ac6-ddbc-4bb8-a84f-5fa7e212f320 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:13.643213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff8ac6-ddbc-4bb8-a84f-5fa7e212f320 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:13.643573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff8ac6-ddbc-4bb8-a84f-5fa7e212f320 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:13.644384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff8ac6-ddbc-4bb8-a84f-5fa7e212f320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:58:13.644764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff8ac6-ddbc-4bb8-a84f-5fa7e212f320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:13.646465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff8ac6-ddbc-4bb8-a84f-5fa7e212f320 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:13.661076 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2059/4076] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:58:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:58:13.665460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8a1ad-a4a3-4a2a-9477-a96e47bc0ec3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:13.683004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8a1ad-a4a3-4a2a-9477-a96e47bc0ec3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:13.699273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a67e89-e71b-48c8-8896-cd4bd1037362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:13.700021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a67e89-e71b-48c8-8896-cd4bd1037362 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:13.700909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a67e89-e71b-48c8-8896-cd4bd1037362 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:13.701265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a67e89-e71b-48c8-8896-cd4bd1037362 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:13.702063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a67e89-e71b-48c8-8896-cd4bd1037362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:13.704252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a67e89-e71b-48c8-8896-cd4bd1037362 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:13.751437 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2018/4077] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:58:13 2021] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:58:13.755827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff8ac6-ddbc-4bb8-a84f-5fa7e212f320 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:13.767628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff8ac6-ddbc-4bb8-a84f-5fa7e212f320 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:13.828921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73d2fd-f206-491a-9c13-79206c8ce8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:13.829599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73d2fd-f206-491a-9c13-79206c8ce8df admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:13.829884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73d2fd-f206-491a-9c13-79206c8ce8df admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:13.830727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73d2fd-f206-491a-9c13-79206c8ce8df admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:13.831428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73d2fd-f206-491a-9c13-79206c8ce8df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:13.833635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73d2fd-f206-491a-9c13-79206c8ce8df admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:13.859767 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2060/4078] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:58:13 2021] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:58:13.862819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a67e89-e71b-48c8-8896-cd4bd1037362 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:13.873247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a67e89-e71b-48c8-8896-cd4bd1037362 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:13.878172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af2d23-2136-465c-ad67-37ae0a14867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:13.878872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af2d23-2136-465c-ad67-37ae0a14867f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:13.879167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af2d23-2136-465c-ad67-37ae0a14867f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:13.879450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af2d23-2136-465c-ad67-37ae0a14867f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:13.880226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af2d23-2136-465c-ad67-37ae0a14867f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:13.881821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af2d23-2136-465c-ad67-37ae0a14867f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:13.894293 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2019/4079] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:58:13 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:58:13.897360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73d2fd-f206-491a-9c13-79206c8ce8df admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:13.909529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73d2fd-f206-491a-9c13-79206c8ce8df admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:13.915051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c92277-87c6-4e59-9921-9449c4bb7f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:13.915985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c92277-87c6-4e59-9921-9449c4bb7f6c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:13.916487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c92277-87c6-4e59-9921-9449c4bb7f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:13.916917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c92277-87c6-4e59-9921-9449c4bb7f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:13.917888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c92277-87c6-4e59-9921-9449c4bb7f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:13.919738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c92277-87c6-4e59-9921-9449c4bb7f6c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:13.930902 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2061/4080] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:58:13 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:58:13.935226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af2d23-2136-465c-ad67-37ae0a14867f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:13.948540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af2d23-2136-465c-ad67-37ae0a14867f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:13.955597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c26fd8-7eb5-462c-bc0f-c895e305c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:13.956966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c26fd8-7eb5-462c-bc0f-c895e305c57d admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:13.957463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c26fd8-7eb5-462c-bc0f-c895e305c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:13.957931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c26fd8-7eb5-462c-bc0f-c895e305c57d admin admin] PATH_INFO: `/v3/projects/a4275f97662f4f3b8eed66d55e5f050b/users/932b394322e2458baa8e8057ca4a9c6a/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:13.975816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c26fd8-7eb5-462c-bc0f-c895e305c57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4275f97662f4f3b8eed66d55e5f050b, user_id=932b394322e2458baa8e8057ca4a9c6a, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:13.978817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c26fd8-7eb5-462c-bc0f-c895e305c57d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:13.997222 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2020/4081] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:58:13 2021] PUT /identity/v3/projects/a4275f97662f4f3b8eed66d55e5f050b/users/932b394322e2458baa8e8057ca4a9c6a/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:58:14.007703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e657ca-1b46-4b6e-9b23-ba149ba4a748 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:14.008413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e657ca-1b46-4b6e-9b23-ba149ba4a748 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:14.009219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e657ca-1b46-4b6e-9b23-ba149ba4a748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:14.041499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c3e657ca-1b46-4b6e-9b23-ba149ba4a748 None None] MFA Rules not processed for user `932b394322e2458baa8e8057ca4a9c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:14.042763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c3e657ca-1b46-4b6e-9b23-ba149ba4a748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:14.115230 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2062/4082] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:14 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:14.125959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d57595-33c2-44c8-82f5-fd606d549f72 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:14.126275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d57595-33c2-44c8-82f5-fd606d549f72 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:14.126567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d57595-33c2-44c8-82f5-fd606d549f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:14.147078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f0d57595-33c2-44c8-82f5-fd606d549f72 None None] MFA Rules not processed for user `932b394322e2458baa8e8057ca4a9c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:14.148430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f0d57595-33c2-44c8-82f5-fd606d549f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:14.162784 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2021/4083] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:14 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:14.200886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e657ca-1b46-4b6e-9b23-ba149ba4a748 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:14.202654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c3e657ca-1b46-4b6e-9b23-ba149ba4a748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:14.292896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e657ca-1b46-4b6e-9b23-ba149ba4a748 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:14.298489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1856e-eacf-4e43-9903-0b483cd83b52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:14.299312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1856e-eacf-4e43-9903-0b483cd83b52 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:14.299596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1856e-eacf-4e43-9903-0b483cd83b52 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:14.299872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1856e-eacf-4e43-9903-0b483cd83b52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:14.307980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1856e-eacf-4e43-9903-0b483cd83b52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:14.309629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1856e-eacf-4e43-9903-0b483cd83b52 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:14.319477 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2063/4084] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:58:14 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:58:23.418106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d57595-33c2-44c8-82f5-fd606d549f72 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:23.419649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f0d57595-33c2-44c8-82f5-fd606d549f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:23.493072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d57595-33c2-44c8-82f5-fd606d549f72 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:23.497954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc804969-916e-49b1-857d-a2303dc6239f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:23.499009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc804969-916e-49b1-857d-a2303dc6239f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:23.499301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc804969-916e-49b1-857d-a2303dc6239f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:23.499710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc804969-916e-49b1-857d-a2303dc6239f admin admin] PATH_INFO: `/v3/users/56e6eb2cd17747939217b9a03e1ca1b5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:23.500941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc804969-916e-49b1-857d-a2303dc6239f admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e6eb2cd17747939217b9a03e1ca1b5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:23.502964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc804969-916e-49b1-857d-a2303dc6239f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:23.554476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dc804969-916e-49b1-857d-a2303dc6239f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e6eb2cd17747939217b9a03e1ca1b5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:23.561913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dc804969-916e-49b1-857d-a2303dc6239f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e6eb2cd17747939217b9a03e1ca1b5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:23.577442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dc804969-916e-49b1-857d-a2303dc6239f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e6eb2cd17747939217b9a03e1ca1b5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:23.578685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dc804969-916e-49b1-857d-a2303dc6239f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e6eb2cd17747939217b9a03e1ca1b5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:23.588057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dc804969-916e-49b1-857d-a2303dc6239f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e6eb2cd17747939217b9a03e1ca1b5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:23.600956 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2022/4085] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:58:23 2021] DELETE /identity/v3/users/56e6eb2cd17747939217b9a03e1ca1b5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:58:23.606762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0668b4-a56f-4a81-a316-6ecb175898fc None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:23.608515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0668b4-a56f-4a81-a316-6ecb175898fc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:23.609386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0668b4-a56f-4a81-a316-6ecb175898fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:23.628335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2f0668b4-a56f-4a81-a316-6ecb175898fc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:23.629602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2f0668b4-a56f-4a81-a316-6ecb175898fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:23.700770 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2064/4086] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:23.722054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc804969-916e-49b1-857d-a2303dc6239f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:23.723868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-dc804969-916e-49b1-857d-a2303dc6239f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:23.850435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc804969-916e-49b1-857d-a2303dc6239f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:23.855710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99316c-69b7-4107-a8b8-e8a433616686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:23.863746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99316c-69b7-4107-a8b8-e8a433616686 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:23.864163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99316c-69b7-4107-a8b8-e8a433616686 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:23.864575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99316c-69b7-4107-a8b8-e8a433616686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:23.894371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99316c-69b7-4107-a8b8-e8a433616686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:23.896911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99316c-69b7-4107-a8b8-e8a433616686 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:23.914854 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2023/4087] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:58:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:58:24.281913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0668b4-a56f-4a81-a316-6ecb175898fc None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:24.283521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2f0668b4-a56f-4a81-a316-6ecb175898fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:24.300242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0668b4-a56f-4a81-a316-6ecb175898fc None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:24.309680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff4a71-0e5d-4eab-92e9-efb94ed32a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:24.310870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff4a71-0e5d-4eab-92e9-efb94ed32a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:24.311145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff4a71-0e5d-4eab-92e9-efb94ed32a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:24.311425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff4a71-0e5d-4eab-92e9-efb94ed32a43 admin admin] PATH_INFO: `/v3/projects/80a85b7775474a3ea11c992e707ac5cc` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:24.313025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff4a71-0e5d-4eab-92e9-efb94ed32a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a85b7775474a3ea11c992e707ac5cc)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:24.316446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff4a71-0e5d-4eab-92e9-efb94ed32a43 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:24.362081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8ff4a71-0e5d-4eab-92e9-efb94ed32a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a85b7775474a3ea11c992e707ac5cc', 'request_id': 'req-d8ff4a71-0e5d-4eab-92e9-efb94ed32a43'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:24.369378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8ff4a71-0e5d-4eab-92e9-efb94ed32a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a85b7775474a3ea11c992e707ac5cc', 'request_id': 'req-d8ff4a71-0e5d-4eab-92e9-efb94ed32a43'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:24.378359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8ff4a71-0e5d-4eab-92e9-efb94ed32a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a85b7775474a3ea11c992e707ac5cc', 'request_id': 'req-d8ff4a71-0e5d-4eab-92e9-efb94ed32a43'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:24.389599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8ff4a71-0e5d-4eab-92e9-efb94ed32a43 admin admin] The token cache is being invalidate because project 80a85b7775474a3ea11c992e707ac5cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:58:24.389890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8ff4a71-0e5d-4eab-92e9-efb94ed32a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:24.390536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8ff4a71-0e5d-4eab-92e9-efb94ed32a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:24.392052 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2065/4088] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:24 2021] DELETE /identity/v3/projects/80a85b7775474a3ea11c992e707ac5cc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:58:24.396161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99316c-69b7-4107-a8b8-e8a433616686 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:24.405501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99316c-69b7-4107-a8b8-e8a433616686 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:24.468840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029aac20-5259-4c71-9f73-f49790e02094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:24.469781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aac20-5259-4c71-9f73-f49790e02094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:24.470002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aac20-5259-4c71-9f73-f49790e02094 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:24.470633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aac20-5259-4c71-9f73-f49790e02094 admin admin] PATH_INFO: `/v3/users/8221b4536a1a432c9c74c5b389f8cb6e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:24.472005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029aac20-5259-4c71-9f73-f49790e02094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8221b4536a1a432c9c74c5b389f8cb6e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:24.474223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029aac20-5259-4c71-9f73-f49790e02094 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:24.529734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-029aac20-5259-4c71-9f73-f49790e02094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8221b4536a1a432c9c74c5b389f8cb6e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:24.536560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-029aac20-5259-4c71-9f73-f49790e02094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8221b4536a1a432c9c74c5b389f8cb6e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:24.548957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-029aac20-5259-4c71-9f73-f49790e02094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8221b4536a1a432c9c74c5b389f8cb6e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:24.549677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-029aac20-5259-4c71-9f73-f49790e02094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8221b4536a1a432c9c74c5b389f8cb6e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:24.558379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-029aac20-5259-4c71-9f73-f49790e02094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8221b4536a1a432c9c74c5b389f8cb6e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:24.565293 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2024/4089] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:58:24 2021] DELETE /identity/v3/users/8221b4536a1a432c9c74c5b389f8cb6e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:58:24.824985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde65eaf-1b85-444b-97be-e939037fbc18 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:24.825950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde65eaf-1b85-444b-97be-e939037fbc18 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:24.826411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde65eaf-1b85-444b-97be-e939037fbc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:24.853606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-dde65eaf-1b85-444b-97be-e939037fbc18 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:24.854837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dde65eaf-1b85-444b-97be-e939037fbc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:24.954032 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2066/4090] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:58:24 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:24.968634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029aac20-5259-4c71-9f73-f49790e02094 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:24.971380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-029aac20-5259-4c71-9f73-f49790e02094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:24.994936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde65eaf-1b85-444b-97be-e939037fbc18 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:24.998188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dde65eaf-1b85-444b-97be-e939037fbc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:25.051702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029aac20-5259-4c71-9f73-f49790e02094 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:25.061211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d36a2-e7c3-4421-a237-e29c368ce354 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:25.061941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d36a2-e7c3-4421-a237-e29c368ce354 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:25.062158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d36a2-e7c3-4421-a237-e29c368ce354 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:25.062528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d36a2-e7c3-4421-a237-e29c368ce354 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:25.077268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d36a2-e7c3-4421-a237-e29c368ce354 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:25.079499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d36a2-e7c3-4421-a237-e29c368ce354 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:25.098349 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2025/4091] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:58:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:58:25.123060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde65eaf-1b85-444b-97be-e939037fbc18 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:25.130934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3645f-06f5-4862-9f02-6144e9ce3bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:25.132006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3645f-06f5-4862-9f02-6144e9ce3bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:25.132458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3645f-06f5-4862-9f02-6144e9ce3bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:25.132879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3645f-06f5-4862-9f02-6144e9ce3bdc admin admin] PATH_INFO: `/v3/projects/9aa9f456ca964ee29177046fc12794a3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:25.134501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3645f-06f5-4862-9f02-6144e9ce3bdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa9f456ca964ee29177046fc12794a3)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:25.136916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3645f-06f5-4862-9f02-6144e9ce3bdc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:25.215515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-17f3645f-06f5-4862-9f02-6144e9ce3bdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa9f456ca964ee29177046fc12794a3', 'request_id': 'req-17f3645f-06f5-4862-9f02-6144e9ce3bdc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:25.228677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-17f3645f-06f5-4862-9f02-6144e9ce3bdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa9f456ca964ee29177046fc12794a3', 'request_id': 'req-17f3645f-06f5-4862-9f02-6144e9ce3bdc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:25.247472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-17f3645f-06f5-4862-9f02-6144e9ce3bdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa9f456ca964ee29177046fc12794a3', 'request_id': 'req-17f3645f-06f5-4862-9f02-6144e9ce3bdc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:25.264880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-17f3645f-06f5-4862-9f02-6144e9ce3bdc admin admin] The token cache is being invalidate because project 9aa9f456ca964ee29177046fc12794a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:58:25.268102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-17f3645f-06f5-4862-9f02-6144e9ce3bdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:25.277932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-17f3645f-06f5-4862-9f02-6144e9ce3bdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:25.290430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c62e2d-ac66-4eb2-a178-ca293c27eb5e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:25.290584 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2067/4092] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:24 2021] DELETE /identity/v3/projects/9aa9f456ca964ee29177046fc12794a3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:58:25.290784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c62e2d-ac66-4eb2-a178-ca293c27eb5e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:25.293009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c62e2d-ac66-4eb2-a178-ca293c27eb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:25.323428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-87c62e2d-ac66-4eb2-a178-ca293c27eb5e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:25.326030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-87c62e2d-ac66-4eb2-a178-ca293c27eb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:25.384619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e1376-d603-4b81-893e-48f76c56b318 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:25.385469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e1376-d603-4b81-893e-48f76c56b318 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:25.385825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e1376-d603-4b81-893e-48f76c56b318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:25.425393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-838e1376-d603-4b81-893e-48f76c56b318 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:25.429809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-838e1376-d603-4b81-893e-48f76c56b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:25.472304 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2026/4093] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:25.480582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a2417-315f-4798-8494-81ac758ff6fc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:25.481257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a2417-315f-4798-8494-81ac758ff6fc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:25.482308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a2417-315f-4798-8494-81ac758ff6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:25.509257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4f4a2417-315f-4798-8494-81ac758ff6fc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:25.510888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4f4a2417-315f-4798-8494-81ac758ff6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:25.524380 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2027/4094] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:25.528543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a2417-315f-4798-8494-81ac758ff6fc None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:25.540797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a2417-315f-4798-8494-81ac758ff6fc None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:25.546666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc24db-9fc2-4ddf-a416-145bd90e748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:25.547689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc24db-9fc2-4ddf-a416-145bd90e748b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:25.548499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc24db-9fc2-4ddf-a416-145bd90e748b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:25.549146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc24db-9fc2-4ddf-a416-145bd90e748b admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:25.550444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc24db-9fc2-4ddf-a416-145bd90e748b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:58:25.551047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc24db-9fc2-4ddf-a416-145bd90e748b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:25.553151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc24db-9fc2-4ddf-a416-145bd90e748b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:25.568931 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2068/4095] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:58:25 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:58:25.571690 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2028/4096] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:58:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 20:58:25.576798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e1376-d603-4b81-893e-48f76c56b318 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:25.590704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc24db-9fc2-4ddf-a416-145bd90e748b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:25.590897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e1376-d603-4b81-893e-48f76c56b318 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:25.595915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cdbc24db-9fc2-4ddf-a416-145bd90e748b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:25.597204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c658d3-d635-4f5f-b322-1c323415b2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:25.597869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c658d3-d635-4f5f-b322-1c323415b2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:25.598137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c658d3-d635-4f5f-b322-1c323415b2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:25.598455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c658d3-d635-4f5f-b322-1c323415b2e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:25.599164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c658d3-d635-4f5f-b322-1c323415b2e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:25.601038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c658d3-d635-4f5f-b322-1c323415b2e9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:25.635192 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2069/4097] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:58:25 2021] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:58:25.641169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c658d3-d635-4f5f-b322-1c323415b2e9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:25.698729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc24db-9fc2-4ddf-a416-145bd90e748b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:25.724369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c658d3-d635-4f5f-b322-1c323415b2e9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:25.729604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff8e39-e677-42af-985f-30a21d3b301d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:25.730384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff8e39-e677-42af-985f-30a21d3b301d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:25.730739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff8e39-e677-42af-985f-30a21d3b301d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:25.731306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff8e39-e677-42af-985f-30a21d3b301d admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:25.731853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff8e39-e677-42af-985f-30a21d3b301d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:25.743386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff8e39-e677-42af-985f-30a21d3b301d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:25.769421 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2070/4098] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:58:25 2021] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:58:25.774621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff8e39-e677-42af-985f-30a21d3b301d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:25.776466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8392d72-6665-4aee-96f9-acee4059b84a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:25.777198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392d72-6665-4aee-96f9-acee4059b84a service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:25.777553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392d72-6665-4aee-96f9-acee4059b84a service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:25.777899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392d72-6665-4aee-96f9-acee4059b84a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:25.786073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff8e39-e677-42af-985f-30a21d3b301d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:25.794973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db286-fb32-47c7-95ff-b5a522027dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:25.796199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db286-fb32-47c7-95ff-b5a522027dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:25.796562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db286-fb32-47c7-95ff-b5a522027dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:25.796916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db286-fb32-47c7-95ff-b5a522027dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:25.798066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9db286-fb32-47c7-95ff-b5a522027dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:25.800393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9db286-fb32-47c7-95ff-b5a522027dc5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:25.825636 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2071/4099] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:58:25 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:58:25.826646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db286-fb32-47c7-95ff-b5a522027dc5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:25.840442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db286-fb32-47c7-95ff-b5a522027dc5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:25.847368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861e83d-9d7b-43a3-847e-5bb7304e7095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:25.848107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861e83d-9d7b-43a3-847e-5bb7304e7095 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:25.848564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861e83d-9d7b-43a3-847e-5bb7304e7095 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:25.848857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861e83d-9d7b-43a3-847e-5bb7304e7095 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:25.849649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861e83d-9d7b-43a3-847e-5bb7304e7095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:25.852011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861e83d-9d7b-43a3-847e-5bb7304e7095 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:25.867129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8392d72-6665-4aee-96f9-acee4059b84a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:25.871502 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2072/4100] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:58:25 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:58:25.871648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8392d72-6665-4aee-96f9-acee4059b84a service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:25.872870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861e83d-9d7b-43a3-847e-5bb7304e7095 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:25.880102 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2029/4101] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:58:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:58:25.883681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861e83d-9d7b-43a3-847e-5bb7304e7095 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:25.908461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b6088-8b59-4651-b475-688c810bac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:25.917879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b6088-8b59-4651-b475-688c810bac9c admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:25.918176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b6088-8b59-4651-b475-688c810bac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:25.918491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b6088-8b59-4651-b475-688c810bac9c admin admin] PATH_INFO: `/v3/projects/64fbffc17fb94d73bd9ad8ad325fb2ae/users/c5e4871963ee496b852a0962fcd00f28/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:25.950188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b6088-8b59-4651-b475-688c810bac9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=64fbffc17fb94d73bd9ad8ad325fb2ae, user_id=c5e4871963ee496b852a0962fcd00f28, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:25.954163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b6088-8b59-4651-b475-688c810bac9c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:25.996739 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2073/4102] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:58:25 2021] PUT /identity/v3/projects/64fbffc17fb94d73bd9ad8ad325fb2ae/users/c5e4871963ee496b852a0962fcd00f28/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:58:25.998526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fe834-9491-4214-bdbe-9f8fcf73b582 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:25.998820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fe834-9491-4214-bdbe-9f8fcf73b582 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:25.999102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fe834-9491-4214-bdbe-9f8fcf73b582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:26.049067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c38fe834-9491-4214-bdbe-9f8fcf73b582 None None] MFA Rules not processed for user `c5e4871963ee496b852a0962fcd00f28`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:26.056277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c38fe834-9491-4214-bdbe-9f8fcf73b582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:26.172481 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2030/4103] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:25 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:26.187573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b6088-8b59-4651-b475-688c810bac9c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:26.189730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ea9b6088-8b59-4651-b475-688c810bac9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:26.283027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b6088-8b59-4651-b475-688c810bac9c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:26.287153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203c4de-d192-45cd-8fca-cb1c6ed71103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:26.288164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203c4de-d192-45cd-8fca-cb1c6ed71103 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:26.288661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203c4de-d192-45cd-8fca-cb1c6ed71103 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:26.289317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203c4de-d192-45cd-8fca-cb1c6ed71103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:26.300205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203c4de-d192-45cd-8fca-cb1c6ed71103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:26.303127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203c4de-d192-45cd-8fca-cb1c6ed71103 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:26.328222 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2074/4104] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:58:26 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:58:29.117437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fe834-9491-4214-bdbe-9f8fcf73b582 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:29.232117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fe834-9491-4214-bdbe-9f8fcf73b582 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:29.243689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261841c-5c36-49c0-aa37-4c3e243b25eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:29.244291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261841c-5c36-49c0-aa37-4c3e243b25eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:29.244587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261841c-5c36-49c0-aa37-4c3e243b25eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:29.245098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261841c-5c36-49c0-aa37-4c3e243b25eb admin admin] PATH_INFO: `/v3/users/c5e4871963ee496b852a0962fcd00f28` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:29.247201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261841c-5c36-49c0-aa37-4c3e243b25eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e4871963ee496b852a0962fcd00f28)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:29.249213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261841c-5c36-49c0-aa37-4c3e243b25eb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:29.352342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8261841c-5c36-49c0-aa37-4c3e243b25eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e4871963ee496b852a0962fcd00f28'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:29.363413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8261841c-5c36-49c0-aa37-4c3e243b25eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e4871963ee496b852a0962fcd00f28'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:29.383013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8261841c-5c36-49c0-aa37-4c3e243b25eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e4871963ee496b852a0962fcd00f28'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:29.383838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8261841c-5c36-49c0-aa37-4c3e243b25eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e4871963ee496b852a0962fcd00f28'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:29.395240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8261841c-5c36-49c0-aa37-4c3e243b25eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e4871963ee496b852a0962fcd00f28'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:29.406023 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2031/4105] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:58:29 2021] DELETE /identity/v3/users/c5e4871963ee496b852a0962fcd00f28 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:58:29.408872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b32b9-fb7e-48cf-9b9f-47d000d932ec None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:29.409340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b32b9-fb7e-48cf-9b9f-47d000d932ec None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:29.409738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b32b9-fb7e-48cf-9b9f-47d000d932ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:29.432489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0b3b32b9-fb7e-48cf-9b9f-47d000d932ec None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:29.433457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0b3b32b9-fb7e-48cf-9b9f-47d000d932ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:29.515486 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2075/4106] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:29.523650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261841c-5c36-49c0-aa37-4c3e243b25eb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:29.524951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8261841c-5c36-49c0-aa37-4c3e243b25eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:29.626083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261841c-5c36-49c0-aa37-4c3e243b25eb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:29.632713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926155f6-0ba1-44c3-a184-73818d0c2942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:29.633750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926155f6-0ba1-44c3-a184-73818d0c2942 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:29.634369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926155f6-0ba1-44c3-a184-73818d0c2942 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:29.634784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926155f6-0ba1-44c3-a184-73818d0c2942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:29.647036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926155f6-0ba1-44c3-a184-73818d0c2942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:29.649428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926155f6-0ba1-44c3-a184-73818d0c2942 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:29.661673 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2032/4107] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:58:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:58:30.241217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b32b9-fb7e-48cf-9b9f-47d000d932ec None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:30.244697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0b3b32b9-fb7e-48cf-9b9f-47d000d932ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:30.266016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b32b9-fb7e-48cf-9b9f-47d000d932ec None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:30.288907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64aad0-a5c3-4c81-a3b9-e2adc53dfbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:30.289772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64aad0-a5c3-4c81-a3b9-e2adc53dfbbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:30.290054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64aad0-a5c3-4c81-a3b9-e2adc53dfbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:30.290359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64aad0-a5c3-4c81-a3b9-e2adc53dfbbc admin admin] PATH_INFO: `/v3/projects/64fbffc17fb94d73bd9ad8ad325fb2ae` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:30.299665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64aad0-a5c3-4c81-a3b9-e2adc53dfbbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=64fbffc17fb94d73bd9ad8ad325fb2ae)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:30.301783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64aad0-a5c3-4c81-a3b9-e2adc53dfbbc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:30.435939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba64aad0-a5c3-4c81-a3b9-e2adc53dfbbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64fbffc17fb94d73bd9ad8ad325fb2ae', 'request_id': 'req-ba64aad0-a5c3-4c81-a3b9-e2adc53dfbbc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:30.446431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba64aad0-a5c3-4c81-a3b9-e2adc53dfbbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64fbffc17fb94d73bd9ad8ad325fb2ae', 'request_id': 'req-ba64aad0-a5c3-4c81-a3b9-e2adc53dfbbc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:30.469413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba64aad0-a5c3-4c81-a3b9-e2adc53dfbbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64fbffc17fb94d73bd9ad8ad325fb2ae', 'request_id': 'req-ba64aad0-a5c3-4c81-a3b9-e2adc53dfbbc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:30.488351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba64aad0-a5c3-4c81-a3b9-e2adc53dfbbc admin admin] The token cache is being invalidate because project 64fbffc17fb94d73bd9ad8ad325fb2ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:58:30.488876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba64aad0-a5c3-4c81-a3b9-e2adc53dfbbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:30.489712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba64aad0-a5c3-4c81-a3b9-e2adc53dfbbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:30.491924 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2076/4108] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:30 2021] DELETE /identity/v3/projects/64fbffc17fb94d73bd9ad8ad325fb2ae => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:58:30.498072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a5ceb-af2c-4b96-bcef-86f22e31b700 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:30.498653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a5ceb-af2c-4b96-bcef-86f22e31b700 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:30.498653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a5ceb-af2c-4b96-bcef-86f22e31b700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:30.524398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1d0a5ceb-af2c-4b96-bcef-86f22e31b700 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:30.525816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1d0a5ceb-af2c-4b96-bcef-86f22e31b700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:30.667456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f33f5-05d8-485f-9419-72665740a08d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:30.668031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f33f5-05d8-485f-9419-72665740a08d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:30.668524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f33f5-05d8-485f-9419-72665740a08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:30.671436 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2033/4109] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:30.702509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bf1f33f5-05d8-485f-9419-72665740a08d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:30.704147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bf1f33f5-05d8-485f-9419-72665740a08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:30.748466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a5ceb-af2c-4b96-bcef-86f22e31b700 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:30.758105 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2077/4110] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:30.765398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a5ceb-af2c-4b96-bcef-86f22e31b700 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:30.787699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f703811-cae7-4958-bf4b-bef113f359ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:30.788390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f703811-cae7-4958-bf4b-bef113f359ab admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:30.789477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f703811-cae7-4958-bf4b-bef113f359ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:30.789830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f703811-cae7-4958-bf4b-bef113f359ab admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:30.790934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f703811-cae7-4958-bf4b-bef113f359ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:58:30.792016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f703811-cae7-4958-bf4b-bef113f359ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:30.793768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f703811-cae7-4958-bf4b-bef113f359ab admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:30.822457 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2034/4111] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:58:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:58:30.826696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f33f5-05d8-485f-9419-72665740a08d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:30.837736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f33f5-05d8-485f-9419-72665740a08d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:30.851159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3856dc-9293-4fa5-9b11-8ca8b621b4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:30.851845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3856dc-9293-4fa5-9b11-8ca8b621b4ed admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:30.852177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3856dc-9293-4fa5-9b11-8ca8b621b4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:30.852470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3856dc-9293-4fa5-9b11-8ca8b621b4ed admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:30.853210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3856dc-9293-4fa5-9b11-8ca8b621b4ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:30.855449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3856dc-9293-4fa5-9b11-8ca8b621b4ed admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:30.901788 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2078/4112] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:58:30 2021] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:58:30.906264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f703811-cae7-4958-bf4b-bef113f359ab admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:30.924808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f703811-cae7-4958-bf4b-bef113f359ab admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:31.012709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc8022-18f5-4abd-9d5b-9bd43cc1ee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:31.013541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc8022-18f5-4abd-9d5b-9bd43cc1ee3e admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:31.013833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc8022-18f5-4abd-9d5b-9bd43cc1ee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:31.014112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc8022-18f5-4abd-9d5b-9bd43cc1ee3e admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:31.014860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc8022-18f5-4abd-9d5b-9bd43cc1ee3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:31.016905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc8022-18f5-4abd-9d5b-9bd43cc1ee3e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:31.059412 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2035/4113] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:58:30 2021] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:58:31.060448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3856dc-9293-4fa5-9b11-8ca8b621b4ed admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:31.075782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3856dc-9293-4fa5-9b11-8ca8b621b4ed admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:31.090794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebbae7-40f8-4357-b499-02e15627630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:31.091481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebbae7-40f8-4357-b499-02e15627630b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:31.091759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebbae7-40f8-4357-b499-02e15627630b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:31.092039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebbae7-40f8-4357-b499-02e15627630b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:31.092781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebbae7-40f8-4357-b499-02e15627630b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:31.094415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebbae7-40f8-4357-b499-02e15627630b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:31.117013 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2079/4114] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:58:31 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:58:31.121684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc8022-18f5-4abd-9d5b-9bd43cc1ee3e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:31.137782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc8022-18f5-4abd-9d5b-9bd43cc1ee3e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:31.149454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e933b35-80b5-4291-93d6-b8ac3446ed31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:31.150963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e933b35-80b5-4291-93d6-b8ac3446ed31 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:31.150963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e933b35-80b5-4291-93d6-b8ac3446ed31 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:31.150963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e933b35-80b5-4291-93d6-b8ac3446ed31 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:31.152175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e933b35-80b5-4291-93d6-b8ac3446ed31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:31.154459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e933b35-80b5-4291-93d6-b8ac3446ed31 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:31.170821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebbae7-40f8-4357-b499-02e15627630b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:31.171913 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2036/4115] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:58:31 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:58:31.191471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebbae7-40f8-4357-b499-02e15627630b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:31.197243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806f224-4644-4f7a-a72f-d73c16e23060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:31.198203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806f224-4644-4f7a-a72f-d73c16e23060 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:31.198704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806f224-4644-4f7a-a72f-d73c16e23060 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:31.199011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806f224-4644-4f7a-a72f-d73c16e23060 admin admin] PATH_INFO: `/v3/projects/d9d01d8c1cbb46e0a9666c225937d2e0/users/27421f4afc3a4c1596fc19399e1616a8/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:31.227228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806f224-4644-4f7a-a72f-d73c16e23060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d01d8c1cbb46e0a9666c225937d2e0, user_id=27421f4afc3a4c1596fc19399e1616a8, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:31.230204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806f224-4644-4f7a-a72f-d73c16e23060 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:31.262602 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2080/4116] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:58:31 2021] PUT /identity/v3/projects/d9d01d8c1cbb46e0a9666c225937d2e0/users/27421f4afc3a4c1596fc19399e1616a8/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:58:31.268005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa77664-d27e-4acb-af9b-61bd7329b4a2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:31.268614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa77664-d27e-4acb-af9b-61bd7329b4a2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:31.268900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa77664-d27e-4acb-af9b-61bd7329b4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:31.307589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5aa77664-d27e-4acb-af9b-61bd7329b4a2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:31.309509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5aa77664-d27e-4acb-af9b-61bd7329b4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:31.463271 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2037/4117] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:31.479814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806f224-4644-4f7a-a72f-d73c16e23060 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:31.483310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0806f224-4644-4f7a-a72f-d73c16e23060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:31.622784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806f224-4644-4f7a-a72f-d73c16e23060 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:31.628569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b94230-7df6-4016-b8af-edf1ec47221b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:31.629681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b94230-7df6-4016-b8af-edf1ec47221b service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:31.630125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b94230-7df6-4016-b8af-edf1ec47221b service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:31.630587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b94230-7df6-4016-b8af-edf1ec47221b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:31.654939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b94230-7df6-4016-b8af-edf1ec47221b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:31.656725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b94230-7df6-4016-b8af-edf1ec47221b service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:31.670008 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2081/4118] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:58:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:58:33.289103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cde40-e0b7-43bd-a869-acb5dbafd43f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:33.289646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cde40-e0b7-43bd-a869-acb5dbafd43f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:33.289736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cde40-e0b7-43bd-a869-acb5dbafd43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:33.352581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e27cde40-e0b7-43bd-a869-acb5dbafd43f None None] MFA Rules not processed for user `27421f4afc3a4c1596fc19399e1616a8`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:33.353838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e27cde40-e0b7-43bd-a869-acb5dbafd43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:33.552209 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2038/4119] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:33 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:58:33.556392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b94230-7df6-4016-b8af-edf1ec47221b service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:33.570714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b94230-7df6-4016-b8af-edf1ec47221b service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:33.580471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db8838-db6a-4fdb-93d6-8a49a2a5c79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:33.581224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db8838-db6a-4fdb-93d6-8a49a2a5c79b admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:33.581520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db8838-db6a-4fdb-93d6-8a49a2a5c79b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:33.581806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db8838-db6a-4fdb-93d6-8a49a2a5c79b admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:33.584355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db8838-db6a-4fdb-93d6-8a49a2a5c79b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:33.591641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db8838-db6a-4fdb-93d6-8a49a2a5c79b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:33.651965 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2082/4120] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:58:33 2021] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:58:33.655889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cde40-e0b7-43bd-a869-acb5dbafd43f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:33.679971 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cde40-e0b7-43bd-a869-acb5dbafd43f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:33.855582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f76b-584a-41b9-87f3-9aa8d36a9f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:33.858116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f76b-584a-41b9-87f3-9aa8d36a9f82 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:33.858116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f76b-584a-41b9-87f3-9aa8d36a9f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:33.858116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f76b-584a-41b9-87f3-9aa8d36a9f82 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:33.858116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010f76b-584a-41b9-87f3-9aa8d36a9f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:33.860474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010f76b-584a-41b9-87f3-9aa8d36a9f82 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:33.930900 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2039/4121] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:58:33 2021] POST /identity/v3/users => generated 295 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:58:33.935184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db8838-db6a-4fdb-93d6-8a49a2a5c79b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:33.955843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db8838-db6a-4fdb-93d6-8a49a2a5c79b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:33.973498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3f27a-7770-483e-9fee-9cd73883967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:33.974587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f27a-7770-483e-9fee-9cd73883967e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:33.975578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f27a-7770-483e-9fee-9cd73883967e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:33.976203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f27a-7770-483e-9fee-9cd73883967e admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:33.977651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3f27a-7770-483e-9fee-9cd73883967e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:33.980489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3f27a-7770-483e-9fee-9cd73883967e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:33.993904 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2083/4122] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:58:33 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:58:33.997367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f76b-584a-41b9-87f3-9aa8d36a9f82 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:34.008223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f76b-584a-41b9-87f3-9aa8d36a9f82 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:34.013821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500accaa-fb3c-468c-9c9e-d42c26b6e6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:34.015704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500accaa-fb3c-468c-9c9e-d42c26b6e6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:34.016022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500accaa-fb3c-468c-9c9e-d42c26b6e6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:34.016306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500accaa-fb3c-468c-9c9e-d42c26b6e6ba admin admin] PATH_INFO: `/v3/projects/0e0664b3fb0447f5824877d2dc2c2113/users/273883670cda476eabc51aee239a83b0/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:34.050682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500accaa-fb3c-468c-9c9e-d42c26b6e6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0664b3fb0447f5824877d2dc2c2113, user_id=273883670cda476eabc51aee239a83b0, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:34.054361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500accaa-fb3c-468c-9c9e-d42c26b6e6ba admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:34.081851 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2040/4123] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:58:33 2021] PUT /identity/v3/projects/0e0664b3fb0447f5824877d2dc2c2113/users/273883670cda476eabc51aee239a83b0/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:58:34.085370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3f27a-7770-483e-9fee-9cd73883967e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:34.101456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3f27a-7770-483e-9fee-9cd73883967e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:34.218273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10e569-66fd-40d5-88b4-abed57973c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:34.218999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10e569-66fd-40d5-88b4-abed57973c14 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:34.219274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10e569-66fd-40d5-88b4-abed57973c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:34.219557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10e569-66fd-40d5-88b4-abed57973c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:34.220851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10e569-66fd-40d5-88b4-abed57973c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:34.222695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10e569-66fd-40d5-88b4-abed57973c14 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:34.233979 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2084/4124] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:58:34 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:58:34.237776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500accaa-fb3c-468c-9c9e-d42c26b6e6ba admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:34.253324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500accaa-fb3c-468c-9c9e-d42c26b6e6ba admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:34.262452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a0823-c6cc-498b-859d-037eacbee1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:34.263870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a0823-c6cc-498b-859d-037eacbee1d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:34.264373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a0823-c6cc-498b-859d-037eacbee1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:34.265035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a0823-c6cc-498b-859d-037eacbee1d2 admin admin] PATH_INFO: `/v3/projects/0e0664b3fb0447f5824877d2dc2c2113/users/273883670cda476eabc51aee239a83b0/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:34.268320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a0823-c6cc-498b-859d-037eacbee1d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0664b3fb0447f5824877d2dc2c2113, user_id=273883670cda476eabc51aee239a83b0, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:34.271362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a0823-c6cc-498b-859d-037eacbee1d2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:34.286778 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2041/4125] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:58:34 2021] PUT /identity/v3/projects/0e0664b3fb0447f5824877d2dc2c2113/users/273883670cda476eabc51aee239a83b0/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:58:35.602776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345c7bc-b2ba-4c22-9cb8-015f936e7668 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:35.603766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345c7bc-b2ba-4c22-9cb8-015f936e7668 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:35.604216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345c7bc-b2ba-4c22-9cb8-015f936e7668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:35.661500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1345c7bc-b2ba-4c22-9cb8-015f936e7668 None None] MFA Rules not processed for user `273883670cda476eabc51aee239a83b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:35.662068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1345c7bc-b2ba-4c22-9cb8-015f936e7668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:35.787147 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2085/4126] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:35 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:35.799388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19cee7-6bd0-4661-9931-27e759b9780f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:35.800756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19cee7-6bd0-4661-9931-27e759b9780f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:35.801267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19cee7-6bd0-4661-9931-27e759b9780f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:35.846449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6f19cee7-6bd0-4661-9931-27e759b9780f None None] MFA Rules not processed for user `27421f4afc3a4c1596fc19399e1616a8`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:35.847845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6f19cee7-6bd0-4661-9931-27e759b9780f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:36.074017 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2042/4127] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:35 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:36.169011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345c7bc-b2ba-4c22-9cb8-015f936e7668 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:36.170941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1345c7bc-b2ba-4c22-9cb8-015f936e7668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:36.365955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa984d39-0172-455a-9f3c-9b62be5a91f6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:36.366497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa984d39-0172-455a-9f3c-9b62be5a91f6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:36.366497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa984d39-0172-455a-9f3c-9b62be5a91f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:36.391474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-aa984d39-0172-455a-9f3c-9b62be5a91f6 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:36.392725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-aa984d39-0172-455a-9f3c-9b62be5a91f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:36.410981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345c7bc-b2ba-4c22-9cb8-015f936e7668 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:36.421984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945931cb-26b1-4f94-8889-bad4e222aa20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:36.424693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945931cb-26b1-4f94-8889-bad4e222aa20 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:36.425212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945931cb-26b1-4f94-8889-bad4e222aa20 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:36.425736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945931cb-26b1-4f94-8889-bad4e222aa20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:36.454961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945931cb-26b1-4f94-8889-bad4e222aa20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:36.457703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945931cb-26b1-4f94-8889-bad4e222aa20 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:36.466129 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2043/4128] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:58:36 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:36.491098 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2086/4129] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:58:36 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:58:36.502384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa984d39-0172-455a-9f3c-9b62be5a91f6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:36.504022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-aa984d39-0172-455a-9f3c-9b62be5a91f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:36.619479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa984d39-0172-455a-9f3c-9b62be5a91f6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:36.628527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198f4c9-a249-4d5c-9e39-ab612e549b8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:36.629615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198f4c9-a249-4d5c-9e39-ab612e549b8c service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:36.630393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198f4c9-a249-4d5c-9e39-ab612e549b8c service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:36.631003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198f4c9-a249-4d5c-9e39-ab612e549b8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:36.652042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198f4c9-a249-4d5c-9e39-ab612e549b8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:36.653732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198f4c9-a249-4d5c-9e39-ab612e549b8c service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:36.669776 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2044/4130] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:58:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:58:40.497379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945931cb-26b1-4f94-8889-bad4e222aa20 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:40.499958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-945931cb-26b1-4f94-8889-bad4e222aa20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:40.626866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945931cb-26b1-4f94-8889-bad4e222aa20 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:40.632515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ba754-5d67-4ce0-b3d7-a42f4ab477f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:40.633556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ba754-5d67-4ce0-b3d7-a42f4ab477f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:40.633847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ba754-5d67-4ce0-b3d7-a42f4ab477f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:40.634142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ba754-5d67-4ce0-b3d7-a42f4ab477f1 admin admin] PATH_INFO: `/v3/users/baaead8443a7492db118aa577386a88b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:40.635547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ba754-5d67-4ce0-b3d7-a42f4ab477f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baaead8443a7492db118aa577386a88b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:40.637717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ba754-5d67-4ce0-b3d7-a42f4ab477f1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:40.720552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6d2ba754-5d67-4ce0-b3d7-a42f4ab477f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baaead8443a7492db118aa577386a88b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:40.728884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6d2ba754-5d67-4ce0-b3d7-a42f4ab477f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baaead8443a7492db118aa577386a88b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:40.730884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6d2ba754-5d67-4ce0-b3d7-a42f4ab477f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baaead8443a7492db118aa577386a88b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:40.764923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6d2ba754-5d67-4ce0-b3d7-a42f4ab477f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baaead8443a7492db118aa577386a88b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:40.790433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6d2ba754-5d67-4ce0-b3d7-a42f4ab477f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baaead8443a7492db118aa577386a88b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:40.800393 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2087/4131] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:58:40 2021] DELETE /identity/v3/users/baaead8443a7492db118aa577386a88b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:58:41.054154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198f4c9-a249-4d5c-9e39-ab612e549b8c service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:41.078440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198f4c9-a249-4d5c-9e39-ab612e549b8c service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:41.161663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de57322-01b7-45f1-8939-e79b8614b4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:41.163085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de57322-01b7-45f1-8939-e79b8614b4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:41.163370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de57322-01b7-45f1-8939-e79b8614b4df admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:41.163702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de57322-01b7-45f1-8939-e79b8614b4df admin admin] PATH_INFO: `/v3/projects/3f69c5059282455ca98cc9bff0fe1c94` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:41.167238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de57322-01b7-45f1-8939-e79b8614b4df admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f69c5059282455ca98cc9bff0fe1c94)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:41.167517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de57322-01b7-45f1-8939-e79b8614b4df admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:41.229201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1de57322-01b7-45f1-8939-e79b8614b4df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f69c5059282455ca98cc9bff0fe1c94', 'request_id': 'req-1de57322-01b7-45f1-8939-e79b8614b4df'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:41.237671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1de57322-01b7-45f1-8939-e79b8614b4df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f69c5059282455ca98cc9bff0fe1c94', 'request_id': 'req-1de57322-01b7-45f1-8939-e79b8614b4df'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:41.242931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1de57322-01b7-45f1-8939-e79b8614b4df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f69c5059282455ca98cc9bff0fe1c94', 'request_id': 'req-1de57322-01b7-45f1-8939-e79b8614b4df'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:41.261964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1de57322-01b7-45f1-8939-e79b8614b4df admin admin] The token cache is being invalidate because project 3f69c5059282455ca98cc9bff0fe1c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:58:41.262429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1de57322-01b7-45f1-8939-e79b8614b4df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:41.263085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1de57322-01b7-45f1-8939-e79b8614b4df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:41.264940 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2045/4132] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:41 2021] DELETE /identity/v3/projects/3f69c5059282455ca98cc9bff0fe1c94 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:58:41.269711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ba754-5d67-4ce0-b3d7-a42f4ab477f1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:41.271360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6d2ba754-5d67-4ce0-b3d7-a42f4ab477f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:41.290565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ba754-5d67-4ce0-b3d7-a42f4ab477f1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:41.395902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4016b-4f08-4386-8266-5bbb86035536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:41.396825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4016b-4f08-4386-8266-5bbb86035536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:41.397111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4016b-4f08-4386-8266-5bbb86035536 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:41.397389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4016b-4f08-4386-8266-5bbb86035536 admin admin] PATH_INFO: `/v3/users/d393be1d9c5841f8b23f37d4af9d75d6` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:41.400302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4016b-4f08-4386-8266-5bbb86035536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d393be1d9c5841f8b23f37d4af9d75d6)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:41.405696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4016b-4f08-4386-8266-5bbb86035536 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:41.503341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8d4016b-4f08-4386-8266-5bbb86035536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd393be1d9c5841f8b23f37d4af9d75d6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:41.513384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8d4016b-4f08-4386-8266-5bbb86035536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd393be1d9c5841f8b23f37d4af9d75d6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:41.514354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8d4016b-4f08-4386-8266-5bbb86035536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd393be1d9c5841f8b23f37d4af9d75d6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:41.528857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8d4016b-4f08-4386-8266-5bbb86035536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd393be1d9c5841f8b23f37d4af9d75d6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:41.541951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8d4016b-4f08-4386-8266-5bbb86035536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd393be1d9c5841f8b23f37d4af9d75d6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:41.550671 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2088/4133] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:58:41 2021] DELETE /identity/v3/users/d393be1d9c5841f8b23f37d4af9d75d6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:58:41.807195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de57322-01b7-45f1-8939-e79b8614b4df admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:41.809154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1de57322-01b7-45f1-8939-e79b8614b4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:41.825966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de57322-01b7-45f1-8939-e79b8614b4df admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:41.960197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ffcfd-3cfa-4aee-a918-18619f07d001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:41.961051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ffcfd-3cfa-4aee-a918-18619f07d001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:41.961342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ffcfd-3cfa-4aee-a918-18619f07d001 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:41.961628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ffcfd-3cfa-4aee-a918-18619f07d001 admin admin] PATH_INFO: `/v3/projects/3b97cde68fd24f27b4183d805abe8d27` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:41.962962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ffcfd-3cfa-4aee-a918-18619f07d001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b97cde68fd24f27b4183d805abe8d27)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:41.964881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ffcfd-3cfa-4aee-a918-18619f07d001 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:42.045712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6f4ffcfd-3cfa-4aee-a918-18619f07d001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b97cde68fd24f27b4183d805abe8d27', 'request_id': 'req-6f4ffcfd-3cfa-4aee-a918-18619f07d001'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:42.052533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6f4ffcfd-3cfa-4aee-a918-18619f07d001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b97cde68fd24f27b4183d805abe8d27', 'request_id': 'req-6f4ffcfd-3cfa-4aee-a918-18619f07d001'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:42.058452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6f4ffcfd-3cfa-4aee-a918-18619f07d001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b97cde68fd24f27b4183d805abe8d27', 'request_id': 'req-6f4ffcfd-3cfa-4aee-a918-18619f07d001'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:42.081993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6f4ffcfd-3cfa-4aee-a918-18619f07d001 admin admin] The token cache is being invalidate because project 3b97cde68fd24f27b4183d805abe8d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:58:42.082753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6f4ffcfd-3cfa-4aee-a918-18619f07d001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:42.083883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6f4ffcfd-3cfa-4aee-a918-18619f07d001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:58:42.091602 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2046/4134] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:58:41 2021] DELETE /identity/v3/projects/3b97cde68fd24f27b4183d805abe8d27 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:58:42.093126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806946bd-5e67-4e85-a4d5-f1cb6466ec65 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:42.093538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806946bd-5e67-4e85-a4d5-f1cb6466ec65 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:42.094211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806946bd-5e67-4e85-a4d5-f1cb6466ec65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:42.131125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-806946bd-5e67-4e85-a4d5-f1cb6466ec65 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:42.135325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-806946bd-5e67-4e85-a4d5-f1cb6466ec65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:42.299391 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2089/4135] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:58:42.308204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1d103-d154-4850-8a59-6b66f9db4420 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:42.308397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1d103-d154-4850-8a59-6b66f9db4420 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:42.308691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1d103-d154-4850-8a59-6b66f9db4420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:42.365729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c1c1d103-d154-4850-8a59-6b66f9db4420 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:42.367352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c1c1d103-d154-4850-8a59-6b66f9db4420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:42.386170 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2047/4136] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:42.387462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806946bd-5e67-4e85-a4d5-f1cb6466ec65 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:42.406963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806946bd-5e67-4e85-a4d5-f1cb6466ec65 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:42.422471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52078ca8-bd96-4a86-9d5f-b809641faf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:42.423302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078ca8-bd96-4a86-9d5f-b809641faf66 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:42.424146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078ca8-bd96-4a86-9d5f-b809641faf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:42.424146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078ca8-bd96-4a86-9d5f-b809641faf66 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:42.425266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52078ca8-bd96-4a86-9d5f-b809641faf66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:58:42.425266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52078ca8-bd96-4a86-9d5f-b809641faf66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:42.427153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52078ca8-bd96-4a86-9d5f-b809641faf66 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:42.458512 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2090/4137] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:58:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:58:42.463746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1d103-d154-4850-8a59-6b66f9db4420 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:42.489552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1d103-d154-4850-8a59-6b66f9db4420 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:42.499157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4ad31-52ed-427e-87d7-ce6cdaab241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:42.501109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4ad31-52ed-427e-87d7-ce6cdaab241f admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:42.501493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4ad31-52ed-427e-87d7-ce6cdaab241f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:42.502129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4ad31-52ed-427e-87d7-ce6cdaab241f admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:42.503237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4ad31-52ed-427e-87d7-ce6cdaab241f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:42.505466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4ad31-52ed-427e-87d7-ce6cdaab241f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:42.578754 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2048/4138] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:58:42 2021] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:58:42.580463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52078ca8-bd96-4a86-9d5f-b809641faf66 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:42.594343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52078ca8-bd96-4a86-9d5f-b809641faf66 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:42.708256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741041d2-4c7e-4cc1-950d-29a18613f048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:42.709235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741041d2-4c7e-4cc1-950d-29a18613f048 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:42.709744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741041d2-4c7e-4cc1-950d-29a18613f048 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:42.710048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741041d2-4c7e-4cc1-950d-29a18613f048 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:42.710812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741041d2-4c7e-4cc1-950d-29a18613f048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:42.712893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741041d2-4c7e-4cc1-950d-29a18613f048 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:42.766198 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2091/4139] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:58:42 2021] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:58:42.774345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4ad31-52ed-427e-87d7-ce6cdaab241f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:42.785505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4ad31-52ed-427e-87d7-ce6cdaab241f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:42.802471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00304cde-4e47-4e8e-b03a-bb8e47cc90b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:42.802907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304cde-4e47-4e8e-b03a-bb8e47cc90b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:42.803289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304cde-4e47-4e8e-b03a-bb8e47cc90b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:42.803741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304cde-4e47-4e8e-b03a-bb8e47cc90b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:42.804905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00304cde-4e47-4e8e-b03a-bb8e47cc90b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:42.807147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00304cde-4e47-4e8e-b03a-bb8e47cc90b8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:42.822327 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2049/4140] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:58:42 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:58:42.823517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741041d2-4c7e-4cc1-950d-29a18613f048 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:42.837805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741041d2-4c7e-4cc1-950d-29a18613f048 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:42.851191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85732b-759c-4d5d-9085-80ce1f7ed297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:42.852011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85732b-759c-4d5d-9085-80ce1f7ed297 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:42.852528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85732b-759c-4d5d-9085-80ce1f7ed297 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:42.853018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85732b-759c-4d5d-9085-80ce1f7ed297 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:42.854054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85732b-759c-4d5d-9085-80ce1f7ed297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:42.855871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85732b-759c-4d5d-9085-80ce1f7ed297 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:42.871881 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2092/4141] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:58:42 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:58:42.875750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00304cde-4e47-4e8e-b03a-bb8e47cc90b8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:42.894777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00304cde-4e47-4e8e-b03a-bb8e47cc90b8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:42.907899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f68d0-bd01-4f3b-872b-ba12ff9cbef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:42.911040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f68d0-bd01-4f3b-872b-ba12ff9cbef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:42.913010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f68d0-bd01-4f3b-872b-ba12ff9cbef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:42.915019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f68d0-bd01-4f3b-872b-ba12ff9cbef4 admin admin] PATH_INFO: `/v3/projects/bedae94992bb429a977e14e9df1ad677/users/cb197d56af3a4177a990788d4424c9ea/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:42.955708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f68d0-bd01-4f3b-872b-ba12ff9cbef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bedae94992bb429a977e14e9df1ad677, user_id=cb197d56af3a4177a990788d4424c9ea, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:42.958393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f68d0-bd01-4f3b-872b-ba12ff9cbef4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:42.987630 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2050/4142] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:58:42 2021] PUT /identity/v3/projects/bedae94992bb429a977e14e9df1ad677/users/cb197d56af3a4177a990788d4424c9ea/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:58:42.992640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37197ce7-e5aa-402c-8eb8-ec526e7413c3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:42.993195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37197ce7-e5aa-402c-8eb8-ec526e7413c3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:42.993695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37197ce7-e5aa-402c-8eb8-ec526e7413c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:43.030799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-37197ce7-e5aa-402c-8eb8-ec526e7413c3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:43.036023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-37197ce7-e5aa-402c-8eb8-ec526e7413c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:43.163933 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2093/4143] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:43.206931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f68d0-bd01-4f3b-872b-ba12ff9cbef4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:43.209515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-439f68d0-bd01-4f3b-872b-ba12ff9cbef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:43.293347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f68d0-bd01-4f3b-872b-ba12ff9cbef4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:43.312882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4ad2f-9827-47f3-b00e-a9b661872361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:43.316293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4ad2f-9827-47f3-b00e-a9b661872361 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:43.316763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4ad2f-9827-47f3-b00e-a9b661872361 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:43.317051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4ad2f-9827-47f3-b00e-a9b661872361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:43.343684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4ad2f-9827-47f3-b00e-a9b661872361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:43.345400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4ad2f-9827-47f3-b00e-a9b661872361 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:43.384317 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2051/4144] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:58:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:58:52.513297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa793e-c4b6-449f-a17a-3c549b44c761 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:52.514439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa793e-c4b6-449f-a17a-3c549b44c761 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:52.514875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa793e-c4b6-449f-a17a-3c549b44c761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:52.572939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-45aa793e-c4b6-449f-a17a-3c549b44c761 None None] MFA Rules not processed for user `cb197d56af3a4177a990788d4424c9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:52.575666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-45aa793e-c4b6-449f-a17a-3c549b44c761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:52.691765 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2094/4145] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:58:52 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:52.706110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4ad2f-9827-47f3-b00e-a9b661872361 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:52.708663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ecd4ad2f-9827-47f3-b00e-a9b661872361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:52.847050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4ad2f-9827-47f3-b00e-a9b661872361 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:52.853041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62bafd-8277-487f-ab6d-ea4ae6bd6971 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:52.853838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62bafd-8277-487f-ab6d-ea4ae6bd6971 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:52.854128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62bafd-8277-487f-ab6d-ea4ae6bd6971 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:52.854446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62bafd-8277-487f-ab6d-ea4ae6bd6971 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:52.865925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62bafd-8277-487f-ab6d-ea4ae6bd6971 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:52.867668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62bafd-8277-487f-ab6d-ea4ae6bd6971 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:52.877727 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2052/4146] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:58:52 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:58:54.351073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b14db9-6457-4fdd-9953-b38a8d43b369 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:54.351556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b14db9-6457-4fdd-9953-b38a8d43b369 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:54.351677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b14db9-6457-4fdd-9953-b38a8d43b369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:54.372194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e1b14db9-6457-4fdd-9953-b38a8d43b369 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:58:54.373384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e1b14db9-6457-4fdd-9953-b38a8d43b369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:54.429926 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2095/4147] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:58:54 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:58:54.451675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62bafd-8277-487f-ab6d-ea4ae6bd6971 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:58:54.453099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5e62bafd-8277-487f-ab6d-ea4ae6bd6971 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:58:54.528291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62bafd-8277-487f-ab6d-ea4ae6bd6971 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:58:54.533600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc26a1-cccf-4bc9-bae6-0c858263b1ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:58:54.534441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc26a1-cccf-4bc9-bae6-0c858263b1ed service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:54.534829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc26a1-cccf-4bc9-bae6-0c858263b1ed service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:54.535319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc26a1-cccf-4bc9-bae6-0c858263b1ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:58:54.544394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc26a1-cccf-4bc9-bae6-0c858263b1ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:58:54.546088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc26a1-cccf-4bc9-bae6-0c858263b1ed service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:58:54.555591 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2053/4148] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:58:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 20:58:59.982465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159f1f4-10bf-4a3a-95bb-81df4775f172 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:58:59.983652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159f1f4-10bf-4a3a-95bb-81df4775f172 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:58:59.984160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159f1f4-10bf-4a3a-95bb-81df4775f172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:00.042758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c159f1f4-10bf-4a3a-95bb-81df4775f172 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:00.044073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c159f1f4-10bf-4a3a-95bb-81df4775f172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:00.052397 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2096/4149] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:58:59 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:00.066322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc26a1-cccf-4bc9-bae6-0c858263b1ed service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:00.077092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc26a1-cccf-4bc9-bae6-0c858263b1ed service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:00.083518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4f605-028c-4970-b7c4-a8c0246f2467 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:00.084252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4f605-028c-4970-b7c4-a8c0246f2467 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:00.084544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4f605-028c-4970-b7c4-a8c0246f2467 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:00.084965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4f605-028c-4970-b7c4-a8c0246f2467 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:00.093617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4f605-028c-4970-b7c4-a8c0246f2467 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:00.096456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4f605-028c-4970-b7c4-a8c0246f2467 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:00.105808 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2054/4150] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:59:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:59:13.723630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159f1f4-10bf-4a3a-95bb-81df4775f172 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:13.725558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c159f1f4-10bf-4a3a-95bb-81df4775f172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:13.765049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159f1f4-10bf-4a3a-95bb-81df4775f172 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:13.791696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58070d3-09c9-42ba-a3dd-a7593a3e8fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:13.792592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58070d3-09c9-42ba-a3dd-a7593a3e8fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:13.799080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58070d3-09c9-42ba-a3dd-a7593a3e8fac admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:13.800493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58070d3-09c9-42ba-a3dd-a7593a3e8fac admin admin] PATH_INFO: `/v3/users/4ceb4b626d5f479b9e28dd26702d9d1e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:13.802918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58070d3-09c9-42ba-a3dd-a7593a3e8fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ceb4b626d5f479b9e28dd26702d9d1e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:13.805925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58070d3-09c9-42ba-a3dd-a7593a3e8fac admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:13.915440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c58070d3-09c9-42ba-a3dd-a7593a3e8fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ceb4b626d5f479b9e28dd26702d9d1e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:13.923668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c58070d3-09c9-42ba-a3dd-a7593a3e8fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ceb4b626d5f479b9e28dd26702d9d1e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:13.924463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c58070d3-09c9-42ba-a3dd-a7593a3e8fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ceb4b626d5f479b9e28dd26702d9d1e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:13.943041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c58070d3-09c9-42ba-a3dd-a7593a3e8fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ceb4b626d5f479b9e28dd26702d9d1e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:13.970795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c58070d3-09c9-42ba-a3dd-a7593a3e8fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ceb4b626d5f479b9e28dd26702d9d1e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:13.983544 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2097/4151] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:59:13 2021] DELETE /identity/v3/users/4ceb4b626d5f479b9e28dd26702d9d1e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:59:14.611659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4f605-028c-4970-b7c4-a8c0246f2467 service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:14.625262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4f605-028c-4970-b7c4-a8c0246f2467 service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:14.703681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac7d8a-f472-4258-a6d5-5941f0e7c34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:14.704432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac7d8a-f472-4258-a6d5-5941f0e7c34d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:14.705604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac7d8a-f472-4258-a6d5-5941f0e7c34d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:14.705914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac7d8a-f472-4258-a6d5-5941f0e7c34d admin admin] PATH_INFO: `/v3/projects/c2aba7bee78744949dc3323cb4c7df55` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:14.707324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac7d8a-f472-4258-a6d5-5941f0e7c34d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2aba7bee78744949dc3323cb4c7df55)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:14.709381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac7d8a-f472-4258-a6d5-5941f0e7c34d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:14.776471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-68ac7d8a-f472-4258-a6d5-5941f0e7c34d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2aba7bee78744949dc3323cb4c7df55', 'request_id': 'req-68ac7d8a-f472-4258-a6d5-5941f0e7c34d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:14.784150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-68ac7d8a-f472-4258-a6d5-5941f0e7c34d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2aba7bee78744949dc3323cb4c7df55', 'request_id': 'req-68ac7d8a-f472-4258-a6d5-5941f0e7c34d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:14.790177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-68ac7d8a-f472-4258-a6d5-5941f0e7c34d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2aba7bee78744949dc3323cb4c7df55', 'request_id': 'req-68ac7d8a-f472-4258-a6d5-5941f0e7c34d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:14.803591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-68ac7d8a-f472-4258-a6d5-5941f0e7c34d admin admin] The token cache is being invalidate because project c2aba7bee78744949dc3323cb4c7df55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:59:14.803881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-68ac7d8a-f472-4258-a6d5-5941f0e7c34d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:14.804524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-68ac7d8a-f472-4258-a6d5-5941f0e7c34d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:14.806046 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2055/4152] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:14 2021] DELETE /identity/v3/projects/c2aba7bee78744949dc3323cb4c7df55 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:59:14.813395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417dd85-202f-42cd-9792-e9ec8b1682b0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:14.814227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417dd85-202f-42cd-9792-e9ec8b1682b0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:14.814556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417dd85-202f-42cd-9792-e9ec8b1682b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:14.832966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a417dd85-202f-42cd-9792-e9ec8b1682b0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:14.834169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a417dd85-202f-42cd-9792-e9ec8b1682b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:14.894397 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2098/4153] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:14.902569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b679f35-23c4-4091-8b27-f124d2925e06 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:14.902859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b679f35-23c4-4091-8b27-f124d2925e06 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:14.903167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b679f35-23c4-4091-8b27-f124d2925e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:14.922563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4b679f35-23c4-4091-8b27-f124d2925e06 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:14.923904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4b679f35-23c4-4091-8b27-f124d2925e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:14.934887 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2056/4154] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:14.937601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417dd85-202f-42cd-9792-e9ec8b1682b0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:14.949556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417dd85-202f-42cd-9792-e9ec8b1682b0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:14.954203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186618a4-be6d-476a-9b42-5c7dd666a4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:14.954900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186618a4-be6d-476a-9b42-5c7dd666a4aa admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:14.955172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186618a4-be6d-476a-9b42-5c7dd666a4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:14.955470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186618a4-be6d-476a-9b42-5c7dd666a4aa admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:14.956194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186618a4-be6d-476a-9b42-5c7dd666a4aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:59:14.956491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186618a4-be6d-476a-9b42-5c7dd666a4aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:14.958064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186618a4-be6d-476a-9b42-5c7dd666a4aa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:14.969874 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2099/4155] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:59:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:59:14.974587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b679f35-23c4-4091-8b27-f124d2925e06 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:14.983842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b679f35-23c4-4091-8b27-f124d2925e06 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:14.989951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58c7ab-47aa-466d-a5f7-ac815cbcc616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:14.990516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58c7ab-47aa-466d-a5f7-ac815cbcc616 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:14.990808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58c7ab-47aa-466d-a5f7-ac815cbcc616 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:14.991140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58c7ab-47aa-466d-a5f7-ac815cbcc616 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:14.991868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58c7ab-47aa-466d-a5f7-ac815cbcc616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:14.993735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58c7ab-47aa-466d-a5f7-ac815cbcc616 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:15.020061 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2057/4156] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:59:14 2021] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:59:15.026439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186618a4-be6d-476a-9b42-5c7dd666a4aa admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:15.045816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186618a4-be6d-476a-9b42-5c7dd666a4aa admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:15.069167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58c7ab-47aa-466d-a5f7-ac815cbcc616 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:15.071249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6d58c7ab-47aa-466d-a5f7-ac815cbcc616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:15.134392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefdd66-83bf-4da8-8165-bcf23ecba087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:15.135211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefdd66-83bf-4da8-8165-bcf23ecba087 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:15.135747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefdd66-83bf-4da8-8165-bcf23ecba087 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:15.136264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefdd66-83bf-4da8-8165-bcf23ecba087 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:15.137246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefdd66-83bf-4da8-8165-bcf23ecba087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:15.139961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefdd66-83bf-4da8-8165-bcf23ecba087 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:15.178652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58c7ab-47aa-466d-a5f7-ac815cbcc616 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:15.184047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d90fb9-4cf9-4a5e-82f3-6b397bf59947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:15.185157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90fb9-4cf9-4a5e-82f3-6b397bf59947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:15.185543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90fb9-4cf9-4a5e-82f3-6b397bf59947 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:15.185918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90fb9-4cf9-4a5e-82f3-6b397bf59947 admin admin] PATH_INFO: `/v3/users/27421f4afc3a4c1596fc19399e1616a8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:15.187782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d90fb9-4cf9-4a5e-82f3-6b397bf59947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27421f4afc3a4c1596fc19399e1616a8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:15.189717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d90fb9-4cf9-4a5e-82f3-6b397bf59947 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:15.192350 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2100/4157] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:59:15 2021] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:59:15.194671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefdd66-83bf-4da8-8165-bcf23ecba087 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:15.197582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bdefdd66-83bf-4da8-8165-bcf23ecba087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:15.221605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefdd66-83bf-4da8-8165-bcf23ecba087 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:15.231029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac055b3-d7ba-4da4-a9b6-941be04bceec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:15.232466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac055b3-d7ba-4da4-a9b6-941be04bceec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:15.233013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac055b3-d7ba-4da4-a9b6-941be04bceec admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:15.233550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac055b3-d7ba-4da4-a9b6-941be04bceec admin admin] PATH_INFO: `/v3/users/cb197d56af3a4177a990788d4424c9ea` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:15.236265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac055b3-d7ba-4da4-a9b6-941be04bceec admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb197d56af3a4177a990788d4424c9ea)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:15.239750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac055b3-d7ba-4da4-a9b6-941be04bceec admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:15.244098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-97d90fb9-4cf9-4a5e-82f3-6b397bf59947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27421f4afc3a4c1596fc19399e1616a8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:15.251976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-97d90fb9-4cf9-4a5e-82f3-6b397bf59947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27421f4afc3a4c1596fc19399e1616a8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:15.266173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-97d90fb9-4cf9-4a5e-82f3-6b397bf59947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27421f4afc3a4c1596fc19399e1616a8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:15.267261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-97d90fb9-4cf9-4a5e-82f3-6b397bf59947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27421f4afc3a4c1596fc19399e1616a8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:15.282979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-97d90fb9-4cf9-4a5e-82f3-6b397bf59947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27421f4afc3a4c1596fc19399e1616a8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:15.293867 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2058/4158] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:59:15 2021] DELETE /identity/v3/users/27421f4afc3a4c1596fc19399e1616a8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:59:15.295168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d90fb9-4cf9-4a5e-82f3-6b397bf59947 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:15.296374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-97d90fb9-4cf9-4a5e-82f3-6b397bf59947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:15.356258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3ac055b3-d7ba-4da4-a9b6-941be04bceec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb197d56af3a4177a990788d4424c9ea'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:15.372864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d90fb9-4cf9-4a5e-82f3-6b397bf59947 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:15.377333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3ac055b3-d7ba-4da4-a9b6-941be04bceec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb197d56af3a4177a990788d4424c9ea'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:15.378072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3ac055b3-d7ba-4da4-a9b6-941be04bceec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb197d56af3a4177a990788d4424c9ea'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:15.388564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ec574-8f66-47e7-8e02-9b215524da2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:15.391652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ec574-8f66-47e7-8e02-9b215524da2b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:15.392439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ec574-8f66-47e7-8e02-9b215524da2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:15.393325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ec574-8f66-47e7-8e02-9b215524da2b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:15.396643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ec574-8f66-47e7-8e02-9b215524da2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:15.400853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ec574-8f66-47e7-8e02-9b215524da2b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:15.410714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3ac055b3-d7ba-4da4-a9b6-941be04bceec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb197d56af3a4177a990788d4424c9ea'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:15.425843 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2059/4159] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:59:15 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:59:15.426362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3ac055b3-d7ba-4da4-a9b6-941be04bceec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb197d56af3a4177a990788d4424c9ea'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:15.433247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ec574-8f66-47e7-8e02-9b215524da2b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:15.436307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-613ec574-8f66-47e7-8e02-9b215524da2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:15.436587 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2101/4160] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:59:15 2021] DELETE /identity/v3/users/cb197d56af3a4177a990788d4424c9ea => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:59:15.471489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ec574-8f66-47e7-8e02-9b215524da2b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:15.572412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d537b6-d450-43bf-8d4f-d4f56b40f3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:15.573365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d537b6-d450-43bf-8d4f-d4f56b40f3ad admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:15.573792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d537b6-d450-43bf-8d4f-d4f56b40f3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:15.574851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d537b6-d450-43bf-8d4f-d4f56b40f3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:15.575782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d537b6-d450-43bf-8d4f-d4f56b40f3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:15.579287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d537b6-d450-43bf-8d4f-d4f56b40f3ad admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:15.595510 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2060/4161] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:59:15 2021] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:59:15.599471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac055b3-d7ba-4da4-a9b6-941be04bceec admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:15.614125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac055b3-d7ba-4da4-a9b6-941be04bceec admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:15.620694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14077c25-05ff-4b08-83d5-ed8bb6f11cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:15.621601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14077c25-05ff-4b08-83d5-ed8bb6f11cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:15.621883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14077c25-05ff-4b08-83d5-ed8bb6f11cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:15.623559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14077c25-05ff-4b08-83d5-ed8bb6f11cc4 admin admin] PATH_INFO: `/v3/projects/d1b96ca6ed964b6a9db0ed2249251328/users/4196dd207ce543d3bdd5f48ae57e156a/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:15.657553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14077c25-05ff-4b08-83d5-ed8bb6f11cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b96ca6ed964b6a9db0ed2249251328, user_id=4196dd207ce543d3bdd5f48ae57e156a, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:15.664422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14077c25-05ff-4b08-83d5-ed8bb6f11cc4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:15.689516 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2102/4162] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:59:15 2021] PUT /identity/v3/projects/d1b96ca6ed964b6a9db0ed2249251328/users/4196dd207ce543d3bdd5f48ae57e156a/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:59:15.696248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfc2ab-f9de-43ef-bba9-5f1886bbf8f3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:15.697492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfc2ab-f9de-43ef-bba9-5f1886bbf8f3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:15.697978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfc2ab-f9de-43ef-bba9-5f1886bbf8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:15.738376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14077c25-05ff-4b08-83d5-ed8bb6f11cc4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:15.740267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-14077c25-05ff-4b08-83d5-ed8bb6f11cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:15.750988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-52bfc2ab-f9de-43ef-bba9-5f1886bbf8f3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:15.753393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-52bfc2ab-f9de-43ef-bba9-5f1886bbf8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:15.880478 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2061/4163] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:15.882035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f6cbb-d4ff-4add-89c1-85f51ac623b7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:15.882387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f6cbb-d4ff-4add-89c1-85f51ac623b7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:15.882672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f6cbb-d4ff-4add-89c1-85f51ac623b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:15.887062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14077c25-05ff-4b08-83d5-ed8bb6f11cc4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:15.893088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716905ac-a3be-45b6-a844-d17b393f870e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:15.894682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716905ac-a3be-45b6-a844-d17b393f870e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:15.895516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716905ac-a3be-45b6-a844-d17b393f870e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:15.895906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716905ac-a3be-45b6-a844-d17b393f870e admin admin] PATH_INFO: `/v3/projects/d9d01d8c1cbb46e0a9666c225937d2e0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:15.897297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716905ac-a3be-45b6-a844-d17b393f870e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d01d8c1cbb46e0a9666c225937d2e0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:15.899527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716905ac-a3be-45b6-a844-d17b393f870e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:15.918691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-795f6cbb-d4ff-4add-89c1-85f51ac623b7 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:15.920125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-795f6cbb-d4ff-4add-89c1-85f51ac623b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:15.961437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-716905ac-a3be-45b6-a844-d17b393f870e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'request_id': 'req-716905ac-a3be-45b6-a844-d17b393f870e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:15.979017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-716905ac-a3be-45b6-a844-d17b393f870e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'request_id': 'req-716905ac-a3be-45b6-a844-d17b393f870e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:15.989519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-716905ac-a3be-45b6-a844-d17b393f870e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d01d8c1cbb46e0a9666c225937d2e0', 'request_id': 'req-716905ac-a3be-45b6-a844-d17b393f870e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:15.998176 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2062/4164] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:59:15 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:15.999708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f6cbb-d4ff-4add-89c1-85f51ac623b7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:16.002346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-795f6cbb-d4ff-4add-89c1-85f51ac623b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:16.014289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-716905ac-a3be-45b6-a844-d17b393f870e admin admin] The token cache is being invalidate because project d9d01d8c1cbb46e0a9666c225937d2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:59:16.014732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-716905ac-a3be-45b6-a844-d17b393f870e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:16.015544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-716905ac-a3be-45b6-a844-d17b393f870e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:16.019180 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2103/4165] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:15 2021] DELETE /identity/v3/projects/d9d01d8c1cbb46e0a9666c225937d2e0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:59:16.020195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716905ac-a3be-45b6-a844-d17b393f870e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:16.021577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-716905ac-a3be-45b6-a844-d17b393f870e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:16.047153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f6cbb-d4ff-4add-89c1-85f51ac623b7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:16.088686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716905ac-a3be-45b6-a844-d17b393f870e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:16.092820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3990424-a963-4b1d-a97f-37429adcdbbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:16.093540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3990424-a963-4b1d-a97f-37429adcdbbb service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:16.093871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3990424-a963-4b1d-a97f-37429adcdbbb service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:16.094329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3990424-a963-4b1d-a97f-37429adcdbbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:16.096512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a3990424-a963-4b1d-a97f-37429adcdbbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:16.115522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed3e5b-1c52-498a-9d18-88bd21e7a760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:16.116808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed3e5b-1c52-498a-9d18-88bd21e7a760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:16.117173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed3e5b-1c52-498a-9d18-88bd21e7a760 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:16.117532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed3e5b-1c52-498a-9d18-88bd21e7a760 admin admin] PATH_INFO: `/v3/projects/bedae94992bb429a977e14e9df1ad677` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:16.119008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed3e5b-1c52-498a-9d18-88bd21e7a760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bedae94992bb429a977e14e9df1ad677)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:16.121003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed3e5b-1c52-498a-9d18-88bd21e7a760 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:16.168031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3990424-a963-4b1d-a97f-37429adcdbbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:16.169478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3990424-a963-4b1d-a97f-37429adcdbbb service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:16.178293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-82ed3e5b-1c52-498a-9d18-88bd21e7a760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bedae94992bb429a977e14e9df1ad677', 'request_id': 'req-82ed3e5b-1c52-498a-9d18-88bd21e7a760'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:16.180795 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2104/4166] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:59:16.181785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3990424-a963-4b1d-a97f-37429adcdbbb service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:16.183439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a3990424-a963-4b1d-a97f-37429adcdbbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:16.186081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-82ed3e5b-1c52-498a-9d18-88bd21e7a760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bedae94992bb429a977e14e9df1ad677', 'request_id': 'req-82ed3e5b-1c52-498a-9d18-88bd21e7a760'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:16.192995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-82ed3e5b-1c52-498a-9d18-88bd21e7a760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bedae94992bb429a977e14e9df1ad677', 'request_id': 'req-82ed3e5b-1c52-498a-9d18-88bd21e7a760'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:16.210434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-82ed3e5b-1c52-498a-9d18-88bd21e7a760 admin admin] The token cache is being invalidate because project bedae94992bb429a977e14e9df1ad677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:59:16.210794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-82ed3e5b-1c52-498a-9d18-88bd21e7a760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:16.211620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-82ed3e5b-1c52-498a-9d18-88bd21e7a760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:16.218194 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2063/4167] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:15 2021] DELETE /identity/v3/projects/bedae94992bb429a977e14e9df1ad677 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:59:16.218194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed3e5b-1c52-498a-9d18-88bd21e7a760 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:16.218194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-82ed3e5b-1c52-498a-9d18-88bd21e7a760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:16.280820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3990424-a963-4b1d-a97f-37429adcdbbb service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:16.284306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed3e5b-1c52-498a-9d18-88bd21e7a760 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:16.289855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20aa42-5f99-4f18-90af-327bfe27b09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:16.290722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20aa42-5f99-4f18-90af-327bfe27b09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:16.291001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20aa42-5f99-4f18-90af-327bfe27b09b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:16.291277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20aa42-5f99-4f18-90af-327bfe27b09b admin admin] PATH_INFO: `/v3/users/273883670cda476eabc51aee239a83b0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:16.292726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20aa42-5f99-4f18-90af-327bfe27b09b admin admin] RBAC: Authorizing `identity:delete_user(user_id=273883670cda476eabc51aee239a83b0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:16.294788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20aa42-5f99-4f18-90af-327bfe27b09b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:16.345590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8a20aa42-5f99-4f18-90af-327bfe27b09b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '273883670cda476eabc51aee239a83b0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:16.347946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b4eb6-a86d-4530-83cd-57e45c02e2c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:16.348696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b4eb6-a86d-4530-83cd-57e45c02e2c5 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:16.349207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b4eb6-a86d-4530-83cd-57e45c02e2c5 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:16.349586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b4eb6-a86d-4530-83cd-57e45c02e2c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:16.351662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4a7b4eb6-a86d-4530-83cd-57e45c02e2c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:16.352928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8a20aa42-5f99-4f18-90af-327bfe27b09b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '273883670cda476eabc51aee239a83b0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:16.367646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8a20aa42-5f99-4f18-90af-327bfe27b09b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '273883670cda476eabc51aee239a83b0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:16.368510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8a20aa42-5f99-4f18-90af-327bfe27b09b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '273883670cda476eabc51aee239a83b0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:16.379169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8a20aa42-5f99-4f18-90af-327bfe27b09b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '273883670cda476eabc51aee239a83b0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:16.386430 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2064/4168] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:59:16 2021] DELETE /identity/v3/users/273883670cda476eabc51aee239a83b0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:59:16.387803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ece26-9239-4700-8de0-ff952b8c41cc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:16.388187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ece26-9239-4700-8de0-ff952b8c41cc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:16.388569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ece26-9239-4700-8de0-ff952b8c41cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:16.407782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fe1ece26-9239-4700-8de0-ff952b8c41cc None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:16.409363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fe1ece26-9239-4700-8de0-ff952b8c41cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:16.425935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b4eb6-a86d-4530-83cd-57e45c02e2c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:16.428217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b4eb6-a86d-4530-83cd-57e45c02e2c5 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:16.439765 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2105/4169] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:59:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:59:16.442494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85f844-429f-4dd6-9924-f2247db62c26 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:16.442952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85f844-429f-4dd6-9924-f2247db62c26 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:16.444127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85f844-429f-4dd6-9924-f2247db62c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:16.464591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-dc85f844-429f-4dd6-9924-f2247db62c26 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:16.466166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dc85f844-429f-4dd6-9924-f2247db62c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:16.503624 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2065/4170] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 20:59:16 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:16.538995 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2106/4171] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:16.547668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06571e6-e80f-4545-9c02-324ffaa3409a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:16.548005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06571e6-e80f-4545-9c02-324ffaa3409a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:16.548284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06571e6-e80f-4545-9c02-324ffaa3409a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:16.561528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85f844-429f-4dd6-9924-f2247db62c26 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:16.563457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dc85f844-429f-4dd6-9924-f2247db62c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:16.569404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e06571e6-e80f-4545-9c02-324ffaa3409a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:16.570699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e06571e6-e80f-4545-9c02-324ffaa3409a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:16.581580 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2066/4172] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:16.586388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06571e6-e80f-4545-9c02-324ffaa3409a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:16.597358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06571e6-e80f-4545-9c02-324ffaa3409a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:16.604773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbf7e3-b125-43d6-8935-33f4d411cfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:16.605721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbf7e3-b125-43d6-8935-33f4d411cfac admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:16.606625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbf7e3-b125-43d6-8935-33f4d411cfac admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:16.606625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbf7e3-b125-43d6-8935-33f4d411cfac admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:16.607540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbf7e3-b125-43d6-8935-33f4d411cfac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:59:16.608097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbf7e3-b125-43d6-8935-33f4d411cfac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:16.610619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbf7e3-b125-43d6-8935-33f4d411cfac admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:16.630003 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2067/4173] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:59:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:59:16.634694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbf7e3-b125-43d6-8935-33f4d411cfac admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:16.647387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbf7e3-b125-43d6-8935-33f4d411cfac admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:16.652777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32855aa1-fa22-4be2-a4dd-8b4cc5b7c0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:16.656228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32855aa1-fa22-4be2-a4dd-8b4cc5b7c0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:16.657539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32855aa1-fa22-4be2-a4dd-8b4cc5b7c0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:16.658419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32855aa1-fa22-4be2-a4dd-8b4cc5b7c0f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:16.659333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32855aa1-fa22-4be2-a4dd-8b4cc5b7c0f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:16.661563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32855aa1-fa22-4be2-a4dd-8b4cc5b7c0f5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:16.662305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85f844-429f-4dd6-9924-f2247db62c26 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:16.667553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b1759-3b32-4575-9036-274ea92039b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:16.668356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b1759-3b32-4575-9036-274ea92039b6 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:16.668642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b1759-3b32-4575-9036-274ea92039b6 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:16.668921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b1759-3b32-4575-9036-274ea92039b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:16.682869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b1759-3b32-4575-9036-274ea92039b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:16.684866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b1759-3b32-4575-9036-274ea92039b6 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:16.697184 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2107/4174] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 20:59:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 20:59:16.705392 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2068/4175] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:59:16 2021] POST /identity/v3/projects => generated 397 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:59:16.706463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b1759-3b32-4575-9036-274ea92039b6 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:16.718010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b1759-3b32-4575-9036-274ea92039b6 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:16.787069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f10769-2f6c-4daf-ba6e-cadcd07244e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:16.787830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f10769-2f6c-4daf-ba6e-cadcd07244e9 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:16.788207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f10769-2f6c-4daf-ba6e-cadcd07244e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:16.788556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f10769-2f6c-4daf-ba6e-cadcd07244e9 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:16.789422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f10769-2f6c-4daf-ba6e-cadcd07244e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:16.791558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f10769-2f6c-4daf-ba6e-cadcd07244e9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:16.816923 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2108/4176] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:59:16 2021] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:59:16.821216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32855aa1-fa22-4be2-a4dd-8b4cc5b7c0f5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:16.835268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32855aa1-fa22-4be2-a4dd-8b4cc5b7c0f5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:16.841925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceec194-6673-49af-a486-864764c07c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:16.842690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceec194-6673-49af-a486-864764c07c90 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:16.842980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceec194-6673-49af-a486-864764c07c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:16.843266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceec194-6673-49af-a486-864764c07c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:16.844571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceec194-6673-49af-a486-864764c07c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:16.846563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceec194-6673-49af-a486-864764c07c90 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:16.860108 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2069/4177] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:59:16 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:59:16.861507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f10769-2f6c-4daf-ba6e-cadcd07244e9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:16.884953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f10769-2f6c-4daf-ba6e-cadcd07244e9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:16.895068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416e9a3-5af1-4e75-8bfa-53182f5c51ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:16.895759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416e9a3-5af1-4e75-8bfa-53182f5c51ae admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:16.896050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416e9a3-5af1-4e75-8bfa-53182f5c51ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:16.896861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416e9a3-5af1-4e75-8bfa-53182f5c51ae admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:16.897607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416e9a3-5af1-4e75-8bfa-53182f5c51ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:16.899278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416e9a3-5af1-4e75-8bfa-53182f5c51ae admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:16.916026 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2109/4178] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:59:16 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:59:16.921419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceec194-6673-49af-a486-864764c07c90 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:16.936752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceec194-6673-49af-a486-864764c07c90 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:16.947872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46adc6-0318-4127-b795-a3df63ef5b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:16.948965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46adc6-0318-4127-b795-a3df63ef5b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:16.949282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46adc6-0318-4127-b795-a3df63ef5b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:16.951343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46adc6-0318-4127-b795-a3df63ef5b64 admin admin] PATH_INFO: `/v3/projects/80e8efe6135e41a689caf483b2c72af1/users/bc32317ed5e54f67b8ae64f92419bcc0/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:16.986173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46adc6-0318-4127-b795-a3df63ef5b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e8efe6135e41a689caf483b2c72af1, user_id=bc32317ed5e54f67b8ae64f92419bcc0, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:16.989088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46adc6-0318-4127-b795-a3df63ef5b64 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:17.010492 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2070/4179] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:59:16 2021] PUT /identity/v3/projects/80e8efe6135e41a689caf483b2c72af1/users/bc32317ed5e54f67b8ae64f92419bcc0/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:59:17.012178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416e9a3-5af1-4e75-8bfa-53182f5c51ae admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:17.014402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6416e9a3-5af1-4e75-8bfa-53182f5c51ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:17.020172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1192107-13de-4336-ae00-c096d3a66af5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:17.020634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1192107-13de-4336-ae00-c096d3a66af5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:17.021018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1192107-13de-4336-ae00-c096d3a66af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:17.041064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416e9a3-5af1-4e75-8bfa-53182f5c51ae admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:17.047329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a1192107-13de-4336-ae00-c096d3a66af5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:17.049063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a1192107-13de-4336-ae00-c096d3a66af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:17.159635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87a218-9e19-4a2a-8369-63e1a63471df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:17.160585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87a218-9e19-4a2a-8369-63e1a63471df admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:17.163835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87a218-9e19-4a2a-8369-63e1a63471df admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:17.163835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87a218-9e19-4a2a-8369-63e1a63471df admin admin] PATH_INFO: `/v3/projects/0e0664b3fb0447f5824877d2dc2c2113` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:17.164103 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2071/4180] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:17.164219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87a218-9e19-4a2a-8369-63e1a63471df admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0664b3fb0447f5824877d2dc2c2113)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:17.168922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87a218-9e19-4a2a-8369-63e1a63471df admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:17.172360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1192107-13de-4336-ae00-c096d3a66af5 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:17.174044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a1192107-13de-4336-ae00-c096d3a66af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:17.236260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3c87a218-9e19-4a2a-8369-63e1a63471df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0664b3fb0447f5824877d2dc2c2113', 'request_id': 'req-3c87a218-9e19-4a2a-8369-63e1a63471df'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:17.244004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3c87a218-9e19-4a2a-8369-63e1a63471df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0664b3fb0447f5824877d2dc2c2113', 'request_id': 'req-3c87a218-9e19-4a2a-8369-63e1a63471df'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:17.257417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3c87a218-9e19-4a2a-8369-63e1a63471df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0664b3fb0447f5824877d2dc2c2113', 'request_id': 'req-3c87a218-9e19-4a2a-8369-63e1a63471df'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:17.289535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3c87a218-9e19-4a2a-8369-63e1a63471df admin admin] The token cache is being invalidate because project 0e0664b3fb0447f5824877d2dc2c2113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:59:17.289935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3c87a218-9e19-4a2a-8369-63e1a63471df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:17.292398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3c87a218-9e19-4a2a-8369-63e1a63471df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:17.295001 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2110/4181] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:17 2021] DELETE /identity/v3/projects/0e0664b3fb0447f5824877d2dc2c2113 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:59:17.301194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41410f78-184c-4283-bb82-c44aa0e7c0b9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:17.301789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41410f78-184c-4283-bb82-c44aa0e7c0b9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:17.302227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41410f78-184c-4283-bb82-c44aa0e7c0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:17.304367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1192107-13de-4336-ae00-c096d3a66af5 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:17.326503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-41410f78-184c-4283-bb82-c44aa0e7c0b9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:17.327788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-41410f78-184c-4283-bb82-c44aa0e7c0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:17.401099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc98ce-aff9-4f15-b29b-11bb004a5cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:17.402344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc98ce-aff9-4f15-b29b-11bb004a5cfc service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:17.402786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc98ce-aff9-4f15-b29b-11bb004a5cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:17.403345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc98ce-aff9-4f15-b29b-11bb004a5cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:17.405841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c4bc98ce-aff9-4f15-b29b-11bb004a5cfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:17.421098 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2111/4182] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:17.423039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f586ef-d3b6-480b-929c-08076fac1c4e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:17.423358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f586ef-d3b6-480b-929c-08076fac1c4e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:17.423639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f586ef-d3b6-480b-929c-08076fac1c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:17.427331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc98ce-aff9-4f15-b29b-11bb004a5cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:17.429147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc98ce-aff9-4f15-b29b-11bb004a5cfc service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:17.445094 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2072/4183] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:59:17.451509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-44f586ef-d3b6-480b-929c-08076fac1c4e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:17.453247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-44f586ef-d3b6-480b-929c-08076fac1c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:17.465210 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2112/4184] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:17.471161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc98ce-aff9-4f15-b29b-11bb004a5cfc service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:17.485512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc98ce-aff9-4f15-b29b-11bb004a5cfc service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:17.493801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab095a5c-23c0-4760-8d8e-418ad4c189d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:17.495158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab095a5c-23c0-4760-8d8e-418ad4c189d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:17.496328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab095a5c-23c0-4760-8d8e-418ad4c189d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:17.496892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab095a5c-23c0-4760-8d8e-418ad4c189d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:17.497784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab095a5c-23c0-4760-8d8e-418ad4c189d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:59:17.498201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab095a5c-23c0-4760-8d8e-418ad4c189d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:17.500615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab095a5c-23c0-4760-8d8e-418ad4c189d0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:17.526815 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2073/4185] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:59:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:59:17.527889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f586ef-d3b6-480b-929c-08076fac1c4e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:17.540108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f586ef-d3b6-480b-929c-08076fac1c4e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:17.545825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c2687-6d10-423c-addf-5274185eb51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:17.547138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c2687-6d10-423c-addf-5274185eb51a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:17.547723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c2687-6d10-423c-addf-5274185eb51a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:17.551078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c2687-6d10-423c-addf-5274185eb51a admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:17.551871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c2687-6d10-423c-addf-5274185eb51a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:17.553931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c2687-6d10-423c-addf-5274185eb51a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:17.591759 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2113/4186] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:59:17 2021] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:59:17.596467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab095a5c-23c0-4760-8d8e-418ad4c189d0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:17.613255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab095a5c-23c0-4760-8d8e-418ad4c189d0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:17.699621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826cdac-b9e9-4c3b-a730-354c8eba9c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:17.700492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826cdac-b9e9-4c3b-a730-354c8eba9c99 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:17.700818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826cdac-b9e9-4c3b-a730-354c8eba9c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:17.701100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826cdac-b9e9-4c3b-a730-354c8eba9c99 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:17.704404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826cdac-b9e9-4c3b-a730-354c8eba9c99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:17.709145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826cdac-b9e9-4c3b-a730-354c8eba9c99 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:17.730065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e237c35-bf15-4e0f-bf87-90461475ee34 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:17.730405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e237c35-bf15-4e0f-bf87-90461475ee34 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:17.730665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e237c35-bf15-4e0f-bf87-90461475ee34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:17.768512 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2074/4187] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:59:17 2021] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:59:17.773362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826cdac-b9e9-4c3b-a730-354c8eba9c99 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:17.793794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3e237c35-bf15-4e0f-bf87-90461475ee34 None None] MFA Rules not processed for user `4196dd207ce543d3bdd5f48ae57e156a`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:17.794866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826cdac-b9e9-4c3b-a730-354c8eba9c99 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:17.795289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3e237c35-bf15-4e0f-bf87-90461475ee34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:17.808888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092ba4a-b1e5-4c39-a798-d198d21eafe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:17.809981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092ba4a-b1e5-4c39-a798-d198d21eafe6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:17.810477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092ba4a-b1e5-4c39-a798-d198d21eafe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:17.810913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092ba4a-b1e5-4c39-a798-d198d21eafe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:17.811874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092ba4a-b1e5-4c39-a798-d198d21eafe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:17.814875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092ba4a-b1e5-4c39-a798-d198d21eafe6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:17.842230 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2075/4188] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:59:17.846486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092ba4a-b1e5-4c39-a798-d198d21eafe6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:17.863137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092ba4a-b1e5-4c39-a798-d198d21eafe6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:17.881427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d9e45-1070-414d-9327-23c91846ba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:17.882108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d9e45-1070-414d-9327-23c91846ba81 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:17.882488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d9e45-1070-414d-9327-23c91846ba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:17.882835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d9e45-1070-414d-9327-23c91846ba81 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:17.883758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d9e45-1070-414d-9327-23c91846ba81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:17.885473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d9e45-1070-414d-9327-23c91846ba81 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:17.911911 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2076/4189] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:59:17.912897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d9e45-1070-414d-9327-23c91846ba81 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:17.918001 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2114/4190] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:17 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:17.920444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4aec9c-8278-4176-a40d-f2b6b564dd5c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:17.925001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4aec9c-8278-4176-a40d-f2b6b564dd5c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:17.925295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4aec9c-8278-4176-a40d-f2b6b564dd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:17.936806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d9e45-1070-414d-9327-23c91846ba81 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:17.950231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63f18f-840c-4ef1-bf5c-9f2f231146a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:17.951420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63f18f-840c-4ef1-bf5c-9f2f231146a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:17.951938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63f18f-840c-4ef1-bf5c-9f2f231146a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:17.953106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63f18f-840c-4ef1-bf5c-9f2f231146a0 admin admin] PATH_INFO: `/v3/projects/837eada96b154829af977e9e1e78f28f/users/cdd1c467298d42acb167a7d3506ad36f/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:17.960152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bb4aec9c-8278-4176-a40d-f2b6b564dd5c None None] MFA Rules not processed for user `4196dd207ce543d3bdd5f48ae57e156a`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:17.963586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bb4aec9c-8278-4176-a40d-f2b6b564dd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:17.972404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63f18f-840c-4ef1-bf5c-9f2f231146a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=837eada96b154829af977e9e1e78f28f, user_id=cdd1c467298d42acb167a7d3506ad36f, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:17.975862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63f18f-840c-4ef1-bf5c-9f2f231146a0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:17.986451 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2115/4191] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:17 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:17.998708 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2077/4192] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:59:17 2021] PUT /identity/v3/projects/837eada96b154829af977e9e1e78f28f/users/cdd1c467298d42acb167a7d3506ad36f/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:59:18.003586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b0cca-82fe-45dd-b9ec-1ea9b8a608cf None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:18.003872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b0cca-82fe-45dd-b9ec-1ea9b8a608cf None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:18.004300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b0cca-82fe-45dd-b9ec-1ea9b8a608cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:18.035291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8b2b0cca-82fe-45dd-b9ec-1ea9b8a608cf None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:18.036500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8b2b0cca-82fe-45dd-b9ec-1ea9b8a608cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:18.127826 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2116/4193] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:18.148327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63f18f-840c-4ef1-bf5c-9f2f231146a0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:18.150645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cd63f18f-840c-4ef1-bf5c-9f2f231146a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:18.252463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63f18f-840c-4ef1-bf5c-9f2f231146a0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:18.259819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773293f-b16d-46d9-9e03-08efdff85841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:18.261466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773293f-b16d-46d9-9e03-08efdff85841 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:18.261782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773293f-b16d-46d9-9e03-08efdff85841 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:18.262069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773293f-b16d-46d9-9e03-08efdff85841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:18.284807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444d657-e7dc-4e13-98ac-0eaf616af5f3 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:18.285231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444d657-e7dc-4e13-98ac-0eaf616af5f3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:18.285534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444d657-e7dc-4e13-98ac-0eaf616af5f3 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:18.288735 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2117/4194] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:59:18 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 20:59:18.297991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773293f-b16d-46d9-9e03-08efdff85841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:18.302162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5214481-0305-4ace-be62-ea71f71cec5c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:18.302495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5214481-0305-4ace-be62-ea71f71cec5c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:18.303188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5214481-0305-4ace-be62-ea71f71cec5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:18.311438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773293f-b16d-46d9-9e03-08efdff85841 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:18.342884 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2078/4195] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:59:18.378438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773293f-b16d-46d9-9e03-08efdff85841 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:18.381017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f773293f-b16d-46d9-9e03-08efdff85841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:18.413940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a5214481-0305-4ace-be62-ea71f71cec5c None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:18.417022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a5214481-0305-4ace-be62-ea71f71cec5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:18.498559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773293f-b16d-46d9-9e03-08efdff85841 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:18.507958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068e99f-de87-4936-a404-f8ad254a14cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:18.508675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068e99f-de87-4936-a404-f8ad254a14cb service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:18.508953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068e99f-de87-4936-a404-f8ad254a14cb service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:18.509397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068e99f-de87-4936-a404-f8ad254a14cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:18.532246 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2118/4196] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:59:18 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:59:18.578863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5214481-0305-4ace-be62-ea71f71cec5c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:18.581416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a5214481-0305-4ace-be62-ea71f71cec5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:18.595626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068e99f-de87-4936-a404-f8ad254a14cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:18.597238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068e99f-de87-4936-a404-f8ad254a14cb service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:18.597350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5214481-0305-4ace-be62-ea71f71cec5c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:18.603121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375b587-1661-4d63-8324-fa761c1d83fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:18.603600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375b587-1661-4d63-8324-fa761c1d83fe service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:18.603891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375b587-1661-4d63-8324-fa761c1d83fe service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:18.604172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375b587-1661-4d63-8324-fa761c1d83fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:18.613837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375b587-1661-4d63-8324-fa761c1d83fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:18.615696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375b587-1661-4d63-8324-fa761c1d83fe service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:18.620063 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2079/4197] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:18 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:59:18.622398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391df69-c037-415c-a3bf-7abf3e03080d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:18.622892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391df69-c037-415c-a3bf-7abf3e03080d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:18.623868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391df69-c037-415c-a3bf-7abf3e03080d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:18.627880 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2119/4198] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:18 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:59:18.664806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f391df69-c037-415c-a3bf-7abf3e03080d None None] MFA Rules not processed for user `bc32317ed5e54f67b8ae64f92419bcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:18.666389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f391df69-c037-415c-a3bf-7abf3e03080d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:18.803379 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2080/4199] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:18 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:18.806116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55bdd7-041e-4b59-afab-7527bcc32cfd None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:18.806610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55bdd7-041e-4b59-afab-7527bcc32cfd None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:18.806971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55bdd7-041e-4b59-afab-7527bcc32cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:18.832016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3a55bdd7-041e-4b59-afab-7527bcc32cfd None None] MFA Rules not processed for user `bc32317ed5e54f67b8ae64f92419bcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:18.833905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3a55bdd7-041e-4b59-afab-7527bcc32cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:18.849903 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2120/4200] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:18 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:59:19.198798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391df69-c037-415c-a3bf-7abf3e03080d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:19.208199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f391df69-c037-415c-a3bf-7abf3e03080d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:19.228820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391df69-c037-415c-a3bf-7abf3e03080d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:19.237121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a7e5e-a2f6-4271-87cb-fcb882054180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:19.237790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a7e5e-a2f6-4271-87cb-fcb882054180 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:19.238077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a7e5e-a2f6-4271-87cb-fcb882054180 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:19.238397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a7e5e-a2f6-4271-87cb-fcb882054180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:19.247216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a7e5e-a2f6-4271-87cb-fcb882054180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:19.248935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a7e5e-a2f6-4271-87cb-fcb882054180 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:19.259759 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2081/4201] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:19 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:59:21.148120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55bdd7-041e-4b59-afab-7527bcc32cfd None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:21.149697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3a55bdd7-041e-4b59-afab-7527bcc32cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:21.168254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55bdd7-041e-4b59-afab-7527bcc32cfd None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:21.175914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2b68e-cd35-4ea1-9ed6-6f7c6c707d61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:21.177202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2b68e-cd35-4ea1-9ed6-6f7c6c707d61 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:21.177724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2b68e-cd35-4ea1-9ed6-6f7c6c707d61 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:21.178217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2b68e-cd35-4ea1-9ed6-6f7c6c707d61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:21.180620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-90e2b68e-cd35-4ea1-9ed6-6f7c6c707d61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:21.200025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2b68e-cd35-4ea1-9ed6-6f7c6c707d61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:21.201860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2b68e-cd35-4ea1-9ed6-6f7c6c707d61 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:21.241464 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2121/4202] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:21 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:59:22.086040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a7e5e-a2f6-4271-87cb-fcb882054180 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:22.087496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c11a7e5e-a2f6-4271-87cb-fcb882054180 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:22.114643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a7e5e-a2f6-4271-87cb-fcb882054180 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:22.157658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3afc2-e73f-4a23-8b13-b326327198a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:22.158585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3afc2-e73f-4a23-8b13-b326327198a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:22.158868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3afc2-e73f-4a23-8b13-b326327198a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:22.159147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3afc2-e73f-4a23-8b13-b326327198a1 admin admin] PATH_INFO: `/v3/users/932b394322e2458baa8e8057ca4a9c6a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:22.173998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3afc2-e73f-4a23-8b13-b326327198a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=932b394322e2458baa8e8057ca4a9c6a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:22.176005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3afc2-e73f-4a23-8b13-b326327198a1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:22.299522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-93d3afc2-e73f-4a23-8b13-b326327198a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932b394322e2458baa8e8057ca4a9c6a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:22.309492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-93d3afc2-e73f-4a23-8b13-b326327198a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932b394322e2458baa8e8057ca4a9c6a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:22.325138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-93d3afc2-e73f-4a23-8b13-b326327198a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932b394322e2458baa8e8057ca4a9c6a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:22.326170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-93d3afc2-e73f-4a23-8b13-b326327198a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932b394322e2458baa8e8057ca4a9c6a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:22.338610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-93d3afc2-e73f-4a23-8b13-b326327198a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932b394322e2458baa8e8057ca4a9c6a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:22.359084 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2082/4203] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:59:22 2021] DELETE /identity/v3/users/932b394322e2458baa8e8057ca4a9c6a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:59:22.363598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3c25b-2691-4fa4-a154-d28b199c632e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:22.364126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3c25b-2691-4fa4-a154-d28b199c632e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:22.364463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3c25b-2691-4fa4-a154-d28b199c632e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:22.389909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-08a3c25b-2691-4fa4-a154-d28b199c632e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:22.392318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-08a3c25b-2691-4fa4-a154-d28b199c632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:22.477294 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2122/4204] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:22.495821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3afc2-e73f-4a23-8b13-b326327198a1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:22.497937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-93d3afc2-e73f-4a23-8b13-b326327198a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:22.600033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3afc2-e73f-4a23-8b13-b326327198a1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:22.609367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976632b6-60fb-459e-8018-10fd948d634e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:22.612554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976632b6-60fb-459e-8018-10fd948d634e service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:22.612554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976632b6-60fb-459e-8018-10fd948d634e service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:22.612554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976632b6-60fb-459e-8018-10fd948d634e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:22.632446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976632b6-60fb-459e-8018-10fd948d634e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:22.646415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976632b6-60fb-459e-8018-10fd948d634e service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:22.657979 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2083/4205] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:59:23.175623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3c25b-2691-4fa4-a154-d28b199c632e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:23.177400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-08a3c25b-2691-4fa4-a154-d28b199c632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:23.192262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3c25b-2691-4fa4-a154-d28b199c632e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:23.198771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05095e09-9c90-4861-8261-90ee07c4dfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:23.200042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05095e09-9c90-4861-8261-90ee07c4dfe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:23.200558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05095e09-9c90-4861-8261-90ee07c4dfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:23.201051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05095e09-9c90-4861-8261-90ee07c4dfe6 admin admin] PATH_INFO: `/v3/projects/a4275f97662f4f3b8eed66d55e5f050b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:23.203182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05095e09-9c90-4861-8261-90ee07c4dfe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4275f97662f4f3b8eed66d55e5f050b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:23.205949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05095e09-9c90-4861-8261-90ee07c4dfe6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:23.275181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-05095e09-9c90-4861-8261-90ee07c4dfe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4275f97662f4f3b8eed66d55e5f050b', 'request_id': 'req-05095e09-9c90-4861-8261-90ee07c4dfe6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:23.291085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-05095e09-9c90-4861-8261-90ee07c4dfe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4275f97662f4f3b8eed66d55e5f050b', 'request_id': 'req-05095e09-9c90-4861-8261-90ee07c4dfe6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:23.303649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-05095e09-9c90-4861-8261-90ee07c4dfe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4275f97662f4f3b8eed66d55e5f050b', 'request_id': 'req-05095e09-9c90-4861-8261-90ee07c4dfe6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:23.317863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-05095e09-9c90-4861-8261-90ee07c4dfe6 admin admin] The token cache is being invalidate because project a4275f97662f4f3b8eed66d55e5f050b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:59:23.318306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-05095e09-9c90-4861-8261-90ee07c4dfe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:23.319085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-05095e09-9c90-4861-8261-90ee07c4dfe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:23.320857 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2123/4206] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:23 2021] DELETE /identity/v3/projects/a4275f97662f4f3b8eed66d55e5f050b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:59:23.326631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e880a-20d5-4e7f-b0f7-f9357e681a6b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:23.327144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e880a-20d5-4e7f-b0f7-f9357e681a6b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:23.327226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e880a-20d5-4e7f-b0f7-f9357e681a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:23.354227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6d6e880a-20d5-4e7f-b0f7-f9357e681a6b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:23.355458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6d6e880a-20d5-4e7f-b0f7-f9357e681a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:23.443957 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2084/4207] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:23.445732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d2fa1-e0dc-4a4e-acb1-8ad57316caa2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:23.446569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d2fa1-e0dc-4a4e-acb1-8ad57316caa2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:23.446871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d2fa1-e0dc-4a4e-acb1-8ad57316caa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:23.491344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-269d2fa1-e0dc-4a4e-acb1-8ad57316caa2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:23.494620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-269d2fa1-e0dc-4a4e-acb1-8ad57316caa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:23.514985 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2124/4208] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:23.520086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e880a-20d5-4e7f-b0f7-f9357e681a6b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:23.533419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e880a-20d5-4e7f-b0f7-f9357e681a6b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:23.544979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13fe64-2de2-46f7-8417-6ca0900bbe7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:23.545771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13fe64-2de2-46f7-8417-6ca0900bbe7d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:23.546233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13fe64-2de2-46f7-8417-6ca0900bbe7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:23.546456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13fe64-2de2-46f7-8417-6ca0900bbe7d admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:23.547891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13fe64-2de2-46f7-8417-6ca0900bbe7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:59:23.548205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13fe64-2de2-46f7-8417-6ca0900bbe7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:23.551070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13fe64-2de2-46f7-8417-6ca0900bbe7d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:23.569522 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2085/4209] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:59:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:59:23.572373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d2fa1-e0dc-4a4e-acb1-8ad57316caa2 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:23.584305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d2fa1-e0dc-4a4e-acb1-8ad57316caa2 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:23.591331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498cbbf-76c5-4dc1-807e-764287403d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:23.592465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498cbbf-76c5-4dc1-807e-764287403d10 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:23.592961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498cbbf-76c5-4dc1-807e-764287403d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:23.593457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498cbbf-76c5-4dc1-807e-764287403d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:23.595772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498cbbf-76c5-4dc1-807e-764287403d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:23.598444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498cbbf-76c5-4dc1-807e-764287403d10 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:23.642546 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2125/4210] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:59:23 2021] POST /identity/v3/projects => generated 387 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:59:23.646047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13fe64-2de2-46f7-8417-6ca0900bbe7d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:23.662621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13fe64-2de2-46f7-8417-6ca0900bbe7d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:23.790542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f839490-36ef-485e-abb7-e678569a0550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:23.792496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f839490-36ef-485e-abb7-e678569a0550 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:23.792675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f839490-36ef-485e-abb7-e678569a0550 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:23.792950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f839490-36ef-485e-abb7-e678569a0550 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:23.794445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f839490-36ef-485e-abb7-e678569a0550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:23.796850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f839490-36ef-485e-abb7-e678569a0550 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:23.841538 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2086/4211] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:59:23 2021] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:59:23.846892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498cbbf-76c5-4dc1-807e-764287403d10 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:23.863724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498cbbf-76c5-4dc1-807e-764287403d10 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:23.905422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52385fac-efae-4f6d-9cc3-3e31705ade6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:23.906727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52385fac-efae-4f6d-9cc3-3e31705ade6d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:23.907272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52385fac-efae-4f6d-9cc3-3e31705ade6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:23.907630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52385fac-efae-4f6d-9cc3-3e31705ade6d admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:23.908633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52385fac-efae-4f6d-9cc3-3e31705ade6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:23.910441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52385fac-efae-4f6d-9cc3-3e31705ade6d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:23.945536 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2126/4212] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:59:23 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:59:23.951151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f839490-36ef-485e-abb7-e678569a0550 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:23.971637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f839490-36ef-485e-abb7-e678569a0550 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:23.980930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37079d5-2171-4086-a74b-0fab631034ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:23.982926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37079d5-2171-4086-a74b-0fab631034ef admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:23.991658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37079d5-2171-4086-a74b-0fab631034ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:23.991975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37079d5-2171-4086-a74b-0fab631034ef admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:23.998551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37079d5-2171-4086-a74b-0fab631034ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:24.003993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37079d5-2171-4086-a74b-0fab631034ef admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:24.034503 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2087/4213] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:59:23 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:59:24.038449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52385fac-efae-4f6d-9cc3-3e31705ade6d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:24.052831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52385fac-efae-4f6d-9cc3-3e31705ade6d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:24.061047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089b561-6752-4c27-ba6e-e5287d7ad3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:24.063181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089b561-6752-4c27-ba6e-e5287d7ad3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:24.063695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089b561-6752-4c27-ba6e-e5287d7ad3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:24.064208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089b561-6752-4c27-ba6e-e5287d7ad3b1 admin admin] PATH_INFO: `/v3/projects/f5cbfde46f9542c6bedb0a8694ffa835/users/92e080152fae4c958af527057fe72fed/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:24.087046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089b561-6752-4c27-ba6e-e5287d7ad3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5cbfde46f9542c6bedb0a8694ffa835, user_id=92e080152fae4c958af527057fe72fed, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:24.093056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089b561-6752-4c27-ba6e-e5287d7ad3b1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:24.116085 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2127/4214] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:59:24 2021] PUT /identity/v3/projects/f5cbfde46f9542c6bedb0a8694ffa835/users/92e080152fae4c958af527057fe72fed/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:59:24.121103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd9dec-6269-4568-a4ac-d387d01d165d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:24.121408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd9dec-6269-4568-a4ac-d387d01d165d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:24.121696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd9dec-6269-4568-a4ac-d387d01d165d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:24.146045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-31cd9dec-6269-4568-a4ac-d387d01d165d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:24.147702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-31cd9dec-6269-4568-a4ac-d387d01d165d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:24.231496 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2088/4215] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:24.280441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089b561-6752-4c27-ba6e-e5287d7ad3b1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:24.282798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1089b561-6752-4c27-ba6e-e5287d7ad3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:24.387082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089b561-6752-4c27-ba6e-e5287d7ad3b1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:24.399902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d9ab5-7b8b-4f6f-9a33-aa09834b0ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:24.400763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d9ab5-7b8b-4f6f-9a33-aa09834b0ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:24.414959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d9ab5-7b8b-4f6f-9a33-aa09834b0ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:24.415366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d9ab5-7b8b-4f6f-9a33-aa09834b0ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:24.457892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d9ab5-7b8b-4f6f-9a33-aa09834b0ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:24.462717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d9ab5-7b8b-4f6f-9a33-aa09834b0ea9 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:24.489951 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2128/4216] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:59:27.085259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76841b96-0048-4f28-8fb3-19780e27de9f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:27.085738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76841b96-0048-4f28-8fb3-19780e27de9f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:27.085831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76841b96-0048-4f28-8fb3-19780e27de9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:27.136273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-76841b96-0048-4f28-8fb3-19780e27de9f None None] MFA Rules not processed for user `92e080152fae4c958af527057fe72fed`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:27.137498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-76841b96-0048-4f28-8fb3-19780e27de9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:27.266418 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2089/4217] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:27 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:27.628047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d9ab5-7b8b-4f6f-9a33-aa09834b0ea9 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:27.632178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-155d9ab5-7b8b-4f6f-9a33-aa09834b0ea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:27.798296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d9ab5-7b8b-4f6f-9a33-aa09834b0ea9 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:27.820829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e478ae-bb31-444a-abc5-c22566e72f96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:27.821767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e478ae-bb31-444a-abc5-c22566e72f96 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:27.822383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e478ae-bb31-444a-abc5-c22566e72f96 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:27.822816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e478ae-bb31-444a-abc5-c22566e72f96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:27.852725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e478ae-bb31-444a-abc5-c22566e72f96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:27.854415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e478ae-bb31-444a-abc5-c22566e72f96 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:27.877164 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2129/4218] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:27 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:59:28.306506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edd42d-4f34-4839-8387-5b1715a7d647 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:28.307096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edd42d-4f34-4839-8387-5b1715a7d647 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:28.307096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edd42d-4f34-4839-8387-5b1715a7d647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:28.386578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-61edd42d-4f34-4839-8387-5b1715a7d647 None None] MFA Rules not processed for user `cdd1c467298d42acb167a7d3506ad36f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:28.387806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-61edd42d-4f34-4839-8387-5b1715a7d647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:28.530299 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2090/4219] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:28 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:28.533202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e478ae-bb31-444a-abc5-c22566e72f96 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:28.534960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-05e478ae-bb31-444a-abc5-c22566e72f96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:28.571124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e478ae-bb31-444a-abc5-c22566e72f96 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:28.576980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9de0bc-b44c-48c3-9309-2d7ae4466b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:28.577767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9de0bc-b44c-48c3-9309-2d7ae4466b50 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:28.578102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9de0bc-b44c-48c3-9309-2d7ae4466b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:28.578487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9de0bc-b44c-48c3-9309-2d7ae4466b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:28.579293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9de0bc-b44c-48c3-9309-2d7ae4466b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:28.581614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9de0bc-b44c-48c3-9309-2d7ae4466b50 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:28.628576 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2130/4220] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:59:28 2021] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:59:28.632700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edd42d-4f34-4839-8387-5b1715a7d647 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:28.653835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edd42d-4f34-4839-8387-5b1715a7d647 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:28.807511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83817b-4fa8-4c5e-8e79-7fd4a5aa880e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:28.808906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83817b-4fa8-4c5e-8e79-7fd4a5aa880e admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:28.809293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83817b-4fa8-4c5e-8e79-7fd4a5aa880e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:28.812341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83817b-4fa8-4c5e-8e79-7fd4a5aa880e admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:28.812341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83817b-4fa8-4c5e-8e79-7fd4a5aa880e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:28.818814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83817b-4fa8-4c5e-8e79-7fd4a5aa880e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:28.895404 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2091/4221] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:59:28 2021] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:59:28.896514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9de0bc-b44c-48c3-9309-2d7ae4466b50 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:28.916437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9de0bc-b44c-48c3-9309-2d7ae4466b50 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:28.939272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42a1b1-f338-4a20-9d22-251fa9f5f0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:28.940824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42a1b1-f338-4a20-9d22-251fa9f5f0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:28.941268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42a1b1-f338-4a20-9d22-251fa9f5f0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:28.941738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42a1b1-f338-4a20-9d22-251fa9f5f0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:28.942709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42a1b1-f338-4a20-9d22-251fa9f5f0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:28.944655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42a1b1-f338-4a20-9d22-251fa9f5f0c6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:28.992117 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2131/4222] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:59:28 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:59:28.996888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83817b-4fa8-4c5e-8e79-7fd4a5aa880e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:29.031850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83817b-4fa8-4c5e-8e79-7fd4a5aa880e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:29.044754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b459c83-d901-45bf-b27a-bc30f44eee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:29.045863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459c83-d901-45bf-b27a-bc30f44eee0d admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:29.046220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459c83-d901-45bf-b27a-bc30f44eee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:29.047048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459c83-d901-45bf-b27a-bc30f44eee0d admin admin] PATH_INFO: `/v3/projects/75c84e493553475aa1781e3e9528e50a/users/864d0556412b4165a129dc1c69c68d44/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:29.072399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b459c83-d901-45bf-b27a-bc30f44eee0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c84e493553475aa1781e3e9528e50a, user_id=864d0556412b4165a129dc1c69c68d44, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:29.075785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b459c83-d901-45bf-b27a-bc30f44eee0d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:29.103846 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2092/4223] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:59:28 2021] PUT /identity/v3/projects/75c84e493553475aa1781e3e9528e50a/users/864d0556412b4165a129dc1c69c68d44/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:59:29.108215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42a1b1-f338-4a20-9d22-251fa9f5f0c6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:29.122612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42a1b1-f338-4a20-9d22-251fa9f5f0c6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:29.204334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5dfe8-1cd0-4809-bace-44ea17e50d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:29.205083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5dfe8-1cd0-4809-bace-44ea17e50d82 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:29.205360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5dfe8-1cd0-4809-bace-44ea17e50d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:29.205644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5dfe8-1cd0-4809-bace-44ea17e50d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:29.206499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5dfe8-1cd0-4809-bace-44ea17e50d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:29.208450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5dfe8-1cd0-4809-bace-44ea17e50d82 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:29.226619 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2132/4224] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:59:29 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:59:29.228247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b459c83-d901-45bf-b27a-bc30f44eee0d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:29.243833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b459c83-d901-45bf-b27a-bc30f44eee0d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:29.253584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40640058-0d22-485f-b8e1-ae79a93c2e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:29.254691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40640058-0d22-485f-b8e1-ae79a93c2e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:29.255052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40640058-0d22-485f-b8e1-ae79a93c2e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:29.255410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40640058-0d22-485f-b8e1-ae79a93c2e88 admin admin] PATH_INFO: `/v3/projects/75c84e493553475aa1781e3e9528e50a/users/864d0556412b4165a129dc1c69c68d44/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:29.258476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40640058-0d22-485f-b8e1-ae79a93c2e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c84e493553475aa1781e3e9528e50a, user_id=864d0556412b4165a129dc1c69c68d44, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:29.263388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40640058-0d22-485f-b8e1-ae79a93c2e88 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:29.315796 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2093/4225] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:59:29 2021] PUT /identity/v3/projects/75c84e493553475aa1781e3e9528e50a/users/864d0556412b4165a129dc1c69c68d44/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:59:35.048456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5dfe8-1cd0-4809-bace-44ea17e50d82 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:35.056603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-07b5dfe8-1cd0-4809-bace-44ea17e50d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:35.291146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5dfe8-1cd0-4809-bace-44ea17e50d82 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:35.390195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6aee3-3e09-4018-a59e-5db8c6498ba0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:35.391645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6aee3-3e09-4018-a59e-5db8c6498ba0 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:35.392022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6aee3-3e09-4018-a59e-5db8c6498ba0 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:35.392364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6aee3-3e09-4018-a59e-5db8c6498ba0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:35.394461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-52e6aee3-3e09-4018-a59e-5db8c6498ba0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:35.407464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6aee3-3e09-4018-a59e-5db8c6498ba0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:35.410190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6aee3-3e09-4018-a59e-5db8c6498ba0 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:35.422693 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2133/4226] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:35 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:59:36.501183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f978a2-34ca-4772-8344-7dae32f6750b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:36.502968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f978a2-34ca-4772-8344-7dae32f6750b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:36.503495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f978a2-34ca-4772-8344-7dae32f6750b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:36.540512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e3f978a2-34ca-4772-8344-7dae32f6750b None None] MFA Rules not processed for user `864d0556412b4165a129dc1c69c68d44`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:36.542079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e3f978a2-34ca-4772-8344-7dae32f6750b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:36.643794 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2094/4227] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:36 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:36.780292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6aee3-3e09-4018-a59e-5db8c6498ba0 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:36.857019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6aee3-3e09-4018-a59e-5db8c6498ba0 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:36.866687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47317740-fd6f-42a8-b2e8-c302f5b95be4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:36.867585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47317740-fd6f-42a8-b2e8-c302f5b95be4 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:36.868673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47317740-fd6f-42a8-b2e8-c302f5b95be4 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:36.869115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47317740-fd6f-42a8-b2e8-c302f5b95be4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:36.881206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47317740-fd6f-42a8-b2e8-c302f5b95be4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:36.884036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47317740-fd6f-42a8-b2e8-c302f5b95be4 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:36.897345 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2134/4228] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:36 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:59:36.985012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa47c93-20ad-46e7-aca0-6cdd17a823c1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:36.985302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa47c93-20ad-46e7-aca0-6cdd17a823c1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:36.985587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa47c93-20ad-46e7-aca0-6cdd17a823c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:37.023354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9fa47c93-20ad-46e7-aca0-6cdd17a823c1 None None] MFA Rules not processed for user `cdd1c467298d42acb167a7d3506ad36f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:37.028858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9fa47c93-20ad-46e7-aca0-6cdd17a823c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:37.129825 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2095/4229] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:36 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:38.936856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47317740-fd6f-42a8-b2e8-c302f5b95be4 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:39.123402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47317740-fd6f-42a8-b2e8-c302f5b95be4 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:39.130042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6c160-2055-4446-96c0-9514e11653e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:39.131290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6c160-2055-4446-96c0-9514e11653e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:39.131764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6c160-2055-4446-96c0-9514e11653e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:39.132473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6c160-2055-4446-96c0-9514e11653e5 admin admin] PATH_INFO: `/v3/users/92e080152fae4c958af527057fe72fed` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:39.135834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6c160-2055-4446-96c0-9514e11653e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92e080152fae4c958af527057fe72fed)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:39.138964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6c160-2055-4446-96c0-9514e11653e5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:39.245811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-92d6c160-2055-4446-96c0-9514e11653e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92e080152fae4c958af527057fe72fed'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:39.255347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-92d6c160-2055-4446-96c0-9514e11653e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92e080152fae4c958af527057fe72fed'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:39.256577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-92d6c160-2055-4446-96c0-9514e11653e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92e080152fae4c958af527057fe72fed'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:39.272175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-92d6c160-2055-4446-96c0-9514e11653e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92e080152fae4c958af527057fe72fed'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:39.289884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-92d6c160-2055-4446-96c0-9514e11653e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92e080152fae4c958af527057fe72fed'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:39.311651 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2135/4230] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:59:38 2021] DELETE /identity/v3/users/92e080152fae4c958af527057fe72fed => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:59:39.696084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51317c5e-564d-4118-877b-5d0f0891917b None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:39.696632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51317c5e-564d-4118-877b-5d0f0891917b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:39.696632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51317c5e-564d-4118-877b-5d0f0891917b None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:39.698471 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2096/4231] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 20:59:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 20:59:39.726980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fedc80-93eb-4dc1-b954-fe6527a1ca80 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:39.728388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fedc80-93eb-4dc1-b954-fe6527a1ca80 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:39.728959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fedc80-93eb-4dc1-b954-fe6527a1ca80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:39.825486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f8fedc80-93eb-4dc1-b954-fe6527a1ca80 None None] MFA Rules not processed for user `6f8eeb55c523480fb45d4bbb8afe8e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:39.828960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f8fedc80-93eb-4dc1-b954-fe6527a1ca80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:39.996714 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2136/4232] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 20:59:39 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:40.027329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51317c5e-564d-4118-877b-5d0f0891917b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:40.033914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-51317c5e-564d-4118-877b-5d0f0891917b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:40.054547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fedc80-93eb-4dc1-b954-fe6527a1ca80 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:40.056879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f8fedc80-93eb-4dc1-b954-fe6527a1ca80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:40.080161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fedc80-93eb-4dc1-b954-fe6527a1ca80 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:40.101742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a9e58-b9f6-436b-ba56-6d6e74120232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:40.104445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a9e58-b9f6-436b-ba56-6d6e74120232 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:40.108737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a9e58-b9f6-436b-ba56-6d6e74120232 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:40.109551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a9e58-b9f6-436b-ba56-6d6e74120232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:40.135172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a9e58-b9f6-436b-ba56-6d6e74120232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:40.151294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a9e58-b9f6-436b-ba56-6d6e74120232 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:40.173801 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2137/4233] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:40 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:59:40.392162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51317c5e-564d-4118-877b-5d0f0891917b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:40.399780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc19916-4ab9-4715-9887-e9f74e99708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:40.401885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc19916-4ab9-4715-9887-e9f74e99708e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:40.402569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc19916-4ab9-4715-9887-e9f74e99708e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:40.403060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc19916-4ab9-4715-9887-e9f74e99708e admin admin] PATH_INFO: `/v3/projects/f5cbfde46f9542c6bedb0a8694ffa835` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:40.406409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc19916-4ab9-4715-9887-e9f74e99708e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5cbfde46f9542c6bedb0a8694ffa835)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:40.408543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc19916-4ab9-4715-9887-e9f74e99708e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:40.538685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1fc19916-4ab9-4715-9887-e9f74e99708e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5cbfde46f9542c6bedb0a8694ffa835', 'request_id': 'req-1fc19916-4ab9-4715-9887-e9f74e99708e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:40.550949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1fc19916-4ab9-4715-9887-e9f74e99708e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5cbfde46f9542c6bedb0a8694ffa835', 'request_id': 'req-1fc19916-4ab9-4715-9887-e9f74e99708e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:40.566855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1fc19916-4ab9-4715-9887-e9f74e99708e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5cbfde46f9542c6bedb0a8694ffa835', 'request_id': 'req-1fc19916-4ab9-4715-9887-e9f74e99708e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:40.587139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1fc19916-4ab9-4715-9887-e9f74e99708e admin admin] The token cache is being invalidate because project f5cbfde46f9542c6bedb0a8694ffa835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:59:40.589347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1fc19916-4ab9-4715-9887-e9f74e99708e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:40.590763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1fc19916-4ab9-4715-9887-e9f74e99708e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:40.594332 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2097/4234] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:40 2021] DELETE /identity/v3/projects/f5cbfde46f9542c6bedb0a8694ffa835 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:59:40.600717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079703b-2f20-4546-9a58-6cbab14a0314 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:40.601006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079703b-2f20-4546-9a58-6cbab14a0314 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:40.601285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079703b-2f20-4546-9a58-6cbab14a0314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:40.620461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0079703b-2f20-4546-9a58-6cbab14a0314 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:40.622997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0079703b-2f20-4546-9a58-6cbab14a0314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:40.736665 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2138/4235] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:40.742373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bcdd8-b014-40d4-bc5f-4668ba40698e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:40.743479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bcdd8-b014-40d4-bc5f-4668ba40698e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:40.743479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bcdd8-b014-40d4-bc5f-4668ba40698e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:40.824391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ab3bcdd8-b014-40d4-bc5f-4668ba40698e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:40.828655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ab3bcdd8-b014-40d4-bc5f-4668ba40698e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:40.879927 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2098/4236] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:40.885485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079703b-2f20-4546-9a58-6cbab14a0314 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:40.906276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079703b-2f20-4546-9a58-6cbab14a0314 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:40.938755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64154b2-186a-48a0-a124-ab43ade783b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:40.939809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64154b2-186a-48a0-a124-ab43ade783b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:40.940317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64154b2-186a-48a0-a124-ab43ade783b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:40.941056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64154b2-186a-48a0-a124-ab43ade783b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:40.942012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64154b2-186a-48a0-a124-ab43ade783b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:59:40.942724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64154b2-186a-48a0-a124-ab43ade783b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:40.945103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64154b2-186a-48a0-a124-ab43ade783b3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:40.959413 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2139/4237] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:59:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:59:40.964393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bcdd8-b014-40d4-bc5f-4668ba40698e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:40.975492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bcdd8-b014-40d4-bc5f-4668ba40698e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:40.981291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31513e36-7fd6-487e-81b2-5836365342e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:40.987108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31513e36-7fd6-487e-81b2-5836365342e9 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:40.987700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31513e36-7fd6-487e-81b2-5836365342e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:40.988209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31513e36-7fd6-487e-81b2-5836365342e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:40.989320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31513e36-7fd6-487e-81b2-5836365342e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:41.002608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31513e36-7fd6-487e-81b2-5836365342e9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:41.081874 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2099/4238] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:59:40 2021] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:59:41.082748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64154b2-186a-48a0-a124-ab43ade783b3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:41.103454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64154b2-186a-48a0-a124-ab43ade783b3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:41.188842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b8dc2-aa06-4c79-b143-63fa5853e8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:41.190126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b8dc2-aa06-4c79-b143-63fa5853e8df admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:41.190897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b8dc2-aa06-4c79-b143-63fa5853e8df admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:41.191543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b8dc2-aa06-4c79-b143-63fa5853e8df admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:41.192476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b8dc2-aa06-4c79-b143-63fa5853e8df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:41.194957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b8dc2-aa06-4c79-b143-63fa5853e8df admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:41.243101 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2140/4239] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:59:41 2021] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:59:41.244724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31513e36-7fd6-487e-81b2-5836365342e9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:41.262207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31513e36-7fd6-487e-81b2-5836365342e9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:41.270861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a5509-2e4d-445b-892a-7f20c05ff627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:41.272045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a5509-2e4d-445b-892a-7f20c05ff627 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:41.273094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a5509-2e4d-445b-892a-7f20c05ff627 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:41.274336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a5509-2e4d-445b-892a-7f20c05ff627 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:41.275314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a5509-2e4d-445b-892a-7f20c05ff627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:41.278679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a5509-2e4d-445b-892a-7f20c05ff627 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:41.294099 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2100/4240] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:59:41 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:59:41.299245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b8dc2-aa06-4c79-b143-63fa5853e8df admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:41.311005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b8dc2-aa06-4c79-b143-63fa5853e8df admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:41.320998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf43931-2b91-4927-ba91-43c27f53d922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:41.321725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf43931-2b91-4927-ba91-43c27f53d922 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:41.322185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf43931-2b91-4927-ba91-43c27f53d922 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:41.322675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf43931-2b91-4927-ba91-43c27f53d922 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:41.323778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf43931-2b91-4927-ba91-43c27f53d922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:41.325738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf43931-2b91-4927-ba91-43c27f53d922 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:41.383739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a5509-2e4d-445b-892a-7f20c05ff627 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:41.384437 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2141/4241] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:59:41 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:59:41.396448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a5509-2e4d-445b-892a-7f20c05ff627 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:41.408820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67d588-a5d1-4f42-a59c-03b4b48c6f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:41.410177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67d588-a5d1-4f42-a59c-03b4b48c6f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:41.411757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67d588-a5d1-4f42-a59c-03b4b48c6f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:41.413080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67d588-a5d1-4f42-a59c-03b4b48c6f56 admin admin] PATH_INFO: `/v3/projects/0d7fb5d0ce9f40d2b55296706489a86a/users/7ca060b0759d4bb687977d2435ce74e9/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:41.449472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67d588-a5d1-4f42-a59c-03b4b48c6f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7fb5d0ce9f40d2b55296706489a86a, user_id=7ca060b0759d4bb687977d2435ce74e9, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:41.452613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67d588-a5d1-4f42-a59c-03b4b48c6f56 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:41.486429 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2101/4242] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:59:41 2021] PUT /identity/v3/projects/0d7fb5d0ce9f40d2b55296706489a86a/users/7ca060b0759d4bb687977d2435ce74e9/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 20:59:41.491836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc264919-0821-4592-9bbb-0a6d56745b37 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:41.492142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc264919-0821-4592-9bbb-0a6d56745b37 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:41.492410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc264919-0821-4592-9bbb-0a6d56745b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:41.522612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bc264919-0821-4592-9bbb-0a6d56745b37 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:41.523713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bc264919-0821-4592-9bbb-0a6d56745b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:41.628601 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2142/4243] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:41.646223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67d588-a5d1-4f42-a59c-03b4b48c6f56 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:41.649333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7d67d588-a5d1-4f42-a59c-03b4b48c6f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:41.799111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67d588-a5d1-4f42-a59c-03b4b48c6f56 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:41.817531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc264919-0821-4592-9bbb-0a6d56745b37 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:41.819009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bc264919-0821-4592-9bbb-0a6d56745b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:41.821323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea1625-c04f-4b0d-8311-4d6b0e8d96b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:41.823099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea1625-c04f-4b0d-8311-4d6b0e8d96b6 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:41.823669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea1625-c04f-4b0d-8311-4d6b0e8d96b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:41.824096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea1625-c04f-4b0d-8311-4d6b0e8d96b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:41.836627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea1625-c04f-4b0d-8311-4d6b0e8d96b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:41.838225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea1625-c04f-4b0d-8311-4d6b0e8d96b6 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:41.851455 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2102/4244] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:59:41.852191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc264919-0821-4592-9bbb-0a6d56745b37 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:41.861315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5ece8-d467-459f-a7dd-5051dcf39f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:41.862243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ece8-d467-459f-a7dd-5051dcf39f74 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:41.862779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ece8-d467-459f-a7dd-5051dcf39f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:41.863420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ece8-d467-459f-a7dd-5051dcf39f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:41.866096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-82b5ece8-d467-459f-a7dd-5051dcf39f74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:41.882707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5ece8-d467-459f-a7dd-5051dcf39f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:41.885477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5ece8-d467-459f-a7dd-5051dcf39f74 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:41.919171 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2143/4245] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:59:44.194430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c69d3-da36-4853-8476-aa9c50fc67cd None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:44.196137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c69d3-da36-4853-8476-aa9c50fc67cd None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:44.197197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c69d3-da36-4853-8476-aa9c50fc67cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:44.237444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-047c69d3-da36-4853-8476-aa9c50fc67cd None None] MFA Rules not processed for user `7ca060b0759d4bb687977d2435ce74e9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:44.240095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-047c69d3-da36-4853-8476-aa9c50fc67cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:44.347468 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2103/4246] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:44 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:44.364220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5ece8-d467-459f-a7dd-5051dcf39f74 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:44.365995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-82b5ece8-d467-459f-a7dd-5051dcf39f74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:44.614194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5ece8-d467-459f-a7dd-5051dcf39f74 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:44.636228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5264464-0fc0-4756-abc6-183552583ef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:44.636904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5264464-0fc0-4756-abc6-183552583ef0 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:44.637325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5264464-0fc0-4756-abc6-183552583ef0 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:44.637606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5264464-0fc0-4756-abc6-183552583ef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:44.669944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5264464-0fc0-4756-abc6-183552583ef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:44.680461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5264464-0fc0-4756-abc6-183552583ef0 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:44.705650 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2144/4247] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:44 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:59:46.168098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb60b2-763a-4f82-bb16-1b7ec4f45e5c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:46.168605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb60b2-763a-4f82-bb16-1b7ec4f45e5c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:46.168716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb60b2-763a-4f82-bb16-1b7ec4f45e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:46.199828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f2cb60b2-763a-4f82-bb16-1b7ec4f45e5c None None] MFA Rules not processed for user `7ca060b0759d4bb687977d2435ce74e9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:46.205508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f2cb60b2-763a-4f82-bb16-1b7ec4f45e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:46.224023 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2104/4248] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:46 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:47.023245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac71c9-770b-4982-b1b1-d057b39f5325 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:47.024071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac71c9-770b-4982-b1b1-d057b39f5325 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:47.024526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac71c9-770b-4982-b1b1-d057b39f5325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:47.050999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-58ac71c9-770b-4982-b1b1-d057b39f5325 None None] MFA Rules not processed for user `4196dd207ce543d3bdd5f48ae57e156a`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:47.053182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-58ac71c9-770b-4982-b1b1-d057b39f5325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:47.123530 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2145/4249] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:47 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:59:49.284377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb60b2-763a-4f82-bb16-1b7ec4f45e5c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:49.287026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f2cb60b2-763a-4f82-bb16-1b7ec4f45e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:49.307334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb60b2-763a-4f82-bb16-1b7ec4f45e5c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:49.313031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d49ef-083a-48f2-9996-06862fb1fff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:49.314761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d49ef-083a-48f2-9996-06862fb1fff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:49.315149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d49ef-083a-48f2-9996-06862fb1fff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:49.315517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d49ef-083a-48f2-9996-06862fb1fff3 admin admin] PATH_INFO: `/v3/users/ebd83848fe8d4e7284291660eb51da51` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:49.317239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d49ef-083a-48f2-9996-06862fb1fff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd83848fe8d4e7284291660eb51da51)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:49.320042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d49ef-083a-48f2-9996-06862fb1fff3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:49.378654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-268d49ef-083a-48f2-9996-06862fb1fff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd83848fe8d4e7284291660eb51da51'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:49.389148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-268d49ef-083a-48f2-9996-06862fb1fff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd83848fe8d4e7284291660eb51da51'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:49.412648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-268d49ef-083a-48f2-9996-06862fb1fff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd83848fe8d4e7284291660eb51da51'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:49.413756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-268d49ef-083a-48f2-9996-06862fb1fff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd83848fe8d4e7284291660eb51da51'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:49.426237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-268d49ef-083a-48f2-9996-06862fb1fff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd83848fe8d4e7284291660eb51da51'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:49.438643 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2105/4250] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 20:59:49 2021] DELETE /identity/v3/users/ebd83848fe8d4e7284291660eb51da51 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:59:50.090530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac71c9-770b-4982-b1b1-d057b39f5325 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:50.102885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac71c9-770b-4982-b1b1-d057b39f5325 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:50.207973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e3c6e-93d3-421d-bdaf-de926a586682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:50.209204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e3c6e-93d3-421d-bdaf-de926a586682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:50.209647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e3c6e-93d3-421d-bdaf-de926a586682 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:50.210126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e3c6e-93d3-421d-bdaf-de926a586682 admin admin] PATH_INFO: `/v3/projects/69de37deec2a49ff9eaad9cbb7c48f31` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:50.211543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e3c6e-93d3-421d-bdaf-de926a586682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69de37deec2a49ff9eaad9cbb7c48f31)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:50.214054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e3c6e-93d3-421d-bdaf-de926a586682 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:50.263645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-852e3c6e-93d3-421d-bdaf-de926a586682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69de37deec2a49ff9eaad9cbb7c48f31', 'request_id': 'req-852e3c6e-93d3-421d-bdaf-de926a586682'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:50.270681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-852e3c6e-93d3-421d-bdaf-de926a586682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69de37deec2a49ff9eaad9cbb7c48f31', 'request_id': 'req-852e3c6e-93d3-421d-bdaf-de926a586682'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:50.279383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-852e3c6e-93d3-421d-bdaf-de926a586682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69de37deec2a49ff9eaad9cbb7c48f31', 'request_id': 'req-852e3c6e-93d3-421d-bdaf-de926a586682'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:50.289590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-852e3c6e-93d3-421d-bdaf-de926a586682 admin admin] The token cache is being invalidate because project 69de37deec2a49ff9eaad9cbb7c48f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 20:59:50.289901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-852e3c6e-93d3-421d-bdaf-de926a586682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:50.290557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-852e3c6e-93d3-421d-bdaf-de926a586682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 20:59:50.292299 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2146/4251] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 20:59:50 2021] DELETE /identity/v3/projects/69de37deec2a49ff9eaad9cbb7c48f31 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:59:50.298040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc47ff-c204-4cc1-b340-2c3c2538ded0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:50.298714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc47ff-c204-4cc1-b340-2c3c2538ded0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:50.298714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc47ff-c204-4cc1-b340-2c3c2538ded0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:50.318313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9cfc47ff-c204-4cc1-b340-2c3c2538ded0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:50.319506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9cfc47ff-c204-4cc1-b340-2c3c2538ded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:50.380467 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2106/4252] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 20:59:50.388228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e206a-3f9b-4519-b03b-48f090bf2bdd None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:50.388688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e206a-3f9b-4519-b03b-48f090bf2bdd None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:50.389209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e206a-3f9b-4519-b03b-48f090bf2bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:50.411137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-364e206a-3f9b-4519-b03b-48f090bf2bdd None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:50.412468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-364e206a-3f9b-4519-b03b-48f090bf2bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:50.420436 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2147/4253] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:50.424852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc47ff-c204-4cc1-b340-2c3c2538ded0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:50.434765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc47ff-c204-4cc1-b340-2c3c2538ded0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:50.440067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2e9e5-d06c-4d78-9fba-05665f2d9bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:50.441115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2e9e5-d06c-4d78-9fba-05665f2d9bbd admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:50.441522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2e9e5-d06c-4d78-9fba-05665f2d9bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:50.441811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2e9e5-d06c-4d78-9fba-05665f2d9bbd admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:50.442732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2e9e5-d06c-4d78-9fba-05665f2d9bbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 20:59:50.443041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2e9e5-d06c-4d78-9fba-05665f2d9bbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:50.444741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2e9e5-d06c-4d78-9fba-05665f2d9bbd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:50.458454 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2107/4254] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 20:59:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 20:59:50.463751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e206a-3f9b-4519-b03b-48f090bf2bdd None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:50.477046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e206a-3f9b-4519-b03b-48f090bf2bdd None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:50.485814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2152d72-1b1a-4d9d-8d55-6b9e53ddf57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:50.487156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2152d72-1b1a-4d9d-8d55-6b9e53ddf57d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:50.488066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2152d72-1b1a-4d9d-8d55-6b9e53ddf57d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:50.488957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2152d72-1b1a-4d9d-8d55-6b9e53ddf57d admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:50.490731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2152d72-1b1a-4d9d-8d55-6b9e53ddf57d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:50.494178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2152d72-1b1a-4d9d-8d55-6b9e53ddf57d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:50.538289 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2148/4255] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 20:59:50 2021] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 20:59:50.540758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2e9e5-d06c-4d78-9fba-05665f2d9bbd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:50.559232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2e9e5-d06c-4d78-9fba-05665f2d9bbd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:50.641551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535e532-96a3-49f3-bdb1-33ee662c0b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:50.642246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535e532-96a3-49f3-bdb1-33ee662c0b26 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:50.642560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535e532-96a3-49f3-bdb1-33ee662c0b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:50.642841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535e532-96a3-49f3-bdb1-33ee662c0b26 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:50.643737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535e532-96a3-49f3-bdb1-33ee662c0b26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:50.645864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535e532-96a3-49f3-bdb1-33ee662c0b26 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:50.667012 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2108/4256] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 20:59:50 2021] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 20:59:50.672069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2152d72-1b1a-4d9d-8d55-6b9e53ddf57d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:50.682526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2152d72-1b1a-4d9d-8d55-6b9e53ddf57d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:50.688272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eae6b8-a6b2-4293-b11f-157621d3a16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:50.689134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eae6b8-a6b2-4293-b11f-157621d3a16b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:50.689422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eae6b8-a6b2-4293-b11f-157621d3a16b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:50.689701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eae6b8-a6b2-4293-b11f-157621d3a16b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:50.690483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eae6b8-a6b2-4293-b11f-157621d3a16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:50.692494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eae6b8-a6b2-4293-b11f-157621d3a16b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:50.706640 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2149/4257] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:59:50 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 20:59:50.707803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535e532-96a3-49f3-bdb1-33ee662c0b26 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:50.721310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535e532-96a3-49f3-bdb1-33ee662c0b26 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:50.730565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d7138-ab6c-47f5-b92f-f0a6bfdbd8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:50.731556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7138-ab6c-47f5-b92f-f0a6bfdbd8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:50.732073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7138-ab6c-47f5-b92f-f0a6bfdbd8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:50.732552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7138-ab6c-47f5-b92f-f0a6bfdbd8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:50.734082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d7138-ab6c-47f5-b92f-f0a6bfdbd8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:50.735972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d7138-ab6c-47f5-b92f-f0a6bfdbd8e9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:50.754796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eae6b8-a6b2-4293-b11f-157621d3a16b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:50.755213 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2109/4258] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 20:59:50 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 20:59:50.769013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eae6b8-a6b2-4293-b11f-157621d3a16b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:50.774822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b5417-387f-446c-8806-041b332c9de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:50.775735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b5417-387f-446c-8806-041b332c9de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:50.776020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b5417-387f-446c-8806-041b332c9de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:50.776304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b5417-387f-446c-8806-041b332c9de6 admin admin] PATH_INFO: `/v3/projects/c4dac9c70ce64bab85da8c23bafd20cc/users/515dc27f25b847a0922262533aa0d5b1/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:50.794381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b5417-387f-446c-8806-041b332c9de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4dac9c70ce64bab85da8c23bafd20cc, user_id=515dc27f25b847a0922262533aa0d5b1, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:50.797638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b5417-387f-446c-8806-041b332c9de6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:50.818312 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2150/4259] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 20:59:50 2021] PUT /identity/v3/projects/c4dac9c70ce64bab85da8c23bafd20cc/users/515dc27f25b847a0922262533aa0d5b1/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 20:59:50.820622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27617816-1e9a-4748-971a-d9f6810b553c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:50.821772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27617816-1e9a-4748-971a-d9f6810b553c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:50.822328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27617816-1e9a-4748-971a-d9f6810b553c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:50.844525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-27617816-1e9a-4748-971a-d9f6810b553c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:50.846143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-27617816-1e9a-4748-971a-d9f6810b553c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:50.920192 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2110/4260] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:50.941944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b5417-387f-446c-8806-041b332c9de6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:50.944445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c91b5417-387f-446c-8806-041b332c9de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:51.066160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b5417-387f-446c-8806-041b332c9de6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:51.070132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41f113-46ff-45e6-a064-0defe1bbc526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:51.070879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41f113-46ff-45e6-a064-0defe1bbc526 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:51.071165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41f113-46ff-45e6-a064-0defe1bbc526 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:51.071444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41f113-46ff-45e6-a064-0defe1bbc526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:51.082354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41f113-46ff-45e6-a064-0defe1bbc526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:51.084601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41f113-46ff-45e6-a064-0defe1bbc526 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:51.102116 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2151/4261] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 20:59:53.008382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db47f5-90b2-444d-afe0-ff1c0a28bfac None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:53.008863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db47f5-90b2-444d-afe0-ff1c0a28bfac None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:53.008987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db47f5-90b2-444d-afe0-ff1c0a28bfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:53.042556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f3db47f5-90b2-444d-afe0-ff1c0a28bfac None None] MFA Rules not processed for user `515dc27f25b847a0922262533aa0d5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:53.043864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f3db47f5-90b2-444d-afe0-ff1c0a28bfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:53.125565 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2111/4262] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:53 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:53.136878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ded459-71e1-45bd-826a-ac311c1da7d4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:53.137576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ded459-71e1-45bd-826a-ac311c1da7d4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:53.137994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ded459-71e1-45bd-826a-ac311c1da7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:53.159762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b2ded459-71e1-45bd-826a-ac311c1da7d4 None None] MFA Rules not processed for user `515dc27f25b847a0922262533aa0d5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:53.161123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b2ded459-71e1-45bd-826a-ac311c1da7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:53.183656 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2152/4263] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:53 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:53.205295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db47f5-90b2-444d-afe0-ff1c0a28bfac None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 20:59:53.207153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f3db47f5-90b2-444d-afe0-ff1c0a28bfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:53.328935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db47f5-90b2-444d-afe0-ff1c0a28bfac None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 20:59:53.344462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c18f7-8f80-42c5-b6d1-947d32dd4323 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 20:59:53.345137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c18f7-8f80-42c5-b6d1-947d32dd4323 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:53.345796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c18f7-8f80-42c5-b6d1-947d32dd4323 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:53.346721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c18f7-8f80-42c5-b6d1-947d32dd4323 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:53.367186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c18f7-8f80-42c5-b6d1-947d32dd4323 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 20:59:53.369453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c18f7-8f80-42c5-b6d1-947d32dd4323 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 20:59:53.386136 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2112/4264] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 20:59:53 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 20:59:54.547944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeb94c-ce1c-431a-b393-8288c92d738a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:54.548796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeb94c-ce1c-431a-b393-8288c92d738a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:54.550605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeb94c-ce1c-431a-b393-8288c92d738a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:54.574621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6bbeb94c-ce1c-431a-b393-8288c92d738a None None] MFA Rules not processed for user `cdd1c467298d42acb167a7d3506ad36f`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:54.575856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6bbeb94c-ce1c-431a-b393-8288c92d738a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:54.642290 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2153/4265] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:54 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 20:59:55.240124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eff3e-8f40-46eb-93ea-3953a56e7b52 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 20:59:55.241745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eff3e-8f40-46eb-93ea-3953a56e7b52 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 20:59:55.242170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eff3e-8f40-46eb-93ea-3953a56e7b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 20:59:55.299080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b33eff3e-8f40-46eb-93ea-3953a56e7b52 None None] MFA Rules not processed for user `bc32317ed5e54f67b8ae64f92419bcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 20:59:55.303052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b33eff3e-8f40-46eb-93ea-3953a56e7b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 20:59:55.448897 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2113/4266] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 20:59:55 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:07.055907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486c44-448a-40ed-b59a-84b0070490ab None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:07.056409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486c44-448a-40ed-b59a-84b0070490ab None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:07.056747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486c44-448a-40ed-b59a-84b0070490ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:07.081353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d2486c44-448a-40ed-b59a-84b0070490ab None None] MFA Rules not processed for user `4196dd207ce543d3bdd5f48ae57e156a`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:07.082827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d2486c44-448a-40ed-b59a-84b0070490ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:07.160477 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2154/4267] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:07 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:11.123318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33eff3e-8f40-46eb-93ea-3953a56e7b52 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:11.124180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b33eff3e-8f40-46eb-93ea-3953a56e7b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:11.138818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33eff3e-8f40-46eb-93ea-3953a56e7b52 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:11.145345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4866cdb-ad6c-4d37-a75a-446c85790ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:11.146369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4866cdb-ad6c-4d37-a75a-446c85790ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:11.146732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4866cdb-ad6c-4d37-a75a-446c85790ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:11.147193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4866cdb-ad6c-4d37-a75a-446c85790ab5 admin admin] PATH_INFO: `/v3/users/fba996171cc148a5b0fe75a937f59055` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:11.148708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4866cdb-ad6c-4d37-a75a-446c85790ab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba996171cc148a5b0fe75a937f59055)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:11.151095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4866cdb-ad6c-4d37-a75a-446c85790ab5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:11.206761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c4866cdb-ad6c-4d37-a75a-446c85790ab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba996171cc148a5b0fe75a937f59055'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:11.213578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c4866cdb-ad6c-4d37-a75a-446c85790ab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba996171cc148a5b0fe75a937f59055'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:11.226330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c4866cdb-ad6c-4d37-a75a-446c85790ab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba996171cc148a5b0fe75a937f59055'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:11.227076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c4866cdb-ad6c-4d37-a75a-446c85790ab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba996171cc148a5b0fe75a937f59055'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:11.242946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c4866cdb-ad6c-4d37-a75a-446c85790ab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba996171cc148a5b0fe75a937f59055'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:11.252446 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2114/4268] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:00:11 2021] DELETE /identity/v3/users/fba996171cc148a5b0fe75a937f59055 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:11.873243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2486c44-448a-40ed-b59a-84b0070490ab None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:11.918233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2486c44-448a-40ed-b59a-84b0070490ab None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:12.060464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361832e-fa43-47da-ad9e-0aeb5609a1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:12.062612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361832e-fa43-47da-ad9e-0aeb5609a1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:12.063426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361832e-fa43-47da-ad9e-0aeb5609a1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:12.063998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361832e-fa43-47da-ad9e-0aeb5609a1f9 admin admin] PATH_INFO: `/v3/projects/2ab34e83092a4610b03af4bfa353fb09` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:12.066388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361832e-fa43-47da-ad9e-0aeb5609a1f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab34e83092a4610b03af4bfa353fb09)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:12.069412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361832e-fa43-47da-ad9e-0aeb5609a1f9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:12.133277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8361832e-fa43-47da-ad9e-0aeb5609a1f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab34e83092a4610b03af4bfa353fb09', 'request_id': 'req-8361832e-fa43-47da-ad9e-0aeb5609a1f9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:12.150385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8361832e-fa43-47da-ad9e-0aeb5609a1f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab34e83092a4610b03af4bfa353fb09', 'request_id': 'req-8361832e-fa43-47da-ad9e-0aeb5609a1f9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:12.161865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8361832e-fa43-47da-ad9e-0aeb5609a1f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab34e83092a4610b03af4bfa353fb09', 'request_id': 'req-8361832e-fa43-47da-ad9e-0aeb5609a1f9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:12.176705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8361832e-fa43-47da-ad9e-0aeb5609a1f9 admin admin] The token cache is being invalidate because project 2ab34e83092a4610b03af4bfa353fb09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:00:12.177511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8361832e-fa43-47da-ad9e-0aeb5609a1f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:12.178677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8361832e-fa43-47da-ad9e-0aeb5609a1f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:12.184762 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2155/4269] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:00:11 2021] DELETE /identity/v3/projects/2ab34e83092a4610b03af4bfa353fb09 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:12.186745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4acbc8-e344-49ca-ab2d-a1d1b5511575 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:12.187760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4acbc8-e344-49ca-ab2d-a1d1b5511575 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:12.188434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4acbc8-e344-49ca-ab2d-a1d1b5511575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:12.208881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ee4acbc8-e344-49ca-ab2d-a1d1b5511575 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:12.210943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ee4acbc8-e344-49ca-ab2d-a1d1b5511575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:12.283338 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2115/4270] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:12.291452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447ccc9-3062-46bc-a310-6e1e2314db65 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:12.291839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447ccc9-3062-46bc-a310-6e1e2314db65 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:12.292392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447ccc9-3062-46bc-a310-6e1e2314db65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:12.319723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d447ccc9-3062-46bc-a310-6e1e2314db65 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:12.322056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d447ccc9-3062-46bc-a310-6e1e2314db65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:12.332673 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2156/4271] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:00:12.337898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4acbc8-e344-49ca-ab2d-a1d1b5511575 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:12.349441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4acbc8-e344-49ca-ab2d-a1d1b5511575 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:12.354426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1001832-4c64-46af-84fe-15bd53bf8cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:12.355112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1001832-4c64-46af-84fe-15bd53bf8cfb admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:12.355402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1001832-4c64-46af-84fe-15bd53bf8cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:12.355686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1001832-4c64-46af-84fe-15bd53bf8cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:12.356439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1001832-4c64-46af-84fe-15bd53bf8cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:00:12.356749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1001832-4c64-46af-84fe-15bd53bf8cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:12.359247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1001832-4c64-46af-84fe-15bd53bf8cfb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:12.383765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447ccc9-3062-46bc-a310-6e1e2314db65 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:12.394338 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2116/4272] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:00:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:00:12.426792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447ccc9-3062-46bc-a310-6e1e2314db65 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:12.441697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29ca2e-8259-44e9-8333-ea3bb8fce012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:12.442732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29ca2e-8259-44e9-8333-ea3bb8fce012 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:12.443196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29ca2e-8259-44e9-8333-ea3bb8fce012 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:12.443583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29ca2e-8259-44e9-8333-ea3bb8fce012 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:12.444412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29ca2e-8259-44e9-8333-ea3bb8fce012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:12.447089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29ca2e-8259-44e9-8333-ea3bb8fce012 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:12.493338 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2157/4273] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:00:12 2021] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:00:12.494518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1001832-4c64-46af-84fe-15bd53bf8cfb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:12.505814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1001832-4c64-46af-84fe-15bd53bf8cfb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:12.598464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c503e-5f2e-4d74-9ffd-92af683b0939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:12.599599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c503e-5f2e-4d74-9ffd-92af683b0939 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:12.600101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c503e-5f2e-4d74-9ffd-92af683b0939 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:12.600585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c503e-5f2e-4d74-9ffd-92af683b0939 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:12.601491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c503e-5f2e-4d74-9ffd-92af683b0939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:12.603677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c503e-5f2e-4d74-9ffd-92af683b0939 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:12.636821 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2117/4274] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:00:12 2021] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:00:12.637554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29ca2e-8259-44e9-8333-ea3bb8fce012 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:12.655846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29ca2e-8259-44e9-8333-ea3bb8fce012 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:12.666317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d57d0d-15ea-4cb9-af0f-a53d229c1404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:12.667702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d57d0d-15ea-4cb9-af0f-a53d229c1404 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:12.668184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d57d0d-15ea-4cb9-af0f-a53d229c1404 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:12.668639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d57d0d-15ea-4cb9-af0f-a53d229c1404 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:12.670367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d57d0d-15ea-4cb9-af0f-a53d229c1404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:12.672628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d57d0d-15ea-4cb9-af0f-a53d229c1404 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:12.694566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c503e-5f2e-4d74-9ffd-92af683b0939 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:12.702590 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2158/4275] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:00:12 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:00:12.708990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c503e-5f2e-4d74-9ffd-92af683b0939 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:12.721250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16336a96-0322-434f-9f33-2da7e09a7912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:12.722599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16336a96-0322-434f-9f33-2da7e09a7912 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:12.723078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16336a96-0322-434f-9f33-2da7e09a7912 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:12.731898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16336a96-0322-434f-9f33-2da7e09a7912 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:12.742499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16336a96-0322-434f-9f33-2da7e09a7912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:12.744946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16336a96-0322-434f-9f33-2da7e09a7912 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:12.757533 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2118/4276] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:00:12 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:00:12.762330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d57d0d-15ea-4cb9-af0f-a53d229c1404 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:12.778511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d57d0d-15ea-4cb9-af0f-a53d229c1404 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:12.786613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82644ea-e2d1-4aac-ad62-8f5ffb0dda49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:12.787792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82644ea-e2d1-4aac-ad62-8f5ffb0dda49 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:12.788102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82644ea-e2d1-4aac-ad62-8f5ffb0dda49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:12.788350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82644ea-e2d1-4aac-ad62-8f5ffb0dda49 admin admin] PATH_INFO: `/v3/projects/653558ed3d3248ea8f07a3066b6c3d88/users/54121b5d80d64c4796889183c5197853/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:12.805253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82644ea-e2d1-4aac-ad62-8f5ffb0dda49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=653558ed3d3248ea8f07a3066b6c3d88, user_id=54121b5d80d64c4796889183c5197853, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:12.809245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82644ea-e2d1-4aac-ad62-8f5ffb0dda49 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:12.844657 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2159/4277] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:00:12 2021] PUT /identity/v3/projects/653558ed3d3248ea8f07a3066b6c3d88/users/54121b5d80d64c4796889183c5197853/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:12.856011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be69d0-41dc-4733-ad81-a662a10b0c8f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:12.856309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be69d0-41dc-4733-ad81-a662a10b0c8f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:12.856723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be69d0-41dc-4733-ad81-a662a10b0c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:12.898201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-83be69d0-41dc-4733-ad81-a662a10b0c8f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:12.899906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-83be69d0-41dc-4733-ad81-a662a10b0c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:12.985887 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2119/4278] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:13.024940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82644ea-e2d1-4aac-ad62-8f5ffb0dda49 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:13.026781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b82644ea-e2d1-4aac-ad62-8f5ffb0dda49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:13.172787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82644ea-e2d1-4aac-ad62-8f5ffb0dda49 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:13.204693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801b6bc-0a11-4876-98d1-b30bfd44bd7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:13.205562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801b6bc-0a11-4876-98d1-b30bfd44bd7c service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:13.205854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801b6bc-0a11-4876-98d1-b30bfd44bd7c service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:13.206131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801b6bc-0a11-4876-98d1-b30bfd44bd7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:13.217412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801b6bc-0a11-4876-98d1-b30bfd44bd7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:13.218975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801b6bc-0a11-4876-98d1-b30bfd44bd7c service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:13.231591 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2160/4279] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:00:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:00:14.769602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a406908-9547-4882-a20d-6d2c5834451d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:14.770177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a406908-9547-4882-a20d-6d2c5834451d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:14.770177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a406908-9547-4882-a20d-6d2c5834451d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:14.804907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6a406908-9547-4882-a20d-6d2c5834451d None None] MFA Rules not processed for user `54121b5d80d64c4796889183c5197853`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:14.806660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6a406908-9547-4882-a20d-6d2c5834451d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:14.899200 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2120/4280] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:14 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:14.910834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855df944-3cd9-47f7-8639-7a9524586325 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:14.911840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855df944-3cd9-47f7-8639-7a9524586325 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:14.912284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855df944-3cd9-47f7-8639-7a9524586325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:14.932587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-855df944-3cd9-47f7-8639-7a9524586325 None None] MFA Rules not processed for user `54121b5d80d64c4796889183c5197853`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:14.934591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-855df944-3cd9-47f7-8639-7a9524586325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:14.943947 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2161/4281] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:14 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:15.296568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850b480-a935-4311-a14c-6b263b4d3d1f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:15.296958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850b480-a935-4311-a14c-6b263b4d3d1f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:15.297336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850b480-a935-4311-a14c-6b263b4d3d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:15.322504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855df944-3cd9-47f7-8639-7a9524586325 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:15.324005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-855df944-3cd9-47f7-8639-7a9524586325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:15.337308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6850b480-a935-4311-a14c-6b263b4d3d1f None None] MFA Rules not processed for user `7ca060b0759d4bb687977d2435ce74e9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:15.339878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6850b480-a935-4311-a14c-6b263b4d3d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:15.350051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855df944-3cd9-47f7-8639-7a9524586325 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:15.357841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef76cb6-6b9b-4130-9984-295c1838f057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:15.359057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef76cb6-6b9b-4130-9984-295c1838f057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:15.359751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef76cb6-6b9b-4130-9984-295c1838f057 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:15.360228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef76cb6-6b9b-4130-9984-295c1838f057 admin admin] PATH_INFO: `/v3/users/515dc27f25b847a0922262533aa0d5b1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:15.362076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef76cb6-6b9b-4130-9984-295c1838f057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=515dc27f25b847a0922262533aa0d5b1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:15.365815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef76cb6-6b9b-4130-9984-295c1838f057 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:15.434527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-aef76cb6-6b9b-4130-9984-295c1838f057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '515dc27f25b847a0922262533aa0d5b1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:15.434753 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2121/4282] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:15 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:15.434753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850b480-a935-4311-a14c-6b263b4d3d1f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:15.436593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6850b480-a935-4311-a14c-6b263b4d3d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:15.441813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-aef76cb6-6b9b-4130-9984-295c1838f057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '515dc27f25b847a0922262533aa0d5b1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:15.442885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-aef76cb6-6b9b-4130-9984-295c1838f057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '515dc27f25b847a0922262533aa0d5b1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:15.456304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-aef76cb6-6b9b-4130-9984-295c1838f057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '515dc27f25b847a0922262533aa0d5b1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:15.465937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-aef76cb6-6b9b-4130-9984-295c1838f057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '515dc27f25b847a0922262533aa0d5b1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:15.475621 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2162/4283] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:00:15 2021] DELETE /identity/v3/users/515dc27f25b847a0922262533aa0d5b1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:00:15.527855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850b480-a935-4311-a14c-6b263b4d3d1f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:15.635973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbb65b-fa82-421a-aec9-8adee25c7af0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:15.636397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbb65b-fa82-421a-aec9-8adee25c7af0 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:15.637550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbb65b-fa82-421a-aec9-8adee25c7af0 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:15.638009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbb65b-fa82-421a-aec9-8adee25c7af0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:15.640640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-12bbb65b-fa82-421a-aec9-8adee25c7af0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:15.759000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbb65b-fa82-421a-aec9-8adee25c7af0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:15.760736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbb65b-fa82-421a-aec9-8adee25c7af0 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:15.771310 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2122/4284] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:00:15 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:00:15.812213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef76cb6-6b9b-4130-9984-295c1838f057 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:15.820495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-aef76cb6-6b9b-4130-9984-295c1838f057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:15.930943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef76cb6-6b9b-4130-9984-295c1838f057 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:15.937311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e002d-c911-41db-be50-d852e9536001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:15.938180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e002d-c911-41db-be50-d852e9536001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:15.938514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e002d-c911-41db-be50-d852e9536001 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:15.938795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e002d-c911-41db-be50-d852e9536001 admin admin] PATH_INFO: `/v3/projects/c4dac9c70ce64bab85da8c23bafd20cc` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:15.940000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e002d-c911-41db-be50-d852e9536001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4dac9c70ce64bab85da8c23bafd20cc)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:15.942342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e002d-c911-41db-be50-d852e9536001 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:15.993805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ab2e002d-c911-41db-be50-d852e9536001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4dac9c70ce64bab85da8c23bafd20cc', 'request_id': 'req-ab2e002d-c911-41db-be50-d852e9536001'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:16.002585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ab2e002d-c911-41db-be50-d852e9536001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4dac9c70ce64bab85da8c23bafd20cc', 'request_id': 'req-ab2e002d-c911-41db-be50-d852e9536001'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:16.012046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ab2e002d-c911-41db-be50-d852e9536001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4dac9c70ce64bab85da8c23bafd20cc', 'request_id': 'req-ab2e002d-c911-41db-be50-d852e9536001'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:16.025867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ab2e002d-c911-41db-be50-d852e9536001 admin admin] The token cache is being invalidate because project c4dac9c70ce64bab85da8c23bafd20cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:00:16.026466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ab2e002d-c911-41db-be50-d852e9536001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:16.027233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ab2e002d-c911-41db-be50-d852e9536001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:16.029619 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2163/4285] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:00:15 2021] DELETE /identity/v3/projects/c4dac9c70ce64bab85da8c23bafd20cc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:16.037527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32169f1d-3a5a-40ad-bbb9-3fa35183052e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:16.037819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32169f1d-3a5a-40ad-bbb9-3fa35183052e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:16.038592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32169f1d-3a5a-40ad-bbb9-3fa35183052e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:16.056655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-32169f1d-3a5a-40ad-bbb9-3fa35183052e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:16.058036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-32169f1d-3a5a-40ad-bbb9-3fa35183052e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:16.129215 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2123/4286] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:00:16.136653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8060cc-68fe-4015-a7e6-85ae8a7dd9d5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:16.136948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8060cc-68fe-4015-a7e6-85ae8a7dd9d5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:16.137449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8060cc-68fe-4015-a7e6-85ae8a7dd9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:16.158462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ad8060cc-68fe-4015-a7e6-85ae8a7dd9d5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:16.159795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ad8060cc-68fe-4015-a7e6-85ae8a7dd9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:16.169086 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2164/4287] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:16.173814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32169f1d-3a5a-40ad-bbb9-3fa35183052e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:16.183430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32169f1d-3a5a-40ad-bbb9-3fa35183052e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:16.189500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dd1b8-1117-426c-9e0d-078504078fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:16.190163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd1b8-1117-426c-9e0d-078504078fcf admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:16.190483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd1b8-1117-426c-9e0d-078504078fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:16.191009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd1b8-1117-426c-9e0d-078504078fcf admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:16.191754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dd1b8-1117-426c-9e0d-078504078fcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:00:16.192061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dd1b8-1117-426c-9e0d-078504078fcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:16.193643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dd1b8-1117-426c-9e0d-078504078fcf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:16.210033 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2124/4288] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:00:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:00:16.211525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8060cc-68fe-4015-a7e6-85ae8a7dd9d5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:16.221373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8060cc-68fe-4015-a7e6-85ae8a7dd9d5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:16.226917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b654f29-79b7-4679-9732-30e3462e090f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:16.227716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b654f29-79b7-4679-9732-30e3462e090f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:16.227997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b654f29-79b7-4679-9732-30e3462e090f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:16.228321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b654f29-79b7-4679-9732-30e3462e090f admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:16.229030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b654f29-79b7-4679-9732-30e3462e090f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:16.231013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b654f29-79b7-4679-9732-30e3462e090f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:16.267526 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2165/4289] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:00:16 2021] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:00:16.271494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dd1b8-1117-426c-9e0d-078504078fcf admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:16.283425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dd1b8-1117-426c-9e0d-078504078fcf admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:16.355874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c102d4-3889-43d5-9599-a4ad544c8ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:16.356742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c102d4-3889-43d5-9599-a4ad544c8ecd admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:16.357097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c102d4-3889-43d5-9599-a4ad544c8ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:16.357559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c102d4-3889-43d5-9599-a4ad544c8ecd admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:16.359027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c102d4-3889-43d5-9599-a4ad544c8ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:16.361167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c102d4-3889-43d5-9599-a4ad544c8ecd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:16.398194 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2125/4290] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:00:16 2021] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:00:16.402338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b654f29-79b7-4679-9732-30e3462e090f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:16.414464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b654f29-79b7-4679-9732-30e3462e090f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:16.419559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c9c70-0a9e-4c4f-af41-bd14f9bc5298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:16.420951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c9c70-0a9e-4c4f-af41-bd14f9bc5298 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:16.421305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c9c70-0a9e-4c4f-af41-bd14f9bc5298 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:16.421581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c9c70-0a9e-4c4f-af41-bd14f9bc5298 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:16.422490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c9c70-0a9e-4c4f-af41-bd14f9bc5298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:16.424310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c9c70-0a9e-4c4f-af41-bd14f9bc5298 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:16.449028 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2166/4291] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:00:16 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:00:16.453230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c102d4-3889-43d5-9599-a4ad544c8ecd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:16.476930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c102d4-3889-43d5-9599-a4ad544c8ecd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:16.502825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937550f-f426-456e-8e25-d68237b7af60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:16.504407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937550f-f426-456e-8e25-d68237b7af60 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:16.504670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937550f-f426-456e-8e25-d68237b7af60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:16.504955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937550f-f426-456e-8e25-d68237b7af60 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:16.505708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937550f-f426-456e-8e25-d68237b7af60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:16.507314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937550f-f426-456e-8e25-d68237b7af60 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:16.533622 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2126/4292] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:00:16 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:00:16.535691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c9c70-0a9e-4c4f-af41-bd14f9bc5298 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:16.550498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c9c70-0a9e-4c4f-af41-bd14f9bc5298 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:16.556711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edc84b-5031-4a8c-89ba-2d6271289a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:16.559414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edc84b-5031-4a8c-89ba-2d6271289a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:16.560117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edc84b-5031-4a8c-89ba-2d6271289a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:16.560858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edc84b-5031-4a8c-89ba-2d6271289a14 admin admin] PATH_INFO: `/v3/projects/f77a53112c4344578a937b3f9396e848/users/7d31494c29fc4f62b4a28f384fc15c13/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:16.585175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edc84b-5031-4a8c-89ba-2d6271289a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77a53112c4344578a937b3f9396e848, user_id=7d31494c29fc4f62b4a28f384fc15c13, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:16.589569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edc84b-5031-4a8c-89ba-2d6271289a14 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:16.628811 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2167/4293] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:00:16 2021] PUT /identity/v3/projects/f77a53112c4344578a937b3f9396e848/users/7d31494c29fc4f62b4a28f384fc15c13/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:00:16.643340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccacc1a-f760-4f99-a2f9-6982737fb3d2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:16.643658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccacc1a-f760-4f99-a2f9-6982737fb3d2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:16.643943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccacc1a-f760-4f99-a2f9-6982737fb3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:16.698111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4ccacc1a-f760-4f99-a2f9-6982737fb3d2 None None] MFA Rules not processed for user `7d31494c29fc4f62b4a28f384fc15c13`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:16.705571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4ccacc1a-f760-4f99-a2f9-6982737fb3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:16.836662 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2127/4294] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:16 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:16.858027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5559f-deac-46e7-b063-084589201383 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:16.858342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5559f-deac-46e7-b063-084589201383 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:16.858626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5559f-deac-46e7-b063-084589201383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:16.906508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-57b5559f-deac-46e7-b063-084589201383 None None] MFA Rules not processed for user `7d31494c29fc4f62b4a28f384fc15c13`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:16.907941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-57b5559f-deac-46e7-b063-084589201383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:16.921422 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2168/4295] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:16 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:17.204901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccacc1a-f760-4f99-a2f9-6982737fb3d2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:17.206593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4ccacc1a-f760-4f99-a2f9-6982737fb3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:17.366631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccacc1a-f760-4f99-a2f9-6982737fb3d2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:17.387856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0be59-377d-4b51-9a99-9b9f2fc0f1f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:17.390122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0be59-377d-4b51-9a99-9b9f2fc0f1f0 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:17.390608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0be59-377d-4b51-9a99-9b9f2fc0f1f0 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:17.392207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0be59-377d-4b51-9a99-9b9f2fc0f1f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:17.411761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0be59-377d-4b51-9a99-9b9f2fc0f1f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:17.417413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0be59-377d-4b51-9a99-9b9f2fc0f1f0 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:17.446154 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2128/4296] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:00:17 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:00:17.892435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff47d1-1dd1-4272-bbcd-2192a1f8acb5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:17.892993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff47d1-1dd1-4272-bbcd-2192a1f8acb5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:17.892993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff47d1-1dd1-4272-bbcd-2192a1f8acb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:17.921385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5eff47d1-1dd1-4272-bbcd-2192a1f8acb5 None None] MFA Rules not processed for user `7d31494c29fc4f62b4a28f384fc15c13`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:17.923351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5eff47d1-1dd1-4272-bbcd-2192a1f8acb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:17.942919 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2169/4297] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:17 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:23.434353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0be59-377d-4b51-9a99-9b9f2fc0f1f0 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:23.436822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d4d0be59-377d-4b51-9a99-9b9f2fc0f1f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:23.575966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0be59-377d-4b51-9a99-9b9f2fc0f1f0 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:23.581790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dcd4d-caf6-485b-b3bc-ef020f1e6b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:23.582923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dcd4d-caf6-485b-b3bc-ef020f1e6b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:23.583615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dcd4d-caf6-485b-b3bc-ef020f1e6b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:23.584056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dcd4d-caf6-485b-b3bc-ef020f1e6b60 admin admin] PATH_INFO: `/v3/users/3166e271ba6f418d9c71cd661ef23226` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:23.586329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dcd4d-caf6-485b-b3bc-ef020f1e6b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3166e271ba6f418d9c71cd661ef23226)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:23.589304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dcd4d-caf6-485b-b3bc-ef020f1e6b60 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:23.678206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-082dcd4d-caf6-485b-b3bc-ef020f1e6b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3166e271ba6f418d9c71cd661ef23226'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:23.702699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-082dcd4d-caf6-485b-b3bc-ef020f1e6b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3166e271ba6f418d9c71cd661ef23226'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:23.739208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-082dcd4d-caf6-485b-b3bc-ef020f1e6b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3166e271ba6f418d9c71cd661ef23226'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:23.739997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-082dcd4d-caf6-485b-b3bc-ef020f1e6b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3166e271ba6f418d9c71cd661ef23226'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:23.755559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-082dcd4d-caf6-485b-b3bc-ef020f1e6b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3166e271ba6f418d9c71cd661ef23226'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:23.765039 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2129/4298] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:00:23 2021] DELETE /identity/v3/users/3166e271ba6f418d9c71cd661ef23226 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:24.150702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b7305-6e2c-4ea8-b287-5a8d01b6c53f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:24.155499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b7305-6e2c-4ea8-b287-5a8d01b6c53f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:24.156186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b7305-6e2c-4ea8-b287-5a8d01b6c53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:24.190306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dcd4d-caf6-485b-b3bc-ef020f1e6b60 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:24.192903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-082dcd4d-caf6-485b-b3bc-ef020f1e6b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:24.236087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-918b7305-6e2c-4ea8-b287-5a8d01b6c53f None None] MFA Rules not processed for user `bc32317ed5e54f67b8ae64f92419bcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:24.239754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-918b7305-6e2c-4ea8-b287-5a8d01b6c53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:24.367299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dcd4d-caf6-485b-b3bc-ef020f1e6b60 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:24.375674 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2170/4299] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:24 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:24.375875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d6f08-24ab-46a6-9824-c91731b8bfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:24.376626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d6f08-24ab-46a6-9824-c91731b8bfef admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:24.376968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d6f08-24ab-46a6-9824-c91731b8bfef admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:24.377258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d6f08-24ab-46a6-9824-c91731b8bfef admin admin] PATH_INFO: `/v3/projects/09cf6435c2a148c6998dd3b1d301da96` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:24.379182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d6f08-24ab-46a6-9824-c91731b8bfef admin admin] RBAC: Authorizing `identity:delete_project(project_id=09cf6435c2a148c6998dd3b1d301da96)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:24.380702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d6f08-24ab-46a6-9824-c91731b8bfef admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:24.474679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4c9d6f08-24ab-46a6-9824-c91731b8bfef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09cf6435c2a148c6998dd3b1d301da96', 'request_id': 'req-4c9d6f08-24ab-46a6-9824-c91731b8bfef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:24.485765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4c9d6f08-24ab-46a6-9824-c91731b8bfef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09cf6435c2a148c6998dd3b1d301da96', 'request_id': 'req-4c9d6f08-24ab-46a6-9824-c91731b8bfef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:24.492748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4c9d6f08-24ab-46a6-9824-c91731b8bfef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09cf6435c2a148c6998dd3b1d301da96', 'request_id': 'req-4c9d6f08-24ab-46a6-9824-c91731b8bfef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:24.520175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4c9d6f08-24ab-46a6-9824-c91731b8bfef admin admin] The token cache is being invalidate because project 09cf6435c2a148c6998dd3b1d301da96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:00:24.521131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4c9d6f08-24ab-46a6-9824-c91731b8bfef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:24.522122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4c9d6f08-24ab-46a6-9824-c91731b8bfef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:24.526314 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2130/4300] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:00:24 2021] DELETE /identity/v3/projects/09cf6435c2a148c6998dd3b1d301da96 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:24.534377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f6b2f-ab04-4af5-8171-83ca3b00e5f9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:24.534805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f6b2f-ab04-4af5-8171-83ca3b00e5f9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:24.535185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f6b2f-ab04-4af5-8171-83ca3b00e5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:24.556942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5d6f6b2f-ab04-4af5-8171-83ca3b00e5f9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:24.558176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5d6f6b2f-ab04-4af5-8171-83ca3b00e5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:24.630943 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2171/4301] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:24.639759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a53d3b-13f2-4a1a-a82d-fb73a7435bbe None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:24.640515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a53d3b-13f2-4a1a-a82d-fb73a7435bbe None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:24.640997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a53d3b-13f2-4a1a-a82d-fb73a7435bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:24.663117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e1a53d3b-13f2-4a1a-a82d-fb73a7435bbe None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:24.664574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e1a53d3b-13f2-4a1a-a82d-fb73a7435bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:24.675742 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2131/4302] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:24.679386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f6b2f-ab04-4af5-8171-83ca3b00e5f9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:24.691504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f6b2f-ab04-4af5-8171-83ca3b00e5f9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:24.698954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e0e5e-9970-459d-9e52-b6c437125067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:24.699736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e0e5e-9970-459d-9e52-b6c437125067 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:24.700012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e0e5e-9970-459d-9e52-b6c437125067 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:24.700479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e0e5e-9970-459d-9e52-b6c437125067 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:24.701762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e0e5e-9970-459d-9e52-b6c437125067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:00:24.702157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e0e5e-9970-459d-9e52-b6c437125067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:24.704088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e0e5e-9970-459d-9e52-b6c437125067 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:24.718610 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2172/4303] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:00:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:00:24.722629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a53d3b-13f2-4a1a-a82d-fb73a7435bbe None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:24.732492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a53d3b-13f2-4a1a-a82d-fb73a7435bbe None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:24.738051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2aa7d-9f27-4b28-974e-233cbb2c212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:24.739171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2aa7d-9f27-4b28-974e-233cbb2c212b admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:24.739411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2aa7d-9f27-4b28-974e-233cbb2c212b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:24.739796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2aa7d-9f27-4b28-974e-233cbb2c212b admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:24.740565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2aa7d-9f27-4b28-974e-233cbb2c212b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:24.742931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2aa7d-9f27-4b28-974e-233cbb2c212b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:24.778893 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2132/4304] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:00:24 2021] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:00:24.780346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e0e5e-9970-459d-9e52-b6c437125067 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:24.792246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e0e5e-9970-459d-9e52-b6c437125067 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:24.855746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711b62f-ece9-432d-88b6-55ddefb20a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:24.856418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711b62f-ece9-432d-88b6-55ddefb20a09 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:24.856700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711b62f-ece9-432d-88b6-55ddefb20a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:24.857088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711b62f-ece9-432d-88b6-55ddefb20a09 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:24.857917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711b62f-ece9-432d-88b6-55ddefb20a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:24.860157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711b62f-ece9-432d-88b6-55ddefb20a09 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:24.886736 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2173/4305] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:00:24 2021] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:00:24.887587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2aa7d-9f27-4b28-974e-233cbb2c212b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:24.901928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2aa7d-9f27-4b28-974e-233cbb2c212b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:24.907181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04252b-9d03-4b5c-b056-2322545c13d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:24.907858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04252b-9d03-4b5c-b056-2322545c13d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:24.908143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04252b-9d03-4b5c-b056-2322545c13d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:24.908424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04252b-9d03-4b5c-b056-2322545c13d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:24.909419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04252b-9d03-4b5c-b056-2322545c13d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:24.911060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04252b-9d03-4b5c-b056-2322545c13d0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:24.922075 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2133/4306] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:00:24 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:00:24.926109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711b62f-ece9-432d-88b6-55ddefb20a09 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:24.936606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711b62f-ece9-432d-88b6-55ddefb20a09 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:24.941511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00ecd1-5437-4db3-88e0-9ae71beeec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:24.942158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00ecd1-5437-4db3-88e0-9ae71beeec7f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:24.942492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00ecd1-5437-4db3-88e0-9ae71beeec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:24.942774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00ecd1-5437-4db3-88e0-9ae71beeec7f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:24.943503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00ecd1-5437-4db3-88e0-9ae71beeec7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:24.945090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00ecd1-5437-4db3-88e0-9ae71beeec7f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:24.956053 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2174/4307] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:00:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:00:24.960041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04252b-9d03-4b5c-b056-2322545c13d0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:24.970089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04252b-9d03-4b5c-b056-2322545c13d0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:24.974770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d90452-b7f3-4613-80b6-b3045aff4df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:24.975647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d90452-b7f3-4613-80b6-b3045aff4df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:24.975935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d90452-b7f3-4613-80b6-b3045aff4df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:24.976217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d90452-b7f3-4613-80b6-b3045aff4df3 admin admin] PATH_INFO: `/v3/projects/08fc19b054a54a08aec65b0870725eb8/users/e80a2e31964348e7b4abd7c321e713b7/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:24.990285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d90452-b7f3-4613-80b6-b3045aff4df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08fc19b054a54a08aec65b0870725eb8, user_id=e80a2e31964348e7b4abd7c321e713b7, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:24.992913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d90452-b7f3-4613-80b6-b3045aff4df3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:25.007002 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2134/4308] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:00:24 2021] PUT /identity/v3/projects/08fc19b054a54a08aec65b0870725eb8/users/e80a2e31964348e7b4abd7c321e713b7/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:25.012120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a1de3-01fb-4ff1-8465-8672a9b28af1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:25.012415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a1de3-01fb-4ff1-8465-8672a9b28af1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:25.012695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a1de3-01fb-4ff1-8465-8672a9b28af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:25.041050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-588a1de3-01fb-4ff1-8465-8672a9b28af1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:25.042303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-588a1de3-01fb-4ff1-8465-8672a9b28af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:25.105771 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2175/4309] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:25.116293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d90452-b7f3-4613-80b6-b3045aff4df3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:25.118112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-22d90452-b7f3-4613-80b6-b3045aff4df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:25.179763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d90452-b7f3-4613-80b6-b3045aff4df3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:25.183522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c4674-79c2-4907-9ab7-5d37f67822ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:25.184179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c4674-79c2-4907-9ab7-5d37f67822ed service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:25.184469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c4674-79c2-4907-9ab7-5d37f67822ed service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:25.184758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c4674-79c2-4907-9ab7-5d37f67822ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:25.196121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c4674-79c2-4907-9ab7-5d37f67822ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:25.197575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c4674-79c2-4907-9ab7-5d37f67822ed service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:25.213067 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2135/4310] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:00:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:00:28.239785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba7df2-8b06-49c9-ab45-8054ee12facc None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:28.240775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba7df2-8b06-49c9-ab45-8054ee12facc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:28.241252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba7df2-8b06-49c9-ab45-8054ee12facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:28.287440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8aba7df2-8b06-49c9-ab45-8054ee12facc None None] MFA Rules not processed for user `4196dd207ce543d3bdd5f48ae57e156a`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:28.290939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8aba7df2-8b06-49c9-ab45-8054ee12facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:28.390497 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2176/4311] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:28 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:33.205499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f6c50-4eb9-4193-8dd8-70532de0e7bc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:33.206017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f6c50-4eb9-4193-8dd8-70532de0e7bc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:33.206154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f6c50-4eb9-4193-8dd8-70532de0e7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:33.242191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-317f6c50-4eb9-4193-8dd8-70532de0e7bc None None] MFA Rules not processed for user `e80a2e31964348e7b4abd7c321e713b7`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:33.243685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-317f6c50-4eb9-4193-8dd8-70532de0e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:33.356719 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2136/4312] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:33 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:33.361719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba7df2-8b06-49c9-ab45-8054ee12facc None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:33.380832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba7df2-8b06-49c9-ab45-8054ee12facc None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:33.387831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c98d17-e0dc-4f8d-a089-959d573f533c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:33.388498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c98d17-e0dc-4f8d-a089-959d573f533c admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:33.388796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c98d17-e0dc-4f8d-a089-959d573f533c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:33.389073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c98d17-e0dc-4f8d-a089-959d573f533c admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:33.389799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c98d17-e0dc-4f8d-a089-959d573f533c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:33.391898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c98d17-e0dc-4f8d-a089-959d573f533c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:33.452459 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2177/4313] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:00:33 2021] POST /identity/v3/projects => generated 389 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:00:33.453582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f6c50-4eb9-4193-8dd8-70532de0e7bc None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:33.466841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f6c50-4eb9-4193-8dd8-70532de0e7bc None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:33.544132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cce1e-dbd8-4d5c-9c2b-8c322f36729e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:33.544861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cce1e-dbd8-4d5c-9c2b-8c322f36729e admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:33.545150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cce1e-dbd8-4d5c-9c2b-8c322f36729e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:33.545431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cce1e-dbd8-4d5c-9c2b-8c322f36729e admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:33.546142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cce1e-dbd8-4d5c-9c2b-8c322f36729e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:33.548469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cce1e-dbd8-4d5c-9c2b-8c322f36729e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:33.575007 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2137/4314] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:00:33 2021] POST /identity/v3/users => generated 301 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:00:33.576873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c98d17-e0dc-4f8d-a089-959d573f533c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:33.609626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c98d17-e0dc-4f8d-a089-959d573f533c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:33.629858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b789b5-c0ce-4944-92a3-3b6aba219979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:33.630899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b789b5-c0ce-4944-92a3-3b6aba219979 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:33.631339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b789b5-c0ce-4944-92a3-3b6aba219979 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:33.631967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b789b5-c0ce-4944-92a3-3b6aba219979 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:33.633000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b789b5-c0ce-4944-92a3-3b6aba219979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:33.634653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b789b5-c0ce-4944-92a3-3b6aba219979 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:33.681194 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2178/4315] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:00:33 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:00:33.685069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cce1e-dbd8-4d5c-9c2b-8c322f36729e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:33.701400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cce1e-dbd8-4d5c-9c2b-8c322f36729e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:33.709835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b9b80-11d5-410b-bd52-7804198daf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:33.711151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b9b80-11d5-410b-bd52-7804198daf8e admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:33.711446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b9b80-11d5-410b-bd52-7804198daf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:33.711737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b9b80-11d5-410b-bd52-7804198daf8e admin admin] PATH_INFO: `/v3/projects/b66794ba47ff4407b4073a90be2df125/users/fd8352549adc473a8578968edb4653b6/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:33.733805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b9b80-11d5-410b-bd52-7804198daf8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66794ba47ff4407b4073a90be2df125, user_id=fd8352549adc473a8578968edb4653b6, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:33.736504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b9b80-11d5-410b-bd52-7804198daf8e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:33.759321 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2138/4316] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:00:33 2021] PUT /identity/v3/projects/b66794ba47ff4407b4073a90be2df125/users/fd8352549adc473a8578968edb4653b6/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:33.762907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b789b5-c0ce-4944-92a3-3b6aba219979 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:33.776036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b789b5-c0ce-4944-92a3-3b6aba219979 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:33.852587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c6427-aaa3-4edf-8cfc-37d9bff5b2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:33.853762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c6427-aaa3-4edf-8cfc-37d9bff5b2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:33.854171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c6427-aaa3-4edf-8cfc-37d9bff5b2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:33.854596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c6427-aaa3-4edf-8cfc-37d9bff5b2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:33.855488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c6427-aaa3-4edf-8cfc-37d9bff5b2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:33.857412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c6427-aaa3-4edf-8cfc-37d9bff5b2c3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:33.877244 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2179/4317] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:00:33 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:00:33.881478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b9b80-11d5-410b-bd52-7804198daf8e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:33.898977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b9b80-11d5-410b-bd52-7804198daf8e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:33.908032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3eb08-36d1-43e2-93cc-aaaa149e41c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:33.909407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3eb08-36d1-43e2-93cc-aaaa149e41c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:33.909913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3eb08-36d1-43e2-93cc-aaaa149e41c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:33.914993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3eb08-36d1-43e2-93cc-aaaa149e41c5 admin admin] PATH_INFO: `/v3/projects/b66794ba47ff4407b4073a90be2df125/users/fd8352549adc473a8578968edb4653b6/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:33.919166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3eb08-36d1-43e2-93cc-aaaa149e41c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66794ba47ff4407b4073a90be2df125, user_id=fd8352549adc473a8578968edb4653b6, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:33.922474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3eb08-36d1-43e2-93cc-aaaa149e41c5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:33.940430 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2139/4318] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:00:33 2021] PUT /identity/v3/projects/b66794ba47ff4407b4073a90be2df125/users/fd8352549adc473a8578968edb4653b6/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:40.217453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0fd81-3638-4445-891a-ca3372b94170 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:40.217453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0fd81-3638-4445-891a-ca3372b94170 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:40.217453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0fd81-3638-4445-891a-ca3372b94170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:40.248907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ffe0fd81-3638-4445-891a-ca3372b94170 None None] MFA Rules not processed for user `fd8352549adc473a8578968edb4653b6`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:40.250509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ffe0fd81-3638-4445-891a-ca3372b94170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:40.337262 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2180/4319] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:40 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:40.346652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3eb08-36d1-43e2-93cc-aaaa149e41c5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:40.348461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b5d3eb08-36d1-43e2-93cc-aaaa149e41c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:40.424964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3eb08-36d1-43e2-93cc-aaaa149e41c5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:40.429934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0928c-2ac3-497e-919a-03113d701aee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:40.431557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0928c-2ac3-497e-919a-03113d701aee service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:40.432063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0928c-2ac3-497e-919a-03113d701aee service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:40.432544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0928c-2ac3-497e-919a-03113d701aee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:40.527156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0928c-2ac3-497e-919a-03113d701aee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:40.529567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0928c-2ac3-497e-919a-03113d701aee service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:40.540164 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2140/4320] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:00:40 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:00:43.148703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0fd81-3638-4445-891a-ca3372b94170 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:43.155625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ffe0fd81-3638-4445-891a-ca3372b94170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:43.380897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0fd81-3638-4445-891a-ca3372b94170 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:43.390581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407c2a8-2b1c-46fc-a29f-6f53dfa14f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:43.391474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407c2a8-2b1c-46fc-a29f-6f53dfa14f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:43.391809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407c2a8-2b1c-46fc-a29f-6f53dfa14f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:43.392409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407c2a8-2b1c-46fc-a29f-6f53dfa14f87 admin admin] PATH_INFO: `/v3/users/cdd1c467298d42acb167a7d3506ad36f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:43.394209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407c2a8-2b1c-46fc-a29f-6f53dfa14f87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd1c467298d42acb167a7d3506ad36f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:43.396524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407c2a8-2b1c-46fc-a29f-6f53dfa14f87 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:43.498451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7407c2a8-2b1c-46fc-a29f-6f53dfa14f87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd1c467298d42acb167a7d3506ad36f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:43.514098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7407c2a8-2b1c-46fc-a29f-6f53dfa14f87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd1c467298d42acb167a7d3506ad36f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:43.516683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7407c2a8-2b1c-46fc-a29f-6f53dfa14f87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd1c467298d42acb167a7d3506ad36f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:43.567543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7407c2a8-2b1c-46fc-a29f-6f53dfa14f87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd1c467298d42acb167a7d3506ad36f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:43.599782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7407c2a8-2b1c-46fc-a29f-6f53dfa14f87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd1c467298d42acb167a7d3506ad36f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:43.609048 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2181/4321] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:00:43 2021] DELETE /identity/v3/users/cdd1c467298d42acb167a7d3506ad36f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:43.881862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0928c-2ac3-497e-919a-03113d701aee service cinder] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:43.893414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0928c-2ac3-497e-919a-03113d701aee service cinder] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:43.971290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc330c81-1b0b-481c-be7c-1910569c854f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:43.972292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc330c81-1b0b-481c-be7c-1910569c854f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:43.972678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc330c81-1b0b-481c-be7c-1910569c854f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:43.973050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc330c81-1b0b-481c-be7c-1910569c854f admin admin] PATH_INFO: `/v3/projects/837eada96b154829af977e9e1e78f28f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:43.974390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc330c81-1b0b-481c-be7c-1910569c854f admin admin] RBAC: Authorizing `identity:delete_project(project_id=837eada96b154829af977e9e1e78f28f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:43.976527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc330c81-1b0b-481c-be7c-1910569c854f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:44.034450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bc330c81-1b0b-481c-be7c-1910569c854f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '837eada96b154829af977e9e1e78f28f', 'request_id': 'req-bc330c81-1b0b-481c-be7c-1910569c854f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:44.043331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bc330c81-1b0b-481c-be7c-1910569c854f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '837eada96b154829af977e9e1e78f28f', 'request_id': 'req-bc330c81-1b0b-481c-be7c-1910569c854f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:44.051538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bc330c81-1b0b-481c-be7c-1910569c854f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '837eada96b154829af977e9e1e78f28f', 'request_id': 'req-bc330c81-1b0b-481c-be7c-1910569c854f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:44.063617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bc330c81-1b0b-481c-be7c-1910569c854f admin admin] The token cache is being invalidate because project 837eada96b154829af977e9e1e78f28f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:00:44.063903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bc330c81-1b0b-481c-be7c-1910569c854f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:44.064519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bc330c81-1b0b-481c-be7c-1910569c854f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:44.066534 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2141/4322] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:00:43 2021] DELETE /identity/v3/projects/837eada96b154829af977e9e1e78f28f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:44.070697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407c2a8-2b1c-46fc-a29f-6f53dfa14f87 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:44.072147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7407c2a8-2b1c-46fc-a29f-6f53dfa14f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:44.085431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407c2a8-2b1c-46fc-a29f-6f53dfa14f87 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:44.148286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7b285-fa62-4557-a732-a45b7928e2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:44.149526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b285-fa62-4557-a732-a45b7928e2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:44.150633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b285-fa62-4557-a732-a45b7928e2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:44.151142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b285-fa62-4557-a732-a45b7928e2aa admin admin] PATH_INFO: `/v3/users/864d0556412b4165a129dc1c69c68d44` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:44.152702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7b285-fa62-4557-a732-a45b7928e2aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=864d0556412b4165a129dc1c69c68d44)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:44.155700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7b285-fa62-4557-a732-a45b7928e2aa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:44.219899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4b7b285-fa62-4557-a732-a45b7928e2aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '864d0556412b4165a129dc1c69c68d44'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:44.229792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4b7b285-fa62-4557-a732-a45b7928e2aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '864d0556412b4165a129dc1c69c68d44'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:44.230784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4b7b285-fa62-4557-a732-a45b7928e2aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '864d0556412b4165a129dc1c69c68d44'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:44.252921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4b7b285-fa62-4557-a732-a45b7928e2aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '864d0556412b4165a129dc1c69c68d44'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:44.263789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4b7b285-fa62-4557-a732-a45b7928e2aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '864d0556412b4165a129dc1c69c68d44'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:44.271403 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2182/4323] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:00:44 2021] DELETE /identity/v3/users/864d0556412b4165a129dc1c69c68d44 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:44.464762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc330c81-1b0b-481c-be7c-1910569c854f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:44.466333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bc330c81-1b0b-481c-be7c-1910569c854f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:44.489144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc330c81-1b0b-481c-be7c-1910569c854f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:44.558364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaa952-b03a-4b9f-a40b-34554ecd04fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:44.559355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaa952-b03a-4b9f-a40b-34554ecd04fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:44.559718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaa952-b03a-4b9f-a40b-34554ecd04fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:44.560626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaa952-b03a-4b9f-a40b-34554ecd04fa admin admin] PATH_INFO: `/v3/projects/75c84e493553475aa1781e3e9528e50a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:44.563463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaa952-b03a-4b9f-a40b-34554ecd04fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c84e493553475aa1781e3e9528e50a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:44.565454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaa952-b03a-4b9f-a40b-34554ecd04fa admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:44.621865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-63eaa952-b03a-4b9f-a40b-34554ecd04fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c84e493553475aa1781e3e9528e50a', 'request_id': 'req-63eaa952-b03a-4b9f-a40b-34554ecd04fa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:44.630434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-63eaa952-b03a-4b9f-a40b-34554ecd04fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c84e493553475aa1781e3e9528e50a', 'request_id': 'req-63eaa952-b03a-4b9f-a40b-34554ecd04fa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:44.637895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-63eaa952-b03a-4b9f-a40b-34554ecd04fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c84e493553475aa1781e3e9528e50a', 'request_id': 'req-63eaa952-b03a-4b9f-a40b-34554ecd04fa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:44.652827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-63eaa952-b03a-4b9f-a40b-34554ecd04fa admin admin] The token cache is being invalidate because project 75c84e493553475aa1781e3e9528e50a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:00:44.653184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-63eaa952-b03a-4b9f-a40b-34554ecd04fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:44.653841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-63eaa952-b03a-4b9f-a40b-34554ecd04fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:44.655707 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2142/4324] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:00:44 2021] DELETE /identity/v3/projects/75c84e493553475aa1781e3e9528e50a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:53.141184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7b285-fa62-4557-a732-a45b7928e2aa admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:53.142757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e4b7b285-fa62-4557-a732-a45b7928e2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:53.157063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7b285-fa62-4557-a732-a45b7928e2aa admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:53.290720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd4fc0-eb79-4c04-b804-ca7046bc9228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:53.292091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd4fc0-eb79-4c04-b804-ca7046bc9228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:53.292569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd4fc0-eb79-4c04-b804-ca7046bc9228 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:53.293867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd4fc0-eb79-4c04-b804-ca7046bc9228 admin admin] PATH_INFO: `/v3/users/bc32317ed5e54f67b8ae64f92419bcc0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:53.298121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd4fc0-eb79-4c04-b804-ca7046bc9228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc32317ed5e54f67b8ae64f92419bcc0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:53.300491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd4fc0-eb79-4c04-b804-ca7046bc9228 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:53.396574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-07dd4fc0-eb79-4c04-b804-ca7046bc9228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc32317ed5e54f67b8ae64f92419bcc0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:53.406073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-07dd4fc0-eb79-4c04-b804-ca7046bc9228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc32317ed5e54f67b8ae64f92419bcc0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:53.407183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-07dd4fc0-eb79-4c04-b804-ca7046bc9228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc32317ed5e54f67b8ae64f92419bcc0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:53.444133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-07dd4fc0-eb79-4c04-b804-ca7046bc9228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc32317ed5e54f67b8ae64f92419bcc0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:53.471719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-07dd4fc0-eb79-4c04-b804-ca7046bc9228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc32317ed5e54f67b8ae64f92419bcc0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:53.483700 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2183/4325] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:00:53 2021] DELETE /identity/v3/users/bc32317ed5e54f67b8ae64f92419bcc0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:53.874904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaa952-b03a-4b9f-a40b-34554ecd04fa admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:53.877185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-63eaa952-b03a-4b9f-a40b-34554ecd04fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:53.894344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaa952-b03a-4b9f-a40b-34554ecd04fa admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:54.020588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44f3d9-389f-42be-befa-6eb749d59350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:54.021495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44f3d9-389f-42be-befa-6eb749d59350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:54.021779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44f3d9-389f-42be-befa-6eb749d59350 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:54.022055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44f3d9-389f-42be-befa-6eb749d59350 admin admin] PATH_INFO: `/v3/projects/80e8efe6135e41a689caf483b2c72af1` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:54.023444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44f3d9-389f-42be-befa-6eb749d59350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80e8efe6135e41a689caf483b2c72af1)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:54.025781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44f3d9-389f-42be-befa-6eb749d59350 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:54.085154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5e44f3d9-389f-42be-befa-6eb749d59350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80e8efe6135e41a689caf483b2c72af1', 'request_id': 'req-5e44f3d9-389f-42be-befa-6eb749d59350'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:54.096420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5e44f3d9-389f-42be-befa-6eb749d59350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80e8efe6135e41a689caf483b2c72af1', 'request_id': 'req-5e44f3d9-389f-42be-befa-6eb749d59350'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:54.105117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5e44f3d9-389f-42be-befa-6eb749d59350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80e8efe6135e41a689caf483b2c72af1', 'request_id': 'req-5e44f3d9-389f-42be-befa-6eb749d59350'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:54.121346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5e44f3d9-389f-42be-befa-6eb749d59350 admin admin] The token cache is being invalidate because project 80e8efe6135e41a689caf483b2c72af1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:00:54.121944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5e44f3d9-389f-42be-befa-6eb749d59350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:54.122914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5e44f3d9-389f-42be-befa-6eb749d59350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:54.131372 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2143/4326] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:00:53 2021] DELETE /identity/v3/projects/80e8efe6135e41a689caf483b2c72af1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:54.132789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8c2e0-e748-4cb3-aef6-bb3418072b37 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:54.133083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8c2e0-e748-4cb3-aef6-bb3418072b37 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:54.133365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8c2e0-e748-4cb3-aef6-bb3418072b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:54.167099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b9a8c2e0-e748-4cb3-aef6-bb3418072b37 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:54.170006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b9a8c2e0-e748-4cb3-aef6-bb3418072b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:54.247120 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2184/4327] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:00:54.255279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8419f7e-1f6b-48b3-9a65-a2b398f8bf7c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:54.255569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8419f7e-1f6b-48b3-9a65-a2b398f8bf7c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:54.255849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8419f7e-1f6b-48b3-9a65-a2b398f8bf7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:54.274405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a8419f7e-1f6b-48b3-9a65-a2b398f8bf7c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:54.275652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a8419f7e-1f6b-48b3-9a65-a2b398f8bf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:54.284272 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2144/4328] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:00:54.288536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8c2e0-e748-4cb3-aef6-bb3418072b37 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:54.300032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8c2e0-e748-4cb3-aef6-bb3418072b37 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:54.306939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e020b1-680f-448d-b187-583fd4600861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:54.307709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e020b1-680f-448d-b187-583fd4600861 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:54.308066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e020b1-680f-448d-b187-583fd4600861 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:54.308431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e020b1-680f-448d-b187-583fd4600861 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:54.309395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e020b1-680f-448d-b187-583fd4600861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:00:54.309776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e020b1-680f-448d-b187-583fd4600861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:54.311503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e020b1-680f-448d-b187-583fd4600861 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:54.324095 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2185/4329] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:00:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:00:54.337568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8419f7e-1f6b-48b3-9a65-a2b398f8bf7c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:54.347594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8419f7e-1f6b-48b3-9a65-a2b398f8bf7c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:54.352226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10f3fe-8a55-42dc-8654-4646f63708fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:54.352885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10f3fe-8a55-42dc-8654-4646f63708fe admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:54.353172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10f3fe-8a55-42dc-8654-4646f63708fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:54.353452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10f3fe-8a55-42dc-8654-4646f63708fe admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:54.354200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10f3fe-8a55-42dc-8654-4646f63708fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:54.356113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10f3fe-8a55-42dc-8654-4646f63708fe admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:54.381639 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2145/4330] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:00:54 2021] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:00:54.385978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e020b1-680f-448d-b187-583fd4600861 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:54.397827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e020b1-680f-448d-b187-583fd4600861 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:54.453749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdd8f6-a3c3-4871-8331-937ccf273e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:54.454446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdd8f6-a3c3-4871-8331-937ccf273e63 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:54.454732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdd8f6-a3c3-4871-8331-937ccf273e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:54.455204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdd8f6-a3c3-4871-8331-937ccf273e63 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:54.455907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdd8f6-a3c3-4871-8331-937ccf273e63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:54.457806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdd8f6-a3c3-4871-8331-937ccf273e63 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:54.483746 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2186/4331] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:00:54 2021] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:00:54.485281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10f3fe-8a55-42dc-8654-4646f63708fe admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:54.496350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10f3fe-8a55-42dc-8654-4646f63708fe admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:54.501080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33778b94-1cfc-4914-a818-ae46d20de041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:54.501756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33778b94-1cfc-4914-a818-ae46d20de041 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:54.502041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33778b94-1cfc-4914-a818-ae46d20de041 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:54.502353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33778b94-1cfc-4914-a818-ae46d20de041 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:54.503039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b051ae-b530-4df0-9d87-cea35d5f4255 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:54.503162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33778b94-1cfc-4914-a818-ae46d20de041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:54.503329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b051ae-b530-4df0-9d87-cea35d5f4255 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:54.503644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b051ae-b530-4df0-9d87-cea35d5f4255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:54.504652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33778b94-1cfc-4914-a818-ae46d20de041 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:54.519300 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2146/4332] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:00:54 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:00:54.520596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33778b94-1cfc-4914-a818-ae46d20de041 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:54.521713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d0b051ae-b530-4df0-9d87-cea35d5f4255 None None] MFA Rules not processed for user `e80a2e31964348e7b4abd7c321e713b7`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:54.523017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d0b051ae-b530-4df0-9d87-cea35d5f4255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:54.530688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33778b94-1cfc-4914-a818-ae46d20de041 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:54.535395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd940ba0-6e32-4157-a037-024b4e4acba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:54.536036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd940ba0-6e32-4157-a037-024b4e4acba1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:54.536326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd940ba0-6e32-4157-a037-024b4e4acba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:54.536603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd940ba0-6e32-4157-a037-024b4e4acba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:54.537319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd940ba0-6e32-4157-a037-024b4e4acba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:54.538918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd940ba0-6e32-4157-a037-024b4e4acba1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:54.551186 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2147/4333] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:00:54 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:00:54.555178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd940ba0-6e32-4157-a037-024b4e4acba1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:54.564829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd940ba0-6e32-4157-a037-024b4e4acba1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:54.569981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdfb6f-3b1b-424d-a3cd-6134362ef773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:54.570908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdfb6f-3b1b-424d-a3cd-6134362ef773 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:54.571198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdfb6f-3b1b-424d-a3cd-6134362ef773 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:54.571480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdfb6f-3b1b-424d-a3cd-6134362ef773 admin admin] PATH_INFO: `/v3/projects/cd0d854b4dbc4609a90bb655f3adc132/users/a832b93ee54244f29be05f54f0eae567/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:54.580670 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2187/4334] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:54 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:54.587157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdfb6f-3b1b-424d-a3cd-6134362ef773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0d854b4dbc4609a90bb655f3adc132, user_id=a832b93ee54244f29be05f54f0eae567, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:54.589803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdfb6f-3b1b-424d-a3cd-6134362ef773 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:54.591607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f1293-9fd6-41b0-812d-0bde33c5df60 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:54.591901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f1293-9fd6-41b0-812d-0bde33c5df60 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:54.592179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f1293-9fd6-41b0-812d-0bde33c5df60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:54.604901 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2148/4335] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:00:54 2021] PUT /identity/v3/projects/cd0d854b4dbc4609a90bb655f3adc132/users/a832b93ee54244f29be05f54f0eae567/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:00:54.610993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d10f7-8c78-4b09-a7ad-18cac21a54bc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:54.611323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d10f7-8c78-4b09-a7ad-18cac21a54bc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:54.611577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d10f7-8c78-4b09-a7ad-18cac21a54bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:54.616802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fc8f1293-9fd6-41b0-812d-0bde33c5df60 None None] MFA Rules not processed for user `e80a2e31964348e7b4abd7c321e713b7`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:54.618511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fc8f1293-9fd6-41b0-812d-0bde33c5df60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:54.634956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-969d10f7-8c78-4b09-a7ad-18cac21a54bc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:54.636209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-969d10f7-8c78-4b09-a7ad-18cac21a54bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:54.682917 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2188/4336] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:54 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:54.700659 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2149/4337] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:00:54.710526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f1293-9fd6-41b0-812d-0bde33c5df60 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:54.727183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fc8f1293-9fd6-41b0-812d-0bde33c5df60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:54.801311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f1293-9fd6-41b0-812d-0bde33c5df60 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:54.805138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ee78e-11f9-4678-8504-05ac7e5a5548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:54.805859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ee78e-11f9-4678-8504-05ac7e5a5548 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:54.806213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ee78e-11f9-4678-8504-05ac7e5a5548 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:54.806591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ee78e-11f9-4678-8504-05ac7e5a5548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:54.816674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ee78e-11f9-4678-8504-05ac7e5a5548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:54.818098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ee78e-11f9-4678-8504-05ac7e5a5548 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:54.828255 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2189/4338] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:00:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:00:56.313891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cc36d-d18f-4a20-8c0a-b9139b701da0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:56.314764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cc36d-d18f-4a20-8c0a-b9139b701da0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:56.315302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cc36d-d18f-4a20-8c0a-b9139b701da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:56.345739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ae4cc36d-d18f-4a20-8c0a-b9139b701da0 None None] MFA Rules not processed for user `a832b93ee54244f29be05f54f0eae567`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:56.347522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ae4cc36d-d18f-4a20-8c0a-b9139b701da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:56.442656 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2150/4339] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:56 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:00:56.454130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c166c1f-b047-4e01-95ff-6608123fe182 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:56.455248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c166c1f-b047-4e01-95ff-6608123fe182 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:56.455542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c166c1f-b047-4e01-95ff-6608123fe182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:56.488819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9c166c1f-b047-4e01-95ff-6608123fe182 None None] MFA Rules not processed for user `a832b93ee54244f29be05f54f0eae567`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:56.490244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9c166c1f-b047-4e01-95ff-6608123fe182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:56.505710 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2190/4340] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:56 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:57.048294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cc36d-d18f-4a20-8c0a-b9139b701da0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:57.049798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ae4cc36d-d18f-4a20-8c0a-b9139b701da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:57.147844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cc36d-d18f-4a20-8c0a-b9139b701da0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:57.153920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bef033-b191-43c8-9116-b4d6f4da8439 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:57.154752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bef033-b191-43c8-9116-b4d6f4da8439 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:57.155088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bef033-b191-43c8-9116-b4d6f4da8439 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:57.155371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bef033-b191-43c8-9116-b4d6f4da8439 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:57.163678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bef033-b191-43c8-9116-b4d6f4da8439 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:57.165215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bef033-b191-43c8-9116-b4d6f4da8439 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:57.178890 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2151/4341] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:00:57 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:00:57.580646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c166c1f-b047-4e01-95ff-6608123fe182 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:57.582276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9c166c1f-b047-4e01-95ff-6608123fe182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:57.598238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c166c1f-b047-4e01-95ff-6608123fe182 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:57.603274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e38acf-ab5d-4e6d-a9bb-f0d04a8d6c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:57.604292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e38acf-ab5d-4e6d-a9bb-f0d04a8d6c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:57.604578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e38acf-ab5d-4e6d-a9bb-f0d04a8d6c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:57.604865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e38acf-ab5d-4e6d-a9bb-f0d04a8d6c0f admin admin] PATH_INFO: `/v3/users/7ca060b0759d4bb687977d2435ce74e9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:57.606292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e38acf-ab5d-4e6d-a9bb-f0d04a8d6c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca060b0759d4bb687977d2435ce74e9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:57.608722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e38acf-ab5d-4e6d-a9bb-f0d04a8d6c0f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:57.659066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-09e38acf-ab5d-4e6d-a9bb-f0d04a8d6c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca060b0759d4bb687977d2435ce74e9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:57.666282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-09e38acf-ab5d-4e6d-a9bb-f0d04a8d6c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca060b0759d4bb687977d2435ce74e9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:57.666962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-09e38acf-ab5d-4e6d-a9bb-f0d04a8d6c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca060b0759d4bb687977d2435ce74e9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:57.680447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-09e38acf-ab5d-4e6d-a9bb-f0d04a8d6c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca060b0759d4bb687977d2435ce74e9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:57.690119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-09e38acf-ab5d-4e6d-a9bb-f0d04a8d6c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca060b0759d4bb687977d2435ce74e9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:57.696853 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2191/4342] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:00:57 2021] DELETE /identity/v3/users/7ca060b0759d4bb687977d2435ce74e9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:57.891456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bef033-b191-43c8-9116-b4d6f4da8439 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:57.902485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bef033-b191-43c8-9116-b4d6f4da8439 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:58.009821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44221b-a15d-41c2-8aaf-18214bf5f8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:58.010717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44221b-a15d-41c2-8aaf-18214bf5f8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:58.011000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44221b-a15d-41c2-8aaf-18214bf5f8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:58.011279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44221b-a15d-41c2-8aaf-18214bf5f8a7 admin admin] PATH_INFO: `/v3/projects/0d7fb5d0ce9f40d2b55296706489a86a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:58.012514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44221b-a15d-41c2-8aaf-18214bf5f8a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d7fb5d0ce9f40d2b55296706489a86a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:58.015355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44221b-a15d-41c2-8aaf-18214bf5f8a7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:58.077345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ef44221b-a15d-41c2-8aaf-18214bf5f8a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d7fb5d0ce9f40d2b55296706489a86a', 'request_id': 'req-ef44221b-a15d-41c2-8aaf-18214bf5f8a7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:58.084697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ef44221b-a15d-41c2-8aaf-18214bf5f8a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d7fb5d0ce9f40d2b55296706489a86a', 'request_id': 'req-ef44221b-a15d-41c2-8aaf-18214bf5f8a7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:58.091618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ef44221b-a15d-41c2-8aaf-18214bf5f8a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d7fb5d0ce9f40d2b55296706489a86a', 'request_id': 'req-ef44221b-a15d-41c2-8aaf-18214bf5f8a7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:58.118589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ef44221b-a15d-41c2-8aaf-18214bf5f8a7 admin admin] The token cache is being invalidate because project 0d7fb5d0ce9f40d2b55296706489a86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:00:58.118888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ef44221b-a15d-41c2-8aaf-18214bf5f8a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:58.121249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ef44221b-a15d-41c2-8aaf-18214bf5f8a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:00:58.126553 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2152/4343] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:00:57 2021] DELETE /identity/v3/projects/0d7fb5d0ce9f40d2b55296706489a86a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:58.130229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d848b1-8c4a-483f-9c73-0eb212fc116e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:58.130692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d848b1-8c4a-483f-9c73-0eb212fc116e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:58.130971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d848b1-8c4a-483f-9c73-0eb212fc116e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:58.151913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-51d848b1-8c4a-483f-9c73-0eb212fc116e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:58.153420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-51d848b1-8c4a-483f-9c73-0eb212fc116e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:58.224323 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2192/4344] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:58.233602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c6d92-7887-4420-998a-27fced314201 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:58.233778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c6d92-7887-4420-998a-27fced314201 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:58.233979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c6d92-7887-4420-998a-27fced314201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:58.272554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-971c6d92-7887-4420-998a-27fced314201 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:58.274520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-971c6d92-7887-4420-998a-27fced314201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:58.288302 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2153/4345] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:00:58.292767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d848b1-8c4a-483f-9c73-0eb212fc116e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:58.305993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d848b1-8c4a-483f-9c73-0eb212fc116e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:58.314787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf131f-0615-486c-8441-eb3df4d1db6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:58.315845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf131f-0615-486c-8441-eb3df4d1db6a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:58.315994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf131f-0615-486c-8441-eb3df4d1db6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:58.316962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf131f-0615-486c-8441-eb3df4d1db6a admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:58.318407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf131f-0615-486c-8441-eb3df4d1db6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:00:58.318997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf131f-0615-486c-8441-eb3df4d1db6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:58.320860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf131f-0615-486c-8441-eb3df4d1db6a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:58.344064 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2193/4346] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:00:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:00:58.346235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c6d92-7887-4420-998a-27fced314201 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:58.358652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c6d92-7887-4420-998a-27fced314201 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:58.365062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bf7f0-1207-40c1-8ac6-b0e24f2711cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:58.366055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bf7f0-1207-40c1-8ac6-b0e24f2711cd admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:58.366457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bf7f0-1207-40c1-8ac6-b0e24f2711cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:58.366816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bf7f0-1207-40c1-8ac6-b0e24f2711cd admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:58.367672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bf7f0-1207-40c1-8ac6-b0e24f2711cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:58.369710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bf7f0-1207-40c1-8ac6-b0e24f2711cd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:58.411786 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2154/4347] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:00:58 2021] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:00:58.418703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf131f-0615-486c-8441-eb3df4d1db6a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:58.436286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf131f-0615-486c-8441-eb3df4d1db6a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:58.569647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc62bb-94e0-49ef-9ef1-471aa960c5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:58.574693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc62bb-94e0-49ef-9ef1-471aa960c5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:58.576701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc62bb-94e0-49ef-9ef1-471aa960c5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:58.576986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc62bb-94e0-49ef-9ef1-471aa960c5b0 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:58.577814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc62bb-94e0-49ef-9ef1-471aa960c5b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:58.580874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc62bb-94e0-49ef-9ef1-471aa960c5b0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:58.607490 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2194/4348] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:00:58 2021] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:00:58.612621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bf7f0-1207-40c1-8ac6-b0e24f2711cd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:58.626158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bf7f0-1207-40c1-8ac6-b0e24f2711cd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:58.633213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a3634-3dc0-4ec5-b89b-3f81ac45500b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:58.634019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a3634-3dc0-4ec5-b89b-3f81ac45500b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:58.634565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a3634-3dc0-4ec5-b89b-3f81ac45500b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:58.634847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a3634-3dc0-4ec5-b89b-3f81ac45500b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:58.635820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a3634-3dc0-4ec5-b89b-3f81ac45500b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:58.637507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a3634-3dc0-4ec5-b89b-3f81ac45500b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:58.650176 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2155/4349] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:00:58 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:00:58.654862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc62bb-94e0-49ef-9ef1-471aa960c5b0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:58.668306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc62bb-94e0-49ef-9ef1-471aa960c5b0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:58.680222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c67ed-c45e-41ea-b592-d224317aec00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:58.681096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c67ed-c45e-41ea-b592-d224317aec00 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:58.681447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c67ed-c45e-41ea-b592-d224317aec00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:58.681814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c67ed-c45e-41ea-b592-d224317aec00 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:58.682693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c67ed-c45e-41ea-b592-d224317aec00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:58.685084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c67ed-c45e-41ea-b592-d224317aec00 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:58.703155 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2195/4350] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:00:58 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:00:58.705335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a3634-3dc0-4ec5-b89b-3f81ac45500b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:58.721450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a3634-3dc0-4ec5-b89b-3f81ac45500b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:58.730820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a522c-df62-4343-a18c-51d828f4f447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:58.731877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a522c-df62-4343-a18c-51d828f4f447 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:58.733249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a522c-df62-4343-a18c-51d828f4f447 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:58.733719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a522c-df62-4343-a18c-51d828f4f447 admin admin] PATH_INFO: `/v3/projects/6e12ada67cbd430bbf671d34c0cc74f3/users/1a062c1000f94164ac8da89a383c22e0/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:58.758042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a522c-df62-4343-a18c-51d828f4f447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e12ada67cbd430bbf671d34c0cc74f3, user_id=1a062c1000f94164ac8da89a383c22e0, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:58.761216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a522c-df62-4343-a18c-51d828f4f447 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:58.785037 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2156/4351] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:00:58 2021] PUT /identity/v3/projects/6e12ada67cbd430bbf671d34c0cc74f3/users/1a062c1000f94164ac8da89a383c22e0/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:00:58.790533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ed042-1d8e-41c8-9917-ef7910e6dd1e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:58.790781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ed042-1d8e-41c8-9917-ef7910e6dd1e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:58.791052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ed042-1d8e-41c8-9917-ef7910e6dd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:58.813030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6d1ed042-1d8e-41c8-9917-ef7910e6dd1e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:00:58.814546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6d1ed042-1d8e-41c8-9917-ef7910e6dd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:58.912611 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2196/4352] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:00:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:00:58.923235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a522c-df62-4343-a18c-51d828f4f447 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:00:58.925018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a53a522c-df62-4343-a18c-51d828f4f447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:00:59.015132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a522c-df62-4343-a18c-51d828f4f447 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:00:59.019276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b039fc-cca7-4576-a2b7-7e16a27ee8a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:00:59.020658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b039fc-cca7-4576-a2b7-7e16a27ee8a8 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:00:59.020658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b039fc-cca7-4576-a2b7-7e16a27ee8a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:00:59.020658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b039fc-cca7-4576-a2b7-7e16a27ee8a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:00:59.035264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b039fc-cca7-4576-a2b7-7e16a27ee8a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:00:59.036720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b039fc-cca7-4576-a2b7-7e16a27ee8a8 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:00:59.049139 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2157/4353] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:00:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:01:08.348032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ed042-1d8e-41c8-9917-ef7910e6dd1e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:08.350183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6d1ed042-1d8e-41c8-9917-ef7910e6dd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:08.368508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ed042-1d8e-41c8-9917-ef7910e6dd1e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:08.382527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69af967-d0ee-445c-a1f2-3a984cbfda12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:08.384595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af967-d0ee-445c-a1f2-3a984cbfda12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:08.385988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af967-d0ee-445c-a1f2-3a984cbfda12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:08.388495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af967-d0ee-445c-a1f2-3a984cbfda12 admin admin] PATH_INFO: `/v3/users/7d31494c29fc4f62b4a28f384fc15c13` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:08.391278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69af967-d0ee-445c-a1f2-3a984cbfda12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d31494c29fc4f62b4a28f384fc15c13)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:08.393926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69af967-d0ee-445c-a1f2-3a984cbfda12 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:08.508767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5282c-c2c6-47dd-8466-de7794cb8278 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:08.509844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5282c-c2c6-47dd-8466-de7794cb8278 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:08.510964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5282c-c2c6-47dd-8466-de7794cb8278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:08.514146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e69af967-d0ee-445c-a1f2-3a984cbfda12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d31494c29fc4f62b4a28f384fc15c13'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:08.524358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e69af967-d0ee-445c-a1f2-3a984cbfda12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d31494c29fc4f62b4a28f384fc15c13'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:08.525716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e69af967-d0ee-445c-a1f2-3a984cbfda12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d31494c29fc4f62b4a28f384fc15c13'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:08.543578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e69af967-d0ee-445c-a1f2-3a984cbfda12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d31494c29fc4f62b4a28f384fc15c13'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:08.553981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-19b5282c-c2c6-47dd-8466-de7794cb8278 None None] MFA Rules not processed for user `1a062c1000f94164ac8da89a383c22e0`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:08.555899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-19b5282c-c2c6-47dd-8466-de7794cb8278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:08.570699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e69af967-d0ee-445c-a1f2-3a984cbfda12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d31494c29fc4f62b4a28f384fc15c13'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:08.579153 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2197/4354] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:08 2021] DELETE /identity/v3/users/7d31494c29fc4f62b4a28f384fc15c13 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:08.586838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d790f5-31b3-46b4-8b69-53fe857ae6e1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:08.587309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d790f5-31b3-46b4-8b69-53fe857ae6e1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:08.587809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d790f5-31b3-46b4-8b69-53fe857ae6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:08.619547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a7d790f5-31b3-46b4-8b69-53fe857ae6e1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:08.621640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a7d790f5-31b3-46b4-8b69-53fe857ae6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:08.642931 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2158/4355] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:08 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:08.717845 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2198/4356] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:08.728346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5282c-c2c6-47dd-8466-de7794cb8278 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:08.729994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-19b5282c-c2c6-47dd-8466-de7794cb8278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:08.748587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5282c-c2c6-47dd-8466-de7794cb8278 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:08.810986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36368b05-8175-4df9-8a09-def293e52cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:08.811653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36368b05-8175-4df9-8a09-def293e52cee service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:08.812127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36368b05-8175-4df9-8a09-def293e52cee service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:08.812684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36368b05-8175-4df9-8a09-def293e52cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:08.840202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36368b05-8175-4df9-8a09-def293e52cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:08.841714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36368b05-8175-4df9-8a09-def293e52cee service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:08.845369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d790f5-31b3-46b4-8b69-53fe857ae6e1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:08.847855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a7d790f5-31b3-46b4-8b69-53fe857ae6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:08.855070 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2159/4357] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:01:08.944824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d790f5-31b3-46b4-8b69-53fe857ae6e1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:08.953923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acf820-21f4-457b-a320-58ae8a63186d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:08.955056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acf820-21f4-457b-a320-58ae8a63186d service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:08.955056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acf820-21f4-457b-a320-58ae8a63186d service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:08.955393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acf820-21f4-457b-a320-58ae8a63186d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:09.036368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acf820-21f4-457b-a320-58ae8a63186d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:09.038093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acf820-21f4-457b-a320-58ae8a63186d service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:09.053017 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2199/4358] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:08 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:01:09.175088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36368b05-8175-4df9-8a09-def293e52cee service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:09.176571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-36368b05-8175-4df9-8a09-def293e52cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:09.202124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36368b05-8175-4df9-8a09-def293e52cee service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:09.212735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d138d0-1d12-4b86-aea7-07cf7a609009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:09.222552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d138d0-1d12-4b86-aea7-07cf7a609009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:09.223145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d138d0-1d12-4b86-aea7-07cf7a609009 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:09.223583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d138d0-1d12-4b86-aea7-07cf7a609009 admin admin] PATH_INFO: `/v3/projects/f77a53112c4344578a937b3f9396e848` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:09.227504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d138d0-1d12-4b86-aea7-07cf7a609009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77a53112c4344578a937b3f9396e848)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:09.232655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d138d0-1d12-4b86-aea7-07cf7a609009 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:09.346208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-94d138d0-1d12-4b86-aea7-07cf7a609009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77a53112c4344578a937b3f9396e848', 'request_id': 'req-94d138d0-1d12-4b86-aea7-07cf7a609009'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:09.362866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-94d138d0-1d12-4b86-aea7-07cf7a609009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77a53112c4344578a937b3f9396e848', 'request_id': 'req-94d138d0-1d12-4b86-aea7-07cf7a609009'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:09.379474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-94d138d0-1d12-4b86-aea7-07cf7a609009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77a53112c4344578a937b3f9396e848', 'request_id': 'req-94d138d0-1d12-4b86-aea7-07cf7a609009'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:09.403750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-94d138d0-1d12-4b86-aea7-07cf7a609009 admin admin] The token cache is being invalidate because project f77a53112c4344578a937b3f9396e848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:09.410592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-94d138d0-1d12-4b86-aea7-07cf7a609009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:09.411501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-94d138d0-1d12-4b86-aea7-07cf7a609009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:09.413073 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2160/4359] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:09 2021] DELETE /identity/v3/projects/f77a53112c4344578a937b3f9396e848 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:09.420295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40da604-e98c-4413-b8c8-c484dd5aea30 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:09.420845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40da604-e98c-4413-b8c8-c484dd5aea30 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:09.420984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40da604-e98c-4413-b8c8-c484dd5aea30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:09.463077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a40da604-e98c-4413-b8c8-c484dd5aea30 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:09.464736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a40da604-e98c-4413-b8c8-c484dd5aea30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:09.592626 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2200/4360] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:09.594001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869feff-3ef5-4647-83fc-9cc62b3d7654 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:09.594528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869feff-3ef5-4647-83fc-9cc62b3d7654 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:09.594670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869feff-3ef5-4647-83fc-9cc62b3d7654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:09.632185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d869feff-3ef5-4647-83fc-9cc62b3d7654 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:09.633651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d869feff-3ef5-4647-83fc-9cc62b3d7654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:09.652933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40da604-e98c-4413-b8c8-c484dd5aea30 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:09.662671 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2161/4361] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:09.666131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40da604-e98c-4413-b8c8-c484dd5aea30 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:09.672481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e495fe-90a6-42bc-be7c-eb4dcfd59c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:09.673527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e495fe-90a6-42bc-be7c-eb4dcfd59c63 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:09.674524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e495fe-90a6-42bc-be7c-eb4dcfd59c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:09.675047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e495fe-90a6-42bc-be7c-eb4dcfd59c63 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:09.676748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e495fe-90a6-42bc-be7c-eb4dcfd59c63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:01:09.677378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e495fe-90a6-42bc-be7c-eb4dcfd59c63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:09.690132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e495fe-90a6-42bc-be7c-eb4dcfd59c63 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:09.712178 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2201/4362] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:01:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:09.712400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869feff-3ef5-4647-83fc-9cc62b3d7654 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:09.725571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869feff-3ef5-4647-83fc-9cc62b3d7654 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:09.743910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf1254-add1-41ed-9416-63f5968f8b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:09.744749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf1254-add1-41ed-9416-63f5968f8b9d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:09.745037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf1254-add1-41ed-9416-63f5968f8b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:09.745316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf1254-add1-41ed-9416-63f5968f8b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:09.746035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf1254-add1-41ed-9416-63f5968f8b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:09.748128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf1254-add1-41ed-9416-63f5968f8b9d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:09.809596 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2162/4363] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:09 2021] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:09.817845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e495fe-90a6-42bc-be7c-eb4dcfd59c63 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:09.843307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e495fe-90a6-42bc-be7c-eb4dcfd59c63 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:09.927553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a2bbc-e92a-4686-9415-adf4180e4162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:09.928987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a2bbc-e92a-4686-9415-adf4180e4162 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:09.929856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a2bbc-e92a-4686-9415-adf4180e4162 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:09.930524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a2bbc-e92a-4686-9415-adf4180e4162 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:09.932779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a2bbc-e92a-4686-9415-adf4180e4162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:09.937677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a2bbc-e92a-4686-9415-adf4180e4162 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:09.971662 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2202/4364] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:09 2021] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:09.976331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf1254-add1-41ed-9416-63f5968f8b9d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:09.989824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf1254-add1-41ed-9416-63f5968f8b9d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:09.997352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b2457-82d4-4aa6-8562-df67e621dfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:09.998542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b2457-82d4-4aa6-8562-df67e621dfc8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:09.999031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b2457-82d4-4aa6-8562-df67e621dfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:09.999532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b2457-82d4-4aa6-8562-df67e621dfc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:10.000789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b2457-82d4-4aa6-8562-df67e621dfc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:10.003799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b2457-82d4-4aa6-8562-df67e621dfc8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:10.027873 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2163/4365] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:09 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:10.032386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a2bbc-e92a-4686-9415-adf4180e4162 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:10.046340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a2bbc-e92a-4686-9415-adf4180e4162 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:10.055708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf30415-66fd-4f14-a3d6-2a6d13aebcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:10.056652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf30415-66fd-4f14-a3d6-2a6d13aebcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:10.057110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf30415-66fd-4f14-a3d6-2a6d13aebcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:10.058103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf30415-66fd-4f14-a3d6-2a6d13aebcc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:10.060883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf30415-66fd-4f14-a3d6-2a6d13aebcc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:10.063942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf30415-66fd-4f14-a3d6-2a6d13aebcc7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:10.081878 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2203/4366] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:10 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:10.085984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b2457-82d4-4aa6-8562-df67e621dfc8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:10.103770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b2457-82d4-4aa6-8562-df67e621dfc8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:10.110826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c0df3-0bcd-41c1-83c2-7d0d6ec06512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:10.112675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c0df3-0bcd-41c1-83c2-7d0d6ec06512 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:10.113164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c0df3-0bcd-41c1-83c2-7d0d6ec06512 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:10.113626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c0df3-0bcd-41c1-83c2-7d0d6ec06512 admin admin] PATH_INFO: `/v3/projects/ac3feffe1ea94b838e64069470ea9862/users/79d04306b7d24e96bfb99a2707d24695/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:10.181325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c0df3-0bcd-41c1-83c2-7d0d6ec06512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac3feffe1ea94b838e64069470ea9862, user_id=79d04306b7d24e96bfb99a2707d24695, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:10.208440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c0df3-0bcd-41c1-83c2-7d0d6ec06512 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:10.238729 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2164/4367] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:10 2021] PUT /identity/v3/projects/ac3feffe1ea94b838e64069470ea9862/users/79d04306b7d24e96bfb99a2707d24695/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:10.251444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb93e8-419a-42d2-97d7-5b4afdad5690 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:10.251982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb93e8-419a-42d2-97d7-5b4afdad5690 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:10.252468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb93e8-419a-42d2-97d7-5b4afdad5690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:10.355558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c0fb93e8-419a-42d2-97d7-5b4afdad5690 None None] MFA Rules not processed for user `79d04306b7d24e96bfb99a2707d24695`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:10.360942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c0fb93e8-419a-42d2-97d7-5b4afdad5690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:10.542963 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2204/4368] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:10 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:10.546809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ef9af-0693-4e27-aead-48ddcdd0542c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:10.547263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ef9af-0693-4e27-aead-48ddcdd0542c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:10.547702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ef9af-0693-4e27-aead-48ddcdd0542c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:10.578300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-832ef9af-0693-4e27-aead-48ddcdd0542c None None] MFA Rules not processed for user `79d04306b7d24e96bfb99a2707d24695`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:10.579620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-832ef9af-0693-4e27-aead-48ddcdd0542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:10.597059 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2165/4369] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:10 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:10.612347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb93e8-419a-42d2-97d7-5b4afdad5690 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:10.613907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c0fb93e8-419a-42d2-97d7-5b4afdad5690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:10.702794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb93e8-419a-42d2-97d7-5b4afdad5690 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:10.723036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721486ac-57a4-41a5-ab79-82b3ab1852c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:10.723713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721486ac-57a4-41a5-ab79-82b3ab1852c8 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:10.724266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721486ac-57a4-41a5-ab79-82b3ab1852c8 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:10.724266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721486ac-57a4-41a5-ab79-82b3ab1852c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:10.743921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721486ac-57a4-41a5-ab79-82b3ab1852c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:10.746288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721486ac-57a4-41a5-ab79-82b3ab1852c8 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:10.758972 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2205/4370] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:10 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:01:12.306476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936be59-7a0f-4aca-a694-c06c456cadea None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:12.306997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936be59-7a0f-4aca-a694-c06c456cadea None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:12.307112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936be59-7a0f-4aca-a694-c06c456cadea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:12.356552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a936be59-7a0f-4aca-a694-c06c456cadea None None] MFA Rules not processed for user `54121b5d80d64c4796889183c5197853`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:12.360419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a936be59-7a0f-4aca-a694-c06c456cadea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:12.552416 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2166/4371] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:12 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:14.957622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55502de-dec3-4614-a681-a219ad3eb935 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:14.958138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55502de-dec3-4614-a681-a219ad3eb935 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:14.959150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55502de-dec3-4614-a681-a219ad3eb935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:14.988341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d55502de-dec3-4614-a681-a219ad3eb935 None None] MFA Rules not processed for user `1a062c1000f94164ac8da89a383c22e0`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:14.990893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d55502de-dec3-4614-a681-a219ad3eb935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:15.116351 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2206/4372] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:14 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:23.015079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936be59-7a0f-4aca-a694-c06c456cadea None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:23.017060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a936be59-7a0f-4aca-a694-c06c456cadea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:23.095773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936be59-7a0f-4aca-a694-c06c456cadea None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:23.100491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4ae44-55e9-4614-8f07-d26936f65a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:23.101364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4ae44-55e9-4614-8f07-d26936f65a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:23.101649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4ae44-55e9-4614-8f07-d26936f65a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:23.101931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4ae44-55e9-4614-8f07-d26936f65a45 admin admin] PATH_INFO: `/v3/users/a832b93ee54244f29be05f54f0eae567` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:23.103196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4ae44-55e9-4614-8f07-d26936f65a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a832b93ee54244f29be05f54f0eae567)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:23.105105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4ae44-55e9-4614-8f07-d26936f65a45 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:23.150421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f8d4ae44-55e9-4614-8f07-d26936f65a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a832b93ee54244f29be05f54f0eae567'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:23.157781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f8d4ae44-55e9-4614-8f07-d26936f65a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a832b93ee54244f29be05f54f0eae567'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:23.169265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f8d4ae44-55e9-4614-8f07-d26936f65a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a832b93ee54244f29be05f54f0eae567'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:23.169997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f8d4ae44-55e9-4614-8f07-d26936f65a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a832b93ee54244f29be05f54f0eae567'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:23.182334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f8d4ae44-55e9-4614-8f07-d26936f65a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a832b93ee54244f29be05f54f0eae567'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:23.193469 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2167/4373] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:23 2021] DELETE /identity/v3/users/a832b93ee54244f29be05f54f0eae567 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:23.556472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55502de-dec3-4614-a681-a219ad3eb935 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:23.571533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55502de-dec3-4614-a681-a219ad3eb935 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:23.727149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc087d-11f0-4749-bee2-fb2e331e3706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:23.729924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc087d-11f0-4749-bee2-fb2e331e3706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:23.731453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc087d-11f0-4749-bee2-fb2e331e3706 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:23.731754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc087d-11f0-4749-bee2-fb2e331e3706 admin admin] PATH_INFO: `/v3/projects/cd0d854b4dbc4609a90bb655f3adc132` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:23.735282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc087d-11f0-4749-bee2-fb2e331e3706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0d854b4dbc4609a90bb655f3adc132)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:23.739699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc087d-11f0-4749-bee2-fb2e331e3706 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:23.890596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-29fc087d-11f0-4749-bee2-fb2e331e3706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0d854b4dbc4609a90bb655f3adc132', 'request_id': 'req-29fc087d-11f0-4749-bee2-fb2e331e3706'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:23.901740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-29fc087d-11f0-4749-bee2-fb2e331e3706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0d854b4dbc4609a90bb655f3adc132', 'request_id': 'req-29fc087d-11f0-4749-bee2-fb2e331e3706'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:23.921772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-29fc087d-11f0-4749-bee2-fb2e331e3706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0d854b4dbc4609a90bb655f3adc132', 'request_id': 'req-29fc087d-11f0-4749-bee2-fb2e331e3706'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:23.939639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-29fc087d-11f0-4749-bee2-fb2e331e3706 admin admin] The token cache is being invalidate because project cd0d854b4dbc4609a90bb655f3adc132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:23.944943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4ae44-55e9-4614-8f07-d26936f65a45 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:23.945140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-29fc087d-11f0-4749-bee2-fb2e331e3706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:23.945881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f8d4ae44-55e9-4614-8f07-d26936f65a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:23.946417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-29fc087d-11f0-4749-bee2-fb2e331e3706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:23.952012 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2207/4374] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:23 2021] DELETE /identity/v3/projects/cd0d854b4dbc4609a90bb655f3adc132 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:23.960846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0c2b6-224d-4740-9e4b-93a00ad6761a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:23.961945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0c2b6-224d-4740-9e4b-93a00ad6761a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:23.962671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0c2b6-224d-4740-9e4b-93a00ad6761a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:23.969564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4ae44-55e9-4614-8f07-d26936f65a45 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:23.996338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-dfd0c2b6-224d-4740-9e4b-93a00ad6761a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:23.998388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dfd0c2b6-224d-4740-9e4b-93a00ad6761a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:24.070433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60433e-29f4-4652-b442-367395f10380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:24.073199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60433e-29f4-4652-b442-367395f10380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:24.075057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60433e-29f4-4652-b442-367395f10380 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:24.075589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60433e-29f4-4652-b442-367395f10380 admin admin] PATH_INFO: `/v3/users/4196dd207ce543d3bdd5f48ae57e156a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:24.083070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60433e-29f4-4652-b442-367395f10380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4196dd207ce543d3bdd5f48ae57e156a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:24.086563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60433e-29f4-4652-b442-367395f10380 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:24.147381 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2208/4375] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:24.157065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e329d7-2c16-42d9-a7a8-ba4e88684c4d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:24.157716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e329d7-2c16-42d9-a7a8-ba4e88684c4d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:24.158536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e329d7-2c16-42d9-a7a8-ba4e88684c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:24.168722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-df60433e-29f4-4652-b442-367395f10380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4196dd207ce543d3bdd5f48ae57e156a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:24.181382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b7e329d7-2c16-42d9-a7a8-ba4e88684c4d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:24.183273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b7e329d7-2c16-42d9-a7a8-ba4e88684c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:24.187937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-df60433e-29f4-4652-b442-367395f10380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4196dd207ce543d3bdd5f48ae57e156a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:24.194191 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2209/4376] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:24.197935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e329d7-2c16-42d9-a7a8-ba4e88684c4d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:24.211505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-df60433e-29f4-4652-b442-367395f10380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4196dd207ce543d3bdd5f48ae57e156a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:24.212185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-df60433e-29f4-4652-b442-367395f10380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4196dd207ce543d3bdd5f48ae57e156a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:24.212901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e329d7-2c16-42d9-a7a8-ba4e88684c4d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:24.223762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-df60433e-29f4-4652-b442-367395f10380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4196dd207ce543d3bdd5f48ae57e156a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:24.228205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25289fe8-872b-4199-a083-f50f851c1a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:24.228877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25289fe8-872b-4199-a083-f50f851c1a2c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:24.229160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25289fe8-872b-4199-a083-f50f851c1a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:24.229437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25289fe8-872b-4199-a083-f50f851c1a2c admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:24.230175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25289fe8-872b-4199-a083-f50f851c1a2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:01:24.231158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25289fe8-872b-4199-a083-f50f851c1a2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:24.232771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25289fe8-872b-4199-a083-f50f851c1a2c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:24.242592 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2168/4377] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:23 2021] DELETE /identity/v3/users/4196dd207ce543d3bdd5f48ae57e156a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:24.256782 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2210/4378] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:01:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:24.265335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60433e-29f4-4652-b442-367395f10380 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:24.274277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-df60433e-29f4-4652-b442-367395f10380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:24.361734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60433e-29f4-4652-b442-367395f10380 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:24.366817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0702a-9b9e-43fb-a4fa-c9dba64f0ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:24.367493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0702a-9b9e-43fb-a4fa-c9dba64f0ada admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:24.367831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0702a-9b9e-43fb-a4fa-c9dba64f0ada admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:24.368179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0702a-9b9e-43fb-a4fa-c9dba64f0ada admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:24.368771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0702a-9b9e-43fb-a4fa-c9dba64f0ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:24.370732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0702a-9b9e-43fb-a4fa-c9dba64f0ada admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:24.426340 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2169/4379] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:24 2021] POST /identity/v3/projects => generated 363 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:24.430085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25289fe8-872b-4199-a083-f50f851c1a2c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:24.441077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25289fe8-872b-4199-a083-f50f851c1a2c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:24.488763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0702a-9b9e-43fb-a4fa-c9dba64f0ada admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:24.490768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a5f0702a-9b9e-43fb-a4fa-c9dba64f0ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:24.521621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787ed76-a5e0-4907-bfa9-5ce2c751ff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:24.522713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787ed76-a5e0-4907-bfa9-5ce2c751ff5d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:24.523788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787ed76-a5e0-4907-bfa9-5ce2c751ff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:24.524149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787ed76-a5e0-4907-bfa9-5ce2c751ff5d admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:24.524949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787ed76-a5e0-4907-bfa9-5ce2c751ff5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:24.540436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787ed76-a5e0-4907-bfa9-5ce2c751ff5d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:24.581558 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2211/4380] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:24 2021] POST /identity/v3/users => generated 282 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:24.585821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787ed76-a5e0-4907-bfa9-5ce2c751ff5d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:24.608081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787ed76-a5e0-4907-bfa9-5ce2c751ff5d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:24.615753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba471af-af3f-4479-8a2a-218bb35a015d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:24.616801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba471af-af3f-4479-8a2a-218bb35a015d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:24.617440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba471af-af3f-4479-8a2a-218bb35a015d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:24.618103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba471af-af3f-4479-8a2a-218bb35a015d admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:24.619166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba471af-af3f-4479-8a2a-218bb35a015d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:24.622521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba471af-af3f-4479-8a2a-218bb35a015d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:24.633498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0702a-9b9e-43fb-a4fa-c9dba64f0ada admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:24.635675 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2212/4381] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:24 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:24.639721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011c914-8c97-4be5-91f5-f92b2c8f6bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:24.640452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba471af-af3f-4479-8a2a-218bb35a015d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:24.641200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011c914-8c97-4be5-91f5-f92b2c8f6bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:24.641489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011c914-8c97-4be5-91f5-f92b2c8f6bda admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:24.641769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011c914-8c97-4be5-91f5-f92b2c8f6bda admin admin] PATH_INFO: `/v3/projects/d1b96ca6ed964b6a9db0ed2249251328` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:24.643160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011c914-8c97-4be5-91f5-f92b2c8f6bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b96ca6ed964b6a9db0ed2249251328)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:24.645112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011c914-8c97-4be5-91f5-f92b2c8f6bda admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:24.653079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba471af-af3f-4479-8a2a-218bb35a015d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:24.659068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913934ad-3137-4dde-8262-acce31b8bcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:24.660212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913934ad-3137-4dde-8262-acce31b8bcac admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:24.661166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913934ad-3137-4dde-8262-acce31b8bcac admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:24.661681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913934ad-3137-4dde-8262-acce31b8bcac admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:24.662694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913934ad-3137-4dde-8262-acce31b8bcac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:24.672293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913934ad-3137-4dde-8262-acce31b8bcac admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:24.688663 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2213/4382] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:24 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:24.694315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913934ad-3137-4dde-8262-acce31b8bcac admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:24.707617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e011c914-8c97-4be5-91f5-f92b2c8f6bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b96ca6ed964b6a9db0ed2249251328', 'request_id': 'req-e011c914-8c97-4be5-91f5-f92b2c8f6bda'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:24.708434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913934ad-3137-4dde-8262-acce31b8bcac admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:24.722885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e011c914-8c97-4be5-91f5-f92b2c8f6bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b96ca6ed964b6a9db0ed2249251328', 'request_id': 'req-e011c914-8c97-4be5-91f5-f92b2c8f6bda'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:24.732176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e011c914-8c97-4be5-91f5-f92b2c8f6bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b96ca6ed964b6a9db0ed2249251328', 'request_id': 'req-e011c914-8c97-4be5-91f5-f92b2c8f6bda'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:24.756594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e011c914-8c97-4be5-91f5-f92b2c8f6bda admin admin] The token cache is being invalidate because project d1b96ca6ed964b6a9db0ed2249251328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:24.757431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e011c914-8c97-4be5-91f5-f92b2c8f6bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:24.758573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e011c914-8c97-4be5-91f5-f92b2c8f6bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:24.762577 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2170/4383] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:24 2021] DELETE /identity/v3/projects/d1b96ca6ed964b6a9db0ed2249251328 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:24.770850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128241c-3691-4f77-bd2a-a94b25aaf775 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:24.771978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128241c-3691-4f77-bd2a-a94b25aaf775 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:24.772865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128241c-3691-4f77-bd2a-a94b25aaf775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:24.795527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9128241c-3691-4f77-bd2a-a94b25aaf775 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:24.795794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0f5a7-17b3-4cae-b303-7fa914d57e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:24.796670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0f5a7-17b3-4cae-b303-7fa914d57e57 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:24.796949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0f5a7-17b3-4cae-b303-7fa914d57e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:24.797226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0f5a7-17b3-4cae-b303-7fa914d57e57 admin admin] PATH_INFO: `/v3/projects/a6b4b2946be6470cbec140a2c207c2df/users/073a758d401343dda8ccee52685986bf/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:24.798074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9128241c-3691-4f77-bd2a-a94b25aaf775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:24.813992 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2171/4384] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:24.823104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387256eb-bcba-4b18-b43d-a30a26f7612d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:24.823395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0f5a7-17b3-4cae-b303-7fa914d57e57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b4b2946be6470cbec140a2c207c2df, user_id=073a758d401343dda8ccee52685986bf, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:24.823521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387256eb-bcba-4b18-b43d-a30a26f7612d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:24.823875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387256eb-bcba-4b18-b43d-a30a26f7612d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:24.827090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0f5a7-17b3-4cae-b303-7fa914d57e57 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:24.848964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-387256eb-bcba-4b18-b43d-a30a26f7612d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:24.850198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-387256eb-bcba-4b18-b43d-a30a26f7612d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:24.863383 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2214/4385] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:24 2021] PUT /identity/v3/projects/a6b4b2946be6470cbec140a2c207c2df/users/073a758d401343dda8ccee52685986bf/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:24.875211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b918dfc-13ee-4e24-b6f8-64225a6873d5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:24.875211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b918dfc-13ee-4e24-b6f8-64225a6873d5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:24.875661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b918dfc-13ee-4e24-b6f8-64225a6873d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:24.908743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4b918dfc-13ee-4e24-b6f8-64225a6873d5 None None] MFA Rules not processed for user `073a758d401343dda8ccee52685986bf`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:24.910764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4b918dfc-13ee-4e24-b6f8-64225a6873d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:24.957019 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2172/4386] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:24.962302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387256eb-bcba-4b18-b43d-a30a26f7612d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:24.972834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387256eb-bcba-4b18-b43d-a30a26f7612d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:24.979005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e599d-0720-405c-8856-8297e2081675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:24.980119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e599d-0720-405c-8856-8297e2081675 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:24.980665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e599d-0720-405c-8856-8297e2081675 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:24.981097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e599d-0720-405c-8856-8297e2081675 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:24.981995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e599d-0720-405c-8856-8297e2081675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:01:24.982521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e599d-0720-405c-8856-8297e2081675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:24.984528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e599d-0720-405c-8856-8297e2081675 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:25.003574 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2173/4387] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:01:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:25.004835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e599d-0720-405c-8856-8297e2081675 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:25.018416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e599d-0720-405c-8856-8297e2081675 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:25.021716 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2215/4388] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:24 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:25.026050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06c1e9-ffe5-4b9a-b162-43e224fdb9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:25.027566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06c1e9-ffe5-4b9a-b162-43e224fdb9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:25.028194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06c1e9-ffe5-4b9a-b162-43e224fdb9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:25.028644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06c1e9-ffe5-4b9a-b162-43e224fdb9d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:25.029543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06c1e9-ffe5-4b9a-b162-43e224fdb9d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:25.031668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06c1e9-ffe5-4b9a-b162-43e224fdb9d3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:25.038539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b918dfc-13ee-4e24-b6f8-64225a6873d5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:25.040573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4b918dfc-13ee-4e24-b6f8-64225a6873d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:25.084749 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2174/4389] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:25 2021] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:25.092004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06c1e9-ffe5-4b9a-b162-43e224fdb9d3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:25.162545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b918dfc-13ee-4e24-b6f8-64225a6873d5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:25.188472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06c1e9-ffe5-4b9a-b162-43e224fdb9d3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:25.194859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f071f42-b065-4a64-91a1-d947e647c87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:25.195759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f071f42-b065-4a64-91a1-d947e647c87e admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:25.196672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f071f42-b065-4a64-91a1-d947e647c87e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:25.196964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f071f42-b065-4a64-91a1-d947e647c87e admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:25.198048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f071f42-b065-4a64-91a1-d947e647c87e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:25.199866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f071f42-b065-4a64-91a1-d947e647c87e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:25.223165 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2175/4390] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:25 2021] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:25.227182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f071f42-b065-4a64-91a1-d947e647c87e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:25.238136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f071f42-b065-4a64-91a1-d947e647c87e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:25.241976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc619be-ea89-42cd-9648-d22ad06faea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:25.242850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e648f-1e80-4f0e-9cbe-f63ada16931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:25.242979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc619be-ea89-42cd-9648-d22ad06faea6 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:25.243142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc619be-ea89-42cd-9648-d22ad06faea6 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:25.243513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e648f-1e80-4f0e-9cbe-f63ada16931b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:25.243626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc619be-ea89-42cd-9648-d22ad06faea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:25.243800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e648f-1e80-4f0e-9cbe-f63ada16931b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:25.244109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e648f-1e80-4f0e-9cbe-f63ada16931b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:25.244817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e648f-1e80-4f0e-9cbe-f63ada16931b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:25.247009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e648f-1e80-4f0e-9cbe-f63ada16931b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:25.257769 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2176/4391] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:25 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:25.263901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e648f-1e80-4f0e-9cbe-f63ada16931b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:25.284658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e648f-1e80-4f0e-9cbe-f63ada16931b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:25.289475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da65a82-cbd7-4ead-b88c-5237c24d379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:25.290884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da65a82-cbd7-4ead-b88c-5237c24d379d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:25.290884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da65a82-cbd7-4ead-b88c-5237c24d379d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:25.290884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da65a82-cbd7-4ead-b88c-5237c24d379d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:25.291666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da65a82-cbd7-4ead-b88c-5237c24d379d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:25.294066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da65a82-cbd7-4ead-b88c-5237c24d379d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:25.310968 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2177/4392] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:25 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:25.311789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da65a82-cbd7-4ead-b88c-5237c24d379d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:25.323826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da65a82-cbd7-4ead-b88c-5237c24d379d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:25.331347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc619be-ea89-42cd-9648-d22ad06faea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:25.333642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc619be-ea89-42cd-9648-d22ad06faea6 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:25.334115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984d724-aacb-4111-a89d-9377f26dcaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:25.335276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984d724-aacb-4111-a89d-9377f26dcaec admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:25.335630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984d724-aacb-4111-a89d-9377f26dcaec admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:25.335972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984d724-aacb-4111-a89d-9377f26dcaec admin admin] PATH_INFO: `/v3/projects/af066c5e8e15477ab5acbcbc698fbaa3/users/536ba28f55204625985ab42816541991/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:25.354473 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2216/4393] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:25 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:01:25.364075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984d724-aacb-4111-a89d-9377f26dcaec admin admin] RBAC: Authorizing `identity:create_grant(project_id=af066c5e8e15477ab5acbcbc698fbaa3, user_id=536ba28f55204625985ab42816541991, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:25.367203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984d724-aacb-4111-a89d-9377f26dcaec admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:25.379618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebf966-1f98-4736-98d8-8d17883bd32d None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:25.379995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebf966-1f98-4736-98d8-8d17883bd32d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:25.380349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebf966-1f98-4736-98d8-8d17883bd32d None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:25.382954 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2217/4394] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 21:01:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 21:01:25.390208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebf966-1f98-4736-98d8-8d17883bd32d None None] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 21:01:25.402421 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2178/4395] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:25 2021] PUT /identity/v3/projects/af066c5e8e15477ab5acbcbc698fbaa3/users/536ba28f55204625985ab42816541991/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:25.411807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3345f5-52ac-4605-8f71-66cbc31ea0d9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:25.412110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3345f5-52ac-4605-8f71-66cbc31ea0d9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:25.412452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3345f5-52ac-4605-8f71-66cbc31ea0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:25.479993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7c3345f5-52ac-4605-8f71-66cbc31ea0d9 None None] MFA Rules not processed for user `536ba28f55204625985ab42816541991`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:25.482068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7c3345f5-52ac-4605-8f71-66cbc31ea0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:25.544880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebf966-1f98-4736-98d8-8d17883bd32d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:25.603028 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2179/4396] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:25 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:25.609129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3345f5-52ac-4605-8f71-66cbc31ea0d9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:25.665225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebf966-1f98-4736-98d8-8d17883bd32d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:25.678951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e399325-1935-4392-b5fd-6371d935e086 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '073a758d401343dda8ccee52685986bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6b4b2946be6470cbec140a2c207c2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:25.679822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e399325-1935-4392-b5fd-6371d935e086 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:25.680107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e399325-1935-4392-b5fd-6371d935e086 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:25.680391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e399325-1935-4392-b5fd-6371d935e086 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] PATH_INFO: `/v3/projects/a6b4b2946be6470cbec140a2c207c2df` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:25.687688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e399325-1935-4392-b5fd-6371d935e086 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] RBAC: Authorizing `identity:get_project(project_id=a6b4b2946be6470cbec140a2c207c2df)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:25.689800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e399325-1935-4392-b5fd-6371d935e086 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:25.695982 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2218/4397] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 21:01:25 2021] GET /identity/v3/projects/a6b4b2946be6470cbec140a2c207c2df => generated 363 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:25.735439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3345f5-52ac-4605-8f71-66cbc31ea0d9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:25.744653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c048122-ddb8-4205-b82e-3aeb9a38ae57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:25.745846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c048122-ddb8-4205-b82e-3aeb9a38ae57 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:25.747622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c048122-ddb8-4205-b82e-3aeb9a38ae57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:25.749558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c048122-ddb8-4205-b82e-3aeb9a38ae57 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:25.750786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c048122-ddb8-4205-b82e-3aeb9a38ae57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:25.753596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c048122-ddb8-4205-b82e-3aeb9a38ae57 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:25.794298 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2180/4398] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:25 2021] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:25.797781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e399325-1935-4392-b5fd-6371d935e086 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:25.818348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e399325-1935-4392-b5fd-6371d935e086 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:25.904866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df05dc9-d556-4838-94da-d0d32b522b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:25.905544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df05dc9-d556-4838-94da-d0d32b522b1f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:25.905836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df05dc9-d556-4838-94da-d0d32b522b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:25.906114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df05dc9-d556-4838-94da-d0d32b522b1f admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:25.906854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df05dc9-d556-4838-94da-d0d32b522b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:25.908771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df05dc9-d556-4838-94da-d0d32b522b1f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:25.931211 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2219/4399] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:25 2021] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:25.935952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c048122-ddb8-4205-b82e-3aeb9a38ae57 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:25.951815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c048122-ddb8-4205-b82e-3aeb9a38ae57 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:25.957511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023bd53-e8a2-4559-b993-eb5136cb6980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:25.958236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023bd53-e8a2-4559-b993-eb5136cb6980 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:25.958505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023bd53-e8a2-4559-b993-eb5136cb6980 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:25.958990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023bd53-e8a2-4559-b993-eb5136cb6980 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:25.959533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023bd53-e8a2-4559-b993-eb5136cb6980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:25.961131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023bd53-e8a2-4559-b993-eb5136cb6980 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:25.984796 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2181/4400] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:25 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:25.988995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df05dc9-d556-4838-94da-d0d32b522b1f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.000716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68677cee-12ac-4f3d-8d31-34097681358d None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.001009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68677cee-12ac-4f3d-8d31-34097681358d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.001288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68677cee-12ac-4f3d-8d31-34097681358d None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.002470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df05dc9-d556-4838-94da-d0d32b522b1f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.003262 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2182/4401] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 21:01:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 21:01:26.008279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68677cee-12ac-4f3d-8d31-34097681358d None None] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 21:01:26.008948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd651f1d-7641-45b5-b310-17bf7000526a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.009953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd651f1d-7641-45b5-b310-17bf7000526a admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.010089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-68677cee-12ac-4f3d-8d31-34097681358d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:26.010242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd651f1d-7641-45b5-b310-17bf7000526a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.010665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd651f1d-7641-45b5-b310-17bf7000526a admin admin] PATH_INFO: `/v3/projects/40d4c4fc721e4fa1a93ee6a271365ced/users/6c4e9f9a7cc345bb82cbb8316f0bfa5a/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.029086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd651f1d-7641-45b5-b310-17bf7000526a admin admin] RBAC: Authorizing `identity:create_grant(project_id=40d4c4fc721e4fa1a93ee6a271365ced, user_id=6c4e9f9a7cc345bb82cbb8316f0bfa5a, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.032036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd651f1d-7641-45b5-b310-17bf7000526a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.049894 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2220/4402] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:25 2021] PUT /identity/v3/projects/40d4c4fc721e4fa1a93ee6a271365ced/users/6c4e9f9a7cc345bb82cbb8316f0bfa5a/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:26.051078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd651f1d-7641-45b5-b310-17bf7000526a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.103076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68677cee-12ac-4f3d-8d31-34097681358d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.117529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd651f1d-7641-45b5-b310-17bf7000526a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.123677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29409f6-6747-4b97-97a2-7d14e7da3f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.124572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29409f6-6747-4b97-97a2-7d14e7da3f74 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.124942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29409f6-6747-4b97-97a2-7d14e7da3f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.125536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29409f6-6747-4b97-97a2-7d14e7da3f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.126122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29409f6-6747-4b97-97a2-7d14e7da3f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.127984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29409f6-6747-4b97-97a2-7d14e7da3f74 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.142648 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2221/4403] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:26 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:26.146539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29409f6-6747-4b97-97a2-7d14e7da3f74 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.158054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29409f6-6747-4b97-97a2-7d14e7da3f74 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.164876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673a258-3f11-4d6d-a6d6-a6c9b2dd868b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.165842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a258-3f11-4d6d-a6d6-a6c9b2dd868b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.166198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a258-3f11-4d6d-a6d6-a6c9b2dd868b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.166745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a258-3f11-4d6d-a6d6-a6c9b2dd868b admin admin] PATH_INFO: `/v3/projects/40d4c4fc721e4fa1a93ee6a271365ced/users/6c4e9f9a7cc345bb82cbb8316f0bfa5a/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.168903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673a258-3f11-4d6d-a6d6-a6c9b2dd868b admin admin] RBAC: Authorizing `identity:create_grant(project_id=40d4c4fc721e4fa1a93ee6a271365ced, user_id=6c4e9f9a7cc345bb82cbb8316f0bfa5a, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.171902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673a258-3f11-4d6d-a6d6-a6c9b2dd868b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.186242 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2222/4404] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:26 2021] PUT /identity/v3/projects/40d4c4fc721e4fa1a93ee6a271365ced/users/6c4e9f9a7cc345bb82cbb8316f0bfa5a/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:26.186534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68677cee-12ac-4f3d-8d31-34097681358d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.197072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30604465-296d-40e2-b68f-ebb894cc2fee None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.197971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30604465-296d-40e2-b68f-ebb894cc2fee None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.198471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30604465-296d-40e2-b68f-ebb894cc2fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.234577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-30604465-296d-40e2-b68f-ebb894cc2fee None None] MFA Rules not processed for user `6c4e9f9a7cc345bb82cbb8316f0bfa5a`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:26.235884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-30604465-296d-40e2-b68f-ebb894cc2fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:26.257519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663927e-6610-4ed5-a407-2b5d9e5637ca tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '073a758d401343dda8ccee52685986bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6b4b2946be6470cbec140a2c207c2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.258470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663927e-6610-4ed5-a407-2b5d9e5637ca tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.258694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663927e-6610-4ed5-a407-2b5d9e5637ca tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.258970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663927e-6610-4ed5-a407-2b5d9e5637ca tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] PATH_INFO: `/v3/projects/a6b4b2946be6470cbec140a2c207c2df` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.259903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663927e-6610-4ed5-a407-2b5d9e5637ca tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] RBAC: Authorizing `identity:get_project(project_id=a6b4b2946be6470cbec140a2c207c2df)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.262672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663927e-6610-4ed5-a407-2b5d9e5637ca tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.265553 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2183/4405] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 21:01:26 2021] GET /identity/v3/projects/a6b4b2946be6470cbec140a2c207c2df => generated 363 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:26.308267 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2223/4406] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:26 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:26.313521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663927e-6610-4ed5-a407-2b5d9e5637ca tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.332102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663927e-6610-4ed5-a407-2b5d9e5637ca tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.345328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797fecf-1355-485e-9115-e2e78fe9b8b7 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.345328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797fecf-1355-485e-9115-e2e78fe9b8b7 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.345596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797fecf-1355-485e-9115-e2e78fe9b8b7 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.345846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797fecf-1355-485e-9115-e2e78fe9b8b7 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.346637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797fecf-1355-485e-9115-e2e78fe9b8b7 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.348923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797fecf-1355-485e-9115-e2e78fe9b8b7 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.386067 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2184/4407] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:26 2021] POST /identity/v3/services => generated 289 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:26.390096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30604465-296d-40e2-b68f-ebb894cc2fee None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.403220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30604465-296d-40e2-b68f-ebb894cc2fee None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.423280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3acfc-3940-423e-9096-0285036d1487 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.424253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3acfc-3940-423e-9096-0285036d1487 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.424645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3acfc-3940-423e-9096-0285036d1487 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.426313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3acfc-3940-423e-9096-0285036d1487 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.426313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3acfc-3940-423e-9096-0285036d1487 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.427181 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-32f3acfc-3940-423e-9096-0285036d1487 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:26.427181 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:26.427181 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:26.428290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3acfc-3940-423e-9096-0285036d1487 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.441118 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2224/4408] 10.222.0.13 () {60 vars in 1212 bytes} [Sat Dec 18 21:01:26 2021] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 331 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:26.446777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797fecf-1355-485e-9115-e2e78fe9b8b7 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.458563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797fecf-1355-485e-9115-e2e78fe9b8b7 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.463584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd407d-9af3-4fbb-9b97-fb5b6652b1cb tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.464355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd407d-9af3-4fbb-9b97-fb5b6652b1cb tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.464792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd407d-9af3-4fbb-9b97-fb5b6652b1cb tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.465181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd407d-9af3-4fbb-9b97-fb5b6652b1cb tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.466172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd407d-9af3-4fbb-9b97-fb5b6652b1cb tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.468091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd407d-9af3-4fbb-9b97-fb5b6652b1cb tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.500591 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2185/4409] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:26 2021] POST /identity/v3/services => generated 289 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:26.501521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3acfc-3940-423e-9096-0285036d1487 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.506180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7dd39-5a2c-4442-b6b0-905d2986499e None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.506774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7dd39-5a2c-4442-b6b0-905d2986499e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.507484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7dd39-5a2c-4442-b6b0-905d2986499e None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.509837 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2186/4410] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 21:01:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 21:01:26.513781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3acfc-3940-423e-9096-0285036d1487 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.515404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7dd39-5a2c-4442-b6b0-905d2986499e None None] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 21:01:26.532918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23779ec7-49a1-4332-84dc-8e1f2d2db840 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.533698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23779ec7-49a1-4332-84dc-8e1f2d2db840 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.534245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23779ec7-49a1-4332-84dc-8e1f2d2db840 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.534650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23779ec7-49a1-4332-84dc-8e1f2d2db840 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.535591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23779ec7-49a1-4332-84dc-8e1f2d2db840 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.537432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23779ec7-49a1-4332-84dc-8e1f2d2db840 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.550198 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2225/4411] 10.222.0.13 () {60 vars in 1212 bytes} [Sat Dec 18 21:01:26 2021] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:26.551628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23779ec7-49a1-4332-84dc-8e1f2d2db840 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.562345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23779ec7-49a1-4332-84dc-8e1f2d2db840 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.568565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a913ea-86ce-41e2-9953-c5019ad8a5b6 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.569311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a913ea-86ce-41e2-9953-c5019ad8a5b6 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.569968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a913ea-86ce-41e2-9953-c5019ad8a5b6 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.570447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a913ea-86ce-41e2-9953-c5019ad8a5b6 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.571267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a913ea-86ce-41e2-9953-c5019ad8a5b6 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.572384 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-23a913ea-86ce-41e2-9953-c5019ad8a5b6 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:26.572384 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:26.572384 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:26.573512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a913ea-86ce-41e2-9953-c5019ad8a5b6 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.584673 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2226/4412] 10.222.0.13 () {58 vars in 1190 bytes} [Sat Dec 18 21:01:26 2021] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 763 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:26.586206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a913ea-86ce-41e2-9953-c5019ad8a5b6 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.598871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a913ea-86ce-41e2-9953-c5019ad8a5b6 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.610907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef466a5-80a7-4a34-8d34-e0ace114802d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.611767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef466a5-80a7-4a34-8d34-e0ace114802d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.612058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef466a5-80a7-4a34-8d34-e0ace114802d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.612342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef466a5-80a7-4a34-8d34-e0ace114802d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/53d1a1a8875449a8af2eae10a1935d6e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.613021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef466a5-80a7-4a34-8d34-e0ace114802d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=53d1a1a8875449a8af2eae10a1935d6e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.614053 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-0ef466a5-80a7-4a34-8d34-e0ace114802d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:26.614053 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:26.614053 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:26.614979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef466a5-80a7-4a34-8d34-e0ace114802d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.616362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7dd39-5a2c-4442-b6b0-905d2986499e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.631108 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2227/4413] 10.222.0.13 () {58 vars in 1289 bytes} [Sat Dec 18 21:01:26 2021] GET /identity/v3/OS-EP-FILTER/endpoint_groups/53d1a1a8875449a8af2eae10a1935d6e => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:26.634780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef466a5-80a7-4a34-8d34-e0ace114802d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.638296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7dd39-5a2c-4442-b6b0-905d2986499e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.643046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e8785-02db-40e9-b6ec-df6ffedf9a1b tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '073a758d401343dda8ccee52685986bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6b4b2946be6470cbec140a2c207c2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.643980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e8785-02db-40e9-b6ec-df6ffedf9a1b tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.644335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e8785-02db-40e9-b6ec-df6ffedf9a1b tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.644689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e8785-02db-40e9-b6ec-df6ffedf9a1b tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] PATH_INFO: `/v3/projects/a6b4b2946be6470cbec140a2c207c2df` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.645568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef466a5-80a7-4a34-8d34-e0ace114802d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.646095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e8785-02db-40e9-b6ec-df6ffedf9a1b tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] RBAC: Authorizing `identity:get_project(project_id=a6b4b2946be6470cbec140a2c207c2df)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.647949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e8785-02db-40e9-b6ec-df6ffedf9a1b tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.649665 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2187/4414] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 21:01:26 2021] GET /identity/v3/projects/a6b4b2946be6470cbec140a2c207c2df => generated 363 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:26.650814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060b287-fcd5-4154-a9c3-88d68e82dec0 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.651678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060b287-fcd5-4154-a9c3-88d68e82dec0 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.651967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060b287-fcd5-4154-a9c3-88d68e82dec0 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.652453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060b287-fcd5-4154-a9c3-88d68e82dec0 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/53d1a1a8875449a8af2eae10a1935d6e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.653139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060b287-fcd5-4154-a9c3-88d68e82dec0 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=53d1a1a8875449a8af2eae10a1935d6e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.654758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060b287-fcd5-4154-a9c3-88d68e82dec0 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.659972 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2228/4415] 10.222.0.13 () {58 vars in 1290 bytes} [Sat Dec 18 21:01:26 2021] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/53d1a1a8875449a8af2eae10a1935d6e => generated 0 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:26.671192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e8785-02db-40e9-b6ec-df6ffedf9a1b tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.684199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e8785-02db-40e9-b6ec-df6ffedf9a1b tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.689887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a9fc5-f1bf-48ef-ad0f-7c4f981e9463 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.691610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a9fc5-f1bf-48ef-ad0f-7c4f981e9463 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.692063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a9fc5-f1bf-48ef-ad0f-7c4f981e9463 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.693279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a9fc5-f1bf-48ef-ad0f-7c4f981e9463 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/53d1a1a8875449a8af2eae10a1935d6e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.694139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a9fc5-f1bf-48ef-ad0f-7c4f981e9463 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=53d1a1a8875449a8af2eae10a1935d6e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.695618 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-404a9fc5-f1bf-48ef-ad0f-7c4f981e9463 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:26.695618 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:26.695618 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:26.696842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a9fc5-f1bf-48ef-ad0f-7c4f981e9463 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.712464 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2188/4416] 10.222.0.13 () {58 vars in 1292 bytes} [Sat Dec 18 21:01:26 2021] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/53d1a1a8875449a8af2eae10a1935d6e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:26.712734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0788f3-8886-48f4-a9f9-b0a365432f97 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.713529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0788f3-8886-48f4-a9f9-b0a365432f97 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.713957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0788f3-8886-48f4-a9f9-b0a365432f97 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.716021 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2229/4417] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 21:01:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 21:01:26.726610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0788f3-8886-48f4-a9f9-b0a365432f97 None None] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 21:01:26.729771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a9fc5-f1bf-48ef-ad0f-7c4f981e9463 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.756179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a9fc5-f1bf-48ef-ad0f-7c4f981e9463 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.764507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e235c-71a0-4804-ad3c-1986c022bc81 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.765558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e235c-71a0-4804-ad3c-1986c022bc81 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.765923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e235c-71a0-4804-ad3c-1986c022bc81 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.766304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e235c-71a0-4804-ad3c-1986c022bc81 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.767201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e235c-71a0-4804-ad3c-1986c022bc81 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.768284 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-6d4e235c-71a0-4804-ad3c-1986c022bc81 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:26.768284 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:26.768284 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:26.768576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0788f3-8886-48f4-a9f9-b0a365432f97 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.769328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e235c-71a0-4804-ad3c-1986c022bc81 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.778013 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2189/4418] 10.222.0.13 () {58 vars in 1190 bytes} [Sat Dec 18 21:01:26 2021] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 448 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:26.782158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e235c-71a0-4804-ad3c-1986c022bc81 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.782547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0788f3-8886-48f4-a9f9-b0a365432f97 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.787923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a96d71-3158-4f51-9f81-421833f29094 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '073a758d401343dda8ccee52685986bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6b4b2946be6470cbec140a2c207c2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.788978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a96d71-3158-4f51-9f81-421833f29094 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.789823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a96d71-3158-4f51-9f81-421833f29094 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.789823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a96d71-3158-4f51-9f81-421833f29094 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] PATH_INFO: `/v3/projects/a6b4b2946be6470cbec140a2c207c2df` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.791029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a96d71-3158-4f51-9f81-421833f29094 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] RBAC: Authorizing `identity:get_project(project_id=a6b4b2946be6470cbec140a2c207c2df)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.793434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a96d71-3158-4f51-9f81-421833f29094 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.795141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e235c-71a0-4804-ad3c-1986c022bc81 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.799219 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2230/4419] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 21:01:26 2021] GET /identity/v3/projects/a6b4b2946be6470cbec140a2c207c2df => generated 363 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:26.800673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719adb98-3f93-44f3-8388-2f9d8688720e tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.801597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719adb98-3f93-44f3-8388-2f9d8688720e tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.801953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719adb98-3f93-44f3-8388-2f9d8688720e tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.803325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719adb98-3f93-44f3-8388-2f9d8688720e tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/53d1a1a8875449a8af2eae10a1935d6e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.804024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719adb98-3f93-44f3-8388-2f9d8688720e tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=53d1a1a8875449a8af2eae10a1935d6e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.805693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719adb98-3f93-44f3-8388-2f9d8688720e tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.819939 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-719adb98-3f93-44f3-8388-2f9d8688720e tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Could not find Endpoint Group: 53d1a1a8875449a8af2eae10a1935d6e.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 53d1a1a8875449a8af2eae10a1935d6e. Dec 18 21:01:26.822303 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2190/4420] 10.222.0.13 () {58 vars in 1292 bytes} [Sat Dec 18 21:01:26 2021] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/53d1a1a8875449a8af2eae10a1935d6e => generated 120 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:01:26.825632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a96d71-3158-4f51-9f81-421833f29094 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.834761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b2c93-dc81-4233-8e83-357c96971076 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.835053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b2c93-dc81-4233-8e83-357c96971076 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.835332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b2c93-dc81-4233-8e83-357c96971076 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.837559 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2191/4421] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 21:01:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 21:01:26.842939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b2c93-dc81-4233-8e83-357c96971076 None None] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 21:01:26.844742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a96d71-3158-4f51-9f81-421833f29094 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.850632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003f7e5-44ba-40fe-aabf-aaea1750b8f2 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.855272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003f7e5-44ba-40fe-aabf-aaea1750b8f2 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.856323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003f7e5-44ba-40fe-aabf-aaea1750b8f2 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.856927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003f7e5-44ba-40fe-aabf-aaea1750b8f2 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/services/c08b64c2b50242be82b7063c915fb3ea` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.857900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003f7e5-44ba-40fe-aabf-aaea1750b8f2 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c08b64c2b50242be82b7063c915fb3ea)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.859560 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-e003f7e5-44ba-40fe-aabf-aaea1750b8f2 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:26.859560 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:26.859560 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:26.861074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003f7e5-44ba-40fe-aabf-aaea1750b8f2 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.861528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b2c93-dc81-4233-8e83-357c96971076 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.872455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b2c93-dc81-4233-8e83-357c96971076 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.877624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677cb13-9445-4194-abd7-a35bec591704 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '073a758d401343dda8ccee52685986bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6b4b2946be6470cbec140a2c207c2df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.878517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677cb13-9445-4194-abd7-a35bec591704 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.878807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677cb13-9445-4194-abd7-a35bec591704 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.879096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677cb13-9445-4194-abd7-a35bec591704 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] PATH_INFO: `/v3/projects/a6b4b2946be6470cbec140a2c207c2df` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.882627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677cb13-9445-4194-abd7-a35bec591704 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] RBAC: Authorizing `identity:get_project(project_id=a6b4b2946be6470cbec140a2c207c2df)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.884549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677cb13-9445-4194-abd7-a35bec591704 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.886942 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2192/4422] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 21:01:26 2021] GET /identity/v3/projects/a6b4b2946be6470cbec140a2c207c2df => generated 363 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:26.899206 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2231/4423] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:26 2021] DELETE /identity/v3/services/c08b64c2b50242be82b7063c915fb3ea => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:26.905309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677cb13-9445-4194-abd7-a35bec591704 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.919430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677cb13-9445-4194-abd7-a35bec591704 tempest-QuotasTestJSON-911566450 tempest-QuotasTestJSON-911566450-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:26.928364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003f7e5-44ba-40fe-aabf-aaea1750b8f2 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:26.930836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e003f7e5-44ba-40fe-aabf-aaea1750b8f2 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:26.941506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa063c5b-9d18-4d43-aa02-8bb47443468d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:26.951223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa063c5b-9d18-4d43-aa02-8bb47443468d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:26.951549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa063c5b-9d18-4d43-aa02-8bb47443468d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:26.951841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa063c5b-9d18-4d43-aa02-8bb47443468d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:26.952631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa063c5b-9d18-4d43-aa02-8bb47443468d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:26.954279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa063c5b-9d18-4d43-aa02-8bb47443468d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:26.971032 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2193/4424] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:26 2021] POST /identity/v3/services => generated 289 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:26.975021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa063c5b-9d18-4d43-aa02-8bb47443468d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:27.029863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa063c5b-9d18-4d43-aa02-8bb47443468d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:27.038839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003f7e5-44ba-40fe-aabf-aaea1750b8f2 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:27.042777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fe628-6ea9-49de-acd4-07869a352b8d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:27.045045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fe628-6ea9-49de-acd4-07869a352b8d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:27.047378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fe628-6ea9-49de-acd4-07869a352b8d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:27.047912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fe628-6ea9-49de-acd4-07869a352b8d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:27.049046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fe628-6ea9-49de-acd4-07869a352b8d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:27.050748 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-e05fe628-6ea9-49de-acd4-07869a352b8d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:27.050748 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:27.050748 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:27.054749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fe628-6ea9-49de-acd4-07869a352b8d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:27.066075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094cb16-3fab-4bd1-b16f-e3233b59a65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:27.067880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094cb16-3fab-4bd1-b16f-e3233b59a65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:27.068168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094cb16-3fab-4bd1-b16f-e3233b59a65c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:27.070971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094cb16-3fab-4bd1-b16f-e3233b59a65c admin admin] PATH_INFO: `/v3/users/073a758d401343dda8ccee52685986bf` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:27.071560 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2194/4425] 10.222.0.13 () {60 vars in 1212 bytes} [Sat Dec 18 21:01:26 2021] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:27.080125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094cb16-3fab-4bd1-b16f-e3233b59a65c admin admin] RBAC: Authorizing `identity:delete_user(user_id=073a758d401343dda8ccee52685986bf)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:27.083311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094cb16-3fab-4bd1-b16f-e3233b59a65c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:27.086858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fe628-6ea9-49de-acd4-07869a352b8d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:27.115815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fe628-6ea9-49de-acd4-07869a352b8d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:27.131745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b036d5e-b566-42c2-b3cd-5488f5c316c5 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:27.132704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b036d5e-b566-42c2-b3cd-5488f5c316c5 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:27.133100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b036d5e-b566-42c2-b3cd-5488f5c316c5 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:27.133472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b036d5e-b566-42c2-b3cd-5488f5c316c5 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:27.134396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b036d5e-b566-42c2-b3cd-5488f5c316c5 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:27.136186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b036d5e-b566-42c2-b3cd-5488f5c316c5 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:27.150175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4094cb16-3fab-4bd1-b16f-e3233b59a65c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073a758d401343dda8ccee52685986bf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:27.159468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4094cb16-3fab-4bd1-b16f-e3233b59a65c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073a758d401343dda8ccee52685986bf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:27.160320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4094cb16-3fab-4bd1-b16f-e3233b59a65c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073a758d401343dda8ccee52685986bf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:27.171263 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2195/4426] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:27 2021] POST /identity/v3/services => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:27.175283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b036d5e-b566-42c2-b3cd-5488f5c316c5 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:27.175630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4094cb16-3fab-4bd1-b16f-e3233b59a65c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073a758d401343dda8ccee52685986bf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:27.187646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4094cb16-3fab-4bd1-b16f-e3233b59a65c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073a758d401343dda8ccee52685986bf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:27.206299 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2232/4427] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:26 2021] DELETE /identity/v3/users/073a758d401343dda8ccee52685986bf => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:27.206444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b036d5e-b566-42c2-b3cd-5488f5c316c5 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:27.206546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e8d8-bd18-4677-a6a0-9cfeef861f48 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:27.206546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e8d8-bd18-4677-a6a0-9cfeef861f48 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:27.206902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e8d8-bd18-4677-a6a0-9cfeef861f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:27.235134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1828e8d8-bd18-4677-a6a0-9cfeef861f48 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:27.237128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1828e8d8-bd18-4677-a6a0-9cfeef861f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:27.315128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25072643-57b2-4b57-ad06-a6e9caa52fe8 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:27.316148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25072643-57b2-4b57-ad06-a6e9caa52fe8 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:27.317479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25072643-57b2-4b57-ad06-a6e9caa52fe8 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:27.317479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25072643-57b2-4b57-ad06-a6e9caa52fe8 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/55bcf1a91ef648bc9f539707ca6ea2a9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:27.318198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25072643-57b2-4b57-ad06-a6e9caa52fe8 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=55bcf1a91ef648bc9f539707ca6ea2a9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:27.319538 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-25072643-57b2-4b57-ad06-a6e9caa52fe8 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:27.319538 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:27.319538 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:27.321475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25072643-57b2-4b57-ad06-a6e9caa52fe8 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:27.333453 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2233/4428] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:27 2021] POST /identity/v3/auth/tokens => generated 3629 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:27.338622 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2196/4429] 10.222.0.13 () {60 vars in 1312 bytes} [Sat Dec 18 21:01:27 2021] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/55bcf1a91ef648bc9f539707ca6ea2a9 => generated 336 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:27.340576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828e8d8-bd18-4677-a6a0-9cfeef861f48 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:27.343431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1828e8d8-bd18-4677-a6a0-9cfeef861f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:27.356666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25072643-57b2-4b57-ad06-a6e9caa52fe8 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:27.359081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828e8d8-bd18-4677-a6a0-9cfeef861f48 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:27.360937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-25072643-57b2-4b57-ad06-a6e9caa52fe8 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:27.364418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24329e-9e4c-43f8-816a-6b27d2a4336d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:27.365384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24329e-9e4c-43f8-816a-6b27d2a4336d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:27.365742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24329e-9e4c-43f8-816a-6b27d2a4336d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:27.366367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24329e-9e4c-43f8-816a-6b27d2a4336d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/services/b25b091ef08240c09370cd06d8f922f6` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:27.366869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24329e-9e4c-43f8-816a-6b27d2a4336d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b25b091ef08240c09370cd06d8f922f6)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:27.368694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24329e-9e4c-43f8-816a-6b27d2a4336d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:27.395203 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2234/4430] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:27 2021] DELETE /identity/v3/services/b25b091ef08240c09370cd06d8f922f6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:27.401277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24329e-9e4c-43f8-816a-6b27d2a4336d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:27.435390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24329e-9e4c-43f8-816a-6b27d2a4336d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:27.442305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a3814-6acf-487c-b9a7-5983f6c2e24a tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:27.443480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a3814-6acf-487c-b9a7-5983f6c2e24a tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:27.443977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a3814-6acf-487c-b9a7-5983f6c2e24a tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:27.444362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a3814-6acf-487c-b9a7-5983f6c2e24a tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/55bcf1a91ef648bc9f539707ca6ea2a9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:27.445204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a3814-6acf-487c-b9a7-5983f6c2e24a tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=55bcf1a91ef648bc9f539707ca6ea2a9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:27.447078 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-567a3814-6acf-487c-b9a7-5983f6c2e24a tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:27.447078 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:27.447078 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:27.448011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a3814-6acf-487c-b9a7-5983f6c2e24a tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:27.476398 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2235/4431] 10.222.0.13 () {58 vars in 1292 bytes} [Sat Dec 18 21:01:27 2021] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/55bcf1a91ef648bc9f539707ca6ea2a9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:27.478127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a3814-6acf-487c-b9a7-5983f6c2e24a tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:27.489729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a3814-6acf-487c-b9a7-5983f6c2e24a tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:27.496677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaf3dc-8038-4978-b33d-aa72372095d4 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:27.498639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaf3dc-8038-4978-b33d-aa72372095d4 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:27.499094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaf3dc-8038-4978-b33d-aa72372095d4 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:27.499406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25072643-57b2-4b57-ad06-a6e9caa52fe8 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:27.500220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaf3dc-8038-4978-b33d-aa72372095d4 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/services/b37c122ec89b4214a0e0c8d97ae33ce3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:27.500908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaf3dc-8038-4978-b33d-aa72372095d4 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b37c122ec89b4214a0e0c8d97ae33ce3)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:27.502609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaf3dc-8038-4978-b33d-aa72372095d4 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:27.518195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b46233-494d-48be-a329-080a02fab9e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:27.519128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b46233-494d-48be-a329-080a02fab9e4 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:27.519547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b46233-494d-48be-a329-080a02fab9e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:27.520491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b46233-494d-48be-a329-080a02fab9e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:27.538646 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2236/4432] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:27 2021] DELETE /identity/v3/services/b37c122ec89b4214a0e0c8d97ae33ce3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:27.540079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaf3dc-8038-4978-b33d-aa72372095d4 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:27.556900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b46233-494d-48be-a329-080a02fab9e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:27.559807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b46233-494d-48be-a329-080a02fab9e4 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:27.573023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaf3dc-8038-4978-b33d-aa72372095d4 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:27.581597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2896d52-3e11-4504-a7e2-aa165c50779d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:27.583158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2896d52-3e11-4504-a7e2-aa165c50779d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:27.583642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2896d52-3e11-4504-a7e2-aa165c50779d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:27.584120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2896d52-3e11-4504-a7e2-aa165c50779d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/48af305dfa274a39a5b4bbfeaf98276d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:27.586341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2896d52-3e11-4504-a7e2-aa165c50779d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=48af305dfa274a39a5b4bbfeaf98276d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:27.589559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2896d52-3e11-4504-a7e2-aa165c50779d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:27.593554 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2197/4433] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:27 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:01:27.622025 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2237/4434] 10.222.0.13 () {58 vars in 1292 bytes} [Sat Dec 18 21:01:27 2021] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/48af305dfa274a39a5b4bbfeaf98276d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:27.623259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b46233-494d-48be-a329-080a02fab9e4 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:27.638343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b46233-494d-48be-a329-080a02fab9e4 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:27.647021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c65da6-c729-46f6-b7c4-baf6f8dcf919 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4e9f9a7cc345bb82cbb8316f0bfa5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40d4c4fc721e4fa1a93ee6a271365ced', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:27.650326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c65da6-c729-46f6-b7c4-baf6f8dcf919 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:27.650821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c65da6-c729-46f6-b7c4-baf6f8dcf919 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:27.651401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c65da6-c729-46f6-b7c4-baf6f8dcf919 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] PATH_INFO: `/v3/services/ae1b787469b2476f92bdc6400d1e8677` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:27.653230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c65da6-c729-46f6-b7c4-baf6f8dcf919 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ae1b787469b2476f92bdc6400d1e8677)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:27.656194 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-e9c65da6-c729-46f6-b7c4-baf6f8dcf919 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:27.656194 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:27.656194 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:27.657576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c65da6-c729-46f6-b7c4-baf6f8dcf919 tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:27.693724 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2198/4435] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:27 2021] DELETE /identity/v3/services/ae1b787469b2476f92bdc6400d1e8677 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:27.697582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2896d52-3e11-4504-a7e2-aa165c50779d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:27.700284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c2896d52-3e11-4504-a7e2-aa165c50779d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:27.741347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2896d52-3e11-4504-a7e2-aa165c50779d tempest-EndPointGroupsTest-666993369 tempest-EndPointGroupsTest-666993369-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:27.764319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf9085-3c4b-4f74-91eb-6b4c1ab2f0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:27.765191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf9085-3c4b-4f74-91eb-6b4c1ab2f0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:27.765477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf9085-3c4b-4f74-91eb-6b4c1ab2f0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:27.765758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf9085-3c4b-4f74-91eb-6b4c1ab2f0f0 admin admin] PATH_INFO: `/v3/users/536ba28f55204625985ab42816541991` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:27.767029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf9085-3c4b-4f74-91eb-6b4c1ab2f0f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=536ba28f55204625985ab42816541991)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:27.769187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf9085-3c4b-4f74-91eb-6b4c1ab2f0f0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:27.839605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-08bf9085-3c4b-4f74-91eb-6b4c1ab2f0f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536ba28f55204625985ab42816541991'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:27.860525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-08bf9085-3c4b-4f74-91eb-6b4c1ab2f0f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536ba28f55204625985ab42816541991'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:27.860525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-08bf9085-3c4b-4f74-91eb-6b4c1ab2f0f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536ba28f55204625985ab42816541991'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:27.895160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-08bf9085-3c4b-4f74-91eb-6b4c1ab2f0f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536ba28f55204625985ab42816541991'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:27.909576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-08bf9085-3c4b-4f74-91eb-6b4c1ab2f0f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536ba28f55204625985ab42816541991'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:27.916829 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2238/4436] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:27 2021] DELETE /identity/v3/users/536ba28f55204625985ab42816541991 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:27.921536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b46c03-603f-44d2-bbaf-282777c3f3a9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:27.921906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b46c03-603f-44d2-bbaf-282777c3f3a9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:27.922351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b46c03-603f-44d2-bbaf-282777c3f3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:27.946701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f0b46c03-603f-44d2-bbaf-282777c3f3a9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:27.947995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f0b46c03-603f-44d2-bbaf-282777c3f3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:28.010776 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2199/4437] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:28.022192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf9085-3c4b-4f74-91eb-6b4c1ab2f0f0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:28.023786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-08bf9085-3c4b-4f74-91eb-6b4c1ab2f0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:28.109906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf9085-3c4b-4f74-91eb-6b4c1ab2f0f0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:28.113978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71a1d5-3da4-4938-9ea4-2fdc640b363e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:28.115016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71a1d5-3da4-4938-9ea4-2fdc640b363e service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:28.115527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71a1d5-3da4-4938-9ea4-2fdc640b363e service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:28.115882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71a1d5-3da4-4938-9ea4-2fdc640b363e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:28.158984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71a1d5-3da4-4938-9ea4-2fdc640b363e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:28.161094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71a1d5-3da4-4938-9ea4-2fdc640b363e service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:28.175628 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2239/4438] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:01:28.304798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b46c03-603f-44d2-bbaf-282777c3f3a9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:28.306213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f0b46c03-603f-44d2-bbaf-282777c3f3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:28.337646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b46c03-603f-44d2-bbaf-282777c3f3a9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:28.364570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad617837-3829-4ff4-8970-6032f786f5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:28.366557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad617837-3829-4ff4-8970-6032f786f5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:28.367329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad617837-3829-4ff4-8970-6032f786f5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:28.367878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad617837-3829-4ff4-8970-6032f786f5a6 admin admin] PATH_INFO: `/v3/projects/a6b4b2946be6470cbec140a2c207c2df` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:28.370648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad617837-3829-4ff4-8970-6032f786f5a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b4b2946be6470cbec140a2c207c2df)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:28.373479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad617837-3829-4ff4-8970-6032f786f5a6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:28.440448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ad617837-3829-4ff4-8970-6032f786f5a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b4b2946be6470cbec140a2c207c2df', 'request_id': 'req-ad617837-3829-4ff4-8970-6032f786f5a6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:28.449795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ad617837-3829-4ff4-8970-6032f786f5a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b4b2946be6470cbec140a2c207c2df', 'request_id': 'req-ad617837-3829-4ff4-8970-6032f786f5a6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:28.455964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ad617837-3829-4ff4-8970-6032f786f5a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b4b2946be6470cbec140a2c207c2df', 'request_id': 'req-ad617837-3829-4ff4-8970-6032f786f5a6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:28.473819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ad617837-3829-4ff4-8970-6032f786f5a6 admin admin] The token cache is being invalidate because project a6b4b2946be6470cbec140a2c207c2df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:28.474215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ad617837-3829-4ff4-8970-6032f786f5a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:28.475003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ad617837-3829-4ff4-8970-6032f786f5a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:28.482337 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2200/4439] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:28 2021] DELETE /identity/v3/projects/a6b4b2946be6470cbec140a2c207c2df => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:28.486538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048a630-7141-45c7-a371-76c1abce33cb None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:28.486794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048a630-7141-45c7-a371-76c1abce33cb None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:28.487070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048a630-7141-45c7-a371-76c1abce33cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:28.508694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1048a630-7141-45c7-a371-76c1abce33cb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:28.510973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1048a630-7141-45c7-a371-76c1abce33cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:28.584734 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2240/4440] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:28.593330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da4162-91f4-4a84-b8f9-bdb303c19e7d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:28.593621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da4162-91f4-4a84-b8f9-bdb303c19e7d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:28.593902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da4162-91f4-4a84-b8f9-bdb303c19e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:28.615593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-23da4162-91f4-4a84-b8f9-bdb303c19e7d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:28.616734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-23da4162-91f4-4a84-b8f9-bdb303c19e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:28.627333 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2201/4441] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:28.631657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048a630-7141-45c7-a371-76c1abce33cb None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:28.642673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048a630-7141-45c7-a371-76c1abce33cb None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:28.648148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a15c0c-0e5d-4863-88eb-cae188df7ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:28.648914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a15c0c-0e5d-4863-88eb-cae188df7ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:28.649395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a15c0c-0e5d-4863-88eb-cae188df7ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:28.649932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a15c0c-0e5d-4863-88eb-cae188df7ed1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:28.650590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a15c0c-0e5d-4863-88eb-cae188df7ed1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:01:28.651251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a15c0c-0e5d-4863-88eb-cae188df7ed1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:28.652859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a15c0c-0e5d-4863-88eb-cae188df7ed1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:28.665503 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2241/4442] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:01:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:28.669824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da4162-91f4-4a84-b8f9-bdb303c19e7d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:28.679182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da4162-91f4-4a84-b8f9-bdb303c19e7d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:28.684683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b7516-edc7-4a29-bbed-5b89301b290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:28.685347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b7516-edc7-4a29-bbed-5b89301b290b admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:28.685629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b7516-edc7-4a29-bbed-5b89301b290b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:28.685974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b7516-edc7-4a29-bbed-5b89301b290b admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:28.686771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b7516-edc7-4a29-bbed-5b89301b290b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:28.688819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b7516-edc7-4a29-bbed-5b89301b290b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:28.724196 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2202/4443] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:28 2021] POST /identity/v3/projects => generated 359 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:28.731133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a15c0c-0e5d-4863-88eb-cae188df7ed1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:28.743630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a15c0c-0e5d-4863-88eb-cae188df7ed1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:28.777771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b7516-edc7-4a29-bbed-5b89301b290b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:28.779638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0b4b7516-edc7-4a29-bbed-5b89301b290b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:28.842475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de634399-2397-47fd-a016-e3937ace63ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:28.843410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de634399-2397-47fd-a016-e3937ace63ad admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:28.843698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de634399-2397-47fd-a016-e3937ace63ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:28.843979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de634399-2397-47fd-a016-e3937ace63ad admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:28.844688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de634399-2397-47fd-a016-e3937ace63ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:28.846661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de634399-2397-47fd-a016-e3937ace63ad admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:28.876999 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2242/4444] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:28 2021] POST /identity/v3/users => generated 280 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:28.878527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de634399-2397-47fd-a016-e3937ace63ad admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:28.888378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b7516-edc7-4a29-bbed-5b89301b290b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:28.890973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de634399-2397-47fd-a016-e3937ace63ad admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:28.895435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:28.896606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff2fbe-c870-402c-aeba-5e31e5602d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:28.896769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:28.897232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:28.897566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff2fbe-c870-402c-aeba-5e31e5602d27 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:28.897918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff2fbe-c870-402c-aeba-5e31e5602d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:28.898277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff2fbe-c870-402c-aeba-5e31e5602d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:28.898740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660 admin admin] PATH_INFO: `/v3/projects/af066c5e8e15477ab5acbcbc698fbaa3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:28.899188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff2fbe-c870-402c-aeba-5e31e5602d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:28.900054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af066c5e8e15477ab5acbcbc698fbaa3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:28.900911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff2fbe-c870-402c-aeba-5e31e5602d27 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:28.912280 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2243/4445] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:28 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:28.916199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff2fbe-c870-402c-aeba-5e31e5602d27 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:28.916421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:28.929942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff2fbe-c870-402c-aeba-5e31e5602d27 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:28.937383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942b42e-ac0d-4874-ab57-1b3c6841a713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:28.938575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942b42e-ac0d-4874-ab57-1b3c6841a713 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:28.939011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942b42e-ac0d-4874-ab57-1b3c6841a713 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:28.939683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942b42e-ac0d-4874-ab57-1b3c6841a713 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:28.940516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942b42e-ac0d-4874-ab57-1b3c6841a713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:28.942516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942b42e-ac0d-4874-ab57-1b3c6841a713 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:28.958884 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2244/4446] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:28 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:28.964649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942b42e-ac0d-4874-ab57-1b3c6841a713 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:28.981571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942b42e-ac0d-4874-ab57-1b3c6841a713 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:28.986480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af066c5e8e15477ab5acbcbc698fbaa3', 'request_id': 'req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:28.996770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af066c5e8e15477ab5acbcbc698fbaa3', 'request_id': 'req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.003948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af066c5e8e15477ab5acbcbc698fbaa3', 'request_id': 'req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.024494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660 admin admin] The token cache is being invalidate because project af066c5e8e15477ab5acbcbc698fbaa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:29.025028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.025773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.030007 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2203/4447] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:28 2021] DELETE /identity/v3/projects/af066c5e8e15477ab5acbcbc698fbaa3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:29.041068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:29.045331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:29.067388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f9840-4f36-4425-8dc2-5b399c5cac2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:29.067388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f9840-4f36-4425-8dc2-5b399c5cac2e admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:29.067388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f9840-4f36-4425-8dc2-5b399c5cac2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:29.067388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f9840-4f36-4425-8dc2-5b399c5cac2e admin admin] PATH_INFO: `/v3/projects/41095ec8af5b441b86b5783b0c8faab7/users/7bbb196cd84949679be23579b778dcf5/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:29.068646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ade954-b5b9-46ad-abe1-7b14e8fe9660 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:29.078048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf1b01-1994-4fb9-9a61-0583b7b7ca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:29.080750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf1b01-1994-4fb9-9a61-0583b7b7ca60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:29.081916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf1b01-1994-4fb9-9a61-0583b7b7ca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:29.084315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf1b01-1994-4fb9-9a61-0583b7b7ca60 admin admin] PATH_INFO: `/v3/users/6c4e9f9a7cc345bb82cbb8316f0bfa5a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:29.086293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf1b01-1994-4fb9-9a61-0583b7b7ca60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c4e9f9a7cc345bb82cbb8316f0bfa5a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:29.086543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f9840-4f36-4425-8dc2-5b399c5cac2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=41095ec8af5b441b86b5783b0c8faab7, user_id=7bbb196cd84949679be23579b778dcf5, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:29.089183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf1b01-1994-4fb9-9a61-0583b7b7ca60 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:29.089817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f9840-4f36-4425-8dc2-5b399c5cac2e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:29.110505 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2245/4448] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:28 2021] PUT /identity/v3/projects/41095ec8af5b441b86b5783b0c8faab7/users/7bbb196cd84949679be23579b778dcf5/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:29.121872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f3b65-1f8a-4ebc-a13b-6b49a524adfd None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:29.122576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f3b65-1f8a-4ebc-a13b-6b49a524adfd None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:29.122860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f3b65-1f8a-4ebc-a13b-6b49a524adfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:29.163241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1c3f3b65-1f8a-4ebc-a13b-6b49a524adfd None None] MFA Rules not processed for user `7bbb196cd84949679be23579b778dcf5`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:29.164553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1c3f3b65-1f8a-4ebc-a13b-6b49a524adfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:29.169131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4adf1b01-1994-4fb9-9a61-0583b7b7ca60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c4e9f9a7cc345bb82cbb8316f0bfa5a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.178818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4adf1b01-1994-4fb9-9a61-0583b7b7ca60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c4e9f9a7cc345bb82cbb8316f0bfa5a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.198785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4adf1b01-1994-4fb9-9a61-0583b7b7ca60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c4e9f9a7cc345bb82cbb8316f0bfa5a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.199988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4adf1b01-1994-4fb9-9a61-0583b7b7ca60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c4e9f9a7cc345bb82cbb8316f0bfa5a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.213437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4adf1b01-1994-4fb9-9a61-0583b7b7ca60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c4e9f9a7cc345bb82cbb8316f0bfa5a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.222755 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2204/4449] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:29 2021] DELETE /identity/v3/users/6c4e9f9a7cc345bb82cbb8316f0bfa5a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:29.247880 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2246/4450] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:29 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:29.289470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf1b01-1994-4fb9-9a61-0583b7b7ca60 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:29.291796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4adf1b01-1994-4fb9-9a61-0583b7b7ca60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:29.378754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf1b01-1994-4fb9-9a61-0583b7b7ca60 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:29.385808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71925af-6358-4464-b200-d15b9b59f07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:29.386906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71925af-6358-4464-b200-d15b9b59f07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:29.387467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71925af-6358-4464-b200-d15b9b59f07d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:29.387975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71925af-6358-4464-b200-d15b9b59f07d admin admin] PATH_INFO: `/v3/users/7bbb196cd84949679be23579b778dcf5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:29.390124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71925af-6358-4464-b200-d15b9b59f07d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bbb196cd84949679be23579b778dcf5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:29.393234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71925af-6358-4464-b200-d15b9b59f07d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:29.471615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c71925af-6358-4464-b200-d15b9b59f07d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bbb196cd84949679be23579b778dcf5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.483227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c71925af-6358-4464-b200-d15b9b59f07d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bbb196cd84949679be23579b778dcf5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.501639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c71925af-6358-4464-b200-d15b9b59f07d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bbb196cd84949679be23579b778dcf5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.502484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c71925af-6358-4464-b200-d15b9b59f07d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bbb196cd84949679be23579b778dcf5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.512390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c71925af-6358-4464-b200-d15b9b59f07d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bbb196cd84949679be23579b778dcf5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.524308 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2205/4451] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:29 2021] DELETE /identity/v3/users/7bbb196cd84949679be23579b778dcf5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:29.528667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b19942-a1bd-491b-82d2-908aa9a54a4b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:29.528874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b19942-a1bd-491b-82d2-908aa9a54a4b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:29.529138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b19942-a1bd-491b-82d2-908aa9a54a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:29.551534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-36b19942-a1bd-491b-82d2-908aa9a54a4b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:29.553364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-36b19942-a1bd-491b-82d2-908aa9a54a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:29.656531 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2247/4452] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:29.674065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71925af-6358-4464-b200-d15b9b59f07d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:29.675562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c71925af-6358-4464-b200-d15b9b59f07d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:29.764488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71925af-6358-4464-b200-d15b9b59f07d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:29.766731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b19942-a1bd-491b-82d2-908aa9a54a4b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:29.768149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-36b19942-a1bd-491b-82d2-908aa9a54a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:29.768937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc582c-2320-4ca4-af28-33ceb6ebf63e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:29.771030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc582c-2320-4ca4-af28-33ceb6ebf63e service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:29.771030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc582c-2320-4ca4-af28-33ceb6ebf63e service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:29.771030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc582c-2320-4ca4-af28-33ceb6ebf63e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:29.782502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc582c-2320-4ca4-af28-33ceb6ebf63e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:29.789913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc582c-2320-4ca4-af28-33ceb6ebf63e service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:29.807197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b19942-a1bd-491b-82d2-908aa9a54a4b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:29.818985 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2206/4453] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:01:29.830845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e3d37-c01a-4bf2-a294-9de200c3b606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:29.831884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e3d37-c01a-4bf2-a294-9de200c3b606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:29.832260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e3d37-c01a-4bf2-a294-9de200c3b606 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:29.832511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e3d37-c01a-4bf2-a294-9de200c3b606 admin admin] PATH_INFO: `/v3/projects/40d4c4fc721e4fa1a93ee6a271365ced` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:29.833912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e3d37-c01a-4bf2-a294-9de200c3b606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40d4c4fc721e4fa1a93ee6a271365ced)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:29.835848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e3d37-c01a-4bf2-a294-9de200c3b606 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:29.952996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4c7e3d37-c01a-4bf2-a294-9de200c3b606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40d4c4fc721e4fa1a93ee6a271365ced', 'request_id': 'req-4c7e3d37-c01a-4bf2-a294-9de200c3b606'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.964111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4c7e3d37-c01a-4bf2-a294-9de200c3b606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40d4c4fc721e4fa1a93ee6a271365ced', 'request_id': 'req-4c7e3d37-c01a-4bf2-a294-9de200c3b606'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.982676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4c7e3d37-c01a-4bf2-a294-9de200c3b606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40d4c4fc721e4fa1a93ee6a271365ced', 'request_id': 'req-4c7e3d37-c01a-4bf2-a294-9de200c3b606'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.995528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4c7e3d37-c01a-4bf2-a294-9de200c3b606 admin admin] The token cache is being invalidate because project 40d4c4fc721e4fa1a93ee6a271365ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:29.995873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4c7e3d37-c01a-4bf2-a294-9de200c3b606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:29.997129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4c7e3d37-c01a-4bf2-a294-9de200c3b606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:30.002642 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2248/4454] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:29 2021] DELETE /identity/v3/projects/40d4c4fc721e4fa1a93ee6a271365ced => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:30.004440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbcb8e-7a3f-40ad-9a11-8b65979936d0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:30.004728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbcb8e-7a3f-40ad-9a11-8b65979936d0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:30.005009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbcb8e-7a3f-40ad-9a11-8b65979936d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:30.025140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-31cbcb8e-7a3f-40ad-9a11-8b65979936d0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:30.027204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-31cbcb8e-7a3f-40ad-9a11-8b65979936d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:30.143111 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2207/4455] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:30.152066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d350113-8672-45ee-9aa8-06072d7a879e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:30.152851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d350113-8672-45ee-9aa8-06072d7a879e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:30.153089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d350113-8672-45ee-9aa8-06072d7a879e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:30.179227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0d350113-8672-45ee-9aa8-06072d7a879e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:30.181299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0d350113-8672-45ee-9aa8-06072d7a879e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:30.189812 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2249/4456] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:30.195317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbcb8e-7a3f-40ad-9a11-8b65979936d0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:30.205438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbcb8e-7a3f-40ad-9a11-8b65979936d0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:30.214002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecaefc-2c58-4fd1-ab73-995eaa498169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:30.215277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecaefc-2c58-4fd1-ab73-995eaa498169 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:30.215567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecaefc-2c58-4fd1-ab73-995eaa498169 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:30.215847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecaefc-2c58-4fd1-ab73-995eaa498169 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:30.216616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecaefc-2c58-4fd1-ab73-995eaa498169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:01:30.216928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecaefc-2c58-4fd1-ab73-995eaa498169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:30.218570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecaefc-2c58-4fd1-ab73-995eaa498169 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:30.237962 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2208/4457] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:01:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:30.238204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d350113-8672-45ee-9aa8-06072d7a879e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:30.250448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d350113-8672-45ee-9aa8-06072d7a879e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:30.257215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bf187-0699-4326-b8d1-a48d90bc057e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:30.258039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bf187-0699-4326-b8d1-a48d90bc057e admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:30.258480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bf187-0699-4326-b8d1-a48d90bc057e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:30.258858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bf187-0699-4326-b8d1-a48d90bc057e admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:30.265721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bf187-0699-4326-b8d1-a48d90bc057e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:30.267718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bf187-0699-4326-b8d1-a48d90bc057e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:30.308585 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2250/4458] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:30 2021] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:30.309765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecaefc-2c58-4fd1-ab73-995eaa498169 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:30.320235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecaefc-2c58-4fd1-ab73-995eaa498169 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:30.382143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532157d-3d9a-41e0-b0fe-41bb514a3e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:30.382879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532157d-3d9a-41e0-b0fe-41bb514a3e6c admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:30.383158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532157d-3d9a-41e0-b0fe-41bb514a3e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:30.383440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532157d-3d9a-41e0-b0fe-41bb514a3e6c admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:30.384154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532157d-3d9a-41e0-b0fe-41bb514a3e6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:30.386071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532157d-3d9a-41e0-b0fe-41bb514a3e6c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:30.417056 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2209/4459] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:30 2021] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:30.418485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bf187-0699-4326-b8d1-a48d90bc057e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:30.429894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bf187-0699-4326-b8d1-a48d90bc057e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:30.436220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c34b99-d6e5-42f5-9f22-9634ec36f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:30.437175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c34b99-d6e5-42f5-9f22-9634ec36f64c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:30.437680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c34b99-d6e5-42f5-9f22-9634ec36f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:30.438178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c34b99-d6e5-42f5-9f22-9634ec36f64c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:30.439358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c34b99-d6e5-42f5-9f22-9634ec36f64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:30.441440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c34b99-d6e5-42f5-9f22-9634ec36f64c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:30.457962 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2251/4460] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:30 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:30.458514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532157d-3d9a-41e0-b0fe-41bb514a3e6c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:30.470474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532157d-3d9a-41e0-b0fe-41bb514a3e6c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:30.487894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218105e-9b28-4512-8d52-1c1615865761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:30.488712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218105e-9b28-4512-8d52-1c1615865761 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:30.489004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218105e-9b28-4512-8d52-1c1615865761 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:30.489294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218105e-9b28-4512-8d52-1c1615865761 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:30.490133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218105e-9b28-4512-8d52-1c1615865761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:30.506819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218105e-9b28-4512-8d52-1c1615865761 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:30.533296 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2210/4461] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:30 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:30.534213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218105e-9b28-4512-8d52-1c1615865761 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:30.540525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c34b99-d6e5-42f5-9f22-9634ec36f64c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:30.543405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a3c34b99-d6e5-42f5-9f22-9634ec36f64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:30.548759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218105e-9b28-4512-8d52-1c1615865761 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:30.559980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46aa599-fedc-423e-b083-4b22752ef6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:30.561977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aa599-fedc-423e-b083-4b22752ef6f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:30.562298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aa599-fedc-423e-b083-4b22752ef6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:30.562586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aa599-fedc-423e-b083-4b22752ef6f0 admin admin] PATH_INFO: `/v3/projects/f7a930c316b640cd901dd54069fab300/users/58efbd1c354a4f869e14149921a2c00e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:30.564667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c34b99-d6e5-42f5-9f22-9634ec36f64c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:30.581572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f768a75-4e86-4ead-8a8f-5f837f37eb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:30.582114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f768a75-4e86-4ead-8a8f-5f837f37eb01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:30.582438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f768a75-4e86-4ead-8a8f-5f837f37eb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:30.583114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f768a75-4e86-4ead-8a8f-5f837f37eb01 admin admin] PATH_INFO: `/v3/projects/41095ec8af5b441b86b5783b0c8faab7` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:30.585143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f768a75-4e86-4ead-8a8f-5f837f37eb01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41095ec8af5b441b86b5783b0c8faab7)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:30.591557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f768a75-4e86-4ead-8a8f-5f837f37eb01 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:30.592742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46aa599-fedc-423e-b083-4b22752ef6f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a930c316b640cd901dd54069fab300, user_id=58efbd1c354a4f869e14149921a2c00e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:30.596037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46aa599-fedc-423e-b083-4b22752ef6f0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:30.621145 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2211/4462] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:30 2021] PUT /identity/v3/projects/f7a930c316b640cd901dd54069fab300/users/58efbd1c354a4f869e14149921a2c00e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:30.623132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c470c44-8d47-4d5f-a84b-96ad1b4849d1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:30.623430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c470c44-8d47-4d5f-a84b-96ad1b4849d1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:30.623711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c470c44-8d47-4d5f-a84b-96ad1b4849d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:30.691108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4c470c44-8d47-4d5f-a84b-96ad1b4849d1 None None] MFA Rules not processed for user `58efbd1c354a4f869e14149921a2c00e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:30.692627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4c470c44-8d47-4d5f-a84b-96ad1b4849d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:30.698059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3f768a75-4e86-4ead-8a8f-5f837f37eb01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41095ec8af5b441b86b5783b0c8faab7', 'request_id': 'req-3f768a75-4e86-4ead-8a8f-5f837f37eb01'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:30.707170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3f768a75-4e86-4ead-8a8f-5f837f37eb01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41095ec8af5b441b86b5783b0c8faab7', 'request_id': 'req-3f768a75-4e86-4ead-8a8f-5f837f37eb01'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:30.730376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3f768a75-4e86-4ead-8a8f-5f837f37eb01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41095ec8af5b441b86b5783b0c8faab7', 'request_id': 'req-3f768a75-4e86-4ead-8a8f-5f837f37eb01'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:30.743210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3f768a75-4e86-4ead-8a8f-5f837f37eb01 admin admin] The token cache is being invalidate because project 41095ec8af5b441b86b5783b0c8faab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:30.743678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3f768a75-4e86-4ead-8a8f-5f837f37eb01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:30.747456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3f768a75-4e86-4ead-8a8f-5f837f37eb01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:30.757973 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2252/4463] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:30 2021] DELETE /identity/v3/projects/41095ec8af5b441b86b5783b0c8faab7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:30.759554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23615352-146f-4bc6-8e74-4fb7f444ca65 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:30.759818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23615352-146f-4bc6-8e74-4fb7f444ca65 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:30.760115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23615352-146f-4bc6-8e74-4fb7f444ca65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:30.791092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-23615352-146f-4bc6-8e74-4fb7f444ca65 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:30.792663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-23615352-146f-4bc6-8e74-4fb7f444ca65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:30.794981 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2212/4464] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:30 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:30.799476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c470c44-8d47-4d5f-a84b-96ad1b4849d1 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:30.800992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4c470c44-8d47-4d5f-a84b-96ad1b4849d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:30.874967 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2253/4465] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:30.884817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf97cc-cbec-434e-bef2-93d7c1b0f16c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:30.885105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf97cc-cbec-434e-bef2-93d7c1b0f16c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:30.885588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf97cc-cbec-434e-bef2-93d7c1b0f16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:30.895952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c470c44-8d47-4d5f-a84b-96ad1b4849d1 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:30.907240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c33288-6d95-43ba-a70e-0fcf98c4dc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:30.908225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c33288-6d95-43ba-a70e-0fcf98c4dc92 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:30.908488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c33288-6d95-43ba-a70e-0fcf98c4dc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:30.908769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c33288-6d95-43ba-a70e-0fcf98c4dc92 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:30.909643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c33288-6d95-43ba-a70e-0fcf98c4dc92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:30.911733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4bdf97cc-cbec-434e-bef2-93d7c1b0f16c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:30.911937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c33288-6d95-43ba-a70e-0fcf98c4dc92 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:30.913645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4bdf97cc-cbec-434e-bef2-93d7c1b0f16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:30.925384 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2254/4466] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:30.943198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf97cc-cbec-434e-bef2-93d7c1b0f16c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:30.945104 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2213/4467] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:30 2021] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:30.952818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c33288-6d95-43ba-a70e-0fcf98c4dc92 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:30.958094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf97cc-cbec-434e-bef2-93d7c1b0f16c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.052635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c33288-6d95-43ba-a70e-0fcf98c4dc92 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.057997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b100a58-db0a-437f-b03a-c2d7b25ab03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.060586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b100a58-db0a-437f-b03a-c2d7b25ab03f admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.060586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b100a58-db0a-437f-b03a-c2d7b25ab03f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.060966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b100a58-db0a-437f-b03a-c2d7b25ab03f admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.061544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b100a58-db0a-437f-b03a-c2d7b25ab03f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.063669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b100a58-db0a-437f-b03a-c2d7b25ab03f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.096373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dc96b-9777-4db3-bd79-4b701574b48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.097379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dc96b-9777-4db3-bd79-4b701574b48d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.097724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dc96b-9777-4db3-bd79-4b701574b48d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.098088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dc96b-9777-4db3-bd79-4b701574b48d admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.098853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dc96b-9777-4db3-bd79-4b701574b48d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:01:31.099179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dc96b-9777-4db3-bd79-4b701574b48d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.100948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dc96b-9777-4db3-bd79-4b701574b48d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.114285 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2214/4468] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:30 2021] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:31.118682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b100a58-db0a-437f-b03a-c2d7b25ab03f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.125141 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2255/4469] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:01:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:31.130051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dc96b-9777-4db3-bd79-4b701574b48d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.133969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b100a58-db0a-437f-b03a-c2d7b25ab03f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.141633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adb5f7-45ea-4a73-b323-2bc9a346aed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.142541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb5f7-45ea-4a73-b323-2bc9a346aed1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.142829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb5f7-45ea-4a73-b323-2bc9a346aed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.143108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb5f7-45ea-4a73-b323-2bc9a346aed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.144040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adb5f7-45ea-4a73-b323-2bc9a346aed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.145628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adb5f7-45ea-4a73-b323-2bc9a346aed1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.152195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dc96b-9777-4db3-bd79-4b701574b48d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.158344 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2215/4470] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:31 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:31.167035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adb5f7-45ea-4a73-b323-2bc9a346aed1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.167450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b13e07-f26a-4a47-8d0e-2917272ba26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.168744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b13e07-f26a-4a47-8d0e-2917272ba26d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.169419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b13e07-f26a-4a47-8d0e-2917272ba26d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.171889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b13e07-f26a-4a47-8d0e-2917272ba26d admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.172637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b13e07-f26a-4a47-8d0e-2917272ba26d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.174604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b13e07-f26a-4a47-8d0e-2917272ba26d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.178887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adb5f7-45ea-4a73-b323-2bc9a346aed1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.184381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ae8b5-a386-410d-830c-e708ba5321e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.185468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ae8b5-a386-410d-830c-e708ba5321e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.185694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ae8b5-a386-410d-830c-e708ba5321e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.185955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ae8b5-a386-410d-830c-e708ba5321e1 admin admin] PATH_INFO: `/v3/projects/b1546bd78195407ab1bc04cea704b405/users/cdc5de19bb314f77a9b39276596f9191/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.203057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ae8b5-a386-410d-830c-e708ba5321e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1546bd78195407ab1bc04cea704b405, user_id=cdc5de19bb314f77a9b39276596f9191, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.206100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ae8b5-a386-410d-830c-e708ba5321e1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.229545 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2216/4471] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:31 2021] PUT /identity/v3/projects/b1546bd78195407ab1bc04cea704b405/users/cdc5de19bb314f77a9b39276596f9191/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:31.229750 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2256/4472] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:31 2021] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:31.233601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b13e07-f26a-4a47-8d0e-2917272ba26d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.233889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ae8b5-a386-410d-830c-e708ba5321e1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.324935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b13e07-f26a-4a47-8d0e-2917272ba26d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.326217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ae8b5-a386-410d-830c-e708ba5321e1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.332541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a9cf5-7966-484a-8c52-facca5c2f527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.333253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a9cf5-7966-484a-8c52-facca5c2f527 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.333455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e67beb-a99a-4a1a-b55f-3394f1d413d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.333582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a9cf5-7966-484a-8c52-facca5c2f527 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.333926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a9cf5-7966-484a-8c52-facca5c2f527 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.334103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e67beb-a99a-4a1a-b55f-3394f1d413d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.334424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e67beb-a99a-4a1a-b55f-3394f1d413d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.334677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a9cf5-7966-484a-8c52-facca5c2f527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.334779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e67beb-a99a-4a1a-b55f-3394f1d413d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.335427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e67beb-a99a-4a1a-b55f-3394f1d413d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.336899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a9cf5-7966-484a-8c52-facca5c2f527 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.337403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e67beb-a99a-4a1a-b55f-3394f1d413d8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.349787 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2217/4473] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:31 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:31.354229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e67beb-a99a-4a1a-b55f-3394f1d413d8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.361109 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2257/4474] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:31 2021] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:31.365009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a9cf5-7966-484a-8c52-facca5c2f527 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.367648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e67beb-a99a-4a1a-b55f-3394f1d413d8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.373860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5dd76-8062-45ad-9c03-a65cbb7fe542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.374779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5dd76-8062-45ad-9c03-a65cbb7fe542 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.375065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5dd76-8062-45ad-9c03-a65cbb7fe542 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.375345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5dd76-8062-45ad-9c03-a65cbb7fe542 admin admin] PATH_INFO: `/v3/projects/b1546bd78195407ab1bc04cea704b405/users/cdc5de19bb314f77a9b39276596f9191/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.377340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5dd76-8062-45ad-9c03-a65cbb7fe542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1546bd78195407ab1bc04cea704b405, user_id=cdc5de19bb314f77a9b39276596f9191, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.377658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a9cf5-7966-484a-8c52-facca5c2f527 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.380295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5dd76-8062-45ad-9c03-a65cbb7fe542 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.384212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dfc7b-1c68-4fb7-8729-3305419906bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.384878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dfc7b-1c68-4fb7-8729-3305419906bd admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.385166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dfc7b-1c68-4fb7-8729-3305419906bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.385536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dfc7b-1c68-4fb7-8729-3305419906bd admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.386182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070dfc7b-1c68-4fb7-8729-3305419906bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.388663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070dfc7b-1c68-4fb7-8729-3305419906bd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.391503 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2218/4475] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:31 2021] PUT /identity/v3/projects/b1546bd78195407ab1bc04cea704b405/users/cdc5de19bb314f77a9b39276596f9191/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:31.401866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9922174-9c4d-43bf-b310-d0ad32ad67df None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.402208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9922174-9c4d-43bf-b310-d0ad32ad67df None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.405156 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2258/4476] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:31 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:31.405258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9922174-9c4d-43bf-b310-d0ad32ad67df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.406072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dfc7b-1c68-4fb7-8729-3305419906bd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.415877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dfc7b-1c68-4fb7-8729-3305419906bd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.430407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a9922174-9c4d-43bf-b310-d0ad32ad67df None None] MFA Rules not processed for user `cdc5de19bb314f77a9b39276596f9191`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:31.431553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a9922174-9c4d-43bf-b310-d0ad32ad67df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:31.481889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f93930-abe2-4c79-a8d4-f38322f832f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.482869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f93930-abe2-4c79-a8d4-f38322f832f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.483154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f93930-abe2-4c79-a8d4-f38322f832f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.483432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f93930-abe2-4c79-a8d4-f38322f832f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.484163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f93930-abe2-4c79-a8d4-f38322f832f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.485771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f93930-abe2-4c79-a8d4-f38322f832f7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.499836 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2259/4477] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:31 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:31.504474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f93930-abe2-4c79-a8d4-f38322f832f7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.514476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f93930-abe2-4c79-a8d4-f38322f832f7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.518838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7937e8-30d0-4bad-b563-4d5b41e77943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.519467 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2219/4478] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:31 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:31.519713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7937e8-30d0-4bad-b563-4d5b41e77943 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.519991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7937e8-30d0-4bad-b563-4d5b41e77943 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.520327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7937e8-30d0-4bad-b563-4d5b41e77943 admin admin] PATH_INFO: `/v3/projects/e258519401fa4623ba33500d3206ff8b/users/1d422a75c1e040088cb8d13428ad1f8d/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.523953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9922174-9c4d-43bf-b310-d0ad32ad67df None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.533696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9922174-9c4d-43bf-b310-d0ad32ad67df None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.537440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7937e8-30d0-4bad-b563-4d5b41e77943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e258519401fa4623ba33500d3206ff8b, user_id=1d422a75c1e040088cb8d13428ad1f8d, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.538382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a16e4-1b3b-479b-aa1a-c694f4015646 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5de19bb314f77a9b39276596f9191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1546bd78195407ab1bc04cea704b405', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.539070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a16e4-1b3b-479b-aa1a-c694f4015646 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.539391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a16e4-1b3b-479b-aa1a-c694f4015646 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.539746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a16e4-1b3b-479b-aa1a-c694f4015646 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.541766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7937e8-30d0-4bad-b563-4d5b41e77943 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.541889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a16e4-1b3b-479b-aa1a-c694f4015646 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.547228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a16e4-1b3b-479b-aa1a-c694f4015646 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.561306 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2260/4479] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:31 2021] PUT /identity/v3/projects/e258519401fa4623ba33500d3206ff8b/users/1d422a75c1e040088cb8d13428ad1f8d/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:31.568638 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2220/4480] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:31 2021] POST /identity/v3/services => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:31.572024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bd897-513e-4d92-9af3-b89230151952 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.572315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bd897-513e-4d92-9af3-b89230151952 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.572608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bd897-513e-4d92-9af3-b89230151952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.575391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a16e4-1b3b-479b-aa1a-c694f4015646 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.597726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a16e4-1b3b-479b-aa1a-c694f4015646 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.610889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-970bd897-513e-4d92-9af3-b89230151952 None None] MFA Rules not processed for user `1d422a75c1e040088cb8d13428ad1f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:31.612245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-970bd897-513e-4d92-9af3-b89230151952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:31.673516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f28b75-6425-4a70-8893-da0608ffcf72 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5de19bb314f77a9b39276596f9191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1546bd78195407ab1bc04cea704b405', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.674496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f28b75-6425-4a70-8893-da0608ffcf72 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.674882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f28b75-6425-4a70-8893-da0608ffcf72 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.675412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f28b75-6425-4a70-8893-da0608ffcf72 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.676311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f28b75-6425-4a70-8893-da0608ffcf72 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.678431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f28b75-6425-4a70-8893-da0608ffcf72 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.702189 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2261/4481] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:31 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:31.703707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bd897-513e-4d92-9af3-b89230151952 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.715548 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-f0f28b75-6425-4a70-8893-da0608ffcf72 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Dec 18 21:01:31.715548 ncdv-master-1 devstack@keystone.service[96645]: Failed validating 'type' in schema['properties']['enabled']: Dec 18 21:01:31.715548 ncdv-master-1 devstack@keystone.service[96645]: {'enum': [True, False, None], 'type': 'boolean'} Dec 18 21:01:31.715548 ncdv-master-1 devstack@keystone.service[96645]: On instance['enabled']: Dec 18 21:01:31.715548 ncdv-master-1 devstack@keystone.service[96645]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Dec 18 21:01:31.717363 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2221/4482] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Dec 18 21:01:31 2021] POST /identity/v3/endpoints => generated 283 bytes in 143 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 18 21:01:31.723587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f28b75-6425-4a70-8893-da0608ffcf72 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.741690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f28b75-6425-4a70-8893-da0608ffcf72 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.748719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365f489-8792-4ee8-a5b6-f69be49bd93a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5de19bb314f77a9b39276596f9191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1546bd78195407ab1bc04cea704b405', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.749979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365f489-8792-4ee8-a5b6-f69be49bd93a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.750341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365f489-8792-4ee8-a5b6-f69be49bd93a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.750861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365f489-8792-4ee8-a5b6-f69be49bd93a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.751948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365f489-8792-4ee8-a5b6-f69be49bd93a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.753865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365f489-8792-4ee8-a5b6-f69be49bd93a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.759788 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-a365f489-8792-4ee8-a5b6-f69be49bd93a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Dec 18 21:01:31.759788 ncdv-master-1 devstack@keystone.service[96645]: Failed validating 'type' in schema['properties']['enabled']: Dec 18 21:01:31.759788 ncdv-master-1 devstack@keystone.service[96645]: {'enum': [True, False, None], 'type': 'boolean'} Dec 18 21:01:31.759788 ncdv-master-1 devstack@keystone.service[96645]: On instance['enabled']: Dec 18 21:01:31.759788 ncdv-master-1 devstack@keystone.service[96645]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Dec 18 21:01:31.765671 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2222/4483] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Dec 18 21:01:31 2021] POST /identity/v3/endpoints => generated 281 bytes in 38 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 18 21:01:31.766806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365f489-8792-4ee8-a5b6-f69be49bd93a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.777612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365f489-8792-4ee8-a5b6-f69be49bd93a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.784369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e486f-bbd6-4119-a23d-d53db9e2bc62 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5de19bb314f77a9b39276596f9191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1546bd78195407ab1bc04cea704b405', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.784936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e486f-bbd6-4119-a23d-d53db9e2bc62 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.785253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e486f-bbd6-4119-a23d-d53db9e2bc62 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.785576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e486f-bbd6-4119-a23d-d53db9e2bc62 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.786841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e486f-bbd6-4119-a23d-d53db9e2bc62 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.789912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e486f-bbd6-4119-a23d-d53db9e2bc62 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.798947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bd897-513e-4d92-9af3-b89230151952 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.805189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f316d-a0e9-4066-b959-14ae23938753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.805938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f316d-a0e9-4066-b959-14ae23938753 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.806243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f316d-a0e9-4066-b959-14ae23938753 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.806752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f316d-a0e9-4066-b959-14ae23938753 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.807556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f316d-a0e9-4066-b959-14ae23938753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.810102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f316d-a0e9-4066-b959-14ae23938753 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.826613 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-6b8e486f-bbd6-4119-a23d-d53db9e2bc62 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1801783098. To ensure interoperability, identifiers should be a valid uuid. Dec 18 21:01:31.826613 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 18 21:01:31.826613 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:31.842301 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2262/4484] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:31 2021] POST /identity/v3/projects => generated 389 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:31.843521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f316d-a0e9-4066-b959-14ae23938753 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.859978 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2223/4485] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Dec 18 21:01:31 2021] POST /identity/v3/endpoints => generated 360 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:31.861766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e486f-bbd6-4119-a23d-d53db9e2bc62 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.883925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e486f-bbd6-4119-a23d-d53db9e2bc62 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.909643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f316d-a0e9-4066-b959-14ae23938753 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.925896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f7233-28f5-44b6-b6d8-4cc2d2cf2b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.926672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f7233-28f5-44b6-b6d8-4cc2d2cf2b67 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.926964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f7233-28f5-44b6-b6d8-4cc2d2cf2b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.927253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f7233-28f5-44b6-b6d8-4cc2d2cf2b67 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.927959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f7233-28f5-44b6-b6d8-4cc2d2cf2b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.930154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f7233-28f5-44b6-b6d8-4cc2d2cf2b67 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.943699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b358009-825e-40bd-bd0f-46d454725f34 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5de19bb314f77a9b39276596f9191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1546bd78195407ab1bc04cea704b405', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.944682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b358009-825e-40bd-bd0f-46d454725f34 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.944961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b358009-825e-40bd-bd0f-46d454725f34 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.945263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b358009-825e-40bd-bd0f-46d454725f34 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] PATH_INFO: `/v3/regions/tempest-region-1801783098` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.945890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b358009-825e-40bd-bd0f-46d454725f34 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1801783098)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.947011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b358009-825e-40bd-bd0f-46d454725f34 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.949417 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2224/4486] 10.222.0.13 () {58 vars in 1205 bytes} [Sat Dec 18 21:01:31 2021] GET /identity/v3/regions/tempest-region-1801783098 => generated 180 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:31.953666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b358009-825e-40bd-bd0f-46d454725f34 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.957522 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2263/4487] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:31 2021] POST /identity/v3/users => generated 301 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:31.961787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f7233-28f5-44b6-b6d8-4cc2d2cf2b67 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.966051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b358009-825e-40bd-bd0f-46d454725f34 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.971811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf62186-47b1-421d-84c4-31844509d2e6 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5de19bb314f77a9b39276596f9191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1546bd78195407ab1bc04cea704b405', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.972480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f7233-28f5-44b6-b6d8-4cc2d2cf2b67 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:31.973092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf62186-47b1-421d-84c4-31844509d2e6 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.973482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf62186-47b1-421d-84c4-31844509d2e6 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.973846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf62186-47b1-421d-84c4-31844509d2e6 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] PATH_INFO: `/v3/endpoints/271343c4399d4066b6d6a4a6056c7ba0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.977888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ddfb4-c950-47c3-a31f-c2ef6abd3fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:31.979044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ddfb4-c950-47c3-a31f-c2ef6abd3fdf admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:31.979044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ddfb4-c950-47c3-a31f-c2ef6abd3fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:31.979356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ddfb4-c950-47c3-a31f-c2ef6abd3fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:31.980722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ddfb4-c950-47c3-a31f-c2ef6abd3fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.982468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ddfb4-c950-47c3-a31f-c2ef6abd3fdf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.982971 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf62186-47b1-421d-84c4-31844509d2e6 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=271343c4399d4066b6d6a4a6056c7ba0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:31.984005 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-0bf62186-47b1-421d-84c4-31844509d2e6 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:31.984005 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:31.984005 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:31.985342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf62186-47b1-421d-84c4-31844509d2e6 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:31.994279 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2264/4488] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:31 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:31.997997 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-0bf62186-47b1-421d-84c4-31844509d2e6 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Dec 18 21:01:31.997997 ncdv-master-1 devstack@keystone.service[96645]: Failed validating 'type' in schema['properties']['enabled']: Dec 18 21:01:31.997997 ncdv-master-1 devstack@keystone.service[96645]: {'enum': [True, False, None], 'type': 'boolean'} Dec 18 21:01:31.997997 ncdv-master-1 devstack@keystone.service[96645]: On instance['enabled']: Dec 18 21:01:31.997997 ncdv-master-1 devstack@keystone.service[96645]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Dec 18 21:01:31.999253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ddfb4-c950-47c3-a31f-c2ef6abd3fdf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:31.999487 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2225/4489] 10.222.0.13 () {60 vars in 1254 bytes} [Sat Dec 18 21:01:31 2021] PATCH /identity/v3/endpoints/271343c4399d4066b6d6a4a6056c7ba0 => generated 283 bytes in 46 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 18 21:01:32.003604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf62186-47b1-421d-84c4-31844509d2e6 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.014860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ddfb4-c950-47c3-a31f-c2ef6abd3fdf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.015023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf62186-47b1-421d-84c4-31844509d2e6 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.019147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a25c2-33e7-4888-81b7-9e3c97067a77 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5de19bb314f77a9b39276596f9191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1546bd78195407ab1bc04cea704b405', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.020001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a25c2-33e7-4888-81b7-9e3c97067a77 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.020289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a25c2-33e7-4888-81b7-9e3c97067a77 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.020410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e3952-ddce-4192-b01d-7c9a829f2c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.020564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a25c2-33e7-4888-81b7-9e3c97067a77 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] PATH_INFO: `/v3/endpoints/271343c4399d4066b6d6a4a6056c7ba0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.021463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e3952-ddce-4192-b01d-7c9a829f2c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.021851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e3952-ddce-4192-b01d-7c9a829f2c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.022006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a25c2-33e7-4888-81b7-9e3c97067a77 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=271343c4399d4066b6d6a4a6056c7ba0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.022359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e3952-ddce-4192-b01d-7c9a829f2c1e admin admin] PATH_INFO: `/v3/projects/e499875a23c74ed09f4e414e43981d54/users/d4049013aaef497dac2e6865a6fee252/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.023248 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-fc0a25c2-33e7-4888-81b7-9e3c97067a77 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:32.023248 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:32.023248 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:32.025054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a25c2-33e7-4888-81b7-9e3c97067a77 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.036729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-fc0a25c2-33e7-4888-81b7-9e3c97067a77 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '271343c4399d4066b6d6a4a6056c7ba0', 'request_id': 'req-fc0a25c2-33e7-4888-81b7-9e3c97067a77'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:32.048015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e3952-ddce-4192-b01d-7c9a829f2c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e499875a23c74ed09f4e414e43981d54, user_id=d4049013aaef497dac2e6865a6fee252, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.051401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e3952-ddce-4192-b01d-7c9a829f2c1e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.056194 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2226/4490] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:32 2021] DELETE /identity/v3/endpoints/271343c4399d4066b6d6a4a6056c7ba0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:32.061016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a25c2-33e7-4888-81b7-9e3c97067a77 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.086194 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2265/4491] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:31 2021] PUT /identity/v3/projects/e499875a23c74ed09f4e414e43981d54/users/d4049013aaef497dac2e6865a6fee252/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:32.087114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e3952-ddce-4192-b01d-7c9a829f2c1e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.099675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a25c2-33e7-4888-81b7-9e3c97067a77 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.180638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e3952-ddce-4192-b01d-7c9a829f2c1e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.193267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd8f39-e85f-4b7f-a298-dd1d66c56ea7 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5de19bb314f77a9b39276596f9191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1546bd78195407ab1bc04cea704b405', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.194195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd8f39-e85f-4b7f-a298-dd1d66c56ea7 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.194451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd8f39-e85f-4b7f-a298-dd1d66c56ea7 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.194730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd8f39-e85f-4b7f-a298-dd1d66c56ea7 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] PATH_INFO: `/v3/regions/tempest-region-1801783098` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.195398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd8f39-e85f-4b7f-a298-dd1d66c56ea7 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1801783098)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.197004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd8f39-e85f-4b7f-a298-dd1d66c56ea7 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.198645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e58c0-c4c2-42dc-8d50-e3026dfada40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.199463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e58c0-c4c2-42dc-8d50-e3026dfada40 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.199861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e58c0-c4c2-42dc-8d50-e3026dfada40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.200224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e58c0-c4c2-42dc-8d50-e3026dfada40 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.201062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e58c0-c4c2-42dc-8d50-e3026dfada40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.202793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e58c0-c4c2-42dc-8d50-e3026dfada40 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.217863 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2266/4492] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:32 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:32.218959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e58c0-c4c2-42dc-8d50-e3026dfada40 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.225154 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2227/4493] 10.222.0.13 () {58 vars in 1208 bytes} [Sat Dec 18 21:01:32 2021] DELETE /identity/v3/regions/tempest-region-1801783098 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:32.226846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd8f39-e85f-4b7f-a298-dd1d66c56ea7 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.233272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e58c0-c4c2-42dc-8d50-e3026dfada40 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.249048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d00a55-afa7-4068-9548-d71300156a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.249690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd8f39-e85f-4b7f-a298-dd1d66c56ea7 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.250106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d00a55-afa7-4068-9548-d71300156a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.250501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d00a55-afa7-4068-9548-d71300156a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.250855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d00a55-afa7-4068-9548-d71300156a04 admin admin] PATH_INFO: `/v3/projects/e499875a23c74ed09f4e414e43981d54/users/d4049013aaef497dac2e6865a6fee252/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.252946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d00a55-afa7-4068-9548-d71300156a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e499875a23c74ed09f4e414e43981d54, user_id=d4049013aaef497dac2e6865a6fee252, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.254730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b27b97-d1a8-48d8-902a-d5e9accb69f2 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5de19bb314f77a9b39276596f9191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1546bd78195407ab1bc04cea704b405', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.255844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b27b97-d1a8-48d8-902a-d5e9accb69f2 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.255844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b27b97-d1a8-48d8-902a-d5e9accb69f2 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.256078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d00a55-afa7-4068-9548-d71300156a04 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.256171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b27b97-d1a8-48d8-902a-d5e9accb69f2 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.256668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b27b97-d1a8-48d8-902a-d5e9accb69f2 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.266408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b27b97-d1a8-48d8-902a-d5e9accb69f2 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.272754 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2267/4494] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:32 2021] PUT /identity/v3/projects/e499875a23c74ed09f4e414e43981d54/users/d4049013aaef497dac2e6865a6fee252/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:32.286479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47668ffc-7241-4882-974d-c94452abf6b5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.286795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47668ffc-7241-4882-974d-c94452abf6b5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.287084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47668ffc-7241-4882-974d-c94452abf6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.290709 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-c0b27b97-d1a8-48d8-902a-d5e9accb69f2 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1599301035. To ensure interoperability, identifiers should be a valid uuid. Dec 18 21:01:32.290709 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 18 21:01:32.290709 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:32.319673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-47668ffc-7241-4882-974d-c94452abf6b5 None None] MFA Rules not processed for user `d4049013aaef497dac2e6865a6fee252`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:32.320956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-47668ffc-7241-4882-974d-c94452abf6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:32.327089 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2228/4495] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Dec 18 21:01:32 2021] POST /identity/v3/endpoints => generated 360 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:32.331390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b27b97-d1a8-48d8-902a-d5e9accb69f2 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.357932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b27b97-d1a8-48d8-902a-d5e9accb69f2 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.427020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a890ca8-d0ed-4ed0-a1d5-a08079df86f7 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5de19bb314f77a9b39276596f9191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1546bd78195407ab1bc04cea704b405', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.427878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a890ca8-d0ed-4ed0-a1d5-a08079df86f7 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.428166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a890ca8-d0ed-4ed0-a1d5-a08079df86f7 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.428308 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2268/4496] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:32 2021] POST /identity/v3/auth/tokens => generated 3636 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:32.428447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a890ca8-d0ed-4ed0-a1d5-a08079df86f7 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] PATH_INFO: `/v3/regions/tempest-region-1599301035` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.429117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a890ca8-d0ed-4ed0-a1d5-a08079df86f7 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1599301035)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.430188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a890ca8-d0ed-4ed0-a1d5-a08079df86f7 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.433470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47668ffc-7241-4882-974d-c94452abf6b5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.433629 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2229/4497] 10.222.0.13 () {58 vars in 1205 bytes} [Sat Dec 18 21:01:32 2021] GET /identity/v3/regions/tempest-region-1599301035 => generated 180 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:32.444667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47668ffc-7241-4882-974d-c94452abf6b5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.445916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a890ca8-d0ed-4ed0-a1d5-a08079df86f7 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.457863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1df69-4b81-4840-9f85-4c95c4af039d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.458570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1df69-4b81-4840-9f85-4c95c4af039d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.458853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1df69-4b81-4840-9f85-4c95c4af039d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.459133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1df69-4b81-4840-9f85-4c95c4af039d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.459890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1df69-4b81-4840-9f85-4c95c4af039d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.461482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1df69-4b81-4840-9f85-4c95c4af039d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.465339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a890ca8-d0ed-4ed0-a1d5-a08079df86f7 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.472418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d8361-4e8f-41f5-9c70-4d68fd9c769a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5de19bb314f77a9b39276596f9191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1546bd78195407ab1bc04cea704b405', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.473598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8361-4e8f-41f5-9c70-4d68fd9c769a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.473911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8361-4e8f-41f5-9c70-4d68fd9c769a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.474186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d8361-4e8f-41f5-9c70-4d68fd9c769a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] PATH_INFO: `/v3/endpoints/1ec19d6b773c48938c98761b5ea14085` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.481119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d8361-4e8f-41f5-9c70-4d68fd9c769a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=1ec19d6b773c48938c98761b5ea14085)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.485249 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2269/4498] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:01:32 2021] POST /identity/v3/domains => generated 277 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:32.485400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d8361-4e8f-41f5-9c70-4d68fd9c769a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.486535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1df69-4b81-4840-9f85-4c95c4af039d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.494082 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-659d8361-4e8f-41f5-9c70-4d68fd9c769a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Dec 18 21:01:32.494082 ncdv-master-1 devstack@keystone.service[96645]: Failed validating 'type' in schema['properties']['enabled']: Dec 18 21:01:32.494082 ncdv-master-1 devstack@keystone.service[96645]: {'enum': [True, False, None], 'type': 'boolean'} Dec 18 21:01:32.494082 ncdv-master-1 devstack@keystone.service[96645]: On instance['enabled']: Dec 18 21:01:32.494082 ncdv-master-1 devstack@keystone.service[96645]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Dec 18 21:01:32.495658 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2230/4499] 10.222.0.13 () {60 vars in 1254 bytes} [Sat Dec 18 21:01:32 2021] PATCH /identity/v3/endpoints/1ec19d6b773c48938c98761b5ea14085 => generated 281 bytes in 52 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 18 21:01:32.499577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d8361-4e8f-41f5-9c70-4d68fd9c769a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.509989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d8361-4e8f-41f5-9c70-4d68fd9c769a tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.550049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1df69-4b81-4840-9f85-4c95c4af039d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.554744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e07a5d-df0a-467d-9623-abd5d06ecb71 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.555617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e07a5d-df0a-467d-9623-abd5d06ecb71 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.555903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e07a5d-df0a-467d-9623-abd5d06ecb71 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.556182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e07a5d-df0a-467d-9623-abd5d06ecb71 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8fffb41c87c649d0b3af0d8918611a49/config` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.556959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e07a5d-df0a-467d-9623-abd5d06ecb71 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=8fffb41c87c649d0b3af0d8918611a49)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.557962 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-90e07a5d-df0a-467d-9623-abd5d06ecb71 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:32.557962 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:32.557962 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:32.558919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e07a5d-df0a-467d-9623-abd5d06ecb71 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.567249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabee1e-8ca3-4d45-8be2-b92121d5383c tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5de19bb314f77a9b39276596f9191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1546bd78195407ab1bc04cea704b405', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.568172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabee1e-8ca3-4d45-8be2-b92121d5383c tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.568516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabee1e-8ca3-4d45-8be2-b92121d5383c tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.568877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabee1e-8ca3-4d45-8be2-b92121d5383c tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] PATH_INFO: `/v3/endpoints/1ec19d6b773c48938c98761b5ea14085` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.570219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabee1e-8ca3-4d45-8be2-b92121d5383c tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=1ec19d6b773c48938c98761b5ea14085)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.571867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabee1e-8ca3-4d45-8be2-b92121d5383c tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.580285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-acabee1e-8ca3-4d45-8be2-b92121d5383c tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '1ec19d6b773c48938c98761b5ea14085', 'request_id': 'req-acabee1e-8ca3-4d45-8be2-b92121d5383c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:32.590688 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2231/4500] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:32 2021] DELETE /identity/v3/endpoints/1ec19d6b773c48938c98761b5ea14085 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:32.594975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabee1e-8ca3-4d45-8be2-b92121d5383c tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.598922 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2270/4501] 10.222.0.13 () {60 vars in 1268 bytes} [Sat Dec 18 21:01:32 2021] PUT /identity/v3/domains/8fffb41c87c649d0b3af0d8918611a49/config => generated 138 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:32.603278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e07a5d-df0a-467d-9623-abd5d06ecb71 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.612883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e07a5d-df0a-467d-9623-abd5d06ecb71 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.615518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabee1e-8ca3-4d45-8be2-b92121d5383c tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.620224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a337c-37b2-497b-920a-4e360c756375 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5de19bb314f77a9b39276596f9191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1546bd78195407ab1bc04cea704b405', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.621063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a337c-37b2-497b-920a-4e360c756375 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.621353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a337c-37b2-497b-920a-4e360c756375 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.621642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a337c-37b2-497b-920a-4e360c756375 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] PATH_INFO: `/v3/regions/tempest-region-1599301035` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.622343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a337c-37b2-497b-920a-4e360c756375 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1599301035)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.624009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a337c-37b2-497b-920a-4e360c756375 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.628631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511de8c8-118c-406b-b5f0-6c133e2d9139 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.629700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511de8c8-118c-406b-b5f0-6c133e2d9139 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.630239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511de8c8-118c-406b-b5f0-6c133e2d9139 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.630571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511de8c8-118c-406b-b5f0-6c133e2d9139 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8fffb41c87c649d0b3af0d8918611a49/config/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.631838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511de8c8-118c-406b-b5f0-6c133e2d9139 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8fffb41c87c649d0b3af0d8918611a49, group=identity)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.632936 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-511de8c8-118c-406b-b5f0-6c133e2d9139 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:32.632936 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:32.632936 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:32.633869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511de8c8-118c-406b-b5f0-6c133e2d9139 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.640399 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2271/4502] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 21:01:32 2021] GET /identity/v3/domains/8fffb41c87c649d0b3af0d8918611a49/config/identity => generated 45 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:32.644225 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2232/4503] 10.222.0.13 () {58 vars in 1208 bytes} [Sat Dec 18 21:01:32 2021] DELETE /identity/v3/regions/tempest-region-1599301035 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:32.647937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511de8c8-118c-406b-b5f0-6c133e2d9139 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.648669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a337c-37b2-497b-920a-4e360c756375 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.655139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511de8c8-118c-406b-b5f0-6c133e2d9139 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.668643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a337c-37b2-497b-920a-4e360c756375 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.669659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee73248-0002-48ac-ba72-d7f36a932489 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.670565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee73248-0002-48ac-ba72-d7f36a932489 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.670887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee73248-0002-48ac-ba72-d7f36a932489 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.671132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee73248-0002-48ac-ba72-d7f36a932489 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8fffb41c87c649d0b3af0d8918611a49/config/identity/driver` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.672383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee73248-0002-48ac-ba72-d7f36a932489 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8fffb41c87c649d0b3af0d8918611a49, group=identity, option=driver)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.673265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9fa2e-f040-49c5-8407-ec7e38492bb3 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5de19bb314f77a9b39276596f9191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1546bd78195407ab1bc04cea704b405', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.673980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee73248-0002-48ac-ba72-d7f36a932489 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.674102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9fa2e-f040-49c5-8407-ec7e38492bb3 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.674407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9fa2e-f040-49c5-8407-ec7e38492bb3 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.674689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9fa2e-f040-49c5-8407-ec7e38492bb3 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] PATH_INFO: `/v3/services/ddb9f546ac9c4095aa44a0dc4d465ddd` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.675343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9fa2e-f040-49c5-8407-ec7e38492bb3 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ddb9f546ac9c4095aa44a0dc4d465ddd)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.676893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9fa2e-f040-49c5-8407-ec7e38492bb3 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.680466 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2272/4504] 10.222.0.13 () {58 vars in 1295 bytes} [Sat Dec 18 21:01:32 2021] GET /identity/v3/domains/8fffb41c87c649d0b3af0d8918611a49/config/identity/driver => generated 31 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:32.685033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee73248-0002-48ac-ba72-d7f36a932489 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.696135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee73248-0002-48ac-ba72-d7f36a932489 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.701451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744ff87-8af1-4a18-aa1a-a127ca3f4fff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.701772 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2233/4505] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:32 2021] DELETE /identity/v3/services/ddb9f546ac9c4095aa44a0dc4d465ddd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:32.702381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744ff87-8af1-4a18-aa1a-a127ca3f4fff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.702671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744ff87-8af1-4a18-aa1a-a127ca3f4fff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.702950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744ff87-8af1-4a18-aa1a-a127ca3f4fff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8fffb41c87c649d0b3af0d8918611a49/config/ldap` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.705407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744ff87-8af1-4a18-aa1a-a127ca3f4fff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8fffb41c87c649d0b3af0d8918611a49, group=ldap)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.705534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9fa2e-f040-49c5-8407-ec7e38492bb3 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.707334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744ff87-8af1-4a18-aa1a-a127ca3f4fff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.712399 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2273/4506] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 21:01:32 2021] GET /identity/v3/domains/8fffb41c87c649d0b3af0d8918611a49/config/ldap => generated 106 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:32.716863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744ff87-8af1-4a18-aa1a-a127ca3f4fff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.727870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744ff87-8af1-4a18-aa1a-a127ca3f4fff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.746037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a605f-45cb-49d3-b097-f70e1b22c615 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.746938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a605f-45cb-49d3-b097-f70e1b22c615 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.747224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a605f-45cb-49d3-b097-f70e1b22c615 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.747554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a605f-45cb-49d3-b097-f70e1b22c615 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8fffb41c87c649d0b3af0d8918611a49/config/ldap/url` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.748725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a605f-45cb-49d3-b097-f70e1b22c615 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8fffb41c87c649d0b3af0d8918611a49, group=ldap, option=url)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.750813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a605f-45cb-49d3-b097-f70e1b22c615 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.755936 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2274/4507] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 21:01:32 2021] GET /identity/v3/domains/8fffb41c87c649d0b3af0d8918611a49/config/ldap/url => generated 46 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:32.759772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a605f-45cb-49d3-b097-f70e1b22c615 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.770540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a605f-45cb-49d3-b097-f70e1b22c615 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.775370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b689a0-4640-4538-8c2e-5993509274f0 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.776569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b689a0-4640-4538-8c2e-5993509274f0 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.776875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b689a0-4640-4538-8c2e-5993509274f0 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.777694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b689a0-4640-4538-8c2e-5993509274f0 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8fffb41c87c649d0b3af0d8918611a49/config/ldap/user_tree_dn` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.779185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b689a0-4640-4538-8c2e-5993509274f0 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8fffb41c87c649d0b3af0d8918611a49, group=ldap, option=user_tree_dn)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.781323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b689a0-4640-4538-8c2e-5993509274f0 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.782315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9fa2e-f040-49c5-8407-ec7e38492bb3 tempest-EndpointsNegativeTestJSON-927664398 tempest-EndpointsNegativeTestJSON-927664398-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.789284 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2275/4508] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Dec 18 21:01:32 2021] GET /identity/v3/domains/8fffb41c87c649d0b3af0d8918611a49/config/ldap/user_tree_dn => generated 63 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:32.790102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d9a42-c76b-44a7-82c4-3e576a58fce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.790242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b689a0-4640-4538-8c2e-5993509274f0 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.791011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d9a42-c76b-44a7-82c4-3e576a58fce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.791304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d9a42-c76b-44a7-82c4-3e576a58fce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.791587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d9a42-c76b-44a7-82c4-3e576a58fce4 admin admin] PATH_INFO: `/v3/users/58efbd1c354a4f869e14149921a2c00e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.792853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d9a42-c76b-44a7-82c4-3e576a58fce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58efbd1c354a4f869e14149921a2c00e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.794795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d9a42-c76b-44a7-82c4-3e576a58fce4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.799430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b689a0-4640-4538-8c2e-5993509274f0 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.804093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17222ae-5977-4fff-adf1-c731a8ff0cbc tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.805289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17222ae-5977-4fff-adf1-c731a8ff0cbc tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.805574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17222ae-5977-4fff-adf1-c731a8ff0cbc tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.805851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17222ae-5977-4fff-adf1-c731a8ff0cbc tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8fffb41c87c649d0b3af0d8918611a49/config` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.806533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17222ae-5977-4fff-adf1-c731a8ff0cbc tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=8fffb41c87c649d0b3af0d8918611a49)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.807510 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-c17222ae-5977-4fff-adf1-c731a8ff0cbc tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:32.807510 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:32.807510 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:32.808392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17222ae-5977-4fff-adf1-c731a8ff0cbc tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.817210 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2276/4509] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:01:32 2021] DELETE /identity/v3/domains/8fffb41c87c649d0b3af0d8918611a49/config => generated 0 bytes in 27 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:32.821616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17222ae-5977-4fff-adf1-c731a8ff0cbc tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.833607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17222ae-5977-4fff-adf1-c731a8ff0cbc tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.838625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef1459-c4c9-491e-965a-b680e9855f04 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:32.840473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef1459-c4c9-491e-965a-b680e9855f04 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.840783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef1459-c4c9-491e-965a-b680e9855f04 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.841053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef1459-c4c9-491e-965a-b680e9855f04 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8fffb41c87c649d0b3af0d8918611a49` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.842410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef1459-c4c9-491e-965a-b680e9855f04 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8fffb41c87c649d0b3af0d8918611a49)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:32.844013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef1459-c4c9-491e-965a-b680e9855f04 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:32.845725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-891d9a42-c76b-44a7-82c4-3e576a58fce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58efbd1c354a4f869e14149921a2c00e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:32.853492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-891d9a42-c76b-44a7-82c4-3e576a58fce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58efbd1c354a4f869e14149921a2c00e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:32.864974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b7ef1459-c4c9-491e-965a-b680e9855f04 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8fffb41c87c649d0b3af0d8918611a49'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:32.865798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b7ef1459-c4c9-491e-965a-b680e9855f04 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8fffb41c87c649d0b3af0d8918611a49'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:32.866072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-891d9a42-c76b-44a7-82c4-3e576a58fce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58efbd1c354a4f869e14149921a2c00e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:32.866995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-891d9a42-c76b-44a7-82c4-3e576a58fce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58efbd1c354a4f869e14149921a2c00e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:32.876607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-891d9a42-c76b-44a7-82c4-3e576a58fce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58efbd1c354a4f869e14149921a2c00e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:32.886936 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2234/4510] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:32 2021] DELETE /identity/v3/users/58efbd1c354a4f869e14149921a2c00e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:32.888928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcffb9b-f5d9-4c2c-9fa0-00abc99575ee None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:32.889238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcffb9b-f5d9-4c2c-9fa0-00abc99575ee None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:32.889544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcffb9b-f5d9-4c2c-9fa0-00abc99575ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:32.896090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b7ef1459-c4c9-491e-965a-b680e9855f04 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8fffb41c87c649d0b3af0d8918611a49'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:32.896855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b7ef1459-c4c9-491e-965a-b680e9855f04 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8fffb41c87c649d0b3af0d8918611a49'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:32.900074 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2277/4511] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:01:32 2021] PATCH /identity/v3/domains/8fffb41c87c649d0b3af0d8918611a49 => generated 278 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:32.904620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef1459-c4c9-491e-965a-b680e9855f04 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.906140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b7ef1459-c4c9-491e-965a-b680e9855f04 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:32.908525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0fcffb9b-f5d9-4c2c-9fa0-00abc99575ee None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:32.909725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0fcffb9b-f5d9-4c2c-9fa0-00abc99575ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:32.980354 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2235/4512] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:32.983447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef1459-c4c9-491e-965a-b680e9855f04 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:32.990599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcffb9b-f5d9-4c2c-9fa0-00abc99575ee None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:32.991981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0fcffb9b-f5d9-4c2c-9fa0-00abc99575ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:33.042858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:33.043940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:33.044405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:33.044771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8fffb41c87c649d0b3af0d8918611a49` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:33.056956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8fffb41c87c649d0b3af0d8918611a49)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:33.057996 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:33.057996 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:33.057996 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:33.059709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:33.062687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcffb9b-f5d9-4c2c-9fa0-00abc99575ee None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:33.068270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1d103-290e-478d-bac7-a296b2ec1743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:33.068444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1d103-290e-478d-bac7-a296b2ec1743 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:33.069824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1d103-290e-478d-bac7-a296b2ec1743 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:33.069946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1d103-290e-478d-bac7-a296b2ec1743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:33.085697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1d103-290e-478d-bac7-a296b2ec1743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:33.085697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1d103-290e-478d-bac7-a296b2ec1743 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:33.086037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8fffb41c87c649d0b3af0d8918611a49'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.091545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8fffb41c87c649d0b3af0d8918611a49'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.092786 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2236/4513] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:01:33.151028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fffb41c87c649d0b3af0d8918611a49', 'request_id': 'req-87690787-a6cf-4f6e-bd03-d09eae6785da'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.157888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fffb41c87c649d0b3af0d8918611a49', 'request_id': 'req-87690787-a6cf-4f6e-bd03-d09eae6785da'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.168361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fffb41c87c649d0b3af0d8918611a49', 'request_id': 'req-87690787-a6cf-4f6e-bd03-d09eae6785da'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.182642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] The token cache is being invalidate because project 8fffb41c87c649d0b3af0d8918611a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:33.182939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.184223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.201172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8fffb41c87c649d0b3af0d8918611a49', 'request_id': 'req-87690787-a6cf-4f6e-bd03-d09eae6785da'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.205743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8fffb41c87c649d0b3af0d8918611a49', 'request_id': 'req-87690787-a6cf-4f6e-bd03-d09eae6785da'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.206705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8fffb41c87c649d0b3af0d8918611a49', 'request_id': 'req-87690787-a6cf-4f6e-bd03-d09eae6785da'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.213695 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2278/4514] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:01:32 2021] DELETE /identity/v3/domains/8fffb41c87c649d0b3af0d8918611a49 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:33.218875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1d103-290e-478d-bac7-a296b2ec1743 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:33.229413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1d103-290e-478d-bac7-a296b2ec1743 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:33.307342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c7be9-bafc-4f5b-b6cd-8b435aeffc4f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:33.308008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c7be9-bafc-4f5b-b6cd-8b435aeffc4f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:33.308807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c7be9-bafc-4f5b-b6cd-8b435aeffc4f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:33.309096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c7be9-bafc-4f5b-b6cd-8b435aeffc4f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:33.309852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c7be9-bafc-4f5b-b6cd-8b435aeffc4f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:33.310893 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-ea0c7be9-bafc-4f5b-b6cd-8b435aeffc4f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:33.310893 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:33.310893 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:33.311801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c7be9-bafc-4f5b-b6cd-8b435aeffc4f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:33.328936 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2237/4515] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:01:33 2021] POST /identity/v3/domains => generated 276 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:33.333318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:33.334807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:33.347429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87690787-a6cf-4f6e-bd03-d09eae6785da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:33.384880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c7be9-bafc-4f5b-b6cd-8b435aeffc4f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:33.386800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ea0c7be9-bafc-4f5b-b6cd-8b435aeffc4f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:33.408870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4651018-06cb-40b9-95b3-4d403b76bc84 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:33.409838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4651018-06cb-40b9-95b3-4d403b76bc84 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:33.410135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4651018-06cb-40b9-95b3-4d403b76bc84 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:33.410608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4651018-06cb-40b9-95b3-4d403b76bc84 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb/config` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:33.411559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4651018-06cb-40b9-95b3-4d403b76bc84 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=8c313fc11fed45cf9dfc6a2ce635b4bb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:33.413608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4651018-06cb-40b9-95b3-4d403b76bc84 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:33.449892 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2279/4516] 10.222.0.13 () {60 vars in 1268 bytes} [Sat Dec 18 21:01:33 2021] PUT /identity/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb/config => generated 138 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:33.451008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4651018-06cb-40b9-95b3-4d403b76bc84 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:33.460577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4651018-06cb-40b9-95b3-4d403b76bc84 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:33.466503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5378086-f7d2-48eb-acd2-ebb938b281c5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:33.466930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c7be9-bafc-4f5b-b6cd-8b435aeffc4f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:33.467452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5378086-f7d2-48eb-acd2-ebb938b281c5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:33.467851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5378086-f7d2-48eb-acd2-ebb938b281c5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:33.468140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5378086-f7d2-48eb-acd2-ebb938b281c5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb/config` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:33.469015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5378086-f7d2-48eb-acd2-ebb938b281c5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=8c313fc11fed45cf9dfc6a2ce635b4bb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:33.470075 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-f5378086-f7d2-48eb-acd2-ebb938b281c5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:33.470075 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:33.470075 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:33.471024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5378086-f7d2-48eb-acd2-ebb938b281c5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:33.471851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:33.472885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:33.473102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:33.473490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f admin admin] PATH_INFO: `/v3/projects/f7a930c316b640cd901dd54069fab300` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:33.474782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7a930c316b640cd901dd54069fab300)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:33.477380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:33.504543 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2280/4517] 10.222.0.13 () {60 vars in 1270 bytes} [Sat Dec 18 21:01:33 2021] PATCH /identity/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb/config => generated 142 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:33.505452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5378086-f7d2-48eb-acd2-ebb938b281c5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:33.516090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5378086-f7d2-48eb-acd2-ebb938b281c5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:33.521417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dd0fa-40ea-4a17-80db-4d38953453f6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:33.522274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dd0fa-40ea-4a17-80db-4d38953453f6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:33.522563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dd0fa-40ea-4a17-80db-4d38953453f6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:33.522846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dd0fa-40ea-4a17-80db-4d38953453f6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb/config` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:33.524202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915dd0fa-40ea-4a17-80db-4d38953453f6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8c313fc11fed45cf9dfc6a2ce635b4bb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:33.525906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915dd0fa-40ea-4a17-80db-4d38953453f6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:33.530660 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2281/4518] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 21:01:33 2021] GET /identity/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb/config => generated 142 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:33.534747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dd0fa-40ea-4a17-80db-4d38953453f6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:33.537023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7a930c316b640cd901dd54069fab300', 'request_id': 'req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.544056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7a930c316b640cd901dd54069fab300', 'request_id': 'req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.545987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dd0fa-40ea-4a17-80db-4d38953453f6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:33.549990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7a930c316b640cd901dd54069fab300', 'request_id': 'req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.565670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f admin admin] The token cache is being invalidate because project f7a930c316b640cd901dd54069fab300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:33.566480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.567552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.569159 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2238/4519] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:33 2021] DELETE /identity/v3/projects/f7a930c316b640cd901dd54069fab300 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:33.572845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:33.574267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:33.617173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea36e78-2683-4f74-9cad-273bc9f41e9b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:33.618056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea36e78-2683-4f74-9cad-273bc9f41e9b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:33.618448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea36e78-2683-4f74-9cad-273bc9f41e9b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:33.618720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea36e78-2683-4f74-9cad-273bc9f41e9b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb/config` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:33.619417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea36e78-2683-4f74-9cad-273bc9f41e9b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=8c313fc11fed45cf9dfc6a2ce635b4bb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:33.621669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea36e78-2683-4f74-9cad-273bc9f41e9b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:33.631421 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2282/4520] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:01:33 2021] DELETE /identity/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb/config => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:33.635855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea36e78-2683-4f74-9cad-273bc9f41e9b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:33.637894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5ea36e78-2683-4f74-9cad-273bc9f41e9b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:33.650640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea36e78-2683-4f74-9cad-273bc9f41e9b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:33.651193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867b14a-c7fb-4dd0-8bc2-f15b64cc114f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:33.655439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49f75d-f98b-4e86-8dcb-8ec55d42ce29 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:33.655855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67d6de-0df5-4fcb-88c6-3cf2ab9aecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:33.656443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49f75d-f98b-4e86-8dcb-8ec55d42ce29 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:33.656720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67d6de-0df5-4fcb-88c6-3cf2ab9aecec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:33.656889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49f75d-f98b-4e86-8dcb-8ec55d42ce29 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:33.657012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67d6de-0df5-4fcb-88c6-3cf2ab9aecec admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:33.657264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67d6de-0df5-4fcb-88c6-3cf2ab9aecec admin admin] PATH_INFO: `/v3/users/cdc5de19bb314f77a9b39276596f9191` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:33.657387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49f75d-f98b-4e86-8dcb-8ec55d42ce29 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb/config` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:33.658493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67d6de-0df5-4fcb-88c6-3cf2ab9aecec admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc5de19bb314f77a9b39276596f9191)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:33.658703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49f75d-f98b-4e86-8dcb-8ec55d42ce29 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8c313fc11fed45cf9dfc6a2ce635b4bb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:33.660378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67d6de-0df5-4fcb-88c6-3cf2ab9aecec admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:33.660476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49f75d-f98b-4e86-8dcb-8ec55d42ce29 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:33.672834 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-ea49f75d-f98b-4e86-8dcb-8ec55d42ce29 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Could not find any options in domain configuration for domain 8c313fc11fed45cf9dfc6a2ce635b4bb.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 8c313fc11fed45cf9dfc6a2ce635b4bb. Dec 18 21:01:33.674037 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2283/4521] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 21:01:33 2021] GET /identity/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb/config => generated 151 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 18 21:01:33.678095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49f75d-f98b-4e86-8dcb-8ec55d42ce29 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:33.688770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49f75d-f98b-4e86-8dcb-8ec55d42ce29 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:33.693924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708875e-9f70-41f6-8bb4-5fbfc30498f8 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:33.694862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708875e-9f70-41f6-8bb4-5fbfc30498f8 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:33.695152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708875e-9f70-41f6-8bb4-5fbfc30498f8 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:33.695442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708875e-9f70-41f6-8bb4-5fbfc30498f8 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb/config` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:33.696298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708875e-9f70-41f6-8bb4-5fbfc30498f8 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=8c313fc11fed45cf9dfc6a2ce635b4bb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:33.697901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708875e-9f70-41f6-8bb4-5fbfc30498f8 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:33.703805 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2284/4522] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:01:33 2021] DELETE /identity/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb/config => generated 0 bytes in 26 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:33.707925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708875e-9f70-41f6-8bb4-5fbfc30498f8 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:33.708990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8e67d6de-0df5-4fcb-88c6-3cf2ab9aecec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc5de19bb314f77a9b39276596f9191'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.716967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8e67d6de-0df5-4fcb-88c6-3cf2ab9aecec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc5de19bb314f77a9b39276596f9191'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.718097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708875e-9f70-41f6-8bb4-5fbfc30498f8 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:33.722936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df1d9e-7797-425e-bb0e-c734b3534c24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:33.723774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df1d9e-7797-425e-bb0e-c734b3534c24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:33.724066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df1d9e-7797-425e-bb0e-c734b3534c24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:33.724345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df1d9e-7797-425e-bb0e-c734b3534c24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:33.725663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df1d9e-7797-425e-bb0e-c734b3534c24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8c313fc11fed45cf9dfc6a2ce635b4bb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:33.727324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df1d9e-7797-425e-bb0e-c734b3534c24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:33.728727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8e67d6de-0df5-4fcb-88c6-3cf2ab9aecec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc5de19bb314f77a9b39276596f9191'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.729442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8e67d6de-0df5-4fcb-88c6-3cf2ab9aecec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc5de19bb314f77a9b39276596f9191'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.741568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8e67d6de-0df5-4fcb-88c6-3cf2ab9aecec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc5de19bb314f77a9b39276596f9191'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.748446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-88df1d9e-7797-425e-bb0e-c734b3534c24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8c313fc11fed45cf9dfc6a2ce635b4bb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.748599 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2239/4523] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:33 2021] DELETE /identity/v3/users/cdc5de19bb314f77a9b39276596f9191 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:33.749563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-88df1d9e-7797-425e-bb0e-c734b3534c24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8c313fc11fed45cf9dfc6a2ce635b4bb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.776224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-88df1d9e-7797-425e-bb0e-c734b3534c24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8c313fc11fed45cf9dfc6a2ce635b4bb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.776874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-88df1d9e-7797-425e-bb0e-c734b3534c24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8c313fc11fed45cf9dfc6a2ce635b4bb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.783108 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2285/4524] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:01:33 2021] PATCH /identity/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb => generated 277 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:33.784316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67d6de-0df5-4fcb-88c6-3cf2ab9aecec admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:33.785784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8e67d6de-0df5-4fcb-88c6-3cf2ab9aecec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:33.858270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67d6de-0df5-4fcb-88c6-3cf2ab9aecec admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:33.921432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:33.922331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:33.922621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:33.922903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:33.933647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8c313fc11fed45cf9dfc6a2ce635b4bb)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:33.935293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:33.957358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8c313fc11fed45cf9dfc6a2ce635b4bb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:33.960509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8c313fc11fed45cf9dfc6a2ce635b4bb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.007426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c313fc11fed45cf9dfc6a2ce635b4bb', 'request_id': 'req-b6139aba-97cb-47aa-977f-137dac5045b5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.013897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c313fc11fed45cf9dfc6a2ce635b4bb', 'request_id': 'req-b6139aba-97cb-47aa-977f-137dac5045b5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.019759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c313fc11fed45cf9dfc6a2ce635b4bb', 'request_id': 'req-b6139aba-97cb-47aa-977f-137dac5045b5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.024103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df1d9e-7797-425e-bb0e-c734b3534c24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.026105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-88df1d9e-7797-425e-bb0e-c734b3534c24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:34.034961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] The token cache is being invalidate because project 8c313fc11fed45cf9dfc6a2ce635b4bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:34.035290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.035973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.048556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8c313fc11fed45cf9dfc6a2ce635b4bb', 'request_id': 'req-b6139aba-97cb-47aa-977f-137dac5045b5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.052183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8c313fc11fed45cf9dfc6a2ce635b4bb', 'request_id': 'req-b6139aba-97cb-47aa-977f-137dac5045b5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.052937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8c313fc11fed45cf9dfc6a2ce635b4bb', 'request_id': 'req-b6139aba-97cb-47aa-977f-137dac5045b5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.063006 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2240/4525] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:01:33 2021] DELETE /identity/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:34.064710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.066134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:34.098336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df1d9e-7797-425e-bb0e-c734b3534c24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.134388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6139aba-97cb-47aa-977f-137dac5045b5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.140430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afd623-0e8b-4bce-9180-3ad0fef0db95 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.141100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afd623-0e8b-4bce-9180-3ad0fef0db95 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.141420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afd623-0e8b-4bce-9180-3ad0fef0db95 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.142363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afd623-0e8b-4bce-9180-3ad0fef0db95 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.143288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afd623-0e8b-4bce-9180-3ad0fef0db95 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.145132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afd623-0e8b-4bce-9180-3ad0fef0db95 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.158068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5402a-0cab-472b-84de-d3b06b4f0150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.159056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5402a-0cab-472b-84de-d3b06b4f0150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.159440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5402a-0cab-472b-84de-d3b06b4f0150 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.159788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5402a-0cab-472b-84de-d3b06b4f0150 admin admin] PATH_INFO: `/v3/projects/b1546bd78195407ab1bc04cea704b405` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.161092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5402a-0cab-472b-84de-d3b06b4f0150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1546bd78195407ab1bc04cea704b405)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.163162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5402a-0cab-472b-84de-d3b06b4f0150 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.165389 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2241/4526] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:01:34 2021] POST /identity/v3/domains => generated 275 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:34.166431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afd623-0e8b-4bce-9180-3ad0fef0db95 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.219708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b0e5402a-0cab-472b-84de-d3b06b4f0150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1546bd78195407ab1bc04cea704b405', 'request_id': 'req-b0e5402a-0cab-472b-84de-d3b06b4f0150'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.227351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b0e5402a-0cab-472b-84de-d3b06b4f0150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1546bd78195407ab1bc04cea704b405', 'request_id': 'req-b0e5402a-0cab-472b-84de-d3b06b4f0150'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.237304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b0e5402a-0cab-472b-84de-d3b06b4f0150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1546bd78195407ab1bc04cea704b405', 'request_id': 'req-b0e5402a-0cab-472b-84de-d3b06b4f0150'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.244240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afd623-0e8b-4bce-9180-3ad0fef0db95 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.250352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b0e5402a-0cab-472b-84de-d3b06b4f0150 admin admin] The token cache is being invalidate because project b1546bd78195407ab1bc04cea704b405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:34.250650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b0e5402a-0cab-472b-84de-d3b06b4f0150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.251454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b0e5402a-0cab-472b-84de-d3b06b4f0150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.253494 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2286/4527] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:34 2021] DELETE /identity/v3/projects/b1546bd78195407ab1bc04cea704b405 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:34.258880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93faa2-d1e9-4761-908a-c8423c005afa None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.259178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93faa2-d1e9-4761-908a-c8423c005afa None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.259467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93faa2-d1e9-4761-908a-c8423c005afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.282338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bb93faa2-d1e9-4761-908a-c8423c005afa None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:34.283582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bb93faa2-d1e9-4761-908a-c8423c005afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:34.326096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b565209-6027-4316-b157-68b173a72f24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.326979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b565209-6027-4316-b157-68b173a72f24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.327271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b565209-6027-4316-b157-68b173a72f24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.327553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b565209-6027-4316-b157-68b173a72f24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/9b8b7c2f31484e48b1f776ba33103999/config` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.328313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b565209-6027-4316-b157-68b173a72f24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=9b8b7c2f31484e48b1f776ba33103999)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.329305 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-4b565209-6027-4316-b157-68b173a72f24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:34.329305 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:34.329305 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:34.330919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b565209-6027-4316-b157-68b173a72f24 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.355763 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2287/4528] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:34.373195 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2242/4529] 10.222.0.13 () {60 vars in 1268 bytes} [Sat Dec 18 21:01:34 2021] PUT /identity/v3/domains/9b8b7c2f31484e48b1f776ba33103999/config => generated 138 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:34.375161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93faa2-d1e9-4761-908a-c8423c005afa None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.376657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bb93faa2-d1e9-4761-908a-c8423c005afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:34.397651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93faa2-d1e9-4761-908a-c8423c005afa None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.408182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8860d7-c3a9-4fe8-9f61-2f7033d2d703 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.409631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8860d7-c3a9-4fe8-9f61-2f7033d2d703 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.410212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8860d7-c3a9-4fe8-9f61-2f7033d2d703 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.410699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8860d7-c3a9-4fe8-9f61-2f7033d2d703 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/9b8b7c2f31484e48b1f776ba33103999/config/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.412409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8860d7-c3a9-4fe8-9f61-2f7033d2d703 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=9b8b7c2f31484e48b1f776ba33103999, group=identity)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.414219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8860d7-c3a9-4fe8-9f61-2f7033d2d703 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.431005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0623397-9fac-402f-aaf7-b35c0a6fb3f3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.431464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0623397-9fac-402f-aaf7-b35c0a6fb3f3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.431900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0623397-9fac-402f-aaf7-b35c0a6fb3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.452369 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2288/4530] 10.222.0.13 () {60 vars in 1296 bytes} [Sat Dec 18 21:01:34 2021] PATCH /identity/v3/domains/9b8b7c2f31484e48b1f776ba33103999/config/identity => generated 177 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:34.455968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8860d7-c3a9-4fe8-9f61-2f7033d2d703 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.458189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b0623397-9fac-402f-aaf7-b35c0a6fb3f3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:34.459521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b0623397-9fac-402f-aaf7-b35c0a6fb3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:34.471043 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2243/4531] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:34.472955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8860d7-c3a9-4fe8-9f61-2f7033d2d703 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.475394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0623397-9fac-402f-aaf7-b35c0a6fb3f3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.477410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8e9d3-863c-454a-b7c6-8c3dc60d5bf2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.478308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8e9d3-863c-454a-b7c6-8c3dc60d5bf2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.479134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8e9d3-863c-454a-b7c6-8c3dc60d5bf2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.479134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8e9d3-863c-454a-b7c6-8c3dc60d5bf2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/9b8b7c2f31484e48b1f776ba33103999/config/identity/driver` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.479708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8e9d3-863c-454a-b7c6-8c3dc60d5bf2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=9b8b7c2f31484e48b1f776ba33103999, group=identity, option=driver)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.481387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8e9d3-863c-454a-b7c6-8c3dc60d5bf2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.486246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0623397-9fac-402f-aaf7-b35c0a6fb3f3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.492386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb839209-23a6-4550-9657-8cc85df1bd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.493075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb839209-23a6-4550-9657-8cc85df1bd7f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.493392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb839209-23a6-4550-9657-8cc85df1bd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.493679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb839209-23a6-4550-9657-8cc85df1bd7f admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.494520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb839209-23a6-4550-9657-8cc85df1bd7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:01:34.494837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb839209-23a6-4550-9657-8cc85df1bd7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.497051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb839209-23a6-4550-9657-8cc85df1bd7f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.508286 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2289/4532] 10.222.0.13 () {60 vars in 1317 bytes} [Sat Dec 18 21:01:34 2021] PATCH /identity/v3/domains/9b8b7c2f31484e48b1f776ba33103999/config/identity/driver => generated 176 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:34.510285 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2244/4533] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:01:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:34.512948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8e9d3-863c-454a-b7c6-8c3dc60d5bf2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.514239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb839209-23a6-4550-9657-8cc85df1bd7f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.522582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8e9d3-863c-454a-b7c6-8c3dc60d5bf2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.523876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb839209-23a6-4550-9657-8cc85df1bd7f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.527358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ceb0e3-a07e-4632-b000-898559c884ff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.528437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ceb0e3-a07e-4632-b000-898559c884ff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.528727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ceb0e3-a07e-4632-b000-898559c884ff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.529009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ceb0e3-a07e-4632-b000-898559c884ff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/9b8b7c2f31484e48b1f776ba33103999/config/identity/driver` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.529134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17808c-a5dc-4810-bcf7-c9e2e8acd3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.529709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ceb0e3-a07e-4632-b000-898559c884ff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=9b8b7c2f31484e48b1f776ba33103999, group=identity, option=driver)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.529840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17808c-a5dc-4810-bcf7-c9e2e8acd3ea admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.530018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17808c-a5dc-4810-bcf7-c9e2e8acd3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.530341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17808c-a5dc-4810-bcf7-c9e2e8acd3ea admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.531164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17808c-a5dc-4810-bcf7-c9e2e8acd3ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.531326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ceb0e3-a07e-4632-b000-898559c884ff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.533029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17808c-a5dc-4810-bcf7-c9e2e8acd3ea admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.546466 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2290/4534] 10.222.0.13 () {58 vars in 1298 bytes} [Sat Dec 18 21:01:34 2021] DELETE /identity/v3/domains/9b8b7c2f31484e48b1f776ba33103999/config/identity/driver => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:34.551069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ceb0e3-a07e-4632-b000-898559c884ff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.559030 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2245/4535] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:34 2021] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:34.561041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ceb0e3-a07e-4632-b000-898559c884ff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.562943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17808c-a5dc-4810-bcf7-c9e2e8acd3ea admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.618230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5d5dd-78b2-4e79-8f27-89d5c7c54a35 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.619125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5d5dd-78b2-4e79-8f27-89d5c7c54a35 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.619406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5d5dd-78b2-4e79-8f27-89d5c7c54a35 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.619683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5d5dd-78b2-4e79-8f27-89d5c7c54a35 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/9b8b7c2f31484e48b1f776ba33103999/config/identity/driver` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.621413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5d5dd-78b2-4e79-8f27-89d5c7c54a35 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=9b8b7c2f31484e48b1f776ba33103999, group=identity, option=driver)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.623108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5d5dd-78b2-4e79-8f27-89d5c7c54a35 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.623845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17808c-a5dc-4810-bcf7-c9e2e8acd3ea admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.628521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5999ceb-8306-40d1-8a84-3d8f34353719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.629180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5999ceb-8306-40d1-8a84-3d8f34353719 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.629463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5999ceb-8306-40d1-8a84-3d8f34353719 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.629737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5999ceb-8306-40d1-8a84-3d8f34353719 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.630456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5999ceb-8306-40d1-8a84-3d8f34353719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.632321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5999ceb-8306-40d1-8a84-3d8f34353719 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.636244 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-efd5d5dd-78b2-4e79-8f27-89d5c7c54a35 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Could not find option driver in group identity in domain configuration for domain 9b8b7c2f31484e48b1f776ba33103999.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 9b8b7c2f31484e48b1f776ba33103999. Dec 18 21:01:34.638030 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2291/4536] 10.222.0.13 () {58 vars in 1295 bytes} [Sat Dec 18 21:01:34 2021] GET /identity/v3/domains/9b8b7c2f31484e48b1f776ba33103999/config/identity/driver => generated 171 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 18 21:01:34.642030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5d5dd-78b2-4e79-8f27-89d5c7c54a35 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.652536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5d5dd-78b2-4e79-8f27-89d5c7c54a35 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.657366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1991775-f1e5-4ea3-8461-4b8dc3e3429a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.657784 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2246/4537] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:34 2021] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:34.658391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991775-f1e5-4ea3-8461-4b8dc3e3429a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.658679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991775-f1e5-4ea3-8461-4b8dc3e3429a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.658802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5999ceb-8306-40d1-8a84-3d8f34353719 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.658958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991775-f1e5-4ea3-8461-4b8dc3e3429a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/9b8b7c2f31484e48b1f776ba33103999/config/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.659755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1991775-f1e5-4ea3-8461-4b8dc3e3429a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=9b8b7c2f31484e48b1f776ba33103999, group=identity)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.661342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1991775-f1e5-4ea3-8461-4b8dc3e3429a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.668217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5999ceb-8306-40d1-8a84-3d8f34353719 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.674826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778996e6-d047-403a-9b95-6c6b235ad738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.675612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778996e6-d047-403a-9b95-6c6b235ad738 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.675945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778996e6-d047-403a-9b95-6c6b235ad738 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.676299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778996e6-d047-403a-9b95-6c6b235ad738 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.677092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778996e6-d047-403a-9b95-6c6b235ad738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.679057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778996e6-d047-403a-9b95-6c6b235ad738 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.679200 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2292/4538] 10.222.0.13 () {58 vars in 1277 bytes} [Sat Dec 18 21:01:34 2021] DELETE /identity/v3/domains/9b8b7c2f31484e48b1f776ba33103999/config/identity => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:34.682997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1991775-f1e5-4ea3-8461-4b8dc3e3429a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.693655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1991775-f1e5-4ea3-8461-4b8dc3e3429a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.697455 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2247/4539] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:34 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:34.698823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a1a6b-fba2-4def-8308-2e54173a3ab5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.699040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778996e6-d047-403a-9b95-6c6b235ad738 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.700378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a1a6b-fba2-4def-8308-2e54173a3ab5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.700734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a1a6b-fba2-4def-8308-2e54173a3ab5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.701081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a1a6b-fba2-4def-8308-2e54173a3ab5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/9b8b7c2f31484e48b1f776ba33103999/config/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.702452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a1a6b-fba2-4def-8308-2e54173a3ab5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=9b8b7c2f31484e48b1f776ba33103999, group=identity)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.704097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a1a6b-fba2-4def-8308-2e54173a3ab5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.713934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778996e6-d047-403a-9b95-6c6b235ad738 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.715119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceddfbd-f708-441e-b928-77186330873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.716114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceddfbd-f708-441e-b928-77186330873d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.716545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceddfbd-f708-441e-b928-77186330873d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.717126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceddfbd-f708-441e-b928-77186330873d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.717960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceddfbd-f708-441e-b928-77186330873d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.719844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceddfbd-f708-441e-b928-77186330873d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.720735 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-d66a1a6b-fba2-4def-8308-2e54173a3ab5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Could not find group identity in domain configuration for domain 9b8b7c2f31484e48b1f776ba33103999.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 9b8b7c2f31484e48b1f776ba33103999. Dec 18 21:01:34.722344 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2293/4540] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Dec 18 21:01:34 2021] GET /identity/v3/domains/9b8b7c2f31484e48b1f776ba33103999/config/identity => generated 154 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 18 21:01:34.726103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a1a6b-fba2-4def-8308-2e54173a3ab5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.736623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a1a6b-fba2-4def-8308-2e54173a3ab5 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.739806 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2248/4541] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:34 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:34.743759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceddfbd-f708-441e-b928-77186330873d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.746566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdff796-b781-49c7-a42f-4ea785d5b20a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.747525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdff796-b781-49c7-a42f-4ea785d5b20a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.747984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdff796-b781-49c7-a42f-4ea785d5b20a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.748368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdff796-b781-49c7-a42f-4ea785d5b20a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/9b8b7c2f31484e48b1f776ba33103999/config` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.749156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdff796-b781-49c7-a42f-4ea785d5b20a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=9b8b7c2f31484e48b1f776ba33103999)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.750891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdff796-b781-49c7-a42f-4ea785d5b20a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.755206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceddfbd-f708-441e-b928-77186330873d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.760883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d571e3-763f-49c9-95b9-43fb5911c443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.762346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d571e3-763f-49c9-95b9-43fb5911c443 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.762558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d571e3-763f-49c9-95b9-43fb5911c443 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.762839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d571e3-763f-49c9-95b9-43fb5911c443 admin admin] PATH_INFO: `/v3/projects/859f7973f65b49c7bfcab4de45b69114/users/2e5575c705744037b98c0ac16253706a/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.764684 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2294/4542] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:01:34 2021] DELETE /identity/v3/domains/9b8b7c2f31484e48b1f776ba33103999/config => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:34.769101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdff796-b781-49c7-a42f-4ea785d5b20a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.781793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d571e3-763f-49c9-95b9-43fb5911c443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859f7973f65b49c7bfcab4de45b69114, user_id=2e5575c705744037b98c0ac16253706a, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.782356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdff796-b781-49c7-a42f-4ea785d5b20a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.785239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d571e3-763f-49c9-95b9-43fb5911c443 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.787840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6614ea0-ef18-4f9d-a2e5-07551ab296d1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.788739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6614ea0-ef18-4f9d-a2e5-07551ab296d1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.789154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6614ea0-ef18-4f9d-a2e5-07551ab296d1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.789442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6614ea0-ef18-4f9d-a2e5-07551ab296d1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/9b8b7c2f31484e48b1f776ba33103999` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.790866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6614ea0-ef18-4f9d-a2e5-07551ab296d1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9b8b7c2f31484e48b1f776ba33103999)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.792669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6614ea0-ef18-4f9d-a2e5-07551ab296d1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.800526 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2249/4543] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:34 2021] PUT /identity/v3/projects/859f7973f65b49c7bfcab4de45b69114/users/2e5575c705744037b98c0ac16253706a/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:34.810876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99362a8c-7f83-438a-af03-16cb9a1c2a3c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.811168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99362a8c-7f83-438a-af03-16cb9a1c2a3c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.811457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99362a8c-7f83-438a-af03-16cb9a1c2a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.820931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b6614ea0-ef18-4f9d-a2e5-07551ab296d1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9b8b7c2f31484e48b1f776ba33103999'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.821555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b6614ea0-ef18-4f9d-a2e5-07551ab296d1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9b8b7c2f31484e48b1f776ba33103999'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.848274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b6614ea0-ef18-4f9d-a2e5-07551ab296d1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9b8b7c2f31484e48b1f776ba33103999'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.849026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b6614ea0-ef18-4f9d-a2e5-07551ab296d1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9b8b7c2f31484e48b1f776ba33103999'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.851837 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2295/4544] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:01:34 2021] PATCH /identity/v3/domains/9b8b7c2f31484e48b1f776ba33103999 => generated 276 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:34.854312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-99362a8c-7f83-438a-af03-16cb9a1c2a3c None None] MFA Rules not processed for user `2e5575c705744037b98c0ac16253706a`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:34.856060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-99362a8c-7f83-438a-af03-16cb9a1c2a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:34.856549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6614ea0-ef18-4f9d-a2e5-07551ab296d1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.857929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b6614ea0-ef18-4f9d-a2e5-07551ab296d1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:34.919594 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2250/4545] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:34 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:34.922464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6614ea0-ef18-4f9d-a2e5-07551ab296d1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.924281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99362a8c-7f83-438a-af03-16cb9a1c2a3c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:34.925585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-99362a8c-7f83-438a-af03-16cb9a1c2a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:34.927316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.928163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.928445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.928728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/9b8b7c2f31484e48b1f776ba33103999` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.939812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9b8b7c2f31484e48b1f776ba33103999)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.941671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:34.963295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9b8b7c2f31484e48b1f776ba33103999'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.966484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9b8b7c2f31484e48b1f776ba33103999'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:34.988583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99362a8c-7f83-438a-af03-16cb9a1c2a3c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:34.993590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d32f07-bbe2-4e05-9162-f80375af89b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:34.994511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d32f07-bbe2-4e05-9162-f80375af89b6 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:34.994850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d32f07-bbe2-4e05-9162-f80375af89b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:34.995148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d32f07-bbe2-4e05-9162-f80375af89b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:34.996523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d32f07-bbe2-4e05-9162-f80375af89b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:34.998447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d32f07-bbe2-4e05-9162-f80375af89b6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.013395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b8b7c2f31484e48b1f776ba33103999', 'request_id': 'req-03b61beb-e6a6-4ae5-8514-a9c70833264b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:35.019771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b8b7c2f31484e48b1f776ba33103999', 'request_id': 'req-03b61beb-e6a6-4ae5-8514-a9c70833264b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:35.023805 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2251/4546] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:34 2021] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:35.028446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b8b7c2f31484e48b1f776ba33103999', 'request_id': 'req-03b61beb-e6a6-4ae5-8514-a9c70833264b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:35.029013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d32f07-bbe2-4e05-9162-f80375af89b6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.039084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] The token cache is being invalidate because project 9b8b7c2f31484e48b1f776ba33103999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:35.039377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:35.040048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:35.047706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9b8b7c2f31484e48b1f776ba33103999', 'request_id': 'req-03b61beb-e6a6-4ae5-8514-a9c70833264b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:35.051239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9b8b7c2f31484e48b1f776ba33103999', 'request_id': 'req-03b61beb-e6a6-4ae5-8514-a9c70833264b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:35.052019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9b8b7c2f31484e48b1f776ba33103999', 'request_id': 'req-03b61beb-e6a6-4ae5-8514-a9c70833264b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:35.058882 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2296/4547] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:01:34 2021] DELETE /identity/v3/domains/9b8b7c2f31484e48b1f776ba33103999 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:35.063946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.065342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:35.093607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d32f07-bbe2-4e05-9162-f80375af89b6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.098437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867af4ca-aacc-4dd6-a0bd-69c5b0f5c3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.099203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867af4ca-aacc-4dd6-a0bd-69c5b0f5c3de admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.099560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867af4ca-aacc-4dd6-a0bd-69c5b0f5c3de admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.099851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867af4ca-aacc-4dd6-a0bd-69c5b0f5c3de admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.100569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867af4ca-aacc-4dd6-a0bd-69c5b0f5c3de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.102478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867af4ca-aacc-4dd6-a0bd-69c5b0f5c3de admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.124168 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2252/4548] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:35 2021] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:35.129106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867af4ca-aacc-4dd6-a0bd-69c5b0f5c3de admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.129553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b61beb-e6a6-4ae5-8514-a9c70833264b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.131117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-867af4ca-aacc-4dd6-a0bd-69c5b0f5c3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:35.144026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867af4ca-aacc-4dd6-a0bd-69c5b0f5c3de admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.148996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce889601-ca15-45ba-bb9b-1455090a0770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.149670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce889601-ca15-45ba-bb9b-1455090a0770 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.149962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce889601-ca15-45ba-bb9b-1455090a0770 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.150519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce889601-ca15-45ba-bb9b-1455090a0770 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.151271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce889601-ca15-45ba-bb9b-1455090a0770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.152967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce889601-ca15-45ba-bb9b-1455090a0770 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.164033 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2253/4549] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:35.168554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce889601-ca15-45ba-bb9b-1455090a0770 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.178179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce889601-ca15-45ba-bb9b-1455090a0770 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.182881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eae230-2673-4307-9a3a-1c45172704fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.184316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eae230-2673-4307-9a3a-1c45172704fa admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.184604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eae230-2673-4307-9a3a-1c45172704fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.184885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eae230-2673-4307-9a3a-1c45172704fa admin admin] PATH_INFO: `/v3/projects/93c96147c5a6417b956c1ba22d851925/users/eeeb494e67d8444391a07cd800e2b4ce/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.187447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323335ff-ef94-4b94-a8d0-4642e054eaf6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.188077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323335ff-ef94-4b94-a8d0-4642e054eaf6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.188359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323335ff-ef94-4b94-a8d0-4642e054eaf6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.188686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323335ff-ef94-4b94-a8d0-4642e054eaf6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.189454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323335ff-ef94-4b94-a8d0-4642e054eaf6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.190499 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-323335ff-ef94-4b94-a8d0-4642e054eaf6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:35.190499 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:35.190499 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:35.191643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323335ff-ef94-4b94-a8d0-4642e054eaf6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.199510 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2297/4550] 10.222.0.13 () {58 vars in 1172 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/default => generated 1527 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:35.200376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323335ff-ef94-4b94-a8d0-4642e054eaf6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.201179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eae230-2673-4307-9a3a-1c45172704fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c96147c5a6417b956c1ba22d851925, user_id=eeeb494e67d8444391a07cd800e2b4ce, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.204008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eae230-2673-4307-9a3a-1c45172704fa admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.210823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323335ff-ef94-4b94-a8d0-4642e054eaf6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.218797 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2254/4551] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:35 2021] PUT /identity/v3/projects/93c96147c5a6417b956c1ba22d851925/users/eeeb494e67d8444391a07cd800e2b4ce/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:35.222808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eae230-2673-4307-9a3a-1c45172704fa admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.267315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfacd1f-2723-47af-8749-22e3e0d7ba89 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.267990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfacd1f-2723-47af-8749-22e3e0d7ba89 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.268276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfacd1f-2723-47af-8749-22e3e0d7ba89 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.268587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfacd1f-2723-47af-8749-22e3e0d7ba89 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.269247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfacd1f-2723-47af-8749-22e3e0d7ba89 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.270888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfacd1f-2723-47af-8749-22e3e0d7ba89 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.272066 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2298/4552] 10.222.0.13 () {58 vars in 1199 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:01:35.275907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfacd1f-2723-47af-8749-22e3e0d7ba89 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.282834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eae230-2673-4307-9a3a-1c45172704fa admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.287296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfacd1f-2723-47af-8749-22e3e0d7ba89 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.287940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878e4bf-58eb-4884-ac91-fea788e2a7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.288256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878e4bf-58eb-4884-ac91-fea788e2a7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.288544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878e4bf-58eb-4884-ac91-fea788e2a7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.288829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878e4bf-58eb-4884-ac91-fea788e2a7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.289704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878e4bf-58eb-4884-ac91-fea788e2a7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.291560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878e4bf-58eb-4884-ac91-fea788e2a7b6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.293587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c5c76-1d8b-4bb3-8ec5-34bce258bb70 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.294484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c5c76-1d8b-4bb3-8ec5-34bce258bb70 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.294841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c5c76-1d8b-4bb3-8ec5-34bce258bb70 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.295193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c5c76-1d8b-4bb3-8ec5-34bce258bb70 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.295925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c5c76-1d8b-4bb3-8ec5-34bce258bb70 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.297589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c5c76-1d8b-4bb3-8ec5-34bce258bb70 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.301633 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2299/4553] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:35.302710 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2255/4554] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:35.303353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c5c76-1d8b-4bb3-8ec5-34bce258bb70 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.306857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878e4bf-58eb-4884-ac91-fea788e2a7b6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.318770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c5c76-1d8b-4bb3-8ec5-34bce258bb70 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.325074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd9d0b-c53b-4cda-a3e9-6925059459c0 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.325939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd9d0b-c53b-4cda-a3e9-6925059459c0 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.326329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd9d0b-c53b-4cda-a3e9-6925059459c0 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.326443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878e4bf-58eb-4884-ac91-fea788e2a7b6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.326753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd9d0b-c53b-4cda-a3e9-6925059459c0 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.327498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd9d0b-c53b-4cda-a3e9-6925059459c0 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.329189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd9d0b-c53b-4cda-a3e9-6925059459c0 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.333525 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2300/4555] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:01:35.333673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110adbc-8b8e-48bf-b0c5-5de091f65fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.333673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110adbc-8b8e-48bf-b0c5-5de091f65fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.333673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110adbc-8b8e-48bf-b0c5-5de091f65fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.333938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110adbc-8b8e-48bf-b0c5-5de091f65fe9 admin admin] PATH_INFO: `/v3/projects/93c96147c5a6417b956c1ba22d851925/users/eeeb494e67d8444391a07cd800e2b4ce/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.334550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd9d0b-c53b-4cda-a3e9-6925059459c0 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.336195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110adbc-8b8e-48bf-b0c5-5de091f65fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c96147c5a6417b956c1ba22d851925, user_id=eeeb494e67d8444391a07cd800e2b4ce, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.338844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110adbc-8b8e-48bf-b0c5-5de091f65fe9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.346193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd9d0b-c53b-4cda-a3e9-6925059459c0 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.350537 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2256/4556] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:35 2021] PUT /identity/v3/projects/93c96147c5a6417b956c1ba22d851925/users/eeeb494e67d8444391a07cd800e2b4ce/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:35.361731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76435582-3986-4413-9ca6-909d8e2e33e6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.362031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76435582-3986-4413-9ca6-909d8e2e33e6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.363313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76435582-3986-4413-9ca6-909d8e2e33e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.393481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-76435582-3986-4413-9ca6-909d8e2e33e6 None None] MFA Rules not processed for user `eeeb494e67d8444391a07cd800e2b4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:35.395245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-76435582-3986-4413-9ca6-909d8e2e33e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:35.420102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74ff62-a277-4787-813b-4a41dce89493 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.420956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74ff62-a277-4787-813b-4a41dce89493 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.421304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74ff62-a277-4787-813b-4a41dce89493 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.421648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74ff62-a277-4787-813b-4a41dce89493 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.422548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74ff62-a277-4787-813b-4a41dce89493 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.424269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74ff62-a277-4787-813b-4a41dce89493 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.426091 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2301/4557] 10.222.0.13 () {58 vars in 1187 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:35.429871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74ff62-a277-4787-813b-4a41dce89493 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.441940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74ff62-a277-4787-813b-4a41dce89493 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.447811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0ac09-b23e-43a9-a1cd-89bf582b00ed tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.448800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0ac09-b23e-43a9-a1cd-89bf582b00ed tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.449999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0ac09-b23e-43a9-a1cd-89bf582b00ed tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.450501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0ac09-b23e-43a9-a1cd-89bf582b00ed tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.451314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0ac09-b23e-43a9-a1cd-89bf582b00ed tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.452929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0ac09-b23e-43a9-a1cd-89bf582b00ed tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.456129 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2302/4558] 10.222.0.13 () {58 vars in 1199 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:35.459966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0ac09-b23e-43a9-a1cd-89bf582b00ed tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.479565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0ac09-b23e-43a9-a1cd-89bf582b00ed tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.482623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e7ff3-2e35-4026-84ab-0463686539c1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.483397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e7ff3-2e35-4026-84ab-0463686539c1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.483686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e7ff3-2e35-4026-84ab-0463686539c1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.483971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e7ff3-2e35-4026-84ab-0463686539c1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.484650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e7ff3-2e35-4026-84ab-0463686539c1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.486314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e7ff3-2e35-4026-84ab-0463686539c1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.487665 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2303/4559] 10.222.0.13 () {58 vars in 1202 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:01:35.491748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e7ff3-2e35-4026-84ab-0463686539c1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.508028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e7ff3-2e35-4026-84ab-0463686539c1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.509365 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2257/4560] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:35 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:35.514594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76435582-3986-4413-9ca6-909d8e2e33e6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.517790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e33a55-05d8-4bb2-bf67-83fd1f6791cd tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.518804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e33a55-05d8-4bb2-bf67-83fd1f6791cd tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.519272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e33a55-05d8-4bb2-bf67-83fd1f6791cd tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.524287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76435582-3986-4413-9ca6-909d8e2e33e6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.524847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e33a55-05d8-4bb2-bf67-83fd1f6791cd tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.525550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e33a55-05d8-4bb2-bf67-83fd1f6791cd tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.527267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e33a55-05d8-4bb2-bf67-83fd1f6791cd tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.528393 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2304/4561] 10.222.0.13 () {58 vars in 1208 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:01:35.531664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cc3cb-982e-4e7d-86f6-b2d8056f6847 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.532341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cc3cb-982e-4e7d-86f6-b2d8056f6847 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.532629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cc3cb-982e-4e7d-86f6-b2d8056f6847 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.532914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cc3cb-982e-4e7d-86f6-b2d8056f6847 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.533666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cc3cb-982e-4e7d-86f6-b2d8056f6847 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.535211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e33a55-05d8-4bb2-bf67-83fd1f6791cd tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.535355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cc3cb-982e-4e7d-86f6-b2d8056f6847 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.546058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e33a55-05d8-4bb2-bf67-83fd1f6791cd tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.552293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cdb1e-80d2-46ad-b531-1fca12ca222d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.553070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cdb1e-80d2-46ad-b531-1fca12ca222d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.553356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cdb1e-80d2-46ad-b531-1fca12ca222d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.553636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cdb1e-80d2-46ad-b531-1fca12ca222d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.554343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cdb1e-80d2-46ad-b531-1fca12ca222d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.554774 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2258/4562] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:01:35 2021] POST /identity/v3/domains => generated 275 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:35.556178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cdb1e-80d2-46ad-b531-1fca12ca222d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.557427 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2305/4563] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:01:35.557680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cc3cb-982e-4e7d-86f6-b2d8056f6847 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.562476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cdb1e-80d2-46ad-b531-1fca12ca222d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.573636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cdb1e-80d2-46ad-b531-1fca12ca222d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.644019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe92634-cb45-47bd-bf59-3d79389922ba tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.644978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe92634-cb45-47bd-bf59-3d79389922ba tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.645247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe92634-cb45-47bd-bf59-3d79389922ba tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.645528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe92634-cb45-47bd-bf59-3d79389922ba tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.646205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe92634-cb45-47bd-bf59-3d79389922ba tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.648139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe92634-cb45-47bd-bf59-3d79389922ba tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.649273 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2306/4564] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:01:35.653182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe92634-cb45-47bd-bf59-3d79389922ba tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.654176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cc3cb-982e-4e7d-86f6-b2d8056f6847 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.659159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7b114-ff98-4661-96b6-42f88c5b0ce0 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.659820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7b114-ff98-4661-96b6-42f88c5b0ce0 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.660108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7b114-ff98-4661-96b6-42f88c5b0ce0 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.660388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7b114-ff98-4661-96b6-42f88c5b0ce0 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.661085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7b114-ff98-4661-96b6-42f88c5b0ce0 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.663015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7b114-ff98-4661-96b6-42f88c5b0ce0 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.663236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe92634-cb45-47bd-bf59-3d79389922ba tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.668723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f738b39-5dc6-4b29-8e30-50c56ca8d83e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.669481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f738b39-5dc6-4b29-8e30-50c56ca8d83e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.669763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f738b39-5dc6-4b29-8e30-50c56ca8d83e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.670043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f738b39-5dc6-4b29-8e30-50c56ca8d83e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.670733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f738b39-5dc6-4b29-8e30-50c56ca8d83e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.672284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f738b39-5dc6-4b29-8e30-50c56ca8d83e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.673382 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2307/4565] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:35.677286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f738b39-5dc6-4b29-8e30-50c56ca8d83e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.690547 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2259/4566] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:01:35 2021] POST /identity/v3/groups => generated 280 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:35.690720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f738b39-5dc6-4b29-8e30-50c56ca8d83e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.692131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7b114-ff98-4661-96b6-42f88c5b0ce0 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.693285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6f016-6eb1-4c21-a113-e73d65a90785 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.694038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6f016-6eb1-4c21-a113-e73d65a90785 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.694384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6f016-6eb1-4c21-a113-e73d65a90785 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.694692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6f016-6eb1-4c21-a113-e73d65a90785 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.695354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6f016-6eb1-4c21-a113-e73d65a90785 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.696925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6f016-6eb1-4c21-a113-e73d65a90785 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.698020 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2308/4567] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:35.701778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7b114-ff98-4661-96b6-42f88c5b0ce0 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.701925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6f016-6eb1-4c21-a113-e73d65a90785 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.706445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec917cdb-35b9-447b-bdb5-95707e9193ce tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.707275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec917cdb-35b9-447b-bdb5-95707e9193ce tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.707558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec917cdb-35b9-447b-bdb5-95707e9193ce tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.707829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec917cdb-35b9-447b-bdb5-95707e9193ce tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/d51975364b814d82b1417eeeb3f420e8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.714955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6f016-6eb1-4c21-a113-e73d65a90785 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.715136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec917cdb-35b9-447b-bdb5-95707e9193ce tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:update_group(group_id=d51975364b814d82b1417eeeb3f420e8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.715136 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-ec917cdb-35b9-447b-bdb5-95707e9193ce tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:35.715136 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:35.715136 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:35.715602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec917cdb-35b9-447b-bdb5-95707e9193ce tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.716716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba461e-9faa-4a60-bf3a-26607e9b75f1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.717471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba461e-9faa-4a60-bf3a-26607e9b75f1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.717763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba461e-9faa-4a60-bf3a-26607e9b75f1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.718046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba461e-9faa-4a60-bf3a-26607e9b75f1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.718761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba461e-9faa-4a60-bf3a-26607e9b75f1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.720335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba461e-9faa-4a60-bf3a-26607e9b75f1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.721735 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2309/4568] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:35.725607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba461e-9faa-4a60-bf3a-26607e9b75f1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.736566 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2260/4569] 10.222.0.13 () {60 vars in 1246 bytes} [Sat Dec 18 21:01:35 2021] PATCH /identity/v3/groups/d51975364b814d82b1417eeeb3f420e8 => generated 292 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:35.739556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba461e-9faa-4a60-bf3a-26607e9b75f1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.740284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec917cdb-35b9-447b-bdb5-95707e9193ce tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.744624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d9d08-d18b-4482-90f5-f47dbb810e2b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.745406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d9d08-d18b-4482-90f5-f47dbb810e2b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.745691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d9d08-d18b-4482-90f5-f47dbb810e2b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.746681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d9d08-d18b-4482-90f5-f47dbb810e2b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.747355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d9d08-d18b-4482-90f5-f47dbb810e2b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.748943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d9d08-d18b-4482-90f5-f47dbb810e2b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.750349 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2310/4570] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:35.751057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec917cdb-35b9-447b-bdb5-95707e9193ce tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.753913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d9d08-d18b-4482-90f5-f47dbb810e2b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.756030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfd557-85aa-424d-b04d-52b616bad59d tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.756878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfd557-85aa-424d-b04d-52b616bad59d tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.757168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfd557-85aa-424d-b04d-52b616bad59d tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.757449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfd557-85aa-424d-b04d-52b616bad59d tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/d51975364b814d82b1417eeeb3f420e8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.762847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfd557-85aa-424d-b04d-52b616bad59d tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:get_group(group_id=d51975364b814d82b1417eeeb3f420e8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.764187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d9d08-d18b-4482-90f5-f47dbb810e2b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.764824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfd557-85aa-424d-b04d-52b616bad59d tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.766563 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2261/4571] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/groups/d51975364b814d82b1417eeeb3f420e8 => generated 292 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:35.769171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e24b0-f51e-4ebb-b13b-926df40b38e4 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.769946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e24b0-f51e-4ebb-b13b-926df40b38e4 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.770269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e24b0-f51e-4ebb-b13b-926df40b38e4 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.770392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfd557-85aa-424d-b04d-52b616bad59d tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.770539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e24b0-f51e-4ebb-b13b-926df40b38e4 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.771193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e24b0-f51e-4ebb-b13b-926df40b38e4 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.772742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e24b0-f51e-4ebb-b13b-926df40b38e4 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.773820 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2311/4572] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:35.777759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e24b0-f51e-4ebb-b13b-926df40b38e4 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.780161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfd557-85aa-424d-b04d-52b616bad59d tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.784893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8584b8c-c91f-48ac-8d65-759fb93f5114 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.785719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8584b8c-c91f-48ac-8d65-759fb93f5114 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.786012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8584b8c-c91f-48ac-8d65-759fb93f5114 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.786327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8584b8c-c91f-48ac-8d65-759fb93f5114 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/d51975364b814d82b1417eeeb3f420e8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.787548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e24b0-f51e-4ebb-b13b-926df40b38e4 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.787673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8584b8c-c91f-48ac-8d65-759fb93f5114 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:update_group(group_id=d51975364b814d82b1417eeeb3f420e8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.789428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8584b8c-c91f-48ac-8d65-759fb93f5114 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.792446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2c1ea-476f-4703-b8d3-3d56d8e9bb56 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.793700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2c1ea-476f-4703-b8d3-3d56d8e9bb56 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.793984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2c1ea-476f-4703-b8d3-3d56d8e9bb56 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.794286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2c1ea-476f-4703-b8d3-3d56d8e9bb56 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.794960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2c1ea-476f-4703-b8d3-3d56d8e9bb56 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.796521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2c1ea-476f-4703-b8d3-3d56d8e9bb56 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.797666 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2312/4573] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:01:35.802042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2c1ea-476f-4703-b8d3-3d56d8e9bb56 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.806628 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2262/4574] 10.222.0.13 () {60 vars in 1245 bytes} [Sat Dec 18 21:01:35 2021] PATCH /identity/v3/groups/d51975364b814d82b1417eeeb3f420e8 => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:35.811511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8584b8c-c91f-48ac-8d65-759fb93f5114 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.812519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2c1ea-476f-4703-b8d3-3d56d8e9bb56 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.817363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4a856-d18a-400c-9192-22336bdabc9b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.818117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4a856-d18a-400c-9192-22336bdabc9b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.818436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4a856-d18a-400c-9192-22336bdabc9b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.818720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4a856-d18a-400c-9192-22336bdabc9b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.819377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4a856-d18a-400c-9192-22336bdabc9b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.820939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4a856-d18a-400c-9192-22336bdabc9b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.821464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8584b8c-c91f-48ac-8d65-759fb93f5114 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.822357 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2313/4575] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:01:35.825766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4a856-d18a-400c-9192-22336bdabc9b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.827146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a75df-f75d-4627-a055-d556809f9636 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.828036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a75df-f75d-4627-a055-d556809f9636 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.828326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a75df-f75d-4627-a055-d556809f9636 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.828611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a75df-f75d-4627-a055-d556809f9636 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/d51975364b814d82b1417eeeb3f420e8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.833755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a75df-f75d-4627-a055-d556809f9636 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d51975364b814d82b1417eeeb3f420e8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.835191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4a856-d18a-400c-9192-22336bdabc9b tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.835675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a75df-f75d-4627-a055-d556809f9636 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.839960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859184d-acc3-4f0e-8f88-8bff064d6a3d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.840745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859184d-acc3-4f0e-8f88-8bff064d6a3d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.841039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859184d-acc3-4f0e-8f88-8bff064d6a3d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.841325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859184d-acc3-4f0e-8f88-8bff064d6a3d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.842817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859184d-acc3-4f0e-8f88-8bff064d6a3d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.844471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859184d-acc3-4f0e-8f88-8bff064d6a3d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.846284 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2314/4576] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:35.849802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859184d-acc3-4f0e-8f88-8bff064d6a3d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.862089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859184d-acc3-4f0e-8f88-8bff064d6a3d tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.867836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc976ba-7e37-4a5c-9e1b-de41fd1d8fe1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.868952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc976ba-7e37-4a5c-9e1b-de41fd1d8fe1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.869250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc976ba-7e37-4a5c-9e1b-de41fd1d8fe1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.869538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc976ba-7e37-4a5c-9e1b-de41fd1d8fe1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.870390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc976ba-7e37-4a5c-9e1b-de41fd1d8fe1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.872571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc976ba-7e37-4a5c-9e1b-de41fd1d8fe1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.873719 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2315/4577] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:35.877999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc976ba-7e37-4a5c-9e1b-de41fd1d8fe1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.888207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc976ba-7e37-4a5c-9e1b-de41fd1d8fe1 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.890775 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2263/4578] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 21:01:35 2021] DELETE /identity/v3/groups/d51975364b814d82b1417eeeb3f420e8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:35.892064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a75df-f75d-4627-a055-d556809f9636 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.958068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c27d1-df65-42e7-860d-88583011dd7e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.959193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c27d1-df65-42e7-860d-88583011dd7e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.959552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c27d1-df65-42e7-860d-88583011dd7e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.959904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c27d1-df65-42e7-860d-88583011dd7e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.961505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c27d1-df65-42e7-860d-88583011dd7e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.964188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c27d1-df65-42e7-860d-88583011dd7e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.965164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a75df-f75d-4627-a055-d556809f9636 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.966377 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2316/4579] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:35.970300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c27d1-df65-42e7-860d-88583011dd7e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:35.974077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee1994-8866-4b24-bc17-465b47e897c7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.975126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee1994-8866-4b24-bc17-465b47e897c7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.975418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee1994-8866-4b24-bc17-465b47e897c7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.975702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee1994-8866-4b24-bc17-465b47e897c7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.976423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee1994-8866-4b24-bc17-465b47e897c7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.978999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee1994-8866-4b24-bc17-465b47e897c7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.983695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c27d1-df65-42e7-860d-88583011dd7e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:35.990608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63a36e-017c-4568-9385-c12908957c6c tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:35.992290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63a36e-017c-4568-9385-c12908957c6c tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:35.992576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63a36e-017c-4568-9385-c12908957c6c tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:35.992861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63a36e-017c-4568-9385-c12908957c6c tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:35.993881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63a36e-017c-4568-9385-c12908957c6c tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:35.995669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63a36e-017c-4568-9385-c12908957c6c tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:35.996834 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2317/4580] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.000587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63a36e-017c-4568-9385-c12908957c6c tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.005461 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2264/4581] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:01:35 2021] POST /identity/v3/groups => generated 325 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:36.006520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee1994-8866-4b24-bc17-465b47e897c7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.017462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee1994-8866-4b24-bc17-465b47e897c7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.018077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63a36e-017c-4568-9385-c12908957c6c tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.022343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56bfea-bcff-4d5d-a5d9-8d187d31bb1c tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.023300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56bfea-bcff-4d5d-a5d9-8d187d31bb1c tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.023424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99701553-ff99-4410-96e3-0025dea4a586 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.023648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56bfea-bcff-4d5d-a5d9-8d187d31bb1c tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.023876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56bfea-bcff-4d5d-a5d9-8d187d31bb1c tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.024103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99701553-ff99-4410-96e3-0025dea4a586 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.024394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99701553-ff99-4410-96e3-0025dea4a586 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.024674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99701553-ff99-4410-96e3-0025dea4a586 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.024793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56bfea-bcff-4d5d-a5d9-8d187d31bb1c tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.025348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99701553-ff99-4410-96e3-0025dea4a586 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.026573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56bfea-bcff-4d5d-a5d9-8d187d31bb1c tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.027651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99701553-ff99-4410-96e3-0025dea4a586 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.028959 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2318/4582] 10.222.0.13 () {58 vars in 1256 bytes} [Sat Dec 18 21:01:35 2021] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:01:36.040615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99701553-ff99-4410-96e3-0025dea4a586 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.052062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99701553-ff99-4410-96e3-0025dea4a586 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.056899 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2265/4583] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:36 2021] POST /identity/v3/users => generated 323 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:36.057062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764e168-dec6-4b3d-b63d-a73216e3d32f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.057724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764e168-dec6-4b3d-b63d-a73216e3d32f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.058045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764e168-dec6-4b3d-b63d-a73216e3d32f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.058391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764e168-dec6-4b3d-b63d-a73216e3d32f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.058509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56bfea-bcff-4d5d-a5d9-8d187d31bb1c tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.059084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764e168-dec6-4b3d-b63d-a73216e3d32f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.060673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764e168-dec6-4b3d-b63d-a73216e3d32f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.061917 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2319/4584] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:01:36.065641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764e168-dec6-4b3d-b63d-a73216e3d32f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.069406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56bfea-bcff-4d5d-a5d9-8d187d31bb1c tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.074116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07b1dc-5c89-4527-9160-dca628d2603e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.075477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764e168-dec6-4b3d-b63d-a73216e3d32f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.075682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07b1dc-5c89-4527-9160-dca628d2603e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.075972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07b1dc-5c89-4527-9160-dca628d2603e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.076257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07b1dc-5c89-4527-9160-dca628d2603e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/dae4ac4039e94130b0d84cdd64232d98` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.080232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763e225-dd10-40e4-9c5c-bf9e4fb5ca68 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.080984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763e225-dd10-40e4-9c5c-bf9e4fb5ca68 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.081272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763e225-dd10-40e4-9c5c-bf9e4fb5ca68 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.081557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763e225-dd10-40e4-9c5c-bf9e4fb5ca68 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.082350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763e225-dd10-40e4-9c5c-bf9e4fb5ca68 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.083908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763e225-dd10-40e4-9c5c-bf9e4fb5ca68 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.084999 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2320/4585] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.088618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763e225-dd10-40e4-9c5c-bf9e4fb5ca68 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.097670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07b1dc-5c89-4527-9160-dca628d2603e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=dcf0cc81d2074fffb381ccaa5285ff16, user_id=dae4ac4039e94130b0d84cdd64232d98)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.098640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763e225-dd10-40e4-9c5c-bf9e4fb5ca68 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.099173 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-fd07b1dc-5c89-4527-9160-dca628d2603e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:36.099173 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:36.099173 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:36.100569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07b1dc-5c89-4527-9160-dca628d2603e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.103390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502e203-8642-4e1f-a44c-a8d0815676b2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.104134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502e203-8642-4e1f-a44c-a8d0815676b2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.104422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502e203-8642-4e1f-a44c-a8d0815676b2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.104701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502e203-8642-4e1f-a44c-a8d0815676b2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.105998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502e203-8642-4e1f-a44c-a8d0815676b2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.107564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502e203-8642-4e1f-a44c-a8d0815676b2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.108821 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2321/4586] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.112299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502e203-8642-4e1f-a44c-a8d0815676b2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.122059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502e203-8642-4e1f-a44c-a8d0815676b2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.126113 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2266/4587] 10.222.0.13 () {60 vars in 1359 bytes} [Sat Dec 18 21:01:36 2021] PUT /identity/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/dae4ac4039e94130b0d84cdd64232d98 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:36.129906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07b1dc-5c89-4527-9160-dca628d2603e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.179910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39877a1-2f6b-466c-be97-dc812fce0896 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.180704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39877a1-2f6b-466c-be97-dc812fce0896 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.180996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39877a1-2f6b-466c-be97-dc812fce0896 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.181560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39877a1-2f6b-466c-be97-dc812fce0896 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.181943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39877a1-2f6b-466c-be97-dc812fce0896 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.183616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39877a1-2f6b-466c-be97-dc812fce0896 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.185801 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2322/4588] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.188463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39877a1-2f6b-466c-be97-dc812fce0896 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.192381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07b1dc-5c89-4527-9160-dca628d2603e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.197782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b00ee-5af4-4c33-902f-893b831d4c10 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.198130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39877a1-2f6b-466c-be97-dc812fce0896 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.198495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b00ee-5af4-4c33-902f-893b831d4c10 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.198790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b00ee-5af4-4c33-902f-893b831d4c10 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.199075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b00ee-5af4-4c33-902f-893b831d4c10 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.199785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b00ee-5af4-4c33-902f-893b831d4c10 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.201651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b00ee-5af4-4c33-902f-893b831d4c10 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.203073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc46a3e-1fba-4bc6-8a77-11feb63c65df tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.203845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc46a3e-1fba-4bc6-8a77-11feb63c65df tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.204155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc46a3e-1fba-4bc6-8a77-11feb63c65df tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.204437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc46a3e-1fba-4bc6-8a77-11feb63c65df tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.205123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc46a3e-1fba-4bc6-8a77-11feb63c65df tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.206720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc46a3e-1fba-4bc6-8a77-11feb63c65df tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.207960 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2323/4589] 10.222.0.13 () {58 vars in 1289 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.211593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc46a3e-1fba-4bc6-8a77-11feb63c65df tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.222120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc46a3e-1fba-4bc6-8a77-11feb63c65df tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.229267 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2267/4590] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:36 2021] POST /identity/v3/users => generated 323 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:36.230011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2795e6d-e751-49ab-9244-81d058070041 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.230011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2795e6d-e751-49ab-9244-81d058070041 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.230011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2795e6d-e751-49ab-9244-81d058070041 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.230925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2795e6d-e751-49ab-9244-81d058070041 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.230925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2795e6d-e751-49ab-9244-81d058070041 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.231438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2795e6d-e751-49ab-9244-81d058070041 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.231855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b00ee-5af4-4c33-902f-893b831d4c10 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.232562 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2324/4591] 10.222.0.13 () {58 vars in 1256 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.236456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2795e6d-e751-49ab-9244-81d058070041 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.244145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b00ee-5af4-4c33-902f-893b831d4c10 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.249367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2795e6d-e751-49ab-9244-81d058070041 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.249628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0431b0-84a5-4e6c-9733-72e2af618099 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.250582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0431b0-84a5-4e6c-9733-72e2af618099 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.250906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0431b0-84a5-4e6c-9733-72e2af618099 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.251187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0431b0-84a5-4e6c-9733-72e2af618099 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/a445dcd9bea64ceab425327eda8eac92` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.255171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7c11d-b996-4c7c-8a96-2155edc2e77f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.255989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7c11d-b996-4c7c-8a96-2155edc2e77f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.256269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7c11d-b996-4c7c-8a96-2155edc2e77f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.256547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7c11d-b996-4c7c-8a96-2155edc2e77f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.257210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7c11d-b996-4c7c-8a96-2155edc2e77f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.258827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7c11d-b996-4c7c-8a96-2155edc2e77f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.260363 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2325/4592] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.264197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7c11d-b996-4c7c-8a96-2155edc2e77f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.267516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0431b0-84a5-4e6c-9733-72e2af618099 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=dcf0cc81d2074fffb381ccaa5285ff16, user_id=a445dcd9bea64ceab425327eda8eac92)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.269894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0431b0-84a5-4e6c-9733-72e2af618099 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.275988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7c11d-b996-4c7c-8a96-2155edc2e77f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.281125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e63717-2774-433b-9bed-0bddc07209da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.281947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e63717-2774-433b-9bed-0bddc07209da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.282231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e63717-2774-433b-9bed-0bddc07209da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.282548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e63717-2774-433b-9bed-0bddc07209da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.283209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e63717-2774-433b-9bed-0bddc07209da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.285779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e63717-2774-433b-9bed-0bddc07209da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.287150 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2326/4593] 10.222.0.13 () {58 vars in 1307 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:01:36.291488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e63717-2774-433b-9bed-0bddc07209da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.299033 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2268/4594] 10.222.0.13 () {60 vars in 1359 bytes} [Sat Dec 18 21:01:36 2021] PUT /identity/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/a445dcd9bea64ceab425327eda8eac92 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:36.301944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e63717-2774-433b-9bed-0bddc07209da tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.302878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0431b0-84a5-4e6c-9733-72e2af618099 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.360318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aacf71-3caf-4713-a55f-646207c29d1c tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.361149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aacf71-3caf-4713-a55f-646207c29d1c tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.361434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aacf71-3caf-4713-a55f-646207c29d1c tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.361714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aacf71-3caf-4713-a55f-646207c29d1c tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.362418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aacf71-3caf-4713-a55f-646207c29d1c tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.364016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aacf71-3caf-4713-a55f-646207c29d1c tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.365420 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2327/4595] 10.222.0.13 () {58 vars in 1289 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.367603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0431b0-84a5-4e6c-9733-72e2af618099 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.368954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aacf71-3caf-4713-a55f-646207c29d1c tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.373502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9318f-b69d-4b1b-9dc3-4a1700a44c95 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.374151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9318f-b69d-4b1b-9dc3-4a1700a44c95 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.374668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9318f-b69d-4b1b-9dc3-4a1700a44c95 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.375020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9318f-b69d-4b1b-9dc3-4a1700a44c95 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.376280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9318f-b69d-4b1b-9dc3-4a1700a44c95 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.377800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9318f-b69d-4b1b-9dc3-4a1700a44c95 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.380178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aacf71-3caf-4713-a55f-646207c29d1c tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.386098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b4d10-32e2-41f4-899f-6cc8f8dbfbbf tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.387596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b4d10-32e2-41f4-899f-6cc8f8dbfbbf tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.388002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b4d10-32e2-41f4-899f-6cc8f8dbfbbf tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.388385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b4d10-32e2-41f4-899f-6cc8f8dbfbbf tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.389149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b4d10-32e2-41f4-899f-6cc8f8dbfbbf tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.390965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b4d10-32e2-41f4-899f-6cc8f8dbfbbf tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.392619 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2328/4596] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.396537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b4d10-32e2-41f4-899f-6cc8f8dbfbbf tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.410628 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2269/4597] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:36 2021] POST /identity/v3/users => generated 323 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:36.410880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b4d10-32e2-41f4-899f-6cc8f8dbfbbf tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.413237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9318f-b69d-4b1b-9dc3-4a1700a44c95 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.415541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c92908-395a-4dd5-a91c-f64b31a95eeb tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.416648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c92908-395a-4dd5-a91c-f64b31a95eeb tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.417010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c92908-395a-4dd5-a91c-f64b31a95eeb tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.417362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c92908-395a-4dd5-a91c-f64b31a95eeb tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.418143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c92908-395a-4dd5-a91c-f64b31a95eeb tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.419907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c92908-395a-4dd5-a91c-f64b31a95eeb tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.422303 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2329/4598] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:01:36.425252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c92908-395a-4dd5-a91c-f64b31a95eeb tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.425447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9318f-b69d-4b1b-9dc3-4a1700a44c95 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.430173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade26d-e43b-4ad3-af5c-4a5b3b989a21 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.431096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade26d-e43b-4ad3-af5c-4a5b3b989a21 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.431383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade26d-e43b-4ad3-af5c-4a5b3b989a21 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.431661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade26d-e43b-4ad3-af5c-4a5b3b989a21 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/40809dd8135c4bd99acba97f594f74df` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.435102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c92908-395a-4dd5-a91c-f64b31a95eeb tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.439720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681ea57-4a38-4566-a106-2e25225e4790 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.440567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681ea57-4a38-4566-a106-2e25225e4790 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.440862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681ea57-4a38-4566-a106-2e25225e4790 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.441188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681ea57-4a38-4566-a106-2e25225e4790 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.442216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681ea57-4a38-4566-a106-2e25225e4790 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.443839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681ea57-4a38-4566-a106-2e25225e4790 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.444917 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2330/4599] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.447992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ade26d-e43b-4ad3-af5c-4a5b3b989a21 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=dcf0cc81d2074fffb381ccaa5285ff16, user_id=40809dd8135c4bd99acba97f594f74df)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.448652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681ea57-4a38-4566-a106-2e25225e4790 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.450726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ade26d-e43b-4ad3-af5c-4a5b3b989a21 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.458745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681ea57-4a38-4566-a106-2e25225e4790 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.463413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf083e-9cd0-41f2-ba00-36e551f9fc26 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.464233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf083e-9cd0-41f2-ba00-36e551f9fc26 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.465203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf083e-9cd0-41f2-ba00-36e551f9fc26 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.465523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf083e-9cd0-41f2-ba00-36e551f9fc26 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.466490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf083e-9cd0-41f2-ba00-36e551f9fc26 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.468431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf083e-9cd0-41f2-ba00-36e551f9fc26 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.469609 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2331/4600] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.473275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf083e-9cd0-41f2-ba00-36e551f9fc26 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.476628 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2270/4601] 10.222.0.13 () {60 vars in 1359 bytes} [Sat Dec 18 21:01:36 2021] PUT /identity/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/40809dd8135c4bd99acba97f594f74df => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:36.480466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade26d-e43b-4ad3-af5c-4a5b3b989a21 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.482851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf083e-9cd0-41f2-ba00-36e551f9fc26 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.538137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb0a50-0cb4-4b5c-857a-bb2967def7f7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.538983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0a50-0cb4-4b5c-857a-bb2967def7f7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.539274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0a50-0cb4-4b5c-857a-bb2967def7f7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.539556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0a50-0cb4-4b5c-857a-bb2967def7f7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.540225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb0a50-0cb4-4b5c-857a-bb2967def7f7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.541824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb0a50-0cb4-4b5c-857a-bb2967def7f7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.541938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade26d-e43b-4ad3-af5c-4a5b3b989a21 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.543380 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2332/4602] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.546622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f88d-3975-4a70-884e-6f953ab309d7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.546812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb0a50-0cb4-4b5c-857a-bb2967def7f7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.547449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f88d-3975-4a70-884e-6f953ab309d7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.547737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f88d-3975-4a70-884e-6f953ab309d7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.548016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f88d-3975-4a70-884e-6f953ab309d7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.549318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4f88d-3975-4a70-884e-6f953ab309d7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=dcf0cc81d2074fffb381ccaa5285ff16)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.550489 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-11b4f88d-3975-4a70-884e-6f953ab309d7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:36.550489 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:36.550489 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:36.551650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4f88d-3975-4a70-884e-6f953ab309d7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.556442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb0a50-0cb4-4b5c-857a-bb2967def7f7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.561121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9992fc-7e9c-42ea-8818-2bf405a76106 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.561878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9992fc-7e9c-42ea-8818-2bf405a76106 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.562168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9992fc-7e9c-42ea-8818-2bf405a76106 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.562485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9992fc-7e9c-42ea-8818-2bf405a76106 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.563147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9992fc-7e9c-42ea-8818-2bf405a76106 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.564825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9992fc-7e9c-42ea-8818-2bf405a76106 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.565924 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2333/4603] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.572579 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2271/4604] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users => generated 1085 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:36.572739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9992fc-7e9c-42ea-8818-2bf405a76106 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.573598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f88d-3975-4a70-884e-6f953ab309d7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.580416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9992fc-7e9c-42ea-8818-2bf405a76106 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.583883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f88d-3975-4a70-884e-6f953ab309d7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.585056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1623aef-a86d-441b-9390-4ba125d3fcf7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.585817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1623aef-a86d-441b-9390-4ba125d3fcf7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.586165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1623aef-a86d-441b-9390-4ba125d3fcf7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.586429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1623aef-a86d-441b-9390-4ba125d3fcf7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.587140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1623aef-a86d-441b-9390-4ba125d3fcf7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.588626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5531c-9f59-4eba-82d5-0b369c6a36d1 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.588802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1623aef-a86d-441b-9390-4ba125d3fcf7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.590140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5531c-9f59-4eba-82d5-0b369c6a36d1 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.590300 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2334/4605] 10.222.0.13 () {58 vars in 1256 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.590499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5531c-9f59-4eba-82d5-0b369c6a36d1 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.590789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5531c-9f59-4eba-82d5-0b369c6a36d1 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/dae4ac4039e94130b0d84cdd64232d98` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.592527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5531c-9f59-4eba-82d5-0b369c6a36d1 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=dcf0cc81d2074fffb381ccaa5285ff16, user_id=dae4ac4039e94130b0d84cdd64232d98)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.593549 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-70a5531c-9f59-4eba-82d5-0b369c6a36d1 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:36.593549 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:36.593549 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:36.593982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1623aef-a86d-441b-9390-4ba125d3fcf7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.594738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5531c-9f59-4eba-82d5-0b369c6a36d1 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.603361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1623aef-a86d-441b-9390-4ba125d3fcf7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.608042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0c317-fdbd-49ac-a218-e8ac87b44a7e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.608750 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2272/4606] 10.222.0.13 () {58 vars in 1341 bytes} [Sat Dec 18 21:01:36 2021] HEAD /identity/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/dae4ac4039e94130b0d84cdd64232d98 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:36.608889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0c317-fdbd-49ac-a218-e8ac87b44a7e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.609141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0c317-fdbd-49ac-a218-e8ac87b44a7e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.609540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0c317-fdbd-49ac-a218-e8ac87b44a7e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.610204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0c317-fdbd-49ac-a218-e8ac87b44a7e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.611915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0c317-fdbd-49ac-a218-e8ac87b44a7e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.612522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5531c-9f59-4eba-82d5-0b369c6a36d1 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.615625 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2335/4607] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.616568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0c317-fdbd-49ac-a218-e8ac87b44a7e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.621952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5531c-9f59-4eba-82d5-0b369c6a36d1 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.625944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0c317-fdbd-49ac-a218-e8ac87b44a7e tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.627160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cef6d2-207a-455e-bebb-a79c53402800 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.628039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cef6d2-207a-455e-bebb-a79c53402800 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.628328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cef6d2-207a-455e-bebb-a79c53402800 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.628611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cef6d2-207a-455e-bebb-a79c53402800 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/dae4ac4039e94130b0d84cdd64232d98` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.630380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cef6d2-207a-455e-bebb-a79c53402800 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=dcf0cc81d2074fffb381ccaa5285ff16, user_id=dae4ac4039e94130b0d84cdd64232d98)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.631389 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-e5cef6d2-207a-455e-bebb-a79c53402800 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:36.631389 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:36.631389 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:36.632093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188364d-c35f-4cfa-866b-3136359b5f33 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.632564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cef6d2-207a-455e-bebb-a79c53402800 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.632881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188364d-c35f-4cfa-866b-3136359b5f33 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.633167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188364d-c35f-4cfa-866b-3136359b5f33 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.633449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188364d-c35f-4cfa-866b-3136359b5f33 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.634139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188364d-c35f-4cfa-866b-3136359b5f33 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.635853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188364d-c35f-4cfa-866b-3136359b5f33 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.637498 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2336/4608] 10.222.0.13 () {58 vars in 1256 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:01:36.641432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188364d-c35f-4cfa-866b-3136359b5f33 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.645118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e5cef6d2-207a-455e-bebb-a79c53402800 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dae4ac4039e94130b0d84cdd64232d98'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:36.653227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188364d-c35f-4cfa-866b-3136359b5f33 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.658271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe2432-028d-4be8-94e4-1f4e96413c52 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.659170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe2432-028d-4be8-94e4-1f4e96413c52 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.659436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe2432-028d-4be8-94e4-1f4e96413c52 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.660060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe2432-028d-4be8-94e4-1f4e96413c52 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.660877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe2432-028d-4be8-94e4-1f4e96413c52 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.662705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe2432-028d-4be8-94e4-1f4e96413c52 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.662844 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2273/4609] 10.222.0.13 () {58 vars in 1343 bytes} [Sat Dec 18 21:01:36 2021] DELETE /identity/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/dae4ac4039e94130b0d84cdd64232d98 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:36.663787 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2337/4610] 10.222.0.13 () {58 vars in 1292 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.667312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cef6d2-207a-455e-bebb-a79c53402800 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.668951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe2432-028d-4be8-94e4-1f4e96413c52 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.679567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe2432-028d-4be8-94e4-1f4e96413c52 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.747708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cef6d2-207a-455e-bebb-a79c53402800 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.750065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e80a87-dd32-4bbc-94fa-9aaf62ed6790 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.751116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e80a87-dd32-4bbc-94fa-9aaf62ed6790 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.751765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e80a87-dd32-4bbc-94fa-9aaf62ed6790 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.752254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e80a87-dd32-4bbc-94fa-9aaf62ed6790 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.752716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2ce78-1912-4b80-8835-bd18fd8eba28 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.753391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e80a87-dd32-4bbc-94fa-9aaf62ed6790 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.753643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2ce78-1912-4b80-8835-bd18fd8eba28 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.753935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2ce78-1912-4b80-8835-bd18fd8eba28 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.754218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2ce78-1912-4b80-8835-bd18fd8eba28 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/a445dcd9bea64ceab425327eda8eac92` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.756017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2ce78-1912-4b80-8835-bd18fd8eba28 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=dcf0cc81d2074fffb381ccaa5285ff16, user_id=a445dcd9bea64ceab425327eda8eac92)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.756216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e80a87-dd32-4bbc-94fa-9aaf62ed6790 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.757868 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2338/4611] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:01:36.757998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2ce78-1912-4b80-8835-bd18fd8eba28 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.762196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e80a87-dd32-4bbc-94fa-9aaf62ed6790 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.773482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e80a87-dd32-4bbc-94fa-9aaf62ed6790 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.774244 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2274/4612] 10.222.0.13 () {58 vars in 1341 bytes} [Sat Dec 18 21:01:36 2021] HEAD /identity/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/a445dcd9bea64ceab425327eda8eac92 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:36.778522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2ce78-1912-4b80-8835-bd18fd8eba28 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.780123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a3e5a-f98f-4c1b-8eba-39111a0d15f2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.780901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a3e5a-f98f-4c1b-8eba-39111a0d15f2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.781187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a3e5a-f98f-4c1b-8eba-39111a0d15f2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.781468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a3e5a-f98f-4c1b-8eba-39111a0d15f2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.782130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a3e5a-f98f-4c1b-8eba-39111a0d15f2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.783821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a3e5a-f98f-4c1b-8eba-39111a0d15f2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.785049 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2339/4613] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.789284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a3e5a-f98f-4c1b-8eba-39111a0d15f2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.793610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2ce78-1912-4b80-8835-bd18fd8eba28 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.798781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb77a5-8a49-4531-a0cd-a488764ae63f tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.799875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb77a5-8a49-4531-a0cd-a488764ae63f tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.800181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb77a5-8a49-4531-a0cd-a488764ae63f tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.800461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb77a5-8a49-4531-a0cd-a488764ae63f tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/a445dcd9bea64ceab425327eda8eac92` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.802707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb77a5-8a49-4531-a0cd-a488764ae63f tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=dcf0cc81d2074fffb381ccaa5285ff16, user_id=a445dcd9bea64ceab425327eda8eac92)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.803407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a3e5a-f98f-4c1b-8eba-39111a0d15f2 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.805383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb77a5-8a49-4531-a0cd-a488764ae63f tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.809112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab952a-b6f9-443c-accb-cda000cb53e6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.809876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab952a-b6f9-443c-accb-cda000cb53e6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.810166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab952a-b6f9-443c-accb-cda000cb53e6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.810488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab952a-b6f9-443c-accb-cda000cb53e6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.811155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab952a-b6f9-443c-accb-cda000cb53e6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.812753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab952a-b6f9-443c-accb-cda000cb53e6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.814086 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2340/4614] 10.222.0.13 () {58 vars in 1211 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.816462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ebeb77a5-8a49-4531-a0cd-a488764ae63f tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a445dcd9bea64ceab425327eda8eac92'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:36.818205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab952a-b6f9-443c-accb-cda000cb53e6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.830116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab952a-b6f9-443c-accb-cda000cb53e6 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.832734 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2275/4615] 10.222.0.13 () {58 vars in 1343 bytes} [Sat Dec 18 21:01:36 2021] DELETE /identity/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/a445dcd9bea64ceab425327eda8eac92 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:36.836444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb77a5-8a49-4531-a0cd-a488764ae63f tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.890476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1717822-638c-448f-8482-fa584d698dbc tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.891268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1717822-638c-448f-8482-fa584d698dbc tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.891560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1717822-638c-448f-8482-fa584d698dbc tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.891846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1717822-638c-448f-8482-fa584d698dbc tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.892517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1717822-638c-448f-8482-fa584d698dbc tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.894117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1717822-638c-448f-8482-fa584d698dbc tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.895319 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2341/4616] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.899183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1717822-638c-448f-8482-fa584d698dbc tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.902698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb77a5-8a49-4531-a0cd-a488764ae63f tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.907680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4240db2-cc51-4c6d-9d64-44d6b8c12ac2 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.908705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4240db2-cc51-4c6d-9d64-44d6b8c12ac2 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.908994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4240db2-cc51-4c6d-9d64-44d6b8c12ac2 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.909191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1717822-638c-448f-8482-fa584d698dbc tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.909311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4240db2-cc51-4c6d-9d64-44d6b8c12ac2 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/40809dd8135c4bd99acba97f594f74df` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.911311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4240db2-cc51-4c6d-9d64-44d6b8c12ac2 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=dcf0cc81d2074fffb381ccaa5285ff16, user_id=40809dd8135c4bd99acba97f594f74df)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.913341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4240db2-cc51-4c6d-9d64-44d6b8c12ac2 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.914937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df501b89-6419-4fab-ae52-6bca070d357f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.915721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df501b89-6419-4fab-ae52-6bca070d357f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.915986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df501b89-6419-4fab-ae52-6bca070d357f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.916266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df501b89-6419-4fab-ae52-6bca070d357f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.916953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df501b89-6419-4fab-ae52-6bca070d357f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.918714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df501b89-6419-4fab-ae52-6bca070d357f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.919995 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2342/4617] 10.222.0.13 () {58 vars in 1214 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.923613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df501b89-6419-4fab-ae52-6bca070d357f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.928082 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2276/4618] 10.222.0.13 () {58 vars in 1341 bytes} [Sat Dec 18 21:01:36 2021] HEAD /identity/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/40809dd8135c4bd99acba97f594f74df => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:36.934800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df501b89-6419-4fab-ae52-6bca070d357f tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.935562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4240db2-cc51-4c6d-9d64-44d6b8c12ac2 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.939907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5907d-768c-487e-95e1-cc5909d11f13 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.940661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5907d-768c-487e-95e1-cc5909d11f13 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.940952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5907d-768c-487e-95e1-cc5909d11f13 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.941477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5907d-768c-487e-95e1-cc5909d11f13 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.942148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5907d-768c-487e-95e1-cc5909d11f13 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.943763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5907d-768c-487e-95e1-cc5909d11f13 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.944853 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2343/4619] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:36.948473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5907d-768c-487e-95e1-cc5909d11f13 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.948744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4240db2-cc51-4c6d-9d64-44d6b8c12ac2 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.953916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d499d-a8c5-44dc-932c-8b0229a4e2d8 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.954846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d499d-a8c5-44dc-932c-8b0229a4e2d8 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.955133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d499d-a8c5-44dc-932c-8b0229a4e2d8 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.955416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d499d-a8c5-44dc-932c-8b0229a4e2d8 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/40809dd8135c4bd99acba97f594f74df` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.957125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d499d-a8c5-44dc-932c-8b0229a4e2d8 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=dcf0cc81d2074fffb381ccaa5285ff16, user_id=40809dd8135c4bd99acba97f594f74df)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.958895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5907d-768c-487e-95e1-cc5909d11f13 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.959106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d499d-a8c5-44dc-932c-8b0229a4e2d8 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.963621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca88de-ebb1-4353-9b16-a26e78b53ba4 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:36.964375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca88de-ebb1-4353-9b16-a26e78b53ba4 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:36.964725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca88de-ebb1-4353-9b16-a26e78b53ba4 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:36.965031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca88de-ebb1-4353-9b16-a26e78b53ba4 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:36.965750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca88de-ebb1-4353-9b16-a26e78b53ba4 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:36.967398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-006d499d-a8c5-44dc-932c-8b0229a4e2d8 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '40809dd8135c4bd99acba97f594f74df'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:36.967572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca88de-ebb1-4353-9b16-a26e78b53ba4 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:36.968591 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2344/4620] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:01:36.972447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca88de-ebb1-4353-9b16-a26e78b53ba4 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:36.981765 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2277/4621] 10.222.0.13 () {58 vars in 1343 bytes} [Sat Dec 18 21:01:36 2021] DELETE /identity/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users/40809dd8135c4bd99acba97f594f74df => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:36.984587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca88de-ebb1-4353-9b16-a26e78b53ba4 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:36.985465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d499d-a8c5-44dc-932c-8b0229a4e2d8 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:37.036594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72328080-5f41-4183-bc8c-7b0b6f1b32e7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.037524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72328080-5f41-4183-bc8c-7b0b6f1b32e7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.037835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72328080-5f41-4183-bc8c-7b0b6f1b32e7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.038114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72328080-5f41-4183-bc8c-7b0b6f1b32e7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.038916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72328080-5f41-4183-bc8c-7b0b6f1b32e7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:37.042520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72328080-5f41-4183-bc8c-7b0b6f1b32e7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:37.043869 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2345/4622] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:37.047409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72328080-5f41-4183-bc8c-7b0b6f1b32e7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:37.048228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d499d-a8c5-44dc-932c-8b0229a4e2d8 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:37.054559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8daa7-b4f2-4e0a-8d2f-29a75773dd83 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.055514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8daa7-b4f2-4e0a-8d2f-29a75773dd83 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.055700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8daa7-b4f2-4e0a-8d2f-29a75773dd83 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.056023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8daa7-b4f2-4e0a-8d2f-29a75773dd83 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.057331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8daa7-b4f2-4e0a-8d2f-29a75773dd83 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=dcf0cc81d2074fffb381ccaa5285ff16)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:37.058079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72328080-5f41-4183-bc8c-7b0b6f1b32e7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:37.059966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8daa7-b4f2-4e0a-8d2f-29a75773dd83 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:37.063451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7b16e-3fa0-46c1-b9cb-214606217eff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.064236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7b16e-3fa0-46c1-b9cb-214606217eff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.064524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7b16e-3fa0-46c1-b9cb-214606217eff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.064808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7b16e-3fa0-46c1-b9cb-214606217eff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.065472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7b16e-3fa0-46c1-b9cb-214606217eff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:37.067387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7b16e-3fa0-46c1-b9cb-214606217eff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:37.068687 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2346/4623] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Dec 18 21:01:37 2021] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:37.072313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7b16e-3fa0-46c1-b9cb-214606217eff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:37.074520 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2278/4624] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Dec 18 21:01:36 2021] GET /identity/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16/users => generated 145 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:37.078398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8daa7-b4f2-4e0a-8d2f-29a75773dd83 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:37.085738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7b16e-3fa0-46c1-b9cb-214606217eff tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:37.090854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a5a61-da53-4174-a8b4-ee8f9ccfa604 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.091066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8daa7-b4f2-4e0a-8d2f-29a75773dd83 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:37.091681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a5a61-da53-4174-a8b4-ee8f9ccfa604 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.091934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a5a61-da53-4174-a8b4-ee8f9ccfa604 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.092213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a5a61-da53-4174-a8b4-ee8f9ccfa604 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.092883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a5a61-da53-4174-a8b4-ee8f9ccfa604 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:37.094512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a5a61-da53-4174-a8b4-ee8f9ccfa604 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:37.095651 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2347/4625] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 21:01:37 2021] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:37.096399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd9b8c-b60e-4b10-8193-bdfb6bf94bae tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.097278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9b8c-b60e-4b10-8193-bdfb6bf94bae tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.097645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9b8c-b60e-4b10-8193-bdfb6bf94bae tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.097921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9b8c-b60e-4b10-8193-bdfb6bf94bae tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/users/40809dd8135c4bd99acba97f594f74df` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.099200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd9b8c-b60e-4b10-8193-bdfb6bf94bae tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:delete_user(user_id=40809dd8135c4bd99acba97f594f74df)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:37.099578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a5a61-da53-4174-a8b4-ee8f9ccfa604 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:37.101303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd9b8c-b60e-4b10-8193-bdfb6bf94bae tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:37.110302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a5a61-da53-4174-a8b4-ee8f9ccfa604 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:37.119400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3d7c9-1fa5-417e-b39d-7799e294ee44 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.120381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3d7c9-1fa5-417e-b39d-7799e294ee44 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.120816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3d7c9-1fa5-417e-b39d-7799e294ee44 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.122627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3d7c9-1fa5-417e-b39d-7799e294ee44 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.123391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3d7c9-1fa5-417e-b39d-7799e294ee44 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:37.125296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3d7c9-1fa5-417e-b39d-7799e294ee44 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:37.127448 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2348/4626] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:01:37 2021] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:01:37.131477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3d7c9-1fa5-417e-b39d-7799e294ee44 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:37.143606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3d7c9-1fa5-417e-b39d-7799e294ee44 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:37.148791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54a257-d097-4258-8009-3d132c219c2a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.149601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54a257-d097-4258-8009-3d132c219c2a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.149868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54a257-d097-4258-8009-3d132c219c2a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.150151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54a257-d097-4258-8009-3d132c219c2a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.150949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54a257-d097-4258-8009-3d132c219c2a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:37.152588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54a257-d097-4258-8009-3d132c219c2a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:37.153733 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2349/4627] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:37 2021] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:01:37.157554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54a257-d097-4258-8009-3d132c219c2a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:37.163455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-33cd9b8c-b60e-4b10-8193-bdfb6bf94bae tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40809dd8135c4bd99acba97f594f74df'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.168174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54a257-d097-4258-8009-3d132c219c2a tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:37.172931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-33cd9b8c-b60e-4b10-8193-bdfb6bf94bae tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40809dd8135c4bd99acba97f594f74df'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.174610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ff067-31ab-4702-a4a7-5d37bcd0d5ea tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.175815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ff067-31ab-4702-a4a7-5d37bcd0d5ea tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.175815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ff067-31ab-4702-a4a7-5d37bcd0d5ea tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.176156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ff067-31ab-4702-a4a7-5d37bcd0d5ea tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.176692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ff067-31ab-4702-a4a7-5d37bcd0d5ea tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:37.178303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ff067-31ab-4702-a4a7-5d37bcd0d5ea tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:37.179446 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2350/4628] 10.222.0.13 () {58 vars in 1277 bytes} [Sat Dec 18 21:01:37 2021] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 18 21:01:37.187072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ff067-31ab-4702-a4a7-5d37bcd0d5ea tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:37.189471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-33cd9b8c-b60e-4b10-8193-bdfb6bf94bae tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40809dd8135c4bd99acba97f594f74df'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.190336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-33cd9b8c-b60e-4b10-8193-bdfb6bf94bae tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40809dd8135c4bd99acba97f594f74df'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.198904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ff067-31ab-4702-a4a7-5d37bcd0d5ea tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:37.199955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-33cd9b8c-b60e-4b10-8193-bdfb6bf94bae tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40809dd8135c4bd99acba97f594f74df'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.204319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708221e-3664-4659-a2c8-457d99a23732 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.205177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708221e-3664-4659-a2c8-457d99a23732 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.205450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708221e-3664-4659-a2c8-457d99a23732 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.205732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708221e-3664-4659-a2c8-457d99a23732 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/9b8b7c2f31484e48b1f776ba33103999` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.207867 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2279/4629] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:37 2021] DELETE /identity/v3/users/40809dd8135c4bd99acba97f594f74df => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:37.211972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd9b8c-b60e-4b10-8193-bdfb6bf94bae tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:37.213994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-33cd9b8c-b60e-4b10-8193-bdfb6bf94bae tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:37.216337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708221e-3664-4659-a2c8-457d99a23732 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:01:37.234782 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-c708221e-3664-4659-a2c8-457d99a23732 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Could not find domain: 9b8b7c2f31484e48b1f776ba33103999.: keystone.exception.DomainNotFound: Could not find domain: 9b8b7c2f31484e48b1f776ba33103999. Dec 18 21:01:37.236213 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2351/4630] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:01:37 2021] PATCH /identity/v3/domains/9b8b7c2f31484e48b1f776ba33103999 => generated 112 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:01:37.239873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708221e-3664-4659-a2c8-457d99a23732 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:37.241656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c708221e-3664-4659-a2c8-457d99a23732 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:37.254883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708221e-3664-4659-a2c8-457d99a23732 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:37.284792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd9b8c-b60e-4b10-8193-bdfb6bf94bae tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:37.289497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c826ff-a733-4c6d-8dbd-ed3c605a685a tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.290396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c826ff-a733-4c6d-8dbd-ed3c605a685a tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.290681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c826ff-a733-4c6d-8dbd-ed3c605a685a tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.290959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c826ff-a733-4c6d-8dbd-ed3c605a685a tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/users/a445dcd9bea64ceab425327eda8eac92` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.292219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c826ff-a733-4c6d-8dbd-ed3c605a685a tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a445dcd9bea64ceab425327eda8eac92)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:37.294799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c826ff-a733-4c6d-8dbd-ed3c605a685a tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:37.309548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5b9f9-d85f-4d93-8a3f-d263c7d987d7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.310576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5b9f9-d85f-4d93-8a3f-d263c7d987d7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.310930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5b9f9-d85f-4d93-8a3f-d263c7d987d7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.311218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5b9f9-d85f-4d93-8a3f-d263c7d987d7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.318884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5b9f9-d85f-4d93-8a3f-d263c7d987d7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:01:37.328882 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-cec5b9f9-d85f-4d93-8a3f-d263c7d987d7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Could not find domain: 8c313fc11fed45cf9dfc6a2ce635b4bb.: keystone.exception.DomainNotFound: Could not find domain: 8c313fc11fed45cf9dfc6a2ce635b4bb. Dec 18 21:01:37.330079 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2352/4631] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:01:37 2021] PATCH /identity/v3/domains/8c313fc11fed45cf9dfc6a2ce635b4bb => generated 112 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 18 21:01:37.333882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5b9f9-d85f-4d93-8a3f-d263c7d987d7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:37.341248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-52c826ff-a733-4c6d-8dbd-ed3c605a685a tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a445dcd9bea64ceab425327eda8eac92'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.343991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5b9f9-d85f-4d93-8a3f-d263c7d987d7 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:37.348106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-52c826ff-a733-4c6d-8dbd-ed3c605a685a tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a445dcd9bea64ceab425327eda8eac92'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.348944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5715b9f-e675-46e0-925b-c43a7fab2310 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4049013aaef497dac2e6865a6fee252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e499875a23c74ed09f4e414e43981d54', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.349746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5715b9f-e675-46e0-925b-c43a7fab2310 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.350032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5715b9f-e675-46e0-925b-c43a7fab2310 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.350349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5715b9f-e675-46e0-925b-c43a7fab2310 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] PATH_INFO: `/v3/domains/8fffb41c87c649d0b3af0d8918611a49` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.358652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5715b9f-e675-46e0-925b-c43a7fab2310 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:01:37.360293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-52c826ff-a733-4c6d-8dbd-ed3c605a685a tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a445dcd9bea64ceab425327eda8eac92'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.360990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-52c826ff-a733-4c6d-8dbd-ed3c605a685a tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a445dcd9bea64ceab425327eda8eac92'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.367610 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-f5715b9f-e675-46e0-925b-c43a7fab2310 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Could not find domain: 8fffb41c87c649d0b3af0d8918611a49.: keystone.exception.DomainNotFound: Could not find domain: 8fffb41c87c649d0b3af0d8918611a49. Dec 18 21:01:37.368774 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2353/4632] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:01:37 2021] PATCH /identity/v3/domains/8fffb41c87c649d0b3af0d8918611a49 => generated 112 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 18 21:01:37.369653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-52c826ff-a733-4c6d-8dbd-ed3c605a685a tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a445dcd9bea64ceab425327eda8eac92'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.373124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5715b9f-e675-46e0-925b-c43a7fab2310 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:37.374919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f5715b9f-e675-46e0-925b-c43a7fab2310 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:37.381820 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2280/4633] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:37 2021] DELETE /identity/v3/users/a445dcd9bea64ceab425327eda8eac92 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:37.382733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c826ff-a733-4c6d-8dbd-ed3c605a685a tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:37.384296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-52c826ff-a733-4c6d-8dbd-ed3c605a685a tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:37.453875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5715b9f-e675-46e0-925b-c43a7fab2310 tempest-DomainConfigurationTestJSON-356541042 tempest-DomainConfigurationTestJSON-356541042-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:37.483086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c826ff-a733-4c6d-8dbd-ed3c605a685a tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:37.488039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a945c-e041-4b1e-9af1-f5f5d98f8f67 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.489011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a945c-e041-4b1e-9af1-f5f5d98f8f67 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.489986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a945c-e041-4b1e-9af1-f5f5d98f8f67 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.490340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a945c-e041-4b1e-9af1-f5f5d98f8f67 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/users/dae4ac4039e94130b0d84cdd64232d98` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.492388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a945c-e041-4b1e-9af1-f5f5d98f8f67 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:delete_user(user_id=dae4ac4039e94130b0d84cdd64232d98)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:37.495249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a945c-e041-4b1e-9af1-f5f5d98f8f67 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:37.530814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af6043-e03a-4628-be2e-a71c10d3a5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.531697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af6043-e03a-4628-be2e-a71c10d3a5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.531982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af6043-e03a-4628-be2e-a71c10d3a5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.532264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af6043-e03a-4628-be2e-a71c10d3a5e2 admin admin] PATH_INFO: `/v3/users/1d422a75c1e040088cb8d13428ad1f8d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.533497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af6043-e03a-4628-be2e-a71c10d3a5e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d422a75c1e040088cb8d13428ad1f8d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:37.535481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af6043-e03a-4628-be2e-a71c10d3a5e2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:37.544560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-075a945c-e041-4b1e-9af1-f5f5d98f8f67 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dae4ac4039e94130b0d84cdd64232d98'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.552548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-075a945c-e041-4b1e-9af1-f5f5d98f8f67 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dae4ac4039e94130b0d84cdd64232d98'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.564804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-075a945c-e041-4b1e-9af1-f5f5d98f8f67 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dae4ac4039e94130b0d84cdd64232d98'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.565939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-075a945c-e041-4b1e-9af1-f5f5d98f8f67 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dae4ac4039e94130b0d84cdd64232d98'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.574164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-075a945c-e041-4b1e-9af1-f5f5d98f8f67 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dae4ac4039e94130b0d84cdd64232d98'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.580546 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2281/4634] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:37 2021] DELETE /identity/v3/users/dae4ac4039e94130b0d84cdd64232d98 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:37.584422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a945c-e041-4b1e-9af1-f5f5d98f8f67 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:37.586026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-075a945c-e041-4b1e-9af1-f5f5d98f8f67 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:37.588612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8af6043-e03a-4628-be2e-a71c10d3a5e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d422a75c1e040088cb8d13428ad1f8d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.600361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8af6043-e03a-4628-be2e-a71c10d3a5e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d422a75c1e040088cb8d13428ad1f8d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.601264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8af6043-e03a-4628-be2e-a71c10d3a5e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d422a75c1e040088cb8d13428ad1f8d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.616072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8af6043-e03a-4628-be2e-a71c10d3a5e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d422a75c1e040088cb8d13428ad1f8d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.624686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8af6043-e03a-4628-be2e-a71c10d3a5e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d422a75c1e040088cb8d13428ad1f8d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:37.631841 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2354/4635] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:37 2021] DELETE /identity/v3/users/1d422a75c1e040088cb8d13428ad1f8d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:37.635964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3347fa4-0d65-44fb-b149-475f797fb1f1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.636398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3347fa4-0d65-44fb-b149-475f797fb1f1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.636824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3347fa4-0d65-44fb-b149-475f797fb1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.656896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c3347fa4-0d65-44fb-b149-475f797fb1f1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:37.657731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c3347fa4-0d65-44fb-b149-475f797fb1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:37.659333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a945c-e041-4b1e-9af1-f5f5d98f8f67 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:37.736207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef27a6-8276-47ba-bfd3-93e18818b570 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.737100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef27a6-8276-47ba-bfd3-93e18818b570 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.737386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef27a6-8276-47ba-bfd3-93e18818b570 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.738172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef27a6-8276-47ba-bfd3-93e18818b570 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.739740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef27a6-8276-47ba-bfd3-93e18818b570 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:delete_group(group_id=dcf0cc81d2074fffb381ccaa5285ff16)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:37.741742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef27a6-8276-47ba-bfd3-93e18818b570 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:37.743604 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2355/4636] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:37.754875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3347fa4-0d65-44fb-b149-475f797fb1f1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:37.757422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c3347fa4-0d65-44fb-b149-475f797fb1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:37.809853 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2282/4637] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 21:01:37 2021] DELETE /identity/v3/groups/dcf0cc81d2074fffb381ccaa5285ff16 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:37.816492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef27a6-8276-47ba-bfd3-93e18818b570 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:37.818686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-42ef27a6-8276-47ba-bfd3-93e18818b570 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:37.825809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3347fa4-0d65-44fb-b149-475f797fb1f1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:37.884878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b01297-6980-4efa-9cc0-37a3a08607aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.885649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b01297-6980-4efa-9cc0-37a3a08607aa service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.885994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b01297-6980-4efa-9cc0-37a3a08607aa service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.886901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b01297-6980-4efa-9cc0-37a3a08607aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.907039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef27a6-8276-47ba-bfd3-93e18818b570 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:37.913320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1836c7-8ac9-43a3-b733-1b95e618117f tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.914181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1836c7-8ac9-43a3-b733-1b95e618117f tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.914641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1836c7-8ac9-43a3-b733-1b95e618117f tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.915031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1836c7-8ac9-43a3-b733-1b95e618117f tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.915853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1836c7-8ac9-43a3-b733-1b95e618117f tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:37.918199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1836c7-8ac9-43a3-b733-1b95e618117f tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:37.935990 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2283/4638] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:01:37 2021] POST /identity/v3/groups => generated 325 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:37.940665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1836c7-8ac9-43a3-b733-1b95e618117f tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:37.966031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1836c7-8ac9-43a3-b733-1b95e618117f tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:37.978481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cd7cf-b5a5-4050-804f-c06c050099d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:37.979034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cd7cf-b5a5-4050-804f-c06c050099d2 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:37.979328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cd7cf-b5a5-4050-804f-c06c050099d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:37.979614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cd7cf-b5a5-4050-804f-c06c050099d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:37.985326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d73cd7cf-b5a5-4050-804f-c06c050099d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:38.037635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b01297-6980-4efa-9cc0-37a3a08607aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:38.039109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b01297-6980-4efa-9cc0-37a3a08607aa service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:38.094509 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2356/4639] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:01:38.097097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b01297-6980-4efa-9cc0-37a3a08607aa service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:38.100869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cd7cf-b5a5-4050-804f-c06c050099d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:38.103069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cd7cf-b5a5-4050-804f-c06c050099d2 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:38.117412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b01297-6980-4efa-9cc0-37a3a08607aa service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:38.129784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8397b-3649-49fe-9add-ba411aa9dc10 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:38.131853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8397b-3649-49fe-9add-ba411aa9dc10 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:38.133285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8397b-3649-49fe-9add-ba411aa9dc10 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:38.134458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8397b-3649-49fe-9add-ba411aa9dc10 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:38.139088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8397b-3649-49fe-9add-ba411aa9dc10 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:38.141607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8397b-3649-49fe-9add-ba411aa9dc10 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:38.143355 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2284/4640] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:37 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:01:38.163184 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2357/4641] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:01:38 2021] POST /identity/v3/groups => generated 325 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:38.169178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cd7cf-b5a5-4050-804f-c06c050099d2 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:38.181133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cd7cf-b5a5-4050-804f-c06c050099d2 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:38.186805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae8497-2d53-4c6b-a224-05487f8d4d35 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:38.187847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae8497-2d53-4c6b-a224-05487f8d4d35 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:38.187847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae8497-2d53-4c6b-a224-05487f8d4d35 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:38.188071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae8497-2d53-4c6b-a224-05487f8d4d35 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:38.189280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae8497-2d53-4c6b-a224-05487f8d4d35 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:38.191651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae8497-2d53-4c6b-a224-05487f8d4d35 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:38.229969 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2285/4642] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:01:38 2021] POST /identity/v3/groups => generated 327 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:38.234239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8397b-3649-49fe-9add-ba411aa9dc10 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:38.248560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8397b-3649-49fe-9add-ba411aa9dc10 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:38.254155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016ca11-ad59-40c5-ba60-aeaf1961870e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:38.255119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016ca11-ad59-40c5-ba60-aeaf1961870e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:38.255756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016ca11-ad59-40c5-ba60-aeaf1961870e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:38.256233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016ca11-ad59-40c5-ba60-aeaf1961870e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:38.257279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016ca11-ad59-40c5-ba60-aeaf1961870e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:38.258551 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-5016ca11-ad59-40c5-ba60-aeaf1961870e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:38.258551 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:38.258551 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:38.260213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016ca11-ad59-40c5-ba60-aeaf1961870e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:38.270196 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2358/4643] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Dec 18 21:01:38 2021] GET /identity/v3/groups => generated 1487 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:38.274379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae8497-2d53-4c6b-a224-05487f8d4d35 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:38.294444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae8497-2d53-4c6b-a224-05487f8d4d35 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:38.307032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095251e-c4a7-4915-9eb6-524fa24cf101 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:38.312379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095251e-c4a7-4915-9eb6-524fa24cf101 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:38.312619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095251e-c4a7-4915-9eb6-524fa24cf101 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:38.312916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095251e-c4a7-4915-9eb6-524fa24cf101 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/e727affe33b146f39b67851b16bc3207` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:38.329812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095251e-c4a7-4915-9eb6-524fa24cf101 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e727affe33b146f39b67851b16bc3207)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:38.332152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095251e-c4a7-4915-9eb6-524fa24cf101 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:38.391937 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2286/4644] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 21:01:38 2021] DELETE /identity/v3/groups/e727affe33b146f39b67851b16bc3207 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:38.395982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016ca11-ad59-40c5-ba60-aeaf1961870e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:38.432030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016ca11-ad59-40c5-ba60-aeaf1961870e tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:38.577265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897c62e-d87f-4c3a-a670-7d93b624b9b4 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:38.578165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897c62e-d87f-4c3a-a670-7d93b624b9b4 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:38.578483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897c62e-d87f-4c3a-a670-7d93b624b9b4 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:38.578789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897c62e-d87f-4c3a-a670-7d93b624b9b4 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/85410f2da5514af5b73dee156ee0d47d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:38.589190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897c62e-d87f-4c3a-a670-7d93b624b9b4 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:delete_group(group_id=85410f2da5514af5b73dee156ee0d47d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:38.590571 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-e897c62e-d87f-4c3a-a670-7d93b624b9b4 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:38.590571 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:38.590571 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:38.592458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897c62e-d87f-4c3a-a670-7d93b624b9b4 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:38.672105 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2359/4645] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 21:01:38 2021] DELETE /identity/v3/groups/85410f2da5514af5b73dee156ee0d47d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:38.673278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095251e-c4a7-4915-9eb6-524fa24cf101 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:38.685336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095251e-c4a7-4915-9eb6-524fa24cf101 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:38.758089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464ac0f-4940-4249-8b25-0c1eb6d8dc6d tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:38.759162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464ac0f-4940-4249-8b25-0c1eb6d8dc6d tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:38.759577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464ac0f-4940-4249-8b25-0c1eb6d8dc6d tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:38.760057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464ac0f-4940-4249-8b25-0c1eb6d8dc6d tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/e83afe82d6d24a86b30b1ac96fe8cc84` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:38.765648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464ac0f-4940-4249-8b25-0c1eb6d8dc6d tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e83afe82d6d24a86b30b1ac96fe8cc84)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:38.767771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464ac0f-4940-4249-8b25-0c1eb6d8dc6d tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:38.813808 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2287/4646] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 21:01:38 2021] DELETE /identity/v3/groups/e83afe82d6d24a86b30b1ac96fe8cc84 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:38.819394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897c62e-d87f-4c3a-a670-7d93b624b9b4 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:38.832951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897c62e-d87f-4c3a-a670-7d93b624b9b4 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:38.872937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464ac0f-4940-4249-8b25-0c1eb6d8dc6d tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:38.875540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1464ac0f-4940-4249-8b25-0c1eb6d8dc6d tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:38.936746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53cdd8-6e8e-4f5d-a155-57eae54219e5 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:38.937656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53cdd8-6e8e-4f5d-a155-57eae54219e5 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:38.937951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53cdd8-6e8e-4f5d-a155-57eae54219e5 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:38.938238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53cdd8-6e8e-4f5d-a155-57eae54219e5 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:38.940190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53cdd8-6e8e-4f5d-a155-57eae54219e5 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:38.942362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53cdd8-6e8e-4f5d-a155-57eae54219e5 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:38.974913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464ac0f-4940-4249-8b25-0c1eb6d8dc6d tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:38.979138 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2360/4647] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:38 2021] POST /identity/v3/users => generated 323 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:38.979870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:38.981460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:38.981793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:38.982075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7 admin admin] PATH_INFO: `/v3/projects/e258519401fa4623ba33500d3206ff8b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:38.983500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53cdd8-6e8e-4f5d-a155-57eae54219e5 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:38.985811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e258519401fa4623ba33500d3206ff8b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:38.988194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:38.999096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53cdd8-6e8e-4f5d-a155-57eae54219e5 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:39.005609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8cb71-0e36-46a5-b9ac-624f30c4bcc7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:39.006355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8cb71-0e36-46a5-b9ac-624f30c4bcc7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:39.006656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8cb71-0e36-46a5-b9ac-624f30c4bcc7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:39.006943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8cb71-0e36-46a5-b9ac-624f30c4bcc7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:39.007664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8cb71-0e36-46a5-b9ac-624f30c4bcc7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:39.009894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8cb71-0e36-46a5-b9ac-624f30c4bcc7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:39.031520 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2361/4648] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:01:38 2021] POST /identity/v3/groups => generated 327 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:39.034181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8cb71-0e36-46a5-b9ac-624f30c4bcc7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:39.049011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8cb71-0e36-46a5-b9ac-624f30c4bcc7 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:39.055151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e258519401fa4623ba33500d3206ff8b', 'request_id': 'req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:39.065583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e258519401fa4623ba33500d3206ff8b', 'request_id': 'req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:39.074448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e258519401fa4623ba33500d3206ff8b', 'request_id': 'req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:39.093613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7 admin admin] The token cache is being invalidate because project e258519401fa4623ba33500d3206ff8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:39.094092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:39.095027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:39.097404 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2288/4649] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:38 2021] DELETE /identity/v3/projects/e258519401fa4623ba33500d3206ff8b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:39.101211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:39.103235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:39.123622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd653c-88a5-4bb6-837c-90f8bd508888 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:39.124832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd653c-88a5-4bb6-837c-90f8bd508888 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:39.125114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd653c-88a5-4bb6-837c-90f8bd508888 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:39.125391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd653c-88a5-4bb6-837c-90f8bd508888 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/5aec92954758439aad79672927fe8420/users/a4e04194707d49889b9b4ffe80ba7a6f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:39.157050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd653c-88a5-4bb6-837c-90f8bd508888 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=5aec92954758439aad79672927fe8420, user_id=a4e04194707d49889b9b4ffe80ba7a6f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:39.158742 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-bfcd653c-88a5-4bb6-837c-90f8bd508888 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:39.158742 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:39.158742 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:39.160315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd653c-88a5-4bb6-837c-90f8bd508888 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:39.191498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76031fa7-bb2f-4d65-98d5-0a30f8a4d8b7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:39.196044 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2362/4650] 10.222.0.13 () {60 vars in 1359 bytes} [Sat Dec 18 21:01:39 2021] PUT /identity/v3/groups/5aec92954758439aad79672927fe8420/users/a4e04194707d49889b9b4ffe80ba7a6f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:39.197256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd653c-88a5-4bb6-837c-90f8bd508888 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:39.200184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bfcd653c-88a5-4bb6-837c-90f8bd508888 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:39.277690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076177b-919b-40ec-9744-c2b5f6112113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:39.278879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076177b-919b-40ec-9744-c2b5f6112113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:39.279163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076177b-919b-40ec-9744-c2b5f6112113 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:39.279439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076177b-919b-40ec-9744-c2b5f6112113 admin admin] PATH_INFO: `/v3/users/d4049013aaef497dac2e6865a6fee252` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:39.280767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076177b-919b-40ec-9744-c2b5f6112113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4049013aaef497dac2e6865a6fee252)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:39.282657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076177b-919b-40ec-9744-c2b5f6112113 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:39.298146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd653c-88a5-4bb6-837c-90f8bd508888 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:39.307020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e55c8c-0a89-46b1-a779-865ada3e46b9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:39.307805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e55c8c-0a89-46b1-a779-865ada3e46b9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:39.308239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e55c8c-0a89-46b1-a779-865ada3e46b9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:39.308616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e55c8c-0a89-46b1-a779-865ada3e46b9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:39.309414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e55c8c-0a89-46b1-a779-865ada3e46b9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:39.311632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e55c8c-0a89-46b1-a779-865ada3e46b9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:39.332487 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2363/4651] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:01:39 2021] POST /identity/v3/groups => generated 327 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:39.344019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e55c8c-0a89-46b1-a779-865ada3e46b9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:39.353192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5076177b-919b-40ec-9744-c2b5f6112113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4049013aaef497dac2e6865a6fee252'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:39.357506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e55c8c-0a89-46b1-a779-865ada3e46b9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:39.360738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5076177b-919b-40ec-9744-c2b5f6112113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4049013aaef497dac2e6865a6fee252'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:39.371036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ba59b-e70c-4e4b-bdd5-d1bd62664cd9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:39.371618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ba59b-e70c-4e4b-bdd5-d1bd62664cd9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:39.371910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ba59b-e70c-4e4b-bdd5-d1bd62664cd9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:39.372771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ba59b-e70c-4e4b-bdd5-d1bd62664cd9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/09fe4184b57e48648bbfcc50af51d115/users/a4e04194707d49889b9b4ffe80ba7a6f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:39.373505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5076177b-919b-40ec-9744-c2b5f6112113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4049013aaef497dac2e6865a6fee252'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:39.374360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5076177b-919b-40ec-9744-c2b5f6112113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4049013aaef497dac2e6865a6fee252'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:39.380364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ba59b-e70c-4e4b-bdd5-d1bd62664cd9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=09fe4184b57e48648bbfcc50af51d115, user_id=a4e04194707d49889b9b4ffe80ba7a6f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:39.382348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5076177b-919b-40ec-9744-c2b5f6112113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4049013aaef497dac2e6865a6fee252'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:39.382522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ba59b-e70c-4e4b-bdd5-d1bd62664cd9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:39.389729 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2289/4652] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:39 2021] DELETE /identity/v3/users/d4049013aaef497dac2e6865a6fee252 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:39.410036 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2364/4653] 10.222.0.13 () {60 vars in 1359 bytes} [Sat Dec 18 21:01:39 2021] PUT /identity/v3/groups/09fe4184b57e48648bbfcc50af51d115/users/a4e04194707d49889b9b4ffe80ba7a6f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:39.413970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076177b-919b-40ec-9744-c2b5f6112113 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:39.415637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5076177b-919b-40ec-9744-c2b5f6112113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:39.494214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076177b-919b-40ec-9744-c2b5f6112113 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:39.562950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88191def-f953-4d6e-a12e-6b86be4efa38 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:39.563875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88191def-f953-4d6e-a12e-6b86be4efa38 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:39.564463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88191def-f953-4d6e-a12e-6b86be4efa38 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:39.564463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88191def-f953-4d6e-a12e-6b86be4efa38 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/users/a4e04194707d49889b9b4ffe80ba7a6f/groups` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:39.565734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88191def-f953-4d6e-a12e-6b86be4efa38 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=a4e04194707d49889b9b4ffe80ba7a6f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:39.568206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88191def-f953-4d6e-a12e-6b86be4efa38 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:39.586222 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2290/4654] 10.222.0.13 () {58 vars in 1241 bytes} [Sat Dec 18 21:01:39 2021] GET /identity/v3/users/a4e04194707d49889b9b4ffe80ba7a6f/groups => generated 840 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:39.587549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ba59b-e70c-4e4b-bdd5-d1bd62664cd9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:39.599513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ba59b-e70c-4e4b-bdd5-d1bd62664cd9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:39.608997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd85526-97e8-48cf-a113-1b3c57cde092 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:39.609980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd85526-97e8-48cf-a113-1b3c57cde092 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:39.610417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd85526-97e8-48cf-a113-1b3c57cde092 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:39.610892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd85526-97e8-48cf-a113-1b3c57cde092 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/09fe4184b57e48648bbfcc50af51d115` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:39.612393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd85526-97e8-48cf-a113-1b3c57cde092 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:delete_group(group_id=09fe4184b57e48648bbfcc50af51d115)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:39.614757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd85526-97e8-48cf-a113-1b3c57cde092 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:39.711748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88191def-f953-4d6e-a12e-6b86be4efa38 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:39.719119 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2365/4655] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 21:01:39 2021] DELETE /identity/v3/groups/09fe4184b57e48648bbfcc50af51d115 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:39.722787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88191def-f953-4d6e-a12e-6b86be4efa38 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:39.813466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee88e7b-ed2c-480b-b0f6-e8d5a3e7a647 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:39.814666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee88e7b-ed2c-480b-b0f6-e8d5a3e7a647 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:39.815017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee88e7b-ed2c-480b-b0f6-e8d5a3e7a647 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:39.815370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee88e7b-ed2c-480b-b0f6-e8d5a3e7a647 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/groups/5aec92954758439aad79672927fe8420` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:39.817833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee88e7b-ed2c-480b-b0f6-e8d5a3e7a647 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:delete_group(group_id=5aec92954758439aad79672927fe8420)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:39.820440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee88e7b-ed2c-480b-b0f6-e8d5a3e7a647 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:39.872041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd85526-97e8-48cf-a113-1b3c57cde092 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:39.874077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7fd85526-97e8-48cf-a113-1b3c57cde092 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:39.882294 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2291/4656] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 21:01:39 2021] DELETE /identity/v3/groups/5aec92954758439aad79672927fe8420 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:39.883968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee88e7b-ed2c-480b-b0f6-e8d5a3e7a647 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:39.964847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee88e7b-ed2c-480b-b0f6-e8d5a3e7a647 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:39.969975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9736d-cd44-478c-9c07-8aa4f60357ff tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:39.970926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9736d-cd44-478c-9c07-8aa4f60357ff tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:39.971219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9736d-cd44-478c-9c07-8aa4f60357ff tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:39.971591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9736d-cd44-478c-9c07-8aa4f60357ff tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/users/a4e04194707d49889b9b4ffe80ba7a6f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:39.972759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9736d-cd44-478c-9c07-8aa4f60357ff tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a4e04194707d49889b9b4ffe80ba7a6f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:39.975127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9736d-cd44-478c-9c07-8aa4f60357ff tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:39.991161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd85526-97e8-48cf-a113-1b3c57cde092 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:40.044015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-07e9736d-cd44-478c-9c07-8aa4f60357ff tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4e04194707d49889b9b4ffe80ba7a6f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.057056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205431b-a80e-40cb-babe-9683f5680ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:40.060324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205431b-a80e-40cb-babe-9683f5680ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:40.061034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205431b-a80e-40cb-babe-9683f5680ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:40.061724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205431b-a80e-40cb-babe-9683f5680ad6 admin admin] PATH_INFO: `/v3/projects/e499875a23c74ed09f4e414e43981d54` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:40.062402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-07e9736d-cd44-478c-9c07-8aa4f60357ff tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4e04194707d49889b9b4ffe80ba7a6f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.064090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205431b-a80e-40cb-babe-9683f5680ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e499875a23c74ed09f4e414e43981d54)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:40.066766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205431b-a80e-40cb-babe-9683f5680ad6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:40.077683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-07e9736d-cd44-478c-9c07-8aa4f60357ff tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4e04194707d49889b9b4ffe80ba7a6f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.078708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-07e9736d-cd44-478c-9c07-8aa4f60357ff tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4e04194707d49889b9b4ffe80ba7a6f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.091404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-07e9736d-cd44-478c-9c07-8aa4f60357ff tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4e04194707d49889b9b4ffe80ba7a6f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.103938 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2292/4657] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:39 2021] DELETE /identity/v3/users/a4e04194707d49889b9b4ffe80ba7a6f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:40.110046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9736d-cd44-478c-9c07-8aa4f60357ff tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:40.112056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-07e9736d-cd44-478c-9c07-8aa4f60357ff tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:40.127841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0205431b-a80e-40cb-babe-9683f5680ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e499875a23c74ed09f4e414e43981d54', 'request_id': 'req-0205431b-a80e-40cb-babe-9683f5680ad6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.136583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0205431b-a80e-40cb-babe-9683f5680ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e499875a23c74ed09f4e414e43981d54', 'request_id': 'req-0205431b-a80e-40cb-babe-9683f5680ad6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.147768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0205431b-a80e-40cb-babe-9683f5680ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e499875a23c74ed09f4e414e43981d54', 'request_id': 'req-0205431b-a80e-40cb-babe-9683f5680ad6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.159993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0205431b-a80e-40cb-babe-9683f5680ad6 admin admin] The token cache is being invalidate because project e499875a23c74ed09f4e414e43981d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:40.160558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0205431b-a80e-40cb-babe-9683f5680ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.161549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0205431b-a80e-40cb-babe-9683f5680ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.163782 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2366/4658] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:39 2021] DELETE /identity/v3/projects/e499875a23c74ed09f4e414e43981d54 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:40.170967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c77dd-0843-4828-a7bc-5e004e4b09c2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:40.171596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c77dd-0843-4828-a7bc-5e004e4b09c2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:40.171890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c77dd-0843-4828-a7bc-5e004e4b09c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:40.193261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9736d-cd44-478c-9c07-8aa4f60357ff tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:40.200983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-286c77dd-0843-4828-a7bc-5e004e4b09c2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:40.202436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-286c77dd-0843-4828-a7bc-5e004e4b09c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:40.285315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28704653-1adc-4a7f-a690-65090468e9f9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:40.286879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28704653-1adc-4a7f-a690-65090468e9f9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:40.287166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28704653-1adc-4a7f-a690-65090468e9f9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:40.287451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28704653-1adc-4a7f-a690-65090468e9f9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/domains/1f541a8ee6d5432ea449d76de2669aea` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:40.288378 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2367/4659] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:40.289158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28704653-1adc-4a7f-a690-65090468e9f9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1f541a8ee6d5432ea449d76de2669aea)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:40.290245 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-28704653-1adc-4a7f-a690-65090468e9f9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:40.290245 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:40.290245 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:40.291199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28704653-1adc-4a7f-a690-65090468e9f9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:40.297536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971b2bc-6614-4f34-b36a-17794414b019 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:40.297825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971b2bc-6614-4f34-b36a-17794414b019 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:40.298107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971b2bc-6614-4f34-b36a-17794414b019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:40.317784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-28704653-1adc-4a7f-a690-65090468e9f9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1f541a8ee6d5432ea449d76de2669aea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.318011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4971b2bc-6614-4f34-b36a-17794414b019 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:40.318858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-28704653-1adc-4a7f-a690-65090468e9f9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1f541a8ee6d5432ea449d76de2669aea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.319281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4971b2bc-6614-4f34-b36a-17794414b019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:40.357088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-28704653-1adc-4a7f-a690-65090468e9f9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1f541a8ee6d5432ea449d76de2669aea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.359263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-28704653-1adc-4a7f-a690-65090468e9f9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1f541a8ee6d5432ea449d76de2669aea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.365108 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2293/4660] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:01:40 2021] PATCH /identity/v3/domains/1f541a8ee6d5432ea449d76de2669aea => generated 276 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:40.370478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28704653-1adc-4a7f-a690-65090468e9f9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:40.373316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-28704653-1adc-4a7f-a690-65090468e9f9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:40.418955 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2368/4661] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:40.423521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971b2bc-6614-4f34-b36a-17794414b019 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:40.444785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971b2bc-6614-4f34-b36a-17794414b019 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:40.454029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f78352-535c-41a3-b2b2-f0596601aaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:40.455069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f78352-535c-41a3-b2b2-f0596601aaed admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:40.455605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f78352-535c-41a3-b2b2-f0596601aaed admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:40.456104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f78352-535c-41a3-b2b2-f0596601aaed admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:40.457067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f78352-535c-41a3-b2b2-f0596601aaed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:01:40.457590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f78352-535c-41a3-b2b2-f0596601aaed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:40.459438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f78352-535c-41a3-b2b2-f0596601aaed admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:40.459749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28704653-1adc-4a7f-a690-65090468e9f9 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:40.470043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb494e67d8444391a07cd800e2b4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93c96147c5a6417b956c1ba22d851925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:40.471505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:40.472181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:40.472480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] PATH_INFO: `/v3/domains/1f541a8ee6d5432ea449d76de2669aea` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:40.489381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1f541a8ee6d5432ea449d76de2669aea)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:40.490064 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2369/4662] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:01:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:40.493423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:40.494716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f78352-535c-41a3-b2b2-f0596601aaed admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:40.506198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f78352-535c-41a3-b2b2-f0596601aaed admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:40.513555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f48f6b-be37-46ac-b6da-cee790935c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:40.513778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f48f6b-be37-46ac-b6da-cee790935c0c admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:40.514139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f48f6b-be37-46ac-b6da-cee790935c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:40.514545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f48f6b-be37-46ac-b6da-cee790935c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:40.515358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f48f6b-be37-46ac-b6da-cee790935c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:40.530070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1f541a8ee6d5432ea449d76de2669aea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.534034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1f541a8ee6d5432ea449d76de2669aea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.536094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f48f6b-be37-46ac-b6da-cee790935c0c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:40.583618 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2370/4663] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:40 2021] POST /identity/v3/projects => generated 365 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:40.584916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f48f6b-be37-46ac-b6da-cee790935c0c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:40.596853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f541a8ee6d5432ea449d76de2669aea', 'request_id': 'req-5c0fcdee-666f-4958-af3f-c99012110b54'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.605866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f541a8ee6d5432ea449d76de2669aea', 'request_id': 'req-5c0fcdee-666f-4958-af3f-c99012110b54'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.615222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f541a8ee6d5432ea449d76de2669aea', 'request_id': 'req-5c0fcdee-666f-4958-af3f-c99012110b54'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.628456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] The token cache is being invalidate because project 1f541a8ee6d5432ea449d76de2669aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:40.628747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.629395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.637132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1f541a8ee6d5432ea449d76de2669aea', 'request_id': 'req-5c0fcdee-666f-4958-af3f-c99012110b54'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.640380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1f541a8ee6d5432ea449d76de2669aea', 'request_id': 'req-5c0fcdee-666f-4958-af3f-c99012110b54'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.641196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1f541a8ee6d5432ea449d76de2669aea', 'request_id': 'req-5c0fcdee-666f-4958-af3f-c99012110b54'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.647319 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2294/4664] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:01:40 2021] DELETE /identity/v3/domains/1f541a8ee6d5432ea449d76de2669aea => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:40.651616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:40.654281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:40.663239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f48f6b-be37-46ac-b6da-cee790935c0c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:40.724385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f822e1-815e-4027-aee5-b367a6ad89c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:40.725234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f822e1-815e-4027-aee5-b367a6ad89c2 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:40.725635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f822e1-815e-4027-aee5-b367a6ad89c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:40.725762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fcdee-666f-4958-af3f-c99012110b54 tempest-GroupsV3TestJSON-1992280317 tempest-GroupsV3TestJSON-1992280317-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:40.726379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f822e1-815e-4027-aee5-b367a6ad89c2 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:40.727358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f822e1-815e-4027-aee5-b367a6ad89c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:40.729949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f822e1-815e-4027-aee5-b367a6ad89c2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:40.731130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0d09d-481d-4206-a2ac-665a6d423354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:40.732087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0d09d-481d-4206-a2ac-665a6d423354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:40.732444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0d09d-481d-4206-a2ac-665a6d423354 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:40.732793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0d09d-481d-4206-a2ac-665a6d423354 admin admin] PATH_INFO: `/v3/users/2e5575c705744037b98c0ac16253706a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:40.734202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0d09d-481d-4206-a2ac-665a6d423354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e5575c705744037b98c0ac16253706a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:40.736461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0d09d-481d-4206-a2ac-665a6d423354 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:40.767821 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2371/4665] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:40 2021] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:40.774512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f822e1-815e-4027-aee5-b367a6ad89c2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:40.776573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-68f822e1-815e-4027-aee5-b367a6ad89c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:40.789310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f822e1-815e-4027-aee5-b367a6ad89c2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:40.795833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8639a-51cf-4011-95c2-1b0c8187029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:40.796234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-26a0d09d-481d-4206-a2ac-665a6d423354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e5575c705744037b98c0ac16253706a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.796659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8639a-51cf-4011-95c2-1b0c8187029c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:40.797011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8639a-51cf-4011-95c2-1b0c8187029c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:40.797401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8639a-51cf-4011-95c2-1b0c8187029c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:40.798199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8639a-51cf-4011-95c2-1b0c8187029c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:40.799908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8639a-51cf-4011-95c2-1b0c8187029c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:40.806958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-26a0d09d-481d-4206-a2ac-665a6d423354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e5575c705744037b98c0ac16253706a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.819749 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2372/4666] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:40 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:40.824281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-26a0d09d-481d-4206-a2ac-665a6d423354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e5575c705744037b98c0ac16253706a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.824847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8639a-51cf-4011-95c2-1b0c8187029c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:40.825021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-26a0d09d-481d-4206-a2ac-665a6d423354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e5575c705744037b98c0ac16253706a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.835261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-26a0d09d-481d-4206-a2ac-665a6d423354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e5575c705744037b98c0ac16253706a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:40.837344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8639a-51cf-4011-95c2-1b0c8187029c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:40.843382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96acac-4055-424e-9346-6dd96d96b0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:40.844175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96acac-4055-424e-9346-6dd96d96b0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:40.844564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96acac-4055-424e-9346-6dd96d96b0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:40.845379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96acac-4055-424e-9346-6dd96d96b0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:40.847594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96acac-4055-424e-9346-6dd96d96b0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:40.849189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96acac-4055-424e-9346-6dd96d96b0a7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:40.850894 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2295/4667] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:40 2021] DELETE /identity/v3/users/2e5575c705744037b98c0ac16253706a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:40.856889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e2d1a-835b-4e9c-9c86-e544ab833a6e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:40.857268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e2d1a-835b-4e9c-9c86-e544ab833a6e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:40.857622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e2d1a-835b-4e9c-9c86-e544ab833a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:40.880355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0b6e2d1a-835b-4e9c-9c86-e544ab833a6e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:40.881601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0b6e2d1a-835b-4e9c-9c86-e544ab833a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:40.885962 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2373/4668] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:40 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:40.887644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96acac-4055-424e-9346-6dd96d96b0a7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:40.890494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2a96acac-4055-424e-9346-6dd96d96b0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:40.910955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96acac-4055-424e-9346-6dd96d96b0a7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:40.965368 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2296/4669] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:40.977898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e2d1a-835b-4e9c-9c86-e544ab833a6e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:40.979692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0b6e2d1a-835b-4e9c-9c86-e544ab833a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:41.065461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4a7a2-4b18-4fa7-8ee6-426e3624fc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:41.066956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4a7a2-4b18-4fa7-8ee6-426e3624fc12 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:41.066956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4a7a2-4b18-4fa7-8ee6-426e3624fc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:41.067207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4a7a2-4b18-4fa7-8ee6-426e3624fc12 admin admin] PATH_INFO: `/v3/projects/992c062a8c0e48d78fb111728e459292/users/39071a4300ca43e9995369c47dd63d02/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:41.095802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4a7a2-4b18-4fa7-8ee6-426e3624fc12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=992c062a8c0e48d78fb111728e459292, user_id=39071a4300ca43e9995369c47dd63d02, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:41.099899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4a7a2-4b18-4fa7-8ee6-426e3624fc12 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:41.109400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e2d1a-835b-4e9c-9c86-e544ab833a6e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:41.120705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a5b09-bbae-49e5-bc1b-aa554766f64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:41.122847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a5b09-bbae-49e5-bc1b-aa554766f64e service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:41.123159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a5b09-bbae-49e5-bc1b-aa554766f64e service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:41.124380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a5b09-bbae-49e5-bc1b-aa554766f64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:41.128240 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2374/4670] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:40 2021] PUT /identity/v3/projects/992c062a8c0e48d78fb111728e459292/users/39071a4300ca43e9995369c47dd63d02/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:41.141472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae16e7-d5a3-4a5c-88af-1f5be5712049 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:41.141670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae16e7-d5a3-4a5c-88af-1f5be5712049 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:41.141947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae16e7-d5a3-4a5c-88af-1f5be5712049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:41.158476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a5b09-bbae-49e5-bc1b-aa554766f64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:41.160020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a5b09-bbae-49e5-bc1b-aa554766f64e service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:41.171403 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2297/4671] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:01:41.194175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-93ae16e7-d5a3-4a5c-88af-1f5be5712049 None None] MFA Rules not processed for user `39071a4300ca43e9995369c47dd63d02`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:41.196197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-93ae16e7-d5a3-4a5c-88af-1f5be5712049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:41.289931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a5b09-bbae-49e5-bc1b-aa554766f64e service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:41.294357 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2375/4672] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:41 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:41.300225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a5b09-bbae-49e5-bc1b-aa554766f64e service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:41.357540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfae69-819d-48cf-9a6b-d19fe75280a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:41.358208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfae69-819d-48cf-9a6b-d19fe75280a3 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:41.358531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfae69-819d-48cf-9a6b-d19fe75280a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:41.358815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfae69-819d-48cf-9a6b-d19fe75280a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:41.359519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfae69-819d-48cf-9a6b-d19fe75280a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:41.361607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfae69-819d-48cf-9a6b-d19fe75280a3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:41.390712 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2298/4673] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:41 2021] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:41.391975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae16e7-d5a3-4a5c-88af-1f5be5712049 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:41.402908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae16e7-d5a3-4a5c-88af-1f5be5712049 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:41.460522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a27bd-5235-4bbc-9749-fe4caac09d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:41.461474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a27bd-5235-4bbc-9749-fe4caac09d1b admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:41.462057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a27bd-5235-4bbc-9749-fe4caac09d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:41.462916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a27bd-5235-4bbc-9749-fe4caac09d1b admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:41.463878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a27bd-5235-4bbc-9749-fe4caac09d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:41.466472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a27bd-5235-4bbc-9749-fe4caac09d1b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:41.489032 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2376/4674] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:41 2021] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:41.494779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfae69-819d-48cf-9a6b-d19fe75280a3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:41.506084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfae69-819d-48cf-9a6b-d19fe75280a3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:41.510888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca3e43-1275-4946-8d8d-4e0c426f2d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:41.512325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca3e43-1275-4946-8d8d-4e0c426f2d46 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:41.512722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca3e43-1275-4946-8d8d-4e0c426f2d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:41.513030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca3e43-1275-4946-8d8d-4e0c426f2d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:41.514038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca3e43-1275-4946-8d8d-4e0c426f2d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:41.515785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca3e43-1275-4946-8d8d-4e0c426f2d46 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:41.530377 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2299/4675] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:41 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:41.531606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a27bd-5235-4bbc-9749-fe4caac09d1b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:41.541577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a27bd-5235-4bbc-9749-fe4caac09d1b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:41.547674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c2330-feba-4751-8637-2758db6f466d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:41.548480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c2330-feba-4751-8637-2758db6f466d admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:41.548769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c2330-feba-4751-8637-2758db6f466d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:41.549046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c2330-feba-4751-8637-2758db6f466d admin admin] PATH_INFO: `/v3/projects/c0397677ac364afe8883e086b8924dd7/users/cf8536affff840af9a7db3c6cc0c585e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:41.570294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c2330-feba-4751-8637-2758db6f466d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0397677ac364afe8883e086b8924dd7, user_id=cf8536affff840af9a7db3c6cc0c585e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:41.572522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c2330-feba-4751-8637-2758db6f466d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:41.590302 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2377/4676] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:41 2021] PUT /identity/v3/projects/c0397677ac364afe8883e086b8924dd7/users/cf8536affff840af9a7db3c6cc0c585e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:41.594730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca3e43-1275-4946-8d8d-4e0c426f2d46 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:41.605619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca3e43-1275-4946-8d8d-4e0c426f2d46 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:41.651378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c2330-feba-4751-8637-2758db6f466d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:41.653595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b26c2330-feba-4751-8637-2758db6f466d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:41.692498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b45479-c07d-45a7-90fc-b5d757a7d231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:41.693171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b45479-c07d-45a7-90fc-b5d757a7d231 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:41.693459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b45479-c07d-45a7-90fc-b5d757a7d231 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:41.693738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b45479-c07d-45a7-90fc-b5d757a7d231 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:41.694614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b45479-c07d-45a7-90fc-b5d757a7d231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:41.696292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b45479-c07d-45a7-90fc-b5d757a7d231 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:41.706558 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2300/4677] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:41 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:41.711285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b45479-c07d-45a7-90fc-b5d757a7d231 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:41.721442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b45479-c07d-45a7-90fc-b5d757a7d231 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:41.722852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c2330-feba-4751-8637-2758db6f466d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:41.726081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3445a12-6fc2-42ef-b922-755366a78c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:41.727005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3445a12-6fc2-42ef-b922-755366a78c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:41.727293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3445a12-6fc2-42ef-b922-755366a78c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:41.727394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d2948-b1f9-4673-948e-626f2ff78c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:41.727597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3445a12-6fc2-42ef-b922-755366a78c0a admin admin] PATH_INFO: `/v3/projects/c0397677ac364afe8883e086b8924dd7/users/cf8536affff840af9a7db3c6cc0c585e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:41.728252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d2948-b1f9-4673-948e-626f2ff78c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:41.728535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d2948-b1f9-4673-948e-626f2ff78c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:41.728812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d2948-b1f9-4673-948e-626f2ff78c04 admin admin] PATH_INFO: `/v3/projects/859f7973f65b49c7bfcab4de45b69114` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:41.729799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3445a12-6fc2-42ef-b922-755366a78c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0397677ac364afe8883e086b8924dd7, user_id=cf8536affff840af9a7db3c6cc0c585e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:41.730671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d2948-b1f9-4673-948e-626f2ff78c04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=859f7973f65b49c7bfcab4de45b69114)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:41.732549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d2948-b1f9-4673-948e-626f2ff78c04 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:41.733006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3445a12-6fc2-42ef-b922-755366a78c0a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:41.743904 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2301/4678] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:41 2021] PUT /identity/v3/projects/c0397677ac364afe8883e086b8924dd7/users/cf8536affff840af9a7db3c6cc0c585e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:41.755628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9b91e-b859-42e6-89bb-bd7c0b292a18 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:41.755923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9b91e-b859-42e6-89bb-bd7c0b292a18 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:41.756204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9b91e-b859-42e6-89bb-bd7c0b292a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:41.780064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-323d2948-b1f9-4673-948e-626f2ff78c04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859f7973f65b49c7bfcab4de45b69114', 'request_id': 'req-323d2948-b1f9-4673-948e-626f2ff78c04'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:41.783418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-12e9b91e-b859-42e6-89bb-bd7c0b292a18 None None] MFA Rules not processed for user `cf8536affff840af9a7db3c6cc0c585e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:41.785066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-12e9b91e-b859-42e6-89bb-bd7c0b292a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:41.786793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-323d2948-b1f9-4673-948e-626f2ff78c04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859f7973f65b49c7bfcab4de45b69114', 'request_id': 'req-323d2948-b1f9-4673-948e-626f2ff78c04'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:41.797594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-323d2948-b1f9-4673-948e-626f2ff78c04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859f7973f65b49c7bfcab4de45b69114', 'request_id': 'req-323d2948-b1f9-4673-948e-626f2ff78c04'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:41.809435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-323d2948-b1f9-4673-948e-626f2ff78c04 admin admin] The token cache is being invalidate because project 859f7973f65b49c7bfcab4de45b69114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:41.809799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-323d2948-b1f9-4673-948e-626f2ff78c04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:41.810969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-323d2948-b1f9-4673-948e-626f2ff78c04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:41.812318 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2378/4679] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:41 2021] DELETE /identity/v3/projects/859f7973f65b49c7bfcab4de45b69114 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:41.816090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d2948-b1f9-4673-948e-626f2ff78c04 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:41.818689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-323d2948-b1f9-4673-948e-626f2ff78c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:41.857986 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2302/4680] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:41 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:41.862503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9b91e-b859-42e6-89bb-bd7c0b292a18 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:41.872397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9b91e-b859-42e6-89bb-bd7c0b292a18 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:41.877193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ae148-1fa9-401f-880b-00a4a7bd1aab tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8536affff840af9a7db3c6cc0c585e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0397677ac364afe8883e086b8924dd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:41.877843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ae148-1fa9-401f-880b-00a4a7bd1aab tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:41.878132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ae148-1fa9-401f-880b-00a4a7bd1aab tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:41.878447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ae148-1fa9-401f-880b-00a4a7bd1aab tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:41.879193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ae148-1fa9-401f-880b-00a4a7bd1aab tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:41.880760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ae148-1fa9-401f-880b-00a4a7bd1aab tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:41.887947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d2948-b1f9-4673-948e-626f2ff78c04 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:41.892730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ac293-3d87-4f3e-b05e-2b741bfbbdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:41.893643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ac293-3d87-4f3e-b05e-2b741bfbbdab admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:41.893902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ac293-3d87-4f3e-b05e-2b741bfbbdab admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:41.894183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ac293-3d87-4f3e-b05e-2b741bfbbdab admin admin] PATH_INFO: `/v3/users/eeeb494e67d8444391a07cd800e2b4ce` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:41.898095 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2303/4681] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:01:41 2021] POST /identity/v3/domains => generated 276 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:41.898231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ac293-3d87-4f3e-b05e-2b741bfbbdab admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeeb494e67d8444391a07cd800e2b4ce)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:41.898231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ac293-3d87-4f3e-b05e-2b741bfbbdab admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:41.898878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ae148-1fa9-401f-880b-00a4a7bd1aab tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:41.950851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-085ac293-3d87-4f3e-b05e-2b741bfbbdab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeeb494e67d8444391a07cd800e2b4ce'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:41.958431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-085ac293-3d87-4f3e-b05e-2b741bfbbdab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeeb494e67d8444391a07cd800e2b4ce'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:41.959126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-085ac293-3d87-4f3e-b05e-2b741bfbbdab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeeb494e67d8444391a07cd800e2b4ce'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:41.961704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ae148-1fa9-401f-880b-00a4a7bd1aab tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:41.967177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105c01b-9ade-4e44-9d13-0acdc3d94266 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8536affff840af9a7db3c6cc0c585e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0397677ac364afe8883e086b8924dd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:41.967851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105c01b-9ade-4e44-9d13-0acdc3d94266 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:41.968143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105c01b-9ade-4e44-9d13-0acdc3d94266 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:41.968428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105c01b-9ade-4e44-9d13-0acdc3d94266 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:41.969135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105c01b-9ade-4e44-9d13-0acdc3d94266 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:41.971139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105c01b-9ade-4e44-9d13-0acdc3d94266 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:41.971811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-085ac293-3d87-4f3e-b05e-2b741bfbbdab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeeb494e67d8444391a07cd800e2b4ce'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:41.978967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-085ac293-3d87-4f3e-b05e-2b741bfbbdab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeeb494e67d8444391a07cd800e2b4ce'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:41.986164 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2379/4682] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:41 2021] DELETE /identity/v3/users/eeeb494e67d8444391a07cd800e2b4ce => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:42.001051 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2304/4683] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:41 2021] POST /identity/v3/users => generated 348 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:42.004919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ac293-3d87-4f3e-b05e-2b741bfbbdab admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:42.006402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-085ac293-3d87-4f3e-b05e-2b741bfbbdab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:42.073378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ac293-3d87-4f3e-b05e-2b741bfbbdab admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:42.078527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4583d2-5c1c-4d4a-9055-bc8a2b48c8a4 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8536affff840af9a7db3c6cc0c585e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0397677ac364afe8883e086b8924dd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:42.079194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4583d2-5c1c-4d4a-9055-bc8a2b48c8a4 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:42.079471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4583d2-5c1c-4d4a-9055-bc8a2b48c8a4 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:42.079767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4583d2-5c1c-4d4a-9055-bc8a2b48c8a4 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:42.080499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4583d2-5c1c-4d4a-9055-bc8a2b48c8a4 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:42.083220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4583d2-5c1c-4d4a-9055-bc8a2b48c8a4 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:42.109187 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2380/4684] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:42 2021] POST /identity/v3/users => generated 323 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:42.113665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105c01b-9ade-4e44-9d13-0acdc3d94266 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:42.123713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105c01b-9ade-4e44-9d13-0acdc3d94266 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:42.128915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd09c55-9506-41cd-8e5c-1de5e9d311ba tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8536affff840af9a7db3c6cc0c585e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0397677ac364afe8883e086b8924dd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:42.129779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09c55-9506-41cd-8e5c-1de5e9d311ba tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:42.130096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09c55-9506-41cd-8e5c-1de5e9d311ba tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:42.130383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09c55-9506-41cd-8e5c-1de5e9d311ba tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] PATH_INFO: `/v3/users/104e662fc445451783ef0d160d1bceec` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:42.145600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd09c55-9506-41cd-8e5c-1de5e9d311ba tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorizing `identity:get_user(user_id=104e662fc445451783ef0d160d1bceec)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:42.148312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd09c55-9506-41cd-8e5c-1de5e9d311ba tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:42.155338 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2305/4685] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 21:01:42 2021] GET /identity/v3/users/104e662fc445451783ef0d160d1bceec => generated 348 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:42.156979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4583d2-5c1c-4d4a-9055-bc8a2b48c8a4 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:42.170938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4583d2-5c1c-4d4a-9055-bc8a2b48c8a4 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:42.177684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48006c9-1b72-40b1-855b-01283fbc298b tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8536affff840af9a7db3c6cc0c585e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0397677ac364afe8883e086b8924dd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:42.178904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48006c9-1b72-40b1-855b-01283fbc298b tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:42.179394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48006c9-1b72-40b1-855b-01283fbc298b tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:42.179679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48006c9-1b72-40b1-855b-01283fbc298b tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:42.180502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48006c9-1b72-40b1-855b-01283fbc298b tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Adding query filter params (domain_id=ed4f08fdc57d4476a2f6a12779951314) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:01:42.180812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48006c9-1b72-40b1-855b-01283fbc298b tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:42.182879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48006c9-1b72-40b1-855b-01283fbc298b tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:42.198236 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2381/4686] 10.222.0.13 () {58 vars in 1206 bytes} [Sat Dec 18 21:01:42 2021] GET /identity/v3/users?domain_id=ed4f08fdc57d4476a2f6a12779951314 => generated 485 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:42.203323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd09c55-9506-41cd-8e5c-1de5e9d311ba tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:42.214044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd09c55-9506-41cd-8e5c-1de5e9d311ba tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:42.219334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c271d1a-1d19-4c8d-a1d4-ceeff8153523 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8536affff840af9a7db3c6cc0c585e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0397677ac364afe8883e086b8924dd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:42.220078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c271d1a-1d19-4c8d-a1d4-ceeff8153523 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:42.220372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c271d1a-1d19-4c8d-a1d4-ceeff8153523 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:42.220658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c271d1a-1d19-4c8d-a1d4-ceeff8153523 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:42.221425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c271d1a-1d19-4c8d-a1d4-ceeff8153523 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:42.223313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c271d1a-1d19-4c8d-a1d4-ceeff8153523 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:42.261948 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2306/4687] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:42 2021] GET /identity/v3/users => generated 8312 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:42.267346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48006c9-1b72-40b1-855b-01283fbc298b tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:42.279497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48006c9-1b72-40b1-855b-01283fbc298b tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:42.284666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093520d-de9f-4de9-bba3-f1a3aad585fd tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8536affff840af9a7db3c6cc0c585e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0397677ac364afe8883e086b8924dd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:42.285357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093520d-de9f-4de9-bba3-f1a3aad585fd tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:42.285639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093520d-de9f-4de9-bba3-f1a3aad585fd tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:42.285916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093520d-de9f-4de9-bba3-f1a3aad585fd tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:42.286774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093520d-de9f-4de9-bba3-f1a3aad585fd tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1705084999) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:01:42.287079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093520d-de9f-4de9-bba3-f1a3aad585fd tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:42.288906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093520d-de9f-4de9-bba3-f1a3aad585fd tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:42.307046 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2382/4688] 10.222.0.13 () {58 vars in 1188 bytes} [Sat Dec 18 21:01:42 2021] GET /identity/v3/users?name=tempest-test_user-1705084999 => generated 476 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:42.312170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c271d1a-1d19-4c8d-a1d4-ceeff8153523 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:42.326162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c271d1a-1d19-4c8d-a1d4-ceeff8153523 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:42.331606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff911c-b23a-4dab-aafb-4fa438fe0c5f tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8536affff840af9a7db3c6cc0c585e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0397677ac364afe8883e086b8924dd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:42.332469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff911c-b23a-4dab-aafb-4fa438fe0c5f tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:42.332864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff911c-b23a-4dab-aafb-4fa438fe0c5f tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:42.333278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff911c-b23a-4dab-aafb-4fa438fe0c5f tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:42.334391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff911c-b23a-4dab-aafb-4fa438fe0c5f tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:01:42.334813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff911c-b23a-4dab-aafb-4fa438fe0c5f tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:42.336866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff911c-b23a-4dab-aafb-4fa438fe0c5f tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:42.361022 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2307/4689] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Dec 18 21:01:42 2021] GET /identity/v3/users?enabled=False => generated 431 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:42.365197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093520d-de9f-4de9-bba3-f1a3aad585fd tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:42.365808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff911c-b23a-4dab-aafb-4fa438fe0c5f tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:42.368402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a093520d-de9f-4de9-bba3-f1a3aad585fd tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:42.376057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff911c-b23a-4dab-aafb-4fa438fe0c5f tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:42.381313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28e10f-fc7a-456b-a66a-3bf97022d4b9 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8536affff840af9a7db3c6cc0c585e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0397677ac364afe8883e086b8924dd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:42.382188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28e10f-fc7a-456b-a66a-3bf97022d4b9 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:42.382520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28e10f-fc7a-456b-a66a-3bf97022d4b9 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:42.383236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28e10f-fc7a-456b-a66a-3bf97022d4b9 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] PATH_INFO: `/v3/users/defe51c25a3b4c1186b07540987a6230` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:42.398577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28e10f-fc7a-456b-a66a-3bf97022d4b9 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorizing `identity:delete_user(user_id=defe51c25a3b4c1186b07540987a6230)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:42.401477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28e10f-fc7a-456b-a66a-3bf97022d4b9 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:42.459141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4f28e10f-fc7a-456b-a66a-3bf97022d4b9 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defe51c25a3b4c1186b07540987a6230'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.462093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093520d-de9f-4de9-bba3-f1a3aad585fd tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:42.468428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4f28e10f-fc7a-456b-a66a-3bf97022d4b9 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defe51c25a3b4c1186b07540987a6230'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.468920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c7113-8273-41d0-87fd-9bdfa15640c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:42.470469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c7113-8273-41d0-87fd-9bdfa15640c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:42.470763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c7113-8273-41d0-87fd-9bdfa15640c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:42.471048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c7113-8273-41d0-87fd-9bdfa15640c2 admin admin] PATH_INFO: `/v3/projects/93c96147c5a6417b956c1ba22d851925` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:42.472281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c7113-8273-41d0-87fd-9bdfa15640c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c96147c5a6417b956c1ba22d851925)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:42.474232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c7113-8273-41d0-87fd-9bdfa15640c2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:42.485125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4f28e10f-fc7a-456b-a66a-3bf97022d4b9 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defe51c25a3b4c1186b07540987a6230'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.485861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4f28e10f-fc7a-456b-a66a-3bf97022d4b9 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defe51c25a3b4c1186b07540987a6230'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.495657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4f28e10f-fc7a-456b-a66a-3bf97022d4b9 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defe51c25a3b4c1186b07540987a6230'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.503061 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2308/4690] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:42 2021] DELETE /identity/v3/users/defe51c25a3b4c1186b07540987a6230 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:42.506114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28e10f-fc7a-456b-a66a-3bf97022d4b9 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:42.506114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4f28e10f-fc7a-456b-a66a-3bf97022d4b9 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:42.521567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-452c7113-8273-41d0-87fd-9bdfa15640c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c96147c5a6417b956c1ba22d851925', 'request_id': 'req-452c7113-8273-41d0-87fd-9bdfa15640c2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.528150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-452c7113-8273-41d0-87fd-9bdfa15640c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c96147c5a6417b956c1ba22d851925', 'request_id': 'req-452c7113-8273-41d0-87fd-9bdfa15640c2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.538994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-452c7113-8273-41d0-87fd-9bdfa15640c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c96147c5a6417b956c1ba22d851925', 'request_id': 'req-452c7113-8273-41d0-87fd-9bdfa15640c2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.550444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-452c7113-8273-41d0-87fd-9bdfa15640c2 admin admin] The token cache is being invalidate because project 93c96147c5a6417b956c1ba22d851925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:42.550733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-452c7113-8273-41d0-87fd-9bdfa15640c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.551461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-452c7113-8273-41d0-87fd-9bdfa15640c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.553285 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2383/4691] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:42 2021] DELETE /identity/v3/projects/93c96147c5a6417b956c1ba22d851925 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:42.553874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c7113-8273-41d0-87fd-9bdfa15640c2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:42.555240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-452c7113-8273-41d0-87fd-9bdfa15640c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:42.564593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28e10f-fc7a-456b-a66a-3bf97022d4b9 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:42.613042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc028647-6466-40bd-be3a-85cee2690872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:42.613695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc028647-6466-40bd-be3a-85cee2690872 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:42.613980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc028647-6466-40bd-be3a-85cee2690872 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:42.614279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc028647-6466-40bd-be3a-85cee2690872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:42.616128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fc028647-6466-40bd-be3a-85cee2690872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:42.621335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c7113-8273-41d0-87fd-9bdfa15640c2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:42.627320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0f624-ccbd-4e09-aae8-974fa7652d60 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8536affff840af9a7db3c6cc0c585e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0397677ac364afe8883e086b8924dd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:42.628520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0f624-ccbd-4e09-aae8-974fa7652d60 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:42.628988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0f624-ccbd-4e09-aae8-974fa7652d60 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:42.629382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0f624-ccbd-4e09-aae8-974fa7652d60 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] PATH_INFO: `/v3/users/104e662fc445451783ef0d160d1bceec` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:42.630943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0f624-ccbd-4e09-aae8-974fa7652d60 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorizing `identity:delete_user(user_id=104e662fc445451783ef0d160d1bceec)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:42.633001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0f624-ccbd-4e09-aae8-974fa7652d60 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:42.677078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cde0f624-ccbd-4e09-aae8-974fa7652d60 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '104e662fc445451783ef0d160d1bceec'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.683994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cde0f624-ccbd-4e09-aae8-974fa7652d60 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '104e662fc445451783ef0d160d1bceec'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.685034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cde0f624-ccbd-4e09-aae8-974fa7652d60 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '104e662fc445451783ef0d160d1bceec'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.691189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc028647-6466-40bd-be3a-85cee2690872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:42.693023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc028647-6466-40bd-be3a-85cee2690872 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:42.699278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cde0f624-ccbd-4e09-aae8-974fa7652d60 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '104e662fc445451783ef0d160d1bceec'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.705281 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2309/4692] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:42 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:01:42.708115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cde0f624-ccbd-4e09-aae8-974fa7652d60 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '104e662fc445451783ef0d160d1bceec'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.709047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128ffdf-4ed7-4719-bbb0-67b1e4b25b83 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:42.709648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128ffdf-4ed7-4719-bbb0-67b1e4b25b83 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:42.710230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128ffdf-4ed7-4719-bbb0-67b1e4b25b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:42.716929 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2384/4693] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:42 2021] DELETE /identity/v3/users/104e662fc445451783ef0d160d1bceec => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:42.724592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0f624-ccbd-4e09-aae8-974fa7652d60 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:42.727551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cde0f624-ccbd-4e09-aae8-974fa7652d60 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:42.733060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c128ffdf-4ed7-4719-bbb0-67b1e4b25b83 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:42.734291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c128ffdf-4ed7-4719-bbb0-67b1e4b25b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:42.799087 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2310/4694] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:42.804616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0f624-ccbd-4e09-aae8-974fa7652d60 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:42.807582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63248800-0e91-41c1-b199-6d7c683bfcc0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:42.807823 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63248800-0e91-41c1-b199-6d7c683bfcc0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:42.808671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63248800-0e91-41c1-b199-6d7c683bfcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:42.810444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705062c4-f05e-4438-b205-7dd1977d5ab1 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8536affff840af9a7db3c6cc0c585e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0397677ac364afe8883e086b8924dd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:42.811517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705062c4-f05e-4438-b205-7dd1977d5ab1 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:42.811965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705062c4-f05e-4438-b205-7dd1977d5ab1 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:42.812538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705062c4-f05e-4438-b205-7dd1977d5ab1 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] PATH_INFO: `/v3/domains/ed4f08fdc57d4476a2f6a12779951314` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:42.814384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705062c4-f05e-4438-b205-7dd1977d5ab1 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ed4f08fdc57d4476a2f6a12779951314)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:42.815831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705062c4-f05e-4438-b205-7dd1977d5ab1 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:42.837075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-705062c4-f05e-4438-b205-7dd1977d5ab1 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ed4f08fdc57d4476a2f6a12779951314'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.837791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-705062c4-f05e-4438-b205-7dd1977d5ab1 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ed4f08fdc57d4476a2f6a12779951314'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.837939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-63248800-0e91-41c1-b199-6d7c683bfcc0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:42.839172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-63248800-0e91-41c1-b199-6d7c683bfcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:42.865951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-705062c4-f05e-4438-b205-7dd1977d5ab1 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ed4f08fdc57d4476a2f6a12779951314'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.866590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-705062c4-f05e-4438-b205-7dd1977d5ab1 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ed4f08fdc57d4476a2f6a12779951314'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.876173 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2385/4695] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:01:42 2021] PATCH /identity/v3/domains/ed4f08fdc57d4476a2f6a12779951314 => generated 277 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:42.879843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705062c4-f05e-4438-b205-7dd1977d5ab1 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:42.881315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-705062c4-f05e-4438-b205-7dd1977d5ab1 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:42.919326 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2311/4696] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:42.924045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63248800-0e91-41c1-b199-6d7c683bfcc0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:42.936218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63248800-0e91-41c1-b199-6d7c683bfcc0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:42.941011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e69a89-d4eb-41a9-bb34-0c98ad45e5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:42.941926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e69a89-d4eb-41a9-bb34-0c98ad45e5ae admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:42.942214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e69a89-d4eb-41a9-bb34-0c98ad45e5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:42.942598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e69a89-d4eb-41a9-bb34-0c98ad45e5ae admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:42.943337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e69a89-d4eb-41a9-bb34-0c98ad45e5ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:01:42.943652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e69a89-d4eb-41a9-bb34-0c98ad45e5ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:42.945237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e69a89-d4eb-41a9-bb34-0c98ad45e5ae admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:42.946044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705062c4-f05e-4438-b205-7dd1977d5ab1 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:42.951523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf8536affff840af9a7db3c6cc0c585e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0397677ac364afe8883e086b8924dd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:42.952396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:42.952664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:42.952941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] PATH_INFO: `/v3/domains/ed4f08fdc57d4476a2f6a12779951314` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:42.957831 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2312/4697] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:01:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:42.962184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e69a89-d4eb-41a9-bb34-0c98ad45e5ae admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:42.964109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ed4f08fdc57d4476a2f6a12779951314)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:42.965756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:42.971943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e69a89-d4eb-41a9-bb34-0c98ad45e5ae admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:42.976867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69e624-adaf-41fa-95cf-bc09ee0b07c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:42.977501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e624-adaf-41fa-95cf-bc09ee0b07c9 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:42.977785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e624-adaf-41fa-95cf-bc09ee0b07c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:42.978061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e624-adaf-41fa-95cf-bc09ee0b07c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:42.978791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69e624-adaf-41fa-95cf-bc09ee0b07c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:42.980697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69e624-adaf-41fa-95cf-bc09ee0b07c9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:42.987850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ed4f08fdc57d4476a2f6a12779951314'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:42.991095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ed4f08fdc57d4476a2f6a12779951314'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:43.010299 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2313/4698] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:42 2021] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:43.011941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69e624-adaf-41fa-95cf-bc09ee0b07c9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:43.037920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed4f08fdc57d4476a2f6a12779951314', 'request_id': 'req-d5adb61c-d9ad-42e6-9fca-a761ebf25821'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:43.044790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed4f08fdc57d4476a2f6a12779951314', 'request_id': 'req-d5adb61c-d9ad-42e6-9fca-a761ebf25821'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:43.052835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed4f08fdc57d4476a2f6a12779951314', 'request_id': 'req-d5adb61c-d9ad-42e6-9fca-a761ebf25821'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:43.063799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] The token cache is being invalidate because project ed4f08fdc57d4476a2f6a12779951314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:43.064226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:43.064999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:43.072520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ed4f08fdc57d4476a2f6a12779951314', 'request_id': 'req-d5adb61c-d9ad-42e6-9fca-a761ebf25821'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:43.072671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69e624-adaf-41fa-95cf-bc09ee0b07c9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:43.076461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ed4f08fdc57d4476a2f6a12779951314', 'request_id': 'req-d5adb61c-d9ad-42e6-9fca-a761ebf25821'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:43.077388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ed4f08fdc57d4476a2f6a12779951314', 'request_id': 'req-d5adb61c-d9ad-42e6-9fca-a761ebf25821'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:43.083661 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2386/4699] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:01:42 2021] DELETE /identity/v3/domains/ed4f08fdc57d4476a2f6a12779951314 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:43.087348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:43.089326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:43.137817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948410-5410-40a4-b5e4-640dc0feb261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:43.138533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948410-5410-40a4-b5e4-640dc0feb261 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:43.138824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948410-5410-40a4-b5e4-640dc0feb261 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:43.139107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948410-5410-40a4-b5e4-640dc0feb261 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:43.139822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee948410-5410-40a4-b5e4-640dc0feb261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:43.141728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee948410-5410-40a4-b5e4-640dc0feb261 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:43.157041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adb61c-d9ad-42e6-9fca-a761ebf25821 tempest-UsersV3TestJSON-1861060313 tempest-UsersV3TestJSON-1861060313-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:43.163065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61e695-fa81-411f-9d98-e93cca4379af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:43.164058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61e695-fa81-411f-9d98-e93cca4379af admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:43.164396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61e695-fa81-411f-9d98-e93cca4379af admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:43.164688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61e695-fa81-411f-9d98-e93cca4379af admin admin] PATH_INFO: `/v3/users/39071a4300ca43e9995369c47dd63d02` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:43.165337 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2314/4700] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:43 2021] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:43.166350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61e695-fa81-411f-9d98-e93cca4379af admin admin] RBAC: Authorizing `identity:delete_user(user_id=39071a4300ca43e9995369c47dd63d02)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:43.169690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61e695-fa81-411f-9d98-e93cca4379af admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:43.170381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948410-5410-40a4-b5e4-640dc0feb261 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:43.174626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ee948410-5410-40a4-b5e4-640dc0feb261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:43.189540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948410-5410-40a4-b5e4-640dc0feb261 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:43.196479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd53cf0-a376-49f3-904c-c50215326aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:43.197436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd53cf0-a376-49f3-904c-c50215326aef admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:43.198543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd53cf0-a376-49f3-904c-c50215326aef admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:43.198789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd53cf0-a376-49f3-904c-c50215326aef admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:43.199671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd53cf0-a376-49f3-904c-c50215326aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:43.203006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd53cf0-a376-49f3-904c-c50215326aef admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:43.219138 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2315/4701] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:43 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:43.222920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd53cf0-a376-49f3-904c-c50215326aef admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:43.233794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd53cf0-a376-49f3-904c-c50215326aef admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:43.238845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040c48b-4409-4d5e-8049-4b00489105f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:43.239616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040c48b-4409-4d5e-8049-4b00489105f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:43.239980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040c48b-4409-4d5e-8049-4b00489105f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:43.240327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040c48b-4409-4d5e-8049-4b00489105f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:43.240629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb61e695-fa81-411f-9d98-e93cca4379af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39071a4300ca43e9995369c47dd63d02'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:43.241229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040c48b-4409-4d5e-8049-4b00489105f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:43.242978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040c48b-4409-4d5e-8049-4b00489105f7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:43.248528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb61e695-fa81-411f-9d98-e93cca4379af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39071a4300ca43e9995369c47dd63d02'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:43.250296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb61e695-fa81-411f-9d98-e93cca4379af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39071a4300ca43e9995369c47dd63d02'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:43.257449 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2316/4702] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:43 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:43.258960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040c48b-4409-4d5e-8049-4b00489105f7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:43.267768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb61e695-fa81-411f-9d98-e93cca4379af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39071a4300ca43e9995369c47dd63d02'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:43.269452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040c48b-4409-4d5e-8049-4b00489105f7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:43.275247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a844058-0d59-4178-a0ee-154ec93cd8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:43.276219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb61e695-fa81-411f-9d98-e93cca4379af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39071a4300ca43e9995369c47dd63d02'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:43.276456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a844058-0d59-4178-a0ee-154ec93cd8ad admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:43.276730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a844058-0d59-4178-a0ee-154ec93cd8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:43.278633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a844058-0d59-4178-a0ee-154ec93cd8ad admin admin] PATH_INFO: `/v3/projects/e0fb352cf6524c5ca929ff4c5404b6a0/users/306e225c8be6473495a5c12c83c0c349/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:43.287750 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2387/4703] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:43 2021] DELETE /identity/v3/users/39071a4300ca43e9995369c47dd63d02 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:43.292222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6f1fa-4b6c-451b-b8db-d1ca65298f84 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:43.293052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6f1fa-4b6c-451b-b8db-d1ca65298f84 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:43.293332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6f1fa-4b6c-451b-b8db-d1ca65298f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:43.299842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a844058-0d59-4178-a0ee-154ec93cd8ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fb352cf6524c5ca929ff4c5404b6a0, user_id=306e225c8be6473495a5c12c83c0c349, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:43.302684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a844058-0d59-4178-a0ee-154ec93cd8ad admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:43.312668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-38a6f1fa-4b6c-451b-b8db-d1ca65298f84 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:43.313968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-38a6f1fa-4b6c-451b-b8db-d1ca65298f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:43.318218 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2317/4704] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:43 2021] PUT /identity/v3/projects/e0fb352cf6524c5ca929ff4c5404b6a0/users/306e225c8be6473495a5c12c83c0c349/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:43.328077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622292e-e70e-4e21-a3b1-13c0ca640d83 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:43.328369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622292e-e70e-4e21-a3b1-13c0ca640d83 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:43.328653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622292e-e70e-4e21-a3b1-13c0ca640d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:43.354129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b622292e-e70e-4e21-a3b1-13c0ca640d83 None None] MFA Rules not processed for user `306e225c8be6473495a5c12c83c0c349`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:43.356227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b622292e-e70e-4e21-a3b1-13c0ca640d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:43.377969 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2388/4705] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:43.388481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6f1fa-4b6c-451b-b8db-d1ca65298f84 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:43.390689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-38a6f1fa-4b6c-451b-b8db-d1ca65298f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:43.426519 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2318/4706] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:43 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:43.431468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622292e-e70e-4e21-a3b1-13c0ca640d83 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:43.435021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b622292e-e70e-4e21-a3b1-13c0ca640d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:43.461781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622292e-e70e-4e21-a3b1-13c0ca640d83 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:43.469559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7783e5-4ad9-45c5-86df-1cb1ff918388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:43.471219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7783e5-4ad9-45c5-86df-1cb1ff918388 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:43.471735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7783e5-4ad9-45c5-86df-1cb1ff918388 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:43.472439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7783e5-4ad9-45c5-86df-1cb1ff918388 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:43.473874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7783e5-4ad9-45c5-86df-1cb1ff918388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:43.476670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7783e5-4ad9-45c5-86df-1cb1ff918388 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:43.500395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6f1fa-4b6c-451b-b8db-d1ca65298f84 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:43.504988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292abe67-0433-48fe-ba08-11d3e2df2543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:43.505791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292abe67-0433-48fe-ba08-11d3e2df2543 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:43.506081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292abe67-0433-48fe-ba08-11d3e2df2543 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:43.506406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292abe67-0433-48fe-ba08-11d3e2df2543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:43.518836 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2319/4707] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:43 2021] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:43.522647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7783e5-4ad9-45c5-86df-1cb1ff918388 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:43.524940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292abe67-0433-48fe-ba08-11d3e2df2543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:43.527812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292abe67-0433-48fe-ba08-11d3e2df2543 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:43.540674 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2389/4708] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:01:43.605916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7783e5-4ad9-45c5-86df-1cb1ff918388 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:43.611903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a639d-9b71-4642-b283-7796c88dd20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:43.612866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a639d-9b71-4642-b283-7796c88dd20d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:43.613162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a639d-9b71-4642-b283-7796c88dd20d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:43.613449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a639d-9b71-4642-b283-7796c88dd20d admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:43.614602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a639d-9b71-4642-b283-7796c88dd20d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:43.616668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a639d-9b71-4642-b283-7796c88dd20d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:43.641195 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2320/4709] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:43 2021] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:43.645000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292abe67-0433-48fe-ba08-11d3e2df2543 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:43.659974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292abe67-0433-48fe-ba08-11d3e2df2543 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:43.666799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82411c15-5ef3-4005-8b6b-5a29fd25e046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:43.668323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82411c15-5ef3-4005-8b6b-5a29fd25e046 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:43.668627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82411c15-5ef3-4005-8b6b-5a29fd25e046 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:43.668909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82411c15-5ef3-4005-8b6b-5a29fd25e046 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:43.669828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82411c15-5ef3-4005-8b6b-5a29fd25e046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:43.671926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82411c15-5ef3-4005-8b6b-5a29fd25e046 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:43.682741 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2390/4710] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:43 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:43.687939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a639d-9b71-4642-b283-7796c88dd20d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:43.701506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a639d-9b71-4642-b283-7796c88dd20d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:43.708244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01ce5f-f94b-4d5c-94df-9fa1bed6ebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:43.709485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01ce5f-f94b-4d5c-94df-9fa1bed6ebb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:43.715738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01ce5f-f94b-4d5c-94df-9fa1bed6ebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:43.715738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01ce5f-f94b-4d5c-94df-9fa1bed6ebb0 admin admin] PATH_INFO: `/v3/projects/eaab154506794aefae91e487b1f57cd1/users/ca3624b1232841b4b8ff3bf62528e079/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:43.728462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01ce5f-f94b-4d5c-94df-9fa1bed6ebb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaab154506794aefae91e487b1f57cd1, user_id=ca3624b1232841b4b8ff3bf62528e079, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:43.731841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01ce5f-f94b-4d5c-94df-9fa1bed6ebb0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:43.751263 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2321/4711] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:43 2021] PUT /identity/v3/projects/eaab154506794aefae91e487b1f57cd1/users/ca3624b1232841b4b8ff3bf62528e079/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:43.756399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82411c15-5ef3-4005-8b6b-5a29fd25e046 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:43.770354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82411c15-5ef3-4005-8b6b-5a29fd25e046 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:43.864039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c39ae1-1f09-4a80-9309-98eb1556a4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:43.865012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c39ae1-1f09-4a80-9309-98eb1556a4ce admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:43.865302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c39ae1-1f09-4a80-9309-98eb1556a4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:43.865589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c39ae1-1f09-4a80-9309-98eb1556a4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:43.866374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c39ae1-1f09-4a80-9309-98eb1556a4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:43.868000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c39ae1-1f09-4a80-9309-98eb1556a4ce admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:43.880364 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2391/4712] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:43 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:43.885223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01ce5f-f94b-4d5c-94df-9fa1bed6ebb0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:43.902721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01ce5f-f94b-4d5c-94df-9fa1bed6ebb0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:43.913586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db29dfb-0d97-42df-8efc-5d8ea496a2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:43.914607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db29dfb-0d97-42df-8efc-5d8ea496a2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:43.915032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db29dfb-0d97-42df-8efc-5d8ea496a2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:43.916620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db29dfb-0d97-42df-8efc-5d8ea496a2a0 admin admin] PATH_INFO: `/v3/projects/eaab154506794aefae91e487b1f57cd1/users/ca3624b1232841b4b8ff3bf62528e079/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:43.922469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db29dfb-0d97-42df-8efc-5d8ea496a2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaab154506794aefae91e487b1f57cd1, user_id=ca3624b1232841b4b8ff3bf62528e079, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:43.925918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db29dfb-0d97-42df-8efc-5d8ea496a2a0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:43.949533 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2322/4713] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:43 2021] PUT /identity/v3/projects/eaab154506794aefae91e487b1f57cd1/users/ca3624b1232841b4b8ff3bf62528e079/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:43.951041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaacd98-19a6-4aa9-b011-259c928bc1db None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:43.951254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaacd98-19a6-4aa9-b011-259c928bc1db None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:43.951696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaacd98-19a6-4aa9-b011-259c928bc1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:44.007388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bfaacd98-19a6-4aa9-b011-259c928bc1db None None] MFA Rules not processed for user `ca3624b1232841b4b8ff3bf62528e079`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:44.009276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bfaacd98-19a6-4aa9-b011-259c928bc1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:44.030929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db29dfb-0d97-42df-8efc-5d8ea496a2a0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:44.033329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1db29dfb-0d97-42df-8efc-5d8ea496a2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:44.135601 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2392/4714] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:43 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:44.137013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db29dfb-0d97-42df-8efc-5d8ea496a2a0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:44.140363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaacd98-19a6-4aa9-b011-259c928bc1db None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:44.143066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:44.144134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:44.144604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:44.145055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e admin admin] PATH_INFO: `/v3/projects/992c062a8c0e48d78fb111728e459292` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:44.146298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e admin admin] RBAC: Authorizing `identity:delete_project(project_id=992c062a8c0e48d78fb111728e459292)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:44.148185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:44.150910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaacd98-19a6-4aa9-b011-259c928bc1db None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:44.157002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1701c7-92aa-4b6b-b768-379f6aaf1b83 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca3624b1232841b4b8ff3bf62528e079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaab154506794aefae91e487b1f57cd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:44.157745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1701c7-92aa-4b6b-b768-379f6aaf1b83 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:44.158117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1701c7-92aa-4b6b-b768-379f6aaf1b83 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:44.158506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1701c7-92aa-4b6b-b768-379f6aaf1b83 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:44.159515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1701c7-92aa-4b6b-b768-379f6aaf1b83 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:44.160667 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-7f1701c7-92aa-4b6b-b768-379f6aaf1b83 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:44.160667 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:44.160667 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:44.161822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1701c7-92aa-4b6b-b768-379f6aaf1b83 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:44.180154 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2393/4715] 10.222.0.13 () {60 vars in 1184 bytes} [Sat Dec 18 21:01:44 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:44.184696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1701c7-92aa-4b6b-b768-379f6aaf1b83 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:44.195367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1701c7-92aa-4b6b-b768-379f6aaf1b83 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:44.203096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '992c062a8c0e48d78fb111728e459292', 'request_id': 'req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.209376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '992c062a8c0e48d78fb111728e459292', 'request_id': 'req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.216072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '992c062a8c0e48d78fb111728e459292', 'request_id': 'req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.233122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e admin admin] The token cache is being invalidate because project 992c062a8c0e48d78fb111728e459292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:44.233505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.234410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.241731 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2323/4716] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:44 2021] DELETE /identity/v3/projects/992c062a8c0e48d78fb111728e459292 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:44.243022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:44.245443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:44.256231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f00dd9-f2bf-4658-a038-f8b45239a987 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca3624b1232841b4b8ff3bf62528e079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaab154506794aefae91e487b1f57cd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:44.257191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f00dd9-f2bf-4658-a038-f8b45239a987 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:44.257385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f00dd9-f2bf-4658-a038-f8b45239a987 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:44.257670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f00dd9-f2bf-4658-a038-f8b45239a987 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/91a91922be174765a965cbbc631aa977` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:44.258372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f00dd9-f2bf-4658-a038-f8b45239a987 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=91a91922be174765a965cbbc631aa977)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:44.259429 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-47f00dd9-f2bf-4658-a038-f8b45239a987 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:44.259429 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:44.259429 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:44.260312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f00dd9-f2bf-4658-a038-f8b45239a987 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:44.266952 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2394/4717] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 21:01:44 2021] GET /identity/v3/OS-OAUTH1/consumers/91a91922be174765a965cbbc631aa977 => generated 220 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:44.270808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f00dd9-f2bf-4658-a038-f8b45239a987 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:44.272574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-47f00dd9-f2bf-4658-a038-f8b45239a987 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:44.286048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f00dd9-f2bf-4658-a038-f8b45239a987 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:44.291769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffba460-3e91-4d86-b2a4-902ae9635755 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca3624b1232841b4b8ff3bf62528e079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaab154506794aefae91e487b1f57cd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:44.293317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffba460-3e91-4d86-b2a4-902ae9635755 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:44.293613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffba460-3e91-4d86-b2a4-902ae9635755 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:44.293925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffba460-3e91-4d86-b2a4-902ae9635755 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/91a91922be174765a965cbbc631aa977` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:44.294940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffba460-3e91-4d86-b2a4-902ae9635755 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=91a91922be174765a965cbbc631aa977)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:44.295654 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-8ffba460-3e91-4d86-b2a4-902ae9635755 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:44.295654 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:44.295654 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:44.296576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffba460-3e91-4d86-b2a4-902ae9635755 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:44.296844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8ffba460-3e91-4d86-b2a4-902ae9635755 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invalidating token cache because consumer 91a91922be174765a965cbbc631aa977 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:44.297124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8ffba460-3e91-4d86-b2a4-902ae9635755 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.298222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8ffba460-3e91-4d86-b2a4-902ae9635755 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.319682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8ffba460-3e91-4d86-b2a4-902ae9635755 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '91a91922be174765a965cbbc631aa977', 'request_id': 'req-8ffba460-3e91-4d86-b2a4-902ae9635755'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.338860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e3300-d07d-4cdb-bfd4-15077a4f323e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:44.340747 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2395/4718] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 21:01:44 2021] DELETE /identity/v3/OS-OAUTH1/consumers/91a91922be174765a965cbbc631aa977 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:44.345551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffba460-3e91-4d86-b2a4-902ae9635755 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:44.347034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8ffba460-3e91-4d86-b2a4-902ae9635755 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:44.349021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c042cda-9dbd-487a-aa7c-f98433d848d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:44.350615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c042cda-9dbd-487a-aa7c-f98433d848d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:44.351151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c042cda-9dbd-487a-aa7c-f98433d848d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:44.351931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c042cda-9dbd-487a-aa7c-f98433d848d3 admin admin] PATH_INFO: `/v3/users/cf8536affff840af9a7db3c6cc0c585e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:44.353576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c042cda-9dbd-487a-aa7c-f98433d848d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8536affff840af9a7db3c6cc0c585e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:44.357023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c042cda-9dbd-487a-aa7c-f98433d848d3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:44.363591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffba460-3e91-4d86-b2a4-902ae9635755 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:44.368534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e033e-5c9d-442c-bcc5-9e7d80029ee0 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca3624b1232841b4b8ff3bf62528e079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaab154506794aefae91e487b1f57cd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:44.369508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e033e-5c9d-442c-bcc5-9e7d80029ee0 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:44.369508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e033e-5c9d-442c-bcc5-9e7d80029ee0 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:44.369851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e033e-5c9d-442c-bcc5-9e7d80029ee0 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:44.370932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e033e-5c9d-442c-bcc5-9e7d80029ee0 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:44.372560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e033e-5c9d-442c-bcc5-9e7d80029ee0 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:44.391998 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2396/4719] 10.222.0.13 () {60 vars in 1184 bytes} [Sat Dec 18 21:01:44 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:44.396447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e033e-5c9d-442c-bcc5-9e7d80029ee0 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:44.409616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e033e-5c9d-442c-bcc5-9e7d80029ee0 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:44.414969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ddf4e-bf70-47bf-9718-c344803929a1 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca3624b1232841b4b8ff3bf62528e079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaab154506794aefae91e487b1f57cd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:44.416067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ddf4e-bf70-47bf-9718-c344803929a1 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:44.416359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ddf4e-bf70-47bf-9718-c344803929a1 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:44.416634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ddf4e-bf70-47bf-9718-c344803929a1 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/502aadb3148e44809f9a3dbe5f00450a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:44.417967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ddf4e-bf70-47bf-9718-c344803929a1 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=502aadb3148e44809f9a3dbe5f00450a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:44.419728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ddf4e-bf70-47bf-9718-c344803929a1 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:44.421869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0c042cda-9dbd-487a-aa7c-f98433d848d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8536affff840af9a7db3c6cc0c585e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.425170 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2397/4720] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 21:01:44 2021] GET /identity/v3/OS-OAUTH1/consumers/502aadb3148e44809f9a3dbe5f00450a => generated 220 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:44.428993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ddf4e-bf70-47bf-9718-c344803929a1 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:44.431294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0c042cda-9dbd-487a-aa7c-f98433d848d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8536affff840af9a7db3c6cc0c585e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.439284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ddf4e-bf70-47bf-9718-c344803929a1 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:44.444615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e0cb3-e3ed-4f71-b1a5-01e688035640 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca3624b1232841b4b8ff3bf62528e079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaab154506794aefae91e487b1f57cd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:44.445422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e0cb3-e3ed-4f71-b1a5-01e688035640 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:44.445699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e0cb3-e3ed-4f71-b1a5-01e688035640 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:44.445923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0c042cda-9dbd-487a-aa7c-f98433d848d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8536affff840af9a7db3c6cc0c585e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.446025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e0cb3-e3ed-4f71-b1a5-01e688035640 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/502aadb3148e44809f9a3dbe5f00450a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:44.447011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0c042cda-9dbd-487a-aa7c-f98433d848d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8536affff840af9a7db3c6cc0c585e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.447139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e0cb3-e3ed-4f71-b1a5-01e688035640 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=502aadb3148e44809f9a3dbe5f00450a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:44.448573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e0cb3-e3ed-4f71-b1a5-01e688035640 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:44.448867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bd4e0cb3-e3ed-4f71-b1a5-01e688035640 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invalidating token cache because consumer 502aadb3148e44809f9a3dbe5f00450a has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:44.449142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bd4e0cb3-e3ed-4f71-b1a5-01e688035640 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.449796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bd4e0cb3-e3ed-4f71-b1a5-01e688035640 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.456058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0c042cda-9dbd-487a-aa7c-f98433d848d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8536affff840af9a7db3c6cc0c585e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.465490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bd4e0cb3-e3ed-4f71-b1a5-01e688035640 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '502aadb3148e44809f9a3dbe5f00450a', 'request_id': 'req-bd4e0cb3-e3ed-4f71-b1a5-01e688035640'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.470693 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2324/4721] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:44 2021] DELETE /identity/v3/users/cf8536affff840af9a7db3c6cc0c585e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:44.515146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c042cda-9dbd-487a-aa7c-f98433d848d3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:44.516846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0c042cda-9dbd-487a-aa7c-f98433d848d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:44.518477 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2398/4722] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 21:01:44 2021] DELETE /identity/v3/OS-OAUTH1/consumers/502aadb3148e44809f9a3dbe5f00450a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:44.607486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c042cda-9dbd-487a-aa7c-f98433d848d3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:44.612636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f81556-d02a-4fe1-99c6-493913bafdfb tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca3624b1232841b4b8ff3bf62528e079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaab154506794aefae91e487b1f57cd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:44.613484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f81556-d02a-4fe1-99c6-493913bafdfb tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:44.613774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f81556-d02a-4fe1-99c6-493913bafdfb tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:44.614057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f81556-d02a-4fe1-99c6-493913bafdfb tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/502aadb3148e44809f9a3dbe5f00450a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:44.614783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f81556-d02a-4fe1-99c6-493913bafdfb tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=502aadb3148e44809f9a3dbe5f00450a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:44.616305 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-99f81556-d02a-4fe1-99c6-493913bafdfb tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:44.616305 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:44.616305 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:44.617208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f81556-d02a-4fe1-99c6-493913bafdfb tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:44.631796 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-99f81556-d02a-4fe1-99c6-493913bafdfb tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Dec 18 21:01:44.636572 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2325/4723] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 21:01:44 2021] GET /identity/v3/OS-OAUTH1/consumers/502aadb3148e44809f9a3dbe5f00450a => generated 74 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 21:01:44.639310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e0cb3-e3ed-4f71-b1a5-01e688035640 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:44.642643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bd4e0cb3-e3ed-4f71-b1a5-01e688035640 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:44.657183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e0cb3-e3ed-4f71-b1a5-01e688035640 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:44.663469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9908e-8fd9-4829-8114-b6867790025d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca3624b1232841b4b8ff3bf62528e079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaab154506794aefae91e487b1f57cd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:44.664013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9908e-8fd9-4829-8114-b6867790025d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:44.664442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9908e-8fd9-4829-8114-b6867790025d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:44.664833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9908e-8fd9-4829-8114-b6867790025d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/502aadb3148e44809f9a3dbe5f00450a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:44.665610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9908e-8fd9-4829-8114-b6867790025d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=502aadb3148e44809f9a3dbe5f00450a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:44.667461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9908e-8fd9-4829-8114-b6867790025d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:44.667823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dff9908e-8fd9-4829-8114-b6867790025d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invalidating token cache because consumer 502aadb3148e44809f9a3dbe5f00450a has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:44.668198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dff9908e-8fd9-4829-8114-b6867790025d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.669331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dff9908e-8fd9-4829-8114-b6867790025d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.686714 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-dff9908e-8fd9-4829-8114-b6867790025d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Dec 18 21:01:44.688054 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2399/4724] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 21:01:44 2021] DELETE /identity/v3/OS-OAUTH1/consumers/502aadb3148e44809f9a3dbe5f00450a => generated 74 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 21:01:44.695329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f81556-d02a-4fe1-99c6-493913bafdfb tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:44.697220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-99f81556-d02a-4fe1-99c6-493913bafdfb tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:44.722387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f81556-d02a-4fe1-99c6-493913bafdfb tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:44.728633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f398a5-c83b-4e06-ad85-ad5bf32642d6 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca3624b1232841b4b8ff3bf62528e079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaab154506794aefae91e487b1f57cd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:44.730197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f398a5-c83b-4e06-ad85-ad5bf32642d6 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:44.730680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f398a5-c83b-4e06-ad85-ad5bf32642d6 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:44.731137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f398a5-c83b-4e06-ad85-ad5bf32642d6 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:44.732096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f398a5-c83b-4e06-ad85-ad5bf32642d6 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:44.733482 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-31f398a5-c83b-4e06-ad85-ad5bf32642d6 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:44.733482 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:44.733482 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:44.734767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f398a5-c83b-4e06-ad85-ad5bf32642d6 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:44.758229 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2326/4725] 10.222.0.13 () {60 vars in 1184 bytes} [Sat Dec 18 21:01:44 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:44.762969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9908e-8fd9-4829-8114-b6867790025d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:44.780308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9908e-8fd9-4829-8114-b6867790025d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:44.792640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e2d2f-3499-49c1-8ad6-dd2694158317 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca3624b1232841b4b8ff3bf62528e079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaab154506794aefae91e487b1f57cd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:44.793434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e2d2f-3499-49c1-8ad6-dd2694158317 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:44.793823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e2d2f-3499-49c1-8ad6-dd2694158317 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:44.793989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e2d2f-3499-49c1-8ad6-dd2694158317 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:44.796174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e2d2f-3499-49c1-8ad6-dd2694158317 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:44.800447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e2d2f-3499-49c1-8ad6-dd2694158317 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:44.829331 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2400/4726] 10.222.0.13 () {60 vars in 1184 bytes} [Sat Dec 18 21:01:44 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:44.841490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f398a5-c83b-4e06-ad85-ad5bf32642d6 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:44.857153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f398a5-c83b-4e06-ad85-ad5bf32642d6 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:44.865263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8654197-232d-4154-ba2d-5fdf065a7b92 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca3624b1232841b4b8ff3bf62528e079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaab154506794aefae91e487b1f57cd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:44.866341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8654197-232d-4154-ba2d-5fdf065a7b92 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:44.866678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8654197-232d-4154-ba2d-5fdf065a7b92 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:44.867011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8654197-232d-4154-ba2d-5fdf065a7b92 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:44.867678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8654197-232d-4154-ba2d-5fdf065a7b92 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:44.869022 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-c8654197-232d-4154-ba2d-5fdf065a7b92 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:44.869022 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:44.869022 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:44.870881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8654197-232d-4154-ba2d-5fdf065a7b92 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:44.884853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e2d2f-3499-49c1-8ad6-dd2694158317 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:44.885969 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2327/4727] 10.222.0.13 () {58 vars in 1163 bytes} [Sat Dec 18 21:01:44 2021] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:44.896968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e2d2f-3499-49c1-8ad6-dd2694158317 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:44.903009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb1ad3-023e-4716-a1a2-f90caa7976ec tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca3624b1232841b4b8ff3bf62528e079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaab154506794aefae91e487b1f57cd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:44.905015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb1ad3-023e-4716-a1a2-f90caa7976ec tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:44.905146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb1ad3-023e-4716-a1a2-f90caa7976ec tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:44.905373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb1ad3-023e-4716-a1a2-f90caa7976ec tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/03328ca3a0fc45a9924a8df4c1d121ad` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:44.906408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb1ad3-023e-4716-a1a2-f90caa7976ec tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=03328ca3a0fc45a9924a8df4c1d121ad)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:44.908318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb1ad3-023e-4716-a1a2-f90caa7976ec tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:44.908318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1deb1ad3-023e-4716-a1a2-f90caa7976ec tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invalidating token cache because consumer 03328ca3a0fc45a9924a8df4c1d121ad has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:44.908623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1deb1ad3-023e-4716-a1a2-f90caa7976ec tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.909468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1deb1ad3-023e-4716-a1a2-f90caa7976ec tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.925876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1deb1ad3-023e-4716-a1a2-f90caa7976ec tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '03328ca3a0fc45a9924a8df4c1d121ad', 'request_id': 'req-1deb1ad3-023e-4716-a1a2-f90caa7976ec'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:44.963662 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2401/4728] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 21:01:44 2021] DELETE /identity/v3/OS-OAUTH1/consumers/03328ca3a0fc45a9924a8df4c1d121ad => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:44.965977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8654197-232d-4154-ba2d-5fdf065a7b92 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:44.973898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c8654197-232d-4154-ba2d-5fdf065a7b92 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:45.005776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8654197-232d-4154-ba2d-5fdf065a7b92 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:45.014165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97673f-670b-4970-9d04-b665fdd7eae9 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca3624b1232841b4b8ff3bf62528e079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaab154506794aefae91e487b1f57cd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:45.015056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97673f-670b-4970-9d04-b665fdd7eae9 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:45.015349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97673f-670b-4970-9d04-b665fdd7eae9 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:45.015632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97673f-670b-4970-9d04-b665fdd7eae9 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4dee18b9c1674ad6a1cf231510c76936` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:45.016314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97673f-670b-4970-9d04-b665fdd7eae9 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=4dee18b9c1674ad6a1cf231510c76936)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:45.017393 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-6e97673f-670b-4970-9d04-b665fdd7eae9 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:45.017393 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:45.017393 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:45.018368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97673f-670b-4970-9d04-b665fdd7eae9 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:45.018638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6e97673f-670b-4970-9d04-b665fdd7eae9 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invalidating token cache because consumer 4dee18b9c1674ad6a1cf231510c76936 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:45.018919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6e97673f-670b-4970-9d04-b665fdd7eae9 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:45.019622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6e97673f-670b-4970-9d04-b665fdd7eae9 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:45.045529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6e97673f-670b-4970-9d04-b665fdd7eae9 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '4dee18b9c1674ad6a1cf231510c76936', 'request_id': 'req-6e97673f-670b-4970-9d04-b665fdd7eae9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:45.077667 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2328/4729] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 21:01:44 2021] DELETE /identity/v3/OS-OAUTH1/consumers/4dee18b9c1674ad6a1cf231510c76936 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:45.084867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb1ad3-023e-4716-a1a2-f90caa7976ec tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:45.098167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb1ad3-023e-4716-a1a2-f90caa7976ec tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:45.103410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8227176-d4dc-4651-9251-925d7153c9d0 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca3624b1232841b4b8ff3bf62528e079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaab154506794aefae91e487b1f57cd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:45.107242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8227176-d4dc-4651-9251-925d7153c9d0 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:45.107691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8227176-d4dc-4651-9251-925d7153c9d0 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:45.108512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8227176-d4dc-4651-9251-925d7153c9d0 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:45.109331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8227176-d4dc-4651-9251-925d7153c9d0 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:45.111632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8227176-d4dc-4651-9251-925d7153c9d0 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:45.130079 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2402/4730] 10.222.0.13 () {60 vars in 1184 bytes} [Sat Dec 18 21:01:45 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:45.133841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97673f-670b-4970-9d04-b665fdd7eae9 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:45.138070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6e97673f-670b-4970-9d04-b665fdd7eae9 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:45.171835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97673f-670b-4970-9d04-b665fdd7eae9 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:45.175588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8227176-d4dc-4651-9251-925d7153c9d0 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:45.177385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f8227176-d4dc-4651-9251-925d7153c9d0 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:45.193498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5aa088-9a9d-49b0-b695-f8febbc6a86d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca3624b1232841b4b8ff3bf62528e079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaab154506794aefae91e487b1f57cd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:45.194386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5aa088-9a9d-49b0-b695-f8febbc6a86d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:45.194672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5aa088-9a9d-49b0-b695-f8febbc6a86d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:45.194952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5aa088-9a9d-49b0-b695-f8febbc6a86d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/76e064df6eea42a39b563e2343d1d5d9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:45.195706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5aa088-9a9d-49b0-b695-f8febbc6a86d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=76e064df6eea42a39b563e2343d1d5d9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:45.196721 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-6f5aa088-9a9d-49b0-b695-f8febbc6a86d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:45.196721 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:45.196721 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:45.197607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5aa088-9a9d-49b0-b695-f8febbc6a86d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:45.230779 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2329/4731] 10.222.0.13 () {60 vars in 1284 bytes} [Sat Dec 18 21:01:45 2021] PATCH /identity/v3/OS-OAUTH1/consumers/76e064df6eea42a39b563e2343d1d5d9 => generated 221 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:45.232832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5aa088-9a9d-49b0-b695-f8febbc6a86d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:45.253566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5aa088-9a9d-49b0-b695-f8febbc6a86d tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:45.264519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528b14a-1f53-4920-ac46-7784fad3801a tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca3624b1232841b4b8ff3bf62528e079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaab154506794aefae91e487b1f57cd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:45.265322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b14a-1f53-4920-ac46-7784fad3801a tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:45.265612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b14a-1f53-4920-ac46-7784fad3801a tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:45.265900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b14a-1f53-4920-ac46-7784fad3801a tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/76e064df6eea42a39b563e2343d1d5d9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:45.268975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528b14a-1f53-4920-ac46-7784fad3801a tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=76e064df6eea42a39b563e2343d1d5d9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:45.275618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528b14a-1f53-4920-ac46-7784fad3801a tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:45.296003 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2330/4732] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 21:01:45 2021] GET /identity/v3/OS-OAUTH1/consumers/76e064df6eea42a39b563e2343d1d5d9 => generated 221 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:45.297604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528b14a-1f53-4920-ac46-7784fad3801a tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:45.317102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528b14a-1f53-4920-ac46-7784fad3801a tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:45.339031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474baaa4-97b3-4f59-84f9-dcc86c8582c3 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca3624b1232841b4b8ff3bf62528e079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaab154506794aefae91e487b1f57cd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:45.342826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474baaa4-97b3-4f59-84f9-dcc86c8582c3 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:45.345724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474baaa4-97b3-4f59-84f9-dcc86c8582c3 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:45.345724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474baaa4-97b3-4f59-84f9-dcc86c8582c3 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/76e064df6eea42a39b563e2343d1d5d9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:45.352767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474baaa4-97b3-4f59-84f9-dcc86c8582c3 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=76e064df6eea42a39b563e2343d1d5d9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:45.354338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474baaa4-97b3-4f59-84f9-dcc86c8582c3 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:45.354617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-474baaa4-97b3-4f59-84f9-dcc86c8582c3 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invalidating token cache because consumer 76e064df6eea42a39b563e2343d1d5d9 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:45.355002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-474baaa4-97b3-4f59-84f9-dcc86c8582c3 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:45.360087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8227176-d4dc-4651-9251-925d7153c9d0 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:45.361492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-474baaa4-97b3-4f59-84f9-dcc86c8582c3 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:45.365337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a2c51-abb2-4238-b7ff-17522fbabf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:45.366219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a2c51-abb2-4238-b7ff-17522fbabf7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:45.366597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a2c51-abb2-4238-b7ff-17522fbabf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:45.366887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a2c51-abb2-4238-b7ff-17522fbabf7c admin admin] PATH_INFO: `/v3/projects/c0397677ac364afe8883e086b8924dd7` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:45.368269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a2c51-abb2-4238-b7ff-17522fbabf7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0397677ac364afe8883e086b8924dd7)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:45.370200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a2c51-abb2-4238-b7ff-17522fbabf7c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:45.394118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-474baaa4-97b3-4f59-84f9-dcc86c8582c3 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '76e064df6eea42a39b563e2343d1d5d9', 'request_id': 'req-474baaa4-97b3-4f59-84f9-dcc86c8582c3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:45.427597 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2331/4733] 10.222.0.13 () {58 vars in 1265 bytes} [Sat Dec 18 21:01:45 2021] DELETE /identity/v3/OS-OAUTH1/consumers/76e064df6eea42a39b563e2343d1d5d9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:45.433484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474baaa4-97b3-4f59-84f9-dcc86c8582c3 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:45.436652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-474baaa4-97b3-4f59-84f9-dcc86c8582c3 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:45.457178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6f1a2c51-abb2-4238-b7ff-17522fbabf7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0397677ac364afe8883e086b8924dd7', 'request_id': 'req-6f1a2c51-abb2-4238-b7ff-17522fbabf7c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:45.468323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6f1a2c51-abb2-4238-b7ff-17522fbabf7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0397677ac364afe8883e086b8924dd7', 'request_id': 'req-6f1a2c51-abb2-4238-b7ff-17522fbabf7c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:45.470834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474baaa4-97b3-4f59-84f9-dcc86c8582c3 tempest-OAUTHConsumersV3Test-868056667 tempest-OAUTHConsumersV3Test-868056667-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:45.484820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6f1a2c51-abb2-4238-b7ff-17522fbabf7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0397677ac364afe8883e086b8924dd7', 'request_id': 'req-6f1a2c51-abb2-4238-b7ff-17522fbabf7c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:45.509055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6f1a2c51-abb2-4238-b7ff-17522fbabf7c admin admin] The token cache is being invalidate because project c0397677ac364afe8883e086b8924dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:45.509674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6f1a2c51-abb2-4238-b7ff-17522fbabf7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:45.510745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6f1a2c51-abb2-4238-b7ff-17522fbabf7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:45.513433 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2403/4734] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:45 2021] DELETE /identity/v3/projects/c0397677ac364afe8883e086b8924dd7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:45.520457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1b669-ee99-4c8f-9dc2-1b69845a4cd8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:45.521124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1b669-ee99-4c8f-9dc2-1b69845a4cd8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:45.522016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1b669-ee99-4c8f-9dc2-1b69845a4cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:45.549713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-94c1b669-ee99-4c8f-9dc2-1b69845a4cd8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:45.552639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-94c1b669-ee99-4c8f-9dc2-1b69845a4cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:45.594398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40571d-ba53-4b39-acf1-e4c911f8dba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:45.595852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40571d-ba53-4b39-acf1-e4c911f8dba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:45.596560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40571d-ba53-4b39-acf1-e4c911f8dba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:45.597776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40571d-ba53-4b39-acf1-e4c911f8dba6 admin admin] PATH_INFO: `/v3/users/306e225c8be6473495a5c12c83c0c349` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:45.603230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40571d-ba53-4b39-acf1-e4c911f8dba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=306e225c8be6473495a5c12c83c0c349)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:45.606373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40571d-ba53-4b39-acf1-e4c911f8dba6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:45.651506 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2404/4735] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:45.660358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa1b3c-61e8-4ada-b26f-225e862c313a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:45.660358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa1b3c-61e8-4ada-b26f-225e862c313a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:45.660675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa1b3c-61e8-4ada-b26f-225e862c313a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:45.663848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3d40571d-ba53-4b39-acf1-e4c911f8dba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '306e225c8be6473495a5c12c83c0c349'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:45.671200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3d40571d-ba53-4b39-acf1-e4c911f8dba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '306e225c8be6473495a5c12c83c0c349'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:45.681992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b4aa1b3c-61e8-4ada-b26f-225e862c313a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:45.683236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3d40571d-ba53-4b39-acf1-e4c911f8dba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '306e225c8be6473495a5c12c83c0c349'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:45.683387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b4aa1b3c-61e8-4ada-b26f-225e862c313a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:45.684581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3d40571d-ba53-4b39-acf1-e4c911f8dba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '306e225c8be6473495a5c12c83c0c349'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:45.693601 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2405/4736] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:45.698006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3d40571d-ba53-4b39-acf1-e4c911f8dba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '306e225c8be6473495a5c12c83c0c349'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:45.698408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa1b3c-61e8-4ada-b26f-225e862c313a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:45.708790 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2332/4737] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:45 2021] DELETE /identity/v3/users/306e225c8be6473495a5c12c83c0c349 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:45.710317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcabc4-5a5e-4ec7-9291-51db250ac146 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:45.710623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcabc4-5a5e-4ec7-9291-51db250ac146 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:45.710908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcabc4-5a5e-4ec7-9291-51db250ac146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:45.719340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa1b3c-61e8-4ada-b26f-225e862c313a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:45.731217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-73fcabc4-5a5e-4ec7-9291-51db250ac146 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:45.733327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-73fcabc4-5a5e-4ec7-9291-51db250ac146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:45.786168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d722e06-6cd1-437a-a6ba-0a89abe0be97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:45.786890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d722e06-6cd1-437a-a6ba-0a89abe0be97 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:45.787173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d722e06-6cd1-437a-a6ba-0a89abe0be97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:45.787453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d722e06-6cd1-437a-a6ba-0a89abe0be97 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:45.788190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d722e06-6cd1-437a-a6ba-0a89abe0be97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:01:45.788503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d722e06-6cd1-437a-a6ba-0a89abe0be97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:45.790355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d722e06-6cd1-437a-a6ba-0a89abe0be97 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:45.807558 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2333/4738] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:45.818664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcabc4-5a5e-4ec7-9291-51db250ac146 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:45.819438 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2406/4739] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:01:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:45.824194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d722e06-6cd1-437a-a6ba-0a89abe0be97 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:45.824626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-73fcabc4-5a5e-4ec7-9291-51db250ac146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:45.825991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2d722e06-6cd1-437a-a6ba-0a89abe0be97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:45.842386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d722e06-6cd1-437a-a6ba-0a89abe0be97 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:45.849281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600b152-479b-4f46-976a-dfeb85db086f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:45.849684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b152-479b-4f46-976a-dfeb85db086f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:45.850067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b152-479b-4f46-976a-dfeb85db086f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:45.850482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b152-479b-4f46-976a-dfeb85db086f admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:45.851641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600b152-479b-4f46-976a-dfeb85db086f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:45.853818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600b152-479b-4f46-976a-dfeb85db086f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:45.897322 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2407/4740] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:45 2021] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:45.901003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcabc4-5a5e-4ec7-9291-51db250ac146 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:45.902853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600b152-479b-4f46-976a-dfeb85db086f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:45.996900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670e91f-1563-47d0-a958-643f466aa0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:45.997923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670e91f-1563-47d0-a958-643f466aa0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:45.998237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600b152-479b-4f46-976a-dfeb85db086f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:45.998401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670e91f-1563-47d0-a958-643f466aa0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:45.998593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670e91f-1563-47d0-a958-643f466aa0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:46.004698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29d4f6-493a-448a-823e-cc1542679fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:46.006211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29d4f6-493a-448a-823e-cc1542679fca admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:46.006629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29d4f6-493a-448a-823e-cc1542679fca admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:46.007021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29d4f6-493a-448a-823e-cc1542679fca admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:46.007955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29d4f6-493a-448a-823e-cc1542679fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:46.009963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670e91f-1563-47d0-a958-643f466aa0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:46.010861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29d4f6-493a-448a-823e-cc1542679fca admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:46.012408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670e91f-1563-47d0-a958-643f466aa0f9 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:46.025191 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2334/4741] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:01:46.026076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670e91f-1563-47d0-a958-643f466aa0f9 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:46.028301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a670e91f-1563-47d0-a958-643f466aa0f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:46.046533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670e91f-1563-47d0-a958-643f466aa0f9 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:46.059302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d7345-a974-47be-b8b3-98ad1ef11b59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:46.060058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d7345-a974-47be-b8b3-98ad1ef11b59 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:46.060600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d7345-a974-47be-b8b3-98ad1ef11b59 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:46.061069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d7345-a974-47be-b8b3-98ad1ef11b59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:46.063877 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2408/4742] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:45 2021] POST /identity/v3/users => generated 284 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:46.069320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-095d7345-a974-47be-b8b3-98ad1ef11b59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:46.069965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29d4f6-493a-448a-823e-cc1542679fca admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:46.082855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d7345-a974-47be-b8b3-98ad1ef11b59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:46.085037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d7345-a974-47be-b8b3-98ad1ef11b59 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:46.088931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29d4f6-493a-448a-823e-cc1542679fca admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:46.094318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc89ff2-2983-4c01-80bb-6eb97e949ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:46.096278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc89ff2-2983-4c01-80bb-6eb97e949ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:46.096747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc89ff2-2983-4c01-80bb-6eb97e949ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:46.097195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc89ff2-2983-4c01-80bb-6eb97e949ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:46.098342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc89ff2-2983-4c01-80bb-6eb97e949ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:46.098575 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2335/4743] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:46 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:01:46.101187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc89ff2-2983-4c01-80bb-6eb97e949ab1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:46.123618 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2409/4744] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:46 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:46.124245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d7345-a974-47be-b8b3-98ad1ef11b59 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:46.140061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d7345-a974-47be-b8b3-98ad1ef11b59 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:46.145649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd1492-e189-440c-8895-062f54df1f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:46.146627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd1492-e189-440c-8895-062f54df1f4b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:46.146911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd1492-e189-440c-8895-062f54df1f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:46.147329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd1492-e189-440c-8895-062f54df1f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:46.148126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd1492-e189-440c-8895-062f54df1f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:46.150774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd1492-e189-440c-8895-062f54df1f4b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:46.193790 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2336/4745] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:46 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:46.197602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc89ff2-2983-4c01-80bb-6eb97e949ab1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:46.211542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc89ff2-2983-4c01-80bb-6eb97e949ab1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:46.218077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a2ef7-f2e4-4de2-bad3-66ca17e76dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:46.219145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a2ef7-f2e4-4de2-bad3-66ca17e76dac admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:46.219540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a2ef7-f2e4-4de2-bad3-66ca17e76dac admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:46.220195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a2ef7-f2e4-4de2-bad3-66ca17e76dac admin admin] PATH_INFO: `/v3/projects/4ed6d8a0a8ef4f17b75bf74191f1d287/users/3cb923664aee460b89b273556187e636/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:46.263871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a2ef7-f2e4-4de2-bad3-66ca17e76dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ed6d8a0a8ef4f17b75bf74191f1d287, user_id=3cb923664aee460b89b273556187e636, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:46.267337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a2ef7-f2e4-4de2-bad3-66ca17e76dac admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:46.296158 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2410/4746] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:46 2021] PUT /identity/v3/projects/4ed6d8a0a8ef4f17b75bf74191f1d287/users/3cb923664aee460b89b273556187e636/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:46.298224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b00c2a-16ca-478f-8a26-5234f7b094be None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:46.298932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b00c2a-16ca-478f-8a26-5234f7b094be None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:46.299344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b00c2a-16ca-478f-8a26-5234f7b094be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:46.346604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-67b00c2a-16ca-478f-8a26-5234f7b094be None None] MFA Rules not processed for user `3cb923664aee460b89b273556187e636`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:46.349162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-67b00c2a-16ca-478f-8a26-5234f7b094be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:46.444812 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2337/4747] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:46 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:46.449155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a2ef7-f2e4-4de2-bad3-66ca17e76dac admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:46.522576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a2ef7-f2e4-4de2-bad3-66ca17e76dac admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:46.528998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89e65b-5222-4e69-8f9e-17d87cd344c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:46.529809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89e65b-5222-4e69-8f9e-17d87cd344c0 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:46.530200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89e65b-5222-4e69-8f9e-17d87cd344c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:46.530606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89e65b-5222-4e69-8f9e-17d87cd344c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:46.531412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89e65b-5222-4e69-8f9e-17d87cd344c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:46.533499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89e65b-5222-4e69-8f9e-17d87cd344c0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:46.586556 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2411/4748] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:46 2021] POST /identity/v3/projects => generated 369 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:46.591339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b00c2a-16ca-478f-8a26-5234f7b094be None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:46.604302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b00c2a-16ca-478f-8a26-5234f7b094be None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:46.640498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89e65b-5222-4e69-8f9e-17d87cd344c0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:46.642308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cb89e65b-5222-4e69-8f9e-17d87cd344c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:46.721135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bddffd-2274-4f1c-a496-03db7b3cdefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:46.721844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bddffd-2274-4f1c-a496-03db7b3cdefc admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:46.722135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bddffd-2274-4f1c-a496-03db7b3cdefc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:46.722874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bddffd-2274-4f1c-a496-03db7b3cdefc admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:46.723211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bddffd-2274-4f1c-a496-03db7b3cdefc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:46.725152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bddffd-2274-4f1c-a496-03db7b3cdefc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:46.753837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89e65b-5222-4e69-8f9e-17d87cd344c0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:46.760220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:46.763906 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2338/4749] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:46 2021] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:46.765438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:46.765577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bddffd-2274-4f1c-a496-03db7b3cdefc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:46.766286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:46.766735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6 admin admin] PATH_INFO: `/v3/projects/e0fb352cf6524c5ca929ff4c5404b6a0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:46.768671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0fb352cf6524c5ca929ff4c5404b6a0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:46.770748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:46.790211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bddffd-2274-4f1c-a496-03db7b3cdefc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:46.798811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870496f-d130-4abf-90f4-a23987ac9049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:46.799725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870496f-d130-4abf-90f4-a23987ac9049 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:46.800211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870496f-d130-4abf-90f4-a23987ac9049 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:46.800497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870496f-d130-4abf-90f4-a23987ac9049 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:46.801241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870496f-d130-4abf-90f4-a23987ac9049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:46.802990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870496f-d130-4abf-90f4-a23987ac9049 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:46.818442 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2339/4750] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:46 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:46.820883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870496f-d130-4abf-90f4-a23987ac9049 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:46.834150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fb352cf6524c5ca929ff4c5404b6a0', 'request_id': 'req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:46.834399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870496f-d130-4abf-90f4-a23987ac9049 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:46.841696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fb352cf6524c5ca929ff4c5404b6a0', 'request_id': 'req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:46.851675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fb352cf6524c5ca929ff4c5404b6a0', 'request_id': 'req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:46.868656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6 admin admin] The token cache is being invalidate because project e0fb352cf6524c5ca929ff4c5404b6a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:46.869085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:46.870004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:46.875020 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2412/4751] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:46 2021] DELETE /identity/v3/projects/e0fb352cf6524c5ca929ff4c5404b6a0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:46.876842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:46.878521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:46.906159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a562c2-7da7-4533-b630-bf849625b180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:46.907271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a562c2-7da7-4533-b630-bf849625b180 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:46.907868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a562c2-7da7-4533-b630-bf849625b180 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:46.908190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a562c2-7da7-4533-b630-bf849625b180 admin admin] PATH_INFO: `/v3/projects/f2f88e9c5edc469f8d6066b60c5d2c10/users/adfa3fac9e29423f87e699dc419d2318/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:46.924710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a562c2-7da7-4533-b630-bf849625b180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f88e9c5edc469f8d6066b60c5d2c10, user_id=adfa3fac9e29423f87e699dc419d2318, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:46.927752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a562c2-7da7-4533-b630-bf849625b180 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:46.945420 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2340/4752] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:46 2021] PUT /identity/v3/projects/f2f88e9c5edc469f8d6066b60c5d2c10/users/adfa3fac9e29423f87e699dc419d2318/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:46.950006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a562c2-7da7-4533-b630-bf849625b180 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:46.951093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698dc37-cc7e-4e6b-b4af-5e1b2fbdd7a6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:46.951774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f9a562c2-7da7-4533-b630-bf849625b180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:47.014182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f27f3a-07ff-4a70-81fb-83cc789a87a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:47.015096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f27f3a-07ff-4a70-81fb-83cc789a87a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:47.015384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f27f3a-07ff-4a70-81fb-83cc789a87a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:47.015667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f27f3a-07ff-4a70-81fb-83cc789a87a3 admin admin] PATH_INFO: `/v3/users/ca3624b1232841b4b8ff3bf62528e079` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:47.016961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f27f3a-07ff-4a70-81fb-83cc789a87a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca3624b1232841b4b8ff3bf62528e079)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:47.018303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a562c2-7da7-4533-b630-bf849625b180 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:47.018939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f27f3a-07ff-4a70-81fb-83cc789a87a3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:47.023220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054884e6-beb1-404e-ba0d-d7ae22bad967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:47.023952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054884e6-beb1-404e-ba0d-d7ae22bad967 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:47.024325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054884e6-beb1-404e-ba0d-d7ae22bad967 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:47.024784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054884e6-beb1-404e-ba0d-d7ae22bad967 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:47.025611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054884e6-beb1-404e-ba0d-d7ae22bad967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:47.028038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054884e6-beb1-404e-ba0d-d7ae22bad967 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:47.042568 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2341/4753] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:46 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:47.046948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054884e6-beb1-404e-ba0d-d7ae22bad967 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:47.057293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054884e6-beb1-404e-ba0d-d7ae22bad967 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:47.062505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25530538-f88a-4f0c-a9b4-299a5d2afa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:47.063321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25530538-f88a-4f0c-a9b4-299a5d2afa85 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:47.063728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25530538-f88a-4f0c-a9b4-299a5d2afa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:47.064197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25530538-f88a-4f0c-a9b4-299a5d2afa85 admin admin] PATH_INFO: `/v3/projects/f2f88e9c5edc469f8d6066b60c5d2c10/users/adfa3fac9e29423f87e699dc419d2318/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:47.066680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25530538-f88a-4f0c-a9b4-299a5d2afa85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f88e9c5edc469f8d6066b60c5d2c10, user_id=adfa3fac9e29423f87e699dc419d2318, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:47.069515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25530538-f88a-4f0c-a9b4-299a5d2afa85 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:47.075907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-56f27f3a-07ff-4a70-81fb-83cc789a87a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca3624b1232841b4b8ff3bf62528e079'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:47.080561 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2342/4754] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:47 2021] PUT /identity/v3/projects/f2f88e9c5edc469f8d6066b60c5d2c10/users/adfa3fac9e29423f87e699dc419d2318/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:47.084088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-56f27f3a-07ff-4a70-81fb-83cc789a87a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca3624b1232841b4b8ff3bf62528e079'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:47.084977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-56f27f3a-07ff-4a70-81fb-83cc789a87a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca3624b1232841b4b8ff3bf62528e079'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:47.092132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ef21a-fa62-4633-9d1c-660b67035d05 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:47.092627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ef21a-fa62-4633-9d1c-660b67035d05 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:47.093044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ef21a-fa62-4633-9d1c-660b67035d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:47.098389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-56f27f3a-07ff-4a70-81fb-83cc789a87a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca3624b1232841b4b8ff3bf62528e079'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:47.107390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-56f27f3a-07ff-4a70-81fb-83cc789a87a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca3624b1232841b4b8ff3bf62528e079'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:47.122517 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2413/4755] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:46 2021] DELETE /identity/v3/users/ca3624b1232841b4b8ff3bf62528e079 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:47.124862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7c4ef21a-fa62-4633-9d1c-660b67035d05 None None] MFA Rules not processed for user `adfa3fac9e29423f87e699dc419d2318`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:47.126647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7c4ef21a-fa62-4633-9d1c-660b67035d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:47.221786 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2343/4756] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:47 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:47.222878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f27f3a-07ff-4a70-81fb-83cc789a87a3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:47.238585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f27f3a-07ff-4a70-81fb-83cc789a87a3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:47.255270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadb0ff-014a-4c8d-bf56-7085c1cdcb13 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfa3fac9e29423f87e699dc419d2318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f88e9c5edc469f8d6066b60c5d2c10', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:47.256578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadb0ff-014a-4c8d-bf56-7085c1cdcb13 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:47.257030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadb0ff-014a-4c8d-bf56-7085c1cdcb13 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:47.257531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadb0ff-014a-4c8d-bf56-7085c1cdcb13 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] PATH_INFO: `/v3/policies` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:47.259553 ncdv-master-1 devstack@keystone.service[96646]: WARNING oslo_log.versionutils [None req-edadb0ff-014a-4c8d-bf56-7085c1cdcb13 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Dec 18 21:01:47.260564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadb0ff-014a-4c8d-bf56-7085c1cdcb13 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:47.264527 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-edadb0ff-014a-4c8d-bf56-7085c1cdcb13 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:47.264527 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:47.264527 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:47.266282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadb0ff-014a-4c8d-bf56-7085c1cdcb13 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:47.308424 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2414/4757] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:01:47 2021] POST /identity/v3/policies => generated 230 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:47.310224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ef21a-fa62-4633-9d1c-660b67035d05 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:47.326378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ef21a-fa62-4633-9d1c-660b67035d05 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:47.333683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9ff00-f4c4-43f4-b7e8-bc929a2d893b tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfa3fac9e29423f87e699dc419d2318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f88e9c5edc469f8d6066b60c5d2c10', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:47.334623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9ff00-f4c4-43f4-b7e8-bc929a2d893b tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:47.334945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9ff00-f4c4-43f4-b7e8-bc929a2d893b tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:47.335259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9ff00-f4c4-43f4-b7e8-bc929a2d893b tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] PATH_INFO: `/v3/policies/bcb7be57f8574301874782dc6a70b61a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:47.336883 ncdv-master-1 devstack@keystone.service[96645]: WARNING oslo_log.versionutils [None req-bbd9ff00-f4c4-43f4-b7e8-bc929a2d893b tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Dec 18 21:01:47.337434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9ff00-f4c4-43f4-b7e8-bc929a2d893b tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=bcb7be57f8574301874782dc6a70b61a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:47.338748 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-bbd9ff00-f4c4-43f4-b7e8-bc929a2d893b tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:47.338748 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:47.338748 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:47.339852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9ff00-f4c4-43f4-b7e8-bc929a2d893b tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:47.384064 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2344/4758] 10.222.0.13 () {60 vars in 1251 bytes} [Sat Dec 18 21:01:47 2021] PATCH /identity/v3/policies/bcb7be57f8574301874782dc6a70b61a => generated 237 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:47.388782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadb0ff-014a-4c8d-bf56-7085c1cdcb13 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:47.405200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadb0ff-014a-4c8d-bf56-7085c1cdcb13 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:47.419070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72acb6-831f-4499-af07-b9acff3b2923 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfa3fac9e29423f87e699dc419d2318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f88e9c5edc469f8d6066b60c5d2c10', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:47.420013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72acb6-831f-4499-af07-b9acff3b2923 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:47.420414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72acb6-831f-4499-af07-b9acff3b2923 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:47.420958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72acb6-831f-4499-af07-b9acff3b2923 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] PATH_INFO: `/v3/policies/bcb7be57f8574301874782dc6a70b61a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:47.422038 ncdv-master-1 devstack@keystone.service[96646]: WARNING oslo_log.versionutils [None req-5b72acb6-831f-4499-af07-b9acff3b2923 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Dec 18 21:01:47.424690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72acb6-831f-4499-af07-b9acff3b2923 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=bcb7be57f8574301874782dc6a70b61a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:47.426943 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-5b72acb6-831f-4499-af07-b9acff3b2923 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:47.426943 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:47.426943 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:47.432098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72acb6-831f-4499-af07-b9acff3b2923 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:47.450657 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2415/4759] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:01:47 2021] GET /identity/v3/policies/bcb7be57f8574301874782dc6a70b61a => generated 237 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:47.456076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9ff00-f4c4-43f4-b7e8-bc929a2d893b tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:47.467614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9ff00-f4c4-43f4-b7e8-bc929a2d893b tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:47.473230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cfd3f-ff78-46a4-b912-ed9ff8094a9a tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfa3fac9e29423f87e699dc419d2318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f88e9c5edc469f8d6066b60c5d2c10', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:47.474094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cfd3f-ff78-46a4-b912-ed9ff8094a9a tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:47.475013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cfd3f-ff78-46a4-b912-ed9ff8094a9a tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:47.475013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cfd3f-ff78-46a4-b912-ed9ff8094a9a tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] PATH_INFO: `/v3/policies/bcb7be57f8574301874782dc6a70b61a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:47.475796 ncdv-master-1 devstack@keystone.service[96645]: WARNING oslo_log.versionutils [None req-139cfd3f-ff78-46a4-b912-ed9ff8094a9a tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Dec 18 21:01:47.476623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cfd3f-ff78-46a4-b912-ed9ff8094a9a tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=bcb7be57f8574301874782dc6a70b61a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:47.477868 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-139cfd3f-ff78-46a4-b912-ed9ff8094a9a tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:47.477868 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:47.477868 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:47.479097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cfd3f-ff78-46a4-b912-ed9ff8094a9a tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:47.508954 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2345/4760] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:47 2021] DELETE /identity/v3/policies/bcb7be57f8574301874782dc6a70b61a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:47.514571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72acb6-831f-4499-af07-b9acff3b2923 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:47.528588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72acb6-831f-4499-af07-b9acff3b2923 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:47.533392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2e761-ff4c-4f6c-9551-1d6fb9de4f19 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfa3fac9e29423f87e699dc419d2318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f88e9c5edc469f8d6066b60c5d2c10', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:47.534047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2e761-ff4c-4f6c-9551-1d6fb9de4f19 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:47.534366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2e761-ff4c-4f6c-9551-1d6fb9de4f19 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:47.534652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2e761-ff4c-4f6c-9551-1d6fb9de4f19 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] PATH_INFO: `/v3/policies` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:47.536885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2e761-ff4c-4f6c-9551-1d6fb9de4f19 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:47.539901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2e761-ff4c-4f6c-9551-1d6fb9de4f19 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:47.560457 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2416/4761] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:01:47 2021] POST /identity/v3/policies => generated 230 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:47.564806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cfd3f-ff78-46a4-b912-ed9ff8094a9a tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:47.576862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cfd3f-ff78-46a4-b912-ed9ff8094a9a tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:47.583163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b121f4-98f5-47c9-b8db-41c7cdc35d27 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfa3fac9e29423f87e699dc419d2318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f88e9c5edc469f8d6066b60c5d2c10', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:47.583444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b121f4-98f5-47c9-b8db-41c7cdc35d27 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:47.583820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b121f4-98f5-47c9-b8db-41c7cdc35d27 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:47.584332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b121f4-98f5-47c9-b8db-41c7cdc35d27 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] PATH_INFO: `/v3/policies` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:47.584984 ncdv-master-1 devstack@keystone.service[96645]: WARNING oslo_log.versionutils [None req-e2b121f4-98f5-47c9-b8db-41c7cdc35d27 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Dec 18 21:01:47.585699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b121f4-98f5-47c9-b8db-41c7cdc35d27 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:47.586865 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-e2b121f4-98f5-47c9-b8db-41c7cdc35d27 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:47.586865 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:47.586865 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:47.587761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b121f4-98f5-47c9-b8db-41c7cdc35d27 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:47.611156 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2346/4762] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:01:47 2021] POST /identity/v3/policies => generated 228 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:47.615969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2e761-ff4c-4f6c-9551-1d6fb9de4f19 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:47.646216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2e761-ff4c-4f6c-9551-1d6fb9de4f19 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:47.669339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00c725-c914-4ae1-8ca2-5fd1eead6971 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfa3fac9e29423f87e699dc419d2318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f88e9c5edc469f8d6066b60c5d2c10', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:47.670061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00c725-c914-4ae1-8ca2-5fd1eead6971 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:47.670375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00c725-c914-4ae1-8ca2-5fd1eead6971 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:47.674000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00c725-c914-4ae1-8ca2-5fd1eead6971 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] PATH_INFO: `/v3/policies` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:47.677971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00c725-c914-4ae1-8ca2-5fd1eead6971 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:47.685843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00c725-c914-4ae1-8ca2-5fd1eead6971 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:47.722131 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2417/4763] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:01:47 2021] POST /identity/v3/policies => generated 230 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:47.723543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b121f4-98f5-47c9-b8db-41c7cdc35d27 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:47.750172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b121f4-98f5-47c9-b8db-41c7cdc35d27 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:47.755926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d8e97-055c-411c-8067-f5b7140cab33 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfa3fac9e29423f87e699dc419d2318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f88e9c5edc469f8d6066b60c5d2c10', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:47.756709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d8e97-055c-411c-8067-f5b7140cab33 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:47.757103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d8e97-055c-411c-8067-f5b7140cab33 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:47.757504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d8e97-055c-411c-8067-f5b7140cab33 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] PATH_INFO: `/v3/policies` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:47.758459 ncdv-master-1 devstack@keystone.service[96645]: WARNING oslo_log.versionutils [None req-bf1d8e97-055c-411c-8067-f5b7140cab33 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Dec 18 21:01:47.759215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d8e97-055c-411c-8067-f5b7140cab33 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:47.764327 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-bf1d8e97-055c-411c-8067-f5b7140cab33 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:47.764327 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:47.764327 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:47.765536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d8e97-055c-411c-8067-f5b7140cab33 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:47.778539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00c725-c914-4ae1-8ca2-5fd1eead6971 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:47.781620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9f00c725-c914-4ae1-8ca2-5fd1eead6971 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:47.786846 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2347/4764] 10.222.0.13 () {58 vars in 1130 bytes} [Sat Dec 18 21:01:47 2021] GET /identity/v3/policies => generated 764 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:47.787979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d8e97-055c-411c-8067-f5b7140cab33 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:47.817596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d8e97-055c-411c-8067-f5b7140cab33 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:47.840740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82797374-fe0a-450b-a269-c7cc97752e40 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfa3fac9e29423f87e699dc419d2318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f88e9c5edc469f8d6066b60c5d2c10', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:47.843069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82797374-fe0a-450b-a269-c7cc97752e40 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:47.845446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82797374-fe0a-450b-a269-c7cc97752e40 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:47.846819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82797374-fe0a-450b-a269-c7cc97752e40 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] PATH_INFO: `/v3/policies/731b7af784354683909f2fb2299623d2` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:47.852979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82797374-fe0a-450b-a269-c7cc97752e40 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=731b7af784354683909f2fb2299623d2)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:47.866907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82797374-fe0a-450b-a269-c7cc97752e40 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:47.904795 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2348/4765] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:47 2021] DELETE /identity/v3/policies/731b7af784354683909f2fb2299623d2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:47.911853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82797374-fe0a-450b-a269-c7cc97752e40 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:47.947324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82797374-fe0a-450b-a269-c7cc97752e40 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:47.953419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00c725-c914-4ae1-8ca2-5fd1eead6971 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:47.956181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d376a-2b20-4bdf-abea-d4231d2304e3 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfa3fac9e29423f87e699dc419d2318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f88e9c5edc469f8d6066b60c5d2c10', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:47.957140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d376a-2b20-4bdf-abea-d4231d2304e3 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:47.957667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d376a-2b20-4bdf-abea-d4231d2304e3 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:47.958882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12556e0f-f6c8-447c-94a8-7357fc25be7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:47.959239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d376a-2b20-4bdf-abea-d4231d2304e3 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] PATH_INFO: `/v3/policies/aa478f75c9f64286b964f5b850710b3f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:47.960091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12556e0f-f6c8-447c-94a8-7357fc25be7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:47.961082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d376a-2b20-4bdf-abea-d4231d2304e3 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=aa478f75c9f64286b964f5b850710b3f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:47.961226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12556e0f-f6c8-447c-94a8-7357fc25be7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:47.961498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12556e0f-f6c8-447c-94a8-7357fc25be7f admin admin] PATH_INFO: `/v3/projects/eaab154506794aefae91e487b1f57cd1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:47.964038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d376a-2b20-4bdf-abea-d4231d2304e3 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:47.964939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12556e0f-f6c8-447c-94a8-7357fc25be7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaab154506794aefae91e487b1f57cd1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:47.968004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12556e0f-f6c8-447c-94a8-7357fc25be7f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:47.987211 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2349/4766] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:47 2021] DELETE /identity/v3/policies/aa478f75c9f64286b964f5b850710b3f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:47.988519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d376a-2b20-4bdf-abea-d4231d2304e3 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:48.016194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d376a-2b20-4bdf-abea-d4231d2304e3 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:48.052915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-12556e0f-f6c8-447c-94a8-7357fc25be7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaab154506794aefae91e487b1f57cd1', 'request_id': 'req-12556e0f-f6c8-447c-94a8-7357fc25be7f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:48.060845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-12556e0f-f6c8-447c-94a8-7357fc25be7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaab154506794aefae91e487b1f57cd1', 'request_id': 'req-12556e0f-f6c8-447c-94a8-7357fc25be7f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:48.072913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-12556e0f-f6c8-447c-94a8-7357fc25be7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaab154506794aefae91e487b1f57cd1', 'request_id': 'req-12556e0f-f6c8-447c-94a8-7357fc25be7f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:48.095246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-12556e0f-f6c8-447c-94a8-7357fc25be7f admin admin] The token cache is being invalidate because project eaab154506794aefae91e487b1f57cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:48.096098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-12556e0f-f6c8-447c-94a8-7357fc25be7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:48.096963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-12556e0f-f6c8-447c-94a8-7357fc25be7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:48.102339 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2418/4767] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:47 2021] DELETE /identity/v3/projects/eaab154506794aefae91e487b1f57cd1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:48.107405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7cb86-4755-4575-8409-a72e3cb55fef None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:48.107772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7cb86-4755-4575-8409-a72e3cb55fef None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:48.108128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7cb86-4755-4575-8409-a72e3cb55fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:48.122884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928a2e7-1cb0-409f-a634-fe7631f82729 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfa3fac9e29423f87e699dc419d2318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f88e9c5edc469f8d6066b60c5d2c10', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:48.123751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928a2e7-1cb0-409f-a634-fe7631f82729 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:48.124527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928a2e7-1cb0-409f-a634-fe7631f82729 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:48.124847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928a2e7-1cb0-409f-a634-fe7631f82729 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] PATH_INFO: `/v3/policies/f81f047cb08d49fd903464888a61cf67` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:48.126007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928a2e7-1cb0-409f-a634-fe7631f82729 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=f81f047cb08d49fd903464888a61cf67)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:48.128099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928a2e7-1cb0-409f-a634-fe7631f82729 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:48.139180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-cfc7cb86-4755-4575-8409-a72e3cb55fef None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:48.140517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cfc7cb86-4755-4575-8409-a72e3cb55fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:48.146287 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2350/4768] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:47 2021] DELETE /identity/v3/policies/f81f047cb08d49fd903464888a61cf67 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:48.151330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928a2e7-1cb0-409f-a634-fe7631f82729 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:48.153899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7928a2e7-1cb0-409f-a634-fe7631f82729 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:48.209608 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2419/4769] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:48.218076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40494e9-cb3f-4c5d-b7da-baf0ae2f3a28 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:48.219316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40494e9-cb3f-4c5d-b7da-baf0ae2f3a28 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:48.219608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40494e9-cb3f-4c5d-b7da-baf0ae2f3a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:48.229413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928a2e7-1cb0-409f-a634-fe7631f82729 tempest-PoliciesTestJSON-1056528060 tempest-PoliciesTestJSON-1056528060-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:48.236098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b12caa-0983-4abb-9e8d-485dc3f18247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:48.236974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b12caa-0983-4abb-9e8d-485dc3f18247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:48.237261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b12caa-0983-4abb-9e8d-485dc3f18247 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:48.238233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b12caa-0983-4abb-9e8d-485dc3f18247 admin admin] PATH_INFO: `/v3/users/3cb923664aee460b89b273556187e636` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:48.239499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b12caa-0983-4abb-9e8d-485dc3f18247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cb923664aee460b89b273556187e636)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:48.239705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c40494e9-cb3f-4c5d-b7da-baf0ae2f3a28 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:48.240989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c40494e9-cb3f-4c5d-b7da-baf0ae2f3a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:48.242045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b12caa-0983-4abb-9e8d-485dc3f18247 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:48.249582 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2420/4770] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:48.253615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40494e9-cb3f-4c5d-b7da-baf0ae2f3a28 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:48.262756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40494e9-cb3f-4c5d-b7da-baf0ae2f3a28 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:48.268239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a160f41-076e-4b4d-892d-b330fcccd716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:48.269024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a160f41-076e-4b4d-892d-b330fcccd716 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:48.269189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a160f41-076e-4b4d-892d-b330fcccd716 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:48.269810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a160f41-076e-4b4d-892d-b330fcccd716 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:48.270166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a160f41-076e-4b4d-892d-b330fcccd716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:01:48.270516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a160f41-076e-4b4d-892d-b330fcccd716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:48.272441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a160f41-076e-4b4d-892d-b330fcccd716 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:48.288286 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2421/4771] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:01:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:48.293618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a160f41-076e-4b4d-892d-b330fcccd716 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:48.305593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b7b12caa-0983-4abb-9e8d-485dc3f18247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cb923664aee460b89b273556187e636'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:48.307294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a160f41-076e-4b4d-892d-b330fcccd716 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:48.312204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5671e-450c-4c69-80ed-fed7223603ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:48.312851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5671e-450c-4c69-80ed-fed7223603ef admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:48.312970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b7b12caa-0983-4abb-9e8d-485dc3f18247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cb923664aee460b89b273556187e636'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:48.313140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5671e-450c-4c69-80ed-fed7223603ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:48.313423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5671e-450c-4c69-80ed-fed7223603ef admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:48.314125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5671e-450c-4c69-80ed-fed7223603ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:48.316107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5671e-450c-4c69-80ed-fed7223603ef admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:48.327412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b7b12caa-0983-4abb-9e8d-485dc3f18247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cb923664aee460b89b273556187e636'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:48.328343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b7b12caa-0983-4abb-9e8d-485dc3f18247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cb923664aee460b89b273556187e636'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:48.338230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b7b12caa-0983-4abb-9e8d-485dc3f18247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cb923664aee460b89b273556187e636'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:48.346628 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2422/4772] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:48 2021] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:48.350499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5671e-450c-4c69-80ed-fed7223603ef admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:48.351550 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2351/4773] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:48 2021] DELETE /identity/v3/users/3cb923664aee460b89b273556187e636 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:48.355272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-73c5671e-450c-4c69-80ed-fed7223603ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:48.356573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d73af-b3c4-412b-9018-7a80f4f4fa0c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:48.356974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d73af-b3c4-412b-9018-7a80f4f4fa0c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:48.357360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d73af-b3c4-412b-9018-7a80f4f4fa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:48.376629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b15d73af-b3c4-412b-9018-7a80f4f4fa0c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:48.377984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b15d73af-b3c4-412b-9018-7a80f4f4fa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:48.446947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5671e-450c-4c69-80ed-fed7223603ef admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:48.447960 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2352/4774] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:48.453268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cbf90-31ca-4911-aa50-d28983782cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:48.453956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cbf90-31ca-4911-aa50-d28983782cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:48.454236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cbf90-31ca-4911-aa50-d28983782cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:48.454548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cbf90-31ca-4911-aa50-d28983782cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:48.455264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cbf90-31ca-4911-aa50-d28983782cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:48.457179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cbf90-31ca-4911-aa50-d28983782cf9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:48.458955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d73af-b3c4-412b-9018-7a80f4f4fa0c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:48.460450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b15d73af-b3c4-412b-9018-7a80f4f4fa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:48.483376 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2423/4775] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:48 2021] POST /identity/v3/users => generated 284 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:48.486906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cbf90-31ca-4911-aa50-d28983782cf9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:48.505059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cbf90-31ca-4911-aa50-d28983782cf9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:48.512379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1c33e-e4b4-42b0-a62c-dbf90ed10eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:48.513089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1c33e-e4b4-42b0-a62c-dbf90ed10eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:48.513407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1c33e-e4b4-42b0-a62c-dbf90ed10eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:48.513986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1c33e-e4b4-42b0-a62c-dbf90ed10eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:48.515025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1c33e-e4b4-42b0-a62c-dbf90ed10eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:48.517040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1c33e-e4b4-42b0-a62c-dbf90ed10eb4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:48.532187 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2424/4776] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:48 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:48.537120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1c33e-e4b4-42b0-a62c-dbf90ed10eb4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:48.550729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1c33e-e4b4-42b0-a62c-dbf90ed10eb4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:48.556381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b20b49-611a-4ec9-a82c-1d45c36920d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:48.557329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b20b49-611a-4ec9-a82c-1d45c36920d5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:48.558579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b20b49-611a-4ec9-a82c-1d45c36920d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:48.558876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b20b49-611a-4ec9-a82c-1d45c36920d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:48.559617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b20b49-611a-4ec9-a82c-1d45c36920d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:48.562537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b20b49-611a-4ec9-a82c-1d45c36920d5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:48.577587 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2425/4777] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:48 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:48.578907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b20b49-611a-4ec9-a82c-1d45c36920d5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:48.591701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b20b49-611a-4ec9-a82c-1d45c36920d5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:48.604000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98c3aa-19c9-4a19-9ee3-2cae84a4d5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:48.605243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98c3aa-19c9-4a19-9ee3-2cae84a4d5e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:48.605523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98c3aa-19c9-4a19-9ee3-2cae84a4d5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:48.605784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d73af-b3c4-412b-9018-7a80f4f4fa0c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:48.606102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98c3aa-19c9-4a19-9ee3-2cae84a4d5e5 admin admin] PATH_INFO: `/v3/projects/bdb8029687da4b8194f5498702cdb2e3/users/062f8a58d8674e29aa997a6685d6dd01/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:48.616685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff49f10-878e-4c5c-9490-788645351d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:48.617612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff49f10-878e-4c5c-9490-788645351d76 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:48.618060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff49f10-878e-4c5c-9490-788645351d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:48.618557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff49f10-878e-4c5c-9490-788645351d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:48.623497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98c3aa-19c9-4a19-9ee3-2cae84a4d5e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb8029687da4b8194f5498702cdb2e3, user_id=062f8a58d8674e29aa997a6685d6dd01, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:48.626136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98c3aa-19c9-4a19-9ee3-2cae84a4d5e5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:48.643068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff49f10-878e-4c5c-9490-788645351d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:48.647105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff49f10-878e-4c5c-9490-788645351d76 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:48.650150 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2426/4778] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:48 2021] PUT /identity/v3/projects/bdb8029687da4b8194f5498702cdb2e3/users/062f8a58d8674e29aa997a6685d6dd01/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:48.661051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce047046-7ea1-4d5d-b36c-04e2746ebb58 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:48.661338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce047046-7ea1-4d5d-b36c-04e2746ebb58 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:48.661613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce047046-7ea1-4d5d-b36c-04e2746ebb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:48.663536 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2353/4779] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:01:48.695426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ce047046-7ea1-4d5d-b36c-04e2746ebb58 None None] MFA Rules not processed for user `062f8a58d8674e29aa997a6685d6dd01`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:48.696745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ce047046-7ea1-4d5d-b36c-04e2746ebb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:48.801510 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2427/4780] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:48 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:48.803007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff49f10-878e-4c5c-9490-788645351d76 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:48.813781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff49f10-878e-4c5c-9490-788645351d76 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:48.879638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53278fb-d1af-426d-83d3-8b69f4d9292c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:48.880455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53278fb-d1af-426d-83d3-8b69f4d9292c admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:48.880745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53278fb-d1af-426d-83d3-8b69f4d9292c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:48.881289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53278fb-d1af-426d-83d3-8b69f4d9292c admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:48.895593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53278fb-d1af-426d-83d3-8b69f4d9292c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:48.898111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53278fb-d1af-426d-83d3-8b69f4d9292c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:48.903720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce047046-7ea1-4d5d-b36c-04e2746ebb58 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:48.905147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ce047046-7ea1-4d5d-b36c-04e2746ebb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:48.941182 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2354/4781] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:48 2021] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:48.945313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53278fb-d1af-426d-83d3-8b69f4d9292c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:49.018831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce047046-7ea1-4d5d-b36c-04e2746ebb58 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:49.034741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53278fb-d1af-426d-83d3-8b69f4d9292c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:49.040678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a049ab0-e806-4262-ba59-4718e22a7188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:49.042226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a049ab0-e806-4262-ba59-4718e22a7188 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:49.042746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a049ab0-e806-4262-ba59-4718e22a7188 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:49.043180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a049ab0-e806-4262-ba59-4718e22a7188 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:49.044463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a049ab0-e806-4262-ba59-4718e22a7188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:49.046964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a049ab0-e806-4262-ba59-4718e22a7188 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:49.080582 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2355/4782] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:48 2021] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:49.084937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a049ab0-e806-4262-ba59-4718e22a7188 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:49.098634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a049ab0-e806-4262-ba59-4718e22a7188 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:49.106810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b326c68-be46-4117-bb7a-cb24da44573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:49.107768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b326c68-be46-4117-bb7a-cb24da44573f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:49.108544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b326c68-be46-4117-bb7a-cb24da44573f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:49.112305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b326c68-be46-4117-bb7a-cb24da44573f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:49.113362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b326c68-be46-4117-bb7a-cb24da44573f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:49.115475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b326c68-be46-4117-bb7a-cb24da44573f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:49.128993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb48f2-d014-4b3a-a70a-f75e52946a92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:49.129804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb48f2-d014-4b3a-a70a-f75e52946a92 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:49.130325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb48f2-d014-4b3a-a70a-f75e52946a92 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:49.130882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb48f2-d014-4b3a-a70a-f75e52946a92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:49.134759 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2356/4783] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:49 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:49.135729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7cdb48f2-d014-4b3a-a70a-f75e52946a92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:49.136902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b326c68-be46-4117-bb7a-cb24da44573f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:49.153878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb48f2-d014-4b3a-a70a-f75e52946a92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:49.154787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb48f2-d014-4b3a-a70a-f75e52946a92 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:49.155856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b326c68-be46-4117-bb7a-cb24da44573f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:49.162777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24608d-a4d3-43ea-9573-d240b13b75a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:49.164395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24608d-a4d3-43ea-9573-d240b13b75a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:49.166170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24608d-a4d3-43ea-9573-d240b13b75a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:49.168911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24608d-a4d3-43ea-9573-d240b13b75a8 admin admin] PATH_INFO: `/v3/projects/5856f06954754b7ea25fe69dd1abdead/users/28a1fa865c124434ad0e66725e588855/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:49.176699 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2428/4784] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:01:49.192473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb48f2-d014-4b3a-a70a-f75e52946a92 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:49.193965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7cdb48f2-d014-4b3a-a70a-f75e52946a92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:49.214842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24608d-a4d3-43ea-9573-d240b13b75a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5856f06954754b7ea25fe69dd1abdead, user_id=28a1fa865c124434ad0e66725e588855, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:49.217650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24608d-a4d3-43ea-9573-d240b13b75a8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:49.231772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb48f2-d014-4b3a-a70a-f75e52946a92 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:49.242961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61dc7f-a020-48f5-b694-a3d02f3be361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:49.244564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61dc7f-a020-48f5-b694-a3d02f3be361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:49.245194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61dc7f-a020-48f5-b694-a3d02f3be361 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:49.246245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61dc7f-a020-48f5-b694-a3d02f3be361 admin admin] PATH_INFO: `/v3/projects/4ed6d8a0a8ef4f17b75bf74191f1d287` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:49.248192 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2357/4785] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:49 2021] PUT /identity/v3/projects/5856f06954754b7ea25fe69dd1abdead/users/28a1fa865c124434ad0e66725e588855/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:49.252341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24608d-a4d3-43ea-9573-d240b13b75a8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:49.252969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61dc7f-a020-48f5-b694-a3d02f3be361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ed6d8a0a8ef4f17b75bf74191f1d287)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:49.258408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61dc7f-a020-48f5-b694-a3d02f3be361 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:49.401070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24608d-a4d3-43ea-9573-d240b13b75a8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:49.405055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4b61dc7f-a020-48f5-b694-a3d02f3be361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ed6d8a0a8ef4f17b75bf74191f1d287', 'request_id': 'req-4b61dc7f-a020-48f5-b694-a3d02f3be361'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:49.420263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4b61dc7f-a020-48f5-b694-a3d02f3be361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ed6d8a0a8ef4f17b75bf74191f1d287', 'request_id': 'req-4b61dc7f-a020-48f5-b694-a3d02f3be361'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:49.441539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4b61dc7f-a020-48f5-b694-a3d02f3be361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ed6d8a0a8ef4f17b75bf74191f1d287', 'request_id': 'req-4b61dc7f-a020-48f5-b694-a3d02f3be361'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:49.472411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4b61dc7f-a020-48f5-b694-a3d02f3be361 admin admin] The token cache is being invalidate because project 4ed6d8a0a8ef4f17b75bf74191f1d287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:49.473017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4b61dc7f-a020-48f5-b694-a3d02f3be361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:49.476426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4b61dc7f-a020-48f5-b694-a3d02f3be361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:49.481314 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2429/4786] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:49 2021] DELETE /identity/v3/projects/4ed6d8a0a8ef4f17b75bf74191f1d287 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:49.485434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61dc7f-a020-48f5-b694-a3d02f3be361 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:49.487112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4b61dc7f-a020-48f5-b694-a3d02f3be361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:49.526005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8afdd-aeb9-4c7d-b949-5781df5c1442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:49.527283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8afdd-aeb9-4c7d-b949-5781df5c1442 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:49.527573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8afdd-aeb9-4c7d-b949-5781df5c1442 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:49.527856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8afdd-aeb9-4c7d-b949-5781df5c1442 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:49.528603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8afdd-aeb9-4c7d-b949-5781df5c1442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:49.530214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8afdd-aeb9-4c7d-b949-5781df5c1442 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:49.549562 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2358/4787] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:49 2021] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:49.553690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8afdd-aeb9-4c7d-b949-5781df5c1442 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:49.559034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d6d8afdd-aeb9-4c7d-b949-5781df5c1442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:49.581916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8afdd-aeb9-4c7d-b949-5781df5c1442 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:49.596229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab588e-f484-40dc-b759-b95c2d3d6fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:49.597385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab588e-f484-40dc-b759-b95c2d3d6fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:49.597506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab588e-f484-40dc-b759-b95c2d3d6fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:49.597710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab588e-f484-40dc-b759-b95c2d3d6fa1 admin admin] PATH_INFO: `/v3/projects/5856f06954754b7ea25fe69dd1abdead/users/28a1fa865c124434ad0e66725e588855/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:49.614845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab588e-f484-40dc-b759-b95c2d3d6fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5856f06954754b7ea25fe69dd1abdead, user_id=28a1fa865c124434ad0e66725e588855, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:49.617527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab588e-f484-40dc-b759-b95c2d3d6fa1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:49.629197 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2359/4788] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:49 2021] PUT /identity/v3/projects/5856f06954754b7ea25fe69dd1abdead/users/28a1fa865c124434ad0e66725e588855/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:49.641617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6949d4-b4da-4cc6-872d-cc3e03795889 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:49.641968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6949d4-b4da-4cc6-872d-cc3e03795889 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:49.642277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6949d4-b4da-4cc6-872d-cc3e03795889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:49.666178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61dc7f-a020-48f5-b694-a3d02f3be361 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:49.755021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ba6949d4-b4da-4cc6-872d-cc3e03795889 None None] MFA Rules not processed for user `28a1fa865c124434ad0e66725e588855`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:49.766127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ba6949d4-b4da-4cc6-872d-cc3e03795889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:49.864790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c32b5-7922-4d02-b45c-2f2c81f518fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:49.865843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c32b5-7922-4d02-b45c-2f2c81f518fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:49.866202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c32b5-7922-4d02-b45c-2f2c81f518fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:49.866601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c32b5-7922-4d02-b45c-2f2c81f518fe admin admin] PATH_INFO: `/v3/users/adfa3fac9e29423f87e699dc419d2318` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:49.875193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c32b5-7922-4d02-b45c-2f2c81f518fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=adfa3fac9e29423f87e699dc419d2318)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:49.878822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c32b5-7922-4d02-b45c-2f2c81f518fe admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:49.958983 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2360/4789] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:49 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:49.965331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6949d4-b4da-4cc6-872d-cc3e03795889 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:49.982403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c89c32b5-7922-4d02-b45c-2f2c81f518fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adfa3fac9e29423f87e699dc419d2318'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:49.983092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6949d4-b4da-4cc6-872d-cc3e03795889 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:49.992781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c89c32b5-7922-4d02-b45c-2f2c81f518fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adfa3fac9e29423f87e699dc419d2318'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:49.993526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c89c32b5-7922-4d02-b45c-2f2c81f518fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adfa3fac9e29423f87e699dc419d2318'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:49.997741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f7869-d2d4-42aa-bd79-86069e0ff918 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:49.998496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f7869-d2d4-42aa-bd79-86069e0ff918 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:49.998791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f7869-d2d4-42aa-bd79-86069e0ff918 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:49.999073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f7869-d2d4-42aa-bd79-86069e0ff918 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:49.999795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f7869-d2d4-42aa-bd79-86069e0ff918 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:50.001912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f7869-d2d4-42aa-bd79-86069e0ff918 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:50.010618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c89c32b5-7922-4d02-b45c-2f2c81f518fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adfa3fac9e29423f87e699dc419d2318'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:50.023603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c89c32b5-7922-4d02-b45c-2f2c81f518fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adfa3fac9e29423f87e699dc419d2318'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:50.038297 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2430/4790] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:49 2021] DELETE /identity/v3/users/adfa3fac9e29423f87e699dc419d2318 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:50.062710 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2361/4791] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:01:49 2021] POST /identity/v3/projects => generated 329 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:50.063981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c32b5-7922-4d02-b45c-2f2c81f518fe admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:50.065742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c89c32b5-7922-4d02-b45c-2f2c81f518fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:50.150217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c32b5-7922-4d02-b45c-2f2c81f518fe admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:50.249219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4b986-1b17-4d22-a4c6-e7b9dcdbe2d1 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:50.250145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4b986-1b17-4d22-a4c6-e7b9dcdbe2d1 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:50.250554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4b986-1b17-4d22-a4c6-e7b9dcdbe2d1 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:50.250786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4b986-1b17-4d22-a4c6-e7b9dcdbe2d1 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:50.251483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4b986-1b17-4d22-a4c6-e7b9dcdbe2d1 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:50.254307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4b986-1b17-4d22-a4c6-e7b9dcdbe2d1 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:50.287964 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2431/4792] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:50 2021] POST /identity/v3/users => generated 413 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:50.288779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f7869-d2d4-42aa-bd79-86069e0ff918 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:50.309499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f7869-d2d4-42aa-bd79-86069e0ff918 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:50.314290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fdddc-67f1-46ea-a6a7-4c9bccdbab41 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:50.314985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fdddc-67f1-46ea-a6a7-4c9bccdbab41 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:50.315281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fdddc-67f1-46ea-a6a7-4c9bccdbab41 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:50.315568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fdddc-67f1-46ea-a6a7-4c9bccdbab41 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:50.316596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fdddc-67f1-46ea-a6a7-4c9bccdbab41 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:50.318206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fdddc-67f1-46ea-a6a7-4c9bccdbab41 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:50.341324 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2362/4793] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:01:50 2021] POST /identity/v3/roles => generated 243 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:50.344788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4b986-1b17-4d22-a4c6-e7b9dcdbe2d1 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:50.356147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4b986-1b17-4d22-a4c6-e7b9dcdbe2d1 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:50.364363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703f70a-bf67-4749-a43a-ee20f30e87bd tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:50.365035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703f70a-bf67-4749-a43a-ee20f30e87bd tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:50.365331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703f70a-bf67-4749-a43a-ee20f30e87bd tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:50.365664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703f70a-bf67-4749-a43a-ee20f30e87bd tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:50.366404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703f70a-bf67-4749-a43a-ee20f30e87bd tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:50.368417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703f70a-bf67-4749-a43a-ee20f30e87bd tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:50.388471 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2432/4794] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:01:50 2021] POST /identity/v3/roles => generated 246 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:50.392749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fdddc-67f1-46ea-a6a7-4c9bccdbab41 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:50.406575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fdddc-67f1-46ea-a6a7-4c9bccdbab41 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:50.416518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f95cf-383c-46f3-82b0-b52015a970d5 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:50.417875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f95cf-383c-46f3-82b0-b52015a970d5 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:50.418666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f95cf-383c-46f3-82b0-b52015a970d5 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:50.419188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f95cf-383c-46f3-82b0-b52015a970d5 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/05d5ee008c314472a8727f3b845f4b9f/users/69584d32c65d44a18e8fa3d9df31cb7b/roles/7e83431d6a974cf3995ac9383458539e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:50.443761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f95cf-383c-46f3-82b0-b52015a970d5 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_grant(project_id=05d5ee008c314472a8727f3b845f4b9f, user_id=69584d32c65d44a18e8fa3d9df31cb7b, role_id=7e83431d6a974cf3995ac9383458539e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:50.449021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f95cf-383c-46f3-82b0-b52015a970d5 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:50.474710 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2363/4795] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:50 2021] PUT /identity/v3/projects/05d5ee008c314472a8727f3b845f4b9f/users/69584d32c65d44a18e8fa3d9df31cb7b/roles/7e83431d6a974cf3995ac9383458539e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:50.478925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703f70a-bf67-4749-a43a-ee20f30e87bd tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:50.492982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703f70a-bf67-4749-a43a-ee20f30e87bd tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:50.582200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fabd30-b69e-48eb-94fe-42191b82cbb6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:50.583654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fabd30-b69e-48eb-94fe-42191b82cbb6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:50.583921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fabd30-b69e-48eb-94fe-42191b82cbb6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:50.584379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fabd30-b69e-48eb-94fe-42191b82cbb6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/05d5ee008c314472a8727f3b845f4b9f/users/69584d32c65d44a18e8fa3d9df31cb7b/roles/d270b1f9b214416894925cb564343a38` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:50.587367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fabd30-b69e-48eb-94fe-42191b82cbb6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_grant(project_id=05d5ee008c314472a8727f3b845f4b9f, user_id=69584d32c65d44a18e8fa3d9df31cb7b, role_id=d270b1f9b214416894925cb564343a38)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:50.592082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fabd30-b69e-48eb-94fe-42191b82cbb6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:50.621096 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2433/4796] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:50 2021] PUT /identity/v3/projects/05d5ee008c314472a8727f3b845f4b9f/users/69584d32c65d44a18e8fa3d9df31cb7b/roles/d270b1f9b214416894925cb564343a38 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:50.624633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f95cf-383c-46f3-82b0-b52015a970d5 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:50.637485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f95cf-383c-46f3-82b0-b52015a970d5 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:50.739053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabfb64-dedd-4d3b-8077-c0a2b726946b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:50.739053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabfb64-dedd-4d3b-8077-c0a2b726946b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:50.739053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabfb64-dedd-4d3b-8077-c0a2b726946b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:50.739448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabfb64-dedd-4d3b-8077-c0a2b726946b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:50.739448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabfb64-dedd-4d3b-8077-c0a2b726946b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:50.741792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabfb64-dedd-4d3b-8077-c0a2b726946b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:50.761011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fabd30-b69e-48eb-94fe-42191b82cbb6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:50.763359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-69fabd30-b69e-48eb-94fe-42191b82cbb6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:50.785479 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2364/4797] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:50 2021] GET /identity/v3/users => generated 8065 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:50.790043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b89270-980c-4016-b85f-29a1e49ca72b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:50.790043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b89270-980c-4016-b85f-29a1e49ca72b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:50.790294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b89270-980c-4016-b85f-29a1e49ca72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:50.868822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fabd30-b69e-48eb-94fe-42191b82cbb6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:50.881282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70524a-ec67-4b97-90d3-130faad59dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:50.882208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70524a-ec67-4b97-90d3-130faad59dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:50.882541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70524a-ec67-4b97-90d3-130faad59dca admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:50.884324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-74b89270-980c-4016-b85f-29a1e49ca72b None None] MFA Rules not processed for user `69584d32c65d44a18e8fa3d9df31cb7b`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:50.885288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70524a-ec67-4b97-90d3-130faad59dca admin admin] PATH_INFO: `/v3/projects/f2f88e9c5edc469f8d6066b60c5d2c10` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:50.886717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70524a-ec67-4b97-90d3-130faad59dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f88e9c5edc469f8d6066b60c5d2c10)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:50.888735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70524a-ec67-4b97-90d3-130faad59dca admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:50.889369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-74b89270-980c-4016-b85f-29a1e49ca72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:50.955705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5a70524a-ec67-4b97-90d3-130faad59dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f88e9c5edc469f8d6066b60c5d2c10', 'request_id': 'req-5a70524a-ec67-4b97-90d3-130faad59dca'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:50.962586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5a70524a-ec67-4b97-90d3-130faad59dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f88e9c5edc469f8d6066b60c5d2c10', 'request_id': 'req-5a70524a-ec67-4b97-90d3-130faad59dca'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:50.975773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5a70524a-ec67-4b97-90d3-130faad59dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f88e9c5edc469f8d6066b60c5d2c10', 'request_id': 'req-5a70524a-ec67-4b97-90d3-130faad59dca'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:51.028353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5a70524a-ec67-4b97-90d3-130faad59dca admin admin] The token cache is being invalidate because project f2f88e9c5edc469f8d6066b60c5d2c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:51.029040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5a70524a-ec67-4b97-90d3-130faad59dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:51.029910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5a70524a-ec67-4b97-90d3-130faad59dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:51.034318 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2434/4798] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:50 2021] DELETE /identity/v3/projects/f2f88e9c5edc469f8d6066b60c5d2c10 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:51.040312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b2d16-8e70-4155-a22f-d305c712c6d9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:51.040651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b2d16-8e70-4155-a22f-d305c712c6d9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:51.040888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b2d16-8e70-4155-a22f-d305c712c6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:51.054437 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2365/4799] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:50 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:51.065220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4603f7b-6ea8-4242-9845-7847f85ccd79 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:51.065565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4603f7b-6ea8-4242-9845-7847f85ccd79 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:51.065842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4603f7b-6ea8-4242-9845-7847f85ccd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:51.103441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b4603f7b-6ea8-4242-9845-7847f85ccd79 None None] MFA Rules not processed for user `69584d32c65d44a18e8fa3d9df31cb7b`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:51.104543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b4603f7b-6ea8-4242-9845-7847f85ccd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:51.111629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-516b2d16-8e70-4155-a22f-d305c712c6d9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:51.114136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-516b2d16-8e70-4155-a22f-d305c712c6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:51.261103 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2366/4800] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:51 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:51.263567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4603f7b-6ea8-4242-9845-7847f85ccd79 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:51.284320 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2435/4801] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:51.293640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2db77c-09d9-4e26-bf6b-b8314c3c5c21 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:51.293932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2db77c-09d9-4e26-bf6b-b8314c3c5c21 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:51.294422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2db77c-09d9-4e26-bf6b-b8314c3c5c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:51.299411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4603f7b-6ea8-4242-9845-7847f85ccd79 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:51.311036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c5310-a907-4d3b-82a2-573cd47af8b4 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69584d32c65d44a18e8fa3d9df31cb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d5ee008c314472a8727f3b845f4b9f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-760004338', 'tempest-NotDelegatedRole-949435720'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:51.311781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c5310-a907-4d3b-82a2-573cd47af8b4 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:51.312073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c5310-a907-4d3b-82a2-573cd47af8b4 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:51.312357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c5310-a907-4d3b-82a2-573cd47af8b4 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:51.313179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c5310-a907-4d3b-82a2-573cd47af8b4 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] RBAC: Authorizing `identity:create_trust()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:51.314404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c5310-a907-4d3b-82a2-573cd47af8b4 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:51.318290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4c2db77c-09d9-4e26-bf6b-b8314c3c5c21 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:51.320566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4c2db77c-09d9-4e26-bf6b-b8314c3c5c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:51.330653 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2436/4802] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:51.335007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2db77c-09d9-4e26-bf6b-b8314c3c5c21 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:51.349255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2db77c-09d9-4e26-bf6b-b8314c3c5c21 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:51.356358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49febd4d-71cd-4125-b5f3-1e348fb7a80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:51.357044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49febd4d-71cd-4125-b5f3-1e348fb7a80e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:51.357388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49febd4d-71cd-4125-b5f3-1e348fb7a80e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:51.357732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49febd4d-71cd-4125-b5f3-1e348fb7a80e admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:51.358520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49febd4d-71cd-4125-b5f3-1e348fb7a80e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:01:51.358888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49febd4d-71cd-4125-b5f3-1e348fb7a80e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:51.360523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49febd4d-71cd-4125-b5f3-1e348fb7a80e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:51.382469 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2437/4803] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:01:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:51.384694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49febd4d-71cd-4125-b5f3-1e348fb7a80e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:51.404005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49febd4d-71cd-4125-b5f3-1e348fb7a80e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:51.412055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6b154-15b1-466f-873a-2600805b0d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:51.413348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6b154-15b1-466f-873a-2600805b0d0d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:51.413824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6b154-15b1-466f-873a-2600805b0d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:51.414182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6b154-15b1-466f-873a-2600805b0d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:51.415004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6b154-15b1-466f-873a-2600805b0d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:51.418210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6b154-15b1-466f-873a-2600805b0d0d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:51.437042 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2367/4804] 10.222.0.13 () {60 vars in 1173 bytes} [Sat Dec 18 21:01:51 2021] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:51.440446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c5310-a907-4d3b-82a2-573cd47af8b4 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:51.444480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a30c5310-a907-4d3b-82a2-573cd47af8b4 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:51.459212 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2438/4805] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:51 2021] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:51.469295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6b154-15b1-466f-873a-2600805b0d0d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:51.564990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6b154-15b1-466f-873a-2600805b0d0d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:51.574324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c5310-a907-4d3b-82a2-573cd47af8b4 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:51.580903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a5632-9c3c-4011-85a7-5aea3ea7b170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:51.581924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a5632-9c3c-4011-85a7-5aea3ea7b170 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:51.582218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a5632-9c3c-4011-85a7-5aea3ea7b170 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:51.582518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a5632-9c3c-4011-85a7-5aea3ea7b170 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:51.583770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a5632-9c3c-4011-85a7-5aea3ea7b170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:51.588631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a5632-9c3c-4011-85a7-5aea3ea7b170 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:51.639849 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2439/4806] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:51 2021] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:51.644033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a5632-9c3c-4011-85a7-5aea3ea7b170 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:51.657132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a5632-9c3c-4011-85a7-5aea3ea7b170 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:51.663822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e8b4a-ef5d-4f0a-9579-ed631e23bfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:51.664680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8b4a-ef5d-4f0a-9579-ed631e23bfb7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:51.665135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8b4a-ef5d-4f0a-9579-ed631e23bfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:51.665749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8b4a-ef5d-4f0a-9579-ed631e23bfb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:51.666680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e8b4a-ef5d-4f0a-9579-ed631e23bfb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:51.668543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e8b4a-ef5d-4f0a-9579-ed631e23bfb7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:51.686406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f53e6-289c-4dc4-ad95-bc4be98bac47 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:51.687077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f53e6-289c-4dc4-ad95-bc4be98bac47 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:51.687366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f53e6-289c-4dc4-ad95-bc4be98bac47 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:51.687654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f53e6-289c-4dc4-ad95-bc4be98bac47 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:51.688494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f53e6-289c-4dc4-ad95-bc4be98bac47 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:51.689737 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-982f53e6-289c-4dc4-ad95-bc4be98bac47 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:51.689737 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:01:51.689737 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:01:51.690909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f53e6-289c-4dc4-ad95-bc4be98bac47 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:51.694005 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2440/4807] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:51 2021] GET /identity/v3/roles => generated 1891 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:51.697439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e8b4a-ef5d-4f0a-9579-ed631e23bfb7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:51.701922 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2368/4808] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Dec 18 21:01:51 2021] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:51.703010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f53e6-289c-4dc4-ad95-bc4be98bac47 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:51.722211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e8b4a-ef5d-4f0a-9579-ed631e23bfb7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:51.730889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa0124-f3eb-4ca0-8a31-f6ed2809e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:51.731660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa0124-f3eb-4ca0-8a31-f6ed2809e23d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:51.732051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa0124-f3eb-4ca0-8a31-f6ed2809e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:51.732407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa0124-f3eb-4ca0-8a31-f6ed2809e23d admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:51.733840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa0124-f3eb-4ca0-8a31-f6ed2809e23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:51.735635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa0124-f3eb-4ca0-8a31-f6ed2809e23d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:51.755432 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2441/4809] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:51 2021] GET /identity/v3/roles => generated 1891 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:51.765653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa0124-f3eb-4ca0-8a31-f6ed2809e23d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:51.776206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f53e6-289c-4dc4-ad95-bc4be98bac47 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:51.780739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50a8c2-8808-4924-b3a8-5b94c3de1214 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69584d32c65d44a18e8fa3d9df31cb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d5ee008c314472a8727f3b845f4b9f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-760004338', 'tempest-NotDelegatedRole-949435720'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:51.781588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50a8c2-8808-4924-b3a8-5b94c3de1214 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:51.782480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50a8c2-8808-4924-b3a8-5b94c3de1214 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:51.783051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50a8c2-8808-4924-b3a8-5b94c3de1214 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] PATH_INFO: `/v3/OS-TRUST/trusts/13e77b5304e3472ea4362c53ed1e0e5a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:51.783566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa0124-f3eb-4ca0-8a31-f6ed2809e23d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:51.789906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b49177-bbcc-4d02-8273-0465346b2ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:51.790760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b49177-bbcc-4d02-8273-0465346b2ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:51.791155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b49177-bbcc-4d02-8273-0465346b2ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:51.791533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b49177-bbcc-4d02-8273-0465346b2ca2 admin admin] PATH_INFO: `/v3/projects/15e5d9db3fde4d5b817e632655758b6f/users/e51f3a2404d74eeda5b7ff5b18796a9f/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:51.791959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50a8c2-8808-4924-b3a8-5b94c3de1214 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] RBAC: Authorizing `identity:delete_trust(trust_id=13e77b5304e3472ea4362c53ed1e0e5a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:51.793471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50a8c2-8808-4924-b3a8-5b94c3de1214 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:51.817169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b49177-bbcc-4d02-8273-0465346b2ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e5d9db3fde4d5b817e632655758b6f, user_id=e51f3a2404d74eeda5b7ff5b18796a9f, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:51.822315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b49177-bbcc-4d02-8273-0465346b2ca2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:51.824457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ab50a8c2-8808-4924-b3a8-5b94c3de1214 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '13e77b5304e3472ea4362c53ed1e0e5a', 'request_id': 'req-ab50a8c2-8808-4924-b3a8-5b94c3de1214'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:51.825394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ab50a8c2-8808-4924-b3a8-5b94c3de1214 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '13e77b5304e3472ea4362c53ed1e0e5a', 'request_id': 'req-ab50a8c2-8808-4924-b3a8-5b94c3de1214'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:51.826894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ab50a8c2-8808-4924-b3a8-5b94c3de1214 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '13e77b5304e3472ea4362c53ed1e0e5a', 'request_id': 'req-ab50a8c2-8808-4924-b3a8-5b94c3de1214'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:51.841177 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2442/4810] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:51 2021] PUT /identity/v3/projects/15e5d9db3fde4d5b817e632655758b6f/users/e51f3a2404d74eeda5b7ff5b18796a9f/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:51.846570 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2369/4811] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Dec 18 21:01:51 2021] DELETE /identity/v3/OS-TRUST/trusts/13e77b5304e3472ea4362c53ed1e0e5a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:51.848615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50a8c2-8808-4924-b3a8-5b94c3de1214 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:51.850672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ab50a8c2-8808-4924-b3a8-5b94c3de1214 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:51.851676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33625584-8c36-4dd7-831f-fc08d7f557c4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:51.851967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33625584-8c36-4dd7-831f-fc08d7f557c4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:51.852338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33625584-8c36-4dd7-831f-fc08d7f557c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:51.863293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50a8c2-8808-4924-b3a8-5b94c3de1214 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:51.891611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-33625584-8c36-4dd7-831f-fc08d7f557c4 None None] MFA Rules not processed for user `e51f3a2404d74eeda5b7ff5b18796a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:51.892986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-33625584-8c36-4dd7-831f-fc08d7f557c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:51.954640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d4824-0d2e-4c91-b3b9-f25173067c65 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69584d32c65d44a18e8fa3d9df31cb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05d5ee008c314472a8727f3b845f4b9f', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-760004338', 'tempest-NotDelegatedRole-949435720'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:51.955822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d4824-0d2e-4c91-b3b9-f25173067c65 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:51.956277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d4824-0d2e-4c91-b3b9-f25173067c65 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:51.956967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d4824-0d2e-4c91-b3b9-f25173067c65 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] PATH_INFO: `/v3/OS-TRUST/trusts/13e77b5304e3472ea4362c53ed1e0e5a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:51.972277 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-5d2d4824-0d2e-4c91-b3b9-f25173067c65 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] Could not find trust: 13e77b5304e3472ea4362c53ed1e0e5a.: keystone.exception.TrustNotFound: Could not find trust: 13e77b5304e3472ea4362c53ed1e0e5a. Dec 18 21:01:51.973894 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2370/4812] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:01:51 2021] GET /identity/v3/OS-TRUST/trusts/13e77b5304e3472ea4362c53ed1e0e5a => generated 111 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:01:51.983750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d4824-0d2e-4c91-b3b9-f25173067c65 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:51.985826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5d2d4824-0d2e-4c91-b3b9-f25173067c65 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:52.009138 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2443/4813] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:51 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:52.011393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33625584-8c36-4dd7-831f-fc08d7f557c4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:52.012816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-33625584-8c36-4dd7-831f-fc08d7f557c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:52.086299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d4824-0d2e-4c91-b3b9-f25173067c65 tempest-TrustsV3TestJSON-1587122368 tempest-user-279464968] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:52.091715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cc0a1-4485-4a59-aa8b-6712aed152ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:52.092550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cc0a1-4485-4a59-aa8b-6712aed152ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:52.092837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cc0a1-4485-4a59-aa8b-6712aed152ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:52.093114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cc0a1-4485-4a59-aa8b-6712aed152ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles/d270b1f9b214416894925cb564343a38` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:52.094735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cc0a1-4485-4a59-aa8b-6712aed152ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d270b1f9b214416894925cb564343a38)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:52.096325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cc0a1-4485-4a59-aa8b-6712aed152ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:52.099776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33625584-8c36-4dd7-831f-fc08d7f557c4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:52.105720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18497f40-9da2-4fc4-bd18-f78184effcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:52.106111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18497f40-9da2-4fc4-bd18-f78184effcfb admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:52.106430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18497f40-9da2-4fc4-bd18-f78184effcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:52.106708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18497f40-9da2-4fc4-bd18-f78184effcfb admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:52.107558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18497f40-9da2-4fc4-bd18-f78184effcfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:52.109802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18497f40-9da2-4fc4-bd18-f78184effcfb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:52.136511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-093cc0a1-4485-4a59-aa8b-6712aed152ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invalidating the token cache because role d270b1f9b214416894925cb564343a38 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:52.136968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-093cc0a1-4485-4a59-aa8b-6712aed152ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:52.138005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-093cc0a1-4485-4a59-aa8b-6712aed152ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:52.140278 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2444/4814] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:52 2021] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:52.143455 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2371/4815] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:51 2021] DELETE /identity/v3/roles/d270b1f9b214416894925cb564343a38 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:52.144484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cc0a1-4485-4a59-aa8b-6712aed152ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:52.144614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18497f40-9da2-4fc4-bd18-f78184effcfb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:52.145963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-093cc0a1-4485-4a59-aa8b-6712aed152ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:52.146736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-18497f40-9da2-4fc4-bd18-f78184effcfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:52.214414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18497f40-9da2-4fc4-bd18-f78184effcfb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:52.218113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cc0a1-4485-4a59-aa8b-6712aed152ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:52.224881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1395e11-3c58-4457-bf39-c74c003770a6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:52.226916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1395e11-3c58-4457-bf39-c74c003770a6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:52.227138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1395e11-3c58-4457-bf39-c74c003770a6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:52.227374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1395e11-3c58-4457-bf39-c74c003770a6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles/7e83431d6a974cf3995ac9383458539e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:52.232681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1395e11-3c58-4457-bf39-c74c003770a6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7e83431d6a974cf3995ac9383458539e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:52.236493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1395e11-3c58-4457-bf39-c74c003770a6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:52.296390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a1395e11-3c58-4457-bf39-c74c003770a6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invalidating the token cache because role 7e83431d6a974cf3995ac9383458539e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:52.296724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a1395e11-3c58-4457-bf39-c74c003770a6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:52.297454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a1395e11-3c58-4457-bf39-c74c003770a6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:52.299708 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2372/4816] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:52 2021] DELETE /identity/v3/roles/7e83431d6a974cf3995ac9383458539e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:52.304608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1395e11-3c58-4457-bf39-c74c003770a6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:52.308894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a1395e11-3c58-4457-bf39-c74c003770a6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:52.314119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66d614-4a60-4a38-a76e-56027f9b5691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:52.316076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66d614-4a60-4a38-a76e-56027f9b5691 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:52.316725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66d614-4a60-4a38-a76e-56027f9b5691 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:52.317006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66d614-4a60-4a38-a76e-56027f9b5691 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:52.317977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66d614-4a60-4a38-a76e-56027f9b5691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:52.325418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66d614-4a60-4a38-a76e-56027f9b5691 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:52.353734 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2445/4817] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:52 2021] POST /identity/v3/users => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:52.358171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66d614-4a60-4a38-a76e-56027f9b5691 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:52.363012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0f66d614-4a60-4a38-a76e-56027f9b5691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:52.381411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66d614-4a60-4a38-a76e-56027f9b5691 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:52.399138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1395e11-3c58-4457-bf39-c74c003770a6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:52.432365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe7b53-4858-4369-97eb-eda6176f3209 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:52.433846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe7b53-4858-4369-97eb-eda6176f3209 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:52.434234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe7b53-4858-4369-97eb-eda6176f3209 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:52.434677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe7b53-4858-4369-97eb-eda6176f3209 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users/69584d32c65d44a18e8fa3d9df31cb7b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:52.439970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe7b53-4858-4369-97eb-eda6176f3209 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_user(user_id=69584d32c65d44a18e8fa3d9df31cb7b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:52.440509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe7b53-4858-4369-97eb-eda6176f3209 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:52.470969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502a95f-380b-4003-85c1-993f3cd0ce3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:52.471644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502a95f-380b-4003-85c1-993f3cd0ce3c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:52.472068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502a95f-380b-4003-85c1-993f3cd0ce3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:52.472187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502a95f-380b-4003-85c1-993f3cd0ce3c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:52.472926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502a95f-380b-4003-85c1-993f3cd0ce3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:52.478035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502a95f-380b-4003-85c1-993f3cd0ce3c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:52.501411 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2446/4818] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:52 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:52.506111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502a95f-380b-4003-85c1-993f3cd0ce3c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:52.521712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502a95f-380b-4003-85c1-993f3cd0ce3c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:52.528939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f0238-eee6-4f52-b631-af44d811dc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:52.530407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f0238-eee6-4f52-b631-af44d811dc5c admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:52.530881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f0238-eee6-4f52-b631-af44d811dc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:52.531350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f0238-eee6-4f52-b631-af44d811dc5c admin admin] PATH_INFO: `/v3/projects/cfda15263a4f4f6a926489afdd4ce449/users/b4f8e189814d43ef8eff3ab3afdb626b/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:52.550285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f0238-eee6-4f52-b631-af44d811dc5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfda15263a4f4f6a926489afdd4ce449, user_id=b4f8e189814d43ef8eff3ab3afdb626b, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:52.553346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f0238-eee6-4f52-b631-af44d811dc5c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:52.571456 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2447/4819] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:52 2021] PUT /identity/v3/projects/cfda15263a4f4f6a926489afdd4ce449/users/b4f8e189814d43ef8eff3ab3afdb626b/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:52.576982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f0238-eee6-4f52-b631-af44d811dc5c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:52.592849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-69fe7b53-4858-4369-97eb-eda6176f3209 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69584d32c65d44a18e8fa3d9df31cb7b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:52.613264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-69fe7b53-4858-4369-97eb-eda6176f3209 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69584d32c65d44a18e8fa3d9df31cb7b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:52.652830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-69fe7b53-4858-4369-97eb-eda6176f3209 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69584d32c65d44a18e8fa3d9df31cb7b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:52.653746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-69fe7b53-4858-4369-97eb-eda6176f3209 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69584d32c65d44a18e8fa3d9df31cb7b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:52.658569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f0238-eee6-4f52-b631-af44d811dc5c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:52.666130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0372a-6514-4149-a580-19aac1b758eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:52.668695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0372a-6514-4149-a580-19aac1b758eb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:52.669436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0372a-6514-4149-a580-19aac1b758eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:52.669849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0372a-6514-4149-a580-19aac1b758eb admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:52.670709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0372a-6514-4149-a580-19aac1b758eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:52.671837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-69fe7b53-4858-4369-97eb-eda6176f3209 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69584d32c65d44a18e8fa3d9df31cb7b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:52.674685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0372a-6514-4149-a580-19aac1b758eb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:52.682283 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2373/4820] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:52 2021] DELETE /identity/v3/users/69584d32c65d44a18e8fa3d9df31cb7b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:52.686165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe7b53-4858-4369-97eb-eda6176f3209 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:52.689392 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2448/4821] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:52 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:52.693658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0372a-6514-4149-a580-19aac1b758eb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:52.693853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-69fe7b53-4858-4369-97eb-eda6176f3209 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:52.696427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9cc0372a-6514-4149-a580-19aac1b758eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:52.725493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0372a-6514-4149-a580-19aac1b758eb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:52.800666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe7b53-4858-4369-97eb-eda6176f3209 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:52.813884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb5b76-6c24-4ef7-a814-42771038c82e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:52.814817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb5b76-6c24-4ef7-a814-42771038c82e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:52.815243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb5b76-6c24-4ef7-a814-42771038c82e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:52.815534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb5b76-6c24-4ef7-a814-42771038c82e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/05d5ee008c314472a8727f3b845f4b9f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:52.820426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb5b76-6c24-4ef7-a814-42771038c82e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_project(project_id=05d5ee008c314472a8727f3b845f4b9f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:52.822376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb5b76-6c24-4ef7-a814-42771038c82e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:52.848928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561bea6-4e73-44f9-85dd-fb514da8a80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:52.851771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561bea6-4e73-44f9-85dd-fb514da8a80f admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:52.852207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561bea6-4e73-44f9-85dd-fb514da8a80f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:52.852499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561bea6-4e73-44f9-85dd-fb514da8a80f admin admin] PATH_INFO: `/v3/projects/cfda15263a4f4f6a926489afdd4ce449/users/b4f8e189814d43ef8eff3ab3afdb626b/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:52.856160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561bea6-4e73-44f9-85dd-fb514da8a80f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfda15263a4f4f6a926489afdd4ce449, user_id=b4f8e189814d43ef8eff3ab3afdb626b, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:52.860131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561bea6-4e73-44f9-85dd-fb514da8a80f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:52.882357 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2449/4822] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:52 2021] PUT /identity/v3/projects/cfda15263a4f4f6a926489afdd4ce449/users/b4f8e189814d43ef8eff3ab3afdb626b/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:52.895292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a987df-a2f0-4a29-bcdf-64714f30deb6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:52.895588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a987df-a2f0-4a29-bcdf-64714f30deb6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:52.895876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a987df-a2f0-4a29-bcdf-64714f30deb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:52.965307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f2a987df-a2f0-4a29-bcdf-64714f30deb6 None None] MFA Rules not processed for user `b4f8e189814d43ef8eff3ab3afdb626b`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:52.966659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0fbb5b76-6c24-4ef7-a814-42771038c82e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d5ee008c314472a8727f3b845f4b9f', 'request_id': 'req-0fbb5b76-6c24-4ef7-a814-42771038c82e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:52.967064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f2a987df-a2f0-4a29-bcdf-64714f30deb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:52.981381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0fbb5b76-6c24-4ef7-a814-42771038c82e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d5ee008c314472a8727f3b845f4b9f', 'request_id': 'req-0fbb5b76-6c24-4ef7-a814-42771038c82e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:52.999734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0fbb5b76-6c24-4ef7-a814-42771038c82e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d5ee008c314472a8727f3b845f4b9f', 'request_id': 'req-0fbb5b76-6c24-4ef7-a814-42771038c82e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:53.028533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0fbb5b76-6c24-4ef7-a814-42771038c82e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] The token cache is being invalidate because project 05d5ee008c314472a8727f3b845f4b9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:53.029005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0fbb5b76-6c24-4ef7-a814-42771038c82e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:53.030493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0fbb5b76-6c24-4ef7-a814-42771038c82e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:53.039040 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2374/4823] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:52 2021] DELETE /identity/v3/projects/05d5ee008c314472a8727f3b845f4b9f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:53.040502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb5b76-6c24-4ef7-a814-42771038c82e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:53.043536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0fbb5b76-6c24-4ef7-a814-42771038c82e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:53.090440 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2450/4824] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:52 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:53.091536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a987df-a2f0-4a29-bcdf-64714f30deb6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:53.101630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a987df-a2f0-4a29-bcdf-64714f30deb6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:53.108210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a873f8-898d-41f7-933d-dd193eac644f tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f8e189814d43ef8eff3ab3afdb626b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfda15263a4f4f6a926489afdd4ce449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:53.109028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a873f8-898d-41f7-933d-dd193eac644f tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:53.109413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a873f8-898d-41f7-933d-dd193eac644f tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:53.109815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a873f8-898d-41f7-933d-dd193eac644f tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:53.111711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a873f8-898d-41f7-933d-dd193eac644f tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:53.113699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a873f8-898d-41f7-933d-dd193eac644f tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:53.181752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb5b76-6c24-4ef7-a814-42771038c82e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:53.182771 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2451/4825] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:53 2021] POST /identity/v3/projects => generated 359 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:53.190305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a873f8-898d-41f7-933d-dd193eac644f tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:53.206853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c2a873f8-898d-41f7-933d-dd193eac644f tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:53.343620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfc9f4-441a-4d1c-a379-40b41af0e3b2 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:53.344474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfc9f4-441a-4d1c-a379-40b41af0e3b2 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:53.344779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfc9f4-441a-4d1c-a379-40b41af0e3b2 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:53.345250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfc9f4-441a-4d1c-a379-40b41af0e3b2 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:53.345963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfc9f4-441a-4d1c-a379-40b41af0e3b2 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:53.349358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfc9f4-441a-4d1c-a379-40b41af0e3b2 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:53.365306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a873f8-898d-41f7-933d-dd193eac644f tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:53.381644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f387fe-a41b-4cc9-b1cd-c7045b6217b2 tempest-ProjectsNegativeTestJSON-1605230768 tempest-ProjectsNegativeTestJSON-1605230768-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e51f3a2404d74eeda5b7ff5b18796a9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e5d9db3fde4d5b817e632655758b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:53.388764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f387fe-a41b-4cc9-b1cd-c7045b6217b2 tempest-ProjectsNegativeTestJSON-1605230768 tempest-ProjectsNegativeTestJSON-1605230768-project] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:53.389094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f387fe-a41b-4cc9-b1cd-c7045b6217b2 tempest-ProjectsNegativeTestJSON-1605230768 tempest-ProjectsNegativeTestJSON-1605230768-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:53.389347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f387fe-a41b-4cc9-b1cd-c7045b6217b2 tempest-ProjectsNegativeTestJSON-1605230768 tempest-ProjectsNegativeTestJSON-1605230768-project] PATH_INFO: `/v3/projects/91bfe8b1172f41eb8ef83dc0c706c373` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:53.391301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f387fe-a41b-4cc9-b1cd-c7045b6217b2 tempest-ProjectsNegativeTestJSON-1605230768 tempest-ProjectsNegativeTestJSON-1605230768-project] RBAC: Authorizing `identity:delete_project(project_id=91bfe8b1172f41eb8ef83dc0c706c373)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:53.403545 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-79f387fe-a41b-4cc9-b1cd-c7045b6217b2 tempest-ProjectsNegativeTestJSON-1605230768 tempest-ProjectsNegativeTestJSON-1605230768-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Dec 18 21:01:53.405276 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2452/4826] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:53 2021] DELETE /identity/v3/projects/91bfe8b1172f41eb8ef83dc0c706c373 => generated 136 bytes in 217 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Dec 18 21:01:53.411449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f387fe-a41b-4cc9-b1cd-c7045b6217b2 tempest-ProjectsNegativeTestJSON-1605230768 tempest-ProjectsNegativeTestJSON-1605230768-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:53.430328 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2375/4827] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:01:53 2021] POST /identity/v3/projects => generated 328 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:53.434839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfc9f4-441a-4d1c-a379-40b41af0e3b2 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:53.507974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f387fe-a41b-4cc9-b1cd-c7045b6217b2 tempest-ProjectsNegativeTestJSON-1605230768 tempest-ProjectsNegativeTestJSON-1605230768-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:53.585313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfc9f4-441a-4d1c-a379-40b41af0e3b2 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:53.591898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042fc64-0a94-433b-8973-e801d98871e3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:53.593424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042fc64-0a94-433b-8973-e801d98871e3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:53.594053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042fc64-0a94-433b-8973-e801d98871e3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:53.594584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042fc64-0a94-433b-8973-e801d98871e3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:53.595688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042fc64-0a94-433b-8973-e801d98871e3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:53.599310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042fc64-0a94-433b-8973-e801d98871e3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:53.609009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe39ab7-fbbd-4d38-bffd-972162779bdf tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f8e189814d43ef8eff3ab3afdb626b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfda15263a4f4f6a926489afdd4ce449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:53.609903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe39ab7-fbbd-4d38-bffd-972162779bdf tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:53.610187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe39ab7-fbbd-4d38-bffd-972162779bdf tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:53.610506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe39ab7-fbbd-4d38-bffd-972162779bdf tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] PATH_INFO: `/v3/projects/91bfe8b1172f41eb8ef83dc0c706c373` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:53.614705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe39ab7-fbbd-4d38-bffd-972162779bdf tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] RBAC: Authorizing `identity:delete_project(project_id=91bfe8b1172f41eb8ef83dc0c706c373)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:53.621174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe39ab7-fbbd-4d38-bffd-972162779bdf tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:53.638335 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2376/4828] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:53 2021] POST /identity/v3/users => generated 413 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:53.642421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042fc64-0a94-433b-8973-e801d98871e3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:53.659070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042fc64-0a94-433b-8973-e801d98871e3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:53.669278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee07cf-9997-43d6-9410-200b01be7fb4 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:53.670494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee07cf-9997-43d6-9410-200b01be7fb4 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:53.672147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee07cf-9997-43d6-9410-200b01be7fb4 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:53.672147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee07cf-9997-43d6-9410-200b01be7fb4 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:53.673139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee07cf-9997-43d6-9410-200b01be7fb4 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:53.674623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee07cf-9997-43d6-9410-200b01be7fb4 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:53.703352 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2377/4829] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:01:53 2021] POST /identity/v3/roles => generated 244 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:53.706649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3fe39ab7-fbbd-4d38-bffd-972162779bdf tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91bfe8b1172f41eb8ef83dc0c706c373', 'request_id': 'req-3fe39ab7-fbbd-4d38-bffd-972162779bdf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:53.706993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee07cf-9997-43d6-9410-200b01be7fb4 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:53.714232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3fe39ab7-fbbd-4d38-bffd-972162779bdf tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91bfe8b1172f41eb8ef83dc0c706c373', 'request_id': 'req-3fe39ab7-fbbd-4d38-bffd-972162779bdf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:53.730620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee07cf-9997-43d6-9410-200b01be7fb4 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:53.731223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3fe39ab7-fbbd-4d38-bffd-972162779bdf tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91bfe8b1172f41eb8ef83dc0c706c373', 'request_id': 'req-3fe39ab7-fbbd-4d38-bffd-972162779bdf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:53.748352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3fe39ab7-fbbd-4d38-bffd-972162779bdf tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] The token cache is being invalidate because project 91bfe8b1172f41eb8ef83dc0c706c373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:53.748654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3fe39ab7-fbbd-4d38-bffd-972162779bdf tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:53.750639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3fe39ab7-fbbd-4d38-bffd-972162779bdf tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:53.752324 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2453/4830] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:53 2021] DELETE /identity/v3/projects/91bfe8b1172f41eb8ef83dc0c706c373 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:53.756944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe39ab7-fbbd-4d38-bffd-972162779bdf tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:53.762999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3fe39ab7-fbbd-4d38-bffd-972162779bdf tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:53.810872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773aeb6-adb0-4333-95f2-d116c4ca549b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:53.812047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773aeb6-adb0-4333-95f2-d116c4ca549b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:53.812507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773aeb6-adb0-4333-95f2-d116c4ca549b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:53.812791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773aeb6-adb0-4333-95f2-d116c4ca549b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:53.813880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773aeb6-adb0-4333-95f2-d116c4ca549b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:53.815335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773aeb6-adb0-4333-95f2-d116c4ca549b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:53.833966 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2378/4831] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:01:53 2021] POST /identity/v3/roles => generated 247 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:53.834875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773aeb6-adb0-4333-95f2-d116c4ca549b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:53.836465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7773aeb6-adb0-4333-95f2-d116c4ca549b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:53.839763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe39ab7-fbbd-4d38-bffd-972162779bdf tempest-ProjectsNegativeTestJSON-307099979 tempest-ProjectsNegativeTestJSON-307099979-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:53.848059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfface19-ef15-4203-9a16-0fa7447e71b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:53.849007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfface19-ef15-4203-9a16-0fa7447e71b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:53.849266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfface19-ef15-4203-9a16-0fa7447e71b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:53.849584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfface19-ef15-4203-9a16-0fa7447e71b0 admin admin] PATH_INFO: `/v3/users/e51f3a2404d74eeda5b7ff5b18796a9f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:53.851481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfface19-ef15-4203-9a16-0fa7447e71b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e51f3a2404d74eeda5b7ff5b18796a9f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:53.853462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfface19-ef15-4203-9a16-0fa7447e71b0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:53.856649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773aeb6-adb0-4333-95f2-d116c4ca549b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:53.865012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73efa4c-3f12-4bb6-b0e7-801927f9f87c tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:53.866235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73efa4c-3f12-4bb6-b0e7-801927f9f87c tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:53.866732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73efa4c-3f12-4bb6-b0e7-801927f9f87c tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:53.867176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73efa4c-3f12-4bb6-b0e7-801927f9f87c tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/6e09740272884cf2b324a18462a06ae9/users/8cfe03ac50644126b317a9397600fd79/roles/caf8a5458a5b41b99210784e3bb3e28c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:53.890670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73efa4c-3f12-4bb6-b0e7-801927f9f87c tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6e09740272884cf2b324a18462a06ae9, user_id=8cfe03ac50644126b317a9397600fd79, role_id=caf8a5458a5b41b99210784e3bb3e28c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:53.894600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73efa4c-3f12-4bb6-b0e7-801927f9f87c tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:53.911345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cfface19-ef15-4203-9a16-0fa7447e71b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e51f3a2404d74eeda5b7ff5b18796a9f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:53.913066 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2379/4832] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:53 2021] PUT /identity/v3/projects/6e09740272884cf2b324a18462a06ae9/users/8cfe03ac50644126b317a9397600fd79/roles/caf8a5458a5b41b99210784e3bb3e28c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:53.918458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73efa4c-3f12-4bb6-b0e7-801927f9f87c tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:53.921166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cfface19-ef15-4203-9a16-0fa7447e71b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e51f3a2404d74eeda5b7ff5b18796a9f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:53.921963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cfface19-ef15-4203-9a16-0fa7447e71b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e51f3a2404d74eeda5b7ff5b18796a9f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:53.936552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cfface19-ef15-4203-9a16-0fa7447e71b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e51f3a2404d74eeda5b7ff5b18796a9f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:53.959930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cfface19-ef15-4203-9a16-0fa7447e71b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e51f3a2404d74eeda5b7ff5b18796a9f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:53.972205 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2454/4833] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:53 2021] DELETE /identity/v3/users/e51f3a2404d74eeda5b7ff5b18796a9f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:53.973856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803cc7c-6d74-40a1-b0cd-3e7504b2d2d2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:53.974152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803cc7c-6d74-40a1-b0cd-3e7504b2d2d2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:53.974818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803cc7c-6d74-40a1-b0cd-3e7504b2d2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:54.005207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0803cc7c-6d74-40a1-b0cd-3e7504b2d2d2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:54.007138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0803cc7c-6d74-40a1-b0cd-3e7504b2d2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:54.025007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73efa4c-3f12-4bb6-b0e7-801927f9f87c tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:54.090021 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2455/4834] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:01:54.091038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803cc7c-6d74-40a1-b0cd-3e7504b2d2d2 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:54.092443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0803cc7c-6d74-40a1-b0cd-3e7504b2d2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:54.106789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bec4d-6458-4061-b21d-8f679d0f3bcd tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:54.107707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bec4d-6458-4061-b21d-8f679d0f3bcd tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:54.107995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bec4d-6458-4061-b21d-8f679d0f3bcd tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:54.108296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bec4d-6458-4061-b21d-8f679d0f3bcd tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/6e09740272884cf2b324a18462a06ae9/users/8cfe03ac50644126b317a9397600fd79/roles/483c2868ca2044bdb7cf67ee81cdc933` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:54.113657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bec4d-6458-4061-b21d-8f679d0f3bcd tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6e09740272884cf2b324a18462a06ae9, user_id=8cfe03ac50644126b317a9397600fd79, role_id=483c2868ca2044bdb7cf67ee81cdc933)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:54.116591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bec4d-6458-4061-b21d-8f679d0f3bcd tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:54.139781 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2380/4835] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:53 2021] PUT /identity/v3/projects/6e09740272884cf2b324a18462a06ae9/users/8cfe03ac50644126b317a9397600fd79/roles/483c2868ca2044bdb7cf67ee81cdc933 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:54.140693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bec4d-6458-4061-b21d-8f679d0f3bcd tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:54.143222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-819bec4d-6458-4061-b21d-8f679d0f3bcd tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:54.175498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803cc7c-6d74-40a1-b0cd-3e7504b2d2d2 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:54.234640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bfdf6-395f-4aa8-9f73-85cddc6cd27f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:54.235717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bfdf6-395f-4aa8-9f73-85cddc6cd27f service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:54.236225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bfdf6-395f-4aa8-9f73-85cddc6cd27f service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:54.236754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bfdf6-395f-4aa8-9f73-85cddc6cd27f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:54.248118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bec4d-6458-4061-b21d-8f679d0f3bcd tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:54.256077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607a88f-73c0-4d15-b6de-f6c33aaa5036 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:54.256943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607a88f-73c0-4d15-b6de-f6c33aaa5036 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:54.257246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607a88f-73c0-4d15-b6de-f6c33aaa5036 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:54.257662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607a88f-73c0-4d15-b6de-f6c33aaa5036 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:54.258487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607a88f-73c0-4d15-b6de-f6c33aaa5036 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:54.260376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607a88f-73c0-4d15-b6de-f6c33aaa5036 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:54.299160 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2381/4836] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:54 2021] GET /identity/v3/users => generated 8354 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:54.305167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1734856-0652-45ce-8ce1-53d119d67a5c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:54.305167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1734856-0652-45ce-8ce1-53d119d67a5c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:54.305545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1734856-0652-45ce-8ce1-53d119d67a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:54.337973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bfdf6-395f-4aa8-9f73-85cddc6cd27f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:54.340045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bfdf6-395f-4aa8-9f73-85cddc6cd27f service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:54.354564 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2456/4837] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:01:54.360295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b1734856-0652-45ce-8ce1-53d119d67a5c None None] MFA Rules not processed for user `8cfe03ac50644126b317a9397600fd79`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:54.361501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b1734856-0652-45ce-8ce1-53d119d67a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:54.455579 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2382/4838] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:54 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:54.465415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e5158-0378-4cec-ae09-f28ba6f3a92b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:54.466512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e5158-0378-4cec-ae09-f28ba6f3a92b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:54.466951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e5158-0378-4cec-ae09-f28ba6f3a92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:54.493481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-247e5158-0378-4cec-ae09-f28ba6f3a92b None None] MFA Rules not processed for user `8cfe03ac50644126b317a9397600fd79`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:54.494643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-247e5158-0378-4cec-ae09-f28ba6f3a92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:54.504514 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2457/4839] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:54 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:54.508954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1734856-0652-45ce-8ce1-53d119d67a5c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:54.518957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1734856-0652-45ce-8ce1-53d119d67a5c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:54.528562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47461adf-c71c-4532-88fd-53b34bdeff78 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfe03ac50644126b317a9397600fd79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e09740272884cf2b324a18462a06ae9', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1355312823', 'tempest-NotDelegatedRole-2114392033'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:54.529892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47461adf-c71c-4532-88fd-53b34bdeff78 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:54.530190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47461adf-c71c-4532-88fd-53b34bdeff78 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:54.530505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47461adf-c71c-4532-88fd-53b34bdeff78 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:54.531287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47461adf-c71c-4532-88fd-53b34bdeff78 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] RBAC: Authorizing `identity:create_trust()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:54.532950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47461adf-c71c-4532-88fd-53b34bdeff78 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:54.629222 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2383/4840] 10.222.0.13 () {60 vars in 1173 bytes} [Sat Dec 18 21:01:54 2021] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:54.633549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e5158-0378-4cec-ae09-f28ba6f3a92b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:54.644437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e5158-0378-4cec-ae09-f28ba6f3a92b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:54.648671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374a405-52c6-4520-9611-565290a2b26d tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfe03ac50644126b317a9397600fd79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e09740272884cf2b324a18462a06ae9', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1355312823', 'tempest-NotDelegatedRole-2114392033'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:54.649321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a405-52c6-4520-9611-565290a2b26d tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:54.649697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a405-52c6-4520-9611-565290a2b26d tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:54.649861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a405-52c6-4520-9611-565290a2b26d tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:54.650611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374a405-52c6-4520-9611-565290a2b26d tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:54.652150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374a405-52c6-4520-9611-565290a2b26d tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:54.661475 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2458/4841] 10.222.0.13 () {58 vars in 1251 bytes} [Sat Dec 18 21:01:54 2021] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=8cfe03ac50644126b317a9397600fd79 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:54.662898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47461adf-c71c-4532-88fd-53b34bdeff78 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:54.678652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47461adf-c71c-4532-88fd-53b34bdeff78 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:54.684406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fba1b3-4217-4913-b53c-fa80db0d0a55 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfe03ac50644126b317a9397600fd79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e09740272884cf2b324a18462a06ae9', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1355312823', 'tempest-NotDelegatedRole-2114392033'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:54.685379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fba1b3-4217-4913-b53c-fa80db0d0a55 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:54.685944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fba1b3-4217-4913-b53c-fa80db0d0a55 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:54.686435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fba1b3-4217-4913-b53c-fa80db0d0a55 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] PATH_INFO: `/v3/OS-TRUST/trusts/28b3b62fb39b4a67b366696c386ae80c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:54.696237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fba1b3-4217-4913-b53c-fa80db0d0a55 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] RBAC: Authorizing `identity:delete_trust(trust_id=28b3b62fb39b4a67b366696c386ae80c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:54.697946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fba1b3-4217-4913-b53c-fa80db0d0a55 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:54.722493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374a405-52c6-4520-9611-565290a2b26d tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:54.724715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b374a405-52c6-4520-9611-565290a2b26d tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:54.754213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-12fba1b3-4217-4913-b53c-fa80db0d0a55 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '28b3b62fb39b4a67b366696c386ae80c', 'request_id': 'req-12fba1b3-4217-4913-b53c-fa80db0d0a55'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:54.754613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374a405-52c6-4520-9611-565290a2b26d tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:54.755128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-12fba1b3-4217-4913-b53c-fa80db0d0a55 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '28b3b62fb39b4a67b366696c386ae80c', 'request_id': 'req-12fba1b3-4217-4913-b53c-fa80db0d0a55'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:54.756348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-12fba1b3-4217-4913-b53c-fa80db0d0a55 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '28b3b62fb39b4a67b366696c386ae80c', 'request_id': 'req-12fba1b3-4217-4913-b53c-fa80db0d0a55'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:54.761503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d016cae-99fc-463c-b3a0-cd4261bfa71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:54.763175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d016cae-99fc-463c-b3a0-cd4261bfa71d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:54.763570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d016cae-99fc-463c-b3a0-cd4261bfa71d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:54.764429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d016cae-99fc-463c-b3a0-cd4261bfa71d admin admin] PATH_INFO: `/v3/projects/15e5d9db3fde4d5b817e632655758b6f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:54.765267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d016cae-99fc-463c-b3a0-cd4261bfa71d admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e5d9db3fde4d5b817e632655758b6f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:54.767401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d016cae-99fc-463c-b3a0-cd4261bfa71d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:54.782232 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2384/4842] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Dec 18 21:01:54 2021] DELETE /identity/v3/OS-TRUST/trusts/28b3b62fb39b4a67b366696c386ae80c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:54.789818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fba1b3-4217-4913-b53c-fa80db0d0a55 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:54.791503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-12fba1b3-4217-4913-b53c-fa80db0d0a55 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:54.808482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fba1b3-4217-4913-b53c-fa80db0d0a55 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:54.812948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba9a09-aa9a-47c8-9622-b357e81b51c3 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cfe03ac50644126b317a9397600fd79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e09740272884cf2b324a18462a06ae9', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1355312823', 'tempest-NotDelegatedRole-2114392033'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:54.813828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba9a09-aa9a-47c8-9622-b357e81b51c3 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:54.814118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba9a09-aa9a-47c8-9622-b357e81b51c3 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:54.814430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba9a09-aa9a-47c8-9622-b357e81b51c3 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] PATH_INFO: `/v3/OS-TRUST/trusts/28b3b62fb39b4a67b366696c386ae80c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:54.824107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5d016cae-99fc-463c-b3a0-cd4261bfa71d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e5d9db3fde4d5b817e632655758b6f', 'request_id': 'req-5d016cae-99fc-463c-b3a0-cd4261bfa71d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:54.832137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5d016cae-99fc-463c-b3a0-cd4261bfa71d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e5d9db3fde4d5b817e632655758b6f', 'request_id': 'req-5d016cae-99fc-463c-b3a0-cd4261bfa71d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:54.834891 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-9aba9a09-aa9a-47c8-9622-b357e81b51c3 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] Could not find trust: 28b3b62fb39b4a67b366696c386ae80c.: keystone.exception.TrustNotFound: Could not find trust: 28b3b62fb39b4a67b366696c386ae80c. Dec 18 21:01:54.836305 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2385/4843] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:01:54 2021] GET /identity/v3/OS-TRUST/trusts/28b3b62fb39b4a67b366696c386ae80c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:01:54.843353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba9a09-aa9a-47c8-9622-b357e81b51c3 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:54.845509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9aba9a09-aa9a-47c8-9622-b357e81b51c3 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:54.846042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5d016cae-99fc-463c-b3a0-cd4261bfa71d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e5d9db3fde4d5b817e632655758b6f', 'request_id': 'req-5d016cae-99fc-463c-b3a0-cd4261bfa71d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:54.864502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba9a09-aa9a-47c8-9622-b357e81b51c3 tempest-TrustsV3TestJSON-932068300 tempest-user-151298117] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:54.866030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5d016cae-99fc-463c-b3a0-cd4261bfa71d admin admin] The token cache is being invalidate because project 15e5d9db3fde4d5b817e632655758b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:54.866543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5d016cae-99fc-463c-b3a0-cd4261bfa71d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:54.867492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5d016cae-99fc-463c-b3a0-cd4261bfa71d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:54.869129 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2459/4844] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:54 2021] DELETE /identity/v3/projects/15e5d9db3fde4d5b817e632655758b6f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:54.873200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d016cae-99fc-463c-b3a0-cd4261bfa71d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:54.874608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5d016cae-99fc-463c-b3a0-cd4261bfa71d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:54.932480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21d87c-9f91-4c1b-b1d6-6926a67a8378 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:54.933436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21d87c-9f91-4c1b-b1d6-6926a67a8378 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:54.933752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21d87c-9f91-4c1b-b1d6-6926a67a8378 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:54.934226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21d87c-9f91-4c1b-b1d6-6926a67a8378 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles/483c2868ca2044bdb7cf67ee81cdc933` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:54.935804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21d87c-9f91-4c1b-b1d6-6926a67a8378 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_role(role_id=483c2868ca2044bdb7cf67ee81cdc933)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:54.937441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21d87c-9f91-4c1b-b1d6-6926a67a8378 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:54.941640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d016cae-99fc-463c-b3a0-cd4261bfa71d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:54.947796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69464013-79c2-40a8-aa08-5f41077c4372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:54.948769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69464013-79c2-40a8-aa08-5f41077c4372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:54.949553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69464013-79c2-40a8-aa08-5f41077c4372 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:54.949553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69464013-79c2-40a8-aa08-5f41077c4372 admin admin] PATH_INFO: `/v3/users/b4f8e189814d43ef8eff3ab3afdb626b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:54.950594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69464013-79c2-40a8-aa08-5f41077c4372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f8e189814d43ef8eff3ab3afdb626b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:54.952521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69464013-79c2-40a8-aa08-5f41077c4372 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:54.989124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5e21d87c-9f91-4c1b-b1d6-6926a67a8378 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invalidating the token cache because role 483c2868ca2044bdb7cf67ee81cdc933 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:54.989457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5e21d87c-9f91-4c1b-b1d6-6926a67a8378 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:54.990193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5e21d87c-9f91-4c1b-b1d6-6926a67a8378 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:54.994704 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2386/4845] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:54 2021] DELETE /identity/v3/roles/483c2868ca2044bdb7cf67ee81cdc933 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:54.999151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21d87c-9f91-4c1b-b1d6-6926a67a8378 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:55.001239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5e21d87c-9f91-4c1b-b1d6-6926a67a8378 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:55.014431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-69464013-79c2-40a8-aa08-5f41077c4372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f8e189814d43ef8eff3ab3afdb626b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.022939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-69464013-79c2-40a8-aa08-5f41077c4372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f8e189814d43ef8eff3ab3afdb626b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.023965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-69464013-79c2-40a8-aa08-5f41077c4372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f8e189814d43ef8eff3ab3afdb626b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.039388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-69464013-79c2-40a8-aa08-5f41077c4372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f8e189814d43ef8eff3ab3afdb626b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.053623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-69464013-79c2-40a8-aa08-5f41077c4372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f8e189814d43ef8eff3ab3afdb626b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.061716 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2460/4846] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:54 2021] DELETE /identity/v3/users/b4f8e189814d43ef8eff3ab3afdb626b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:55.095421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21d87c-9f91-4c1b-b1d6-6926a67a8378 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:55.204604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8743561-8846-4566-a9ae-b5e590cfed20 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:55.205206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8743561-8846-4566-a9ae-b5e590cfed20 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:55.205528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8743561-8846-4566-a9ae-b5e590cfed20 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:55.205941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8743561-8846-4566-a9ae-b5e590cfed20 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles/caf8a5458a5b41b99210784e3bb3e28c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:55.207872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8743561-8846-4566-a9ae-b5e590cfed20 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_role(role_id=caf8a5458a5b41b99210784e3bb3e28c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:55.209615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8743561-8846-4566-a9ae-b5e590cfed20 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:55.262588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d8743561-8846-4566-a9ae-b5e590cfed20 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invalidating the token cache because role caf8a5458a5b41b99210784e3bb3e28c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:55.263268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d8743561-8846-4566-a9ae-b5e590cfed20 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.264162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d8743561-8846-4566-a9ae-b5e590cfed20 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.267642 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2387/4847] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:54 2021] DELETE /identity/v3/roles/caf8a5458a5b41b99210784e3bb3e28c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:55.272728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69464013-79c2-40a8-aa08-5f41077c4372 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:55.274909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-69464013-79c2-40a8-aa08-5f41077c4372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:55.300889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69464013-79c2-40a8-aa08-5f41077c4372 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:55.381119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8743561-8846-4566-a9ae-b5e590cfed20 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:55.383024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d8743561-8846-4566-a9ae-b5e590cfed20 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:55.408580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be009ba3-fe7f-43ee-ab2b-e8921cddba51 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:55.411137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be009ba3-fe7f-43ee-ab2b-e8921cddba51 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:55.412665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be009ba3-fe7f-43ee-ab2b-e8921cddba51 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:55.412948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be009ba3-fe7f-43ee-ab2b-e8921cddba51 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users/8cfe03ac50644126b317a9397600fd79` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:55.416645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be009ba3-fe7f-43ee-ab2b-e8921cddba51 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8cfe03ac50644126b317a9397600fd79)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:55.421066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be009ba3-fe7f-43ee-ab2b-e8921cddba51 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:55.483089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-be009ba3-fe7f-43ee-ab2b-e8921cddba51 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cfe03ac50644126b317a9397600fd79'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.496981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8743561-8846-4566-a9ae-b5e590cfed20 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:55.503425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-be009ba3-fe7f-43ee-ab2b-e8921cddba51 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cfe03ac50644126b317a9397600fd79'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.504147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-be009ba3-fe7f-43ee-ab2b-e8921cddba51 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cfe03ac50644126b317a9397600fd79'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.517134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f47cda-41fd-4bad-a4ed-e5edf3c3f58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:55.518360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f47cda-41fd-4bad-a4ed-e5edf3c3f58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:55.518830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-be009ba3-fe7f-43ee-ab2b-e8921cddba51 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cfe03ac50644126b317a9397600fd79'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.520297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f47cda-41fd-4bad-a4ed-e5edf3c3f58d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:55.520297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f47cda-41fd-4bad-a4ed-e5edf3c3f58d admin admin] PATH_INFO: `/v3/users/79d04306b7d24e96bfb99a2707d24695` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:55.523880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f47cda-41fd-4bad-a4ed-e5edf3c3f58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d04306b7d24e96bfb99a2707d24695)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:55.534188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-be009ba3-fe7f-43ee-ab2b-e8921cddba51 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cfe03ac50644126b317a9397600fd79'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.537678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f47cda-41fd-4bad-a4ed-e5edf3c3f58d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:55.551962 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2461/4848] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:55 2021] DELETE /identity/v3/users/8cfe03ac50644126b317a9397600fd79 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:55.551962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be009ba3-fe7f-43ee-ab2b-e8921cddba51 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:55.552782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-be009ba3-fe7f-43ee-ab2b-e8921cddba51 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:55.626415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f5f47cda-41fd-4bad-a4ed-e5edf3c3f58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d04306b7d24e96bfb99a2707d24695'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.639739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f5f47cda-41fd-4bad-a4ed-e5edf3c3f58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d04306b7d24e96bfb99a2707d24695'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.652895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f5f47cda-41fd-4bad-a4ed-e5edf3c3f58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d04306b7d24e96bfb99a2707d24695'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.654114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f5f47cda-41fd-4bad-a4ed-e5edf3c3f58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d04306b7d24e96bfb99a2707d24695'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.666417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f5f47cda-41fd-4bad-a4ed-e5edf3c3f58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d04306b7d24e96bfb99a2707d24695'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.674919 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2388/4849] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:55 2021] DELETE /identity/v3/users/79d04306b7d24e96bfb99a2707d24695 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:55.676082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f47cda-41fd-4bad-a4ed-e5edf3c3f58d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:55.678017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f5f47cda-41fd-4bad-a4ed-e5edf3c3f58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:55.706002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be009ba3-fe7f-43ee-ab2b-e8921cddba51 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:55.796520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7e3b6-dc89-4c6b-a310-2398d4fdfae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:55.797451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7e3b6-dc89-4c6b-a310-2398d4fdfae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:55.797993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7e3b6-dc89-4c6b-a310-2398d4fdfae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:55.800031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7e3b6-dc89-4c6b-a310-2398d4fdfae5 admin admin] PATH_INFO: `/v3/projects/cfda15263a4f4f6a926489afdd4ce449` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:55.801414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7e3b6-dc89-4c6b-a310-2398d4fdfae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfda15263a4f4f6a926489afdd4ce449)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:55.804941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7e3b6-dc89-4c6b-a310-2398d4fdfae5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:55.865626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f47cda-41fd-4bad-a4ed-e5edf3c3f58d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:55.896435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dcf7e3b6-dc89-4c6b-a310-2398d4fdfae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfda15263a4f4f6a926489afdd4ce449', 'request_id': 'req-dcf7e3b6-dc89-4c6b-a310-2398d4fdfae5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.913472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dcf7e3b6-dc89-4c6b-a310-2398d4fdfae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfda15263a4f4f6a926489afdd4ce449', 'request_id': 'req-dcf7e3b6-dc89-4c6b-a310-2398d4fdfae5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.938610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dcf7e3b6-dc89-4c6b-a310-2398d4fdfae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfda15263a4f4f6a926489afdd4ce449', 'request_id': 'req-dcf7e3b6-dc89-4c6b-a310-2398d4fdfae5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.954682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dcf7e3b6-dc89-4c6b-a310-2398d4fdfae5 admin admin] The token cache is being invalidate because project cfda15263a4f4f6a926489afdd4ce449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:55.955354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dcf7e3b6-dc89-4c6b-a310-2398d4fdfae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.957219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dcf7e3b6-dc89-4c6b-a310-2398d4fdfae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:55.962683 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2462/4850] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:55 2021] DELETE /identity/v3/projects/cfda15263a4f4f6a926489afdd4ce449 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:55.962880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37835fb-5d63-4bb2-95ec-20120164a542 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:55.963071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37835fb-5d63-4bb2-95ec-20120164a542 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:55.963302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37835fb-5d63-4bb2-95ec-20120164a542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:55.985285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c37835fb-5d63-4bb2-95ec-20120164a542 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:55.987605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c37835fb-5d63-4bb2-95ec-20120164a542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:55.993578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c69f4-2758-4207-a2f4-d5dc007e2aad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:55.994861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c69f4-2758-4207-a2f4-d5dc007e2aad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:55.996124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c69f4-2758-4207-a2f4-d5dc007e2aad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:55.996624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c69f4-2758-4207-a2f4-d5dc007e2aad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/6e09740272884cf2b324a18462a06ae9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:55.998507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c69f4-2758-4207-a2f4-d5dc007e2aad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6e09740272884cf2b324a18462a06ae9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:56.001108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c69f4-2758-4207-a2f4-d5dc007e2aad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:56.066550 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2463/4851] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:56.068038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a01b2-4a7b-4a2c-875f-4b89835205c8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:56.073238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a01b2-4a7b-4a2c-875f-4b89835205c8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:56.073238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a01b2-4a7b-4a2c-875f-4b89835205c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:56.097864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-737a01b2-4a7b-4a2c-875f-4b89835205c8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:56.099487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-737a01b2-4a7b-4a2c-875f-4b89835205c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:56.103505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-961c69f4-2758-4207-a2f4-d5dc007e2aad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e09740272884cf2b324a18462a06ae9', 'request_id': 'req-961c69f4-2758-4207-a2f4-d5dc007e2aad'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:56.118302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-961c69f4-2758-4207-a2f4-d5dc007e2aad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e09740272884cf2b324a18462a06ae9', 'request_id': 'req-961c69f4-2758-4207-a2f4-d5dc007e2aad'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:56.128619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-961c69f4-2758-4207-a2f4-d5dc007e2aad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e09740272884cf2b324a18462a06ae9', 'request_id': 'req-961c69f4-2758-4207-a2f4-d5dc007e2aad'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:56.149108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-961c69f4-2758-4207-a2f4-d5dc007e2aad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] The token cache is being invalidate because project 6e09740272884cf2b324a18462a06ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:56.149461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-961c69f4-2758-4207-a2f4-d5dc007e2aad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:56.152242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-961c69f4-2758-4207-a2f4-d5dc007e2aad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:56.153968 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2389/4852] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:55 2021] DELETE /identity/v3/projects/6e09740272884cf2b324a18462a06ae9 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:56.158572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c69f4-2758-4207-a2f4-d5dc007e2aad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:56.160207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-961c69f4-2758-4207-a2f4-d5dc007e2aad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:56.201022 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2464/4853] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:56.202784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a01b2-4a7b-4a2c-875f-4b89835205c8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:56.204241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-737a01b2-4a7b-4a2c-875f-4b89835205c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:56.242197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c69f4-2758-4207-a2f4-d5dc007e2aad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:56.252380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3b306-6e47-4d28-b982-fdd8cb29ee66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:56.253074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3b306-6e47-4d28-b982-fdd8cb29ee66 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:56.255132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3b306-6e47-4d28-b982-fdd8cb29ee66 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:56.255446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3b306-6e47-4d28-b982-fdd8cb29ee66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:56.258765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-68f3b306-6e47-4d28-b982-fdd8cb29ee66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:56.281871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3b306-6e47-4d28-b982-fdd8cb29ee66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:56.284601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3b306-6e47-4d28-b982-fdd8cb29ee66 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:56.286381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a01b2-4a7b-4a2c-875f-4b89835205c8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:56.291790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e5ce7-c332-4e5d-b626-339a0cda0ddf tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:56.293122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e5ce7-c332-4e5d-b626-339a0cda0ddf tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:56.293419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e5ce7-c332-4e5d-b626-339a0cda0ddf tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:56.293779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e5ce7-c332-4e5d-b626-339a0cda0ddf tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:56.294591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e5ce7-c332-4e5d-b626-339a0cda0ddf tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:56.297825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e5ce7-c332-4e5d-b626-339a0cda0ddf tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:56.310442 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2390/4854] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:01:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:01:56.312272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81e6a6-53cb-44c8-92eb-a3eef83bb938 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:56.312576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81e6a6-53cb-44c8-92eb-a3eef83bb938 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:56.312857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81e6a6-53cb-44c8-92eb-a3eef83bb938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:56.340477 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2465/4855] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:01:56 2021] POST /identity/v3/projects => generated 329 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:56.341818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e5ce7-c332-4e5d-b626-339a0cda0ddf tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:56.362041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5d81e6a6-53cb-44c8-92eb-a3eef83bb938 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:56.363338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5d81e6a6-53cb-44c8-92eb-a3eef83bb938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:56.456988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e5ce7-c332-4e5d-b626-339a0cda0ddf tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:56.461032 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2391/4856] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:56.465759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81e6a6-53cb-44c8-92eb-a3eef83bb938 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:56.468198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da8436-ace9-4e07-80d5-6041bf48627e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:56.469172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da8436-ace9-4e07-80d5-6041bf48627e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:56.469776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da8436-ace9-4e07-80d5-6041bf48627e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:56.470319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da8436-ace9-4e07-80d5-6041bf48627e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:56.471523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da8436-ace9-4e07-80d5-6041bf48627e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:56.474502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da8436-ace9-4e07-80d5-6041bf48627e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:56.477509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81e6a6-53cb-44c8-92eb-a3eef83bb938 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:56.485924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c33fa-eb18-44fa-af56-7cf827698148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:56.486866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c33fa-eb18-44fa-af56-7cf827698148 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:56.487225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c33fa-eb18-44fa-af56-7cf827698148 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:56.487651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c33fa-eb18-44fa-af56-7cf827698148 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:56.488512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c33fa-eb18-44fa-af56-7cf827698148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:01:56.488826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c33fa-eb18-44fa-af56-7cf827698148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:56.492157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c33fa-eb18-44fa-af56-7cf827698148 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:56.515206 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2466/4857] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:56 2021] POST /identity/v3/users => generated 416 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:56.517487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da8436-ace9-4e07-80d5-6041bf48627e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:56.522438 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2392/4858] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:01:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:01:56.523541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c33fa-eb18-44fa-af56-7cf827698148 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:56.537443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c33fa-eb18-44fa-af56-7cf827698148 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:56.544346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da8436-ace9-4e07-80d5-6041bf48627e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:56.545677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd954652-04cf-487a-ba80-64332f25e751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:56.547336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd954652-04cf-487a-ba80-64332f25e751 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:56.547715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd954652-04cf-487a-ba80-64332f25e751 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:56.548235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd954652-04cf-487a-ba80-64332f25e751 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:56.549145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd954652-04cf-487a-ba80-64332f25e751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:56.551397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd954652-04cf-487a-ba80-64332f25e751 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:56.551844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812de01a-0cd4-493b-bbeb-5ee30589486f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:56.552689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812de01a-0cd4-493b-bbeb-5ee30589486f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:56.553281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812de01a-0cd4-493b-bbeb-5ee30589486f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:56.553817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812de01a-0cd4-493b-bbeb-5ee30589486f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:56.555020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812de01a-0cd4-493b-bbeb-5ee30589486f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:56.557059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812de01a-0cd4-493b-bbeb-5ee30589486f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:56.594639 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2393/4859] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:56 2021] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:56.601614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd954652-04cf-487a-ba80-64332f25e751 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:56.605360 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2467/4860] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:01:56 2021] POST /identity/v3/roles => generated 244 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:56.608653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812de01a-0cd4-493b-bbeb-5ee30589486f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:56.625051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812de01a-0cd4-493b-bbeb-5ee30589486f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:56.699137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd954652-04cf-487a-ba80-64332f25e751 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:56.705632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fc1e0-59a4-4a1e-8604-4f40dc8ed761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:56.706774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fc1e0-59a4-4a1e-8604-4f40dc8ed761 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:56.707560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fc1e0-59a4-4a1e-8604-4f40dc8ed761 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:56.708377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fc1e0-59a4-4a1e-8604-4f40dc8ed761 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:56.709891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fc1e0-59a4-4a1e-8604-4f40dc8ed761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:56.717891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fc1e0-59a4-4a1e-8604-4f40dc8ed761 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:56.744544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2429983-9982-4cdb-baa4-7d62c95c8cb2 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:56.746055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2429983-9982-4cdb-baa4-7d62c95c8cb2 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:56.747035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2429983-9982-4cdb-baa4-7d62c95c8cb2 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:56.747435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2429983-9982-4cdb-baa4-7d62c95c8cb2 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:56.748697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2429983-9982-4cdb-baa4-7d62c95c8cb2 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:56.759462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2429983-9982-4cdb-baa4-7d62c95c8cb2 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:56.759591 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2394/4861] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:56 2021] POST /identity/v3/users => generated 285 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:56.759591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fc1e0-59a4-4a1e-8604-4f40dc8ed761 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:56.777098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fc1e0-59a4-4a1e-8604-4f40dc8ed761 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:56.784085 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2468/4862] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:01:56 2021] POST /identity/v3/roles => generated 247 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:01:56.788960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2429983-9982-4cdb-baa4-7d62c95c8cb2 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:56.797665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaca846-4ea0-49c9-b828-ff1604ba57f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:56.798391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaca846-4ea0-49c9-b828-ff1604ba57f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:56.798680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaca846-4ea0-49c9-b828-ff1604ba57f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:56.798961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaca846-4ea0-49c9-b828-ff1604ba57f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:56.799709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaca846-4ea0-49c9-b828-ff1604ba57f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:56.801303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaca846-4ea0-49c9-b828-ff1604ba57f0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:56.802986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2429983-9982-4cdb-baa4-7d62c95c8cb2 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:56.808688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec3583-581d-4dcf-857f-bfa82bee811a tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:56.809600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec3583-581d-4dcf-857f-bfa82bee811a tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:56.809877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec3583-581d-4dcf-857f-bfa82bee811a tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:56.810245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec3583-581d-4dcf-857f-bfa82bee811a tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/d73e30489db94158a9fc1ae8f1bc8a2e/users/8ee27d08098048f7ad0a22c642d0b111/roles/7dee8328de6d4848901e7894ccce916b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:56.824361 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2395/4863] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:56 2021] GET /identity/v3/roles => generated 1893 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:56.828006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaca846-4ea0-49c9-b828-ff1604ba57f0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:56.828417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec3583-581d-4dcf-857f-bfa82bee811a tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d73e30489db94158a9fc1ae8f1bc8a2e, user_id=8ee27d08098048f7ad0a22c642d0b111, role_id=7dee8328de6d4848901e7894ccce916b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:56.831250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec3583-581d-4dcf-857f-bfa82bee811a tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:56.848818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaca846-4ea0-49c9-b828-ff1604ba57f0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:56.851098 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2469/4864] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:56 2021] PUT /identity/v3/projects/d73e30489db94158a9fc1ae8f1bc8a2e/users/8ee27d08098048f7ad0a22c642d0b111/roles/7dee8328de6d4848901e7894ccce916b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:01:56.855473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec3583-581d-4dcf-857f-bfa82bee811a tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:56.960367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ac382-95ee-4f13-830a-0919d48bd8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:56.961522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ac382-95ee-4f13-830a-0919d48bd8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:56.962009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ac382-95ee-4f13-830a-0919d48bd8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:56.962510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ac382-95ee-4f13-830a-0919d48bd8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:56.963619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ac382-95ee-4f13-830a-0919d48bd8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:56.968038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ac382-95ee-4f13-830a-0919d48bd8e9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:56.972839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec3583-581d-4dcf-857f-bfa82bee811a tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:56.979465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341aef12-93fd-4332-92ac-8f5d038c04be tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:56.980465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aef12-93fd-4332-92ac-8f5d038c04be tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:56.980954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aef12-93fd-4332-92ac-8f5d038c04be tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:56.981089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aef12-93fd-4332-92ac-8f5d038c04be tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/d73e30489db94158a9fc1ae8f1bc8a2e/users/8ee27d08098048f7ad0a22c642d0b111/roles/dd484db903c649afb40c4d7ec9a9ae64` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:56.981642 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2396/4865] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:56 2021] GET /identity/v3/roles => generated 1893 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:01:56.982699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ac382-95ee-4f13-830a-0919d48bd8e9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:56.984234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341aef12-93fd-4332-92ac-8f5d038c04be tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d73e30489db94158a9fc1ae8f1bc8a2e, user_id=8ee27d08098048f7ad0a22c642d0b111, role_id=dd484db903c649afb40c4d7ec9a9ae64)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:56.985838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0f3ac382-95ee-4f13-830a-0919d48bd8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:56.988307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341aef12-93fd-4332-92ac-8f5d038c04be tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:57.004570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ac382-95ee-4f13-830a-0919d48bd8e9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:57.010357 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2470/4866] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:56 2021] PUT /identity/v3/projects/d73e30489db94158a9fc1ae8f1bc8a2e/users/8ee27d08098048f7ad0a22c642d0b111/roles/dd484db903c649afb40c4d7ec9a9ae64 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:57.011966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341aef12-93fd-4332-92ac-8f5d038c04be tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:57.128554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341aef12-93fd-4332-92ac-8f5d038c04be tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:57.132082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821b99d-501d-4e52-a8b8-14e294a1bd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:57.135570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821b99d-501d-4e52-a8b8-14e294a1bd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:57.136327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821b99d-501d-4e52-a8b8-14e294a1bd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:57.136740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821b99d-501d-4e52-a8b8-14e294a1bd89 admin admin] PATH_INFO: `/v3/projects/ac3feffe1ea94b838e64069470ea9862` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:57.139187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821b99d-501d-4e52-a8b8-14e294a1bd89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac3feffe1ea94b838e64069470ea9862)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:57.140503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821b99d-501d-4e52-a8b8-14e294a1bd89 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:57.140874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375876a2-b4df-4e5f-9159-cbc7c921c50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:57.141848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375876a2-b4df-4e5f-9159-cbc7c921c50b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:57.142124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375876a2-b4df-4e5f-9159-cbc7c921c50b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:57.142441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375876a2-b4df-4e5f-9159-cbc7c921c50b admin admin] PATH_INFO: `/v3/projects/ba29f82fb5704cd6a83680a442fcf04a/users/9f088bde04c34e53bf2748e612592ef9/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:57.171970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375876a2-b4df-4e5f-9159-cbc7c921c50b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba29f82fb5704cd6a83680a442fcf04a, user_id=9f088bde04c34e53bf2748e612592ef9, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:57.175333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375876a2-b4df-4e5f-9159-cbc7c921c50b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:57.209069 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2471/4867] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:57 2021] PUT /identity/v3/projects/ba29f82fb5704cd6a83680a442fcf04a/users/9f088bde04c34e53bf2748e612592ef9/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:57.209069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375876a2-b4df-4e5f-9159-cbc7c921c50b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:57.216783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7821b99d-501d-4e52-a8b8-14e294a1bd89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac3feffe1ea94b838e64069470ea9862', 'request_id': 'req-7821b99d-501d-4e52-a8b8-14e294a1bd89'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:57.236483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7821b99d-501d-4e52-a8b8-14e294a1bd89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac3feffe1ea94b838e64069470ea9862', 'request_id': 'req-7821b99d-501d-4e52-a8b8-14e294a1bd89'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:57.253652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7821b99d-501d-4e52-a8b8-14e294a1bd89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac3feffe1ea94b838e64069470ea9862', 'request_id': 'req-7821b99d-501d-4e52-a8b8-14e294a1bd89'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:57.268407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7821b99d-501d-4e52-a8b8-14e294a1bd89 admin admin] The token cache is being invalidate because project ac3feffe1ea94b838e64069470ea9862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:57.268788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7821b99d-501d-4e52-a8b8-14e294a1bd89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:57.270138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7821b99d-501d-4e52-a8b8-14e294a1bd89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:57.271931 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2397/4868] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:56 2021] DELETE /identity/v3/projects/ac3feffe1ea94b838e64069470ea9862 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:57.273292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdcf6b-ae51-477a-82c8-95b278cec4cb None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:57.273589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdcf6b-ae51-477a-82c8-95b278cec4cb None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:57.273882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdcf6b-ae51-477a-82c8-95b278cec4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:57.300416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375876a2-b4df-4e5f-9159-cbc7c921c50b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:57.304390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-57fdcf6b-ae51-477a-82c8-95b278cec4cb None None] MFA Rules not processed for user `9f088bde04c34e53bf2748e612592ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:57.305628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-57fdcf6b-ae51-477a-82c8-95b278cec4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:57.371105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fe2ae-735c-4cc8-b6e8-2007b84ec3ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:57.372128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fe2ae-735c-4cc8-b6e8-2007b84ec3ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:57.372729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fe2ae-735c-4cc8-b6e8-2007b84ec3ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:57.373020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fe2ae-735c-4cc8-b6e8-2007b84ec3ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:57.373678 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2398/4869] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:57 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:57.373926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fe2ae-735c-4cc8-b6e8-2007b84ec3ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:57.375001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a9a54-fdf3-4668-91ef-9a1f735cf492 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:57.375299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a9a54-fdf3-4668-91ef-9a1f735cf492 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:57.375582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a9a54-fdf3-4668-91ef-9a1f735cf492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:57.375824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fe2ae-735c-4cc8-b6e8-2007b84ec3ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:57.394243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6f6a9a54-fdf3-4668-91ef-9a1f735cf492 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:57.395473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6f6a9a54-fdf3-4668-91ef-9a1f735cf492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:57.420169 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2472/4870] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:57 2021] GET /identity/v3/users => generated 8067 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:57.420169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fe2ae-735c-4cc8-b6e8-2007b84ec3ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:57.422979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ae0fe2ae-735c-4cc8-b6e8-2007b84ec3ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:57.460345 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2399/4871] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:57.461477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40ec5b-264d-4bb6-ab37-89d15065a3c0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:57.461771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40ec5b-264d-4bb6-ab37-89d15065a3c0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:57.462058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40ec5b-264d-4bb6-ab37-89d15065a3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:57.515057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0e40ec5b-264d-4bb6-ab37-89d15065a3c0 None None] MFA Rules not processed for user `8ee27d08098048f7ad0a22c642d0b111`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:57.515231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fe2ae-735c-4cc8-b6e8-2007b84ec3ac tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:57.516991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0e40ec5b-264d-4bb6-ab37-89d15065a3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:57.522458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e10f1-b495-4d13-b137-c2a0871cc0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:57.522458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e10f1-b495-4d13-b137-c2a0871cc0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:57.522458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e10f1-b495-4d13-b137-c2a0871cc0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:57.522458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e10f1-b495-4d13-b137-c2a0871cc0b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:57.523107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e10f1-b495-4d13-b137-c2a0871cc0b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:57.525055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e10f1-b495-4d13-b137-c2a0871cc0b1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:57.554662 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2473/4872] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:57 2021] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:57.559200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914301cc-43bc-4272-bcf4-b9b20a3d7b14 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:57.559492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914301cc-43bc-4272-bcf4-b9b20a3d7b14 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:57.559824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914301cc-43bc-4272-bcf4-b9b20a3d7b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:57.579407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-914301cc-43bc-4272-bcf4-b9b20a3d7b14 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:57.580813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-914301cc-43bc-4272-bcf4-b9b20a3d7b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:57.585348 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2400/4873] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:57 2021] POST /identity/v3/auth/tokens => generated 3271 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:57.591144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40ec5b-264d-4bb6-ab37-89d15065a3c0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:57.603330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40ec5b-264d-4bb6-ab37-89d15065a3c0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:57.666803 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2474/4874] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:57.667788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9a115-d018-47bd-804c-4c4f040a2765 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:57.668080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9a115-d018-47bd-804c-4c4f040a2765 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:57.668360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9a115-d018-47bd-804c-4c4f040a2765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:57.678547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c6259-4a90-478b-85be-5567cc63dd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:57.679321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c6259-4a90-478b-85be-5567cc63dd5d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:57.679718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c6259-4a90-478b-85be-5567cc63dd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:57.680111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c6259-4a90-478b-85be-5567cc63dd5d admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:57.680849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c6259-4a90-478b-85be-5567cc63dd5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:57.682675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c6259-4a90-478b-85be-5567cc63dd5d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:57.689700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-77e9a115-d018-47bd-804c-4c4f040a2765 None None] MFA Rules not processed for user `8ee27d08098048f7ad0a22c642d0b111`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:57.691069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-77e9a115-d018-47bd-804c-4c4f040a2765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:57.710004 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2401/4875] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:57 2021] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:57.710004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c6259-4a90-478b-85be-5567cc63dd5d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:57.723526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c6259-4a90-478b-85be-5567cc63dd5d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:57.732232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25be5c-c21e-4808-9e68-9029083b1547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:57.733976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25be5c-c21e-4808-9e68-9029083b1547 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:57.734943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25be5c-c21e-4808-9e68-9029083b1547 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:57.735548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25be5c-c21e-4808-9e68-9029083b1547 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:57.736450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25be5c-c21e-4808-9e68-9029083b1547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:01:57.736769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25be5c-c21e-4808-9e68-9029083b1547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:57.738495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25be5c-c21e-4808-9e68-9029083b1547 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:57.755593 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2402/4876] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:01:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:57.756505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25be5c-c21e-4808-9e68-9029083b1547 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:57.770488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25be5c-c21e-4808-9e68-9029083b1547 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:57.775287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63036d-cdc1-4493-b231-f3197a4d4535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:57.776037 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2475/4877] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:57 2021] POST /identity/v3/auth/tokens => generated 3271 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:57.776204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63036d-cdc1-4493-b231-f3197a4d4535 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:57.776546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63036d-cdc1-4493-b231-f3197a4d4535 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:57.776894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63036d-cdc1-4493-b231-f3197a4d4535 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:57.777774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63036d-cdc1-4493-b231-f3197a4d4535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:57.779508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63036d-cdc1-4493-b231-f3197a4d4535 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:57.780169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9a115-d018-47bd-804c-4c4f040a2765 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:57.794714 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2403/4878] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:57 2021] GET /identity/v3/roles => generated 1893 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:57.794714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63036d-cdc1-4493-b231-f3197a4d4535 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:57.796272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9a115-d018-47bd-804c-4c4f040a2765 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:57.804507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cf019-e64d-4a78-ae5f-b1a52cd02a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:57.805253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cf019-e64d-4a78-ae5f-b1a52cd02a25 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:57.805609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cf019-e64d-4a78-ae5f-b1a52cd02a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:57.805740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63036d-cdc1-4493-b231-f3197a4d4535 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:57.806096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cf019-e64d-4a78-ae5f-b1a52cd02a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:57.806907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cf019-e64d-4a78-ae5f-b1a52cd02a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:57.809505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cf019-e64d-4a78-ae5f-b1a52cd02a25 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:57.813095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f6594-f726-48fe-8bd3-2958b6f0185f tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee27d08098048f7ad0a22c642d0b111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd73e30489db94158a9fc1ae8f1bc8a2e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1877072164', 'tempest-NotDelegatedRole-1081713531'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:57.814101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f6594-f726-48fe-8bd3-2958b6f0185f tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:57.814513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f6594-f726-48fe-8bd3-2958b6f0185f tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:57.814798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f6594-f726-48fe-8bd3-2958b6f0185f tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:57.815553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f6594-f726-48fe-8bd3-2958b6f0185f tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: Authorizing `identity:create_trust()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:57.817396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f6594-f726-48fe-8bd3-2958b6f0185f tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:57.843478 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2476/4879] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:57 2021] POST /identity/v3/projects => generated 403 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:57.844447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cf019-e64d-4a78-ae5f-b1a52cd02a25 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:57.898370 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2404/4880] 10.222.0.13 () {60 vars in 1173 bytes} [Sat Dec 18 21:01:57 2021] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:57.898370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f6594-f726-48fe-8bd3-2958b6f0185f tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:57.909563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f6594-f726-48fe-8bd3-2958b6f0185f tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:57.915490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be9770-4bd6-48da-994a-7b824c9378c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:57.919211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be9770-4bd6-48da-994a-7b824c9378c5 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:57.919211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be9770-4bd6-48da-994a-7b824c9378c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:57.919398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cf019-e64d-4a78-ae5f-b1a52cd02a25 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:57.919496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be9770-4bd6-48da-994a-7b824c9378c5 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:57.919496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be9770-4bd6-48da-994a-7b824c9378c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:57.919715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be9770-4bd6-48da-994a-7b824c9378c5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:57.924955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d0c18-ef75-4ded-9aaa-0906a32a8aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:57.925948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d0c18-ef75-4ded-9aaa-0906a32a8aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:57.926419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d0c18-ef75-4ded-9aaa-0906a32a8aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:57.926960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d0c18-ef75-4ded-9aaa-0906a32a8aaa admin admin] PATH_INFO: `/v3/projects/2025ca53caac413293464a79bebece1a/users/b05218dd6d84464abeda2300ba5dc8fa/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:57.945909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d0c18-ef75-4ded-9aaa-0906a32a8aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2025ca53caac413293464a79bebece1a, user_id=b05218dd6d84464abeda2300ba5dc8fa, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:57.949138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d0c18-ef75-4ded-9aaa-0906a32a8aaa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:57.953252 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2405/4881] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:57 2021] POST /identity/v3/users => generated 302 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:57.954362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be9770-4bd6-48da-994a-7b824c9378c5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:57.970061 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2477/4882] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:57 2021] PUT /identity/v3/projects/2025ca53caac413293464a79bebece1a/users/b05218dd6d84464abeda2300ba5dc8fa/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:57.971309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d0c18-ef75-4ded-9aaa-0906a32a8aaa admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.026547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be9770-4bd6-48da-994a-7b824c9378c5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.041644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d0c18-ef75-4ded-9aaa-0906a32a8aaa admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.048081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4198d-1974-4dd8-94eb-85079f9c0b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.048897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4198d-1974-4dd8-94eb-85079f9c0b6a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.049353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4198d-1974-4dd8-94eb-85079f9c0b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.049733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4198d-1974-4dd8-94eb-85079f9c0b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.050724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4198d-1974-4dd8-94eb-85079f9c0b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.052943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4198d-1974-4dd8-94eb-85079f9c0b6a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.067063 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2478/4883] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:57 2021] GET /identity/v3/roles => generated 1893 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:58.077138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4198d-1974-4dd8-94eb-85079f9c0b6a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.100796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4198d-1974-4dd8-94eb-85079f9c0b6a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.106731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8e0b0-d4e9-44c6-b1c9-0323c93a4e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.107485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8e0b0-d4e9-44c6-b1c9-0323c93a4e53 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.107843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8e0b0-d4e9-44c6-b1c9-0323c93a4e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.108193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8e0b0-d4e9-44c6-b1c9-0323c93a4e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.109452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8e0b0-d4e9-44c6-b1c9-0323c93a4e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.110802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8e0b0-d4e9-44c6-b1c9-0323c93a4e53 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.116794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba013f-d30b-4d37-9639-5ce47dfa40de tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee27d08098048f7ad0a22c642d0b111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd73e30489db94158a9fc1ae8f1bc8a2e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1877072164', 'tempest-NotDelegatedRole-1081713531'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.117790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba013f-d30b-4d37-9639-5ce47dfa40de tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.118079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba013f-d30b-4d37-9639-5ce47dfa40de tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.118476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba013f-d30b-4d37-9639-5ce47dfa40de tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] PATH_INFO: `/v3/OS-TRUST/trusts/b025cdff4bf448889a85da3df1a4c2b8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.124398 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2479/4884] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:58 2021] GET /identity/v3/roles => generated 1893 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:58.125258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8e0b0-d4e9-44c6-b1c9-0323c93a4e53 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.126068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba013f-d30b-4d37-9639-5ce47dfa40de tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: Authorizing `identity:get_trust(trust_id=b025cdff4bf448889a85da3df1a4c2b8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.127985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba013f-d30b-4d37-9639-5ce47dfa40de tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.135927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8e0b0-d4e9-44c6-b1c9-0323c93a4e53 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.136329 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2406/4885] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:01:57 2021] GET /identity/v3/OS-TRUST/trusts/b025cdff4bf448889a85da3df1a4c2b8 => generated 859 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:58.137215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba013f-d30b-4d37-9639-5ce47dfa40de tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.142282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd8615-37ae-4048-80fc-0dae0cedb021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.143030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd8615-37ae-4048-80fc-0dae0cedb021 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.143314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd8615-37ae-4048-80fc-0dae0cedb021 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.143597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd8615-37ae-4048-80fc-0dae0cedb021 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.144361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd8615-37ae-4048-80fc-0dae0cedb021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.146130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd8615-37ae-4048-80fc-0dae0cedb021 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.149927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba013f-d30b-4d37-9639-5ce47dfa40de tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.155420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85920c-9bcd-4c65-8e50-c6243654d5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.156304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85920c-9bcd-4c65-8e50-c6243654d5de admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.156592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85920c-9bcd-4c65-8e50-c6243654d5de admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.156971 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85920c-9bcd-4c65-8e50-c6243654d5de admin admin] PATH_INFO: `/v3/projects/2025ca53caac413293464a79bebece1a/users/b05218dd6d84464abeda2300ba5dc8fa/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.159034 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2480/4886] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:58 2021] GET /identity/v3/roles => generated 1893 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:58.159371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85920c-9bcd-4c65-8e50-c6243654d5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=2025ca53caac413293464a79bebece1a, user_id=b05218dd6d84464abeda2300ba5dc8fa, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.159990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd8615-37ae-4048-80fc-0dae0cedb021 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.162420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85920c-9bcd-4c65-8e50-c6243654d5de admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.172677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd8615-37ae-4048-80fc-0dae0cedb021 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.175279 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2407/4887] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:58 2021] PUT /identity/v3/projects/2025ca53caac413293464a79bebece1a/users/b05218dd6d84464abeda2300ba5dc8fa/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:58.176264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85920c-9bcd-4c65-8e50-c6243654d5de admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.250307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d422dd3-3950-4ae2-af08-ad06b77c3445 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee27d08098048f7ad0a22c642d0b111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd73e30489db94158a9fc1ae8f1bc8a2e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1877072164', 'tempest-NotDelegatedRole-1081713531'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.251081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d422dd3-3950-4ae2-af08-ad06b77c3445 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.251361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d422dd3-3950-4ae2-af08-ad06b77c3445 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.251614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d422dd3-3950-4ae2-af08-ad06b77c3445 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] PATH_INFO: `/v3/OS-TRUST/trusts/b025cdff4bf448889a85da3df1a4c2b8/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.259627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85920c-9bcd-4c65-8e50-c6243654d5de admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.264564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d422dd3-3950-4ae2-af08-ad06b77c3445 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=b025cdff4bf448889a85da3df1a4c2b8)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.265501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19002ec-776a-4106-9c70-c432a38aa794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.266419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19002ec-776a-4106-9c70-c432a38aa794 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.266706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19002ec-776a-4106-9c70-c432a38aa794 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.266953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d422dd3-3950-4ae2-af08-ad06b77c3445 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.267136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19002ec-776a-4106-9c70-c432a38aa794 admin admin] PATH_INFO: `/v3/projects/f1f9e7d3cd4e4cb7a8c9ca3255b939d5/users/26bc142b7c9a41a78f4c0e4efb11ce8e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.279126 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2481/4888] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 21:01:58 2021] GET /identity/v3/OS-TRUST/trusts/b025cdff4bf448889a85da3df1a4c2b8/roles => generated 371 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:58.285453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19002ec-776a-4106-9c70-c432a38aa794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f9e7d3cd4e4cb7a8c9ca3255b939d5, user_id=26bc142b7c9a41a78f4c0e4efb11ce8e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.288279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19002ec-776a-4106-9c70-c432a38aa794 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.292362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89be57-e6dd-43d5-9af2-2b30b604936b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.294237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89be57-e6dd-43d5-9af2-2b30b604936b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.294574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89be57-e6dd-43d5-9af2-2b30b604936b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.320872 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2408/4889] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:58 2021] PUT /identity/v3/projects/f1f9e7d3cd4e4cb7a8c9ca3255b939d5/users/26bc142b7c9a41a78f4c0e4efb11ce8e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:58.321713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19002ec-776a-4106-9c70-c432a38aa794 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.331013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7a89be57-e6dd-43d5-9af2-2b30b604936b None None] MFA Rules not processed for user `b05218dd6d84464abeda2300ba5dc8fa`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:58.332775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7a89be57-e6dd-43d5-9af2-2b30b604936b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:58.412226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19002ec-776a-4106-9c70-c432a38aa794 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.418113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e4337-4a12-40b8-9005-2052d3a8b4e3 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee27d08098048f7ad0a22c642d0b111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd73e30489db94158a9fc1ae8f1bc8a2e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1877072164', 'tempest-NotDelegatedRole-1081713531'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.419008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e4337-4a12-40b8-9005-2052d3a8b4e3 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.419387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e4337-4a12-40b8-9005-2052d3a8b4e3 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.419571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e4337-4a12-40b8-9005-2052d3a8b4e3 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] PATH_INFO: `/v3/OS-TRUST/trusts/b025cdff4bf448889a85da3df1a4c2b8/roles/7dee8328de6d4848901e7894ccce916b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.426669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e4337-4a12-40b8-9005-2052d3a8b4e3 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b025cdff4bf448889a85da3df1a4c2b8, role_id=7dee8328de6d4848901e7894ccce916b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.428248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e4337-4a12-40b8-9005-2052d3a8b4e3 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.436767 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2409/4890] 10.222.0.13 () {58 vars in 1367 bytes} [Sat Dec 18 21:01:58 2021] GET /identity/v3/OS-TRUST/trusts/b025cdff4bf448889a85da3df1a4c2b8/roles/7dee8328de6d4848901e7894ccce916b => generated 244 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:58.438489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c632a5f-37b8-4d1e-8b29-e24f1ead145b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.438942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c632a5f-37b8-4d1e-8b29-e24f1ead145b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.439404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c632a5f-37b8-4d1e-8b29-e24f1ead145b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.465426 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2482/4891] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:58 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:58.468558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89be57-e6dd-43d5-9af2-2b30b604936b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.478321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6c632a5f-37b8-4d1e-8b29-e24f1ead145b None None] MFA Rules not processed for user `26bc142b7c9a41a78f4c0e4efb11ce8e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:58.480217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89be57-e6dd-43d5-9af2-2b30b604936b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.483330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6c632a5f-37b8-4d1e-8b29-e24f1ead145b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:58.484819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396bbad-ca30-48cc-a027-0b5f4c13952c tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee27d08098048f7ad0a22c642d0b111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd73e30489db94158a9fc1ae8f1bc8a2e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1877072164', 'tempest-NotDelegatedRole-1081713531'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.485716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396bbad-ca30-48cc-a027-0b5f4c13952c tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] REQUEST_METHOD: `HEAD` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.486073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396bbad-ca30-48cc-a027-0b5f4c13952c tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.486314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396bbad-ca30-48cc-a027-0b5f4c13952c tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] PATH_INFO: `/v3/OS-TRUST/trusts/b025cdff4bf448889a85da3df1a4c2b8/roles/7dee8328de6d4848901e7894ccce916b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.495626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396bbad-ca30-48cc-a027-0b5f4c13952c tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b025cdff4bf448889a85da3df1a4c2b8, role_id=7dee8328de6d4848901e7894ccce916b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.497408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396bbad-ca30-48cc-a027-0b5f4c13952c tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.505236 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2483/4892] 10.222.0.13 () {58 vars in 1368 bytes} [Sat Dec 18 21:01:58 2021] HEAD /identity/v3/OS-TRUST/trusts/b025cdff4bf448889a85da3df1a4c2b8/roles/7dee8328de6d4848901e7894ccce916b => generated 0 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Dec 18 21:01:58.506013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396bbad-ca30-48cc-a027-0b5f4c13952c tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.521578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396bbad-ca30-48cc-a027-0b5f4c13952c tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.527869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82526dd-a361-4507-8b27-8896c401c0eb tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b05218dd6d84464abeda2300ba5dc8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2025ca53caac413293464a79bebece1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.528533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82526dd-a361-4507-8b27-8896c401c0eb tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.528968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82526dd-a361-4507-8b27-8896c401c0eb tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.529262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82526dd-a361-4507-8b27-8896c401c0eb tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.530130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82526dd-a361-4507-8b27-8896c401c0eb tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.531812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82526dd-a361-4507-8b27-8896c401c0eb tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.552710 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2484/4893] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:01:58 2021] POST /identity/v3/services => generated 240 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:58.552710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82526dd-a361-4507-8b27-8896c401c0eb tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.567975 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2410/4894] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:58 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:58.568822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c632a5f-37b8-4d1e-8b29-e24f1ead145b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.570928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82526dd-a361-4507-8b27-8896c401c0eb tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.575392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052f118-cecc-42ca-b30e-707e2523d14a tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee27d08098048f7ad0a22c642d0b111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd73e30489db94158a9fc1ae8f1bc8a2e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1877072164', 'tempest-NotDelegatedRole-1081713531'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.576196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052f118-cecc-42ca-b30e-707e2523d14a tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.576478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052f118-cecc-42ca-b30e-707e2523d14a tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.576754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052f118-cecc-42ca-b30e-707e2523d14a tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] PATH_INFO: `/v3/OS-TRUST/trusts/b025cdff4bf448889a85da3df1a4c2b8/roles/dd484db903c649afb40c4d7ec9a9ae64` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.582642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052f118-cecc-42ca-b30e-707e2523d14a tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b025cdff4bf448889a85da3df1a4c2b8, role_id=dd484db903c649afb40c4d7ec9a9ae64)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.584071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052f118-cecc-42ca-b30e-707e2523d14a tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.588673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c632a5f-37b8-4d1e-8b29-e24f1ead145b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.593940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be775c74-2fcf-41e7-adeb-8ab0ffd5e64d tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b05218dd6d84464abeda2300ba5dc8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2025ca53caac413293464a79bebece1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.594838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be775c74-2fcf-41e7-adeb-8ab0ffd5e64d tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.595124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be775c74-2fcf-41e7-adeb-8ab0ffd5e64d tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.595425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be775c74-2fcf-41e7-adeb-8ab0ffd5e64d tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] PATH_INFO: `/v3/services/7e26a6a6984748d18e0d48fb1784618f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.596072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be775c74-2fcf-41e7-adeb-8ab0ffd5e64d tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7e26a6a6984748d18e0d48fb1784618f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.597652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be775c74-2fcf-41e7-adeb-8ab0ffd5e64d tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.598001 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-0052f118-cecc-42ca-b30e-707e2523d14a tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Could not find role: dd484db903c649afb40c4d7ec9a9ae64.: keystone.exception.RoleNotFound: Could not find role: dd484db903c649afb40c4d7ec9a9ae64. Dec 18 21:01:58.599213 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2485/4895] 10.222.0.13 () {58 vars in 1367 bytes} [Sat Dec 18 21:01:58 2021] GET /identity/v3/OS-TRUST/trusts/b025cdff4bf448889a85da3df1a4c2b8/roles/dd484db903c649afb40c4d7ec9a9ae64 => generated 110 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:01:58.602998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052f118-cecc-42ca-b30e-707e2523d14a tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.619019 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2411/4896] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:58 2021] DELETE /identity/v3/services/7e26a6a6984748d18e0d48fb1784618f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:58.619774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be775c74-2fcf-41e7-adeb-8ab0ffd5e64d tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.639021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be775c74-2fcf-41e7-adeb-8ab0ffd5e64d tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.643619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869c237-5264-4363-9cc2-44a4a16aded9 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee27d08098048f7ad0a22c642d0b111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd73e30489db94158a9fc1ae8f1bc8a2e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1877072164', 'tempest-NotDelegatedRole-1081713531'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.644473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869c237-5264-4363-9cc2-44a4a16aded9 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] REQUEST_METHOD: `HEAD` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.644754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869c237-5264-4363-9cc2-44a4a16aded9 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.645028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869c237-5264-4363-9cc2-44a4a16aded9 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] PATH_INFO: `/v3/OS-TRUST/trusts/b025cdff4bf448889a85da3df1a4c2b8/roles/dd484db903c649afb40c4d7ec9a9ae64` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.650689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869c237-5264-4363-9cc2-44a4a16aded9 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b025cdff4bf448889a85da3df1a4c2b8, role_id=dd484db903c649afb40c4d7ec9a9ae64)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.652654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869c237-5264-4363-9cc2-44a4a16aded9 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.665599 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-a869c237-5264-4363-9cc2-44a4a16aded9 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Could not find role: dd484db903c649afb40c4d7ec9a9ae64.: keystone.exception.RoleNotFound: Could not find role: dd484db903c649afb40c4d7ec9a9ae64. Dec 18 21:01:58.666781 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2412/4897] 10.222.0.13 () {58 vars in 1368 bytes} [Sat Dec 18 21:01:58 2021] HEAD /identity/v3/OS-TRUST/trusts/b025cdff4bf448889a85da3df1a4c2b8/roles/dd484db903c649afb40c4d7ec9a9ae64 => generated 0 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Dec 18 21:01:58.668059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869c237-5264-4363-9cc2-44a4a16aded9 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.680642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052f118-cecc-42ca-b30e-707e2523d14a tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.691059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869c237-5264-4363-9cc2-44a4a16aded9 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.694998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996e0ed-18d6-4300-87ff-6a680b80b1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.695657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996e0ed-18d6-4300-87ff-6a680b80b1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.695978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996e0ed-18d6-4300-87ff-6a680b80b1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.696215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996e0ed-18d6-4300-87ff-6a680b80b1c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.696505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56951f-f7ae-40e0-b45e-0ca0edac5bb5 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b05218dd6d84464abeda2300ba5dc8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2025ca53caac413293464a79bebece1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.696949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996e0ed-18d6-4300-87ff-6a680b80b1c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.697154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56951f-f7ae-40e0-b45e-0ca0edac5bb5 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.697441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56951f-f7ae-40e0-b45e-0ca0edac5bb5 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.697724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56951f-f7ae-40e0-b45e-0ca0edac5bb5 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.698509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56951f-f7ae-40e0-b45e-0ca0edac5bb5 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.698883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996e0ed-18d6-4300-87ff-6a680b80b1c7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.700075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56951f-f7ae-40e0-b45e-0ca0edac5bb5 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.715175 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2413/4898] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:58 2021] POST /identity/v3/services => generated 289 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:58.716077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56951f-f7ae-40e0-b45e-0ca0edac5bb5 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.730308 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2486/4899] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:58 2021] POST /identity/v3/projects => generated 401 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:58.731180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996e0ed-18d6-4300-87ff-6a680b80b1c7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.741653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56951f-f7ae-40e0-b45e-0ca0edac5bb5 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.790569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996e0ed-18d6-4300-87ff-6a680b80b1c7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.792572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54414cd-82d4-4cfd-9b20-c70f2df95325 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee27d08098048f7ad0a22c642d0b111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd73e30489db94158a9fc1ae8f1bc8a2e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1877072164', 'tempest-NotDelegatedRole-1081713531'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.793407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54414cd-82d4-4cfd-9b20-c70f2df95325 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.793696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54414cd-82d4-4cfd-9b20-c70f2df95325 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.793977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54414cd-82d4-4cfd-9b20-c70f2df95325 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] PATH_INFO: `/v3/OS-TRUST/trusts/b025cdff4bf448889a85da3df1a4c2b8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.800056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54414cd-82d4-4cfd-9b20-c70f2df95325 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: Authorizing `identity:delete_trust(trust_id=b025cdff4bf448889a85da3df1a4c2b8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.801531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54414cd-82d4-4cfd-9b20-c70f2df95325 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.805252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdc21f-e3b5-4ffd-9343-0ac8372aec9b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b05218dd6d84464abeda2300ba5dc8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2025ca53caac413293464a79bebece1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.806084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdc21f-e3b5-4ffd-9343-0ac8372aec9b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.806396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdc21f-e3b5-4ffd-9343-0ac8372aec9b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.806676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdc21f-e3b5-4ffd-9343-0ac8372aec9b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] PATH_INFO: `/v3/services/64fd68b0c65740c790c1214e527567f0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.807400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdc21f-e3b5-4ffd-9343-0ac8372aec9b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorizing `identity:update_service(service_id=64fd68b0c65740c790c1214e527567f0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.808434 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-62fdc21f-e3b5-4ffd-9343-0ac8372aec9b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:01:58.808434 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:01:58.808434 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:01:58.809292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdc21f-e3b5-4ffd-9343-0ac8372aec9b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.818889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d54414cd-82d4-4cfd-9b20-c70f2df95325 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b025cdff4bf448889a85da3df1a4c2b8', 'request_id': 'req-d54414cd-82d4-4cfd-9b20-c70f2df95325'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:58.819721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d54414cd-82d4-4cfd-9b20-c70f2df95325 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b025cdff4bf448889a85da3df1a4c2b8', 'request_id': 'req-d54414cd-82d4-4cfd-9b20-c70f2df95325'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:58.820554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d54414cd-82d4-4cfd-9b20-c70f2df95325 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'b025cdff4bf448889a85da3df1a4c2b8', 'request_id': 'req-d54414cd-82d4-4cfd-9b20-c70f2df95325'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:58.825263 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2487/4900] 10.222.0.13 () {60 vars in 1251 bytes} [Sat Dec 18 21:01:58 2021] PATCH /identity/v3/services/64fd68b0c65740c790c1214e527567f0 => generated 283 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:58.826651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdc21f-e3b5-4ffd-9343-0ac8372aec9b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.828468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-62fdc21f-e3b5-4ffd-9343-0ac8372aec9b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:58.834524 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2414/4901] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Dec 18 21:01:58 2021] DELETE /identity/v3/OS-TRUST/trusts/b025cdff4bf448889a85da3df1a4c2b8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:58.835566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54414cd-82d4-4cfd-9b20-c70f2df95325 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.836884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d54414cd-82d4-4cfd-9b20-c70f2df95325 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:58.851747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54414cd-82d4-4cfd-9b20-c70f2df95325 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.866949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f7cf4-10d7-45cf-9edd-c4d7cffa2db2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b05218dd6d84464abeda2300ba5dc8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2025ca53caac413293464a79bebece1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.867908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7cf4-10d7-45cf-9edd-c4d7cffa2db2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.868319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7cf4-10d7-45cf-9edd-c4d7cffa2db2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.868695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7cf4-10d7-45cf-9edd-c4d7cffa2db2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] PATH_INFO: `/v3/services/64fd68b0c65740c790c1214e527567f0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.869527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f7cf4-10d7-45cf-9edd-c4d7cffa2db2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorizing `identity:get_service(service_id=64fd68b0c65740c790c1214e527567f0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.871221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f7cf4-10d7-45cf-9edd-c4d7cffa2db2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.876866 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2415/4902] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:01:58 2021] GET /identity/v3/services/64fd68b0c65740c790c1214e527567f0 => generated 283 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:01:58.880877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f7cf4-10d7-45cf-9edd-c4d7cffa2db2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.883039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d26f7cf4-10d7-45cf-9edd-c4d7cffa2db2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:58.906565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdc21f-e3b5-4ffd-9343-0ac8372aec9b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.908390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f7cf4-10d7-45cf-9edd-c4d7cffa2db2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.912669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da476e-605d-4b56-8885-c403815d7f00 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee27d08098048f7ad0a22c642d0b111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd73e30489db94158a9fc1ae8f1bc8a2e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1877072164', 'tempest-NotDelegatedRole-1081713531'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.913617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da476e-605d-4b56-8885-c403815d7f00 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.913997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da476e-605d-4b56-8885-c403815d7f00 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.914343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912f6f9-4ea2-4d69-b0bc-4647de15bde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.914470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da476e-605d-4b56-8885-c403815d7f00 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] PATH_INFO: `/v3/OS-TRUST/trusts/b025cdff4bf448889a85da3df1a4c2b8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.915014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912f6f9-4ea2-4d69-b0bc-4647de15bde7 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.915297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912f6f9-4ea2-4d69-b0bc-4647de15bde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.915577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912f6f9-4ea2-4d69-b0bc-4647de15bde7 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.916274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912f6f9-4ea2-4d69-b0bc-4647de15bde7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.918174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912f6f9-4ea2-4d69-b0bc-4647de15bde7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.927040 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-c8da476e-605d-4b56-8885-c403815d7f00 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Could not find trust: b025cdff4bf448889a85da3df1a4c2b8.: keystone.exception.TrustNotFound: Could not find trust: b025cdff4bf448889a85da3df1a4c2b8. Dec 18 21:01:58.928229 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2416/4903] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:01:58 2021] GET /identity/v3/OS-TRUST/trusts/b025cdff4bf448889a85da3df1a4c2b8 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:01:58.928978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da476e-605d-4b56-8885-c403815d7f00 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.940589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da476e-605d-4b56-8885-c403815d7f00 tempest-TrustsV3TestJSON-1474656126 tempest-user-1847519878] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:58.941626 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2488/4904] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:01:58 2021] POST /identity/v3/users => generated 307 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:58.942613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912f6f9-4ea2-4d69-b0bc-4647de15bde7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.944241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a912f6f9-4ea2-4d69-b0bc-4647de15bde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:58.947713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c214b-72ad-4815-8f34-f87efeddda50 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b05218dd6d84464abeda2300ba5dc8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2025ca53caac413293464a79bebece1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:58.949120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c214b-72ad-4815-8f34-f87efeddda50 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:58.949410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c214b-72ad-4815-8f34-f87efeddda50 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:58.949687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c214b-72ad-4815-8f34-f87efeddda50 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] PATH_INFO: `/v3/services/64fd68b0c65740c790c1214e527567f0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:58.950377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c214b-72ad-4815-8f34-f87efeddda50 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorizing `identity:delete_service(service_id=64fd68b0c65740c790c1214e527567f0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:58.951977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c214b-72ad-4815-8f34-f87efeddda50 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:58.972365 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2417/4905] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:58 2021] DELETE /identity/v3/services/64fd68b0c65740c790c1214e527567f0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:58.975092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c214b-72ad-4815-8f34-f87efeddda50 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:58.999804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c214b-72ad-4815-8f34-f87efeddda50 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:59.005005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1674f-5eb7-47c9-be03-8af79d1cf9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:59.005794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1674f-5eb7-47c9-be03-8af79d1cf9ea admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:59.006084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1674f-5eb7-47c9-be03-8af79d1cf9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:59.006437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1674f-5eb7-47c9-be03-8af79d1cf9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:59.007118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1674f-5eb7-47c9-be03-8af79d1cf9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:59.008722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1674f-5eb7-47c9-be03-8af79d1cf9ea admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:59.021835 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2418/4906] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:58 2021] GET /identity/v3/roles => generated 1893 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:59.022545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1674f-5eb7-47c9-be03-8af79d1cf9ea admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:59.025004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912f6f9-4ea2-4d69-b0bc-4647de15bde7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:59.041557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f88a40-40c7-47c2-b974-2afd6373bed8 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:59.042681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f88a40-40c7-47c2-b974-2afd6373bed8 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:59.043040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f88a40-40c7-47c2-b974-2afd6373bed8 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:59.043399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f88a40-40c7-47c2-b974-2afd6373bed8 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles/dd484db903c649afb40c4d7ec9a9ae64` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:59.044837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1674f-5eb7-47c9-be03-8af79d1cf9ea admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:59.045359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f88a40-40c7-47c2-b974-2afd6373bed8 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dd484db903c649afb40c4d7ec9a9ae64)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:59.047092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f88a40-40c7-47c2-b974-2afd6373bed8 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:59.050285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cb084-3c84-4c20-aac9-a1c72b85a58a tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b05218dd6d84464abeda2300ba5dc8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2025ca53caac413293464a79bebece1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:59.050987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cb084-3c84-4c20-aac9-a1c72b85a58a tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:59.051305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cb084-3c84-4c20-aac9-a1c72b85a58a tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:59.051610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cb084-3c84-4c20-aac9-a1c72b85a58a tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] PATH_INFO: `/v3/services/64fd68b0c65740c790c1214e527567f0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:59.052312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cb084-3c84-4c20-aac9-a1c72b85a58a tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorizing `identity:get_service(service_id=64fd68b0c65740c790c1214e527567f0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:59.053887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cb084-3c84-4c20-aac9-a1c72b85a58a tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:59.069032 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-536cb084-3c84-4c20-aac9-a1c72b85a58a tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Could not find service: 64fd68b0c65740c790c1214e527567f0.: keystone.exception.ServiceNotFound: Could not find service: 64fd68b0c65740c790c1214e527567f0. Dec 18 21:01:59.074564 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2419/4907] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:01:59 2021] GET /identity/v3/services/64fd68b0c65740c790c1214e527567f0 => generated 113 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:01:59.074564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cb084-3c84-4c20-aac9-a1c72b85a58a tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:59.086858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cb084-3c84-4c20-aac9-a1c72b85a58a tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:59.095767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a0ecd-9b0e-4e3d-9fc6-b4f7bb2f5a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:59.096979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a0ecd-9b0e-4e3d-9fc6-b4f7bb2f5a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:59.098801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a0ecd-9b0e-4e3d-9fc6-b4f7bb2f5a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:59.100947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a0ecd-9b0e-4e3d-9fc6-b4f7bb2f5a54 admin admin] PATH_INFO: `/v3/projects/9ba57159d13b4b05a25df426fbc2cd47/users/281fe3e80cf5425f9b7f7c3d42c7716c/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:59.114224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-08f88a40-40c7-47c2-b974-2afd6373bed8 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invalidating the token cache because role dd484db903c649afb40c4d7ec9a9ae64 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:59.114667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-08f88a40-40c7-47c2-b974-2afd6373bed8 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:59.115415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-08f88a40-40c7-47c2-b974-2afd6373bed8 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:59.118531 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2489/4908] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:58 2021] DELETE /identity/v3/roles/dd484db903c649afb40c4d7ec9a9ae64 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:59.119583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f88a40-40c7-47c2-b974-2afd6373bed8 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:59.121383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-08f88a40-40c7-47c2-b974-2afd6373bed8 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:59.132249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a0ecd-9b0e-4e3d-9fc6-b4f7bb2f5a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba57159d13b4b05a25df426fbc2cd47, user_id=281fe3e80cf5425f9b7f7c3d42c7716c, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:59.134895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a0ecd-9b0e-4e3d-9fc6-b4f7bb2f5a54 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:59.150610 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2420/4909] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:59 2021] PUT /identity/v3/projects/9ba57159d13b4b05a25df426fbc2cd47/users/281fe3e80cf5425f9b7f7c3d42c7716c/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:59.152386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a0ecd-9b0e-4e3d-9fc6-b4f7bb2f5a54 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:59.155632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d85a0ecd-9b0e-4e3d-9fc6-b4f7bb2f5a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:59.218528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f88a40-40c7-47c2-b974-2afd6373bed8 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:59.242422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a0ecd-9b0e-4e3d-9fc6-b4f7bb2f5a54 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:59.248955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdc4b3-ad49-4376-8849-3e7a17fb59d6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:59.249869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdc4b3-ad49-4376-8849-3e7a17fb59d6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:59.250274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdc4b3-ad49-4376-8849-3e7a17fb59d6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:59.250593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdc4b3-ad49-4376-8849-3e7a17fb59d6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles/7dee8328de6d4848901e7894ccce916b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:59.252250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdc4b3-ad49-4376-8849-3e7a17fb59d6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7dee8328de6d4848901e7894ccce916b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:59.254000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdc4b3-ad49-4376-8849-3e7a17fb59d6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:59.285295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc2e3b-c8e1-4864-904a-182264bb9346 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b05218dd6d84464abeda2300ba5dc8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2025ca53caac413293464a79bebece1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:59.286171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc2e3b-c8e1-4864-904a-182264bb9346 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:59.287047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc2e3b-c8e1-4864-904a-182264bb9346 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:59.287168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc2e3b-c8e1-4864-904a-182264bb9346 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:59.288024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc2e3b-c8e1-4864-904a-182264bb9346 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:59.290170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc2e3b-c8e1-4864-904a-182264bb9346 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:59.299140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-97bdc4b3-ad49-4376-8849-3e7a17fb59d6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invalidating the token cache because role 7dee8328de6d4848901e7894ccce916b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:59.299445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-97bdc4b3-ad49-4376-8849-3e7a17fb59d6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:59.300282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-97bdc4b3-ad49-4376-8849-3e7a17fb59d6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:59.302466 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2421/4910] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:59 2021] DELETE /identity/v3/roles/7dee8328de6d4848901e7894ccce916b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:59.305565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdc4b3-ad49-4376-8849-3e7a17fb59d6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:59.305565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-97bdc4b3-ad49-4376-8849-3e7a17fb59d6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:59.310037 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2490/4911] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:59 2021] POST /identity/v3/services => generated 273 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:59.310037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc2e3b-c8e1-4864-904a-182264bb9346 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:59.311522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6bdc2e3b-c8e1-4864-904a-182264bb9346 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:59.344809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc2e3b-c8e1-4864-904a-182264bb9346 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:59.380410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdc4b3-ad49-4376-8849-3e7a17fb59d6 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:59.401421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac1d0b-28ab-43b7-b48b-ad5df933a48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:59.402543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac1d0b-28ab-43b7-b48b-ad5df933a48e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:59.402886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac1d0b-28ab-43b7-b48b-ad5df933a48e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:59.403191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac1d0b-28ab-43b7-b48b-ad5df933a48e admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:59.404127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac1d0b-28ab-43b7-b48b-ad5df933a48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:59.406087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac1d0b-28ab-43b7-b48b-ad5df933a48e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:59.417397 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2422/4912] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:01:59 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:59.418522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac1d0b-28ab-43b7-b48b-ad5df933a48e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:59.421633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0abb4-a949-4f9c-88e3-1d9aa2be6e9f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:59.421633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0abb4-a949-4f9c-88e3-1d9aa2be6e9f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:59.421633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0abb4-a949-4f9c-88e3-1d9aa2be6e9f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:59.421994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0abb4-a949-4f9c-88e3-1d9aa2be6e9f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users/8ee27d08098048f7ad0a22c642d0b111` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:59.422364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0abb4-a949-4f9c-88e3-1d9aa2be6e9f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8ee27d08098048f7ad0a22c642d0b111)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:59.424269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0abb4-a949-4f9c-88e3-1d9aa2be6e9f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:59.425128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-11ac1d0b-28ab-43b7-b48b-ad5df933a48e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:59.477024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-61d0abb4-a949-4f9c-88e3-1d9aa2be6e9f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee27d08098048f7ad0a22c642d0b111'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:59.485764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-61d0abb4-a949-4f9c-88e3-1d9aa2be6e9f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee27d08098048f7ad0a22c642d0b111'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:59.486823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-61d0abb4-a949-4f9c-88e3-1d9aa2be6e9f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee27d08098048f7ad0a22c642d0b111'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:59.509784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-61d0abb4-a949-4f9c-88e3-1d9aa2be6e9f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee27d08098048f7ad0a22c642d0b111'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:59.512255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac1d0b-28ab-43b7-b48b-ad5df933a48e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:59.517495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f209e7-96be-4d04-882a-050f7bc113b9 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b05218dd6d84464abeda2300ba5dc8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2025ca53caac413293464a79bebece1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:59.518534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f209e7-96be-4d04-882a-050f7bc113b9 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:59.518813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f209e7-96be-4d04-882a-050f7bc113b9 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:59.519230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f209e7-96be-4d04-882a-050f7bc113b9 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:59.520104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f209e7-96be-4d04-882a-050f7bc113b9 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:59.522066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f209e7-96be-4d04-882a-050f7bc113b9 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:59.522326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-61d0abb4-a949-4f9c-88e3-1d9aa2be6e9f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee27d08098048f7ad0a22c642d0b111'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:59.537634 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2491/4913] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:01:59 2021] DELETE /identity/v3/users/8ee27d08098048f7ad0a22c642d0b111 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:59.539803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0abb4-a949-4f9c-88e3-1d9aa2be6e9f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:59.542877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-61d0abb4-a949-4f9c-88e3-1d9aa2be6e9f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:59.544232 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2423/4914] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:59 2021] POST /identity/v3/services => generated 274 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:59.545065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f209e7-96be-4d04-882a-050f7bc113b9 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:59.548104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b9f209e7-96be-4d04-882a-050f7bc113b9 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:59.583610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f209e7-96be-4d04-882a-050f7bc113b9 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:59.653285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0abb4-a949-4f9c-88e3-1d9aa2be6e9f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:59.657505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09be95-8e0f-4e4c-a371-84b3ad8db814 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:59.658683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09be95-8e0f-4e4c-a371-84b3ad8db814 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:59.658978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09be95-8e0f-4e4c-a371-84b3ad8db814 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:59.659251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09be95-8e0f-4e4c-a371-84b3ad8db814 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/d73e30489db94158a9fc1ae8f1bc8a2e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:59.660602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09be95-8e0f-4e4c-a371-84b3ad8db814 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d73e30489db94158a9fc1ae8f1bc8a2e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:59.663713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09be95-8e0f-4e4c-a371-84b3ad8db814 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:59.669464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a961d4-d5e9-44fa-be4c-096bd7c218da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:59.670964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a961d4-d5e9-44fa-be4c-096bd7c218da admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:59.671442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a961d4-d5e9-44fa-be4c-096bd7c218da admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:59.671707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a961d4-d5e9-44fa-be4c-096bd7c218da admin admin] PATH_INFO: `/v3/projects/9ba57159d13b4b05a25df426fbc2cd47/users/281fe3e80cf5425f9b7f7c3d42c7716c/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:59.673814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a961d4-d5e9-44fa-be4c-096bd7c218da admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba57159d13b4b05a25df426fbc2cd47, user_id=281fe3e80cf5425f9b7f7c3d42c7716c, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:59.676999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a961d4-d5e9-44fa-be4c-096bd7c218da admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:59.690574 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2492/4915] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:01:59 2021] PUT /identity/v3/projects/9ba57159d13b4b05a25df426fbc2cd47/users/281fe3e80cf5425f9b7f7c3d42c7716c/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:59.691959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a961d4-d5e9-44fa-be4c-096bd7c218da admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:59.693587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c7a961d4-d5e9-44fa-be4c-096bd7c218da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:59.761819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-af09be95-8e0f-4e4c-a371-84b3ad8db814 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73e30489db94158a9fc1ae8f1bc8a2e', 'request_id': 'req-af09be95-8e0f-4e4c-a371-84b3ad8db814'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:59.768812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-af09be95-8e0f-4e4c-a371-84b3ad8db814 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73e30489db94158a9fc1ae8f1bc8a2e', 'request_id': 'req-af09be95-8e0f-4e4c-a371-84b3ad8db814'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:59.775386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-af09be95-8e0f-4e4c-a371-84b3ad8db814 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73e30489db94158a9fc1ae8f1bc8a2e', 'request_id': 'req-af09be95-8e0f-4e4c-a371-84b3ad8db814'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:59.791000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-af09be95-8e0f-4e4c-a371-84b3ad8db814 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] The token cache is being invalidate because project d73e30489db94158a9fc1ae8f1bc8a2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:01:59.791302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-af09be95-8e0f-4e4c-a371-84b3ad8db814 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:59.792126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-af09be95-8e0f-4e4c-a371-84b3ad8db814 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:01:59.794061 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2424/4916] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:01:59 2021] DELETE /identity/v3/projects/d73e30489db94158a9fc1ae8f1bc8a2e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:01:59.795544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b356d-d83b-443e-8672-4bb700a12fdf None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:59.796312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b356d-d83b-443e-8672-4bb700a12fdf None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:59.796312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b356d-d83b-443e-8672-4bb700a12fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:59.804949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a961d4-d5e9-44fa-be4c-096bd7c218da admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:59.834420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-045b356d-d83b-443e-8672-4bb700a12fdf None None] MFA Rules not processed for user `281fe3e80cf5425f9b7f7c3d42c7716c`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:01:59.836087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-045b356d-d83b-443e-8672-4bb700a12fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:59.866088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2d179-82aa-408b-8c7f-459387f17b81 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b05218dd6d84464abeda2300ba5dc8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2025ca53caac413293464a79bebece1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:59.866879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2d179-82aa-408b-8c7f-459387f17b81 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:59.867224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2d179-82aa-408b-8c7f-459387f17b81 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:59.867603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2d179-82aa-408b-8c7f-459387f17b81 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:59.868393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2d179-82aa-408b-8c7f-459387f17b81 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:59.870054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2d179-82aa-408b-8c7f-459387f17b81 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:59.885016 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2493/4917] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:01:59 2021] POST /identity/v3/services => generated 274 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:01:59.886592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2d179-82aa-408b-8c7f-459387f17b81 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:59.888582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e8d2d179-82aa-408b-8c7f-459387f17b81 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:59.908316 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2425/4918] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:01:59 2021] POST /identity/v3/auth/tokens => generated 3835 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:01:59.909196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b356d-d83b-443e-8672-4bb700a12fdf None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:59.912444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-045b356d-d83b-443e-8672-4bb700a12fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:01:59.939550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b356d-d83b-443e-8672-4bb700a12fdf None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:59.946320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d02ea4-43d2-42bb-9799-21e5db1d03b5 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b05218dd6d84464abeda2300ba5dc8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2025ca53caac413293464a79bebece1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:59.946994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d02ea4-43d2-42bb-9799-21e5db1d03b5 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:59.947284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d02ea4-43d2-42bb-9799-21e5db1d03b5 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:59.949062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d02ea4-43d2-42bb-9799-21e5db1d03b5 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:59.949818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d02ea4-43d2-42bb-9799-21e5db1d03b5 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:59.952728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d02ea4-43d2-42bb-9799-21e5db1d03b5 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:59.961662 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2426/4919] 10.222.0.13 () {58 vars in 1130 bytes} [Sat Dec 18 21:01:59 2021] GET /identity/v3/services => generated 2976 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:01:59.962545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d02ea4-43d2-42bb-9799-21e5db1d03b5 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:01:59.970454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2d179-82aa-408b-8c7f-459387f17b81 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:59.975419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c57cb-4e7c-46e6-b561-9cb73a2b8652 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:59.976317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c57cb-4e7c-46e6-b561-9cb73a2b8652 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:59.976599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c57cb-4e7c-46e6-b561-9cb73a2b8652 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:59.976879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c57cb-4e7c-46e6-b561-9cb73a2b8652 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:59.977573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c57cb-4e7c-46e6-b561-9cb73a2b8652 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:59.978079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d02ea4-43d2-42bb-9799-21e5db1d03b5 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:01:59.979531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c57cb-4e7c-46e6-b561-9cb73a2b8652 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:01:59.983210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3103c-9809-4ff2-bc09-f35dc6661fbf tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '281fe3e80cf5425f9b7f7c3d42c7716c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba57159d13b4b05a25df426fbc2cd47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:01:59.983866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3103c-9809-4ff2-bc09-f35dc6661fbf tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:01:59.984154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3103c-9809-4ff2-bc09-f35dc6661fbf tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:01:59.984440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3103c-9809-4ff2-bc09-f35dc6661fbf tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:01:59.985327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3103c-9809-4ff2-bc09-f35dc6661fbf tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:01:59.987121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3103c-9809-4ff2-bc09-f35dc6661fbf tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:00.002386 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2427/4920] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:01:59 2021] POST /identity/v3/roles => generated 239 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:00.003609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3103c-9809-4ff2-bc09-f35dc6661fbf tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:00.007270 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2494/4921] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:01:59 2021] POST /identity/v3/projects => generated 328 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:00.008076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c57cb-4e7c-46e6-b561-9cb73a2b8652 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:00.015067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3103c-9809-4ff2-bc09-f35dc6661fbf tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:00.072708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c57cb-4e7c-46e6-b561-9cb73a2b8652 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:00.073686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed731cc0-b5ab-4c96-9c44-46633f90bdc2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b05218dd6d84464abeda2300ba5dc8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2025ca53caac413293464a79bebece1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:00.074438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed731cc0-b5ab-4c96-9c44-46633f90bdc2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:00.074760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed731cc0-b5ab-4c96-9c44-46633f90bdc2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:00.075043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed731cc0-b5ab-4c96-9c44-46633f90bdc2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:00.075759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed731cc0-b5ab-4c96-9c44-46633f90bdc2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-499302079) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:00.076071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed731cc0-b5ab-4c96-9c44-46633f90bdc2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:00.077966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed731cc0-b5ab-4c96-9c44-46633f90bdc2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:00.078806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258954be-3c00-448b-aff7-73ea98b37e78 tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '281fe3e80cf5425f9b7f7c3d42c7716c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba57159d13b4b05a25df426fbc2cd47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:00.079762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258954be-3c00-448b-aff7-73ea98b37e78 tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:00.080113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258954be-3c00-448b-aff7-73ea98b37e78 tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:00.080465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258954be-3c00-448b-aff7-73ea98b37e78 tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] PATH_INFO: `/v3/projects/f1f9e7d3cd4e4cb7a8c9ca3255b939d5/users/26bc142b7c9a41a78f4c0e4efb11ce8e/roles/229494670d984eb4bef56b1e1550aebf` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:00.082843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258954be-3c00-448b-aff7-73ea98b37e78 tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f1f9e7d3cd4e4cb7a8c9ca3255b939d5, user_id=26bc142b7c9a41a78f4c0e4efb11ce8e, role_id=229494670d984eb4bef56b1e1550aebf)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:00.083249 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2428/4922] 10.222.0.13 () {58 vars in 1219 bytes} [Sat Dec 18 21:02:00 2021] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-499302079 => generated 415 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:00.084093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed731cc0-b5ab-4c96-9c44-46633f90bdc2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:00.088660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258954be-3c00-448b-aff7-73ea98b37e78 tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:00.102516 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2495/4923] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:00 2021] PUT /identity/v3/projects/f1f9e7d3cd4e4cb7a8c9ca3255b939d5/users/26bc142b7c9a41a78f4c0e4efb11ce8e/roles/229494670d984eb4bef56b1e1550aebf => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:00.103396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258954be-3c00-448b-aff7-73ea98b37e78 tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:00.152808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed731cc0-b5ab-4c96-9c44-46633f90bdc2 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:00.173734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258954be-3c00-448b-aff7-73ea98b37e78 tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:00.181287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6f1f1-7d29-4ac8-bf3b-34523a921c58 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b05218dd6d84464abeda2300ba5dc8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2025ca53caac413293464a79bebece1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:00.182175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6f1f1-7d29-4ac8-bf3b-34523a921c58 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:00.183785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6f1f1-7d29-4ac8-bf3b-34523a921c58 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:00.183785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6f1f1-7d29-4ac8-bf3b-34523a921c58 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:00.184034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6f1f1-7d29-4ac8-bf3b-34523a921c58 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1769443823) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:00.184341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6f1f1-7d29-4ac8-bf3b-34523a921c58 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:00.186108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6f1f1-7d29-4ac8-bf3b-34523a921c58 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:00.192660 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2496/4924] 10.222.0.13 () {58 vars in 1221 bytes} [Sat Dec 18 21:02:00 2021] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1769443823 => generated 417 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:00.193811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6f1f1-7d29-4ac8-bf3b-34523a921c58 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:00.195585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c0e6f1f1-7d29-4ac8-bf3b-34523a921c58 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:00.226078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b44865-ee79-4a54-8862-913f12a9bea0 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:00.226874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44865-ee79-4a54-8862-913f12a9bea0 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:00.227238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44865-ee79-4a54-8862-913f12a9bea0 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:00.227593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44865-ee79-4a54-8862-913f12a9bea0 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:00.228404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b44865-ee79-4a54-8862-913f12a9bea0 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:00.230851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b44865-ee79-4a54-8862-913f12a9bea0 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:00.254634 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2429/4925] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:00 2021] POST /identity/v3/users => generated 413 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:00.255752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b44865-ee79-4a54-8862-913f12a9bea0 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:00.268665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b44865-ee79-4a54-8862-913f12a9bea0 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:00.275798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1926df-92d8-4bfe-a850-2112c2eb9c45 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b05218dd6d84464abeda2300ba5dc8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2025ca53caac413293464a79bebece1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:00.276977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1926df-92d8-4bfe-a850-2112c2eb9c45 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:00.277443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1926df-92d8-4bfe-a850-2112c2eb9c45 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:00.278436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1926df-92d8-4bfe-a850-2112c2eb9c45 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:00.279290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1926df-92d8-4bfe-a850-2112c2eb9c45 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1337074909) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:00.280076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1926df-92d8-4bfe-a850-2112c2eb9c45 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:00.281486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1926df-92d8-4bfe-a850-2112c2eb9c45 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:00.288478 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2430/4926] 10.222.0.13 () {58 vars in 1221 bytes} [Sat Dec 18 21:02:00 2021] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1337074909 => generated 417 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:00.289287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1926df-92d8-4bfe-a850-2112c2eb9c45 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:00.297388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6f1f1-7d29-4ac8-bf3b-34523a921c58 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:00.303871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1926df-92d8-4bfe-a850-2112c2eb9c45 tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:00.310165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83579990-0ebc-4c9a-a172-310f5d68fc9b tempest-ApplicationCredentialsV3AdminTest-1886991400 tempest-ApplicationCredentialsV3AdminTest-1886991400-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26bc142b7c9a41a78f4c0e4efb11ce8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1f9e7d3cd4e4cb7a8c9ca3255b939d5', 'project_domain_id': 'default', 'roles': ['tempest-test_role-584154726', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:00.311902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83579990-0ebc-4c9a-a172-310f5d68fc9b tempest-ApplicationCredentialsV3AdminTest-1886991400 tempest-ApplicationCredentialsV3AdminTest-1886991400-project] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:00.312194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83579990-0ebc-4c9a-a172-310f5d68fc9b tempest-ApplicationCredentialsV3AdminTest-1886991400 tempest-ApplicationCredentialsV3AdminTest-1886991400-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:00.312476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83579990-0ebc-4c9a-a172-310f5d68fc9b tempest-ApplicationCredentialsV3AdminTest-1886991400 tempest-ApplicationCredentialsV3AdminTest-1886991400-project] PATH_INFO: `/v3/users/26bc142b7c9a41a78f4c0e4efb11ce8e/application_credentials` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:00.313001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35227c8-435d-4068-b34e-4b9a4f1c83ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:00.313240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83579990-0ebc-4c9a-a172-310f5d68fc9b tempest-ApplicationCredentialsV3AdminTest-1886991400 tempest-ApplicationCredentialsV3AdminTest-1886991400-project] RBAC: Authorizing `identity:create_application_credential(user_id=26bc142b7c9a41a78f4c0e4efb11ce8e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:00.313684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35227c8-435d-4068-b34e-4b9a4f1c83ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:00.314082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35227c8-435d-4068-b34e-4b9a4f1c83ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:00.314407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35227c8-435d-4068-b34e-4b9a4f1c83ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:00.314541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83579990-0ebc-4c9a-a172-310f5d68fc9b tempest-ApplicationCredentialsV3AdminTest-1886991400 tempest-ApplicationCredentialsV3AdminTest-1886991400-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:00.315168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35227c8-435d-4068-b34e-4b9a4f1c83ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:00.317006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35227c8-435d-4068-b34e-4b9a4f1c83ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:00.334433 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2431/4927] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:02:00 2021] POST /identity/v3/roles => generated 243 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:00.338371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35227c8-435d-4068-b34e-4b9a4f1c83ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:00.349601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35227c8-435d-4068-b34e-4b9a4f1c83ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:00.355200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b1578-82af-4a21-9ad1-36e36a50e24b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b05218dd6d84464abeda2300ba5dc8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2025ca53caac413293464a79bebece1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:00.356091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b1578-82af-4a21-9ad1-36e36a50e24b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:00.356382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b1578-82af-4a21-9ad1-36e36a50e24b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:00.356665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b1578-82af-4a21-9ad1-36e36a50e24b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] PATH_INFO: `/v3/services/3a19d44dc84843618ac9ef30d329e02c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:00.357470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b1578-82af-4a21-9ad1-36e36a50e24b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3a19d44dc84843618ac9ef30d329e02c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:00.359301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b1578-82af-4a21-9ad1-36e36a50e24b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:00.385007 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2432/4928] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:00 2021] DELETE /identity/v3/services/3a19d44dc84843618ac9ef30d329e02c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:00.387333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b1578-82af-4a21-9ad1-36e36a50e24b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:00.405457 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2497/4929] 10.222.0.13 () {60 vars in 1314 bytes} [Sat Dec 18 21:02:00 2021] POST /identity/v3/users/26bc142b7c9a41a78f4c0e4efb11ce8e/application_credentials => generated 658 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:00.405457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83579990-0ebc-4c9a-a172-310f5d68fc9b tempest-ApplicationCredentialsV3AdminTest-1886991400 tempest-ApplicationCredentialsV3AdminTest-1886991400-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:00.413634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83579990-0ebc-4c9a-a172-310f5d68fc9b tempest-ApplicationCredentialsV3AdminTest-1886991400 tempest-ApplicationCredentialsV3AdminTest-1886991400-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:00.422026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b1578-82af-4a21-9ad1-36e36a50e24b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:00.428249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a224fc1-d49d-49d8-9267-7db1b9552492 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:00.429285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a224fc1-d49d-49d8-9267-7db1b9552492 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:00.429754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a224fc1-d49d-49d8-9267-7db1b9552492 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:00.430788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a224fc1-d49d-49d8-9267-7db1b9552492 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:00.432438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a224fc1-d49d-49d8-9267-7db1b9552492 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:00.435820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a224fc1-d49d-49d8-9267-7db1b9552492 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:00.437036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9317888-fe1c-48b1-8c74-3234363d7a7a tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b05218dd6d84464abeda2300ba5dc8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2025ca53caac413293464a79bebece1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:00.438006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9317888-fe1c-48b1-8c74-3234363d7a7a tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:00.438455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9317888-fe1c-48b1-8c74-3234363d7a7a tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:00.438784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9317888-fe1c-48b1-8c74-3234363d7a7a tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] PATH_INFO: `/v3/services/a1d1079e3cfb48b9a618f0e8cb96f80d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:00.439635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9317888-fe1c-48b1-8c74-3234363d7a7a tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a1d1079e3cfb48b9a618f0e8cb96f80d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:00.441747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9317888-fe1c-48b1-8c74-3234363d7a7a tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:00.456199 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2433/4930] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:02:00 2021] POST /identity/v3/roles => generated 246 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:00.461147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689da7f0-f2e9-4ec9-96ac-7d29168fdd63 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:00.461692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689da7f0-f2e9-4ec9-96ac-7d29168fdd63 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:00.462154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689da7f0-f2e9-4ec9-96ac-7d29168fdd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:00.477241 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2498/4931] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:00 2021] DELETE /identity/v3/services/a1d1079e3cfb48b9a618f0e8cb96f80d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:00.482218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9317888-fe1c-48b1-8c74-3234363d7a7a tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:00.502116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-689da7f0-f2e9-4ec9-96ac-7d29168fdd63 None None] MFA Rules not processed for user `26bc142b7c9a41a78f4c0e4efb11ce8e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:00.503912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-689da7f0-f2e9-4ec9-96ac-7d29168fdd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:00.509589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9317888-fe1c-48b1-8c74-3234363d7a7a tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:00.515764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4da8a9-7c15-4403-954d-275cbd084846 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:00.516758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4da8a9-7c15-4403-954d-275cbd084846 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:00.517192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4da8a9-7c15-4403-954d-275cbd084846 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:00.517486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4da8a9-7c15-4403-954d-275cbd084846 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/639bb4b1c8104d2795311876f8d37e12/users/9cfd46e14c6a4e5dbe6ad0f684676a76/roles/08656c95824441e198f113a3c9565a99` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:00.536929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4da8a9-7c15-4403-954d-275cbd084846 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_grant(project_id=639bb4b1c8104d2795311876f8d37e12, user_id=9cfd46e14c6a4e5dbe6ad0f684676a76, role_id=08656c95824441e198f113a3c9565a99)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:00.539846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4da8a9-7c15-4403-954d-275cbd084846 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:00.556649 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2499/4932] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:00 2021] PUT /identity/v3/projects/639bb4b1c8104d2795311876f8d37e12/users/9cfd46e14c6a4e5dbe6ad0f684676a76/roles/08656c95824441e198f113a3c9565a99 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:00.558631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4da8a9-7c15-4403-954d-275cbd084846 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:00.648815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4da8a9-7c15-4403-954d-275cbd084846 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:00.652876 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2434/4933] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:00 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Dec 18 21:02:00.653662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689da7f0-f2e9-4ec9-96ac-7d29168fdd63 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:00.658721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4be84-33ee-4eb0-abcb-cf513ee8469b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b05218dd6d84464abeda2300ba5dc8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2025ca53caac413293464a79bebece1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:00.660013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4be84-33ee-4eb0-abcb-cf513ee8469b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:00.660013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4be84-33ee-4eb0-abcb-cf513ee8469b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:00.660229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4be84-33ee-4eb0-abcb-cf513ee8469b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] PATH_INFO: `/v3/services/5751f23a13554fd7ba49089582b307b8` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:00.660901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4be84-33ee-4eb0-abcb-cf513ee8469b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5751f23a13554fd7ba49089582b307b8)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:00.662915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4be84-33ee-4eb0-abcb-cf513ee8469b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:00.689412 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2500/4934] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:00 2021] DELETE /identity/v3/services/5751f23a13554fd7ba49089582b307b8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:00.695372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4be84-33ee-4eb0-abcb-cf513ee8469b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:00.738789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689da7f0-f2e9-4ec9-96ac-7d29168fdd63 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:00.759667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffcc82-bd50-4f1c-852a-3acfd5faa692 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:00.761488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffcc82-bd50-4f1c-852a-3acfd5faa692 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:00.761791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffcc82-bd50-4f1c-852a-3acfd5faa692 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:00.762092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffcc82-bd50-4f1c-852a-3acfd5faa692 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/639bb4b1c8104d2795311876f8d37e12/users/9cfd46e14c6a4e5dbe6ad0f684676a76/roles/2c74bfd87671487b87a81c2c4399a687` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:00.765182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffcc82-bd50-4f1c-852a-3acfd5faa692 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_grant(project_id=639bb4b1c8104d2795311876f8d37e12, user_id=9cfd46e14c6a4e5dbe6ad0f684676a76, role_id=2c74bfd87671487b87a81c2c4399a687)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:00.770989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffcc82-bd50-4f1c-852a-3acfd5faa692 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:00.797472 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2435/4935] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:00 2021] PUT /identity/v3/projects/639bb4b1c8104d2795311876f8d37e12/users/9cfd46e14c6a4e5dbe6ad0f684676a76/roles/2c74bfd87671487b87a81c2c4399a687 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:00.798501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffcc82-bd50-4f1c-852a-3acfd5faa692 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:00.802401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-46ffcc82-bd50-4f1c-852a-3acfd5faa692 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:00.812217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4be84-33ee-4eb0-abcb-cf513ee8469b tempest-ServicesTestJSON-1013208614 tempest-ServicesTestJSON-1013208614-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:00.883653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffcc82-bd50-4f1c-852a-3acfd5faa692 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:00.886620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a09ad1-42ef-437f-b5e8-d27eee170c46 tempest-ApplicationCredentialsV3AdminTest-1886991400 tempest-ApplicationCredentialsV3AdminTest-1886991400-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26bc142b7c9a41a78f4c0e4efb11ce8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1f9e7d3cd4e4cb7a8c9ca3255b939d5', 'project_domain_id': 'default', 'roles': ['tempest-test_role-584154726', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:00.887574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a09ad1-42ef-437f-b5e8-d27eee170c46 tempest-ApplicationCredentialsV3AdminTest-1886991400 tempest-ApplicationCredentialsV3AdminTest-1886991400-project] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:00.887864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a09ad1-42ef-437f-b5e8-d27eee170c46 tempest-ApplicationCredentialsV3AdminTest-1886991400 tempest-ApplicationCredentialsV3AdminTest-1886991400-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:00.888184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a09ad1-42ef-437f-b5e8-d27eee170c46 tempest-ApplicationCredentialsV3AdminTest-1886991400 tempest-ApplicationCredentialsV3AdminTest-1886991400-project] PATH_INFO: `/v3/users/26bc142b7c9a41a78f4c0e4efb11ce8e/application_credentials/63cab7cf154146c9a365847661485f87` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:00.889537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca75bd-6c50-4058-80e4-d40b0cda3b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:00.889686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a09ad1-42ef-437f-b5e8-d27eee170c46 tempest-ApplicationCredentialsV3AdminTest-1886991400 tempest-ApplicationCredentialsV3AdminTest-1886991400-project] RBAC: Authorizing `identity:delete_application_credential(user_id=26bc142b7c9a41a78f4c0e4efb11ce8e, application_credential_id=63cab7cf154146c9a365847661485f87)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:00.890466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca75bd-6c50-4058-80e4-d40b0cda3b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:00.890753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca75bd-6c50-4058-80e4-d40b0cda3b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:00.891034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca75bd-6c50-4058-80e4-d40b0cda3b8f admin admin] PATH_INFO: `/v3/users/9f088bde04c34e53bf2748e612592ef9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:00.891243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a09ad1-42ef-437f-b5e8-d27eee170c46 tempest-ApplicationCredentialsV3AdminTest-1886991400 tempest-ApplicationCredentialsV3AdminTest-1886991400-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:00.892267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca75bd-6c50-4058-80e4-d40b0cda3b8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f088bde04c34e53bf2748e612592ef9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:00.894365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca75bd-6c50-4058-80e4-d40b0cda3b8f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:00.934359 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2501/4936] 10.222.0.13 () {58 vars in 1394 bytes} [Sat Dec 18 21:02:00 2021] DELETE /identity/v3/users/26bc142b7c9a41a78f4c0e4efb11ce8e/application_credentials/63cab7cf154146c9a365847661485f87 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:00.936021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a09ad1-42ef-437f-b5e8-d27eee170c46 tempest-ApplicationCredentialsV3AdminTest-1886991400 tempest-ApplicationCredentialsV3AdminTest-1886991400-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:00.965212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0cca75bd-6c50-4058-80e4-d40b0cda3b8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f088bde04c34e53bf2748e612592ef9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:00.972539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0cca75bd-6c50-4058-80e4-d40b0cda3b8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f088bde04c34e53bf2748e612592ef9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.001108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0cca75bd-6c50-4058-80e4-d40b0cda3b8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f088bde04c34e53bf2748e612592ef9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.001976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0cca75bd-6c50-4058-80e4-d40b0cda3b8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f088bde04c34e53bf2748e612592ef9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.016239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0cca75bd-6c50-4058-80e4-d40b0cda3b8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f088bde04c34e53bf2748e612592ef9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.022298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a09ad1-42ef-437f-b5e8-d27eee170c46 tempest-ApplicationCredentialsV3AdminTest-1886991400 tempest-ApplicationCredentialsV3AdminTest-1886991400-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:01.028608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848033ee-13fa-46ee-b1d6-ecdca571c779 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:01.029331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848033ee-13fa-46ee-b1d6-ecdca571c779 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:01.029632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848033ee-13fa-46ee-b1d6-ecdca571c779 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:01.029937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848033ee-13fa-46ee-b1d6-ecdca571c779 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:01.030755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848033ee-13fa-46ee-b1d6-ecdca571c779 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:01.032849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848033ee-13fa-46ee-b1d6-ecdca571c779 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:01.033369 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2436/4937] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:00 2021] DELETE /identity/v3/users/9f088bde04c34e53bf2748e612592ef9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:01.034420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca75bd-6c50-4058-80e4-d40b0cda3b8f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:01.036145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0cca75bd-6c50-4058-80e4-d40b0cda3b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:01.069154 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2502/4938] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:00 2021] GET /identity/v3/users => generated 8661 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:01.070423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035094a3-4a00-4481-9c36-05bf662d0787 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:01.070718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035094a3-4a00-4481-9c36-05bf662d0787 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:01.071090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035094a3-4a00-4481-9c36-05bf662d0787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:01.092117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-035094a3-4a00-4481-9c36-05bf662d0787 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:01.093540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-035094a3-4a00-4481-9c36-05bf662d0787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:01.133462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca75bd-6c50-4058-80e4-d40b0cda3b8f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:01.139996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8bdce-6932-4c9a-b296-3165e386619f tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '281fe3e80cf5425f9b7f7c3d42c7716c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba57159d13b4b05a25df426fbc2cd47', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:01.140869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8bdce-6932-4c9a-b296-3165e386619f tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:01.141154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8bdce-6932-4c9a-b296-3165e386619f tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:01.141668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8bdce-6932-4c9a-b296-3165e386619f tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] PATH_INFO: `/v3/roles/229494670d984eb4bef56b1e1550aebf` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:01.143295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8bdce-6932-4c9a-b296-3165e386619f tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] RBAC: Authorizing `identity:delete_role(role_id=229494670d984eb4bef56b1e1550aebf)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:01.145172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8bdce-6932-4c9a-b296-3165e386619f tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:01.157063 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2503/4939] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:01.160034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c26334-0205-4e14-b123-1d84839a9497 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:01.160635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c26334-0205-4e14-b123-1d84839a9497 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:01.161141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c26334-0205-4e14-b123-1d84839a9497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:01.192379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e2e8bdce-6932-4c9a-b296-3165e386619f tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] Invalidating the token cache because role 229494670d984eb4bef56b1e1550aebf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:01.192676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e2e8bdce-6932-4c9a-b296-3165e386619f tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.193378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e2e8bdce-6932-4c9a-b296-3165e386619f tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.195434 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2437/4940] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:01 2021] DELETE /identity/v3/roles/229494670d984eb4bef56b1e1550aebf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:01.202394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8bdce-6932-4c9a-b296-3165e386619f tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:01.204124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e2e8bdce-6932-4c9a-b296-3165e386619f tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:01.204287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e5c26334-0205-4e14-b123-1d84839a9497 None None] MFA Rules not processed for user `9cfd46e14c6a4e5dbe6ad0f684676a76`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:01.204822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e5c26334-0205-4e14-b123-1d84839a9497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:01.268417 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2504/4941] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:01 2021] POST /identity/v3/auth/tokens => generated 3267 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:01.269358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c26334-0205-4e14-b123-1d84839a9497 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:01.270745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e5c26334-0205-4e14-b123-1d84839a9497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:01.271283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8bdce-6932-4c9a-b296-3165e386619f tempest-ApplicationCredentialsV3AdminTest-508495295 tempest-ApplicationCredentialsV3AdminTest-508495295-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:01.275908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b457e8e-7018-423c-b96b-e374581f1a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:01.277363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b457e8e-7018-423c-b96b-e374581f1a70 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:01.277655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b457e8e-7018-423c-b96b-e374581f1a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:01.277954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b457e8e-7018-423c-b96b-e374581f1a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:01.279820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8b457e8e-7018-423c-b96b-e374581f1a70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:01.340025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c26334-0205-4e14-b123-1d84839a9497 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:01.345133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c7f51-f771-4391-97fa-b75aa90d9150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:01.345803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b457e8e-7018-423c-b96b-e374581f1a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:01.345935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c7f51-f771-4391-97fa-b75aa90d9150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:01.346207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c7f51-f771-4391-97fa-b75aa90d9150 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:01.346599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c7f51-f771-4391-97fa-b75aa90d9150 admin admin] PATH_INFO: `/v3/users/26bc142b7c9a41a78f4c0e4efb11ce8e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:01.348293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c7f51-f771-4391-97fa-b75aa90d9150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26bc142b7c9a41a78f4c0e4efb11ce8e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:01.348841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b457e8e-7018-423c-b96b-e374581f1a70 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:01.356900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c7f51-f771-4391-97fa-b75aa90d9150 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:01.361966 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2438/4942] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:01.363687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fb9f4-b096-4c4e-88b5-20475b6630f7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:01.364086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fb9f4-b096-4c4e-88b5-20475b6630f7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:01.364466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fb9f4-b096-4c4e-88b5-20475b6630f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:01.385002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-727fb9f4-b096-4c4e-88b5-20475b6630f7 None None] MFA Rules not processed for user `9cfd46e14c6a4e5dbe6ad0f684676a76`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:01.388530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-727fb9f4-b096-4c4e-88b5-20475b6630f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:01.398916 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2439/4943] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:01 2021] POST /identity/v3/auth/tokens => generated 3267 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:01.404875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fb9f4-b096-4c4e-88b5-20475b6630f7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:01.418050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fb9f4-b096-4c4e-88b5-20475b6630f7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:01.422201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-055c7f51-f771-4391-97fa-b75aa90d9150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26bc142b7c9a41a78f4c0e4efb11ce8e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.423453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622e227-0e0a-4384-96f7-847610e7788a tempest-TrustsV3TestJSON-601935638 tempest-user-474595340] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cfd46e14c6a4e5dbe6ad0f684676a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639bb4b1c8104d2795311876f8d37e12', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-778687791', 'tempest-DelegatedRole-376652302'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:01.424433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622e227-0e0a-4384-96f7-847610e7788a tempest-TrustsV3TestJSON-601935638 tempest-user-474595340] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:01.425021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622e227-0e0a-4384-96f7-847610e7788a tempest-TrustsV3TestJSON-601935638 tempest-user-474595340] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:01.425542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622e227-0e0a-4384-96f7-847610e7788a tempest-TrustsV3TestJSON-601935638 tempest-user-474595340] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:01.426619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622e227-0e0a-4384-96f7-847610e7788a tempest-TrustsV3TestJSON-601935638 tempest-user-474595340] RBAC: Authorizing `identity:create_trust()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:01.427960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622e227-0e0a-4384-96f7-847610e7788a tempest-TrustsV3TestJSON-601935638 tempest-user-474595340] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:01.430305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-055c7f51-f771-4391-97fa-b75aa90d9150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26bc142b7c9a41a78f4c0e4efb11ce8e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.431205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-055c7f51-f771-4391-97fa-b75aa90d9150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26bc142b7c9a41a78f4c0e4efb11ce8e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.445850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-055c7f51-f771-4391-97fa-b75aa90d9150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26bc142b7c9a41a78f4c0e4efb11ce8e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.454901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-055c7f51-f771-4391-97fa-b75aa90d9150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26bc142b7c9a41a78f4c0e4efb11ce8e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.461614 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2505/4944] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:01 2021] DELETE /identity/v3/users/26bc142b7c9a41a78f4c0e4efb11ce8e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:01.467044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033116f6-8aee-4de6-9e0e-cc1333ca2caf None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:01.467489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033116f6-8aee-4de6-9e0e-cc1333ca2caf None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:01.467815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033116f6-8aee-4de6-9e0e-cc1333ca2caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:01.503444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-033116f6-8aee-4de6-9e0e-cc1333ca2caf None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:01.504863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-033116f6-8aee-4de6-9e0e-cc1333ca2caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:01.534208 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-7622e227-0e0a-4384-96f7-847610e7788a tempest-TrustsV3TestJSON-601935638 tempest-user-474595340] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Dec 18 21:02:01.536522 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2440/4945] 10.222.0.13 () {60 vars in 1173 bytes} [Sat Dec 18 21:02:01 2021] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 132 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 18 21:02:01.543481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622e227-0e0a-4384-96f7-847610e7788a tempest-TrustsV3TestJSON-601935638 tempest-user-474595340] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:01.549326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7622e227-0e0a-4384-96f7-847610e7788a tempest-TrustsV3TestJSON-601935638 tempest-user-474595340] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:01.595778 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2506/4946] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:01.609436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033116f6-8aee-4de6-9e0e-cc1333ca2caf None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:01.611297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-033116f6-8aee-4de6-9e0e-cc1333ca2caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:01.657447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622e227-0e0a-4384-96f7-847610e7788a tempest-TrustsV3TestJSON-601935638 tempest-user-474595340] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:01.685154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033116f6-8aee-4de6-9e0e-cc1333ca2caf None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:01.691054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990d0f6-5621-4ee7-becb-afeb524b886a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:01.692772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990d0f6-5621-4ee7-becb-afeb524b886a service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:01.693364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990d0f6-5621-4ee7-becb-afeb524b886a service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:01.693674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990d0f6-5621-4ee7-becb-afeb524b886a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:01.708261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990d0f6-5621-4ee7-becb-afeb524b886a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:01.716913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990d0f6-5621-4ee7-becb-afeb524b886a service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:01.731813 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2507/4947] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:01.736941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3be3e7-250c-4597-941a-27205115c42b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:01.737836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3be3e7-250c-4597-941a-27205115c42b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:01.738275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3be3e7-250c-4597-941a-27205115c42b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:01.738602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3be3e7-250c-4597-941a-27205115c42b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles/2c74bfd87671487b87a81c2c4399a687` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:01.742220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3be3e7-250c-4597-941a-27205115c42b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2c74bfd87671487b87a81c2c4399a687)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:01.743963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3be3e7-250c-4597-941a-27205115c42b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:01.747740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990d0f6-5621-4ee7-becb-afeb524b886a service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:01.750086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e990d0f6-5621-4ee7-becb-afeb524b886a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:01.772922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990d0f6-5621-4ee7-becb-afeb524b886a service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:01.779450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7f70f-56d0-4624-aee9-5c94cd1909af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:01.780570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7f70f-56d0-4624-aee9-5c94cd1909af admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:01.781054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7f70f-56d0-4624-aee9-5c94cd1909af admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:01.781361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7f70f-56d0-4624-aee9-5c94cd1909af admin admin] PATH_INFO: `/v3/projects/ba29f82fb5704cd6a83680a442fcf04a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:01.782942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7f70f-56d0-4624-aee9-5c94cd1909af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba29f82fb5704cd6a83680a442fcf04a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:01.785779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7f70f-56d0-4624-aee9-5c94cd1909af admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:01.813129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ea3be3e7-250c-4597-941a-27205115c42b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invalidating the token cache because role 2c74bfd87671487b87a81c2c4399a687 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:01.813684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ea3be3e7-250c-4597-941a-27205115c42b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.814604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ea3be3e7-250c-4597-941a-27205115c42b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.820492 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2441/4948] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:01 2021] DELETE /identity/v3/roles/2c74bfd87671487b87a81c2c4399a687 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:01.822071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3be3e7-250c-4597-941a-27205115c42b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:01.824610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ea3be3e7-250c-4597-941a-27205115c42b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:01.845210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cac7f70f-56d0-4624-aee9-5c94cd1909af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba29f82fb5704cd6a83680a442fcf04a', 'request_id': 'req-cac7f70f-56d0-4624-aee9-5c94cd1909af'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.851593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cac7f70f-56d0-4624-aee9-5c94cd1909af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba29f82fb5704cd6a83680a442fcf04a', 'request_id': 'req-cac7f70f-56d0-4624-aee9-5c94cd1909af'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.859909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cac7f70f-56d0-4624-aee9-5c94cd1909af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba29f82fb5704cd6a83680a442fcf04a', 'request_id': 'req-cac7f70f-56d0-4624-aee9-5c94cd1909af'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.872046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cac7f70f-56d0-4624-aee9-5c94cd1909af admin admin] The token cache is being invalidate because project ba29f82fb5704cd6a83680a442fcf04a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:01.872431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cac7f70f-56d0-4624-aee9-5c94cd1909af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.873172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cac7f70f-56d0-4624-aee9-5c94cd1909af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:01.874872 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2508/4949] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:01 2021] DELETE /identity/v3/projects/ba29f82fb5704cd6a83680a442fcf04a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:01.878827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7f70f-56d0-4624-aee9-5c94cd1909af admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:01.880361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cac7f70f-56d0-4624-aee9-5c94cd1909af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:01.895782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3be3e7-250c-4597-941a-27205115c42b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:01.964192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7f70f-56d0-4624-aee9-5c94cd1909af admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:01.969419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fe848-a60e-4777-9bf5-28d4dff71a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:01.970599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fe848-a60e-4777-9bf5-28d4dff71a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:01.970980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fe848-a60e-4777-9bf5-28d4dff71a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:01.971354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fe848-a60e-4777-9bf5-28d4dff71a59 admin admin] PATH_INFO: `/v3/users/b05218dd6d84464abeda2300ba5dc8fa` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:01.973026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fe848-a60e-4777-9bf5-28d4dff71a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05218dd6d84464abeda2300ba5dc8fa)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:01.976177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fe848-a60e-4777-9bf5-28d4dff71a59 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:01.985721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220e13c-97fd-412d-9bae-304c314dfcc3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:01.987279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220e13c-97fd-412d-9bae-304c314dfcc3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:01.987436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220e13c-97fd-412d-9bae-304c314dfcc3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:01.987639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220e13c-97fd-412d-9bae-304c314dfcc3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles/08656c95824441e198f113a3c9565a99` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:01.989301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220e13c-97fd-412d-9bae-304c314dfcc3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_role(role_id=08656c95824441e198f113a3c9565a99)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:01.991298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220e13c-97fd-412d-9bae-304c314dfcc3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:02.028769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4d7fe848-a60e-4777-9bf5-28d4dff71a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05218dd6d84464abeda2300ba5dc8fa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.036116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4d7fe848-a60e-4777-9bf5-28d4dff71a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05218dd6d84464abeda2300ba5dc8fa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.036766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9220e13c-97fd-412d-9bae-304c314dfcc3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invalidating the token cache because role 08656c95824441e198f113a3c9565a99 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:02.036917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4d7fe848-a60e-4777-9bf5-28d4dff71a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05218dd6d84464abeda2300ba5dc8fa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.037064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9220e13c-97fd-412d-9bae-304c314dfcc3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.037902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9220e13c-97fd-412d-9bae-304c314dfcc3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.040199 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2442/4950] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:01 2021] DELETE /identity/v3/roles/08656c95824441e198f113a3c9565a99 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:02.044020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220e13c-97fd-412d-9bae-304c314dfcc3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:02.046399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9220e13c-97fd-412d-9bae-304c314dfcc3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:02.050896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4d7fe848-a60e-4777-9bf5-28d4dff71a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05218dd6d84464abeda2300ba5dc8fa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.061567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4d7fe848-a60e-4777-9bf5-28d4dff71a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05218dd6d84464abeda2300ba5dc8fa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.075547 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2509/4951] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:01 2021] DELETE /identity/v3/users/b05218dd6d84464abeda2300ba5dc8fa => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:02.108844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fe848-a60e-4777-9bf5-28d4dff71a59 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:02.110374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4d7fe848-a60e-4777-9bf5-28d4dff71a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:02.163503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220e13c-97fd-412d-9bae-304c314dfcc3 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:02.243776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fe848-a60e-4777-9bf5-28d4dff71a59 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:02.250097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:02.251171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:02.251638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:02.252066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1 admin admin] PATH_INFO: `/v3/projects/f1f9e7d3cd4e4cb7a8c9ca3255b939d5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:02.253460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1f9e7d3cd4e4cb7a8c9ca3255b939d5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:02.255555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:02.262021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f33fd5-e528-4883-9f26-4f142dad4127 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:02.264098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f33fd5-e528-4883-9f26-4f142dad4127 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:02.264834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f33fd5-e528-4883-9f26-4f142dad4127 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:02.265128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f33fd5-e528-4883-9f26-4f142dad4127 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users/9cfd46e14c6a4e5dbe6ad0f684676a76` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:02.266521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f33fd5-e528-4883-9f26-4f142dad4127 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9cfd46e14c6a4e5dbe6ad0f684676a76)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:02.269372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f33fd5-e528-4883-9f26-4f142dad4127 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:02.326303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1f9e7d3cd4e4cb7a8c9ca3255b939d5', 'request_id': 'req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.336027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1f9e7d3cd4e4cb7a8c9ca3255b939d5', 'request_id': 'req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.343800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-99f33fd5-e528-4883-9f26-4f142dad4127 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cfd46e14c6a4e5dbe6ad0f684676a76'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.347614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1f9e7d3cd4e4cb7a8c9ca3255b939d5', 'request_id': 'req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.359042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-99f33fd5-e528-4883-9f26-4f142dad4127 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cfd46e14c6a4e5dbe6ad0f684676a76'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.366859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1 admin admin] The token cache is being invalidate because project f1f9e7d3cd4e4cb7a8c9ca3255b939d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:02.367256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.368554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.374128 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2510/4952] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:02 2021] DELETE /identity/v3/projects/f1f9e7d3cd4e4cb7a8c9ca3255b939d5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:02:02.376375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:02.383093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:02.391542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-99f33fd5-e528-4883-9f26-4f142dad4127 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cfd46e14c6a4e5dbe6ad0f684676a76'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.393390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-99f33fd5-e528-4883-9f26-4f142dad4127 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cfd46e14c6a4e5dbe6ad0f684676a76'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.407981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-99f33fd5-e528-4883-9f26-4f142dad4127 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cfd46e14c6a4e5dbe6ad0f684676a76'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.416188 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2443/4953] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:02 2021] DELETE /identity/v3/users/9cfd46e14c6a4e5dbe6ad0f684676a76 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:02.418297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f33fd5-e528-4883-9f26-4f142dad4127 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:02.420744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-99f33fd5-e528-4883-9f26-4f142dad4127 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:02.487836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92df6e6-4b5a-45f0-93a5-59fdc422c7e1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:02.519528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f33fd5-e528-4883-9f26-4f142dad4127 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:02.523692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286649e8-93e6-4716-ab84-883aa5111996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:02.524449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286649e8-93e6-4716-ab84-883aa5111996 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:02.524830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286649e8-93e6-4716-ab84-883aa5111996 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:02.525237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286649e8-93e6-4716-ab84-883aa5111996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:02.529391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-286649e8-93e6-4716-ab84-883aa5111996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:02.566941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520bf5a-958a-4bad-935d-cfacc540d495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:02.567904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520bf5a-958a-4bad-935d-cfacc540d495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:02.568260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520bf5a-958a-4bad-935d-cfacc540d495 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:02.568627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520bf5a-958a-4bad-935d-cfacc540d495 admin admin] PATH_INFO: `/v3/users/281fe3e80cf5425f9b7f7c3d42c7716c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:02.569918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520bf5a-958a-4bad-935d-cfacc540d495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=281fe3e80cf5425f9b7f7c3d42c7716c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:02.571994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520bf5a-958a-4bad-935d-cfacc540d495 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:02.595711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286649e8-93e6-4716-ab84-883aa5111996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:02.597133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286649e8-93e6-4716-ab84-883aa5111996 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:02.610729 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2444/4954] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:02.611777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286649e8-93e6-4716-ab84-883aa5111996 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:02.613626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-286649e8-93e6-4716-ab84-883aa5111996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:02.623809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5520bf5a-958a-4bad-935d-cfacc540d495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '281fe3e80cf5425f9b7f7c3d42c7716c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.632696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5520bf5a-958a-4bad-935d-cfacc540d495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '281fe3e80cf5425f9b7f7c3d42c7716c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.633739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5520bf5a-958a-4bad-935d-cfacc540d495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '281fe3e80cf5425f9b7f7c3d42c7716c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.647783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5520bf5a-958a-4bad-935d-cfacc540d495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '281fe3e80cf5425f9b7f7c3d42c7716c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.657317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5520bf5a-958a-4bad-935d-cfacc540d495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '281fe3e80cf5425f9b7f7c3d42c7716c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.667012 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2511/4955] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:02 2021] DELETE /identity/v3/users/281fe3e80cf5425f9b7f7c3d42c7716c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:02.667012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520bf5a-958a-4bad-935d-cfacc540d495 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:02.667012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5520bf5a-958a-4bad-935d-cfacc540d495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:02.685551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286649e8-93e6-4716-ab84-883aa5111996 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:02.766313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64807db2-07c2-4566-b42c-a62f2f0449ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:02.767893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64807db2-07c2-4566-b42c-a62f2f0449ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:02.768289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64807db2-07c2-4566-b42c-a62f2f0449ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:02.768682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64807db2-07c2-4566-b42c-a62f2f0449ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/639bb4b1c8104d2795311876f8d37e12` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:02.770715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64807db2-07c2-4566-b42c-a62f2f0449ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_project(project_id=639bb4b1c8104d2795311876f8d37e12)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:02.773366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520bf5a-958a-4bad-935d-cfacc540d495 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:02.773519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64807db2-07c2-4566-b42c-a62f2f0449ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:02.780020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c98fd-4579-42fc-81a1-b9847ce9696b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:02.781140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c98fd-4579-42fc-81a1-b9847ce9696b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:02.781649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c98fd-4579-42fc-81a1-b9847ce9696b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:02.782204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c98fd-4579-42fc-81a1-b9847ce9696b admin admin] PATH_INFO: `/v3/projects/2025ca53caac413293464a79bebece1a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:02.784321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c98fd-4579-42fc-81a1-b9847ce9696b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2025ca53caac413293464a79bebece1a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:02.786802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c98fd-4579-42fc-81a1-b9847ce9696b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:02.831194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-64807db2-07c2-4566-b42c-a62f2f0449ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '639bb4b1c8104d2795311876f8d37e12', 'request_id': 'req-64807db2-07c2-4566-b42c-a62f2f0449ad'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.839234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-64807db2-07c2-4566-b42c-a62f2f0449ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '639bb4b1c8104d2795311876f8d37e12', 'request_id': 'req-64807db2-07c2-4566-b42c-a62f2f0449ad'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.845638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-64807db2-07c2-4566-b42c-a62f2f0449ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '639bb4b1c8104d2795311876f8d37e12', 'request_id': 'req-64807db2-07c2-4566-b42c-a62f2f0449ad'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.857683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-999c98fd-4579-42fc-81a1-b9847ce9696b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2025ca53caac413293464a79bebece1a', 'request_id': 'req-999c98fd-4579-42fc-81a1-b9847ce9696b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.861238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-64807db2-07c2-4566-b42c-a62f2f0449ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] The token cache is being invalidate because project 639bb4b1c8104d2795311876f8d37e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:02.861838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-64807db2-07c2-4566-b42c-a62f2f0449ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.862709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-64807db2-07c2-4566-b42c-a62f2f0449ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.864463 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2445/4956] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:02 2021] DELETE /identity/v3/projects/639bb4b1c8104d2795311876f8d37e12 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:02.867907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-999c98fd-4579-42fc-81a1-b9847ce9696b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2025ca53caac413293464a79bebece1a', 'request_id': 'req-999c98fd-4579-42fc-81a1-b9847ce9696b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.872498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64807db2-07c2-4566-b42c-a62f2f0449ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:02.874033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-64807db2-07c2-4566-b42c-a62f2f0449ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:02.880338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-999c98fd-4579-42fc-81a1-b9847ce9696b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2025ca53caac413293464a79bebece1a', 'request_id': 'req-999c98fd-4579-42fc-81a1-b9847ce9696b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.897629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-999c98fd-4579-42fc-81a1-b9847ce9696b admin admin] The token cache is being invalidate because project 2025ca53caac413293464a79bebece1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:02.898409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-999c98fd-4579-42fc-81a1-b9847ce9696b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.899277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-999c98fd-4579-42fc-81a1-b9847ce9696b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:02.912648 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2512/4957] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:02 2021] DELETE /identity/v3/projects/2025ca53caac413293464a79bebece1a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:02.918467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dc405-49be-4415-941e-c81b52f7f725 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:02.919000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dc405-49be-4415-941e-c81b52f7f725 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:02.919471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dc405-49be-4415-941e-c81b52f7f725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:02.945545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-de1dc405-49be-4415-941e-c81b52f7f725 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:02.947122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-de1dc405-49be-4415-941e-c81b52f7f725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:02.986604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64807db2-07c2-4566-b42c-a62f2f0449ad tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:03.027764 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2513/4958] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:03.028511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dc405-49be-4415-941e-c81b52f7f725 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:03.031243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-de1dc405-49be-4415-941e-c81b52f7f725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:03.056437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dc405-49be-4415-941e-c81b52f7f725 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:03.063388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:03.064456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.064845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.065226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd admin admin] PATH_INFO: `/v3/projects/9ba57159d13b4b05a25df426fbc2cd47` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.067551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba57159d13b4b05a25df426fbc2cd47)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:03.069598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:03.070298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ed3b9-62bf-40d2-bd99-12351693bb42 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:03.071291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ed3b9-62bf-40d2-bd99-12351693bb42 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.071601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ed3b9-62bf-40d2-bd99-12351693bb42 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.071877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ed3b9-62bf-40d2-bd99-12351693bb42 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.072793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ed3b9-62bf-40d2-bd99-12351693bb42 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:03.075361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ed3b9-62bf-40d2-bd99-12351693bb42 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:03.104258 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2446/4959] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:02:02 2021] POST /identity/v3/projects => generated 329 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:03.104258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286941d-4765-454c-b6d8-2ea42e80dc7d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.104258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286941d-4765-454c-b6d8-2ea42e80dc7d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.104258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286941d-4765-454c-b6d8-2ea42e80dc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.125604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0286941d-4765-454c-b6d8-2ea42e80dc7d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:03.126911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0286941d-4765-454c-b6d8-2ea42e80dc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:03.129619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba57159d13b4b05a25df426fbc2cd47', 'request_id': 'req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:03.136908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba57159d13b4b05a25df426fbc2cd47', 'request_id': 'req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:03.145696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba57159d13b4b05a25df426fbc2cd47', 'request_id': 'req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:03.158201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd admin admin] The token cache is being invalidate because project 9ba57159d13b4b05a25df426fbc2cd47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:03.158639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:03.159579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:03.161405 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2514/4960] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:03 2021] DELETE /identity/v3/projects/9ba57159d13b4b05a25df426fbc2cd47 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:03.165980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:03.165980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:03.210147 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2447/4961] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:03.212096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0b139-423a-462b-b32c-55e154cf4603 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.213008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0b139-423a-462b-b32c-55e154cf4603 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.213336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0b139-423a-462b-b32c-55e154cf4603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.233646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d2e0b139-423a-462b-b32c-55e154cf4603 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:03.235041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d2e0b139-423a-462b-b32c-55e154cf4603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:03.253061 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2448/4962] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:03.254050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0b139-423a-462b-b32c-55e154cf4603 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:03.265095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0b139-423a-462b-b32c-55e154cf4603 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:03.271145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4362f-ae61-4c47-8e93-fc7056b96c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:03.272374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4362f-ae61-4c47-8e93-fc7056b96c00 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.272670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4362f-ae61-4c47-8e93-fc7056b96c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.272952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4362f-ae61-4c47-8e93-fc7056b96c00 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.273997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4362f-ae61-4c47-8e93-fc7056b96c00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:03.274187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4362f-ae61-4c47-8e93-fc7056b96c00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:03.279954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4362f-ae61-4c47-8e93-fc7056b96c00 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:03.286233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c4ffc-49bc-4cb7-a1db-0c3211069efd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:03.292402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042eb5b0-cb13-47f8-a87a-d0200127a7e5 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:03.292784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042eb5b0-cb13-47f8-a87a-d0200127a7e5 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.293059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042eb5b0-cb13-47f8-a87a-d0200127a7e5 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.293918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042eb5b0-cb13-47f8-a87a-d0200127a7e5 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.294693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042eb5b0-cb13-47f8-a87a-d0200127a7e5 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:03.296811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042eb5b0-cb13-47f8-a87a-d0200127a7e5 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:03.299163 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2449/4963] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:03.300928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f670b62-5e84-4827-af31-f30d3c5eae3f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.301220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f670b62-5e84-4827-af31-f30d3c5eae3f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.301514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f670b62-5e84-4827-af31-f30d3c5eae3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.321305 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2515/4964] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:03 2021] POST /identity/v3/users => generated 413 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:03.322731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042eb5b0-cb13-47f8-a87a-d0200127a7e5 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:03.323865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7f670b62-5e84-4827-af31-f30d3c5eae3f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:03.325291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7f670b62-5e84-4827-af31-f30d3c5eae3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:03.333452 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2450/4965] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:03.334239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f670b62-5e84-4827-af31-f30d3c5eae3f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:03.337184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042eb5b0-cb13-47f8-a87a-d0200127a7e5 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:03.343096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b1b12-a4ab-4456-8438-6c4e21460e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:03.344031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b1b12-a4ab-4456-8438-6c4e21460e10 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.344599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b1b12-a4ab-4456-8438-6c4e21460e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.344888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b1b12-a4ab-4456-8438-6c4e21460e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.345655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b1b12-a4ab-4456-8438-6c4e21460e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:03.347583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b1b12-a4ab-4456-8438-6c4e21460e10 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:03.348017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f670b62-5e84-4827-af31-f30d3c5eae3f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:03.353339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a81a6-9ece-4b44-b825-ebbf3d366255 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:03.354006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a81a6-9ece-4b44-b825-ebbf3d366255 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.354850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a81a6-9ece-4b44-b825-ebbf3d366255 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.355644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a81a6-9ece-4b44-b825-ebbf3d366255 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.355947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a81a6-9ece-4b44-b825-ebbf3d366255 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:03.357513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a81a6-9ece-4b44-b825-ebbf3d366255 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:03.373662 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2451/4966] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:02:03 2021] POST /identity/v3/roles => generated 243 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:03.374517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a81a6-9ece-4b44-b825-ebbf3d366255 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:03.381961 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2516/4967] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:03 2021] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:03.382870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b1b12-a4ab-4456-8438-6c4e21460e10 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:03.390669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a81a6-9ece-4b44-b825-ebbf3d366255 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:03.454127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c01f65-2dfe-4f8f-beb5-4c7aa5ba3f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:03.454836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01f65-2dfe-4f8f-beb5-4c7aa5ba3f8d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.455337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01f65-2dfe-4f8f-beb5-4c7aa5ba3f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.455625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01f65-2dfe-4f8f-beb5-4c7aa5ba3f8d admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.456975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c01f65-2dfe-4f8f-beb5-4c7aa5ba3f8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:03.457335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c01f65-2dfe-4f8f-beb5-4c7aa5ba3f8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:03.459356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c01f65-2dfe-4f8f-beb5-4c7aa5ba3f8d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:03.462383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b1b12-a4ab-4456-8438-6c4e21460e10 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:03.469388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ba122-969d-45b3-9d7a-7aa6c4dba58b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:03.470694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba122-969d-45b3-9d7a-7aa6c4dba58b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.471200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba122-969d-45b3-9d7a-7aa6c4dba58b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.471714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba122-969d-45b3-9d7a-7aa6c4dba58b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.472721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ba122-969d-45b3-9d7a-7aa6c4dba58b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:03.474658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ba122-969d-45b3-9d7a-7aa6c4dba58b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:03.477348 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2452/4968] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:03.478234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c01f65-2dfe-4f8f-beb5-4c7aa5ba3f8d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:03.490121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c01f65-2dfe-4f8f-beb5-4c7aa5ba3f8d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:03.498244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f373c81-b1eb-49f8-90e3-a8eb08c6fae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:03.499677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f373c81-b1eb-49f8-90e3-a8eb08c6fae9 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.500217 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2517/4969] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:02:03 2021] POST /identity/v3/roles => generated 246 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:03.503421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f373c81-b1eb-49f8-90e3-a8eb08c6fae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.503818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ba122-969d-45b3-9d7a-7aa6c4dba58b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:03.504511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f373c81-b1eb-49f8-90e3-a8eb08c6fae9 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.505408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f373c81-b1eb-49f8-90e3-a8eb08c6fae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:03.510306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f373c81-b1eb-49f8-90e3-a8eb08c6fae9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:03.516567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ba122-969d-45b3-9d7a-7aa6c4dba58b tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:03.523275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c344dfa-6f05-4151-a4b1-836013812b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:03.524034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c344dfa-6f05-4151-a4b1-836013812b79 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.524393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c344dfa-6f05-4151-a4b1-836013812b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.525398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c344dfa-6f05-4151-a4b1-836013812b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.525521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c344dfa-6f05-4151-a4b1-836013812b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:03.527686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c344dfa-6f05-4151-a4b1-836013812b79 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:03.542629 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2453/4970] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:03 2021] POST /identity/v3/users => generated 284 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:03.544650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f373c81-b1eb-49f8-90e3-a8eb08c6fae9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:03.566773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f373c81-b1eb-49f8-90e3-a8eb08c6fae9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:03.572116 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2518/4971] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:03 2021] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:03.572116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c344dfa-6f05-4151-a4b1-836013812b79 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:03.646331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c344dfa-6f05-4151-a4b1-836013812b79 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:03.652032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9d3c0-071d-4b87-917f-ae07576a4332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:03.652697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9d3c0-071d-4b87-917f-ae07576a4332 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.652987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9d3c0-071d-4b87-917f-ae07576a4332 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.653399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9d3c0-071d-4b87-917f-ae07576a4332 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.654332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9d3c0-071d-4b87-917f-ae07576a4332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:03.655356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb9e67-3eb0-4d2a-b9ce-e08b65057dc4 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:03.656105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9d3c0-071d-4b87-917f-ae07576a4332 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:03.657232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb9e67-3eb0-4d2a-b9ce-e08b65057dc4 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.658053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb9e67-3eb0-4d2a-b9ce-e08b65057dc4 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.658597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb9e67-3eb0-4d2a-b9ce-e08b65057dc4 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/10190fa71de6467b8c9d231bd15136fa/users/04816cee44f4409c83517a35ae97c75f/roles/b7df1eaf090c4854b6cfe0f0a6550116` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.671408 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2519/4972] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:03 2021] GET /identity/v3/roles => generated 1891 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:03.671408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9d3c0-071d-4b87-917f-ae07576a4332 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:03.683929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9d3c0-071d-4b87-917f-ae07576a4332 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:03.687512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb9e67-3eb0-4d2a-b9ce-e08b65057dc4 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_grant(project_id=10190fa71de6467b8c9d231bd15136fa, user_id=04816cee44f4409c83517a35ae97c75f, role_id=b7df1eaf090c4854b6cfe0f0a6550116)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:03.689147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1ffdd-7616-4c5e-a486-087fb22936e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:03.689827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1ffdd-7616-4c5e-a486-087fb22936e7 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.690100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1ffdd-7616-4c5e-a486-087fb22936e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.690432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1ffdd-7616-4c5e-a486-087fb22936e7 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.691254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1ffdd-7616-4c5e-a486-087fb22936e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:03.693556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1ffdd-7616-4c5e-a486-087fb22936e7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:03.693879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb9e67-3eb0-4d2a-b9ce-e08b65057dc4 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:03.723198 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2454/4973] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:03 2021] PUT /identity/v3/projects/10190fa71de6467b8c9d231bd15136fa/users/04816cee44f4409c83517a35ae97c75f/roles/b7df1eaf090c4854b6cfe0f0a6550116 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:03.724025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb9e67-3eb0-4d2a-b9ce-e08b65057dc4 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:03.730938 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2520/4974] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:03 2021] POST /identity/v3/users => generated 283 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:03.731866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1ffdd-7616-4c5e-a486-087fb22936e7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:03.760194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1ffdd-7616-4c5e-a486-087fb22936e7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:03.815401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb9e67-3eb0-4d2a-b9ce-e08b65057dc4 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:03.821537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8569bd5-3f26-490b-879d-df9d21eaa7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:03.822519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8569bd5-3f26-490b-879d-df9d21eaa7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.822960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8569bd5-3f26-490b-879d-df9d21eaa7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.823311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8569bd5-3f26-490b-879d-df9d21eaa7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.824264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8569bd5-3f26-490b-879d-df9d21eaa7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:03.826041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8569bd5-3f26-490b-879d-df9d21eaa7f1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:03.843021 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2455/4975] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:03 2021] GET /identity/v3/roles => generated 1891 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:03.853269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8569bd5-3f26-490b-879d-df9d21eaa7f1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:03.863658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf2d2e-4b43-44ba-b019-a2019b20925c tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:03.864749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf2d2e-4b43-44ba-b019-a2019b20925c tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.865049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf2d2e-4b43-44ba-b019-a2019b20925c tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.865339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf2d2e-4b43-44ba-b019-a2019b20925c tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/10190fa71de6467b8c9d231bd15136fa/users/04816cee44f4409c83517a35ae97c75f/roles/9b24d8acaccd49f8befc0117ef9b2459` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.869060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf2d2e-4b43-44ba-b019-a2019b20925c tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_grant(project_id=10190fa71de6467b8c9d231bd15136fa, user_id=04816cee44f4409c83517a35ae97c75f, role_id=9b24d8acaccd49f8befc0117ef9b2459)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:03.873439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf2d2e-4b43-44ba-b019-a2019b20925c tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:03.881184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8569bd5-3f26-490b-879d-df9d21eaa7f1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:03.894672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f0f29-dc6e-4191-ba02-02a92f974f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:03.895616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f0f29-dc6e-4191-ba02-02a92f974f0a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:03.897320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f0f29-dc6e-4191-ba02-02a92f974f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:03.899835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f0f29-dc6e-4191-ba02-02a92f974f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:03.899995 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2521/4976] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:03 2021] PUT /identity/v3/projects/10190fa71de6467b8c9d231bd15136fa/users/04816cee44f4409c83517a35ae97c75f/roles/9b24d8acaccd49f8befc0117ef9b2459 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:03.904558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f0f29-dc6e-4191-ba02-02a92f974f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:03.904740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf2d2e-4b43-44ba-b019-a2019b20925c tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:03.911952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f0f29-dc6e-4191-ba02-02a92f974f0a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:03.954198 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2456/4977] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:03 2021] GET /identity/v3/roles => generated 1891 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:03.959046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f0f29-dc6e-4191-ba02-02a92f974f0a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:03.986626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f0f29-dc6e-4191-ba02-02a92f974f0a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:04.000241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf2d2e-4b43-44ba-b019-a2019b20925c tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:04.005898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aae747-8aca-446f-8e87-ec030e36380f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:04.007042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aae747-8aca-446f-8e87-ec030e36380f admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:04.007528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aae747-8aca-446f-8e87-ec030e36380f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:04.007812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aae747-8aca-446f-8e87-ec030e36380f admin admin] PATH_INFO: `/v3/projects/358ba499e00e409fa196e710568f3d96/users/a59b243b4d9f4135bce6ef36397e659c/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:04.041020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aae747-8aca-446f-8e87-ec030e36380f admin admin] RBAC: Authorizing `identity:create_grant(project_id=358ba499e00e409fa196e710568f3d96, user_id=a59b243b4d9f4135bce6ef36397e659c, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:04.045119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aae747-8aca-446f-8e87-ec030e36380f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:04.084966 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2522/4978] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:03 2021] PUT /identity/v3/projects/358ba499e00e409fa196e710568f3d96/users/a59b243b4d9f4135bce6ef36397e659c/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:04.094942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aae747-8aca-446f-8e87-ec030e36380f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:04.100041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d28683-3490-4e63-9eb9-02a5f50d1f7f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:04.101039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d28683-3490-4e63-9eb9-02a5f50d1f7f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:04.101559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d28683-3490-4e63-9eb9-02a5f50d1f7f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:04.102086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d28683-3490-4e63-9eb9-02a5f50d1f7f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:04.103143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d28683-3490-4e63-9eb9-02a5f50d1f7f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:04.105804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d28683-3490-4e63-9eb9-02a5f50d1f7f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:04.138405 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2457/4979] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:03 2021] GET /identity/v3/users => generated 8337 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:04.139881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb1af0-400c-45b8-84ee-440dfe29f4be None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:04.140245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb1af0-400c-45b8-84ee-440dfe29f4be None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:04.140596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb1af0-400c-45b8-84ee-440dfe29f4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:04.184522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9bbb1af0-400c-45b8-84ee-440dfe29f4be None None] MFA Rules not processed for user `a59b243b4d9f4135bce6ef36397e659c`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:04.185739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9bbb1af0-400c-45b8-84ee-440dfe29f4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:04.197525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aae747-8aca-446f-8e87-ec030e36380f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:04.204784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7479a60-648d-4f0f-829f-b16a031a0317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:04.205462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7479a60-648d-4f0f-829f-b16a031a0317 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:04.205747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7479a60-648d-4f0f-829f-b16a031a0317 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:04.206024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7479a60-648d-4f0f-829f-b16a031a0317 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:04.207076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7479a60-648d-4f0f-829f-b16a031a0317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:04.208751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7479a60-648d-4f0f-829f-b16a031a0317 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:04.230848 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2523/4980] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:04 2021] GET /identity/v3/roles => generated 1891 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:04.231879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4811c-9012-4683-9a11-4187e667e7f6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:04.232327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4811c-9012-4683-9a11-4187e667e7f6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:04.232668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4811c-9012-4683-9a11-4187e667e7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:04.315748 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2458/4981] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:04 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:04.318398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cffa05-6980-4041-b1a2-a5cebf25b60e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:04.319120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cffa05-6980-4041-b1a2-a5cebf25b60e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:04.319900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cffa05-6980-4041-b1a2-a5cebf25b60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:04.349779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-16cffa05-6980-4041-b1a2-a5cebf25b60e None None] MFA Rules not processed for user `54121b5d80d64c4796889183c5197853`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:04.351216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-16cffa05-6980-4041-b1a2-a5cebf25b60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:04.352105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d0d4811c-9012-4683-9a11-4187e667e7f6 None None] MFA Rules not processed for user `04816cee44f4409c83517a35ae97c75f`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:04.353786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d0d4811c-9012-4683-9a11-4187e667e7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:04.432205 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2459/4982] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:04 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:04.436561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cffa05-6980-4041-b1a2-a5cebf25b60e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:04.442906 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2524/4983] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:04 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:04.447654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4811c-9012-4683-9a11-4187e667e7f6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:04.464847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cffa05-6980-4041-b1a2-a5cebf25b60e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:04.469453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4811c-9012-4683-9a11-4187e667e7f6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:04.470509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958f9c6-6cb8-4c73-aff6-5196741a09f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:04.472132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958f9c6-6cb8-4c73-aff6-5196741a09f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:04.472132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958f9c6-6cb8-4c73-aff6-5196741a09f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:04.472132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958f9c6-6cb8-4c73-aff6-5196741a09f4 admin admin] PATH_INFO: `/v3/projects/cda7298cf23e481685801602b13d9711/users/5dd93e6860634baa9245392f37d93f4e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:04.482815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce5cb5-92a9-4465-bfc3-4dd99fc979eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:04.483507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce5cb5-92a9-4465-bfc3-4dd99fc979eb admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:04.483772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce5cb5-92a9-4465-bfc3-4dd99fc979eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:04.484083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce5cb5-92a9-4465-bfc3-4dd99fc979eb admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:04.484779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce5cb5-92a9-4465-bfc3-4dd99fc979eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:04.486774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce5cb5-92a9-4465-bfc3-4dd99fc979eb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:04.497785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958f9c6-6cb8-4c73-aff6-5196741a09f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda7298cf23e481685801602b13d9711, user_id=5dd93e6860634baa9245392f37d93f4e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:04.530971 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958f9c6-6cb8-4c73-aff6-5196741a09f4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:04.536817 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2525/4984] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:04 2021] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:04.537984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf17c3-2d93-4992-92d1-f86eab6656ad None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:04.538289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf17c3-2d93-4992-92d1-f86eab6656ad None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:04.538767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf17c3-2d93-4992-92d1-f86eab6656ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:04.561786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7ecf17c3-2d93-4992-92d1-f86eab6656ad None None] MFA Rules not processed for user `04816cee44f4409c83517a35ae97c75f`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:04.563897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7ecf17c3-2d93-4992-92d1-f86eab6656ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:04.565326 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2460/4985] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:04 2021] PUT /identity/v3/projects/cda7298cf23e481685801602b13d9711/users/5dd93e6860634baa9245392f37d93f4e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:04.566231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958f9c6-6cb8-4c73-aff6-5196741a09f4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:04.660673 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2526/4986] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:04 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:04.662456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275e80a-b571-4880-9555-4ff31303e995 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:04.662747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275e80a-b571-4880-9555-4ff31303e995 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:04.663025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275e80a-b571-4880-9555-4ff31303e995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:04.674745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958f9c6-6cb8-4c73-aff6-5196741a09f4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:04.680338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9ec3e-a5c8-44ba-b7c4-d162bb5b68c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:04.681217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9ec3e-a5c8-44ba-b7c4-d162bb5b68c1 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:04.681536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9ec3e-a5c8-44ba-b7c4-d162bb5b68c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:04.681826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9ec3e-a5c8-44ba-b7c4-d162bb5b68c1 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:04.683330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9ec3e-a5c8-44ba-b7c4-d162bb5b68c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:04.696945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9ec3e-a5c8-44ba-b7c4-d162bb5b68c1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:04.701288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0275e80a-b571-4880-9555-4ff31303e995 None None] MFA Rules not processed for user `5dd93e6860634baa9245392f37d93f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:04.702723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0275e80a-b571-4880-9555-4ff31303e995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:04.739635 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2461/4987] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:04 2021] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:04.740384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9ec3e-a5c8-44ba-b7c4-d162bb5b68c1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:04.764949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9ec3e-a5c8-44ba-b7c4-d162bb5b68c1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:04.775955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5411eaf-9874-4093-aa3c-b000147404d9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04816cee44f4409c83517a35ae97c75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10190fa71de6467b8c9d231bd15136fa', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-285741286', 'tempest-NotDelegatedRole-826445456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:04.776695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5411eaf-9874-4093-aa3c-b000147404d9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:04.777142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5411eaf-9874-4093-aa3c-b000147404d9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:04.777436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5411eaf-9874-4093-aa3c-b000147404d9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:04.778218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5411eaf-9874-4093-aa3c-b000147404d9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: Authorizing `identity:create_trust()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:04.779667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5411eaf-9874-4093-aa3c-b000147404d9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:04.811418 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2527/4988] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:04 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:04.812437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275e80a-b571-4880-9555-4ff31303e995 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:04.828007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275e80a-b571-4880-9555-4ff31303e995 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:04.833156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39b833-c753-4948-ba91-198408119a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:04.833817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39b833-c753-4948-ba91-198408119a6c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:04.834101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39b833-c753-4948-ba91-198408119a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:04.834454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39b833-c753-4948-ba91-198408119a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:04.835193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39b833-c753-4948-ba91-198408119a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:04.836893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39b833-c753-4948-ba91-198408119a6c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:04.853564 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2528/4989] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:04 2021] GET /identity/v3/roles => generated 1891 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:04.853564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39b833-c753-4948-ba91-198408119a6c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:04.862359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39b833-c753-4948-ba91-198408119a6c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:04.867079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ada150-7628-499a-9d9e-1403fd8be704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:04.867720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ada150-7628-499a-9d9e-1403fd8be704 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:04.868001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ada150-7628-499a-9d9e-1403fd8be704 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:04.868273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ada150-7628-499a-9d9e-1403fd8be704 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:04.868968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ada150-7628-499a-9d9e-1403fd8be704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:04.869560 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2462/4990] 10.222.0.13 () {60 vars in 1173 bytes} [Sat Dec 18 21:02:04 2021] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:04.870966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5411eaf-9874-4093-aa3c-b000147404d9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:04.874697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ada150-7628-499a-9d9e-1403fd8be704 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:04.885189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5411eaf-9874-4093-aa3c-b000147404d9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:04.892030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed2497-1f40-464e-a90c-3483d6c1cc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:04.893388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed2497-1f40-464e-a90c-3483d6c1cc8c admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:04.893633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed2497-1f40-464e-a90c-3483d6c1cc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:04.894012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed2497-1f40-464e-a90c-3483d6c1cc8c admin admin] PATH_INFO: `/v3/projects/d6e7bb71b6174bfa8e06dcdea524dcc1/users/51c57e314524435dad5246396ff42bd3/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:04.906515 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2529/4991] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:04 2021] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:04.906515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ada150-7628-499a-9d9e-1403fd8be704 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:04.921285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed2497-1f40-464e-a90c-3483d6c1cc8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e7bb71b6174bfa8e06dcdea524dcc1, user_id=51c57e314524435dad5246396ff42bd3, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:04.924190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed2497-1f40-464e-a90c-3483d6c1cc8c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:04.939392 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2463/4992] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:04 2021] PUT /identity/v3/projects/d6e7bb71b6174bfa8e06dcdea524dcc1/users/51c57e314524435dad5246396ff42bd3/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:04.940196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed2497-1f40-464e-a90c-3483d6c1cc8c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:04.971884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ada150-7628-499a-9d9e-1403fd8be704 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:05.006983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed2497-1f40-464e-a90c-3483d6c1cc8c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:05.012194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77900c-2c24-4d69-b30e-e3a4767ab12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:05.012861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77900c-2c24-4d69-b30e-e3a4767ab12a admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:05.013306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77900c-2c24-4d69-b30e-e3a4767ab12a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:05.013588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77900c-2c24-4d69-b30e-e3a4767ab12a admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:05.014322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77900c-2c24-4d69-b30e-e3a4767ab12a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:05.016814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77900c-2c24-4d69-b30e-e3a4767ab12a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:05.030534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd4a8d-1f9f-43b0-a056-10d0469ec0ae tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04816cee44f4409c83517a35ae97c75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10190fa71de6467b8c9d231bd15136fa', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-285741286', 'tempest-NotDelegatedRole-826445456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:05.031399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd4a8d-1f9f-43b0-a056-10d0469ec0ae tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:05.031715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd4a8d-1f9f-43b0-a056-10d0469ec0ae tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:05.032042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd4a8d-1f9f-43b0-a056-10d0469ec0ae tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] PATH_INFO: `/v3/OS-TRUST/trusts/221155e7ab23413e9bc2232c8d710df2` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:05.038436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd4a8d-1f9f-43b0-a056-10d0469ec0ae tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: Authorizing `identity:get_trust(trust_id=221155e7ab23413e9bc2232c8d710df2)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:05.039892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd4a8d-1f9f-43b0-a056-10d0469ec0ae tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:05.043860 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2464/4993] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:04 2021] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:05.043860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77900c-2c24-4d69-b30e-e3a4767ab12a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:05.053679 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2530/4994] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:02:04 2021] GET /identity/v3/OS-TRUST/trusts/221155e7ab23413e9bc2232c8d710df2 => generated 833 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:05.053679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd4a8d-1f9f-43b0-a056-10d0469ec0ae tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:05.057160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77900c-2c24-4d69-b30e-e3a4767ab12a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:05.062452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1328878-c419-424e-8e9b-39167c918860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:05.063164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1328878-c419-424e-8e9b-39167c918860 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:05.063512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1328878-c419-424e-8e9b-39167c918860 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:05.063756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1328878-c419-424e-8e9b-39167c918860 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:05.064638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1328878-c419-424e-8e9b-39167c918860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:05.064948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd4a8d-1f9f-43b0-a056-10d0469ec0ae tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:05.066656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1328878-c419-424e-8e9b-39167c918860 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:05.070287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6e030-ff9b-4c1e-864e-d6a881650d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:05.070958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6e030-ff9b-4c1e-864e-d6a881650d12 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:05.071247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6e030-ff9b-4c1e-864e-d6a881650d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:05.071529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6e030-ff9b-4c1e-864e-d6a881650d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:05.072262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6e030-ff9b-4c1e-864e-d6a881650d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:05.073885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6e030-ff9b-4c1e-864e-d6a881650d12 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:05.079083 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2465/4995] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:05 2021] GET /identity/v3/roles => generated 1891 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:05.079911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1328878-c419-424e-8e9b-39167c918860 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:05.092135 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2531/4996] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:05 2021] GET /identity/v3/roles => generated 1891 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:05.092135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6e030-ff9b-4c1e-864e-d6a881650d12 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:05.095176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1328878-c419-424e-8e9b-39167c918860 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:05.099337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ccc36-7822-49fc-9360-d38ca808d804 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04816cee44f4409c83517a35ae97c75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10190fa71de6467b8c9d231bd15136fa', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-285741286', 'tempest-NotDelegatedRole-826445456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:05.100107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ccc36-7822-49fc-9360-d38ca808d804 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:05.100389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ccc36-7822-49fc-9360-d38ca808d804 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:05.100668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ccc36-7822-49fc-9360-d38ca808d804 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] PATH_INFO: `/v3/OS-TRUST/trusts/221155e7ab23413e9bc2232c8d710df2/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:05.100798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6e030-ff9b-4c1e-864e-d6a881650d12 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:05.107035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec287ce9-2a13-4d4e-8b76-36696c5df5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:05.107533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ccc36-7822-49fc-9360-d38ca808d804 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=221155e7ab23413e9bc2232c8d710df2)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:05.108055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec287ce9-2a13-4d4e-8b76-36696c5df5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:05.108411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec287ce9-2a13-4d4e-8b76-36696c5df5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:05.108763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec287ce9-2a13-4d4e-8b76-36696c5df5f3 admin admin] PATH_INFO: `/v3/projects/d6e7bb71b6174bfa8e06dcdea524dcc1/users/51c57e314524435dad5246396ff42bd3/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:05.108959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ccc36-7822-49fc-9360-d38ca808d804 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:05.111444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec287ce9-2a13-4d4e-8b76-36696c5df5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e7bb71b6174bfa8e06dcdea524dcc1, user_id=51c57e314524435dad5246396ff42bd3, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:05.114471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec287ce9-2a13-4d4e-8b76-36696c5df5f3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:05.116980 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2466/4997] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 21:02:05 2021] GET /identity/v3/OS-TRUST/trusts/221155e7ab23413e9bc2232c8d710df2/roles => generated 370 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:05.117950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ccc36-7822-49fc-9360-d38ca808d804 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:05.129698 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2532/4998] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:05 2021] PUT /identity/v3/projects/d6e7bb71b6174bfa8e06dcdea524dcc1/users/51c57e314524435dad5246396ff42bd3/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:05.131174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ccc36-7822-49fc-9360-d38ca808d804 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:05.131300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec287ce9-2a13-4d4e-8b76-36696c5df5f3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:05.212662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec287ce9-2a13-4d4e-8b76-36696c5df5f3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:05.217757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae475a-c3a0-401c-8b42-b4d9d496451e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:05.219196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae475a-c3a0-401c-8b42-b4d9d496451e admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:05.219953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae475a-c3a0-401c-8b42-b4d9d496451e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:05.221209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae475a-c3a0-401c-8b42-b4d9d496451e admin admin] PATH_INFO: `/v3/projects/924633b7f6f84c40a8a80a39af8a8b5d/users/dae93cbf74f147dfaf55cfe61afe3a27/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:05.221798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0a38d-e62f-4942-8fa9-8c0645af5001 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04816cee44f4409c83517a35ae97c75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10190fa71de6467b8c9d231bd15136fa', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-285741286', 'tempest-NotDelegatedRole-826445456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:05.222776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0a38d-e62f-4942-8fa9-8c0645af5001 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:05.223121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0a38d-e62f-4942-8fa9-8c0645af5001 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:05.223488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0a38d-e62f-4942-8fa9-8c0645af5001 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] PATH_INFO: `/v3/OS-TRUST/trusts/221155e7ab23413e9bc2232c8d710df2/roles/b7df1eaf090c4854b6cfe0f0a6550116` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:05.230833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0a38d-e62f-4942-8fa9-8c0645af5001 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: Authorizing `identity:get_role_for_trust(trust_id=221155e7ab23413e9bc2232c8d710df2, role_id=b7df1eaf090c4854b6cfe0f0a6550116)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:05.232396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0a38d-e62f-4942-8fa9-8c0645af5001 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:05.239680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae475a-c3a0-401c-8b42-b4d9d496451e admin admin] RBAC: Authorizing `identity:create_grant(project_id=924633b7f6f84c40a8a80a39af8a8b5d, user_id=dae93cbf74f147dfaf55cfe61afe3a27, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:05.240981 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2533/4999] 10.222.0.13 () {58 vars in 1367 bytes} [Sat Dec 18 21:02:05 2021] GET /identity/v3/OS-TRUST/trusts/221155e7ab23413e9bc2232c8d710df2/roles/b7df1eaf090c4854b6cfe0f0a6550116 => generated 243 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:05.242330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae475a-c3a0-401c-8b42-b4d9d496451e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:05.242449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d311f-6716-499f-8228-32b359dbcfe0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:05.242724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d311f-6716-499f-8228-32b359dbcfe0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:05.243081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d311f-6716-499f-8228-32b359dbcfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:05.256475 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2467/5000] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:05 2021] PUT /identity/v3/projects/924633b7f6f84c40a8a80a39af8a8b5d/users/dae93cbf74f147dfaf55cfe61afe3a27/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:05.257293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae475a-c3a0-401c-8b42-b4d9d496451e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:05.273832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-353d311f-6716-499f-8228-32b359dbcfe0 None None] MFA Rules not processed for user `51c57e314524435dad5246396ff42bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:05.275231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-353d311f-6716-499f-8228-32b359dbcfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:05.333308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae475a-c3a0-401c-8b42-b4d9d496451e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:05.338799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab17786-bece-450f-8d5b-2f2bc412b7a0 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04816cee44f4409c83517a35ae97c75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10190fa71de6467b8c9d231bd15136fa', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-285741286', 'tempest-NotDelegatedRole-826445456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:05.339804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab17786-bece-450f-8d5b-2f2bc412b7a0 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] REQUEST_METHOD: `HEAD` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:05.340152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab17786-bece-450f-8d5b-2f2bc412b7a0 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:05.340508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab17786-bece-450f-8d5b-2f2bc412b7a0 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] PATH_INFO: `/v3/OS-TRUST/trusts/221155e7ab23413e9bc2232c8d710df2/roles/b7df1eaf090c4854b6cfe0f0a6550116` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:05.348952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab17786-bece-450f-8d5b-2f2bc412b7a0 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: Authorizing `identity:get_role_for_trust(trust_id=221155e7ab23413e9bc2232c8d710df2, role_id=b7df1eaf090c4854b6cfe0f0a6550116)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:05.351002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab17786-bece-450f-8d5b-2f2bc412b7a0 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:05.366217 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2468/5001] 10.222.0.13 () {58 vars in 1368 bytes} [Sat Dec 18 21:02:05 2021] HEAD /identity/v3/OS-TRUST/trusts/221155e7ab23413e9bc2232c8d710df2/roles/b7df1eaf090c4854b6cfe0f0a6550116 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Dec 18 21:02:05.366217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab17786-bece-450f-8d5b-2f2bc412b7a0 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:05.372112 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2534/5002] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:05 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:05.373122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d311f-6716-499f-8228-32b359dbcfe0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:05.386088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d311f-6716-499f-8228-32b359dbcfe0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:05.391032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad0b86-28c2-473c-b5a5-8e93b6ed652a tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04816cee44f4409c83517a35ae97c75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10190fa71de6467b8c9d231bd15136fa', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-285741286', 'tempest-NotDelegatedRole-826445456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:05.391726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad0b86-28c2-473c-b5a5-8e93b6ed652a tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:05.392382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad0b86-28c2-473c-b5a5-8e93b6ed652a tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:05.392714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad0b86-28c2-473c-b5a5-8e93b6ed652a tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] PATH_INFO: `/v3/OS-TRUST/trusts/221155e7ab23413e9bc2232c8d710df2/roles/9b24d8acaccd49f8befc0117ef9b2459` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:05.403364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad0b86-28c2-473c-b5a5-8e93b6ed652a tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: Authorizing `identity:get_role_for_trust(trust_id=221155e7ab23413e9bc2232c8d710df2, role_id=9b24d8acaccd49f8befc0117ef9b2459)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:05.406720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad0b86-28c2-473c-b5a5-8e93b6ed652a tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:05.444666 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-c9ad0b86-28c2-473c-b5a5-8e93b6ed652a tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Could not find role: 9b24d8acaccd49f8befc0117ef9b2459.: keystone.exception.RoleNotFound: Could not find role: 9b24d8acaccd49f8befc0117ef9b2459. Dec 18 21:02:05.453753 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2535/5003] 10.222.0.13 () {58 vars in 1367 bytes} [Sat Dec 18 21:02:05 2021] GET /identity/v3/OS-TRUST/trusts/221155e7ab23413e9bc2232c8d710df2/roles/9b24d8acaccd49f8befc0117ef9b2459 => generated 110 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:02:05.453753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad0b86-28c2-473c-b5a5-8e93b6ed652a tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:05.493603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad0b86-28c2-473c-b5a5-8e93b6ed652a tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:05.504858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6b4fe-73ca-4089-be90-6cf83dea55a9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:05.505533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b4fe-73ca-4089-be90-6cf83dea55a9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:05.505855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b4fe-73ca-4089-be90-6cf83dea55a9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:05.506192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b4fe-73ca-4089-be90-6cf83dea55a9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:05.511602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6b4fe-73ca-4089-be90-6cf83dea55a9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:05.515458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6b4fe-73ca-4089-be90-6cf83dea55a9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:05.529288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab17786-bece-450f-8d5b-2f2bc412b7a0 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:05.540232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ff6d2-948e-4c49-b789-ad44a774a30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:05.541537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff6d2-948e-4c49-b789-ad44a774a30c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:05.542038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff6d2-948e-4c49-b789-ad44a774a30c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:05.542694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff6d2-948e-4c49-b789-ad44a774a30c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:05.543870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ff6d2-948e-4c49-b789-ad44a774a30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:05.548019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ff6d2-948e-4c49-b789-ad44a774a30c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:05.565419 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2469/5004] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:05 2021] GET /identity/v3/roles => generated 1891 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:05.566136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ff6d2-948e-4c49-b789-ad44a774a30c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:05.584362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ff6d2-948e-4c49-b789-ad44a774a30c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:05.592435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af07f-daa6-4652-8358-a4da588b01a8 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04816cee44f4409c83517a35ae97c75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10190fa71de6467b8c9d231bd15136fa', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-285741286', 'tempest-NotDelegatedRole-826445456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:05.593844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af07f-daa6-4652-8358-a4da588b01a8 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] REQUEST_METHOD: `HEAD` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:05.594203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af07f-daa6-4652-8358-a4da588b01a8 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:05.594633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af07f-daa6-4652-8358-a4da588b01a8 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] PATH_INFO: `/v3/OS-TRUST/trusts/221155e7ab23413e9bc2232c8d710df2/roles/9b24d8acaccd49f8befc0117ef9b2459` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:05.608352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351af07f-daa6-4652-8358-a4da588b01a8 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: Authorizing `identity:get_role_for_trust(trust_id=221155e7ab23413e9bc2232c8d710df2, role_id=9b24d8acaccd49f8befc0117ef9b2459)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:05.614651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351af07f-daa6-4652-8358-a4da588b01a8 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:05.618539 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2536/5005] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:05 2021] POST /identity/v3/projects => generated 360 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:05.618539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6b4fe-73ca-4089-be90-6cf83dea55a9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:05.622931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-42c6b4fe-73ca-4089-be90-6cf83dea55a9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:05.665569 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-351af07f-daa6-4652-8358-a4da588b01a8 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Could not find role: 9b24d8acaccd49f8befc0117ef9b2459.: keystone.exception.RoleNotFound: Could not find role: 9b24d8acaccd49f8befc0117ef9b2459. Dec 18 21:02:05.667364 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2470/5006] 10.222.0.13 () {58 vars in 1368 bytes} [Sat Dec 18 21:02:05 2021] HEAD /identity/v3/OS-TRUST/trusts/221155e7ab23413e9bc2232c8d710df2/roles/9b24d8acaccd49f8befc0117ef9b2459 => generated 0 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Dec 18 21:02:05.673981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af07f-daa6-4652-8358-a4da588b01a8 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:05.701206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af07f-daa6-4652-8358-a4da588b01a8 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:05.850075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b7d46-459f-4547-a329-0680a7743bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:05.851609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b7d46-459f-4547-a329-0680a7743bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:05.852050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b7d46-459f-4547-a329-0680a7743bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:05.852484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b7d46-459f-4547-a329-0680a7743bb9 admin admin] PATH_INFO: `/v3/projects/924633b7f6f84c40a8a80a39af8a8b5d/users/dae93cbf74f147dfaf55cfe61afe3a27/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:05.864754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b7d46-459f-4547-a329-0680a7743bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=924633b7f6f84c40a8a80a39af8a8b5d, user_id=dae93cbf74f147dfaf55cfe61afe3a27, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:05.867724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b7d46-459f-4547-a329-0680a7743bb9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:05.873992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6b4fe-73ca-4089-be90-6cf83dea55a9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:05.884487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020ea66-e45a-4815-ac35-71bbd0ce25f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:05.885158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020ea66-e45a-4815-ac35-71bbd0ce25f4 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:05.885836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020ea66-e45a-4815-ac35-71bbd0ce25f4 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:05.886124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020ea66-e45a-4815-ac35-71bbd0ce25f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:05.893946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b020ea66-e45a-4815-ac35-71bbd0ce25f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:05.901568 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2471/5007] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:05 2021] PUT /identity/v3/projects/924633b7f6f84c40a8a80a39af8a8b5d/users/dae93cbf74f147dfaf55cfe61afe3a27/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:05.902598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b7d46-459f-4547-a329-0680a7743bb9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:05.921016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020ea66-e45a-4815-ac35-71bbd0ce25f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:05.923037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020ea66-e45a-4815-ac35-71bbd0ce25f4 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:05.941972 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2537/5008] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:05 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:05.943615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020ea66-e45a-4815-ac35-71bbd0ce25f4 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:06.014413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b7d46-459f-4547-a329-0680a7743bb9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:06.022815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce998f97-4e30-4f5a-b9e0-8818fef43907 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:06.023612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce998f97-4e30-4f5a-b9e0-8818fef43907 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:06.023973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce998f97-4e30-4f5a-b9e0-8818fef43907 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:06.024478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce998f97-4e30-4f5a-b9e0-8818fef43907 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:06.025513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce998f97-4e30-4f5a-b9e0-8818fef43907 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:06.028579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce998f97-4e30-4f5a-b9e0-8818fef43907 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:06.073366 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2472/5009] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:05 2021] POST /identity/v3/users => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:06.076286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5672000-aab4-4c33-8b23-b0fed47bfb45 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:06.076827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5672000-aab4-4c33-8b23-b0fed47bfb45 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:06.077329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5672000-aab4-4c33-8b23-b0fed47bfb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:06.087814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020ea66-e45a-4815-ac35-71bbd0ce25f4 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:06.118428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c5672000-aab4-4c33-8b23-b0fed47bfb45 None None] MFA Rules not processed for user `dae93cbf74f147dfaf55cfe61afe3a27`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:06.121180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c5672000-aab4-4c33-8b23-b0fed47bfb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:06.169924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d4f7d-a6b2-474f-83bf-1d3400f276b9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04816cee44f4409c83517a35ae97c75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10190fa71de6467b8c9d231bd15136fa', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-285741286', 'tempest-NotDelegatedRole-826445456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:06.171044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4f7d-a6b2-474f-83bf-1d3400f276b9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:06.172116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4f7d-a6b2-474f-83bf-1d3400f276b9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:06.172506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4f7d-a6b2-474f-83bf-1d3400f276b9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] PATH_INFO: `/v3/OS-TRUST/trusts/221155e7ab23413e9bc2232c8d710df2` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:06.207749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d4f7d-a6b2-474f-83bf-1d3400f276b9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: Authorizing `identity:delete_trust(trust_id=221155e7ab23413e9bc2232c8d710df2)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:06.209536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d4f7d-a6b2-474f-83bf-1d3400f276b9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:06.239438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e34d4f7d-a6b2-474f-83bf-1d3400f276b9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '221155e7ab23413e9bc2232c8d710df2', 'request_id': 'req-e34d4f7d-a6b2-474f-83bf-1d3400f276b9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:06.240352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e34d4f7d-a6b2-474f-83bf-1d3400f276b9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '221155e7ab23413e9bc2232c8d710df2', 'request_id': 'req-e34d4f7d-a6b2-474f-83bf-1d3400f276b9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:06.251108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e34d4f7d-a6b2-474f-83bf-1d3400f276b9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '221155e7ab23413e9bc2232c8d710df2', 'request_id': 'req-e34d4f7d-a6b2-474f-83bf-1d3400f276b9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:06.262914 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2538/5010] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Dec 18 21:02:05 2021] DELETE /identity/v3/OS-TRUST/trusts/221155e7ab23413e9bc2232c8d710df2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:06.262914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d4f7d-a6b2-474f-83bf-1d3400f276b9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:06.262914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e34d4f7d-a6b2-474f-83bf-1d3400f276b9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:06.284924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d4f7d-a6b2-474f-83bf-1d3400f276b9 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:06.292966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c3187-6cb2-41d6-ad96-e07217a0d158 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:06.293990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c3187-6cb2-41d6-ad96-e07217a0d158 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:06.294552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c3187-6cb2-41d6-ad96-e07217a0d158 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:06.295208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c3187-6cb2-41d6-ad96-e07217a0d158 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users/dddff8db87a0409285754f31b2c0f6da` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:06.306025 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2473/5011] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:06 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:06.310651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5672000-aab4-4c33-8b23-b0fed47bfb45 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:06.314225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c3187-6cb2-41d6-ad96-e07217a0d158 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:get_user(user_id=dddff8db87a0409285754f31b2c0f6da)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:06.317900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c3187-6cb2-41d6-ad96-e07217a0d158 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:06.336094 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2539/5012] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 21:02:06 2021] GET /identity/v3/users/dddff8db87a0409285754f31b2c0f6da => generated 373 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:06.337304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c3187-6cb2-41d6-ad96-e07217a0d158 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:06.344427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a37c3187-6cb2-41d6-ad96-e07217a0d158 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:06.356766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5672000-aab4-4c33-8b23-b0fed47bfb45 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:06.377933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b55c4-1549-4fb3-859c-76546bbede56 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04816cee44f4409c83517a35ae97c75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10190fa71de6467b8c9d231bd15136fa', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-285741286', 'tempest-NotDelegatedRole-826445456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:06.380204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b55c4-1549-4fb3-859c-76546bbede56 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:06.380368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b55c4-1549-4fb3-859c-76546bbede56 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:06.382183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c3187-6cb2-41d6-ad96-e07217a0d158 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:06.384809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b55c4-1549-4fb3-859c-76546bbede56 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] PATH_INFO: `/v3/OS-TRUST/trusts/221155e7ab23413e9bc2232c8d710df2` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:06.396479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeab2f3-d59c-49e9-a6d9-31de732cb59a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:06.397163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeab2f3-d59c-49e9-a6d9-31de732cb59a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:06.397461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeab2f3-d59c-49e9-a6d9-31de732cb59a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:06.398131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeab2f3-d59c-49e9-a6d9-31de732cb59a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:06.398480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeab2f3-d59c-49e9-a6d9-31de732cb59a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:06.405773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeab2f3-d59c-49e9-a6d9-31de732cb59a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:06.427243 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-d65b55c4-1549-4fb3-859c-76546bbede56 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Could not find trust: 221155e7ab23413e9bc2232c8d710df2.: keystone.exception.TrustNotFound: Could not find trust: 221155e7ab23413e9bc2232c8d710df2. Dec 18 21:02:06.429411 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2474/5013] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:02:06 2021] GET /identity/v3/OS-TRUST/trusts/221155e7ab23413e9bc2232c8d710df2 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:02:06.430643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b55c4-1549-4fb3-859c-76546bbede56 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:06.445811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b55c4-1549-4fb3-859c-76546bbede56 tempest-TrustsV3TestJSON-1955652223 tempest-user-766914614] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:06.451804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a59921-4633-4a2b-a6c3-d9ee1e971d73 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:06.452888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a59921-4633-4a2b-a6c3-d9ee1e971d73 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:06.453345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a59921-4633-4a2b-a6c3-d9ee1e971d73 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:06.453811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a59921-4633-4a2b-a6c3-d9ee1e971d73 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users/dddff8db87a0409285754f31b2c0f6da` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:06.455638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a59921-4633-4a2b-a6c3-d9ee1e971d73 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:delete_user(user_id=dddff8db87a0409285754f31b2c0f6da)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:06.458361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a59921-4633-4a2b-a6c3-d9ee1e971d73 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:06.459154 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2540/5014] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:06 2021] POST /identity/v3/projects => generated 359 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:06.460393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeab2f3-d59c-49e9-a6d9-31de732cb59a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:06.462401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-deeab2f3-d59c-49e9-a6d9-31de732cb59a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:06.516943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a9a59921-4633-4a2b-a6c3-d9ee1e971d73 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dddff8db87a0409285754f31b2c0f6da'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:06.528515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a9a59921-4633-4a2b-a6c3-d9ee1e971d73 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dddff8db87a0409285754f31b2c0f6da'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:06.541656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a9a59921-4633-4a2b-a6c3-d9ee1e971d73 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dddff8db87a0409285754f31b2c0f6da'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:06.542580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a9a59921-4633-4a2b-a6c3-d9ee1e971d73 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dddff8db87a0409285754f31b2c0f6da'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:06.556286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a9a59921-4633-4a2b-a6c3-d9ee1e971d73 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dddff8db87a0409285754f31b2c0f6da'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:06.565519 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2475/5015] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:06 2021] DELETE /identity/v3/users/dddff8db87a0409285754f31b2c0f6da => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:06.566789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a59921-4633-4a2b-a6c3-d9ee1e971d73 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:06.568493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a9a59921-4633-4a2b-a6c3-d9ee1e971d73 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:06.597738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeab2f3-d59c-49e9-a6d9-31de732cb59a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:06.688595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a59921-4633-4a2b-a6c3-d9ee1e971d73 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:06.695503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8956c87-aab0-4869-bd8f-963cabdc2c6e tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:06.696634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8956c87-aab0-4869-bd8f-963cabdc2c6e tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:06.697128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8956c87-aab0-4869-bd8f-963cabdc2c6e tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:06.698647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8956c87-aab0-4869-bd8f-963cabdc2c6e tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:06.699705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8956c87-aab0-4869-bd8f-963cabdc2c6e tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:06.703911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8956c87-aab0-4869-bd8f-963cabdc2c6e tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:06.743219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9fe20-4e1e-4ba2-8955-8b2638aa9727 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:06.745313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9fe20-4e1e-4ba2-8955-8b2638aa9727 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:06.745661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9fe20-4e1e-4ba2-8955-8b2638aa9727 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:06.749023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9fe20-4e1e-4ba2-8955-8b2638aa9727 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles/9b24d8acaccd49f8befc0117ef9b2459` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:06.750293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9fe20-4e1e-4ba2-8955-8b2638aa9727 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9b24d8acaccd49f8befc0117ef9b2459)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:06.751068 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2476/5016] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:06 2021] POST /identity/v3/users => generated 413 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:06.752217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8956c87-aab0-4869-bd8f-963cabdc2c6e tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:06.752707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9fe20-4e1e-4ba2-8955-8b2638aa9727 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:06.754295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a8956c87-aab0-4869-bd8f-963cabdc2c6e tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:06.809663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7db9fe20-4e1e-4ba2-8955-8b2638aa9727 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invalidating the token cache because role 9b24d8acaccd49f8befc0117ef9b2459 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:06.810109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7db9fe20-4e1e-4ba2-8955-8b2638aa9727 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:06.811599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7db9fe20-4e1e-4ba2-8955-8b2638aa9727 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:06.814396 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2541/5017] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:06 2021] DELETE /identity/v3/roles/9b24d8acaccd49f8befc0117ef9b2459 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:06.814778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9fe20-4e1e-4ba2-8955-8b2638aa9727 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:06.827298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7db9fe20-4e1e-4ba2-8955-8b2638aa9727 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:06.838564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8956c87-aab0-4869-bd8f-963cabdc2c6e tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:06.918129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bb236-45fe-48ba-a570-3fba792104fe tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:06.920249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb236-45fe-48ba-a570-3fba792104fe tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:06.921155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb236-45fe-48ba-a570-3fba792104fe tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:06.921647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb236-45fe-48ba-a570-3fba792104fe tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/projects/216adcd305804ca6aa73bdcf8830c509` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:06.923356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bb236-45fe-48ba-a570-3fba792104fe tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:delete_project(project_id=216adcd305804ca6aa73bdcf8830c509)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:06.926455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bb236-45fe-48ba-a570-3fba792104fe tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:07.007006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9fe20-4e1e-4ba2-8955-8b2638aa9727 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:07.023445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3c9bb236-45fe-48ba-a570-3fba792104fe tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216adcd305804ca6aa73bdcf8830c509', 'request_id': 'req-3c9bb236-45fe-48ba-a570-3fba792104fe'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:07.032497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3c9bb236-45fe-48ba-a570-3fba792104fe tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216adcd305804ca6aa73bdcf8830c509', 'request_id': 'req-3c9bb236-45fe-48ba-a570-3fba792104fe'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:07.053480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3c9bb236-45fe-48ba-a570-3fba792104fe tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216adcd305804ca6aa73bdcf8830c509', 'request_id': 'req-3c9bb236-45fe-48ba-a570-3fba792104fe'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:07.074936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3c9bb236-45fe-48ba-a570-3fba792104fe tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] The token cache is being invalidate because project 216adcd305804ca6aa73bdcf8830c509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:07.075180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3c9bb236-45fe-48ba-a570-3fba792104fe tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:07.075922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3c9bb236-45fe-48ba-a570-3fba792104fe tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:07.083941 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2477/5018] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:06 2021] DELETE /identity/v3/projects/216adcd305804ca6aa73bdcf8830c509 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:07.085263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bb236-45fe-48ba-a570-3fba792104fe tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:07.088215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3c9bb236-45fe-48ba-a570-3fba792104fe tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:07.111370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c84836-0137-4c4f-9315-a2a2d0ad3776 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:07.112252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c84836-0137-4c4f-9315-a2a2d0ad3776 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:07.112537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c84836-0137-4c4f-9315-a2a2d0ad3776 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:07.113393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c84836-0137-4c4f-9315-a2a2d0ad3776 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/users/d5d726b8a6674409ad9bc83a5dcc5717` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:07.133462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c84836-0137-4c4f-9315-a2a2d0ad3776 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:get_user(user_id=d5d726b8a6674409ad9bc83a5dcc5717)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:07.135864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c84836-0137-4c4f-9315-a2a2d0ad3776 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:07.137888 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2542/5019] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 21:02:06 2021] GET /identity/v3/users/d5d726b8a6674409ad9bc83a5dcc5717 => generated 413 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:07.138724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c84836-0137-4c4f-9315-a2a2d0ad3776 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:07.140475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-71c84836-0137-4c4f-9315-a2a2d0ad3776 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:07.212767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bb236-45fe-48ba-a570-3fba792104fe tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:07.224901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82579f50-5306-45a4-8fb1-39685aa9c890 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:07.225704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c84836-0137-4c4f-9315-a2a2d0ad3776 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:07.226568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82579f50-5306-45a4-8fb1-39685aa9c890 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:07.226865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82579f50-5306-45a4-8fb1-39685aa9c890 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:07.227147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82579f50-5306-45a4-8fb1-39685aa9c890 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles/b7df1eaf090c4854b6cfe0f0a6550116` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:07.229968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82579f50-5306-45a4-8fb1-39685aa9c890 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b7df1eaf090c4854b6cfe0f0a6550116)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:07.234895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d762d-3a14-4d67-81da-45183234ef3a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:07.236097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d762d-3a14-4d67-81da-45183234ef3a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:07.236097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d762d-3a14-4d67-81da-45183234ef3a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:07.236311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d762d-3a14-4d67-81da-45183234ef3a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:07.237713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82579f50-5306-45a4-8fb1-39685aa9c890 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:07.237910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d762d-3a14-4d67-81da-45183234ef3a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:07.240165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d762d-3a14-4d67-81da-45183234ef3a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:07.280362 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2543/5020] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:07 2021] POST /identity/v3/projects => generated 358 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:07.281500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d762d-3a14-4d67-81da-45183234ef3a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:07.284742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-af9d762d-3a14-4d67-81da-45183234ef3a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:07.293796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-82579f50-5306-45a4-8fb1-39685aa9c890 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invalidating the token cache because role b7df1eaf090c4854b6cfe0f0a6550116 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:07.294467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-82579f50-5306-45a4-8fb1-39685aa9c890 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:07.301997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-82579f50-5306-45a4-8fb1-39685aa9c890 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:07.304435 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2478/5021] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:07 2021] DELETE /identity/v3/roles/b7df1eaf090c4854b6cfe0f0a6550116 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:07.305552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82579f50-5306-45a4-8fb1-39685aa9c890 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:07.307259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-82579f50-5306-45a4-8fb1-39685aa9c890 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:07.414985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d762d-3a14-4d67-81da-45183234ef3a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:07.452585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82579f50-5306-45a4-8fb1-39685aa9c890 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:07.467755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a7243-359f-4d50-8ce8-5078ee12d973 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:07.468515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a7243-359f-4d50-8ce8-5078ee12d973 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:07.468816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a7243-359f-4d50-8ce8-5078ee12d973 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:07.469108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a7243-359f-4d50-8ce8-5078ee12d973 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:07.470031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a7243-359f-4d50-8ce8-5078ee12d973 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:07.472295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a7243-359f-4d50-8ce8-5078ee12d973 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:07.534225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8ff88-4323-4fb9-ab88-d06d2f623069 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:07.535344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8ff88-4323-4fb9-ab88-d06d2f623069 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:07.536056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8ff88-4323-4fb9-ab88-d06d2f623069 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:07.536351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8ff88-4323-4fb9-ab88-d06d2f623069 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/users/d5d726b8a6674409ad9bc83a5dcc5717` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:07.537110 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2479/5022] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:07 2021] POST /identity/v3/users => generated 417 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:07.537782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8ff88-4323-4fb9-ab88-d06d2f623069 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d5d726b8a6674409ad9bc83a5dcc5717)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:07.538648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a7243-359f-4d50-8ce8-5078ee12d973 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:07.541315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8ff88-4323-4fb9-ab88-d06d2f623069 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:07.542624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2a2a7243-359f-4d50-8ce8-5078ee12d973 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:07.687992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-21f8ff88-4323-4fb9-ab88-d06d2f623069 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d726b8a6674409ad9bc83a5dcc5717'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:07.706352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-21f8ff88-4323-4fb9-ab88-d06d2f623069 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d726b8a6674409ad9bc83a5dcc5717'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:07.708261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-21f8ff88-4323-4fb9-ab88-d06d2f623069 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d726b8a6674409ad9bc83a5dcc5717'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:07.711152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a7243-359f-4d50-8ce8-5078ee12d973 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:07.735771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2376c-7159-420f-b68a-6d85c45f977f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:07.738498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2376c-7159-420f-b68a-6d85c45f977f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:07.739592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2376c-7159-420f-b68a-6d85c45f977f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:07.745321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2376c-7159-420f-b68a-6d85c45f977f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users/04816cee44f4409c83517a35ae97c75f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:07.748126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2376c-7159-420f-b68a-6d85c45f977f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_user(user_id=04816cee44f4409c83517a35ae97c75f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:07.757819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2376c-7159-420f-b68a-6d85c45f977f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:07.764082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-21f8ff88-4323-4fb9-ab88-d06d2f623069 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d726b8a6674409ad9bc83a5dcc5717'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:07.788582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-21f8ff88-4323-4fb9-ab88-d06d2f623069 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d726b8a6674409ad9bc83a5dcc5717'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:07.802071 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2544/5023] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:07 2021] DELETE /identity/v3/users/d5d726b8a6674409ad9bc83a5dcc5717 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:07.804925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8ff88-4323-4fb9-ab88-d06d2f623069 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:07.808268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-21f8ff88-4323-4fb9-ab88-d06d2f623069 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:07.857047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2fa2376c-7159-420f-b68a-6d85c45f977f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04816cee44f4409c83517a35ae97c75f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:07.868628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2fa2376c-7159-420f-b68a-6d85c45f977f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04816cee44f4409c83517a35ae97c75f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:07.884599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2fa2376c-7159-420f-b68a-6d85c45f977f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04816cee44f4409c83517a35ae97c75f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:07.886007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2fa2376c-7159-420f-b68a-6d85c45f977f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04816cee44f4409c83517a35ae97c75f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:07.899298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2fa2376c-7159-420f-b68a-6d85c45f977f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04816cee44f4409c83517a35ae97c75f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:07.908364 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2480/5024] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:07 2021] DELETE /identity/v3/users/04816cee44f4409c83517a35ae97c75f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:07.909357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2376c-7159-420f-b68a-6d85c45f977f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:07.910878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2fa2376c-7159-420f-b68a-6d85c45f977f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:07.957836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8ff88-4323-4fb9-ab88-d06d2f623069 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:08.004786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2376c-7159-420f-b68a-6d85c45f977f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:08.009614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:08.011067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:08.012270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:08.012581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/a8dce889271046eb81d60ed5f4bd768d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:08.014115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a8dce889271046eb81d60ed5f4bd768d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:08.016076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:08.020670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516aee1-a4b2-4290-b61f-bb617c449a8f tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:08.021432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516aee1-a4b2-4290-b61f-bb617c449a8f tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:08.021795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516aee1-a4b2-4290-b61f-bb617c449a8f tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:08.022157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516aee1-a4b2-4290-b61f-bb617c449a8f tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:08.023046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516aee1-a4b2-4290-b61f-bb617c449a8f tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:08.024769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516aee1-a4b2-4290-b61f-bb617c449a8f tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:08.050841 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2545/5025] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:02:07 2021] POST /identity/v3/roles => generated 239 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:08.052134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516aee1-a4b2-4290-b61f-bb617c449a8f tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:08.059228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5516aee1-a4b2-4290-b61f-bb617c449a8f tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:08.089638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8dce889271046eb81d60ed5f4bd768d', 'request_id': 'req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:08.100394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8dce889271046eb81d60ed5f4bd768d', 'request_id': 'req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:08.109280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8dce889271046eb81d60ed5f4bd768d', 'request_id': 'req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:08.133507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] The token cache is being invalidate because project a8dce889271046eb81d60ed5f4bd768d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:08.134102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:08.135087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:08.138470 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2481/5026] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:07 2021] DELETE /identity/v3/projects/a8dce889271046eb81d60ed5f4bd768d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:08.139751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:08.141828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:08.180453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516aee1-a4b2-4290-b61f-bb617c449a8f tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:08.218850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee2de6-4bde-4bcc-842f-0fe1e561f4ec tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:08.223825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49025147-0474-4698-904d-0b1deff6f37a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:08.224830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49025147-0474-4698-904d-0b1deff6f37a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:08.225141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49025147-0474-4698-904d-0b1deff6f37a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:08.225428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49025147-0474-4698-904d-0b1deff6f37a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users/0c784625a540478093a0857f03952524` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:08.239191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49025147-0474-4698-904d-0b1deff6f37a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:get_user(user_id=0c784625a540478093a0857f03952524)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:08.240242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97592c-3326-4618-9c6d-a3cf6606b52f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:08.241244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97592c-3326-4618-9c6d-a3cf6606b52f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:08.241440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49025147-0474-4698-904d-0b1deff6f37a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:08.241603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97592c-3326-4618-9c6d-a3cf6606b52f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:08.241997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97592c-3326-4618-9c6d-a3cf6606b52f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/10190fa71de6467b8c9d231bd15136fa` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:08.246975 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2482/5027] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 21:02:08 2021] GET /identity/v3/users/0c784625a540478093a0857f03952524 => generated 417 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:08.247153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97592c-3326-4618-9c6d-a3cf6606b52f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_project(project_id=10190fa71de6467b8c9d231bd15136fa)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:08.247254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49025147-0474-4698-904d-0b1deff6f37a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:08.247344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97592c-3326-4618-9c6d-a3cf6606b52f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:08.248430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-49025147-0474-4698-904d-0b1deff6f37a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:08.305950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0e97592c-3326-4618-9c6d-a3cf6606b52f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10190fa71de6467b8c9d231bd15136fa', 'request_id': 'req-0e97592c-3326-4618-9c6d-a3cf6606b52f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:08.316094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0e97592c-3326-4618-9c6d-a3cf6606b52f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10190fa71de6467b8c9d231bd15136fa', 'request_id': 'req-0e97592c-3326-4618-9c6d-a3cf6606b52f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:08.329245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0e97592c-3326-4618-9c6d-a3cf6606b52f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10190fa71de6467b8c9d231bd15136fa', 'request_id': 'req-0e97592c-3326-4618-9c6d-a3cf6606b52f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:08.342012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0e97592c-3326-4618-9c6d-a3cf6606b52f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] The token cache is being invalidate because project 10190fa71de6467b8c9d231bd15136fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:08.342694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0e97592c-3326-4618-9c6d-a3cf6606b52f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:08.343724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0e97592c-3326-4618-9c6d-a3cf6606b52f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:08.358323 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2546/5028] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:08 2021] DELETE /identity/v3/projects/10190fa71de6467b8c9d231bd15136fa => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:08.359285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97592c-3326-4618-9c6d-a3cf6606b52f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:08.363388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0e97592c-3326-4618-9c6d-a3cf6606b52f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:08.364650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49025147-0474-4698-904d-0b1deff6f37a tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:08.451340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97592c-3326-4618-9c6d-a3cf6606b52f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:08.461532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54f1b8-c56e-4f8d-bf9c-bf970963585d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:08.463859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54f1b8-c56e-4f8d-bf9c-bf970963585d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:08.464302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54f1b8-c56e-4f8d-bf9c-bf970963585d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:08.464590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54f1b8-c56e-4f8d-bf9c-bf970963585d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/roles/9def599d6c5440ce998f2459abf2a4b1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:08.465910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc5ae8-4502-48ed-adb6-9e913d52f9fc tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:08.466650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc5ae8-4502-48ed-adb6-9e913d52f9fc tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:08.467018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc5ae8-4502-48ed-adb6-9e913d52f9fc tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:08.467263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc5ae8-4502-48ed-adb6-9e913d52f9fc tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:08.468116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc5ae8-4502-48ed-adb6-9e913d52f9fc tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:08.469577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54f1b8-c56e-4f8d-bf9c-bf970963585d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:get_role(role_id=9def599d6c5440ce998f2459abf2a4b1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:08.469940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc5ae8-4502-48ed-adb6-9e913d52f9fc tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:08.472091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54f1b8-c56e-4f8d-bf9c-bf970963585d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:08.478913 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2547/5029] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 21:02:08 2021] GET /identity/v3/roles/9def599d6c5440ce998f2459abf2a4b1 => generated 239 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:08.480752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54f1b8-c56e-4f8d-bf9c-bf970963585d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:08.484477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7b54f1b8-c56e-4f8d-bf9c-bf970963585d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:08.513174 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2483/5030] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:08 2021] POST /identity/v3/projects => generated 348 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:08.517725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc5ae8-4502-48ed-adb6-9e913d52f9fc tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:08.591734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54f1b8-c56e-4f8d-bf9c-bf970963585d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:08.624629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc5ae8-4502-48ed-adb6-9e913d52f9fc tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:08.634564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a841f2-9cde-4204-b50f-8c06df215a41 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:08.637328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a841f2-9cde-4204-b50f-8c06df215a41 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:08.637816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a841f2-9cde-4204-b50f-8c06df215a41 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:08.638798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a841f2-9cde-4204-b50f-8c06df215a41 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:08.639238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a841f2-9cde-4204-b50f-8c06df215a41 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:08.642103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a841f2-9cde-4204-b50f-8c06df215a41 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:08.681324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d018d-d7e2-4ee6-99b3-1b100361967e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:08.682147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d018d-d7e2-4ee6-99b3-1b100361967e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:08.682740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d018d-d7e2-4ee6-99b3-1b100361967e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:08.683033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d018d-d7e2-4ee6-99b3-1b100361967e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:08.684155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d018d-d7e2-4ee6-99b3-1b100361967e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:08.685818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d018d-d7e2-4ee6-99b3-1b100361967e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:08.691602 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2484/5031] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:08 2021] POST /identity/v3/projects => generated 359 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:08.693309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a841f2-9cde-4204-b50f-8c06df215a41 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:08.696257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-65a841f2-9cde-4204-b50f-8c06df215a41 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:08.731752 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2548/5032] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:02:08 2021] POST /identity/v3/projects => generated 328 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:08.733551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d018d-d7e2-4ee6-99b3-1b100361967e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:08.802933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a841f2-9cde-4204-b50f-8c06df215a41 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:08.851813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d018d-d7e2-4ee6-99b3-1b100361967e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:08.858909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d8fea-7648-4cbd-8bd1-c9d715762e9b tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:08.860122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d8fea-7648-4cbd-8bd1-c9d715762e9b tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:08.860506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d8fea-7648-4cbd-8bd1-c9d715762e9b tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:08.861015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d8fea-7648-4cbd-8bd1-c9d715762e9b tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/projects/9a3019fca6cb49739de2ba74a3a5fadf` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:08.863630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d8fea-7648-4cbd-8bd1-c9d715762e9b tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:get_project(project_id=9a3019fca6cb49739de2ba74a3a5fadf)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:08.865890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d8fea-7648-4cbd-8bd1-c9d715762e9b tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:08.871271 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2549/5033] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:02:08 2021] GET /identity/v3/projects/9a3019fca6cb49739de2ba74a3a5fadf => generated 359 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:08.871271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d8fea-7648-4cbd-8bd1-c9d715762e9b tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:08.903815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184affe8-8576-467c-a287-b1e083e773eb tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:08.904895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184affe8-8576-467c-a287-b1e083e773eb tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:08.905269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184affe8-8576-467c-a287-b1e083e773eb tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:08.905628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184affe8-8576-467c-a287-b1e083e773eb tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:08.907047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184affe8-8576-467c-a287-b1e083e773eb tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:08.907445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184affe8-8576-467c-a287-b1e083e773eb tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:08.910591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184affe8-8576-467c-a287-b1e083e773eb tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:08.937979 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2485/5034] 10.222.0.13 () {58 vars in 1159 bytes} [Sat Dec 18 21:02:08 2021] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:08.939234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184affe8-8576-467c-a287-b1e083e773eb tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:08.954245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184affe8-8576-467c-a287-b1e083e773eb tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:08.956315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d8fea-7648-4cbd-8bd1-c9d715762e9b tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:08.960975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ddbf7-9c5a-4e8e-891c-7db97440a557 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:08.961409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb779eb7-039c-4169-a13b-2c2fb461d663 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:08.962584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb779eb7-039c-4169-a13b-2c2fb461d663 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:08.962911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ddbf7-9c5a-4e8e-891c-7db97440a557 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:08.963046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb779eb7-039c-4169-a13b-2c2fb461d663 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:08.963881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb779eb7-039c-4169-a13b-2c2fb461d663 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:08.964222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ddbf7-9c5a-4e8e-891c-7db97440a557 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:08.964987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ddbf7-9c5a-4e8e-891c-7db97440a557 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/projects/9a3019fca6cb49739de2ba74a3a5fadf/users/0c784625a540478093a0857f03952524/roles/9def599d6c5440ce998f2459abf2a4b1` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:08.965435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb779eb7-039c-4169-a13b-2c2fb461d663 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:08.967794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb779eb7-039c-4169-a13b-2c2fb461d663 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:08.968464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ddbf7-9c5a-4e8e-891c-7db97440a557 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9a3019fca6cb49739de2ba74a3a5fadf, user_id=0c784625a540478093a0857f03952524, role_id=9def599d6c5440ce998f2459abf2a4b1)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:08.972130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ddbf7-9c5a-4e8e-891c-7db97440a557 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:08.989631 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2486/5035] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:08 2021] PUT /identity/v3/projects/9a3019fca6cb49739de2ba74a3a5fadf/users/0c784625a540478093a0857f03952524/roles/9def599d6c5440ce998f2459abf2a4b1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:08.990746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ddbf7-9c5a-4e8e-891c-7db97440a557 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:09.000693 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2550/5036] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:08 2021] POST /identity/v3/users => generated 416 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:09.001854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb779eb7-039c-4169-a13b-2c2fb461d663 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:09.021658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb779eb7-039c-4169-a13b-2c2fb461d663 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:09.077690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ddbf7-9c5a-4e8e-891c-7db97440a557 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:09.101078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bf6fb-91b0-4746-9734-6bd5e58e64a3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:09.101835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bf6fb-91b0-4746-9734-6bd5e58e64a3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:09.102169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bf6fb-91b0-4746-9734-6bd5e58e64a3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:09.103276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bf6fb-91b0-4746-9734-6bd5e58e64a3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:09.105066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bf6fb-91b0-4746-9734-6bd5e58e64a3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:09.109382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bf6fb-91b0-4746-9734-6bd5e58e64a3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:09.124875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776ee7d-c612-46ba-863c-50d0fa15339e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:09.126135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776ee7d-c612-46ba-863c-50d0fa15339e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:09.126519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776ee7d-c612-46ba-863c-50d0fa15339e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:09.126880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776ee7d-c612-46ba-863c-50d0fa15339e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:09.127859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776ee7d-c612-46ba-863c-50d0fa15339e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:09.129733 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2487/5037] 10.222.0.13 () {58 vars in 1127 bytes} [Sat Dec 18 21:02:08 2021] GET /identity/v3/domains => generated 829 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:09.131530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bf6fb-91b0-4746-9734-6bd5e58e64a3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:09.145303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776ee7d-c612-46ba-863c-50d0fa15339e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:09.199177 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2551/5038] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:09 2021] POST /identity/v3/projects => generated 358 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:09.199980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776ee7d-c612-46ba-863c-50d0fa15339e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:09.262877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bf6fb-91b0-4746-9734-6bd5e58e64a3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:09.301078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776ee7d-c612-46ba-863c-50d0fa15339e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:09.306212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc02ceb-2e9d-4825-bde6-6314288e11ce tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:09.307640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc02ceb-2e9d-4825-bde6-6314288e11ce tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:09.307939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc02ceb-2e9d-4825-bde6-6314288e11ce tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:09.308220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc02ceb-2e9d-4825-bde6-6314288e11ce tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/e971694e3f0c4a8d9143147671eb5a00` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:09.309520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc02ceb-2e9d-4825-bde6-6314288e11ce tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:update_project(project_id=e971694e3f0c4a8d9143147671eb5a00)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:09.311273 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-acc02ceb-2e9d-4825-bde6-6314288e11ce tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:02:09.311273 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:02:09.311273 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:02:09.312054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc02ceb-2e9d-4825-bde6-6314288e11ce tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:09.327773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-acc02ceb-2e9d-4825-bde6-6314288e11ce tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e971694e3f0c4a8d9143147671eb5a00'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:09.328449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-acc02ceb-2e9d-4825-bde6-6314288e11ce tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e971694e3f0c4a8d9143147671eb5a00'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:09.370580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba98db1-b6fb-4b85-85b4-d26a55f08f07 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:09.370857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-acc02ceb-2e9d-4825-bde6-6314288e11ce tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e971694e3f0c4a8d9143147671eb5a00'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:09.371441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-acc02ceb-2e9d-4825-bde6-6314288e11ce tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e971694e3f0c4a8d9143147671eb5a00'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:09.372523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba98db1-b6fb-4b85-85b4-d26a55f08f07 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:09.373142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba98db1-b6fb-4b85-85b4-d26a55f08f07 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:09.373602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba98db1-b6fb-4b85-85b4-d26a55f08f07 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:09.374562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba98db1-b6fb-4b85-85b4-d26a55f08f07 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:09.376432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba98db1-b6fb-4b85-85b4-d26a55f08f07 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:09.378568 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2552/5039] 10.222.0.13 () {60 vars in 1251 bytes} [Sat Dec 18 21:02:09 2021] PATCH /identity/v3/projects/e971694e3f0c4a8d9143147671eb5a00 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:09.380302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc02ceb-2e9d-4825-bde6-6314288e11ce tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:09.382755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-acc02ceb-2e9d-4825-bde6-6314288e11ce tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:09.400622 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2488/5040] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:02:09 2021] POST /identity/v3/roles => generated 244 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:09.400622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba98db1-b6fb-4b85-85b4-d26a55f08f07 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:09.400622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fba98db1-b6fb-4b85-85b4-d26a55f08f07 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:09.419572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba98db1-b6fb-4b85-85b4-d26a55f08f07 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:09.469272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc02ceb-2e9d-4825-bde6-6314288e11ce tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:09.477065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cf395-db42-4885-93f4-f0e2783e0327 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:09.479605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cf395-db42-4885-93f4-f0e2783e0327 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:09.480067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cf395-db42-4885-93f4-f0e2783e0327 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:09.480663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cf395-db42-4885-93f4-f0e2783e0327 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/projects/1973b317e0d943ffb6ceafd4304d46d3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:09.482660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cf395-db42-4885-93f4-f0e2783e0327 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:get_project(project_id=1973b317e0d943ffb6ceafd4304d46d3)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:09.485523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cf395-db42-4885-93f4-f0e2783e0327 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:09.490993 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2553/5041] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:02:09 2021] GET /identity/v3/projects/1973b317e0d943ffb6ceafd4304d46d3 => generated 358 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:09.492106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cf395-db42-4885-93f4-f0e2783e0327 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:09.493767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-620cf395-db42-4885-93f4-f0e2783e0327 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:09.500503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:09.502366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:09.502999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:09.503590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/e971694e3f0c4a8d9143147671eb5a00` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:09.517317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e971694e3f0c4a8d9143147671eb5a00)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:09.519501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:09.545081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e971694e3f0c4a8d9143147671eb5a00'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:09.548753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e971694e3f0c4a8d9143147671eb5a00'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:09.576745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cf395-db42-4885-93f4-f0e2783e0327 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:09.582962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04d26d-f0a3-49ca-ae8b-e23bcc9af5f9 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:09.584249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04d26d-f0a3-49ca-ae8b-e23bcc9af5f9 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:09.584770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04d26d-f0a3-49ca-ae8b-e23bcc9af5f9 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:09.585665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04d26d-f0a3-49ca-ae8b-e23bcc9af5f9 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:09.587222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04d26d-f0a3-49ca-ae8b-e23bcc9af5f9 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:09.591069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04d26d-f0a3-49ca-ae8b-e23bcc9af5f9 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:09.611157 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2554/5042] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:02:09 2021] POST /identity/v3/roles => generated 246 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:09.612077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04d26d-f0a3-49ca-ae8b-e23bcc9af5f9 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:09.616000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e971694e3f0c4a8d9143147671eb5a00', 'request_id': 'req-5896d5ca-009f-4fc9-870a-72217313423f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:09.624758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04d26d-f0a3-49ca-ae8b-e23bcc9af5f9 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:09.625287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e971694e3f0c4a8d9143147671eb5a00', 'request_id': 'req-5896d5ca-009f-4fc9-870a-72217313423f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:09.633125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e971694e3f0c4a8d9143147671eb5a00', 'request_id': 'req-5896d5ca-009f-4fc9-870a-72217313423f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:09.654911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] The token cache is being invalidate because project e971694e3f0c4a8d9143147671eb5a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:09.655524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:09.656653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:09.667075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e971694e3f0c4a8d9143147671eb5a00', 'request_id': 'req-5896d5ca-009f-4fc9-870a-72217313423f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:09.672726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e971694e3f0c4a8d9143147671eb5a00', 'request_id': 'req-5896d5ca-009f-4fc9-870a-72217313423f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:09.673699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e971694e3f0c4a8d9143147671eb5a00', 'request_id': 'req-5896d5ca-009f-4fc9-870a-72217313423f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:09.682485 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2489/5043] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:09 2021] DELETE /identity/v3/projects/e971694e3f0c4a8d9143147671eb5a00 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:09.684119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:09.690341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:09.706740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a2341-582b-45a2-92b5-f77bbed4e2c9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:09.707223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a2341-582b-45a2-92b5-f77bbed4e2c9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:09.707515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a2341-582b-45a2-92b5-f77bbed4e2c9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:09.707711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a2341-582b-45a2-92b5-f77bbed4e2c9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/projects/1973b317e0d943ffb6ceafd4304d46d3/users/0c784625a540478093a0857f03952524/roles/9def599d6c5440ce998f2459abf2a4b1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:09.710930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a2341-582b-45a2-92b5-f77bbed4e2c9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1973b317e0d943ffb6ceafd4304d46d3, user_id=0c784625a540478093a0857f03952524, role_id=9def599d6c5440ce998f2459abf2a4b1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:09.714533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a2341-582b-45a2-92b5-f77bbed4e2c9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:09.737768 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2555/5044] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:09 2021] PUT /identity/v3/projects/1973b317e0d943ffb6ceafd4304d46d3/users/0c784625a540478093a0857f03952524/roles/9def599d6c5440ce998f2459abf2a4b1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:09.738838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a2341-582b-45a2-92b5-f77bbed4e2c9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:09.741719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ff6a2341-582b-45a2-92b5-f77bbed4e2c9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:09.803722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896d5ca-009f-4fc9-870a-72217313423f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:09.844827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a2341-582b-45a2-92b5-f77bbed4e2c9 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:09.850100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61492af1-6936-429d-adbe-ee103937e035 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:09.851143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61492af1-6936-429d-adbe-ee103937e035 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:09.851937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61492af1-6936-429d-adbe-ee103937e035 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:09.852467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61492af1-6936-429d-adbe-ee103937e035 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:09.853667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61492af1-6936-429d-adbe-ee103937e035 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:09.855959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61492af1-6936-429d-adbe-ee103937e035 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:09.900025 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2556/5045] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:09 2021] POST /identity/v3/projects => generated 360 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:09.901605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61492af1-6936-429d-adbe-ee103937e035 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:09.904281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-61492af1-6936-429d-adbe-ee103937e035 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:09.928144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51d9a4-3600-4adf-ad7c-277dbe680a7e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:09.929321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51d9a4-3600-4adf-ad7c-277dbe680a7e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:09.929771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51d9a4-3600-4adf-ad7c-277dbe680a7e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:09.930289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51d9a4-3600-4adf-ad7c-277dbe680a7e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/17e8c4d57554495096f6514adc18ff57/users/65daff688b2a4d11824061e41028ad88/roles/fed45fa869b04683b300fe8e55d600d7` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:09.965599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51d9a4-3600-4adf-ad7c-277dbe680a7e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_grant(project_id=17e8c4d57554495096f6514adc18ff57, user_id=65daff688b2a4d11824061e41028ad88, role_id=fed45fa869b04683b300fe8e55d600d7)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:09.974591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51d9a4-3600-4adf-ad7c-277dbe680a7e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:09.993778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61492af1-6936-429d-adbe-ee103937e035 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:10.000906 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2490/5046] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:09 2021] PUT /identity/v3/projects/17e8c4d57554495096f6514adc18ff57/users/65daff688b2a4d11824061e41028ad88/roles/fed45fa869b04683b300fe8e55d600d7 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:10.001776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51d9a4-3600-4adf-ad7c-277dbe680a7e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:10.098219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51d9a4-3600-4adf-ad7c-277dbe680a7e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:10.105541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd15a6e-a4c9-44d4-acbc-de3cac429867 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:10.107116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd15a6e-a4c9-44d4-acbc-de3cac429867 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:10.107722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd15a6e-a4c9-44d4-acbc-de3cac429867 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:10.108637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd15a6e-a4c9-44d4-acbc-de3cac429867 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/2a1c288cf161410dace8588ebb13bd7a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:10.111252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd15a6e-a4c9-44d4-acbc-de3cac429867 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:get_project(project_id=2a1c288cf161410dace8588ebb13bd7a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:10.115813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd15a6e-a4c9-44d4-acbc-de3cac429867 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:10.120969 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2491/5047] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:02:10 2021] GET /identity/v3/projects/2a1c288cf161410dace8588ebb13bd7a => generated 360 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:10.122583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd15a6e-a4c9-44d4-acbc-de3cac429867 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:10.134760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc8604-0ab0-4bf1-bc1a-fab98feb9250 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:10.135773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc8604-0ab0-4bf1-bc1a-fab98feb9250 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:10.146820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc8604-0ab0-4bf1-bc1a-fab98feb9250 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:10.147493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc8604-0ab0-4bf1-bc1a-fab98feb9250 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users/0c784625a540478093a0857f03952524/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:10.153169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc8604-0ab0-4bf1-bc1a-fab98feb9250 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=0c784625a540478093a0857f03952524)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:10.160160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc8604-0ab0-4bf1-bc1a-fab98feb9250 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:10.221851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd15a6e-a4c9-44d4-acbc-de3cac429867 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:10.230687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315c27e-ae80-4fb8-8560-15b8f0f30239 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:10.233016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315c27e-ae80-4fb8-8560-15b8f0f30239 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:10.233559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315c27e-ae80-4fb8-8560-15b8f0f30239 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:10.234428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315c27e-ae80-4fb8-8560-15b8f0f30239 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/17e8c4d57554495096f6514adc18ff57/users/65daff688b2a4d11824061e41028ad88/roles/44216500be734c73b9ed02eeb0b2d77e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:10.238032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315c27e-ae80-4fb8-8560-15b8f0f30239 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:create_grant(project_id=17e8c4d57554495096f6514adc18ff57, user_id=65daff688b2a4d11824061e41028ad88, role_id=44216500be734c73b9ed02eeb0b2d77e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:10.241711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315c27e-ae80-4fb8-8560-15b8f0f30239 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:10.249786 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2557/5048] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 21:02:09 2021] GET /identity/v3/users/0c784625a540478093a0857f03952524/projects => generated 841 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:10.249786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc8604-0ab0-4bf1-bc1a-fab98feb9250 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:10.273310 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2492/5049] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:10 2021] PUT /identity/v3/projects/17e8c4d57554495096f6514adc18ff57/users/65daff688b2a4d11824061e41028ad88/roles/44216500be734c73b9ed02eeb0b2d77e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:10.275448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315c27e-ae80-4fb8-8560-15b8f0f30239 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:10.278458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc8604-0ab0-4bf1-bc1a-fab98feb9250 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:10.489428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315c27e-ae80-4fb8-8560-15b8f0f30239 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:10.490444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72393dd1-d05e-4aa9-91ea-c34d95110fb8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:10.491844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72393dd1-d05e-4aa9-91ea-c34d95110fb8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:10.492354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72393dd1-d05e-4aa9-91ea-c34d95110fb8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:10.492857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72393dd1-d05e-4aa9-91ea-c34d95110fb8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/2a1c288cf161410dace8588ebb13bd7a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:10.494726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72393dd1-d05e-4aa9-91ea-c34d95110fb8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2a1c288cf161410dace8588ebb13bd7a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:10.495523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:10.496485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:10.497195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:10.497195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/projects/1973b317e0d943ffb6ceafd4304d46d3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:10.498521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72393dd1-d05e-4aa9-91ea-c34d95110fb8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:10.501815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1973b317e0d943ffb6ceafd4304d46d3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:10.504412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:10.572451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1973b317e0d943ffb6ceafd4304d46d3', 'request_id': 'req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:10.572883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-72393dd1-d05e-4aa9-91ea-c34d95110fb8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1c288cf161410dace8588ebb13bd7a', 'request_id': 'req-72393dd1-d05e-4aa9-91ea-c34d95110fb8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:10.580490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1973b317e0d943ffb6ceafd4304d46d3', 'request_id': 'req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:10.581756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-72393dd1-d05e-4aa9-91ea-c34d95110fb8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1c288cf161410dace8588ebb13bd7a', 'request_id': 'req-72393dd1-d05e-4aa9-91ea-c34d95110fb8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:10.587181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1973b317e0d943ffb6ceafd4304d46d3', 'request_id': 'req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:10.592575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-72393dd1-d05e-4aa9-91ea-c34d95110fb8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1c288cf161410dace8588ebb13bd7a', 'request_id': 'req-72393dd1-d05e-4aa9-91ea-c34d95110fb8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:10.607587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] The token cache is being invalidate because project 1973b317e0d943ffb6ceafd4304d46d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:10.607853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-72393dd1-d05e-4aa9-91ea-c34d95110fb8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] The token cache is being invalidate because project 2a1c288cf161410dace8588ebb13bd7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:10.607963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-72393dd1-d05e-4aa9-91ea-c34d95110fb8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:10.608514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:10.609209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-72393dd1-d05e-4aa9-91ea-c34d95110fb8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:10.610893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:10.612086 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2558/5050] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:10 2021] DELETE /identity/v3/projects/2a1c288cf161410dace8588ebb13bd7a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:10.612234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72393dd1-d05e-4aa9-91ea-c34d95110fb8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:10.613737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-72393dd1-d05e-4aa9-91ea-c34d95110fb8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:10.617294 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2493/5051] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:10 2021] DELETE /identity/v3/projects/1973b317e0d943ffb6ceafd4304d46d3 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:10.619143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:10.621566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:10.708724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72393dd1-d05e-4aa9-91ea-c34d95110fb8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:10.719294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b81fa-4f09-497f-961c-bf960443bc2f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:10.720482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b81fa-4f09-497f-961c-bf960443bc2f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:10.721100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b81fa-4f09-497f-961c-bf960443bc2f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:10.721589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b81fa-4f09-497f-961c-bf960443bc2f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:10.722832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b81fa-4f09-497f-961c-bf960443bc2f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:10.726539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b81fa-4f09-497f-961c-bf960443bc2f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:10.737403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7ae3f-a0b8-4d52-9c38-eddb9c0d2a94 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:10.769818 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2559/5052] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:10 2021] GET /identity/v3/users => generated 9310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:10.774181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b81fa-4f09-497f-961c-bf960443bc2f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:10.776518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-650b81fa-4f09-497f-961c-bf960443bc2f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:10.819794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b6e7f-1da7-479c-829c-a7a4e297345f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:10.820479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b6e7f-1da7-479c-829c-a7a4e297345f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:10.820772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b6e7f-1da7-479c-829c-a7a4e297345f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:10.821055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b6e7f-1da7-479c-829c-a7a4e297345f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:10.821791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b6e7f-1da7-479c-829c-a7a4e297345f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:10.824295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b6e7f-1da7-479c-829c-a7a4e297345f tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:10.855175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b81fa-4f09-497f-961c-bf960443bc2f tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:10.860758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259eca2-6789-4e40-b91f-81a106fd7fe3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:10.862473 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2494/5053] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:10 2021] POST /identity/v3/projects => generated 360 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:10.862682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259eca2-6789-4e40-b91f-81a106fd7fe3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:10.863019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259eca2-6789-4e40-b91f-81a106fd7fe3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:10.863382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259eca2-6789-4e40-b91f-81a106fd7fe3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/projects/9a3019fca6cb49739de2ba74a3a5fadf` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:10.864195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7ad43-4999-4ab9-aeb2-1fef15ece118 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:10.864503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7ad43-4999-4ab9-aeb2-1fef15ece118 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:10.865110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7ad43-4999-4ab9-aeb2-1fef15ece118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:10.865547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259eca2-6789-4e40-b91f-81a106fd7fe3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9a3019fca6cb49739de2ba74a3a5fadf)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:10.868750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259eca2-6789-4e40-b91f-81a106fd7fe3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:10.916018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6fc7ad43-4999-4ab9-aeb2-1fef15ece118 None None] MFA Rules not processed for user `65daff688b2a4d11824061e41028ad88`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:10.917799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6fc7ad43-4999-4ab9-aeb2-1fef15ece118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:10.937173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b259eca2-6789-4e40-b91f-81a106fd7fe3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a3019fca6cb49739de2ba74a3a5fadf', 'request_id': 'req-b259eca2-6789-4e40-b91f-81a106fd7fe3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:10.945944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b259eca2-6789-4e40-b91f-81a106fd7fe3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a3019fca6cb49739de2ba74a3a5fadf', 'request_id': 'req-b259eca2-6789-4e40-b91f-81a106fd7fe3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:10.958303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b259eca2-6789-4e40-b91f-81a106fd7fe3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a3019fca6cb49739de2ba74a3a5fadf', 'request_id': 'req-b259eca2-6789-4e40-b91f-81a106fd7fe3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:10.990298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b259eca2-6789-4e40-b91f-81a106fd7fe3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] The token cache is being invalidate because project 9a3019fca6cb49739de2ba74a3a5fadf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:10.992339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b259eca2-6789-4e40-b91f-81a106fd7fe3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:10.994156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b259eca2-6789-4e40-b91f-81a106fd7fe3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:11.002428 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2560/5054] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:10 2021] DELETE /identity/v3/projects/9a3019fca6cb49739de2ba74a3a5fadf => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:11.003725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259eca2-6789-4e40-b91f-81a106fd7fe3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:11.013067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b259eca2-6789-4e40-b91f-81a106fd7fe3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:11.032806 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2495/5055] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:10 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:11.034275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7ad43-4999-4ab9-aeb2-1fef15ece118 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:11.103589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259eca2-6789-4e40-b91f-81a106fd7fe3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:11.108960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1137a6-7d72-42f6-a5a6-e22328f25ce4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:11.110086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1137a6-7d72-42f6-a5a6-e22328f25ce4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:11.110618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1137a6-7d72-42f6-a5a6-e22328f25ce4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:11.111036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1137a6-7d72-42f6-a5a6-e22328f25ce4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/6efb397f29b447599540d675f9bb0e28` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:11.113268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1137a6-7d72-42f6-a5a6-e22328f25ce4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:get_project(project_id=6efb397f29b447599540d675f9bb0e28)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:11.116158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1137a6-7d72-42f6-a5a6-e22328f25ce4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:11.118443 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2561/5056] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:02:11 2021] GET /identity/v3/projects/6efb397f29b447599540d675f9bb0e28 => generated 360 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:11.120240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28598f81-d39f-4acd-984d-249416ff48c9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:11.120625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28598f81-d39f-4acd-984d-249416ff48c9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:11.121005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28598f81-d39f-4acd-984d-249416ff48c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:11.133679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7ad43-4999-4ab9-aeb2-1fef15ece118 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:11.143724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901a777-b9fa-4df8-9a37-aa259b015763 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:11.145063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901a777-b9fa-4df8-9a37-aa259b015763 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:11.145358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901a777-b9fa-4df8-9a37-aa259b015763 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:11.145787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901a777-b9fa-4df8-9a37-aa259b015763 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/roles/9def599d6c5440ce998f2459abf2a4b1` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:11.148659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901a777-b9fa-4df8-9a37-aa259b015763 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9def599d6c5440ce998f2459abf2a4b1)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:11.150637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901a777-b9fa-4df8-9a37-aa259b015763 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:11.151765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-28598f81-d39f-4acd-984d-249416ff48c9 None None] MFA Rules not processed for user `65daff688b2a4d11824061e41028ad88`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:11.156080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-28598f81-d39f-4acd-984d-249416ff48c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:11.167682 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2562/5057] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:11 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:11.169171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28598f81-d39f-4acd-984d-249416ff48c9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:11.194954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28598f81-d39f-4acd-984d-249416ff48c9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:11.204009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:11.204719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3901a777-b9fa-4df8-9a37-aa259b015763 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invalidating the token cache because role 9def599d6c5440ce998f2459abf2a4b1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:11.205013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3901a777-b9fa-4df8-9a37-aa259b015763 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:11.205730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3901a777-b9fa-4df8-9a37-aa259b015763 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:11.207463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:11.208094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:11.208621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/6efb397f29b447599540d675f9bb0e28` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:11.210327 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2496/5058] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:11 2021] DELETE /identity/v3/roles/9def599d6c5440ce998f2459abf2a4b1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:11.211581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901a777-b9fa-4df8-9a37-aa259b015763 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:11.214760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6efb397f29b447599540d675f9bb0e28)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:11.219203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3901a777-b9fa-4df8-9a37-aa259b015763 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:11.221741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:11.339646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901a777-b9fa-4df8-9a37-aa259b015763 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:11.357679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6efb397f29b447599540d675f9bb0e28', 'request_id': 'req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:11.370988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6efb397f29b447599540d675f9bb0e28', 'request_id': 'req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:11.386112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6efb397f29b447599540d675f9bb0e28', 'request_id': 'req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:11.404832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] The token cache is being invalidate because project 6efb397f29b447599540d675f9bb0e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:11.405429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:11.406172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:11.408756 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2563/5059] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:11 2021] DELETE /identity/v3/projects/6efb397f29b447599540d675f9bb0e28 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:11.415355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:11.418845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:11.419009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ab0b1-e1a6-4598-9cb4-4b27fbc251b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65daff688b2a4d11824061e41028ad88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17e8c4d57554495096f6514adc18ff57', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-136093180', 'tempest-DelegatedRole-1370634660'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:11.419840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ab0b1-e1a6-4598-9cb4-4b27fbc251b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:11.420137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ab0b1-e1a6-4598-9cb4-4b27fbc251b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:11.420419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ab0b1-e1a6-4598-9cb4-4b27fbc251b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:11.421482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ab0b1-e1a6-4598-9cb4-4b27fbc251b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: Authorizing `identity:create_trust()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:11.433790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ab0b1-e1a6-4598-9cb4-4b27fbc251b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:11.543917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b38d76-bd8f-429e-80c5-6bbcbc8e18e3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:11.549852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba82cd5-b4d5-4ccf-ba37-3bd656a444af tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:11.551528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba82cd5-b4d5-4ccf-ba37-3bd656a444af tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:11.552524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba82cd5-b4d5-4ccf-ba37-3bd656a444af tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:11.553033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba82cd5-b4d5-4ccf-ba37-3bd656a444af tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users/0c784625a540478093a0857f03952524` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:11.555560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba82cd5-b4d5-4ccf-ba37-3bd656a444af tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0c784625a540478093a0857f03952524)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:11.559380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba82cd5-b4d5-4ccf-ba37-3bd656a444af tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:11.580719 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2497/5060] 10.222.0.13 () {60 vars in 1173 bytes} [Sat Dec 18 21:02:11 2021] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:11.581818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ab0b1-e1a6-4598-9cb4-4b27fbc251b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:11.588726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ac0ab0b1-e1a6-4598-9cb4-4b27fbc251b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:11.617275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6ba82cd5-b4d5-4ccf-ba37-3bd656a444af tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c784625a540478093a0857f03952524'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:11.628737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6ba82cd5-b4d5-4ccf-ba37-3bd656a444af tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c784625a540478093a0857f03952524'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:11.629736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6ba82cd5-b4d5-4ccf-ba37-3bd656a444af tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c784625a540478093a0857f03952524'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:11.646029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6ba82cd5-b4d5-4ccf-ba37-3bd656a444af tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c784625a540478093a0857f03952524'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:11.660664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6ba82cd5-b4d5-4ccf-ba37-3bd656a444af tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c784625a540478093a0857f03952524'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:11.677043 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2564/5061] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:11 2021] DELETE /identity/v3/users/0c784625a540478093a0857f03952524 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:11.678288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba82cd5-b4d5-4ccf-ba37-3bd656a444af tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:11.679732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ab0b1-e1a6-4598-9cb4-4b27fbc251b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:11.680042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6ba82cd5-b4d5-4ccf-ba37-3bd656a444af tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:11.767003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba82cd5-b4d5-4ccf-ba37-3bd656a444af tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:11.773357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27528fc-2333-429e-a33f-005c8d251f4b tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65daff688b2a4d11824061e41028ad88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17e8c4d57554495096f6514adc18ff57', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-136093180', 'tempest-DelegatedRole-1370634660'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:11.774710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27528fc-2333-429e-a33f-005c8d251f4b tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:11.775134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27528fc-2333-429e-a33f-005c8d251f4b tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:11.775476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27528fc-2333-429e-a33f-005c8d251f4b tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] PATH_INFO: `/v3/OS-TRUST/trusts/007b91e8062b47fd8682c9352cea4f3e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:11.779850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556cc05-dddf-4aed-9ec4-a43acfd973e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:11.780668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556cc05-dddf-4aed-9ec4-a43acfd973e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:11.781130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556cc05-dddf-4aed-9ec4-a43acfd973e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:11.781416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556cc05-dddf-4aed-9ec4-a43acfd973e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:11.782121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556cc05-dddf-4aed-9ec4-a43acfd973e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:11.783994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556cc05-dddf-4aed-9ec4-a43acfd973e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:11.784130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27528fc-2333-429e-a33f-005c8d251f4b tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: Authorizing `identity:get_trust(trust_id=007b91e8062b47fd8682c9352cea4f3e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:11.786493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27528fc-2333-429e-a33f-005c8d251f4b tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:11.812934 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2565/5062] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:02:11 2021] GET /identity/v3/OS-TRUST/trusts/007b91e8062b47fd8682c9352cea4f3e => generated 835 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:11.813692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27528fc-2333-429e-a33f-005c8d251f4b tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:11.819974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e27528fc-2333-429e-a33f-005c8d251f4b tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:11.824969 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2498/5063] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:02:11 2021] POST /identity/v3/projects => generated 346 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:11.826221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556cc05-dddf-4aed-9ec4-a43acfd973e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:11.915087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27528fc-2333-429e-a33f-005c8d251f4b tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:11.918482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556cc05-dddf-4aed-9ec4-a43acfd973e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:11.934637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db679e53-9994-4bd0-ab60-4554ce92df34 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65daff688b2a4d11824061e41028ad88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17e8c4d57554495096f6514adc18ff57', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-136093180', 'tempest-DelegatedRole-1370634660'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:11.934637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db679e53-9994-4bd0-ab60-4554ce92df34 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:11.934637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db679e53-9994-4bd0-ab60-4554ce92df34 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:11.934895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db679e53-9994-4bd0-ab60-4554ce92df34 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] PATH_INFO: `/v3/OS-TRUST/trusts/007b91e8062b47fd8682c9352cea4f3e/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:11.942978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db679e53-9994-4bd0-ab60-4554ce92df34 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=007b91e8062b47fd8682c9352cea4f3e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:11.948029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db679e53-9994-4bd0-ab60-4554ce92df34 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:11.957152 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2499/5064] 10.222.0.13 () {58 vars in 1268 bytes} [Sat Dec 18 21:02:11 2021] GET /identity/v3/OS-TRUST/trusts/007b91e8062b47fd8682c9352cea4f3e/roles => generated 371 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:11.960713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db679e53-9994-4bd0-ab60-4554ce92df34 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:11.962518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-db679e53-9994-4bd0-ab60-4554ce92df34 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:12.005673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881f629-6019-4ced-b49f-68e9db75e11e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:12.006904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881f629-6019-4ced-b49f-68e9db75e11e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:12.007257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881f629-6019-4ced-b49f-68e9db75e11e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:12.007604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881f629-6019-4ced-b49f-68e9db75e11e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/projects/7cdd596f4c2a40ca91db4846de0c7ece` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:12.008970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881f629-6019-4ced-b49f-68e9db75e11e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7cdd596f4c2a40ca91db4846de0c7ece)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:12.011050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881f629-6019-4ced-b49f-68e9db75e11e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:12.098022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d881f629-6019-4ced-b49f-68e9db75e11e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cdd596f4c2a40ca91db4846de0c7ece', 'request_id': 'req-d881f629-6019-4ced-b49f-68e9db75e11e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:12.105960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d881f629-6019-4ced-b49f-68e9db75e11e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cdd596f4c2a40ca91db4846de0c7ece', 'request_id': 'req-d881f629-6019-4ced-b49f-68e9db75e11e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:12.117098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d881f629-6019-4ced-b49f-68e9db75e11e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cdd596f4c2a40ca91db4846de0c7ece', 'request_id': 'req-d881f629-6019-4ced-b49f-68e9db75e11e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:12.124306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db679e53-9994-4bd0-ab60-4554ce92df34 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:12.147712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d881f629-6019-4ced-b49f-68e9db75e11e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] The token cache is being invalidate because project 7cdd596f4c2a40ca91db4846de0c7ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:12.148201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d881f629-6019-4ced-b49f-68e9db75e11e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:12.149423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d881f629-6019-4ced-b49f-68e9db75e11e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:12.152540 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2566/5065] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:11 2021] DELETE /identity/v3/projects/7cdd596f4c2a40ca91db4846de0c7ece => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:12.154463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881f629-6019-4ced-b49f-68e9db75e11e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:12.156060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d881f629-6019-4ced-b49f-68e9db75e11e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:12.226410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e5d8d-82c8-4311-bd51-3efa09a757ba tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:12.227933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e5d8d-82c8-4311-bd51-3efa09a757ba tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:12.228079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e5d8d-82c8-4311-bd51-3efa09a757ba tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:12.228310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e5d8d-82c8-4311-bd51-3efa09a757ba tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/b349929a39e14a74a9b9038b02df8219` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:12.231392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e5d8d-82c8-4311-bd51-3efa09a757ba tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:get_project(project_id=b349929a39e14a74a9b9038b02df8219)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:12.232969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e5d8d-82c8-4311-bd51-3efa09a757ba tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:12.238067 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2500/5066] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:02:11 2021] GET /identity/v3/projects/b349929a39e14a74a9b9038b02df8219 => generated 346 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:12.238067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e5d8d-82c8-4311-bd51-3efa09a757ba tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:12.238067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-499e5d8d-82c8-4311-bd51-3efa09a757ba tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:12.256914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881f629-6019-4ced-b49f-68e9db75e11e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:12.264607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0e68c-776d-48f7-b020-0b0f801f81f2 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65daff688b2a4d11824061e41028ad88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17e8c4d57554495096f6514adc18ff57', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-136093180', 'tempest-DelegatedRole-1370634660'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:12.265462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0e68c-776d-48f7-b020-0b0f801f81f2 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:12.265715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0e68c-776d-48f7-b020-0b0f801f81f2 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:12.266178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0e68c-776d-48f7-b020-0b0f801f81f2 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] PATH_INFO: `/v3/OS-TRUST/trusts/007b91e8062b47fd8682c9352cea4f3e/roles/fed45fa869b04683b300fe8e55d600d7` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:12.272875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0e68c-776d-48f7-b020-0b0f801f81f2 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: Authorizing `identity:get_role_for_trust(trust_id=007b91e8062b47fd8682c9352cea4f3e, role_id=fed45fa869b04683b300fe8e55d600d7)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:12.274423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0e68c-776d-48f7-b020-0b0f801f81f2 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:12.283329 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2567/5067] 10.222.0.13 () {58 vars in 1367 bytes} [Sat Dec 18 21:02:12 2021] GET /identity/v3/OS-TRUST/trusts/007b91e8062b47fd8682c9352cea4f3e/roles/fed45fa869b04683b300fe8e55d600d7 => generated 244 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:12.284165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0e68c-776d-48f7-b020-0b0f801f81f2 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:12.289467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8ea0e68c-776d-48f7-b020-0b0f801f81f2 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:12.306497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0e68c-776d-48f7-b020-0b0f801f81f2 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:12.311353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30c088-c5d0-4eb5-9de8-db5fea8237e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:12.312205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30c088-c5d0-4eb5-9de8-db5fea8237e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:12.312506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30c088-c5d0-4eb5-9de8-db5fea8237e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:12.312771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30c088-c5d0-4eb5-9de8-db5fea8237e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/b349929a39e14a74a9b9038b02df8219` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:12.313983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30c088-c5d0-4eb5-9de8-db5fea8237e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b349929a39e14a74a9b9038b02df8219)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:12.316826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30c088-c5d0-4eb5-9de8-db5fea8237e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:12.322188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e5d8d-82c8-4311-bd51-3efa09a757ba tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:12.330887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af48b8-cf22-45b5-ab40-3e613e0d3032 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:12.331777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af48b8-cf22-45b5-ab40-3e613e0d3032 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:12.332068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af48b8-cf22-45b5-ab40-3e613e0d3032 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:12.332395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af48b8-cf22-45b5-ab40-3e613e0d3032 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users/a59b243b4d9f4135bce6ef36397e659c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:12.333668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af48b8-cf22-45b5-ab40-3e613e0d3032 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:update_user(user_id=a59b243b4d9f4135bce6ef36397e659c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:12.334798 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-95af48b8-cf22-45b5-ab40-3e613e0d3032 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:02:12.334798 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:02:12.334798 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:02:12.335983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af48b8-cf22-45b5-ab40-3e613e0d3032 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:12.369879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8b30c088-c5d0-4eb5-9de8-db5fea8237e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b349929a39e14a74a9b9038b02df8219', 'request_id': 'req-8b30c088-c5d0-4eb5-9de8-db5fea8237e5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:12.375447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-95af48b8-cf22-45b5-ab40-3e613e0d3032 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a59b243b4d9f4135bce6ef36397e659c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:12.377158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8b30c088-c5d0-4eb5-9de8-db5fea8237e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b349929a39e14a74a9b9038b02df8219', 'request_id': 'req-8b30c088-c5d0-4eb5-9de8-db5fea8237e5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:12.384300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-95af48b8-cf22-45b5-ab40-3e613e0d3032 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invalidating the token cache because user a59b243b4d9f4135bce6ef36397e659c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:12.385919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-95af48b8-cf22-45b5-ab40-3e613e0d3032 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:12.386713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-95af48b8-cf22-45b5-ab40-3e613e0d3032 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:12.392103 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2501/5068] 10.222.0.13 () {60 vars in 1242 bytes} [Sat Dec 18 21:02:12 2021] PATCH /identity/v3/users/a59b243b4d9f4135bce6ef36397e659c => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:12.392103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af48b8-cf22-45b5-ab40-3e613e0d3032 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:12.392103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-95af48b8-cf22-45b5-ab40-3e613e0d3032 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:12.398196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8b30c088-c5d0-4eb5-9de8-db5fea8237e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b349929a39e14a74a9b9038b02df8219', 'request_id': 'req-8b30c088-c5d0-4eb5-9de8-db5fea8237e5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:12.409843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af48b8-cf22-45b5-ab40-3e613e0d3032 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:12.412695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8b30c088-c5d0-4eb5-9de8-db5fea8237e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] The token cache is being invalidate because project b349929a39e14a74a9b9038b02df8219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:12.412993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8b30c088-c5d0-4eb5-9de8-db5fea8237e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:12.413667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8b30c088-c5d0-4eb5-9de8-db5fea8237e5 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:12.416548 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2568/5069] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:12 2021] DELETE /identity/v3/projects/b349929a39e14a74a9b9038b02df8219 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:12.416548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa85473-f7a7-430c-87f3-026ab114e068 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:12.416548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa85473-f7a7-430c-87f3-026ab114e068 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:12.416548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa85473-f7a7-430c-87f3-026ab114e068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:12.453701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4aa85473-f7a7-430c-87f3-026ab114e068 None None] MFA Rules not processed for user `a59b243b4d9f4135bce6ef36397e659c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:12.454886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4aa85473-f7a7-430c-87f3-026ab114e068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:12.458922 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2569/5070] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:12 2021] POST /identity/v3/auth/tokens => generated 349 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 18 21:02:12.459860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa85473-f7a7-430c-87f3-026ab114e068 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:12.464096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4aa85473-f7a7-430c-87f3-026ab114e068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:12.481258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b93b9-3d5b-46ac-9ebb-b417c65588b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65daff688b2a4d11824061e41028ad88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17e8c4d57554495096f6514adc18ff57', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-136093180', 'tempest-DelegatedRole-1370634660'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:12.482097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b93b9-3d5b-46ac-9ebb-b417c65588b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] REQUEST_METHOD: `HEAD` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:12.482425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b93b9-3d5b-46ac-9ebb-b417c65588b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:12.483113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b93b9-3d5b-46ac-9ebb-b417c65588b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] PATH_INFO: `/v3/OS-TRUST/trusts/007b91e8062b47fd8682c9352cea4f3e/roles/fed45fa869b04683b300fe8e55d600d7` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:12.488764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b93b9-3d5b-46ac-9ebb-b417c65588b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: Authorizing `identity:get_role_for_trust(trust_id=007b91e8062b47fd8682c9352cea4f3e, role_id=fed45fa869b04683b300fe8e55d600d7)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:12.490286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b93b9-3d5b-46ac-9ebb-b417c65588b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:12.500672 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2502/5071] 10.222.0.13 () {58 vars in 1368 bytes} [Sat Dec 18 21:02:12 2021] HEAD /identity/v3/OS-TRUST/trusts/007b91e8062b47fd8682c9352cea4f3e/roles/fed45fa869b04683b300fe8e55d600d7 => generated 0 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Dec 18 21:02:12.502424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b93b9-3d5b-46ac-9ebb-b417c65588b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:12.504365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-202b93b9-3d5b-46ac-9ebb-b417c65588b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:12.571270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa85473-f7a7-430c-87f3-026ab114e068 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:12.588352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b63aa8-9255-401a-a673-cfe2f463262c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:12.589828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63aa8-9255-401a-a673-cfe2f463262c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:12.590352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63aa8-9255-401a-a673-cfe2f463262c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:12.590797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63aa8-9255-401a-a673-cfe2f463262c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:12.591888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b63aa8-9255-401a-a673-cfe2f463262c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:12.593901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b63aa8-9255-401a-a673-cfe2f463262c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:12.651552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b93b9-3d5b-46ac-9ebb-b417c65588b8 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:12.654919 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2570/5072] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:02:12 2021] POST /identity/v3/domains => generated 276 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:12.655791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b63aa8-9255-401a-a673-cfe2f463262c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:12.658776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-37b63aa8-9255-401a-a673-cfe2f463262c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:12.758658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac1ffe-f16d-4000-bf07-b12ac08784d3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:12.759759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac1ffe-f16d-4000-bf07-b12ac08784d3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:12.760943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac1ffe-f16d-4000-bf07-b12ac08784d3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:12.761362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac1ffe-f16d-4000-bf07-b12ac08784d3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users/a59b243b4d9f4135bce6ef36397e659c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:12.763055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac1ffe-f16d-4000-bf07-b12ac08784d3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:update_user(user_id=a59b243b4d9f4135bce6ef36397e659c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:12.765312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac1ffe-f16d-4000-bf07-b12ac08784d3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:12.767637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b63aa8-9255-401a-a673-cfe2f463262c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:12.781189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbf807-e974-4813-bf82-d96a5085ca73 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65daff688b2a4d11824061e41028ad88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17e8c4d57554495096f6514adc18ff57', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-136093180', 'tempest-DelegatedRole-1370634660'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:12.782552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbf807-e974-4813-bf82-d96a5085ca73 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:12.783757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbf807-e974-4813-bf82-d96a5085ca73 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:12.785569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbf807-e974-4813-bf82-d96a5085ca73 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] PATH_INFO: `/v3/OS-TRUST/trusts/007b91e8062b47fd8682c9352cea4f3e/roles/44216500be734c73b9ed02eeb0b2d77e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:12.795800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbf807-e974-4813-bf82-d96a5085ca73 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: Authorizing `identity:get_role_for_trust(trust_id=007b91e8062b47fd8682c9352cea4f3e, role_id=44216500be734c73b9ed02eeb0b2d77e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:12.797853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbf807-e974-4813-bf82-d96a5085ca73 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:12.824896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-02ac1ffe-f16d-4000-bf07-b12ac08784d3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a59b243b4d9f4135bce6ef36397e659c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:12.827836 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-f2dbf807-e974-4813-bf82-d96a5085ca73 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Could not find role: 44216500be734c73b9ed02eeb0b2d77e.: keystone.exception.RoleNotFound: Could not find role: 44216500be734c73b9ed02eeb0b2d77e. Dec 18 21:02:12.834459 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2571/5073] 10.222.0.13 () {58 vars in 1367 bytes} [Sat Dec 18 21:02:12 2021] GET /identity/v3/OS-TRUST/trusts/007b91e8062b47fd8682c9352cea4f3e/roles/44216500be734c73b9ed02eeb0b2d77e => generated 110 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:02:12.834459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbf807-e974-4813-bf82-d96a5085ca73 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:12.849283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-02ac1ffe-f16d-4000-bf07-b12ac08784d3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invalidating the token cache because user a59b243b4d9f4135bce6ef36397e659c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:12.851031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-02ac1ffe-f16d-4000-bf07-b12ac08784d3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:12.852456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-02ac1ffe-f16d-4000-bf07-b12ac08784d3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:12.864430 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2503/5074] 10.222.0.13 () {60 vars in 1242 bytes} [Sat Dec 18 21:02:12 2021] PATCH /identity/v3/users/a59b243b4d9f4135bce6ef36397e659c => generated 297 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:12.865843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac1ffe-f16d-4000-bf07-b12ac08784d3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:12.881013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-02ac1ffe-f16d-4000-bf07-b12ac08784d3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:12.897546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac1ffe-f16d-4000-bf07-b12ac08784d3 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:12.903418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa10a21-6f2d-4b57-8b03-8c7fb30d3486 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65daff688b2a4d11824061e41028ad88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17e8c4d57554495096f6514adc18ff57', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-136093180', 'tempest-DelegatedRole-1370634660'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:12.906736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa10a21-6f2d-4b57-8b03-8c7fb30d3486 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] REQUEST_METHOD: `HEAD` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:12.906996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa10a21-6f2d-4b57-8b03-8c7fb30d3486 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:12.907288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa10a21-6f2d-4b57-8b03-8c7fb30d3486 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] PATH_INFO: `/v3/OS-TRUST/trusts/007b91e8062b47fd8682c9352cea4f3e/roles/44216500be734c73b9ed02eeb0b2d77e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:12.917495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa10a21-6f2d-4b57-8b03-8c7fb30d3486 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: Authorizing `identity:get_role_for_trust(trust_id=007b91e8062b47fd8682c9352cea4f3e, role_id=44216500be734c73b9ed02eeb0b2d77e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:12.919126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa10a21-6f2d-4b57-8b03-8c7fb30d3486 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:12.936219 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-8fa10a21-6f2d-4b57-8b03-8c7fb30d3486 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Could not find role: 44216500be734c73b9ed02eeb0b2d77e.: keystone.exception.RoleNotFound: Could not find role: 44216500be734c73b9ed02eeb0b2d77e. Dec 18 21:02:12.937711 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2504/5075] 10.222.0.13 () {58 vars in 1368 bytes} [Sat Dec 18 21:02:12 2021] HEAD /identity/v3/OS-TRUST/trusts/007b91e8062b47fd8682c9352cea4f3e/roles/44216500be734c73b9ed02eeb0b2d77e => generated 0 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Dec 18 21:02:12.940785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa10a21-6f2d-4b57-8b03-8c7fb30d3486 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:12.945492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8fa10a21-6f2d-4b57-8b03-8c7fb30d3486 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:12.959196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbf807-e974-4813-bf82-d96a5085ca73 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:12.966570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa10a21-6f2d-4b57-8b03-8c7fb30d3486 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:12.971148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17091e09-5bd5-460d-9b72-b9bc339dc810 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:12.971826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17091e09-5bd5-460d-9b72-b9bc339dc810 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:12.972110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17091e09-5bd5-460d-9b72-b9bc339dc810 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:12.972389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17091e09-5bd5-460d-9b72-b9bc339dc810 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:12.973097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17091e09-5bd5-460d-9b72-b9bc339dc810 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:12.975051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17091e09-5bd5-460d-9b72-b9bc339dc810 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:12.975322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dd7ff-9941-4fc2-9483-2911b3064bd4 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:12.976492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dd7ff-9941-4fc2-9483-2911b3064bd4 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:12.976953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dd7ff-9941-4fc2-9483-2911b3064bd4 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:12.977395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dd7ff-9941-4fc2-9483-2911b3064bd4 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users/a59b243b4d9f4135bce6ef36397e659c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:13.000999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dd7ff-9941-4fc2-9483-2911b3064bd4 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:update_user(user_id=a59b243b4d9f4135bce6ef36397e659c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:13.003412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dd7ff-9941-4fc2-9483-2911b3064bd4 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:13.036219 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2572/5076] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:12 2021] POST /identity/v3/projects => generated 405 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:13.037063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17091e09-5bd5-460d-9b72-b9bc339dc810 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:13.065887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d55dd7ff-9941-4fc2-9483-2911b3064bd4 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a59b243b4d9f4135bce6ef36397e659c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.078479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d55dd7ff-9941-4fc2-9483-2911b3064bd4 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invalidating the token cache because user a59b243b4d9f4135bce6ef36397e659c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:13.078937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d55dd7ff-9941-4fc2-9483-2911b3064bd4 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.079706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d55dd7ff-9941-4fc2-9483-2911b3064bd4 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.084718 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2505/5077] 10.222.0.13 () {60 vars in 1242 bytes} [Sat Dec 18 21:02:12 2021] PATCH /identity/v3/users/a59b243b4d9f4135bce6ef36397e659c => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:13.084718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dd7ff-9941-4fc2-9483-2911b3064bd4 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:13.087505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d55dd7ff-9941-4fc2-9483-2911b3064bd4 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:13.104915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dd7ff-9941-4fc2-9483-2911b3064bd4 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:13.132652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17091e09-5bd5-460d-9b72-b9bc339dc810 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:13.148395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a39c72-ac82-4477-9faf-fbde410ef011 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65daff688b2a4d11824061e41028ad88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17e8c4d57554495096f6514adc18ff57', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-136093180', 'tempest-DelegatedRole-1370634660'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:13.149303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a39c72-ac82-4477-9faf-fbde410ef011 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:13.149591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a39c72-ac82-4477-9faf-fbde410ef011 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:13.149871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a39c72-ac82-4477-9faf-fbde410ef011 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] PATH_INFO: `/v3/OS-TRUST/trusts/007b91e8062b47fd8682c9352cea4f3e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:13.166919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a39c72-ac82-4477-9faf-fbde410ef011 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: Authorizing `identity:delete_trust(trust_id=007b91e8062b47fd8682c9352cea4f3e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:13.170770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a39c72-ac82-4477-9faf-fbde410ef011 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:13.205735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b3a39c72-ac82-4477-9faf-fbde410ef011 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '007b91e8062b47fd8682c9352cea4f3e', 'request_id': 'req-b3a39c72-ac82-4477-9faf-fbde410ef011'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.206711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b3a39c72-ac82-4477-9faf-fbde410ef011 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '007b91e8062b47fd8682c9352cea4f3e', 'request_id': 'req-b3a39c72-ac82-4477-9faf-fbde410ef011'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.219640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8d9db-4f57-4138-80f4-799196758ee8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:13.219908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b3a39c72-ac82-4477-9faf-fbde410ef011 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '007b91e8062b47fd8682c9352cea4f3e', 'request_id': 'req-b3a39c72-ac82-4477-9faf-fbde410ef011'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.221024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8d9db-4f57-4138-80f4-799196758ee8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:13.222601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8d9db-4f57-4138-80f4-799196758ee8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:13.223057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8d9db-4f57-4138-80f4-799196758ee8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/a2ad233e7fce4d48878e22d78fd3267e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:13.225192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8d9db-4f57-4138-80f4-799196758ee8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2ad233e7fce4d48878e22d78fd3267e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:13.227202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8d9db-4f57-4138-80f4-799196758ee8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:13.229795 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2506/5079] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:02:13 2021] GET /identity/v3/projects/a2ad233e7fce4d48878e22d78fd3267e => generated 405 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:13.230925 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2573/5079] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Dec 18 21:02:13 2021] DELETE /identity/v3/OS-TRUST/trusts/007b91e8062b47fd8682c9352cea4f3e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:13.231594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938e628-dedc-44c7-844c-4e3360f6b9bd None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:13.231955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938e628-dedc-44c7-844c-4e3360f6b9bd None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:13.232476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938e628-dedc-44c7-844c-4e3360f6b9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:13.232783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a39c72-ac82-4477-9faf-fbde410ef011 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:13.234942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b3a39c72-ac82-4477-9faf-fbde410ef011 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:13.258296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a39c72-ac82-4477-9faf-fbde410ef011 tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:13.263518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca347be-4a0d-4ade-bd03-43e998933b1b tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65daff688b2a4d11824061e41028ad88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17e8c4d57554495096f6514adc18ff57', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-136093180', 'tempest-DelegatedRole-1370634660'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:13.264373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca347be-4a0d-4ade-bd03-43e998933b1b tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:13.264653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca347be-4a0d-4ade-bd03-43e998933b1b tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:13.264932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca347be-4a0d-4ade-bd03-43e998933b1b tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] PATH_INFO: `/v3/OS-TRUST/trusts/007b91e8062b47fd8682c9352cea4f3e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:13.271410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4938e628-dedc-44c7-844c-4e3360f6b9bd None None] MFA Rules not processed for user `a59b243b4d9f4135bce6ef36397e659c`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:13.272679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4938e628-dedc-44c7-844c-4e3360f6b9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:13.277193 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2507/5080] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:13 2021] POST /identity/v3/auth/tokens => generated 349 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 18 21:02:13.278067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938e628-dedc-44c7-844c-4e3360f6b9bd None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:13.279453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4938e628-dedc-44c7-844c-4e3360f6b9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:13.281849 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-5ca347be-4a0d-4ade-bd03-43e998933b1b tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Could not find trust: 007b91e8062b47fd8682c9352cea4f3e.: keystone.exception.TrustNotFound: Could not find trust: 007b91e8062b47fd8682c9352cea4f3e. Dec 18 21:02:13.286972 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2574/5081] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Dec 18 21:02:13 2021] GET /identity/v3/OS-TRUST/trusts/007b91e8062b47fd8682c9352cea4f3e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:02:13.287801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca347be-4a0d-4ade-bd03-43e998933b1b tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:13.289543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5ca347be-4a0d-4ade-bd03-43e998933b1b tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:13.302515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938e628-dedc-44c7-844c-4e3360f6b9bd None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:13.309842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5987dc2-a053-46c1-bed1-17f273e50abd tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:13.317421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5987dc2-a053-46c1-bed1-17f273e50abd tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:13.317421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5987dc2-a053-46c1-bed1-17f273e50abd tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:13.317421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5987dc2-a053-46c1-bed1-17f273e50abd tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/a2ad233e7fce4d48878e22d78fd3267e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:13.318994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5987dc2-a053-46c1-bed1-17f273e50abd tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a2ad233e7fce4d48878e22d78fd3267e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:13.322045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5987dc2-a053-46c1-bed1-17f273e50abd tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:13.377419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca347be-4a0d-4ade-bd03-43e998933b1b tempest-TrustsV3TestJSON-487248604 tempest-user-1041296524] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:13.388325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b5987dc2-a053-46c1-bed1-17f273e50abd tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ad233e7fce4d48878e22d78fd3267e', 'request_id': 'req-b5987dc2-a053-46c1-bed1-17f273e50abd'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.402327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b5987dc2-a053-46c1-bed1-17f273e50abd tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ad233e7fce4d48878e22d78fd3267e', 'request_id': 'req-b5987dc2-a053-46c1-bed1-17f273e50abd'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.404468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b5987dc2-a053-46c1-bed1-17f273e50abd tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ad233e7fce4d48878e22d78fd3267e', 'request_id': 'req-b5987dc2-a053-46c1-bed1-17f273e50abd'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.419316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b5987dc2-a053-46c1-bed1-17f273e50abd tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] The token cache is being invalidate because project a2ad233e7fce4d48878e22d78fd3267e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:13.419854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b5987dc2-a053-46c1-bed1-17f273e50abd tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.420558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b5987dc2-a053-46c1-bed1-17f273e50abd tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.422534 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2508/5082] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:13 2021] DELETE /identity/v3/projects/a2ad233e7fce4d48878e22d78fd3267e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:13.423687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5987dc2-a053-46c1-bed1-17f273e50abd tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:13.425518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b5987dc2-a053-46c1-bed1-17f273e50abd tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:13.443339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb1467-77ca-4863-8e20-d188d984b18e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:13.444188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb1467-77ca-4863-8e20-d188d984b18e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:13.444416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb1467-77ca-4863-8e20-d188d984b18e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:13.444704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb1467-77ca-4863-8e20-d188d984b18e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users/a59b243b4d9f4135bce6ef36397e659c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:13.445997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb1467-77ca-4863-8e20-d188d984b18e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:update_user(user_id=a59b243b4d9f4135bce6ef36397e659c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:13.447048 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-57cb1467-77ca-4863-8e20-d188d984b18e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:02:13.447048 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:02:13.447048 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:02:13.448802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb1467-77ca-4863-8e20-d188d984b18e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:13.487134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-57cb1467-77ca-4863-8e20-d188d984b18e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a59b243b4d9f4135bce6ef36397e659c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.497439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-57cb1467-77ca-4863-8e20-d188d984b18e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invalidating the token cache because user a59b243b4d9f4135bce6ef36397e659c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:13.497770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-57cb1467-77ca-4863-8e20-d188d984b18e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.505609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-57cb1467-77ca-4863-8e20-d188d984b18e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.508138 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2575/5083] 10.222.0.13 () {60 vars in 1242 bytes} [Sat Dec 18 21:02:13 2021] PATCH /identity/v3/users/a59b243b4d9f4135bce6ef36397e659c => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:13.509149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb1467-77ca-4863-8e20-d188d984b18e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:13.512782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-57cb1467-77ca-4863-8e20-d188d984b18e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:13.526168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5987dc2-a053-46c1-bed1-17f273e50abd tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:13.531155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc4439-c9cb-4a03-94f7-f72a94feb74e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:13.532020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc4439-c9cb-4a03-94f7-f72a94feb74e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:13.532360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc4439-c9cb-4a03-94f7-f72a94feb74e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:13.532628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc4439-c9cb-4a03-94f7-f72a94feb74e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles/44216500be734c73b9ed02eeb0b2d77e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:13.534115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc4439-c9cb-4a03-94f7-f72a94feb74e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_role(role_id=44216500be734c73b9ed02eeb0b2d77e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:13.535772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc4439-c9cb-4a03-94f7-f72a94feb74e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:13.586367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e5bc4439-c9cb-4a03-94f7-f72a94feb74e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invalidating the token cache because role 44216500be734c73b9ed02eeb0b2d77e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:13.587028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e5bc4439-c9cb-4a03-94f7-f72a94feb74e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.588055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e5bc4439-c9cb-4a03-94f7-f72a94feb74e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.590143 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2509/5084] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:13 2021] DELETE /identity/v3/roles/44216500be734c73b9ed02eeb0b2d77e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:13.590931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc4439-c9cb-4a03-94f7-f72a94feb74e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:13.592544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e5bc4439-c9cb-4a03-94f7-f72a94feb74e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:13.604452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb1467-77ca-4863-8e20-d188d984b18e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:13.674571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc4439-c9cb-4a03-94f7-f72a94feb74e tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:13.680690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc446fd1-f78f-4def-99dd-d1da41b0e778 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:13.681375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc446fd1-f78f-4def-99dd-d1da41b0e778 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:13.681666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc446fd1-f78f-4def-99dd-d1da41b0e778 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:13.682493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc446fd1-f78f-4def-99dd-d1da41b0e778 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:13.683746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc446fd1-f78f-4def-99dd-d1da41b0e778 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:13.685892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc446fd1-f78f-4def-99dd-d1da41b0e778 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:13.723315 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2510/5085] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:02:13 2021] POST /identity/v3/users => generated 265 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:13.723315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc446fd1-f78f-4def-99dd-d1da41b0e778 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:13.724559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cc446fd1-f78f-4def-99dd-d1da41b0e778 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:13.726900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c5d44-11a0-4dfe-bb70-a2b45ba36751 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:13.727893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c5d44-11a0-4dfe-bb70-a2b45ba36751 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:13.732577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c5d44-11a0-4dfe-bb70-a2b45ba36751 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:13.733132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c5d44-11a0-4dfe-bb70-a2b45ba36751 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/domains/29236d26ed7f441eabe2dc49c0cbc652` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:13.748320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c5d44-11a0-4dfe-bb70-a2b45ba36751 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=29236d26ed7f441eabe2dc49c0cbc652)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:13.750906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c5d44-11a0-4dfe-bb70-a2b45ba36751 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:13.777838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-161c5d44-11a0-4dfe-bb70-a2b45ba36751 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '29236d26ed7f441eabe2dc49c0cbc652'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.779428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-161c5d44-11a0-4dfe-bb70-a2b45ba36751 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '29236d26ed7f441eabe2dc49c0cbc652'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.806905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-161c5d44-11a0-4dfe-bb70-a2b45ba36751 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '29236d26ed7f441eabe2dc49c0cbc652'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.808201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc446fd1-f78f-4def-99dd-d1da41b0e778 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:13.808400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-161c5d44-11a0-4dfe-bb70-a2b45ba36751 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '29236d26ed7f441eabe2dc49c0cbc652'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.811048 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2576/5086] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:02:13 2021] PATCH /identity/v3/domains/29236d26ed7f441eabe2dc49c0cbc652 => generated 277 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:13.811820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c5d44-11a0-4dfe-bb70-a2b45ba36751 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:13.813348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-161c5d44-11a0-4dfe-bb70-a2b45ba36751 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:13.875801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bb166-a6b4-41f7-96cd-dbd33dbea226 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:13.877195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bb166-a6b4-41f7-96cd-dbd33dbea226 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:13.877495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bb166-a6b4-41f7-96cd-dbd33dbea226 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:13.877772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bb166-a6b4-41f7-96cd-dbd33dbea226 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/roles/fed45fa869b04683b300fe8e55d600d7` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:13.879297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bb166-a6b4-41f7-96cd-dbd33dbea226 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fed45fa869b04683b300fe8e55d600d7)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:13.881197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bb166-a6b4-41f7-96cd-dbd33dbea226 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:13.886825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c5d44-11a0-4dfe-bb70-a2b45ba36751 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:13.891623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c86aec-7d1e-46bc-af9a-ff2bdc5449d5 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:13.892604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c86aec-7d1e-46bc-af9a-ff2bdc5449d5 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:13.892894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c86aec-7d1e-46bc-af9a-ff2bdc5449d5 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:13.893184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c86aec-7d1e-46bc-af9a-ff2bdc5449d5 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users/89f3fb41eff545a787280db49f05ead5/password` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:13.918625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8e0bb166-a6b4-41f7-96cd-dbd33dbea226 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invalidating the token cache because role fed45fa869b04683b300fe8e55d600d7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:13.918917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8e0bb166-a6b4-41f7-96cd-dbd33dbea226 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.919668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8e0bb166-a6b4-41f7-96cd-dbd33dbea226 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.921557 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2511/5087] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:13 2021] DELETE /identity/v3/roles/fed45fa869b04683b300fe8e55d600d7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:13.922414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bb166-a6b4-41f7-96cd-dbd33dbea226 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:13.925688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8e0bb166-a6b4-41f7-96cd-dbd33dbea226 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:13.955198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-56c86aec-7d1e-46bc-af9a-ff2bdc5449d5 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '89f3fb41eff545a787280db49f05ead5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:13.965160 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2577/5088] 10.222.0.13 () {60 vars in 1268 bytes} [Sat Dec 18 21:02:13 2021] POST /identity/v3/users/89f3fb41eff545a787280db49f05ead5/password => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:13.966043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c86aec-7d1e-46bc-af9a-ff2bdc5449d5 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:13.968685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-56c86aec-7d1e-46bc-af9a-ff2bdc5449d5 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:14.001392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bb166-a6b4-41f7-96cd-dbd33dbea226 tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:14.006176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611fb18-68cb-421c-b2a3-dc0035ccb8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:14.007073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611fb18-68cb-421c-b2a3-dc0035ccb8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:14.007375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611fb18-68cb-421c-b2a3-dc0035ccb8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:14.007751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611fb18-68cb-421c-b2a3-dc0035ccb8c2 admin admin] PATH_INFO: `/v3/users/9073865992504246b9d1699da089c86f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:14.024061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611fb18-68cb-421c-b2a3-dc0035ccb8c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9073865992504246b9d1699da089c86f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:14.026038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611fb18-68cb-421c-b2a3-dc0035ccb8c2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:14.038979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c86aec-7d1e-46bc-af9a-ff2bdc5449d5 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:14.079604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7611fb18-68cb-421c-b2a3-dc0035ccb8c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9073865992504246b9d1699da089c86f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.087215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7611fb18-68cb-421c-b2a3-dc0035ccb8c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9073865992504246b9d1699da089c86f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.102427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:14.104504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:14.104768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7611fb18-68cb-421c-b2a3-dc0035ccb8c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9073865992504246b9d1699da089c86f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.104968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:14.105248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/domains/29236d26ed7f441eabe2dc49c0cbc652` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:14.106992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7611fb18-68cb-421c-b2a3-dc0035ccb8c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9073865992504246b9d1699da089c86f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.118658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7611fb18-68cb-421c-b2a3-dc0035ccb8c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9073865992504246b9d1699da089c86f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.121770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=29236d26ed7f441eabe2dc49c0cbc652)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:14.123735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:14.131476 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2512/5089] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:13 2021] DELETE /identity/v3/users/9073865992504246b9d1699da089c86f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:14.132903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611fb18-68cb-421c-b2a3-dc0035ccb8c2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:14.135092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7611fb18-68cb-421c-b2a3-dc0035ccb8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:14.148570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '29236d26ed7f441eabe2dc49c0cbc652'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.152216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '29236d26ed7f441eabe2dc49c0cbc652'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.210303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29236d26ed7f441eabe2dc49c0cbc652', 'request_id': 'req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.217836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29236d26ed7f441eabe2dc49c0cbc652', 'request_id': 'req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.227098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29236d26ed7f441eabe2dc49c0cbc652', 'request_id': 'req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.237264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611fb18-68cb-421c-b2a3-dc0035ccb8c2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:14.244131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] The token cache is being invalidate because project 29236d26ed7f441eabe2dc49c0cbc652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:14.244461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.245500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.263723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '29236d26ed7f441eabe2dc49c0cbc652', 'request_id': 'req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.270017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '29236d26ed7f441eabe2dc49c0cbc652', 'request_id': 'req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.271499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '29236d26ed7f441eabe2dc49c0cbc652', 'request_id': 'req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.280557 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2578/5090] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:02:13 2021] DELETE /identity/v3/domains/29236d26ed7f441eabe2dc49c0cbc652 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:14.285885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:14.287556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:14.354987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfffb0-26c0-4c88-8bbe-91bb017235af tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:14.355897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfffb0-26c0-4c88-8bbe-91bb017235af tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:14.356183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfffb0-26c0-4c88-8bbe-91bb017235af tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:14.356466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfffb0-26c0-4c88-8bbe-91bb017235af tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/users/65daff688b2a4d11824061e41028ad88` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:14.358786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfffb0-26c0-4c88-8bbe-91bb017235af tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_user(user_id=65daff688b2a4d11824061e41028ad88)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:14.361353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfffb0-26c0-4c88-8bbe-91bb017235af tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:14.380392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62abbe0-b49c-44b6-b62d-50e83f1cd8e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:14.385413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60a2b0-d72a-415b-939e-69d67ce1fa86 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:14.387625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60a2b0-d72a-415b-939e-69d67ce1fa86 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:14.387625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60a2b0-d72a-415b-939e-69d67ce1fa86 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:14.387625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60a2b0-d72a-415b-939e-69d67ce1fa86 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:14.387625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60a2b0-d72a-415b-939e-69d67ce1fa86 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:14.389179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60a2b0-d72a-415b-939e-69d67ce1fa86 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:14.409792 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2579/5091] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:02:14 2021] POST /identity/v3/domains => generated 276 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:02:14.410971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60a2b0-d72a-415b-939e-69d67ce1fa86 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:14.413011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4b60a2b0-d72a-415b-939e-69d67ce1fa86 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:14.446308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbbfffb0-26c0-4c88-8bbe-91bb017235af tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65daff688b2a4d11824061e41028ad88'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.453123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbbfffb0-26c0-4c88-8bbe-91bb017235af tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65daff688b2a4d11824061e41028ad88'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.470408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbbfffb0-26c0-4c88-8bbe-91bb017235af tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65daff688b2a4d11824061e41028ad88'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.471329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbbfffb0-26c0-4c88-8bbe-91bb017235af tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65daff688b2a4d11824061e41028ad88'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.480218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbbfffb0-26c0-4c88-8bbe-91bb017235af tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65daff688b2a4d11824061e41028ad88'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.488236 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2513/5092] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:14 2021] DELETE /identity/v3/users/65daff688b2a4d11824061e41028ad88 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:14.488418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfffb0-26c0-4c88-8bbe-91bb017235af tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:14.490202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cbbfffb0-26c0-4c88-8bbe-91bb017235af tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:14.497858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60a2b0-d72a-415b-939e-69d67ce1fa86 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:14.565952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7671ac8-3b98-403d-9f37-a4a9ffda892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:14.567311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7671ac8-3b98-403d-9f37-a4a9ffda892b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:14.567591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7671ac8-3b98-403d-9f37-a4a9ffda892b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:14.568225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7671ac8-3b98-403d-9f37-a4a9ffda892b admin admin] PATH_INFO: `/v3/projects/405bfbeb7b7d47c48b706aa32c6702bf` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:14.573605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfffb0-26c0-4c88-8bbe-91bb017235af tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:14.581683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7671ac8-3b98-403d-9f37-a4a9ffda892b admin admin] RBAC: Authorizing `identity:delete_project(project_id=405bfbeb7b7d47c48b706aa32c6702bf)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:14.583061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106498a5-74b8-4b47-9b2e-1f7cd12974e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:14.583727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7671ac8-3b98-403d-9f37-a4a9ffda892b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:14.583877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106498a5-74b8-4b47-9b2e-1f7cd12974e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:14.584148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106498a5-74b8-4b47-9b2e-1f7cd12974e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:14.584498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106498a5-74b8-4b47-9b2e-1f7cd12974e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:14.585319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106498a5-74b8-4b47-9b2e-1f7cd12974e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:14.587778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106498a5-74b8-4b47-9b2e-1f7cd12974e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:14.635223 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2514/5093] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:14 2021] POST /identity/v3/projects => generated 409 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:14.636552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106498a5-74b8-4b47-9b2e-1f7cd12974e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:14.639417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-106498a5-74b8-4b47-9b2e-1f7cd12974e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:14.647394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7671ac8-3b98-403d-9f37-a4a9ffda892b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405bfbeb7b7d47c48b706aa32c6702bf', 'request_id': 'req-e7671ac8-3b98-403d-9f37-a4a9ffda892b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.654697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7671ac8-3b98-403d-9f37-a4a9ffda892b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405bfbeb7b7d47c48b706aa32c6702bf', 'request_id': 'req-e7671ac8-3b98-403d-9f37-a4a9ffda892b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.665627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7671ac8-3b98-403d-9f37-a4a9ffda892b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405bfbeb7b7d47c48b706aa32c6702bf', 'request_id': 'req-e7671ac8-3b98-403d-9f37-a4a9ffda892b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.678985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7671ac8-3b98-403d-9f37-a4a9ffda892b admin admin] The token cache is being invalidate because project 405bfbeb7b7d47c48b706aa32c6702bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:14.679311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7671ac8-3b98-403d-9f37-a4a9ffda892b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.680004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7671ac8-3b98-403d-9f37-a4a9ffda892b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.681614 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2580/5094] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:14 2021] DELETE /identity/v3/projects/405bfbeb7b7d47c48b706aa32c6702bf => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:14.683839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7671ac8-3b98-403d-9f37-a4a9ffda892b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:14.686233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e7671ac8-3b98-403d-9f37-a4a9ffda892b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:14.712941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106498a5-74b8-4b47-9b2e-1f7cd12974e4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:14.718753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057b596-63cf-4031-8b6d-c05aa64fcfda tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1fa865c124434ad0e66725e588855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5856f06954754b7ea25fe69dd1abdead', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:14.719113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b596-63cf-4031-8b6d-c05aa64fcfda tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:14.719393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b596-63cf-4031-8b6d-c05aa64fcfda tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:14.719675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b596-63cf-4031-8b6d-c05aa64fcfda tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] PATH_INFO: `/v3/projects/17e8c4d57554495096f6514adc18ff57` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:14.721282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057b596-63cf-4031-8b6d-c05aa64fcfda tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorizing `identity:delete_project(project_id=17e8c4d57554495096f6514adc18ff57)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:14.723204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057b596-63cf-4031-8b6d-c05aa64fcfda tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:14.761103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7671ac8-3b98-403d-9f37-a4a9ffda892b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:14.780304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3057b596-63cf-4031-8b6d-c05aa64fcfda tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e8c4d57554495096f6514adc18ff57', 'request_id': 'req-3057b596-63cf-4031-8b6d-c05aa64fcfda'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.787247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3057b596-63cf-4031-8b6d-c05aa64fcfda tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e8c4d57554495096f6514adc18ff57', 'request_id': 'req-3057b596-63cf-4031-8b6d-c05aa64fcfda'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.793549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3057b596-63cf-4031-8b6d-c05aa64fcfda tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e8c4d57554495096f6514adc18ff57', 'request_id': 'req-3057b596-63cf-4031-8b6d-c05aa64fcfda'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.810214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3057b596-63cf-4031-8b6d-c05aa64fcfda tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] The token cache is being invalidate because project 17e8c4d57554495096f6514adc18ff57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:14.810628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3057b596-63cf-4031-8b6d-c05aa64fcfda tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.811327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3057b596-63cf-4031-8b6d-c05aa64fcfda tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:14.813052 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2515/5095] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:14 2021] DELETE /identity/v3/projects/17e8c4d57554495096f6514adc18ff57 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:14.814409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057b596-63cf-4031-8b6d-c05aa64fcfda tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:14.815585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3057b596-63cf-4031-8b6d-c05aa64fcfda tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:14.827340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4841a91-ac2e-4c0f-b246-364f201a6577 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:14.828067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4841a91-ac2e-4c0f-b246-364f201a6577 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:14.828364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4841a91-ac2e-4c0f-b246-364f201a6577 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:14.828646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4841a91-ac2e-4c0f-b246-364f201a6577 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:14.829367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4841a91-ac2e-4c0f-b246-364f201a6577 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:14.831997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4841a91-ac2e-4c0f-b246-364f201a6577 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:14.875565 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2581/5096] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:14 2021] POST /identity/v3/projects => generated 405 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:14.876450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4841a91-ac2e-4c0f-b246-364f201a6577 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:14.879827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e4841a91-ac2e-4c0f-b246-364f201a6577 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:14.896118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057b596-63cf-4031-8b6d-c05aa64fcfda tempest-TrustsV3TestJSON-1277342819 tempest-TrustsV3TestJSON-1277342819-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:14.951864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4841a91-ac2e-4c0f-b246-364f201a6577 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:14.956463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910fb72-e60b-4b09-a0c4-26f1d69adbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:14.957121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8205bf-8d3e-4ed3-bfa4-f030f405d686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:14.957323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910fb72-e60b-4b09-a0c4-26f1d69adbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:14.957604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910fb72-e60b-4b09-a0c4-26f1d69adbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:14.957880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910fb72-e60b-4b09-a0c4-26f1d69adbe3 admin admin] PATH_INFO: `/v3/users/062f8a58d8674e29aa997a6685d6dd01` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:14.957990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8205bf-8d3e-4ed3-bfa4-f030f405d686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:14.958275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8205bf-8d3e-4ed3-bfa4-f030f405d686 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:14.958599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8205bf-8d3e-4ed3-bfa4-f030f405d686 admin admin] PATH_INFO: `/v3/users/7fb502e539054c5f80754303e233aaf9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:14.959181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910fb72-e60b-4b09-a0c4-26f1d69adbe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=062f8a58d8674e29aa997a6685d6dd01)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:14.961073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910fb72-e60b-4b09-a0c4-26f1d69adbe3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:14.973411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8205bf-8d3e-4ed3-bfa4-f030f405d686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb502e539054c5f80754303e233aaf9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:14.975707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8205bf-8d3e-4ed3-bfa4-f030f405d686 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:15.014209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b910fb72-e60b-4b09-a0c4-26f1d69adbe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062f8a58d8674e29aa997a6685d6dd01'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.022054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b910fb72-e60b-4b09-a0c4-26f1d69adbe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062f8a58d8674e29aa997a6685d6dd01'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.022843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b910fb72-e60b-4b09-a0c4-26f1d69adbe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062f8a58d8674e29aa997a6685d6dd01'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.032539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-be8205bf-8d3e-4ed3-bfa4-f030f405d686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb502e539054c5f80754303e233aaf9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.038671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b910fb72-e60b-4b09-a0c4-26f1d69adbe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062f8a58d8674e29aa997a6685d6dd01'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.041087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-be8205bf-8d3e-4ed3-bfa4-f030f405d686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb502e539054c5f80754303e233aaf9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.049255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b910fb72-e60b-4b09-a0c4-26f1d69adbe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062f8a58d8674e29aa997a6685d6dd01'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.054346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-be8205bf-8d3e-4ed3-bfa4-f030f405d686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb502e539054c5f80754303e233aaf9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.055136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-be8205bf-8d3e-4ed3-bfa4-f030f405d686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb502e539054c5f80754303e233aaf9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.056490 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2582/5097] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:14 2021] DELETE /identity/v3/users/062f8a58d8674e29aa997a6685d6dd01 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:15.057101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910fb72-e60b-4b09-a0c4-26f1d69adbe3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:15.058774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b910fb72-e60b-4b09-a0c4-26f1d69adbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:15.070950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-be8205bf-8d3e-4ed3-bfa4-f030f405d686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb502e539054c5f80754303e233aaf9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.079057 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2516/5098] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:14 2021] DELETE /identity/v3/users/7fb502e539054c5f80754303e233aaf9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:15.080607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20ef52-578d-4c86-8b50-e353c209e8d2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:15.080799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20ef52-578d-4c86-8b50-e353c209e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:15.080955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20ef52-578d-4c86-8b50-e353c209e8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:15.099102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2b20ef52-578d-4c86-8b50-e353c209e8d2 None None] MFA Rules not processed for user `89f3fb41eff545a787280db49f05ead5`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:15.100323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2b20ef52-578d-4c86-8b50-e353c209e8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:15.106417 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2517/5099] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:15 2021] POST /identity/v3/auth/tokens => generated 330 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 18 21:02:15.111224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f2f87-340e-47d5-b68a-fbf35a7e1fa3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:15.111523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f2f87-340e-47d5-b68a-fbf35a7e1fa3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:15.111816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f2f87-340e-47d5-b68a-fbf35a7e1fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:15.132146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0b6f2f87-340e-47d5-b68a-fbf35a7e1fa3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:15.133653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0b6f2f87-340e-47d5-b68a-fbf35a7e1fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:15.146010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910fb72-e60b-4b09-a0c4-26f1d69adbe3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:15.208944 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2518/5100] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:15.210118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f2f87-340e-47d5-b68a-fbf35a7e1fa3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:15.211738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0b6f2f87-340e-47d5-b68a-fbf35a7e1fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:15.221173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:15.222576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:15.223845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:15.224289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/7912749e554f4f2ab69be5e61603903d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:15.225730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7912749e554f4f2ab69be5e61603903d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:15.229884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:15.288681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7912749e554f4f2ab69be5e61603903d', 'request_id': 'req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.297120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7912749e554f4f2ab69be5e61603903d', 'request_id': 'req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.300304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f2f87-340e-47d5-b68a-fbf35a7e1fa3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:15.307521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7912749e554f4f2ab69be5e61603903d', 'request_id': 'req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.323349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] The token cache is being invalidate because project 7912749e554f4f2ab69be5e61603903d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:15.323645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.324410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.326448 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2583/5101] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:15 2021] DELETE /identity/v3/projects/7912749e554f4f2ab69be5e61603903d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:15.327503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:15.328999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:15.379546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa16a9-a660-495f-ab57-705cd1c83204 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:15.381720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa16a9-a660-495f-ab57-705cd1c83204 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:15.382168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa16a9-a660-495f-ab57-705cd1c83204 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:15.382765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa16a9-a660-495f-ab57-705cd1c83204 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:15.385936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-84aa16a9-a660-495f-ab57-705cd1c83204 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:15.399782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3e896-9a9b-47dd-aa18-42d9dc3a590c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:15.403561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa16a9-a660-495f-ab57-705cd1c83204 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:15.405234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf937dd-94b2-4cf0-9f2f-e617f6faee8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:15.405621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf937dd-94b2-4cf0-9f2f-e617f6faee8b service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:15.405982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf937dd-94b2-4cf0-9f2f-e617f6faee8b service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:15.406109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf937dd-94b2-4cf0-9f2f-e617f6faee8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:15.408664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ddf937dd-94b2-4cf0-9f2f-e617f6faee8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:15.409007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa16a9-a660-495f-ab57-705cd1c83204 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:15.417626 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2519/5102] 10.222.0.13 () {56 vars in 1262 bytes} [Sat Dec 18 21:02:15 2021] GET /identity/v3/auth/tokens => generated 330 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:15.419003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa16a9-a660-495f-ab57-705cd1c83204 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:15.422050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-84aa16a9-a660-495f-ab57-705cd1c83204 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:15.480742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf937dd-94b2-4cf0-9f2f-e617f6faee8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:15.482302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf937dd-94b2-4cf0-9f2f-e617f6faee8b service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:15.492307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa16a9-a660-495f-ab57-705cd1c83204 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:15.492965 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2584/5103] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:15.493939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf937dd-94b2-4cf0-9f2f-e617f6faee8b service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:15.495537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ddf937dd-94b2-4cf0-9f2f-e617f6faee8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:15.499894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:15.500780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:15.501074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:15.501378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0 admin admin] PATH_INFO: `/v3/projects/30d11e8b908541bea484c5b90e60d4dd` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:15.520101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d11e8b908541bea484c5b90e60d4dd)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:15.522239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:15.576467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf937dd-94b2-4cf0-9f2f-e617f6faee8b service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:15.585827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d11e8b908541bea484c5b90e60d4dd', 'request_id': 'req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.593761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d11e8b908541bea484c5b90e60d4dd', 'request_id': 'req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.601075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d11e8b908541bea484c5b90e60d4dd', 'request_id': 'req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.619491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0 admin admin] The token cache is being invalidate because project 30d11e8b908541bea484c5b90e60d4dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:15.619852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.621160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.623513 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2520/5104] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:15 2021] DELETE /identity/v3/projects/30d11e8b908541bea484c5b90e60d4dd => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:15.624425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:15.626190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:15.669647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5e6c5-0bef-448a-a025-f83aed29339a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:15.670676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5e6c5-0bef-448a-a025-f83aed29339a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:15.670969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5e6c5-0bef-448a-a025-f83aed29339a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:15.671355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5e6c5-0bef-448a-a025-f83aed29339a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/42229f665afa4be9a3f84b3a6e1e6086` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:15.673386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5e6c5-0bef-448a-a025-f83aed29339a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:delete_project(project_id=42229f665afa4be9a3f84b3a6e1e6086)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:15.676321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5e6c5-0bef-448a-a025-f83aed29339a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:15.728086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63df54e-b0e3-4e39-b9dd-37fde35eb8e0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:15.740358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44425a7c-697f-4d12-9ffc-a7580f4d24ab tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:15.742287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44425a7c-697f-4d12-9ffc-a7580f4d24ab tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:15.742788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44425a7c-697f-4d12-9ffc-a7580f4d24ab tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:15.742934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44425a7c-697f-4d12-9ffc-a7580f4d24ab tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users/89f3fb41eff545a787280db49f05ead5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:15.746515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44425a7c-697f-4d12-9ffc-a7580f4d24ab tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:delete_user(user_id=89f3fb41eff545a787280db49f05ead5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:15.749096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44425a7c-697f-4d12-9ffc-a7580f4d24ab tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:15.782891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e1c5e6c5-0bef-448a-a025-f83aed29339a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42229f665afa4be9a3f84b3a6e1e6086', 'request_id': 'req-e1c5e6c5-0bef-448a-a025-f83aed29339a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.806033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e1c5e6c5-0bef-448a-a025-f83aed29339a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42229f665afa4be9a3f84b3a6e1e6086', 'request_id': 'req-e1c5e6c5-0bef-448a-a025-f83aed29339a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.821288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-44425a7c-697f-4d12-9ffc-a7580f4d24ab tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f3fb41eff545a787280db49f05ead5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.824000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e1c5e6c5-0bef-448a-a025-f83aed29339a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42229f665afa4be9a3f84b3a6e1e6086', 'request_id': 'req-e1c5e6c5-0bef-448a-a025-f83aed29339a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.833830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-44425a7c-697f-4d12-9ffc-a7580f4d24ab tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f3fb41eff545a787280db49f05ead5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.838195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e1c5e6c5-0bef-448a-a025-f83aed29339a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] The token cache is being invalidate because project 42229f665afa4be9a3f84b3a6e1e6086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:15.839210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e1c5e6c5-0bef-448a-a025-f83aed29339a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.840423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e1c5e6c5-0bef-448a-a025-f83aed29339a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.844920 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2585/5105] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:15 2021] DELETE /identity/v3/projects/42229f665afa4be9a3f84b3a6e1e6086 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:15.846762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3c586-27f7-4885-a09a-afd054a0de3a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:15.847357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3c586-27f7-4885-a09a-afd054a0de3a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:15.847864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3c586-27f7-4885-a09a-afd054a0de3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:15.854848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-44425a7c-697f-4d12-9ffc-a7580f4d24ab tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f3fb41eff545a787280db49f05ead5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.857002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-44425a7c-697f-4d12-9ffc-a7580f4d24ab tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f3fb41eff545a787280db49f05ead5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.874872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-44425a7c-697f-4d12-9ffc-a7580f4d24ab tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f3fb41eff545a787280db49f05ead5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:15.878964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d1b3c586-27f7-4885-a09a-afd054a0de3a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:15.881069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d1b3c586-27f7-4885-a09a-afd054a0de3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:15.888653 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2521/5106] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:15 2021] DELETE /identity/v3/users/89f3fb41eff545a787280db49f05ead5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:15.890321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44425a7c-697f-4d12-9ffc-a7580f4d24ab tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:15.895604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-44425a7c-697f-4d12-9ffc-a7580f4d24ab tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:15.997114 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2586/5107] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:16.003236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3c586-27f7-4885-a09a-afd054a0de3a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:16.004948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d1b3c586-27f7-4885-a09a-afd054a0de3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:16.016819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44425a7c-697f-4d12-9ffc-a7580f4d24ab tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:16.024645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb782b23-0d2f-4259-ba30-75eb060e3259 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:16.025940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb782b23-0d2f-4259-ba30-75eb060e3259 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:16.026540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb782b23-0d2f-4259-ba30-75eb060e3259 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:16.027049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb782b23-0d2f-4259-ba30-75eb060e3259 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/domains/3d02eeb3af934e5ab42b35f509effebf` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:16.029236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb782b23-0d2f-4259-ba30-75eb060e3259 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3d02eeb3af934e5ab42b35f509effebf)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:16.031407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb782b23-0d2f-4259-ba30-75eb060e3259 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:16.067509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cb782b23-0d2f-4259-ba30-75eb060e3259 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3d02eeb3af934e5ab42b35f509effebf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.068434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cb782b23-0d2f-4259-ba30-75eb060e3259 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3d02eeb3af934e5ab42b35f509effebf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.099664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cb782b23-0d2f-4259-ba30-75eb060e3259 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3d02eeb3af934e5ab42b35f509effebf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.100651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3c586-27f7-4885-a09a-afd054a0de3a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:16.101731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cb782b23-0d2f-4259-ba30-75eb060e3259 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3d02eeb3af934e5ab42b35f509effebf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.105543 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2522/5108] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:02:15 2021] PATCH /identity/v3/domains/3d02eeb3af934e5ab42b35f509effebf => generated 277 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:16.107303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2cbac-7250-40b6-a226-abf60b15148b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:16.107601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2cbac-7250-40b6-a226-abf60b15148b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:16.108069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2cbac-7250-40b6-a226-abf60b15148b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:16.138192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b6f2cbac-7250-40b6-a226-abf60b15148b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:16.140341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b6f2cbac-7250-40b6-a226-abf60b15148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:16.178644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800542f8-e14d-4c03-9c38-602677837188 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:16.179349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800542f8-e14d-4c03-9c38-602677837188 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:16.179642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800542f8-e14d-4c03-9c38-602677837188 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:16.179970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800542f8-e14d-4c03-9c38-602677837188 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:16.180835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800542f8-e14d-4c03-9c38-602677837188 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:16.182937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800542f8-e14d-4c03-9c38-602677837188 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:16.209018 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2587/5109] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:15 2021] POST /identity/v3/users => generated 364 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:16.210044 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2523/5110] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:16.210832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800542f8-e14d-4c03-9c38-602677837188 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:16.210979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2cbac-7250-40b6-a226-abf60b15148b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:16.212529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b6f2cbac-7250-40b6-a226-abf60b15148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:16.218242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-800542f8-e14d-4c03-9c38-602677837188 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:16.233279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800542f8-e14d-4c03-9c38-602677837188 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:16.238320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:16.239242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:16.239597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:16.239805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9 admin admin] PATH_INFO: `/v3/projects/bdb8029687da4b8194f5498702cdb2e3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:16.241132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb8029687da4b8194f5498702cdb2e3)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:16.243235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:16.285026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2cbac-7250-40b6-a226-abf60b15148b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:16.292989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb8029687da4b8194f5498702cdb2e3', 'request_id': 'req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.299768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb8029687da4b8194f5498702cdb2e3', 'request_id': 'req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.307525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb8029687da4b8194f5498702cdb2e3', 'request_id': 'req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.318359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9 admin admin] The token cache is being invalidate because project bdb8029687da4b8194f5498702cdb2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:16.318658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.319390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.321074 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2588/5111] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:16 2021] DELETE /identity/v3/projects/bdb8029687da4b8194f5498702cdb2e3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:16.321818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:16.323852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:16.350575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:16.351780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:16.352105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:16.352469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/domains/3d02eeb3af934e5ab42b35f509effebf` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:16.365920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3d02eeb3af934e5ab42b35f509effebf)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:16.367975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:16.390775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3d02eeb3af934e5ab42b35f509effebf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.392965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67252c8-f2e8-4a9e-950c-f80e27bfd2b9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:16.394026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3d02eeb3af934e5ab42b35f509effebf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.399347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885db012-cb84-43fd-9992-c382c95e6a49 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:16.400010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885db012-cb84-43fd-9992-c382c95e6a49 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:16.400295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885db012-cb84-43fd-9992-c382c95e6a49 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:16.400577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885db012-cb84-43fd-9992-c382c95e6a49 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:16.401851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885db012-cb84-43fd-9992-c382c95e6a49 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:16.403764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885db012-cb84-43fd-9992-c382c95e6a49 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:16.443662 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2589/5112] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:16 2021] POST /identity/v3/projects => generated 358 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:16.444973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885db012-cb84-43fd-9992-c382c95e6a49 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:16.447082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-885db012-cb84-43fd-9992-c382c95e6a49 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:16.467528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d02eeb3af934e5ab42b35f509effebf', 'request_id': 'req-f110bf1e-c25f-444d-838d-f140d17adc8c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.480107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d02eeb3af934e5ab42b35f509effebf', 'request_id': 'req-f110bf1e-c25f-444d-838d-f140d17adc8c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.486617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d02eeb3af934e5ab42b35f509effebf', 'request_id': 'req-f110bf1e-c25f-444d-838d-f140d17adc8c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.502228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] The token cache is being invalidate because project 3d02eeb3af934e5ab42b35f509effebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:16.502576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.503235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.511303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3d02eeb3af934e5ab42b35f509effebf', 'request_id': 'req-f110bf1e-c25f-444d-838d-f140d17adc8c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.514559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3d02eeb3af934e5ab42b35f509effebf', 'request_id': 'req-f110bf1e-c25f-444d-838d-f140d17adc8c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.515232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3d02eeb3af934e5ab42b35f509effebf', 'request_id': 'req-f110bf1e-c25f-444d-838d-f140d17adc8c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.521782 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2524/5113] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:02:16 2021] DELETE /identity/v3/domains/3d02eeb3af934e5ab42b35f509effebf => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:16.522617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:16.523959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:16.532686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885db012-cb84-43fd-9992-c382c95e6a49 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:16.597948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110bf1e-c25f-444d-838d-f140d17adc8c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:16.598740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478d62a-aa21-407a-be98-31f99de8780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:16.599625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478d62a-aa21-407a-be98-31f99de8780a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:16.599863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478d62a-aa21-407a-be98-31f99de8780a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:16.600145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478d62a-aa21-407a-be98-31f99de8780a admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:16.600925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478d62a-aa21-407a-be98-31f99de8780a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:16.601239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478d62a-aa21-407a-be98-31f99de8780a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:16.603255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478d62a-aa21-407a-be98-31f99de8780a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:16.603841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31bfcb-4551-49c3-b263-d052b501438e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:16.605365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31bfcb-4551-49c3-b263-d052b501438e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:16.605674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31bfcb-4551-49c3-b263-d052b501438e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:16.606009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31bfcb-4551-49c3-b263-d052b501438e admin admin] PATH_INFO: `/v3/users/28a1fa865c124434ad0e66725e588855` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:16.607486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31bfcb-4551-49c3-b263-d052b501438e admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a1fa865c124434ad0e66725e588855)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:16.609812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31bfcb-4551-49c3-b263-d052b501438e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:16.616398 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2590/5114] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:16.617216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478d62a-aa21-407a-be98-31f99de8780a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:16.618990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d478d62a-aa21-407a-be98-31f99de8780a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:16.663530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3e31bfcb-4551-49c3-b263-d052b501438e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a1fa865c124434ad0e66725e588855'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.671502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3e31bfcb-4551-49c3-b263-d052b501438e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a1fa865c124434ad0e66725e588855'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.685137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3e31bfcb-4551-49c3-b263-d052b501438e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a1fa865c124434ad0e66725e588855'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.686016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3e31bfcb-4551-49c3-b263-d052b501438e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a1fa865c124434ad0e66725e588855'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.694580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3e31bfcb-4551-49c3-b263-d052b501438e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a1fa865c124434ad0e66725e588855'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:16.694757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478d62a-aa21-407a-be98-31f99de8780a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:16.700551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d143445-1793-4fc6-8d45-d206bc4402ee tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:16.701446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d143445-1793-4fc6-8d45-d206bc4402ee tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:16.701581 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2525/5115] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:16 2021] DELETE /identity/v3/users/28a1fa865c124434ad0e66725e588855 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:16.701777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d143445-1793-4fc6-8d45-d206bc4402ee tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:16.702006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d143445-1793-4fc6-8d45-d206bc4402ee tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users/2ab734febf52457e9f8af49285098540` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:16.702422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31bfcb-4551-49c3-b263-d052b501438e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:16.704040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3e31bfcb-4551-49c3-b263-d052b501438e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:16.721208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d143445-1793-4fc6-8d45-d206bc4402ee tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:update_user(user_id=2ab734febf52457e9f8af49285098540)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:16.723520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d143445-1793-4fc6-8d45-d206bc4402ee tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:16.759525 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2591/5116] 10.222.0.13 () {60 vars in 1243 bytes} [Sat Dec 18 21:02:16 2021] PATCH /identity/v3/users/2ab734febf52457e9f8af49285098540 => generated 521 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:16.761115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d143445-1793-4fc6-8d45-d206bc4402ee tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:16.762954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9d143445-1793-4fc6-8d45-d206bc4402ee tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:16.787541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d143445-1793-4fc6-8d45-d206bc4402ee tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:16.790422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31bfcb-4551-49c3-b263-d052b501438e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:16.796132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8791f3d-445d-464b-b79f-5169263eae5a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:16.796735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8791f3d-445d-464b-b79f-5169263eae5a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:16.797033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8791f3d-445d-464b-b79f-5169263eae5a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:16.797324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8791f3d-445d-464b-b79f-5169263eae5a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:16.798161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8791f3d-445d-464b-b79f-5169263eae5a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:16.800527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8791f3d-445d-464b-b79f-5169263eae5a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:16.847317 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2526/5117] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:16 2021] POST /identity/v3/projects => generated 376 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:16.847317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8791f3d-445d-464b-b79f-5169263eae5a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:16.849552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d8791f3d-445d-464b-b79f-5169263eae5a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:16.858959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f776f-5e54-475c-a62f-51d30a2cbf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:16.860076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f776f-5e54-475c-a62f-51d30a2cbf74 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:16.860365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f776f-5e54-475c-a62f-51d30a2cbf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:16.860643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f776f-5e54-475c-a62f-51d30a2cbf74 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:16.861424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f776f-5e54-475c-a62f-51d30a2cbf74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:16.863635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f776f-5e54-475c-a62f-51d30a2cbf74 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:16.910803 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2592/5118] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:16 2021] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:16.910803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f776f-5e54-475c-a62f-51d30a2cbf74 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:16.930297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8791f3d-445d-464b-b79f-5169263eae5a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:16.982773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f776f-5e54-475c-a62f-51d30a2cbf74 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:16.988915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347b8ff-e567-4c46-b076-b1cfab645975 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:16.990690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347b8ff-e567-4c46-b076-b1cfab645975 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:16.991175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347b8ff-e567-4c46-b076-b1cfab645975 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:16.991560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347b8ff-e567-4c46-b076-b1cfab645975 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/151c0663642a4abb90c6e1b3b608176c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:16.993573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347b8ff-e567-4c46-b076-b1cfab645975 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:get_project(project_id=151c0663642a4abb90c6e1b3b608176c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:16.997541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347b8ff-e567-4c46-b076-b1cfab645975 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:16.999511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0085d-852e-47cd-b86e-ebe4f17f0a6e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:17.000435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0085d-852e-47cd-b86e-ebe4f17f0a6e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:17.004948 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2593/5119] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:02:16 2021] GET /identity/v3/projects/151c0663642a4abb90c6e1b3b608176c => generated 376 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:17.005042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0085d-852e-47cd-b86e-ebe4f17f0a6e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:17.005042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0085d-852e-47cd-b86e-ebe4f17f0a6e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users/2ab734febf52457e9f8af49285098540` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:17.005215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347b8ff-e567-4c46-b076-b1cfab645975 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:17.026587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0085d-852e-47cd-b86e-ebe4f17f0a6e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:get_user(user_id=2ab734febf52457e9f8af49285098540)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:17.030452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0085d-852e-47cd-b86e-ebe4f17f0a6e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:17.036028 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2527/5120] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 21:02:16 2021] GET /identity/v3/users/2ab734febf52457e9f8af49285098540 => generated 388 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:17.036028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0085d-852e-47cd-b86e-ebe4f17f0a6e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:17.052558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0085d-852e-47cd-b86e-ebe4f17f0a6e tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:17.059716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ebfbf-1277-4384-b500-814cfdb32cd1 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:17.060452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ebfbf-1277-4384-b500-814cfdb32cd1 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:17.060742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ebfbf-1277-4384-b500-814cfdb32cd1 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:17.061020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ebfbf-1277-4384-b500-814cfdb32cd1 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:17.061827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ebfbf-1277-4384-b500-814cfdb32cd1 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:17.065210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ebfbf-1277-4384-b500-814cfdb32cd1 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:17.100926 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2528/5121] 10.222.0.13 () {58 vars in 1130 bytes} [Sat Dec 18 21:02:17 2021] GET /identity/v3/projects => generated 6895 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:17.102033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ebfbf-1277-4384-b500-814cfdb32cd1 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:17.116007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347b8ff-e567-4c46-b076-b1cfab645975 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:17.118732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ebfbf-1277-4384-b500-814cfdb32cd1 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:17.125672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:17.126112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e8918-a272-4edb-a0a7-5a3369b1bec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:17.127129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:17.127454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:17.127770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/projects/a10a8fe45d064b6496b9a37db923aae6` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:17.127923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e8918-a272-4edb-a0a7-5a3369b1bec3 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:17.128403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e8918-a272-4edb-a0a7-5a3369b1bec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:17.129011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e8918-a272-4edb-a0a7-5a3369b1bec3 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:17.129169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a10a8fe45d064b6496b9a37db923aae6)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:17.131219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:17.131667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e8918-a272-4edb-a0a7-5a3369b1bec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:17.135063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e8918-a272-4edb-a0a7-5a3369b1bec3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:17.161475 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2594/5122] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:17 2021] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:17.161475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e8918-a272-4edb-a0a7-5a3369b1bec3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:17.161475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6b0e8918-a272-4edb-a0a7-5a3369b1bec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:17.182603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e8918-a272-4edb-a0a7-5a3369b1bec3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:17.188001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a10a8fe45d064b6496b9a37db923aae6', 'request_id': 'req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.194934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a10a8fe45d064b6496b9a37db923aae6', 'request_id': 'req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.201022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a10a8fe45d064b6496b9a37db923aae6', 'request_id': 'req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.217619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] The token cache is being invalidate because project a10a8fe45d064b6496b9a37db923aae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:17.218003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.218885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.220663 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2529/5123] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:17 2021] DELETE /identity/v3/projects/a10a8fe45d064b6496b9a37db923aae6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:17.221663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:17.223096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:17.245107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2924bd-52cc-4467-8e9a-a43f573690a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:17.245991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2924bd-52cc-4467-8e9a-a43f573690a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:17.246443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2924bd-52cc-4467-8e9a-a43f573690a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:17.246648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2924bd-52cc-4467-8e9a-a43f573690a3 admin admin] PATH_INFO: `/v3/projects/5856f06954754b7ea25fe69dd1abdead` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:17.247852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2924bd-52cc-4467-8e9a-a43f573690a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5856f06954754b7ea25fe69dd1abdead)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:17.250030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2924bd-52cc-4467-8e9a-a43f573690a3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:17.297682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1592694-7d12-4627-b3ae-5dfd5fa65d2d tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:17.300246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9d2924bd-52cc-4467-8e9a-a43f573690a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5856f06954754b7ea25fe69dd1abdead', 'request_id': 'req-9d2924bd-52cc-4467-8e9a-a43f573690a3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.307592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9d2924bd-52cc-4467-8e9a-a43f573690a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5856f06954754b7ea25fe69dd1abdead', 'request_id': 'req-9d2924bd-52cc-4467-8e9a-a43f573690a3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.318346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9d2924bd-52cc-4467-8e9a-a43f573690a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5856f06954754b7ea25fe69dd1abdead', 'request_id': 'req-9d2924bd-52cc-4467-8e9a-a43f573690a3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.329963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9d2924bd-52cc-4467-8e9a-a43f573690a3 admin admin] The token cache is being invalidate because project 5856f06954754b7ea25fe69dd1abdead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:17.330278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9d2924bd-52cc-4467-8e9a-a43f573690a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.331134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9d2924bd-52cc-4467-8e9a-a43f573690a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.333010 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2595/5124] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:17 2021] DELETE /identity/v3/projects/5856f06954754b7ea25fe69dd1abdead => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:17.333796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2924bd-52cc-4467-8e9a-a43f573690a3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:17.335179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9d2924bd-52cc-4467-8e9a-a43f573690a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:17.376015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be42300-b237-44a0-a14f-dc59bd16f6ef tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:17.377024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be42300-b237-44a0-a14f-dc59bd16f6ef tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:17.377313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be42300-b237-44a0-a14f-dc59bd16f6ef tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:17.377640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be42300-b237-44a0-a14f-dc59bd16f6ef tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/151c0663642a4abb90c6e1b3b608176c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:17.379107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be42300-b237-44a0-a14f-dc59bd16f6ef tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:delete_project(project_id=151c0663642a4abb90c6e1b3b608176c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:17.381063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be42300-b237-44a0-a14f-dc59bd16f6ef tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:17.412555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2924bd-52cc-4467-8e9a-a43f573690a3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:17.417963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f870c-da39-41dd-9cba-e485e259a6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:17.418673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f870c-da39-41dd-9cba-e485e259a6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:17.418957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f870c-da39-41dd-9cba-e485e259a6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:17.459794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f870c-da39-41dd-9cba-e485e259a6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:17.459794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f870c-da39-41dd-9cba-e485e259a6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:17.459794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f870c-da39-41dd-9cba-e485e259a6f7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:17.459794 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2596/5125] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:17 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:17.459794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f870c-da39-41dd-9cba-e485e259a6f7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:17.459794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0b7f870c-da39-41dd-9cba-e485e259a6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:17.492373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4be42300-b237-44a0-a14f-dc59bd16f6ef tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '151c0663642a4abb90c6e1b3b608176c', 'request_id': 'req-4be42300-b237-44a0-a14f-dc59bd16f6ef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.501856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4be42300-b237-44a0-a14f-dc59bd16f6ef tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '151c0663642a4abb90c6e1b3b608176c', 'request_id': 'req-4be42300-b237-44a0-a14f-dc59bd16f6ef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.504363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f870c-da39-41dd-9cba-e485e259a6f7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:17.511006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4be42300-b237-44a0-a14f-dc59bd16f6ef tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '151c0663642a4abb90c6e1b3b608176c', 'request_id': 'req-4be42300-b237-44a0-a14f-dc59bd16f6ef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.530557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4be42300-b237-44a0-a14f-dc59bd16f6ef tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] The token cache is being invalidate because project 151c0663642a4abb90c6e1b3b608176c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:17.530991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4be42300-b237-44a0-a14f-dc59bd16f6ef tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.531691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4be42300-b237-44a0-a14f-dc59bd16f6ef tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.537233 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2530/5126] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:17 2021] DELETE /identity/v3/projects/151c0663642a4abb90c6e1b3b608176c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:17.537233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da762c-77f5-49fb-bab9-c665e4bbea4f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:17.537233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da762c-77f5-49fb-bab9-c665e4bbea4f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:17.537233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da762c-77f5-49fb-bab9-c665e4bbea4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:17.557173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-19da762c-77f5-49fb-bab9-c665e4bbea4f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:17.558601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-19da762c-77f5-49fb-bab9-c665e4bbea4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:17.580107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b413a6b-6932-4d7f-9aad-fdb9aadeb6c0 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51c57e314524435dad5246396ff42bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:17.580967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413a6b-6932-4d7f-9aad-fdb9aadeb6c0 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:17.581251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413a6b-6932-4d7f-9aad-fdb9aadeb6c0 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:17.581529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413a6b-6932-4d7f-9aad-fdb9aadeb6c0 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] PATH_INFO: `/v3/users/2ab734febf52457e9f8af49285098540` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:17.582834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b413a6b-6932-4d7f-9aad-fdb9aadeb6c0 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2ab734febf52457e9f8af49285098540)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:17.585077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b413a6b-6932-4d7f-9aad-fdb9aadeb6c0 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:17.630496 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2531/5127] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:17.630496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da762c-77f5-49fb-bab9-c665e4bbea4f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:17.632246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-19da762c-77f5-49fb-bab9-c665e4bbea4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:17.634556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9b413a6b-6932-4d7f-9aad-fdb9aadeb6c0 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab734febf52457e9f8af49285098540'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.643392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9b413a6b-6932-4d7f-9aad-fdb9aadeb6c0 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab734febf52457e9f8af49285098540'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.644191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9b413a6b-6932-4d7f-9aad-fdb9aadeb6c0 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab734febf52457e9f8af49285098540'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.646287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da762c-77f5-49fb-bab9-c665e4bbea4f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:17.652757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1986078-817f-4bc4-9927-5d708f7e6c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:17.653424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1986078-817f-4bc4-9927-5d708f7e6c31 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:17.653708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1986078-817f-4bc4-9927-5d708f7e6c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:17.653995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1986078-817f-4bc4-9927-5d708f7e6c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:17.654777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1986078-817f-4bc4-9927-5d708f7e6c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:17.656465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1986078-817f-4bc4-9927-5d708f7e6c31 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:17.658145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9b413a6b-6932-4d7f-9aad-fdb9aadeb6c0 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab734febf52457e9f8af49285098540'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.666133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9b413a6b-6932-4d7f-9aad-fdb9aadeb6c0 tempest-UsersV3TestJSON-704186867 tempest-UsersV3TestJSON-704186867-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab734febf52457e9f8af49285098540'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:17.667441 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2532/5128] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:17 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:17.668226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1986078-817f-4bc4-9927-5d708f7e6c31 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:17.672100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e1986078-817f-4bc4-9927-5d708f7e6c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:17.674444 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2597/5129] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:17 2021] DELETE /identity/v3/users/2ab734febf52457e9f8af49285098540 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:17.681253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6c29f-b8c2-4478-bc8d-dace9a3b188c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:17.681529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6c29f-b8c2-4478-bc8d-dace9a3b188c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:17.681987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6c29f-b8c2-4478-bc8d-dace9a3b188c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:17.703915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9bc6c29f-b8c2-4478-bc8d-dace9a3b188c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:17.705145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9bc6c29f-b8c2-4478-bc8d-dace9a3b188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:17.751318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1986078-817f-4bc4-9927-5d708f7e6c31 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:17.784857 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2598/5130] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:17.785977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6c29f-b8c2-4478-bc8d-dace9a3b188c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:17.787349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9bc6c29f-b8c2-4478-bc8d-dace9a3b188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:17.801466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6c29f-b8c2-4478-bc8d-dace9a3b188c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:17.807352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e81b77-96f6-4739-9f11-4c5230ff82e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:17.808628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e81b77-96f6-4739-9f11-4c5230ff82e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:17.808628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e81b77-96f6-4739-9f11-4c5230ff82e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:17.813475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e81b77-96f6-4739-9f11-4c5230ff82e6 admin admin] PATH_INFO: `/v3/projects/02953ea763ef4ddeb43c836d85986809/users/e18391d5b5ae43d3b9b3cc8d61b27de1/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:17.819714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1f2e4-ea10-4417-8e5f-1d4023381768 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:17.821088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1f2e4-ea10-4417-8e5f-1d4023381768 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:17.821598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1f2e4-ea10-4417-8e5f-1d4023381768 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:17.823311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1f2e4-ea10-4417-8e5f-1d4023381768 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:17.824358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1f2e4-ea10-4417-8e5f-1d4023381768 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:17.827290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1f2e4-ea10-4417-8e5f-1d4023381768 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:17.831916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e81b77-96f6-4739-9f11-4c5230ff82e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02953ea763ef4ddeb43c836d85986809, user_id=e18391d5b5ae43d3b9b3cc8d61b27de1, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:17.835313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e81b77-96f6-4739-9f11-4c5230ff82e6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:17.849901 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2599/5131] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:17 2021] PUT /identity/v3/projects/02953ea763ef4ddeb43c836d85986809/users/e18391d5b5ae43d3b9b3cc8d61b27de1/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:17.851065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e81b77-96f6-4739-9f11-4c5230ff82e6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:17.859707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-46e81b77-96f6-4739-9f11-4c5230ff82e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:17.862660 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2533/5132] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:02:17 2021] POST /identity/v3/projects => generated 347 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:17.863587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1f2e4-ea10-4417-8e5f-1d4023381768 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:17.931813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e81b77-96f6-4739-9f11-4c5230ff82e6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:17.933721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1f2e4-ea10-4417-8e5f-1d4023381768 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:17.938116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c14b0-aef9-47e6-968f-a840c822e161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:17.939053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e408ae5-0499-48f0-811e-929ec04fa84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:17.939474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c14b0-aef9-47e6-968f-a840c822e161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:17.939792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c14b0-aef9-47e6-968f-a840c822e161 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:17.939897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e408ae5-0499-48f0-811e-929ec04fa84b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:17.940072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c14b0-aef9-47e6-968f-a840c822e161 admin admin] PATH_INFO: `/v3/users/a59b243b4d9f4135bce6ef36397e659c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:17.940180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e408ae5-0499-48f0-811e-929ec04fa84b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:17.940351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e408ae5-0499-48f0-811e-929ec04fa84b admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:17.941086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e408ae5-0499-48f0-811e-929ec04fa84b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:17.941638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e408ae5-0499-48f0-811e-929ec04fa84b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:17.943566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e408ae5-0499-48f0-811e-929ec04fa84b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:17.956533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c14b0-aef9-47e6-968f-a840c822e161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a59b243b4d9f4135bce6ef36397e659c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:17.957409 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2534/5133] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:17.958926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c14b0-aef9-47e6-968f-a840c822e161 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:17.959149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8249ef4-4d74-43b1-a707-c19f173ab6e4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:17.959297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8249ef4-4d74-43b1-a707-c19f173ab6e4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:17.959614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8249ef4-4d74-43b1-a707-c19f173ab6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:17.990596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d8249ef4-4d74-43b1-a707-c19f173ab6e4 None None] MFA Rules not processed for user `e18391d5b5ae43d3b9b3cc8d61b27de1`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:17.992449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d8249ef4-4d74-43b1-a707-c19f173ab6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:18.014640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-188c14b0-aef9-47e6-968f-a840c822e161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a59b243b4d9f4135bce6ef36397e659c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:18.022786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-188c14b0-aef9-47e6-968f-a840c822e161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a59b243b4d9f4135bce6ef36397e659c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:18.023648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-188c14b0-aef9-47e6-968f-a840c822e161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a59b243b4d9f4135bce6ef36397e659c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:18.037794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-188c14b0-aef9-47e6-968f-a840c822e161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a59b243b4d9f4135bce6ef36397e659c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:18.046031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-188c14b0-aef9-47e6-968f-a840c822e161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a59b243b4d9f4135bce6ef36397e659c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:18.053067 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2600/5134] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:17 2021] DELETE /identity/v3/users/a59b243b4d9f4135bce6ef36397e659c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:18.053578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c14b0-aef9-47e6-968f-a840c822e161 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:18.054981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-188c14b0-aef9-47e6-968f-a840c822e161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:18.065529 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2535/5135] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:17 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:18.066845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8249ef4-4d74-43b1-a707-c19f173ab6e4 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:18.069107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d8249ef4-4d74-43b1-a707-c19f173ab6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:18.091681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8249ef4-4d74-43b1-a707-c19f173ab6e4 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:18.132024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c14b0-aef9-47e6-968f-a840c822e161 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:18.137638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bc210-a4c7-45e7-bd68-8983a1626eac tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:18.138557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bc210-a4c7-45e7-bd68-8983a1626eac tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:18.138845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bc210-a4c7-45e7-bd68-8983a1626eac tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:18.139126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bc210-a4c7-45e7-bd68-8983a1626eac tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/afc50007e5014856962ed7cf040656c6` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:18.140550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bc210-a4c7-45e7-bd68-8983a1626eac tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:update_project(project_id=afc50007e5014856962ed7cf040656c6)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:18.142884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bc210-a4c7-45e7-bd68-8983a1626eac tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:18.166915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09374eac-29a4-4650-9da2-d5168afc8f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:18.167755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09374eac-29a4-4650-9da2-d5168afc8f8e admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:18.168029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09374eac-29a4-4650-9da2-d5168afc8f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:18.168321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09374eac-29a4-4650-9da2-d5168afc8f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:18.169251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09374eac-29a4-4650-9da2-d5168afc8f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:18.171562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09374eac-29a4-4650-9da2-d5168afc8f8e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:18.184611 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2601/5136] 10.222.0.13 () {60 vars in 1251 bytes} [Sat Dec 18 21:02:18 2021] PATCH /identity/v3/projects/afc50007e5014856962ed7cf040656c6 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:18.186179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf69cc-d5ee-45a1-af73-0e5d6b2eef92 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:18.186555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf69cc-d5ee-45a1-af73-0e5d6b2eef92 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:18.186959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf69cc-d5ee-45a1-af73-0e5d6b2eef92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:18.204601 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2536/5137] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:18 2021] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:18.206363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9dfad-6e49-4ca3-b5ab-39bbf5e38277 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:18.206607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9dfad-6e49-4ca3-b5ab-39bbf5e38277 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:18.206892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9dfad-6e49-4ca3-b5ab-39bbf5e38277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:18.207240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f5bf69cc-d5ee-45a1-af73-0e5d6b2eef92 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:18.208443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f5bf69cc-d5ee-45a1-af73-0e5d6b2eef92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:18.229646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-30c9dfad-6e49-4ca3-b5ab-39bbf5e38277 None None] MFA Rules not processed for user `e18391d5b5ae43d3b9b3cc8d61b27de1`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:18.231124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-30c9dfad-6e49-4ca3-b5ab-39bbf5e38277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:18.277893 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2602/5138] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:18.279392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf69cc-d5ee-45a1-af73-0e5d6b2eef92 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:18.305838 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2537/5139] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:18 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:18.306725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9dfad-6e49-4ca3-b5ab-39bbf5e38277 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:18.328397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9dfad-6e49-4ca3-b5ab-39bbf5e38277 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:18.335899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed819d-3572-47aa-8bdc-87603a15ab00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:18.336631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed819d-3572-47aa-8bdc-87603a15ab00 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:18.336891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed819d-3572-47aa-8bdc-87603a15ab00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:18.337172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed819d-3572-47aa-8bdc-87603a15ab00 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:18.337891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed819d-3572-47aa-8bdc-87603a15ab00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:18.340409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed819d-3572-47aa-8bdc-87603a15ab00 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:18.354692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf69cc-d5ee-45a1-af73-0e5d6b2eef92 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:18.360448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5770e-d384-44bd-a0d0-c39c50be977c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:18.361407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5770e-d384-44bd-a0d0-c39c50be977c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:18.361732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5770e-d384-44bd-a0d0-c39c50be977c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:18.362078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5770e-d384-44bd-a0d0-c39c50be977c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/afc50007e5014856962ed7cf040656c6` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:18.367097 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2538/5140] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:18 2021] POST /identity/v3/users => generated 287 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:18.368965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed819d-3572-47aa-8bdc-87603a15ab00 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:18.371172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7eed819d-3572-47aa-8bdc-87603a15ab00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:18.381518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5770e-d384-44bd-a0d0-c39c50be977c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:get_project(project_id=afc50007e5014856962ed7cf040656c6)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:18.384443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5770e-d384-44bd-a0d0-c39c50be977c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:18.389660 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2603/5141] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:02:18 2021] GET /identity/v3/projects/afc50007e5014856962ed7cf040656c6 => generated 348 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:18.390635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5770e-d384-44bd-a0d0-c39c50be977c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:18.393235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dae5770e-d384-44bd-a0d0-c39c50be977c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:18.442781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed819d-3572-47aa-8bdc-87603a15ab00 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:18.456771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf614ea-7a19-47ac-abd5-05de903eff77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:18.456771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf614ea-7a19-47ac-abd5-05de903eff77 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:18.456771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf614ea-7a19-47ac-abd5-05de903eff77 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:18.456771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf614ea-7a19-47ac-abd5-05de903eff77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:18.460244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf614ea-7a19-47ac-abd5-05de903eff77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:18.461944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf614ea-7a19-47ac-abd5-05de903eff77 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:18.475799 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2539/5142] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:18.478293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf614ea-7a19-47ac-abd5-05de903eff77 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:18.489424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf614ea-7a19-47ac-abd5-05de903eff77 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:18.497230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242e95c-8789-4809-8c2d-d86114fa6396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:18.498145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242e95c-8789-4809-8c2d-d86114fa6396 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:18.498540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242e95c-8789-4809-8c2d-d86114fa6396 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:18.498992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242e95c-8789-4809-8c2d-d86114fa6396 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:18.499725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242e95c-8789-4809-8c2d-d86114fa6396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:18.501480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242e95c-8789-4809-8c2d-d86114fa6396 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:18.504607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5770e-d384-44bd-a0d0-c39c50be977c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:18.512003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6fbaa-6670-42ba-a8ef-5f13320744aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:18.512883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6fbaa-6670-42ba-a8ef-5f13320744aa service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:18.513173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6fbaa-6670-42ba-a8ef-5f13320744aa service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:18.513460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6fbaa-6670-42ba-a8ef-5f13320744aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:18.523067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6fbaa-6670-42ba-a8ef-5f13320744aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:18.523496 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2540/5143] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:18 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:18.524428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242e95c-8789-4809-8c2d-d86114fa6396 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:18.525251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6fbaa-6670-42ba-a8ef-5f13320744aa service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:18.542883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242e95c-8789-4809-8c2d-d86114fa6396 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:18.549726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:18.551250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:18.551760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:18.552042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/afc50007e5014856962ed7cf040656c6` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:18.552233 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2604/5144] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:18 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:18.553708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:delete_project(project_id=afc50007e5014856962ed7cf040656c6)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:18.555488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6fbaa-6670-42ba-a8ef-5f13320744aa service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:18.556534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:18.583803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6fbaa-6670-42ba-a8ef-5f13320744aa service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:18.595508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394997a8-50c2-4440-910a-fec10b551add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:18.596216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394997a8-50c2-4440-910a-fec10b551add admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:18.596568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394997a8-50c2-4440-910a-fec10b551add admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:18.596830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394997a8-50c2-4440-910a-fec10b551add admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:18.597676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394997a8-50c2-4440-910a-fec10b551add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:18.599441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394997a8-50c2-4440-910a-fec10b551add admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:18.614390 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2605/5145] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:18 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:18.616186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394997a8-50c2-4440-910a-fec10b551add admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:18.631842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afc50007e5014856962ed7cf040656c6', 'request_id': 'req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:18.634427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394997a8-50c2-4440-910a-fec10b551add admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:18.642796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afc50007e5014856962ed7cf040656c6', 'request_id': 'req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:18.652315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afc50007e5014856962ed7cf040656c6', 'request_id': 'req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:18.674586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] The token cache is being invalidate because project afc50007e5014856962ed7cf040656c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:18.674889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:18.675631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:18.682815 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2541/5146] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:18 2021] DELETE /identity/v3/projects/afc50007e5014856962ed7cf040656c6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:18.684356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:18.686984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:18.796223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174552d-2b6d-456a-a620-29767678622f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:18.796586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa9bd4-b932-4f71-b7ea-d7e57a36da11 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:18.800573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174552d-2b6d-456a-a620-29767678622f admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:18.801227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174552d-2b6d-456a-a620-29767678622f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:18.801628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174552d-2b6d-456a-a620-29767678622f admin admin] PATH_INFO: `/v3/projects/195b0b52a15b4bac829f1543bb876b46/users/e63ad434a9804dc1b373c123a0169edb/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:18.802584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311239f-e184-48a1-8fab-1bdd261b7ff8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:18.803271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311239f-e184-48a1-8fab-1bdd261b7ff8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:18.803611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311239f-e184-48a1-8fab-1bdd261b7ff8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:18.803896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311239f-e184-48a1-8fab-1bdd261b7ff8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:18.804612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311239f-e184-48a1-8fab-1bdd261b7ff8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:18.808982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311239f-e184-48a1-8fab-1bdd261b7ff8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:18.848239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174552d-2b6d-456a-a620-29767678622f admin admin] RBAC: Authorizing `identity:create_grant(project_id=195b0b52a15b4bac829f1543bb876b46, user_id=e63ad434a9804dc1b373c123a0169edb, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:18.854880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174552d-2b6d-456a-a620-29767678622f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:18.878064 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2542/5147] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:18 2021] POST /identity/v3/projects => generated 360 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:18.884084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311239f-e184-48a1-8fab-1bdd261b7ff8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:18.884598 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2606/5148] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:18 2021] PUT /identity/v3/projects/195b0b52a15b4bac829f1543bb876b46/users/e63ad434a9804dc1b373c123a0169edb/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:18.898866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c721dd6-c571-48b0-9160-c99e36fd1058 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:18.899815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c721dd6-c571-48b0-9160-c99e36fd1058 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:18.900206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c721dd6-c571-48b0-9160-c99e36fd1058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:18.937895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5c721dd6-c571-48b0-9160-c99e36fd1058 None None] MFA Rules not processed for user `e63ad434a9804dc1b373c123a0169edb`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:18.939579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5c721dd6-c571-48b0-9160-c99e36fd1058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:18.973714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311239f-e184-48a1-8fab-1bdd261b7ff8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:18.988549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fa4cf-df1d-4c26-9b88-0b1568ada11c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:18.989763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fa4cf-df1d-4c26-9b88-0b1568ada11c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:18.990158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fa4cf-df1d-4c26-9b88-0b1568ada11c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:18.990689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fa4cf-df1d-4c26-9b88-0b1568ada11c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/e582a70b414547e5b731376f480f221b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:18.992245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fa4cf-df1d-4c26-9b88-0b1568ada11c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:update_project(project_id=e582a70b414547e5b731376f480f221b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:18.995040 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-584fa4cf-df1d-4c26-9b88-0b1568ada11c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:02:18.995040 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:02:18.995040 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:02:18.996606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fa4cf-df1d-4c26-9b88-0b1568ada11c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:19.070986 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2607/5149] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:18 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:19.070986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c721dd6-c571-48b0-9160-c99e36fd1058 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:19.070986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5c721dd6-c571-48b0-9160-c99e36fd1058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:19.096857 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2543/5150] 10.222.0.13 () {60 vars in 1251 bytes} [Sat Dec 18 21:02:18 2021] PATCH /identity/v3/projects/e582a70b414547e5b731376f480f221b => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:19.096857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fa4cf-df1d-4c26-9b88-0b1568ada11c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:19.116803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fa4cf-df1d-4c26-9b88-0b1568ada11c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:19.123641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8560a8-0b15-4619-a73f-caf268325099 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63ad434a9804dc1b373c123a0169edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195b0b52a15b4bac829f1543bb876b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:19.125033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8560a8-0b15-4619-a73f-caf268325099 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:19.126134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8560a8-0b15-4619-a73f-caf268325099 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:19.127704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8560a8-0b15-4619-a73f-caf268325099 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] PATH_INFO: `/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:19.129186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8560a8-0b15-4619-a73f-caf268325099 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e63ad434a9804dc1b373c123a0169edb)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:19.130936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8560a8-0b15-4619-a73f-caf268325099 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:19.168282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c721dd6-c571-48b0-9160-c99e36fd1058 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:19.172536 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2544/5151] 10.222.0.13 () {60 vars in 1298 bytes} [Sat Dec 18 21:02:19 2021] POST /identity/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2 => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:19.173297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dde96-8676-43af-a597-dd85b3669efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:19.174150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dde96-8676-43af-a597-dd85b3669efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:19.174451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8560a8-0b15-4619-a73f-caf268325099 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:19.174570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dde96-8676-43af-a597-dd85b3669efe admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:19.174759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dde96-8676-43af-a597-dd85b3669efe admin admin] PATH_INFO: `/v3/projects/358ba499e00e409fa196e710568f3d96` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:19.176747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253dde96-8676-43af-a597-dd85b3669efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=358ba499e00e409fa196e710568f3d96)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:19.178721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253dde96-8676-43af-a597-dd85b3669efe admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:19.195867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8560a8-0b15-4619-a73f-caf268325099 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:19.208749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90362efb-5632-4846-9216-6afaa7e6043e tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:19.210686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90362efb-5632-4846-9216-6afaa7e6043e tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:19.210832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90362efb-5632-4846-9216-6afaa7e6043e tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:19.211147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90362efb-5632-4846-9216-6afaa7e6043e tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/e582a70b414547e5b731376f480f221b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:19.241093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253dde96-8676-43af-a597-dd85b3669efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358ba499e00e409fa196e710568f3d96', 'request_id': 'req-253dde96-8676-43af-a597-dd85b3669efe'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:19.250758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253dde96-8676-43af-a597-dd85b3669efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358ba499e00e409fa196e710568f3d96', 'request_id': 'req-253dde96-8676-43af-a597-dd85b3669efe'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:19.253377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90362efb-5632-4846-9216-6afaa7e6043e tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:get_project(project_id=e582a70b414547e5b731376f480f221b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:19.257399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90362efb-5632-4846-9216-6afaa7e6043e tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:19.262510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253dde96-8676-43af-a597-dd85b3669efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358ba499e00e409fa196e710568f3d96', 'request_id': 'req-253dde96-8676-43af-a597-dd85b3669efe'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:19.264015 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2545/5152] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:02:19 2021] GET /identity/v3/projects/e582a70b414547e5b731376f480f221b => generated 359 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:19.264346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90362efb-5632-4846-9216-6afaa7e6043e tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:19.282391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253dde96-8676-43af-a597-dd85b3669efe admin admin] The token cache is being invalidate because project 358ba499e00e409fa196e710568f3d96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:19.283003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253dde96-8676-43af-a597-dd85b3669efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:19.283486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253dde96-8676-43af-a597-dd85b3669efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:19.285560 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2608/5153] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:19 2021] DELETE /identity/v3/projects/358ba499e00e409fa196e710568f3d96 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:19.287232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dde96-8676-43af-a597-dd85b3669efe admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:19.289586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90362efb-5632-4846-9216-6afaa7e6043e tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:19.290791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-253dde96-8676-43af-a597-dd85b3669efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:19.381815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dde96-8676-43af-a597-dd85b3669efe admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:19.387973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd613d-2c03-4a6d-a7e9-b821c8ae05e5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63ad434a9804dc1b373c123a0169edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195b0b52a15b4bac829f1543bb876b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:19.388200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324fcfd-6556-4b97-b538-3bde8bc64f22 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:19.389091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324fcfd-6556-4b97-b538-3bde8bc64f22 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:19.389401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324fcfd-6556-4b97-b538-3bde8bc64f22 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:19.389534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd613d-2c03-4a6d-a7e9-b821c8ae05e5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:19.389645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324fcfd-6556-4b97-b538-3bde8bc64f22 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/e582a70b414547e5b731376f480f221b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:19.390022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd613d-2c03-4a6d-a7e9-b821c8ae05e5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:19.391098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd613d-2c03-4a6d-a7e9-b821c8ae05e5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] PATH_INFO: `/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2/c08f2f8f1c2545958abc5cdcaf60e561` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:19.391260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324fcfd-6556-4b97-b538-3bde8bc64f22 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e582a70b414547e5b731376f480f221b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:19.393411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324fcfd-6556-4b97-b538-3bde8bc64f22 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:19.393937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd613d-2c03-4a6d-a7e9-b821c8ae05e5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e63ad434a9804dc1b373c123a0169edb, credential_id=c08f2f8f1c2545958abc5cdcaf60e561)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:19.395484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd613d-2c03-4a6d-a7e9-b821c8ae05e5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:19.434673 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2546/5154] 10.222.0.13 () {58 vars in 1379 bytes} [Sat Dec 18 21:02:19 2021] DELETE /identity/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2/c08f2f8f1c2545958abc5cdcaf60e561 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:19.435750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd613d-2c03-4a6d-a7e9-b821c8ae05e5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:19.438818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-06fd613d-2c03-4a6d-a7e9-b821c8ae05e5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:19.456451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b324fcfd-6556-4b97-b538-3bde8bc64f22 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e582a70b414547e5b731376f480f221b', 'request_id': 'req-b324fcfd-6556-4b97-b538-3bde8bc64f22'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:19.465089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b324fcfd-6556-4b97-b538-3bde8bc64f22 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e582a70b414547e5b731376f480f221b', 'request_id': 'req-b324fcfd-6556-4b97-b538-3bde8bc64f22'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:19.485459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b324fcfd-6556-4b97-b538-3bde8bc64f22 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e582a70b414547e5b731376f480f221b', 'request_id': 'req-b324fcfd-6556-4b97-b538-3bde8bc64f22'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:19.503614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b324fcfd-6556-4b97-b538-3bde8bc64f22 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] The token cache is being invalidate because project e582a70b414547e5b731376f480f221b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:19.504114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b324fcfd-6556-4b97-b538-3bde8bc64f22 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:19.505213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b324fcfd-6556-4b97-b538-3bde8bc64f22 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:19.508100 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2609/5155] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:19 2021] DELETE /identity/v3/projects/e582a70b414547e5b731376f480f221b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:19.508909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324fcfd-6556-4b97-b538-3bde8bc64f22 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:19.510558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b324fcfd-6556-4b97-b538-3bde8bc64f22 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:19.537569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd613d-2c03-4a6d-a7e9-b821c8ae05e5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:19.594987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324fcfd-6556-4b97-b538-3bde8bc64f22 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:19.600601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b01d62-ba93-4073-8a05-c777cfa26641 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63ad434a9804dc1b373c123a0169edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195b0b52a15b4bac829f1543bb876b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:19.600601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b01d62-ba93-4073-8a05-c777cfa26641 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:19.600601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b01d62-ba93-4073-8a05-c777cfa26641 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:19.600997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b01d62-ba93-4073-8a05-c777cfa26641 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] PATH_INFO: `/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:19.601416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b01d62-ba93-4073-8a05-c777cfa26641 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e63ad434a9804dc1b373c123a0169edb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:19.604500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b01d62-ba93-4073-8a05-c777cfa26641 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:19.620476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450be00-5b1f-4792-937f-33e6ddaf1147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:19.621972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450be00-5b1f-4792-937f-33e6ddaf1147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:19.622527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450be00-5b1f-4792-937f-33e6ddaf1147 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:19.623799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450be00-5b1f-4792-937f-33e6ddaf1147 admin admin] PATH_INFO: `/v3/users/51c57e314524435dad5246396ff42bd3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:19.625884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450be00-5b1f-4792-937f-33e6ddaf1147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51c57e314524435dad5246396ff42bd3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:19.627873 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2610/5156] 10.222.0.13 () {60 vars in 1298 bytes} [Sat Dec 18 21:02:19 2021] POST /identity/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2 => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:19.628852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b01d62-ba93-4073-8a05-c777cfa26641 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:19.629780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450be00-5b1f-4792-937f-33e6ddaf1147 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:19.630900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-99b01d62-ba93-4073-8a05-c777cfa26641 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:19.700988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3450be00-5b1f-4792-937f-33e6ddaf1147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51c57e314524435dad5246396ff42bd3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:19.708349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3450be00-5b1f-4792-937f-33e6ddaf1147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51c57e314524435dad5246396ff42bd3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:19.724645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b01d62-ba93-4073-8a05-c777cfa26641 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:19.731116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3450be00-5b1f-4792-937f-33e6ddaf1147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51c57e314524435dad5246396ff42bd3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:19.731837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3450be00-5b1f-4792-937f-33e6ddaf1147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51c57e314524435dad5246396ff42bd3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:19.733061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895c605-d63f-4cf4-bb50-32f8a8e66be4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:19.734724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895c605-d63f-4cf4-bb50-32f8a8e66be4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:19.735056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895c605-d63f-4cf4-bb50-32f8a8e66be4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:19.735369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895c605-d63f-4cf4-bb50-32f8a8e66be4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:19.736177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895c605-d63f-4cf4-bb50-32f8a8e66be4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:19.739002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895c605-d63f-4cf4-bb50-32f8a8e66be4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:19.748183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3450be00-5b1f-4792-937f-33e6ddaf1147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51c57e314524435dad5246396ff42bd3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:19.759449 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2547/5157] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:19 2021] DELETE /identity/v3/users/51c57e314524435dad5246396ff42bd3 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:19.759449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450be00-5b1f-4792-937f-33e6ddaf1147 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:19.759748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3450be00-5b1f-4792-937f-33e6ddaf1147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:19.801080 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2611/5158] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:19 2021] POST /identity/v3/projects => generated 353 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:19.802407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895c605-d63f-4cf4-bb50-32f8a8e66be4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:19.806127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2895c605-d63f-4cf4-bb50-32f8a8e66be4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:19.899628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450be00-5b1f-4792-937f-33e6ddaf1147 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:19.909705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895c605-d63f-4cf4-bb50-32f8a8e66be4 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:19.916096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa04803-1d97-4638-8bca-35b0d46e00a8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:19.916992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa04803-1d97-4638-8bca-35b0d46e00a8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:19.917281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa04803-1d97-4638-8bca-35b0d46e00a8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:19.917879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa04803-1d97-4638-8bca-35b0d46e00a8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/6cb32868de9d4f5fb653434c68965df4` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:19.919205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa04803-1d97-4638-8bca-35b0d46e00a8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:update_project(project_id=6cb32868de9d4f5fb653434c68965df4)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:19.921524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa04803-1d97-4638-8bca-35b0d46e00a8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:19.968631 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2612/5159] 10.222.0.13 () {60 vars in 1251 bytes} [Sat Dec 18 21:02:19 2021] PATCH /identity/v3/projects/6cb32868de9d4f5fb653434c68965df4 => generated 366 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:19.977669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa04803-1d97-4638-8bca-35b0d46e00a8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:19.983187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a029b9-15fb-408a-be60-6e46b026fb4a tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63ad434a9804dc1b373c123a0169edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195b0b52a15b4bac829f1543bb876b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:19.984300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a029b9-15fb-408a-be60-6e46b026fb4a tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:19.984588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a029b9-15fb-408a-be60-6e46b026fb4a tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:19.984927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a029b9-15fb-408a-be60-6e46b026fb4a tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] PATH_INFO: `/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2/1f59c0d2be12487881a54b01acef9151` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:19.987051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a029b9-15fb-408a-be60-6e46b026fb4a tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e63ad434a9804dc1b373c123a0169edb, credential_id=1f59c0d2be12487881a54b01acef9151)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:19.989419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a029b9-15fb-408a-be60-6e46b026fb4a tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:19.990025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa04803-1d97-4638-8bca-35b0d46e00a8 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:20.003742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae6651-acec-49af-b3b8-ccc9f65b662a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:20.006497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae6651-acec-49af-b3b8-ccc9f65b662a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.006984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae6651-acec-49af-b3b8-ccc9f65b662a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.007285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae6651-acec-49af-b3b8-ccc9f65b662a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/6cb32868de9d4f5fb653434c68965df4` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.009627 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2548/5160] 10.222.0.13 () {58 vars in 1379 bytes} [Sat Dec 18 21:02:19 2021] DELETE /identity/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2/1f59c0d2be12487881a54b01acef9151 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:20.014165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a029b9-15fb-408a-be60-6e46b026fb4a tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:20.024289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae6651-acec-49af-b3b8-ccc9f65b662a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:get_project(project_id=6cb32868de9d4f5fb653434c68965df4)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:20.027780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae6651-acec-49af-b3b8-ccc9f65b662a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:20.029157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a029b9-15fb-408a-be60-6e46b026fb4a tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:20.033645 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2613/5161] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:02:19 2021] GET /identity/v3/projects/6cb32868de9d4f5fb653434c68965df4 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:02:20.034872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae6651-acec-49af-b3b8-ccc9f65b662a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:20.035704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f25e10-024d-4bdd-af05-26f91e7b9f00 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63ad434a9804dc1b373c123a0169edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195b0b52a15b4bac829f1543bb876b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:20.036877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f25e10-024d-4bdd-af05-26f91e7b9f00 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.037439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f25e10-024d-4bdd-af05-26f91e7b9f00 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.037983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f25e10-024d-4bdd-af05-26f91e7b9f00 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] PATH_INFO: `/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2/1f59c0d2be12487881a54b01acef9151` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.047522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae6651-acec-49af-b3b8-ccc9f65b662a tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:20.061610 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-b7f25e10-024d-4bdd-af05-26f91e7b9f00 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Could not find credential: 2d4b9be57b5e816dec8ff66e9ad7dccd2ddd8f77c97cab07ba0c7275b1ace95c.: keystone.exception.CredentialNotFound: Could not find credential: 2d4b9be57b5e816dec8ff66e9ad7dccd2ddd8f77c97cab07ba0c7275b1ace95c. Dec 18 21:02:20.062088 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2549/5162] 10.222.0.13 () {58 vars in 1376 bytes} [Sat Dec 18 21:02:20 2021] GET /identity/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2/1f59c0d2be12487881a54b01acef9151 => generated 148 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 18 21:02:20.067547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f25e10-024d-4bdd-af05-26f91e7b9f00 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:20.073464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c064b22-0840-45d0-a00b-1e2c093b4cb3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:20.074318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c064b22-0840-45d0-a00b-1e2c093b4cb3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.074639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c064b22-0840-45d0-a00b-1e2c093b4cb3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.077134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c064b22-0840-45d0-a00b-1e2c093b4cb3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/projects/6cb32868de9d4f5fb653434c68965df4` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.078739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f25e10-024d-4bdd-af05-26f91e7b9f00 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:20.081206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c064b22-0840-45d0-a00b-1e2c093b4cb3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6cb32868de9d4f5fb653434c68965df4)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:20.084011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fbc59-2cbe-47b9-aae4-c8130677e152 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63ad434a9804dc1b373c123a0169edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195b0b52a15b4bac829f1543bb876b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:20.084846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fbc59-2cbe-47b9-aae4-c8130677e152 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.085135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fbc59-2cbe-47b9-aae4-c8130677e152 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.085419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fbc59-2cbe-47b9-aae4-c8130677e152 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] PATH_INFO: `/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.086578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fbc59-2cbe-47b9-aae4-c8130677e152 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e63ad434a9804dc1b373c123a0169edb)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:20.086774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c064b22-0840-45d0-a00b-1e2c093b4cb3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:20.088721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fbc59-2cbe-47b9-aae4-c8130677e152 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:20.116754 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2550/5163] 10.222.0.13 () {60 vars in 1298 bytes} [Sat Dec 18 21:02:20 2021] POST /identity/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2 => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:20.118162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fbc59-2cbe-47b9-aae4-c8130677e152 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:20.137769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fbc59-2cbe-47b9-aae4-c8130677e152 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:20.143164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee98cf0-90cf-43d5-958f-f42954397aef tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63ad434a9804dc1b373c123a0169edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195b0b52a15b4bac829f1543bb876b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:20.144249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee98cf0-90cf-43d5-958f-f42954397aef tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.144566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee98cf0-90cf-43d5-958f-f42954397aef tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.144856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee98cf0-90cf-43d5-958f-f42954397aef tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] PATH_INFO: `/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.145725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee98cf0-90cf-43d5-958f-f42954397aef tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e63ad434a9804dc1b373c123a0169edb)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:20.147590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee98cf0-90cf-43d5-958f-f42954397aef tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:20.173961 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2551/5164] 10.222.0.13 () {60 vars in 1298 bytes} [Sat Dec 18 21:02:20 2021] POST /identity/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2 => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:20.175919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee98cf0-90cf-43d5-958f-f42954397aef tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:20.191857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee98cf0-90cf-43d5-958f-f42954397aef tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:20.195241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2c064b22-0840-45d0-a00b-1e2c093b4cb3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb32868de9d4f5fb653434c68965df4', 'request_id': 'req-2c064b22-0840-45d0-a00b-1e2c093b4cb3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:20.204121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2c064b22-0840-45d0-a00b-1e2c093b4cb3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb32868de9d4f5fb653434c68965df4', 'request_id': 'req-2c064b22-0840-45d0-a00b-1e2c093b4cb3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:20.217442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2c064b22-0840-45d0-a00b-1e2c093b4cb3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb32868de9d4f5fb653434c68965df4', 'request_id': 'req-2c064b22-0840-45d0-a00b-1e2c093b4cb3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:20.232724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2c064b22-0840-45d0-a00b-1e2c093b4cb3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] The token cache is being invalidate because project 6cb32868de9d4f5fb653434c68965df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:20.233653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2c064b22-0840-45d0-a00b-1e2c093b4cb3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:20.234141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2c064b22-0840-45d0-a00b-1e2c093b4cb3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:20.236632 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2614/5165] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:20 2021] DELETE /identity/v3/projects/6cb32868de9d4f5fb653434c68965df4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:20.242276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c064b22-0840-45d0-a00b-1e2c093b4cb3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:20.246101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2c064b22-0840-45d0-a00b-1e2c093b4cb3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:20.305096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00528957-48a5-49fc-95a2-e6a7887e06c3 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63ad434a9804dc1b373c123a0169edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195b0b52a15b4bac829f1543bb876b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:20.305947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00528957-48a5-49fc-95a2-e6a7887e06c3 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.306481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00528957-48a5-49fc-95a2-e6a7887e06c3 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.307302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00528957-48a5-49fc-95a2-e6a7887e06c3 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] PATH_INFO: `/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.308910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00528957-48a5-49fc-95a2-e6a7887e06c3 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=e63ad434a9804dc1b373c123a0169edb)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:20.312041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00528957-48a5-49fc-95a2-e6a7887e06c3 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:20.327545 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2552/5166] 10.222.0.13 () {58 vars in 1277 bytes} [Sat Dec 18 21:02:20 2021] GET /identity/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2 => generated 865 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:02:20.328717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00528957-48a5-49fc-95a2-e6a7887e06c3 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:20.334781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-00528957-48a5-49fc-95a2-e6a7887e06c3 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:20.379146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c064b22-0840-45d0-a00b-1e2c093b4cb3 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:20.387120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e693769-3cdb-4c40-95a2-52472a004e9c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:20.388573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e693769-3cdb-4c40-95a2-52472a004e9c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.388920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e693769-3cdb-4c40-95a2-52472a004e9c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.389186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e693769-3cdb-4c40-95a2-52472a004e9c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/domains/3d02eeb3af934e5ab42b35f509effebf` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.399752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e693769-3cdb-4c40-95a2-52472a004e9c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:02:20.410971 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-4e693769-3cdb-4c40-95a2-52472a004e9c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Could not find domain: 3d02eeb3af934e5ab42b35f509effebf.: keystone.exception.DomainNotFound: Could not find domain: 3d02eeb3af934e5ab42b35f509effebf. Dec 18 21:02:20.412878 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2615/5167] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:02:20 2021] PATCH /identity/v3/domains/3d02eeb3af934e5ab42b35f509effebf => generated 112 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:02:20.414658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e693769-3cdb-4c40-95a2-52472a004e9c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:20.417086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4e693769-3cdb-4c40-95a2-52472a004e9c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:20.434394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e693769-3cdb-4c40-95a2-52472a004e9c tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:20.439209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c33258-923e-4741-b3fd-b90bd956bed5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63ad434a9804dc1b373c123a0169edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195b0b52a15b4bac829f1543bb876b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:20.440173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c33258-923e-4741-b3fd-b90bd956bed5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.440434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c33258-923e-4741-b3fd-b90bd956bed5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.440718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c33258-923e-4741-b3fd-b90bd956bed5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] PATH_INFO: `/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2/18dd3bd4662e4bebb3e1380638708182` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.443376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c33258-923e-4741-b3fd-b90bd956bed5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e63ad434a9804dc1b373c123a0169edb, credential_id=18dd3bd4662e4bebb3e1380638708182)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:20.445038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c33258-923e-4741-b3fd-b90bd956bed5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:20.454376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00528957-48a5-49fc-95a2-e6a7887e06c3 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:20.462644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfad2e0-6bb0-491e-8700-b289a4f6560e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:20.466515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfad2e0-6bb0-491e-8700-b289a4f6560e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.466978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfad2e0-6bb0-491e-8700-b289a4f6560e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.467388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfad2e0-6bb0-491e-8700-b289a4f6560e admin admin] PATH_INFO: `/v3/projects/d6e7bb71b6174bfa8e06dcdea524dcc1` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.471195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfad2e0-6bb0-491e-8700-b289a4f6560e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e7bb71b6174bfa8e06dcdea524dcc1)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:20.472480 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2616/5168] 10.222.0.13 () {58 vars in 1379 bytes} [Sat Dec 18 21:02:20 2021] DELETE /identity/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2/18dd3bd4662e4bebb3e1380638708182 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:20.473565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfad2e0-6bb0-491e-8700-b289a4f6560e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:20.475326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c33258-923e-4741-b3fd-b90bd956bed5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:20.493147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c33258-923e-4741-b3fd-b90bd956bed5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:20.501297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fd69a-abef-4311-8e48-3e748e46d0d2 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae93cbf74f147dfaf55cfe61afe3a27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924633b7f6f84c40a8a80a39af8a8b5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:20.501297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fd69a-abef-4311-8e48-3e748e46d0d2 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.501297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fd69a-abef-4311-8e48-3e748e46d0d2 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.501723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fd69a-abef-4311-8e48-3e748e46d0d2 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] PATH_INFO: `/v3/domains/29236d26ed7f441eabe2dc49c0cbc652` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.508974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fd69a-abef-4311-8e48-3e748e46d0d2 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:02:20.518926 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-016fd69a-abef-4311-8e48-3e748e46d0d2 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Could not find domain: 29236d26ed7f441eabe2dc49c0cbc652.: keystone.exception.DomainNotFound: Could not find domain: 29236d26ed7f441eabe2dc49c0cbc652. Dec 18 21:02:20.521004 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2617/5169] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:02:20 2021] PATCH /identity/v3/domains/29236d26ed7f441eabe2dc49c0cbc652 => generated 112 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:02:20.522294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fd69a-abef-4311-8e48-3e748e46d0d2 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:20.535085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fd69a-abef-4311-8e48-3e748e46d0d2 tempest-ProjectsTestJSON-1553718244 tempest-ProjectsTestJSON-1553718244-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:20.542542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fc16a-b180-485f-8f2d-f5075729d9f5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63ad434a9804dc1b373c123a0169edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195b0b52a15b4bac829f1543bb876b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:20.543673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fc16a-b180-485f-8f2d-f5075729d9f5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.543980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fc16a-b180-485f-8f2d-f5075729d9f5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.544249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fc16a-b180-485f-8f2d-f5075729d9f5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] PATH_INFO: `/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2/cc0f62f79b844c4c9b0bb20bbd0f84c5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.546960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fc16a-b180-485f-8f2d-f5075729d9f5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e63ad434a9804dc1b373c123a0169edb, credential_id=cc0f62f79b844c4c9b0bb20bbd0f84c5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:20.548525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fc16a-b180-485f-8f2d-f5075729d9f5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:20.554933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7cfad2e0-6bb0-491e-8700-b289a4f6560e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'request_id': 'req-7cfad2e0-6bb0-491e-8700-b289a4f6560e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:20.566823 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7cfad2e0-6bb0-491e-8700-b289a4f6560e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'request_id': 'req-7cfad2e0-6bb0-491e-8700-b289a4f6560e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:20.569027 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2618/5170] 10.222.0.13 () {58 vars in 1379 bytes} [Sat Dec 18 21:02:20 2021] DELETE /identity/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2/cc0f62f79b844c4c9b0bb20bbd0f84c5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:20.569666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fc16a-b180-485f-8f2d-f5075729d9f5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:20.574683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e65fc16a-b180-485f-8f2d-f5075729d9f5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:20.575994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7cfad2e0-6bb0-491e-8700-b289a4f6560e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e7bb71b6174bfa8e06dcdea524dcc1', 'request_id': 'req-7cfad2e0-6bb0-491e-8700-b289a4f6560e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:20.592280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7cfad2e0-6bb0-491e-8700-b289a4f6560e admin admin] The token cache is being invalidate because project d6e7bb71b6174bfa8e06dcdea524dcc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:20.592583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7cfad2e0-6bb0-491e-8700-b289a4f6560e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:20.594041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7cfad2e0-6bb0-491e-8700-b289a4f6560e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:20.596197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fc16a-b180-485f-8f2d-f5075729d9f5 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:20.596356 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2553/5171] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:20 2021] DELETE /identity/v3/projects/d6e7bb71b6174bfa8e06dcdea524dcc1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:20.604002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfad2e0-6bb0-491e-8700-b289a4f6560e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:20.604002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7cfad2e0-6bb0-491e-8700-b289a4f6560e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:20.678345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfad2e0-6bb0-491e-8700-b289a4f6560e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:20.678704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c19830-4761-41e2-a31e-ee6984dc074f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:20.679560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c19830-4761-41e2-a31e-ee6984dc074f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.680042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c19830-4761-41e2-a31e-ee6984dc074f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.680348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c19830-4761-41e2-a31e-ee6984dc074f admin admin] PATH_INFO: `/v3/users/5dd93e6860634baa9245392f37d93f4e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.682092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c19830-4761-41e2-a31e-ee6984dc074f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd93e6860634baa9245392f37d93f4e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:20.683956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f21cbc-436e-4951-9a5c-a51a5609d29d tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63ad434a9804dc1b373c123a0169edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195b0b52a15b4bac829f1543bb876b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:20.684854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f21cbc-436e-4951-9a5c-a51a5609d29d tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.684982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c19830-4761-41e2-a31e-ee6984dc074f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:20.685260 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f21cbc-436e-4951-9a5c-a51a5609d29d tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.685737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f21cbc-436e-4951-9a5c-a51a5609d29d tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] PATH_INFO: `/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.686641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f21cbc-436e-4951-9a5c-a51a5609d29d tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e63ad434a9804dc1b373c123a0169edb)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:20.688271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f21cbc-436e-4951-9a5c-a51a5609d29d tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:20.709813 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2554/5172] 10.222.0.13 () {60 vars in 1298 bytes} [Sat Dec 18 21:02:20 2021] POST /identity/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2 => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:20.711234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba212de-04eb-4be7-8c62-f7e0162b518c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.711554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba212de-04eb-4be7-8c62-f7e0162b518c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.711849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba212de-04eb-4be7-8c62-f7e0162b518c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.735042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0ba212de-04eb-4be7-8c62-f7e0162b518c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:20.736984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0ba212de-04eb-4be7-8c62-f7e0162b518c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:20.749180 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2555/5173] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:20.750225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba212de-04eb-4be7-8c62-f7e0162b518c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:20.762502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba212de-04eb-4be7-8c62-f7e0162b518c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:20.765008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-09c19830-4761-41e2-a31e-ee6984dc074f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd93e6860634baa9245392f37d93f4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:20.768175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0807ff-6e85-4af5-9707-c850ab061b6e tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63ad434a9804dc1b373c123a0169edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195b0b52a15b4bac829f1543bb876b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:20.768797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0807ff-6e85-4af5-9707-c850ab061b6e tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.769088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0807ff-6e85-4af5-9707-c850ab061b6e tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.769366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0807ff-6e85-4af5-9707-c850ab061b6e tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] PATH_INFO: `/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2/e9af349d5f394d2f90eaee30bfac66b1` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.771548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0807ff-6e85-4af5-9707-c850ab061b6e tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=e63ad434a9804dc1b373c123a0169edb, credential_id=e9af349d5f394d2f90eaee30bfac66b1)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:20.773078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0807ff-6e85-4af5-9707-c850ab061b6e tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:20.776765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-09c19830-4761-41e2-a31e-ee6984dc074f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd93e6860634baa9245392f37d93f4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:20.776925 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2556/5174] 10.222.0.13 () {58 vars in 1376 bytes} [Sat Dec 18 21:02:20 2021] GET /identity/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2/e9af349d5f394d2f90eaee30bfac66b1 => generated 367 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:20.778065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-09c19830-4761-41e2-a31e-ee6984dc074f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd93e6860634baa9245392f37d93f4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:20.778397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77376ea-8c19-42c5-a0ce-25217162c5e6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.778717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77376ea-8c19-42c5-a0ce-25217162c5e6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.778997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77376ea-8c19-42c5-a0ce-25217162c5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.796474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-09c19830-4761-41e2-a31e-ee6984dc074f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd93e6860634baa9245392f37d93f4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:20.800928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b77376ea-8c19-42c5-a0ce-25217162c5e6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:20.802340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b77376ea-8c19-42c5-a0ce-25217162c5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:20.808590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-09c19830-4761-41e2-a31e-ee6984dc074f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd93e6860634baa9245392f37d93f4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:20.815625 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2557/5175] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:20.816824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77376ea-8c19-42c5-a0ce-25217162c5e6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:20.817040 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2619/5176] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:20 2021] DELETE /identity/v3/users/5dd93e6860634baa9245392f37d93f4e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:20.823627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3988601-e758-4116-b023-2f6f2016b837 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.824171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3988601-e758-4116-b023-2f6f2016b837 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.824764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3988601-e758-4116-b023-2f6f2016b837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.828890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77376ea-8c19-42c5-a0ce-25217162c5e6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:20.850840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e3988601-e758-4116-b023-2f6f2016b837 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:20.852453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e3988601-e758-4116-b023-2f6f2016b837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:20.896774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02262800-e8e9-4c80-95c0-3f96f6612451 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63ad434a9804dc1b373c123a0169edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195b0b52a15b4bac829f1543bb876b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:20.897988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02262800-e8e9-4c80-95c0-3f96f6612451 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.898413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02262800-e8e9-4c80-95c0-3f96f6612451 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.898803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02262800-e8e9-4c80-95c0-3f96f6612451 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] PATH_INFO: `/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2/e9af349d5f394d2f90eaee30bfac66b1` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.903901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02262800-e8e9-4c80-95c0-3f96f6612451 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e63ad434a9804dc1b373c123a0169edb, credential_id=e9af349d5f394d2f90eaee30bfac66b1)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:20.905884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02262800-e8e9-4c80-95c0-3f96f6612451 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:20.934339 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2558/5177] 10.222.0.13 () {58 vars in 1379 bytes} [Sat Dec 18 21:02:20 2021] DELETE /identity/v3/users/e63ad434a9804dc1b373c123a0169edb/credentials/OS-EC2/e9af349d5f394d2f90eaee30bfac66b1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:20.937609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02262800-e8e9-4c80-95c0-3f96f6612451 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:20.940929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-02262800-e8e9-4c80-95c0-3f96f6612451 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:20.944409 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2620/5178] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:20.945268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3988601-e758-4116-b023-2f6f2016b837 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:20.946574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e3988601-e758-4116-b023-2f6f2016b837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:20.958469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02262800-e8e9-4c80-95c0-3f96f6612451 tempest-EC2CredentialsTest-1719161615 tempest-EC2CredentialsTest-1719161615-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:20.965353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356aec5d-523b-4db9-9506-e7524b75b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:20.965573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3988601-e758-4116-b023-2f6f2016b837 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:20.965964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aec5d-523b-4db9-9506-e7524b75b372 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.966280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aec5d-523b-4db9-9506-e7524b75b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.966550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aec5d-523b-4db9-9506-e7524b75b372 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.967304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356aec5d-523b-4db9-9506-e7524b75b372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:20.967650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356aec5d-523b-4db9-9506-e7524b75b372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:20.969372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356aec5d-523b-4db9-9506-e7524b75b372 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:20.971247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e4c4b-67cb-46d7-ad37-a43c0fbc9775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:20.972174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e4c4b-67cb-46d7-ad37-a43c0fbc9775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:20.973044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e4c4b-67cb-46d7-ad37-a43c0fbc9775 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:20.973044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e4c4b-67cb-46d7-ad37-a43c0fbc9775 admin admin] PATH_INFO: `/v3/users/e63ad434a9804dc1b373c123a0169edb` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:20.977281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e4c4b-67cb-46d7-ad37-a43c0fbc9775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e63ad434a9804dc1b373c123a0169edb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:20.977281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e4c4b-67cb-46d7-ad37-a43c0fbc9775 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:20.986367 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2559/5179] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:20.986367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356aec5d-523b-4db9-9506-e7524b75b372 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:20.986617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-356aec5d-523b-4db9-9506-e7524b75b372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:21.029741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-145e4c4b-67cb-46d7-ad37-a43c0fbc9775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e63ad434a9804dc1b373c123a0169edb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.038518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-145e4c4b-67cb-46d7-ad37-a43c0fbc9775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e63ad434a9804dc1b373c123a0169edb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.039264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-145e4c4b-67cb-46d7-ad37-a43c0fbc9775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e63ad434a9804dc1b373c123a0169edb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.052618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356aec5d-523b-4db9-9506-e7524b75b372 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:21.053478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-145e4c4b-67cb-46d7-ad37-a43c0fbc9775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e63ad434a9804dc1b373c123a0169edb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.056328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f46d6-74da-4da1-b6b1-73cec2a11eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:21.057520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f46d6-74da-4da1-b6b1-73cec2a11eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:21.057799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f46d6-74da-4da1-b6b1-73cec2a11eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:21.058075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f46d6-74da-4da1-b6b1-73cec2a11eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:21.063502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-145e4c4b-67cb-46d7-ad37-a43c0fbc9775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e63ad434a9804dc1b373c123a0169edb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.069406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f46d6-74da-4da1-b6b1-73cec2a11eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:21.070490 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2621/5180] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:20 2021] DELETE /identity/v3/users/e63ad434a9804dc1b373c123a0169edb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:21.070990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f46d6-74da-4da1-b6b1-73cec2a11eb3 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:21.071299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e4c4b-67cb-46d7-ad37-a43c0fbc9775 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:21.073283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-145e4c4b-67cb-46d7-ad37-a43c0fbc9775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:21.082493 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2560/5181] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:21.084073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85576492-8128-4002-ad5e-9473b5d0a64e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:21.084476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85576492-8128-4002-ad5e-9473b5d0a64e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:21.085006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85576492-8128-4002-ad5e-9473b5d0a64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:21.109818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-85576492-8128-4002-ad5e-9473b5d0a64e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:21.111334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-85576492-8128-4002-ad5e-9473b5d0a64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:21.149884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e4c4b-67cb-46d7-ad37-a43c0fbc9775 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:21.157068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea71be6-f86e-482d-968a-55190b27a986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:21.158031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea71be6-f86e-482d-968a-55190b27a986 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:21.158609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea71be6-f86e-482d-968a-55190b27a986 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:21.158961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea71be6-f86e-482d-968a-55190b27a986 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:21.159750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea71be6-f86e-482d-968a-55190b27a986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:21.161916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea71be6-f86e-482d-968a-55190b27a986 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:21.191977 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2561/5182] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:21.203346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85576492-8128-4002-ad5e-9473b5d0a64e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:21.207766 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2622/5183] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:21 2021] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:21.207941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-85576492-8128-4002-ad5e-9473b5d0a64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:21.209420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea71be6-f86e-482d-968a-55190b27a986 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:21.291982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea71be6-f86e-482d-968a-55190b27a986 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:21.297660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3686187-344d-4a58-bb8d-680febf89ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:21.298404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3686187-344d-4a58-bb8d-680febf89ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:21.298674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3686187-344d-4a58-bb8d-680febf89ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:21.299041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3686187-344d-4a58-bb8d-680febf89ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:21.299637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3686187-344d-4a58-bb8d-680febf89ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:21.301669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3686187-344d-4a58-bb8d-680febf89ee9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:21.309108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85576492-8128-4002-ad5e-9473b5d0a64e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:21.339785 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2623/5184] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:21 2021] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:02:21.340807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3686187-344d-4a58-bb8d-680febf89ee9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:21.360401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3686187-344d-4a58-bb8d-680febf89ee9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:21.365668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f385d1c-35bf-4f48-9e12-602a0251ad28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:21.366655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f385d1c-35bf-4f48-9e12-602a0251ad28 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:21.366945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f385d1c-35bf-4f48-9e12-602a0251ad28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:21.367263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f385d1c-35bf-4f48-9e12-602a0251ad28 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:21.368070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f385d1c-35bf-4f48-9e12-602a0251ad28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:21.370352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f385d1c-35bf-4f48-9e12-602a0251ad28 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:21.382298 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2624/5185] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:21 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:21.384412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e0444-5db9-4304-96b2-c9e919819759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:21.385542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e0444-5db9-4304-96b2-c9e919819759 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:21.385797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e0444-5db9-4304-96b2-c9e919819759 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:21.386108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e0444-5db9-4304-96b2-c9e919819759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:21.386801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f385d1c-35bf-4f48-9e12-602a0251ad28 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:21.397929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e0444-5db9-4304-96b2-c9e919819759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:21.399970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f385d1c-35bf-4f48-9e12-602a0251ad28 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:21.400129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e0444-5db9-4304-96b2-c9e919819759 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:21.406372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b93bd-18b3-4ea8-a5c2-64e098f86466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:21.407138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b93bd-18b3-4ea8-a5c2-64e098f86466 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:21.407339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b93bd-18b3-4ea8-a5c2-64e098f86466 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:21.407609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b93bd-18b3-4ea8-a5c2-64e098f86466 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:21.408330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b93bd-18b3-4ea8-a5c2-64e098f86466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:21.410220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b93bd-18b3-4ea8-a5c2-64e098f86466 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:21.412365 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2562/5186] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:02:21.423060 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2625/5187] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:21 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:21.427164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e0444-5db9-4304-96b2-c9e919819759 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:21.440149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e0444-5db9-4304-96b2-c9e919819759 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:21.448760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eb900-c6e3-4db4-91d1-5f88ad6e51e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:21.449818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eb900-c6e3-4db4-91d1-5f88ad6e51e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:21.450467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eb900-c6e3-4db4-91d1-5f88ad6e51e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:21.451212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eb900-c6e3-4db4-91d1-5f88ad6e51e2 admin admin] PATH_INFO: `/v3/projects/1089efb658724cfc9a0943ad0a3df737/users/ceccdce5024d47fd85c1c58d68c7f20e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:21.465101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b93bd-18b3-4ea8-a5c2-64e098f86466 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:21.469586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-186b93bd-18b3-4ea8-a5c2-64e098f86466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:21.482373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160eb900-c6e3-4db4-91d1-5f88ad6e51e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1089efb658724cfc9a0943ad0a3df737, user_id=ceccdce5024d47fd85c1c58d68c7f20e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:21.485869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160eb900-c6e3-4db4-91d1-5f88ad6e51e2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:21.501856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b93bd-18b3-4ea8-a5c2-64e098f86466 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:21.514639 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2563/5188] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:21 2021] PUT /identity/v3/projects/1089efb658724cfc9a0943ad0a3df737/users/ceccdce5024d47fd85c1c58d68c7f20e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:21.525787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee34b6c-3bc8-4ab3-b401-72d638f8726b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:21.526367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee34b6c-3bc8-4ab3-b401-72d638f8726b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:21.526793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee34b6c-3bc8-4ab3-b401-72d638f8726b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:21.573301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-bee34b6c-3bc8-4ab3-b401-72d638f8726b None None] MFA Rules not processed for user `ceccdce5024d47fd85c1c58d68c7f20e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:21.574886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bee34b6c-3bc8-4ab3-b401-72d638f8726b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:21.589585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dec217-365a-4137-bd2d-3ce7cfa3bb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:21.590908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dec217-365a-4137-bd2d-3ce7cfa3bb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:21.591755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dec217-365a-4137-bd2d-3ce7cfa3bb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:21.592119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dec217-365a-4137-bd2d-3ce7cfa3bb60 admin admin] PATH_INFO: `/v3/projects/cda7298cf23e481685801602b13d9711` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:21.593552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dec217-365a-4137-bd2d-3ce7cfa3bb60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda7298cf23e481685801602b13d9711)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:21.595858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dec217-365a-4137-bd2d-3ce7cfa3bb60 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:21.658933 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2564/5189] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:21 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:21.666691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee34b6c-3bc8-4ab3-b401-72d638f8726b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:21.679790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-41dec217-365a-4137-bd2d-3ce7cfa3bb60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda7298cf23e481685801602b13d9711', 'request_id': 'req-41dec217-365a-4137-bd2d-3ce7cfa3bb60'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.680733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee34b6c-3bc8-4ab3-b401-72d638f8726b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:21.689490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-41dec217-365a-4137-bd2d-3ce7cfa3bb60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda7298cf23e481685801602b13d9711', 'request_id': 'req-41dec217-365a-4137-bd2d-3ce7cfa3bb60'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.704877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-41dec217-365a-4137-bd2d-3ce7cfa3bb60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda7298cf23e481685801602b13d9711', 'request_id': 'req-41dec217-365a-4137-bd2d-3ce7cfa3bb60'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.718969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-41dec217-365a-4137-bd2d-3ce7cfa3bb60 admin admin] The token cache is being invalidate because project cda7298cf23e481685801602b13d9711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:21.719267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-41dec217-365a-4137-bd2d-3ce7cfa3bb60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.720102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-41dec217-365a-4137-bd2d-3ce7cfa3bb60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.721880 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2626/5190] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:21 2021] DELETE /identity/v3/projects/cda7298cf23e481685801602b13d9711 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:21.726120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dec217-365a-4137-bd2d-3ce7cfa3bb60 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:21.728269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-41dec217-365a-4137-bd2d-3ce7cfa3bb60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:21.751607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7e1c3-19e5-4a83-abe0-28e4d7de415d tempest-DefaultDomainTestJSON-1277739250 tempest-DefaultDomainTestJSON-1277739250-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceccdce5024d47fd85c1c58d68c7f20e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1089efb658724cfc9a0943ad0a3df737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:21.752748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7e1c3-19e5-4a83-abe0-28e4d7de415d tempest-DefaultDomainTestJSON-1277739250 tempest-DefaultDomainTestJSON-1277739250-project] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:21.753358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7e1c3-19e5-4a83-abe0-28e4d7de415d tempest-DefaultDomainTestJSON-1277739250 tempest-DefaultDomainTestJSON-1277739250-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:21.753812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7e1c3-19e5-4a83-abe0-28e4d7de415d tempest-DefaultDomainTestJSON-1277739250 tempest-DefaultDomainTestJSON-1277739250-project] PATH_INFO: `/v3/domains/default` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:21.755141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7e1c3-19e5-4a83-abe0-28e4d7de415d tempest-DefaultDomainTestJSON-1277739250 tempest-DefaultDomainTestJSON-1277739250-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:21.756918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7e1c3-19e5-4a83-abe0-28e4d7de415d tempest-DefaultDomainTestJSON-1277739250 tempest-DefaultDomainTestJSON-1277739250-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:21.762233 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2565/5191] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 21:02:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:21.763781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7e1c3-19e5-4a83-abe0-28e4d7de415d tempest-DefaultDomainTestJSON-1277739250 tempest-DefaultDomainTestJSON-1277739250-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:21.765820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-86f7e1c3-19e5-4a83-abe0-28e4d7de415d tempest-DefaultDomainTestJSON-1277739250 tempest-DefaultDomainTestJSON-1277739250-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:21.837622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dec217-365a-4137-bd2d-3ce7cfa3bb60 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:21.844089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7e1c3-19e5-4a83-abe0-28e4d7de415d tempest-DefaultDomainTestJSON-1277739250 tempest-DefaultDomainTestJSON-1277739250-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:21.845086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218dc88-328e-4a7f-9b13-6b6b14bfa756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:21.846481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218dc88-328e-4a7f-9b13-6b6b14bfa756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:21.846905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218dc88-328e-4a7f-9b13-6b6b14bfa756 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:21.847089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218dc88-328e-4a7f-9b13-6b6b14bfa756 admin admin] PATH_INFO: `/v3/users/dae93cbf74f147dfaf55cfe61afe3a27` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:21.848401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218dc88-328e-4a7f-9b13-6b6b14bfa756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dae93cbf74f147dfaf55cfe61afe3a27)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:21.850206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0c1c1-0f37-4014-8d75-248501d1ff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:21.850788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218dc88-328e-4a7f-9b13-6b6b14bfa756 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:21.851098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0c1c1-0f37-4014-8d75-248501d1ff7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:21.851394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0c1c1-0f37-4014-8d75-248501d1ff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:21.851697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0c1c1-0f37-4014-8d75-248501d1ff7f admin admin] PATH_INFO: `/v3/users/ceccdce5024d47fd85c1c58d68c7f20e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:21.853151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0c1c1-0f37-4014-8d75-248501d1ff7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceccdce5024d47fd85c1c58d68c7f20e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:21.856580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0c1c1-0f37-4014-8d75-248501d1ff7f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:21.904619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e218dc88-328e-4a7f-9b13-6b6b14bfa756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dae93cbf74f147dfaf55cfe61afe3a27'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.909795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-79b0c1c1-0f37-4014-8d75-248501d1ff7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceccdce5024d47fd85c1c58d68c7f20e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.911771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e218dc88-328e-4a7f-9b13-6b6b14bfa756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dae93cbf74f147dfaf55cfe61afe3a27'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.912546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e218dc88-328e-4a7f-9b13-6b6b14bfa756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dae93cbf74f147dfaf55cfe61afe3a27'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.918035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-79b0c1c1-0f37-4014-8d75-248501d1ff7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceccdce5024d47fd85c1c58d68c7f20e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.926682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e218dc88-328e-4a7f-9b13-6b6b14bfa756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dae93cbf74f147dfaf55cfe61afe3a27'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.931615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-79b0c1c1-0f37-4014-8d75-248501d1ff7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceccdce5024d47fd85c1c58d68c7f20e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.932869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-79b0c1c1-0f37-4014-8d75-248501d1ff7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceccdce5024d47fd85c1c58d68c7f20e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.935596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e218dc88-328e-4a7f-9b13-6b6b14bfa756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dae93cbf74f147dfaf55cfe61afe3a27'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.940503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-79b0c1c1-0f37-4014-8d75-248501d1ff7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceccdce5024d47fd85c1c58d68c7f20e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:21.943203 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2627/5192] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:21 2021] DELETE /identity/v3/users/dae93cbf74f147dfaf55cfe61afe3a27 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:02:21.943896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218dc88-328e-4a7f-9b13-6b6b14bfa756 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:21.945267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e218dc88-328e-4a7f-9b13-6b6b14bfa756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:21.960343 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2566/5193] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:21 2021] DELETE /identity/v3/users/ceccdce5024d47fd85c1c58d68c7f20e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:02:21.961942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c80407-45bb-4787-934b-c0cfc656cf55 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:21.962623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c80407-45bb-4787-934b-c0cfc656cf55 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:21.963537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c80407-45bb-4787-934b-c0cfc656cf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:21.985756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e9c80407-45bb-4787-934b-c0cfc656cf55 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:21.987768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e9c80407-45bb-4787-934b-c0cfc656cf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:22.018583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218dc88-328e-4a7f-9b13-6b6b14bfa756 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:22.085286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd7ee1-2071-43b7-8f12-f3736a570488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:22.086200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd7ee1-2071-43b7-8f12-f3736a570488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:22.086546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd7ee1-2071-43b7-8f12-f3736a570488 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:22.086910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd7ee1-2071-43b7-8f12-f3736a570488 admin admin] PATH_INFO: `/v3/projects/195b0b52a15b4bac829f1543bb876b46` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:22.091910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd7ee1-2071-43b7-8f12-f3736a570488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=195b0b52a15b4bac829f1543bb876b46)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:22.092089 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2567/5194] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:22.092217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd7ee1-2071-43b7-8f12-f3736a570488 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:22.102331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c80407-45bb-4787-934b-c0cfc656cf55 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:22.104566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e9c80407-45bb-4787-934b-c0cfc656cf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:22.153225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d4cd7ee1-2071-43b7-8f12-f3736a570488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195b0b52a15b4bac829f1543bb876b46', 'request_id': 'req-d4cd7ee1-2071-43b7-8f12-f3736a570488'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:22.163205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d4cd7ee1-2071-43b7-8f12-f3736a570488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195b0b52a15b4bac829f1543bb876b46', 'request_id': 'req-d4cd7ee1-2071-43b7-8f12-f3736a570488'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:22.184654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d4cd7ee1-2071-43b7-8f12-f3736a570488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195b0b52a15b4bac829f1543bb876b46', 'request_id': 'req-d4cd7ee1-2071-43b7-8f12-f3736a570488'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:22.184873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c80407-45bb-4787-934b-c0cfc656cf55 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:22.200987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d4cd7ee1-2071-43b7-8f12-f3736a570488 admin admin] The token cache is being invalidate because project 195b0b52a15b4bac829f1543bb876b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:22.201407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d4cd7ee1-2071-43b7-8f12-f3736a570488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:22.202462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d4cd7ee1-2071-43b7-8f12-f3736a570488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:22.204885 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2628/5195] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:21 2021] DELETE /identity/v3/projects/195b0b52a15b4bac829f1543bb876b46 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:22.211836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4238b-25fe-49b8-9f79-cf0c92d00670 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:22.212403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4238b-25fe-49b8-9f79-cf0c92d00670 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:22.212919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4238b-25fe-49b8-9f79-cf0c92d00670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:22.244774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4eb4238b-25fe-49b8-9f79-cf0c92d00670 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:22.246206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4eb4238b-25fe-49b8-9f79-cf0c92d00670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:22.260393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db78411-3ce2-4da3-8795-e043e436068e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:22.261163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db78411-3ce2-4da3-8795-e043e436068e service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:22.261331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db78411-3ce2-4da3-8795-e043e436068e service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:22.261616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db78411-3ce2-4da3-8795-e043e436068e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:22.263907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8db78411-3ce2-4da3-8795-e043e436068e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:22.323012 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2629/5196] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:22.326730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190f12e-d885-484c-a807-8bcaef226e70 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:22.327141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190f12e-d885-484c-a807-8bcaef226e70 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:22.327433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190f12e-d885-484c-a807-8bcaef226e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:22.349454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7190f12e-d885-484c-a807-8bcaef226e70 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:22.350936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7190f12e-d885-484c-a807-8bcaef226e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:22.351365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db78411-3ce2-4da3-8795-e043e436068e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:22.353209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db78411-3ce2-4da3-8795-e043e436068e service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:22.365086 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2630/5197] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:22.370472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190f12e-d885-484c-a807-8bcaef226e70 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:22.375710 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2568/5198] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:02:22.386148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190f12e-d885-484c-a807-8bcaef226e70 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:22.393471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dcee1-5809-4c18-8020-35efcd988aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:22.394830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dcee1-5809-4c18-8020-35efcd988aab admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:22.394981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dcee1-5809-4c18-8020-35efcd988aab admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:22.395708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dcee1-5809-4c18-8020-35efcd988aab admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:22.396372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dcee1-5809-4c18-8020-35efcd988aab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:22.398347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dcee1-5809-4c18-8020-35efcd988aab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:22.400358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dcee1-5809-4c18-8020-35efcd988aab admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:22.418506 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2631/5199] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:22.421795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db78411-3ce2-4da3-8795-e043e436068e service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:22.434292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db78411-3ce2-4da3-8795-e043e436068e service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:22.442513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3de9e3-174d-46f7-b103-d757f256a18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:22.443826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3de9e3-174d-46f7-b103-d757f256a18d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:22.444299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3de9e3-174d-46f7-b103-d757f256a18d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:22.444708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3de9e3-174d-46f7-b103-d757f256a18d admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:22.445921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3de9e3-174d-46f7-b103-d757f256a18d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:22.450580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3de9e3-174d-46f7-b103-d757f256a18d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:22.487227 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2569/5200] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:22 2021] POST /identity/v3/projects => generated 361 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:22.491305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dcee1-5809-4c18-8020-35efcd988aab admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:22.508592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dcee1-5809-4c18-8020-35efcd988aab admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:22.568776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3de9e3-174d-46f7-b103-d757f256a18d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:22.573728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4e3de9e3-174d-46f7-b103-d757f256a18d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:22.624896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49875f34-2313-499c-a843-d523d8a08a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:22.625642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49875f34-2313-499c-a843-d523d8a08a64 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:22.625937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49875f34-2313-499c-a843-d523d8a08a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:22.626204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49875f34-2313-499c-a843-d523d8a08a64 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:22.627040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49875f34-2313-499c-a843-d523d8a08a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:22.629088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49875f34-2313-499c-a843-d523d8a08a64 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:22.667503 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2632/5201] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:22 2021] POST /identity/v3/users => generated 281 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:02:22.669182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49875f34-2313-499c-a843-d523d8a08a64 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:22.684456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49875f34-2313-499c-a843-d523d8a08a64 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:22.690632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985427ce-0628-4fd2-8f93-9f506cf70e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:22.691312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985427ce-0628-4fd2-8f93-9f506cf70e0d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:22.692061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985427ce-0628-4fd2-8f93-9f506cf70e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:22.692192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985427ce-0628-4fd2-8f93-9f506cf70e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:22.693001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985427ce-0628-4fd2-8f93-9f506cf70e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:22.695024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985427ce-0628-4fd2-8f93-9f506cf70e0d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:22.709657 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2633/5202] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:22 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:22.714770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985427ce-0628-4fd2-8f93-9f506cf70e0d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:22.725273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3de9e3-174d-46f7-b103-d757f256a18d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:22.738514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174ad23-eb1c-4d87-937a-e90923a6769e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:22.738514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174ad23-eb1c-4d87-937a-e90923a6769e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:22.738514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174ad23-eb1c-4d87-937a-e90923a6769e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:22.738514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174ad23-eb1c-4d87-937a-e90923a6769e admin admin] PATH_INFO: `/v3/projects/924633b7f6f84c40a8a80a39af8a8b5d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:22.739036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174ad23-eb1c-4d87-937a-e90923a6769e admin admin] RBAC: Authorizing `identity:delete_project(project_id=924633b7f6f84c40a8a80a39af8a8b5d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:22.739441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174ad23-eb1c-4d87-937a-e90923a6769e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:22.746957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985427ce-0628-4fd2-8f93-9f506cf70e0d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:22.754494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5ab9f-23fe-4056-a4ec-855dd8b9c86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:22.755276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5ab9f-23fe-4056-a4ec-855dd8b9c86a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:22.756228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5ab9f-23fe-4056-a4ec-855dd8b9c86a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:22.756600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5ab9f-23fe-4056-a4ec-855dd8b9c86a admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:22.757545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5ab9f-23fe-4056-a4ec-855dd8b9c86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:22.759673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5ab9f-23fe-4056-a4ec-855dd8b9c86a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:22.785807 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2634/5203] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:22 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:22.787097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5ab9f-23fe-4056-a4ec-855dd8b9c86a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:22.798301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5ab9f-23fe-4056-a4ec-855dd8b9c86a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:22.814399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8174ad23-eb1c-4d87-937a-e90923a6769e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924633b7f6f84c40a8a80a39af8a8b5d', 'request_id': 'req-8174ad23-eb1c-4d87-937a-e90923a6769e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:22.827554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8174ad23-eb1c-4d87-937a-e90923a6769e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924633b7f6f84c40a8a80a39af8a8b5d', 'request_id': 'req-8174ad23-eb1c-4d87-937a-e90923a6769e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:22.840556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8174ad23-eb1c-4d87-937a-e90923a6769e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924633b7f6f84c40a8a80a39af8a8b5d', 'request_id': 'req-8174ad23-eb1c-4d87-937a-e90923a6769e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:22.865878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8174ad23-eb1c-4d87-937a-e90923a6769e admin admin] The token cache is being invalidate because project 924633b7f6f84c40a8a80a39af8a8b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:22.866334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8174ad23-eb1c-4d87-937a-e90923a6769e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:22.867581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8174ad23-eb1c-4d87-937a-e90923a6769e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:22.870396 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2570/5204] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:22 2021] DELETE /identity/v3/projects/924633b7f6f84c40a8a80a39af8a8b5d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:02:22.876715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16db195-ea4e-42d7-9689-e15e6837dd01 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:22.877100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16db195-ea4e-42d7-9689-e15e6837dd01 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:22.877473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16db195-ea4e-42d7-9689-e15e6837dd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:22.896416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bf746-2d93-47e4-b498-07726cb5fe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:22.897948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bf746-2d93-47e4-b498-07726cb5fe7b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:22.898432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bf746-2d93-47e4-b498-07726cb5fe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:22.898720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bf746-2d93-47e4-b498-07726cb5fe7b admin admin] PATH_INFO: `/v3/projects/967d31f31db148e8a2a8fd17f29daace/users/4cdaf066441e4ee09414d3e9e88c160e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:22.903031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f16db195-ea4e-42d7-9689-e15e6837dd01 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:22.904926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f16db195-ea4e-42d7-9689-e15e6837dd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:22.920592 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2571/5205] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:22.923955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bf746-2d93-47e4-b498-07726cb5fe7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=967d31f31db148e8a2a8fd17f29daace, user_id=4cdaf066441e4ee09414d3e9e88c160e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:22.927421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bf746-2d93-47e4-b498-07726cb5fe7b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:22.928477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3431742-a6eb-464a-830d-59dcf995824b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:22.928776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3431742-a6eb-464a-830d-59dcf995824b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:22.929109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3431742-a6eb-464a-830d-59dcf995824b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:22.947830 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2635/5206] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:22 2021] PUT /identity/v3/projects/967d31f31db148e8a2a8fd17f29daace/users/4cdaf066441e4ee09414d3e9e88c160e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:02:22.960297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503322ec-38e5-4257-b22e-39efd7e0df2d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:22.960883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503322ec-38e5-4257-b22e-39efd7e0df2d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:22.961451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503322ec-38e5-4257-b22e-39efd7e0df2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:22.963811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c3431742-a6eb-464a-830d-59dcf995824b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:22.968219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c3431742-a6eb-464a-830d-59dcf995824b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:23.003884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-503322ec-38e5-4257-b22e-39efd7e0df2d None None] MFA Rules not processed for user `4cdaf066441e4ee09414d3e9e88c160e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:23.005321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-503322ec-38e5-4257-b22e-39efd7e0df2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:23.060564 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2572/5207] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:23.060938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3431742-a6eb-464a-830d-59dcf995824b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:23.063044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c3431742-a6eb-464a-830d-59dcf995824b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:23.077919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3431742-a6eb-464a-830d-59dcf995824b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:23.091068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891beb17-2dc6-4106-b017-1cffd11ff421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:23.092565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891beb17-2dc6-4106-b017-1cffd11ff421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.093145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891beb17-2dc6-4106-b017-1cffd11ff421 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.093989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891beb17-2dc6-4106-b017-1cffd11ff421 admin admin] PATH_INFO: `/v3/projects/1089efb658724cfc9a0943ad0a3df737` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.096287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891beb17-2dc6-4106-b017-1cffd11ff421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1089efb658724cfc9a0943ad0a3df737)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:23.097766 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2636/5208] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:22 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:23.098817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503322ec-38e5-4257-b22e-39efd7e0df2d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:23.099391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891beb17-2dc6-4106-b017-1cffd11ff421 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:23.111619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503322ec-38e5-4257-b22e-39efd7e0df2d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:23.118110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e44ed-6598-4f69-aa50-c7ac2ec2f81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:23.120051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e44ed-6598-4f69-aa50-c7ac2ec2f81d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.120459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e44ed-6598-4f69-aa50-c7ac2ec2f81d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.120808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e44ed-6598-4f69-aa50-c7ac2ec2f81d admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.122229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e44ed-6598-4f69-aa50-c7ac2ec2f81d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:23.122635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e44ed-6598-4f69-aa50-c7ac2ec2f81d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:23.126242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e44ed-6598-4f69-aa50-c7ac2ec2f81d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:23.142216 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2637/5209] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:23.147748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fadf0-e6d0-4f36-8bf1-bb9e221e6dd6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.148047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fadf0-e6d0-4f36-8bf1-bb9e221e6dd6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.148334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fadf0-e6d0-4f36-8bf1-bb9e221e6dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.170073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-de4fadf0-e6d0-4f36-8bf1-bb9e221e6dd6 None None] MFA Rules not processed for user `4cdaf066441e4ee09414d3e9e88c160e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:23.171345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-de4fadf0-e6d0-4f36-8bf1-bb9e221e6dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:23.174743 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2638/5210] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:23 2021] POST /identity/v3/auth/tokens => generated 346 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 18 21:02:23.180562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fadf0-e6d0-4f36-8bf1-bb9e221e6dd6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:23.207163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-891beb17-2dc6-4106-b017-1cffd11ff421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1089efb658724cfc9a0943ad0a3df737', 'request_id': 'req-891beb17-2dc6-4106-b017-1cffd11ff421'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:23.215851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-891beb17-2dc6-4106-b017-1cffd11ff421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1089efb658724cfc9a0943ad0a3df737', 'request_id': 'req-891beb17-2dc6-4106-b017-1cffd11ff421'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:23.236644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-891beb17-2dc6-4106-b017-1cffd11ff421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1089efb658724cfc9a0943ad0a3df737', 'request_id': 'req-891beb17-2dc6-4106-b017-1cffd11ff421'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:23.258420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-891beb17-2dc6-4106-b017-1cffd11ff421 admin admin] The token cache is being invalidate because project 1089efb658724cfc9a0943ad0a3df737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:23.258712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-891beb17-2dc6-4106-b017-1cffd11ff421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:23.259247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fadf0-e6d0-4f36-8bf1-bb9e221e6dd6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:23.259371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-891beb17-2dc6-4106-b017-1cffd11ff421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:23.266662 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2573/5211] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:23 2021] DELETE /identity/v3/projects/1089efb658724cfc9a0943ad0a3df737 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:23.266662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df700add-94c9-4a93-838a-a26f158e7d11 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.266662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df700add-94c9-4a93-838a-a26f158e7d11 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.266662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df700add-94c9-4a93-838a-a26f158e7d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.286085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e55a2-8170-4144-8983-e5e11416bdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:23.286982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e55a2-8170-4144-8983-e5e11416bdb5 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.287387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e55a2-8170-4144-8983-e5e11416bdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.287738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e55a2-8170-4144-8983-e5e11416bdb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.288977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e55a2-8170-4144-8983-e5e11416bdb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:23.291942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e55a2-8170-4144-8983-e5e11416bdb5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:23.293208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-df700add-94c9-4a93-838a-a26f158e7d11 None None] MFA Rules not processed for user `4cdaf066441e4ee09414d3e9e88c160e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:23.295754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-df700add-94c9-4a93-838a-a26f158e7d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:23.299703 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2574/5212] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:23 2021] POST /identity/v3/auth/tokens => generated 346 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 18 21:02:23.301003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6ee71-e6d0-4378-9d72-36955682b08c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.301365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6ee71-e6d0-4378-9d72-36955682b08c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.301650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6ee71-e6d0-4378-9d72-36955682b08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.326133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-21f6ee71-e6d0-4378-9d72-36955682b08c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:23.328667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-21f6ee71-e6d0-4378-9d72-36955682b08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:23.340840 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2575/5213] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:23.341844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6ee71-e6d0-4378-9d72-36955682b08c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:23.343372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-21f6ee71-e6d0-4378-9d72-36955682b08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:23.346341 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2639/5214] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:23 2021] POST /identity/v3/projects => generated 395 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:23.348730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f4733-d23d-4cc3-97df-0786c08d47c8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.349449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f4733-d23d-4cc3-97df-0786c08d47c8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.349900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f4733-d23d-4cc3-97df-0786c08d47c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.374297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-497f4733-d23d-4cc3-97df-0786c08d47c8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:23.375636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-497f4733-d23d-4cc3-97df-0786c08d47c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:23.427974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6ee71-e6d0-4378-9d72-36955682b08c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:23.456472 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2640/5215] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:23.457532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f4733-d23d-4cc3-97df-0786c08d47c8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:23.458965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-497f4733-d23d-4cc3-97df-0786c08d47c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:23.473301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f4733-d23d-4cc3-97df-0786c08d47c8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:23.479774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31697be-7726-482a-bed2-7af6fcf80bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:23.480600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31697be-7726-482a-bed2-7af6fcf80bec admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.480949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31697be-7726-482a-bed2-7af6fcf80bec admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.481491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31697be-7726-482a-bed2-7af6fcf80bec admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.482570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31697be-7726-482a-bed2-7af6fcf80bec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:23.484894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31697be-7726-482a-bed2-7af6fcf80bec admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:23.493715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b7ba1-13a3-484b-b37d-954a13d4d031 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cdaf066441e4ee09414d3e9e88c160e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '967d31f31db148e8a2a8fd17f29daace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:23.494609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b7ba1-13a3-484b-b37d-954a13d4d031 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] REQUEST_METHOD: `HEAD` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.495056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b7ba1-13a3-484b-b37d-954a13d4d031 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.495616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b7ba1-13a3-484b-b37d-954a13d4d031 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.503964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b7ba1-13a3-484b-b37d-954a13d4d031 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] RBAC: Authorizing `identity:check_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:23.505951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b7ba1-13a3-484b-b37d-954a13d4d031 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:23.516559 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2641/5216] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:23 2021] POST /identity/v3/users => generated 298 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:23.517771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31697be-7726-482a-bed2-7af6fcf80bec admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:23.518609 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2576/5217] 10.222.0.13 () {56 vars in 1263 bytes} [Sat Dec 18 21:02:23 2021] HEAD /identity/v3/auth/tokens => generated 0 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Dec 18 21:02:23.522398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b7ba1-13a3-484b-b37d-954a13d4d031 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:23.534100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b7ba1-13a3-484b-b37d-954a13d4d031 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:23.535230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31697be-7726-482a-bed2-7af6fcf80bec admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:23.540541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd39105-8b25-4e0a-90e2-cded4a1e97b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:23.542146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd39105-8b25-4e0a-90e2-cded4a1e97b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.542367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100d5d7-b450-4806-a20f-8f8fb2292c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:23.542534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd39105-8b25-4e0a-90e2-cded4a1e97b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.542816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd39105-8b25-4e0a-90e2-cded4a1e97b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.542941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100d5d7-b450-4806-a20f-8f8fb2292c48 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.543218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100d5d7-b450-4806-a20f-8f8fb2292c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.543594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100d5d7-b450-4806-a20f-8f8fb2292c48 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.544342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100d5d7-b450-4806-a20f-8f8fb2292c48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:23.544456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd39105-8b25-4e0a-90e2-cded4a1e97b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:23.544663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100d5d7-b450-4806-a20f-8f8fb2292c48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:23.546362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd39105-8b25-4e0a-90e2-cded4a1e97b6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:23.546760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100d5d7-b450-4806-a20f-8f8fb2292c48 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:23.562360 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2577/5218] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:23 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:23.562575 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2642/5219] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:23.565139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd39105-8b25-4e0a-90e2-cded4a1e97b6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:23.571349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100d5d7-b450-4806-a20f-8f8fb2292c48 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:23.580945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd39105-8b25-4e0a-90e2-cded4a1e97b6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:23.584116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100d5d7-b450-4806-a20f-8f8fb2292c48 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:23.586778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc39779-34f5-4fa0-9daa-c84ebdaa8303 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cdaf066441e4ee09414d3e9e88c160e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '967d31f31db148e8a2a8fd17f29daace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:23.587733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc39779-34f5-4fa0-9daa-c84ebdaa8303 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.588947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc39779-34f5-4fa0-9daa-c84ebdaa8303 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.589321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc39779-34f5-4fa0-9daa-c84ebdaa8303 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.591363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc896b-8165-464c-b97c-a18090833580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:23.592027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc896b-8165-464c-b97c-a18090833580 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.592410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc896b-8165-464c-b97c-a18090833580 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.592794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc896b-8165-464c-b97c-a18090833580 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.593528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc896b-8165-464c-b97c-a18090833580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:23.595184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc896b-8165-464c-b97c-a18090833580 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:23.605594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc39779-34f5-4fa0-9daa-c84ebdaa8303 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:23.608328 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2643/5220] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:23 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:23.608621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc39779-34f5-4fa0-9daa-c84ebdaa8303 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:23.612732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc896b-8165-464c-b97c-a18090833580 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:23.620812 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2578/5221] 10.222.0.13 () {56 vars in 1262 bytes} [Sat Dec 18 21:02:23 2021] GET /identity/v3/auth/tokens => generated 346 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:23.622123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc39779-34f5-4fa0-9daa-c84ebdaa8303 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:23.625633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc896b-8165-464c-b97c-a18090833580 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:23.634293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc39779-34f5-4fa0-9daa-c84ebdaa8303 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:23.640846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e07fb-4e01-45cd-ab2d-aa87030c8ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:23.641981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e07fb-4e01-45cd-ab2d-aa87030c8ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.642337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e07fb-4e01-45cd-ab2d-aa87030c8ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.642546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019bb38-e63e-4ee9-b536-5be124ece546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:23.642687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e07fb-4e01-45cd-ab2d-aa87030c8ad5 admin admin] PATH_INFO: `/v3/projects/614a99fa0fc14f4ebd02bf31e9ff9def/users/e5b3c202cfeb4ef78d8917e660cfbb65/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.643892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019bb38-e63e-4ee9-b536-5be124ece546 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.644197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019bb38-e63e-4ee9-b536-5be124ece546 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.644510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019bb38-e63e-4ee9-b536-5be124ece546 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.645262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019bb38-e63e-4ee9-b536-5be124ece546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:23.647555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019bb38-e63e-4ee9-b536-5be124ece546 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:23.662510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e07fb-4e01-45cd-ab2d-aa87030c8ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=614a99fa0fc14f4ebd02bf31e9ff9def, user_id=e5b3c202cfeb4ef78d8917e660cfbb65, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:23.665264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e07fb-4e01-45cd-ab2d-aa87030c8ad5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:23.682775 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2644/5222] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:23 2021] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:23.684038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019bb38-e63e-4ee9-b536-5be124ece546 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:23.692182 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2579/5223] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:23 2021] PUT /identity/v3/projects/614a99fa0fc14f4ebd02bf31e9ff9def/users/e5b3c202cfeb4ef78d8917e660cfbb65/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:23.693568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e07fb-4e01-45cd-ab2d-aa87030c8ad5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:23.767977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019bb38-e63e-4ee9-b536-5be124ece546 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:23.773297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712af25a-5070-4636-a204-47618bcec65c tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cdaf066441e4ee09414d3e9e88c160e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '967d31f31db148e8a2a8fd17f29daace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:23.774239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712af25a-5070-4636-a204-47618bcec65c tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.774765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712af25a-5070-4636-a204-47618bcec65c tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.775144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712af25a-5070-4636-a204-47618bcec65c tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.779229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e07fb-4e01-45cd-ab2d-aa87030c8ad5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:23.785326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712af25a-5070-4636-a204-47618bcec65c tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:23.787167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712af25a-5070-4636-a204-47618bcec65c tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:23.804573 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2645/5224] 10.222.0.13 () {56 vars in 1265 bytes} [Sat Dec 18 21:02:23 2021] DELETE /identity/v3/auth/tokens => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:23.807732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc459b7-0c26-477c-85cc-4ec02643d752 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.807732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc459b7-0c26-477c-85cc-4ec02643d752 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.807732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc459b7-0c26-477c-85cc-4ec02643d752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.856478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ddc459b7-0c26-477c-85cc-4ec02643d752 None None] MFA Rules not processed for user `e5b3c202cfeb4ef78d8917e660cfbb65`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:23.858068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaa5a7-82bc-476c-9c81-b01e849fccc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:23.858464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ddc459b7-0c26-477c-85cc-4ec02643d752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:23.858967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaa5a7-82bc-476c-9c81-b01e849fccc7 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.859340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaa5a7-82bc-476c-9c81-b01e849fccc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.859714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaa5a7-82bc-476c-9c81-b01e849fccc7 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.860494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaa5a7-82bc-476c-9c81-b01e849fccc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:23.863033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaa5a7-82bc-476c-9c81-b01e849fccc7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:23.889251 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2580/5225] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:23 2021] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:23.890356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaa5a7-82bc-476c-9c81-b01e849fccc7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:23.905862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaa5a7-82bc-476c-9c81-b01e849fccc7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:23.911153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a91eef-dd7f-4ffc-8d81-ef3f537b3bf4 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cdaf066441e4ee09414d3e9e88c160e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '967d31f31db148e8a2a8fd17f29daace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:23.911972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a91eef-dd7f-4ffc-8d81-ef3f537b3bf4 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] REQUEST_METHOD: `HEAD` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.912385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a91eef-dd7f-4ffc-8d81-ef3f537b3bf4 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.912721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a91eef-dd7f-4ffc-8d81-ef3f537b3bf4 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.915015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c9a91eef-dd7f-4ffc-8d81-ef3f537b3bf4 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:23.928426 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-c9a91eef-dd7f-4ffc-8d81-ef3f537b3bf4 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Dec 18 21:02:23.929975 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2581/5226] 10.222.0.13 () {56 vars in 1263 bytes} [Sat Dec 18 21:02:23 2021] HEAD /identity/v3/auth/tokens => generated 0 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Dec 18 21:02:23.934949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a91eef-dd7f-4ffc-8d81-ef3f537b3bf4 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:23.948324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a91eef-dd7f-4ffc-8d81-ef3f537b3bf4 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:23.954005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b150109-7269-4297-be4e-bf0e3152127c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:23.955268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b150109-7269-4297-be4e-bf0e3152127c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.955268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b150109-7269-4297-be4e-bf0e3152127c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.955470 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2646/5227] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:23 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:23.955842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b150109-7269-4297-be4e-bf0e3152127c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.956785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b150109-7269-4297-be4e-bf0e3152127c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:23.958490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b150109-7269-4297-be4e-bf0e3152127c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:23.960505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4671c6-62c5-456f-959c-5a754195ffe3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.960805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4671c6-62c5-456f-959c-5a754195ffe3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.961442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4671c6-62c5-456f-959c-5a754195ffe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:23.973702 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2582/5228] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:23 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:23.973702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b150109-7269-4297-be4e-bf0e3152127c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:23.980910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2c4671c6-62c5-456f-959c-5a754195ffe3 None None] MFA Rules not processed for user `4cdaf066441e4ee09414d3e9e88c160e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:23.982526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2c4671c6-62c5-456f-959c-5a754195ffe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:23.989769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b150109-7269-4297-be4e-bf0e3152127c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:23.989948 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2647/5229] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:23 2021] POST /identity/v3/auth/tokens => generated 346 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 18 21:02:23.989948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4671c6-62c5-456f-959c-5a754195ffe3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:23.996980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cd6ae-7414-4c26-b8b8-a50eb3d86eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:23.998210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cd6ae-7414-4c26-b8b8-a50eb3d86eaf admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:23.998777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cd6ae-7414-4c26-b8b8-a50eb3d86eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:23.999326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cd6ae-7414-4c26-b8b8-a50eb3d86eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:24.000209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7cd6ae-7414-4c26-b8b8-a50eb3d86eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:24.003300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7cd6ae-7414-4c26-b8b8-a50eb3d86eaf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:24.005216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4671c6-62c5-456f-959c-5a754195ffe3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:24.011357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867fc3e-51b4-426e-99a7-a60105f24b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:24.012418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867fc3e-51b4-426e-99a7-a60105f24b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:24.012746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867fc3e-51b4-426e-99a7-a60105f24b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:24.013000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867fc3e-51b4-426e-99a7-a60105f24b02 admin admin] PATH_INFO: `/v3/projects/7f92b96b96f940aebbda4ed82cee846e/users/6d509fd68e964314ad912b4d74140b63/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:24.030728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867fc3e-51b4-426e-99a7-a60105f24b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f92b96b96f940aebbda4ed82cee846e, user_id=6d509fd68e964314ad912b4d74140b63, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:24.033913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867fc3e-51b4-426e-99a7-a60105f24b02 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:24.038822 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2583/5230] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:23 2021] POST /identity/v3/projects => generated 397 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:24.040009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cd6ae-7414-4c26-b8b8-a50eb3d86eaf admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:24.053610 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2648/5231] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:23 2021] PUT /identity/v3/projects/7f92b96b96f940aebbda4ed82cee846e/users/6d509fd68e964314ad912b4d74140b63/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:24.053610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867fc3e-51b4-426e-99a7-a60105f24b02 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:24.118142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cd6ae-7414-4c26-b8b8-a50eb3d86eaf admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:24.125762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867fc3e-51b4-426e-99a7-a60105f24b02 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:24.131827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17de9f-7cc4-40e5-81ea-f64f0a949e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:24.132526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17de9f-7cc4-40e5-81ea-f64f0a949e3c admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:24.132860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17de9f-7cc4-40e5-81ea-f64f0a949e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:24.133125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17de9f-7cc4-40e5-81ea-f64f0a949e3c admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:24.135637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17de9f-7cc4-40e5-81ea-f64f0a949e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:24.138182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17de9f-7cc4-40e5-81ea-f64f0a949e3c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:24.168850 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2649/5232] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:24 2021] POST /identity/v3/users => generated 305 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:24.169682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17de9f-7cc4-40e5-81ea-f64f0a949e3c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:24.183110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17de9f-7cc4-40e5-81ea-f64f0a949e3c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:24.188462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e39bbe-e966-4631-81cd-70a823c01178 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cdaf066441e4ee09414d3e9e88c160e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '967d31f31db148e8a2a8fd17f29daace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:24.189404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a078c-4927-42fc-9031-364fb77ac5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:24.189593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e39bbe-e966-4631-81cd-70a823c01178 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:24.189759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e39bbe-e966-4631-81cd-70a823c01178 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:24.190000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e39bbe-e966-4631-81cd-70a823c01178 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:24.190590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a078c-4927-42fc-9031-364fb77ac5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:24.191136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a078c-4927-42fc-9031-364fb77ac5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:24.191691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a078c-4927-42fc-9031-364fb77ac5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:24.192826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a078c-4927-42fc-9031-364fb77ac5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:24.194577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a078c-4927-42fc-9031-364fb77ac5d6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:24.199844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e39bbe-e966-4631-81cd-70a823c01178 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:24.200594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e39bbe-e966-4631-81cd-70a823c01178 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:24.207379 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2584/5233] 10.222.0.13 () {56 vars in 1262 bytes} [Sat Dec 18 21:02:24 2021] GET /identity/v3/auth/tokens => generated 346 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Dec 18 21:02:24.209762 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2650/5234] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:24 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:24.212418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a078c-4927-42fc-9031-364fb77ac5d6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:24.212929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e39bbe-e966-4631-81cd-70a823c01178 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:24.229487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e39bbe-e966-4631-81cd-70a823c01178 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:24.229716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a078c-4927-42fc-9031-364fb77ac5d6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:24.235203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc7c73-3a96-4c0e-b3f3-23be2e9f8abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:24.235534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f7346-78a4-4324-8d7a-65e3b42b3488 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cdaf066441e4ee09414d3e9e88c160e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '967d31f31db148e8a2a8fd17f29daace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:24.236144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc7c73-3a96-4c0e-b3f3-23be2e9f8abd admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:24.236577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc7c73-3a96-4c0e-b3f3-23be2e9f8abd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:24.236699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f7346-78a4-4324-8d7a-65e3b42b3488 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:24.236877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc7c73-3a96-4c0e-b3f3-23be2e9f8abd admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:24.236991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f7346-78a4-4324-8d7a-65e3b42b3488 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:24.237147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f7346-78a4-4324-8d7a-65e3b42b3488 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:24.237860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc7c73-3a96-4c0e-b3f3-23be2e9f8abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:24.240622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc7c73-3a96-4c0e-b3f3-23be2e9f8abd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:24.249582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f7346-78a4-4324-8d7a-65e3b42b3488 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:24.252140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f7346-78a4-4324-8d7a-65e3b42b3488 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:24.256261 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2585/5235] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:24 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:24.257441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc7c73-3a96-4c0e-b3f3-23be2e9f8abd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:24.276550 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2651/5236] 10.222.0.13 () {56 vars in 1265 bytes} [Sat Dec 18 21:02:24 2021] DELETE /identity/v3/auth/tokens => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:24.277828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f7346-78a4-4324-8d7a-65e3b42b3488 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:24.281187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc7c73-3a96-4c0e-b3f3-23be2e9f8abd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:24.291642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02b60d-ce3a-4a14-bf0c-1165a106c10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:24.292594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02b60d-ce3a-4a14-bf0c-1165a106c10d admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:24.292891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02b60d-ce3a-4a14-bf0c-1165a106c10d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:24.293209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02b60d-ce3a-4a14-bf0c-1165a106c10d admin admin] PATH_INFO: `/v3/projects/7f92b96b96f940aebbda4ed82cee846e/users/6d509fd68e964314ad912b4d74140b63/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:24.294288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f7346-78a4-4324-8d7a-65e3b42b3488 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:24.304556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09848f1-0bac-4673-a2bf-7df74f9b95b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:24.304556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09848f1-0bac-4673-a2bf-7df74f9b95b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:24.304556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09848f1-0bac-4673-a2bf-7df74f9b95b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:24.304556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09848f1-0bac-4673-a2bf-7df74f9b95b2 admin admin] PATH_INFO: `/v3/projects/8c59a670c2d446bcb62aa6b9454ef426/users/c6bee2e3a52c499ea3207625117ccfac/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:24.305173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02b60d-ce3a-4a14-bf0c-1165a106c10d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f92b96b96f940aebbda4ed82cee846e, user_id=6d509fd68e964314ad912b4d74140b63, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:24.308607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02b60d-ce3a-4a14-bf0c-1165a106c10d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:24.323184 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2586/5237] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:24 2021] PUT /identity/v3/projects/7f92b96b96f940aebbda4ed82cee846e/users/6d509fd68e964314ad912b4d74140b63/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:24.326483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02b60d-ce3a-4a14-bf0c-1165a106c10d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:24.331221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09848f1-0bac-4673-a2bf-7df74f9b95b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c59a670c2d446bcb62aa6b9454ef426, user_id=c6bee2e3a52c499ea3207625117ccfac, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:24.334958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09848f1-0bac-4673-a2bf-7df74f9b95b2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:24.353048 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2652/5238] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:24 2021] PUT /identity/v3/projects/8c59a670c2d446bcb62aa6b9454ef426/users/c6bee2e3a52c499ea3207625117ccfac/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:24.355631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2925cd-8d07-49a6-ba67-6f12cedf5d1d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:24.355926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2925cd-8d07-49a6-ba67-6f12cedf5d1d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:24.356209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2925cd-8d07-49a6-ba67-6f12cedf5d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:24.392511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1c2925cd-8d07-49a6-ba67-6f12cedf5d1d None None] MFA Rules not processed for user `6d509fd68e964314ad912b4d74140b63`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:24.394105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1c2925cd-8d07-49a6-ba67-6f12cedf5d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:24.413731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02b60d-ce3a-4a14-bf0c-1165a106c10d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:24.507361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b659261-7aa4-4e52-bfae-dfa57bfe76b3 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cdaf066441e4ee09414d3e9e88c160e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '967d31f31db148e8a2a8fd17f29daace', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:24.508771 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2653/5239] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:24 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:24.509638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b659261-7aa4-4e52-bfae-dfa57bfe76b3 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:24.509808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2925cd-8d07-49a6-ba67-6f12cedf5d1d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:24.509990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b659261-7aa4-4e52-bfae-dfa57bfe76b3 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:24.510404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b659261-7aa4-4e52-bfae-dfa57bfe76b3 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:24.517238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7b659261-7aa4-4e52-bfae-dfa57bfe76b3 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:24.531869 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-7b659261-7aa4-4e52-bfae-dfa57bfe76b3 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Dec 18 21:02:24.533059 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2587/5240] 10.222.0.13 () {56 vars in 1262 bytes} [Sat Dec 18 21:02:24 2021] GET /identity/v3/auth/tokens => generated 80 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 21:02:24.534156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b659261-7aa4-4e52-bfae-dfa57bfe76b3 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:24.620356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b659261-7aa4-4e52-bfae-dfa57bfe76b3 tempest-TokensV3Test-1749570714 tempest-TokensV3Test-1749570714-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:24.637103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2925cd-8d07-49a6-ba67-6f12cedf5d1d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:24.638153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bd215-7c05-43da-924a-bed3fc88eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:24.638885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bd215-7c05-43da-924a-bed3fc88eb8e admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:24.639186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bd215-7c05-43da-924a-bed3fc88eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:24.639467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bd215-7c05-43da-924a-bed3fc88eb8e admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:24.640185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bd215-7c05-43da-924a-bed3fc88eb8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:24.642327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bd215-7c05-43da-924a-bed3fc88eb8e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:24.651444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68480967-080e-4c97-bae9-cd61404754bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:24.653695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68480967-080e-4c97-bae9-cd61404754bc admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:24.655431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68480967-080e-4c97-bae9-cd61404754bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:24.655852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68480967-080e-4c97-bae9-cd61404754bc admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:24.657337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68480967-080e-4c97-bae9-cd61404754bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:24.661417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68480967-080e-4c97-bae9-cd61404754bc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:24.684705 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2654/5241] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:24 2021] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:24.685559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68480967-080e-4c97-bae9-cd61404754bc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:24.696470 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2588/5242] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:24 2021] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:24.697092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bd215-7c05-43da-924a-bed3fc88eb8e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:24.699656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-68480967-080e-4c97-bae9-cd61404754bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:24.735877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68480967-080e-4c97-bae9-cd61404754bc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:24.792263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bd215-7c05-43da-924a-bed3fc88eb8e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:24.797657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f4f5d-8e19-4e4a-b69c-bd776937e9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:24.799045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f4f5d-8e19-4e4a-b69c-bd776937e9a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:24.799424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f4f5d-8e19-4e4a-b69c-bd776937e9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:24.799876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f4f5d-8e19-4e4a-b69c-bd776937e9a7 admin admin] PATH_INFO: `/v3/projects/8c59a670c2d446bcb62aa6b9454ef426/users/c6bee2e3a52c499ea3207625117ccfac/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:24.802835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f4f5d-8e19-4e4a-b69c-bd776937e9a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c59a670c2d446bcb62aa6b9454ef426, user_id=c6bee2e3a52c499ea3207625117ccfac, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:24.806235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f4f5d-8e19-4e4a-b69c-bd776937e9a7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:24.819889 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2589/5243] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:24 2021] PUT /identity/v3/projects/8c59a670c2d446bcb62aa6b9454ef426/users/c6bee2e3a52c499ea3207625117ccfac/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:24.820748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f4f5d-8e19-4e4a-b69c-bd776937e9a7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:24.833734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf47a1d-8af5-424a-a9dd-e369ad823b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:24.835011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf47a1d-8af5-424a-a9dd-e369ad823b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:24.835399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf47a1d-8af5-424a-a9dd-e369ad823b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:24.835794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf47a1d-8af5-424a-a9dd-e369ad823b46 admin admin] PATH_INFO: `/v3/users/4cdaf066441e4ee09414d3e9e88c160e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:24.837285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf47a1d-8af5-424a-a9dd-e369ad823b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cdaf066441e4ee09414d3e9e88c160e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:24.840820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf47a1d-8af5-424a-a9dd-e369ad823b46 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:24.917662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f4f5d-8e19-4e4a-b69c-bd776937e9a7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:24.932534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd56361-d1c4-49b2-a8de-cc9d2c6ae776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:24.933182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd56361-d1c4-49b2-a8de-cc9d2c6ae776 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:24.933581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd56361-d1c4-49b2-a8de-cc9d2c6ae776 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:24.933943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd56361-d1c4-49b2-a8de-cc9d2c6ae776 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:24.934895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd56361-d1c4-49b2-a8de-cc9d2c6ae776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:24.938668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd56361-d1c4-49b2-a8de-cc9d2c6ae776 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:24.941896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ccf47a1d-8af5-424a-a9dd-e369ad823b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cdaf066441e4ee09414d3e9e88c160e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:24.950560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ccf47a1d-8af5-424a-a9dd-e369ad823b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cdaf066441e4ee09414d3e9e88c160e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:24.951393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ccf47a1d-8af5-424a-a9dd-e369ad823b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cdaf066441e4ee09414d3e9e88c160e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:24.970188 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2590/5244] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:24 2021] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:24.970188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39cf63-dc87-4282-af8d-069c48a67139 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:24.973631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39cf63-dc87-4282-af8d-069c48a67139 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:24.974867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39cf63-dc87-4282-af8d-069c48a67139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:24.976712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ccf47a1d-8af5-424a-a9dd-e369ad823b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cdaf066441e4ee09414d3e9e88c160e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:24.988974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ccf47a1d-8af5-424a-a9dd-e369ad823b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cdaf066441e4ee09414d3e9e88c160e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:25.002542 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2655/5245] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:24 2021] DELETE /identity/v3/users/4cdaf066441e4ee09414d3e9e88c160e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:25.004017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf47a1d-8af5-424a-a9dd-e369ad823b46 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:25.005707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ccf47a1d-8af5-424a-a9dd-e369ad823b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:25.023282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5d39cf63-dc87-4282-af8d-069c48a67139 None None] MFA Rules not processed for user `c6bee2e3a52c499ea3207625117ccfac`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:25.024586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5d39cf63-dc87-4282-af8d-069c48a67139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:25.093153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf47a1d-8af5-424a-a9dd-e369ad823b46 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:25.099243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10cf8e-c014-44f2-907c-4418e1ccf980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:25.100002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10cf8e-c014-44f2-907c-4418e1ccf980 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:25.100511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10cf8e-c014-44f2-907c-4418e1ccf980 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:25.100647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10cf8e-c014-44f2-907c-4418e1ccf980 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:25.101483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10cf8e-c014-44f2-907c-4418e1ccf980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:25.103133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10cf8e-c014-44f2-907c-4418e1ccf980 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:25.114559 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2656/5246] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:25 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:25.115992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296a696-e9d4-4b16-9662-45438f8e89d8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:25.116284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296a696-e9d4-4b16-9662-45438f8e89d8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:25.116563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296a696-e9d4-4b16-9662-45438f8e89d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:25.133771 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2591/5247] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:24 2021] POST /identity/v3/auth/tokens => generated 3331 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:25.135804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c296a696-e9d4-4b16-9662-45438f8e89d8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:25.136330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39cf63-dc87-4282-af8d-069c48a67139 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:25.137037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c296a696-e9d4-4b16-9662-45438f8e89d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:25.146575 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2657/5248] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:25.147460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296a696-e9d4-4b16-9662-45438f8e89d8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:25.156183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39cf63-dc87-4282-af8d-069c48a67139 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:25.157570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c296a696-e9d4-4b16-9662-45438f8e89d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:25.163417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3188e-8199-4614-9e7a-53164cf4fd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:25.164388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3188e-8199-4614-9e7a-53164cf4fd8a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:25.164719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3188e-8199-4614-9e7a-53164cf4fd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:25.165046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3188e-8199-4614-9e7a-53164cf4fd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:25.165782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3188e-8199-4614-9e7a-53164cf4fd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:25.168061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3188e-8199-4614-9e7a-53164cf4fd8a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:25.180103 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2592/5249] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:25 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:25.180855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3188e-8199-4614-9e7a-53164cf4fd8a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:25.184335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-38f3188e-8199-4614-9e7a-53164cf4fd8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:25.234777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296a696-e9d4-4b16-9662-45438f8e89d8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:25.239829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9f863-9eb6-401c-96cf-02319769e06f tempest-ProjectsNegativeStaticTestJSON-302940496 tempest-ProjectsNegativeStaticTestJSON-302940496-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b3c202cfeb4ef78d8917e660cfbb65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '614a99fa0fc14f4ebd02bf31e9ff9def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:25.240748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9f863-9eb6-401c-96cf-02319769e06f tempest-ProjectsNegativeStaticTestJSON-302940496 tempest-ProjectsNegativeStaticTestJSON-302940496-project] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:25.241436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9f863-9eb6-401c-96cf-02319769e06f tempest-ProjectsNegativeStaticTestJSON-302940496 tempest-ProjectsNegativeStaticTestJSON-302940496-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:25.241733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9f863-9eb6-401c-96cf-02319769e06f tempest-ProjectsNegativeStaticTestJSON-302940496 tempest-ProjectsNegativeStaticTestJSON-302940496-project] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:25.242520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9f863-9eb6-401c-96cf-02319769e06f tempest-ProjectsNegativeStaticTestJSON-302940496 tempest-ProjectsNegativeStaticTestJSON-302940496-project] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:25.250035 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-14c9f863-9eb6-401c-96cf-02319769e06f tempest-ProjectsNegativeStaticTestJSON-302940496 tempest-ProjectsNegativeStaticTestJSON-302940496-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Dec 18 21:02:25.256105 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2658/5250] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:02:25 2021] POST /identity/v3/projects => generated 136 bytes in 105 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:02:25.256105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9f863-9eb6-401c-96cf-02319769e06f tempest-ProjectsNegativeStaticTestJSON-302940496 tempest-ProjectsNegativeStaticTestJSON-302940496-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:25.257725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3188e-8199-4614-9e7a-53164cf4fd8a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:25.262987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173b2bb-39a5-473f-9c5c-ee5be27459d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:25.263808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173b2bb-39a5-473f-9c5c-ee5be27459d2 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:25.264205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173b2bb-39a5-473f-9c5c-ee5be27459d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:25.264756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173b2bb-39a5-473f-9c5c-ee5be27459d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:25.271733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9f863-9eb6-401c-96cf-02319769e06f tempest-ProjectsNegativeStaticTestJSON-302940496 tempest-ProjectsNegativeStaticTestJSON-302940496-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:25.275410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173b2bb-39a5-473f-9c5c-ee5be27459d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:25.277490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173b2bb-39a5-473f-9c5c-ee5be27459d2 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:25.282685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72360a86-2c72-4b82-b70d-ee7e0ee5721d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:25.284505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72360a86-2c72-4b82-b70d-ee7e0ee5721d admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:25.284916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72360a86-2c72-4b82-b70d-ee7e0ee5721d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:25.285493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72360a86-2c72-4b82-b70d-ee7e0ee5721d admin admin] PATH_INFO: `/v3/projects/1719d319e0f045e8958ed817eb36214b/users/e4bd3d85c12d4d17bfe25dea81421f5f/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:25.293638 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2593/5251] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:25.294619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173b2bb-39a5-473f-9c5c-ee5be27459d2 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:25.310757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173b2bb-39a5-473f-9c5c-ee5be27459d2 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:25.318667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72360a86-2c72-4b82-b70d-ee7e0ee5721d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1719d319e0f045e8958ed817eb36214b, user_id=e4bd3d85c12d4d17bfe25dea81421f5f, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:25.318993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a977ea4-e330-4646-9760-73eb8ebca4af tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bee2e3a52c499ea3207625117ccfac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c59a670c2d446bcb62aa6b9454ef426', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:25.319701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977ea4-e330-4646-9760-73eb8ebca4af tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:25.319998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977ea4-e330-4646-9760-73eb8ebca4af tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:25.320312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977ea4-e330-4646-9760-73eb8ebca4af tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:25.321351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a977ea4-e330-4646-9760-73eb8ebca4af tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:25.326103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a977ea4-e330-4646-9760-73eb8ebca4af tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:25.326290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72360a86-2c72-4b82-b70d-ee7e0ee5721d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:25.333656 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-2a977ea4-e330-4646-9760-73eb8ebca4af tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Invalid input for field 'name': '' is too short Dec 18 21:02:25.333656 ncdv-master-1 devstack@keystone.service[96645]: Failed validating 'minLength' in schema['properties']['name']: Dec 18 21:02:25.333656 ncdv-master-1 devstack@keystone.service[96645]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Dec 18 21:02:25.333656 ncdv-master-1 devstack@keystone.service[96645]: On instance['name']: Dec 18 21:02:25.333656 ncdv-master-1 devstack@keystone.service[96645]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Dec 18 21:02:25.339165 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2594/5252] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:02:25 2021] POST /identity/v3/projects => generated 283 bytes in 45 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 18 21:02:25.345520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a977ea4-e330-4646-9760-73eb8ebca4af tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:25.362689 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2659/5253] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:25 2021] PUT /identity/v3/projects/1719d319e0f045e8958ed817eb36214b/users/e4bd3d85c12d4d17bfe25dea81421f5f/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:25.368679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a977ea4-e330-4646-9760-73eb8ebca4af tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:25.374051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730a072-3557-4053-9ae7-3817c412beb9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:25.374620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730a072-3557-4053-9ae7-3817c412beb9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:25.375083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730a072-3557-4053-9ae7-3817c412beb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:25.421160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8730a072-3557-4053-9ae7-3817c412beb9 None None] MFA Rules not processed for user `e4bd3d85c12d4d17bfe25dea81421f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:25.422826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8730a072-3557-4053-9ae7-3817c412beb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:25.455103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc70795-b526-4829-b8d8-468e60f600b3 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bee2e3a52c499ea3207625117ccfac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c59a670c2d446bcb62aa6b9454ef426', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:25.457806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc70795-b526-4829-b8d8-468e60f600b3 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:25.458186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc70795-b526-4829-b8d8-468e60f600b3 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:25.458659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc70795-b526-4829-b8d8-468e60f600b3 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:25.460051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc70795-b526-4829-b8d8-468e60f600b3 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:25.461435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc70795-b526-4829-b8d8-468e60f600b3 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:25.472543 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-ffc70795-b526-4829-b8d8-468e60f600b3 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Dec 18 21:02:25.472543 ncdv-master-1 devstack@keystone.service[96645]: Failed validating 'maxLength' in schema['properties']['name']: Dec 18 21:02:25.472543 ncdv-master-1 devstack@keystone.service[96645]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Dec 18 21:02:25.472543 ncdv-master-1 devstack@keystone.service[96645]: On instance['name']: Dec 18 21:02:25.472543 ncdv-master-1 devstack@keystone.service[96645]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Dec 18 21:02:25.475622 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2595/5254] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:02:25 2021] POST /identity/v3/projects => generated 412 bytes in 131 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 18 21:02:25.479013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc70795-b526-4829-b8d8-468e60f600b3 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:25.481116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ffc70795-b526-4829-b8d8-468e60f600b3 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:25.515419 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2660/5255] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:25 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:25.516961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730a072-3557-4053-9ae7-3817c412beb9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:25.530518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730a072-3557-4053-9ae7-3817c412beb9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:25.536079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8faac17-6aff-48e8-97ea-16dea0197f1d tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bee2e3a52c499ea3207625117ccfac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c59a670c2d446bcb62aa6b9454ef426', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:25.536884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faac17-6aff-48e8-97ea-16dea0197f1d tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:25.537100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faac17-6aff-48e8-97ea-16dea0197f1d tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:25.537387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faac17-6aff-48e8-97ea-16dea0197f1d tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] PATH_INFO: `/v3/projects/4529527ecbf14af8bc78a925e9aff3ca` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:25.547632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8faac17-6aff-48e8-97ea-16dea0197f1d tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4529527ecbf14af8bc78a925e9aff3ca)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:25.549893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8faac17-6aff-48e8-97ea-16dea0197f1d tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:25.577939 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-f8faac17-6aff-48e8-97ea-16dea0197f1d tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Could not find project: 4529527ecbf14af8bc78a925e9aff3ca.: keystone.exception.ProjectNotFound: Could not find project: 4529527ecbf14af8bc78a925e9aff3ca. Dec 18 21:02:25.582316 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2661/5256] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:25 2021] DELETE /identity/v3/projects/4529527ecbf14af8bc78a925e9aff3ca => generated 113 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:02:25.582316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8faac17-6aff-48e8-97ea-16dea0197f1d tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:25.585135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f8faac17-6aff-48e8-97ea-16dea0197f1d tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:25.594599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc70795-b526-4829-b8d8-468e60f600b3 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:25.601657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17774119-bd67-4bfc-901a-1cc56303ba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:25.602837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17774119-bd67-4bfc-901a-1cc56303ba11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:25.603200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17774119-bd67-4bfc-901a-1cc56303ba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:25.603599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17774119-bd67-4bfc-901a-1cc56303ba11 admin admin] PATH_INFO: `/v3/users/54121b5d80d64c4796889183c5197853` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:25.604962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17774119-bd67-4bfc-901a-1cc56303ba11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54121b5d80d64c4796889183c5197853)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:25.607899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17774119-bd67-4bfc-901a-1cc56303ba11 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:25.682888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-17774119-bd67-4bfc-901a-1cc56303ba11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54121b5d80d64c4796889183c5197853'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:25.692715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-17774119-bd67-4bfc-901a-1cc56303ba11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54121b5d80d64c4796889183c5197853'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:25.708214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-17774119-bd67-4bfc-901a-1cc56303ba11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54121b5d80d64c4796889183c5197853'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:25.710407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-17774119-bd67-4bfc-901a-1cc56303ba11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54121b5d80d64c4796889183c5197853'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:25.721785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-17774119-bd67-4bfc-901a-1cc56303ba11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54121b5d80d64c4796889183c5197853'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:25.734032 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2596/5257] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:25 2021] DELETE /identity/v3/users/54121b5d80d64c4796889183c5197853 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:25.734032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17774119-bd67-4bfc-901a-1cc56303ba11 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:25.747566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-17774119-bd67-4bfc-901a-1cc56303ba11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:25.845586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8faac17-6aff-48e8-97ea-16dea0197f1d tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:25.858824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17774119-bd67-4bfc-901a-1cc56303ba11 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:25.865996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b89a9-d6b8-4bd4-b9e1-3dd1d027d2db tempest-ProjectsNegativeStaticTestJSON-302940496 tempest-ProjectsNegativeStaticTestJSON-302940496-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b3c202cfeb4ef78d8917e660cfbb65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '614a99fa0fc14f4ebd02bf31e9ff9def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:25.867101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b89a9-d6b8-4bd4-b9e1-3dd1d027d2db tempest-ProjectsNegativeStaticTestJSON-302940496 tempest-ProjectsNegativeStaticTestJSON-302940496-project] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:25.867720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b89a9-d6b8-4bd4-b9e1-3dd1d027d2db tempest-ProjectsNegativeStaticTestJSON-302940496 tempest-ProjectsNegativeStaticTestJSON-302940496-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:25.868216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b89a9-d6b8-4bd4-b9e1-3dd1d027d2db tempest-ProjectsNegativeStaticTestJSON-302940496 tempest-ProjectsNegativeStaticTestJSON-302940496-project] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:25.869973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b89a9-d6b8-4bd4-b9e1-3dd1d027d2db tempest-ProjectsNegativeStaticTestJSON-302940496 tempest-ProjectsNegativeStaticTestJSON-302940496-project] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:25.878933 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-355b89a9-d6b8-4bd4-b9e1-3dd1d027d2db tempest-ProjectsNegativeStaticTestJSON-302940496 tempest-ProjectsNegativeStaticTestJSON-302940496-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Dec 18 21:02:25.881589 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2597/5258] 10.222.0.13 () {58 vars in 1130 bytes} [Sat Dec 18 21:02:25 2021] GET /identity/v3/projects => generated 135 bytes in 150 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:02:25.883289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b89a9-d6b8-4bd4-b9e1-3dd1d027d2db tempest-ProjectsNegativeStaticTestJSON-302940496 tempest-ProjectsNegativeStaticTestJSON-302940496-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:25.885233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-355b89a9-d6b8-4bd4-b9e1-3dd1d027d2db tempest-ProjectsNegativeStaticTestJSON-302940496 tempest-ProjectsNegativeStaticTestJSON-302940496-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:25.913137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c4971-6a83-4b48-afaf-f6d0821b79bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:25.913636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c4971-6a83-4b48-afaf-f6d0821b79bd service glance] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:25.914425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c4971-6a83-4b48-afaf-f6d0821b79bd service glance] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:25.914793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c4971-6a83-4b48-afaf-f6d0821b79bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:25.917489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c85c4971-6a83-4b48-afaf-f6d0821b79bd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:25.985212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b89a9-d6b8-4bd4-b9e1-3dd1d027d2db tempest-ProjectsNegativeStaticTestJSON-302940496 tempest-ProjectsNegativeStaticTestJSON-302940496-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:25.997054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:25.998599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:25.998995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:25.999921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80 admin admin] PATH_INFO: `/v3/projects/967d31f31db148e8a2a8fd17f29daace` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:26.001458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=967d31f31db148e8a2a8fd17f29daace)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:26.005423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:26.015945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c4971-6a83-4b48-afaf-f6d0821b79bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:26.017948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c4971-6a83-4b48-afaf-f6d0821b79bd service glance] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:26.032682 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2662/5259] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:25 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:26.033512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c4971-6a83-4b48-afaf-f6d0821b79bd service glance] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:26.035285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c85c4971-6a83-4b48-afaf-f6d0821b79bd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:26.100311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '967d31f31db148e8a2a8fd17f29daace', 'request_id': 'req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.112196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '967d31f31db148e8a2a8fd17f29daace', 'request_id': 'req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.116240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c4971-6a83-4b48-afaf-f6d0821b79bd service glance] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:26.123781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '967d31f31db148e8a2a8fd17f29daace', 'request_id': 'req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.137905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80 admin admin] The token cache is being invalidate because project 967d31f31db148e8a2a8fd17f29daace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:26.138281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.138934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.140725 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2598/5260] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:25 2021] DELETE /identity/v3/projects/967d31f31db148e8a2a8fd17f29daace => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:26.141424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:26.142879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:26.184432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cd710-29d7-4ee7-8d2c-42ffca21e95e tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bee2e3a52c499ea3207625117ccfac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c59a670c2d446bcb62aa6b9454ef426', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:26.185226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cd710-29d7-4ee7-8d2c-42ffca21e95e tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:26.185869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cd710-29d7-4ee7-8d2c-42ffca21e95e tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:26.186281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cd710-29d7-4ee7-8d2c-42ffca21e95e tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:26.187132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cd710-29d7-4ee7-8d2c-42ffca21e95e tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:26.189294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cd710-29d7-4ee7-8d2c-42ffca21e95e tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:26.216592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65bb0d-ebcb-4ee6-a100-1f88382cbd80 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:26.222010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:26.222916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:26.223203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:26.223481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78 admin admin] PATH_INFO: `/v3/projects/653558ed3d3248ea8f07a3066b6c3d88` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:26.224697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=653558ed3d3248ea8f07a3066b6c3d88)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:26.229211 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2663/5261] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:26 2021] POST /identity/v3/projects => generated 356 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:26.229393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:26.229501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554f80b-4557-47ba-92f7-0d02de1ea2f9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:26.229501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554f80b-4557-47ba-92f7-0d02de1ea2f9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:26.229501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554f80b-4557-47ba-92f7-0d02de1ea2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:26.250477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2554f80b-4557-47ba-92f7-0d02de1ea2f9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:26.252030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2554f80b-4557-47ba-92f7-0d02de1ea2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:26.277064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '653558ed3d3248ea8f07a3066b6c3d88', 'request_id': 'req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.283207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '653558ed3d3248ea8f07a3066b6c3d88', 'request_id': 'req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.290935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '653558ed3d3248ea8f07a3066b6c3d88', 'request_id': 'req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.304299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78 admin admin] The token cache is being invalidate because project 653558ed3d3248ea8f07a3066b6c3d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:26.304857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.305384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.307322 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2599/5262] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:26 2021] DELETE /identity/v3/projects/653558ed3d3248ea8f07a3066b6c3d88 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:26.308144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:26.309668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:26.320558 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2664/5263] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:26.321695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2bbf-7b48-4a44-968f-80887bc9a365 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:26.322221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2bbf-7b48-4a44-968f-80887bc9a365 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:26.322636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2bbf-7b48-4a44-968f-80887bc9a365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:26.341913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d9ba2bbf-7b48-4a44-968f-80887bc9a365 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:26.343391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d9ba2bbf-7b48-4a44-968f-80887bc9a365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:26.386522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e1511-0ee3-40b9-9658-9f7a3552ee78 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:26.392051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea9d18-7af0-4334-874b-f9d25356294b tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bee2e3a52c499ea3207625117ccfac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c59a670c2d446bcb62aa6b9454ef426', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:26.392809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea9d18-7af0-4334-874b-f9d25356294b tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:26.393118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea9d18-7af0-4334-874b-f9d25356294b tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:26.393402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea9d18-7af0-4334-874b-f9d25356294b tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:26.394148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea9d18-7af0-4334-874b-f9d25356294b tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:26.396170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea9d18-7af0-4334-874b-f9d25356294b tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:26.413007 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2665/5264] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:26.413007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b445e5-7f14-4c3f-a3c3-fcf630596639 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:26.413863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b445e5-7f14-4c3f-a3c3-fcf630596639 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:26.414152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b445e5-7f14-4c3f-a3c3-fcf630596639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:26.423694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.sql.core [None req-62ea9d18-7af0-4334-874b-f9d25356294b tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-71861110' for key 'project.ixu_project_name_domain_id'") Dec 18 21:02:26.423694 ncdv-master-1 devstack@keystone.service[96645]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 18 21:02:26.423694 ncdv-master-1 devstack@keystone.service[96645]: [parameters: {'id': 'b7b6dfda2bec4c7ea9d80b22481f968f', 'name': 'tempest-project-dup-71861110', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 18 21:02:26.423694 ncdv-master-1 devstack@keystone.service[96645]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96645) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 18 21:02:26.441258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-00b445e5-7f14-4c3f-a3c3-fcf630596639 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:26.444547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-00b445e5-7f14-4c3f-a3c3-fcf630596639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:26.453452 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2666/5265] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:26.456786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3843b9f-9c45-4399-ac0c-c4128b496e7e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:26.456786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3843b9f-9c45-4399-ac0c-c4128b496e7e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:26.456786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3843b9f-9c45-4399-ac0c-c4128b496e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:26.462078 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-62ea9d18-7af0-4334-874b-f9d25356294b tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-71861110, project id b7b6dfda2bec4c7ea9d80b22481f968f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-71861110, project id b7b6dfda2bec4c7ea9d80b22481f968f. Dec 18 21:02:26.465569 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2600/5266] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:02:26 2021] POST /identity/v3/projects => generated 283 bytes in 158 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 18 21:02:26.467004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea9d18-7af0-4334-874b-f9d25356294b tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:26.477737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b3843b9f-9c45-4399-ac0c-c4128b496e7e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:26.479499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b3843b9f-9c45-4399-ac0c-c4128b496e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:26.483777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea9d18-7af0-4334-874b-f9d25356294b tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:26.489525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f977b-36f2-42d7-bfe8-391a495eab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:26.490383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f977b-36f2-42d7-bfe8-391a495eab7f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:26.490750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f977b-36f2-42d7-bfe8-391a495eab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:26.491298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f977b-36f2-42d7-bfe8-391a495eab7f admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:26.492429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f977b-36f2-42d7-bfe8-391a495eab7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:26.492893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f977b-36f2-42d7-bfe8-391a495eab7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:26.495633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f977b-36f2-42d7-bfe8-391a495eab7f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:26.512623 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2667/5268] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:26.512827 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2601/5268] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:26.513732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f977b-36f2-42d7-bfe8-391a495eab7f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:26.514207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3843b9f-9c45-4399-ac0c-c4128b496e7e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:26.524125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3843b9f-9c45-4399-ac0c-c4128b496e7e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:26.527088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f977b-36f2-42d7-bfe8-391a495eab7f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:26.531409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cf290-3d0b-455e-8ccb-cfac4b455821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:26.532881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf290-3d0b-455e-8ccb-cfac4b455821 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:26.533206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf290-3d0b-455e-8ccb-cfac4b455821 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:26.533557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf290-3d0b-455e-8ccb-cfac4b455821 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:26.534198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf496a9-585f-4493-a549-26da8372b618 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bee2e3a52c499ea3207625117ccfac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c59a670c2d446bcb62aa6b9454ef426', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:26.534486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cf290-3d0b-455e-8ccb-cfac4b455821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:26.534861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cf290-3d0b-455e-8ccb-cfac4b455821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:26.535394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf496a9-585f-4493-a549-26da8372b618 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:26.535394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf496a9-585f-4493-a549-26da8372b618 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:26.536110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf496a9-585f-4493-a549-26da8372b618 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] PATH_INFO: `/v3/projects/9bee82469e1e43e8b8d32590d3462660` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:26.537061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cf290-3d0b-455e-8ccb-cfac4b455821 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:26.537850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf496a9-585f-4493-a549-26da8372b618 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9bee82469e1e43e8b8d32590d3462660)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:26.540151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf496a9-585f-4493-a549-26da8372b618 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:26.552282 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2668/5269] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:26.553198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cf290-3d0b-455e-8ccb-cfac4b455821 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:26.563948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cf290-3d0b-455e-8ccb-cfac4b455821 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:26.569147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8b066-716b-4448-ac2e-b031a2b0743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:26.569808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8b066-716b-4448-ac2e-b031a2b0743f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:26.570093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8b066-716b-4448-ac2e-b031a2b0743f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:26.570549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8b066-716b-4448-ac2e-b031a2b0743f admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:26.571325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8b066-716b-4448-ac2e-b031a2b0743f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:26.573697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8b066-716b-4448-ac2e-b031a2b0743f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:26.604773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9bf496a9-585f-4493-a549-26da8372b618 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bee82469e1e43e8b8d32590d3462660', 'request_id': 'req-9bf496a9-585f-4493-a549-26da8372b618'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.610398 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2669/5270] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:26 2021] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:26.611329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8b066-716b-4448-ac2e-b031a2b0743f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:26.613224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9bf496a9-585f-4493-a549-26da8372b618 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bee82469e1e43e8b8d32590d3462660', 'request_id': 'req-9bf496a9-585f-4493-a549-26da8372b618'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.619915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9bf496a9-585f-4493-a549-26da8372b618 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bee82469e1e43e8b8d32590d3462660', 'request_id': 'req-9bf496a9-585f-4493-a549-26da8372b618'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.635831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9bf496a9-585f-4493-a549-26da8372b618 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] The token cache is being invalidate because project 9bee82469e1e43e8b8d32590d3462660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:26.636212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9bf496a9-585f-4493-a549-26da8372b618 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.637082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9bf496a9-585f-4493-a549-26da8372b618 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.643125 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2602/5271] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:26 2021] DELETE /identity/v3/projects/9bee82469e1e43e8b8d32590d3462660 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:26.643125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf496a9-585f-4493-a549-26da8372b618 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:26.643125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9bf496a9-585f-4493-a549-26da8372b618 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:26.695673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8b066-716b-4448-ac2e-b031a2b0743f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:26.702536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8294a2c-cf19-42b2-ab26-0571360223ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:26.703306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8294a2c-cf19-42b2-ab26-0571360223ce admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:26.703465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8294a2c-cf19-42b2-ab26-0571360223ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:26.703738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8294a2c-cf19-42b2-ab26-0571360223ce admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:26.704432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8294a2c-cf19-42b2-ab26-0571360223ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:26.706363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8294a2c-cf19-42b2-ab26-0571360223ce admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:26.727431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf496a9-585f-4493-a549-26da8372b618 tempest-ProjectsNegativeStaticTestJSON-1780766216 tempest-ProjectsNegativeStaticTestJSON-1780766216-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:26.734968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8d8de-87ef-42ae-9348-b4558ab30ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:26.735847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8d8de-87ef-42ae-9348-b4558ab30ffb admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:26.736144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8d8de-87ef-42ae-9348-b4558ab30ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:26.736564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8d8de-87ef-42ae-9348-b4558ab30ffb admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:26.737400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8d8de-87ef-42ae-9348-b4558ab30ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:26.739511 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2670/5272] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:26 2021] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:26.740393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8d8de-87ef-42ae-9348-b4558ab30ffb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:26.740563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8294a2c-cf19-42b2-ab26-0571360223ce admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:26.744423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b8294a2c-cf19-42b2-ab26-0571360223ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:26.761702 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2603/5273] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:26 2021] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:26.762592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8d8de-87ef-42ae-9348-b4558ab30ffb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:26.764098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e9a8d8de-87ef-42ae-9348-b4558ab30ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:26.776158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8d8de-87ef-42ae-9348-b4558ab30ffb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:26.808100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8294a2c-cf19-42b2-ab26-0571360223ce admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:26.812643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a19e8c-cd45-4c42-b6c0-23e43d59d38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:26.813496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a19e8c-cd45-4c42-b6c0-23e43d59d38d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:26.813777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a19e8c-cd45-4c42-b6c0-23e43d59d38d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:26.814048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a19e8c-cd45-4c42-b6c0-23e43d59d38d admin admin] PATH_INFO: `/v3/users/e5b3c202cfeb4ef78d8917e660cfbb65` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:26.815378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a19e8c-cd45-4c42-b6c0-23e43d59d38d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5b3c202cfeb4ef78d8917e660cfbb65)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:26.817522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a19e8c-cd45-4c42-b6c0-23e43d59d38d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:26.830590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab329c7-4e91-4777-ab7e-069960ecd1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:26.831389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab329c7-4e91-4777-ab7e-069960ecd1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:26.831683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab329c7-4e91-4777-ab7e-069960ecd1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:26.831964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab329c7-4e91-4777-ab7e-069960ecd1f2 admin admin] PATH_INFO: `/v3/users/6d509fd68e964314ad912b4d74140b63` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:26.833195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab329c7-4e91-4777-ab7e-069960ecd1f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d509fd68e964314ad912b4d74140b63)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:26.835137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab329c7-4e91-4777-ab7e-069960ecd1f2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:26.863632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0a19e8c-cd45-4c42-b6c0-23e43d59d38d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5b3c202cfeb4ef78d8917e660cfbb65'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.871024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0a19e8c-cd45-4c42-b6c0-23e43d59d38d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5b3c202cfeb4ef78d8917e660cfbb65'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.871989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0a19e8c-cd45-4c42-b6c0-23e43d59d38d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5b3c202cfeb4ef78d8917e660cfbb65'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.880808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5ab329c7-4e91-4777-ab7e-069960ecd1f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d509fd68e964314ad912b4d74140b63'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.883887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0a19e8c-cd45-4c42-b6c0-23e43d59d38d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5b3c202cfeb4ef78d8917e660cfbb65'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.888988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5ab329c7-4e91-4777-ab7e-069960ecd1f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d509fd68e964314ad912b4d74140b63'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.893725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0a19e8c-cd45-4c42-b6c0-23e43d59d38d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5b3c202cfeb4ef78d8917e660cfbb65'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.902539 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2671/5274] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:26 2021] DELETE /identity/v3/users/e5b3c202cfeb4ef78d8917e660cfbb65 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:26.906398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5ab329c7-4e91-4777-ab7e-069960ecd1f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d509fd68e964314ad912b4d74140b63'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.907144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5ab329c7-4e91-4777-ab7e-069960ecd1f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d509fd68e964314ad912b4d74140b63'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.907337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a19e8c-cd45-4c42-b6c0-23e43d59d38d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:26.908779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d0a19e8c-cd45-4c42-b6c0-23e43d59d38d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:26.916987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5ab329c7-4e91-4777-ab7e-069960ecd1f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d509fd68e964314ad912b4d74140b63'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:26.923410 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2604/5275] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:26 2021] DELETE /identity/v3/users/6d509fd68e964314ad912b4d74140b63 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:26.924200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab329c7-4e91-4777-ab7e-069960ecd1f2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:26.925533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5ab329c7-4e91-4777-ab7e-069960ecd1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:26.977050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a19e8c-cd45-4c42-b6c0-23e43d59d38d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:26.987725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab329c7-4e91-4777-ab7e-069960ecd1f2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:26.992447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdba2f-47fa-48c8-9894-1f49c012708b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:26.993108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdba2f-47fa-48c8-9894-1f49c012708b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:26.993394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdba2f-47fa-48c8-9894-1f49c012708b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:26.993674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdba2f-47fa-48c8-9894-1f49c012708b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:26.994963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdba2f-47fa-48c8-9894-1f49c012708b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:26.996550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdba2f-47fa-48c8-9894-1f49c012708b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:27.006415 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2605/5276] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:26 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:27.007510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c59a70-37b5-4db8-9895-a6451fec53b3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.007807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c59a70-37b5-4db8-9895-a6451fec53b3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.008090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c59a70-37b5-4db8-9895-a6451fec53b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.025469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-07c59a70-37b5-4db8-9895-a6451fec53b3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:27.026685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-07c59a70-37b5-4db8-9895-a6451fec53b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:27.032162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ce166-0f17-44e0-a519-d69360be9ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:27.032837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ce166-0f17-44e0-a519-d69360be9ead admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.033121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ce166-0f17-44e0-a519-d69360be9ead admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.033399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ce166-0f17-44e0-a519-d69360be9ead admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.034097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ce166-0f17-44e0-a519-d69360be9ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:27.037523 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2606/5277] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:27.037523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9c518-b9a4-45fc-a90d-69aaf9436a26 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.037523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9c518-b9a4-45fc-a90d-69aaf9436a26 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.037886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ce166-0f17-44e0-a519-d69360be9ead admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:27.038572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9c518-b9a4-45fc-a90d-69aaf9436a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.060506 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2672/5278] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:26 2021] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:27.061426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-22b9c518-b9a4-45fc-a90d-69aaf9436a26 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:27.061531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ce166-0f17-44e0-a519-d69360be9ead admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:27.061621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-22b9c518-b9a4-45fc-a90d-69aaf9436a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:27.068031 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2607/5279] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:27.068708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9c518-b9a4-45fc-a90d-69aaf9436a26 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:27.070158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-22b9c518-b9a4-45fc-a90d-69aaf9436a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:27.075641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ce166-0f17-44e0-a519-d69360be9ead admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:27.080727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea6e6a-e292-4e42-b8b4-cf7011a45f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:27.081797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea6e6a-e292-4e42-b8b4-cf7011a45f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.082163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea6e6a-e292-4e42-b8b4-cf7011a45f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.082539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea6e6a-e292-4e42-b8b4-cf7011a45f34 admin admin] PATH_INFO: `/v3/projects/7d39c44ab1d948c1aa6b6dec003fb9e8/users/e9422d65d2774f0fa07bc35bcefada02/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.098923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea6e6a-e292-4e42-b8b4-cf7011a45f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d39c44ab1d948c1aa6b6dec003fb9e8, user_id=e9422d65d2774f0fa07bc35bcefada02, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:27.101711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea6e6a-e292-4e42-b8b4-cf7011a45f34 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:27.118174 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2673/5280] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:27 2021] PUT /identity/v3/projects/7d39c44ab1d948c1aa6b6dec003fb9e8/users/e9422d65d2774f0fa07bc35bcefada02/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:27.119168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea6e6a-e292-4e42-b8b4-cf7011a45f34 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:27.121034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-62ea6e6a-e292-4e42-b8b4-cf7011a45f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:27.137373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9c518-b9a4-45fc-a90d-69aaf9436a26 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:27.192137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea6e6a-e292-4e42-b8b4-cf7011a45f34 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:27.194693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5594f7-4bef-442d-9a8e-d4cdf8122d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:27.195552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5594f7-4bef-442d-9a8e-d4cdf8122d8b service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.196023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5594f7-4bef-442d-9a8e-d4cdf8122d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.196303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5594f7-4bef-442d-9a8e-d4cdf8122d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.197056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb03392-de19-46d4-9c8f-8c0de689446c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:27.197779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb03392-de19-46d4-9c8f-8c0de689446c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.198067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb03392-de19-46d4-9c8f-8c0de689446c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.198380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb03392-de19-46d4-9c8f-8c0de689446c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.199140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb03392-de19-46d4-9c8f-8c0de689446c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:27.200868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb03392-de19-46d4-9c8f-8c0de689446c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:27.206030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5594f7-4bef-442d-9a8e-d4cdf8122d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:27.207557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5594f7-4bef-442d-9a8e-d4cdf8122d8b service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:27.214774 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2674/5281] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:27 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:27.214774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb03392-de19-46d4-9c8f-8c0de689446c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:27.226169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb03392-de19-46d4-9c8f-8c0de689446c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:27.230344 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2608/5282] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:27.231940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5594f7-4bef-442d-9a8e-d4cdf8122d8b service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:27.237668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574d591-1275-4768-b0d2-41a9598df0c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:27.238671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574d591-1275-4768-b0d2-41a9598df0c3 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.239159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574d591-1275-4768-b0d2-41a9598df0c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.239443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574d591-1275-4768-b0d2-41a9598df0c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.244682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5594f7-4bef-442d-9a8e-d4cdf8122d8b service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:27.249553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574d591-1275-4768-b0d2-41a9598df0c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:27.250204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a39ed-75ce-4000-a749-1ea6c73ede33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:27.251055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574d591-1275-4768-b0d2-41a9598df0c3 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:27.251303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a39ed-75ce-4000-a749-1ea6c73ede33 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.251683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a39ed-75ce-4000-a749-1ea6c73ede33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.260423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a39ed-75ce-4000-a749-1ea6c73ede33 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.261655 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2675/5283] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:27.261823 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a39ed-75ce-4000-a749-1ea6c73ede33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:27.262362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574d591-1275-4768-b0d2-41a9598df0c3 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:27.263632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a39ed-75ce-4000-a749-1ea6c73ede33 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:27.272525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574d591-1275-4768-b0d2-41a9598df0c3 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:27.277800 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2609/5284] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:27 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:27.280848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c470af-76e8-4128-9d56-db808b6a7f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:27.281939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a39ed-75ce-4000-a749-1ea6c73ede33 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:27.283349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c470af-76e8-4128-9d56-db808b6a7f7c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.283902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c470af-76e8-4128-9d56-db808b6a7f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.284541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c470af-76e8-4128-9d56-db808b6a7f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.285498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c470af-76e8-4128-9d56-db808b6a7f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:27.288058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c470af-76e8-4128-9d56-db808b6a7f7c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:27.294172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a39ed-75ce-4000-a749-1ea6c73ede33 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:27.299915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcdc6c-d947-4409-ae98-8080f9d5365a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:27.300788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcdc6c-d947-4409-ae98-8080f9d5365a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.301318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcdc6c-d947-4409-ae98-8080f9d5365a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.301697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcdc6c-d947-4409-ae98-8080f9d5365a admin admin] PATH_INFO: `/v3/projects/7d39c44ab1d948c1aa6b6dec003fb9e8/users/e9422d65d2774f0fa07bc35bcefada02/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.304145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcdc6c-d947-4409-ae98-8080f9d5365a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d39c44ab1d948c1aa6b6dec003fb9e8, user_id=e9422d65d2774f0fa07bc35bcefada02, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:27.304715 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2676/5285] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:27 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:27.308064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcdc6c-d947-4409-ae98-8080f9d5365a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:27.308909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c470af-76e8-4128-9d56-db808b6a7f7c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:27.321565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c470af-76e8-4128-9d56-db808b6a7f7c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:27.325612 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2610/5286] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:27 2021] PUT /identity/v3/projects/7d39c44ab1d948c1aa6b6dec003fb9e8/users/e9422d65d2774f0fa07bc35bcefada02/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:27.336164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c34946-01b0-49ec-b8e1-eaa73fbe8043 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.336378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c34946-01b0-49ec-b8e1-eaa73fbe8043 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.337285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c34946-01b0-49ec-b8e1-eaa73fbe8043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.370727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f3c34946-01b0-49ec-b8e1-eaa73fbe8043 None None] MFA Rules not processed for user `e9422d65d2774f0fa07bc35bcefada02`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:27.372191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f3c34946-01b0-49ec-b8e1-eaa73fbe8043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:27.386387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e3ac7-b10b-4d3d-8876-0f12afb6d853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:27.387409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e3ac7-b10b-4d3d-8876-0f12afb6d853 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.387584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e3ac7-b10b-4d3d-8876-0f12afb6d853 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.387842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e3ac7-b10b-4d3d-8876-0f12afb6d853 admin admin] PATH_INFO: `/v3/projects/a437811487424144a39cf7205f4646fb/users/026afcda165f437cbd8dc3a854a14c95/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.408643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e3ac7-b10b-4d3d-8876-0f12afb6d853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a437811487424144a39cf7205f4646fb, user_id=026afcda165f437cbd8dc3a854a14c95, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:27.417705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e3ac7-b10b-4d3d-8876-0f12afb6d853 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:27.438403 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2677/5287] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:27 2021] PUT /identity/v3/projects/a437811487424144a39cf7205f4646fb/users/026afcda165f437cbd8dc3a854a14c95/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:02:27.442090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3f8c5-ed8d-4df4-9035-c543d774b011 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.442637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3f8c5-ed8d-4df4-9035-c543d774b011 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.443190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3f8c5-ed8d-4df4-9035-c543d774b011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.466764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6cd3f8c5-ed8d-4df4-9035-c543d774b011 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:27.468072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6cd3f8c5-ed8d-4df4-9035-c543d774b011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:27.472855 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2611/5288] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:27 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:27.477271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c34946-01b0-49ec-b8e1-eaa73fbe8043 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:27.487985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c34946-01b0-49ec-b8e1-eaa73fbe8043 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:27.566039 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2678/5289] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:27.578700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3f8c5-ed8d-4df4-9035-c543d774b011 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:27.580727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6cd3f8c5-ed8d-4df4-9035-c543d774b011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:27.612533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b9c0c-fa7d-4d81-ab60-0f0e575685c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:27.613232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b9c0c-fa7d-4d81-ab60-0f0e575685c8 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.613632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b9c0c-fa7d-4d81-ab60-0f0e575685c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.614068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b9c0c-fa7d-4d81-ab60-0f0e575685c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.615402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b9c0c-fa7d-4d81-ab60-0f0e575685c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:27.617622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b9c0c-fa7d-4d81-ab60-0f0e575685c8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:27.665304 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2612/5290] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:27 2021] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:27.669799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b9c0c-fa7d-4d81-ab60-0f0e575685c8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:27.699429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3f8c5-ed8d-4df4-9035-c543d774b011 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:27.772350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b9c0c-fa7d-4d81-ab60-0f0e575685c8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:27.784389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39caca15-b0fe-4b07-809f-dce25944b874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:27.785130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caca15-b0fe-4b07-809f-dce25944b874 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.785458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caca15-b0fe-4b07-809f-dce25944b874 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.786724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caca15-b0fe-4b07-809f-dce25944b874 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.787927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39caca15-b0fe-4b07-809f-dce25944b874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:27.790790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39caca15-b0fe-4b07-809f-dce25944b874 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:27.810475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcc7ec-4520-4f95-82c4-292da4f38036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:27.811287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcc7ec-4520-4f95-82c4-292da4f38036 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.811676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcc7ec-4520-4f95-82c4-292da4f38036 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.812072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcc7ec-4520-4f95-82c4-292da4f38036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.824606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fcc7ec-4520-4f95-82c4-292da4f38036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:27.826479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fcc7ec-4520-4f95-82c4-292da4f38036 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:27.837657 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2613/5291] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:27 2021] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:27.837876 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2679/5292] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:27.839106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39caca15-b0fe-4b07-809f-dce25944b874 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:27.849270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39caca15-b0fe-4b07-809f-dce25944b874 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:27.855835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcc7ec-4520-4f95-82c4-292da4f38036 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:27.857359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c7fcc7ec-4520-4f95-82c4-292da4f38036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:27.858564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a776e-65e1-4834-be2b-6b80971ab81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:27.859303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a776e-65e1-4834-be2b-6b80971ab81a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.859591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a776e-65e1-4834-be2b-6b80971ab81a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.859876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a776e-65e1-4834-be2b-6b80971ab81a admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.860620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a776e-65e1-4834-be2b-6b80971ab81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:27.862316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a776e-65e1-4834-be2b-6b80971ab81a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:27.874483 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2614/5293] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:27 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:27.878619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a776e-65e1-4834-be2b-6b80971ab81a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:27.880109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcc7ec-4520-4f95-82c4-292da4f38036 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:27.894835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb053a73-fb79-439f-9069-a0f1fd979fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:27.895723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb053a73-fb79-439f-9069-a0f1fd979fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.896009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb053a73-fb79-439f-9069-a0f1fd979fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.896290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb053a73-fb79-439f-9069-a0f1fd979fc7 admin admin] PATH_INFO: `/v3/projects/7f92b96b96f940aebbda4ed82cee846e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.897587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb053a73-fb79-439f-9069-a0f1fd979fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f92b96b96f940aebbda4ed82cee846e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:27.898685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a776e-65e1-4834-be2b-6b80971ab81a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:27.899548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb053a73-fb79-439f-9069-a0f1fd979fc7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:27.903727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dce4b-a43c-4829-ba74-420240fa4d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:27.905475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dce4b-a43c-4829-ba74-420240fa4d85 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.906469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dce4b-a43c-4829-ba74-420240fa4d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.907140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dce4b-a43c-4829-ba74-420240fa4d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.908005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8dce4b-a43c-4829-ba74-420240fa4d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:27.909715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8dce4b-a43c-4829-ba74-420240fa4d85 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:27.933961 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2615/5294] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:27 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:02:27.940798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dce4b-a43c-4829-ba74-420240fa4d85 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:27.950356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5c8dce4b-a43c-4829-ba74-420240fa4d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:27.965816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dce4b-a43c-4829-ba74-420240fa4d85 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:27.973625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05122361-c46a-4680-8446-4ed7e74fb2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:27.975090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05122361-c46a-4680-8446-4ed7e74fb2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:27.975324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05122361-c46a-4680-8446-4ed7e74fb2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:27.975560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05122361-c46a-4680-8446-4ed7e74fb2a7 admin admin] PATH_INFO: `/v3/projects/614a99fa0fc14f4ebd02bf31e9ff9def` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:27.977581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05122361-c46a-4680-8446-4ed7e74fb2a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=614a99fa0fc14f4ebd02bf31e9ff9def)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:27.980543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05122361-c46a-4680-8446-4ed7e74fb2a7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:27.999707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb053a73-fb79-439f-9069-a0f1fd979fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f92b96b96f940aebbda4ed82cee846e', 'request_id': 'req-cb053a73-fb79-439f-9069-a0f1fd979fc7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.014077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb053a73-fb79-439f-9069-a0f1fd979fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f92b96b96f940aebbda4ed82cee846e', 'request_id': 'req-cb053a73-fb79-439f-9069-a0f1fd979fc7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.024350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb053a73-fb79-439f-9069-a0f1fd979fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f92b96b96f940aebbda4ed82cee846e', 'request_id': 'req-cb053a73-fb79-439f-9069-a0f1fd979fc7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.042744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb053a73-fb79-439f-9069-a0f1fd979fc7 admin admin] The token cache is being invalidate because project 7f92b96b96f940aebbda4ed82cee846e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:28.043174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb053a73-fb79-439f-9069-a0f1fd979fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.044030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb053a73-fb79-439f-9069-a0f1fd979fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.046074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-05122361-c46a-4680-8446-4ed7e74fb2a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '614a99fa0fc14f4ebd02bf31e9ff9def', 'request_id': 'req-05122361-c46a-4680-8446-4ed7e74fb2a7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.046230 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2680/5295] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:27 2021] DELETE /identity/v3/projects/7f92b96b96f940aebbda4ed82cee846e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:28.050052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb053a73-fb79-439f-9069-a0f1fd979fc7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:28.052238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cb053a73-fb79-439f-9069-a0f1fd979fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:28.053440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-05122361-c46a-4680-8446-4ed7e74fb2a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '614a99fa0fc14f4ebd02bf31e9ff9def', 'request_id': 'req-05122361-c46a-4680-8446-4ed7e74fb2a7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.061084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-05122361-c46a-4680-8446-4ed7e74fb2a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '614a99fa0fc14f4ebd02bf31e9ff9def', 'request_id': 'req-05122361-c46a-4680-8446-4ed7e74fb2a7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.092385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-05122361-c46a-4680-8446-4ed7e74fb2a7 admin admin] The token cache is being invalidate because project 614a99fa0fc14f4ebd02bf31e9ff9def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:28.092934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-05122361-c46a-4680-8446-4ed7e74fb2a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.093685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-05122361-c46a-4680-8446-4ed7e74fb2a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.095751 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2616/5296] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:27 2021] DELETE /identity/v3/projects/614a99fa0fc14f4ebd02bf31e9ff9def => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:28.097167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05122361-c46a-4680-8446-4ed7e74fb2a7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:28.100590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-05122361-c46a-4680-8446-4ed7e74fb2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:28.176105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb053a73-fb79-439f-9069-a0f1fd979fc7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:28.198486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05122361-c46a-4680-8446-4ed7e74fb2a7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:28.204147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212063e-75dc-4473-9196-731383ef5f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:28.206687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212063e-75dc-4473-9196-731383ef5f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:28.207132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212063e-75dc-4473-9196-731383ef5f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:28.207665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212063e-75dc-4473-9196-731383ef5f2e admin admin] PATH_INFO: `/v3/users/e4bd3d85c12d4d17bfe25dea81421f5f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:28.209230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212063e-75dc-4473-9196-731383ef5f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4bd3d85c12d4d17bfe25dea81421f5f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:28.211504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212063e-75dc-4473-9196-731383ef5f2e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:28.254729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c98ba6-0dcd-4836-af66-383746c36628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:28.256632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c98ba6-0dcd-4836-af66-383746c36628 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:28.256989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c98ba6-0dcd-4836-af66-383746c36628 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:28.261259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c98ba6-0dcd-4836-af66-383746c36628 admin admin] PATH_INFO: `/v3/projects/6c9d79c311ca4e61bd2d4e9d03c859d3/users/6476c64c17174490ab9649ceeb717d3e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:28.304677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c98ba6-0dcd-4836-af66-383746c36628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9d79c311ca4e61bd2d4e9d03c859d3, user_id=6476c64c17174490ab9649ceeb717d3e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:28.310697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c98ba6-0dcd-4836-af66-383746c36628 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:28.312608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b212063e-75dc-4473-9196-731383ef5f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4bd3d85c12d4d17bfe25dea81421f5f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.328399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b212063e-75dc-4473-9196-731383ef5f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4bd3d85c12d4d17bfe25dea81421f5f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.340029 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2681/5297] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:28 2021] PUT /identity/v3/projects/6c9d79c311ca4e61bd2d4e9d03c859d3/users/6476c64c17174490ab9649ceeb717d3e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:28.343878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b212063e-75dc-4473-9196-731383ef5f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4bd3d85c12d4d17bfe25dea81421f5f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.345316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c98ba6-0dcd-4836-af66-383746c36628 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:28.350228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-53c98ba6-0dcd-4836-af66-383746c36628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:28.350851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b212063e-75dc-4473-9196-731383ef5f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4bd3d85c12d4d17bfe25dea81421f5f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.364726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b212063e-75dc-4473-9196-731383ef5f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4bd3d85c12d4d17bfe25dea81421f5f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.377201 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2617/5298] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:28 2021] DELETE /identity/v3/users/e4bd3d85c12d4d17bfe25dea81421f5f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:28.379169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1ef4f-63f9-424e-ab48-ef1fd6c35c8c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:28.380574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1ef4f-63f9-424e-ab48-ef1fd6c35c8c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:28.380984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1ef4f-63f9-424e-ab48-ef1fd6c35c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:28.431279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e3b1ef4f-63f9-424e-ab48-ef1fd6c35c8c None None] MFA Rules not processed for user `6476c64c17174490ab9649ceeb717d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:28.433103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e3b1ef4f-63f9-424e-ab48-ef1fd6c35c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:28.459462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c98ba6-0dcd-4836-af66-383746c36628 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:28.536502 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2618/5299] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:28 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:28.551616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1ef4f-63f9-424e-ab48-ef1fd6c35c8c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:28.554481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e3b1ef4f-63f9-424e-ab48-ef1fd6c35c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:28.568795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1366ce-65b3-43fe-ab1f-48b8e61a890a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:28.570434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1366ce-65b3-43fe-ab1f-48b8e61a890a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:28.570815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1366ce-65b3-43fe-ab1f-48b8e61a890a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:28.571210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1366ce-65b3-43fe-ab1f-48b8e61a890a admin admin] PATH_INFO: `/v3/users/c6bee2e3a52c499ea3207625117ccfac` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:28.573046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1366ce-65b3-43fe-ab1f-48b8e61a890a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6bee2e3a52c499ea3207625117ccfac)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:28.575875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1366ce-65b3-43fe-ab1f-48b8e61a890a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:28.644795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1ef4f-63f9-424e-ab48-ef1fd6c35c8c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:28.650017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c33a7-2b16-4f6f-823e-c74e3f8059bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:28.651424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c33a7-2b16-4f6f-823e-c74e3f8059bd service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:28.651967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3b1366ce-65b3-43fe-ab1f-48b8e61a890a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6bee2e3a52c499ea3207625117ccfac'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.652671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c33a7-2b16-4f6f-823e-c74e3f8059bd service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:28.653356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c33a7-2b16-4f6f-823e-c74e3f8059bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:28.656876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4d6c33a7-2b16-4f6f-823e-c74e3f8059bd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:28.659930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3b1366ce-65b3-43fe-ab1f-48b8e61a890a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6bee2e3a52c499ea3207625117ccfac'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.660666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3b1366ce-65b3-43fe-ab1f-48b8e61a890a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6bee2e3a52c499ea3207625117ccfac'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.679959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3b1366ce-65b3-43fe-ab1f-48b8e61a890a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6bee2e3a52c499ea3207625117ccfac'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.695586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3b1366ce-65b3-43fe-ab1f-48b8e61a890a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6bee2e3a52c499ea3207625117ccfac'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:28.703626 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2682/5300] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:28 2021] DELETE /identity/v3/users/c6bee2e3a52c499ea3207625117ccfac => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:28.759444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c33a7-2b16-4f6f-823e-c74e3f8059bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:28.760828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c33a7-2b16-4f6f-823e-c74e3f8059bd service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:28.773314 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2619/5301] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:28 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:29.084497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1afb25-3df6-4b3c-8845-6ed1cf97a671 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:29.085143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1afb25-3df6-4b3c-8845-6ed1cf97a671 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:29.085627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1afb25-3df6-4b3c-8845-6ed1cf97a671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:29.118012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8a1afb25-3df6-4b3c-8845-6ed1cf97a671 None None] MFA Rules not processed for user `026afcda165f437cbd8dc3a854a14c95`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:29.121792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8a1afb25-3df6-4b3c-8845-6ed1cf97a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:29.210341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c33a7-2b16-4f6f-823e-c74e3f8059bd service glance] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:29.211873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4d6c33a7-2b16-4f6f-823e-c74e3f8059bd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:29.235519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c33a7-2b16-4f6f-823e-c74e3f8059bd service glance] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:29.245902 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2683/5302] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:29 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:29.247900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1158d-ad84-4211-9482-5d9dcc168543 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:29.248270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1158d-ad84-4211-9482-5d9dcc168543 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:29.248654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1158d-ad84-4211-9482-5d9dcc168543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:29.274859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-99a1158d-ad84-4211-9482-5d9dcc168543 None None] MFA Rules not processed for user `026afcda165f437cbd8dc3a854a14c95`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:29.276480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-99a1158d-ad84-4211-9482-5d9dcc168543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:29.299896 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2684/5303] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:29 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:29.335496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1158d-ad84-4211-9482-5d9dcc168543 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:29.337163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-99a1158d-ad84-4211-9482-5d9dcc168543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:29.354143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:29.358080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:29.358443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:29.362872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f admin admin] PATH_INFO: `/v3/projects/1719d319e0f045e8958ed817eb36214b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:29.364800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1719d319e0f045e8958ed817eb36214b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:29.370624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:29.456985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1158d-ad84-4211-9482-5d9dcc168543 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:29.457663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1719d319e0f045e8958ed817eb36214b', 'request_id': 'req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:29.465962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1719d319e0f045e8958ed817eb36214b', 'request_id': 'req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:29.472760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1719d319e0f045e8958ed817eb36214b', 'request_id': 'req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:29.496446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f admin admin] The token cache is being invalidate because project 1719d319e0f045e8958ed817eb36214b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:29.496446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:29.512613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:29.516928 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2620/5304] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:29 2021] DELETE /identity/v3/projects/1719d319e0f045e8958ed817eb36214b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:29.519633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:29.522746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:29.537396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879e933-f068-4cb5-bf22-b23dc8c30df9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:29.538486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879e933-f068-4cb5-bf22-b23dc8c30df9 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:29.539067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879e933-f068-4cb5-bf22-b23dc8c30df9 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:29.539393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879e933-f068-4cb5-bf22-b23dc8c30df9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:29.541373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a879e933-f068-4cb5-bf22-b23dc8c30df9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:29.633895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47953ac4-a142-4aa5-8268-e2d4aaa4fd2f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:29.640850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13743889-4bdd-45c4-9b4c-093a9c11885c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:29.644090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13743889-4bdd-45c4-9b4c-093a9c11885c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:29.644447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13743889-4bdd-45c4-9b4c-093a9c11885c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:29.644743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13743889-4bdd-45c4-9b4c-093a9c11885c admin admin] PATH_INFO: `/v3/projects/8c59a670c2d446bcb62aa6b9454ef426` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:29.647966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13743889-4bdd-45c4-9b4c-093a9c11885c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c59a670c2d446bcb62aa6b9454ef426)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:29.650025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13743889-4bdd-45c4-9b4c-093a9c11885c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:29.658379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879e933-f068-4cb5-bf22-b23dc8c30df9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:29.662080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879e933-f068-4cb5-bf22-b23dc8c30df9 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:29.679618 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2685/5305] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:29 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:29.683994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c65379-ff3a-4aee-a3a4-9c50ffc000e8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:29.684397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c65379-ff3a-4aee-a3a4-9c50ffc000e8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:29.684753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c65379-ff3a-4aee-a3a4-9c50ffc000e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:29.709066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-07c65379-ff3a-4aee-a3a4-9c50ffc000e8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:29.712041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-13743889-4bdd-45c4-9b4c-093a9c11885c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c59a670c2d446bcb62aa6b9454ef426', 'request_id': 'req-13743889-4bdd-45c4-9b4c-093a9c11885c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:29.717411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-07c65379-ff3a-4aee-a3a4-9c50ffc000e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:29.720317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-13743889-4bdd-45c4-9b4c-093a9c11885c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c59a670c2d446bcb62aa6b9454ef426', 'request_id': 'req-13743889-4bdd-45c4-9b4c-093a9c11885c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:29.727532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-13743889-4bdd-45c4-9b4c-093a9c11885c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c59a670c2d446bcb62aa6b9454ef426', 'request_id': 'req-13743889-4bdd-45c4-9b4c-093a9c11885c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:29.750334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-13743889-4bdd-45c4-9b4c-093a9c11885c admin admin] The token cache is being invalidate because project 8c59a670c2d446bcb62aa6b9454ef426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:29.750757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-13743889-4bdd-45c4-9b4c-093a9c11885c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:29.751962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-13743889-4bdd-45c4-9b4c-093a9c11885c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:29.754798 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2621/5306] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:29 2021] DELETE /identity/v3/projects/8c59a670c2d446bcb62aa6b9454ef426 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:29.755769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13743889-4bdd-45c4-9b4c-093a9c11885c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:29.757432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-13743889-4bdd-45c4-9b4c-093a9c11885c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:29.815555 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2686/5307] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:29.817659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cf019-a7e5-45f0-8f72-e7f1d69db4d0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:29.818100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cf019-a7e5-45f0-8f72-e7f1d69db4d0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:29.818582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cf019-a7e5-45f0-8f72-e7f1d69db4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:29.841897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d93cf019-a7e5-45f0-8f72-e7f1d69db4d0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:29.843431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d93cf019-a7e5-45f0-8f72-e7f1d69db4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:29.854393 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2687/5308] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:29.856637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40365e-0c42-4ebe-9bba-efa5436cd975 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:29.857105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40365e-0c42-4ebe-9bba-efa5436cd975 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:29.857556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13743889-4bdd-45c4-9b4c-093a9c11885c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:29.857688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40365e-0c42-4ebe-9bba-efa5436cd975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:29.864338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bf02e-5c17-4659-ae79-5114f6f9ec02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:29.865565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bf02e-5c17-4659-ae79-5114f6f9ec02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:29.865936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bf02e-5c17-4659-ae79-5114f6f9ec02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:29.866295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bf02e-5c17-4659-ae79-5114f6f9ec02 admin admin] PATH_INFO: `/v3/users/e9422d65d2774f0fa07bc35bcefada02` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:29.868410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bf02e-5c17-4659-ae79-5114f6f9ec02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9422d65d2774f0fa07bc35bcefada02)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:29.871486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bf02e-5c17-4659-ae79-5114f6f9ec02 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:29.880639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3f40365e-0c42-4ebe-9bba-efa5436cd975 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:29.882354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3f40365e-0c42-4ebe-9bba-efa5436cd975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:29.893267 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2688/5309] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:29.895053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18d853-e837-4598-854a-816fe9b8ffff None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:29.895536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18d853-e837-4598-854a-816fe9b8ffff None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:29.896294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18d853-e837-4598-854a-816fe9b8ffff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:29.916698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0c18d853-e837-4598-854a-816fe9b8ffff None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:29.918189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0c18d853-e837-4598-854a-816fe9b8ffff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:29.928412 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2689/5310] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:29.929524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18d853-e837-4598-854a-816fe9b8ffff None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:29.945223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18d853-e837-4598-854a-816fe9b8ffff None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:29.945921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-193bf02e-5c17-4659-ae79-5114f6f9ec02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9422d65d2774f0fa07bc35bcefada02'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:29.952011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352a740-4a5c-4a34-8205-5e0d62696375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:29.952909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352a740-4a5c-4a34-8205-5e0d62696375 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:29.953198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352a740-4a5c-4a34-8205-5e0d62696375 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:29.953480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352a740-4a5c-4a34-8205-5e0d62696375 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:29.954471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352a740-4a5c-4a34-8205-5e0d62696375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:29.954814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352a740-4a5c-4a34-8205-5e0d62696375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:29.956417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352a740-4a5c-4a34-8205-5e0d62696375 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:29.957187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-193bf02e-5c17-4659-ae79-5114f6f9ec02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9422d65d2774f0fa07bc35bcefada02'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:29.972846 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2690/5311] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:29.972846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352a740-4a5c-4a34-8205-5e0d62696375 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:29.973867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-193bf02e-5c17-4659-ae79-5114f6f9ec02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9422d65d2774f0fa07bc35bcefada02'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:29.974836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-193bf02e-5c17-4659-ae79-5114f6f9ec02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9422d65d2774f0fa07bc35bcefada02'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:29.984448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352a740-4a5c-4a34-8205-5e0d62696375 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:29.985052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-193bf02e-5c17-4659-ae79-5114f6f9ec02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9422d65d2774f0fa07bc35bcefada02'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:29.989686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfe28a-17db-406e-a549-0065f2064684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:29.990428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfe28a-17db-406e-a549-0065f2064684 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:29.990719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfe28a-17db-406e-a549-0065f2064684 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:29.991000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfe28a-17db-406e-a549-0065f2064684 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:29.991792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfe28a-17db-406e-a549-0065f2064684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:29.992249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfe28a-17db-406e-a549-0065f2064684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:29.993944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfe28a-17db-406e-a549-0065f2064684 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:29.997069 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2622/5312] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:29 2021] DELETE /identity/v3/users/e9422d65d2774f0fa07bc35bcefada02 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:29.998045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bf02e-5c17-4659-ae79-5114f6f9ec02 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:30.003439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-193bf02e-5c17-4659-ae79-5114f6f9ec02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:30.019528 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2691/5313] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:30.019528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a57c54-4a16-45f1-a013-fa2f08d82782 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:30.019528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a57c54-4a16-45f1-a013-fa2f08d82782 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:30.019528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a57c54-4a16-45f1-a013-fa2f08d82782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:30.039025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-58a57c54-4a16-45f1-a013-fa2f08d82782 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:30.040476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-58a57c54-4a16-45f1-a013-fa2f08d82782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:30.091620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bf02e-5c17-4659-ae79-5114f6f9ec02 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:30.099071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692ebb8-ab17-4ce8-b443-53595a40db13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:30.100039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692ebb8-ab17-4ce8-b443-53595a40db13 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:30.100329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692ebb8-ab17-4ce8-b443-53595a40db13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:30.100927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692ebb8-ab17-4ce8-b443-53595a40db13 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:30.101816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692ebb8-ab17-4ce8-b443-53595a40db13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:30.104724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692ebb8-ab17-4ce8-b443-53595a40db13 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:30.123225 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2692/5314] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:30.124657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a57c54-4a16-45f1-a013-fa2f08d82782 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:30.126078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-58a57c54-4a16-45f1-a013-fa2f08d82782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:30.140325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a57c54-4a16-45f1-a013-fa2f08d82782 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:30.146046 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2623/5315] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:29 2021] POST /identity/v3/projects => generated 409 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:30.146950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c42653-be52-4347-aff0-84131e6efe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:30.147503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692ebb8-ab17-4ce8-b443-53595a40db13 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:30.147625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42653-be52-4347-aff0-84131e6efe27 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:30.147880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42653-be52-4347-aff0-84131e6efe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:30.148223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42653-be52-4347-aff0-84131e6efe27 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:30.149045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c42653-be52-4347-aff0-84131e6efe27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:30.151032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b692ebb8-ab17-4ce8-b443-53595a40db13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:30.151908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c42653-be52-4347-aff0-84131e6efe27 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:30.188938 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2693/5316] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:30 2021] POST /identity/v3/projects => generated 391 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:30.190044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c42653-be52-4347-aff0-84131e6efe27 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:30.244631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692ebb8-ab17-4ce8-b443-53595a40db13 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:30.271525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c42653-be52-4347-aff0-84131e6efe27 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:30.278762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc064-3507-41ac-8599-fb834ea42a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:30.279697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc064-3507-41ac-8599-fb834ea42a86 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:30.280046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc064-3507-41ac-8599-fb834ea42a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:30.280339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc064-3507-41ac-8599-fb834ea42a86 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:30.281105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dc064-3507-41ac-8599-fb834ea42a86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:30.283148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dc064-3507-41ac-8599-fb834ea42a86 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:30.312835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14edf90-dc07-4f1d-ba4e-c4bd6c055ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:30.313489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14edf90-dc07-4f1d-ba4e-c4bd6c055ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:30.313931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14edf90-dc07-4f1d-ba4e-c4bd6c055ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:30.314281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14edf90-dc07-4f1d-ba4e-c4bd6c055ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:30.315636 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2694/5317] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:30 2021] POST /identity/v3/users => generated 305 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:30.316891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc064-3507-41ac-8599-fb834ea42a86 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:30.329196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc064-3507-41ac-8599-fb834ea42a86 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:30.330415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14edf90-dc07-4f1d-ba4e-c4bd6c055ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:30.331776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14edf90-dc07-4f1d-ba4e-c4bd6c055ec6 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:30.338341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6da0e7-fe3b-4a84-a1ff-37b5c37fb66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:30.339457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6da0e7-fe3b-4a84-a1ff-37b5c37fb66d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:30.339863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6da0e7-fe3b-4a84-a1ff-37b5c37fb66d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:30.340305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6da0e7-fe3b-4a84-a1ff-37b5c37fb66d admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:30.341293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6da0e7-fe3b-4a84-a1ff-37b5c37fb66d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:30.343692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6da0e7-fe3b-4a84-a1ff-37b5c37fb66d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:30.348037 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2624/5318] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:30.349231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14edf90-dc07-4f1d-ba4e-c4bd6c055ec6 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:30.359427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14edf90-dc07-4f1d-ba4e-c4bd6c055ec6 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:30.365030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd0d76-8032-4720-84c6-ce016c30097c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:30.365954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd0d76-8032-4720-84c6-ce016c30097c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:30.366174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd0d76-8032-4720-84c6-ce016c30097c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:30.366468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd0d76-8032-4720-84c6-ce016c30097c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:30.367338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd0d76-8032-4720-84c6-ce016c30097c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:30.369071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd0d76-8032-4720-84c6-ce016c30097c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:30.373939 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2695/5319] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:30 2021] POST /identity/v3/users => generated 296 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:30.378236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6da0e7-fe3b-4a84-a1ff-37b5c37fb66d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:30.381440 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2625/5320] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:30 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:30.385506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd0d76-8032-4720-84c6-ce016c30097c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:30.402956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd0d76-8032-4720-84c6-ce016c30097c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:30.409128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562d502-1241-426e-9e20-bf749a07540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:30.410659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562d502-1241-426e-9e20-bf749a07540a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:30.411034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562d502-1241-426e-9e20-bf749a07540a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:30.411877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562d502-1241-426e-9e20-bf749a07540a admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:30.412251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562d502-1241-426e-9e20-bf749a07540a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:30.413636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6da0e7-fe3b-4a84-a1ff-37b5c37fb66d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:30.414060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562d502-1241-426e-9e20-bf749a07540a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:30.423526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f56c7f-40b0-487b-834a-8bc11c33e9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:30.424228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f56c7f-40b0-487b-834a-8bc11c33e9ad admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:30.424952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f56c7f-40b0-487b-834a-8bc11c33e9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:30.425534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f56c7f-40b0-487b-834a-8bc11c33e9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:30.427821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f56c7f-40b0-487b-834a-8bc11c33e9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:30.431294 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2626/5321] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:30 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:30.431967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f56c7f-40b0-487b-834a-8bc11c33e9ad admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:30.433056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562d502-1241-426e-9e20-bf749a07540a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:30.455521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562d502-1241-426e-9e20-bf749a07540a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:30.457743 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2696/5322] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:30 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:30.461654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f56c7f-40b0-487b-834a-8bc11c33e9ad admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:30.464232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d5fc8-168f-4348-93f7-36e51ae20a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:30.465346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d5fc8-168f-4348-93f7-36e51ae20a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:30.465935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d5fc8-168f-4348-93f7-36e51ae20a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:30.466548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d5fc8-168f-4348-93f7-36e51ae20a2d admin admin] PATH_INFO: `/v3/projects/e1ebcef17bb4458fa70b95e48552082a/users/8c47da68e55c42329c3de60422bfa862/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:30.481462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f56c7f-40b0-487b-834a-8bc11c33e9ad admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:30.488405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b870d1-b2de-409d-bdbb-85e40b5fbc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:30.489692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b870d1-b2de-409d-bdbb-85e40b5fbc87 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:30.495379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b870d1-b2de-409d-bdbb-85e40b5fbc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:30.495379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b870d1-b2de-409d-bdbb-85e40b5fbc87 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:30.495379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b870d1-b2de-409d-bdbb-85e40b5fbc87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:30.496402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d5fc8-168f-4348-93f7-36e51ae20a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ebcef17bb4458fa70b95e48552082a, user_id=8c47da68e55c42329c3de60422bfa862, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:30.499121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b870d1-b2de-409d-bdbb-85e40b5fbc87 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:30.501274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d5fc8-168f-4348-93f7-36e51ae20a2d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:30.518037 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2697/5323] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:30 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:30.534393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b870d1-b2de-409d-bdbb-85e40b5fbc87 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:30.534684 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2627/5324] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:30 2021] PUT /identity/v3/projects/e1ebcef17bb4458fa70b95e48552082a/users/8c47da68e55c42329c3de60422bfa862/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:30.540483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84446eea-0a5c-4a43-9c72-b5bef3b96188 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:30.541325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84446eea-0a5c-4a43-9c72-b5bef3b96188 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:30.542537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84446eea-0a5c-4a43-9c72-b5bef3b96188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:30.544087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b870d1-b2de-409d-bdbb-85e40b5fbc87 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:30.597714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-84446eea-0a5c-4a43-9c72-b5bef3b96188 None None] MFA Rules not processed for user `8c47da68e55c42329c3de60422bfa862`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:30.599781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-84446eea-0a5c-4a43-9c72-b5bef3b96188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:30.623093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9318d-41de-49f4-a9c2-9f32a70fcc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:30.624715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9318d-41de-49f4-a9c2-9f32a70fcc3e admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:30.624715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9318d-41de-49f4-a9c2-9f32a70fcc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:30.625879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9318d-41de-49f4-a9c2-9f32a70fcc3e admin admin] PATH_INFO: `/v3/projects/6bcda0eef0cc4cfba8a358c27ca82c4d/users/665515a0e3164c92898dec7eb6cacf6b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:30.645443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9318d-41de-49f4-a9c2-9f32a70fcc3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bcda0eef0cc4cfba8a358c27ca82c4d, user_id=665515a0e3164c92898dec7eb6cacf6b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:30.648211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9318d-41de-49f4-a9c2-9f32a70fcc3e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:30.679301 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2698/5325] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:30 2021] PUT /identity/v3/projects/6bcda0eef0cc4cfba8a358c27ca82c4d/users/665515a0e3164c92898dec7eb6cacf6b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:30.685974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f2f35-3ffa-4236-b955-9fbdef9b92b7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:30.686274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f2f35-3ffa-4236-b955-9fbdef9b92b7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:30.686550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f2f35-3ffa-4236-b955-9fbdef9b92b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:30.706350 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2628/5326] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:30 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:30.709586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84446eea-0a5c-4a43-9c72-b5bef3b96188 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:30.724448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-894f2f35-3ffa-4236-b955-9fbdef9b92b7 None None] MFA Rules not processed for user `665515a0e3164c92898dec7eb6cacf6b`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:30.728603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-894f2f35-3ffa-4236-b955-9fbdef9b92b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:30.733325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84446eea-0a5c-4a43-9c72-b5bef3b96188 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:30.847022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe03ef3-afba-4c2d-986a-5e49f866978b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:30.847771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe03ef3-afba-4c2d-986a-5e49f866978b admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:30.848337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe03ef3-afba-4c2d-986a-5e49f866978b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:30.848791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe03ef3-afba-4c2d-986a-5e49f866978b admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:30.850238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe03ef3-afba-4c2d-986a-5e49f866978b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:30.852425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe03ef3-afba-4c2d-986a-5e49f866978b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:30.896911 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2699/5327] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:30 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:30.905750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f2f35-3ffa-4236-b955-9fbdef9b92b7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:30.937621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f2f35-3ffa-4236-b955-9fbdef9b92b7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:30.953413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6acf1-f6e3-4520-b416-1a13fac2de02 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665515a0e3164c92898dec7eb6cacf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:30.956285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6acf1-f6e3-4520-b416-1a13fac2de02 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:30.956502 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2629/5328] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:30 2021] POST /identity/v3/projects => generated 411 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:30.958394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6acf1-f6e3-4520-b416-1a13fac2de02 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:30.959166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6acf1-f6e3-4520-b416-1a13fac2de02 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:30.961012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe03ef3-afba-4c2d-986a-5e49f866978b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:30.963631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6acf1-f6e3-4520-b416-1a13fac2de02 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorizing `identity:create_application_credential(user_id=665515a0e3164c92898dec7eb6cacf6b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:30.966137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6acf1-f6e3-4520-b416-1a13fac2de02 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:31.064316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe03ef3-afba-4c2d-986a-5e49f866978b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:31.071880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76369bb-0b07-4561-ba10-28d1664294be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:31.073261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76369bb-0b07-4561-ba10-28d1664294be admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:31.073385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76369bb-0b07-4561-ba10-28d1664294be admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:31.074241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76369bb-0b07-4561-ba10-28d1664294be admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:31.074741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76369bb-0b07-4561-ba10-28d1664294be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:31.077421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76369bb-0b07-4561-ba10-28d1664294be admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:31.109565 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2630/5329] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:30 2021] POST /identity/v3/users => generated 312 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:31.112833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76369bb-0b07-4561-ba10-28d1664294be admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:31.113695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e76369bb-0b07-4561-ba10-28d1664294be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:31.125009 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2700/5330] 10.222.0.13 () {60 vars in 1313 bytes} [Sat Dec 18 21:02:30 2021] POST /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials => generated 789 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:31.126160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6acf1-f6e3-4520-b416-1a13fac2de02 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:31.139049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76369bb-0b07-4561-ba10-28d1664294be admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:31.147956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6acf1-f6e3-4520-b416-1a13fac2de02 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:31.149777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9bdeb-d5ce-4413-93b7-dc325deba135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:31.151505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9bdeb-d5ce-4413-93b7-dc325deba135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:31.151766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9bdeb-d5ce-4413-93b7-dc325deba135 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:31.152052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9bdeb-d5ce-4413-93b7-dc325deba135 admin admin] PATH_INFO: `/v3/projects/7d39c44ab1d948c1aa6b6dec003fb9e8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:31.153254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9bdeb-d5ce-4413-93b7-dc325deba135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d39c44ab1d948c1aa6b6dec003fb9e8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:31.154506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33db4c-b075-4b34-98ab-8070db044764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:31.155202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33db4c-b075-4b34-98ab-8070db044764 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:31.155512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33db4c-b075-4b34-98ab-8070db044764 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:31.155801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33db4c-b075-4b34-98ab-8070db044764 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:31.156189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9bdeb-d5ce-4413-93b7-dc325deba135 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:31.156550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33db4c-b075-4b34-98ab-8070db044764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:31.158376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33db4c-b075-4b34-98ab-8070db044764 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:31.169408 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2701/5331] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:31 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:31.170521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33db4c-b075-4b34-98ab-8070db044764 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:31.221682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-02a9bdeb-d5ce-4413-93b7-dc325deba135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d39c44ab1d948c1aa6b6dec003fb9e8', 'request_id': 'req-02a9bdeb-d5ce-4413-93b7-dc325deba135'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:31.231075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-02a9bdeb-d5ce-4413-93b7-dc325deba135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d39c44ab1d948c1aa6b6dec003fb9e8', 'request_id': 'req-02a9bdeb-d5ce-4413-93b7-dc325deba135'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:31.239141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-02a9bdeb-d5ce-4413-93b7-dc325deba135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d39c44ab1d948c1aa6b6dec003fb9e8', 'request_id': 'req-02a9bdeb-d5ce-4413-93b7-dc325deba135'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:31.253522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-02a9bdeb-d5ce-4413-93b7-dc325deba135 admin admin] The token cache is being invalidate because project 7d39c44ab1d948c1aa6b6dec003fb9e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:31.253900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-02a9bdeb-d5ce-4413-93b7-dc325deba135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:31.254777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-02a9bdeb-d5ce-4413-93b7-dc325deba135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:31.258070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33db4c-b075-4b34-98ab-8070db044764 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:31.266638 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2631/5332] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:31 2021] DELETE /identity/v3/projects/7d39c44ab1d948c1aa6b6dec003fb9e8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:31.267550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9bdeb-d5ce-4413-93b7-dc325deba135 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:31.269433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-02a9bdeb-d5ce-4413-93b7-dc325deba135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:31.342135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c268d-e5e0-4e5a-91aa-03a7abf5d63b tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665515a0e3164c92898dec7eb6cacf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:31.344353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c268d-e5e0-4e5a-91aa-03a7abf5d63b tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:31.344571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c268d-e5e0-4e5a-91aa-03a7abf5d63b tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:31.344854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c268d-e5e0-4e5a-91aa-03a7abf5d63b tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials/7f45f7ec9668427fb55919c43b461ee8` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:31.355342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c268d-e5e0-4e5a-91aa-03a7abf5d63b tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorizing `identity:get_application_credential(user_id=665515a0e3164c92898dec7eb6cacf6b, application_credential_id=7f45f7ec9668427fb55919c43b461ee8)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:31.357200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c268d-e5e0-4e5a-91aa-03a7abf5d63b tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:31.359181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9bdeb-d5ce-4413-93b7-dc325deba135 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:31.359925 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2702/5333] 10.222.0.13 () {58 vars in 1391 bytes} [Sat Dec 18 21:02:31 2021] GET /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials/7f45f7ec9668427fb55919c43b461ee8 => generated 689 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:31.360726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c268d-e5e0-4e5a-91aa-03a7abf5d63b tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:31.362498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-916c268d-e5e0-4e5a-91aa-03a7abf5d63b tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:31.367089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3e9f7-c7ce-44a9-8a2c-85f2cab13e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:31.368204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3e9f7-c7ce-44a9-8a2c-85f2cab13e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:31.368504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3e9f7-c7ce-44a9-8a2c-85f2cab13e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:31.368788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3e9f7-c7ce-44a9-8a2c-85f2cab13e8a admin admin] PATH_INFO: `/v3/projects/66cceca1286c45e6b03c26cdde24a002/users/7f6d588e2f474ab0ba57988b7e8910e6/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:31.379538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c268d-e5e0-4e5a-91aa-03a7abf5d63b tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:31.384447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527947d-b4fc-49dc-9945-d87c0c960b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:31.385639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3e9f7-c7ce-44a9-8a2c-85f2cab13e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66cceca1286c45e6b03c26cdde24a002, user_id=7f6d588e2f474ab0ba57988b7e8910e6, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:31.385883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527947d-b4fc-49dc-9945-d87c0c960b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:31.386171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527947d-b4fc-49dc-9945-d87c0c960b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:31.386720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527947d-b4fc-49dc-9945-d87c0c960b0e admin admin] PATH_INFO: `/v3/users/6476c64c17174490ab9649ceeb717d3e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:31.388153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527947d-b4fc-49dc-9945-d87c0c960b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6476c64c17174490ab9649ceeb717d3e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:31.388584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3e9f7-c7ce-44a9-8a2c-85f2cab13e8a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:31.390147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527947d-b4fc-49dc-9945-d87c0c960b0e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:31.405867 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2632/5334] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:31 2021] PUT /identity/v3/projects/66cceca1286c45e6b03c26cdde24a002/users/7f6d588e2f474ab0ba57988b7e8910e6/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:31.407132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0962f-9328-4e71-beab-01da25e16262 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:31.407430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0962f-9328-4e71-beab-01da25e16262 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:31.407718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0962f-9328-4e71-beab-01da25e16262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:31.422880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1fe0962f-9328-4e71-beab-01da25e16262 None None] MFA Rules not processed for user `665515a0e3164c92898dec7eb6cacf6b`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:31.424335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1fe0962f-9328-4e71-beab-01da25e16262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:31.453067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9527947d-b4fc-49dc-9945-d87c0c960b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6476c64c17174490ab9649ceeb717d3e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:31.461757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9527947d-b4fc-49dc-9945-d87c0c960b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6476c64c17174490ab9649ceeb717d3e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:31.462516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9527947d-b4fc-49dc-9945-d87c0c960b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6476c64c17174490ab9649ceeb717d3e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:31.474793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9527947d-b4fc-49dc-9945-d87c0c960b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6476c64c17174490ab9649ceeb717d3e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:31.483063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9527947d-b4fc-49dc-9945-d87c0c960b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6476c64c17174490ab9649ceeb717d3e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:31.489338 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2703/5335] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:31 2021] DELETE /identity/v3/users/6476c64c17174490ab9649ceeb717d3e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:31.490016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527947d-b4fc-49dc-9945-d87c0c960b0e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:31.491406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9527947d-b4fc-49dc-9945-d87c0c960b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:31.542155 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2633/5336] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:31 2021] POST /identity/v3/auth/tokens => generated 3415 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Dec 18 21:02:31.547599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0962f-9328-4e71-beab-01da25e16262 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:31.549099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1fe0962f-9328-4e71-beab-01da25e16262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:31.598297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527947d-b4fc-49dc-9945-d87c0c960b0e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:31.606992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d5533-12f5-4ed6-be5b-d7fbd62631a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:31.607988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d5533-12f5-4ed6-be5b-d7fbd62631a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:31.608455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d5533-12f5-4ed6-be5b-d7fbd62631a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:31.608742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d5533-12f5-4ed6-be5b-d7fbd62631a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:31.609539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d5533-12f5-4ed6-be5b-d7fbd62631a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:31.612007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d5533-12f5-4ed6-be5b-d7fbd62631a2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:31.626298 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2704/5337] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:31 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:31.629532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d5533-12f5-4ed6-be5b-d7fbd62631a2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:31.643249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d5533-12f5-4ed6-be5b-d7fbd62631a2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:31.649548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822a42e-c6f1-46ff-9a6c-3e8f484f902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:31.651883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822a42e-c6f1-46ff-9a6c-3e8f484f902b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:31.652533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822a42e-c6f1-46ff-9a6c-3e8f484f902b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:31.653429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822a42e-c6f1-46ff-9a6c-3e8f484f902b admin admin] PATH_INFO: `/v3/projects/66cceca1286c45e6b03c26cdde24a002/users/7f6d588e2f474ab0ba57988b7e8910e6/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:31.657332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822a42e-c6f1-46ff-9a6c-3e8f484f902b admin admin] RBAC: Authorizing `identity:create_grant(project_id=66cceca1286c45e6b03c26cdde24a002, user_id=7f6d588e2f474ab0ba57988b7e8910e6, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:31.660619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822a42e-c6f1-46ff-9a6c-3e8f484f902b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:31.673859 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2705/5338] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:31 2021] PUT /identity/v3/projects/66cceca1286c45e6b03c26cdde24a002/users/7f6d588e2f474ab0ba57988b7e8910e6/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:31.685125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b333e9-75de-4594-a6cc-1b15e880d3d8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:31.685784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b333e9-75de-4594-a6cc-1b15e880d3d8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:31.685784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b333e9-75de-4594-a6cc-1b15e880d3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:31.716864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0962f-9328-4e71-beab-01da25e16262 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:31.730696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e1b333e9-75de-4594-a6cc-1b15e880d3d8 None None] MFA Rules not processed for user `7f6d588e2f474ab0ba57988b7e8910e6`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:31.731842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e1b333e9-75de-4594-a6cc-1b15e880d3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:31.824114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fad1a2-2306-4165-affc-5c210effcff7 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665515a0e3164c92898dec7eb6cacf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:31.825205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fad1a2-2306-4165-affc-5c210effcff7 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:31.825616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fad1a2-2306-4165-affc-5c210effcff7 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:31.826097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fad1a2-2306-4165-affc-5c210effcff7 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials/7f45f7ec9668427fb55919c43b461ee8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:31.828459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fad1a2-2306-4165-affc-5c210effcff7 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorizing `identity:delete_application_credential(user_id=665515a0e3164c92898dec7eb6cacf6b, application_credential_id=7f45f7ec9668427fb55919c43b461ee8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:31.830608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fad1a2-2306-4165-affc-5c210effcff7 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:31.862297 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2634/5339] 10.222.0.13 () {58 vars in 1394 bytes} [Sat Dec 18 21:02:31 2021] DELETE /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials/7f45f7ec9668427fb55919c43b461ee8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:31.867310 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2706/5340] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:31 2021] POST /identity/v3/auth/tokens => generated 3345 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:31.870042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fad1a2-2306-4165-affc-5c210effcff7 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:31.872140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c8fad1a2-2306-4165-affc-5c210effcff7 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:31.884329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fad1a2-2306-4165-affc-5c210effcff7 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:31.888260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b333e9-75de-4594-a6cc-1b15e880d3d8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:31.890911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e1b333e9-75de-4594-a6cc-1b15e880d3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:31.905150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54af65c-9e3e-4947-af16-550d02f46619 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665515a0e3164c92898dec7eb6cacf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:31.906092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54af65c-9e3e-4947-af16-550d02f46619 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:31.908020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54af65c-9e3e-4947-af16-550d02f46619 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:31.908342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54af65c-9e3e-4947-af16-550d02f46619 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:31.909885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54af65c-9e3e-4947-af16-550d02f46619 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorizing `identity:create_application_credential(user_id=665515a0e3164c92898dec7eb6cacf6b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:31.912398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54af65c-9e3e-4947-af16-550d02f46619 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:31.993388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b333e9-75de-4594-a6cc-1b15e880d3d8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:31.998274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120fbcf-1c5c-44dc-b44f-675d3ca9272f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:31.998928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120fbcf-1c5c-44dc-b44f-675d3ca9272f service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:31.999193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120fbcf-1c5c-44dc-b44f-675d3ca9272f service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:31.999477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120fbcf-1c5c-44dc-b44f-675d3ca9272f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:32.013615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120fbcf-1c5c-44dc-b44f-675d3ca9272f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:32.015169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120fbcf-1c5c-44dc-b44f-675d3ca9272f service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:32.031806 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2707/5341] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:31 2021] GET /identity/v3/auth/tokens => generated 3345 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:02:32.083684 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2635/5342] 10.222.0.13 () {60 vars in 1314 bytes} [Sat Dec 18 21:02:31 2021] POST /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials => generated 921 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:32.084924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120fbcf-1c5c-44dc-b44f-675d3ca9272f service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:32.096853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120fbcf-1c5c-44dc-b44f-675d3ca9272f service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:32.107074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43341fbb-5ac3-48e3-bff8-b1d0c561f810 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665515a0e3164c92898dec7eb6cacf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:32.108013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43341fbb-5ac3-48e3-bff8-b1d0c561f810 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:32.108406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43341fbb-5ac3-48e3-bff8-b1d0c561f810 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:32.108694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43341fbb-5ac3-48e3-bff8-b1d0c561f810 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials/3634941253384b2b8873c819ecc39bf0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:32.128870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43341fbb-5ac3-48e3-bff8-b1d0c561f810 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorizing `identity:delete_application_credential(user_id=665515a0e3164c92898dec7eb6cacf6b, application_credential_id=3634941253384b2b8873c819ecc39bf0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:32.130658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43341fbb-5ac3-48e3-bff8-b1d0c561f810 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:32.165380 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2708/5343] 10.222.0.13 () {58 vars in 1394 bytes} [Sat Dec 18 21:02:32 2021] DELETE /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials/3634941253384b2b8873c819ecc39bf0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:32.167440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54af65c-9e3e-4947-af16-550d02f46619 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:32.171809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c54af65c-9e3e-4947-af16-550d02f46619 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:32.178954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43341fbb-5ac3-48e3-bff8-b1d0c561f810 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:32.194411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43341fbb-5ac3-48e3-bff8-b1d0c561f810 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:32.199909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63255731-9cbc-4918-88d4-efaec71b7ce8 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665515a0e3164c92898dec7eb6cacf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:32.200737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63255731-9cbc-4918-88d4-efaec71b7ce8 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:32.201024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63255731-9cbc-4918-88d4-efaec71b7ce8 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:32.201306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63255731-9cbc-4918-88d4-efaec71b7ce8 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:32.202058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63255731-9cbc-4918-88d4-efaec71b7ce8 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorizing `identity:create_application_credential(user_id=665515a0e3164c92898dec7eb6cacf6b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:32.203438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63255731-9cbc-4918-88d4-efaec71b7ce8 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:32.285380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54af65c-9e3e-4947-af16-550d02f46619 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:32.291414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884f979-215e-448b-acf4-69c3f9660178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:32.292074 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2709/5344] 10.222.0.13 () {60 vars in 1314 bytes} [Sat Dec 18 21:02:32 2021] POST /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials => generated 812 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:32.296600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884f979-215e-448b-acf4-69c3f9660178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:32.296876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63255731-9cbc-4918-88d4-efaec71b7ce8 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:32.297909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884f979-215e-448b-acf4-69c3f9660178 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:32.298488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884f979-215e-448b-acf4-69c3f9660178 admin admin] PATH_INFO: `/v3/projects/6c9d79c311ca4e61bd2d4e9d03c859d3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:32.300180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884f979-215e-448b-acf4-69c3f9660178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9d79c311ca4e61bd2d4e9d03c859d3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:32.303968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884f979-215e-448b-acf4-69c3f9660178 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:32.308891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63255731-9cbc-4918-88d4-efaec71b7ce8 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:32.322677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859d4e2-d1a2-4b79-a375-3aed69925a6e tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665515a0e3164c92898dec7eb6cacf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:32.323633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859d4e2-d1a2-4b79-a375-3aed69925a6e tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:32.323930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859d4e2-d1a2-4b79-a375-3aed69925a6e tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:32.324836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859d4e2-d1a2-4b79-a375-3aed69925a6e tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials/bbe597c76e894fdfb5d6f446acdd5b97` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:32.337212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859d4e2-d1a2-4b79-a375-3aed69925a6e tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorizing `identity:delete_application_credential(user_id=665515a0e3164c92898dec7eb6cacf6b, application_credential_id=bbe597c76e894fdfb5d6f446acdd5b97)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:32.339356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859d4e2-d1a2-4b79-a375-3aed69925a6e tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:32.370471 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2710/5345] 10.222.0.13 () {58 vars in 1394 bytes} [Sat Dec 18 21:02:32 2021] DELETE /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials/bbe597c76e894fdfb5d6f446acdd5b97 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:32.372430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859d4e2-d1a2-4b79-a375-3aed69925a6e tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:32.375151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8884f979-215e-448b-acf4-69c3f9660178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9d79c311ca4e61bd2d4e9d03c859d3', 'request_id': 'req-8884f979-215e-448b-acf4-69c3f9660178'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:32.383761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8884f979-215e-448b-acf4-69c3f9660178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9d79c311ca4e61bd2d4e9d03c859d3', 'request_id': 'req-8884f979-215e-448b-acf4-69c3f9660178'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:32.386335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859d4e2-d1a2-4b79-a375-3aed69925a6e tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:32.393024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8884f979-215e-448b-acf4-69c3f9660178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9d79c311ca4e61bd2d4e9d03c859d3', 'request_id': 'req-8884f979-215e-448b-acf4-69c3f9660178'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:32.412832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8884f979-215e-448b-acf4-69c3f9660178 admin admin] The token cache is being invalidate because project 6c9d79c311ca4e61bd2d4e9d03c859d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:32.413523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8884f979-215e-448b-acf4-69c3f9660178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:32.414181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8884f979-215e-448b-acf4-69c3f9660178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:32.423834 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2636/5346] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:32 2021] DELETE /identity/v3/projects/6c9d79c311ca4e61bd2d4e9d03c859d3 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:32.425491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa05035-462b-42af-a44d-9b5d1ca10316 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:32.425789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa05035-462b-42af-a44d-9b5d1ca10316 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:32.426077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa05035-462b-42af-a44d-9b5d1ca10316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:32.456593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-bfa05035-462b-42af-a44d-9b5d1ca10316 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:32.457947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bfa05035-462b-42af-a44d-9b5d1ca10316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:32.464947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d8ab0-8d45-45a8-810f-3b1e284feee1 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665515a0e3164c92898dec7eb6cacf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:32.466714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d8ab0-8d45-45a8-810f-3b1e284feee1 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:32.467217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d8ab0-8d45-45a8-810f-3b1e284feee1 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:32.469468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d8ab0-8d45-45a8-810f-3b1e284feee1 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:32.470378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d8ab0-8d45-45a8-810f-3b1e284feee1 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorizing `identity:create_application_credential(user_id=665515a0e3164c92898dec7eb6cacf6b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:32.471913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d8ab0-8d45-45a8-810f-3b1e284feee1 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:32.539482 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2637/5347] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:32.548083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72570a58-01cd-40ea-84b6-a9ef5eddb56a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:32.548522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72570a58-01cd-40ea-84b6-a9ef5eddb56a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:32.548930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72570a58-01cd-40ea-84b6-a9ef5eddb56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:32.581637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-72570a58-01cd-40ea-84b6-a9ef5eddb56a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:32.582614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-72570a58-01cd-40ea-84b6-a9ef5eddb56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:32.589614 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2711/5348] 10.222.0.13 () {60 vars in 1313 bytes} [Sat Dec 18 21:02:32 2021] POST /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials => generated 789 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:32.593996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d8ab0-8d45-45a8-810f-3b1e284feee1 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:32.596208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-581d8ab0-8d45-45a8-810f-3b1e284feee1 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:32.602732 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2638/5349] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:32.605984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72570a58-01cd-40ea-84b6-a9ef5eddb56a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:32.611855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d8ab0-8d45-45a8-810f-3b1e284feee1 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:32.618316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72570a58-01cd-40ea-84b6-a9ef5eddb56a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:32.619932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376f0d7-39ab-41e6-8f37-a812b344fac6 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665515a0e3164c92898dec7eb6cacf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:32.621130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376f0d7-39ab-41e6-8f37-a812b344fac6 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:32.621568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376f0d7-39ab-41e6-8f37-a812b344fac6 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:32.622491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376f0d7-39ab-41e6-8f37-a812b344fac6 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:32.623476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376f0d7-39ab-41e6-8f37-a812b344fac6 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorizing `identity:create_application_credential(user_id=665515a0e3164c92898dec7eb6cacf6b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:32.625084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376f0d7-39ab-41e6-8f37-a812b344fac6 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:32.625362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b142e72-a627-425d-9556-a120da3342cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:32.626123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b142e72-a627-425d-9556-a120da3342cd admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:32.626532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b142e72-a627-425d-9556-a120da3342cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:32.626905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b142e72-a627-425d-9556-a120da3342cd admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:32.628075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b142e72-a627-425d-9556-a120da3342cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:32.628478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b142e72-a627-425d-9556-a120da3342cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:32.630317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b142e72-a627-425d-9556-a120da3342cd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:32.658621 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2639/5350] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:32.662741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b142e72-a627-425d-9556-a120da3342cd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:32.683775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b142e72-a627-425d-9556-a120da3342cd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:32.689092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9847c2-9bfb-4939-813d-de0bd3ef9087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:32.689753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9847c2-9bfb-4939-813d-de0bd3ef9087 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:32.690038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9847c2-9bfb-4939-813d-de0bd3ef9087 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:32.690343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9847c2-9bfb-4939-813d-de0bd3ef9087 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:32.691098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9847c2-9bfb-4939-813d-de0bd3ef9087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:32.695326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9847c2-9bfb-4939-813d-de0bd3ef9087 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:32.730654 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2640/5351] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:32 2021] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:32.733787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9847c2-9bfb-4939-813d-de0bd3ef9087 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:32.752075 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2712/5352] 10.222.0.13 () {60 vars in 1313 bytes} [Sat Dec 18 21:02:32 2021] POST /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials => generated 788 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:02:32.756840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376f0d7-39ab-41e6-8f37-a812b344fac6 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:32.771018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376f0d7-39ab-41e6-8f37-a812b344fac6 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:32.833129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9847c2-9bfb-4939-813d-de0bd3ef9087 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:32.838722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb0f05-c44c-43f9-beac-2c441117ef21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:32.839368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb0f05-c44c-43f9-beac-2c441117ef21 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:32.839650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb0f05-c44c-43f9-beac-2c441117ef21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:32.839928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb0f05-c44c-43f9-beac-2c441117ef21 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:32.840742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb0f05-c44c-43f9-beac-2c441117ef21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:32.842796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb0f05-c44c-43f9-beac-2c441117ef21 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:32.850192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d544575-a7e3-4a3e-9180-fa0c6e10821b tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665515a0e3164c92898dec7eb6cacf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:32.851748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d544575-a7e3-4a3e-9180-fa0c6e10821b tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:32.852868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d544575-a7e3-4a3e-9180-fa0c6e10821b tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:32.854698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d544575-a7e3-4a3e-9180-fa0c6e10821b tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:32.855530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d544575-a7e3-4a3e-9180-fa0c6e10821b tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorizing `identity:list_application_credentials(user_id=665515a0e3164c92898dec7eb6cacf6b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:32.857696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d544575-a7e3-4a3e-9180-fa0c6e10821b tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:32.872747 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2641/5353] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:32 2021] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:32.873890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb0f05-c44c-43f9-beac-2c441117ef21 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:32.875284 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2713/5354] 10.222.0.13 () {58 vars in 1292 bytes} [Sat Dec 18 21:02:32 2021] GET /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials => generated 1501 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:32.876222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d544575-a7e3-4a3e-9180-fa0c6e10821b tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:32.886900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d544575-a7e3-4a3e-9180-fa0c6e10821b tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:32.887088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb0f05-c44c-43f9-beac-2c441117ef21 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:32.892255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47985cd8-1cea-4c5d-8c4f-7392b610f1c0 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665515a0e3164c92898dec7eb6cacf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:32.892487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13568e95-e895-4fba-bc7a-c06047fa3612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:32.893198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47985cd8-1cea-4c5d-8c4f-7392b610f1c0 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:32.893484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47985cd8-1cea-4c5d-8c4f-7392b610f1c0 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:32.893758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47985cd8-1cea-4c5d-8c4f-7392b610f1c0 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials/f95f9e2c11ce4a0a8856f9d0d2d57d63` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:32.894043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13568e95-e895-4fba-bc7a-c06047fa3612 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:32.895565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13568e95-e895-4fba-bc7a-c06047fa3612 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:32.896011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13568e95-e895-4fba-bc7a-c06047fa3612 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:32.898034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13568e95-e895-4fba-bc7a-c06047fa3612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:32.900781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13568e95-e895-4fba-bc7a-c06047fa3612 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:32.922890 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2642/5355] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:32 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:32.924615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13568e95-e895-4fba-bc7a-c06047fa3612 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:32.925167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47985cd8-1cea-4c5d-8c4f-7392b610f1c0 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorizing `identity:delete_application_credential(user_id=665515a0e3164c92898dec7eb6cacf6b, application_credential_id=f95f9e2c11ce4a0a8856f9d0d2d57d63)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:32.928561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47985cd8-1cea-4c5d-8c4f-7392b610f1c0 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:32.945712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13568e95-e895-4fba-bc7a-c06047fa3612 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:32.952930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8ec86-eb82-4f0e-aa0e-bcd4640a6858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:32.953659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8ec86-eb82-4f0e-aa0e-bcd4640a6858 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:32.953949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8ec86-eb82-4f0e-aa0e-bcd4640a6858 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:32.954341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8ec86-eb82-4f0e-aa0e-bcd4640a6858 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:32.955086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8ec86-eb82-4f0e-aa0e-bcd4640a6858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:32.956939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8ec86-eb82-4f0e-aa0e-bcd4640a6858 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:32.958493 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2714/5356] 10.222.0.13 () {58 vars in 1394 bytes} [Sat Dec 18 21:02:32 2021] DELETE /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials/f95f9e2c11ce4a0a8856f9d0d2d57d63 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:32.963338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47985cd8-1cea-4c5d-8c4f-7392b610f1c0 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:32.973356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47985cd8-1cea-4c5d-8c4f-7392b610f1c0 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:32.975259 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2643/5357] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:32 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:32.979786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8ec86-eb82-4f0e-aa0e-bcd4640a6858 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:32.983546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbc146-eaf1-418c-9fbe-356577892968 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665515a0e3164c92898dec7eb6cacf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:32.984500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbc146-eaf1-418c-9fbe-356577892968 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:32.984786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbc146-eaf1-418c-9fbe-356577892968 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:32.985071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbc146-eaf1-418c-9fbe-356577892968 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials/934c5a5598594960908c21f55526cb83` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:32.994004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8ec86-eb82-4f0e-aa0e-bcd4640a6858 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:32.996290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbc146-eaf1-418c-9fbe-356577892968 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorizing `identity:delete_application_credential(user_id=665515a0e3164c92898dec7eb6cacf6b, application_credential_id=934c5a5598594960908c21f55526cb83)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:32.998016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbc146-eaf1-418c-9fbe-356577892968 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:33.001658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1498209-56f3-406f-add0-b55e50bf74e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:33.002814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1498209-56f3-406f-add0-b55e50bf74e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:33.003597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1498209-56f3-406f-add0-b55e50bf74e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:33.004068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1498209-56f3-406f-add0-b55e50bf74e4 admin admin] PATH_INFO: `/v3/projects/54b9b5c2745548e48a1f01cfa857f69b/users/b67312bdf6614e6fab9abb2abc5ef5ac/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:33.023592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1498209-56f3-406f-add0-b55e50bf74e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b9b5c2745548e48a1f01cfa857f69b, user_id=b67312bdf6614e6fab9abb2abc5ef5ac, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:33.027887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1498209-56f3-406f-add0-b55e50bf74e4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:33.031291 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2715/5358] 10.222.0.13 () {58 vars in 1394 bytes} [Sat Dec 18 21:02:32 2021] DELETE /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials/934c5a5598594960908c21f55526cb83 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:33.037337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbc146-eaf1-418c-9fbe-356577892968 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:33.049173 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2644/5359] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:32 2021] PUT /identity/v3/projects/54b9b5c2745548e48a1f01cfa857f69b/users/b67312bdf6614e6fab9abb2abc5ef5ac/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:33.053180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbc146-eaf1-418c-9fbe-356577892968 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:33.060691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0b973-565c-437f-9d9e-5c162866aff1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:33.060992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0b973-565c-437f-9d9e-5c162866aff1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:33.061335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0b973-565c-437f-9d9e-5c162866aff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:33.107788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2ea0b973-565c-437f-9d9e-5c162866aff1 None None] MFA Rules not processed for user `b67312bdf6614e6fab9abb2abc5ef5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:33.109470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2ea0b973-565c-437f-9d9e-5c162866aff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:33.144032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17032cd-6bd6-4ce7-9d37-33cd00e81e08 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665515a0e3164c92898dec7eb6cacf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:33.144935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17032cd-6bd6-4ce7-9d37-33cd00e81e08 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:33.145543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17032cd-6bd6-4ce7-9d37-33cd00e81e08 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:33.145859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17032cd-6bd6-4ce7-9d37-33cd00e81e08 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:33.146673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17032cd-6bd6-4ce7-9d37-33cd00e81e08 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorizing `identity:create_application_credential(user_id=665515a0e3164c92898dec7eb6cacf6b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:33.147914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17032cd-6bd6-4ce7-9d37-33cd00e81e08 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:33.253311 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2716/5360] 10.222.0.13 () {60 vars in 1313 bytes} [Sat Dec 18 21:02:33 2021] POST /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials => generated 789 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:33.259669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17032cd-6bd6-4ce7-9d37-33cd00e81e08 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:33.260218 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2645/5361] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:33 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:33.260796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0b973-565c-437f-9d9e-5c162866aff1 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:33.277420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17032cd-6bd6-4ce7-9d37-33cd00e81e08 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:33.298383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6df45-a577-436a-8b92-a9848a8dbd8c tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665515a0e3164c92898dec7eb6cacf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:33.300040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6df45-a577-436a-8b92-a9848a8dbd8c tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:33.301283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6df45-a577-436a-8b92-a9848a8dbd8c tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:33.301794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6df45-a577-436a-8b92-a9848a8dbd8c tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:33.304527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6df45-a577-436a-8b92-a9848a8dbd8c tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorizing `identity:create_application_credential(user_id=665515a0e3164c92898dec7eb6cacf6b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:33.306581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6df45-a577-436a-8b92-a9848a8dbd8c tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:33.372897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0b973-565c-437f-9d9e-5c162866aff1 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:33.379044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a77be6-9505-4f39-baf6-b9a80428979f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:33.379799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77be6-9505-4f39-baf6-b9a80428979f admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:33.380364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77be6-9505-4f39-baf6-b9a80428979f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:33.380650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77be6-9505-4f39-baf6-b9a80428979f admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:33.381869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a77be6-9505-4f39-baf6-b9a80428979f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:33.385609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a77be6-9505-4f39-baf6-b9a80428979f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:33.416910 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2717/5362] 10.222.0.13 () {60 vars in 1313 bytes} [Sat Dec 18 21:02:33 2021] POST /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials => generated 789 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:33.419098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6df45-a577-436a-8b92-a9848a8dbd8c tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:33.426725 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2646/5363] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:33 2021] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:33.431050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a77be6-9505-4f39-baf6-b9a80428979f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:33.436889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6df45-a577-436a-8b92-a9848a8dbd8c tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:33.512441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a0431-8065-449b-85e5-fca4037e1187 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665515a0e3164c92898dec7eb6cacf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:33.513622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a0431-8065-449b-85e5-fca4037e1187 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:33.513987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a0431-8065-449b-85e5-fca4037e1187 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:33.514440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a0431-8065-449b-85e5-fca4037e1187 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:33.515259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a0431-8065-449b-85e5-fca4037e1187 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Adding query filter params (name=tempest-application_credential-2016089737) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:33.515683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a0431-8065-449b-85e5-fca4037e1187 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorizing `identity:list_application_credentials(user_id=665515a0e3164c92898dec7eb6cacf6b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:33.517429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a0431-8065-449b-85e5-fca4037e1187 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:33.518973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a77be6-9505-4f39-baf6-b9a80428979f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:33.525066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03093c6c-7408-4a95-ba27-3c7c05b81b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:33.526008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03093c6c-7408-4a95-ba27-3c7c05b81b21 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:33.526684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03093c6c-7408-4a95-ba27-3c7c05b81b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:33.527195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03093c6c-7408-4a95-ba27-3c7c05b81b21 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:33.528136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03093c6c-7408-4a95-ba27-3c7c05b81b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:33.530358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03093c6c-7408-4a95-ba27-3c7c05b81b21 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:33.530985 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2718/5364] 10.222.0.13 () {58 vars in 1385 bytes} [Sat Dec 18 21:02:33 2021] GET /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials?name=tempest-application_credential-2016089737 => generated 887 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:33.534879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a0431-8065-449b-85e5-fca4037e1187 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:33.547807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a0431-8065-449b-85e5-fca4037e1187 tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:33.555303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7c38d-d26b-4994-a070-7b46e7008d7a tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665515a0e3164c92898dec7eb6cacf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:33.558836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7c38d-d26b-4994-a070-7b46e7008d7a tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:33.559860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7c38d-d26b-4994-a070-7b46e7008d7a tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:33.560268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7c38d-d26b-4994-a070-7b46e7008d7a tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials/850c5d6107c8462cb73dfe59c1004fc2` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:33.573421 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2647/5365] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:33 2021] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:02:33.576928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03093c6c-7408-4a95-ba27-3c7c05b81b21 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:33.583178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7c38d-d26b-4994-a070-7b46e7008d7a tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorizing `identity:delete_application_credential(user_id=665515a0e3164c92898dec7eb6cacf6b, application_credential_id=850c5d6107c8462cb73dfe59c1004fc2)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:33.586389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7c38d-d26b-4994-a070-7b46e7008d7a tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:33.598427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03093c6c-7408-4a95-ba27-3c7c05b81b21 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:33.613483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea84b8-aece-489a-8fde-ce0ac4269887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:33.614318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea84b8-aece-489a-8fde-ce0ac4269887 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:33.614610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea84b8-aece-489a-8fde-ce0ac4269887 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:33.614888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea84b8-aece-489a-8fde-ce0ac4269887 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:33.620790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea84b8-aece-489a-8fde-ce0ac4269887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:33.622298 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2719/5366] 10.222.0.13 () {58 vars in 1394 bytes} [Sat Dec 18 21:02:33 2021] DELETE /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials/850c5d6107c8462cb73dfe59c1004fc2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:33.622473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea84b8-aece-489a-8fde-ce0ac4269887 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:33.625721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7c38d-d26b-4994-a070-7b46e7008d7a tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:33.636097 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2648/5367] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:33 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:33.637117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea84b8-aece-489a-8fde-ce0ac4269887 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:33.639751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7c38d-d26b-4994-a070-7b46e7008d7a tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:33.646348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe1896-bd08-427d-8d24-2b9db170c0cb tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '665515a0e3164c92898dec7eb6cacf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:33.647106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea84b8-aece-489a-8fde-ce0ac4269887 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:33.648123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe1896-bd08-427d-8d24-2b9db170c0cb tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:33.648601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe1896-bd08-427d-8d24-2b9db170c0cb tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:33.648954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe1896-bd08-427d-8d24-2b9db170c0cb tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials/f3c44aff8868457dbd3c4f16529a46ee` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:33.653127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42110ce4-ba31-4915-891e-3fb6b93ff2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:33.654389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42110ce4-ba31-4915-891e-3fb6b93ff2ef admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:33.654971 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42110ce4-ba31-4915-891e-3fb6b93ff2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:33.655269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42110ce4-ba31-4915-891e-3fb6b93ff2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:33.657407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42110ce4-ba31-4915-891e-3fb6b93ff2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:33.658918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe1896-bd08-427d-8d24-2b9db170c0cb tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorizing `identity:delete_application_credential(user_id=665515a0e3164c92898dec7eb6cacf6b, application_credential_id=f3c44aff8868457dbd3c4f16529a46ee)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:33.659056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42110ce4-ba31-4915-891e-3fb6b93ff2ef admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:33.661466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe1896-bd08-427d-8d24-2b9db170c0cb tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:33.675291 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2649/5368] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:33 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:02:33.679094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42110ce4-ba31-4915-891e-3fb6b93ff2ef admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:33.687596 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2720/5369] 10.222.0.13 () {58 vars in 1394 bytes} [Sat Dec 18 21:02:33 2021] DELETE /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b/application_credentials/f3c44aff8868457dbd3c4f16529a46ee => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:33.694146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42110ce4-ba31-4915-891e-3fb6b93ff2ef admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:33.695265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe1896-bd08-427d-8d24-2b9db170c0cb tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:33.699448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0859f24-48ab-4ef2-9a42-2239077848d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:33.700814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0859f24-48ab-4ef2-9a42-2239077848d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:33.700814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0859f24-48ab-4ef2-9a42-2239077848d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:33.701175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0859f24-48ab-4ef2-9a42-2239077848d0 admin admin] PATH_INFO: `/v3/projects/37515c9f9f3e497cb6bc211df004327a/users/8e843f9611c3443581c5058e5b6f2a32/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:33.706513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3efe1896-bd08-427d-8d24-2b9db170c0cb tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:33.725138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0859f24-48ab-4ef2-9a42-2239077848d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37515c9f9f3e497cb6bc211df004327a, user_id=8e843f9611c3443581c5058e5b6f2a32, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:33.727561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe1896-bd08-427d-8d24-2b9db170c0cb tempest-ApplicationCredentialsV3Test-580204198 tempest-ApplicationCredentialsV3Test-580204198-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:33.729257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0859f24-48ab-4ef2-9a42-2239077848d0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:33.735329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d04f49-71a3-47c8-b7de-82cb20b39c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:33.739934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d04f49-71a3-47c8-b7de-82cb20b39c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:33.740204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d04f49-71a3-47c8-b7de-82cb20b39c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:33.740720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d04f49-71a3-47c8-b7de-82cb20b39c17 admin admin] PATH_INFO: `/v3/users/665515a0e3164c92898dec7eb6cacf6b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:33.742145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d04f49-71a3-47c8-b7de-82cb20b39c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=665515a0e3164c92898dec7eb6cacf6b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:33.744702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d04f49-71a3-47c8-b7de-82cb20b39c17 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:33.753398 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2650/5370] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:33 2021] PUT /identity/v3/projects/37515c9f9f3e497cb6bc211df004327a/users/8e843f9611c3443581c5058e5b6f2a32/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:33.765554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9aa249-ae02-461f-bd8f-d3db73b05ce2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:33.765953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9aa249-ae02-461f-bd8f-d3db73b05ce2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:33.766195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9aa249-ae02-461f-bd8f-d3db73b05ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:33.795851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0a9aa249-ae02-461f-bd8f-d3db73b05ce2 None None] MFA Rules not processed for user `8e843f9611c3443581c5058e5b6f2a32`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:33.797005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0a9aa249-ae02-461f-bd8f-d3db73b05ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:33.814183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b5d04f49-71a3-47c8-b7de-82cb20b39c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665515a0e3164c92898dec7eb6cacf6b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:33.831504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b5d04f49-71a3-47c8-b7de-82cb20b39c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665515a0e3164c92898dec7eb6cacf6b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:33.832427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b5d04f49-71a3-47c8-b7de-82cb20b39c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665515a0e3164c92898dec7eb6cacf6b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:33.888586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b5d04f49-71a3-47c8-b7de-82cb20b39c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665515a0e3164c92898dec7eb6cacf6b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:33.897015 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2651/5371] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:33 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:33.911297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b5d04f49-71a3-47c8-b7de-82cb20b39c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665515a0e3164c92898dec7eb6cacf6b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:33.916474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9aa249-ae02-461f-bd8f-d3db73b05ce2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:33.919648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0a9aa249-ae02-461f-bd8f-d3db73b05ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:33.920155 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2721/5372] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:33 2021] DELETE /identity/v3/users/665515a0e3164c92898dec7eb6cacf6b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:33.927000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab53313-24b6-407e-a10b-2c5755d633b3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:33.927403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab53313-24b6-407e-a10b-2c5755d633b3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:33.927759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab53313-24b6-407e-a10b-2c5755d633b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:33.950784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bab53313-24b6-407e-a10b-2c5755d633b3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:33.952379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bab53313-24b6-407e-a10b-2c5755d633b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:34.014446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9aa249-ae02-461f-bd8f-d3db73b05ce2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:34.025416 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2722/5373] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:34.034321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab53313-24b6-407e-a10b-2c5755d633b3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:34.036924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bab53313-24b6-407e-a10b-2c5755d633b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:34.083587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db23d72-b2f5-439a-82ec-56da9c45e204 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:34.084231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db23d72-b2f5-439a-82ec-56da9c45e204 service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:34.084524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db23d72-b2f5-439a-82ec-56da9c45e204 service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:34.084810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db23d72-b2f5-439a-82ec-56da9c45e204 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:34.086725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6db23d72-b2f5-439a-82ec-56da9c45e204 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:34.132773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab53313-24b6-407e-a10b-2c5755d633b3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:34.139313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ffc9c-4752-4cf8-b007-73900e087d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:34.140165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ffc9c-4752-4cf8-b007-73900e087d6a service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:34.140605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ffc9c-4752-4cf8-b007-73900e087d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:34.141167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ffc9c-4752-4cf8-b007-73900e087d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:34.160816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ffc9c-4752-4cf8-b007-73900e087d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:34.162671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ffc9c-4752-4cf8-b007-73900e087d6a service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:34.164210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db23d72-b2f5-439a-82ec-56da9c45e204 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:34.167784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db23d72-b2f5-439a-82ec-56da9c45e204 service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:34.175394 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2723/5374] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:34.197483 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2652/5375] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:33 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:34.333054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b74928-66f1-43ec-b4d4-c4adb9b25f78 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:34.333879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b74928-66f1-43ec-b4d4-c4adb9b25f78 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:34.335098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b74928-66f1-43ec-b4d4-c4adb9b25f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:34.388364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-07b74928-66f1-43ec-b4d4-c4adb9b25f78 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:34.390302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-07b74928-66f1-43ec-b4d4-c4adb9b25f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:34.499632 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2724/5376] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:02:34 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:34.556687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b74928-66f1-43ec-b4d4-c4adb9b25f78 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:34.557508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db23d72-b2f5-439a-82ec-56da9c45e204 service glance] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:34.558857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-07b74928-66f1-43ec-b4d4-c4adb9b25f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:34.561140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6db23d72-b2f5-439a-82ec-56da9c45e204 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:34.573820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b74928-66f1-43ec-b4d4-c4adb9b25f78 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:34.578848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a9038-1b82-4705-b104-e69da9e88d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:34.579718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a9038-1b82-4705-b104-e69da9e88d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:34.579998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a9038-1b82-4705-b104-e69da9e88d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:34.580276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a9038-1b82-4705-b104-e69da9e88d0f admin admin] PATH_INFO: `/v3/users/8c47da68e55c42329c3de60422bfa862` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:34.581665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a9038-1b82-4705-b104-e69da9e88d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c47da68e55c42329c3de60422bfa862)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:34.583608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a9038-1b82-4705-b104-e69da9e88d0f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:34.647307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4d2a9038-1b82-4705-b104-e69da9e88d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c47da68e55c42329c3de60422bfa862'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:34.656360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4d2a9038-1b82-4705-b104-e69da9e88d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c47da68e55c42329c3de60422bfa862'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:34.658051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4d2a9038-1b82-4705-b104-e69da9e88d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c47da68e55c42329c3de60422bfa862'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:34.683335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4d2a9038-1b82-4705-b104-e69da9e88d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c47da68e55c42329c3de60422bfa862'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:34.686105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db23d72-b2f5-439a-82ec-56da9c45e204 service glance] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:34.693276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4d2a9038-1b82-4705-b104-e69da9e88d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c47da68e55c42329c3de60422bfa862'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:34.693676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291f5d1-f32b-4e2c-b51d-c1a3fd6aa098 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:34.694587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291f5d1-f32b-4e2c-b51d-c1a3fd6aa098 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:34.695060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291f5d1-f32b-4e2c-b51d-c1a3fd6aa098 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:34.695466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291f5d1-f32b-4e2c-b51d-c1a3fd6aa098 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:34.697752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9291f5d1-f32b-4e2c-b51d-c1a3fd6aa098 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:34.705050 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2725/5377] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:34 2021] DELETE /identity/v3/users/8c47da68e55c42329c3de60422bfa862 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:34.706410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a9038-1b82-4705-b104-e69da9e88d0f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:34.713840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291f5d1-f32b-4e2c-b51d-c1a3fd6aa098 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:34.715673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291f5d1-f32b-4e2c-b51d-c1a3fd6aa098 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:34.718894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4d2a9038-1b82-4705-b104-e69da9e88d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:34.725847 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2653/5378] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:02:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:02:34.727171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a28a3-9517-47d1-a588-89600766d6f4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:34.727566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a28a3-9517-47d1-a588-89600766d6f4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:34.728263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a28a3-9517-47d1-a588-89600766d6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:34.762646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-041a28a3-9517-47d1-a588-89600766d6f4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:34.763848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-041a28a3-9517-47d1-a588-89600766d6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:34.821421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a9038-1b82-4705-b104-e69da9e88d0f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:34.830588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f578f3-b5f2-4390-aa1b-ff9e789ce069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:34.832848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f578f3-b5f2-4390-aa1b-ff9e789ce069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:34.833221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f578f3-b5f2-4390-aa1b-ff9e789ce069 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:34.834037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f578f3-b5f2-4390-aa1b-ff9e789ce069 admin admin] PATH_INFO: `/v3/projects/6bcda0eef0cc4cfba8a358c27ca82c4d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:34.835033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f578f3-b5f2-4390-aa1b-ff9e789ce069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bcda0eef0cc4cfba8a358c27ca82c4d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:34.837441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f578f3-b5f2-4390-aa1b-ff9e789ce069 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:34.847893 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2654/5379] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:34.858717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a28a3-9517-47d1-a588-89600766d6f4 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:34.860897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-041a28a3-9517-47d1-a588-89600766d6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:34.911527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b7f578f3-b5f2-4390-aa1b-ff9e789ce069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'request_id': 'req-b7f578f3-b5f2-4390-aa1b-ff9e789ce069'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:34.920179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b7f578f3-b5f2-4390-aa1b-ff9e789ce069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'request_id': 'req-b7f578f3-b5f2-4390-aa1b-ff9e789ce069'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:34.942957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b7f578f3-b5f2-4390-aa1b-ff9e789ce069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bcda0eef0cc4cfba8a358c27ca82c4d', 'request_id': 'req-b7f578f3-b5f2-4390-aa1b-ff9e789ce069'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:34.972652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b7f578f3-b5f2-4390-aa1b-ff9e789ce069 admin admin] The token cache is being invalidate because project 6bcda0eef0cc4cfba8a358c27ca82c4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:34.972963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b7f578f3-b5f2-4390-aa1b-ff9e789ce069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:34.973863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b7f578f3-b5f2-4390-aa1b-ff9e789ce069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:34.975841 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2726/5380] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:34 2021] DELETE /identity/v3/projects/6bcda0eef0cc4cfba8a358c27ca82c4d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:34.980721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a28a3-9517-47d1-a588-89600766d6f4 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:34.982915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa9cca-2f39-411a-88aa-0daa16a5da9d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:34.983220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa9cca-2f39-411a-88aa-0daa16a5da9d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:34.983486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa9cca-2f39-411a-88aa-0daa16a5da9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:35.008090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-31aa9cca-2f39-411a-88aa-0daa16a5da9d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:35.010580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-31aa9cca-2f39-411a-88aa-0daa16a5da9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:35.038515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a398cac-41da-4898-82a3-686db87bdaca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:35.039208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398cac-41da-4898-82a3-686db87bdaca service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:35.039554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398cac-41da-4898-82a3-686db87bdaca service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:35.039865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398cac-41da-4898-82a3-686db87bdaca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:35.042367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1a398cac-41da-4898-82a3-686db87bdaca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:35.084215 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2727/5381] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:35.085313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa9cca-2f39-411a-88aa-0daa16a5da9d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:35.086738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-31aa9cca-2f39-411a-88aa-0daa16a5da9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:35.126064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a398cac-41da-4898-82a3-686db87bdaca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:35.127627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a398cac-41da-4898-82a3-686db87bdaca service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:35.139193 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2655/5382] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:35.140899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee2510-615f-4687-a859-936a631b7600 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:35.141379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee2510-615f-4687-a859-936a631b7600 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:35.141950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee2510-615f-4687-a859-936a631b7600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:35.166118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-53ee2510-615f-4687-a859-936a631b7600 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:35.167319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-53ee2510-615f-4687-a859-936a631b7600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:35.178017 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2656/5383] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:35.182425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee2510-615f-4687-a859-936a631b7600 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:35.186023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa9cca-2f39-411a-88aa-0daa16a5da9d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:35.192808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0e05d-a405-4517-9f6d-4b154f2ab15e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:35.193584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee2510-615f-4687-a859-936a631b7600 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:35.193856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0e05d-a405-4517-9f6d-4b154f2ab15e service glance] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:35.194231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0e05d-a405-4517-9f6d-4b154f2ab15e service glance] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:35.194642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0e05d-a405-4517-9f6d-4b154f2ab15e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:35.197585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8ae0e05d-a405-4517-9f6d-4b154f2ab15e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:35.202007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1161d83-cafe-47f1-8406-55b9b3b751fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:35.202968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1161d83-cafe-47f1-8406-55b9b3b751fd admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:35.203374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1161d83-cafe-47f1-8406-55b9b3b751fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:35.203972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1161d83-cafe-47f1-8406-55b9b3b751fd admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:35.204537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1161d83-cafe-47f1-8406-55b9b3b751fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:35.205056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1161d83-cafe-47f1-8406-55b9b3b751fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:35.206801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1161d83-cafe-47f1-8406-55b9b3b751fd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:35.221616 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2657/5384] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:35.226198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1161d83-cafe-47f1-8406-55b9b3b751fd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:35.237356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1161d83-cafe-47f1-8406-55b9b3b751fd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:35.243109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2b170-ebef-4755-9b73-d99689b265bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:35.244324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2b170-ebef-4755-9b73-d99689b265bd admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:35.244638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2b170-ebef-4755-9b73-d99689b265bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:35.244942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2b170-ebef-4755-9b73-d99689b265bd admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:35.245741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2b170-ebef-4755-9b73-d99689b265bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:35.247703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2b170-ebef-4755-9b73-d99689b265bd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:35.269062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0e05d-a405-4517-9f6d-4b154f2ab15e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:35.270793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0e05d-a405-4517-9f6d-4b154f2ab15e service glance] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:35.282314 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2658/5385] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:35 2021] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:35.282527 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2728/5386] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:35 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:35.284290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2b170-ebef-4755-9b73-d99689b265bd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:35.375625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2b170-ebef-4755-9b73-d99689b265bd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:35.389141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fc1f9-1201-4beb-bfd1-169a9fc9c94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:35.390387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fc1f9-1201-4beb-bfd1-169a9fc9c94f admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:35.391436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bea303-84f2-42e8-a993-2103bcf0d431 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:35.391612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fc1f9-1201-4beb-bfd1-169a9fc9c94f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:35.391872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bea303-84f2-42e8-a993-2103bcf0d431 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:35.392213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bea303-84f2-42e8-a993-2103bcf0d431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:35.392506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fc1f9-1201-4beb-bfd1-169a9fc9c94f admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:35.393795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fc1f9-1201-4beb-bfd1-169a9fc9c94f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:35.396987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fc1f9-1201-4beb-bfd1-169a9fc9c94f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:35.411871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c8bea303-84f2-42e8-a993-2103bcf0d431 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:35.413180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c8bea303-84f2-42e8-a993-2103bcf0d431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:35.444623 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2659/5387] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:35 2021] POST /identity/v3/users => generated 306 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:02:35.454245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fc1f9-1201-4beb-bfd1-169a9fc9c94f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:35.466716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fc1f9-1201-4beb-bfd1-169a9fc9c94f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:35.473037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbf18d-611e-4a1a-bb01-b1886b27ca2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:35.474076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbf18d-611e-4a1a-bb01-b1886b27ca2f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:35.474323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbf18d-611e-4a1a-bb01-b1886b27ca2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:35.474666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbf18d-611e-4a1a-bb01-b1886b27ca2f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:35.475592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbf18d-611e-4a1a-bb01-b1886b27ca2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:35.477329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbf18d-611e-4a1a-bb01-b1886b27ca2f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:35.489567 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2660/5388] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:35 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:35.494656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbf18d-611e-4a1a-bb01-b1886b27ca2f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:35.500612 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2729/5389] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 21:02:35 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:35.513150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbf18d-611e-4a1a-bb01-b1886b27ca2f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:35.521415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bc404-9dff-4731-ad48-179d78bfe199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:35.522510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bc404-9dff-4731-ad48-179d78bfe199 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:35.523441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bc404-9dff-4731-ad48-179d78bfe199 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:35.523609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bc404-9dff-4731-ad48-179d78bfe199 admin admin] PATH_INFO: `/v3/projects/57f50b0136fe4f3995186749899c4344/users/f6e2be6309ba4258a1599caecba7dce6/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:35.525681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bea303-84f2-42e8-a993-2103bcf0d431 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:35.528034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c8bea303-84f2-42e8-a993-2103bcf0d431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:35.545225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bc404-9dff-4731-ad48-179d78bfe199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f50b0136fe4f3995186749899c4344, user_id=f6e2be6309ba4258a1599caecba7dce6, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:35.549951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bea303-84f2-42e8-a993-2103bcf0d431 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:35.550127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bc404-9dff-4731-ad48-179d78bfe199 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:35.555709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa804a0c-c01c-42e5-bb6a-79f12b127399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:35.557195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa804a0c-c01c-42e5-bb6a-79f12b127399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:35.557857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa804a0c-c01c-42e5-bb6a-79f12b127399 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:35.558508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa804a0c-c01c-42e5-bb6a-79f12b127399 admin admin] PATH_INFO: `/v3/projects/e1ebcef17bb4458fa70b95e48552082a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:35.560669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa804a0c-c01c-42e5-bb6a-79f12b127399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ebcef17bb4458fa70b95e48552082a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:35.562955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa804a0c-c01c-42e5-bb6a-79f12b127399 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:35.573825 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2661/5390] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:35 2021] PUT /identity/v3/projects/57f50b0136fe4f3995186749899c4344/users/f6e2be6309ba4258a1599caecba7dce6/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:35.574881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bc404-9dff-4731-ad48-179d78bfe199 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:35.577617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-178bc404-9dff-4731-ad48-179d78bfe199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:35.643903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fa804a0c-c01c-42e5-bb6a-79f12b127399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ebcef17bb4458fa70b95e48552082a', 'request_id': 'req-fa804a0c-c01c-42e5-bb6a-79f12b127399'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:35.660897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fa804a0c-c01c-42e5-bb6a-79f12b127399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ebcef17bb4458fa70b95e48552082a', 'request_id': 'req-fa804a0c-c01c-42e5-bb6a-79f12b127399'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:35.671717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bc404-9dff-4731-ad48-179d78bfe199 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:35.682180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fa804a0c-c01c-42e5-bb6a-79f12b127399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ebcef17bb4458fa70b95e48552082a', 'request_id': 'req-fa804a0c-c01c-42e5-bb6a-79f12b127399'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:35.695504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fa804a0c-c01c-42e5-bb6a-79f12b127399 admin admin] The token cache is being invalidate because project e1ebcef17bb4458fa70b95e48552082a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:35.695912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fa804a0c-c01c-42e5-bb6a-79f12b127399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:35.696969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fa804a0c-c01c-42e5-bb6a-79f12b127399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:35.702169 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2730/5391] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:35 2021] DELETE /identity/v3/projects/e1ebcef17bb4458fa70b95e48552082a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:35.702169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa804a0c-c01c-42e5-bb6a-79f12b127399 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:35.702169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fa804a0c-c01c-42e5-bb6a-79f12b127399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:35.772135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707e1b0-018c-4632-b123-73d7c0f6ecdd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:35.773044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707e1b0-018c-4632-b123-73d7c0f6ecdd service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:35.773475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707e1b0-018c-4632-b123-73d7c0f6ecdd service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:35.773814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707e1b0-018c-4632-b123-73d7c0f6ecdd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:35.776208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7707e1b0-018c-4632-b123-73d7c0f6ecdd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:35.787111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa804a0c-c01c-42e5-bb6a-79f12b127399 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:35.794768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5a06d-e9ee-487f-8215-97755f9a6a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:35.795536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5a06d-e9ee-487f-8215-97755f9a6a9a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:35.795847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5a06d-e9ee-487f-8215-97755f9a6a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:35.796154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5a06d-e9ee-487f-8215-97755f9a6a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:35.797110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5a06d-e9ee-487f-8215-97755f9a6a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:35.799172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5a06d-e9ee-487f-8215-97755f9a6a9a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:35.811692 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2731/5392] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:35 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:35.812976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5a06d-e9ee-487f-8215-97755f9a6a9a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:35.814893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7ec5a06d-e9ee-487f-8215-97755f9a6a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:35.828143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5a06d-e9ee-487f-8215-97755f9a6a9a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:35.834513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4c607-9330-4088-9052-5f938c665691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:35.835446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4c607-9330-4088-9052-5f938c665691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:35.835841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4c607-9330-4088-9052-5f938c665691 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:35.836091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4c607-9330-4088-9052-5f938c665691 admin admin] PATH_INFO: `/v3/users/7f6d588e2f474ab0ba57988b7e8910e6` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:35.837229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4c607-9330-4088-9052-5f938c665691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6d588e2f474ab0ba57988b7e8910e6)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:35.839506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4c607-9330-4088-9052-5f938c665691 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:35.845255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707e1b0-018c-4632-b123-73d7c0f6ecdd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:35.847013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707e1b0-018c-4632-b123-73d7c0f6ecdd service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:35.856892 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2662/5393] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:02:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:02:35.858075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707e1b0-018c-4632-b123-73d7c0f6ecdd service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:35.870401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707e1b0-018c-4632-b123-73d7c0f6ecdd service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:35.877242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458d6b5-d76d-46bc-8b0c-c9631ec190c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:35.879128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458d6b5-d76d-46bc-8b0c-c9631ec190c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:35.879439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458d6b5-d76d-46bc-8b0c-c9631ec190c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:35.879949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458d6b5-d76d-46bc-8b0c-c9631ec190c3 admin admin] PATH_INFO: `/v3/projects/57f50b0136fe4f3995186749899c4344/users/f6e2be6309ba4258a1599caecba7dce6/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:35.883165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458d6b5-d76d-46bc-8b0c-c9631ec190c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f50b0136fe4f3995186749899c4344, user_id=f6e2be6309ba4258a1599caecba7dce6, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:35.886193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458d6b5-d76d-46bc-8b0c-c9631ec190c3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:35.898911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-49a4c607-9330-4088-9052-5f938c665691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6d588e2f474ab0ba57988b7e8910e6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:35.900944 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2663/5394] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:35 2021] PUT /identity/v3/projects/57f50b0136fe4f3995186749899c4344/users/f6e2be6309ba4258a1599caecba7dce6/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:35.907295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-49a4c607-9330-4088-9052-5f938c665691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6d588e2f474ab0ba57988b7e8910e6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:35.908039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-49a4c607-9330-4088-9052-5f938c665691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6d588e2f474ab0ba57988b7e8910e6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:35.913342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7913bf-2578-44e0-8931-63f935d2de90 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:35.913782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7913bf-2578-44e0-8931-63f935d2de90 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:35.913949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7913bf-2578-44e0-8931-63f935d2de90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:35.923398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-49a4c607-9330-4088-9052-5f938c665691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6d588e2f474ab0ba57988b7e8910e6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:35.934331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-49a4c607-9330-4088-9052-5f938c665691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6d588e2f474ab0ba57988b7e8910e6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:35.943512 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2732/5395] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:35 2021] DELETE /identity/v3/users/7f6d588e2f474ab0ba57988b7e8910e6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:35.951800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4e7913bf-2578-44e0-8931-63f935d2de90 None None] MFA Rules not processed for user `f6e2be6309ba4258a1599caecba7dce6`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:35.953149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4e7913bf-2578-44e0-8931-63f935d2de90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:35.997244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4c607-9330-4088-9052-5f938c665691 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:35.999017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-49a4c607-9330-4088-9052-5f938c665691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:36.068798 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2664/5396] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:35 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:36.073372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7913bf-2578-44e0-8931-63f935d2de90 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:36.075803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4e7913bf-2578-44e0-8931-63f935d2de90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:36.086981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4c607-9330-4088-9052-5f938c665691 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:36.094109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7913bf-2578-44e0-8931-63f935d2de90 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:36.095809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab07035-1a8c-4561-94e3-df040a417298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:36.097029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab07035-1a8c-4561-94e3-df040a417298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.097510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab07035-1a8c-4561-94e3-df040a417298 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.097948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab07035-1a8c-4561-94e3-df040a417298 admin admin] PATH_INFO: `/v3/users/b67312bdf6614e6fab9abb2abc5ef5ac` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.099805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab07035-1a8c-4561-94e3-df040a417298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b67312bdf6614e6fab9abb2abc5ef5ac)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:36.100799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51717cf-5b2b-4c9a-bc6d-640f59cae2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:36.101464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51717cf-5b2b-4c9a-bc6d-640f59cae2dd admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.101748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51717cf-5b2b-4c9a-bc6d-640f59cae2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.102346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab07035-1a8c-4561-94e3-df040a417298 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:36.102519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51717cf-5b2b-4c9a-bc6d-640f59cae2dd admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.104343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51717cf-5b2b-4c9a-bc6d-640f59cae2dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:36.106744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51717cf-5b2b-4c9a-bc6d-640f59cae2dd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:36.138369 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2665/5397] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:36 2021] POST /identity/v3/projects => generated 397 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:02:36.143324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51717cf-5b2b-4c9a-bc6d-640f59cae2dd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:36.171153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dab07035-1a8c-4561-94e3-df040a417298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b67312bdf6614e6fab9abb2abc5ef5ac'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:36.179161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dab07035-1a8c-4561-94e3-df040a417298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b67312bdf6614e6fab9abb2abc5ef5ac'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:36.179951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dab07035-1a8c-4561-94e3-df040a417298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b67312bdf6614e6fab9abb2abc5ef5ac'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:36.194061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dab07035-1a8c-4561-94e3-df040a417298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b67312bdf6614e6fab9abb2abc5ef5ac'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:36.203001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dab07035-1a8c-4561-94e3-df040a417298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b67312bdf6614e6fab9abb2abc5ef5ac'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:36.209753 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2733/5398] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:35 2021] DELETE /identity/v3/users/b67312bdf6614e6fab9abb2abc5ef5ac => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:36.210687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab07035-1a8c-4561-94e3-df040a417298 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:36.212136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dab07035-1a8c-4561-94e3-df040a417298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:36.235969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51717cf-5b2b-4c9a-bc6d-640f59cae2dd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:36.281902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab07035-1a8c-4561-94e3-df040a417298 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:36.287582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810586b1-2bc9-46ea-ad03-2b23d8d3a349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:36.288441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810586b1-2bc9-46ea-ad03-2b23d8d3a349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.288732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810586b1-2bc9-46ea-ad03-2b23d8d3a349 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.289013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810586b1-2bc9-46ea-ad03-2b23d8d3a349 admin admin] PATH_INFO: `/v3/projects/66cceca1286c45e6b03c26cdde24a002` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.290504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810586b1-2bc9-46ea-ad03-2b23d8d3a349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66cceca1286c45e6b03c26cdde24a002)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:36.293284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810586b1-2bc9-46ea-ad03-2b23d8d3a349 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:36.301212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9391f4-a5e6-418c-b3eb-796a2cea806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:36.302223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9391f4-a5e6-418c-b3eb-796a2cea806b admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.302553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9391f4-a5e6-418c-b3eb-796a2cea806b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.302857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9391f4-a5e6-418c-b3eb-796a2cea806b admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.303643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9391f4-a5e6-418c-b3eb-796a2cea806b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:36.305861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9391f4-a5e6-418c-b3eb-796a2cea806b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:36.334315 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2666/5399] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:36 2021] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:36.334315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dcc43-60f4-49d3-9341-043f451c0e1b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.334315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dcc43-60f4-49d3-9341-043f451c0e1b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.334315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dcc43-60f4-49d3-9341-043f451c0e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.347211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-810586b1-2bc9-46ea-ad03-2b23d8d3a349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66cceca1286c45e6b03c26cdde24a002', 'request_id': 'req-810586b1-2bc9-46ea-ad03-2b23d8d3a349'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:36.355152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-810586b1-2bc9-46ea-ad03-2b23d8d3a349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66cceca1286c45e6b03c26cdde24a002', 'request_id': 'req-810586b1-2bc9-46ea-ad03-2b23d8d3a349'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:36.357447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-264dcc43-60f4-49d3-9341-043f451c0e1b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:36.358998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-264dcc43-60f4-49d3-9341-043f451c0e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:36.365949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-810586b1-2bc9-46ea-ad03-2b23d8d3a349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66cceca1286c45e6b03c26cdde24a002', 'request_id': 'req-810586b1-2bc9-46ea-ad03-2b23d8d3a349'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:36.377845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-810586b1-2bc9-46ea-ad03-2b23d8d3a349 admin admin] The token cache is being invalidate because project 66cceca1286c45e6b03c26cdde24a002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:36.378151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-810586b1-2bc9-46ea-ad03-2b23d8d3a349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:36.379086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-810586b1-2bc9-46ea-ad03-2b23d8d3a349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:36.380803 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2734/5400] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:36 2021] DELETE /identity/v3/projects/66cceca1286c45e6b03c26cdde24a002 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:36.382169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810586b1-2bc9-46ea-ad03-2b23d8d3a349 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:36.383644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-810586b1-2bc9-46ea-ad03-2b23d8d3a349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:36.433017 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2667/5401] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:36.434106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1a4f0-3e6f-4a76-b66e-438189e5c52c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.434555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1a4f0-3e6f-4a76-b66e-438189e5c52c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.434842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1a4f0-3e6f-4a76-b66e-438189e5c52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.454832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810586b1-2bc9-46ea-ad03-2b23d8d3a349 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:36.456132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c8a1a4f0-3e6f-4a76-b66e-438189e5c52c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:36.457452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c8a1a4f0-3e6f-4a76-b66e-438189e5c52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:36.462175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60c85d-c788-4fd4-b921-ca6aad940643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:36.464381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60c85d-c788-4fd4-b921-ca6aad940643 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.465021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60c85d-c788-4fd4-b921-ca6aad940643 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.465186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60c85d-c788-4fd4-b921-ca6aad940643 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.466199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60c85d-c788-4fd4-b921-ca6aad940643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:36.466694 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2668/5402] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:36.468158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60c85d-c788-4fd4-b921-ca6aad940643 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:36.474521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1a4f0-3e6f-4a76-b66e-438189e5c52c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:36.476739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c8a1a4f0-3e6f-4a76-b66e-438189e5c52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:36.485228 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2735/5403] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:36 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:36.485228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e1c35-6af8-48ae-afcc-bce00f74e966 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.485228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e1c35-6af8-48ae-afcc-bce00f74e966 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.485228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e1c35-6af8-48ae-afcc-bce00f74e966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.506167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-365e1c35-6af8-48ae-afcc-bce00f74e966 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:36.507721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-365e1c35-6af8-48ae-afcc-bce00f74e966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:36.519406 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2736/5404] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:36.520678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e1c35-6af8-48ae-afcc-bce00f74e966 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:36.535624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e1c35-6af8-48ae-afcc-bce00f74e966 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:36.541637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a5fc3-0f73-424c-ac49-cd6f71b3dfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:36.542454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a5fc3-0f73-424c-ac49-cd6f71b3dfdb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.542845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a5fc3-0f73-424c-ac49-cd6f71b3dfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.543221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a5fc3-0f73-424c-ac49-cd6f71b3dfdb admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.543966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a5fc3-0f73-424c-ac49-cd6f71b3dfdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:36.545955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a5fc3-0f73-424c-ac49-cd6f71b3dfdb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:36.553103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1a4f0-3e6f-4a76-b66e-438189e5c52c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:36.557464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4037a92-2e98-4d83-b4a5-ea563f8c3e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:36.558111 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2737/5405] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:36 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:36.558294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4037a92-2e98-4d83-b4a5-ea563f8c3e3a service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.558570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4037a92-2e98-4d83-b4a5-ea563f8c3e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.558941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4037a92-2e98-4d83-b4a5-ea563f8c3e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.559056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a5fc3-0f73-424c-ac49-cd6f71b3dfdb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:36.570454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a5fc3-0f73-424c-ac49-cd6f71b3dfdb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:36.570742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4037a92-2e98-4d83-b4a5-ea563f8c3e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:36.572681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4037a92-2e98-4d83-b4a5-ea563f8c3e3a service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:36.576230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d13661-6d28-4fde-8886-6316c800201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:36.577015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d13661-6d28-4fde-8886-6316c800201f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.577343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d13661-6d28-4fde-8886-6316c800201f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.577693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d13661-6d28-4fde-8886-6316c800201f admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.578611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d13661-6d28-4fde-8886-6316c800201f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:36.578830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d13661-6d28-4fde-8886-6316c800201f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:36.580872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d13661-6d28-4fde-8886-6316c800201f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:36.590459 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2669/5406] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:36.591621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4037a92-2e98-4d83-b4a5-ea563f8c3e3a service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:36.596254 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2738/5407] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:36.601200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d13661-6d28-4fde-8886-6316c800201f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:36.605017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4037a92-2e98-4d83-b4a5-ea563f8c3e3a service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:36.613271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d13661-6d28-4fde-8886-6316c800201f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:36.613881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d57d0-828b-4a74-8b6b-88fc4ba234fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:36.614890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d57d0-828b-4a74-8b6b-88fc4ba234fc admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.615191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d57d0-828b-4a74-8b6b-88fc4ba234fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.615555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d57d0-828b-4a74-8b6b-88fc4ba234fc admin admin] PATH_INFO: `/v3/projects/04f31f53b2d148b4bab980d6c14ce067/users/f8dfc69c23504d4bbccdd8bbfb2b733d/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.620195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e2ecf-19f3-4928-a32f-e7f58d5de035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:36.621278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e2ecf-19f3-4928-a32f-e7f58d5de035 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.621763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e2ecf-19f3-4928-a32f-e7f58d5de035 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.622414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e2ecf-19f3-4928-a32f-e7f58d5de035 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.623366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e2ecf-19f3-4928-a32f-e7f58d5de035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:36.625719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e2ecf-19f3-4928-a32f-e7f58d5de035 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:36.632463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d57d0-828b-4a74-8b6b-88fc4ba234fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f31f53b2d148b4bab980d6c14ce067, user_id=f8dfc69c23504d4bbccdd8bbfb2b733d, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:36.635830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d57d0-828b-4a74-8b6b-88fc4ba234fc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:36.650830 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2670/5408] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:36 2021] PUT /identity/v3/projects/04f31f53b2d148b4bab980d6c14ce067/users/f8dfc69c23504d4bbccdd8bbfb2b733d/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:36.662331 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2739/5409] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:36 2021] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:36.662538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2bc54-912e-4215-9aec-c2dc7cb3b988 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.662538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2bc54-912e-4215-9aec-c2dc7cb3b988 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.662538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2bc54-912e-4215-9aec-c2dc7cb3b988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.663697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e2ecf-19f3-4928-a32f-e7f58d5de035 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:36.696406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-13f2bc54-912e-4215-9aec-c2dc7cb3b988 None None] MFA Rules not processed for user `f8dfc69c23504d4bbccdd8bbfb2b733d`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:36.698382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-13f2bc54-912e-4215-9aec-c2dc7cb3b988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:36.772322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e2ecf-19f3-4928-a32f-e7f58d5de035 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:36.782181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602467fd-9df8-4e8e-b0fe-febc15729cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:36.783435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602467fd-9df8-4e8e-b0fe-febc15729cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.783893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602467fd-9df8-4e8e-b0fe-febc15729cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.784383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602467fd-9df8-4e8e-b0fe-febc15729cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.785230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602467fd-9df8-4e8e-b0fe-febc15729cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:36.787586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602467fd-9df8-4e8e-b0fe-febc15729cc0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:36.823344 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2740/5410] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:36 2021] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:02:36.825101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602467fd-9df8-4e8e-b0fe-febc15729cc0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:36.846524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602467fd-9df8-4e8e-b0fe-febc15729cc0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:36.846524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237671e-cb9c-4b62-a63f-074ea5ebfa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:36.847188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237671e-cb9c-4b62-a63f-074ea5ebfa8f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.847188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237671e-cb9c-4b62-a63f-074ea5ebfa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.847374 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2671/5411] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:36 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:36.847482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237671e-cb9c-4b62-a63f-074ea5ebfa8f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.848070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237671e-cb9c-4b62-a63f-074ea5ebfa8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:36.850677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237671e-cb9c-4b62-a63f-074ea5ebfa8f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:36.864345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2bc54-912e-4215-9aec-c2dc7cb3b988 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:36.866225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-13f2bc54-912e-4215-9aec-c2dc7cb3b988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:36.869993 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2741/5412] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:36 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:36.871016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237671e-cb9c-4b62-a63f-074ea5ebfa8f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:36.885081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237671e-cb9c-4b62-a63f-074ea5ebfa8f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:36.892734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b95528-9fba-4b8d-aabd-3c34f932aa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:36.893451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b95528-9fba-4b8d-aabd-3c34f932aa5f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.893889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b95528-9fba-4b8d-aabd-3c34f932aa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.894175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b95528-9fba-4b8d-aabd-3c34f932aa5f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.895283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b95528-9fba-4b8d-aabd-3c34f932aa5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:36.898594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b95528-9fba-4b8d-aabd-3c34f932aa5f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:36.940094 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2742/5413] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:36 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:36.944774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b95528-9fba-4b8d-aabd-3c34f932aa5f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:36.956386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2bc54-912e-4215-9aec-c2dc7cb3b988 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:36.960465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b95528-9fba-4b8d-aabd-3c34f932aa5f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:36.963913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cb769-7e1c-44dd-bca5-b03d36a4c9a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:36.965051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cb769-7e1c-44dd-bca5-b03d36a4c9a4 service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.966299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cb769-7e1c-44dd-bca5-b03d36a4c9a4 service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.967086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cb769-7e1c-44dd-bca5-b03d36a4c9a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.969803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612789df-edf3-41f7-a544-a89ee20c5069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:36.970596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-275cb769-7e1c-44dd-bca5-b03d36a4c9a4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:36.970843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612789df-edf3-41f7-a544-a89ee20c5069 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:36.971417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612789df-edf3-41f7-a544-a89ee20c5069 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:36.971717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612789df-edf3-41f7-a544-a89ee20c5069 admin admin] PATH_INFO: `/v3/projects/3b863fb8f5a04bf5af92236a9a0b8e8c/users/3fe58c6d2fc442e99956fb3b8d4f0e56/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:36.997601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612789df-edf3-41f7-a544-a89ee20c5069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b863fb8f5a04bf5af92236a9a0b8e8c, user_id=3fe58c6d2fc442e99956fb3b8d4f0e56, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:36.999923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612789df-edf3-41f7-a544-a89ee20c5069 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:37.022429 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2743/5414] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:36 2021] PUT /identity/v3/projects/3b863fb8f5a04bf5af92236a9a0b8e8c/users/3fe58c6d2fc442e99956fb3b8d4f0e56/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:37.023518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612789df-edf3-41f7-a544-a89ee20c5069 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:37.026127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-612789df-edf3-41f7-a544-a89ee20c5069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:37.081568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cb769-7e1c-44dd-bca5-b03d36a4c9a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:37.083319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cb769-7e1c-44dd-bca5-b03d36a4c9a4 service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:37.097296 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2672/5415] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:36 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:37.101065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522a020-1594-4f4a-b639-49f3a0110edc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:37.101367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522a020-1594-4f4a-b639-49f3a0110edc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:37.101783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522a020-1594-4f4a-b639-49f3a0110edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:37.118289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612789df-edf3-41f7-a544-a89ee20c5069 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:37.124011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:37.125689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:37.125835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:37.126192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599 admin admin] PATH_INFO: `/v3/projects/54b9b5c2745548e48a1f01cfa857f69b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:37.127669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54b9b5c2745548e48a1f01cfa857f69b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:37.130157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:37.158422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f522a020-1594-4f4a-b639-49f3a0110edc None None] MFA Rules not processed for user `3fe58c6d2fc442e99956fb3b8d4f0e56`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:37.159835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f522a020-1594-4f4a-b639-49f3a0110edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:37.201584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b9b5c2745548e48a1f01cfa857f69b', 'request_id': 'req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:37.209805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b9b5c2745548e48a1f01cfa857f69b', 'request_id': 'req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:37.225383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b9b5c2745548e48a1f01cfa857f69b', 'request_id': 'req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:37.238877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599 admin admin] The token cache is being invalidate because project 54b9b5c2745548e48a1f01cfa857f69b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:37.239342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:37.240195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:37.240329 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2673/5416] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:37 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:37.242243 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2744/5417] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:37 2021] DELETE /identity/v3/projects/54b9b5c2745548e48a1f01cfa857f69b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:37.246193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522a020-1594-4f4a-b639-49f3a0110edc None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:37.247567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:37.250535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:37.266693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522a020-1594-4f4a-b639-49f3a0110edc None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:37.328833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e99674-c9bb-4a38-a0b8-3777c7ccd599 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:37.336112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f07755-a058-42e2-a2e6-f456196a5110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:37.337296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f07755-a058-42e2-a2e6-f456196a5110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:37.338286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f07755-a058-42e2-a2e6-f456196a5110 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:37.338731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f07755-a058-42e2-a2e6-f456196a5110 admin admin] PATH_INFO: `/v3/users/8e843f9611c3443581c5058e5b6f2a32` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:37.340911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f07755-a058-42e2-a2e6-f456196a5110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e843f9611c3443581c5058e5b6f2a32)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:37.343514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f07755-a058-42e2-a2e6-f456196a5110 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:37.349532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5ab4d-d20f-4b00-8219-2a59004c6255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:37.350462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5ab4d-d20f-4b00-8219-2a59004c6255 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:37.350661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5ab4d-d20f-4b00-8219-2a59004c6255 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:37.351058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5ab4d-d20f-4b00-8219-2a59004c6255 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:37.351942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5ab4d-d20f-4b00-8219-2a59004c6255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:37.354221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5ab4d-d20f-4b00-8219-2a59004c6255 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:37.393218 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2674/5418] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:37 2021] POST /identity/v3/projects => generated 369 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:37.394303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5ab4d-d20f-4b00-8219-2a59004c6255 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:37.396352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-75f5ab4d-d20f-4b00-8219-2a59004c6255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:37.411896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-24f07755-a058-42e2-a2e6-f456196a5110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e843f9611c3443581c5058e5b6f2a32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:37.420469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-24f07755-a058-42e2-a2e6-f456196a5110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e843f9611c3443581c5058e5b6f2a32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:37.421445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-24f07755-a058-42e2-a2e6-f456196a5110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e843f9611c3443581c5058e5b6f2a32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:37.436348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-24f07755-a058-42e2-a2e6-f456196a5110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e843f9611c3443581c5058e5b6f2a32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:37.447392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-24f07755-a058-42e2-a2e6-f456196a5110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e843f9611c3443581c5058e5b6f2a32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:37.455903 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2745/5419] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:37 2021] DELETE /identity/v3/users/8e843f9611c3443581c5058e5b6f2a32 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:37.483709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5ab4d-d20f-4b00-8219-2a59004c6255 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:37.534955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f07755-a058-42e2-a2e6-f456196a5110 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:37.542974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-24f07755-a058-42e2-a2e6-f456196a5110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:37.562470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e3a50-98fd-4af8-8af9-5464100c44d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:37.563568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e3a50-98fd-4af8-8af9-5464100c44d8 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:37.564840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e3a50-98fd-4af8-8af9-5464100c44d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:37.564840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e3a50-98fd-4af8-8af9-5464100c44d8 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:37.565772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e3a50-98fd-4af8-8af9-5464100c44d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:37.568682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e3a50-98fd-4af8-8af9-5464100c44d8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:37.614717 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2675/5420] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:37 2021] POST /identity/v3/users => generated 291 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:37.618315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e3a50-98fd-4af8-8af9-5464100c44d8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:37.621143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bf5e3a50-98fd-4af8-8af9-5464100c44d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:37.636044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e3a50-98fd-4af8-8af9-5464100c44d8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:37.641226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acb87d-5e4e-45d4-9c39-87a3ce1a5af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:37.641917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acb87d-5e4e-45d4-9c39-87a3ce1a5af7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:37.642197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acb87d-5e4e-45d4-9c39-87a3ce1a5af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:37.642658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acb87d-5e4e-45d4-9c39-87a3ce1a5af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:37.644026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78acb87d-5e4e-45d4-9c39-87a3ce1a5af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:37.645330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78acb87d-5e4e-45d4-9c39-87a3ce1a5af7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:37.648754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f07755-a058-42e2-a2e6-f456196a5110 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:37.654684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a30f07-4f2f-445e-a8fe-670b23874af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:37.656260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a30f07-4f2f-445e-a8fe-670b23874af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:37.656484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a30f07-4f2f-445e-a8fe-670b23874af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:37.656729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a30f07-4f2f-445e-a8fe-670b23874af0 admin admin] PATH_INFO: `/v3/users/f6e2be6309ba4258a1599caecba7dce6` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:37.659545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a30f07-4f2f-445e-a8fe-670b23874af0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e2be6309ba4258a1599caecba7dce6)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:37.661503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a30f07-4f2f-445e-a8fe-670b23874af0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:37.665710 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2676/5421] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:37 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:02:37.670499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acb87d-5e4e-45d4-9c39-87a3ce1a5af7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:37.687684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acb87d-5e4e-45d4-9c39-87a3ce1a5af7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:37.701762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2802343-481d-4ab1-b1ef-281f33ba5743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:37.703209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2802343-481d-4ab1-b1ef-281f33ba5743 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:37.703209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2802343-481d-4ab1-b1ef-281f33ba5743 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:37.703462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2802343-481d-4ab1-b1ef-281f33ba5743 admin admin] PATH_INFO: `/v3/projects/033500781fb149b997b81b3d38bc507e/users/1d38732e0e964ca2a7a05e1b530d3180/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:37.729835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2802343-481d-4ab1-b1ef-281f33ba5743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=033500781fb149b997b81b3d38bc507e, user_id=1d38732e0e964ca2a7a05e1b530d3180, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:37.738020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2802343-481d-4ab1-b1ef-281f33ba5743 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:37.742688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-21a30f07-4f2f-445e-a8fe-670b23874af0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e2be6309ba4258a1599caecba7dce6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:37.753485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-21a30f07-4f2f-445e-a8fe-670b23874af0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e2be6309ba4258a1599caecba7dce6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:37.754345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-21a30f07-4f2f-445e-a8fe-670b23874af0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e2be6309ba4258a1599caecba7dce6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:37.769307 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2677/5422] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:37 2021] PUT /identity/v3/projects/033500781fb149b997b81b3d38bc507e/users/1d38732e0e964ca2a7a05e1b530d3180/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:02:37.770286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-21a30f07-4f2f-445e-a8fe-670b23874af0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e2be6309ba4258a1599caecba7dce6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:37.771276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2802343-481d-4ab1-b1ef-281f33ba5743 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:37.780242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-21a30f07-4f2f-445e-a8fe-670b23874af0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e2be6309ba4258a1599caecba7dce6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:37.793318 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2746/5423] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:37 2021] DELETE /identity/v3/users/f6e2be6309ba4258a1599caecba7dce6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:37.795895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c5300-ec18-4ac0-a9dd-0b63bfeb030c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:37.796186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c5300-ec18-4ac0-a9dd-0b63bfeb030c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:37.796691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c5300-ec18-4ac0-a9dd-0b63bfeb030c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:37.821273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1f3c5300-ec18-4ac0-a9dd-0b63bfeb030c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:37.823775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1f3c5300-ec18-4ac0-a9dd-0b63bfeb030c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:37.870146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2802343-481d-4ab1-b1ef-281f33ba5743 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:37.935359 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2747/5424] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:37.935817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c5300-ec18-4ac0-a9dd-0b63bfeb030c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:37.937916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1f3c5300-ec18-4ac0-a9dd-0b63bfeb030c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:37.966131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c5300-ec18-4ac0-a9dd-0b63bfeb030c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:37.976746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bc6ef-700e-4287-b8b5-125054370c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:37.979408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc6ef-700e-4287-b8b5-125054370c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:37.979876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc6ef-700e-4287-b8b5-125054370c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:37.980449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc6ef-700e-4287-b8b5-125054370c61 admin admin] PATH_INFO: `/v3/projects/37515c9f9f3e497cb6bc211df004327a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:37.982237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bc6ef-700e-4287-b8b5-125054370c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37515c9f9f3e497cb6bc211df004327a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:37.984516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bc6ef-700e-4287-b8b5-125054370c61 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:38.007756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ede101-bb23-4b5d-8e2f-a7ed4158d51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:38.008451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ede101-bb23-4b5d-8e2f-a7ed4158d51f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:38.008739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ede101-bb23-4b5d-8e2f-a7ed4158d51f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:38.009216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ede101-bb23-4b5d-8e2f-a7ed4158d51f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:38.010428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ede101-bb23-4b5d-8e2f-a7ed4158d51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:38.011708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ede101-bb23-4b5d-8e2f-a7ed4158d51f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:38.034527 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2678/5425] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:37 2021] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:38.035621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ede101-bb23-4b5d-8e2f-a7ed4158d51f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:38.037491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b4ede101-bb23-4b5d-8e2f-a7ed4158d51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:38.080529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ec4bc6ef-700e-4287-b8b5-125054370c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37515c9f9f3e497cb6bc211df004327a', 'request_id': 'req-ec4bc6ef-700e-4287-b8b5-125054370c61'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:38.090168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ec4bc6ef-700e-4287-b8b5-125054370c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37515c9f9f3e497cb6bc211df004327a', 'request_id': 'req-ec4bc6ef-700e-4287-b8b5-125054370c61'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:38.106192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ec4bc6ef-700e-4287-b8b5-125054370c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37515c9f9f3e497cb6bc211df004327a', 'request_id': 'req-ec4bc6ef-700e-4287-b8b5-125054370c61'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:38.136366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ec4bc6ef-700e-4287-b8b5-125054370c61 admin admin] The token cache is being invalidate because project 37515c9f9f3e497cb6bc211df004327a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:38.136984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ec4bc6ef-700e-4287-b8b5-125054370c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:38.137988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ec4bc6ef-700e-4287-b8b5-125054370c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:38.139990 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2748/5426] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:37 2021] DELETE /identity/v3/projects/37515c9f9f3e497cb6bc211df004327a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:38.141054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bc6ef-700e-4287-b8b5-125054370c61 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:38.147493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ec4bc6ef-700e-4287-b8b5-125054370c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:38.149856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ede101-bb23-4b5d-8e2f-a7ed4158d51f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:38.235469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae49757-27f0-4212-9e7b-327ad800fc3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:38.236145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae49757-27f0-4212-9e7b-327ad800fc3d service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:38.236428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae49757-27f0-4212-9e7b-327ad800fc3d service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:38.236704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae49757-27f0-4212-9e7b-327ad800fc3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:38.239032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cae49757-27f0-4212-9e7b-327ad800fc3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:38.254071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bc6ef-700e-4287-b8b5-125054370c61 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:38.256746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae49757-27f0-4212-9e7b-327ad800fc3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:38.258445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae49757-27f0-4212-9e7b-327ad800fc3d service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:38.260008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a61337-2de8-4179-bc28-c45dc59fa1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:38.261763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a61337-2de8-4179-bc28-c45dc59fa1ea admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:38.261763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a61337-2de8-4179-bc28-c45dc59fa1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:38.261763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a61337-2de8-4179-bc28-c45dc59fa1ea admin admin] PATH_INFO: `/v3/projects/033500781fb149b997b81b3d38bc507e/users/1d38732e0e964ca2a7a05e1b530d3180/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:38.265456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a61337-2de8-4179-bc28-c45dc59fa1ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=033500781fb149b997b81b3d38bc507e, user_id=1d38732e0e964ca2a7a05e1b530d3180, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:38.269336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a61337-2de8-4179-bc28-c45dc59fa1ea admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:38.270767 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2679/5427] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:38.272090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33764955-e123-417e-9839-1cfff1b11f88 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:38.272381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33764955-e123-417e-9839-1cfff1b11f88 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:38.272666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33764955-e123-417e-9839-1cfff1b11f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:38.292034 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2749/5428] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:38 2021] PUT /identity/v3/projects/033500781fb149b997b81b3d38bc507e/users/1d38732e0e964ca2a7a05e1b530d3180/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:38.308524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de375c1-b405-4361-80f0-81d0484d48dc None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:38.309101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de375c1-b405-4361-80f0-81d0484d48dc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:38.309372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-33764955-e123-417e-9839-1cfff1b11f88 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:38.310203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de375c1-b405-4361-80f0-81d0484d48dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:38.310738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-33764955-e123-417e-9839-1cfff1b11f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:38.360707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6de375c1-b405-4361-80f0-81d0484d48dc None None] MFA Rules not processed for user `1d38732e0e964ca2a7a05e1b530d3180`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:38.362104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6de375c1-b405-4361-80f0-81d0484d48dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:38.401260 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2680/5429] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:38.404165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2d729-a666-4854-a457-0fc926c1610d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:38.404874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2d729-a666-4854-a457-0fc926c1610d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:38.404874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2d729-a666-4854-a457-0fc926c1610d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:38.430603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6ea2d729-a666-4854-a457-0fc926c1610d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:38.432461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6ea2d729-a666-4854-a457-0fc926c1610d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:38.447567 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2681/5430] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:38.448543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2d729-a666-4854-a457-0fc926c1610d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:38.466787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2d729-a666-4854-a457-0fc926c1610d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:38.469391 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2750/5431] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:38 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:38.477137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb838d-d6ef-442a-be75-5ad86a02f3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:38.477950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb838d-d6ef-442a-be75-5ad86a02f3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:38.479043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb838d-d6ef-442a-be75-5ad86a02f3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:38.479391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb838d-d6ef-442a-be75-5ad86a02f3d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:38.481349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de375c1-b405-4361-80f0-81d0484d48dc None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:38.482548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb838d-d6ef-442a-be75-5ad86a02f3d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:38.483009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6de375c1-b405-4361-80f0-81d0484d48dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:38.486432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb838d-d6ef-442a-be75-5ad86a02f3d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:38.490008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb838d-d6ef-442a-be75-5ad86a02f3d4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:38.510859 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2682/5432] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:38.517239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb838d-d6ef-442a-be75-5ad86a02f3d4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:38.533788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb838d-d6ef-442a-be75-5ad86a02f3d4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:38.542004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91947ae2-060a-4abe-8f63-38cf81c0f089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:38.542973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91947ae2-060a-4abe-8f63-38cf81c0f089 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:38.543268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91947ae2-060a-4abe-8f63-38cf81c0f089 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:38.550912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91947ae2-060a-4abe-8f63-38cf81c0f089 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:38.552243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91947ae2-060a-4abe-8f63-38cf81c0f089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:38.554423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91947ae2-060a-4abe-8f63-38cf81c0f089 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:38.593274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de375c1-b405-4361-80f0-81d0484d48dc None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:38.599587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b114a-5656-4a80-b78b-059e961649d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:38.600021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b114a-5656-4a80-b78b-059e961649d0 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:38.600564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b114a-5656-4a80-b78b-059e961649d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:38.600753 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2683/5433] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:38 2021] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:38.601389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b114a-5656-4a80-b78b-059e961649d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:38.604991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91947ae2-060a-4abe-8f63-38cf81c0f089 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:38.616267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b114a-5656-4a80-b78b-059e961649d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:38.617915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b114a-5656-4a80-b78b-059e961649d0 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:38.636650 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2751/5434] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:38 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:02:38.760835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91947ae2-060a-4abe-8f63-38cf81c0f089 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:38.767119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526b62c-6175-4cba-874c-73a80890e1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:38.767820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526b62c-6175-4cba-874c-73a80890e1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:38.768111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526b62c-6175-4cba-874c-73a80890e1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:38.768436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526b62c-6175-4cba-874c-73a80890e1a0 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:38.769234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526b62c-6175-4cba-874c-73a80890e1a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:38.771875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526b62c-6175-4cba-874c-73a80890e1a0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:38.795681 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2684/5435] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:38 2021] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:38.799821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b114a-5656-4a80-b78b-059e961649d0 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:38.811283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b114a-5656-4a80-b78b-059e961649d0 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:38.816786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe3c39-fd01-4d39-927b-b3d1154afd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:38.817427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe3c39-fd01-4d39-927b-b3d1154afd7d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:38.817727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe3c39-fd01-4d39-927b-b3d1154afd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:38.818018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe3c39-fd01-4d39-927b-b3d1154afd7d admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:38.818914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe3c39-fd01-4d39-927b-b3d1154afd7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:38.820729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe3c39-fd01-4d39-927b-b3d1154afd7d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:38.832378 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2752/5436] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:38 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:02:38.836916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526b62c-6175-4cba-874c-73a80890e1a0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:38.857733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526b62c-6175-4cba-874c-73a80890e1a0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:38.867646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2727373-43a2-4b88-99a0-5492538e10b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:38.869103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2727373-43a2-4b88-99a0-5492538e10b2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:38.869496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2727373-43a2-4b88-99a0-5492538e10b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:38.869878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2727373-43a2-4b88-99a0-5492538e10b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:38.870979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2727373-43a2-4b88-99a0-5492538e10b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:38.875344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2727373-43a2-4b88-99a0-5492538e10b2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:38.895903 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2685/5437] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:38 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:38.897448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe3c39-fd01-4d39-927b-b3d1154afd7d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:38.909007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2727373-43a2-4b88-99a0-5492538e10b2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:38.911515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b2727373-43a2-4b88-99a0-5492538e10b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:38.920466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe3c39-fd01-4d39-927b-b3d1154afd7d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:38.928748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd0ca3-8c30-4a20-9e39-36bdb28fe40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:38.930088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd0ca3-8c30-4a20-9e39-36bdb28fe40b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:38.930438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd0ca3-8c30-4a20-9e39-36bdb28fe40b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:38.930989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd0ca3-8c30-4a20-9e39-36bdb28fe40b admin admin] PATH_INFO: `/v3/projects/8ac6a5d172304e9a97ce8e01a5928f18/users/3930bda3716244de9ae53fec4b33ec31/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:38.944107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2727373-43a2-4b88-99a0-5492538e10b2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:38.951348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:38.951923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd0ca3-8c30-4a20-9e39-36bdb28fe40b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac6a5d172304e9a97ce8e01a5928f18, user_id=3930bda3716244de9ae53fec4b33ec31, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:38.953159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:38.953527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:38.953950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea admin admin] PATH_INFO: `/v3/projects/57f50b0136fe4f3995186749899c4344` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:38.955312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd0ca3-8c30-4a20-9e39-36bdb28fe40b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:38.955552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f50b0136fe4f3995186749899c4344)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:38.957939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:38.975139 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2753/5438] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:38 2021] PUT /identity/v3/projects/8ac6a5d172304e9a97ce8e01a5928f18/users/3930bda3716244de9ae53fec4b33ec31/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:38.988460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceda7fb-b4c3-4a70-9299-48484dd4676a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:38.988669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceda7fb-b4c3-4a70-9299-48484dd4676a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:38.989172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceda7fb-b4c3-4a70-9299-48484dd4676a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:39.024330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f50b0136fe4f3995186749899c4344', 'request_id': 'req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:39.024579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7ceda7fb-b4c3-4a70-9299-48484dd4676a None None] MFA Rules not processed for user `3930bda3716244de9ae53fec4b33ec31`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:39.025956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7ceda7fb-b4c3-4a70-9299-48484dd4676a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:39.033893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f50b0136fe4f3995186749899c4344', 'request_id': 'req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:39.040678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f50b0136fe4f3995186749899c4344', 'request_id': 'req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:39.074120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea admin admin] The token cache is being invalidate because project 57f50b0136fe4f3995186749899c4344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:39.075694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:39.077341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:39.081557 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2686/5439] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:38 2021] DELETE /identity/v3/projects/57f50b0136fe4f3995186749899c4344 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:02:39.086339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:39.088392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:39.167324 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2754/5440] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:38 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:39.171793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceda7fb-b4c3-4a70-9299-48484dd4676a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:39.173197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7ceda7fb-b4c3-4a70-9299-48484dd4676a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:39.188779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceda7fb-b4c3-4a70-9299-48484dd4676a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:39.189655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbb03b-ddc7-4e5b-940c-ac09afa95aea admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:39.194950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a121fd-517f-4bab-a7ea-1296fe95ba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:39.195753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a121fd-517f-4bab-a7ea-1296fe95ba51 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:39.196115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a121fd-517f-4bab-a7ea-1296fe95ba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:39.196398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21d799-b33c-42ef-8b88-4b2b7710e4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:39.196581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a121fd-517f-4bab-a7ea-1296fe95ba51 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:39.198214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21d799-b33c-42ef-8b88-4b2b7710e4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:39.198395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a121fd-517f-4bab-a7ea-1296fe95ba51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:39.198539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21d799-b33c-42ef-8b88-4b2b7710e4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:39.198785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21d799-b33c-42ef-8b88-4b2b7710e4c5 admin admin] PATH_INFO: `/v3/users/f8dfc69c23504d4bbccdd8bbfb2b733d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:39.200740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21d799-b33c-42ef-8b88-4b2b7710e4c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8dfc69c23504d4bbccdd8bbfb2b733d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:39.200879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a121fd-517f-4bab-a7ea-1296fe95ba51 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:39.203169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21d799-b33c-42ef-8b88-4b2b7710e4c5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:39.239249 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2755/5441] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:39 2021] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:02:39.251794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a121fd-517f-4bab-a7ea-1296fe95ba51 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:39.270108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ed21d799-b33c-42ef-8b88-4b2b7710e4c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8dfc69c23504d4bbccdd8bbfb2b733d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:39.283189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ed21d799-b33c-42ef-8b88-4b2b7710e4c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8dfc69c23504d4bbccdd8bbfb2b733d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:39.307525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ed21d799-b33c-42ef-8b88-4b2b7710e4c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8dfc69c23504d4bbccdd8bbfb2b733d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:39.308581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ed21d799-b33c-42ef-8b88-4b2b7710e4c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8dfc69c23504d4bbccdd8bbfb2b733d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:39.324803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ed21d799-b33c-42ef-8b88-4b2b7710e4c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8dfc69c23504d4bbccdd8bbfb2b733d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:39.333616 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2687/5442] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:39 2021] DELETE /identity/v3/users/f8dfc69c23504d4bbccdd8bbfb2b733d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:39.358029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a121fd-517f-4bab-a7ea-1296fe95ba51 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:39.450386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725668c-307b-46b8-a753-731d1a7f1508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:39.451069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725668c-307b-46b8-a753-731d1a7f1508 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:39.451414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725668c-307b-46b8-a753-731d1a7f1508 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:39.451755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725668c-307b-46b8-a753-731d1a7f1508 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:39.452687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725668c-307b-46b8-a753-731d1a7f1508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:39.455184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725668c-307b-46b8-a753-731d1a7f1508 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:39.488029 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2756/5443] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:39 2021] POST /identity/v3/users => generated 298 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:39.489221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21d799-b33c-42ef-8b88-4b2b7710e4c5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:39.491828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ed21d799-b33c-42ef-8b88-4b2b7710e4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:39.518657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21d799-b33c-42ef-8b88-4b2b7710e4c5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:39.528426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed5f0f-8df8-448f-b0f6-54370c4fc1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:39.530222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed5f0f-8df8-448f-b0f6-54370c4fc1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:39.530916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed5f0f-8df8-448f-b0f6-54370c4fc1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:39.531347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed5f0f-8df8-448f-b0f6-54370c4fc1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:39.533523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed5f0f-8df8-448f-b0f6-54370c4fc1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:39.538632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed5f0f-8df8-448f-b0f6-54370c4fc1c8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:39.560888 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2688/5444] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:39 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:02:39.565976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725668c-307b-46b8-a753-731d1a7f1508 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:39.582314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725668c-307b-46b8-a753-731d1a7f1508 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:39.590764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d72ae1-9abf-43b8-9426-7e4805ca6466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:39.591750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d72ae1-9abf-43b8-9426-7e4805ca6466 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:39.592182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d72ae1-9abf-43b8-9426-7e4805ca6466 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:39.592568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d72ae1-9abf-43b8-9426-7e4805ca6466 admin admin] PATH_INFO: `/v3/projects/68f3b87574044b6aac3092047a07172e/users/e9bc7072624045d5b02e6bb9412a7c8b/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:39.620428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d72ae1-9abf-43b8-9426-7e4805ca6466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f3b87574044b6aac3092047a07172e, user_id=e9bc7072624045d5b02e6bb9412a7c8b, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:39.623603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d72ae1-9abf-43b8-9426-7e4805ca6466 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:39.654857 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2757/5445] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:39 2021] PUT /identity/v3/projects/68f3b87574044b6aac3092047a07172e/users/e9bc7072624045d5b02e6bb9412a7c8b/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:39.658982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed5f0f-8df8-448f-b0f6-54370c4fc1c8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:39.671967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed5f0f-8df8-448f-b0f6-54370c4fc1c8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:39.690921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d72ae1-9abf-43b8-9426-7e4805ca6466 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:39.693436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-16d72ae1-9abf-43b8-9426-7e4805ca6466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:39.848032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc2792-39c4-49c4-b14c-251cafdc60f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:39.849093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2792-39c4-49c4-b14c-251cafdc60f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:39.849491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2792-39c4-49c4-b14c-251cafdc60f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:39.850187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2792-39c4-49c4-b14c-251cafdc60f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:39.851370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc2792-39c4-49c4-b14c-251cafdc60f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:39.855197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc2792-39c4-49c4-b14c-251cafdc60f0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:39.873639 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2689/5446] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:39 2021] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:39.874600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d72ae1-9abf-43b8-9426-7e4805ca6466 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:39.877469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc2792-39c4-49c4-b14c-251cafdc60f0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:39.889996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979d9c7-a496-4be5-a5a7-e208dfe26c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:39.891893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979d9c7-a496-4be5-a5a7-e208dfe26c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:39.892948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc2792-39c4-49c4-b14c-251cafdc60f0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:39.893399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979d9c7-a496-4be5-a5a7-e208dfe26c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:39.893968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979d9c7-a496-4be5-a5a7-e208dfe26c04 admin admin] PATH_INFO: `/v3/projects/04f31f53b2d148b4bab980d6c14ce067` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:39.900486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979d9c7-a496-4be5-a5a7-e208dfe26c04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f31f53b2d148b4bab980d6c14ce067)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:39.902027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8335394-eec4-4cf1-8ed9-0413eed8041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:39.903488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8335394-eec4-4cf1-8ed9-0413eed8041a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:39.903966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8335394-eec4-4cf1-8ed9-0413eed8041a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:39.904376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8335394-eec4-4cf1-8ed9-0413eed8041a admin admin] PATH_INFO: `/v3/projects/68f3b87574044b6aac3092047a07172e/users/e9bc7072624045d5b02e6bb9412a7c8b/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:39.904796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979d9c7-a496-4be5-a5a7-e208dfe26c04 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:39.909707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8335394-eec4-4cf1-8ed9-0413eed8041a admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f3b87574044b6aac3092047a07172e, user_id=e9bc7072624045d5b02e6bb9412a7c8b, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:39.913132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8335394-eec4-4cf1-8ed9-0413eed8041a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:39.934270 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2690/5447] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:39 2021] PUT /identity/v3/projects/68f3b87574044b6aac3092047a07172e/users/e9bc7072624045d5b02e6bb9412a7c8b/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:39.946337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5530d5-0990-4275-92a7-358237c4b653 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:39.948040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5530d5-0990-4275-92a7-358237c4b653 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:39.948645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5530d5-0990-4275-92a7-358237c4b653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:39.987455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2979d9c7-a496-4be5-a5a7-e208dfe26c04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f31f53b2d148b4bab980d6c14ce067', 'request_id': 'req-2979d9c7-a496-4be5-a5a7-e208dfe26c04'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:39.995816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2979d9c7-a496-4be5-a5a7-e208dfe26c04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f31f53b2d148b4bab980d6c14ce067', 'request_id': 'req-2979d9c7-a496-4be5-a5a7-e208dfe26c04'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:40.001638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3b5530d5-0990-4275-92a7-358237c4b653 None None] MFA Rules not processed for user `e9bc7072624045d5b02e6bb9412a7c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:40.004992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3b5530d5-0990-4275-92a7-358237c4b653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:40.007794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2979d9c7-a496-4be5-a5a7-e208dfe26c04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f31f53b2d148b4bab980d6c14ce067', 'request_id': 'req-2979d9c7-a496-4be5-a5a7-e208dfe26c04'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:40.029208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2979d9c7-a496-4be5-a5a7-e208dfe26c04 admin admin] The token cache is being invalidate because project 04f31f53b2d148b4bab980d6c14ce067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:40.029855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2979d9c7-a496-4be5-a5a7-e208dfe26c04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:40.031161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2979d9c7-a496-4be5-a5a7-e208dfe26c04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:40.033506 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2758/5448] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:39 2021] DELETE /identity/v3/projects/04f31f53b2d148b4bab980d6c14ce067 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:40.034762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979d9c7-a496-4be5-a5a7-e208dfe26c04 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:40.036350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2979d9c7-a496-4be5-a5a7-e208dfe26c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:40.153664 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2691/5449] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:39 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:40.158130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979d9c7-a496-4be5-a5a7-e208dfe26c04 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:40.164490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81e017-191c-464a-b650-b637c4425971 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:40.165344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81e017-191c-464a-b650-b637c4425971 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:40.166564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81e017-191c-464a-b650-b637c4425971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:40.167121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f932eb1-5ae2-4df8-a88e-fbb4b3c0ee74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:40.167844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f932eb1-5ae2-4df8-a88e-fbb4b3c0ee74 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:40.168665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f932eb1-5ae2-4df8-a88e-fbb4b3c0ee74 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:40.168665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f932eb1-5ae2-4df8-a88e-fbb4b3c0ee74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:40.170820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5f932eb1-5ae2-4df8-a88e-fbb4b3c0ee74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:40.187696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f932eb1-5ae2-4df8-a88e-fbb4b3c0ee74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:40.189397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f932eb1-5ae2-4df8-a88e-fbb4b3c0ee74 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:40.191882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-bf81e017-191c-464a-b650-b637c4425971 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:40.193173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bf81e017-191c-464a-b650-b637c4425971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:40.204388 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2759/5450] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:40.207741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f932eb1-5ae2-4df8-a88e-fbb4b3c0ee74 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:40.211297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5f932eb1-5ae2-4df8-a88e-fbb4b3c0ee74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:40.284466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f932eb1-5ae2-4df8-a88e-fbb4b3c0ee74 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:40.290153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9537c8-fcda-4636-ac55-f0e96e53962d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:40.291691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9537c8-fcda-4636-ac55-f0e96e53962d service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:40.292049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9537c8-fcda-4636-ac55-f0e96e53962d service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:40.292338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9537c8-fcda-4636-ac55-f0e96e53962d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:40.294759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fa9537c8-fcda-4636-ac55-f0e96e53962d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:40.312076 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2692/5451] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:40.314827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49854c4-e640-4f43-9fff-1ca67a5647ff None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:40.315217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49854c4-e640-4f43-9fff-1ca67a5647ff None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:40.315667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49854c4-e640-4f43-9fff-1ca67a5647ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:40.342943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d49854c4-e640-4f43-9fff-1ca67a5647ff None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:40.342943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d49854c4-e640-4f43-9fff-1ca67a5647ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:40.353571 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2693/5452] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:40.358742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49854c4-e640-4f43-9fff-1ca67a5647ff None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:40.381360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49854c4-e640-4f43-9fff-1ca67a5647ff None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:40.389135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17f5d9-c571-4bb8-b79b-d597e8aedce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:40.390051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17f5d9-c571-4bb8-b79b-d597e8aedce9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:40.390671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17f5d9-c571-4bb8-b79b-d597e8aedce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:40.391288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17f5d9-c571-4bb8-b79b-d597e8aedce9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:40.392275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17f5d9-c571-4bb8-b79b-d597e8aedce9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:40.392882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17f5d9-c571-4bb8-b79b-d597e8aedce9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:40.396863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9537c8-fcda-4636-ac55-f0e96e53962d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:40.400019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17f5d9-c571-4bb8-b79b-d597e8aedce9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:40.404573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9537c8-fcda-4636-ac55-f0e96e53962d service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:40.417940 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2694/5453] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:40.419305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17f5d9-c571-4bb8-b79b-d597e8aedce9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:40.444078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17f5d9-c571-4bb8-b79b-d597e8aedce9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:40.445435 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2760/5454] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:40 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:40.451538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ffe27-35d9-47dd-9988-4afab27c440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:40.452476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ffe27-35d9-47dd-9988-4afab27c440f admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:40.452764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ffe27-35d9-47dd-9988-4afab27c440f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:40.453160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ffe27-35d9-47dd-9988-4afab27c440f admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:40.453874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ffe27-35d9-47dd-9988-4afab27c440f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:40.455878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ffe27-35d9-47dd-9988-4afab27c440f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:40.492918 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2695/5455] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:40 2021] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:40.497873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9537c8-fcda-4636-ac55-f0e96e53962d service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:40.516430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9537c8-fcda-4636-ac55-f0e96e53962d service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:40.604173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397960b-5df9-430a-aa89-53d3ed73facf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:40.604968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397960b-5df9-430a-aa89-53d3ed73facf admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:40.605401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397960b-5df9-430a-aa89-53d3ed73facf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:40.606224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397960b-5df9-430a-aa89-53d3ed73facf admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:40.607188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397960b-5df9-430a-aa89-53d3ed73facf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:40.609267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397960b-5df9-430a-aa89-53d3ed73facf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:40.642456 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2761/5456] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:40 2021] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:40.646528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ffe27-35d9-47dd-9988-4afab27c440f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:40.659192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ffe27-35d9-47dd-9988-4afab27c440f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:40.665700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11754b-b84d-44a7-9e7a-88e671e3428c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:40.667106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11754b-b84d-44a7-9e7a-88e671e3428c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:40.667581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11754b-b84d-44a7-9e7a-88e671e3428c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:40.668209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11754b-b84d-44a7-9e7a-88e671e3428c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:40.668956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11754b-b84d-44a7-9e7a-88e671e3428c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:40.670860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11754b-b84d-44a7-9e7a-88e671e3428c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:40.686416 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2696/5457] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:40 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:40.688778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397960b-5df9-430a-aa89-53d3ed73facf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:40.700605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397960b-5df9-430a-aa89-53d3ed73facf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:40.706594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef2d4a-b719-4b13-ad11-f4aa5c829606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:40.707395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef2d4a-b719-4b13-ad11-f4aa5c829606 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:40.707729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef2d4a-b719-4b13-ad11-f4aa5c829606 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:40.708014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef2d4a-b719-4b13-ad11-f4aa5c829606 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:40.708820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef2d4a-b719-4b13-ad11-f4aa5c829606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:40.710525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef2d4a-b719-4b13-ad11-f4aa5c829606 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:40.722508 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2762/5458] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:40 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:02:40.727155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11754b-b84d-44a7-9e7a-88e671e3428c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:40.739207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11754b-b84d-44a7-9e7a-88e671e3428c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:40.746326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e05267-0891-4a0e-b6b2-4789ebd10515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:40.747560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05267-0891-4a0e-b6b2-4789ebd10515 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:40.748015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05267-0891-4a0e-b6b2-4789ebd10515 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:40.748607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05267-0891-4a0e-b6b2-4789ebd10515 admin admin] PATH_INFO: `/v3/projects/0960ea4f6983471095bde7840b1393cf/users/56d5694a5fe34778ad3b74f770103204/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:40.769118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e05267-0891-4a0e-b6b2-4789ebd10515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0960ea4f6983471095bde7840b1393cf, user_id=56d5694a5fe34778ad3b74f770103204, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:40.772433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e05267-0891-4a0e-b6b2-4789ebd10515 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:40.790790 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2697/5459] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:40 2021] PUT /identity/v3/projects/0960ea4f6983471095bde7840b1393cf/users/56d5694a5fe34778ad3b74f770103204/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:02:40.868204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906d285-1265-404e-9395-84367bdea1f7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:40.869559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906d285-1265-404e-9395-84367bdea1f7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:40.869802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906d285-1265-404e-9395-84367bdea1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:40.889255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e05267-0891-4a0e-b6b2-4789ebd10515 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:40.910507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0906d285-1265-404e-9395-84367bdea1f7 None None] MFA Rules not processed for user `56d5694a5fe34778ad3b74f770103204`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:40.911904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0906d285-1265-404e-9395-84367bdea1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:40.988251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e05267-0891-4a0e-b6b2-4789ebd10515 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:40.995272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70487b75-809e-4ed7-bffb-231ae128f307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:40.997885 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2763/5460] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:40 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:41.002615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70487b75-809e-4ed7-bffb-231ae128f307 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:41.002615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70487b75-809e-4ed7-bffb-231ae128f307 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:41.002615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70487b75-809e-4ed7-bffb-231ae128f307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:41.013123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906d285-1265-404e-9395-84367bdea1f7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:41.015515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0906d285-1265-404e-9395-84367bdea1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:41.091916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70487b75-809e-4ed7-bffb-231ae128f307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:41.093602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70487b75-809e-4ed7-bffb-231ae128f307 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:41.097791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906d285-1265-404e-9395-84367bdea1f7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:41.109822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be9cd5-23b9-410d-9e9f-bb8628454a18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:41.110520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be9cd5-23b9-410d-9e9f-bb8628454a18 service glance] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:41.110917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be9cd5-23b9-410d-9e9f-bb8628454a18 service glance] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:41.111228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be9cd5-23b9-410d-9e9f-bb8628454a18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:41.125105 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2698/5461] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:40 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:41.131285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be9cd5-23b9-410d-9e9f-bb8628454a18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:41.133128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be9cd5-23b9-410d-9e9f-bb8628454a18 service glance] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:41.159129 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2764/5462] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:41 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:41.286407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8417c3d-50ff-4592-8225-6ea26938514b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:41.286732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8417c3d-50ff-4592-8225-6ea26938514b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:41.287012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8417c3d-50ff-4592-8225-6ea26938514b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:41.312985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b8417c3d-50ff-4592-8225-6ea26938514b None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:41.314170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b8417c3d-50ff-4592-8225-6ea26938514b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:41.437691 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2699/5463] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:02:41 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:41.452827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be9cd5-23b9-410d-9e9f-bb8628454a18 service glance] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:41.454628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-08be9cd5-23b9-410d-9e9f-bb8628454a18 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:41.568268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be9cd5-23b9-410d-9e9f-bb8628454a18 service glance] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:41.583276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16a8b3-1a3b-43de-a505-e58da4693424 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:41.584351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16a8b3-1a3b-43de-a505-e58da4693424 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:41.584793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16a8b3-1a3b-43de-a505-e58da4693424 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:41.585265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16a8b3-1a3b-43de-a505-e58da4693424 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:41.598499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16a8b3-1a3b-43de-a505-e58da4693424 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:41.601267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16a8b3-1a3b-43de-a505-e58da4693424 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:41.613302 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2765/5464] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:02:41 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:02:42.092501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a6226-4307-42eb-816e-4516df059712 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:42.093072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a6226-4307-42eb-816e-4516df059712 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:42.093558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a6226-4307-42eb-816e-4516df059712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:42.116152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ba4a6226-4307-42eb-816e-4516df059712 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:42.118039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ba4a6226-4307-42eb-816e-4516df059712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:42.131871 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2700/5465] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:02:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:42.149455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16a8b3-1a3b-43de-a505-e58da4693424 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:42.164532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16a8b3-1a3b-43de-a505-e58da4693424 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:42.172882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45884f1c-2092-4610-8d9e-74b3841de40d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:42.174455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45884f1c-2092-4610-8d9e-74b3841de40d service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:42.174769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45884f1c-2092-4610-8d9e-74b3841de40d service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:42.175231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45884f1c-2092-4610-8d9e-74b3841de40d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:42.188164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45884f1c-2092-4610-8d9e-74b3841de40d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:42.190351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45884f1c-2092-4610-8d9e-74b3841de40d service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:42.203926 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2766/5466] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:02:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:02:42.697815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc33769-58c1-4955-878d-d712724724fb None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:42.698091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc33769-58c1-4955-878d-d712724724fb None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:42.698377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc33769-58c1-4955-878d-d712724724fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:42.749180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7fc33769-58c1-4955-878d-d712724724fb None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:42.751393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7fc33769-58c1-4955-878d-d712724724fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:42.762170 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2701/5467] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:02:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:42.795472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45884f1c-2092-4610-8d9e-74b3841de40d service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:42.813870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45884f1c-2092-4610-8d9e-74b3841de40d service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:42.828206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066c214-aa89-439b-8a2b-1d9d3d4333be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:42.829452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066c214-aa89-439b-8a2b-1d9d3d4333be service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:42.830397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066c214-aa89-439b-8a2b-1d9d3d4333be service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:42.831536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066c214-aa89-439b-8a2b-1d9d3d4333be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:42.843803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066c214-aa89-439b-8a2b-1d9d3d4333be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:42.845945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066c214-aa89-439b-8a2b-1d9d3d4333be service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:42.859741 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2767/5468] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:02:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:02:43.126237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131f0b3-91d7-4896-a193-7816d8fed1a1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:43.127443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131f0b3-91d7-4896-a193-7816d8fed1a1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:43.127888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131f0b3-91d7-4896-a193-7816d8fed1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:43.156346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6131f0b3-91d7-4896-a193-7816d8fed1a1 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:43.158859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6131f0b3-91d7-4896-a193-7816d8fed1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:43.185229 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2702/5469] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:02:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:43.186568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066c214-aa89-439b-8a2b-1d9d3d4333be service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:43.210782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066c214-aa89-439b-8a2b-1d9d3d4333be service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:43.236027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dd22f-4e52-40b6-ad3f-b8eb9dd3d645 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:43.237940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dd22f-4e52-40b6-ad3f-b8eb9dd3d645 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:43.241582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dd22f-4e52-40b6-ad3f-b8eb9dd3d645 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:43.242095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dd22f-4e52-40b6-ad3f-b8eb9dd3d645 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:43.273759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dd22f-4e52-40b6-ad3f-b8eb9dd3d645 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:43.279578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dd22f-4e52-40b6-ad3f-b8eb9dd3d645 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:43.300252 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2768/5470] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:02:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:02:43.645440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba6132-1d69-410a-822b-143ea0be9060 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:43.646040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba6132-1d69-410a-822b-143ea0be9060 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:43.647021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba6132-1d69-410a-822b-143ea0be9060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:43.670422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-25ba6132-1d69-410a-822b-143ea0be9060 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:43.671801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-25ba6132-1d69-410a-822b-143ea0be9060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:43.688955 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2703/5471] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 21:02:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:43.710089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dd22f-4e52-40b6-ad3f-b8eb9dd3d645 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:43.747030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dd22f-4e52-40b6-ad3f-b8eb9dd3d645 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:43.753089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141fa1d-f53c-44a8-acfa-3e1b1aa98cae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:43.754141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141fa1d-f53c-44a8-acfa-3e1b1aa98cae service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:43.754684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141fa1d-f53c-44a8-acfa-3e1b1aa98cae service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:43.755125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141fa1d-f53c-44a8-acfa-3e1b1aa98cae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:43.768823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141fa1d-f53c-44a8-acfa-3e1b1aa98cae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:43.772312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141fa1d-f53c-44a8-acfa-3e1b1aa98cae service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:43.807264 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2769/5472] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:02:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:02:44.073731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11f87e-c534-4638-93c7-a6c9a1f2ff08 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:44.074420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11f87e-c534-4638-93c7-a6c9a1f2ff08 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:44.074893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11f87e-c534-4638-93c7-a6c9a1f2ff08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:44.099569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ca11f87e-c534-4638-93c7-a6c9a1f2ff08 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:44.101851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ca11f87e-c534-4638-93c7-a6c9a1f2ff08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:44.119703 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2704/5473] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 21:02:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:44.144096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141fa1d-f53c-44a8-acfa-3e1b1aa98cae service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:44.160220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141fa1d-f53c-44a8-acfa-3e1b1aa98cae service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:44.166978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaeb76b-4b09-4118-9c3b-c0189bbb47cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:44.167866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaeb76b-4b09-4118-9c3b-c0189bbb47cf service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:44.168412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaeb76b-4b09-4118-9c3b-c0189bbb47cf service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:44.168795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaeb76b-4b09-4118-9c3b-c0189bbb47cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:44.180648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaeb76b-4b09-4118-9c3b-c0189bbb47cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:44.183012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaeb76b-4b09-4118-9c3b-c0189bbb47cf service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:44.204020 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2770/5474] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:02:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:02:44.363174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11f87e-c534-4638-93c7-a6c9a1f2ff08 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:44.478590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11f87e-c534-4638-93c7-a6c9a1f2ff08 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:44.488352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ece2b6-99c3-4b9e-95c1-6a72af96aae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:44.489656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ece2b6-99c3-4b9e-95c1-6a72af96aae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:44.489947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ece2b6-99c3-4b9e-95c1-6a72af96aae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:44.490237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ece2b6-99c3-4b9e-95c1-6a72af96aae7 admin admin] PATH_INFO: `/v3/users/56d5694a5fe34778ad3b74f770103204` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:44.491870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ece2b6-99c3-4b9e-95c1-6a72af96aae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d5694a5fe34778ad3b74f770103204)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:44.496071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ece2b6-99c3-4b9e-95c1-6a72af96aae7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:44.578212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-53ece2b6-99c3-4b9e-95c1-6a72af96aae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d5694a5fe34778ad3b74f770103204'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:44.589436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-53ece2b6-99c3-4b9e-95c1-6a72af96aae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d5694a5fe34778ad3b74f770103204'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:44.605602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-53ece2b6-99c3-4b9e-95c1-6a72af96aae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d5694a5fe34778ad3b74f770103204'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:44.606675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-53ece2b6-99c3-4b9e-95c1-6a72af96aae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d5694a5fe34778ad3b74f770103204'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:44.623468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-53ece2b6-99c3-4b9e-95c1-6a72af96aae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d5694a5fe34778ad3b74f770103204'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:44.632676 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2705/5475] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:44 2021] DELETE /identity/v3/users/56d5694a5fe34778ad3b74f770103204 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:44.637571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1f0d0-a427-4280-a195-b7b07d53180b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:44.638842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1f0d0-a427-4280-a195-b7b07d53180b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:44.639232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1f0d0-a427-4280-a195-b7b07d53180b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:44.661404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bbe1f0d0-a427-4280-a195-b7b07d53180b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:44.662902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bbe1f0d0-a427-4280-a195-b7b07d53180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:44.779151 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2771/5476] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:44.797906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ece2b6-99c3-4b9e-95c1-6a72af96aae7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:44.799479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-53ece2b6-99c3-4b9e-95c1-6a72af96aae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:44.922785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ece2b6-99c3-4b9e-95c1-6a72af96aae7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:44.934208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83512fa8-d497-4c6a-8889-f0511b341514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:44.935079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83512fa8-d497-4c6a-8889-f0511b341514 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:44.935378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83512fa8-d497-4c6a-8889-f0511b341514 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:44.935664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83512fa8-d497-4c6a-8889-f0511b341514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:44.950269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83512fa8-d497-4c6a-8889-f0511b341514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:44.951877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83512fa8-d497-4c6a-8889-f0511b341514 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:44.969592 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2706/5477] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:45.915006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1f0d0-a427-4280-a195-b7b07d53180b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:45.918226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bbe1f0d0-a427-4280-a195-b7b07d53180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:45.959469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1f0d0-a427-4280-a195-b7b07d53180b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:45.978986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8750e0-d1ad-4891-8091-b983749f2545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:45.980349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8750e0-d1ad-4891-8091-b983749f2545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:45.990467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8750e0-d1ad-4891-8091-b983749f2545 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:45.990854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8750e0-d1ad-4891-8091-b983749f2545 admin admin] PATH_INFO: `/v3/projects/0960ea4f6983471095bde7840b1393cf` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:45.995865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8750e0-d1ad-4891-8091-b983749f2545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0960ea4f6983471095bde7840b1393cf)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:46.001227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8750e0-d1ad-4891-8091-b983749f2545 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:46.084366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ff8750e0-d1ad-4891-8091-b983749f2545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0960ea4f6983471095bde7840b1393cf', 'request_id': 'req-ff8750e0-d1ad-4891-8091-b983749f2545'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:46.094958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ff8750e0-d1ad-4891-8091-b983749f2545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0960ea4f6983471095bde7840b1393cf', 'request_id': 'req-ff8750e0-d1ad-4891-8091-b983749f2545'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:46.110124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ff8750e0-d1ad-4891-8091-b983749f2545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0960ea4f6983471095bde7840b1393cf', 'request_id': 'req-ff8750e0-d1ad-4891-8091-b983749f2545'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:46.131981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ff8750e0-d1ad-4891-8091-b983749f2545 admin admin] The token cache is being invalidate because project 0960ea4f6983471095bde7840b1393cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:46.132229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ff8750e0-d1ad-4891-8091-b983749f2545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:46.132860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ff8750e0-d1ad-4891-8091-b983749f2545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:46.142968 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2772/5478] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:45 2021] DELETE /identity/v3/projects/0960ea4f6983471095bde7840b1393cf => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:46.145037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72506da2-6676-435a-b340-4b2682a6e399 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:46.145563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72506da2-6676-435a-b340-4b2682a6e399 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:46.145652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72506da2-6676-435a-b340-4b2682a6e399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:46.174403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-72506da2-6676-435a-b340-4b2682a6e399 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:46.175641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-72506da2-6676-435a-b340-4b2682a6e399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:46.258474 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2707/5479] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:46.263309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8f425-0d11-48d9-9beb-f17ff30f9d5b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:46.263603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8f425-0d11-48d9-9beb-f17ff30f9d5b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:46.263937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8f425-0d11-48d9-9beb-f17ff30f9d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:46.287569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7ff8f425-0d11-48d9-9beb-f17ff30f9d5b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:46.289082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7ff8f425-0d11-48d9-9beb-f17ff30f9d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:46.303080 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2773/5480] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:46.307798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72506da2-6676-435a-b340-4b2682a6e399 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:46.319948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72506da2-6676-435a-b340-4b2682a6e399 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:46.335103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8f425-0d11-48d9-9beb-f17ff30f9d5b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:46.338466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7ff8f425-0d11-48d9-9beb-f17ff30f9d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:46.349973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcbc9b-57e1-4bf9-a529-7bbc34f57344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:46.350703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcbc9b-57e1-4bf9-a529-7bbc34f57344 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:46.350994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcbc9b-57e1-4bf9-a529-7bbc34f57344 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:46.351939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcbc9b-57e1-4bf9-a529-7bbc34f57344 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:46.352092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcbc9b-57e1-4bf9-a529-7bbc34f57344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:46.352328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcbc9b-57e1-4bf9-a529-7bbc34f57344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:46.362669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcbc9b-57e1-4bf9-a529-7bbc34f57344 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:46.396756 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2708/5481] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:46.403188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcbc9b-57e1-4bf9-a529-7bbc34f57344 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:46.435317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcbc9b-57e1-4bf9-a529-7bbc34f57344 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:46.447300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c754d-3238-4987-a7e2-83ab00e2a142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:46.450150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c754d-3238-4987-a7e2-83ab00e2a142 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:46.451518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c754d-3238-4987-a7e2-83ab00e2a142 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:46.452024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c754d-3238-4987-a7e2-83ab00e2a142 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:46.454081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c754d-3238-4987-a7e2-83ab00e2a142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:46.459905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c754d-3238-4987-a7e2-83ab00e2a142 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:46.518051 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2709/5482] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:46 2021] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:46.518483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8f425-0d11-48d9-9beb-f17ff30f9d5b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:46.520003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c754d-3238-4987-a7e2-83ab00e2a142 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:46.623583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8db36b-6d02-4491-bfcc-50d3b7e8fe7c tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d38732e0e964ca2a7a05e1b530d3180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033500781fb149b997b81b3d38bc507e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:46.624825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8db36b-6d02-4491-bfcc-50d3b7e8fe7c tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:46.626640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8db36b-6d02-4491-bfcc-50d3b7e8fe7c tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:46.627262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8db36b-6d02-4491-bfcc-50d3b7e8fe7c tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:46.627384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c754d-3238-4987-a7e2-83ab00e2a142 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:46.628365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8db36b-6d02-4491-bfcc-50d3b7e8fe7c tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:46.628932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8db36b-6d02-4491-bfcc-50d3b7e8fe7c tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:46.631307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8db36b-6d02-4491-bfcc-50d3b7e8fe7c tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:46.633032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba87be-d21e-4e00-a2c6-d4644274cf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:46.633745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba87be-d21e-4e00-a2c6-d4644274cf14 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:46.634239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba87be-d21e-4e00-a2c6-d4644274cf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:46.634658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba87be-d21e-4e00-a2c6-d4644274cf14 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:46.635373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba87be-d21e-4e00-a2c6-d4644274cf14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:46.638446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba87be-d21e-4e00-a2c6-d4644274cf14 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:46.653391 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2774/5483] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:46.660099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8db36b-6d02-4491-bfcc-50d3b7e8fe7c tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:46.675357 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2710/5484] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:46 2021] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:46.680485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba87be-d21e-4e00-a2c6-d4644274cf14 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:46.683467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8db36b-6d02-4491-bfcc-50d3b7e8fe7c tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:46.692442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b64ef8-eadc-454d-ae87-f77366eabb6d tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d38732e0e964ca2a7a05e1b530d3180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033500781fb149b997b81b3d38bc507e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:46.693075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba87be-d21e-4e00-a2c6-d4644274cf14 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:46.693563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b64ef8-eadc-454d-ae87-f77366eabb6d tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:46.694399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b64ef8-eadc-454d-ae87-f77366eabb6d tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:46.694962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b64ef8-eadc-454d-ae87-f77366eabb6d tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:46.695911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b64ef8-eadc-454d-ae87-f77366eabb6d tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:46.698297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b64ef8-eadc-454d-ae87-f77366eabb6d tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:46.699881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce3b40-eadf-45b6-95c9-e90018fc0151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:46.700720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce3b40-eadf-45b6-95c9-e90018fc0151 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:46.701141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce3b40-eadf-45b6-95c9-e90018fc0151 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:46.701616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce3b40-eadf-45b6-95c9-e90018fc0151 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:46.702682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce3b40-eadf-45b6-95c9-e90018fc0151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:46.705410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce3b40-eadf-45b6-95c9-e90018fc0151 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:46.725876 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2711/5485] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:46 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:46.731465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce3b40-eadf-45b6-95c9-e90018fc0151 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:46.742346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce3b40-eadf-45b6-95c9-e90018fc0151 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:46.753795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17338c2-8214-4522-a952-a7926754389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:46.753795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17338c2-8214-4522-a952-a7926754389e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:46.754188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17338c2-8214-4522-a952-a7926754389e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:46.754188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17338c2-8214-4522-a952-a7926754389e admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:46.755115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17338c2-8214-4522-a952-a7926754389e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:46.756757 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2775/5486] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:46 2021] POST /identity/v3/projects => generated 346 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:46.758879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17338c2-8214-4522-a952-a7926754389e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:46.760643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b64ef8-eadc-454d-ae87-f77366eabb6d tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:46.785230 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2712/5487] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:46 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:46.786340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17338c2-8214-4522-a952-a7926754389e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:46.799040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17338c2-8214-4522-a952-a7926754389e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:46.849167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b64ef8-eadc-454d-ae87-f77366eabb6d tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:46.854214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a91a23-8676-4eb3-9469-42e9bd95e125 tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d38732e0e964ca2a7a05e1b530d3180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033500781fb149b997b81b3d38bc507e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:46.855038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a91a23-8676-4eb3-9469-42e9bd95e125 tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:46.855337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a91a23-8676-4eb3-9469-42e9bd95e125 tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:46.855970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a91a23-8676-4eb3-9469-42e9bd95e125 tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:46.856620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a91a23-8676-4eb3-9469-42e9bd95e125 tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:46.857054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a91a23-8676-4eb3-9469-42e9bd95e125 tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:46.858730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a91a23-8676-4eb3-9469-42e9bd95e125 tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:46.873861 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2776/5488] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:46.875223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8ad6b-73b1-4740-9fd0-c9fd1fd203ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:46.876077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8ad6b-73b1-4740-9fd0-c9fd1fd203ef admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:46.876361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8ad6b-73b1-4740-9fd0-c9fd1fd203ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:46.878760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8ad6b-73b1-4740-9fd0-c9fd1fd203ef admin admin] PATH_INFO: `/v3/projects/78c8925e524c48d28928f5e4526e7608/users/0e78f68b56fa46568a1f3b54621b177b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:46.902096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8ad6b-73b1-4740-9fd0-c9fd1fd203ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c8925e524c48d28928f5e4526e7608, user_id=0e78f68b56fa46568a1f3b54621b177b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:46.906389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8ad6b-73b1-4740-9fd0-c9fd1fd203ef admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:46.923228 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2713/5489] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:46 2021] PUT /identity/v3/projects/78c8925e524c48d28928f5e4526e7608/users/0e78f68b56fa46568a1f3b54621b177b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:46.936860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478be99-37b7-408d-a99f-7a1d95214bef None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:46.937383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478be99-37b7-408d-a99f-7a1d95214bef None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:46.937509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478be99-37b7-408d-a99f-7a1d95214bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:46.981051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1478be99-37b7-408d-a99f-7a1d95214bef None None] MFA Rules not processed for user `0e78f68b56fa46568a1f3b54621b177b`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:46.982629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1478be99-37b7-408d-a99f-7a1d95214bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:47.098576 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2777/5490] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:46 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:47.118460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8ad6b-73b1-4740-9fd0-c9fd1fd203ef admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:47.120443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b5e8ad6b-73b1-4740-9fd0-c9fd1fd203ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:47.194744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8ad6b-73b1-4740-9fd0-c9fd1fd203ef admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:47.201790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bcd8a-0982-4705-bcfb-343f1853bd56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:47.202981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bcd8a-0982-4705-bcfb-343f1853bd56 service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:47.203536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bcd8a-0982-4705-bcfb-343f1853bd56 service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:47.204063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bcd8a-0982-4705-bcfb-343f1853bd56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:47.215628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bcd8a-0982-4705-bcfb-343f1853bd56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:47.217325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bcd8a-0982-4705-bcfb-343f1853bd56 service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:47.227925 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2714/5491] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:47 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:47.484038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478be99-37b7-408d-a99f-7a1d95214bef None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:47.596564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478be99-37b7-408d-a99f-7a1d95214bef None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:47.604481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7db24-63f1-467b-8b38-371f52f74342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:47.605046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7db24-63f1-467b-8b38-371f52f74342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:47.605517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7db24-63f1-467b-8b38-371f52f74342 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:47.605925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7db24-63f1-467b-8b38-371f52f74342 admin admin] PATH_INFO: `/v3/users/0e78f68b56fa46568a1f3b54621b177b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:47.607443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7db24-63f1-467b-8b38-371f52f74342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e78f68b56fa46568a1f3b54621b177b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:47.609612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7db24-63f1-467b-8b38-371f52f74342 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:47.680554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-46d7db24-63f1-467b-8b38-371f52f74342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e78f68b56fa46568a1f3b54621b177b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:47.692507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-46d7db24-63f1-467b-8b38-371f52f74342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e78f68b56fa46568a1f3b54621b177b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:47.693564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-46d7db24-63f1-467b-8b38-371f52f74342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e78f68b56fa46568a1f3b54621b177b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:47.712475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-46d7db24-63f1-467b-8b38-371f52f74342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e78f68b56fa46568a1f3b54621b177b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:47.728807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-46d7db24-63f1-467b-8b38-371f52f74342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e78f68b56fa46568a1f3b54621b177b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:47.748185 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2778/5492] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:47 2021] DELETE /identity/v3/users/0e78f68b56fa46568a1f3b54621b177b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:47.752721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad41073-1050-44db-9be0-c9cb2f3fd15d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:47.753230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad41073-1050-44db-9be0-c9cb2f3fd15d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:47.753754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad41073-1050-44db-9be0-c9cb2f3fd15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:47.774978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4ad41073-1050-44db-9be0-c9cb2f3fd15d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:47.776261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4ad41073-1050-44db-9be0-c9cb2f3fd15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:47.875759 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2715/5493] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:47.951120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7db24-63f1-467b-8b38-371f52f74342 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:47.952715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-46d7db24-63f1-467b-8b38-371f52f74342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:48.033142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad41073-1050-44db-9be0-c9cb2f3fd15d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:48.036284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4ad41073-1050-44db-9be0-c9cb2f3fd15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:48.037852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7db24-63f1-467b-8b38-371f52f74342 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:48.043217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f71d1-8d44-4071-b596-8412d70c9898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:48.044691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f71d1-8d44-4071-b596-8412d70c9898 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:48.044691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f71d1-8d44-4071-b596-8412d70c9898 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:48.045192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f71d1-8d44-4071-b596-8412d70c9898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:48.057289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f71d1-8d44-4071-b596-8412d70c9898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:48.058902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f71d1-8d44-4071-b596-8412d70c9898 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:48.070982 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2779/5494] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:02:48.132600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad41073-1050-44db-9be0-c9cb2f3fd15d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:48.139850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d38932-f6e9-48c4-b774-8b658278d19b tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d38732e0e964ca2a7a05e1b530d3180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033500781fb149b997b81b3d38bc507e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:48.140864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d38932-f6e9-48c4-b774-8b658278d19b tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:48.141378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d38932-f6e9-48c4-b774-8b658278d19b tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:48.141711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d38932-f6e9-48c4-b774-8b658278d19b tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] PATH_INFO: `/v3/projects/cddc8a7fb768472884a73320ca7967c8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:48.144067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d38932-f6e9-48c4-b774-8b658278d19b tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cddc8a7fb768472884a73320ca7967c8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:48.147851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d38932-f6e9-48c4-b774-8b658278d19b tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:48.246625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f2d38932-f6e9-48c4-b774-8b658278d19b tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cddc8a7fb768472884a73320ca7967c8', 'request_id': 'req-f2d38932-f6e9-48c4-b774-8b658278d19b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:48.255461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f2d38932-f6e9-48c4-b774-8b658278d19b tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cddc8a7fb768472884a73320ca7967c8', 'request_id': 'req-f2d38932-f6e9-48c4-b774-8b658278d19b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:48.265108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f2d38932-f6e9-48c4-b774-8b658278d19b tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cddc8a7fb768472884a73320ca7967c8', 'request_id': 'req-f2d38932-f6e9-48c4-b774-8b658278d19b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:48.285331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f2d38932-f6e9-48c4-b774-8b658278d19b tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] The token cache is being invalidate because project cddc8a7fb768472884a73320ca7967c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:48.285722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f2d38932-f6e9-48c4-b774-8b658278d19b tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:48.286542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f2d38932-f6e9-48c4-b774-8b658278d19b tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:48.292875 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2716/5495] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:48 2021] DELETE /identity/v3/projects/cddc8a7fb768472884a73320ca7967c8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:48.314184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f71d1-8d44-4071-b596-8412d70c9898 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:48.350723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f71d1-8d44-4071-b596-8412d70c9898 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:48.427825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdaa68-07f7-4423-9e8b-d07e9455d610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:48.428485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdaa68-07f7-4423-9e8b-d07e9455d610 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:48.428772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdaa68-07f7-4423-9e8b-d07e9455d610 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:48.429050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdaa68-07f7-4423-9e8b-d07e9455d610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:48.430923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-62cdaa68-07f7-4423-9e8b-d07e9455d610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:48.528035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdaa68-07f7-4423-9e8b-d07e9455d610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:48.532453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdaa68-07f7-4423-9e8b-d07e9455d610 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:48.553118 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2780/5496] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:48 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:48.723282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d38932-f6e9-48c4-b774-8b658278d19b tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:48.725757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f2d38932-f6e9-48c4-b774-8b658278d19b tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:48.817931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdaa68-07f7-4423-9e8b-d07e9455d610 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:48.820265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-62cdaa68-07f7-4423-9e8b-d07e9455d610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:48.852547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d38932-f6e9-48c4-b774-8b658278d19b tempest-RoutersAdminTest-1348518700 tempest-RoutersAdminTest-1348518700-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:48.859147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7191e-76b9-4c96-8c05-6cf8e4af4989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:48.861603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7191e-76b9-4c96-8c05-6cf8e4af4989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:48.862076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7191e-76b9-4c96-8c05-6cf8e4af4989 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:48.862620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7191e-76b9-4c96-8c05-6cf8e4af4989 admin admin] PATH_INFO: `/v3/users/026afcda165f437cbd8dc3a854a14c95` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:48.864675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7191e-76b9-4c96-8c05-6cf8e4af4989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=026afcda165f437cbd8dc3a854a14c95)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:48.867090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7191e-76b9-4c96-8c05-6cf8e4af4989 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:48.964325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdaa68-07f7-4423-9e8b-d07e9455d610 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:48.965893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a1d7191e-76b9-4c96-8c05-6cf8e4af4989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '026afcda165f437cbd8dc3a854a14c95'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:48.973423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164631a0-2d32-4f9a-bfbe-63f42bd66bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:48.974368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a1d7191e-76b9-4c96-8c05-6cf8e4af4989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '026afcda165f437cbd8dc3a854a14c95'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:48.975359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164631a0-2d32-4f9a-bfbe-63f42bd66bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:48.975872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164631a0-2d32-4f9a-bfbe-63f42bd66bec admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:48.976471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164631a0-2d32-4f9a-bfbe-63f42bd66bec admin admin] PATH_INFO: `/v3/projects/78c8925e524c48d28928f5e4526e7608` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:48.979636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164631a0-2d32-4f9a-bfbe-63f42bd66bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c8925e524c48d28928f5e4526e7608)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:48.983191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164631a0-2d32-4f9a-bfbe-63f42bd66bec admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:48.999821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a1d7191e-76b9-4c96-8c05-6cf8e4af4989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '026afcda165f437cbd8dc3a854a14c95'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:49.000941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a1d7191e-76b9-4c96-8c05-6cf8e4af4989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '026afcda165f437cbd8dc3a854a14c95'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:49.014459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a1d7191e-76b9-4c96-8c05-6cf8e4af4989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '026afcda165f437cbd8dc3a854a14c95'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:49.023887 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2717/5497] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:48 2021] DELETE /identity/v3/users/026afcda165f437cbd8dc3a854a14c95 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:02:49.071381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-164631a0-2d32-4f9a-bfbe-63f42bd66bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c8925e524c48d28928f5e4526e7608', 'request_id': 'req-164631a0-2d32-4f9a-bfbe-63f42bd66bec'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:49.080336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-164631a0-2d32-4f9a-bfbe-63f42bd66bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c8925e524c48d28928f5e4526e7608', 'request_id': 'req-164631a0-2d32-4f9a-bfbe-63f42bd66bec'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:49.092332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-164631a0-2d32-4f9a-bfbe-63f42bd66bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c8925e524c48d28928f5e4526e7608', 'request_id': 'req-164631a0-2d32-4f9a-bfbe-63f42bd66bec'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:49.107738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-164631a0-2d32-4f9a-bfbe-63f42bd66bec admin admin] The token cache is being invalidate because project 78c8925e524c48d28928f5e4526e7608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:49.108224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-164631a0-2d32-4f9a-bfbe-63f42bd66bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:49.109014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-164631a0-2d32-4f9a-bfbe-63f42bd66bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:49.114344 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2781/5498] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:48 2021] DELETE /identity/v3/projects/78c8925e524c48d28928f5e4526e7608 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:02:49.118066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c880ddb-1078-4cf9-ad28-b98beae0bdd5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:49.118963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c880ddb-1078-4cf9-ad28-b98beae0bdd5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:49.119219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c880ddb-1078-4cf9-ad28-b98beae0bdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:49.139141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0c880ddb-1078-4cf9-ad28-b98beae0bdd5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:49.140305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0c880ddb-1078-4cf9-ad28-b98beae0bdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:49.211791 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2718/5499] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:49.220040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61ed71-9ca7-44e9-990f-2e69a8a682d4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:49.220528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61ed71-9ca7-44e9-990f-2e69a8a682d4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:49.220679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61ed71-9ca7-44e9-990f-2e69a8a682d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:49.250786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6e61ed71-9ca7-44e9-990f-2e69a8a682d4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:49.252485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6e61ed71-9ca7-44e9-990f-2e69a8a682d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:49.270827 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2782/5500] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:49.277052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c880ddb-1078-4cf9-ad28-b98beae0bdd5 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:49.293167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c880ddb-1078-4cf9-ad28-b98beae0bdd5 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:49.302189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e445e51-27a6-459b-a94e-ec8aecc4f4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:49.302966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e445e51-27a6-459b-a94e-ec8aecc4f4da admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:49.303253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e445e51-27a6-459b-a94e-ec8aecc4f4da admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:49.303613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e445e51-27a6-459b-a94e-ec8aecc4f4da admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:49.304860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e445e51-27a6-459b-a94e-ec8aecc4f4da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:49.304860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e445e51-27a6-459b-a94e-ec8aecc4f4da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:49.306952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e445e51-27a6-459b-a94e-ec8aecc4f4da admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:49.333355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61ed71-9ca7-44e9-990f-2e69a8a682d4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:49.338168 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2719/5501] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:49.343600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61ed71-9ca7-44e9-990f-2e69a8a682d4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:49.352934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e266034-7a52-46dd-b6be-2c0bc20f9fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:49.353606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e266034-7a52-46dd-b6be-2c0bc20f9fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:49.353897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e266034-7a52-46dd-b6be-2c0bc20f9fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:49.354231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e266034-7a52-46dd-b6be-2c0bc20f9fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:49.354986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e266034-7a52-46dd-b6be-2c0bc20f9fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:49.358108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e266034-7a52-46dd-b6be-2c0bc20f9fa8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:49.410118 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2783/5502] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:49 2021] POST /identity/v3/projects => generated 361 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:49.419151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e445e51-27a6-459b-a94e-ec8aecc4f4da admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:49.438426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e266034-7a52-46dd-b6be-2c0bc20f9fa8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:49.440369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1e266034-7a52-46dd-b6be-2c0bc20f9fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:49.442715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e445e51-27a6-459b-a94e-ec8aecc4f4da admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:49.560409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e266034-7a52-46dd-b6be-2c0bc20f9fa8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:49.573241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b083c31-d675-4787-978c-926f505aea53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:49.575560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b083c31-d675-4787-978c-926f505aea53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:49.577018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b083c31-d675-4787-978c-926f505aea53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:49.577475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b083c31-d675-4787-978c-926f505aea53 admin admin] PATH_INFO: `/v3/projects/a437811487424144a39cf7205f4646fb` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:49.581449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b083c31-d675-4787-978c-926f505aea53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a437811487424144a39cf7205f4646fb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:49.587665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b083c31-d675-4787-978c-926f505aea53 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:49.594086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bf08b-a654-4602-b771-2bbaa5f6e9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:49.594818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bf08b-a654-4602-b771-2bbaa5f6e9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:49.595108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bf08b-a654-4602-b771-2bbaa5f6e9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:49.595406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bf08b-a654-4602-b771-2bbaa5f6e9d9 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:49.596107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bf08b-a654-4602-b771-2bbaa5f6e9d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:49.598215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bf08b-a654-4602-b771-2bbaa5f6e9d9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:49.629181 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2720/5503] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:49 2021] POST /identity/v3/users => generated 281 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:49.634717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bf08b-a654-4602-b771-2bbaa5f6e9d9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:49.648351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bf08b-a654-4602-b771-2bbaa5f6e9d9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:49.657644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe5d4a-9c58-4663-96c2-e1ae031cd612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:49.658871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe5d4a-9c58-4663-96c2-e1ae031cd612 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:49.659389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe5d4a-9c58-4663-96c2-e1ae031cd612 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:49.659933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe5d4a-9c58-4663-96c2-e1ae031cd612 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:49.660990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe5d4a-9c58-4663-96c2-e1ae031cd612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:49.663007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe5d4a-9c58-4663-96c2-e1ae031cd612 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:49.680586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6b083c31-d675-4787-978c-926f505aea53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a437811487424144a39cf7205f4646fb', 'request_id': 'req-6b083c31-d675-4787-978c-926f505aea53'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:49.687200 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2721/5504] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:49 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:49.688909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6b083c31-d675-4787-978c-926f505aea53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a437811487424144a39cf7205f4646fb', 'request_id': 'req-6b083c31-d675-4787-978c-926f505aea53'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:49.694056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe5d4a-9c58-4663-96c2-e1ae031cd612 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:49.701982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6b083c31-d675-4787-978c-926f505aea53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a437811487424144a39cf7205f4646fb', 'request_id': 'req-6b083c31-d675-4787-978c-926f505aea53'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:49.722174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6b083c31-d675-4787-978c-926f505aea53 admin admin] The token cache is being invalidate because project a437811487424144a39cf7205f4646fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:49.722805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6b083c31-d675-4787-978c-926f505aea53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:49.723862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6b083c31-d675-4787-978c-926f505aea53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:49.726014 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2784/5505] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:49 2021] DELETE /identity/v3/projects/a437811487424144a39cf7205f4646fb => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:02:49.726540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe5d4a-9c58-4663-96c2-e1ae031cd612 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:49.732762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd502a-8421-448b-befd-324e60717cba None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:49.733371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd502a-8421-448b-befd-324e60717cba None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:49.733886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd502a-8421-448b-befd-324e60717cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:49.779035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-aadd502a-8421-448b-befd-324e60717cba None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:49.780356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-aadd502a-8421-448b-befd-324e60717cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:49.889708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffc460-efa3-404a-bc11-9a30700278d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:49.890771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffc460-efa3-404a-bc11-9a30700278d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:49.891279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffc460-efa3-404a-bc11-9a30700278d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:49.891845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffc460-efa3-404a-bc11-9a30700278d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:49.892890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffc460-efa3-404a-bc11-9a30700278d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:49.895438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffc460-efa3-404a-bc11-9a30700278d3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:49.919594 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2785/5506] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:49.921028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085b73-7f3d-4028-9538-2e0cb58e36c0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:49.921319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085b73-7f3d-4028-9538-2e0cb58e36c0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:49.921603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085b73-7f3d-4028-9538-2e0cb58e36c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:49.927418 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2722/5507] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:49 2021] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:02:49.934416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffc460-efa3-404a-bc11-9a30700278d3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:49.937938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f4ffc460-efa3-404a-bc11-9a30700278d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:49.956787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-44085b73-7f3d-4028-9538-2e0cb58e36c0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:49.958031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-44085b73-7f3d-4028-9538-2e0cb58e36c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:49.958802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffc460-efa3-404a-bc11-9a30700278d3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:49.966766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cf995-022f-4edd-98e7-3e99ead001a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:49.967943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cf995-022f-4edd-98e7-3e99ead001a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:49.968235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cf995-022f-4edd-98e7-3e99ead001a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:49.968519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cf995-022f-4edd-98e7-3e99ead001a2 admin admin] PATH_INFO: `/v3/projects/85dce985eb4b43f29bdc830062c127b8/users/118184f7d72e40658dd89a7d841ceeb0/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:49.981818 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2786/5508] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:49.983138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44085b73-7f3d-4028-9538-2e0cb58e36c0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:49.993784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44085b73-7f3d-4028-9538-2e0cb58e36c0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:50.011438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8c1f2-18c6-480c-8105-a5c1f40ba5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:50.013525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8c1f2-18c6-480c-8105-a5c1f40ba5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:50.014324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8c1f2-18c6-480c-8105-a5c1f40ba5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:50.014858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8c1f2-18c6-480c-8105-a5c1f40ba5b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:50.016095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8c1f2-18c6-480c-8105-a5c1f40ba5b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:50.016653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8c1f2-18c6-480c-8105-a5c1f40ba5b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:50.020102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8c1f2-18c6-480c-8105-a5c1f40ba5b7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:50.040442 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2787/5509] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:50.046049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8c1f2-18c6-480c-8105-a5c1f40ba5b7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:50.068381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8c1f2-18c6-480c-8105-a5c1f40ba5b7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:50.076789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b4f2c-94a2-49f9-b119-cf90e8c28648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:50.077871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b4f2c-94a2-49f9-b119-cf90e8c28648 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:50.078684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b4f2c-94a2-49f9-b119-cf90e8c28648 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:50.079249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b4f2c-94a2-49f9-b119-cf90e8c28648 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:50.080630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b4f2c-94a2-49f9-b119-cf90e8c28648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:50.083872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b4f2c-94a2-49f9-b119-cf90e8c28648 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:50.145951 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2788/5510] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:50 2021] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:50.150885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b4f2c-94a2-49f9-b119-cf90e8c28648 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:50.275233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b4f2c-94a2-49f9-b119-cf90e8c28648 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:50.277462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cf995-022f-4edd-98e7-3e99ead001a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85dce985eb4b43f29bdc830062c127b8, user_id=118184f7d72e40658dd89a7d841ceeb0, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:50.279791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cf995-022f-4edd-98e7-3e99ead001a2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:50.283019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7894b4-d94d-4846-be70-9a210ee671eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:50.283554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7894b4-d94d-4846-be70-9a210ee671eb admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:50.284183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7894b4-d94d-4846-be70-9a210ee671eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:50.284744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7894b4-d94d-4846-be70-9a210ee671eb admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:50.286100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7894b4-d94d-4846-be70-9a210ee671eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:50.288370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7894b4-d94d-4846-be70-9a210ee671eb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:50.306366 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2723/5511] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:49 2021] PUT /identity/v3/projects/85dce985eb4b43f29bdc830062c127b8/users/118184f7d72e40658dd89a7d841ceeb0/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:02:50.313658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66054a-fc5a-4dda-99ff-b11891bcba51 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:50.315072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66054a-fc5a-4dda-99ff-b11891bcba51 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:50.315545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66054a-fc5a-4dda-99ff-b11891bcba51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:50.323388 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2789/5512] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:50 2021] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:02:50.325335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7894b4-d94d-4846-be70-9a210ee671eb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:50.338191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7894b4-d94d-4846-be70-9a210ee671eb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:50.381947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0e66054a-fc5a-4dda-99ff-b11891bcba51 None None] MFA Rules not processed for user `118184f7d72e40658dd89a7d841ceeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:50.385177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0e66054a-fc5a-4dda-99ff-b11891bcba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:50.431740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cccae9-197a-4280-a370-291f36dd80c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:50.434913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cccae9-197a-4280-a370-291f36dd80c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:50.437006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cccae9-197a-4280-a370-291f36dd80c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:50.437546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cccae9-197a-4280-a370-291f36dd80c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:50.441094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cccae9-197a-4280-a370-291f36dd80c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:50.446157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cccae9-197a-4280-a370-291f36dd80c7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:50.465937 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2790/5513] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:50 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:50.467160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cccae9-197a-4280-a370-291f36dd80c7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:50.482285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cccae9-197a-4280-a370-291f36dd80c7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:50.490225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24afee-d8fa-4f40-ac51-607beb6ecd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:50.490906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24afee-d8fa-4f40-ac51-607beb6ecd53 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:50.496697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24afee-d8fa-4f40-ac51-607beb6ecd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:50.496830 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2724/5514] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:50 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:50.497460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24afee-d8fa-4f40-ac51-607beb6ecd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:50.497460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24afee-d8fa-4f40-ac51-607beb6ecd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:50.497460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24afee-d8fa-4f40-ac51-607beb6ecd53 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:50.505472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66054a-fc5a-4dda-99ff-b11891bcba51 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:50.523256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66054a-fc5a-4dda-99ff-b11891bcba51 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:50.534143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fefcf-396d-4f80-aef2-a7501b0c3538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:50.536389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fefcf-396d-4f80-aef2-a7501b0c3538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:50.537757 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2791/5515] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:50 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:50.538290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fefcf-396d-4f80-aef2-a7501b0c3538 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:50.538922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24afee-d8fa-4f40-ac51-607beb6ecd53 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:50.540158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fefcf-396d-4f80-aef2-a7501b0c3538 admin admin] PATH_INFO: `/v3/users/118184f7d72e40658dd89a7d841ceeb0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:50.542195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fefcf-396d-4f80-aef2-a7501b0c3538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=118184f7d72e40658dd89a7d841ceeb0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:50.546378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fefcf-396d-4f80-aef2-a7501b0c3538 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:50.552449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24afee-d8fa-4f40-ac51-607beb6ecd53 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:50.559643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3fea4-604c-4c03-a6b0-2910e3d5d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:50.562299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3fea4-604c-4c03-a6b0-2910e3d5d6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:50.562703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3fea4-604c-4c03-a6b0-2910e3d5d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:50.563145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3fea4-604c-4c03-a6b0-2910e3d5d6e8 admin admin] PATH_INFO: `/v3/projects/f161cef6f2864c7e8c2d183d1a22107e/users/015cce270f514b67a30f46bf31195933/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:50.584157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3fea4-604c-4c03-a6b0-2910e3d5d6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f161cef6f2864c7e8c2d183d1a22107e, user_id=015cce270f514b67a30f46bf31195933, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:50.587654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3fea4-604c-4c03-a6b0-2910e3d5d6e8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:50.611481 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2792/5516] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:50 2021] PUT /identity/v3/projects/f161cef6f2864c7e8c2d183d1a22107e/users/015cce270f514b67a30f46bf31195933/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:50.617192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06b1b4-09bc-40b4-9fa7-89534b1faad6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:50.619461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06b1b4-09bc-40b4-9fa7-89534b1faad6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:50.619461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06b1b4-09bc-40b4-9fa7-89534b1faad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:50.651153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2f06b1b4-09bc-40b4-9fa7-89534b1faad6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:50.653187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2f06b1b4-09bc-40b4-9fa7-89534b1faad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:50.672409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-823fefcf-396d-4f80-aef2-a7501b0c3538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '118184f7d72e40658dd89a7d841ceeb0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:50.687337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-823fefcf-396d-4f80-aef2-a7501b0c3538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '118184f7d72e40658dd89a7d841ceeb0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:50.704257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-823fefcf-396d-4f80-aef2-a7501b0c3538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '118184f7d72e40658dd89a7d841ceeb0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:50.705431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-823fefcf-396d-4f80-aef2-a7501b0c3538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '118184f7d72e40658dd89a7d841ceeb0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:50.730504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-823fefcf-396d-4f80-aef2-a7501b0c3538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '118184f7d72e40658dd89a7d841ceeb0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:50.743317 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2725/5517] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:50 2021] DELETE /identity/v3/users/118184f7d72e40658dd89a7d841ceeb0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:50.748768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f631e-76ea-425e-bebd-fcdb3b867a75 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:50.749014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f631e-76ea-425e-bebd-fcdb3b867a75 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:50.749416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f631e-76ea-425e-bebd-fcdb3b867a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:50.767324 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2793/5518] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:50.783347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06b1b4-09bc-40b4-9fa7-89534b1faad6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:50.785724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2f06b1b4-09bc-40b4-9fa7-89534b1faad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:50.787525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b35f631e-76ea-425e-bebd-fcdb3b867a75 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:50.790760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b35f631e-76ea-425e-bebd-fcdb3b867a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:50.900778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06b1b4-09bc-40b4-9fa7-89534b1faad6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:50.910685 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2726/5519] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:50.925288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f631e-76ea-425e-bebd-fcdb3b867a75 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:50.972781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86e56d-e4d7-47a7-9945-b98b835f8df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:50.973724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86e56d-e4d7-47a7-9945-b98b835f8df7 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:50.973855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86e56d-e4d7-47a7-9945-b98b835f8df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:50.974354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86e56d-e4d7-47a7-9945-b98b835f8df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:50.988109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86e56d-e4d7-47a7-9945-b98b835f8df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:50.989741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86e56d-e4d7-47a7-9945-b98b835f8df7 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:51.002917 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2794/5520] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:02:51.031211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f631e-76ea-425e-bebd-fcdb3b867a75 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:51.036650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620ebf7-808d-4cf6-b85d-fd51e1086cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:51.037315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ebf7-808d-4cf6-b85d-fd51e1086cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:51.037596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ebf7-808d-4cf6-b85d-fd51e1086cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:51.037919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ebf7-808d-4cf6-b85d-fd51e1086cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:51.055016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620ebf7-808d-4cf6-b85d-fd51e1086cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:51.057101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620ebf7-808d-4cf6-b85d-fd51e1086cd8 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:51.074454 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2727/5521] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:51.593002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86e56d-e4d7-47a7-9945-b98b835f8df7 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:51.594612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4d86e56d-e4d7-47a7-9945-b98b835f8df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:51.625048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86e56d-e4d7-47a7-9945-b98b835f8df7 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:51.631402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2502f2-1cf9-4f30-8e70-1b79818a78f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:51.632205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2502f2-1cf9-4f30-8e70-1b79818a78f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:51.632490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2502f2-1cf9-4f30-8e70-1b79818a78f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:51.632773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2502f2-1cf9-4f30-8e70-1b79818a78f3 admin admin] PATH_INFO: `/v3/projects/85dce985eb4b43f29bdc830062c127b8` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:51.635227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2502f2-1cf9-4f30-8e70-1b79818a78f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85dce985eb4b43f29bdc830062c127b8)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:51.637302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2502f2-1cf9-4f30-8e70-1b79818a78f3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:51.718831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8e2502f2-1cf9-4f30-8e70-1b79818a78f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85dce985eb4b43f29bdc830062c127b8', 'request_id': 'req-8e2502f2-1cf9-4f30-8e70-1b79818a78f3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:51.725710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8e2502f2-1cf9-4f30-8e70-1b79818a78f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85dce985eb4b43f29bdc830062c127b8', 'request_id': 'req-8e2502f2-1cf9-4f30-8e70-1b79818a78f3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:51.737525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8e2502f2-1cf9-4f30-8e70-1b79818a78f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85dce985eb4b43f29bdc830062c127b8', 'request_id': 'req-8e2502f2-1cf9-4f30-8e70-1b79818a78f3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:51.759525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8e2502f2-1cf9-4f30-8e70-1b79818a78f3 admin admin] The token cache is being invalidate because project 85dce985eb4b43f29bdc830062c127b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:51.760184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8e2502f2-1cf9-4f30-8e70-1b79818a78f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:51.761866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8e2502f2-1cf9-4f30-8e70-1b79818a78f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:51.763980 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2795/5522] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:51 2021] DELETE /identity/v3/projects/85dce985eb4b43f29bdc830062c127b8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:51.770547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf19148-6b49-4b2d-9c76-cc7ab99428ed None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:51.771100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf19148-6b49-4b2d-9c76-cc7ab99428ed None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:51.771366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf19148-6b49-4b2d-9c76-cc7ab99428ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:51.790459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fdf19148-6b49-4b2d-9c76-cc7ab99428ed None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:51.793616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fdf19148-6b49-4b2d-9c76-cc7ab99428ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:51.878392 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2728/5523] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:51.887963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8ebef-959c-4f60-8128-3984a00c15b6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:51.888250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8ebef-959c-4f60-8128-3984a00c15b6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:51.888528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8ebef-959c-4f60-8128-3984a00c15b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:51.917851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1ea8ebef-959c-4f60-8128-3984a00c15b6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:51.919278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1ea8ebef-959c-4f60-8128-3984a00c15b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:51.928817 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2796/5524] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:51.933867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf19148-6b49-4b2d-9c76-cc7ab99428ed None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:51.950089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf19148-6b49-4b2d-9c76-cc7ab99428ed None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:51.957347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa2c28-78ba-43ea-ac6e-e49046911787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:51.957347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa2c28-78ba-43ea-ac6e-e49046911787 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:51.957347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa2c28-78ba-43ea-ac6e-e49046911787 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:51.957926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa2c28-78ba-43ea-ac6e-e49046911787 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:51.958507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa2c28-78ba-43ea-ac6e-e49046911787 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:51.958821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa2c28-78ba-43ea-ac6e-e49046911787 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:51.960711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa2c28-78ba-43ea-ac6e-e49046911787 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:51.978180 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2729/5525] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:51.984197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8ebef-959c-4f60-8128-3984a00c15b6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:52.007023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8ebef-959c-4f60-8128-3984a00c15b6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:52.015519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b02ae-bf04-4ecb-a69c-1f868420a4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:52.016797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b02ae-bf04-4ecb-a69c-1f868420a4cc admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:52.017358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b02ae-bf04-4ecb-a69c-1f868420a4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:52.017908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b02ae-bf04-4ecb-a69c-1f868420a4cc admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:52.020436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b02ae-bf04-4ecb-a69c-1f868420a4cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:52.024072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b02ae-bf04-4ecb-a69c-1f868420a4cc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:52.079741 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2797/5526] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:51 2021] POST /identity/v3/projects => generated 391 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:52.083523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa2c28-78ba-43ea-ac6e-e49046911787 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:52.096100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa2c28-78ba-43ea-ac6e-e49046911787 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:52.183122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17f9db-e0ee-44fa-b9f6-d63f9cdeff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:52.184187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17f9db-e0ee-44fa-b9f6-d63f9cdeff5c admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:52.184770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17f9db-e0ee-44fa-b9f6-d63f9cdeff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:52.185228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17f9db-e0ee-44fa-b9f6-d63f9cdeff5c admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:52.186416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17f9db-e0ee-44fa-b9f6-d63f9cdeff5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:52.190765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17f9db-e0ee-44fa-b9f6-d63f9cdeff5c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:52.218420 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2730/5527] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:52 2021] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:52.223169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b02ae-bf04-4ecb-a69c-1f868420a4cc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:52.245676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b02ae-bf04-4ecb-a69c-1f868420a4cc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:52.252047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dde6d-a8f2-4aba-8d08-d6a8e0fb8eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:52.253240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dde6d-a8f2-4aba-8d08-d6a8e0fb8eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:52.253410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dde6d-a8f2-4aba-8d08-d6a8e0fb8eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:52.253853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dde6d-a8f2-4aba-8d08-d6a8e0fb8eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:52.279087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39dde6d-a8f2-4aba-8d08-d6a8e0fb8eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:52.283251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39dde6d-a8f2-4aba-8d08-d6a8e0fb8eb6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:52.317832 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2798/5528] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:52 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:02:52.323385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17f9db-e0ee-44fa-b9f6-d63f9cdeff5c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:52.338775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17f9db-e0ee-44fa-b9f6-d63f9cdeff5c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:52.354123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b7ee2-9dee-4987-96e1-e5f2dfa7ea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:52.357000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b7ee2-9dee-4987-96e1-e5f2dfa7ea7a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:52.357452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b7ee2-9dee-4987-96e1-e5f2dfa7ea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:52.359063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b7ee2-9dee-4987-96e1-e5f2dfa7ea7a admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:52.359961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b7ee2-9dee-4987-96e1-e5f2dfa7ea7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:52.363961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b7ee2-9dee-4987-96e1-e5f2dfa7ea7a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:52.396238 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2731/5529] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:52 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:52.400356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dde6d-a8f2-4aba-8d08-d6a8e0fb8eb6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:52.423801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dde6d-a8f2-4aba-8d08-d6a8e0fb8eb6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:52.432653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60107d6e-6755-450d-a0c2-24fb879333a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:52.433976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60107d6e-6755-450d-a0c2-24fb879333a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:52.434537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60107d6e-6755-450d-a0c2-24fb879333a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:52.435035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60107d6e-6755-450d-a0c2-24fb879333a7 admin admin] PATH_INFO: `/v3/projects/410c554ef4a44e01bb88006b3d72fb39/users/7e7d2f9b5b5648a991b703c431d0359f/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:52.483291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60107d6e-6755-450d-a0c2-24fb879333a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=410c554ef4a44e01bb88006b3d72fb39, user_id=7e7d2f9b5b5648a991b703c431d0359f, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:52.486549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60107d6e-6755-450d-a0c2-24fb879333a7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:52.520232 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2799/5530] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:52 2021] PUT /identity/v3/projects/410c554ef4a44e01bb88006b3d72fb39/users/7e7d2f9b5b5648a991b703c431d0359f/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:52.531643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e9cbc-f78f-4598-8be4-d0838613a67f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:52.532202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e9cbc-f78f-4598-8be4-d0838613a67f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:52.532666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e9cbc-f78f-4598-8be4-d0838613a67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:52.592614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f18e9cbc-f78f-4598-8be4-d0838613a67f None None] MFA Rules not processed for user `7e7d2f9b5b5648a991b703c431d0359f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:52.594169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f18e9cbc-f78f-4598-8be4-d0838613a67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:52.699692 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2732/5531] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:52 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:52.704744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60107d6e-6755-450d-a0c2-24fb879333a7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:52.767970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e9cbc-f78f-4598-8be4-d0838613a67f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:52.769933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f18e9cbc-f78f-4598-8be4-d0838613a67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:52.819865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60107d6e-6755-450d-a0c2-24fb879333a7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:52.826670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb23eb-f830-4943-b812-69ca824877bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:52.827484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb23eb-f830-4943-b812-69ca824877bb admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:52.827883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb23eb-f830-4943-b812-69ca824877bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:52.828374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb23eb-f830-4943-b812-69ca824877bb admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:52.829210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb23eb-f830-4943-b812-69ca824877bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:52.831389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb23eb-f830-4943-b812-69ca824877bb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:52.880482 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2800/5532] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:52 2021] POST /identity/v3/projects => generated 391 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:52.882043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0cc5c-7f81-48ee-8b9c-b7484e32be14 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:52.883209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0cc5c-7f81-48ee-8b9c-b7484e32be14 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:52.883598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0cc5c-7f81-48ee-8b9c-b7484e32be14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:52.897888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e9cbc-f78f-4598-8be4-d0838613a67f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:52.946966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4af0cc5c-7f81-48ee-8b9c-b7484e32be14 None None] MFA Rules not processed for user `015cce270f514b67a30f46bf31195933`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:52.948617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4af0cc5c-7f81-48ee-8b9c-b7484e32be14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:53.011770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2b52b-5ce9-48e7-8f5f-b64ccd348b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:53.012892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2b52b-5ce9-48e7-8f5f-b64ccd348b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:53.013184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2b52b-5ce9-48e7-8f5f-b64ccd348b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:53.013641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2b52b-5ce9-48e7-8f5f-b64ccd348b5e admin admin] PATH_INFO: `/v3/users/3930bda3716244de9ae53fec4b33ec31` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:53.015878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2b52b-5ce9-48e7-8f5f-b64ccd348b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3930bda3716244de9ae53fec4b33ec31)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:53.021128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2b52b-5ce9-48e7-8f5f-b64ccd348b5e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:53.091425 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2801/5533] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:52 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:53.092361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0cc5c-7f81-48ee-8b9c-b7484e32be14 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:53.115429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0cc5c-7f81-48ee-8b9c-b7484e32be14 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:53.122821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c70b76-90ab-4547-ac2d-6c8838d7a905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:53.123111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ecb2b52b-5ce9-48e7-8f5f-b64ccd348b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3930bda3716244de9ae53fec4b33ec31'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:53.124471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c70b76-90ab-4547-ac2d-6c8838d7a905 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:53.125231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c70b76-90ab-4547-ac2d-6c8838d7a905 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:53.125231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c70b76-90ab-4547-ac2d-6c8838d7a905 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:53.127539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c70b76-90ab-4547-ac2d-6c8838d7a905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:53.130266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c70b76-90ab-4547-ac2d-6c8838d7a905 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:53.133517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ecb2b52b-5ce9-48e7-8f5f-b64ccd348b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3930bda3716244de9ae53fec4b33ec31'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:53.149397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ecb2b52b-5ce9-48e7-8f5f-b64ccd348b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3930bda3716244de9ae53fec4b33ec31'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:53.150662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ecb2b52b-5ce9-48e7-8f5f-b64ccd348b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3930bda3716244de9ae53fec4b33ec31'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:53.166623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ecb2b52b-5ce9-48e7-8f5f-b64ccd348b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3930bda3716244de9ae53fec4b33ec31'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:53.166845 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2802/5534] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:53 2021] POST /identity/v3/users => generated 302 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:53.166845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65c0aa-9ac2-420b-978f-a3ee295e6ad8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:53.166845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65c0aa-9ac2-420b-978f-a3ee295e6ad8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:53.166845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65c0aa-9ac2-420b-978f-a3ee295e6ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:53.179877 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2733/5535] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:52 2021] DELETE /identity/v3/users/3930bda3716244de9ae53fec4b33ec31 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:53.179877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2b52b-5ce9-48e7-8f5f-b64ccd348b5e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:53.180301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ecb2b52b-5ce9-48e7-8f5f-b64ccd348b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:53.189684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-af65c0aa-9ac2-420b-978f-a3ee295e6ad8 None None] MFA Rules not processed for user `015cce270f514b67a30f46bf31195933`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:53.191397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-af65c0aa-9ac2-420b-978f-a3ee295e6ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:53.265956 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2803/5536] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:53 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:53.267744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41428f46-e91c-4d10-b121-cb3f27d0df87 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:53.268123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41428f46-e91c-4d10-b121-cb3f27d0df87 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:53.268524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41428f46-e91c-4d10-b121-cb3f27d0df87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:53.269607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2b52b-5ce9-48e7-8f5f-b64ccd348b5e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:53.276976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dbf0e-b85c-4368-9a8b-562d1d8205b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:53.278055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dbf0e-b85c-4368-9a8b-562d1d8205b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:53.278614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dbf0e-b85c-4368-9a8b-562d1d8205b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:53.278965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dbf0e-b85c-4368-9a8b-562d1d8205b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:53.279722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dbf0e-b85c-4368-9a8b-562d1d8205b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:53.281486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dbf0e-b85c-4368-9a8b-562d1d8205b1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:53.292594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-41428f46-e91c-4d10-b121-cb3f27d0df87 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:53.294297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-41428f46-e91c-4d10-b121-cb3f27d0df87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:53.297660 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2734/5537] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:53 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:53.298752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dbf0e-b85c-4368-9a8b-562d1d8205b1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:53.302832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-994dbf0e-b85c-4368-9a8b-562d1d8205b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:53.306799 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2804/5538] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:53.307769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41428f46-e91c-4d10-b121-cb3f27d0df87 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:53.323531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41428f46-e91c-4d10-b121-cb3f27d0df87 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:53.328894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38592d5c-139c-40af-ba41-3ea71abce10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:53.329961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38592d5c-139c-40af-ba41-3ea71abce10a admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:53.330153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38592d5c-139c-40af-ba41-3ea71abce10a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:53.330499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38592d5c-139c-40af-ba41-3ea71abce10a admin admin] PATH_INFO: `/v3/projects/7e0aa312fa154029be4312fcefa39273/users/5b1458b311704b299a0e2d21db57582a/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:53.357260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38592d5c-139c-40af-ba41-3ea71abce10a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0aa312fa154029be4312fcefa39273, user_id=5b1458b311704b299a0e2d21db57582a, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:53.361736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38592d5c-139c-40af-ba41-3ea71abce10a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:53.378409 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2805/5539] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:53 2021] PUT /identity/v3/projects/7e0aa312fa154029be4312fcefa39273/users/5b1458b311704b299a0e2d21db57582a/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:53.379551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38592d5c-139c-40af-ba41-3ea71abce10a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:53.381168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-38592d5c-139c-40af-ba41-3ea71abce10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:53.408462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dbf0e-b85c-4368-9a8b-562d1d8205b1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:53.465538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38592d5c-139c-40af-ba41-3ea71abce10a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:53.471752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84240f9e-dd95-4a31-8723-e1c1d2534910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:53.472627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84240f9e-dd95-4a31-8723-e1c1d2534910 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:53.472986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84240f9e-dd95-4a31-8723-e1c1d2534910 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:53.473469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84240f9e-dd95-4a31-8723-e1c1d2534910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:53.503411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72604ada-da66-4dea-8291-235a5e3e2df7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:53.504183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72604ada-da66-4dea-8291-235a5e3e2df7 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:53.504495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72604ada-da66-4dea-8291-235a5e3e2df7 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:53.504730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72604ada-da66-4dea-8291-235a5e3e2df7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:53.508246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-72604ada-da66-4dea-8291-235a5e3e2df7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:53.562575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84240f9e-dd95-4a31-8723-e1c1d2534910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:53.564685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84240f9e-dd95-4a31-8723-e1c1d2534910 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:53.582643 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2806/5540] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:53.584753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84240f9e-dd95-4a31-8723-e1c1d2534910 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:53.591293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72604ada-da66-4dea-8291-235a5e3e2df7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:53.595374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72604ada-da66-4dea-8291-235a5e3e2df7 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:53.599844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84240f9e-dd95-4a31-8723-e1c1d2534910 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:53.608544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e4872-e29b-4b98-97f1-5dcc3ea4f33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:53.609299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e4872-e29b-4b98-97f1-5dcc3ea4f33e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:53.609627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e4872-e29b-4b98-97f1-5dcc3ea4f33e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:53.609916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e4872-e29b-4b98-97f1-5dcc3ea4f33e admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:53.610736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e4872-e29b-4b98-97f1-5dcc3ea4f33e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:53.612945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e4872-e29b-4b98-97f1-5dcc3ea4f33e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:53.622337 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2735/5541] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:53 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:53.627303 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2807/5542] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:53 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:53.632221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72604ada-da66-4dea-8291-235a5e3e2df7 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:53.664853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72604ada-da66-4dea-8291-235a5e3e2df7 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:53.673464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81bd0d-53e1-489e-81f6-489d4edbe6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:53.674748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81bd0d-53e1-489e-81f6-489d4edbe6a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:53.675034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81bd0d-53e1-489e-81f6-489d4edbe6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:53.675370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81bd0d-53e1-489e-81f6-489d4edbe6a2 admin admin] PATH_INFO: `/v3/projects/7e0aa312fa154029be4312fcefa39273/users/5b1458b311704b299a0e2d21db57582a/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:53.679205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81bd0d-53e1-489e-81f6-489d4edbe6a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0aa312fa154029be4312fcefa39273, user_id=5b1458b311704b299a0e2d21db57582a, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:53.683998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81bd0d-53e1-489e-81f6-489d4edbe6a2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:53.702418 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2736/5543] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:53 2021] PUT /identity/v3/projects/7e0aa312fa154029be4312fcefa39273/users/5b1458b311704b299a0e2d21db57582a/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:53.714792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9054ef3-95dd-4f44-a942-42b0577fe496 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:53.714792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9054ef3-95dd-4f44-a942-42b0577fe496 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:53.715086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9054ef3-95dd-4f44-a942-42b0577fe496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:53.765561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a9054ef3-95dd-4f44-a942-42b0577fe496 None None] MFA Rules not processed for user `5b1458b311704b299a0e2d21db57582a`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:53.766903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a9054ef3-95dd-4f44-a942-42b0577fe496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:53.890474 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2808/5544] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:53 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:53.903926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81bd0d-53e1-489e-81f6-489d4edbe6a2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:53.906372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4f81bd0d-53e1-489e-81f6-489d4edbe6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:53.988719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81bd0d-53e1-489e-81f6-489d4edbe6a2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:53.994397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2fd73-8dc9-4118-89b6-a357d0bdc4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:53.995189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2fd73-8dc9-4118-89b6-a357d0bdc4fa service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:53.995506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2fd73-8dc9-4118-89b6-a357d0bdc4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:53.995909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2fd73-8dc9-4118-89b6-a357d0bdc4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:53.998288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b5c2fd73-8dc9-4118-89b6-a357d0bdc4fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:54.080410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2fd73-8dc9-4118-89b6-a357d0bdc4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:54.082637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2fd73-8dc9-4118-89b6-a357d0bdc4fa service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:54.096086 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2737/5545] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:53 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:54.324192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9054ef3-95dd-4f44-a942-42b0577fe496 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:54.326662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a9054ef3-95dd-4f44-a942-42b0577fe496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:54.389014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2fd73-8dc9-4118-89b6-a357d0bdc4fa service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:54.405829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2fd73-8dc9-4118-89b6-a357d0bdc4fa service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:54.411609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623226c6-4beb-4d96-b997-a95a40720144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:54.412508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623226c6-4beb-4d96-b997-a95a40720144 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:54.413105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623226c6-4beb-4d96-b997-a95a40720144 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:54.413257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623226c6-4beb-4d96-b997-a95a40720144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:54.416584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-623226c6-4beb-4d96-b997-a95a40720144 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:54.429590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9054ef3-95dd-4f44-a942-42b0577fe496 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:54.433833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623226c6-4beb-4d96-b997-a95a40720144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:54.435631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623226c6-4beb-4d96-b997-a95a40720144 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:54.437538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:54.438920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:54.439214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:54.439552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa admin admin] PATH_INFO: `/v3/projects/8ac6a5d172304e9a97ce8e01a5928f18` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:54.441070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ac6a5d172304e9a97ce8e01a5928f18)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:54.443517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:54.448164 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2738/5546] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:54 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:02:54.523489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ac6a5d172304e9a97ce8e01a5928f18', 'request_id': 'req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:54.540173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ac6a5d172304e9a97ce8e01a5928f18', 'request_id': 'req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:54.556208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ac6a5d172304e9a97ce8e01a5928f18', 'request_id': 'req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:54.579872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa admin admin] The token cache is being invalidate because project 8ac6a5d172304e9a97ce8e01a5928f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:54.580275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:54.581045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:54.583371 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2809/5547] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:54 2021] DELETE /identity/v3/projects/8ac6a5d172304e9a97ce8e01a5928f18 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:54.588177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623226c6-4beb-4d96-b997-a95a40720144 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:54.604226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623226c6-4beb-4d96-b997-a95a40720144 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:54.681111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df55a5-4ded-4a20-a557-b1e6c0da8492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:54.682122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df55a5-4ded-4a20-a557-b1e6c0da8492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:54.682548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df55a5-4ded-4a20-a557-b1e6c0da8492 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:54.683092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df55a5-4ded-4a20-a557-b1e6c0da8492 admin admin] PATH_INFO: `/v3/users/e9bc7072624045d5b02e6bb9412a7c8b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:54.684317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df55a5-4ded-4a20-a557-b1e6c0da8492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9bc7072624045d5b02e6bb9412a7c8b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:54.686412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df55a5-4ded-4a20-a557-b1e6c0da8492 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:54.791965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a7df55a5-4ded-4a20-a557-b1e6c0da8492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9bc7072624045d5b02e6bb9412a7c8b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:54.807423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a7df55a5-4ded-4a20-a557-b1e6c0da8492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9bc7072624045d5b02e6bb9412a7c8b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:54.857486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a7df55a5-4ded-4a20-a557-b1e6c0da8492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9bc7072624045d5b02e6bb9412a7c8b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:54.859918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a7df55a5-4ded-4a20-a557-b1e6c0da8492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9bc7072624045d5b02e6bb9412a7c8b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:54.884541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a7df55a5-4ded-4a20-a557-b1e6c0da8492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9bc7072624045d5b02e6bb9412a7c8b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:54.893214 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2739/5548] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:02:54 2021] DELETE /identity/v3/users/e9bc7072624045d5b02e6bb9412a7c8b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:55.461281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:55.471136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:55.514816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa83db-0e5d-4241-a23e-ff0d38359dfa admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:55.642092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19686a4-d40f-4b82-a848-1ba6d91f76c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:55.643330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19686a4-d40f-4b82-a848-1ba6d91f76c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:55.643810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19686a4-d40f-4b82-a848-1ba6d91f76c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:55.644363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19686a4-d40f-4b82-a848-1ba6d91f76c0 admin admin] PATH_INFO: `/v3/projects/68f3b87574044b6aac3092047a07172e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:55.647990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19686a4-d40f-4b82-a848-1ba6d91f76c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f3b87574044b6aac3092047a07172e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:55.651748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19686a4-d40f-4b82-a848-1ba6d91f76c0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:55.752752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b19686a4-d40f-4b82-a848-1ba6d91f76c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f3b87574044b6aac3092047a07172e', 'request_id': 'req-b19686a4-d40f-4b82-a848-1ba6d91f76c0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:55.761789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b19686a4-d40f-4b82-a848-1ba6d91f76c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f3b87574044b6aac3092047a07172e', 'request_id': 'req-b19686a4-d40f-4b82-a848-1ba6d91f76c0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:55.777653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b19686a4-d40f-4b82-a848-1ba6d91f76c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f3b87574044b6aac3092047a07172e', 'request_id': 'req-b19686a4-d40f-4b82-a848-1ba6d91f76c0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:55.811281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b19686a4-d40f-4b82-a848-1ba6d91f76c0 admin admin] The token cache is being invalidate because project 68f3b87574044b6aac3092047a07172e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:02:55.811615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b19686a4-d40f-4b82-a848-1ba6d91f76c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:55.818855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b19686a4-d40f-4b82-a848-1ba6d91f76c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:02:55.820952 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2810/5549] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:02:55 2021] DELETE /identity/v3/projects/68f3b87574044b6aac3092047a07172e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:55.827240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c10ad-cc4a-401f-95f5-0c8f89cd573e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:55.827874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c10ad-cc4a-401f-95f5-0c8f89cd573e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:55.827874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c10ad-cc4a-401f-95f5-0c8f89cd573e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:55.868839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e42c10ad-cc4a-401f-95f5-0c8f89cd573e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:55.869951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e42c10ad-cc4a-401f-95f5-0c8f89cd573e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:55.973757 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2740/5550] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:55.980221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda888d6-6d92-447e-850d-433bb491a799 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:55.980637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda888d6-6d92-447e-850d-433bb491a799 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:55.981033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda888d6-6d92-447e-850d-433bb491a799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:56.035477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bda888d6-6d92-447e-850d-433bb491a799 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:56.036852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bda888d6-6d92-447e-850d-433bb491a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:56.067137 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2811/5551] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:02:56.070438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c10ad-cc4a-401f-95f5-0c8f89cd573e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:56.090776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c10ad-cc4a-401f-95f5-0c8f89cd573e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:56.116009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6c104-155a-46f9-bcfb-ef55e6482beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:56.117251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6c104-155a-46f9-bcfb-ef55e6482beb admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:56.117388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6c104-155a-46f9-bcfb-ef55e6482beb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:56.117849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6c104-155a-46f9-bcfb-ef55e6482beb admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:56.120570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6c104-155a-46f9-bcfb-ef55e6482beb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:02:56.121280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6c104-155a-46f9-bcfb-ef55e6482beb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:56.124934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6c104-155a-46f9-bcfb-ef55e6482beb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:56.144261 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2741/5552] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:02:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:02:56.145434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda888d6-6d92-447e-850d-433bb491a799 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:56.160785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda888d6-6d92-447e-850d-433bb491a799 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:56.173368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efeffd-f17e-4d09-a4ac-eefdd5194f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:56.174054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efeffd-f17e-4d09-a4ac-eefdd5194f2e admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:56.174375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efeffd-f17e-4d09-a4ac-eefdd5194f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:56.174661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efeffd-f17e-4d09-a4ac-eefdd5194f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:56.175839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efeffd-f17e-4d09-a4ac-eefdd5194f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:56.178228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efeffd-f17e-4d09-a4ac-eefdd5194f2e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:56.235708 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2812/5553] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:56 2021] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:02:56.240532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6c104-155a-46f9-bcfb-ef55e6482beb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:56.273022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6c104-155a-46f9-bcfb-ef55e6482beb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:56.442116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c7ffb-f684-41c1-9336-c2799afe8712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:56.444279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c7ffb-f684-41c1-9336-c2799afe8712 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:56.445749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c7ffb-f684-41c1-9336-c2799afe8712 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:56.446627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c7ffb-f684-41c1-9336-c2799afe8712 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:56.449716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c7ffb-f684-41c1-9336-c2799afe8712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:56.455282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c7ffb-f684-41c1-9336-c2799afe8712 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:56.526503 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2742/5554] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:56 2021] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:56.527592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efeffd-f17e-4d09-a4ac-eefdd5194f2e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:56.553815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efeffd-f17e-4d09-a4ac-eefdd5194f2e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:56.566311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0d3b3-dcc7-4102-94ed-b3a648ebded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:56.567619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0d3b3-dcc7-4102-94ed-b3a648ebded3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:56.568282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0d3b3-dcc7-4102-94ed-b3a648ebded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:56.568847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0d3b3-dcc7-4102-94ed-b3a648ebded3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:56.569857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0d3b3-dcc7-4102-94ed-b3a648ebded3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:56.572509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0d3b3-dcc7-4102-94ed-b3a648ebded3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:56.605441 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2813/5555] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:56 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:56.610235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c7ffb-f684-41c1-9336-c2799afe8712 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:56.628853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c7ffb-f684-41c1-9336-c2799afe8712 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:56.637950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19202b-df61-4409-8699-ced4ba2c25ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:56.639119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19202b-df61-4409-8699-ced4ba2c25ba admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:56.639509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19202b-df61-4409-8699-ced4ba2c25ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:56.639920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19202b-df61-4409-8699-ced4ba2c25ba admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:56.641263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19202b-df61-4409-8699-ced4ba2c25ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:56.643848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19202b-df61-4409-8699-ced4ba2c25ba admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:56.667127 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2743/5556] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:56 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:56.668191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0d3b3-dcc7-4102-94ed-b3a648ebded3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:56.686313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0d3b3-dcc7-4102-94ed-b3a648ebded3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:56.697627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96439428-2b41-462b-bd66-51bf0b7a85b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:56.699209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96439428-2b41-462b-bd66-51bf0b7a85b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:56.699963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96439428-2b41-462b-bd66-51bf0b7a85b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:56.700305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96439428-2b41-462b-bd66-51bf0b7a85b8 admin admin] PATH_INFO: `/v3/projects/6d64eba70cc64bb3a58d61b81cac2675/users/01902ae8afe546c397931198056f192b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:56.746035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96439428-2b41-462b-bd66-51bf0b7a85b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d64eba70cc64bb3a58d61b81cac2675, user_id=01902ae8afe546c397931198056f192b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:56.749240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96439428-2b41-462b-bd66-51bf0b7a85b8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:56.779679 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2814/5557] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:56 2021] PUT /identity/v3/projects/6d64eba70cc64bb3a58d61b81cac2675/users/01902ae8afe546c397931198056f192b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:02:56.791181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3294d-8ee8-40e7-9162-b3da4a317a8b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:56.791475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3294d-8ee8-40e7-9162-b3da4a317a8b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:56.791772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3294d-8ee8-40e7-9162-b3da4a317a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:56.828133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-12b3294d-8ee8-40e7-9162-b3da4a317a8b None None] MFA Rules not processed for user `01902ae8afe546c397931198056f192b`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:56.830707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-12b3294d-8ee8-40e7-9162-b3da4a317a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:56.970082 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2744/5558] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:56 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:56.974565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96439428-2b41-462b-bd66-51bf0b7a85b8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:57.082139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96439428-2b41-462b-bd66-51bf0b7a85b8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:57.089536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7545a22-7e85-464e-9cbe-a3548c28a091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:57.090614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7545a22-7e85-464e-9cbe-a3548c28a091 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:57.091126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7545a22-7e85-464e-9cbe-a3548c28a091 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:57.092639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7545a22-7e85-464e-9cbe-a3548c28a091 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:57.093621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7545a22-7e85-464e-9cbe-a3548c28a091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:57.097590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7545a22-7e85-464e-9cbe-a3548c28a091 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:57.168628 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2815/5559] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:02:56 2021] POST /identity/v3/projects => generated 383 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:57.169764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3294d-8ee8-40e7-9162-b3da4a317a8b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:57.193833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3294d-8ee8-40e7-9162-b3da4a317a8b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:57.325578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33e639-4287-4c98-a625-c960a451bedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:57.326285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33e639-4287-4c98-a625-c960a451bedc admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:57.326704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33e639-4287-4c98-a625-c960a451bedc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:57.326983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33e639-4287-4c98-a625-c960a451bedc admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:57.327691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33e639-4287-4c98-a625-c960a451bedc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:57.329608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33e639-4287-4c98-a625-c960a451bedc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:57.362629 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2745/5560] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:02:57 2021] POST /identity/v3/users => generated 298 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:02:57.363190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7545a22-7e85-464e-9cbe-a3548c28a091 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:57.377886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7545a22-7e85-464e-9cbe-a3548c28a091 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:57.385358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34b2c5-65be-4ba4-86ce-00e89e835553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:57.386304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34b2c5-65be-4ba4-86ce-00e89e835553 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:57.387222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34b2c5-65be-4ba4-86ce-00e89e835553 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:57.387746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34b2c5-65be-4ba4-86ce-00e89e835553 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:57.389678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34b2c5-65be-4ba4-86ce-00e89e835553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:57.392353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34b2c5-65be-4ba4-86ce-00e89e835553 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:57.433632 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2816/5561] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:57 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:57.435910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33e639-4287-4c98-a625-c960a451bedc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:57.450156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33e639-4287-4c98-a625-c960a451bedc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:57.456794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148fdc9-a343-48ea-8025-0ed6eb4be34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:57.458398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148fdc9-a343-48ea-8025-0ed6eb4be34a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:57.458938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148fdc9-a343-48ea-8025-0ed6eb4be34a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:57.459576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148fdc9-a343-48ea-8025-0ed6eb4be34a admin admin] PATH_INFO: `/v3/projects/15cb84bc656c4526b9686cb550700f89/users/8cc04bb10a31407ead29e245a78a607e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:57.482583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148fdc9-a343-48ea-8025-0ed6eb4be34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=15cb84bc656c4526b9686cb550700f89, user_id=8cc04bb10a31407ead29e245a78a607e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:57.485611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148fdc9-a343-48ea-8025-0ed6eb4be34a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:57.511282 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2746/5562] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:57 2021] PUT /identity/v3/projects/15cb84bc656c4526b9686cb550700f89/users/8cc04bb10a31407ead29e245a78a607e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:02:57.514037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34b2c5-65be-4ba4-86ce-00e89e835553 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:57.534021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34b2c5-65be-4ba4-86ce-00e89e835553 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:57.630763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdcb96-42b1-4753-9f9c-9f086f20bb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:57.631433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdcb96-42b1-4753-9f9c-9f086f20bb0b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:57.631774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdcb96-42b1-4753-9f9c-9f086f20bb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:57.631992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdcb96-42b1-4753-9f9c-9f086f20bb0b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:57.632785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bdcb96-42b1-4753-9f9c-9f086f20bb0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:57.635700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bdcb96-42b1-4753-9f9c-9f086f20bb0b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:57.659724 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2817/5563] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:02:57 2021] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:02:57.663978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148fdc9-a343-48ea-8025-0ed6eb4be34a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:57.677582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148fdc9-a343-48ea-8025-0ed6eb4be34a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:57.684148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23830390-7c2e-4c53-96d5-f6ba750cf34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:57.685269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23830390-7c2e-4c53-96d5-f6ba750cf34b admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:57.685655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23830390-7c2e-4c53-96d5-f6ba750cf34b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:57.686035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23830390-7c2e-4c53-96d5-f6ba750cf34b admin admin] PATH_INFO: `/v3/projects/15cb84bc656c4526b9686cb550700f89/users/8cc04bb10a31407ead29e245a78a607e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:57.688664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23830390-7c2e-4c53-96d5-f6ba750cf34b admin admin] RBAC: Authorizing `identity:create_grant(project_id=15cb84bc656c4526b9686cb550700f89, user_id=8cc04bb10a31407ead29e245a78a607e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:57.693714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23830390-7c2e-4c53-96d5-f6ba750cf34b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:57.766595 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2747/5564] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:02:57 2021] PUT /identity/v3/projects/15cb84bc656c4526b9686cb550700f89/users/8cc04bb10a31407ead29e245a78a607e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:02:57.834651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd051ad7-0aa5-45d9-9fad-acd4d0ff1775 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:57.834943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd051ad7-0aa5-45d9-9fad-acd4d0ff1775 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:57.835384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd051ad7-0aa5-45d9-9fad-acd4d0ff1775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:57.889732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bd051ad7-0aa5-45d9-9fad-acd4d0ff1775 None None] MFA Rules not processed for user `8cc04bb10a31407ead29e245a78a607e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:02:57.891058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bd051ad7-0aa5-45d9-9fad-acd4d0ff1775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:58.028350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23830390-7c2e-4c53-96d5-f6ba750cf34b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:58.030804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-23830390-7c2e-4c53-96d5-f6ba750cf34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:58.109185 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2818/5565] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:02:57 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:02:58.127003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd051ad7-0aa5-45d9-9fad-acd4d0ff1775 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:58.131642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bd051ad7-0aa5-45d9-9fad-acd4d0ff1775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:58.206405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23830390-7c2e-4c53-96d5-f6ba750cf34b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:58.215448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21108a27-b6ee-4a63-840e-dde6291f5d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:58.218197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21108a27-b6ee-4a63-840e-dde6291f5d0d service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:58.218645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21108a27-b6ee-4a63-840e-dde6291f5d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:58.219001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21108a27-b6ee-4a63-840e-dde6291f5d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:58.223255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-21108a27-b6ee-4a63-840e-dde6291f5d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:58.295912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21108a27-b6ee-4a63-840e-dde6291f5d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:58.297522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21108a27-b6ee-4a63-840e-dde6291f5d0d service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:58.300357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd051ad7-0aa5-45d9-9fad-acd4d0ff1775 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:58.306176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193f717-4666-4156-b119-e937a49ac492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:58.310211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193f717-4666-4156-b119-e937a49ac492 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:58.310872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193f717-4666-4156-b119-e937a49ac492 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:58.311484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193f717-4666-4156-b119-e937a49ac492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:58.317253 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2748/5566] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:58 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:58.326500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193f717-4666-4156-b119-e937a49ac492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:58.328078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193f717-4666-4156-b119-e937a49ac492 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:58.365374 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2819/5567] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:58 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:02:58.640898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21108a27-b6ee-4a63-840e-dde6291f5d0d service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:02:58.664639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21108a27-b6ee-4a63-840e-dde6291f5d0d service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:02:58.677282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d717f-654e-49a0-8204-343120f4e42e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:02:58.677959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d717f-654e-49a0-8204-343120f4e42e service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:02:58.678284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d717f-654e-49a0-8204-343120f4e42e service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:02:58.681586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d717f-654e-49a0-8204-343120f4e42e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:02:58.689648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2f6d717f-654e-49a0-8204-343120f4e42e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:02:58.857703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d717f-654e-49a0-8204-343120f4e42e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:02:58.859368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d717f-654e-49a0-8204-343120f4e42e service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:02:58.885551 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2749/5568] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:02:58 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:02.803139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193f717-4666-4156-b119-e937a49ac492 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:02.885564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193f717-4666-4156-b119-e937a49ac492 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:02.893488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083a11c-57e1-4649-99e3-011335769f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:02.894749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083a11c-57e1-4649-99e3-011335769f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:02.895216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083a11c-57e1-4649-99e3-011335769f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:02.895696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083a11c-57e1-4649-99e3-011335769f7a admin admin] PATH_INFO: `/v3/users/01902ae8afe546c397931198056f192b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:02.897274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083a11c-57e1-4649-99e3-011335769f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=01902ae8afe546c397931198056f192b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:02.900277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083a11c-57e1-4649-99e3-011335769f7a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:03.029634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4083a11c-57e1-4649-99e3-011335769f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01902ae8afe546c397931198056f192b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:03.046190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4083a11c-57e1-4649-99e3-011335769f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01902ae8afe546c397931198056f192b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:03.047110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4083a11c-57e1-4649-99e3-011335769f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01902ae8afe546c397931198056f192b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:03.066046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4083a11c-57e1-4649-99e3-011335769f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01902ae8afe546c397931198056f192b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:03.089889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4083a11c-57e1-4649-99e3-011335769f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01902ae8afe546c397931198056f192b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:03.121629 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2820/5569] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:02 2021] DELETE /identity/v3/users/01902ae8afe546c397931198056f192b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:03.127691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea0a74-2322-47f7-aa45-578ca2305739 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:03.128266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea0a74-2322-47f7-aa45-578ca2305739 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:03.128558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea0a74-2322-47f7-aa45-578ca2305739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:03.160448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8fea0a74-2322-47f7-aa45-578ca2305739 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:03.162367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8fea0a74-2322-47f7-aa45-578ca2305739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:03.246078 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2750/5570] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:03.264569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083a11c-57e1-4649-99e3-011335769f7a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:03.269759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4083a11c-57e1-4649-99e3-011335769f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:03.368669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083a11c-57e1-4649-99e3-011335769f7a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:03.373250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb0bc9-5366-48f0-8919-12f891aa2273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:03.374065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb0bc9-5366-48f0-8919-12f891aa2273 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:03.374457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb0bc9-5366-48f0-8919-12f891aa2273 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:03.374914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb0bc9-5366-48f0-8919-12f891aa2273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:03.386984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb0bc9-5366-48f0-8919-12f891aa2273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:03.388940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb0bc9-5366-48f0-8919-12f891aa2273 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:03.404140 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2821/5571] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:03.917922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea0a74-2322-47f7-aa45-578ca2305739 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:03.920535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8fea0a74-2322-47f7-aa45-578ca2305739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:03.945692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea0a74-2322-47f7-aa45-578ca2305739 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:03.957797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490f067-28fe-44bd-b9c9-4dfb37372bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:03.959106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490f067-28fe-44bd-b9c9-4dfb37372bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:03.959551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490f067-28fe-44bd-b9c9-4dfb37372bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:03.959987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490f067-28fe-44bd-b9c9-4dfb37372bfd admin admin] PATH_INFO: `/v3/projects/6d64eba70cc64bb3a58d61b81cac2675` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:03.962802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490f067-28fe-44bd-b9c9-4dfb37372bfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d64eba70cc64bb3a58d61b81cac2675)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:03.967863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490f067-28fe-44bd-b9c9-4dfb37372bfd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:04.088811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb0bc9-5366-48f0-8919-12f891aa2273 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:04.091137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-02bb0bc9-5366-48f0-8919-12f891aa2273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:04.124977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb0bc9-5366-48f0-8919-12f891aa2273 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:04.138215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0490f067-28fe-44bd-b9c9-4dfb37372bfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d64eba70cc64bb3a58d61b81cac2675', 'request_id': 'req-0490f067-28fe-44bd-b9c9-4dfb37372bfd'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:04.145396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0490f067-28fe-44bd-b9c9-4dfb37372bfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d64eba70cc64bb3a58d61b81cac2675', 'request_id': 'req-0490f067-28fe-44bd-b9c9-4dfb37372bfd'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:04.152171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0490f067-28fe-44bd-b9c9-4dfb37372bfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d64eba70cc64bb3a58d61b81cac2675', 'request_id': 'req-0490f067-28fe-44bd-b9c9-4dfb37372bfd'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:04.175416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0490f067-28fe-44bd-b9c9-4dfb37372bfd admin admin] The token cache is being invalidate because project 6d64eba70cc64bb3a58d61b81cac2675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:04.176348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0490f067-28fe-44bd-b9c9-4dfb37372bfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:04.177365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0490f067-28fe-44bd-b9c9-4dfb37372bfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:04.179821 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2751/5572] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:03 2021] DELETE /identity/v3/projects/6d64eba70cc64bb3a58d61b81cac2675 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:04.185309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490f067-28fe-44bd-b9c9-4dfb37372bfd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:04.188406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0490f067-28fe-44bd-b9c9-4dfb37372bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:04.261435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36588003-b638-4fbf-93b5-15f10909d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:04.262360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36588003-b638-4fbf-93b5-15f10909d6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:04.262643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36588003-b638-4fbf-93b5-15f10909d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:04.262934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36588003-b638-4fbf-93b5-15f10909d6a0 admin admin] PATH_INFO: `/v3/users/e18391d5b5ae43d3b9b3cc8d61b27de1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:04.270000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36588003-b638-4fbf-93b5-15f10909d6a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e18391d5b5ae43d3b9b3cc8d61b27de1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:04.274688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36588003-b638-4fbf-93b5-15f10909d6a0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:04.354154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490f067-28fe-44bd-b9c9-4dfb37372bfd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:04.369792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ac869-7f5b-4dbe-a178-8003509bd520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:04.370565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ac869-7f5b-4dbe-a178-8003509bd520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:04.370852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ac869-7f5b-4dbe-a178-8003509bd520 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:04.371135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ac869-7f5b-4dbe-a178-8003509bd520 admin admin] PATH_INFO: `/v3/users/8cc04bb10a31407ead29e245a78a607e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:04.372891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ac869-7f5b-4dbe-a178-8003509bd520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc04bb10a31407ead29e245a78a607e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:04.375691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ac869-7f5b-4dbe-a178-8003509bd520 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:04.470860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-36588003-b638-4fbf-93b5-15f10909d6a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e18391d5b5ae43d3b9b3cc8d61b27de1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:04.489177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-36588003-b638-4fbf-93b5-15f10909d6a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e18391d5b5ae43d3b9b3cc8d61b27de1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:04.490241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-36588003-b638-4fbf-93b5-15f10909d6a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e18391d5b5ae43d3b9b3cc8d61b27de1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:04.520392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-36588003-b638-4fbf-93b5-15f10909d6a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e18391d5b5ae43d3b9b3cc8d61b27de1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:04.542449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-36588003-b638-4fbf-93b5-15f10909d6a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e18391d5b5ae43d3b9b3cc8d61b27de1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:04.552724 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2822/5573] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:04 2021] DELETE /identity/v3/users/e18391d5b5ae43d3b9b3cc8d61b27de1 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:04.557732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd798f4-0d83-4500-b80b-3b805905d893 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:04.558053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd798f4-0d83-4500-b80b-3b805905d893 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:04.558365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd798f4-0d83-4500-b80b-3b805905d893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:04.599293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ddd798f4-0d83-4500-b80b-3b805905d893 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:04.600522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ddd798f4-0d83-4500-b80b-3b805905d893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:04.623020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-722ac869-7f5b-4dbe-a178-8003509bd520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc04bb10a31407ead29e245a78a607e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:04.663545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-722ac869-7f5b-4dbe-a178-8003509bd520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc04bb10a31407ead29e245a78a607e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:04.729599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-722ac869-7f5b-4dbe-a178-8003509bd520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc04bb10a31407ead29e245a78a607e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:04.736197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-722ac869-7f5b-4dbe-a178-8003509bd520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc04bb10a31407ead29e245a78a607e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:04.760648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-722ac869-7f5b-4dbe-a178-8003509bd520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc04bb10a31407ead29e245a78a607e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:04.795208 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2752/5574] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:04 2021] DELETE /identity/v3/users/8cc04bb10a31407ead29e245a78a607e => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:04.841897 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2823/5575] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:03:04.882635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ac869-7f5b-4dbe-a178-8003509bd520 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:04.884663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-722ac869-7f5b-4dbe-a178-8003509bd520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:04.995494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ac869-7f5b-4dbe-a178-8003509bd520 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:05.003818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889b4c0-4703-4bcc-a605-c4cadb80d43d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:05.004677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889b4c0-4703-4bcc-a605-c4cadb80d43d service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:05.005163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889b4c0-4703-4bcc-a605-c4cadb80d43d service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:05.005784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889b4c0-4703-4bcc-a605-c4cadb80d43d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:05.035257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd798f4-0d83-4500-b80b-3b805905d893 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:05.039554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ddd798f4-0d83-4500-b80b-3b805905d893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:05.066098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd798f4-0d83-4500-b80b-3b805905d893 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:05.153062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f78677-10b6-4f60-99fb-06597a38bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:05.155221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f78677-10b6-4f60-99fb-06597a38bf31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:05.155758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f78677-10b6-4f60-99fb-06597a38bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:05.156551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f78677-10b6-4f60-99fb-06597a38bf31 admin admin] PATH_INFO: `/v3/users/7e7d2f9b5b5648a991b703c431d0359f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:05.158639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f78677-10b6-4f60-99fb-06597a38bf31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7d2f9b5b5648a991b703c431d0359f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:05.160880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f78677-10b6-4f60-99fb-06597a38bf31 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:05.258136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-85f78677-10b6-4f60-99fb-06597a38bf31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7d2f9b5b5648a991b703c431d0359f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:05.260038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889b4c0-4703-4bcc-a605-c4cadb80d43d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:05.265340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889b4c0-4703-4bcc-a605-c4cadb80d43d service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:05.278668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-85f78677-10b6-4f60-99fb-06597a38bf31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7d2f9b5b5648a991b703c431d0359f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:05.280179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-85f78677-10b6-4f60-99fb-06597a38bf31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7d2f9b5b5648a991b703c431d0359f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:05.291496 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2753/5576] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:05.292140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889b4c0-4703-4bcc-a605-c4cadb80d43d service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:05.300641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e889b4c0-4703-4bcc-a605-c4cadb80d43d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:05.333023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-85f78677-10b6-4f60-99fb-06597a38bf31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7d2f9b5b5648a991b703c431d0359f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:05.348055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889b4c0-4703-4bcc-a605-c4cadb80d43d service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:05.348849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-85f78677-10b6-4f60-99fb-06597a38bf31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7d2f9b5b5648a991b703c431d0359f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:05.353975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d89fa-4f13-46fc-a28e-fde5c399367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:05.354870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d89fa-4f13-46fc-a28e-fde5c399367f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:05.355185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d89fa-4f13-46fc-a28e-fde5c399367f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:05.355424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d89fa-4f13-46fc-a28e-fde5c399367f admin admin] PATH_INFO: `/v3/projects/15cb84bc656c4526b9686cb550700f89` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:05.357162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d89fa-4f13-46fc-a28e-fde5c399367f admin admin] RBAC: Authorizing `identity:delete_project(project_id=15cb84bc656c4526b9686cb550700f89)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:05.359764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d89fa-4f13-46fc-a28e-fde5c399367f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:05.365604 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2824/5577] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:05 2021] DELETE /identity/v3/users/7e7d2f9b5b5648a991b703c431d0359f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:05.372230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4bff1-202c-42fe-991c-5beb05e1d815 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:05.373097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4bff1-202c-42fe-991c-5beb05e1d815 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:05.373647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4bff1-202c-42fe-991c-5beb05e1d815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:05.417276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-85f4bff1-202c-42fe-991c-5beb05e1d815 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:05.419330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-85f4bff1-202c-42fe-991c-5beb05e1d815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:05.478829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-712d89fa-4f13-46fc-a28e-fde5c399367f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15cb84bc656c4526b9686cb550700f89', 'request_id': 'req-712d89fa-4f13-46fc-a28e-fde5c399367f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:05.489089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-712d89fa-4f13-46fc-a28e-fde5c399367f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15cb84bc656c4526b9686cb550700f89', 'request_id': 'req-712d89fa-4f13-46fc-a28e-fde5c399367f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:05.504300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-712d89fa-4f13-46fc-a28e-fde5c399367f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15cb84bc656c4526b9686cb550700f89', 'request_id': 'req-712d89fa-4f13-46fc-a28e-fde5c399367f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:05.551108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-712d89fa-4f13-46fc-a28e-fde5c399367f admin admin] The token cache is being invalidate because project 15cb84bc656c4526b9686cb550700f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:05.551108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-712d89fa-4f13-46fc-a28e-fde5c399367f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:05.553660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-712d89fa-4f13-46fc-a28e-fde5c399367f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:05.558314 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2754/5578] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:05 2021] DELETE /identity/v3/projects/15cb84bc656c4526b9686cb550700f89 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:05.566422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7737fed-3a58-4633-ad46-8b099728f5e9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:05.567012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7737fed-3a58-4633-ad46-8b099728f5e9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:05.567297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7737fed-3a58-4633-ad46-8b099728f5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:05.571583 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2825/5579] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:03:05.608549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f7737fed-3a58-4633-ad46-8b099728f5e9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:05.611447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f7737fed-3a58-4633-ad46-8b099728f5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:05.616703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4bff1-202c-42fe-991c-5beb05e1d815 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:05.619987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-85f4bff1-202c-42fe-991c-5beb05e1d815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:05.738152 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2755/5580] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:05.747385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad611950-c087-4671-8dde-ffffa5516ed9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:05.747747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad611950-c087-4671-8dde-ffffa5516ed9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:05.748109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad611950-c087-4671-8dde-ffffa5516ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:05.752884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4bff1-202c-42fe-991c-5beb05e1d815 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:05.773504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ad611950-c087-4671-8dde-ffffa5516ed9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:05.774924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ad611950-c087-4671-8dde-ffffa5516ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:05.785890 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2756/5581] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:05.791013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad611950-c087-4671-8dde-ffffa5516ed9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:05.806824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad611950-c087-4671-8dde-ffffa5516ed9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:05.813766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993f26e-28d0-42a0-a8a0-df4bb5abf034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:05.814671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993f26e-28d0-42a0-a8a0-df4bb5abf034 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:05.814882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993f26e-28d0-42a0-a8a0-df4bb5abf034 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:05.815741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993f26e-28d0-42a0-a8a0-df4bb5abf034 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:05.815896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993f26e-28d0-42a0-a8a0-df4bb5abf034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:05.816193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993f26e-28d0-42a0-a8a0-df4bb5abf034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:05.818198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993f26e-28d0-42a0-a8a0-df4bb5abf034 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:05.828885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9e2ee-08bb-4b94-8602-499e4efe0d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:05.829643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9e2ee-08bb-4b94-8602-499e4efe0d55 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:05.829873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9e2ee-08bb-4b94-8602-499e4efe0d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:05.830161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9e2ee-08bb-4b94-8602-499e4efe0d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:05.839504 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2757/5582] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:03:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:05.841204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993f26e-28d0-42a0-a8a0-df4bb5abf034 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:05.846014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9e2ee-08bb-4b94-8602-499e4efe0d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:05.848188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9e2ee-08bb-4b94-8602-499e4efe0d55 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:05.857483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993f26e-28d0-42a0-a8a0-df4bb5abf034 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:05.863897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68579812-6d11-4ee7-9126-f10ed7807e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:05.864210 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2826/5583] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:03:05.865345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68579812-6d11-4ee7-9126-f10ed7807e77 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:05.865668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68579812-6d11-4ee7-9126-f10ed7807e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:05.865938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68579812-6d11-4ee7-9126-f10ed7807e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:05.866853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68579812-6d11-4ee7-9126-f10ed7807e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:05.870771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68579812-6d11-4ee7-9126-f10ed7807e77 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:05.904745 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2758/5584] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:05 2021] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:05.909406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9e2ee-08bb-4b94-8602-499e4efe0d55 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:05.924984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9e2ee-08bb-4b94-8602-499e4efe0d55 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:06.003906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730e8e3-c6e0-4649-9e6e-260fc7e288cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:06.004726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730e8e3-c6e0-4649-9e6e-260fc7e288cf admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:06.005017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730e8e3-c6e0-4649-9e6e-260fc7e288cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:06.005298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730e8e3-c6e0-4649-9e6e-260fc7e288cf admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:06.006016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730e8e3-c6e0-4649-9e6e-260fc7e288cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:06.008086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730e8e3-c6e0-4649-9e6e-260fc7e288cf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:06.032062 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2827/5585] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:05 2021] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:06.036244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68579812-6d11-4ee7-9126-f10ed7807e77 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:06.048410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68579812-6d11-4ee7-9126-f10ed7807e77 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:06.054291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7d0ef-27de-4bfe-be82-97290e33f1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:06.055622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7d0ef-27de-4bfe-be82-97290e33f1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:06.055622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7d0ef-27de-4bfe-be82-97290e33f1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:06.055622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7d0ef-27de-4bfe-be82-97290e33f1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:06.056279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7d0ef-27de-4bfe-be82-97290e33f1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:06.058426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7d0ef-27de-4bfe-be82-97290e33f1a4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:06.073841 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2759/5586] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:06 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:03:06.075194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730e8e3-c6e0-4649-9e6e-260fc7e288cf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:06.093996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730e8e3-c6e0-4649-9e6e-260fc7e288cf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:06.099571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb9919-7126-4ed7-a8bd-37d7ddcdd708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:06.100418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb9919-7126-4ed7-a8bd-37d7ddcdd708 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:06.100645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb9919-7126-4ed7-a8bd-37d7ddcdd708 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:06.100939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb9919-7126-4ed7-a8bd-37d7ddcdd708 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:06.101749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb9919-7126-4ed7-a8bd-37d7ddcdd708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:06.103991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb9919-7126-4ed7-a8bd-37d7ddcdd708 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:06.115767 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2828/5587] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:06 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:06.122089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7d0ef-27de-4bfe-be82-97290e33f1a4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:06.134837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7d0ef-27de-4bfe-be82-97290e33f1a4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:06.141003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fa5ee-21e8-4856-99ba-f0cc981096f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:06.142074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fa5ee-21e8-4856-99ba-f0cc981096f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:06.142447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fa5ee-21e8-4856-99ba-f0cc981096f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:06.142824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fa5ee-21e8-4856-99ba-f0cc981096f9 admin admin] PATH_INFO: `/v3/projects/50ba8bfbb7404ca3af1621fb54b33317/users/716e310ad9334ee2b6dcbc95b30275b4/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:06.163343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fa5ee-21e8-4856-99ba-f0cc981096f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ba8bfbb7404ca3af1621fb54b33317, user_id=716e310ad9334ee2b6dcbc95b30275b4, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:06.167116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fa5ee-21e8-4856-99ba-f0cc981096f9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:06.183274 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2760/5588] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:06 2021] PUT /identity/v3/projects/50ba8bfbb7404ca3af1621fb54b33317/users/716e310ad9334ee2b6dcbc95b30275b4/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:06.193822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8468fe-5783-4a1f-8bf7-872bb5a60dca None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:06.194592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8468fe-5783-4a1f-8bf7-872bb5a60dca None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:06.194592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8468fe-5783-4a1f-8bf7-872bb5a60dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:06.225352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ef8468fe-5783-4a1f-8bf7-872bb5a60dca None None] MFA Rules not processed for user `716e310ad9334ee2b6dcbc95b30275b4`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:06.226557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ef8468fe-5783-4a1f-8bf7-872bb5a60dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:06.291335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fa5ee-21e8-4856-99ba-f0cc981096f9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:06.293306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d87fa5ee-21e8-4856-99ba-f0cc981096f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:06.318957 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2829/5589] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:06 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:06.333785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8468fe-5783-4a1f-8bf7-872bb5a60dca None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:06.335682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ef8468fe-5783-4a1f-8bf7-872bb5a60dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:06.455581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fa5ee-21e8-4856-99ba-f0cc981096f9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:06.463107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa723b1-17dd-4900-86f9-d7e402035829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:06.463990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa723b1-17dd-4900-86f9-d7e402035829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:06.464519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa723b1-17dd-4900-86f9-d7e402035829 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:06.464848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa723b1-17dd-4900-86f9-d7e402035829 admin admin] PATH_INFO: `/v3/projects/02953ea763ef4ddeb43c836d85986809` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:06.466214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa723b1-17dd-4900-86f9-d7e402035829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02953ea763ef4ddeb43c836d85986809)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:06.469310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa723b1-17dd-4900-86f9-d7e402035829 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:06.475777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8468fe-5783-4a1f-8bf7-872bb5a60dca None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:06.480934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d697b03-03d6-43b5-9342-219c4525719c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:06.482281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d697b03-03d6-43b5-9342-219c4525719c service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:06.482281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d697b03-03d6-43b5-9342-219c4525719c service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:06.482514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d697b03-03d6-43b5-9342-219c4525719c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:06.493320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d697b03-03d6-43b5-9342-219c4525719c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:06.495273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d697b03-03d6-43b5-9342-219c4525719c service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:06.513182 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2830/5590] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:06 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:03:06.572303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2aa723b1-17dd-4900-86f9-d7e402035829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02953ea763ef4ddeb43c836d85986809', 'request_id': 'req-2aa723b1-17dd-4900-86f9-d7e402035829'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:06.583690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2aa723b1-17dd-4900-86f9-d7e402035829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02953ea763ef4ddeb43c836d85986809', 'request_id': 'req-2aa723b1-17dd-4900-86f9-d7e402035829'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:06.598374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2aa723b1-17dd-4900-86f9-d7e402035829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02953ea763ef4ddeb43c836d85986809', 'request_id': 'req-2aa723b1-17dd-4900-86f9-d7e402035829'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:06.620927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2aa723b1-17dd-4900-86f9-d7e402035829 admin admin] The token cache is being invalidate because project 02953ea763ef4ddeb43c836d85986809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:06.621622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2aa723b1-17dd-4900-86f9-d7e402035829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:06.622214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2aa723b1-17dd-4900-86f9-d7e402035829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:06.626051 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2761/5591] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:06 2021] DELETE /identity/v3/projects/02953ea763ef4ddeb43c836d85986809 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:06.634281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87e3f2-f9a3-4420-95eb-b79e27503c4b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:06.634281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87e3f2-f9a3-4420-95eb-b79e27503c4b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:06.634281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87e3f2-f9a3-4420-95eb-b79e27503c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:06.644351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa723b1-17dd-4900-86f9-d7e402035829 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:06.646074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2aa723b1-17dd-4900-86f9-d7e402035829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:06.673315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fd87e3f2-f9a3-4420-95eb-b79e27503c4b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:06.675840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fd87e3f2-f9a3-4420-95eb-b79e27503c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:06.798631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa723b1-17dd-4900-86f9-d7e402035829 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:06.804862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052514b3-e557-4116-8835-62512360611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:06.806621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052514b3-e557-4116-8835-62512360611d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:06.806863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052514b3-e557-4116-8835-62512360611d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:06.807186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052514b3-e557-4116-8835-62512360611d admin admin] PATH_INFO: `/v3/projects/410c554ef4a44e01bb88006b3d72fb39` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:06.808592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052514b3-e557-4116-8835-62512360611d admin admin] RBAC: Authorizing `identity:delete_project(project_id=410c554ef4a44e01bb88006b3d72fb39)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:06.813541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052514b3-e557-4116-8835-62512360611d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:06.821925 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2831/5592] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:06.825212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0681d1-044d-4234-998b-9f2935a86856 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:06.825908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0681d1-044d-4234-998b-9f2935a86856 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:06.826590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0681d1-044d-4234-998b-9f2935a86856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:06.857315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1f0681d1-044d-4234-998b-9f2935a86856 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:06.859358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1f0681d1-044d-4234-998b-9f2935a86856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:06.876783 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2832/5593] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:06.878888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0681d1-044d-4234-998b-9f2935a86856 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:06.892246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0681d1-044d-4234-998b-9f2935a86856 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:06.896160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-052514b3-e557-4116-8835-62512360611d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410c554ef4a44e01bb88006b3d72fb39', 'request_id': 'req-052514b3-e557-4116-8835-62512360611d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:06.907182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-052514b3-e557-4116-8835-62512360611d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410c554ef4a44e01bb88006b3d72fb39', 'request_id': 'req-052514b3-e557-4116-8835-62512360611d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:06.915487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-052514b3-e557-4116-8835-62512360611d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410c554ef4a44e01bb88006b3d72fb39', 'request_id': 'req-052514b3-e557-4116-8835-62512360611d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:06.952259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-052514b3-e557-4116-8835-62512360611d admin admin] The token cache is being invalidate because project 410c554ef4a44e01bb88006b3d72fb39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:06.952562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-052514b3-e557-4116-8835-62512360611d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:06.953326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-052514b3-e557-4116-8835-62512360611d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:06.955775 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2762/5594] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:06 2021] DELETE /identity/v3/projects/410c554ef4a44e01bb88006b3d72fb39 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:06.959779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052514b3-e557-4116-8835-62512360611d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:06.963694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-052514b3-e557-4116-8835-62512360611d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:07.022550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399fe05-638e-4a94-b812-cceae3d37e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:07.023776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399fe05-638e-4a94-b812-cceae3d37e7d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:07.024519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399fe05-638e-4a94-b812-cceae3d37e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:07.025028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399fe05-638e-4a94-b812-cceae3d37e7d admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:07.026154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399fe05-638e-4a94-b812-cceae3d37e7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:07.026748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399fe05-638e-4a94-b812-cceae3d37e7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:07.028701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399fe05-638e-4a94-b812-cceae3d37e7d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:07.043124 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2833/5595] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:03:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:07.048946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399fe05-638e-4a94-b812-cceae3d37e7d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:07.051263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c399fe05-638e-4a94-b812-cceae3d37e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:07.065006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399fe05-638e-4a94-b812-cceae3d37e7d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:07.072741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc41080-5da2-48f9-9376-866cfba2cd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:07.073478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc41080-5da2-48f9-9376-866cfba2cd62 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:07.074242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc41080-5da2-48f9-9376-866cfba2cd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:07.074242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc41080-5da2-48f9-9376-866cfba2cd62 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:07.075225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc41080-5da2-48f9-9376-866cfba2cd62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:07.077134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc41080-5da2-48f9-9376-866cfba2cd62 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:07.106860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052514b3-e557-4116-8835-62512360611d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:07.109850 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2834/5596] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:07 2021] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:07.114156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc41080-5da2-48f9-9376-866cfba2cd62 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:07.122587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af84833-9fee-4801-ae57-562cd9900d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:07.124662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af84833-9fee-4801-ae57-562cd9900d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:07.125626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af84833-9fee-4801-ae57-562cd9900d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:07.126187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af84833-9fee-4801-ae57-562cd9900d3a admin admin] PATH_INFO: `/v3/users/5b1458b311704b299a0e2d21db57582a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:07.130371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af84833-9fee-4801-ae57-562cd9900d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1458b311704b299a0e2d21db57582a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:07.133182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af84833-9fee-4801-ae57-562cd9900d3a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:07.188107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc41080-5da2-48f9-9376-866cfba2cd62 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:07.195560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef8540-88e9-4280-8992-549b56465322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:07.197089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef8540-88e9-4280-8992-549b56465322 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:07.197737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef8540-88e9-4280-8992-549b56465322 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:07.198287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef8540-88e9-4280-8992-549b56465322 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:07.199457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef8540-88e9-4280-8992-549b56465322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:07.201755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef8540-88e9-4280-8992-549b56465322 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:07.232551 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2835/5597] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:07 2021] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:07.236711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef8540-88e9-4280-8992-549b56465322 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:07.249789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1af84833-9fee-4801-ae57-562cd9900d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1458b311704b299a0e2d21db57582a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:07.250441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef8540-88e9-4280-8992-549b56465322 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:07.256060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631a183-cfb4-4fa0-8ce5-fd6d1d24a15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:07.256734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631a183-cfb4-4fa0-8ce5-fd6d1d24a15b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:07.257026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631a183-cfb4-4fa0-8ce5-fd6d1d24a15b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:07.257308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631a183-cfb4-4fa0-8ce5-fd6d1d24a15b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:07.258132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631a183-cfb4-4fa0-8ce5-fd6d1d24a15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:07.261655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631a183-cfb4-4fa0-8ce5-fd6d1d24a15b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:07.263927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1af84833-9fee-4801-ae57-562cd9900d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1458b311704b299a0e2d21db57582a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:07.279009 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2836/5598] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:07 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:07.280101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631a183-cfb4-4fa0-8ce5-fd6d1d24a15b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:07.287526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1af84833-9fee-4801-ae57-562cd9900d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1458b311704b299a0e2d21db57582a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:07.289090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1af84833-9fee-4801-ae57-562cd9900d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1458b311704b299a0e2d21db57582a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:07.291661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631a183-cfb4-4fa0-8ce5-fd6d1d24a15b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:07.297284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcdb7e-246c-49a8-94b1-06eb73b5fcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:07.298036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcdb7e-246c-49a8-94b1-06eb73b5fcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:07.298368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcdb7e-246c-49a8-94b1-06eb73b5fcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:07.299390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcdb7e-246c-49a8-94b1-06eb73b5fcd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:07.300124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcdb7e-246c-49a8-94b1-06eb73b5fcd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:07.301855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcdb7e-246c-49a8-94b1-06eb73b5fcd3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:07.304977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1af84833-9fee-4801-ae57-562cd9900d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1458b311704b299a0e2d21db57582a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:07.322636 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2763/5599] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:06 2021] DELETE /identity/v3/users/5b1458b311704b299a0e2d21db57582a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:07.326800 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2837/5600] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:07 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:07.331318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af84833-9fee-4801-ae57-562cd9900d3a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:07.332807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1af84833-9fee-4801-ae57-562cd9900d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:07.417978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af84833-9fee-4801-ae57-562cd9900d3a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:07.424852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ed46c-fe59-4197-ab6d-8f33046e0d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:07.426100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ed46c-fe59-4197-ab6d-8f33046e0d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:07.426547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ed46c-fe59-4197-ab6d-8f33046e0d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:07.427116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ed46c-fe59-4197-ab6d-8f33046e0d27 admin admin] PATH_INFO: `/v3/projects/37f8d3a76a7b40ccbd92ec26deed6ab5/users/4e51d207098e4793a27ce37c1d7a0d70/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:07.448624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ed46c-fe59-4197-ab6d-8f33046e0d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f8d3a76a7b40ccbd92ec26deed6ab5, user_id=4e51d207098e4793a27ce37c1d7a0d70, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:07.452078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ed46c-fe59-4197-ab6d-8f33046e0d27 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:07.473934 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2764/5601] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:07 2021] PUT /identity/v3/projects/37f8d3a76a7b40ccbd92ec26deed6ab5/users/4e51d207098e4793a27ce37c1d7a0d70/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:07.485355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa95554-b4b7-48e5-9e8e-aaf2fec3999e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:07.485521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa95554-b4b7-48e5-9e8e-aaf2fec3999e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:07.485815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa95554-b4b7-48e5-9e8e-aaf2fec3999e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:07.517480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ffa95554-b4b7-48e5-9e8e-aaf2fec3999e None None] MFA Rules not processed for user `4e51d207098e4793a27ce37c1d7a0d70`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:07.519231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ffa95554-b4b7-48e5-9e8e-aaf2fec3999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:07.621560 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2838/5602] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:07 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:07.645394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ed46c-fe59-4197-ab6d-8f33046e0d27 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:07.648582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cc7ed46c-fe59-4197-ab6d-8f33046e0d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:07.766369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ed46c-fe59-4197-ab6d-8f33046e0d27 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:07.773288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5091230-9468-4b7f-8b77-e6d54236f348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:07.774943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5091230-9468-4b7f-8b77-e6d54236f348 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:07.775696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5091230-9468-4b7f-8b77-e6d54236f348 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:07.776159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5091230-9468-4b7f-8b77-e6d54236f348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:07.792376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5091230-9468-4b7f-8b77-e6d54236f348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:07.793935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5091230-9468-4b7f-8b77-e6d54236f348 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:07.810742 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2765/5603] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:07 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:08.105168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa95554-b4b7-48e5-9e8e-aaf2fec3999e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:08.108933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ffa95554-b4b7-48e5-9e8e-aaf2fec3999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:08.202228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa95554-b4b7-48e5-9e8e-aaf2fec3999e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:08.213229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c587e4e-32a4-48c1-b2a0-3063d57acaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:08.216157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c587e4e-32a4-48c1-b2a0-3063d57acaa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:08.216485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c587e4e-32a4-48c1-b2a0-3063d57acaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:08.216798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c587e4e-32a4-48c1-b2a0-3063d57acaa0 admin admin] PATH_INFO: `/v3/projects/7e0aa312fa154029be4312fcefa39273` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:08.219208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c587e4e-32a4-48c1-b2a0-3063d57acaa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0aa312fa154029be4312fcefa39273)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:08.233413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c587e4e-32a4-48c1-b2a0-3063d57acaa0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:08.317752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0c587e4e-32a4-48c1-b2a0-3063d57acaa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0aa312fa154029be4312fcefa39273', 'request_id': 'req-0c587e4e-32a4-48c1-b2a0-3063d57acaa0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:08.347224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0c587e4e-32a4-48c1-b2a0-3063d57acaa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0aa312fa154029be4312fcefa39273', 'request_id': 'req-0c587e4e-32a4-48c1-b2a0-3063d57acaa0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:08.370291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0c587e4e-32a4-48c1-b2a0-3063d57acaa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0aa312fa154029be4312fcefa39273', 'request_id': 'req-0c587e4e-32a4-48c1-b2a0-3063d57acaa0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:08.390206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0c587e4e-32a4-48c1-b2a0-3063d57acaa0 admin admin] The token cache is being invalidate because project 7e0aa312fa154029be4312fcefa39273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:08.390591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0c587e4e-32a4-48c1-b2a0-3063d57acaa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:08.392280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0c587e4e-32a4-48c1-b2a0-3063d57acaa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:08.399366 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2839/5604] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:08 2021] DELETE /identity/v3/projects/7e0aa312fa154029be4312fcefa39273 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:08.402086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aa271-38d6-48a2-af63-fbfd91e3e6ea None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:08.402671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aa271-38d6-48a2-af63-fbfd91e3e6ea None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:08.408115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aa271-38d6-48a2-af63-fbfd91e3e6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:08.468151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0d3aa271-38d6-48a2-af63-fbfd91e3e6ea None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:08.472315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0d3aa271-38d6-48a2-af63-fbfd91e3e6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:08.590434 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2766/5605] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:08.592278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da9589-52db-47fa-b7f9-d89445aee88c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:08.592618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da9589-52db-47fa-b7f9-d89445aee88c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:08.592905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da9589-52db-47fa-b7f9-d89445aee88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:08.617359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-27da9589-52db-47fa-b7f9-d89445aee88c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:08.619464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-27da9589-52db-47fa-b7f9-d89445aee88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:08.629432 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2840/5606] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:08.633804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3aa271-38d6-48a2-af63-fbfd91e3e6ea None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:08.663362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3aa271-38d6-48a2-af63-fbfd91e3e6ea None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:08.679604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0264eb-318d-4752-b1b3-b5173161661d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:08.681132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0264eb-318d-4752-b1b3-b5173161661d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:08.686672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0264eb-318d-4752-b1b3-b5173161661d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:08.686672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0264eb-318d-4752-b1b3-b5173161661d admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:08.686672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0264eb-318d-4752-b1b3-b5173161661d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:08.686672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0264eb-318d-4752-b1b3-b5173161661d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:08.695592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0264eb-318d-4752-b1b3-b5173161661d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:08.757338 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2767/5607] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:03:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:08.762231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da9589-52db-47fa-b7f9-d89445aee88c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:08.783515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da9589-52db-47fa-b7f9-d89445aee88c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:08.792939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc8502-3bb3-4926-9f54-0c4cb538dd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:08.794006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc8502-3bb3-4926-9f54-0c4cb538dd80 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:08.794601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc8502-3bb3-4926-9f54-0c4cb538dd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:08.795393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc8502-3bb3-4926-9f54-0c4cb538dd80 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:08.796313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc8502-3bb3-4926-9f54-0c4cb538dd80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:08.798542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc8502-3bb3-4926-9f54-0c4cb538dd80 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:08.846076 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2841/5608] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:08 2021] POST /identity/v3/projects => generated 369 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:03:08.851252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0264eb-318d-4752-b1b3-b5173161661d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:08.865120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0264eb-318d-4752-b1b3-b5173161661d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:08.951085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853ee3a-9aa1-4755-a728-6d978a2e87d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:08.956845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853ee3a-9aa1-4755-a728-6d978a2e87d1 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:08.956845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853ee3a-9aa1-4755-a728-6d978a2e87d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:08.956845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853ee3a-9aa1-4755-a728-6d978a2e87d1 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:08.956845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853ee3a-9aa1-4755-a728-6d978a2e87d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:08.958018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853ee3a-9aa1-4755-a728-6d978a2e87d1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:08.987099 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2768/5609] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:08 2021] POST /identity/v3/users => generated 285 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:08.990931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc8502-3bb3-4926-9f54-0c4cb538dd80 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:09.004434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc8502-3bb3-4926-9f54-0c4cb538dd80 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:09.010493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f01c4-4878-45b0-bedf-8eb722855120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:09.011554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f01c4-4878-45b0-bedf-8eb722855120 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:09.012013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f01c4-4878-45b0-bedf-8eb722855120 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:09.013039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f01c4-4878-45b0-bedf-8eb722855120 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:09.014043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f01c4-4878-45b0-bedf-8eb722855120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:09.016056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f01c4-4878-45b0-bedf-8eb722855120 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:09.033717 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2842/5610] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:08 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:03:09.035583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853ee3a-9aa1-4755-a728-6d978a2e87d1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:09.047875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853ee3a-9aa1-4755-a728-6d978a2e87d1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:09.053941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fe501-d225-40bd-a7fe-c401b0496342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:09.054785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe501-d225-40bd-a7fe-c401b0496342 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:09.055018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe501-d225-40bd-a7fe-c401b0496342 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:09.055443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe501-d225-40bd-a7fe-c401b0496342 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:09.056337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fe501-d225-40bd-a7fe-c401b0496342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:09.058101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fe501-d225-40bd-a7fe-c401b0496342 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:09.073926 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2769/5611] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:09 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:09.078727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f01c4-4878-45b0-bedf-8eb722855120 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:09.093703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f01c4-4878-45b0-bedf-8eb722855120 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:09.104026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c6fee-2a3a-43b5-b03a-45daa650113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:09.105270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c6fee-2a3a-43b5-b03a-45daa650113d admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:09.105767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c6fee-2a3a-43b5-b03a-45daa650113d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:09.106208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c6fee-2a3a-43b5-b03a-45daa650113d admin admin] PATH_INFO: `/v3/projects/596a7d17333e49c2834eeb597ee1b133/users/e9519d054879489f92c528e9a0c6ba78/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:09.133908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c6fee-2a3a-43b5-b03a-45daa650113d admin admin] RBAC: Authorizing `identity:create_grant(project_id=596a7d17333e49c2834eeb597ee1b133, user_id=e9519d054879489f92c528e9a0c6ba78, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:09.141824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c6fee-2a3a-43b5-b03a-45daa650113d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:09.180224 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2843/5612] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:09 2021] PUT /identity/v3/projects/596a7d17333e49c2834eeb597ee1b133/users/e9519d054879489f92c528e9a0c6ba78/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:09.180449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdda21-69a0-432b-a930-f7086a7a0f3c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:09.180657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdda21-69a0-432b-a930-f7086a7a0f3c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:09.180981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdda21-69a0-432b-a930-f7086a7a0f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:09.221720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-05cdda21-69a0-432b-a930-f7086a7a0f3c None None] MFA Rules not processed for user `e9519d054879489f92c528e9a0c6ba78`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:09.223163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-05cdda21-69a0-432b-a930-f7086a7a0f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:09.341715 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2770/5613] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:09 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:09.346582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c6fee-2a3a-43b5-b03a-45daa650113d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:09.449966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c6fee-2a3a-43b5-b03a-45daa650113d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:09.455546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19c50e-5ac3-4ed9-8991-ddb1275cacbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:09.456575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19c50e-5ac3-4ed9-8991-ddb1275cacbb admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:09.456868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19c50e-5ac3-4ed9-8991-ddb1275cacbb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:09.457619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19c50e-5ac3-4ed9-8991-ddb1275cacbb admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:09.459074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19c50e-5ac3-4ed9-8991-ddb1275cacbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:09.461030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19c50e-5ac3-4ed9-8991-ddb1275cacbb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:09.503996 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2844/5614] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:09 2021] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:09.504688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdda21-69a0-432b-a930-f7086a7a0f3c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:09.525724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdda21-69a0-432b-a930-f7086a7a0f3c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:09.728381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372cd37-b053-477d-a36f-a5d4f4ab5251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:09.729407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372cd37-b053-477d-a36f-a5d4f4ab5251 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:09.729924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372cd37-b053-477d-a36f-a5d4f4ab5251 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:09.730511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372cd37-b053-477d-a36f-a5d4f4ab5251 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:09.731529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372cd37-b053-477d-a36f-a5d4f4ab5251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:09.742150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372cd37-b053-477d-a36f-a5d4f4ab5251 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:09.833328 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2771/5615] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:09 2021] POST /identity/v3/users => generated 291 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:03:09.837934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19c50e-5ac3-4ed9-8991-ddb1275cacbb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:09.873874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19c50e-5ac3-4ed9-8991-ddb1275cacbb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:09.885180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb6788-e221-4f7f-9dcb-229d6366ab0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:09.886428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb6788-e221-4f7f-9dcb-229d6366ab0d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:09.886997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb6788-e221-4f7f-9dcb-229d6366ab0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:09.889757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb6788-e221-4f7f-9dcb-229d6366ab0d admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:09.892703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb6788-e221-4f7f-9dcb-229d6366ab0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:09.901421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb6788-e221-4f7f-9dcb-229d6366ab0d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:09.926546 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2845/5616] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:09 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:09.931282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372cd37-b053-477d-a36f-a5d4f4ab5251 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:09.949359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372cd37-b053-477d-a36f-a5d4f4ab5251 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:09.964210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32808a-91b9-4ba6-ba17-dbd63493dd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:09.968345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32808a-91b9-4ba6-ba17-dbd63493dd78 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:09.968851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32808a-91b9-4ba6-ba17-dbd63493dd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:09.969420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32808a-91b9-4ba6-ba17-dbd63493dd78 admin admin] PATH_INFO: `/v3/projects/41eff4297535439c8535db7efb1869ce/users/1747777337b6402c82ef10a824883ce2/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:10.003135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32808a-91b9-4ba6-ba17-dbd63493dd78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41eff4297535439c8535db7efb1869ce, user_id=1747777337b6402c82ef10a824883ce2, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:10.005872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32808a-91b9-4ba6-ba17-dbd63493dd78 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:10.039612 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2772/5617] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:09 2021] PUT /identity/v3/projects/41eff4297535439c8535db7efb1869ce/users/1747777337b6402c82ef10a824883ce2/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:10.043843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb6788-e221-4f7f-9dcb-229d6366ab0d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:10.060841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb6788-e221-4f7f-9dcb-229d6366ab0d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:10.225353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11000ba6-4453-483c-8a83-feb8e66ee5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:10.226419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11000ba6-4453-483c-8a83-feb8e66ee5cf admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:10.226530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11000ba6-4453-483c-8a83-feb8e66ee5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:10.226891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11000ba6-4453-483c-8a83-feb8e66ee5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:10.228432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11000ba6-4453-483c-8a83-feb8e66ee5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:10.231361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11000ba6-4453-483c-8a83-feb8e66ee5cf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:10.246165 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2846/5618] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:10 2021] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:10.254449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32808a-91b9-4ba6-ba17-dbd63493dd78 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:10.267080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32808a-91b9-4ba6-ba17-dbd63493dd78 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:10.273628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71034bf8-9bed-41c6-bb23-13c0ac6164c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:10.274929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71034bf8-9bed-41c6-bb23-13c0ac6164c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:10.275213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71034bf8-9bed-41c6-bb23-13c0ac6164c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:10.275494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71034bf8-9bed-41c6-bb23-13c0ac6164c9 admin admin] PATH_INFO: `/v3/projects/41eff4297535439c8535db7efb1869ce/users/1747777337b6402c82ef10a824883ce2/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:10.285077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71034bf8-9bed-41c6-bb23-13c0ac6164c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41eff4297535439c8535db7efb1869ce, user_id=1747777337b6402c82ef10a824883ce2, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:10.292278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71034bf8-9bed-41c6-bb23-13c0ac6164c9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:10.346532 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2773/5619] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:10 2021] PUT /identity/v3/projects/41eff4297535439c8535db7efb1869ce/users/1747777337b6402c82ef10a824883ce2/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:10.347301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241fb16-1d4a-4671-9d8b-42e1c0cd8017 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:10.347780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241fb16-1d4a-4671-9d8b-42e1c0cd8017 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:10.348061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241fb16-1d4a-4671-9d8b-42e1c0cd8017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:10.412815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3241fb16-1d4a-4671-9d8b-42e1c0cd8017 None None] MFA Rules not processed for user `1747777337b6402c82ef10a824883ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:10.415030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3241fb16-1d4a-4671-9d8b-42e1c0cd8017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:10.578956 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2847/5620] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:10 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:03:10.595258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71034bf8-9bed-41c6-bb23-13c0ac6164c9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:10.598034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-71034bf8-9bed-41c6-bb23-13c0ac6164c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:10.718484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71034bf8-9bed-41c6-bb23-13c0ac6164c9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:10.734762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17b22e-9e9b-4f3c-b1d8-74a59e133af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:10.735435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17b22e-9e9b-4f3c-b1d8-74a59e133af6 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:10.735901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17b22e-9e9b-4f3c-b1d8-74a59e133af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:10.736366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17b22e-9e9b-4f3c-b1d8-74a59e133af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:10.755714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17b22e-9e9b-4f3c-b1d8-74a59e133af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:10.759545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17b22e-9e9b-4f3c-b1d8-74a59e133af6 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:10.783526 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2774/5621] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:10 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:13.821990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241fb16-1d4a-4671-9d8b-42e1c0cd8017 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:13.827787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3241fb16-1d4a-4671-9d8b-42e1c0cd8017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:14.049120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241fb16-1d4a-4671-9d8b-42e1c0cd8017 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:14.064405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46261602-b6cf-474f-8e71-38285219f928 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:14.067655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46261602-b6cf-474f-8e71-38285219f928 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:14.070914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46261602-b6cf-474f-8e71-38285219f928 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:14.071431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46261602-b6cf-474f-8e71-38285219f928 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:14.075006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-46261602-b6cf-474f-8e71-38285219f928 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:14.115807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46261602-b6cf-474f-8e71-38285219f928 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:14.128305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46261602-b6cf-474f-8e71-38285219f928 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:14.166454 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2848/5622] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:13 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:14.193883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17b22e-9e9b-4f3c-b1d8-74a59e133af6 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:14.329147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17b22e-9e9b-4f3c-b1d8-74a59e133af6 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:14.337830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9eabbe-172c-40fd-882f-04047dd2aad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:14.339146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9eabbe-172c-40fd-882f-04047dd2aad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:14.339649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9eabbe-172c-40fd-882f-04047dd2aad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:14.340135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9eabbe-172c-40fd-882f-04047dd2aad9 admin admin] PATH_INFO: `/v3/users/e9519d054879489f92c528e9a0c6ba78` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:14.341619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9eabbe-172c-40fd-882f-04047dd2aad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9519d054879489f92c528e9a0c6ba78)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:14.343830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9eabbe-172c-40fd-882f-04047dd2aad9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:14.450950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bd9eabbe-172c-40fd-882f-04047dd2aad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9519d054879489f92c528e9a0c6ba78'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:14.472316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bd9eabbe-172c-40fd-882f-04047dd2aad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9519d054879489f92c528e9a0c6ba78'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:14.491115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bd9eabbe-172c-40fd-882f-04047dd2aad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9519d054879489f92c528e9a0c6ba78'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:14.492257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bd9eabbe-172c-40fd-882f-04047dd2aad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9519d054879489f92c528e9a0c6ba78'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:14.510203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bd9eabbe-172c-40fd-882f-04047dd2aad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9519d054879489f92c528e9a0c6ba78'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:14.523930 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2775/5623] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:14 2021] DELETE /identity/v3/users/e9519d054879489f92c528e9a0c6ba78 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:14.529749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9f088-f391-458d-8e27-070d59bcd99a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:14.530338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9f088-f391-458d-8e27-070d59bcd99a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:14.531340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9f088-f391-458d-8e27-070d59bcd99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:14.600163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-05c9f088-f391-458d-8e27-070d59bcd99a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:14.601447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-05c9f088-f391-458d-8e27-070d59bcd99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:14.718942 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2849/5624] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:14.780212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9eabbe-172c-40fd-882f-04047dd2aad9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:14.782859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bd9eabbe-172c-40fd-882f-04047dd2aad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:14.869205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9eabbe-172c-40fd-882f-04047dd2aad9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:14.875871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95bda1-f99d-4d4a-98f9-172fef91622e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:14.876886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95bda1-f99d-4d4a-98f9-172fef91622e service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:14.877593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95bda1-f99d-4d4a-98f9-172fef91622e service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:14.878107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95bda1-f99d-4d4a-98f9-172fef91622e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:14.891873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95bda1-f99d-4d4a-98f9-172fef91622e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:14.895112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95bda1-f99d-4d4a-98f9-172fef91622e service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:14.909747 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2776/5625] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:16.654649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9f088-f391-458d-8e27-070d59bcd99a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:16.656251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-05c9f088-f391-458d-8e27-070d59bcd99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:16.694934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9f088-f391-458d-8e27-070d59bcd99a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:16.715369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:16.716938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:16.717792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:16.718913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211 admin admin] PATH_INFO: `/v3/projects/596a7d17333e49c2834eeb597ee1b133` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:16.722402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=596a7d17333e49c2834eeb597ee1b133)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:16.729070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:16.873561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '596a7d17333e49c2834eeb597ee1b133', 'request_id': 'req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:16.896572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '596a7d17333e49c2834eeb597ee1b133', 'request_id': 'req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:16.916308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '596a7d17333e49c2834eeb597ee1b133', 'request_id': 'req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:16.941891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211 admin admin] The token cache is being invalidate because project 596a7d17333e49c2834eeb597ee1b133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:16.942314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:16.943222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:16.948388 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2850/5626] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:16 2021] DELETE /identity/v3/projects/596a7d17333e49c2834eeb597ee1b133 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:16.952713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95bda1-f99d-4d4a-98f9-172fef91622e service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:16.989101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95bda1-f99d-4d4a-98f9-172fef91622e service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:17.180502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ba405-16cd-4c8c-8b59-0bf23250d2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:17.181400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ba405-16cd-4c8c-8b59-0bf23250d2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:17.181869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ba405-16cd-4c8c-8b59-0bf23250d2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:17.182483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ba405-16cd-4c8c-8b59-0bf23250d2ef admin admin] PATH_INFO: `/v3/users/1747777337b6402c82ef10a824883ce2` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:17.185885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ba405-16cd-4c8c-8b59-0bf23250d2ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1747777337b6402c82ef10a824883ce2)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:17.188141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ba405-16cd-4c8c-8b59-0bf23250d2ef admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:17.326757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4a7ba405-16cd-4c8c-8b59-0bf23250d2ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1747777337b6402c82ef10a824883ce2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:17.364527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4a7ba405-16cd-4c8c-8b59-0bf23250d2ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1747777337b6402c82ef10a824883ce2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:17.413295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4a7ba405-16cd-4c8c-8b59-0bf23250d2ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1747777337b6402c82ef10a824883ce2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:17.415078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4a7ba405-16cd-4c8c-8b59-0bf23250d2ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1747777337b6402c82ef10a824883ce2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:17.444953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4a7ba405-16cd-4c8c-8b59-0bf23250d2ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1747777337b6402c82ef10a824883ce2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:17.462311 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2777/5627] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:16 2021] DELETE /identity/v3/users/1747777337b6402c82ef10a824883ce2 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:17.688450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:17.691125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:17.716453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17cd4d-b6be-49a1-9dbb-61bdeeacd211 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:17.830503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1f6af-848f-4ef1-ad68-0cc13f301de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:17.832746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1f6af-848f-4ef1-ad68-0cc13f301de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:17.833576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1f6af-848f-4ef1-ad68-0cc13f301de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:17.834218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1f6af-848f-4ef1-ad68-0cc13f301de4 admin admin] PATH_INFO: `/v3/users/015cce270f514b67a30f46bf31195933` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:17.836169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1f6af-848f-4ef1-ad68-0cc13f301de4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=015cce270f514b67a30f46bf31195933)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:17.840411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1f6af-848f-4ef1-ad68-0cc13f301de4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:17.912347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-95d1f6af-848f-4ef1-ad68-0cc13f301de4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '015cce270f514b67a30f46bf31195933'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:17.920857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-95d1f6af-848f-4ef1-ad68-0cc13f301de4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '015cce270f514b67a30f46bf31195933'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:17.921948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-95d1f6af-848f-4ef1-ad68-0cc13f301de4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '015cce270f514b67a30f46bf31195933'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:17.944068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-95d1f6af-848f-4ef1-ad68-0cc13f301de4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '015cce270f514b67a30f46bf31195933'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:17.959241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-95d1f6af-848f-4ef1-ad68-0cc13f301de4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '015cce270f514b67a30f46bf31195933'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:17.984694 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2851/5628] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:17 2021] DELETE /identity/v3/users/015cce270f514b67a30f46bf31195933 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:18.418061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ba405-16cd-4c8c-8b59-0bf23250d2ef admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:18.421295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1f6af-848f-4ef1-ad68-0cc13f301de4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:18.422897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-95d1f6af-848f-4ef1-ad68-0cc13f301de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:18.427442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4a7ba405-16cd-4c8c-8b59-0bf23250d2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:18.462201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ba405-16cd-4c8c-8b59-0bf23250d2ef admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:18.540647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1f6af-848f-4ef1-ad68-0cc13f301de4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:18.550924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1351-c21c-4a59-adc9-a68a79af0a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:18.552187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1351-c21c-4a59-adc9-a68a79af0a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:18.552677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1351-c21c-4a59-adc9-a68a79af0a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:18.552957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1351-c21c-4a59-adc9-a68a79af0a66 admin admin] PATH_INFO: `/v3/projects/41eff4297535439c8535db7efb1869ce` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:18.555103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e1351-c21c-4a59-adc9-a68a79af0a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41eff4297535439c8535db7efb1869ce)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:18.563053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e1351-c21c-4a59-adc9-a68a79af0a66 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:18.606946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c347b7-c401-4b6b-b806-092a916984ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:18.607835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c347b7-c401-4b6b-b806-092a916984ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:18.608120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c347b7-c401-4b6b-b806-092a916984ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:18.608396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c347b7-c401-4b6b-b806-092a916984ad admin admin] PATH_INFO: `/v3/users/4e51d207098e4793a27ce37c1d7a0d70` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:18.609963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c347b7-c401-4b6b-b806-092a916984ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e51d207098e4793a27ce37c1d7a0d70)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:18.611919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c347b7-c401-4b6b-b806-092a916984ad admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:18.655425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ff4e1351-c21c-4a59-adc9-a68a79af0a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41eff4297535439c8535db7efb1869ce', 'request_id': 'req-ff4e1351-c21c-4a59-adc9-a68a79af0a66'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:18.663340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ff4e1351-c21c-4a59-adc9-a68a79af0a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41eff4297535439c8535db7efb1869ce', 'request_id': 'req-ff4e1351-c21c-4a59-adc9-a68a79af0a66'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:18.680705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ff4e1351-c21c-4a59-adc9-a68a79af0a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41eff4297535439c8535db7efb1869ce', 'request_id': 'req-ff4e1351-c21c-4a59-adc9-a68a79af0a66'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:18.694013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ff4e1351-c21c-4a59-adc9-a68a79af0a66 admin admin] The token cache is being invalidate because project 41eff4297535439c8535db7efb1869ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:18.695132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ff4e1351-c21c-4a59-adc9-a68a79af0a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:18.696544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ff4e1351-c21c-4a59-adc9-a68a79af0a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:18.701281 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2852/5629] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:18 2021] DELETE /identity/v3/projects/41eff4297535439c8535db7efb1869ce => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:18.702621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d8c347b7-c401-4b6b-b806-092a916984ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e51d207098e4793a27ce37c1d7a0d70'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:18.703542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1351-c21c-4a59-adc9-a68a79af0a66 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:18.706692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ff4e1351-c21c-4a59-adc9-a68a79af0a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:18.718388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d8c347b7-c401-4b6b-b806-092a916984ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e51d207098e4793a27ce37c1d7a0d70'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:18.748431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d8c347b7-c401-4b6b-b806-092a916984ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e51d207098e4793a27ce37c1d7a0d70'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:18.759409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d8c347b7-c401-4b6b-b806-092a916984ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e51d207098e4793a27ce37c1d7a0d70'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:18.781304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d8c347b7-c401-4b6b-b806-092a916984ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e51d207098e4793a27ce37c1d7a0d70'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:18.789915 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2778/5630] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:18 2021] DELETE /identity/v3/users/4e51d207098e4793a27ce37c1d7a0d70 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:18.791600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2ff5a-6434-4c9f-9d14-3db6a4af85e6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:18.792146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2ff5a-6434-4c9f-9d14-3db6a4af85e6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:18.792854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2ff5a-6434-4c9f-9d14-3db6a4af85e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:18.812875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1351-c21c-4a59-adc9-a68a79af0a66 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:18.818199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1ce2ff5a-6434-4c9f-9d14-3db6a4af85e6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:18.819890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1ce2ff5a-6434-4c9f-9d14-3db6a4af85e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:18.879929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7bf2c-a782-42e8-801d-843c0143a731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:18.880860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7bf2c-a782-42e8-801d-843c0143a731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:18.881492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7bf2c-a782-42e8-801d-843c0143a731 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:18.881618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7bf2c-a782-42e8-801d-843c0143a731 admin admin] PATH_INFO: `/v3/projects/f161cef6f2864c7e8c2d183d1a22107e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:18.885226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7bf2c-a782-42e8-801d-843c0143a731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f161cef6f2864c7e8c2d183d1a22107e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:18.887551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7bf2c-a782-42e8-801d-843c0143a731 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:18.906219 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2779/5631] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:18.908373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d50c3-0950-4bca-b221-0e80b1877d63 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:18.908678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d50c3-0950-4bca-b221-0e80b1877d63 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:18.908965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d50c3-0950-4bca-b221-0e80b1877d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:18.949518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e22d50c3-0950-4bca-b221-0e80b1877d63 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:18.951946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e22d50c3-0950-4bca-b221-0e80b1877d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:18.974081 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2780/5632] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:18.977055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97acac-8b7c-4208-b176-300cf6eae99d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:18.977596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97acac-8b7c-4208-b176-300cf6eae99d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:18.978099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97acac-8b7c-4208-b176-300cf6eae99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:19.001068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2bd7bf2c-a782-42e8-801d-843c0143a731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f161cef6f2864c7e8c2d183d1a22107e', 'request_id': 'req-2bd7bf2c-a782-42e8-801d-843c0143a731'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:19.002286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-bd97acac-8b7c-4208-b176-300cf6eae99d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:19.010425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2bd7bf2c-a782-42e8-801d-843c0143a731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f161cef6f2864c7e8c2d183d1a22107e', 'request_id': 'req-2bd7bf2c-a782-42e8-801d-843c0143a731'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:19.015374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bd97acac-8b7c-4208-b176-300cf6eae99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:19.024781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2bd7bf2c-a782-42e8-801d-843c0143a731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f161cef6f2864c7e8c2d183d1a22107e', 'request_id': 'req-2bd7bf2c-a782-42e8-801d-843c0143a731'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:19.043239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2bd7bf2c-a782-42e8-801d-843c0143a731 admin admin] The token cache is being invalidate because project f161cef6f2864c7e8c2d183d1a22107e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:19.044162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2bd7bf2c-a782-42e8-801d-843c0143a731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:19.044950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2bd7bf2c-a782-42e8-801d-843c0143a731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:19.047056 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2853/5633] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:18 2021] DELETE /identity/v3/projects/f161cef6f2864c7e8c2d183d1a22107e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:19.048291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7bf2c-a782-42e8-801d-843c0143a731 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:19.050399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2bd7bf2c-a782-42e8-801d-843c0143a731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:19.127136 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2781/5634] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:19.129338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a51ccd-9727-4a6c-8fe0-82980a4aebed None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:19.129872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a51ccd-9727-4a6c-8fe0-82980a4aebed None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:19.130324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a51ccd-9727-4a6c-8fe0-82980a4aebed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:19.162982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c8a51ccd-9727-4a6c-8fe0-82980a4aebed None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:19.164931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7bf2c-a782-42e8-801d-843c0143a731 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:19.165462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c8a51ccd-9727-4a6c-8fe0-82980a4aebed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:19.172414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b4b54-48f4-4e20-a28c-1cce8d7db14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:19.173312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b4b54-48f4-4e20-a28c-1cce8d7db14b service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:19.173953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b4b54-48f4-4e20-a28c-1cce8d7db14b service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:19.174452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b4b54-48f4-4e20-a28c-1cce8d7db14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:19.179404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-295b4b54-48f4-4e20-a28c-1cce8d7db14b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:19.180734 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2782/5635] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:19.182128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a51ccd-9727-4a6c-8fe0-82980a4aebed None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:19.197022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a51ccd-9727-4a6c-8fe0-82980a4aebed None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:19.202582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da737cde-3c0d-4a9b-9726-55a6e75bd274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:19.203254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da737cde-3c0d-4a9b-9726-55a6e75bd274 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:19.203537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da737cde-3c0d-4a9b-9726-55a6e75bd274 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:19.203998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da737cde-3c0d-4a9b-9726-55a6e75bd274 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:19.204740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da737cde-3c0d-4a9b-9726-55a6e75bd274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:19.205090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da737cde-3c0d-4a9b-9726-55a6e75bd274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:19.206757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da737cde-3c0d-4a9b-9726-55a6e75bd274 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:19.209938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b4b54-48f4-4e20-a28c-1cce8d7db14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:19.211566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b4b54-48f4-4e20-a28c-1cce8d7db14b service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:19.233686 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2854/5636] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:19.236289 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2783/5637] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:03:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:19.241290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da737cde-3c0d-4a9b-9726-55a6e75bd274 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:19.245097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eebdc7-5f12-40ba-964b-d4597aea0800 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:19.245937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eebdc7-5f12-40ba-964b-d4597aea0800 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:19.246240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eebdc7-5f12-40ba-964b-d4597aea0800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:19.257487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da737cde-3c0d-4a9b-9726-55a6e75bd274 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:19.263785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43028e00-a3e5-4ee9-ac63-3f16ca3ddf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:19.264745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43028e00-a3e5-4ee9-ac63-3f16ca3ddf7d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:19.265239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43028e00-a3e5-4ee9-ac63-3f16ca3ddf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:19.265822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43028e00-a3e5-4ee9-ac63-3f16ca3ddf7d admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:19.266813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43028e00-a3e5-4ee9-ac63-3f16ca3ddf7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:19.269148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43028e00-a3e5-4ee9-ac63-3f16ca3ddf7d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:19.279390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c5eebdc7-5f12-40ba-964b-d4597aea0800 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:19.280623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c5eebdc7-5f12-40ba-964b-d4597aea0800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:19.307147 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2855/5638] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:19.316020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eebdc7-5f12-40ba-964b-d4597aea0800 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:19.326479 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2784/5639] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:19 2021] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:19.327402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43028e00-a3e5-4ee9-ac63-3f16ca3ddf7d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:19.342732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eebdc7-5f12-40ba-964b-d4597aea0800 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:19.469945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43028e00-a3e5-4ee9-ac63-3f16ca3ddf7d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:19.489576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843ad3c-4018-4745-bf30-ca5fa5f45b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:19.489870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55ad17-8bc0-4549-8a11-b276f8e31c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:19.490683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55ad17-8bc0-4549-8a11-b276f8e31c15 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:19.490850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55ad17-8bc0-4549-8a11-b276f8e31c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:19.491178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55ad17-8bc0-4549-8a11-b276f8e31c15 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:19.492325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55ad17-8bc0-4549-8a11-b276f8e31c15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:19.492642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55ad17-8bc0-4549-8a11-b276f8e31c15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:19.493158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843ad3c-4018-4745-bf30-ca5fa5f45b97 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:19.494827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55ad17-8bc0-4549-8a11-b276f8e31c15 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:19.497616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843ad3c-4018-4745-bf30-ca5fa5f45b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:19.498062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843ad3c-4018-4745-bf30-ca5fa5f45b97 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:19.499873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843ad3c-4018-4745-bf30-ca5fa5f45b97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:19.501942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843ad3c-4018-4745-bf30-ca5fa5f45b97 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:19.517924 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2856/5640] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:03:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:19.522417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55ad17-8bc0-4549-8a11-b276f8e31c15 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:19.537990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55ad17-8bc0-4549-8a11-b276f8e31c15 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:19.550903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac40a82-78b1-4fe1-bf0f-c07672eeb786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:19.552254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac40a82-78b1-4fe1-bf0f-c07672eeb786 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:19.555467 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2785/5641] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:19 2021] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:19.555615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac40a82-78b1-4fe1-bf0f-c07672eeb786 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:19.555615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac40a82-78b1-4fe1-bf0f-c07672eeb786 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:19.555615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac40a82-78b1-4fe1-bf0f-c07672eeb786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:19.556549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843ad3c-4018-4745-bf30-ca5fa5f45b97 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:19.557658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac40a82-78b1-4fe1-bf0f-c07672eeb786 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:19.576951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843ad3c-4018-4745-bf30-ca5fa5f45b97 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:19.590645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a14345-07d4-4043-8e73-53ea020a1b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:19.590982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a14345-07d4-4043-8e73-53ea020a1b9b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:19.591266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a14345-07d4-4043-8e73-53ea020a1b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:19.592073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a14345-07d4-4043-8e73-53ea020a1b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:19.592281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a14345-07d4-4043-8e73-53ea020a1b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:19.594465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a14345-07d4-4043-8e73-53ea020a1b9b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:19.622441 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2786/5642] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:19 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:03:19.624452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a14345-07d4-4043-8e73-53ea020a1b9b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:19.646100 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2857/5643] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:19 2021] POST /identity/v3/projects => generated 395 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:19.650773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac40a82-78b1-4fe1-bf0f-c07672eeb786 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:19.659678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a14345-07d4-4043-8e73-53ea020a1b9b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:19.750634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1593b-07d2-43b3-b648-fdb101984cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:19.753339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1593b-07d2-43b3-b648-fdb101984cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:19.754024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1593b-07d2-43b3-b648-fdb101984cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:19.754502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1593b-07d2-43b3-b648-fdb101984cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:19.756079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1593b-07d2-43b3-b648-fdb101984cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:19.759192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1593b-07d2-43b3-b648-fdb101984cf4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:19.770791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac40a82-78b1-4fe1-bf0f-c07672eeb786 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:19.774979 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2787/5644] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:19 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:19.779714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1593b-07d2-43b3-b648-fdb101984cf4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:19.781251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb28b7a-7b0a-41b8-a99e-ba1e1df0b92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:19.782497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb28b7a-7b0a-41b8-a99e-ba1e1df0b92a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:19.783116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb28b7a-7b0a-41b8-a99e-ba1e1df0b92a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:19.783644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb28b7a-7b0a-41b8-a99e-ba1e1df0b92a admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:19.785008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb28b7a-7b0a-41b8-a99e-ba1e1df0b92a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:19.789928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb28b7a-7b0a-41b8-a99e-ba1e1df0b92a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:19.813078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1593b-07d2-43b3-b648-fdb101984cf4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:19.820226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df364c0-a3a5-4002-a085-c20e0054e42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:19.821870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df364c0-a3a5-4002-a085-c20e0054e42c admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:19.822161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df364c0-a3a5-4002-a085-c20e0054e42c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:19.822475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df364c0-a3a5-4002-a085-c20e0054e42c admin admin] PATH_INFO: `/v3/projects/6654167275ce4b90ba5822487002c182/users/7fc40db170a94246b4c863e0d7659fd5/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:19.823592 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2858/5645] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:19 2021] POST /identity/v3/users => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:19.828592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb28b7a-7b0a-41b8-a99e-ba1e1df0b92a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:19.845072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb28b7a-7b0a-41b8-a99e-ba1e1df0b92a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:19.846640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df364c0-a3a5-4002-a085-c20e0054e42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6654167275ce4b90ba5822487002c182, user_id=7fc40db170a94246b4c863e0d7659fd5, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:19.853559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df364c0-a3a5-4002-a085-c20e0054e42c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:19.854211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e89f08-959e-473d-9ae8-0801835f3981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:19.855215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e89f08-959e-473d-9ae8-0801835f3981 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:19.855931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e89f08-959e-473d-9ae8-0801835f3981 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:19.856353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e89f08-959e-473d-9ae8-0801835f3981 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:19.857552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e89f08-959e-473d-9ae8-0801835f3981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:19.862230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e89f08-959e-473d-9ae8-0801835f3981 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:19.877768 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2859/5646] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:19 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:03:19.881511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e89f08-959e-473d-9ae8-0801835f3981 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:19.886600 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2788/5647] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:19 2021] PUT /identity/v3/projects/6654167275ce4b90ba5822487002c182/users/7fc40db170a94246b4c863e0d7659fd5/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:19.898633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e89f08-959e-473d-9ae8-0801835f3981 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:19.898844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af1e0b-3da2-437a-a628-a3300d76ca70 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:19.899138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af1e0b-3da2-437a-a628-a3300d76ca70 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:19.899355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af1e0b-3da2-437a-a628-a3300d76ca70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:19.982316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19a108-4eb7-4de6-a680-eb9d48d8eedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:19.983050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19a108-4eb7-4de6-a680-eb9d48d8eedf admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:19.983557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b2af1e0b-3da2-437a-a628-a3300d76ca70 None None] MFA Rules not processed for user `7fc40db170a94246b4c863e0d7659fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:19.983899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19a108-4eb7-4de6-a680-eb9d48d8eedf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:19.984182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19a108-4eb7-4de6-a680-eb9d48d8eedf admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:19.984921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19a108-4eb7-4de6-a680-eb9d48d8eedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:19.985171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b2af1e0b-3da2-437a-a628-a3300d76ca70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:19.986862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19a108-4eb7-4de6-a680-eb9d48d8eedf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:20.003065 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2860/5648] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:19 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:20.003065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19a108-4eb7-4de6-a680-eb9d48d8eedf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:20.006611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dc19a108-4eb7-4de6-a680-eb9d48d8eedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:20.031003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19a108-4eb7-4de6-a680-eb9d48d8eedf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:20.037861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feb1ec-9c10-4421-9e36-499f007f3dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:20.040025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feb1ec-9c10-4421-9e36-499f007f3dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:20.040545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feb1ec-9c10-4421-9e36-499f007f3dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:20.040917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feb1ec-9c10-4421-9e36-499f007f3dcc admin admin] PATH_INFO: `/v3/projects/37f8d3a76a7b40ccbd92ec26deed6ab5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:20.043027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9feb1ec-9c10-4421-9e36-499f007f3dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f8d3a76a7b40ccbd92ec26deed6ab5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:20.045236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9feb1ec-9c10-4421-9e36-499f007f3dcc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:20.140323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9feb1ec-9c10-4421-9e36-499f007f3dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f8d3a76a7b40ccbd92ec26deed6ab5', 'request_id': 'req-c9feb1ec-9c10-4421-9e36-499f007f3dcc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:20.150908 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2789/5649] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:19 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:20.153186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9feb1ec-9c10-4421-9e36-499f007f3dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f8d3a76a7b40ccbd92ec26deed6ab5', 'request_id': 'req-c9feb1ec-9c10-4421-9e36-499f007f3dcc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:20.153424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af1e0b-3da2-437a-a628-a3300d76ca70 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:20.173147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9feb1ec-9c10-4421-9e36-499f007f3dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f8d3a76a7b40ccbd92ec26deed6ab5', 'request_id': 'req-c9feb1ec-9c10-4421-9e36-499f007f3dcc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:20.184926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af1e0b-3da2-437a-a628-a3300d76ca70 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:20.197620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9feb1ec-9c10-4421-9e36-499f007f3dcc admin admin] The token cache is being invalidate because project 37f8d3a76a7b40ccbd92ec26deed6ab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:20.198198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9feb1ec-9c10-4421-9e36-499f007f3dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:20.199164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9feb1ec-9c10-4421-9e36-499f007f3dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:20.203732 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2861/5650] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:20 2021] DELETE /identity/v3/projects/37f8d3a76a7b40ccbd92ec26deed6ab5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:20.206052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feb1ec-9c10-4421-9e36-499f007f3dcc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:20.209739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c9feb1ec-9c10-4421-9e36-499f007f3dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:20.300001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4abd75-cb66-4129-bb15-86a814d77b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:20.301219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4abd75-cb66-4129-bb15-86a814d77b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:20.301589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4abd75-cb66-4129-bb15-86a814d77b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:20.301864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4abd75-cb66-4129-bb15-86a814d77b38 admin admin] PATH_INFO: `/v3/projects/4b037c54b761428db4df46b975b70574/users/0012ccb14865485192056087c9926493/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:20.325422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4abd75-cb66-4129-bb15-86a814d77b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b037c54b761428db4df46b975b70574, user_id=0012ccb14865485192056087c9926493, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:20.328758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4abd75-cb66-4129-bb15-86a814d77b38 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:20.334053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feb1ec-9c10-4421-9e36-499f007f3dcc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:20.341958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34984438-d1db-4a80-98a2-af47b05e0240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:20.343103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34984438-d1db-4a80-98a2-af47b05e0240 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:20.343613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34984438-d1db-4a80-98a2-af47b05e0240 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:20.344115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34984438-d1db-4a80-98a2-af47b05e0240 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:20.345070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34984438-d1db-4a80-98a2-af47b05e0240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:20.347641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34984438-d1db-4a80-98a2-af47b05e0240 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:20.363062 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2790/5651] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:20 2021] PUT /identity/v3/projects/4b037c54b761428db4df46b975b70574/users/0012ccb14865485192056087c9926493/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:20.366725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880ff08-3fa9-46b4-8a91-c05e3dc39cb0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:20.371998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880ff08-3fa9-46b4-8a91-c05e3dc39cb0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:20.372330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880ff08-3fa9-46b4-8a91-c05e3dc39cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:20.411977 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2862/5652] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:20 2021] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:20.412232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f880ff08-3fa9-46b4-8a91-c05e3dc39cb0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:20.412232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f880ff08-3fa9-46b4-8a91-c05e3dc39cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:20.413537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75aebb6-ac9f-438d-82dc-7a26fa3a1ed3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:20.413929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75aebb6-ac9f-438d-82dc-7a26fa3a1ed3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:20.415065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75aebb6-ac9f-438d-82dc-7a26fa3a1ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:20.469028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b75aebb6-ac9f-438d-82dc-7a26fa3a1ed3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:20.470466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b75aebb6-ac9f-438d-82dc-7a26fa3a1ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:20.520831 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2791/5653] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:20.522115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880ff08-3fa9-46b4-8a91-c05e3dc39cb0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:20.538761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880ff08-3fa9-46b4-8a91-c05e3dc39cb0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:20.544727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f1a12-fa29-4778-a658-e7f25e3c47cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:20.545804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f1a12-fa29-4778-a658-e7f25e3c47cc admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:20.546627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f1a12-fa29-4778-a658-e7f25e3c47cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:20.546926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f1a12-fa29-4778-a658-e7f25e3c47cc admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:20.547776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f1a12-fa29-4778-a658-e7f25e3c47cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:20.549854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f1a12-fa29-4778-a658-e7f25e3c47cc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:20.585142 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2863/5654] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:20.590087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73686930-1c1e-427a-9a6e-54a09569c310 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:20.590406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73686930-1c1e-427a-9a6e-54a09569c310 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:20.590709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73686930-1c1e-427a-9a6e-54a09569c310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:20.595762 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2792/5655] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:20 2021] POST /identity/v3/users => generated 293 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:20.599686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f1a12-fa29-4778-a658-e7f25e3c47cc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:20.615272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f1a12-fa29-4778-a658-e7f25e3c47cc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:20.623542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8e1f3-da94-4c1f-ae6a-c890836106d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:20.624607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8e1f3-da94-4c1f-ae6a-c890836106d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:20.624936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8e1f3-da94-4c1f-ae6a-c890836106d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:20.625225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8e1f3-da94-4c1f-ae6a-c890836106d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:20.627148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8e1f3-da94-4c1f-ae6a-c890836106d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:20.629735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-73686930-1c1e-427a-9a6e-54a09569c310 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:20.630996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8e1f3-da94-4c1f-ae6a-c890836106d7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:20.631732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-73686930-1c1e-427a-9a6e-54a09569c310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:20.644735 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2864/5656] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:20.646392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73686930-1c1e-427a-9a6e-54a09569c310 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:20.653586 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2793/5657] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:20 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:20.653586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8e1f3-da94-4c1f-ae6a-c890836106d7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:20.655643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-73686930-1c1e-427a-9a6e-54a09569c310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:20.673332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8e1f3-da94-4c1f-ae6a-c890836106d7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:20.681955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a65193-1814-4ae4-ae57-50b2fe4d6ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:20.683139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a65193-1814-4ae4-ae57-50b2fe4d6ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:20.683727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a65193-1814-4ae4-ae57-50b2fe4d6ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:20.684026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a65193-1814-4ae4-ae57-50b2fe4d6ac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:20.686698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a65193-1814-4ae4-ae57-50b2fe4d6ac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:20.687327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a65193-1814-4ae4-ae57-50b2fe4d6ac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:20.688845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a65193-1814-4ae4-ae57-50b2fe4d6ac0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:20.708642 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2794/5658] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:03:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:20.714990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a65193-1814-4ae4-ae57-50b2fe4d6ac0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:20.739494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a65193-1814-4ae4-ae57-50b2fe4d6ac0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:20.752554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565912ea-71e7-4c15-ba4d-5eb2b650b98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:20.753958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565912ea-71e7-4c15-ba4d-5eb2b650b98c admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:20.754219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73686930-1c1e-427a-9a6e-54a09569c310 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:20.754661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565912ea-71e7-4c15-ba4d-5eb2b650b98c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:20.755338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565912ea-71e7-4c15-ba4d-5eb2b650b98c admin admin] PATH_INFO: `/v3/projects/2b90d455200e41bb9993ba97220341c0/users/02a56803e34b46819ac4364d7bc597c5/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:20.762654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819bc15-8a69-44c9-935a-8ad05f8797d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:20.763747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819bc15-8a69-44c9-935a-8ad05f8797d0 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:20.764145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819bc15-8a69-44c9-935a-8ad05f8797d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:20.764547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819bc15-8a69-44c9-935a-8ad05f8797d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:20.783357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819bc15-8a69-44c9-935a-8ad05f8797d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:20.783980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565912ea-71e7-4c15-ba4d-5eb2b650b98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b90d455200e41bb9993ba97220341c0, user_id=02a56803e34b46819ac4364d7bc597c5, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:20.786870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565912ea-71e7-4c15-ba4d-5eb2b650b98c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:20.802501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819bc15-8a69-44c9-935a-8ad05f8797d0 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:20.811887 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2795/5659] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:20 2021] PUT /identity/v3/projects/2b90d455200e41bb9993ba97220341c0/users/02a56803e34b46819ac4364d7bc597c5/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:20.811887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565912ea-71e7-4c15-ba4d-5eb2b650b98c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:20.818592 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2865/5660] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:20.819470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819bc15-8a69-44c9-935a-8ad05f8797d0 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:20.837452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819bc15-8a69-44c9-935a-8ad05f8797d0 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:20.940772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50b459-b3a0-47a2-a327-e3ece373b0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:20.943621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50b459-b3a0-47a2-a327-e3ece373b0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:20.943915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50b459-b3a0-47a2-a327-e3ece373b0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:20.944272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50b459-b3a0-47a2-a327-e3ece373b0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:20.945435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50b459-b3a0-47a2-a327-e3ece373b0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:20.947892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50b459-b3a0-47a2-a327-e3ece373b0e2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:20.950364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565912ea-71e7-4c15-ba4d-5eb2b650b98c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:20.958662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136a5a6-0823-488c-b442-d1e6d86ff458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:20.959899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136a5a6-0823-488c-b442-d1e6d86ff458 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:20.960088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136a5a6-0823-488c-b442-d1e6d86ff458 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:20.960446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136a5a6-0823-488c-b442-d1e6d86ff458 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:20.961906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136a5a6-0823-488c-b442-d1e6d86ff458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:20.964934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136a5a6-0823-488c-b442-d1e6d86ff458 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:20.976063 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2866/5661] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:20 2021] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:20.979793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50b459-b3a0-47a2-a327-e3ece373b0e2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:21.004715 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2796/5662] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:20 2021] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:21.006420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136a5a6-0823-488c-b442-d1e6d86ff458 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:21.007718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50b459-b3a0-47a2-a327-e3ece373b0e2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:21.081694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f6fab-7641-464b-b0ff-637bad97d581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:21.083236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f6fab-7641-464b-b0ff-637bad97d581 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:21.083770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f6fab-7641-464b-b0ff-637bad97d581 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:21.084691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f6fab-7641-464b-b0ff-637bad97d581 admin admin] PATH_INFO: `/v3/projects/2b90d455200e41bb9993ba97220341c0/users/02a56803e34b46819ac4364d7bc597c5/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:21.088388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f6fab-7641-464b-b0ff-637bad97d581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b90d455200e41bb9993ba97220341c0, user_id=02a56803e34b46819ac4364d7bc597c5, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:21.092402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f6fab-7641-464b-b0ff-637bad97d581 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:21.110165 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2867/5663] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:20 2021] PUT /identity/v3/projects/2b90d455200e41bb9993ba97220341c0/users/02a56803e34b46819ac4364d7bc597c5/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:21.121489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21e3e1-4198-4275-8dad-282b014237b1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:21.121755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21e3e1-4198-4275-8dad-282b014237b1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:21.122039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21e3e1-4198-4275-8dad-282b014237b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:21.158440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136a5a6-0823-488c-b442-d1e6d86ff458 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:21.162226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-cb21e3e1-4198-4275-8dad-282b014237b1 None None] MFA Rules not processed for user `02a56803e34b46819ac4364d7bc597c5`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:21.164115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cb21e3e1-4198-4275-8dad-282b014237b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:21.263582 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2868/5664] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:21 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:21.265122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21e3e1-4198-4275-8dad-282b014237b1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:21.277127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21e3e1-4198-4275-8dad-282b014237b1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:21.288206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101a2db-a4b7-4b8c-ab45-a29bf73248d3 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02a56803e34b46819ac4364d7bc597c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b90d455200e41bb9993ba97220341c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:21.291025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae51c2d-524b-4b8e-ae2e-62d6e02f4e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:21.291666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101a2db-a4b7-4b8c-ab45-a29bf73248d3 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:21.291965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101a2db-a4b7-4b8c-ab45-a29bf73248d3 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:21.292253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101a2db-a4b7-4b8c-ab45-a29bf73248d3 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:21.292678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae51c2d-524b-4b8e-ae2e-62d6e02f4e2d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:21.293244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101a2db-a4b7-4b8c-ab45-a29bf73248d3 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:21.293358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101a2db-a4b7-4b8c-ab45-a29bf73248d3 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:21.294685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae51c2d-524b-4b8e-ae2e-62d6e02f4e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:21.295476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae51c2d-524b-4b8e-ae2e-62d6e02f4e2d admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:21.296433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae51c2d-524b-4b8e-ae2e-62d6e02f4e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:21.298815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae51c2d-524b-4b8e-ae2e-62d6e02f4e2d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:21.299282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101a2db-a4b7-4b8c-ab45-a29bf73248d3 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:21.326627 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2869/5665] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:03:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:21.334130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101a2db-a4b7-4b8c-ab45-a29bf73248d3 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:21.343737 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2797/5666] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:21 2021] POST /identity/v3/users => generated 284 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:21.347243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae51c2d-524b-4b8e-ae2e-62d6e02f4e2d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:21.360271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae51c2d-524b-4b8e-ae2e-62d6e02f4e2d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:21.361901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101a2db-a4b7-4b8c-ab45-a29bf73248d3 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:21.367652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fd571-134b-4d91-bf95-b7a5c11dfa56 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02a56803e34b46819ac4364d7bc597c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b90d455200e41bb9993ba97220341c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:21.368323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fd571-134b-4d91-bf95-b7a5c11dfa56 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:21.368614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fd571-134b-4d91-bf95-b7a5c11dfa56 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:21.368901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fd571-134b-4d91-bf95-b7a5c11dfa56 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:21.369624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9fd571-134b-4d91-bf95-b7a5c11dfa56 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:21.371854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9fd571-134b-4d91-bf95-b7a5c11dfa56 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:21.373787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de95f00-8b4b-479a-98da-86a850b59784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:21.373787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de95f00-8b4b-479a-98da-86a850b59784 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:21.375818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de95f00-8b4b-479a-98da-86a850b59784 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:21.376130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de95f00-8b4b-479a-98da-86a850b59784 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:21.378487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de95f00-8b4b-479a-98da-86a850b59784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:21.382138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de95f00-8b4b-479a-98da-86a850b59784 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:21.411046 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2798/5667] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:21 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:03:21.415070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de95f00-8b4b-479a-98da-86a850b59784 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:21.417364 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2870/5668] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:21 2021] POST /identity/v3/projects => generated 348 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:21.419121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fd571-134b-4d91-bf95-b7a5c11dfa56 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:21.428480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de95f00-8b4b-479a-98da-86a850b59784 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:21.545752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7c0d7-40a3-4889-8b3c-e266cc4a2e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:21.546546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7c0d7-40a3-4889-8b3c-e266cc4a2e5d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:21.546837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7c0d7-40a3-4889-8b3c-e266cc4a2e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:21.547132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7c0d7-40a3-4889-8b3c-e266cc4a2e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:21.551521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7c0d7-40a3-4889-8b3c-e266cc4a2e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:21.558567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7c0d7-40a3-4889-8b3c-e266cc4a2e5d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:21.564519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fd571-134b-4d91-bf95-b7a5c11dfa56 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:21.572094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53a1db-c3bd-4299-b76f-9ecbcffe6133 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02a56803e34b46819ac4364d7bc597c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b90d455200e41bb9993ba97220341c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:21.572776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53a1db-c3bd-4299-b76f-9ecbcffe6133 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:21.573066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53a1db-c3bd-4299-b76f-9ecbcffe6133 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:21.573360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53a1db-c3bd-4299-b76f-9ecbcffe6133 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:21.574105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53a1db-c3bd-4299-b76f-9ecbcffe6133 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:21.574465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53a1db-c3bd-4299-b76f-9ecbcffe6133 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:21.576164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53a1db-c3bd-4299-b76f-9ecbcffe6133 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:21.582690 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2799/5669] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:21 2021] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:21.583666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7c0d7-40a3-4889-8b3c-e266cc4a2e5d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:21.596025 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2871/5670] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:03:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:21.602486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7c0d7-40a3-4889-8b3c-e266cc4a2e5d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:21.608853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2098613-5878-4d59-a389-4b3a668b9c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:21.610109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2098613-5878-4d59-a389-4b3a668b9c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:21.610642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2098613-5878-4d59-a389-4b3a668b9c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:21.610941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2098613-5878-4d59-a389-4b3a668b9c72 admin admin] PATH_INFO: `/v3/projects/0640b386883942e2aae48b0a074ef2fd/users/1e1b8a8c4644444a9c01421ccb373741/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:21.613370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53a1db-c3bd-4299-b76f-9ecbcffe6133 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:21.616020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1a53a1db-c3bd-4299-b76f-9ecbcffe6133 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:21.657453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2098613-5878-4d59-a389-4b3a668b9c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0640b386883942e2aae48b0a074ef2fd, user_id=1e1b8a8c4644444a9c01421ccb373741, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:21.660368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2098613-5878-4d59-a389-4b3a668b9c72 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:21.684588 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2800/5671] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:21 2021] PUT /identity/v3/projects/0640b386883942e2aae48b0a074ef2fd/users/1e1b8a8c4644444a9c01421ccb373741/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:21.696011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809ff4e-fd8e-4b41-a704-f604d98d3b61 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:21.697649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809ff4e-fd8e-4b41-a704-f604d98d3b61 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:21.698157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809ff4e-fd8e-4b41-a704-f604d98d3b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:21.705820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53a1db-c3bd-4299-b76f-9ecbcffe6133 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:21.748189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d809ff4e-fd8e-4b41-a704-f604d98d3b61 None None] MFA Rules not processed for user `1e1b8a8c4644444a9c01421ccb373741`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:21.749310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d809ff4e-fd8e-4b41-a704-f604d98d3b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:21.828981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724a381-3020-4239-abd4-b36ba5c8ee38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:21.829648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724a381-3020-4239-abd4-b36ba5c8ee38 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:21.829931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724a381-3020-4239-abd4-b36ba5c8ee38 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:21.830681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724a381-3020-4239-abd4-b36ba5c8ee38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:21.841854 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2801/5672] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:21 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:21.851855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809ff4e-fd8e-4b41-a704-f604d98d3b61 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:22.036136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809ff4e-fd8e-4b41-a704-f604d98d3b61 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:22.042172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8fcd7-3fff-4f63-8575-36c0bbdfe134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:22.043857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8fcd7-3fff-4f63-8575-36c0bbdfe134 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:22.044381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8fcd7-3fff-4f63-8575-36c0bbdfe134 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:22.044935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8fcd7-3fff-4f63-8575-36c0bbdfe134 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:22.046301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8fcd7-3fff-4f63-8575-36c0bbdfe134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:22.048051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724a381-3020-4239-abd4-b36ba5c8ee38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:22.050065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8fcd7-3fff-4f63-8575-36c0bbdfe134 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:22.052949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724a381-3020-4239-abd4-b36ba5c8ee38 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:22.086056 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2872/5673] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:21 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:22.113619 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2802/5674] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:21 2021] POST /identity/v3/projects => generated 367 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:22.113807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724a381-3020-4239-abd4-b36ba5c8ee38 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:22.129679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724a381-3020-4239-abd4-b36ba5c8ee38 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:22.246943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ded0e-7d5e-4b3b-9e75-8edbecc8756f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:22.247617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ded0e-7d5e-4b3b-9e75-8edbecc8756f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:22.247898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ded0e-7d5e-4b3b-9e75-8edbecc8756f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:22.248669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ded0e-7d5e-4b3b-9e75-8edbecc8756f admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:22.249029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ded0e-7d5e-4b3b-9e75-8edbecc8756f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:22.250862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ded0e-7d5e-4b3b-9e75-8edbecc8756f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:22.295488 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2873/5675] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:22 2021] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:03:22.299022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8fcd7-3fff-4f63-8575-36c0bbdfe134 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:22.311385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8fcd7-3fff-4f63-8575-36c0bbdfe134 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:22.317242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c257e2a-1f5e-4db1-bdd7-be0214efe67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:22.318009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c257e2a-1f5e-4db1-bdd7-be0214efe67b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:22.318395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c257e2a-1f5e-4db1-bdd7-be0214efe67b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:22.318741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c257e2a-1f5e-4db1-bdd7-be0214efe67b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:22.319553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c257e2a-1f5e-4db1-bdd7-be0214efe67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:22.321402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c257e2a-1f5e-4db1-bdd7-be0214efe67b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:22.338335 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2803/5676] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:22 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:03:22.342160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ded0e-7d5e-4b3b-9e75-8edbecc8756f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:22.355786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ded0e-7d5e-4b3b-9e75-8edbecc8756f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:22.364082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3602a64-73fe-4670-a8db-59e4e70376d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:22.365156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3602a64-73fe-4670-a8db-59e4e70376d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:22.365542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3602a64-73fe-4670-a8db-59e4e70376d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:22.365924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3602a64-73fe-4670-a8db-59e4e70376d1 admin admin] PATH_INFO: `/v3/projects/ed2e124612d248a5b68852a9783e12fb/users/4b286c2615df4d0aa47a126f7c072ad6/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:22.384039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3602a64-73fe-4670-a8db-59e4e70376d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2e124612d248a5b68852a9783e12fb, user_id=4b286c2615df4d0aa47a126f7c072ad6, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:22.388088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3602a64-73fe-4670-a8db-59e4e70376d1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:22.412051 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2874/5677] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:22 2021] PUT /identity/v3/projects/ed2e124612d248a5b68852a9783e12fb/users/4b286c2615df4d0aa47a126f7c072ad6/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:22.420349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c257e2a-1f5e-4db1-bdd7-be0214efe67b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:22.442171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c257e2a-1f5e-4db1-bdd7-be0214efe67b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:22.604419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a16db4-7998-4c85-8df7-5813756c34c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:22.605840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a16db4-7998-4c85-8df7-5813756c34c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:22.606135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a16db4-7998-4c85-8df7-5813756c34c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:22.606474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a16db4-7998-4c85-8df7-5813756c34c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:22.607254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a16db4-7998-4c85-8df7-5813756c34c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:22.608931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a16db4-7998-4c85-8df7-5813756c34c1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:22.660866 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2804/5678] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:22 2021] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:22.666345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3602a64-73fe-4670-a8db-59e4e70376d1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:22.694091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3602a64-73fe-4670-a8db-59e4e70376d1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:22.710121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91d48a-78c8-47bd-bf61-bf2f375dc335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:22.711723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91d48a-78c8-47bd-bf61-bf2f375dc335 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:22.711856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91d48a-78c8-47bd-bf61-bf2f375dc335 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:22.715176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91d48a-78c8-47bd-bf61-bf2f375dc335 admin admin] PATH_INFO: `/v3/projects/ed2e124612d248a5b68852a9783e12fb/users/4b286c2615df4d0aa47a126f7c072ad6/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:22.719531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91d48a-78c8-47bd-bf61-bf2f375dc335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2e124612d248a5b68852a9783e12fb, user_id=4b286c2615df4d0aa47a126f7c072ad6, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:22.722195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91d48a-78c8-47bd-bf61-bf2f375dc335 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:22.764090 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2875/5679] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:22 2021] PUT /identity/v3/projects/ed2e124612d248a5b68852a9783e12fb/users/4b286c2615df4d0aa47a126f7c072ad6/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:22.775493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f975ae-34f7-4eaa-92e3-3e1fc5ac37c7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:22.775799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f975ae-34f7-4eaa-92e3-3e1fc5ac37c7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:22.776321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f975ae-34f7-4eaa-92e3-3e1fc5ac37c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:22.841854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-57f975ae-34f7-4eaa-92e3-3e1fc5ac37c7 None None] MFA Rules not processed for user `4b286c2615df4d0aa47a126f7c072ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:22.843421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-57f975ae-34f7-4eaa-92e3-3e1fc5ac37c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:22.962600 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2805/5680] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:22 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:22.968868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91d48a-78c8-47bd-bf61-bf2f375dc335 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:22.989807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91d48a-78c8-47bd-bf61-bf2f375dc335 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:23.003833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec028267-b839-4e82-9f33-dc4f5dc1353f tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:23.004623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec028267-b839-4e82-9f33-dc4f5dc1353f tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:23.005257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec028267-b839-4e82-9f33-dc4f5dc1353f tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:23.005257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec028267-b839-4e82-9f33-dc4f5dc1353f tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:23.005944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec028267-b839-4e82-9f33-dc4f5dc1353f tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:23.008625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec028267-b839-4e82-9f33-dc4f5dc1353f tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:23.048606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f975ae-34f7-4eaa-92e3-3e1fc5ac37c7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:23.048883 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2876/5681] 10.222.0.13 () {60 vars in 1149 bytes} [Sat Dec 18 21:03:22 2021] POST /identity/v3/domains => generated 276 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:23.061700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f975ae-34f7-4eaa-92e3-3e1fc5ac37c7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:23.200012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af1a98-f666-47e3-8a5d-d44c8ab92585 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:23.200300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af1a98-f666-47e3-8a5d-d44c8ab92585 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:23.201131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af1a98-f666-47e3-8a5d-d44c8ab92585 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:23.201487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af1a98-f666-47e3-8a5d-d44c8ab92585 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:23.202630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af1a98-f666-47e3-8a5d-d44c8ab92585 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:23.207159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af1a98-f666-47e3-8a5d-d44c8ab92585 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:23.239991 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2806/5682] 10.222.0.13 () {60 vars in 1149 bytes} [Sat Dec 18 21:03:23 2021] POST /identity/v3/domains => generated 276 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:23.244677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec028267-b839-4e82-9f33-dc4f5dc1353f tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:23.262301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec028267-b839-4e82-9f33-dc4f5dc1353f tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:23.340643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf80993-d099-477a-a494-a583b37982f0 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:23.341654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf80993-d099-477a-a494-a583b37982f0 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:23.342323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf80993-d099-477a-a494-a583b37982f0 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:23.342707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf80993-d099-477a-a494-a583b37982f0 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:23.343562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf80993-d099-477a-a494-a583b37982f0 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:23.345316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf80993-d099-477a-a494-a583b37982f0 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:23.372180 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2877/5683] 10.222.0.13 () {60 vars in 1149 bytes} [Sat Dec 18 21:03:23 2021] POST /identity/v3/domains => generated 277 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:23.374833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af1a98-f666-47e3-8a5d-d44c8ab92585 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:23.393987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af1a98-f666-47e3-8a5d-d44c8ab92585 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:23.510438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62a5fb-bef3-403b-9157-61cd8f17e368 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:23.511263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62a5fb-bef3-403b-9157-61cd8f17e368 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:23.511551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62a5fb-bef3-403b-9157-61cd8f17e368 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:23.511892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62a5fb-bef3-403b-9157-61cd8f17e368 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:23.512850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62a5fb-bef3-403b-9157-61cd8f17e368 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:23.514715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62a5fb-bef3-403b-9157-61cd8f17e368 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:23.549045 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2807/5684] 10.222.0.13 () {60 vars in 1149 bytes} [Sat Dec 18 21:03:23 2021] POST /identity/v3/domains => generated 280 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:23.552323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf80993-d099-477a-a494-a583b37982f0 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:23.567759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf80993-d099-477a-a494-a583b37982f0 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:23.674376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:23.675524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:23.675883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:23.676260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/cfdbf448cb6344d3aca49cadc5e251a4` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:23.692089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cfdbf448cb6344d3aca49cadc5e251a4)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:23.694681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:23.729163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cfdbf448cb6344d3aca49cadc5e251a4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:23.733135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cfdbf448cb6344d3aca49cadc5e251a4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:23.797591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfdbf448cb6344d3aca49cadc5e251a4', 'request_id': 'req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:23.807964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfdbf448cb6344d3aca49cadc5e251a4', 'request_id': 'req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:23.818792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfdbf448cb6344d3aca49cadc5e251a4', 'request_id': 'req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:23.834073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] The token cache is being invalidate because project cfdbf448cb6344d3aca49cadc5e251a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:23.834965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:23.835786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:23.848957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cfdbf448cb6344d3aca49cadc5e251a4', 'request_id': 'req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:23.855013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cfdbf448cb6344d3aca49cadc5e251a4', 'request_id': 'req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:23.856333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cfdbf448cb6344d3aca49cadc5e251a4', 'request_id': 'req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:23.878282 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2878/5685] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:03:23 2021] DELETE /identity/v3/domains/cfdbf448cb6344d3aca49cadc5e251a4 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:23.890321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62a5fb-bef3-403b-9157-61cd8f17e368 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:23.896494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6a62a5fb-bef3-403b-9157-61cd8f17e368 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:23.910148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62a5fb-bef3-403b-9157-61cd8f17e368 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:23.995300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a258e-8d27-4899-a2ec-771e84fe008c tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:23.996366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a258e-8d27-4899-a2ec-771e84fe008c tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:23.997359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a258e-8d27-4899-a2ec-771e84fe008c tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:23.998555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a258e-8d27-4899-a2ec-771e84fe008c tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:24.000075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a258e-8d27-4899-a2ec-771e84fe008c tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:24.002693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a258e-8d27-4899-a2ec-771e84fe008c tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:24.044095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:24.046659 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2808/5686] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:03:23 2021] POST /identity/v3/domains => generated 248 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:24.056289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4b497-8fbb-4fa5-a3c7-c7b67a60a4c6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:24.201562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c4434-f23e-4504-adfd-9d41ac76851a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:24.206645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c4434-f23e-4504-adfd-9d41ac76851a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:24.207436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c4434-f23e-4504-adfd-9d41ac76851a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:24.208091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c4434-f23e-4504-adfd-9d41ac76851a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/b46c26464614421eb69a0375132dc6c8` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:24.236848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c4434-f23e-4504-adfd-9d41ac76851a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b46c26464614421eb69a0375132dc6c8)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:24.239160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c4434-f23e-4504-adfd-9d41ac76851a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:24.269536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9a1c4434-f23e-4504-adfd-9d41ac76851a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b46c26464614421eb69a0375132dc6c8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:24.270718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9a1c4434-f23e-4504-adfd-9d41ac76851a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b46c26464614421eb69a0375132dc6c8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:24.317682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9a1c4434-f23e-4504-adfd-9d41ac76851a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b46c26464614421eb69a0375132dc6c8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:24.318465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9a1c4434-f23e-4504-adfd-9d41ac76851a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b46c26464614421eb69a0375132dc6c8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:24.330841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a258e-8d27-4899-a2ec-771e84fe008c tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:24.333347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6d0a258e-8d27-4899-a2ec-771e84fe008c tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:24.340504 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2879/5687] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:03:24 2021] PATCH /identity/v3/domains/b46c26464614421eb69a0375132dc6c8 => generated 249 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:03:24.354636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a258e-8d27-4899-a2ec-771e84fe008c tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:24.534512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:24.535417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:24.537419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:24.537726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/b46c26464614421eb69a0375132dc6c8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:24.569007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b46c26464614421eb69a0375132dc6c8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:24.576119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:24.631812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b46c26464614421eb69a0375132dc6c8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:24.642359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b46c26464614421eb69a0375132dc6c8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:24.767809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46c26464614421eb69a0375132dc6c8', 'request_id': 'req-b54fccd1-0d4e-4531-bf85-9d472a755b3b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:24.778005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46c26464614421eb69a0375132dc6c8', 'request_id': 'req-b54fccd1-0d4e-4531-bf85-9d472a755b3b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:24.787610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46c26464614421eb69a0375132dc6c8', 'request_id': 'req-b54fccd1-0d4e-4531-bf85-9d472a755b3b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:24.808192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] The token cache is being invalidate because project b46c26464614421eb69a0375132dc6c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:24.808544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:24.809217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:24.824103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b46c26464614421eb69a0375132dc6c8', 'request_id': 'req-b54fccd1-0d4e-4531-bf85-9d472a755b3b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:24.825652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b46c26464614421eb69a0375132dc6c8', 'request_id': 'req-b54fccd1-0d4e-4531-bf85-9d472a755b3b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:24.826533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b46c26464614421eb69a0375132dc6c8', 'request_id': 'req-b54fccd1-0d4e-4531-bf85-9d472a755b3b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:24.834352 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2809/5688] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:03:24 2021] DELETE /identity/v3/domains/b46c26464614421eb69a0375132dc6c8 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:24.840756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c4434-f23e-4504-adfd-9d41ac76851a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:24.856189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c4434-f23e-4504-adfd-9d41ac76851a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:24.952999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e166af4-7c43-474c-91a9-e946422e1c0e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:24.953660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e166af4-7c43-474c-91a9-e946422e1c0e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:24.954112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e166af4-7c43-474c-91a9-e946422e1c0e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:24.954530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e166af4-7c43-474c-91a9-e946422e1c0e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:24.955372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e166af4-7c43-474c-91a9-e946422e1c0e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:24.957299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e166af4-7c43-474c-91a9-e946422e1c0e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:24.977426 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2880/5689] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:03:24 2021] POST /identity/v3/domains => generated 277 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:24.978918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:24.980405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:24.995021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fccd1-0d4e-4531-bf85-9d472a755b3b tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:25.098193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646aac7-b06e-4b5f-b6a0-995d7f51e933 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:25.099292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646aac7-b06e-4b5f-b6a0-995d7f51e933 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:25.099668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646aac7-b06e-4b5f-b6a0-995d7f51e933 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:25.100017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646aac7-b06e-4b5f-b6a0-995d7f51e933 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/6ea119f144914a56a519167f8a3fa49f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:25.127773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646aac7-b06e-4b5f-b6a0-995d7f51e933 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6ea119f144914a56a519167f8a3fa49f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:25.129521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646aac7-b06e-4b5f-b6a0-995d7f51e933 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:25.174321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3646aac7-b06e-4b5f-b6a0-995d7f51e933 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6ea119f144914a56a519167f8a3fa49f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:25.175916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3646aac7-b06e-4b5f-b6a0-995d7f51e933 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6ea119f144914a56a519167f8a3fa49f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:25.215691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3646aac7-b06e-4b5f-b6a0-995d7f51e933 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6ea119f144914a56a519167f8a3fa49f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:25.216729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3646aac7-b06e-4b5f-b6a0-995d7f51e933 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6ea119f144914a56a519167f8a3fa49f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:25.222980 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2810/5690] 10.222.0.13 () {60 vars in 1249 bytes} [Sat Dec 18 21:03:24 2021] PATCH /identity/v3/domains/6ea119f144914a56a519167f8a3fa49f => generated 278 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:25.224324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e166af4-7c43-474c-91a9-e946422e1c0e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:25.225998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3e166af4-7c43-474c-91a9-e946422e1c0e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:25.248599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e166af4-7c43-474c-91a9-e946422e1c0e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:25.322955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a1ee8-35ad-4634-aa13-05ba3d157687 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:25.324591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a1ee8-35ad-4634-aa13-05ba3d157687 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:25.325061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a1ee8-35ad-4634-aa13-05ba3d157687 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:25.325346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a1ee8-35ad-4634-aa13-05ba3d157687 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/6ea119f144914a56a519167f8a3fa49f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:25.340415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a1ee8-35ad-4634-aa13-05ba3d157687 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=6ea119f144914a56a519167f8a3fa49f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:25.342504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a1ee8-35ad-4634-aa13-05ba3d157687 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:25.347999 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2881/5691] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 21:03:25 2021] GET /identity/v3/domains/6ea119f144914a56a519167f8a3fa49f => generated 278 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:25.351101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646aac7-b06e-4b5f-b6a0-995d7f51e933 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:25.366817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646aac7-b06e-4b5f-b6a0-995d7f51e933 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:25.375568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:25.376973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:25.377139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:25.377578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/6ea119f144914a56a519167f8a3fa49f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:25.379628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6ea119f144914a56a519167f8a3fa49f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:25.381739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:25.410783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6ea119f144914a56a519167f8a3fa49f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:25.416463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6ea119f144914a56a519167f8a3fa49f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:25.472961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ea119f144914a56a519167f8a3fa49f', 'request_id': 'req-b8d05555-3528-4c91-8d8e-38367cd6e7b6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:25.480671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ea119f144914a56a519167f8a3fa49f', 'request_id': 'req-b8d05555-3528-4c91-8d8e-38367cd6e7b6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:25.487595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ea119f144914a56a519167f8a3fa49f', 'request_id': 'req-b8d05555-3528-4c91-8d8e-38367cd6e7b6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:25.502773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] The token cache is being invalidate because project 6ea119f144914a56a519167f8a3fa49f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:25.503472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:25.509319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:25.520329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6ea119f144914a56a519167f8a3fa49f', 'request_id': 'req-b8d05555-3528-4c91-8d8e-38367cd6e7b6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:25.524322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6ea119f144914a56a519167f8a3fa49f', 'request_id': 'req-b8d05555-3528-4c91-8d8e-38367cd6e7b6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:25.525120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6ea119f144914a56a519167f8a3fa49f', 'request_id': 'req-b8d05555-3528-4c91-8d8e-38367cd6e7b6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:25.542050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a1ee8-35ad-4634-aa13-05ba3d157687 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:25.542530 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2811/5692] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:03:25 2021] DELETE /identity/v3/domains/6ea119f144914a56a519167f8a3fa49f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:25.543862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-518a1ee8-35ad-4634-aa13-05ba3d157687 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:25.563763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a1ee8-35ad-4634-aa13-05ba3d157687 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:25.657927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a81ce3-d0b4-495c-9f0e-9f18aaee1870 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:25.658809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a81ce3-d0b4-495c-9f0e-9f18aaee1870 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:25.659102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a81ce3-d0b4-495c-9f0e-9f18aaee1870 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:25.659423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a81ce3-d0b4-495c-9f0e-9f18aaee1870 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:25.660233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a81ce3-d0b4-495c-9f0e-9f18aaee1870 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:25.662457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a81ce3-d0b4-495c-9f0e-9f18aaee1870 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:25.711722 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2882/5693] 10.222.0.13 () {58 vars in 1127 bytes} [Sat Dec 18 21:03:25 2021] GET /identity/v3/domains => generated 1347 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:25.717685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:25.737369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d05555-3528-4c91-8d8e-38367cd6e7b6 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:25.759514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de808d9e-988f-4ae2-a72b-25a6c22a04d8 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:25.761803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de808d9e-988f-4ae2-a72b-25a6c22a04d8 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:25.762968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de808d9e-988f-4ae2-a72b-25a6c22a04d8 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:25.763510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de808d9e-988f-4ae2-a72b-25a6c22a04d8 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/6ea119f144914a56a519167f8a3fa49f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:25.773043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de808d9e-988f-4ae2-a72b-25a6c22a04d8 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:03:25.794239 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-de808d9e-988f-4ae2-a72b-25a6c22a04d8 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Could not find domain: 6ea119f144914a56a519167f8a3fa49f.: keystone.exception.DomainNotFound: Could not find domain: 6ea119f144914a56a519167f8a3fa49f. Dec 18 21:03:25.801390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a81ce3-d0b4-495c-9f0e-9f18aaee1870 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:25.808300 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2812/5694] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:03:25 2021] PATCH /identity/v3/domains/6ea119f144914a56a519167f8a3fa49f => generated 112 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:03:25.819587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a81ce3-d0b4-495c-9f0e-9f18aaee1870 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:25.839044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d658b-9609-454f-a0a0-9c0e9153e1d7 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:25.839738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d658b-9609-454f-a0a0-9c0e9153e1d7 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:25.840493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d658b-9609-454f-a0a0-9c0e9153e1d7 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:25.840788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d658b-9609-454f-a0a0-9c0e9153e1d7 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:25.841559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d658b-9609-454f-a0a0-9c0e9153e1d7 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:25.844090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d658b-9609-454f-a0a0-9c0e9153e1d7 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:25.906623 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2883/5695] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:03:25 2021] POST /identity/v3/domains => generated 275 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:25.908248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de808d9e-988f-4ae2-a72b-25a6c22a04d8 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:25.924478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de808d9e-988f-4ae2-a72b-25a6c22a04d8 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:26.040352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cff067-fc08-41e6-a308-debc24e855ec tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:26.041330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cff067-fc08-41e6-a308-debc24e855ec tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:26.041872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cff067-fc08-41e6-a308-debc24e855ec tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:26.042246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cff067-fc08-41e6-a308-debc24e855ec tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:26.044033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cff067-fc08-41e6-a308-debc24e855ec tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:26.046772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cff067-fc08-41e6-a308-debc24e855ec tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:26.103478 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2813/5696] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:25 2021] POST /identity/v3/users => generated 342 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:26.108081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d658b-9609-454f-a0a0-9c0e9153e1d7 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:26.120271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d658b-9609-454f-a0a0-9c0e9153e1d7 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:26.126842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634989c-3e60-4f50-82e1-a53bab0ae8ed tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:26.127963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634989c-3e60-4f50-82e1-a53bab0ae8ed tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:26.128614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634989c-3e60-4f50-82e1-a53bab0ae8ed tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:26.129110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634989c-3e60-4f50-82e1-a53bab0ae8ed tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/groups` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:26.130055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634989c-3e60-4f50-82e1-a53bab0ae8ed tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:26.132217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634989c-3e60-4f50-82e1-a53bab0ae8ed tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:26.151702 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2884/5697] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:03:26 2021] POST /identity/v3/groups => generated 324 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:26.155841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cff067-fc08-41e6-a308-debc24e855ec tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:26.168762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cff067-fc08-41e6-a308-debc24e855ec tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:26.179257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546aebe-714a-48a5-9d56-387afd7dab49 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:26.179257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546aebe-714a-48a5-9d56-387afd7dab49 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:26.179257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546aebe-714a-48a5-9d56-387afd7dab49 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:26.179780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546aebe-714a-48a5-9d56-387afd7dab49 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/a2959e394e9a4c258dc74ad2bb8ae384` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:26.179780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546aebe-714a-48a5-9d56-387afd7dab49 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a2959e394e9a4c258dc74ad2bb8ae384)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:26.180900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546aebe-714a-48a5-9d56-387afd7dab49 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:26.215762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3546aebe-714a-48a5-9d56-387afd7dab49 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a2959e394e9a4c258dc74ad2bb8ae384'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.216669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3546aebe-714a-48a5-9d56-387afd7dab49 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a2959e394e9a4c258dc74ad2bb8ae384'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.275179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3546aebe-714a-48a5-9d56-387afd7dab49 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a2959e394e9a4c258dc74ad2bb8ae384'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.275781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3546aebe-714a-48a5-9d56-387afd7dab49 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a2959e394e9a4c258dc74ad2bb8ae384'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.278315 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2814/5698] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:03:26 2021] PATCH /identity/v3/domains/a2959e394e9a4c258dc74ad2bb8ae384 => generated 276 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:26.282175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634989c-3e60-4f50-82e1-a53bab0ae8ed tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:26.284220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0634989c-3e60-4f50-82e1-a53bab0ae8ed tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:26.299019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634989c-3e60-4f50-82e1-a53bab0ae8ed tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:26.377519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:26.379629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:26.381844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:26.382426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/a2959e394e9a4c258dc74ad2bb8ae384` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:26.419276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a2959e394e9a4c258dc74ad2bb8ae384)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:26.421090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:26.468107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a2959e394e9a4c258dc74ad2bb8ae384'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.485926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a2959e394e9a4c258dc74ad2bb8ae384'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.637948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7e49ceccc948efa9d44d4109ad99cc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.647473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7e49ceccc948efa9d44d4109ad99cc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.648143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7e49ceccc948efa9d44d4109ad99cc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.665004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7e49ceccc948efa9d44d4109ad99cc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.675570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7e49ceccc948efa9d44d4109ad99cc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.729673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2959e394e9a4c258dc74ad2bb8ae384', 'request_id': 'req-253ed8b2-909f-4fb4-a247-b8daf31a83a1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.741465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2959e394e9a4c258dc74ad2bb8ae384', 'request_id': 'req-253ed8b2-909f-4fb4-a247-b8daf31a83a1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.749388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2959e394e9a4c258dc74ad2bb8ae384', 'request_id': 'req-253ed8b2-909f-4fb4-a247-b8daf31a83a1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.764121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] The token cache is being invalidate because project a2959e394e9a4c258dc74ad2bb8ae384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:26.765383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.766980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.779041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a2959e394e9a4c258dc74ad2bb8ae384', 'request_id': 'req-253ed8b2-909f-4fb4-a247-b8daf31a83a1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.782488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a2959e394e9a4c258dc74ad2bb8ae384', 'request_id': 'req-253ed8b2-909f-4fb4-a247-b8daf31a83a1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.783387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a2959e394e9a4c258dc74ad2bb8ae384', 'request_id': 'req-253ed8b2-909f-4fb4-a247-b8daf31a83a1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:26.792436 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2885/5699] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:03:26 2021] DELETE /identity/v3/domains/a2959e394e9a4c258dc74ad2bb8ae384 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:26.796392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546aebe-714a-48a5-9d56-387afd7dab49 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:26.807495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546aebe-714a-48a5-9d56-387afd7dab49 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:26.877090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07e5a3-3850-477f-891e-1cb453a272ba tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:26.878539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07e5a3-3850-477f-891e-1cb453a272ba tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:26.878828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07e5a3-3850-477f-891e-1cb453a272ba tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:26.880076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07e5a3-3850-477f-891e-1cb453a272ba tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/a2959e394e9a4c258dc74ad2bb8ae384` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:26.889271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07e5a3-3850-477f-891e-1cb453a272ba tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=a2959e394e9a4c258dc74ad2bb8ae384)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:26.892040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07e5a3-3850-477f-891e-1cb453a272ba tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:26.910658 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-df07e5a3-3850-477f-891e-1cb453a272ba tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Could not find domain: a2959e394e9a4c258dc74ad2bb8ae384.: keystone.exception.DomainNotFound: Could not find domain: a2959e394e9a4c258dc74ad2bb8ae384. Dec 18 21:03:26.938959 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2815/5700] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 21:03:26 2021] GET /identity/v3/domains/a2959e394e9a4c258dc74ad2bb8ae384 => generated 112 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:03:26.943995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:26.945811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:26.959308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ed8b2-909f-4fb4-a247-b8daf31a83a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:26.967077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fc27f-0646-4e4a-a3c0-c8beae47cdb2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:26.968248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fc27f-0646-4e4a-a3c0-c8beae47cdb2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:26.968759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fc27f-0646-4e4a-a3c0-c8beae47cdb2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:26.969228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fc27f-0646-4e4a-a3c0-c8beae47cdb2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/users/da7e49ceccc948efa9d44d4109ad99cc` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:26.979703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fc27f-0646-4e4a-a3c0-c8beae47cdb2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:get_user(user_id=da7e49ceccc948efa9d44d4109ad99cc)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:26.982134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fc27f-0646-4e4a-a3c0-c8beae47cdb2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:27.005880 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-739fc27f-0646-4e4a-a3c0-c8beae47cdb2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Could not find user: da7e49ceccc948efa9d44d4109ad99cc.: keystone.exception.UserNotFound: Could not find user: da7e49ceccc948efa9d44d4109ad99cc. Dec 18 21:03:27.012638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07e5a3-3850-477f-891e-1cb453a272ba tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:27.013398 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2886/5701] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 21:03:26 2021] GET /identity/v3/users/da7e49ceccc948efa9d44d4109ad99cc => generated 110 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:03:27.028503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07e5a3-3850-477f-891e-1cb453a272ba tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:27.034623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb9e56-158f-4dd6-b5b7-89be65aa1746 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:27.036756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9e56-158f-4dd6-b5b7-89be65aa1746 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:27.037279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9e56-158f-4dd6-b5b7-89be65aa1746 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:27.037828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9e56-158f-4dd6-b5b7-89be65aa1746 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/groups/31f46d7e6bdc4025b50f001cd0fa3b75` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:27.044741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb9e56-158f-4dd6-b5b7-89be65aa1746 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:get_group(group_id=31f46d7e6bdc4025b50f001cd0fa3b75)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:27.048050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb9e56-158f-4dd6-b5b7-89be65aa1746 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:27.068268 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-59bb9e56-158f-4dd6-b5b7-89be65aa1746 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Could not find group: 31f46d7e6bdc4025b50f001cd0fa3b75.: keystone.exception.GroupNotFound: Could not find group: 31f46d7e6bdc4025b50f001cd0fa3b75. Dec 18 21:03:27.070637 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2816/5702] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:27 2021] GET /identity/v3/groups/31f46d7e6bdc4025b50f001cd0fa3b75 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:03:27.076039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fc27f-0646-4e4a-a3c0-c8beae47cdb2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:27.088910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fc27f-0646-4e4a-a3c0-c8beae47cdb2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:27.095642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8bf32-a7b1-4fa3-a3e0-7217a4450980 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:27.097349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8bf32-a7b1-4fa3-a3e0-7217a4450980 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:27.097898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8bf32-a7b1-4fa3-a3e0-7217a4450980 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:27.098494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8bf32-a7b1-4fa3-a3e0-7217a4450980 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/groups/31f46d7e6bdc4025b50f001cd0fa3b75` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:27.108117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8bf32-a7b1-4fa3-a3e0-7217a4450980 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:03:27.119154 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-d9f8bf32-a7b1-4fa3-a3e0-7217a4450980 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Could not find group: 31f46d7e6bdc4025b50f001cd0fa3b75.: keystone.exception.GroupNotFound: Could not find group: 31f46d7e6bdc4025b50f001cd0fa3b75. Dec 18 21:03:27.120516 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2887/5703] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 21:03:27 2021] DELETE /identity/v3/groups/31f46d7e6bdc4025b50f001cd0fa3b75 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:03:27.125482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb9e56-158f-4dd6-b5b7-89be65aa1746 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:27.136301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb9e56-158f-4dd6-b5b7-89be65aa1746 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:27.141773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866f051-843d-456c-acc4-e0feefabb820 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:27.143005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866f051-843d-456c-acc4-e0feefabb820 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:27.143816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866f051-843d-456c-acc4-e0feefabb820 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:27.144319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866f051-843d-456c-acc4-e0feefabb820 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/users/da7e49ceccc948efa9d44d4109ad99cc` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:27.154838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866f051-843d-456c-acc4-e0feefabb820 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:delete_user(user_id=da7e49ceccc948efa9d44d4109ad99cc)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:27.156725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866f051-843d-456c-acc4-e0feefabb820 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:27.186868 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-f866f051-843d-456c-acc4-e0feefabb820 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Could not find user: da7e49ceccc948efa9d44d4109ad99cc.: keystone.exception.UserNotFound: Could not find user: da7e49ceccc948efa9d44d4109ad99cc. Dec 18 21:03:27.188372 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2817/5704] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:27 2021] DELETE /identity/v3/users/da7e49ceccc948efa9d44d4109ad99cc => generated 110 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:03:27.192849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8bf32-a7b1-4fa3-a3e0-7217a4450980 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:27.214187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8bf32-a7b1-4fa3-a3e0-7217a4450980 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:27.220862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95163406-b3e5-4379-82ce-fa1ff6dc922a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:27.221734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95163406-b3e5-4379-82ce-fa1ff6dc922a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:27.222231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95163406-b3e5-4379-82ce-fa1ff6dc922a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:27.222709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95163406-b3e5-4379-82ce-fa1ff6dc922a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/a2959e394e9a4c258dc74ad2bb8ae384` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:27.233035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95163406-b3e5-4379-82ce-fa1ff6dc922a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:03:27.244284 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-95163406-b3e5-4379-82ce-fa1ff6dc922a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Could not find domain: a2959e394e9a4c258dc74ad2bb8ae384.: keystone.exception.DomainNotFound: Could not find domain: a2959e394e9a4c258dc74ad2bb8ae384. Dec 18 21:03:27.250742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866f051-843d-456c-acc4-e0feefabb820 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:27.256287 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2888/5705] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:03:27 2021] PATCH /identity/v3/domains/a2959e394e9a4c258dc74ad2bb8ae384 => generated 112 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:03:27.261904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866f051-843d-456c-acc4-e0feefabb820 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:27.269356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b292d1-6d17-4d54-a786-3d0965f6d9a9 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:27.270452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b292d1-6d17-4d54-a786-3d0965f6d9a9 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:27.270930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b292d1-6d17-4d54-a786-3d0965f6d9a9 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:27.271375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b292d1-6d17-4d54-a786-3d0965f6d9a9 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:27.272321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b292d1-6d17-4d54-a786-3d0965f6d9a9 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:27.275288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b292d1-6d17-4d54-a786-3d0965f6d9a9 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:27.295277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95163406-b3e5-4379-82ce-fa1ff6dc922a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:27.296264 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2818/5706] 10.222.0.13 () {58 vars in 1127 bytes} [Sat Dec 18 21:03:27 2021] GET /identity/v3/domains => generated 1347 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:03:27.306910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95163406-b3e5-4379-82ce-fa1ff6dc922a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:27.313449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83e8f4-89e7-472a-a902-d3dfde605aa3 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:27.314374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83e8f4-89e7-472a-a902-d3dfde605aa3 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:27.314841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83e8f4-89e7-472a-a902-d3dfde605aa3 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:27.315284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83e8f4-89e7-472a-a902-d3dfde605aa3 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:27.316186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83e8f4-89e7-472a-a902-d3dfde605aa3 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:27.316978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83e8f4-89e7-472a-a902-d3dfde605aa3 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:27.318967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83e8f4-89e7-472a-a902-d3dfde605aa3 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:27.346300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b292d1-6d17-4d54-a786-3d0965f6d9a9 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:27.347575 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2889/5707] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:03:27 2021] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:27.360360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b292d1-6d17-4d54-a786-3d0965f6d9a9 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:27.366663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce1afc-bfd7-4751-a652-e6370fcd1c59 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:27.368560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce1afc-bfd7-4751-a652-e6370fcd1c59 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:27.369071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce1afc-bfd7-4751-a652-e6370fcd1c59 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:27.369362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce1afc-bfd7-4751-a652-e6370fcd1c59 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:27.370425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce1afc-bfd7-4751-a652-e6370fcd1c59 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-831657027) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:27.370905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce1afc-bfd7-4751-a652-e6370fcd1c59 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:27.372987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce1afc-bfd7-4751-a652-e6370fcd1c59 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:27.387055 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2819/5708] 10.222.0.13 () {58 vars in 1196 bytes} [Sat Dec 18 21:03:27 2021] GET /identity/v3/domains?name=tempest-test_domain-831657027 => generated 407 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:27.392445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83e8f4-89e7-472a-a902-d3dfde605aa3 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:27.407875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83e8f4-89e7-472a-a902-d3dfde605aa3 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:27.415970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fa2e2-e0f3-414d-857a-bb8725bbc640 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:27.417231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fa2e2-e0f3-414d-857a-bb8725bbc640 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:27.417812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fa2e2-e0f3-414d-857a-bb8725bbc640 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:27.418481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fa2e2-e0f3-414d-857a-bb8725bbc640 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/a2959e394e9a4c258dc74ad2bb8ae384` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:27.430721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fa2e2-e0f3-414d-857a-bb8725bbc640 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:03:27.443917 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-360fa2e2-e0f3-414d-857a-bb8725bbc640 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Could not find domain: a2959e394e9a4c258dc74ad2bb8ae384.: keystone.exception.DomainNotFound: Could not find domain: a2959e394e9a4c258dc74ad2bb8ae384. Dec 18 21:03:27.450293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce1afc-bfd7-4751-a652-e6370fcd1c59 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:27.451468 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2890/5709] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:03:27 2021] PATCH /identity/v3/domains/a2959e394e9a4c258dc74ad2bb8ae384 => generated 112 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:03:27.465710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce1afc-bfd7-4751-a652-e6370fcd1c59 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:27.473076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d58f7-6185-44ba-86a0-5ba8cf49ec4e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:27.475087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d58f7-6185-44ba-86a0-5ba8cf49ec4e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:27.475743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d58f7-6185-44ba-86a0-5ba8cf49ec4e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:27.476249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d58f7-6185-44ba-86a0-5ba8cf49ec4e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/53f9728b5dfe4296bed154da8a5f0679` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:27.495748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d58f7-6185-44ba-86a0-5ba8cf49ec4e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=53f9728b5dfe4296bed154da8a5f0679)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:27.498948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d58f7-6185-44ba-86a0-5ba8cf49ec4e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:27.571544 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2820/5710] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:03:27 2021] PATCH /identity/v3/domains/53f9728b5dfe4296bed154da8a5f0679 => generated 277 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:03:27.573227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fa2e2-e0f3-414d-857a-bb8725bbc640 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:27.596918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fa2e2-e0f3-414d-857a-bb8725bbc640 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:27.606773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:27.607912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:27.608409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:27.608691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/53f9728b5dfe4296bed154da8a5f0679` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:27.622121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=53f9728b5dfe4296bed154da8a5f0679)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:27.624267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:27.662882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '53f9728b5dfe4296bed154da8a5f0679'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:27.669505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '53f9728b5dfe4296bed154da8a5f0679'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:27.768836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f9728b5dfe4296bed154da8a5f0679', 'request_id': 'req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:27.782799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f9728b5dfe4296bed154da8a5f0679', 'request_id': 'req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:27.795846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f9728b5dfe4296bed154da8a5f0679', 'request_id': 'req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:27.818060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] The token cache is being invalidate because project 53f9728b5dfe4296bed154da8a5f0679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:27.818543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:27.819751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:27.833635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '53f9728b5dfe4296bed154da8a5f0679', 'request_id': 'req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:27.837818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '53f9728b5dfe4296bed154da8a5f0679', 'request_id': 'req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:27.838615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '53f9728b5dfe4296bed154da8a5f0679', 'request_id': 'req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:27.849324 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2891/5711] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:03:27 2021] DELETE /identity/v3/domains/53f9728b5dfe4296bed154da8a5f0679 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:27.851959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d58f7-6185-44ba-86a0-5ba8cf49ec4e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:27.853925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a36d58f7-6185-44ba-86a0-5ba8cf49ec4e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:27.868168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d58f7-6185-44ba-86a0-5ba8cf49ec4e tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:27.945965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f36c2a-43c8-4c0e-9527-1036b5a1446a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:27.946848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f36c2a-43c8-4c0e-9527-1036b5a1446a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:27.947360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f36c2a-43c8-4c0e-9527-1036b5a1446a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:27.949834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f36c2a-43c8-4c0e-9527-1036b5a1446a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/9ef4054b61284b1d98036c01fa131e6f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:27.968310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f36c2a-43c8-4c0e-9527-1036b5a1446a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9ef4054b61284b1d98036c01fa131e6f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:27.972287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f36c2a-43c8-4c0e-9527-1036b5a1446a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:28.005657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-69f36c2a-43c8-4c0e-9527-1036b5a1446a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9ef4054b61284b1d98036c01fa131e6f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.006774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-69f36c2a-43c8-4c0e-9527-1036b5a1446a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9ef4054b61284b1d98036c01fa131e6f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.041545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-69f36c2a-43c8-4c0e-9527-1036b5a1446a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9ef4054b61284b1d98036c01fa131e6f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.042501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-69f36c2a-43c8-4c0e-9527-1036b5a1446a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9ef4054b61284b1d98036c01fa131e6f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.046706 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2821/5712] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:03:27 2021] PATCH /identity/v3/domains/9ef4054b61284b1d98036c01fa131e6f => generated 277 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:28.050383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:28.064979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb8e88-de6f-4fd8-b23a-d7e0dc5a40a1 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:28.170366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:28.171697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:28.172173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:28.173416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/9ef4054b61284b1d98036c01fa131e6f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:28.190553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9ef4054b61284b1d98036c01fa131e6f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:28.192627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:28.228458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f36c2a-43c8-4c0e-9527-1036b5a1446a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:28.230036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-69f36c2a-43c8-4c0e-9527-1036b5a1446a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:28.247137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9ef4054b61284b1d98036c01fa131e6f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.266601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9ef4054b61284b1d98036c01fa131e6f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.368651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f36c2a-43c8-4c0e-9527-1036b5a1446a tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:28.368868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef4054b61284b1d98036c01fa131e6f', 'request_id': 'req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.382275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef4054b61284b1d98036c01fa131e6f', 'request_id': 'req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.402530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef4054b61284b1d98036c01fa131e6f', 'request_id': 'req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.419296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] The token cache is being invalidate because project 9ef4054b61284b1d98036c01fa131e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:28.419761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.423884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.448169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9ef4054b61284b1d98036c01fa131e6f', 'request_id': 'req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.452221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9ef4054b61284b1d98036c01fa131e6f', 'request_id': 'req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.453087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9ef4054b61284b1d98036c01fa131e6f', 'request_id': 'req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.466352 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2892/5713] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:03:28 2021] DELETE /identity/v3/domains/9ef4054b61284b1d98036c01fa131e6f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:28.470445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:28.472206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:28.478659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee15255-99e0-4953-b305-5a4a79e55bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:28.479975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15255-99e0-4953-b305-5a4a79e55bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:28.480527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15255-99e0-4953-b305-5a4a79e55bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:28.481058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15255-99e0-4953-b305-5a4a79e55bcc admin admin] PATH_INFO: `/v3/users/1a062c1000f94164ac8da89a383c22e0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:28.482739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee15255-99e0-4953-b305-5a4a79e55bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a062c1000f94164ac8da89a383c22e0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:28.485557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee15255-99e0-4953-b305-5a4a79e55bcc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:28.584000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-aee15255-99e0-4953-b305-5a4a79e55bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a062c1000f94164ac8da89a383c22e0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.595449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-aee15255-99e0-4953-b305-5a4a79e55bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a062c1000f94164ac8da89a383c22e0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.611575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-aee15255-99e0-4953-b305-5a4a79e55bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a062c1000f94164ac8da89a383c22e0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.612654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-aee15255-99e0-4953-b305-5a4a79e55bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a062c1000f94164ac8da89a383c22e0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.614878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4f93d-7614-4e37-8edf-0d47c6d9dff2 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:28.627616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c707766-f72c-4050-a336-510b87222466 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:28.628115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-aee15255-99e0-4953-b305-5a4a79e55bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a062c1000f94164ac8da89a383c22e0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.629944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c707766-f72c-4050-a336-510b87222466 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:28.631133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c707766-f72c-4050-a336-510b87222466 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:28.631641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c707766-f72c-4050-a336-510b87222466 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/9d38c9b622f348cb90eaced1a340a705` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:28.656732 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2822/5714] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:28 2021] DELETE /identity/v3/users/1a062c1000f94164ac8da89a383c22e0 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:28.671680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c707766-f72c-4050-a336-510b87222466 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9d38c9b622f348cb90eaced1a340a705)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:28.672211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c707766-f72c-4050-a336-510b87222466 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:28.673057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee15255-99e0-4953-b305-5a4a79e55bcc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:28.674834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-aee15255-99e0-4953-b305-5a4a79e55bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:28.729981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3c707766-f72c-4050-a336-510b87222466 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9d38c9b622f348cb90eaced1a340a705'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.731036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3c707766-f72c-4050-a336-510b87222466 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9d38c9b622f348cb90eaced1a340a705'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.811178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee15255-99e0-4953-b305-5a4a79e55bcc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:28.811769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3c707766-f72c-4050-a336-510b87222466 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9d38c9b622f348cb90eaced1a340a705'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.813287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3c707766-f72c-4050-a336-510b87222466 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9d38c9b622f348cb90eaced1a340a705'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:28.819354 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2893/5715] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:03:28 2021] PATCH /identity/v3/domains/9d38c9b622f348cb90eaced1a340a705 => generated 277 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:28.825144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c707766-f72c-4050-a336-510b87222466 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:28.826952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3c707766-f72c-4050-a336-510b87222466 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:28.954972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3894c63-e21a-4d91-ba58-b001f4b62ae4 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02a56803e34b46819ac4364d7bc597c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b90d455200e41bb9993ba97220341c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:28.956193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3894c63-e21a-4d91-ba58-b001f4b62ae4 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:28.956653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3894c63-e21a-4d91-ba58-b001f4b62ae4 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:28.957101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3894c63-e21a-4d91-ba58-b001f4b62ae4 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] PATH_INFO: `/v3/projects/581804fa4c984e1ba9352b897f27e135` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:28.958888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3894c63-e21a-4d91-ba58-b001f4b62ae4 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] RBAC: Authorizing `identity:delete_project(project_id=581804fa4c984e1ba9352b897f27e135)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:28.961890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3894c63-e21a-4d91-ba58-b001f4b62ae4 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:28.966437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c707766-f72c-4050-a336-510b87222466 tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:28.979064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b286c2615df4d0aa47a126f7c072ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2e124612d248a5b68852a9783e12fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:28.980419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:28.980786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:28.981161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] PATH_INFO: `/v3/domains/9d38c9b622f348cb90eaced1a340a705` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:29.034145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9d38c9b622f348cb90eaced1a340a705)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:29.036653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:29.079852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9d38c9b622f348cb90eaced1a340a705'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.092673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9d38c9b622f348cb90eaced1a340a705'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.114990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f3894c63-e21a-4d91-ba58-b001f4b62ae4 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581804fa4c984e1ba9352b897f27e135', 'request_id': 'req-f3894c63-e21a-4d91-ba58-b001f4b62ae4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.131480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f3894c63-e21a-4d91-ba58-b001f4b62ae4 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581804fa4c984e1ba9352b897f27e135', 'request_id': 'req-f3894c63-e21a-4d91-ba58-b001f4b62ae4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.152738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f3894c63-e21a-4d91-ba58-b001f4b62ae4 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581804fa4c984e1ba9352b897f27e135', 'request_id': 'req-f3894c63-e21a-4d91-ba58-b001f4b62ae4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.157977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d38c9b622f348cb90eaced1a340a705', 'request_id': 'req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.174653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f3894c63-e21a-4d91-ba58-b001f4b62ae4 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] The token cache is being invalidate because project 581804fa4c984e1ba9352b897f27e135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:29.175456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f3894c63-e21a-4d91-ba58-b001f4b62ae4 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.176196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f3894c63-e21a-4d91-ba58-b001f4b62ae4 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.176903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d38c9b622f348cb90eaced1a340a705', 'request_id': 'req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.177802 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2823/5716] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:28 2021] DELETE /identity/v3/projects/581804fa4c984e1ba9352b897f27e135 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:29.186589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3894c63-e21a-4d91-ba58-b001f4b62ae4 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:29.188164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f3894c63-e21a-4d91-ba58-b001f4b62ae4 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:29.194115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d38c9b622f348cb90eaced1a340a705', 'request_id': 'req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.240375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] The token cache is being invalidate because project 9d38c9b622f348cb90eaced1a340a705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:29.240777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.241539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.255188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9d38c9b622f348cb90eaced1a340a705', 'request_id': 'req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.260996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9d38c9b622f348cb90eaced1a340a705', 'request_id': 'req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.261789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9d38c9b622f348cb90eaced1a340a705', 'request_id': 'req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.268528 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2894/5717] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:03:28 2021] DELETE /identity/v3/domains/9d38c9b622f348cb90eaced1a340a705 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:29.271932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:29.273711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:29.381687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3894c63-e21a-4d91-ba58-b001f4b62ae4 tempest-QuotasNegativeTest-1690725948 tempest-QuotasNegativeTest-1690725948-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:29.388389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe85803-8843-400c-bae2-4f54e004f4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:29.389303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe85803-8843-400c-bae2-4f54e004f4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:29.389588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe85803-8843-400c-bae2-4f54e004f4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:29.389866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe85803-8843-400c-bae2-4f54e004f4d9 admin admin] PATH_INFO: `/v3/users/7fc40db170a94246b4c863e0d7659fd5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:29.391990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe85803-8843-400c-bae2-4f54e004f4d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc40db170a94246b4c863e0d7659fd5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:29.395583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be868b0-1a81-4fc8-8dc1-73ff95a4f3bd tempest-DomainsTestJSON-1721877988 tempest-DomainsTestJSON-1721877988-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:29.396090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe85803-8843-400c-bae2-4f54e004f4d9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:29.401987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b5ef6-b353-4f1c-8ca2-f527b5fb4723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:29.410476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b5ef6-b353-4f1c-8ca2-f527b5fb4723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:29.410769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b5ef6-b353-4f1c-8ca2-f527b5fb4723 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:29.411060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b5ef6-b353-4f1c-8ca2-f527b5fb4723 admin admin] PATH_INFO: `/v3/users/1e1b8a8c4644444a9c01421ccb373741` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:29.412444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b5ef6-b353-4f1c-8ca2-f527b5fb4723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e1b8a8c4644444a9c01421ccb373741)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:29.414476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b5ef6-b353-4f1c-8ca2-f527b5fb4723 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:29.481604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-796b5ef6-b353-4f1c-8ca2-f527b5fb4723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e1b8a8c4644444a9c01421ccb373741'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.495178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-796b5ef6-b353-4f1c-8ca2-f527b5fb4723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e1b8a8c4644444a9c01421ccb373741'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.496098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-796b5ef6-b353-4f1c-8ca2-f527b5fb4723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e1b8a8c4644444a9c01421ccb373741'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.499719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4fe85803-8843-400c-bae2-4f54e004f4d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc40db170a94246b4c863e0d7659fd5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.514531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4fe85803-8843-400c-bae2-4f54e004f4d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc40db170a94246b4c863e0d7659fd5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.519894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-796b5ef6-b353-4f1c-8ca2-f527b5fb4723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e1b8a8c4644444a9c01421ccb373741'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.533173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-796b5ef6-b353-4f1c-8ca2-f527b5fb4723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e1b8a8c4644444a9c01421ccb373741'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.535129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4fe85803-8843-400c-bae2-4f54e004f4d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc40db170a94246b4c863e0d7659fd5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.535875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4fe85803-8843-400c-bae2-4f54e004f4d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc40db170a94246b4c863e0d7659fd5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.549414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4fe85803-8843-400c-bae2-4f54e004f4d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc40db170a94246b4c863e0d7659fd5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:29.552424 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2895/5718] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:29 2021] DELETE /identity/v3/users/1e1b8a8c4644444a9c01421ccb373741 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:29.556246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eb488-743c-4bef-8fd1-4c4ba9a3a9d7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:29.556553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eb488-743c-4bef-8fd1-4c4ba9a3a9d7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:29.558193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eb488-743c-4bef-8fd1-4c4ba9a3a9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:29.559122 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2824/5719] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:29 2021] DELETE /identity/v3/users/7fc40db170a94246b4c863e0d7659fd5 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:29.563466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096a9f9-9f5c-4ad8-a006-dc6577c989fe None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:29.563881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096a9f9-9f5c-4ad8-a006-dc6577c989fe None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:29.564257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096a9f9-9f5c-4ad8-a006-dc6577c989fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:29.584055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9096a9f9-9f5c-4ad8-a006-dc6577c989fe None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:29.585388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9096a9f9-9f5c-4ad8-a006-dc6577c989fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:29.591169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-221eb488-743c-4bef-8fd1-4c4ba9a3a9d7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:29.592673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-221eb488-743c-4bef-8fd1-4c4ba9a3a9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:29.673363 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2825/5720] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:03:29.684166 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2896/5721] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:29.715909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096a9f9-9f5c-4ad8-a006-dc6577c989fe None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:29.717440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9096a9f9-9f5c-4ad8-a006-dc6577c989fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:29.727586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221eb488-743c-4bef-8fd1-4c4ba9a3a9d7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:29.731002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-221eb488-743c-4bef-8fd1-4c4ba9a3a9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:29.847392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096a9f9-9f5c-4ad8-a006-dc6577c989fe None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:29.856213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326c82a-95b0-4910-bea0-de1de41e1568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:29.857780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326c82a-95b0-4910-bea0-de1de41e1568 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:29.857780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326c82a-95b0-4910-bea0-de1de41e1568 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:29.857780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326c82a-95b0-4910-bea0-de1de41e1568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:29.864406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221eb488-743c-4bef-8fd1-4c4ba9a3a9d7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:29.894923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86472777-0402-45be-bb75-58982237213e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:29.895481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326c82a-95b0-4910-bea0-de1de41e1568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:29.896285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86472777-0402-45be-bb75-58982237213e service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:29.898600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86472777-0402-45be-bb75-58982237213e service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:29.899184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326c82a-95b0-4910-bea0-de1de41e1568 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:29.899742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86472777-0402-45be-bb75-58982237213e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:29.921149 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2826/5722] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:29.922270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326c82a-95b0-4910-bea0-de1de41e1568 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:29.925658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b326c82a-95b0-4910-bea0-de1de41e1568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:29.926954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86472777-0402-45be-bb75-58982237213e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:29.928734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86472777-0402-45be-bb75-58982237213e service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:29.958640 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2897/5723] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:29.968302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326c82a-95b0-4910-bea0-de1de41e1568 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:29.984616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cbe1e-5063-4a4e-b7f9-93adfce3f4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:29.985517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cbe1e-5063-4a4e-b7f9-93adfce3f4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:29.985806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cbe1e-5063-4a4e-b7f9-93adfce3f4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:29.986091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cbe1e-5063-4a4e-b7f9-93adfce3f4ec admin admin] PATH_INFO: `/v3/projects/6e12ada67cbd430bbf671d34c0cc74f3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:29.989938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1cbe1e-5063-4a4e-b7f9-93adfce3f4ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e12ada67cbd430bbf671d34c0cc74f3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:29.996312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1cbe1e-5063-4a4e-b7f9-93adfce3f4ec admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:30.090463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8d1cbe1e-5063-4a4e-b7f9-93adfce3f4ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e12ada67cbd430bbf671d34c0cc74f3', 'request_id': 'req-8d1cbe1e-5063-4a4e-b7f9-93adfce3f4ec'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:30.099692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8d1cbe1e-5063-4a4e-b7f9-93adfce3f4ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e12ada67cbd430bbf671d34c0cc74f3', 'request_id': 'req-8d1cbe1e-5063-4a4e-b7f9-93adfce3f4ec'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:30.108119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8d1cbe1e-5063-4a4e-b7f9-93adfce3f4ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e12ada67cbd430bbf671d34c0cc74f3', 'request_id': 'req-8d1cbe1e-5063-4a4e-b7f9-93adfce3f4ec'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:30.162630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8d1cbe1e-5063-4a4e-b7f9-93adfce3f4ec admin admin] The token cache is being invalidate because project 6e12ada67cbd430bbf671d34c0cc74f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:30.164349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8d1cbe1e-5063-4a4e-b7f9-93adfce3f4ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:30.165774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8d1cbe1e-5063-4a4e-b7f9-93adfce3f4ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:30.168007 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2827/5724] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:29 2021] DELETE /identity/v3/projects/6e12ada67cbd430bbf671d34c0cc74f3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:30.174219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a47cf-1202-4bd6-ad1c-df52bd190219 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:30.174816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a47cf-1202-4bd6-ad1c-df52bd190219 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:30.175289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a47cf-1202-4bd6-ad1c-df52bd190219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:30.218021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-eb6a47cf-1202-4bd6-ad1c-df52bd190219 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:30.222942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-eb6a47cf-1202-4bd6-ad1c-df52bd190219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:30.333061 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2898/5725] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:30.341181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975679ce-14e0-480f-bf06-a0686beaf74f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:30.343774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975679ce-14e0-480f-bf06-a0686beaf74f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:30.344302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975679ce-14e0-480f-bf06-a0686beaf74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:30.366162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-975679ce-14e0-480f-bf06-a0686beaf74f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:30.367600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-975679ce-14e0-480f-bf06-a0686beaf74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:30.400565 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2828/5726] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:30.404976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a47cf-1202-4bd6-ad1c-df52bd190219 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:30.420546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a47cf-1202-4bd6-ad1c-df52bd190219 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:30.431543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466d60a-145d-4467-9e95-45d7f44f5f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:30.432220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466d60a-145d-4467-9e95-45d7f44f5f75 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:30.432510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466d60a-145d-4467-9e95-45d7f44f5f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:30.432791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466d60a-145d-4467-9e95-45d7f44f5f75 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:30.433763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466d60a-145d-4467-9e95-45d7f44f5f75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:30.434081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466d60a-145d-4467-9e95-45d7f44f5f75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:30.436676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466d60a-145d-4467-9e95-45d7f44f5f75 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:30.467625 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2899/5727] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:03:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:30.472344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975679ce-14e0-480f-bf06-a0686beaf74f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:30.491353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975679ce-14e0-480f-bf06-a0686beaf74f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:30.502298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f5a2d-3469-440c-8505-6b35322d05d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:30.503068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5a2d-3469-440c-8505-6b35322d05d1 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:30.503437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5a2d-3469-440c-8505-6b35322d05d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:30.504057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5a2d-3469-440c-8505-6b35322d05d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:30.504842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f5a2d-3469-440c-8505-6b35322d05d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:30.510366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f5a2d-3469-440c-8505-6b35322d05d1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:30.574965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466d60a-145d-4467-9e95-45d7f44f5f75 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:30.587468 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2829/5728] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:30 2021] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:30.590284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466d60a-145d-4467-9e95-45d7f44f5f75 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:30.731545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531bb29-46f6-48f1-a436-b04e17191cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:30.741276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531bb29-46f6-48f1-a436-b04e17191cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:30.741640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531bb29-46f6-48f1-a436-b04e17191cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:30.742437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531bb29-46f6-48f1-a436-b04e17191cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:30.743213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531bb29-46f6-48f1-a436-b04e17191cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:30.745190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531bb29-46f6-48f1-a436-b04e17191cc9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:30.797395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f5a2d-3469-440c-8505-6b35322d05d1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:30.807159 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2900/5729] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:30 2021] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:03:30.823476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f5a2d-3469-440c-8505-6b35322d05d1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:30.832250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f7de1-de56-4a3f-a280-847d3313945e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:30.832948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f7de1-de56-4a3f-a280-847d3313945e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:30.833230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f7de1-de56-4a3f-a280-847d3313945e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:30.833516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f7de1-de56-4a3f-a280-847d3313945e admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:30.834284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f7de1-de56-4a3f-a280-847d3313945e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:30.839096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f7de1-de56-4a3f-a280-847d3313945e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:30.874600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531bb29-46f6-48f1-a436-b04e17191cc9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:30.881326 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2830/5730] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:30 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:30.885835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531bb29-46f6-48f1-a436-b04e17191cc9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:30.901647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a5177-c9a6-4f43-a49c-8e6c5aae702a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:30.902225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5177-c9a6-4f43-a49c-8e6c5aae702a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:30.902538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5177-c9a6-4f43-a49c-8e6c5aae702a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:30.902822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5177-c9a6-4f43-a49c-8e6c5aae702a admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:30.903575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a5177-c9a6-4f43-a49c-8e6c5aae702a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:30.906105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a5177-c9a6-4f43-a49c-8e6c5aae702a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:30.936674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f7de1-de56-4a3f-a280-847d3313945e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:30.937110 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2901/5731] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:30 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:30.948389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f7de1-de56-4a3f-a280-847d3313945e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:30.968440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6e797-4a50-493b-9667-ff38d570fa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:30.969363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6e797-4a50-493b-9667-ff38d570fa82 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:30.969650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6e797-4a50-493b-9667-ff38d570fa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:30.969934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6e797-4a50-493b-9667-ff38d570fa82 admin admin] PATH_INFO: `/v3/projects/58d1ab8b81784fb2ad1b6c9a7d9efc37/users/0a98795bdb7447c5b2a4930173b3c56d/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:31.004250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6e797-4a50-493b-9667-ff38d570fa82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d1ab8b81784fb2ad1b6c9a7d9efc37, user_id=0a98795bdb7447c5b2a4930173b3c56d, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:31.007286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6e797-4a50-493b-9667-ff38d570fa82 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:31.034770 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2831/5732] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:30 2021] PUT /identity/v3/projects/58d1ab8b81784fb2ad1b6c9a7d9efc37/users/0a98795bdb7447c5b2a4930173b3c56d/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:31.039702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b58b7-5177-47d1-b805-d08a33d62d2d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:31.040146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b58b7-5177-47d1-b805-d08a33d62d2d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:31.040529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b58b7-5177-47d1-b805-d08a33d62d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:31.071532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-cc5b58b7-5177-47d1-b805-d08a33d62d2d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:31.072884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cc5b58b7-5177-47d1-b805-d08a33d62d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:31.166555 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2902/5733] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:03:31.178992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6e797-4a50-493b-9667-ff38d570fa82 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:31.182669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-46a6e797-4a50-493b-9667-ff38d570fa82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:31.195068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b58b7-5177-47d1-b805-d08a33d62d2d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:31.198414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cc5b58b7-5177-47d1-b805-d08a33d62d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:31.201882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6e797-4a50-493b-9667-ff38d570fa82 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:31.213572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:31.215714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:31.217026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:31.218219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899 admin admin] PATH_INFO: `/v3/projects/6654167275ce4b90ba5822487002c182` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:31.221648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6654167275ce4b90ba5822487002c182)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:31.225897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:31.328192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b58b7-5177-47d1-b805-d08a33d62d2d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:31.332503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6654167275ce4b90ba5822487002c182', 'request_id': 'req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:31.346308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6654167275ce4b90ba5822487002c182', 'request_id': 'req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:31.360407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6654167275ce4b90ba5822487002c182', 'request_id': 'req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:31.384945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899 admin admin] The token cache is being invalidate because project 6654167275ce4b90ba5822487002c182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:31.385234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:31.388819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:31.391094 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2832/5734] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:31 2021] DELETE /identity/v3/projects/6654167275ce4b90ba5822487002c182 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:31.393441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:31.398520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:31.445150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04edd85-5766-4d93-b8f6-87b69f6e8876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:31.445853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04edd85-5766-4d93-b8f6-87b69f6e8876 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:31.446056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04edd85-5766-4d93-b8f6-87b69f6e8876 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:31.446318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04edd85-5766-4d93-b8f6-87b69f6e8876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:31.454137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f04edd85-5766-4d93-b8f6-87b69f6e8876 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:31.595322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f03da-7fbc-42e4-bd47-27fc4e9f1899 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:31.610004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94485b-f5cc-43b5-af55-126ad81b52e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:31.616100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94485b-f5cc-43b5-af55-126ad81b52e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:31.616100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94485b-f5cc-43b5-af55-126ad81b52e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:31.616100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94485b-f5cc-43b5-af55-126ad81b52e1 admin admin] PATH_INFO: `/v3/projects/0640b386883942e2aae48b0a074ef2fd` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:31.617674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94485b-f5cc-43b5-af55-126ad81b52e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0640b386883942e2aae48b0a074ef2fd)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:31.624130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94485b-f5cc-43b5-af55-126ad81b52e1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:31.657690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04edd85-5766-4d93-b8f6-87b69f6e8876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:31.663583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04edd85-5766-4d93-b8f6-87b69f6e8876 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:31.685266 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2903/5735] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:31.686512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04edd85-5766-4d93-b8f6-87b69f6e8876 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:31.691268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f04edd85-5766-4d93-b8f6-87b69f6e8876 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:31.719592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ee94485b-f5cc-43b5-af55-126ad81b52e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0640b386883942e2aae48b0a074ef2fd', 'request_id': 'req-ee94485b-f5cc-43b5-af55-126ad81b52e1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:31.728921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04edd85-5766-4d93-b8f6-87b69f6e8876 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:31.738966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ee94485b-f5cc-43b5-af55-126ad81b52e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0640b386883942e2aae48b0a074ef2fd', 'request_id': 'req-ee94485b-f5cc-43b5-af55-126ad81b52e1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:31.752700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ee94485b-f5cc-43b5-af55-126ad81b52e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0640b386883942e2aae48b0a074ef2fd', 'request_id': 'req-ee94485b-f5cc-43b5-af55-126ad81b52e1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:31.780758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ee94485b-f5cc-43b5-af55-126ad81b52e1 admin admin] The token cache is being invalidate because project 0640b386883942e2aae48b0a074ef2fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:31.782404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ee94485b-f5cc-43b5-af55-126ad81b52e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:31.786284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ee94485b-f5cc-43b5-af55-126ad81b52e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:31.801679 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2833/5736] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:31 2021] DELETE /identity/v3/projects/0640b386883942e2aae48b0a074ef2fd => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:31.811461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94485b-f5cc-43b5-af55-126ad81b52e1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:31.811706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758e59d-be50-4060-810b-3ce77f6b1743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:31.812869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758e59d-be50-4060-810b-3ce77f6b1743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:31.813158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758e59d-be50-4060-810b-3ce77f6b1743 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:31.813641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758e59d-be50-4060-810b-3ce77f6b1743 admin admin] PATH_INFO: `/v3/users/02a56803e34b46819ac4364d7bc597c5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:31.814552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ee94485b-f5cc-43b5-af55-126ad81b52e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:31.815288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758e59d-be50-4060-810b-3ce77f6b1743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a56803e34b46819ac4364d7bc597c5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:31.817609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758e59d-be50-4060-810b-3ce77f6b1743 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:31.832923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94485b-f5cc-43b5-af55-126ad81b52e1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:31.842508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143122b6-7e3c-4c83-b262-0eb273a5c918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:31.843660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143122b6-7e3c-4c83-b262-0eb273a5c918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:31.844182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143122b6-7e3c-4c83-b262-0eb273a5c918 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:31.845857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143122b6-7e3c-4c83-b262-0eb273a5c918 admin admin] PATH_INFO: `/v3/users/4b286c2615df4d0aa47a126f7c072ad6` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:31.847780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143122b6-7e3c-4c83-b262-0eb273a5c918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b286c2615df4d0aa47a126f7c072ad6)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:31.863813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143122b6-7e3c-4c83-b262-0eb273a5c918 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:31.914523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7758e59d-be50-4060-810b-3ce77f6b1743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a56803e34b46819ac4364d7bc597c5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:31.932460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7758e59d-be50-4060-810b-3ce77f6b1743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a56803e34b46819ac4364d7bc597c5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:31.934120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7758e59d-be50-4060-810b-3ce77f6b1743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a56803e34b46819ac4364d7bc597c5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:31.971302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7758e59d-be50-4060-810b-3ce77f6b1743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a56803e34b46819ac4364d7bc597c5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:31.985047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-143122b6-7e3c-4c83-b262-0eb273a5c918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b286c2615df4d0aa47a126f7c072ad6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:31.993210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7758e59d-be50-4060-810b-3ce77f6b1743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a56803e34b46819ac4364d7bc597c5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:31.997627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-143122b6-7e3c-4c83-b262-0eb273a5c918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b286c2615df4d0aa47a126f7c072ad6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:32.001179 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2904/5737] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:31 2021] DELETE /identity/v3/users/02a56803e34b46819ac4364d7bc597c5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:32.028899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-143122b6-7e3c-4c83-b262-0eb273a5c918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b286c2615df4d0aa47a126f7c072ad6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:32.029773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-143122b6-7e3c-4c83-b262-0eb273a5c918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b286c2615df4d0aa47a126f7c072ad6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:32.040198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-143122b6-7e3c-4c83-b262-0eb273a5c918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b286c2615df4d0aa47a126f7c072ad6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:32.053108 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2834/5738] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:31 2021] DELETE /identity/v3/users/4b286c2615df4d0aa47a126f7c072ad6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:33.095468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758e59d-be50-4060-810b-3ce77f6b1743 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:33.099578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7758e59d-be50-4060-810b-3ce77f6b1743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:33.219154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143122b6-7e3c-4c83-b262-0eb273a5c918 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:33.220711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-143122b6-7e3c-4c83-b262-0eb273a5c918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:33.277431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758e59d-be50-4060-810b-3ce77f6b1743 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:33.364879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143122b6-7e3c-4c83-b262-0eb273a5c918 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:33.370920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f100d25-87a4-4853-877d-bb3a0727be78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:33.372138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f100d25-87a4-4853-877d-bb3a0727be78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:33.372585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f100d25-87a4-4853-877d-bb3a0727be78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:33.374128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f100d25-87a4-4853-877d-bb3a0727be78 admin admin] PATH_INFO: `/v3/projects/ed2e124612d248a5b68852a9783e12fb` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:33.375797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f100d25-87a4-4853-877d-bb3a0727be78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed2e124612d248a5b68852a9783e12fb)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:33.377867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f100d25-87a4-4853-877d-bb3a0727be78 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:33.421162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9a1dd-c799-4f12-897c-b6c801a56bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:33.424325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a1dd-c799-4f12-897c-b6c801a56bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:33.424822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a1dd-c799-4f12-897c-b6c801a56bed admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:33.425799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a1dd-c799-4f12-897c-b6c801a56bed admin admin] PATH_INFO: `/v3/projects/2b90d455200e41bb9993ba97220341c0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:33.428461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9a1dd-c799-4f12-897c-b6c801a56bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b90d455200e41bb9993ba97220341c0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:33.436519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9a1dd-c799-4f12-897c-b6c801a56bed admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:33.470426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f100d25-87a4-4853-877d-bb3a0727be78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed2e124612d248a5b68852a9783e12fb', 'request_id': 'req-7f100d25-87a4-4853-877d-bb3a0727be78'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:33.487140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f100d25-87a4-4853-877d-bb3a0727be78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed2e124612d248a5b68852a9783e12fb', 'request_id': 'req-7f100d25-87a4-4853-877d-bb3a0727be78'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:33.503366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f100d25-87a4-4853-877d-bb3a0727be78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed2e124612d248a5b68852a9783e12fb', 'request_id': 'req-7f100d25-87a4-4853-877d-bb3a0727be78'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:33.530007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f100d25-87a4-4853-877d-bb3a0727be78 admin admin] The token cache is being invalidate because project ed2e124612d248a5b68852a9783e12fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:33.553572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f100d25-87a4-4853-877d-bb3a0727be78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:33.556205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f100d25-87a4-4853-877d-bb3a0727be78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:33.563331 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2835/5739] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:33 2021] DELETE /identity/v3/projects/ed2e124612d248a5b68852a9783e12fb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:33.577624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7d01b-9c0c-478b-88c7-d5c3fd06fac9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:33.577624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7d01b-9c0c-478b-88c7-d5c3fd06fac9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:33.577624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7d01b-9c0c-478b-88c7-d5c3fd06fac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:33.598162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-72f9a1dd-c799-4f12-897c-b6c801a56bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b90d455200e41bb9993ba97220341c0', 'request_id': 'req-72f9a1dd-c799-4f12-897c-b6c801a56bed'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:33.605290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-72f9a1dd-c799-4f12-897c-b6c801a56bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b90d455200e41bb9993ba97220341c0', 'request_id': 'req-72f9a1dd-c799-4f12-897c-b6c801a56bed'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:33.617303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-72f9a1dd-c799-4f12-897c-b6c801a56bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b90d455200e41bb9993ba97220341c0', 'request_id': 'req-72f9a1dd-c799-4f12-897c-b6c801a56bed'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:33.620990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ebd7d01b-9c0c-478b-88c7-d5c3fd06fac9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:33.622940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ebd7d01b-9c0c-478b-88c7-d5c3fd06fac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:33.637638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-72f9a1dd-c799-4f12-897c-b6c801a56bed admin admin] The token cache is being invalidate because project 2b90d455200e41bb9993ba97220341c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:33.637638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-72f9a1dd-c799-4f12-897c-b6c801a56bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:33.639008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-72f9a1dd-c799-4f12-897c-b6c801a56bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:33.640892 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2905/5740] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:33 2021] DELETE /identity/v3/projects/2b90d455200e41bb9993ba97220341c0 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:33.644119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44e4e-d94c-45e8-a055-d07c840ca5a9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:33.644919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44e4e-d94c-45e8-a055-d07c840ca5a9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:33.644919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44e4e-d94c-45e8-a055-d07c840ca5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:33.690210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f4f44e4e-d94c-45e8-a055-d07c840ca5a9 None None] MFA Rules not processed for user `0a98795bdb7447c5b2a4930173b3c56d`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:33.692241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f4f44e4e-d94c-45e8-a055-d07c840ca5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:33.752226 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2836/5741] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:33.753347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2db12-90de-4923-abf4-8b9bb0094fbb None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:33.753814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2db12-90de-4923-abf4-8b9bb0094fbb None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:33.754100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2db12-90de-4923-abf4-8b9bb0094fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:33.792508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-58c2db12-90de-4923-abf4-8b9bb0094fbb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:33.793726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-58c2db12-90de-4923-abf4-8b9bb0094fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:33.796440 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2906/5742] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:33 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:33.797999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f69ff3-1f4e-433f-9805-4dfd39d8d5db None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:33.798277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f69ff3-1f4e-433f-9805-4dfd39d8d5db None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:33.802466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f69ff3-1f4e-433f-9805-4dfd39d8d5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:33.825744 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2837/5743] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:33.825744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2eb013-39f6-4a54-a025-4c93a662edae None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:33.825744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2eb013-39f6-4a54-a025-4c93a662edae None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:33.825744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2eb013-39f6-4a54-a025-4c93a662edae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:33.854567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e4f69ff3-1f4e-433f-9805-4dfd39d8d5db None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:33.857721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e4f69ff3-1f4e-433f-9805-4dfd39d8d5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:33.875937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ca2eb013-39f6-4a54-a025-4c93a662edae None None] MFA Rules not processed for user `0a98795bdb7447c5b2a4930173b3c56d`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:33.883343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ca2eb013-39f6-4a54-a025-4c93a662edae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:33.898143 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2907/5744] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:33.904243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c7576-e879-49c3-ab8d-061d51246da6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:33.904577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c7576-e879-49c3-ab8d-061d51246da6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:33.904790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c7576-e879-49c3-ab8d-061d51246da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:33.909252 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2838/5745] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:33 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:33.911541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2eb013-39f6-4a54-a025-4c93a662edae None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:33.932432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2eb013-39f6-4a54-a025-4c93a662edae None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:33.942071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fc4c7576-e879-49c3-ab8d-061d51246da6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:33.943334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fc4c7576-e879-49c3-ab8d-061d51246da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:33.956100 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2908/5746] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:33.957247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c7576-e879-49c3-ab8d-061d51246da6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:33.959929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fc4c7576-e879-49c3-ab8d-061d51246da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:33.962949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85478062-3ae9-4464-93b9-b8ae134a177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:33.964643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85478062-3ae9-4464-93b9-b8ae134a177e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:33.965112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85478062-3ae9-4464-93b9-b8ae134a177e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:33.965743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85478062-3ae9-4464-93b9-b8ae134a177e admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:33.967833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85478062-3ae9-4464-93b9-b8ae134a177e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:33.968519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85478062-3ae9-4464-93b9-b8ae134a177e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:33.971212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85478062-3ae9-4464-93b9-b8ae134a177e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:33.990871 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2839/5747] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:03:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:33.992626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85478062-3ae9-4464-93b9-b8ae134a177e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:34.007016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85478062-3ae9-4464-93b9-b8ae134a177e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:34.024555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2099a9-6e5e-4326-bd01-7e1a8f7762d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:34.025534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2099a9-6e5e-4326-bd01-7e1a8f7762d9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:34.026142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2099a9-6e5e-4326-bd01-7e1a8f7762d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:34.026659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2099a9-6e5e-4326-bd01-7e1a8f7762d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:34.027749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2099a9-6e5e-4326-bd01-7e1a8f7762d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:34.028246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2099a9-6e5e-4326-bd01-7e1a8f7762d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:34.030866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2099a9-6e5e-4326-bd01-7e1a8f7762d9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:34.061441 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2840/5748] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:03:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:34.064173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2099a9-6e5e-4326-bd01-7e1a8f7762d9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:34.079465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2099a9-6e5e-4326-bd01-7e1a8f7762d9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:34.085124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c7576-e879-49c3-ab8d-061d51246da6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:34.090140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93685f-e7e7-4932-9d73-bdadb12f10b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:34.092774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93685f-e7e7-4932-9d73-bdadb12f10b4 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:34.093940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb9b52-e2f3-4ef4-ae71-a57d8b2959bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:34.094849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb9b52-e2f3-4ef4-ae71-a57d8b2959bb service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:34.095274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb9b52-e2f3-4ef4-ae71-a57d8b2959bb service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:34.095657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb9b52-e2f3-4ef4-ae71-a57d8b2959bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:34.097376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93685f-e7e7-4932-9d73-bdadb12f10b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:34.097835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93685f-e7e7-4932-9d73-bdadb12f10b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:34.098643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93685f-e7e7-4932-9d73-bdadb12f10b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:34.100833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93685f-e7e7-4932-9d73-bdadb12f10b4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:34.112030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb9b52-e2f3-4ef4-ae71-a57d8b2959bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:34.116343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb9b52-e2f3-4ef4-ae71-a57d8b2959bb service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:34.134360 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2909/5749] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:33 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:34.136760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb9b52-e2f3-4ef4-ae71-a57d8b2959bb service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:34.153206 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2841/5750] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:34 2021] POST /identity/v3/projects => generated 365 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:34.157838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93685f-e7e7-4932-9d73-bdadb12f10b4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:34.161620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb9b52-e2f3-4ef4-ae71-a57d8b2959bb service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:34.297851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a717195-a264-4962-8643-228873fc6939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:34.298557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a717195-a264-4962-8643-228873fc6939 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:34.298858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a717195-a264-4962-8643-228873fc6939 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:34.299121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a717195-a264-4962-8643-228873fc6939 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:34.299832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a717195-a264-4962-8643-228873fc6939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:34.301828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a717195-a264-4962-8643-228873fc6939 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:34.310963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93685f-e7e7-4932-9d73-bdadb12f10b4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:34.326367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df186d-9280-4957-98bf-c0269c7f5ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:34.328864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df186d-9280-4957-98bf-c0269c7f5ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:34.331437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df186d-9280-4957-98bf-c0269c7f5ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:34.331919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df186d-9280-4957-98bf-c0269c7f5ec0 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:34.334633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df186d-9280-4957-98bf-c0269c7f5ec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:34.338571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df186d-9280-4957-98bf-c0269c7f5ec0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:34.369500 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2910/5751] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:34 2021] POST /identity/v3/projects => generated 397 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:34.370578 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2842/5752] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:34 2021] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:34.373055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a717195-a264-4962-8643-228873fc6939 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:34.374836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f15059-359e-4142-adca-336dd081b7e5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:34.375442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f15059-359e-4142-adca-336dd081b7e5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:34.378023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f15059-359e-4142-adca-336dd081b7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:34.431061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-31f15059-359e-4142-adca-336dd081b7e5 None None] MFA Rules not processed for user `0012ccb14865485192056087c9926493`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:34.432325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-31f15059-359e-4142-adca-336dd081b7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:34.548688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a717195-a264-4962-8643-228873fc6939 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:34.555993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00635d32-ddb7-471b-a994-d122c07d1fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:34.556687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00635d32-ddb7-471b-a994-d122c07d1fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:34.556974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00635d32-ddb7-471b-a994-d122c07d1fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:34.557254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00635d32-ddb7-471b-a994-d122c07d1fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:34.558155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00635d32-ddb7-471b-a994-d122c07d1fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:34.560285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00635d32-ddb7-471b-a994-d122c07d1fd3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:34.568856 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2843/5753] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:34 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:34.570210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f15059-359e-4142-adca-336dd081b7e5 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:34.583156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f15059-359e-4142-adca-336dd081b7e5 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:34.591088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4b9fa-0c19-4943-885b-bb0d38e73a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:34.592145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4b9fa-0c19-4943-885b-bb0d38e73a07 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:34.592750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4b9fa-0c19-4943-885b-bb0d38e73a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:34.593261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4b9fa-0c19-4943-885b-bb0d38e73a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:34.594197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4b9fa-0c19-4943-885b-bb0d38e73a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:34.596009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4b9fa-0c19-4943-885b-bb0d38e73a07 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:34.611031 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2844/5754] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:34 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:34.612965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35ae6d-6f3f-4566-9e29-f435d31e7cbc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:34.613491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35ae6d-6f3f-4566-9e29-f435d31e7cbc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:34.614046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35ae6d-6f3f-4566-9e29-f435d31e7cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:34.614180 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2911/5755] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:34 2021] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:34.616482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00635d32-ddb7-471b-a994-d122c07d1fd3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:34.630709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00635d32-ddb7-471b-a994-d122c07d1fd3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:34.639593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57550bf9-994a-4f43-9c29-a056b3e03de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:34.641073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57550bf9-994a-4f43-9c29-a056b3e03de8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:34.641679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57550bf9-994a-4f43-9c29-a056b3e03de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:34.642305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57550bf9-994a-4f43-9c29-a056b3e03de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:34.643439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57550bf9-994a-4f43-9c29-a056b3e03de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:34.656874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57550bf9-994a-4f43-9c29-a056b3e03de8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:34.659591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-af35ae6d-6f3f-4566-9e29-f435d31e7cbc None None] MFA Rules not processed for user `0012ccb14865485192056087c9926493`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:34.661245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-af35ae6d-6f3f-4566-9e29-f435d31e7cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:34.675297 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2845/5756] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:34 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:34.675297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35ae6d-6f3f-4566-9e29-f435d31e7cbc None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:34.681363 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2912/5757] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:34 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:34.682855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57550bf9-994a-4f43-9c29-a056b3e03de8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:34.701454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35ae6d-6f3f-4566-9e29-f435d31e7cbc None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:34.707293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447d503-d4ef-414a-a1a4-3a133ef3a3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:34.707981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447d503-d4ef-414a-a1a4-3a133ef3a3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:34.709003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57550bf9-994a-4f43-9c29-a056b3e03de8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:34.711502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447d503-d4ef-414a-a1a4-3a133ef3a3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:34.712061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447d503-d4ef-414a-a1a4-3a133ef3a3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:34.714986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447d503-d4ef-414a-a1a4-3a133ef3a3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:34.718532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447d503-d4ef-414a-a1a4-3a133ef3a3c9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:34.727968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649ae6c-1631-4e35-ae61-9865bcdd4783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:34.729109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649ae6c-1631-4e35-ae61-9865bcdd4783 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:34.729577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649ae6c-1631-4e35-ae61-9865bcdd4783 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:34.730032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649ae6c-1631-4e35-ae61-9865bcdd4783 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:34.731017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649ae6c-1631-4e35-ae61-9865bcdd4783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:34.732810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649ae6c-1631-4e35-ae61-9865bcdd4783 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:34.736276 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2846/5758] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:34 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:34.737072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447d503-d4ef-414a-a1a4-3a133ef3a3c9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:34.738958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d447d503-d4ef-414a-a1a4-3a133ef3a3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:34.764368 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2913/5759] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:34 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:34.764368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649ae6c-1631-4e35-ae61-9865bcdd4783 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:34.778083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649ae6c-1631-4e35-ae61-9865bcdd4783 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:34.786114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7929351-fb05-4a7e-a7b9-b77fe60fe1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:34.788098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929351-fb05-4a7e-a7b9-b77fe60fe1ad admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:34.788098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929351-fb05-4a7e-a7b9-b77fe60fe1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:34.788403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929351-fb05-4a7e-a7b9-b77fe60fe1ad admin admin] PATH_INFO: `/v3/projects/8656202655b0467281162f20b6bce6d5/users/afc216d30f724896b5fdcb270017c3bf/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:34.809887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7929351-fb05-4a7e-a7b9-b77fe60fe1ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8656202655b0467281162f20b6bce6d5, user_id=afc216d30f724896b5fdcb270017c3bf, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:34.813720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7929351-fb05-4a7e-a7b9-b77fe60fe1ad admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:34.834439 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2914/5760] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:34 2021] PUT /identity/v3/projects/8656202655b0467281162f20b6bce6d5/users/afc216d30f724896b5fdcb270017c3bf/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:34.835099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447d503-d4ef-414a-a1a4-3a133ef3a3c9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:34.836603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7929351-fb05-4a7e-a7b9-b77fe60fe1ad admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:34.926302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425412b-8530-40cb-8177-9f2ec35d1161 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:34.927197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425412b-8530-40cb-8177-9f2ec35d1161 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:34.927590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425412b-8530-40cb-8177-9f2ec35d1161 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:34.928629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425412b-8530-40cb-8177-9f2ec35d1161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:34.973275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7929351-fb05-4a7e-a7b9-b77fe60fe1ad admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:34.978894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe51ef-184a-4489-b041-af3419e52e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:34.980310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe51ef-184a-4489-b041-af3419e52e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:34.980633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe51ef-184a-4489-b041-af3419e52e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:34.980857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe51ef-184a-4489-b041-af3419e52e07 admin admin] PATH_INFO: `/v3/projects/08260505386449d88fefea317ecb38b0/users/7a3f4863c7464764bab18d742ec523c3/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:35.002235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe51ef-184a-4489-b041-af3419e52e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08260505386449d88fefea317ecb38b0, user_id=7a3f4863c7464764bab18d742ec523c3, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:35.005335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe51ef-184a-4489-b041-af3419e52e07 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:35.047309 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2915/5761] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:34 2021] PUT /identity/v3/projects/08260505386449d88fefea317ecb38b0/users/7a3f4863c7464764bab18d742ec523c3/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:35.047309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b776493-184c-4227-bc11-acec2547ae40 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:35.047309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b776493-184c-4227-bc11-acec2547ae40 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:35.047309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b776493-184c-4227-bc11-acec2547ae40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:35.056816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425412b-8530-40cb-8177-9f2ec35d1161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:35.058575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425412b-8530-40cb-8177-9f2ec35d1161 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:35.078928 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2847/5762] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:34 2021] GET /identity/v3/auth/tokens => generated 3262 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:35.080605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322d443-fbf6-4c53-bea9-23c926117952 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:35.081170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322d443-fbf6-4c53-bea9-23c926117952 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:35.082684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322d443-fbf6-4c53-bea9-23c926117952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:35.109320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7b776493-184c-4227-bc11-acec2547ae40 None None] MFA Rules not processed for user `afc216d30f724896b5fdcb270017c3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:35.110730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7b776493-184c-4227-bc11-acec2547ae40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:35.158689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a322d443-fbf6-4c53-bea9-23c926117952 None None] MFA Rules not processed for user `7a3f4863c7464764bab18d742ec523c3`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:35.160019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a322d443-fbf6-4c53-bea9-23c926117952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:35.271750 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2916/5763] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:35 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:35.274011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b776493-184c-4227-bc11-acec2547ae40 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:35.286916 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2848/5764] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:35 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:35.313636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322d443-fbf6-4c53-bea9-23c926117952 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:35.315495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a322d443-fbf6-4c53-bea9-23c926117952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:35.389375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b776493-184c-4227-bc11-acec2547ae40 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:35.396763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4eefa-e719-48d6-8eb4-b3dbf0fd1579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:35.397497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4eefa-e719-48d6-8eb4-b3dbf0fd1579 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:35.397788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4eefa-e719-48d6-8eb4-b3dbf0fd1579 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:35.399168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4eefa-e719-48d6-8eb4-b3dbf0fd1579 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:35.399963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4eefa-e719-48d6-8eb4-b3dbf0fd1579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:35.403303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4eefa-e719-48d6-8eb4-b3dbf0fd1579 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:35.420454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322d443-fbf6-4c53-bea9-23c926117952 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:35.429768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6560ea-a599-4b10-8132-1041caa91b87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:35.432552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6560ea-a599-4b10-8132-1041caa91b87 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:35.433028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6560ea-a599-4b10-8132-1041caa91b87 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:35.433405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6560ea-a599-4b10-8132-1041caa91b87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:35.449472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6560ea-a599-4b10-8132-1041caa91b87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:35.451092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6560ea-a599-4b10-8132-1041caa91b87 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:35.479039 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2849/5765] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:35 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:35.504289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6560ea-a599-4b10-8132-1041caa91b87 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:35.505192 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2917/5766] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:35 2021] POST /identity/v3/projects => generated 367 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:35.520981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6560ea-a599-4b10-8132-1041caa91b87 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:35.652282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98271a1b-78ce-458c-b501-18c79a49919a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:35.652798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271a1b-78ce-458c-b501-18c79a49919a admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:35.653092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271a1b-78ce-458c-b501-18c79a49919a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:35.653379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271a1b-78ce-458c-b501-18c79a49919a admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:35.654099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98271a1b-78ce-458c-b501-18c79a49919a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:35.656065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98271a1b-78ce-458c-b501-18c79a49919a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:35.730085 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2850/5767] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:35 2021] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:35.734234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4eefa-e719-48d6-8eb4-b3dbf0fd1579 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:35.749197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4eefa-e719-48d6-8eb4-b3dbf0fd1579 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:35.764704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2e0c3-2ce6-4994-bb1c-893a56533f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:35.767542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2e0c3-2ce6-4994-bb1c-893a56533f2f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:35.767962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2e0c3-2ce6-4994-bb1c-893a56533f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:35.768910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2e0c3-2ce6-4994-bb1c-893a56533f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:35.770244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2e0c3-2ce6-4994-bb1c-893a56533f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:35.772708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2e0c3-2ce6-4994-bb1c-893a56533f2f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:35.818507 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2918/5768] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:35 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:35.820640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98271a1b-78ce-458c-b501-18c79a49919a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:35.837288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98271a1b-78ce-458c-b501-18c79a49919a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:35.844211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397089e2-7706-4cb6-9bc8-4d8db59e44a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:35.845770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397089e2-7706-4cb6-9bc8-4d8db59e44a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:35.846839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397089e2-7706-4cb6-9bc8-4d8db59e44a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:35.847395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397089e2-7706-4cb6-9bc8-4d8db59e44a6 admin admin] PATH_INFO: `/v3/projects/54ceb95755374a6a9773cce13d251e93/users/7b958158ab2f4edd8072d799ffcef5f5/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:35.905316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397089e2-7706-4cb6-9bc8-4d8db59e44a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ceb95755374a6a9773cce13d251e93, user_id=7b958158ab2f4edd8072d799ffcef5f5, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:35.917779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397089e2-7706-4cb6-9bc8-4d8db59e44a6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:35.950336 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2851/5769] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:35 2021] PUT /identity/v3/projects/54ceb95755374a6a9773cce13d251e93/users/7b958158ab2f4edd8072d799ffcef5f5/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:35.954173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2e0c3-2ce6-4994-bb1c-893a56533f2f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:35.969484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2e0c3-2ce6-4994-bb1c-893a56533f2f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:36.124546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b39bf0-3734-4a5a-8251-0979b0e25b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:36.125394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b39bf0-3734-4a5a-8251-0979b0e25b73 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:36.125394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b39bf0-3734-4a5a-8251-0979b0e25b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:36.125601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b39bf0-3734-4a5a-8251-0979b0e25b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:36.126374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b39bf0-3734-4a5a-8251-0979b0e25b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:36.128010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b39bf0-3734-4a5a-8251-0979b0e25b73 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:36.160969 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2919/5770] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:35 2021] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:36.165529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397089e2-7706-4cb6-9bc8-4d8db59e44a6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:36.185186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397089e2-7706-4cb6-9bc8-4d8db59e44a6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:36.203637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6af9e-588c-4091-a722-4677143b74b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:36.205132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6af9e-588c-4091-a722-4677143b74b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:36.205427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6af9e-588c-4091-a722-4677143b74b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:36.205713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6af9e-588c-4091-a722-4677143b74b6 admin admin] PATH_INFO: `/v3/projects/54ceb95755374a6a9773cce13d251e93/users/7b958158ab2f4edd8072d799ffcef5f5/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:36.208613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6af9e-588c-4091-a722-4677143b74b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ceb95755374a6a9773cce13d251e93, user_id=7b958158ab2f4edd8072d799ffcef5f5, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:36.214766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6af9e-588c-4091-a722-4677143b74b6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:36.254186 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2852/5771] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:36 2021] PUT /identity/v3/projects/54ceb95755374a6a9773cce13d251e93/users/7b958158ab2f4edd8072d799ffcef5f5/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:36.266947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82a1af-141f-46ba-8798-a2e191e24352 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:36.267667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82a1af-141f-46ba-8798-a2e191e24352 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:36.268123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82a1af-141f-46ba-8798-a2e191e24352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:36.340260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5c82a1af-141f-46ba-8798-a2e191e24352 None None] MFA Rules not processed for user `7b958158ab2f4edd8072d799ffcef5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:36.344815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5c82a1af-141f-46ba-8798-a2e191e24352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:36.393828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6af9e-588c-4091-a722-4677143b74b6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:36.636575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6af9e-588c-4091-a722-4677143b74b6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:36.644097 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2920/5772] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:36 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:36.650046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82a1af-141f-46ba-8798-a2e191e24352 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:36.659031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61104f0-0796-459c-afa6-b4f78061179f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:36.659700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61104f0-0796-459c-afa6-b4f78061179f service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:36.659997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61104f0-0796-459c-afa6-b4f78061179f service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:36.660287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61104f0-0796-459c-afa6-b4f78061179f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:36.667733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c61104f0-0796-459c-afa6-b4f78061179f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:36.673804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82a1af-141f-46ba-8798-a2e191e24352 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:36.686112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d31519-2656-46de-86f6-b5f9ecdddd85 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:36.686112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d31519-2656-46de-86f6-b5f9ecdddd85 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:36.688224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d31519-2656-46de-86f6-b5f9ecdddd85 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:36.688548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d31519-2656-46de-86f6-b5f9ecdddd85 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:36.689745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d31519-2656-46de-86f6-b5f9ecdddd85 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:36.696365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d31519-2656-46de-86f6-b5f9ecdddd85 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:36.710337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61104f0-0796-459c-afa6-b4f78061179f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:36.712700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61104f0-0796-459c-afa6-b4f78061179f service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:36.735677 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2921/5773] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:03:36 2021] POST /identity/v3/roles => generated 235 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:36.745268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d31519-2656-46de-86f6-b5f9ecdddd85 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:36.755746 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2853/5774] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:36 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:36.766774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d31519-2656-46de-86f6-b5f9ecdddd85 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:36.774161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627c1ad-3fba-4a67-8aae-03ea6e2293ff tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:36.775004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627c1ad-3fba-4a67-8aae-03ea6e2293ff tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:36.775400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627c1ad-3fba-4a67-8aae-03ea6e2293ff tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:36.775845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627c1ad-3fba-4a67-8aae-03ea6e2293ff tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:36.777139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627c1ad-3fba-4a67-8aae-03ea6e2293ff tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:36.778742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627c1ad-3fba-4a67-8aae-03ea6e2293ff tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:36.801637 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2922/5775] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:03:36 2021] POST /identity/v3/roles => generated 234 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:36.805781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61104f0-0796-459c-afa6-b4f78061179f service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:36.827672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61104f0-0796-459c-afa6-b4f78061179f service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:36.839250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604893b2-7cf1-44f9-97df-b7dc219151c6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:36.839959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604893b2-7cf1-44f9-97df-b7dc219151c6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:36.840262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604893b2-7cf1-44f9-97df-b7dc219151c6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:36.840610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604893b2-7cf1-44f9-97df-b7dc219151c6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:36.841317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604893b2-7cf1-44f9-97df-b7dc219151c6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:36.842961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604893b2-7cf1-44f9-97df-b7dc219151c6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:36.876061 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2854/5776] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:03:36 2021] POST /identity/v3/roles => generated 235 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:36.880654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627c1ad-3fba-4a67-8aae-03ea6e2293ff tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:36.891335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627c1ad-3fba-4a67-8aae-03ea6e2293ff tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:36.906540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a819e0-fc80-4f23-afc3-6335dc924fde tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:36.907228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a819e0-fc80-4f23-afc3-6335dc924fde tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:36.907518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a819e0-fc80-4f23-afc3-6335dc924fde tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:36.907797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a819e0-fc80-4f23-afc3-6335dc924fde tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:36.908570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a819e0-fc80-4f23-afc3-6335dc924fde tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:36.910413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a819e0-fc80-4f23-afc3-6335dc924fde tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:36.944006 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2923/5777] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:03:36 2021] POST /identity/v3/domains => generated 276 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:36.948600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604893b2-7cf1-44f9-97df-b7dc219151c6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:36.966087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604893b2-7cf1-44f9-97df-b7dc219151c6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:37.073974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265c432-8141-4597-b739-83707c1fe385 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:37.075531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265c432-8141-4597-b739-83707c1fe385 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:37.075531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265c432-8141-4597-b739-83707c1fe385 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:37.075787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265c432-8141-4597-b739-83707c1fe385 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:37.076613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265c432-8141-4597-b739-83707c1fe385 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:37.079240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265c432-8141-4597-b739-83707c1fe385 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:37.133854 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2855/5778] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:36 2021] POST /identity/v3/projects => generated 400 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:37.138402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a819e0-fc80-4f23-afc3-6335dc924fde tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:37.163046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a819e0-fc80-4f23-afc3-6335dc924fde tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:37.288302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b78ce-f7cf-4383-a43b-6f775a3c14f2 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:37.289571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b78ce-f7cf-4383-a43b-6f775a3c14f2 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:37.290047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b78ce-f7cf-4383-a43b-6f775a3c14f2 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:37.290524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b78ce-f7cf-4383-a43b-6f775a3c14f2 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/groups` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:37.291777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b78ce-f7cf-4383-a43b-6f775a3c14f2 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:37.295755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b78ce-f7cf-4383-a43b-6f775a3c14f2 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:37.338990 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2924/5779] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:03:37 2021] POST /identity/v3/groups => generated 300 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:37.342681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265c432-8141-4597-b739-83707c1fe385 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:37.356758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265c432-8141-4597-b739-83707c1fe385 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:37.363867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48da1a0-c7db-42f6-b6bc-0da66c7e38a4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:37.364932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48da1a0-c7db-42f6-b6bc-0da66c7e38a4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:37.366392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48da1a0-c7db-42f6-b6bc-0da66c7e38a4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:37.366901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48da1a0-c7db-42f6-b6bc-0da66c7e38a4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:37.367840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48da1a0-c7db-42f6-b6bc-0da66c7e38a4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:37.369849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48da1a0-c7db-42f6-b6bc-0da66c7e38a4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:37.404371 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2856/5780] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:03:37 2021] POST /identity/v3/roles => generated 234 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:37.408657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b78ce-f7cf-4383-a43b-6f775a3c14f2 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:37.430974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b78ce-f7cf-4383-a43b-6f775a3c14f2 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:37.441227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f4419-1a9b-4d76-a38b-84a72962ec3e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:37.444951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f4419-1a9b-4d76-a38b-84a72962ec3e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:37.446573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f4419-1a9b-4d76-a38b-84a72962ec3e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:37.447390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f4419-1a9b-4d76-a38b-84a72962ec3e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:37.449812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f4419-1a9b-4d76-a38b-84a72962ec3e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:37.454149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f4419-1a9b-4d76-a38b-84a72962ec3e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:37.527662 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2925/5781] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:37 2021] POST /identity/v3/users => generated 442 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:03:37.532593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48da1a0-c7db-42f6-b6bc-0da66c7e38a4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:37.551568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48da1a0-c7db-42f6-b6bc-0da66c7e38a4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:37.580133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c039b2-952d-4dd0-825e-5d4b45048a2a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:37.580897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c039b2-952d-4dd0-825e-5d4b45048a2a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:37.581192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c039b2-952d-4dd0-825e-5d4b45048a2a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:37.581476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c039b2-952d-4dd0-825e-5d4b45048a2a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:37.588229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c039b2-952d-4dd0-825e-5d4b45048a2a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:37.589316 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-a8c039b2-952d-4dd0-825e-5d4b45048a2a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:37.589316 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:03:37.589316 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:03:37.593586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c039b2-952d-4dd0-825e-5d4b45048a2a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:37.629102 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2857/5782] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:03:37 2021] POST /identity/v3/roles => generated 269 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:37.633225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f4419-1a9b-4d76-a38b-84a72962ec3e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:37.660413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f4419-1a9b-4d76-a38b-84a72962ec3e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:37.672574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f021e4b-557e-4941-8af0-d567c3905388 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:37.675543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f021e4b-557e-4941-8af0-d567c3905388 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:37.676377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f021e4b-557e-4941-8af0-d567c3905388 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:37.677857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f021e4b-557e-4941-8af0-d567c3905388 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/projects/d016c14147c344909bc9d59b430dd36e/users/6caa0720d79e45a091b89898e3c85cc0/roles/82af4975120a4d29b2e50f570986042b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:37.751173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f021e4b-557e-4941-8af0-d567c3905388 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d016c14147c344909bc9d59b430dd36e, user_id=6caa0720d79e45a091b89898e3c85cc0, role_id=82af4975120a4d29b2e50f570986042b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:37.761996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f021e4b-557e-4941-8af0-d567c3905388 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:37.795956 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2926/5783] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:37 2021] PUT /identity/v3/projects/d016c14147c344909bc9d59b430dd36e/users/6caa0720d79e45a091b89898e3c85cc0/roles/82af4975120a4d29b2e50f570986042b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:37.797201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c039b2-952d-4dd0-825e-5d4b45048a2a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:37.817719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c039b2-952d-4dd0-825e-5d4b45048a2a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:37.959083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7db789-55a1-42ff-ba4a-d7edae3f2d96 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:37.960160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7db789-55a1-42ff-ba4a-d7edae3f2d96 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:37.961105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7db789-55a1-42ff-ba4a-d7edae3f2d96 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:37.961453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7db789-55a1-42ff-ba4a-d7edae3f2d96 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:37.962349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7db789-55a1-42ff-ba4a-d7edae3f2d96 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Adding query filter params (scope.project.id=d016c14147c344909bc9d59b430dd36e, user.id=6caa0720d79e45a091b89898e3c85cc0) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:37.962674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7db789-55a1-42ff-ba4a-d7edae3f2d96 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:37.964560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7db789-55a1-42ff-ba4a-d7edae3f2d96 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:38.081644 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2858/5784] 10.222.0.13 () {58 vars in 1355 bytes} [Sat Dec 18 21:03:37 2021] GET /identity/v3/role_assignments?scope.project.id=d016c14147c344909bc9d59b430dd36e&user.id=6caa0720d79e45a091b89898e3c85cc0&effective => generated 228 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:38.090198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f021e4b-557e-4941-8af0-d567c3905388 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:38.115639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f021e4b-557e-4941-8af0-d567c3905388 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:38.135150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe0775-ec6e-460d-ab54-553fcbbfed78 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:38.136156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe0775-ec6e-460d-ab54-553fcbbfed78 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:38.136351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe0775-ec6e-460d-ab54-553fcbbfed78 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:38.139031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe0775-ec6e-460d-ab54-553fcbbfed78 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/projects/d016c14147c344909bc9d59b430dd36e/users/6caa0720d79e45a091b89898e3c85cc0/roles/82af4975120a4d29b2e50f570986042b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:38.145610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe0775-ec6e-460d-ab54-553fcbbfed78 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d016c14147c344909bc9d59b430dd36e, user_id=6caa0720d79e45a091b89898e3c85cc0, role_id=82af4975120a4d29b2e50f570986042b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:38.151684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe0775-ec6e-460d-ab54-553fcbbfed78 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:38.178190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ccfe0775-ec6e-460d-ab54-553fcbbfed78 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invalidating the token cache because role 82af4975120a4d29b2e50f570986042b was removed from user 6caa0720d79e45a091b89898e3c85cc0 on project d016c14147c344909bc9d59b430dd36e. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:38.178576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ccfe0775-ec6e-460d-ab54-553fcbbfed78 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:38.179519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ccfe0775-ec6e-460d-ab54-553fcbbfed78 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:38.204460 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2927/5785] 10.222.0.13 () {58 vars in 1466 bytes} [Sat Dec 18 21:03:38 2021] DELETE /identity/v3/projects/d016c14147c344909bc9d59b430dd36e/users/6caa0720d79e45a091b89898e3c85cc0/roles/82af4975120a4d29b2e50f570986042b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:38.210424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7db789-55a1-42ff-ba4a-d7edae3f2d96 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:38.213421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9f7db789-55a1-42ff-ba4a-d7edae3f2d96 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:38.236220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7db789-55a1-42ff-ba4a-d7edae3f2d96 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:38.407377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ddb2e-ea51-4baf-b764-7bcc98650961 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:38.408581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ddb2e-ea51-4baf-b764-7bcc98650961 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:38.409558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ddb2e-ea51-4baf-b764-7bcc98650961 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:38.410886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ddb2e-ea51-4baf-b764-7bcc98650961 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/82af4975120a4d29b2e50f570986042b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:38.412870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ddb2e-ea51-4baf-b764-7bcc98650961 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=82af4975120a4d29b2e50f570986042b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:38.414701 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-b71ddb2e-ea51-4baf-b764-7bcc98650961 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:38.414701 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:03:38.414701 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:03:38.416266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ddb2e-ea51-4baf-b764-7bcc98650961 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:38.494998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b71ddb2e-ea51-4baf-b764-7bcc98650961 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invalidating the token cache because role 82af4975120a4d29b2e50f570986042b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:38.495684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b71ddb2e-ea51-4baf-b764-7bcc98650961 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:38.497016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b71ddb2e-ea51-4baf-b764-7bcc98650961 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:38.506716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe0775-ec6e-460d-ab54-553fcbbfed78 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:38.513643 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2859/5786] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:38 2021] DELETE /identity/v3/roles/82af4975120a4d29b2e50f570986042b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:38.526536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe0775-ec6e-460d-ab54-553fcbbfed78 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:38.642361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7285b4-597a-40cc-af11-99124189e37d tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:38.643584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7285b4-597a-40cc-af11-99124189e37d tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:38.644025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7285b4-597a-40cc-af11-99124189e37d tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:38.644374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7285b4-597a-40cc-af11-99124189e37d tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/projects/d016c14147c344909bc9d59b430dd36e/users/6caa0720d79e45a091b89898e3c85cc0/roles/bb138913933849ebb17eba9f634ae018` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:38.647324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7285b4-597a-40cc-af11-99124189e37d tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d016c14147c344909bc9d59b430dd36e, user_id=6caa0720d79e45a091b89898e3c85cc0, role_id=bb138913933849ebb17eba9f634ae018)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:38.652538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7285b4-597a-40cc-af11-99124189e37d tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:38.678334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ddb2e-ea51-4baf-b764-7bcc98650961 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:38.678877 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2928/5787] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:38 2021] PUT /identity/v3/projects/d016c14147c344909bc9d59b430dd36e/users/6caa0720d79e45a091b89898e3c85cc0/roles/bb138913933849ebb17eba9f634ae018 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:38.680980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b71ddb2e-ea51-4baf-b764-7bcc98650961 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:38.699760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ddb2e-ea51-4baf-b764-7bcc98650961 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:38.823471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2eb31e-d1fb-40b8-8754-8dba2b08300f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:38.824459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2eb31e-d1fb-40b8-8754-8dba2b08300f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:38.824756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2eb31e-d1fb-40b8-8754-8dba2b08300f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:38.825504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2eb31e-d1fb-40b8-8754-8dba2b08300f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:38.827662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2eb31e-d1fb-40b8-8754-8dba2b08300f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=581693129fcf4914bb64fa1c86fa3cac)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:38.829332 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-6c2eb31e-d1fb-40b8-8754-8dba2b08300f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:38.829332 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:03:38.829332 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:03:38.830407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2eb31e-d1fb-40b8-8754-8dba2b08300f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:38.896850 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2860/5788] 10.222.0.13 () {60 vars in 1362 bytes} [Sat Dec 18 21:03:38 2021] PUT /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac => generated 520 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:38.902285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7285b4-597a-40cc-af11-99124189e37d tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:38.940030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7285b4-597a-40cc-af11-99124189e37d tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:39.145921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17ccb8-5ee4-4c1b-a062-a973eaed959f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:39.146738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17ccb8-5ee4-4c1b-a062-a973eaed959f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:39.147268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17ccb8-5ee4-4c1b-a062-a973eaed959f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:39.147724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17ccb8-5ee4-4c1b-a062-a973eaed959f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:39.149530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17ccb8-5ee4-4c1b-a062-a973eaed959f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Adding query filter params (scope.project.id=d016c14147c344909bc9d59b430dd36e, user.id=6caa0720d79e45a091b89898e3c85cc0) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:39.151040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17ccb8-5ee4-4c1b-a062-a973eaed959f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:39.156664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17ccb8-5ee4-4c1b-a062-a973eaed959f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:39.338752 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2929/5789] 10.222.0.13 () {58 vars in 1355 bytes} [Sat Dec 18 21:03:38 2021] GET /identity/v3/role_assignments?scope.project.id=d016c14147c344909bc9d59b430dd36e&user.id=6caa0720d79e45a091b89898e3c85cc0&effective => generated 1061 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:39.343548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2eb31e-d1fb-40b8-8754-8dba2b08300f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:39.364963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2eb31e-d1fb-40b8-8754-8dba2b08300f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:39.399611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f4ac1-2b39-491e-8074-803ce25ab56b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:39.401074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f4ac1-2b39-491e-8074-803ce25ab56b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:39.401640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f4ac1-2b39-491e-8074-803ce25ab56b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:39.402153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f4ac1-2b39-491e-8074-803ce25ab56b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:39.404550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f4ac1-2b39-491e-8074-803ce25ab56b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=581693129fcf4914bb64fa1c86fa3cac)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:39.405819 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-4d6f4ac1-2b39-491e-8074-803ce25ab56b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:39.405819 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:03:39.405819 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:03:39.407232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f4ac1-2b39-491e-8074-803ce25ab56b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:39.428704 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2861/5790] 10.222.0.13 () {58 vars in 1346 bytes} [Sat Dec 18 21:03:39 2021] DELETE /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:39.433971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17ccb8-5ee4-4c1b-a062-a973eaed959f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:39.451004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17ccb8-5ee4-4c1b-a062-a973eaed959f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:39.613298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17854992-54f0-4891-a5c0-4cd6baffa334 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:39.615011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17854992-54f0-4891-a5c0-4cd6baffa334 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:39.618227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17854992-54f0-4891-a5c0-4cd6baffa334 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:39.620574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17854992-54f0-4891-a5c0-4cd6baffa334 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:39.623977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17854992-54f0-4891-a5c0-4cd6baffa334 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Adding query filter params (scope.project.id=d016c14147c344909bc9d59b430dd36e, user.id=6caa0720d79e45a091b89898e3c85cc0) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:39.624305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17854992-54f0-4891-a5c0-4cd6baffa334 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:39.644774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17854992-54f0-4891-a5c0-4cd6baffa334 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:39.771205 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2930/5791] 10.222.0.13 () {58 vars in 1355 bytes} [Sat Dec 18 21:03:39 2021] GET /identity/v3/role_assignments?scope.project.id=d016c14147c344909bc9d59b430dd36e&user.id=6caa0720d79e45a091b89898e3c85cc0&effective => generated 577 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:39.772867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f4ac1-2b39-491e-8074-803ce25ab56b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:39.788748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f4ac1-2b39-491e-8074-803ce25ab56b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:39.803098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781cfd2-3119-4e16-8af8-102eaf9ee526 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:39.804705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781cfd2-3119-4e16-8af8-102eaf9ee526 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:39.805063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781cfd2-3119-4e16-8af8-102eaf9ee526 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:39.805415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781cfd2-3119-4e16-8af8-102eaf9ee526 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:39.813109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781cfd2-3119-4e16-8af8-102eaf9ee526 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=581693129fcf4914bb64fa1c86fa3cac)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:39.815013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781cfd2-3119-4e16-8af8-102eaf9ee526 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:39.856349 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-e781cfd2-3119-4e16-8af8-102eaf9ee526 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] bb138913933849ebb17eba9f634ae018 does not imply 581693129fcf4914bb64fa1c86fa3cac.: keystone.exception.ImpliedRoleNotFound: bb138913933849ebb17eba9f634ae018 does not imply 581693129fcf4914bb64fa1c86fa3cac. Dec 18 21:03:39.858542 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2862/5792] 10.222.0.13 () {58 vars in 1346 bytes} [Sat Dec 18 21:03:39 2021] DELETE /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac => generated 137 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:03:39.862976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17854992-54f0-4891-a5c0-4cd6baffa334 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:39.882118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17854992-54f0-4891-a5c0-4cd6baffa334 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:39.899611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2faba0-b798-4f9c-83b5-2e3601455f76 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:39.900539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2faba0-b798-4f9c-83b5-2e3601455f76 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:39.900828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2faba0-b798-4f9c-83b5-2e3601455f76 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:39.901108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2faba0-b798-4f9c-83b5-2e3601455f76 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/projects/d016c14147c344909bc9d59b430dd36e/users/6caa0720d79e45a091b89898e3c85cc0/roles/bb138913933849ebb17eba9f634ae018` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:39.911686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2faba0-b798-4f9c-83b5-2e3601455f76 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d016c14147c344909bc9d59b430dd36e, user_id=6caa0720d79e45a091b89898e3c85cc0, role_id=bb138913933849ebb17eba9f634ae018)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:39.914355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2faba0-b798-4f9c-83b5-2e3601455f76 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:39.932632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f2faba0-b798-4f9c-83b5-2e3601455f76 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invalidating the token cache because role bb138913933849ebb17eba9f634ae018 was removed from user 6caa0720d79e45a091b89898e3c85cc0 on project d016c14147c344909bc9d59b430dd36e. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:39.932914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f2faba0-b798-4f9c-83b5-2e3601455f76 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:39.933681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f2faba0-b798-4f9c-83b5-2e3601455f76 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:39.956568 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2931/5793] 10.222.0.13 () {58 vars in 1466 bytes} [Sat Dec 18 21:03:39 2021] DELETE /identity/v3/projects/d016c14147c344909bc9d59b430dd36e/users/6caa0720d79e45a091b89898e3c85cc0/roles/bb138913933849ebb17eba9f634ae018 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:39.962126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781cfd2-3119-4e16-8af8-102eaf9ee526 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:39.963969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e781cfd2-3119-4e16-8af8-102eaf9ee526 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:39.989301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781cfd2-3119-4e16-8af8-102eaf9ee526 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:40.080536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d86a6-7f23-4eb9-957c-5acc96b3d58e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:40.081830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d86a6-7f23-4eb9-957c-5acc96b3d58e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:40.082424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d86a6-7f23-4eb9-957c-5acc96b3d58e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:40.083153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d86a6-7f23-4eb9-957c-5acc96b3d58e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:40.084320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d86a6-7f23-4eb9-957c-5acc96b3d58e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:40.086881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d86a6-7f23-4eb9-957c-5acc96b3d58e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:40.117814 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2863/5794] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:39 2021] POST /identity/v3/roles => generated 271 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:40.121730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2faba0-b798-4f9c-83b5-2e3601455f76 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:40.145076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2faba0-b798-4f9c-83b5-2e3601455f76 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:40.157532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed5a8f-e5b2-438d-8489-3b2e98a0198c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:40.158215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed5a8f-e5b2-438d-8489-3b2e98a0198c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:40.158602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed5a8f-e5b2-438d-8489-3b2e98a0198c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:40.158890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed5a8f-e5b2-438d-8489-3b2e98a0198c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:40.159641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed5a8f-e5b2-438d-8489-3b2e98a0198c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Adding query filter params (domain_id=2a5fc77da1024dfca8a2ca17b1d99acc) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:40.160188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed5a8f-e5b2-438d-8489-3b2e98a0198c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:40.161430 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-4bed5a8f-e5b2-438d-8489-3b2e98a0198c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:40.161430 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:03:40.161430 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:03:40.162824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed5a8f-e5b2-438d-8489-3b2e98a0198c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:40.193993 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2932/5795] 10.222.0.13 () {58 vars in 1206 bytes} [Sat Dec 18 21:03:40 2021] GET /identity/v3/roles?domain_id=2a5fc77da1024dfca8a2ca17b1d99acc => generated 408 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:40.200295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d86a6-7f23-4eb9-957c-5acc96b3d58e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:40.227426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d86a6-7f23-4eb9-957c-5acc96b3d58e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:40.236621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c82c89-fb91-4a2d-b6b0-98ce7d4e8530 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:40.237882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c82c89-fb91-4a2d-b6b0-98ce7d4e8530 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:40.240149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c82c89-fb91-4a2d-b6b0-98ce7d4e8530 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:40.240788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c82c89-fb91-4a2d-b6b0-98ce7d4e8530 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/27e4916afee94ad6a0d74acb9471f05e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:40.245656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c82c89-fb91-4a2d-b6b0-98ce7d4e8530 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=27e4916afee94ad6a0d74acb9471f05e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:40.250917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c82c89-fb91-4a2d-b6b0-98ce7d4e8530 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:40.297558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-98c82c89-fb91-4a2d-b6b0-98ce7d4e8530 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invalidating the token cache because role 27e4916afee94ad6a0d74acb9471f05e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:40.298220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-98c82c89-fb91-4a2d-b6b0-98ce7d4e8530 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:40.299228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-98c82c89-fb91-4a2d-b6b0-98ce7d4e8530 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:40.301466 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2864/5796] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:40 2021] DELETE /identity/v3/roles/27e4916afee94ad6a0d74acb9471f05e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:40.305787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed5a8f-e5b2-438d-8489-3b2e98a0198c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:40.307704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4bed5a8f-e5b2-438d-8489-3b2e98a0198c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:40.331458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed5a8f-e5b2-438d-8489-3b2e98a0198c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:40.412449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e1114-fd5e-4ac1-bcce-40e9fe5244fe tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:40.413883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e1114-fd5e-4ac1-bcce-40e9fe5244fe tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:40.414452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e1114-fd5e-4ac1-bcce-40e9fe5244fe tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:40.414916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e1114-fd5e-4ac1-bcce-40e9fe5244fe tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:40.415862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e1114-fd5e-4ac1-bcce-40e9fe5244fe tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Adding query filter params (domain_id=2a5fc77da1024dfca8a2ca17b1d99acc) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:40.416345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e1114-fd5e-4ac1-bcce-40e9fe5244fe tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:40.418615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e1114-fd5e-4ac1-bcce-40e9fe5244fe tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:40.427361 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2933/5797] 10.222.0.13 () {58 vars in 1206 bytes} [Sat Dec 18 21:03:40 2021] GET /identity/v3/roles?domain_id=2a5fc77da1024dfca8a2ca17b1d99acc => generated 148 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:03:40.431986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c82c89-fb91-4a2d-b6b0-98ce7d4e8530 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:40.446136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c82c89-fb91-4a2d-b6b0-98ce7d4e8530 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:40.474915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd02f49-3e96-48d5-aecf-6b1ff6bd95b6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:40.475791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd02f49-3e96-48d5-aecf-6b1ff6bd95b6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:40.476312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd02f49-3e96-48d5-aecf-6b1ff6bd95b6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:40.476754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd02f49-3e96-48d5-aecf-6b1ff6bd95b6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/27e4916afee94ad6a0d74acb9471f05e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:40.531384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd02f49-3e96-48d5-aecf-6b1ff6bd95b6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:03:40.584335 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-edd02f49-3e96-48d5-aecf-6b1ff6bd95b6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Could not find role: 27e4916afee94ad6a0d74acb9471f05e.: keystone.exception.RoleNotFound: Could not find role: 27e4916afee94ad6a0d74acb9471f05e. Dec 18 21:03:40.592728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e1114-fd5e-4ac1-bcce-40e9fe5244fe tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:40.595889 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2865/5798] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:40 2021] DELETE /identity/v3/roles/27e4916afee94ad6a0d74acb9471f05e => generated 110 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:03:40.612875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e1114-fd5e-4ac1-bcce-40e9fe5244fe tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:40.628098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363147d-9a74-4828-a93d-4c7887539d05 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:40.629107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363147d-9a74-4828-a93d-4c7887539d05 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:40.629494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363147d-9a74-4828-a93d-4c7887539d05 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:40.629843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363147d-9a74-4828-a93d-4c7887539d05 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:40.646783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363147d-9a74-4828-a93d-4c7887539d05 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2a5fc77da1024dfca8a2ca17b1d99acc, group_id=d584dda5ff32430aa5c87960fbb91ee5, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:40.650144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363147d-9a74-4828-a93d-4c7887539d05 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:40.688716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd02f49-3e96-48d5-aecf-6b1ff6bd95b6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:40.689612 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2934/5799] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:40 2021] PUT /identity/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:40.709551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd02f49-3e96-48d5-aecf-6b1ff6bd95b6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:40.838932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc688b71-fc8f-4f55-b8f2-a281fd27e0a6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:40.839798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc688b71-fc8f-4f55-b8f2-a281fd27e0a6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:40.840304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc688b71-fc8f-4f55-b8f2-a281fd27e0a6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:40.841024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc688b71-fc8f-4f55-b8f2-a281fd27e0a6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc/groups/d584dda5ff32430aa5c87960fbb91ee5/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:40.843346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc688b71-fc8f-4f55-b8f2-a281fd27e0a6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2a5fc77da1024dfca8a2ca17b1d99acc, group_id=d584dda5ff32430aa5c87960fbb91ee5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:40.849976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc688b71-fc8f-4f55-b8f2-a281fd27e0a6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:40.880867 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2866/5800] 10.222.0.13 () {58 vars in 1364 bytes} [Sat Dec 18 21:03:40 2021] GET /identity/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc/groups/d584dda5ff32430aa5c87960fbb91ee5/roles => generated 409 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:40.882817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363147d-9a74-4828-a93d-4c7887539d05 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:40.895594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363147d-9a74-4828-a93d-4c7887539d05 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:40.901838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f383b-d716-4f95-902e-933f1126687a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:40.903026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f383b-d716-4f95-902e-933f1126687a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:40.903489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f383b-d716-4f95-902e-933f1126687a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:40.903936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f383b-d716-4f95-902e-933f1126687a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:40.906993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f383b-d716-4f95-902e-933f1126687a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2a5fc77da1024dfca8a2ca17b1d99acc, group_id=d584dda5ff32430aa5c87960fbb91ee5, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:40.911357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f383b-d716-4f95-902e-933f1126687a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:40.944871 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2935/5801] 10.222.0.13 () {58 vars in 1464 bytes} [Sat Dec 18 21:03:40 2021] HEAD /identity/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:40.945852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc688b71-fc8f-4f55-b8f2-a281fd27e0a6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:40.956947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc688b71-fc8f-4f55-b8f2-a281fd27e0a6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:40.962661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f131a56-94e1-4deb-9c65-52c07f4d8c07 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:40.963610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f131a56-94e1-4deb-9c65-52c07f4d8c07 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:40.964020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f131a56-94e1-4deb-9c65-52c07f4d8c07 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:40.964310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f131a56-94e1-4deb-9c65-52c07f4d8c07 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:40.966696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f131a56-94e1-4deb-9c65-52c07f4d8c07 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2a5fc77da1024dfca8a2ca17b1d99acc, group_id=d584dda5ff32430aa5c87960fbb91ee5, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:40.969660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f131a56-94e1-4deb-9c65-52c07f4d8c07 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:40.979383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0f131a56-94e1-4deb-9c65-52c07f4d8c07 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invalidating the token cache because role b1b0694d8e9046abbdc5d52f38ca2865 was removed from group d584dda5ff32430aa5c87960fbb91ee5 on domain 2a5fc77da1024dfca8a2ca17b1d99acc. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:40.979700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0f131a56-94e1-4deb-9c65-52c07f4d8c07 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:40.980437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0f131a56-94e1-4deb-9c65-52c07f4d8c07 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:41.004320 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2867/5802] 10.222.0.13 () {58 vars in 1466 bytes} [Sat Dec 18 21:03:40 2021] DELETE /identity/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:41.009347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f383b-d716-4f95-902e-933f1126687a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:41.010941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ea4f383b-d716-4f95-902e-933f1126687a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:41.028565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f383b-d716-4f95-902e-933f1126687a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:41.147257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f835aae-c9cf-464a-92f1-6eaad8205e67 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:41.148671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f835aae-c9cf-464a-92f1-6eaad8205e67 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:41.148813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f835aae-c9cf-464a-92f1-6eaad8205e67 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:41.149048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f835aae-c9cf-464a-92f1-6eaad8205e67 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/projects/d016c14147c344909bc9d59b430dd36e/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:41.151739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f835aae-c9cf-464a-92f1-6eaad8205e67 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d016c14147c344909bc9d59b430dd36e, group_id=d584dda5ff32430aa5c87960fbb91ee5, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:41.160555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f835aae-c9cf-464a-92f1-6eaad8205e67 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:41.195520 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2936/5803] 10.222.0.13 () {60 vars in 1485 bytes} [Sat Dec 18 21:03:41 2021] PUT /identity/v3/projects/d016c14147c344909bc9d59b430dd36e/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:41.196503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f131a56-94e1-4deb-9c65-52c07f4d8c07 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:41.211019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f131a56-94e1-4deb-9c65-52c07f4d8c07 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:41.301627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db68fa9-eb40-42a2-843c-5f43104d9f57 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:41.302982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db68fa9-eb40-42a2-843c-5f43104d9f57 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:41.303381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db68fa9-eb40-42a2-843c-5f43104d9f57 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:41.303770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db68fa9-eb40-42a2-843c-5f43104d9f57 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/projects/d016c14147c344909bc9d59b430dd36e/groups/d584dda5ff32430aa5c87960fbb91ee5/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:41.306547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db68fa9-eb40-42a2-843c-5f43104d9f57 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:list_grants(project_id=d016c14147c344909bc9d59b430dd36e, group_id=d584dda5ff32430aa5c87960fbb91ee5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:41.310560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db68fa9-eb40-42a2-843c-5f43104d9f57 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:41.334377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f835aae-c9cf-464a-92f1-6eaad8205e67 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:41.345252 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2868/5804] 10.222.0.13 () {58 vars in 1367 bytes} [Sat Dec 18 21:03:41 2021] GET /identity/v3/projects/d016c14147c344909bc9d59b430dd36e/groups/d584dda5ff32430aa5c87960fbb91ee5/roles => generated 410 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:41.348287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f835aae-c9cf-464a-92f1-6eaad8205e67 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:41.356877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc0870-d217-431a-81af-81b4386d5478 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:41.359006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc0870-d217-431a-81af-81b4386d5478 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:41.359418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc0870-d217-431a-81af-81b4386d5478 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:41.359805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc0870-d217-431a-81af-81b4386d5478 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/groups/d584dda5ff32430aa5c87960fbb91ee5/users/6caa0720d79e45a091b89898e3c85cc0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:41.362151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc0870-d217-431a-81af-81b4386d5478 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=d584dda5ff32430aa5c87960fbb91ee5, user_id=6caa0720d79e45a091b89898e3c85cc0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:41.365490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc0870-d217-431a-81af-81b4386d5478 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:41.420771 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2937/5805] 10.222.0.13 () {60 vars in 1359 bytes} [Sat Dec 18 21:03:41 2021] PUT /identity/v3/groups/d584dda5ff32430aa5c87960fbb91ee5/users/6caa0720d79e45a091b89898e3c85cc0 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:41.425658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff467-cfd8-4045-b56c-7e3d07fa14b7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:41.425919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff467-cfd8-4045-b56c-7e3d07fa14b7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:41.426297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff467-cfd8-4045-b56c-7e3d07fa14b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:41.468653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ee7ff467-cfd8-4045-b56c-7e3d07fa14b7 None None] MFA Rules not processed for user `6caa0720d79e45a091b89898e3c85cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:41.469998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ee7ff467-cfd8-4045-b56c-7e3d07fa14b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:41.626640 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2869/5806] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:41 2021] POST /identity/v3/auth/tokens => generated 3257 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:41.632828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc0870-d217-431a-81af-81b4386d5478 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:41.765765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc0870-d217-431a-81af-81b4386d5478 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:41.771860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9f7f8-7d8c-40b9-8d52-d1a1cb16ccca tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:41.773462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9f7f8-7d8c-40b9-8d52-d1a1cb16ccca tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:41.773868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9f7f8-7d8c-40b9-8d52-d1a1cb16ccca tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:41.774284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9f7f8-7d8c-40b9-8d52-d1a1cb16ccca tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/projects/d016c14147c344909bc9d59b430dd36e/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:41.783067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9f7f8-7d8c-40b9-8d52-d1a1cb16ccca tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:check_grant(project_id=d016c14147c344909bc9d59b430dd36e, group_id=d584dda5ff32430aa5c87960fbb91ee5, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:41.786729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9f7f8-7d8c-40b9-8d52-d1a1cb16ccca tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:41.802098 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2938/5807] 10.222.0.13 () {58 vars in 1467 bytes} [Sat Dec 18 21:03:41 2021] HEAD /identity/v3/projects/d016c14147c344909bc9d59b430dd36e/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:41.806724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ff467-cfd8-4045-b56c-7e3d07fa14b7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:41.827653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ff467-cfd8-4045-b56c-7e3d07fa14b7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:41.849459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e92c80-92c0-4196-aa31-97be21b5d2f9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:41.850791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92c80-92c0-4196-aa31-97be21b5d2f9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:41.852193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92c80-92c0-4196-aa31-97be21b5d2f9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:41.852752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92c80-92c0-4196-aa31-97be21b5d2f9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/projects/d016c14147c344909bc9d59b430dd36e/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:41.860466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e92c80-92c0-4196-aa31-97be21b5d2f9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d016c14147c344909bc9d59b430dd36e, group_id=d584dda5ff32430aa5c87960fbb91ee5, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:41.864202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e92c80-92c0-4196-aa31-97be21b5d2f9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:41.881994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d5e92c80-92c0-4196-aa31-97be21b5d2f9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invalidating the token cache because role b1b0694d8e9046abbdc5d52f38ca2865 was removed from group d584dda5ff32430aa5c87960fbb91ee5 on project d016c14147c344909bc9d59b430dd36e. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:41.882674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d5e92c80-92c0-4196-aa31-97be21b5d2f9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:41.885011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d5e92c80-92c0-4196-aa31-97be21b5d2f9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:41.921379 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2870/5808] 10.222.0.13 () {58 vars in 1469 bytes} [Sat Dec 18 21:03:41 2021] DELETE /identity/v3/projects/d016c14147c344909bc9d59b430dd36e/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:41.925596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9f7f8-7d8c-40b9-8d52-d1a1cb16ccca tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:41.927631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e9e9f7f8-7d8c-40b9-8d52-d1a1cb16ccca tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:41.947698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9f7f8-7d8c-40b9-8d52-d1a1cb16ccca tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:42.035641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350e358-7ddf-4168-b59b-ff4a5084571a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:42.036556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350e358-7ddf-4168-b59b-ff4a5084571a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:42.036849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350e358-7ddf-4168-b59b-ff4a5084571a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:42.037138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350e358-7ddf-4168-b59b-ff4a5084571a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/groups/d584dda5ff32430aa5c87960fbb91ee5/users/6caa0720d79e45a091b89898e3c85cc0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:42.039716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350e358-7ddf-4168-b59b-ff4a5084571a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=d584dda5ff32430aa5c87960fbb91ee5, user_id=6caa0720d79e45a091b89898e3c85cc0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:42.041099 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-a350e358-7ddf-4168-b59b-ff4a5084571a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:42.041099 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:03:42.041099 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:03:42.042591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350e358-7ddf-4168-b59b-ff4a5084571a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:42.054650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a350e358-7ddf-4168-b59b-ff4a5084571a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6caa0720d79e45a091b89898e3c85cc0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:42.079618 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2939/5809] 10.222.0.13 () {58 vars in 1343 bytes} [Sat Dec 18 21:03:41 2021] DELETE /identity/v3/groups/d584dda5ff32430aa5c87960fbb91ee5/users/6caa0720d79e45a091b89898e3c85cc0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:42.086644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e92c80-92c0-4196-aa31-97be21b5d2f9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:42.112200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e92c80-92c0-4196-aa31-97be21b5d2f9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:42.201075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087d1ad-c6c3-4c4b-86d7-334e9bf0e8fb tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:42.216950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087d1ad-c6c3-4c4b-86d7-334e9bf0e8fb tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:42.217825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087d1ad-c6c3-4c4b-86d7-334e9bf0e8fb tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:42.218134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087d1ad-c6c3-4c4b-86d7-334e9bf0e8fb tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/system/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:42.220700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087d1ad-c6c3-4c4b-86d7-334e9bf0e8fb tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=d584dda5ff32430aa5c87960fbb91ee5, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:42.223135 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-4087d1ad-c6c3-4c4b-86d7-334e9bf0e8fb tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:42.223135 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:03:42.223135 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:03:42.223471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087d1ad-c6c3-4c4b-86d7-334e9bf0e8fb tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:42.238217 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2871/5810] 10.222.0.13 () {60 vars in 1380 bytes} [Sat Dec 18 21:03:42 2021] PUT /identity/v3/system/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:42.242024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350e358-7ddf-4168-b59b-ff4a5084571a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:42.260139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350e358-7ddf-4168-b59b-ff4a5084571a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:42.265668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952b059-39c5-482c-a1fe-ab6f38e9019e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:42.267469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952b059-39c5-482c-a1fe-ab6f38e9019e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:42.268319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952b059-39c5-482c-a1fe-ab6f38e9019e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:42.269091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952b059-39c5-482c-a1fe-ab6f38e9019e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/system/groups/d584dda5ff32430aa5c87960fbb91ee5/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:42.270936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952b059-39c5-482c-a1fe-ab6f38e9019e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=d584dda5ff32430aa5c87960fbb91ee5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:42.272193 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-3952b059-39c5-482c-a1fe-ab6f38e9019e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:42.272193 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:03:42.272193 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:03:42.274034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952b059-39c5-482c-a1fe-ab6f38e9019e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:42.296056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087d1ad-c6c3-4c4b-86d7-334e9bf0e8fb tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:42.298056 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2940/5811] 10.222.0.13 () {58 vars in 1262 bytes} [Sat Dec 18 21:03:42 2021] GET /identity/v3/system/groups/d584dda5ff32430aa5c87960fbb91ee5/roles => generated 375 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:42.309810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087d1ad-c6c3-4c4b-86d7-334e9bf0e8fb tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:42.314914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9749f-be03-410d-a1de-1278c0ab166f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:42.315779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9749f-be03-410d-a1de-1278c0ab166f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:42.316073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9749f-be03-410d-a1de-1278c0ab166f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:42.316361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9749f-be03-410d-a1de-1278c0ab166f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/system/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:42.320593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9749f-be03-410d-a1de-1278c0ab166f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=d584dda5ff32430aa5c87960fbb91ee5, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:42.322138 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-30b9749f-be03-410d-a1de-1278c0ab166f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:42.322138 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:03:42.322138 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:03:42.323654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9749f-be03-410d-a1de-1278c0ab166f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:42.331766 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2872/5812] 10.222.0.13 () {58 vars in 1362 bytes} [Sat Dec 18 21:03:42 2021] HEAD /identity/v3/system/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:42.336378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952b059-39c5-482c-a1fe-ab6f38e9019e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:42.348051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952b059-39c5-482c-a1fe-ab6f38e9019e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:42.356731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf106245-a230-4a93-89ed-2152301c8b47 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:42.357611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf106245-a230-4a93-89ed-2152301c8b47 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:42.357903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf106245-a230-4a93-89ed-2152301c8b47 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:42.358192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf106245-a230-4a93-89ed-2152301c8b47 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/system/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:42.362588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf106245-a230-4a93-89ed-2152301c8b47 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=d584dda5ff32430aa5c87960fbb91ee5, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:42.362588 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-cf106245-a230-4a93-89ed-2152301c8b47 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:42.362588 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:03:42.362588 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:03:42.362990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf106245-a230-4a93-89ed-2152301c8b47 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:42.383798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9749f-be03-410d-a1de-1278c0ab166f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:42.384239 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2941/5813] 10.222.0.13 () {58 vars in 1364 bytes} [Sat Dec 18 21:03:42 2021] DELETE /identity/v3/system/groups/d584dda5ff32430aa5c87960fbb91ee5/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:42.397152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9749f-be03-410d-a1de-1278c0ab166f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:42.405855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10366466-4d31-4547-9aef-449599fb8ab7 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:42.407129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10366466-4d31-4547-9aef-449599fb8ab7 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:42.407608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10366466-4d31-4547-9aef-449599fb8ab7 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:42.408384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10366466-4d31-4547-9aef-449599fb8ab7 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:42.415243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10366466-4d31-4547-9aef-449599fb8ab7 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2a5fc77da1024dfca8a2ca17b1d99acc, user_id=6caa0720d79e45a091b89898e3c85cc0, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:42.431810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10366466-4d31-4547-9aef-449599fb8ab7 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:42.454698 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2873/5814] 10.222.0.13 () {60 vars in 1479 bytes} [Sat Dec 18 21:03:42 2021] PUT /identity/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:42.459693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf106245-a230-4a93-89ed-2152301c8b47 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:42.472700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf106245-a230-4a93-89ed-2152301c8b47 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:42.612771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244829e9-5d10-47b5-b1e9-307b614e3d61 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:42.614553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244829e9-5d10-47b5-b1e9-307b614e3d61 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:42.615024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244829e9-5d10-47b5-b1e9-307b614e3d61 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:42.615836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244829e9-5d10-47b5-b1e9-307b614e3d61 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc/users/6caa0720d79e45a091b89898e3c85cc0/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:42.618131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244829e9-5d10-47b5-b1e9-307b614e3d61 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2a5fc77da1024dfca8a2ca17b1d99acc, user_id=6caa0720d79e45a091b89898e3c85cc0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:42.622214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244829e9-5d10-47b5-b1e9-307b614e3d61 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:42.639775 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2942/5815] 10.222.0.13 () {58 vars in 1361 bytes} [Sat Dec 18 21:03:42 2021] GET /identity/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc/users/6caa0720d79e45a091b89898e3c85cc0/roles => generated 408 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:42.643583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10366466-4d31-4547-9aef-449599fb8ab7 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:42.672433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10366466-4d31-4547-9aef-449599fb8ab7 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:42.679210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb642ce-285d-461d-8a9c-9eb48c8743a4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:42.680915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb642ce-285d-461d-8a9c-9eb48c8743a4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:42.681402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb642ce-285d-461d-8a9c-9eb48c8743a4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:42.681885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb642ce-285d-461d-8a9c-9eb48c8743a4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:42.685332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb642ce-285d-461d-8a9c-9eb48c8743a4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2a5fc77da1024dfca8a2ca17b1d99acc, user_id=6caa0720d79e45a091b89898e3c85cc0, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:42.689667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb642ce-285d-461d-8a9c-9eb48c8743a4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:42.699847 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2874/5816] 10.222.0.13 () {58 vars in 1461 bytes} [Sat Dec 18 21:03:42 2021] HEAD /identity/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:42.704154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244829e9-5d10-47b5-b1e9-307b614e3d61 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:42.720115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244829e9-5d10-47b5-b1e9-307b614e3d61 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:42.726547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495adac-b686-47ae-8a88-9ffbe006e33e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:42.727478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495adac-b686-47ae-8a88-9ffbe006e33e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:42.727825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495adac-b686-47ae-8a88-9ffbe006e33e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:42.728117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495adac-b686-47ae-8a88-9ffbe006e33e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:42.730652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495adac-b686-47ae-8a88-9ffbe006e33e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2a5fc77da1024dfca8a2ca17b1d99acc, user_id=6caa0720d79e45a091b89898e3c85cc0, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:42.734346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495adac-b686-47ae-8a88-9ffbe006e33e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:42.744233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1495adac-b686-47ae-8a88-9ffbe006e33e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invalidating the token cache because role b1b0694d8e9046abbdc5d52f38ca2865 was removed from user 6caa0720d79e45a091b89898e3c85cc0 on domain 2a5fc77da1024dfca8a2ca17b1d99acc. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:42.744727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1495adac-b686-47ae-8a88-9ffbe006e33e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:42.745857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1495adac-b686-47ae-8a88-9ffbe006e33e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:42.766329 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2943/5817] 10.222.0.13 () {58 vars in 1463 bytes} [Sat Dec 18 21:03:42 2021] DELETE /identity/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:42.771868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb642ce-285d-461d-8a9c-9eb48c8743a4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:42.774290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3fb642ce-285d-461d-8a9c-9eb48c8743a4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:42.792677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb642ce-285d-461d-8a9c-9eb48c8743a4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:42.872093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06cc49-7148-4cf7-b77b-bf695626b53b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:42.873645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06cc49-7148-4cf7-b77b-bf695626b53b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:42.874304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06cc49-7148-4cf7-b77b-bf695626b53b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:42.874834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06cc49-7148-4cf7-b77b-bf695626b53b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/projects/d016c14147c344909bc9d59b430dd36e/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:42.877974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06cc49-7148-4cf7-b77b-bf695626b53b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d016c14147c344909bc9d59b430dd36e, user_id=6caa0720d79e45a091b89898e3c85cc0, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:42.884535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06cc49-7148-4cf7-b77b-bf695626b53b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:42.920312 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2875/5818] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:42 2021] PUT /identity/v3/projects/d016c14147c344909bc9d59b430dd36e/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:42.924425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495adac-b686-47ae-8a88-9ffbe006e33e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:42.936232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495adac-b686-47ae-8a88-9ffbe006e33e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:43.019377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3a593-a669-414c-925e-7005511917b9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:43.020626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3a593-a669-414c-925e-7005511917b9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:43.020927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3a593-a669-414c-925e-7005511917b9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:43.021363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3a593-a669-414c-925e-7005511917b9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/projects/d016c14147c344909bc9d59b430dd36e/users/6caa0720d79e45a091b89898e3c85cc0/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:43.023642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3a593-a669-414c-925e-7005511917b9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:list_grants(project_id=d016c14147c344909bc9d59b430dd36e, user_id=6caa0720d79e45a091b89898e3c85cc0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:43.026769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3a593-a669-414c-925e-7005511917b9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:43.043313 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2944/5819] 10.222.0.13 () {58 vars in 1364 bytes} [Sat Dec 18 21:03:42 2021] GET /identity/v3/projects/d016c14147c344909bc9d59b430dd36e/users/6caa0720d79e45a091b89898e3c85cc0/roles => generated 409 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:43.049897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06cc49-7148-4cf7-b77b-bf695626b53b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:43.064528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06cc49-7148-4cf7-b77b-bf695626b53b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:43.086191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5ab5f-71e8-4c4e-bb4f-d801aa9e15a5 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:43.088041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5ab5f-71e8-4c4e-bb4f-d801aa9e15a5 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:43.088335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5ab5f-71e8-4c4e-bb4f-d801aa9e15a5 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:43.088625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5ab5f-71e8-4c4e-bb4f-d801aa9e15a5 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/projects/d016c14147c344909bc9d59b430dd36e/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:43.094875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5ab5f-71e8-4c4e-bb4f-d801aa9e15a5 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:check_grant(project_id=d016c14147c344909bc9d59b430dd36e, user_id=6caa0720d79e45a091b89898e3c85cc0, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:43.097565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5ab5f-71e8-4c4e-bb4f-d801aa9e15a5 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:43.113103 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2876/5820] 10.222.0.13 () {58 vars in 1464 bytes} [Sat Dec 18 21:03:43 2021] HEAD /identity/v3/projects/d016c14147c344909bc9d59b430dd36e/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:43.115195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3a593-a669-414c-925e-7005511917b9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:43.127589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3a593-a669-414c-925e-7005511917b9 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:43.135327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8dd1d-99bb-4fbc-b28c-eb54478f575a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:43.136410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8dd1d-99bb-4fbc-b28c-eb54478f575a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:43.136806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8dd1d-99bb-4fbc-b28c-eb54478f575a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:43.137193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8dd1d-99bb-4fbc-b28c-eb54478f575a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/projects/d016c14147c344909bc9d59b430dd36e/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:43.140752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8dd1d-99bb-4fbc-b28c-eb54478f575a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d016c14147c344909bc9d59b430dd36e, user_id=6caa0720d79e45a091b89898e3c85cc0, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:43.144854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8dd1d-99bb-4fbc-b28c-eb54478f575a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:43.153049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-78f8dd1d-99bb-4fbc-b28c-eb54478f575a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invalidating the token cache because role b1b0694d8e9046abbdc5d52f38ca2865 was removed from user 6caa0720d79e45a091b89898e3c85cc0 on project d016c14147c344909bc9d59b430dd36e. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:43.153662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-78f8dd1d-99bb-4fbc-b28c-eb54478f575a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:43.154825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-78f8dd1d-99bb-4fbc-b28c-eb54478f575a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:43.187926 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2945/5821] 10.222.0.13 () {58 vars in 1466 bytes} [Sat Dec 18 21:03:43 2021] DELETE /identity/v3/projects/d016c14147c344909bc9d59b430dd36e/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:43.196130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5ab5f-71e8-4c4e-bb4f-d801aa9e15a5 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:43.202171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f5f5ab5f-71e8-4c4e-bb4f-d801aa9e15a5 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:43.254756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5ab5f-71e8-4c4e-bb4f-d801aa9e15a5 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:43.453168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4262e-dd0f-4e9e-aba0-6ef7027c5f03 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:43.454176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4262e-dd0f-4e9e-aba0-6ef7027c5f03 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:43.455646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4262e-dd0f-4e9e-aba0-6ef7027c5f03 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:43.459395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4262e-dd0f-4e9e-aba0-6ef7027c5f03 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/system/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:43.462965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4262e-dd0f-4e9e-aba0-6ef7027c5f03 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6caa0720d79e45a091b89898e3c85cc0, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:43.464661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4262e-dd0f-4e9e-aba0-6ef7027c5f03 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:43.486455 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2877/5822] 10.222.0.13 () {60 vars in 1377 bytes} [Sat Dec 18 21:03:43 2021] PUT /identity/v3/system/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:43.491419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8dd1d-99bb-4fbc-b28c-eb54478f575a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:43.505863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8dd1d-99bb-4fbc-b28c-eb54478f575a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:43.513810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10df6c9-d6c3-4116-814f-98cd2018481a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:43.515261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10df6c9-d6c3-4116-814f-98cd2018481a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:43.526828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10df6c9-d6c3-4116-814f-98cd2018481a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:43.527434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10df6c9-d6c3-4116-814f-98cd2018481a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/system/users/6caa0720d79e45a091b89898e3c85cc0/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:43.529925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10df6c9-d6c3-4116-814f-98cd2018481a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=6caa0720d79e45a091b89898e3c85cc0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:43.536526 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-f10df6c9-d6c3-4116-814f-98cd2018481a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:43.536526 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:03:43.536526 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:03:43.543039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10df6c9-d6c3-4116-814f-98cd2018481a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:43.571665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4262e-dd0f-4e9e-aba0-6ef7027c5f03 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:43.579389 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2946/5823] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Dec 18 21:03:43 2021] GET /identity/v3/system/users/6caa0720d79e45a091b89898e3c85cc0/roles => generated 374 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:43.587094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4262e-dd0f-4e9e-aba0-6ef7027c5f03 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:43.598236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13020a6-4a40-4e5a-af73-6405e89e2b11 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:43.599573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13020a6-4a40-4e5a-af73-6405e89e2b11 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:43.600123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13020a6-4a40-4e5a-af73-6405e89e2b11 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:43.600680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13020a6-4a40-4e5a-af73-6405e89e2b11 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/system/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:43.608446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13020a6-4a40-4e5a-af73-6405e89e2b11 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=6caa0720d79e45a091b89898e3c85cc0, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:43.611324 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-d13020a6-4a40-4e5a-af73-6405e89e2b11 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:43.611324 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:03:43.611324 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:03:43.613614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13020a6-4a40-4e5a-af73-6405e89e2b11 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:43.630616 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2878/5824] 10.222.0.13 () {58 vars in 1359 bytes} [Sat Dec 18 21:03:43 2021] HEAD /identity/v3/system/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:43.638466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10df6c9-d6c3-4116-814f-98cd2018481a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:43.653687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10df6c9-d6c3-4116-814f-98cd2018481a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:43.664823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafbf5a-a357-486a-9348-665ddd5f3283 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:43.666195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafbf5a-a357-486a-9348-665ddd5f3283 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:43.666807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafbf5a-a357-486a-9348-665ddd5f3283 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:43.667342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafbf5a-a357-486a-9348-665ddd5f3283 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/system/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:43.676130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafbf5a-a357-486a-9348-665ddd5f3283 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=6caa0720d79e45a091b89898e3c85cc0, role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:43.677569 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-abafbf5a-a357-486a-9348-665ddd5f3283 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:43.677569 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:03:43.677569 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:03:43.679570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafbf5a-a357-486a-9348-665ddd5f3283 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:43.694283 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2947/5825] 10.222.0.13 () {58 vars in 1361 bytes} [Sat Dec 18 21:03:43 2021] DELETE /identity/v3/system/users/6caa0720d79e45a091b89898e3c85cc0/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:43.703948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13020a6-4a40-4e5a-af73-6405e89e2b11 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:43.720527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13020a6-4a40-4e5a-af73-6405e89e2b11 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:43.727750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da1fbe-71d7-4d45-b8d2-1c0cde773a50 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:43.729378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da1fbe-71d7-4d45-b8d2-1c0cde773a50 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:43.729910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da1fbe-71d7-4d45-b8d2-1c0cde773a50 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:43.730489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da1fbe-71d7-4d45-b8d2-1c0cde773a50 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:43.731970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da1fbe-71d7-4d45-b8d2-1c0cde773a50 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:43.734762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da1fbe-71d7-4d45-b8d2-1c0cde773a50 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:43.761811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafbf5a-a357-486a-9348-665ddd5f3283 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:43.770011 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2879/5826] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:03:43 2021] POST /identity/v3/roles => generated 270 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:43.776195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafbf5a-a357-486a-9348-665ddd5f3283 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:43.786899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74156a43-c606-4850-93b9-f75359444765 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:43.787723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74156a43-c606-4850-93b9-f75359444765 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:43.788118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74156a43-c606-4850-93b9-f75359444765 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:43.789096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74156a43-c606-4850-93b9-f75359444765 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:43.790029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74156a43-c606-4850-93b9-f75359444765 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:43.803304 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-74156a43-c606-4850-93b9-f75359444765 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:43.803304 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:03:43.803304 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:03:43.821272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74156a43-c606-4850-93b9-f75359444765 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:43.852988 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2948/5827] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:03:43 2021] POST /identity/v3/roles => generated 270 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:43.857190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da1fbe-71d7-4d45-b8d2-1c0cde773a50 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:43.869226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da1fbe-71d7-4d45-b8d2-1c0cde773a50 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:43.884836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b2216-cbc2-41b1-9a9e-f62332e474d0 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:43.885790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b2216-cbc2-41b1-9a9e-f62332e474d0 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:43.886129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b2216-cbc2-41b1-9a9e-f62332e474d0 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:43.886438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b2216-cbc2-41b1-9a9e-f62332e474d0 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/7b736bffedfb4736ae226ef08f0de09c/implies/1d63e411e03b4cdd96565a5b2356b872` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:43.888906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b2216-cbc2-41b1-9a9e-f62332e474d0 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7b736bffedfb4736ae226ef08f0de09c, implied_role_id=1d63e411e03b4cdd96565a5b2356b872)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:43.891123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b2216-cbc2-41b1-9a9e-f62332e474d0 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:43.930641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74156a43-c606-4850-93b9-f75359444765 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:43.945225 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2880/5828] 10.222.0.13 () {60 vars in 1362 bytes} [Sat Dec 18 21:03:43 2021] PUT /identity/v3/roles/7b736bffedfb4736ae226ef08f0de09c/implies/1d63e411e03b4cdd96565a5b2356b872 => generated 531 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:43.951927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74156a43-c606-4850-93b9-f75359444765 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:44.059295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ee49b-0c74-4232-abbe-522f646413dc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:44.060166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ee49b-0c74-4232-abbe-522f646413dc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:44.060529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ee49b-0c74-4232-abbe-522f646413dc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:44.060791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ee49b-0c74-4232-abbe-522f646413dc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:44.061623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ee49b-0c74-4232-abbe-522f646413dc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:44.063232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ee49b-0c74-4232-abbe-522f646413dc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:44.100730 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2949/5829] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:03:43 2021] POST /identity/v3/domains => generated 276 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:44.104531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b2216-cbc2-41b1-9a9e-f62332e474d0 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:44.134488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b2216-cbc2-41b1-9a9e-f62332e474d0 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:44.306491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c87fb9-6b20-4504-b1bb-c973dfada36c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:44.308626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c87fb9-6b20-4504-b1bb-c973dfada36c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:44.309161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c87fb9-6b20-4504-b1bb-c973dfada36c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:44.309660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c87fb9-6b20-4504-b1bb-c973dfada36c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:44.310693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c87fb9-6b20-4504-b1bb-c973dfada36c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:44.312694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c87fb9-6b20-4504-b1bb-c973dfada36c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:44.351007 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2881/5830] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:03:44 2021] POST /identity/v3/roles => generated 269 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:44.351431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ee49b-0c74-4232-abbe-522f646413dc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:44.367450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ee49b-0c74-4232-abbe-522f646413dc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:44.398586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76b6b9-8825-4b83-9684-d66a20166605 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:44.399667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76b6b9-8825-4b83-9684-d66a20166605 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:44.399970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76b6b9-8825-4b83-9684-d66a20166605 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:44.400255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76b6b9-8825-4b83-9684-d66a20166605 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/7b736bffedfb4736ae226ef08f0de09c/implies/cb3255f553474f758bcc02da24811a5a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:44.407183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76b6b9-8825-4b83-9684-d66a20166605 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7b736bffedfb4736ae226ef08f0de09c, implied_role_id=cb3255f553474f758bcc02da24811a5a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:44.408395 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-fe76b6b9-8825-4b83-9684-d66a20166605 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:44.408395 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:03:44.408395 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:03:44.411119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76b6b9-8825-4b83-9684-d66a20166605 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:44.485006 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2950/5831] 10.222.0.13 () {60 vars in 1362 bytes} [Sat Dec 18 21:03:44 2021] PUT /identity/v3/roles/7b736bffedfb4736ae226ef08f0de09c/implies/cb3255f553474f758bcc02da24811a5a => generated 530 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:03:44.486471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c87fb9-6b20-4504-b1bb-c973dfada36c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:44.509641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c87fb9-6b20-4504-b1bb-c973dfada36c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:44.697803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f1175-508e-47c8-b912-1f6d03c3a27e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:44.699095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f1175-508e-47c8-b912-1f6d03c3a27e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:44.699387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f1175-508e-47c8-b912-1f6d03c3a27e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:44.699669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f1175-508e-47c8-b912-1f6d03c3a27e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/7b736bffedfb4736ae226ef08f0de09c/implies/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:44.701726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f1175-508e-47c8-b912-1f6d03c3a27e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7b736bffedfb4736ae226ef08f0de09c, implied_role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:44.703661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f1175-508e-47c8-b912-1f6d03c3a27e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:44.770609 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2882/5832] 10.222.0.13 () {60 vars in 1362 bytes} [Sat Dec 18 21:03:44 2021] PUT /identity/v3/roles/7b736bffedfb4736ae226ef08f0de09c/implies/b1b0694d8e9046abbdc5d52f38ca2865 => generated 525 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:44.772303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76b6b9-8825-4b83-9684-d66a20166605 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:44.790625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76b6b9-8825-4b83-9684-d66a20166605 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:44.921836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664b782-e2a0-4745-b35c-ed649c9c686c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:44.923074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664b782-e2a0-4745-b35c-ed649c9c686c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:44.923368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664b782-e2a0-4745-b35c-ed649c9c686c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:44.923841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664b782-e2a0-4745-b35c-ed649c9c686c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/b1b0694d8e9046abbdc5d52f38ca2865/implies/7b736bffedfb4736ae226ef08f0de09c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:44.926756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664b782-e2a0-4745-b35c-ed649c9c686c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b1b0694d8e9046abbdc5d52f38ca2865, implied_role_id=7b736bffedfb4736ae226ef08f0de09c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:44.929692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664b782-e2a0-4745-b35c-ed649c9c686c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:44.961752 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-9664b782-e2a0-4745-b35c-ed649c9c686c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] 7b736bffedfb4736ae226ef08f0de09c cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 7b736bffedfb4736ae226ef08f0de09c cannot be an implied roles. Dec 18 21:03:44.963601 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2951/5833] 10.222.0.13 () {60 vars in 1362 bytes} [Sat Dec 18 21:03:44 2021] PUT /identity/v3/roles/b1b0694d8e9046abbdc5d52f38ca2865/implies/7b736bffedfb4736ae226ef08f0de09c => generated 116 bytes in 191 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:03:44.967459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f1175-508e-47c8-b912-1f6d03c3a27e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:44.984733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f1175-508e-47c8-b912-1f6d03c3a27e tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:44.991074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e86c3-b5fc-4a90-8cb0-388485a7b319 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:44.992696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e86c3-b5fc-4a90-8cb0-388485a7b319 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:44.993012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e86c3-b5fc-4a90-8cb0-388485a7b319 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:44.993286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e86c3-b5fc-4a90-8cb0-388485a7b319 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/7b736bffedfb4736ae226ef08f0de09c/implies/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:44.995622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e86c3-b5fc-4a90-8cb0-388485a7b319 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7b736bffedfb4736ae226ef08f0de09c, implied_role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:44.997236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e86c3-b5fc-4a90-8cb0-388485a7b319 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:45.009887 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2883/5834] 10.222.0.13 () {58 vars in 1346 bytes} [Sat Dec 18 21:03:44 2021] DELETE /identity/v3/roles/7b736bffedfb4736ae226ef08f0de09c/implies/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:45.015839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664b782-e2a0-4745-b35c-ed649c9c686c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:45.028555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664b782-e2a0-4745-b35c-ed649c9c686c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:45.131540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf90ede-c429-4999-882f-f0583cb13f2b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:45.133137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf90ede-c429-4999-882f-f0583cb13f2b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:45.133518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf90ede-c429-4999-882f-f0583cb13f2b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:45.134049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf90ede-c429-4999-882f-f0583cb13f2b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/7b736bffedfb4736ae226ef08f0de09c/implies/cb3255f553474f758bcc02da24811a5a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:45.135967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf90ede-c429-4999-882f-f0583cb13f2b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7b736bffedfb4736ae226ef08f0de09c, implied_role_id=cb3255f553474f758bcc02da24811a5a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:45.137225 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-2cf90ede-c429-4999-882f-f0583cb13f2b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:45.137225 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:03:45.137225 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:03:45.138296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf90ede-c429-4999-882f-f0583cb13f2b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:45.152718 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2952/5835] 10.222.0.13 () {58 vars in 1346 bytes} [Sat Dec 18 21:03:45 2021] DELETE /identity/v3/roles/7b736bffedfb4736ae226ef08f0de09c/implies/cb3255f553474f758bcc02da24811a5a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:45.153540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e86c3-b5fc-4a90-8cb0-388485a7b319 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:45.166790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e86c3-b5fc-4a90-8cb0-388485a7b319 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:45.245693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac0594-b744-46dd-9f5f-3e328f9e78fd tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:45.246704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac0594-b744-46dd-9f5f-3e328f9e78fd tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:45.247021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac0594-b744-46dd-9f5f-3e328f9e78fd tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:45.247314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac0594-b744-46dd-9f5f-3e328f9e78fd tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/cb3255f553474f758bcc02da24811a5a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:45.249147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac0594-b744-46dd-9f5f-3e328f9e78fd tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=cb3255f553474f758bcc02da24811a5a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:45.250978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac0594-b744-46dd-9f5f-3e328f9e78fd tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:45.332362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-25ac0594-b744-46dd-9f5f-3e328f9e78fd tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invalidating the token cache because role cb3255f553474f758bcc02da24811a5a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:45.333117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-25ac0594-b744-46dd-9f5f-3e328f9e78fd tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:45.336012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-25ac0594-b744-46dd-9f5f-3e328f9e78fd tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:45.338703 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2884/5836] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:45 2021] DELETE /identity/v3/roles/cb3255f553474f758bcc02da24811a5a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:45.344761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf90ede-c429-4999-882f-f0583cb13f2b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:45.346616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2cf90ede-c429-4999-882f-f0583cb13f2b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:45.367716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf90ede-c429-4999-882f-f0583cb13f2b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:45.441135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412278b-e4bd-4f0b-91df-ed929158f2b1 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:45.442641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412278b-e4bd-4f0b-91df-ed929158f2b1 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:45.443198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412278b-e4bd-4f0b-91df-ed929158f2b1 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:45.443718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412278b-e4bd-4f0b-91df-ed929158f2b1 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/domains/581a88b2ead244faac1fa929bd05f5f5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:45.470718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412278b-e4bd-4f0b-91df-ed929158f2b1 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=581a88b2ead244faac1fa929bd05f5f5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:45.477952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412278b-e4bd-4f0b-91df-ed929158f2b1 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:45.506515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9412278b-e4bd-4f0b-91df-ed929158f2b1 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '581a88b2ead244faac1fa929bd05f5f5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:45.508294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9412278b-e4bd-4f0b-91df-ed929158f2b1 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '581a88b2ead244faac1fa929bd05f5f5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:45.565485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9412278b-e4bd-4f0b-91df-ed929158f2b1 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '581a88b2ead244faac1fa929bd05f5f5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:45.566148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9412278b-e4bd-4f0b-91df-ed929158f2b1 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '581a88b2ead244faac1fa929bd05f5f5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:45.574912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac0594-b744-46dd-9f5f-3e328f9e78fd tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:45.575134 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2953/5837] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:03:45 2021] PATCH /identity/v3/domains/581a88b2ead244faac1fa929bd05f5f5 => generated 277 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:45.585918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac0594-b744-46dd-9f5f-3e328f9e78fd tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:45.667010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:45.668305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:45.668779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:45.669271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/domains/581a88b2ead244faac1fa929bd05f5f5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:45.682537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=581a88b2ead244faac1fa929bd05f5f5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:45.685228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:45.726762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '581a88b2ead244faac1fa929bd05f5f5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:45.731283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '581a88b2ead244faac1fa929bd05f5f5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:45.849560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581a88b2ead244faac1fa929bd05f5f5', 'request_id': 'req-873d27f8-7523-4083-a5db-761ccd378867'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:45.861090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581a88b2ead244faac1fa929bd05f5f5', 'request_id': 'req-873d27f8-7523-4083-a5db-761ccd378867'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:45.868634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581a88b2ead244faac1fa929bd05f5f5', 'request_id': 'req-873d27f8-7523-4083-a5db-761ccd378867'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:45.905363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] The token cache is being invalidate because project 581a88b2ead244faac1fa929bd05f5f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:45.907094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:45.908847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:45.922124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '581a88b2ead244faac1fa929bd05f5f5', 'request_id': 'req-873d27f8-7523-4083-a5db-761ccd378867'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:45.927936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '581a88b2ead244faac1fa929bd05f5f5', 'request_id': 'req-873d27f8-7523-4083-a5db-761ccd378867'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:45.928753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '581a88b2ead244faac1fa929bd05f5f5', 'request_id': 'req-873d27f8-7523-4083-a5db-761ccd378867'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:45.937111 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2885/5838] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:03:45 2021] DELETE /identity/v3/domains/581a88b2ead244faac1fa929bd05f5f5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:45.941047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412278b-e4bd-4f0b-91df-ed929158f2b1 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:45.942957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9412278b-e4bd-4f0b-91df-ed929158f2b1 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:45.957888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412278b-e4bd-4f0b-91df-ed929158f2b1 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:46.031640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20afb5-eb79-4930-8914-bb822ec5f20d tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:46.033038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20afb5-eb79-4930-8914-bb822ec5f20d tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:46.033331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20afb5-eb79-4930-8914-bb822ec5f20d tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:46.033618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20afb5-eb79-4930-8914-bb822ec5f20d tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/7b736bffedfb4736ae226ef08f0de09c/implies/1d63e411e03b4cdd96565a5b2356b872` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:46.035808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20afb5-eb79-4930-8914-bb822ec5f20d tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7b736bffedfb4736ae226ef08f0de09c, implied_role_id=1d63e411e03b4cdd96565a5b2356b872)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:46.037924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20afb5-eb79-4930-8914-bb822ec5f20d tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:46.054416 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2954/5839] 10.222.0.13 () {58 vars in 1346 bytes} [Sat Dec 18 21:03:45 2021] DELETE /identity/v3/roles/7b736bffedfb4736ae226ef08f0de09c/implies/1d63e411e03b4cdd96565a5b2356b872 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:46.058864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:46.066277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:46.084211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d27f8-7523-4083-a5db-761ccd378867 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:46.157396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb3940-d181-44d1-9ca4-8164f742354b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:46.159007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb3940-d181-44d1-9ca4-8164f742354b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:46.159007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb3940-d181-44d1-9ca4-8164f742354b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:46.159007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb3940-d181-44d1-9ca4-8164f742354b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/1d63e411e03b4cdd96565a5b2356b872` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:46.161163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb3940-d181-44d1-9ca4-8164f742354b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=1d63e411e03b4cdd96565a5b2356b872)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:46.161804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb3940-d181-44d1-9ca4-8164f742354b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:46.211982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6dcb3940-d181-44d1-9ca4-8164f742354b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invalidating the token cache because role 1d63e411e03b4cdd96565a5b2356b872 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:46.212397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6dcb3940-d181-44d1-9ca4-8164f742354b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:46.218005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6dcb3940-d181-44d1-9ca4-8164f742354b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:46.226203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20afb5-eb79-4930-8914-bb822ec5f20d tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:46.226995 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2886/5840] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:46 2021] DELETE /identity/v3/roles/1d63e411e03b4cdd96565a5b2356b872 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:46.228455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4f20afb5-eb79-4930-8914-bb822ec5f20d tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:46.249222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20afb5-eb79-4930-8914-bb822ec5f20d tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:46.325083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2beae-b3d3-4509-822e-63ec4d565c24 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:46.326355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2beae-b3d3-4509-822e-63ec4d565c24 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:46.326749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2beae-b3d3-4509-822e-63ec4d565c24 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:46.327135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2beae-b3d3-4509-822e-63ec4d565c24 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/7b736bffedfb4736ae226ef08f0de09c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:46.329082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2beae-b3d3-4509-822e-63ec4d565c24 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=7b736bffedfb4736ae226ef08f0de09c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:46.330279 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-01e2beae-b3d3-4509-822e-63ec4d565c24 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:46.330279 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:03:46.330279 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:03:46.331830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2beae-b3d3-4509-822e-63ec4d565c24 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:46.391779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-01e2beae-b3d3-4509-822e-63ec4d565c24 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invalidating the token cache because role 7b736bffedfb4736ae226ef08f0de09c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:46.392193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-01e2beae-b3d3-4509-822e-63ec4d565c24 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:46.392947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-01e2beae-b3d3-4509-822e-63ec4d565c24 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:46.395400 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2955/5841] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:46 2021] DELETE /identity/v3/roles/7b736bffedfb4736ae226ef08f0de09c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:46.403866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb3940-d181-44d1-9ca4-8164f742354b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:46.415239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb3940-d181-44d1-9ca4-8164f742354b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:46.481220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc92ec4-b6bf-4c84-b7a2-685a913dc91c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:46.482154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92ec4-b6bf-4c84-b7a2-685a913dc91c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:46.483514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92ec4-b6bf-4c84-b7a2-685a913dc91c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:46.483514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92ec4-b6bf-4c84-b7a2-685a913dc91c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:46.484735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc92ec4-b6bf-4c84-b7a2-685a913dc91c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=581693129fcf4914bb64fa1c86fa3cac)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:46.486890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc92ec4-b6bf-4c84-b7a2-685a913dc91c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:46.494587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2beae-b3d3-4509-822e-63ec4d565c24 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:46.496690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-01e2beae-b3d3-4509-822e-63ec4d565c24 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:46.555927 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2887/5842] 10.222.0.13 () {60 vars in 1362 bytes} [Sat Dec 18 21:03:46 2021] PUT /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac => generated 520 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:03:46.560049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc92ec4-b6bf-4c84-b7a2-685a913dc91c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:46.563744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3cc92ec4-b6bf-4c84-b7a2-685a913dc91c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:46.668241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2beae-b3d3-4509-822e-63ec4d565c24 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:46.745436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc92ec4-b6bf-4c84-b7a2-685a913dc91c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:46.753914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761cfb5-4940-4897-bfe2-30d8c99c04bc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:46.755389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761cfb5-4940-4897-bfe2-30d8c99c04bc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:46.756102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761cfb5-4940-4897-bfe2-30d8c99c04bc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:46.756447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761cfb5-4940-4897-bfe2-30d8c99c04bc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:46.758696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761cfb5-4940-4897-bfe2-30d8c99c04bc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=581693129fcf4914bb64fa1c86fa3cac)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:46.759904 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-e761cfb5-4940-4897-bfe2-30d8c99c04bc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:46.759904 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:03:46.759904 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:03:46.764645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761cfb5-4940-4897-bfe2-30d8c99c04bc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:46.766203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761cfb5-4940-4897-bfe2-30d8c99c04bc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=581693129fcf4914bb64fa1c86fa3cac)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:46.778850 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-e761cfb5-4940-4897-bfe2-30d8c99c04bc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:46.778850 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:03:46.778850 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:03:46.780272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761cfb5-4940-4897-bfe2-30d8c99c04bc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:46.793226 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2888/5843] 10.222.0.13 () {58 vars in 1344 bytes} [Sat Dec 18 21:03:46 2021] HEAD /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:46.794976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761cfb5-4940-4897-bfe2-30d8c99c04bc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:46.819319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bbb7a-00df-4618-90f5-608b68b7d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:46.821623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bbb7a-00df-4618-90f5-608b68b7d3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:46.821916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bbb7a-00df-4618-90f5-608b68b7d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:46.822318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bbb7a-00df-4618-90f5-608b68b7d3f4 admin admin] PATH_INFO: `/v3/users/3fe58c6d2fc442e99956fb3b8d4f0e56` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:46.826568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3bbb7a-00df-4618-90f5-608b68b7d3f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe58c6d2fc442e99956fb3b8d4f0e56)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:46.828729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3bbb7a-00df-4618-90f5-608b68b7d3f4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:46.845775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761cfb5-4940-4897-bfe2-30d8c99c04bc tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:46.888392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72991bd-20d3-45d2-8801-19baf91d431f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:46.890087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72991bd-20d3-45d2-8801-19baf91d431f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:46.891045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72991bd-20d3-45d2-8801-19baf91d431f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:46.891629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72991bd-20d3-45d2-8801-19baf91d431f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:46.894466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72991bd-20d3-45d2-8801-19baf91d431f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=581693129fcf4914bb64fa1c86fa3cac)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:46.903913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72991bd-20d3-45d2-8801-19baf91d431f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:46.910390 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2889/5844] 10.222.0.13 () {58 vars in 1343 bytes} [Sat Dec 18 21:03:46 2021] GET /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac => generated 520 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:46.914807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72991bd-20d3-45d2-8801-19baf91d431f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:46.917857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7f3bbb7a-00df-4618-90f5-608b68b7d3f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe58c6d2fc442e99956fb3b8d4f0e56'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:46.936607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7f3bbb7a-00df-4618-90f5-608b68b7d3f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe58c6d2fc442e99956fb3b8d4f0e56'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:46.938729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7f3bbb7a-00df-4618-90f5-608b68b7d3f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe58c6d2fc442e99956fb3b8d4f0e56'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:46.945742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72991bd-20d3-45d2-8801-19baf91d431f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:46.965590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20504a6-85b9-437c-87bb-8917c1e363c5 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:46.966978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20504a6-85b9-437c-87bb-8917c1e363c5 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:46.967252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20504a6-85b9-437c-87bb-8917c1e363c5 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:46.967534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20504a6-85b9-437c-87bb-8917c1e363c5 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:46.970939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20504a6-85b9-437c-87bb-8917c1e363c5 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=581693129fcf4914bb64fa1c86fa3cac)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:46.972158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20504a6-85b9-437c-87bb-8917c1e363c5 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:46.978926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7f3bbb7a-00df-4618-90f5-608b68b7d3f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe58c6d2fc442e99956fb3b8d4f0e56'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:46.989449 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2890/5845] 10.222.0.13 () {58 vars in 1346 bytes} [Sat Dec 18 21:03:46 2021] DELETE /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:46.994374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20504a6-85b9-437c-87bb-8917c1e363c5 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:46.996448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7f3bbb7a-00df-4618-90f5-608b68b7d3f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe58c6d2fc442e99956fb3b8d4f0e56'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:47.013566 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2956/5846] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:46 2021] DELETE /identity/v3/users/3fe58c6d2fc442e99956fb3b8d4f0e56 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:47.015762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e155ca6-5b32-4dd1-a734-33574a7622ec None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:47.015762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e155ca6-5b32-4dd1-a734-33574a7622ec None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:47.016070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e155ca6-5b32-4dd1-a734-33574a7622ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:47.041942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5e155ca6-5b32-4dd1-a734-33574a7622ec None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:47.044068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5e155ca6-5b32-4dd1-a734-33574a7622ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:47.176144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20504a6-85b9-437c-87bb-8917c1e363c5 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:47.247619 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2957/5847] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:47.266762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e155ca6-5b32-4dd1-a734-33574a7622ec None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:47.268192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5e155ca6-5b32-4dd1-a734-33574a7622ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:47.303361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bb402-294d-4076-a546-06777252cd3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:47.305748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bb402-294d-4076-a546-06777252cd3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:47.306326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bb402-294d-4076-a546-06777252cd3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:47.306783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bb402-294d-4076-a546-06777252cd3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:47.308887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bb402-294d-4076-a546-06777252cd3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=581693129fcf4914bb64fa1c86fa3cac)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:47.311493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bb402-294d-4076-a546-06777252cd3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:47.328517 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-746bb402-294d-4076-a546-06777252cd3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] bb138913933849ebb17eba9f634ae018 does not imply 581693129fcf4914bb64fa1c86fa3cac.: keystone.exception.ImpliedRoleNotFound: bb138913933849ebb17eba9f634ae018 does not imply 581693129fcf4914bb64fa1c86fa3cac. Dec 18 21:03:47.331021 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2891/5848] 10.222.0.13 () {58 vars in 1343 bytes} [Sat Dec 18 21:03:46 2021] GET /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac => generated 137 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:03:47.335672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bb402-294d-4076-a546-06777252cd3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:47.338178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-746bb402-294d-4076-a546-06777252cd3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:47.353539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bb402-294d-4076-a546-06777252cd3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:47.361323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0824922-2ac5-4ae2-8e86-804f47a0514c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:47.362536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0824922-2ac5-4ae2-8e86-804f47a0514c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:47.362941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0824922-2ac5-4ae2-8e86-804f47a0514c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:47.363324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0824922-2ac5-4ae2-8e86-804f47a0514c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:47.365320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0824922-2ac5-4ae2-8e86-804f47a0514c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=581693129fcf4914bb64fa1c86fa3cac)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:47.369204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0824922-2ac5-4ae2-8e86-804f47a0514c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:47.391900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e155ca6-5b32-4dd1-a734-33574a7622ec None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:47.402616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d42e26-60e2-46f3-8dc7-e95b6ede2a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:47.403276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42e26-60e2-46f3-8dc7-e95b6ede2a25 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:47.403565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42e26-60e2-46f3-8dc7-e95b6ede2a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:47.403846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42e26-60e2-46f3-8dc7-e95b6ede2a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:47.406547 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-b0824922-2ac5-4ae2-8e86-804f47a0514c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] bb138913933849ebb17eba9f634ae018 does not imply 581693129fcf4914bb64fa1c86fa3cac.: keystone.exception.ImpliedRoleNotFound: bb138913933849ebb17eba9f634ae018 does not imply 581693129fcf4914bb64fa1c86fa3cac. Dec 18 21:03:47.409531 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2892/5849] 10.222.0.13 () {58 vars in 1346 bytes} [Sat Dec 18 21:03:47 2021] DELETE /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac => generated 137 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 18 21:03:47.415412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0824922-2ac5-4ae2-8e86-804f47a0514c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:47.424867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d42e26-60e2-46f3-8dc7-e95b6ede2a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:47.426456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d42e26-60e2-46f3-8dc7-e95b6ede2a25 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:47.441370 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2958/5850] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:47.441603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0824922-2ac5-4ae2-8e86-804f47a0514c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:47.448918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9dbc0-de8e-46cf-a43f-083e7ce9e894 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:47.449866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9dbc0-de8e-46cf-a43f-083e7ce9e894 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:47.450157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9dbc0-de8e-46cf-a43f-083e7ce9e894 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:47.450473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9dbc0-de8e-46cf-a43f-083e7ce9e894 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:47.452385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9dbc0-de8e-46cf-a43f-083e7ce9e894 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=581693129fcf4914bb64fa1c86fa3cac)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:47.454079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9dbc0-de8e-46cf-a43f-083e7ce9e894 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:47.497863 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2893/5851] 10.222.0.13 () {60 vars in 1362 bytes} [Sat Dec 18 21:03:47 2021] PUT /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac => generated 520 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:47.502552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d42e26-60e2-46f3-8dc7-e95b6ede2a25 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:47.517382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d42e26-60e2-46f3-8dc7-e95b6ede2a25 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:47.625343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a4ad1-e81c-4a80-a5ae-714d8000e4d4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:47.626786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a4ad1-e81c-4a80-a5ae-714d8000e4d4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:47.627079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a4ad1-e81c-4a80-a5ae-714d8000e4d4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:47.627365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a4ad1-e81c-4a80-a5ae-714d8000e4d4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies/dad3072068e040659036efa71e9cc583` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:47.630673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a4ad1-e81c-4a80-a5ae-714d8000e4d4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=dad3072068e040659036efa71e9cc583)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:47.632333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a4ad1-e81c-4a80-a5ae-714d8000e4d4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:47.665958 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2959/5852] 10.222.0.13 () {60 vars in 1362 bytes} [Sat Dec 18 21:03:47 2021] PUT /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies/dad3072068e040659036efa71e9cc583 => generated 521 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:03:47.670519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9dbc0-de8e-46cf-a43f-083e7ce9e894 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:47.682927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9dbc0-de8e-46cf-a43f-083e7ce9e894 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:47.790612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a8a64-7efa-4cb9-ab1a-23ddace50e32 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:47.791583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a8a64-7efa-4cb9-ab1a-23ddace50e32 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:47.791874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a8a64-7efa-4cb9-ab1a-23ddace50e32 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:47.792158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a8a64-7efa-4cb9-ab1a-23ddace50e32 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/dad3072068e040659036efa71e9cc583/implies/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:47.794706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a8a64-7efa-4cb9-ab1a-23ddace50e32 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=dad3072068e040659036efa71e9cc583, implied_role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:47.799174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a8a64-7efa-4cb9-ab1a-23ddace50e32 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:47.839418 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2894/5853] 10.222.0.13 () {60 vars in 1362 bytes} [Sat Dec 18 21:03:47 2021] PUT /identity/v3/roles/dad3072068e040659036efa71e9cc583/implies/b1b0694d8e9046abbdc5d52f38ca2865 => generated 520 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:47.841456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a4ad1-e81c-4a80-a5ae-714d8000e4d4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:47.857425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a4ad1-e81c-4a80-a5ae-714d8000e4d4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:47.985427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796b639-18be-4e3f-a406-3cfd9ba9d96a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:47.987036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796b639-18be-4e3f-a406-3cfd9ba9d96a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:47.988016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796b639-18be-4e3f-a406-3cfd9ba9d96a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:47.988969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796b639-18be-4e3f-a406-3cfd9ba9d96a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:47.990597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796b639-18be-4e3f-a406-3cfd9ba9d96a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:47.993571 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-7796b639-18be-4e3f-a406-3cfd9ba9d96a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:47.993571 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:03:47.993571 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:03:47.998178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796b639-18be-4e3f-a406-3cfd9ba9d96a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:48.059170 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2960/5854] 10.222.0.13 () {58 vars in 1151 bytes} [Sat Dec 18 21:03:47 2021] GET /identity/v3/role_inferences => generated 1606 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:48.067178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a8a64-7efa-4cb9-ab1a-23ddace50e32 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:48.081141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a8a64-7efa-4cb9-ab1a-23ddace50e32 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:48.092599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89e4b7-4b99-484d-91aa-26a389a3c863 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:48.094291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89e4b7-4b99-484d-91aa-26a389a3c863 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:48.094825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89e4b7-4b99-484d-91aa-26a389a3c863 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:48.097860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89e4b7-4b99-484d-91aa-26a389a3c863 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/dad3072068e040659036efa71e9cc583/implies/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:48.108146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89e4b7-4b99-484d-91aa-26a389a3c863 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=dad3072068e040659036efa71e9cc583, implied_role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:48.110185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89e4b7-4b99-484d-91aa-26a389a3c863 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:48.125068 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2895/5855] 10.222.0.13 () {58 vars in 1346 bytes} [Sat Dec 18 21:03:48 2021] DELETE /identity/v3/roles/dad3072068e040659036efa71e9cc583/implies/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:48.131114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796b639-18be-4e3f-a406-3cfd9ba9d96a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:48.162977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796b639-18be-4e3f-a406-3cfd9ba9d96a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:48.246755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89e4b7-4b99-484d-91aa-26a389a3c863 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:48.248634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2d89e4b7-4b99-484d-91aa-26a389a3c863 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:48.291451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f4136-1939-4bd8-9ee6-027cb0f480ec tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:48.292830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f4136-1939-4bd8-9ee6-027cb0f480ec tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:48.293488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f4136-1939-4bd8-9ee6-027cb0f480ec tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:48.294016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f4136-1939-4bd8-9ee6-027cb0f480ec tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies/dad3072068e040659036efa71e9cc583` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:48.296439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f4136-1939-4bd8-9ee6-027cb0f480ec tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=dad3072068e040659036efa71e9cc583)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:48.301460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f4136-1939-4bd8-9ee6-027cb0f480ec tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:48.322603 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2961/5856] 10.222.0.13 () {58 vars in 1346 bytes} [Sat Dec 18 21:03:48 2021] DELETE /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies/dad3072068e040659036efa71e9cc583 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:48.330616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f4136-1939-4bd8-9ee6-027cb0f480ec tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:48.404772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89e4b7-4b99-484d-91aa-26a389a3c863 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:48.430968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f4136-1939-4bd8-9ee6-027cb0f480ec tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:48.438133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572ec61-bd72-4a7a-a5e9-b4589ead6cb7 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:48.440623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572ec61-bd72-4a7a-a5e9-b4589ead6cb7 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:48.441639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572ec61-bd72-4a7a-a5e9-b4589ead6cb7 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:48.454134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572ec61-bd72-4a7a-a5e9-b4589ead6cb7 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:48.456857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572ec61-bd72-4a7a-a5e9-b4589ead6cb7 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=581693129fcf4914bb64fa1c86fa3cac)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:48.458705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572ec61-bd72-4a7a-a5e9-b4589ead6cb7 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:48.478063 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2962/5857] 10.222.0.13 () {58 vars in 1346 bytes} [Sat Dec 18 21:03:48 2021] DELETE /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:48.483778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572ec61-bd72-4a7a-a5e9-b4589ead6cb7 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:48.521091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:48.522268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:48.522268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:48.522268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818 admin admin] PATH_INFO: `/v3/projects/3b863fb8f5a04bf5af92236a9a0b8e8c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:48.528553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b863fb8f5a04bf5af92236a9a0b8e8c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:48.536588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:48.674882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b863fb8f5a04bf5af92236a9a0b8e8c', 'request_id': 'req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:48.683282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572ec61-bd72-4a7a-a5e9-b4589ead6cb7 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:48.689562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b863fb8f5a04bf5af92236a9a0b8e8c', 'request_id': 'req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:48.697776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b863fb8f5a04bf5af92236a9a0b8e8c', 'request_id': 'req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:48.718105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818 admin admin] The token cache is being invalidate because project 3b863fb8f5a04bf5af92236a9a0b8e8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:48.720648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:48.721783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:48.724984 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2896/5858] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:48 2021] DELETE /identity/v3/projects/3b863fb8f5a04bf5af92236a9a0b8e8c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:48.729608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:48.731609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:48.759695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095fcbd-48f7-4532-9f57-e0b0b134cea4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:48.760728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095fcbd-48f7-4532-9f57-e0b0b134cea4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:48.761120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095fcbd-48f7-4532-9f57-e0b0b134cea4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:48.761509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095fcbd-48f7-4532-9f57-e0b0b134cea4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:48.762415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095fcbd-48f7-4532-9f57-e0b0b134cea4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:48.764151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095fcbd-48f7-4532-9f57-e0b0b134cea4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:48.784762 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2963/5859] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:48 2021] GET /identity/v3/roles => generated 2322 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:48.786616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095fcbd-48f7-4532-9f57-e0b0b134cea4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:48.788661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7095fcbd-48f7-4532-9f57-e0b0b134cea4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:48.807113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095fcbd-48f7-4532-9f57-e0b0b134cea4 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:48.813072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528d2e-9b28-4239-848e-7115befb9325 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:48.815358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528d2e-9b28-4239-848e-7115befb9325 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:48.815358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528d2e-9b28-4239-848e-7115befb9325 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:48.815889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528d2e-9b28-4239-848e-7115befb9325 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:48.817222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39528d2e-9b28-4239-848e-7115befb9325 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:48.819266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39528d2e-9b28-4239-848e-7115befb9325 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:48.830374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f4c83-b22f-4d2c-b2f6-4e356dd35818 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:48.842412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06340453-245a-4c83-9dce-2de498618c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:48.844130 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2964/5860] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:03:48 2021] POST /identity/v3/roles => generated 235 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:48.846470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06340453-245a-4c83-9dce-2de498618c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:48.847476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528d2e-9b28-4239-848e-7115befb9325 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:48.848123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06340453-245a-4c83-9dce-2de498618c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:48.848335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06340453-245a-4c83-9dce-2de498618c39 admin admin] PATH_INFO: `/v3/users/1d38732e0e964ca2a7a05e1b530d3180` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:48.850082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06340453-245a-4c83-9dce-2de498618c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d38732e0e964ca2a7a05e1b530d3180)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:48.852608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06340453-245a-4c83-9dce-2de498618c39 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:48.863832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528d2e-9b28-4239-848e-7115befb9325 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:48.869606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf777cc2-e8df-4b14-9283-2d2e38b62852 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:48.870640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf777cc2-e8df-4b14-9283-2d2e38b62852 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:48.871041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf777cc2-e8df-4b14-9283-2d2e38b62852 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:48.871443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf777cc2-e8df-4b14-9283-2d2e38b62852 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/83d493abd8e34550a019ea9ec59cb4ec` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:48.873254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf777cc2-e8df-4b14-9283-2d2e38b62852 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:update_role(role_id=83d493abd8e34550a019ea9ec59cb4ec)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:48.874486 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-cf777cc2-e8df-4b14-9283-2d2e38b62852 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:48.874486 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:03:48.874486 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:03:48.875737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf777cc2-e8df-4b14-9283-2d2e38b62852 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:48.927629 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2965/5861] 10.222.0.13 () {60 vars in 1242 bytes} [Sat Dec 18 21:03:48 2021] PATCH /identity/v3/roles/83d493abd8e34550a019ea9ec59cb4ec => generated 237 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:48.933192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf777cc2-e8df-4b14-9283-2d2e38b62852 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:48.947905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf777cc2-e8df-4b14-9283-2d2e38b62852 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:48.948131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-06340453-245a-4c83-9dce-2de498618c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d38732e0e964ca2a7a05e1b530d3180'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:48.955797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc4f32-4770-4ee6-be16-22f57bc8b148 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:48.957104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc4f32-4770-4ee6-be16-22f57bc8b148 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:48.957652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc4f32-4770-4ee6-be16-22f57bc8b148 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:48.958214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-06340453-245a-4c83-9dce-2de498618c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d38732e0e964ca2a7a05e1b530d3180'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:48.958398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc4f32-4770-4ee6-be16-22f57bc8b148 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/83d493abd8e34550a019ea9ec59cb4ec` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:48.968198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc4f32-4770-4ee6-be16-22f57bc8b148 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:get_role(role_id=83d493abd8e34550a019ea9ec59cb4ec)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:48.970399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc4f32-4770-4ee6-be16-22f57bc8b148 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:48.973273 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2966/5862] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 21:03:48 2021] GET /identity/v3/roles/83d493abd8e34550a019ea9ec59cb4ec => generated 237 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:48.976975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc4f32-4770-4ee6-be16-22f57bc8b148 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:48.977477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-06340453-245a-4c83-9dce-2de498618c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d38732e0e964ca2a7a05e1b530d3180'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:48.978308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-06340453-245a-4c83-9dce-2de498618c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d38732e0e964ca2a7a05e1b530d3180'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:48.988907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc4f32-4770-4ee6-be16-22f57bc8b148 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:48.992516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-06340453-245a-4c83-9dce-2de498618c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d38732e0e964ca2a7a05e1b530d3180'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:48.995923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764f318-f9bc-4135-9057-b5084f186bc2 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:48.997288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764f318-f9bc-4135-9057-b5084f186bc2 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:48.997721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764f318-f9bc-4135-9057-b5084f186bc2 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:48.998124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764f318-f9bc-4135-9057-b5084f186bc2 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:49.000697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764f318-f9bc-4135-9057-b5084f186bc2 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:49.002609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764f318-f9bc-4135-9057-b5084f186bc2 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:49.002795 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2897/5863] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:48 2021] DELETE /identity/v3/users/1d38732e0e964ca2a7a05e1b530d3180 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:49.020769 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2967/5864] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:48 2021] GET /identity/v3/roles => generated 2550 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:49.022974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06340453-245a-4c83-9dce-2de498618c39 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:49.024605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-06340453-245a-4c83-9dce-2de498618c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:49.107051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06340453-245a-4c83-9dce-2de498618c39 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:49.113913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a2fe0-5d06-46ca-8edc-b886e4482a46 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:49.115082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a2fe0-5d06-46ca-8edc-b886e4482a46 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:49.115432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a2fe0-5d06-46ca-8edc-b886e4482a46 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:49.115734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a2fe0-5d06-46ca-8edc-b886e4482a46 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/83d493abd8e34550a019ea9ec59cb4ec` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:49.118071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a2fe0-5d06-46ca-8edc-b886e4482a46 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_role(role_id=83d493abd8e34550a019ea9ec59cb4ec)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:49.119869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a2fe0-5d06-46ca-8edc-b886e4482a46 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:49.172844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f1a2fe0-5d06-46ca-8edc-b886e4482a46 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invalidating the token cache because role 83d493abd8e34550a019ea9ec59cb4ec has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:49.172844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f1a2fe0-5d06-46ca-8edc-b886e4482a46 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:49.174409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f1a2fe0-5d06-46ca-8edc-b886e4482a46 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:49.183522 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2898/5865] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:49 2021] DELETE /identity/v3/roles/83d493abd8e34550a019ea9ec59cb4ec => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:49.188665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764f318-f9bc-4135-9057-b5084f186bc2 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:49.190673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2764f318-f9bc-4135-9057-b5084f186bc2 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:49.205261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764f318-f9bc-4135-9057-b5084f186bc2 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:49.290413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ef5df-e903-410a-a9fa-e47c081250ec tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:49.291447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ef5df-e903-410a-a9fa-e47c081250ec tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:49.291805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ef5df-e903-410a-a9fa-e47c081250ec tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:49.292180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ef5df-e903-410a-a9fa-e47c081250ec tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:49.294087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ef5df-e903-410a-a9fa-e47c081250ec tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=581693129fcf4914bb64fa1c86fa3cac)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:49.296615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ef5df-e903-410a-a9fa-e47c081250ec tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:49.328358 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2968/5866] 10.222.0.13 () {60 vars in 1362 bytes} [Sat Dec 18 21:03:49 2021] PUT /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac => generated 520 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:49.332409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a2fe0-5d06-46ca-8edc-b886e4482a46 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:49.343794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a2fe0-5d06-46ca-8edc-b886e4482a46 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:49.432458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbf4c8-0bb2-4394-a142-c8f13f0eb75b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:49.433558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbf4c8-0bb2-4394-a142-c8f13f0eb75b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:49.433920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbf4c8-0bb2-4394-a142-c8f13f0eb75b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:49.434310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbf4c8-0bb2-4394-a142-c8f13f0eb75b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies/dad3072068e040659036efa71e9cc583` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:49.436992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbf4c8-0bb2-4394-a142-c8f13f0eb75b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=dad3072068e040659036efa71e9cc583)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:49.438853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbf4c8-0bb2-4394-a142-c8f13f0eb75b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:49.488680 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2899/5867] 10.222.0.13 () {60 vars in 1362 bytes} [Sat Dec 18 21:03:49 2021] PUT /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies/dad3072068e040659036efa71e9cc583 => generated 521 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:03:49.490033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ef5df-e903-410a-a9fa-e47c081250ec tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:49.503763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ef5df-e903-410a-a9fa-e47c081250ec tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:49.591443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be79a39-0f4a-4c17-80c9-8bda36b3670c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:49.593198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be79a39-0f4a-4c17-80c9-8bda36b3670c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:49.593714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be79a39-0f4a-4c17-80c9-8bda36b3670c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:49.594237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be79a39-0f4a-4c17-80c9-8bda36b3670c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/dad3072068e040659036efa71e9cc583/implies/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:49.596267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be79a39-0f4a-4c17-80c9-8bda36b3670c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=dad3072068e040659036efa71e9cc583, implied_role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:49.598152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be79a39-0f4a-4c17-80c9-8bda36b3670c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:49.636902 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2969/5868] 10.222.0.13 () {60 vars in 1362 bytes} [Sat Dec 18 21:03:49 2021] PUT /identity/v3/roles/dad3072068e040659036efa71e9cc583/implies/b1b0694d8e9046abbdc5d52f38ca2865 => generated 520 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:49.638480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbf4c8-0bb2-4394-a142-c8f13f0eb75b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:49.651325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbf4c8-0bb2-4394-a142-c8f13f0eb75b tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:49.742245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be79a39-0f4a-4c17-80c9-8bda36b3670c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:49.744490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0dc387-e08f-4a84-9dad-bdfff0710139 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:49.745423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0dc387-e08f-4a84-9dad-bdfff0710139 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:49.745828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0dc387-e08f-4a84-9dad-bdfff0710139 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:49.746120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0dc387-e08f-4a84-9dad-bdfff0710139 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/dad3072068e040659036efa71e9cc583/implies` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:49.746867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2be79a39-0f4a-4c17-80c9-8bda36b3670c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:49.747380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0dc387-e08f-4a84-9dad-bdfff0710139 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=dad3072068e040659036efa71e9cc583)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:49.748388 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-dd0dc387-e08f-4a84-9dad-bdfff0710139 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:03:49.748388 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:03:49.748388 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:03:49.749340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0dc387-e08f-4a84-9dad-bdfff0710139 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:49.758993 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2900/5869] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:03:49 2021] GET /identity/v3/roles/dad3072068e040659036efa71e9cc583/implies => generated 489 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:49.763098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0dc387-e08f-4a84-9dad-bdfff0710139 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:49.784784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0dc387-e08f-4a84-9dad-bdfff0710139 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:49.795060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ddf9f-5eb5-449f-b2b1-17cdb0570319 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:49.797553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ddf9f-5eb5-449f-b2b1-17cdb0570319 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:49.797852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ddf9f-5eb5-449f-b2b1-17cdb0570319 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:49.798212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ddf9f-5eb5-449f-b2b1-17cdb0570319 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:49.800416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ddf9f-5eb5-449f-b2b1-17cdb0570319 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=bb138913933849ebb17eba9f634ae018)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:49.802091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ddf9f-5eb5-449f-b2b1-17cdb0570319 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:49.827173 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2901/5870] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:03:49 2021] GET /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies => generated 660 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:03:49.831886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ddf9f-5eb5-449f-b2b1-17cdb0570319 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:49.850648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ddf9f-5eb5-449f-b2b1-17cdb0570319 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:49.856923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0c1c3-e02d-4045-b5a6-09358a4541e8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:49.858017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0c1c3-e02d-4045-b5a6-09358a4541e8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:49.858653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0c1c3-e02d-4045-b5a6-09358a4541e8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:49.858939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0c1c3-e02d-4045-b5a6-09358a4541e8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/dad3072068e040659036efa71e9cc583/implies/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:49.862570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0c1c3-e02d-4045-b5a6-09358a4541e8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=dad3072068e040659036efa71e9cc583, implied_role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:49.864481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0c1c3-e02d-4045-b5a6-09358a4541e8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:49.876278 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2902/5871] 10.222.0.13 () {58 vars in 1346 bytes} [Sat Dec 18 21:03:49 2021] DELETE /identity/v3/roles/dad3072068e040659036efa71e9cc583/implies/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:49.880829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0c1c3-e02d-4045-b5a6-09358a4541e8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:49.883316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be79a39-0f4a-4c17-80c9-8bda36b3670c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:49.962814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0c1c3-e02d-4045-b5a6-09358a4541e8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:49.967931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182564d6-b94d-40cd-80c6-0e661ca5a95f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:49.969070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182564d6-b94d-40cd-80c6-0e661ca5a95f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:49.969394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182564d6-b94d-40cd-80c6-0e661ca5a95f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:49.969796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182564d6-b94d-40cd-80c6-0e661ca5a95f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies/dad3072068e040659036efa71e9cc583` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:49.972053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182564d6-b94d-40cd-80c6-0e661ca5a95f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=dad3072068e040659036efa71e9cc583)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:49.973783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182564d6-b94d-40cd-80c6-0e661ca5a95f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:49.985534 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2903/5872] 10.222.0.13 () {58 vars in 1346 bytes} [Sat Dec 18 21:03:49 2021] DELETE /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies/dad3072068e040659036efa71e9cc583 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:49.989661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3bb49-5f71-41ea-bb9a-71fe539acf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:49.990657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3bb49-5f71-41ea-bb9a-71fe539acf4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:49.992873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3bb49-5f71-41ea-bb9a-71fe539acf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:49.993189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3bb49-5f71-41ea-bb9a-71fe539acf4a admin admin] PATH_INFO: `/v3/projects/033500781fb149b997b81b3d38bc507e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:49.994891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3bb49-5f71-41ea-bb9a-71fe539acf4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=033500781fb149b997b81b3d38bc507e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:49.998096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3bb49-5f71-41ea-bb9a-71fe539acf4a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:50.008689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182564d6-b94d-40cd-80c6-0e661ca5a95f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:50.064716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9f3bb49-5f71-41ea-bb9a-71fe539acf4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033500781fb149b997b81b3d38bc507e', 'request_id': 'req-c9f3bb49-5f71-41ea-bb9a-71fe539acf4a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:50.102005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9f3bb49-5f71-41ea-bb9a-71fe539acf4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033500781fb149b997b81b3d38bc507e', 'request_id': 'req-c9f3bb49-5f71-41ea-bb9a-71fe539acf4a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:50.107824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182564d6-b94d-40cd-80c6-0e661ca5a95f tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:50.121997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9f3bb49-5f71-41ea-bb9a-71fe539acf4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033500781fb149b997b81b3d38bc507e', 'request_id': 'req-c9f3bb49-5f71-41ea-bb9a-71fe539acf4a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:50.144882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9f3bb49-5f71-41ea-bb9a-71fe539acf4a admin admin] The token cache is being invalidate because project 033500781fb149b997b81b3d38bc507e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:50.146982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9f3bb49-5f71-41ea-bb9a-71fe539acf4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:50.150185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c9f3bb49-5f71-41ea-bb9a-71fe539acf4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:50.153705 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2970/5873] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:49 2021] DELETE /identity/v3/projects/033500781fb149b997b81b3d38bc507e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:50.160343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540c5f4-fecc-458d-ab8c-32dc82f6350c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:50.160729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540c5f4-fecc-458d-ab8c-32dc82f6350c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:50.161110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540c5f4-fecc-458d-ab8c-32dc82f6350c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:50.209577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2540c5f4-fecc-458d-ab8c-32dc82f6350c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:50.213299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2540c5f4-fecc-458d-ab8c-32dc82f6350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:50.243433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124129a-d07c-4409-be0a-0e30de20bced tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:50.246886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124129a-d07c-4409-be0a-0e30de20bced tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:50.247265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124129a-d07c-4409-be0a-0e30de20bced tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:50.247563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124129a-d07c-4409-be0a-0e30de20bced tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:50.252168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124129a-d07c-4409-be0a-0e30de20bced tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bb138913933849ebb17eba9f634ae018, implied_role_id=581693129fcf4914bb64fa1c86fa3cac)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:50.253801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124129a-d07c-4409-be0a-0e30de20bced tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:50.281662 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2904/5874] 10.222.0.13 () {58 vars in 1346 bytes} [Sat Dec 18 21:03:50 2021] DELETE /identity/v3/roles/bb138913933849ebb17eba9f634ae018/implies/581693129fcf4914bb64fa1c86fa3cac => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:50.286711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124129a-d07c-4409-be0a-0e30de20bced tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:50.288631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1124129a-d07c-4409-be0a-0e30de20bced tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:50.371245 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2971/5875] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:03:50.378907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1850ed-3aae-4e56-926d-1eeb3db918c6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:50.379322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1850ed-3aae-4e56-926d-1eeb3db918c6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:50.379931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1850ed-3aae-4e56-926d-1eeb3db918c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:50.411302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5f1850ed-3aae-4e56-926d-1eeb3db918c6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:50.412844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5f1850ed-3aae-4e56-926d-1eeb3db918c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:50.415368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124129a-d07c-4409-be0a-0e30de20bced tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:50.426728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61952f4-0709-4c8a-a999-08a2d8024b3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:50.428349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61952f4-0709-4c8a-a999-08a2d8024b3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:50.429409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61952f4-0709-4c8a-a999-08a2d8024b3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:50.430221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61952f4-0709-4c8a-a999-08a2d8024b3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/domains/581a88b2ead244faac1fa929bd05f5f5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:50.449808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61952f4-0709-4c8a-a999-08a2d8024b3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:03:50.466767 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-d61952f4-0709-4c8a-a999-08a2d8024b3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Could not find domain: 581a88b2ead244faac1fa929bd05f5f5.: keystone.exception.DomainNotFound: Could not find domain: 581a88b2ead244faac1fa929bd05f5f5. Dec 18 21:03:50.471377 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2905/5876] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:03:50 2021] PATCH /identity/v3/domains/581a88b2ead244faac1fa929bd05f5f5 => generated 112 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:03:50.472355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61952f4-0709-4c8a-a999-08a2d8024b3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:50.484845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61952f4-0709-4c8a-a999-08a2d8024b3a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:50.490001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01de9dd-c3fc-4f37-9121-829b62984c60 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:50.491046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01de9dd-c3fc-4f37-9121-829b62984c60 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:50.492096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01de9dd-c3fc-4f37-9121-829b62984c60 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:50.492483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01de9dd-c3fc-4f37-9121-829b62984c60 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/users/6caa0720d79e45a091b89898e3c85cc0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:50.494089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01de9dd-c3fc-4f37-9121-829b62984c60 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6caa0720d79e45a091b89898e3c85cc0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:50.497272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01de9dd-c3fc-4f37-9121-829b62984c60 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:50.578749 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2972/5877] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:03:50.582050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1850ed-3aae-4e56-926d-1eeb3db918c6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:50.586758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e01de9dd-c3fc-4f37-9121-829b62984c60 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6caa0720d79e45a091b89898e3c85cc0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:50.600389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1850ed-3aae-4e56-926d-1eeb3db918c6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:50.606173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f99450-bcfe-4040-916d-bb6cfb8ea7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:50.606807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99450-bcfe-4040-916d-bb6cfb8ea7bc admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:50.606943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e01de9dd-c3fc-4f37-9121-829b62984c60 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6caa0720d79e45a091b89898e3c85cc0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:50.607083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99450-bcfe-4040-916d-bb6cfb8ea7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:50.607365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99450-bcfe-4040-916d-bb6cfb8ea7bc admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:50.608104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f99450-bcfe-4040-916d-bb6cfb8ea7bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:50.608412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f99450-bcfe-4040-916d-bb6cfb8ea7bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:50.610031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f99450-bcfe-4040-916d-bb6cfb8ea7bc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:50.630013 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2973/5878] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:03:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:50.631076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f99450-bcfe-4040-916d-bb6cfb8ea7bc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:50.640578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e01de9dd-c3fc-4f37-9121-829b62984c60 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6caa0720d79e45a091b89898e3c85cc0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:50.643686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f99450-bcfe-4040-916d-bb6cfb8ea7bc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:50.643871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e01de9dd-c3fc-4f37-9121-829b62984c60 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6caa0720d79e45a091b89898e3c85cc0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:50.647872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefa069-9ef8-443f-ac52-ff6aa5de9bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:50.649072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa069-9ef8-443f-ac52-ff6aa5de9bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:50.649072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa069-9ef8-443f-ac52-ff6aa5de9bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:50.649454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa069-9ef8-443f-ac52-ff6aa5de9bc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:50.650389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefa069-9ef8-443f-ac52-ff6aa5de9bc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:50.653735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefa069-9ef8-443f-ac52-ff6aa5de9bc7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:50.654348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e01de9dd-c3fc-4f37-9121-829b62984c60 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6caa0720d79e45a091b89898e3c85cc0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:50.666795 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2906/5879] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:50 2021] DELETE /identity/v3/users/6caa0720d79e45a091b89898e3c85cc0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:50.671022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01de9dd-c3fc-4f37-9121-829b62984c60 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:50.672664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e01de9dd-c3fc-4f37-9121-829b62984c60 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:50.694167 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2974/5880] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:50 2021] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:50.700554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefa069-9ef8-443f-ac52-ff6aa5de9bc7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:50.702571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-faefa069-9ef8-443f-ac52-ff6aa5de9bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:50.774583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01de9dd-c3fc-4f37-9121-829b62984c60 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:50.821945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefa069-9ef8-443f-ac52-ff6aa5de9bc7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:50.829578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7d924-cced-4183-986d-4265f8d5354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:50.830820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7d924-cced-4183-986d-4265f8d5354a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:50.831227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7d924-cced-4183-986d-4265f8d5354a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:50.832207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7d924-cced-4183-986d-4265f8d5354a admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:50.833714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7d924-cced-4183-986d-4265f8d5354a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:50.836843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7d924-cced-4183-986d-4265f8d5354a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:50.886607 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2975/5881] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:50 2021] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:50.888153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7d924-cced-4183-986d-4265f8d5354a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:50.920903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7d924-cced-4183-986d-4265f8d5354a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:50.927379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede1d28-1d0c-44af-ae8d-872ad9725177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:50.928308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede1d28-1d0c-44af-ae8d-872ad9725177 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:50.929313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede1d28-1d0c-44af-ae8d-872ad9725177 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:50.929771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede1d28-1d0c-44af-ae8d-872ad9725177 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:50.930752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede1d28-1d0c-44af-ae8d-872ad9725177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:50.933775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede1d28-1d0c-44af-ae8d-872ad9725177 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:50.954391 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2976/5882] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:50 2021] GET /identity/v3/roles => generated 2322 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:50.954707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacf304-da6f-4c29-babc-646320ec81a8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:50.956171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacf304-da6f-4c29-babc-646320ec81a8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:50.956463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacf304-da6f-4c29-babc-646320ec81a8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:50.956748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacf304-da6f-4c29-babc-646320ec81a8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/b1b0694d8e9046abbdc5d52f38ca2865` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:50.959402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacf304-da6f-4c29-babc-646320ec81a8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b1b0694d8e9046abbdc5d52f38ca2865)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:50.967055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacf304-da6f-4c29-babc-646320ec81a8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:50.973513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede1d28-1d0c-44af-ae8d-872ad9725177 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:51.000423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede1d28-1d0c-44af-ae8d-872ad9725177 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:51.014952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef339f01-eafa-46bf-b5f2-4bbee84f6e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:51.016579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef339f01-eafa-46bf-b5f2-4bbee84f6e87 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:51.017037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef339f01-eafa-46bf-b5f2-4bbee84f6e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:51.017605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef339f01-eafa-46bf-b5f2-4bbee84f6e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:51.018635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef339f01-eafa-46bf-b5f2-4bbee84f6e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:51.020961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef339f01-eafa-46bf-b5f2-4bbee84f6e87 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:51.049526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0cacf304-da6f-4c29-babc-646320ec81a8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invalidating the token cache because role b1b0694d8e9046abbdc5d52f38ca2865 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:51.050915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0cacf304-da6f-4c29-babc-646320ec81a8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:51.052617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0cacf304-da6f-4c29-babc-646320ec81a8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:51.057149 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2977/5883] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:50 2021] GET /identity/v3/roles => generated 2322 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:51.059555 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2907/5884] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:50 2021] DELETE /identity/v3/roles/b1b0694d8e9046abbdc5d52f38ca2865 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:51.063658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacf304-da6f-4c29-babc-646320ec81a8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:51.064728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef339f01-eafa-46bf-b5f2-4bbee84f6e87 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:51.066412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0cacf304-da6f-4c29-babc-646320ec81a8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:51.071940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ef339f01-eafa-46bf-b5f2-4bbee84f6e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:51.111033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef339f01-eafa-46bf-b5f2-4bbee84f6e87 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:51.264810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacf304-da6f-4c29-babc-646320ec81a8 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:51.310708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92080f10-a3c5-43a0-b1b8-52077d0c1634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:51.311675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080f10-a3c5-43a0-b1b8-52077d0c1634 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:51.311972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080f10-a3c5-43a0-b1b8-52077d0c1634 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:51.312282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080f10-a3c5-43a0-b1b8-52077d0c1634 admin admin] PATH_INFO: `/v3/projects/3b6a4d992fa24a3aa3172ab0a34515c9/users/5b5df590abf54cc9ba83f13a029da14b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:51.335635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933bf6d-161e-42ca-a745-c7c57ec1dc21 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:51.336522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933bf6d-161e-42ca-a745-c7c57ec1dc21 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:51.336807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933bf6d-161e-42ca-a745-c7c57ec1dc21 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:51.337091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933bf6d-161e-42ca-a745-c7c57ec1dc21 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/groups/d584dda5ff32430aa5c87960fbb91ee5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:51.348452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933bf6d-161e-42ca-a745-c7c57ec1dc21 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d584dda5ff32430aa5c87960fbb91ee5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:51.358810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933bf6d-161e-42ca-a745-c7c57ec1dc21 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:51.390352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92080f10-a3c5-43a0-b1b8-52077d0c1634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6a4d992fa24a3aa3172ab0a34515c9, user_id=5b5df590abf54cc9ba83f13a029da14b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:51.397132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92080f10-a3c5-43a0-b1b8-52077d0c1634 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:51.429259 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2908/5885] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:51 2021] PUT /identity/v3/projects/3b6a4d992fa24a3aa3172ab0a34515c9/users/5b5df590abf54cc9ba83f13a029da14b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:51.444947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4517f-9475-4b61-ab86-28df165e19a1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:51.445274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4517f-9475-4b61-ab86-28df165e19a1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:51.445571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4517f-9475-4b61-ab86-28df165e19a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:51.455383 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2978/5886] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 21:03:51 2021] DELETE /identity/v3/groups/d584dda5ff32430aa5c87960fbb91ee5 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:51.461099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933bf6d-161e-42ca-a745-c7c57ec1dc21 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:51.514152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3dd4517f-9475-4b61-ab86-28df165e19a1 None None] MFA Rules not processed for user `5b5df590abf54cc9ba83f13a029da14b`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:51.515565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3dd4517f-9475-4b61-ab86-28df165e19a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:51.574166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933bf6d-161e-42ca-a745-c7c57ec1dc21 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:51.580282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb776d1-1f58-4de8-b418-3eb942006937 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:51.581837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb776d1-1f58-4de8-b418-3eb942006937 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:51.583145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb776d1-1f58-4de8-b418-3eb942006937 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:51.584090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb776d1-1f58-4de8-b418-3eb942006937 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/projects/d016c14147c344909bc9d59b430dd36e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:51.585886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb776d1-1f58-4de8-b418-3eb942006937 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d016c14147c344909bc9d59b430dd36e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:51.588796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb776d1-1f58-4de8-b418-3eb942006937 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:51.624444 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2909/5887] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:51 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:51.644916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4517f-9475-4b61-ab86-28df165e19a1 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:51.647309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3dd4517f-9475-4b61-ab86-28df165e19a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:51.679635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-abb776d1-1f58-4de8-b418-3eb942006937 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd016c14147c344909bc9d59b430dd36e', 'request_id': 'req-abb776d1-1f58-4de8-b418-3eb942006937'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:51.694944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-abb776d1-1f58-4de8-b418-3eb942006937 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd016c14147c344909bc9d59b430dd36e', 'request_id': 'req-abb776d1-1f58-4de8-b418-3eb942006937'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:51.704439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-abb776d1-1f58-4de8-b418-3eb942006937 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd016c14147c344909bc9d59b430dd36e', 'request_id': 'req-abb776d1-1f58-4de8-b418-3eb942006937'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:51.729310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-abb776d1-1f58-4de8-b418-3eb942006937 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] The token cache is being invalidate because project d016c14147c344909bc9d59b430dd36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:51.729907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-abb776d1-1f58-4de8-b418-3eb942006937 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:51.730513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4517f-9475-4b61-ab86-28df165e19a1 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:51.730967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-abb776d1-1f58-4de8-b418-3eb942006937 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:51.733203 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2979/5888] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:51 2021] DELETE /identity/v3/projects/d016c14147c344909bc9d59b430dd36e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:51.737395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb776d1-1f58-4de8-b418-3eb942006937 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:51.739529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-abb776d1-1f58-4de8-b418-3eb942006937 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:51.846064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03efb3-e1c9-44d8-bbf8-80ccef0899f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:51.846979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03efb3-e1c9-44d8-bbf8-80ccef0899f0 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:51.847275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03efb3-e1c9-44d8-bbf8-80ccef0899f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:51.847558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03efb3-e1c9-44d8-bbf8-80ccef0899f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:51.849605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4d03efb3-e1c9-44d8-bbf8-80ccef0899f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:51.890422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb776d1-1f58-4de8-b418-3eb942006937 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:51.896862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4ddbc-b034-47c0-8d81-74ec54906a4c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:51.900270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4ddbc-b034-47c0-8d81-74ec54906a4c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:51.900681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4ddbc-b034-47c0-8d81-74ec54906a4c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:51.901069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4ddbc-b034-47c0-8d81-74ec54906a4c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:51.904147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4ddbc-b034-47c0-8d81-74ec54906a4c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2a5fc77da1024dfca8a2ca17b1d99acc)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:51.906119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4ddbc-b034-47c0-8d81-74ec54906a4c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:51.934995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-03d4ddbc-b034-47c0-8d81-74ec54906a4c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2a5fc77da1024dfca8a2ca17b1d99acc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:51.935915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-03d4ddbc-b034-47c0-8d81-74ec54906a4c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2a5fc77da1024dfca8a2ca17b1d99acc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:51.986777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-03d4ddbc-b034-47c0-8d81-74ec54906a4c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2a5fc77da1024dfca8a2ca17b1d99acc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:51.988619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-03d4ddbc-b034-47c0-8d81-74ec54906a4c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2a5fc77da1024dfca8a2ca17b1d99acc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:51.993259 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2980/5889] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:03:51 2021] PATCH /identity/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc => generated 277 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:51.998512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4ddbc-b034-47c0-8d81-74ec54906a4c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:52.002580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-03d4ddbc-b034-47c0-8d81-74ec54906a4c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:52.010758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03efb3-e1c9-44d8-bbf8-80ccef0899f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:52.012211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03efb3-e1c9-44d8-bbf8-80ccef0899f0 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:52.023400 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2910/5890] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:51 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:03:52.119889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4ddbc-b034-47c0-8d81-74ec54906a4c tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:52.156962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03efb3-e1c9-44d8-bbf8-80ccef0899f0 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:52.158836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4d03efb3-e1c9-44d8-bbf8-80ccef0899f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:52.166092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:52.169468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:52.169836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:52.170214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:52.198153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2a5fc77da1024dfca8a2ca17b1d99acc)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:52.201125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:52.250984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2a5fc77da1024dfca8a2ca17b1d99acc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:52.254858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2a5fc77da1024dfca8a2ca17b1d99acc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:52.274613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03efb3-e1c9-44d8-bbf8-80ccef0899f0 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:52.344843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a5fc77da1024dfca8a2ca17b1d99acc', 'request_id': 'req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:52.359953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a5fc77da1024dfca8a2ca17b1d99acc', 'request_id': 'req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:52.365368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a19d06-afb8-4605-a942-3931c082c919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:52.366738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a19d06-afb8-4605-a942-3931c082c919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:52.367201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a19d06-afb8-4605-a942-3931c082c919 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:52.367675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a19d06-afb8-4605-a942-3931c082c919 admin admin] PATH_INFO: `/v3/users/5b5df590abf54cc9ba83f13a029da14b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:52.370005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a19d06-afb8-4605-a942-3931c082c919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b5df590abf54cc9ba83f13a029da14b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:52.372301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a19d06-afb8-4605-a942-3931c082c919 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:52.373242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a5fc77da1024dfca8a2ca17b1d99acc', 'request_id': 'req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:52.391022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] The token cache is being invalidate because project 2a5fc77da1024dfca8a2ca17b1d99acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:52.391391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:52.392408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:52.427208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2a5fc77da1024dfca8a2ca17b1d99acc', 'request_id': 'req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:52.432405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2a5fc77da1024dfca8a2ca17b1d99acc', 'request_id': 'req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:52.433176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2a5fc77da1024dfca8a2ca17b1d99acc', 'request_id': 'req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:52.445393 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2981/5891] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:03:51 2021] DELETE /identity/v3/domains/2a5fc77da1024dfca8a2ca17b1d99acc => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:52.451078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:52.454850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:52.479161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-32a19d06-afb8-4605-a942-3931c082c919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b5df590abf54cc9ba83f13a029da14b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:52.487699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-32a19d06-afb8-4605-a942-3931c082c919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b5df590abf54cc9ba83f13a029da14b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:52.510348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-32a19d06-afb8-4605-a942-3931c082c919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b5df590abf54cc9ba83f13a029da14b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:52.511205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-32a19d06-afb8-4605-a942-3931c082c919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b5df590abf54cc9ba83f13a029da14b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:52.536833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-32a19d06-afb8-4605-a942-3931c082c919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b5df590abf54cc9ba83f13a029da14b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:52.555716 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2911/5892] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:52 2021] DELETE /identity/v3/users/5b5df590abf54cc9ba83f13a029da14b => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:52.558050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dc071-5afe-4dc9-8664-b2b6c19ed410 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:52.559046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dc071-5afe-4dc9-8664-b2b6c19ed410 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:52.559822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dc071-5afe-4dc9-8664-b2b6c19ed410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:52.599945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-797dc071-5afe-4dc9-8664-b2b6c19ed410 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:52.602218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-797dc071-5afe-4dc9-8664-b2b6c19ed410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:52.641719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5f9e2-dc3d-402d-9f22-ef6d1b1f0049 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:52.769871 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2912/5893] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:52.785552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc94be-280d-497e-ac4d-be58e4cdb4f6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:52.786832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc94be-280d-497e-ac4d-be58e4cdb4f6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:52.787232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc94be-280d-497e-ac4d-be58e4cdb4f6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:52.787675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc94be-280d-497e-ac4d-be58e4cdb4f6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/dad3072068e040659036efa71e9cc583` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:52.789548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc94be-280d-497e-ac4d-be58e4cdb4f6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dad3072068e040659036efa71e9cc583)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:52.792358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc94be-280d-497e-ac4d-be58e4cdb4f6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:52.806691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dc071-5afe-4dc9-8664-b2b6c19ed410 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:52.808155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-797dc071-5afe-4dc9-8664-b2b6c19ed410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:52.850412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6cc94be-280d-497e-ac4d-be58e4cdb4f6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invalidating the token cache because role dad3072068e040659036efa71e9cc583 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:52.852145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6cc94be-280d-497e-ac4d-be58e4cdb4f6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:52.853939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c6cc94be-280d-497e-ac4d-be58e4cdb4f6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:52.859758 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2982/5894] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:52 2021] DELETE /identity/v3/roles/dad3072068e040659036efa71e9cc583 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:52.860828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc94be-280d-497e-ac4d-be58e4cdb4f6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:52.862367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c6cc94be-280d-497e-ac4d-be58e4cdb4f6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:52.941603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dc071-5afe-4dc9-8664-b2b6c19ed410 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:52.980313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc94be-280d-497e-ac4d-be58e4cdb4f6 tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:52.988816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02926a-6f4a-4a87-8073-fc50dc8ec4ed tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:52.990159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02926a-6f4a-4a87-8073-fc50dc8ec4ed tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:52.990810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02926a-6f4a-4a87-8073-fc50dc8ec4ed tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:52.992274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02926a-6f4a-4a87-8073-fc50dc8ec4ed tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/581693129fcf4914bb64fa1c86fa3cac` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:52.995439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02926a-6f4a-4a87-8073-fc50dc8ec4ed tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_role(role_id=581693129fcf4914bb64fa1c86fa3cac)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:52.997651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02926a-6f4a-4a87-8073-fc50dc8ec4ed tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:53.056968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cf02926a-6f4a-4a87-8073-fc50dc8ec4ed tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invalidating the token cache because role 581693129fcf4914bb64fa1c86fa3cac has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:53.057602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cf02926a-6f4a-4a87-8073-fc50dc8ec4ed tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:53.058239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea486e75-109d-427e-8af5-d7c5fb2d86b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:53.059010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cf02926a-6f4a-4a87-8073-fc50dc8ec4ed tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:53.060140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea486e75-109d-427e-8af5-d7c5fb2d86b4 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:53.060429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea486e75-109d-427e-8af5-d7c5fb2d86b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:53.060709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea486e75-109d-427e-8af5-d7c5fb2d86b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:53.063772 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2983/5895] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:52 2021] DELETE /identity/v3/roles/581693129fcf4914bb64fa1c86fa3cac => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:53.068792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02926a-6f4a-4a87-8073-fc50dc8ec4ed tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:53.070938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ea486e75-109d-427e-8af5-d7c5fb2d86b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:53.073794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cf02926a-6f4a-4a87-8073-fc50dc8ec4ed tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:53.205028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea486e75-109d-427e-8af5-d7c5fb2d86b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:53.206535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea486e75-109d-427e-8af5-d7c5fb2d86b4 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:53.215940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02926a-6f4a-4a87-8073-fc50dc8ec4ed tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:53.218910 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2913/5896] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:53.223126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95195d-7f40-457f-a505-8b68f8f0478a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b958158ab2f4edd8072d799ffcef5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ceb95755374a6a9773cce13d251e93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:53.225218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95195d-7f40-457f-a505-8b68f8f0478a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:53.226358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95195d-7f40-457f-a505-8b68f8f0478a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:53.226917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95195d-7f40-457f-a505-8b68f8f0478a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] PATH_INFO: `/v3/roles/bb138913933849ebb17eba9f634ae018` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:53.228694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95195d-7f40-457f-a505-8b68f8f0478a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bb138913933849ebb17eba9f634ae018)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:53.230521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95195d-7f40-457f-a505-8b68f8f0478a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:53.277048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba95195d-7f40-457f-a505-8b68f8f0478a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invalidating the token cache because role bb138913933849ebb17eba9f634ae018 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:53.277346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba95195d-7f40-457f-a505-8b68f8f0478a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:53.278033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba95195d-7f40-457f-a505-8b68f8f0478a tempest-RolesV3TestJSON-1250029169 tempest-RolesV3TestJSON-1250029169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:53.279987 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2984/5897] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:53 2021] DELETE /identity/v3/roles/bb138913933849ebb17eba9f634ae018 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:53.284198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea486e75-109d-427e-8af5-d7c5fb2d86b4 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:53.285730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ea486e75-109d-427e-8af5-d7c5fb2d86b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:53.298954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea486e75-109d-427e-8af5-d7c5fb2d86b4 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:53.394911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca22a32-d0e7-4214-868f-0a9cc4d26ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:53.403081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca22a32-d0e7-4214-868f-0a9cc4d26ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:53.403637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca22a32-d0e7-4214-868f-0a9cc4d26ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:53.404557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca22a32-d0e7-4214-868f-0a9cc4d26ebe admin admin] PATH_INFO: `/v3/users/afc216d30f724896b5fdcb270017c3bf` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:53.406094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca22a32-d0e7-4214-868f-0a9cc4d26ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=afc216d30f724896b5fdcb270017c3bf)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:53.415141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca22a32-d0e7-4214-868f-0a9cc4d26ebe admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:53.487363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2ca22a32-d0e7-4214-868f-0a9cc4d26ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afc216d30f724896b5fdcb270017c3bf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:53.501076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2ca22a32-d0e7-4214-868f-0a9cc4d26ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afc216d30f724896b5fdcb270017c3bf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:53.518776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2ca22a32-d0e7-4214-868f-0a9cc4d26ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afc216d30f724896b5fdcb270017c3bf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:53.519531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2ca22a32-d0e7-4214-868f-0a9cc4d26ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afc216d30f724896b5fdcb270017c3bf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:53.539212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2ca22a32-d0e7-4214-868f-0a9cc4d26ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afc216d30f724896b5fdcb270017c3bf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:53.550945 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2914/5898] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:53 2021] DELETE /identity/v3/users/afc216d30f724896b5fdcb270017c3bf => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:03:53.553288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47b448-eb0d-4817-8d69-a6df18d8c1a0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:53.554068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47b448-eb0d-4817-8d69-a6df18d8c1a0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:53.554727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47b448-eb0d-4817-8d69-a6df18d8c1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:53.594099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1e47b448-eb0d-4817-8d69-a6df18d8c1a0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:53.596664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1e47b448-eb0d-4817-8d69-a6df18d8c1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:53.684724 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2985/5899] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:53.700678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca22a32-d0e7-4214-868f-0a9cc4d26ebe admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:53.704328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2ca22a32-d0e7-4214-868f-0a9cc4d26ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:53.740976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47b448-eb0d-4817-8d69-a6df18d8c1a0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:53.742538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1e47b448-eb0d-4817-8d69-a6df18d8c1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:53.780496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47b448-eb0d-4817-8d69-a6df18d8c1a0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:53.795364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca22a32-d0e7-4214-868f-0a9cc4d26ebe admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:53.799138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b6183-0749-4775-a526-128ab024c37c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:53.799803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b6183-0749-4775-a526-128ab024c37c service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:53.800087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b6183-0749-4775-a526-128ab024c37c service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:53.800371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b6183-0749-4775-a526-128ab024c37c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:53.813008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b6183-0749-4775-a526-128ab024c37c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:53.814507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b6183-0749-4775-a526-128ab024c37c service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:53.814960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba37ef-12b9-4c9e-983f-b91d8f929828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:53.815933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba37ef-12b9-4c9e-983f-b91d8f929828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:53.816306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba37ef-12b9-4c9e-983f-b91d8f929828 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:53.816682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba37ef-12b9-4c9e-983f-b91d8f929828 admin admin] PATH_INFO: `/v3/projects/3b6a4d992fa24a3aa3172ab0a34515c9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:53.818946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba37ef-12b9-4c9e-983f-b91d8f929828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b6a4d992fa24a3aa3172ab0a34515c9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:53.827203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba37ef-12b9-4c9e-983f-b91d8f929828 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:53.838736 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2915/5900] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:53.917855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-daba37ef-12b9-4c9e-983f-b91d8f929828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b6a4d992fa24a3aa3172ab0a34515c9', 'request_id': 'req-daba37ef-12b9-4c9e-983f-b91d8f929828'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:53.925895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-daba37ef-12b9-4c9e-983f-b91d8f929828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b6a4d992fa24a3aa3172ab0a34515c9', 'request_id': 'req-daba37ef-12b9-4c9e-983f-b91d8f929828'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:53.939622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-daba37ef-12b9-4c9e-983f-b91d8f929828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b6a4d992fa24a3aa3172ab0a34515c9', 'request_id': 'req-daba37ef-12b9-4c9e-983f-b91d8f929828'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:53.961137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-daba37ef-12b9-4c9e-983f-b91d8f929828 admin admin] The token cache is being invalidate because project 3b6a4d992fa24a3aa3172ab0a34515c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:53.961551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-daba37ef-12b9-4c9e-983f-b91d8f929828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:53.963962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-daba37ef-12b9-4c9e-983f-b91d8f929828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:53.967153 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2986/5901] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:53 2021] DELETE /identity/v3/projects/3b6a4d992fa24a3aa3172ab0a34515c9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:53.973917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fd7ca-05b8-4b54-b414-2b78c8425bac None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:53.974339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fd7ca-05b8-4b54-b414-2b78c8425bac None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:53.974721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fd7ca-05b8-4b54-b414-2b78c8425bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:53.996690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-796fd7ca-05b8-4b54-b414-2b78c8425bac None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:53.998215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-796fd7ca-05b8-4b54-b414-2b78c8425bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:54.081367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7134a3-9005-415a-bcf0-e64a42cfd326 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:54.081990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7134a3-9005-415a-bcf0-e64a42cfd326 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:54.082200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7134a3-9005-415a-bcf0-e64a42cfd326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:54.084536 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2916/5902] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:54.108526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1c7134a3-9005-415a-bcf0-e64a42cfd326 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:54.109624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1c7134a3-9005-415a-bcf0-e64a42cfd326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:54.121924 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2987/5903] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:54.126497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fd7ca-05b8-4b54-b414-2b78c8425bac None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:54.139778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fd7ca-05b8-4b54-b414-2b78c8425bac None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:54.154217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a045359-f312-46ba-ba31-0b157c1ade4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:54.156433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a045359-f312-46ba-ba31-0b157c1ade4c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:54.158631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a045359-f312-46ba-ba31-0b157c1ade4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:54.159067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a045359-f312-46ba-ba31-0b157c1ade4c admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:54.160008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a045359-f312-46ba-ba31-0b157c1ade4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:54.162076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a045359-f312-46ba-ba31-0b157c1ade4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:54.167730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a045359-f312-46ba-ba31-0b157c1ade4c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:54.205633 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2917/5904] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:03:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:54.211113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7134a3-9005-415a-bcf0-e64a42cfd326 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:54.221191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7134a3-9005-415a-bcf0-e64a42cfd326 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:54.240479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33a8f8-5dde-4207-8f08-fdc0c95a5f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:54.241210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33a8f8-5dde-4207-8f08-fdc0c95a5f76 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:54.241210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33a8f8-5dde-4207-8f08-fdc0c95a5f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:54.241632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33a8f8-5dde-4207-8f08-fdc0c95a5f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:54.242445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33a8f8-5dde-4207-8f08-fdc0c95a5f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:54.244379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33a8f8-5dde-4207-8f08-fdc0c95a5f76 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:54.305761 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2988/5905] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:54 2021] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:54.307082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a045359-f312-46ba-ba31-0b157c1ade4c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:54.323708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a045359-f312-46ba-ba31-0b157c1ade4c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:54.505087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b4d27-e1b1-43f7-a97a-65abba84fc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:54.506087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b4d27-e1b1-43f7-a97a-65abba84fc60 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:54.506345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b4d27-e1b1-43f7-a97a-65abba84fc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:54.507151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b4d27-e1b1-43f7-a97a-65abba84fc60 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:54.508479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b4d27-e1b1-43f7-a97a-65abba84fc60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:54.511016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b4d27-e1b1-43f7-a97a-65abba84fc60 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:54.565862 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2918/5906] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:54 2021] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:03:54.570882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33a8f8-5dde-4207-8f08-fdc0c95a5f76 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:54.584524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33a8f8-5dde-4207-8f08-fdc0c95a5f76 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:54.590680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df168395-e94b-4ed0-94bd-8f9b74c4ce0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:54.604983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df168395-e94b-4ed0-94bd-8f9b74c4ce0f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:54.605355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df168395-e94b-4ed0-94bd-8f9b74c4ce0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:54.605639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df168395-e94b-4ed0-94bd-8f9b74c4ce0f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:54.606468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df168395-e94b-4ed0-94bd-8f9b74c4ce0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:54.612665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df168395-e94b-4ed0-94bd-8f9b74c4ce0f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:54.629660 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2989/5907] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:54.634273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b4d27-e1b1-43f7-a97a-65abba84fc60 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:54.653815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b4d27-e1b1-43f7-a97a-65abba84fc60 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:54.659977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce229d-4e37-4518-8b3b-0a907a2b40b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:54.660659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce229d-4e37-4518-8b3b-0a907a2b40b9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:54.660947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce229d-4e37-4518-8b3b-0a907a2b40b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:54.661226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce229d-4e37-4518-8b3b-0a907a2b40b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:54.662020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce229d-4e37-4518-8b3b-0a907a2b40b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:54.664410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce229d-4e37-4518-8b3b-0a907a2b40b9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:54.681425 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2919/5908] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:54.685617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df168395-e94b-4ed0-94bd-8f9b74c4ce0f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:54.715061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df168395-e94b-4ed0-94bd-8f9b74c4ce0f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:54.727812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806f98b-eae3-472c-8f75-d9532ba36ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:54.729094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806f98b-eae3-472c-8f75-d9532ba36ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:54.729584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806f98b-eae3-472c-8f75-d9532ba36ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:54.730411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806f98b-eae3-472c-8f75-d9532ba36ae0 admin admin] PATH_INFO: `/v3/projects/d7c94b08c98f49b6b734eda4021909b9/users/1e53da7af08747da895b06ecc262508a/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:54.757001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806f98b-eae3-472c-8f75-d9532ba36ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c94b08c98f49b6b734eda4021909b9, user_id=1e53da7af08747da895b06ecc262508a, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:54.760638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806f98b-eae3-472c-8f75-d9532ba36ae0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:54.781323 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2990/5909] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:54 2021] PUT /identity/v3/projects/d7c94b08c98f49b6b734eda4021909b9/users/1e53da7af08747da895b06ecc262508a/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:54.792275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3247b4-dfa6-4b2c-9f61-93dc924f46a2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:54.792648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3247b4-dfa6-4b2c-9f61-93dc924f46a2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:54.793006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3247b4-dfa6-4b2c-9f61-93dc924f46a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:54.832315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1c3247b4-dfa6-4b2c-9f61-93dc924f46a2 None None] MFA Rules not processed for user `1e53da7af08747da895b06ecc262508a`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:54.834563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1c3247b4-dfa6-4b2c-9f61-93dc924f46a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:54.931541 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2920/5910] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:54 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:54.948424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806f98b-eae3-472c-8f75-d9532ba36ae0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:54.959435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5806f98b-eae3-472c-8f75-d9532ba36ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:55.072547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806f98b-eae3-472c-8f75-d9532ba36ae0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:55.077338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c0657-64d7-4a3d-ace4-94626d36d954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:55.078077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c0657-64d7-4a3d-ace4-94626d36d954 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:55.078491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c0657-64d7-4a3d-ace4-94626d36d954 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:55.078930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c0657-64d7-4a3d-ace4-94626d36d954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:55.098454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c0657-64d7-4a3d-ace4-94626d36d954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:55.100932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c0657-64d7-4a3d-ace4-94626d36d954 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:55.122630 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2991/5911] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:03:54 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:03:55.391697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3247b4-dfa6-4b2c-9f61-93dc924f46a2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:55.393870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1c3247b4-dfa6-4b2c-9f61-93dc924f46a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:55.551919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3247b4-dfa6-4b2c-9f61-93dc924f46a2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:55.559052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:55.560420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:55.560901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:55.570584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf admin admin] PATH_INFO: `/v3/projects/8656202655b0467281162f20b6bce6d5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:55.577675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8656202655b0467281162f20b6bce6d5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:55.580776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:55.667545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8656202655b0467281162f20b6bce6d5', 'request_id': 'req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:55.677358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8656202655b0467281162f20b6bce6d5', 'request_id': 'req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:55.686853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8656202655b0467281162f20b6bce6d5', 'request_id': 'req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:55.706787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf admin admin] The token cache is being invalidate because project 8656202655b0467281162f20b6bce6d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:55.707770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:55.708484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:55.716994 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2921/5912] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:55 2021] DELETE /identity/v3/projects/8656202655b0467281162f20b6bce6d5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:55.721452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c0657-64d7-4a3d-ace4-94626d36d954 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:55.745325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c0657-64d7-4a3d-ace4-94626d36d954 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:55.901836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508b925-1d4b-4676-be78-0342c43c21c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:55.905313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508b925-1d4b-4676-be78-0342c43c21c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:55.906554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508b925-1d4b-4676-be78-0342c43c21c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:55.908516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508b925-1d4b-4676-be78-0342c43c21c4 admin admin] PATH_INFO: `/v3/users/7b958158ab2f4edd8072d799ffcef5f5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:55.910613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508b925-1d4b-4676-be78-0342c43c21c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b958158ab2f4edd8072d799ffcef5f5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:55.916140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508b925-1d4b-4676-be78-0342c43c21c4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:56.020841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1508b925-1d4b-4676-be78-0342c43c21c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b958158ab2f4edd8072d799ffcef5f5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:56.036032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1508b925-1d4b-4676-be78-0342c43c21c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b958158ab2f4edd8072d799ffcef5f5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:56.037726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1508b925-1d4b-4676-be78-0342c43c21c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b958158ab2f4edd8072d799ffcef5f5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:56.080353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1508b925-1d4b-4676-be78-0342c43c21c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b958158ab2f4edd8072d799ffcef5f5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:56.096880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1508b925-1d4b-4676-be78-0342c43c21c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b958158ab2f4edd8072d799ffcef5f5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:56.109148 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2992/5913] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:03:55 2021] DELETE /identity/v3/users/7b958158ab2f4edd8072d799ffcef5f5 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:57.279889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:57.281472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:57.304680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3db37-5e9d-4b59-a1aa-4d5cb5d840bf admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:57.507253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35442866-7c27-4969-8442-12714eec09cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:57.508179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35442866-7c27-4969-8442-12714eec09cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:57.508775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35442866-7c27-4969-8442-12714eec09cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:57.509293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35442866-7c27-4969-8442-12714eec09cd admin admin] PATH_INFO: `/v3/projects/54ceb95755374a6a9773cce13d251e93` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:57.511544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35442866-7c27-4969-8442-12714eec09cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ceb95755374a6a9773cce13d251e93)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:57.521920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35442866-7c27-4969-8442-12714eec09cd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:57.656967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-35442866-7c27-4969-8442-12714eec09cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ceb95755374a6a9773cce13d251e93', 'request_id': 'req-35442866-7c27-4969-8442-12714eec09cd'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:57.683066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-35442866-7c27-4969-8442-12714eec09cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ceb95755374a6a9773cce13d251e93', 'request_id': 'req-35442866-7c27-4969-8442-12714eec09cd'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:57.695351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-35442866-7c27-4969-8442-12714eec09cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ceb95755374a6a9773cce13d251e93', 'request_id': 'req-35442866-7c27-4969-8442-12714eec09cd'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:57.722927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-35442866-7c27-4969-8442-12714eec09cd admin admin] The token cache is being invalidate because project 54ceb95755374a6a9773cce13d251e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:03:57.723354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-35442866-7c27-4969-8442-12714eec09cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:57.724382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-35442866-7c27-4969-8442-12714eec09cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:03:57.728210 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2922/5914] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:03:57 2021] DELETE /identity/v3/projects/54ceb95755374a6a9773cce13d251e93 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:57.733754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b781ea-7b8d-4fb4-a6a6-38e510c12f64 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:57.734296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b781ea-7b8d-4fb4-a6a6-38e510c12f64 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:57.734296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b781ea-7b8d-4fb4-a6a6-38e510c12f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:57.765433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d4b781ea-7b8d-4fb4-a6a6-38e510c12f64 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:57.766705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d4b781ea-7b8d-4fb4-a6a6-38e510c12f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:57.848695 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2993/5915] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:57.856800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59516dd-e469-4ccd-ab19-d826873803d3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:57.857220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59516dd-e469-4ccd-ab19-d826873803d3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:57.857541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59516dd-e469-4ccd-ab19-d826873803d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:57.884732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b59516dd-e469-4ccd-ab19-d826873803d3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:57.886125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b59516dd-e469-4ccd-ab19-d826873803d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:57.906086 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2923/5916] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:57.910572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b781ea-7b8d-4fb4-a6a6-38e510c12f64 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:57.930910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b781ea-7b8d-4fb4-a6a6-38e510c12f64 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:57.942665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cd94b-5d35-457b-993a-b23cc532e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:57.944740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cd94b-5d35-457b-993a-b23cc532e8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:57.945153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cd94b-5d35-457b-993a-b23cc532e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:57.945541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cd94b-5d35-457b-993a-b23cc532e8d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:57.956132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cd94b-5d35-457b-993a-b23cc532e8d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:03:57.956462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cd94b-5d35-457b-993a-b23cc532e8d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:57.959460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cd94b-5d35-457b-993a-b23cc532e8d5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:57.994644 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2994/5917] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:03:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:03:57.998238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59516dd-e469-4ccd-ab19-d826873803d3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:58.012688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59516dd-e469-4ccd-ab19-d826873803d3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:58.026316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d9275-d7ce-4a21-a174-23c5e07f755a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:58.026962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d9275-d7ce-4a21-a174-23c5e07f755a admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:58.027250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d9275-d7ce-4a21-a174-23c5e07f755a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:58.027531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d9275-d7ce-4a21-a174-23c5e07f755a admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:58.028258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d9275-d7ce-4a21-a174-23c5e07f755a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:58.033796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d9275-d7ce-4a21-a174-23c5e07f755a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:58.099220 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2924/5918] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:57 2021] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:58.103601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cd94b-5d35-457b-993a-b23cc532e8d5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:58.119771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cd94b-5d35-457b-993a-b23cc532e8d5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:58.245164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f378720-3f4f-4114-a574-f939e13bdae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:58.245990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f378720-3f4f-4114-a574-f939e13bdae1 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:58.246375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f378720-3f4f-4114-a574-f939e13bdae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:58.246731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f378720-3f4f-4114-a574-f939e13bdae1 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:58.247601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f378720-3f4f-4114-a574-f939e13bdae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:58.250305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f378720-3f4f-4114-a574-f939e13bdae1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:58.284628 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2995/5919] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:58 2021] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:58.288953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d9275-d7ce-4a21-a174-23c5e07f755a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:58.301633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d9275-d7ce-4a21-a174-23c5e07f755a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:58.308230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56914e9d-8ca2-4019-aa06-b2d2a2539b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:58.309204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56914e9d-8ca2-4019-aa06-b2d2a2539b11 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:58.309497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56914e9d-8ca2-4019-aa06-b2d2a2539b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:58.309779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56914e9d-8ca2-4019-aa06-b2d2a2539b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:58.310760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56914e9d-8ca2-4019-aa06-b2d2a2539b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:58.313058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56914e9d-8ca2-4019-aa06-b2d2a2539b11 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:58.330934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f378720-3f4f-4114-a574-f939e13bdae1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:58.331682 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2925/5920] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:58 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:03:58.343096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f378720-3f4f-4114-a574-f939e13bdae1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:58.351995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778de4f-7de6-4316-a440-afea21f1dffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:58.352985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778de4f-7de6-4316-a440-afea21f1dffb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:58.353493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778de4f-7de6-4316-a440-afea21f1dffb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:58.355004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778de4f-7de6-4316-a440-afea21f1dffb admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:58.355993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778de4f-7de6-4316-a440-afea21f1dffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:58.358614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778de4f-7de6-4316-a440-afea21f1dffb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:58.377595 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2996/5921] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:58 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:03:58.379594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56914e9d-8ca2-4019-aa06-b2d2a2539b11 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:58.393624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56914e9d-8ca2-4019-aa06-b2d2a2539b11 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:58.402506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2c3b8-1b06-4fa6-8da8-3e08d1d4d06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:58.404271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2c3b8-1b06-4fa6-8da8-3e08d1d4d06e admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:58.405842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2c3b8-1b06-4fa6-8da8-3e08d1d4d06e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:58.406342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2c3b8-1b06-4fa6-8da8-3e08d1d4d06e admin admin] PATH_INFO: `/v3/projects/0be5fc4b78af42f590c93cb522566c73/users/780f6512450249e68f772a0f3991b091/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:58.435205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2c3b8-1b06-4fa6-8da8-3e08d1d4d06e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be5fc4b78af42f590c93cb522566c73, user_id=780f6512450249e68f772a0f3991b091, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:58.438757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2c3b8-1b06-4fa6-8da8-3e08d1d4d06e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:58.464356 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2926/5922] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:58 2021] PUT /identity/v3/projects/0be5fc4b78af42f590c93cb522566c73/users/780f6512450249e68f772a0f3991b091/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:58.476537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685b01d-0f7f-4afb-bb91-5e22ad722563 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:58.476832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685b01d-0f7f-4afb-bb91-5e22ad722563 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:58.477381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685b01d-0f7f-4afb-bb91-5e22ad722563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:58.527963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b685b01d-0f7f-4afb-bb91-5e22ad722563 None None] MFA Rules not processed for user `780f6512450249e68f772a0f3991b091`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:58.529474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b685b01d-0f7f-4afb-bb91-5e22ad722563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:58.654421 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2997/5923] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:58 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:58.660761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2c3b8-1b06-4fa6-8da8-3e08d1d4d06e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:58.784646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2c3b8-1b06-4fa6-8da8-3e08d1d4d06e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:58.810735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd271d5-1d53-4bf8-955a-1a2b49b17492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:58.811509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd271d5-1d53-4bf8-955a-1a2b49b17492 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:58.811866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd271d5-1d53-4bf8-955a-1a2b49b17492 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:58.812214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd271d5-1d53-4bf8-955a-1a2b49b17492 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:58.816157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd271d5-1d53-4bf8-955a-1a2b49b17492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:58.817310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd271d5-1d53-4bf8-955a-1a2b49b17492 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:58.882198 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2927/5924] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:58 2021] POST /identity/v3/projects => generated 367 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:58.886280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685b01d-0f7f-4afb-bb91-5e22ad722563 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:58.902242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685b01d-0f7f-4afb-bb91-5e22ad722563 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:59.079156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f8d33-18b8-4452-9a22-a5316dc395cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:59.080009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f8d33-18b8-4452-9a22-a5316dc395cd admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:59.080902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f8d33-18b8-4452-9a22-a5316dc395cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:59.081206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f8d33-18b8-4452-9a22-a5316dc395cd admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:59.082219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f8d33-18b8-4452-9a22-a5316dc395cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:59.084184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f8d33-18b8-4452-9a22-a5316dc395cd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:59.143763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd271d5-1d53-4bf8-955a-1a2b49b17492 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:59.150183 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2998/5925] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:03:58 2021] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:03:59.170036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd271d5-1d53-4bf8-955a-1a2b49b17492 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:59.178906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10add29-ca3e-46f9-a8ee-cfe1c9a37dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:59.179856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10add29-ca3e-46f9-a8ee-cfe1c9a37dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:59.180865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10add29-ca3e-46f9-a8ee-cfe1c9a37dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:59.181825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10add29-ca3e-46f9-a8ee-cfe1c9a37dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:59.183425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10add29-ca3e-46f9-a8ee-cfe1c9a37dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:59.185430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10add29-ca3e-46f9-a8ee-cfe1c9a37dc7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:59.206924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f8d33-18b8-4452-9a22-a5316dc395cd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:59.224405 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2928/5926] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:59 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:59.230401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f8d33-18b8-4452-9a22-a5316dc395cd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:59.244849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96651269-4da2-4bd0-b17f-001475093c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:59.246224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96651269-4da2-4bd0-b17f-001475093c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:59.246564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96651269-4da2-4bd0-b17f-001475093c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:59.246847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96651269-4da2-4bd0-b17f-001475093c47 admin admin] PATH_INFO: `/v3/projects/1f23331b912248c5b965584a6ed47838/users/7e0c576a62814be6a556c959402ebcb2/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:59.277878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96651269-4da2-4bd0-b17f-001475093c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f23331b912248c5b965584a6ed47838, user_id=7e0c576a62814be6a556c959402ebcb2, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:59.281064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96651269-4da2-4bd0-b17f-001475093c47 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:59.311396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10add29-ca3e-46f9-a8ee-cfe1c9a37dc7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:59.312086 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 2999/5927] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:59 2021] PUT /identity/v3/projects/1f23331b912248c5b965584a6ed47838/users/7e0c576a62814be6a556c959402ebcb2/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:59.326481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10add29-ca3e-46f9-a8ee-cfe1c9a37dc7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:59.415291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31e702-f48e-4452-832a-48817e6373e4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:59.415661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31e702-f48e-4452-832a-48817e6373e4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:59.416152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31e702-f48e-4452-832a-48817e6373e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:59.450388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1b31e702-f48e-4452-832a-48817e6373e4 None None] MFA Rules not processed for user `0a98795bdb7447c5b2a4930173b3c56d`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:59.451617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1b31e702-f48e-4452-832a-48817e6373e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:59.457750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ec2ce-4223-4318-b6c6-b60e9263f2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:59.458737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ec2ce-4223-4318-b6c6-b60e9263f2ef admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:59.459175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ec2ce-4223-4318-b6c6-b60e9263f2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:59.459459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ec2ce-4223-4318-b6c6-b60e9263f2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:59.461835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ec2ce-4223-4318-b6c6-b60e9263f2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:59.467078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ec2ce-4223-4318-b6c6-b60e9263f2ef admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:59.530397 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2929/5928] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:03:59 2021] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:03:59.531369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ec2ce-4223-4318-b6c6-b60e9263f2ef admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:59.552053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ec2ce-4223-4318-b6c6-b60e9263f2ef admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:59.558290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62548341-ca21-4057-b1ec-c8b9d66bc713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:59.559197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548341-ca21-4057-b1ec-c8b9d66bc713 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:59.559835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548341-ca21-4057-b1ec-c8b9d66bc713 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:59.561096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548341-ca21-4057-b1ec-c8b9d66bc713 admin admin] PATH_INFO: `/v3/projects/1f23331b912248c5b965584a6ed47838/users/7e0c576a62814be6a556c959402ebcb2/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:59.566014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62548341-ca21-4057-b1ec-c8b9d66bc713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f23331b912248c5b965584a6ed47838, user_id=7e0c576a62814be6a556c959402ebcb2, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:59.570898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62548341-ca21-4057-b1ec-c8b9d66bc713 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:03:59.596720 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2930/5929] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:03:59 2021] PUT /identity/v3/projects/1f23331b912248c5b965584a6ed47838/users/7e0c576a62814be6a556c959402ebcb2/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:03:59.604050 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3000/5930] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:59 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:59.698892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436268-a07c-4b8b-a1d1-ad0eeb7273a9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:59.704775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436268-a07c-4b8b-a1d1-ad0eeb7273a9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:59.705148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436268-a07c-4b8b-a1d1-ad0eeb7273a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:59.738155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5c436268-a07c-4b8b-a1d1-ad0eeb7273a9 None None] MFA Rules not processed for user `7e0c576a62814be6a556c959402ebcb2`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:03:59.739419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5c436268-a07c-4b8b-a1d1-ad0eeb7273a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:03:59.848662 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2931/5931] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:03:59 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:03:59.849465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31e702-f48e-4452-832a-48817e6373e4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:03:59.867633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31e702-f48e-4452-832a-48817e6373e4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:03:59.969680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d3d99-2d46-4ae2-af3b-4dd6a0264a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:03:59.970540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d3d99-2d46-4ae2-af3b-4dd6a0264a3d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:03:59.970893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d3d99-2d46-4ae2-af3b-4dd6a0264a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:03:59.971589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d3d99-2d46-4ae2-af3b-4dd6a0264a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:03:59.979477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d3d99-2d46-4ae2-af3b-4dd6a0264a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:03:59.981862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d3d99-2d46-4ae2-af3b-4dd6a0264a3d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:00.048105 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3001/5932] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:03:59 2021] POST /identity/v3/projects => generated 369 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:00.049305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c436268-a07c-4b8b-a1d1-ad0eeb7273a9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:00.064856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c436268-a07c-4b8b-a1d1-ad0eeb7273a9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:00.179087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebe25a-efc6-4911-889f-4f63bd3acd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:00.180344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebe25a-efc6-4911-889f-4f63bd3acd86 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:00.180812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebe25a-efc6-4911-889f-4f63bd3acd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:00.181262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebe25a-efc6-4911-889f-4f63bd3acd86 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:00.182335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebe25a-efc6-4911-889f-4f63bd3acd86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:00.187712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebe25a-efc6-4911-889f-4f63bd3acd86 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:00.232654 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2932/5933] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:04:00 2021] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:00.238006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d3d99-2d46-4ae2-af3b-4dd6a0264a3d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:00.251875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d3d99-2d46-4ae2-af3b-4dd6a0264a3d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:00.258143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ffbae-d95e-436a-8268-978fb50c6565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:00.258864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ffbae-d95e-436a-8268-978fb50c6565 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:00.259246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ffbae-d95e-436a-8268-978fb50c6565 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:00.259637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ffbae-d95e-436a-8268-978fb50c6565 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:00.260493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ffbae-d95e-436a-8268-978fb50c6565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:00.262235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ffbae-d95e-436a-8268-978fb50c6565 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:00.280481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebe25a-efc6-4911-889f-4f63bd3acd86 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:00.281037 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3002/5934] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:00 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:00.316519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebe25a-efc6-4911-889f-4f63bd3acd86 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:00.343717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6aaee-fd4a-423e-b917-005a0f9133cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:00.344475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6aaee-fd4a-423e-b917-005a0f9133cd admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:00.344802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6aaee-fd4a-423e-b917-005a0f9133cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:00.345197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6aaee-fd4a-423e-b917-005a0f9133cd admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:00.346312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6aaee-fd4a-423e-b917-005a0f9133cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:00.348788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6aaee-fd4a-423e-b917-005a0f9133cd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:00.364659 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2933/5935] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:00 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:04:00.370896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ffbae-d95e-436a-8268-978fb50c6565 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:00.385815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ffbae-d95e-436a-8268-978fb50c6565 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:00.391303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a2440-5f58-4773-bc40-fad5d618c421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:00.392313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a2440-5f58-4773-bc40-fad5d618c421 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:00.392699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a2440-5f58-4773-bc40-fad5d618c421 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:00.392862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a2440-5f58-4773-bc40-fad5d618c421 admin admin] PATH_INFO: `/v3/projects/5d72caaccdd34f848a660bf4f9270474/users/0a85d8d2aead4e47b14f5215c4e88073/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:00.413072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a2440-5f58-4773-bc40-fad5d618c421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d72caaccdd34f848a660bf4f9270474, user_id=0a85d8d2aead4e47b14f5215c4e88073, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:00.416052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a2440-5f58-4773-bc40-fad5d618c421 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:00.441130 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3003/5936] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:00 2021] PUT /identity/v3/projects/5d72caaccdd34f848a660bf4f9270474/users/0a85d8d2aead4e47b14f5215c4e88073/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:00.454120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c874f4b-7e1e-498e-851b-6b061ec456a0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:00.454589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c874f4b-7e1e-498e-851b-6b061ec456a0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:00.454974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c874f4b-7e1e-498e-851b-6b061ec456a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:00.491606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4c874f4b-7e1e-498e-851b-6b061ec456a0 None None] MFA Rules not processed for user `0a85d8d2aead4e47b14f5215c4e88073`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:00.493994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4c874f4b-7e1e-498e-851b-6b061ec456a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:00.653291 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2934/5937] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:00 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:00.660461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a2440-5f58-4773-bc40-fad5d618c421 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:00.813266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a2440-5f58-4773-bc40-fad5d618c421 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:00.822065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc555a3-c0d8-46af-96f0-20ced45c3754 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:00.824849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc555a3-c0d8-46af-96f0-20ced45c3754 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:00.825175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc555a3-c0d8-46af-96f0-20ced45c3754 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:00.826242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc555a3-c0d8-46af-96f0-20ced45c3754 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:00.827579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc555a3-c0d8-46af-96f0-20ced45c3754 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:00.828875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc555a3-c0d8-46af-96f0-20ced45c3754 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:00.856906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c874f4b-7e1e-498e-851b-6b061ec456a0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:00.865180 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3004/5938] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:04:00 2021] POST /identity/v3/domains => generated 277 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:00.880787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c874f4b-7e1e-498e-851b-6b061ec456a0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:01.000043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc6b0a-d5b3-4231-92e1-da227c665bd8 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:01.000982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc6b0a-d5b3-4231-92e1-da227c665bd8 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:01.001174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc6b0a-d5b3-4231-92e1-da227c665bd8 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:01.002543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc6b0a-d5b3-4231-92e1-da227c665bd8 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:01.004060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc6b0a-d5b3-4231-92e1-da227c665bd8 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:01.007016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc6b0a-d5b3-4231-92e1-da227c665bd8 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:01.051362 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2935/5939] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:04:00 2021] POST /identity/v3/roles => generated 240 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:01.053941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc555a3-c0d8-46af-96f0-20ced45c3754 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:01.075058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc555a3-c0d8-46af-96f0-20ced45c3754 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:01.093807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146098e-23e6-4e4a-9985-2bf758b0566e tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:01.095026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146098e-23e6-4e4a-9985-2bf758b0566e tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:01.095561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146098e-23e6-4e4a-9985-2bf758b0566e tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:01.096077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146098e-23e6-4e4a-9985-2bf758b0566e tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/0772371eee26427dae8ba84e9dff6814/users/0a85d8d2aead4e47b14f5215c4e88073/roles/b9d03f8c0e6e45e79f1e2b612711c811` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:01.129459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146098e-23e6-4e4a-9985-2bf758b0566e tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0772371eee26427dae8ba84e9dff6814, user_id=0a85d8d2aead4e47b14f5215c4e88073, role_id=b9d03f8c0e6e45e79f1e2b612711c811)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:01.132904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146098e-23e6-4e4a-9985-2bf758b0566e tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:01.182054 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3005/5940] 10.222.0.13 () {60 vars in 1479 bytes} [Sat Dec 18 21:04:01 2021] PUT /identity/v3/domains/0772371eee26427dae8ba84e9dff6814/users/0a85d8d2aead4e47b14f5215c4e88073/roles/b9d03f8c0e6e45e79f1e2b612711c811 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:01.187085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc6b0a-d5b3-4231-92e1-da227c665bd8 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:01.217169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc6b0a-d5b3-4231-92e1-da227c665bd8 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:01.359432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146098e-23e6-4e4a-9985-2bf758b0566e tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:01.364833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f146098e-23e6-4e4a-9985-2bf758b0566e tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:01.386224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c129a1-b4f4-441c-86dc-c298335dd0fc tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:01.387068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c129a1-b4f4-441c-86dc-c298335dd0fc tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:01.387451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c129a1-b4f4-441c-86dc-c298335dd0fc tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:01.389529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c129a1-b4f4-441c-86dc-c298335dd0fc tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:01.390460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c129a1-b4f4-441c-86dc-c298335dd0fc tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:01.394282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c129a1-b4f4-441c-86dc-c298335dd0fc tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:01.426545 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2936/5941] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:04:01 2021] POST /identity/v3/domains => generated 276 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:01.427507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c129a1-b4f4-441c-86dc-c298335dd0fc tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:01.572502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146098e-23e6-4e4a-9985-2bf758b0566e tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:01.598994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c129a1-b4f4-441c-86dc-c298335dd0fc tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:01.611492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a36a0b-2740-4c18-bc27-e2085c7fcf55 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:01.613784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a36a0b-2740-4c18-bc27-e2085c7fcf55 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:01.614298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a36a0b-2740-4c18-bc27-e2085c7fcf55 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:01.616967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a36a0b-2740-4c18-bc27-e2085c7fcf55 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:01.619295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a36a0b-2740-4c18-bc27-e2085c7fcf55 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:01.623526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a36a0b-2740-4c18-bc27-e2085c7fcf55 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:01.689308 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2937/5942] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:04:01 2021] POST /identity/v3/roles => generated 240 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:01.695185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a36a0b-2740-4c18-bc27-e2085c7fcf55 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:01.731122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a36a0b-2740-4c18-bc27-e2085c7fcf55 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:01.752619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc08112-75a0-412c-b253-1944e5561079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:01.753391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc08112-75a0-412c-b253-1944e5561079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:01.753887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc08112-75a0-412c-b253-1944e5561079 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:01.754480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc08112-75a0-412c-b253-1944e5561079 admin admin] PATH_INFO: `/v3/users/7a3f4863c7464764bab18d742ec523c3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:01.774378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc08112-75a0-412c-b253-1944e5561079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a3f4863c7464764bab18d742ec523c3)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:01.776821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc08112-75a0-412c-b253-1944e5561079 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:01.784120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef448aa6-05b7-40cb-b280-e7cb8ef991bc tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:01.784852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef448aa6-05b7-40cb-b280-e7cb8ef991bc tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:01.785115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef448aa6-05b7-40cb-b280-e7cb8ef991bc tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:01.785401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef448aa6-05b7-40cb-b280-e7cb8ef991bc tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/groups` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:01.795055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef448aa6-05b7-40cb-b280-e7cb8ef991bc tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:01.805733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef448aa6-05b7-40cb-b280-e7cb8ef991bc tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:01.872784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1dc08112-75a0-412c-b253-1944e5561079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a3f4863c7464764bab18d742ec523c3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:01.886358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1dc08112-75a0-412c-b253-1944e5561079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a3f4863c7464764bab18d742ec523c3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:01.889471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1dc08112-75a0-412c-b253-1944e5561079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a3f4863c7464764bab18d742ec523c3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:01.916421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1dc08112-75a0-412c-b253-1944e5561079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a3f4863c7464764bab18d742ec523c3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:01.922429 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2938/5943] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:04:01 2021] POST /identity/v3/groups => generated 326 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:01.926899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef448aa6-05b7-40cb-b280-e7cb8ef991bc tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:01.942090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1dc08112-75a0-412c-b253-1944e5561079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a3f4863c7464764bab18d742ec523c3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:01.958175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef448aa6-05b7-40cb-b280-e7cb8ef991bc tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:01.959177 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3006/5944] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:01 2021] DELETE /identity/v3/users/7a3f4863c7464764bab18d742ec523c3 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:01.963601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096df90-37a3-44c2-93b2-f1a25278e1e5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:01.963881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096df90-37a3-44c2-93b2-f1a25278e1e5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:01.964345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096df90-37a3-44c2-93b2-f1a25278e1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:02.016093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a096df90-37a3-44c2-93b2-f1a25278e1e5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:02.018790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a096df90-37a3-44c2-93b2-f1a25278e1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:02.154009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaff9e3-3aa3-4f66-9e4d-f519ea1146f7 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:02.154959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaff9e3-3aa3-4f66-9e4d-f519ea1146f7 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:02.155244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaff9e3-3aa3-4f66-9e4d-f519ea1146f7 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:02.155546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaff9e3-3aa3-4f66-9e4d-f519ea1146f7 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/groups/eb54327397e146af943ad37c1ce0c2d0/users/0a85d8d2aead4e47b14f5215c4e88073` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:02.177572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaff9e3-3aa3-4f66-9e4d-f519ea1146f7 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=eb54327397e146af943ad37c1ce0c2d0, user_id=0a85d8d2aead4e47b14f5215c4e88073)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:02.180383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaff9e3-3aa3-4f66-9e4d-f519ea1146f7 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:02.199618 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3007/5945] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:04:02.227476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096df90-37a3-44c2-93b2-f1a25278e1e5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:02.228937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a096df90-37a3-44c2-93b2-f1a25278e1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:02.250644 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2939/5946] 10.222.0.13 () {60 vars in 1359 bytes} [Sat Dec 18 21:04:01 2021] PUT /identity/v3/groups/eb54327397e146af943ad37c1ce0c2d0/users/0a85d8d2aead4e47b14f5215c4e88073 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:04:02.251715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaff9e3-3aa3-4f66-9e4d-f519ea1146f7 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:02.255042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bbaff9e3-3aa3-4f66-9e4d-f519ea1146f7 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:02.352375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096df90-37a3-44c2-93b2-f1a25278e1e5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:02.379984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaff9e3-3aa3-4f66-9e4d-f519ea1146f7 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:02.386839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2db51-e2cd-4bf4-a884-1c36ca9d7b35 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:02.387778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2db51-e2cd-4bf4-a884-1c36ca9d7b35 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:02.388071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2db51-e2cd-4bf4-a884-1c36ca9d7b35 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:02.388353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2db51-e2cd-4bf4-a884-1c36ca9d7b35 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/d95226c3b5044921b6f7c03b6333d4b9/groups/eb54327397e146af943ad37c1ce0c2d0/roles/49324fb5e54b499d82a738850168bdc6` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:02.391795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2db51-e2cd-4bf4-a884-1c36ca9d7b35 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d95226c3b5044921b6f7c03b6333d4b9, group_id=eb54327397e146af943ad37c1ce0c2d0, role_id=49324fb5e54b499d82a738850168bdc6)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:02.395118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2db51-e2cd-4bf4-a884-1c36ca9d7b35 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:02.421722 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2940/5947] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:02 2021] PUT /identity/v3/domains/d95226c3b5044921b6f7c03b6333d4b9/groups/eb54327397e146af943ad37c1ce0c2d0/roles/49324fb5e54b499d82a738850168bdc6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:04:02.426576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2db51-e2cd-4bf4-a884-1c36ca9d7b35 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:02.460927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b20de-78c1-4f56-abd7-43fbbb40d77a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:02.461284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b20de-78c1-4f56-abd7-43fbbb40d77a service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:02.463658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b20de-78c1-4f56-abd7-43fbbb40d77a service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:02.466627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b20de-78c1-4f56-abd7-43fbbb40d77a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:02.643111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2db51-e2cd-4bf4-a884-1c36ca9d7b35 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:02.656198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756f218-697a-4a73-b328-fc7d4ec20f7c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:02.659740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756f218-697a-4a73-b328-fc7d4ec20f7c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:02.660225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756f218-697a-4a73-b328-fc7d4ec20f7c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:02.660858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756f218-697a-4a73-b328-fc7d4ec20f7c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:02.662021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756f218-697a-4a73-b328-fc7d4ec20f7c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:02.671146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756f218-697a-4a73-b328-fc7d4ec20f7c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:02.702628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b20de-78c1-4f56-abd7-43fbbb40d77a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:02.704493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b20de-78c1-4f56-abd7-43fbbb40d77a service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:02.717337 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3008/5948] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:04:02.738765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b20de-78c1-4f56-abd7-43fbbb40d77a service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:02.738965 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2941/5949] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:04:02 2021] POST /identity/v3/domains => generated 275 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:02.766481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b20de-78c1-4f56-abd7-43fbbb40d77a service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:02.917330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300fa6b-b68f-43ea-9dcc-0a239f267dcf tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:02.920081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300fa6b-b68f-43ea-9dcc-0a239f267dcf tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:02.923223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300fa6b-b68f-43ea-9dcc-0a239f267dcf tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:02.926676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300fa6b-b68f-43ea-9dcc-0a239f267dcf tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:02.927726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300fa6b-b68f-43ea-9dcc-0a239f267dcf tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:02.932095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300fa6b-b68f-43ea-9dcc-0a239f267dcf tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:02.981848 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3009/5950] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:04:02 2021] POST /identity/v3/roles => generated 239 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:02.984822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756f218-697a-4a73-b328-fc7d4ec20f7c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:03.000276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756f218-697a-4a73-b328-fc7d4ec20f7c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:03.021895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f492224-b0eb-4ae4-8cdd-1403ef3c9ed4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:03.030769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f492224-b0eb-4ae4-8cdd-1403ef3c9ed4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:03.032185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f492224-b0eb-4ae4-8cdd-1403ef3c9ed4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:03.032597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f492224-b0eb-4ae4-8cdd-1403ef3c9ed4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/fbe97574489b4e71b62206f3488e78a2/users/0a85d8d2aead4e47b14f5215c4e88073/roles/1d8051ee696448e08cb0a05d80d5f5e5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:03.064847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f492224-b0eb-4ae4-8cdd-1403ef3c9ed4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=fbe97574489b4e71b62206f3488e78a2, user_id=0a85d8d2aead4e47b14f5215c4e88073, role_id=1d8051ee696448e08cb0a05d80d5f5e5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:03.071109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f492224-b0eb-4ae4-8cdd-1403ef3c9ed4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:03.111784 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2942/5951] 10.222.0.13 () {60 vars in 1479 bytes} [Sat Dec 18 21:04:02 2021] PUT /identity/v3/domains/fbe97574489b4e71b62206f3488e78a2/users/0a85d8d2aead4e47b14f5215c4e88073/roles/1d8051ee696448e08cb0a05d80d5f5e5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:03.117113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300fa6b-b68f-43ea-9dcc-0a239f267dcf tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:03.152103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300fa6b-b68f-43ea-9dcc-0a239f267dcf tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:03.335907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d726bfb-68fa-4025-bab6-b4046f422f0c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:03.336754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d726bfb-68fa-4025-bab6-b4046f422f0c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:03.337164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d726bfb-68fa-4025-bab6-b4046f422f0c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:03.337555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d726bfb-68fa-4025-bab6-b4046f422f0c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:03.339267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d726bfb-68fa-4025-bab6-b4046f422f0c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:03.343123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d726bfb-68fa-4025-bab6-b4046f422f0c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:03.373858 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3010/5952] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:04:03 2021] POST /identity/v3/domains => generated 276 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:03.379002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f492224-b0eb-4ae4-8cdd-1403ef3c9ed4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:03.395456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f492224-b0eb-4ae4-8cdd-1403ef3c9ed4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:03.523415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725f6d-4bbd-44e6-a04b-dced1870bffd tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:03.526246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725f6d-4bbd-44e6-a04b-dced1870bffd tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:03.531121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725f6d-4bbd-44e6-a04b-dced1870bffd tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:03.531757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725f6d-4bbd-44e6-a04b-dced1870bffd tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:03.541931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed725f6d-4bbd-44e6-a04b-dced1870bffd tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:03.547792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed725f6d-4bbd-44e6-a04b-dced1870bffd tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:03.565860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d726bfb-68fa-4025-bab6-b4046f422f0c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:03.567621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1d726bfb-68fa-4025-bab6-b4046f422f0c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:03.585201 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2943/5953] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:04:03 2021] POST /identity/v3/roles => generated 240 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:03.590041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725f6d-4bbd-44e6-a04b-dced1870bffd tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:03.630125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725f6d-4bbd-44e6-a04b-dced1870bffd tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:03.645965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043481c3-c671-4224-87e9-ec3da50f7e04 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:03.651230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043481c3-c671-4224-87e9-ec3da50f7e04 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:03.651843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043481c3-c671-4224-87e9-ec3da50f7e04 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:03.652376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043481c3-c671-4224-87e9-ec3da50f7e04 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/groups` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:03.656597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043481c3-c671-4224-87e9-ec3da50f7e04 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:03.658699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043481c3-c671-4224-87e9-ec3da50f7e04 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:03.728383 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2944/5954] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Dec 18 21:04:03 2021] POST /identity/v3/groups => generated 325 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:03.729409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043481c3-c671-4224-87e9-ec3da50f7e04 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:03.754195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043481c3-c671-4224-87e9-ec3da50f7e04 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:03.770503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df4fd0-70d4-493d-93d8-63243f23088f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:03.771805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df4fd0-70d4-493d-93d8-63243f23088f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:03.772773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df4fd0-70d4-493d-93d8-63243f23088f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:03.773253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df4fd0-70d4-493d-93d8-63243f23088f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/groups/b6699238e0ed401481589475ffbeb9df/users/0a85d8d2aead4e47b14f5215c4e88073` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:03.774785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d726bfb-68fa-4025-bab6-b4046f422f0c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:03.784882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f5ff1-8978-4c45-b26d-94562b6d079c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:03.786955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f5ff1-8978-4c45-b26d-94562b6d079c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:03.790657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f5ff1-8978-4c45-b26d-94562b6d079c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:03.790959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f5ff1-8978-4c45-b26d-94562b6d079c admin admin] PATH_INFO: `/v3/projects/08260505386449d88fefea317ecb38b0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:03.791976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df4fd0-70d4-493d-93d8-63243f23088f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=b6699238e0ed401481589475ffbeb9df, user_id=0a85d8d2aead4e47b14f5215c4e88073)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:03.792555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f5ff1-8978-4c45-b26d-94562b6d079c admin admin] RBAC: Authorizing `identity:delete_project(project_id=08260505386449d88fefea317ecb38b0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:03.794351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df4fd0-70d4-493d-93d8-63243f23088f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:03.795236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f5ff1-8978-4c45-b26d-94562b6d079c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:03.854150 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2945/5955] 10.222.0.13 () {60 vars in 1359 bytes} [Sat Dec 18 21:04:03 2021] PUT /identity/v3/groups/b6699238e0ed401481589475ffbeb9df/users/0a85d8d2aead4e47b14f5215c4e88073 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:03.855604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df4fd0-70d4-493d-93d8-63243f23088f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:03.928468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ae9f5ff1-8978-4c45-b26d-94562b6d079c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08260505386449d88fefea317ecb38b0', 'request_id': 'req-ae9f5ff1-8978-4c45-b26d-94562b6d079c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:03.940974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ae9f5ff1-8978-4c45-b26d-94562b6d079c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08260505386449d88fefea317ecb38b0', 'request_id': 'req-ae9f5ff1-8978-4c45-b26d-94562b6d079c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:03.955492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ae9f5ff1-8978-4c45-b26d-94562b6d079c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08260505386449d88fefea317ecb38b0', 'request_id': 'req-ae9f5ff1-8978-4c45-b26d-94562b6d079c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:03.972028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ae9f5ff1-8978-4c45-b26d-94562b6d079c admin admin] The token cache is being invalidate because project 08260505386449d88fefea317ecb38b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:03.972331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ae9f5ff1-8978-4c45-b26d-94562b6d079c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:03.973053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ae9f5ff1-8978-4c45-b26d-94562b6d079c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:03.981070 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3011/5956] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:04:03 2021] DELETE /identity/v3/projects/08260505386449d88fefea317ecb38b0 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:03.983354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a33603-04bc-481c-bd80-98054afa22f3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:03.983651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a33603-04bc-481c-bd80-98054afa22f3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:03.984053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a33603-04bc-481c-bd80-98054afa22f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:03.995581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df4fd0-70d4-493d-93d8-63243f23088f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:04.012797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-82a33603-04bc-481c-bd80-98054afa22f3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:04.012797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-82a33603-04bc-481c-bd80-98054afa22f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:04.111357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f2700-3e01-4336-a965-2ec886bc87fe tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:04.113561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f2700-3e01-4336-a965-2ec886bc87fe tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:04.115082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f2700-3e01-4336-a965-2ec886bc87fe tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:04.115388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f2700-3e01-4336-a965-2ec886bc87fe tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/48553605f3bd49579b39c4440674a358/groups/b6699238e0ed401481589475ffbeb9df/roles/773e67a87ca44065a3467e627b545383` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:04.121193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f2700-3e01-4336-a965-2ec886bc87fe tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=48553605f3bd49579b39c4440674a358, group_id=b6699238e0ed401481589475ffbeb9df, role_id=773e67a87ca44065a3467e627b545383)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:04.128686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f2700-3e01-4336-a965-2ec886bc87fe tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:04.130699 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3012/5957] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:04.133092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda20ad-3d7e-49ce-aecb-31f0962a5209 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:04.133495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda20ad-3d7e-49ce-aecb-31f0962a5209 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:04.133962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda20ad-3d7e-49ce-aecb-31f0962a5209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:04.155441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8eda20ad-3d7e-49ce-aecb-31f0962a5209 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:04.156758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8eda20ad-3d7e-49ce-aecb-31f0962a5209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:04.157639 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2946/5958] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:03 2021] PUT /identity/v3/domains/48553605f3bd49579b39c4440674a358/groups/b6699238e0ed401481589475ffbeb9df/roles/773e67a87ca44065a3467e627b545383 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:04.164632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f2700-3e01-4336-a965-2ec886bc87fe tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:04.166747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e24f2700-3e01-4336-a965-2ec886bc87fe tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:04.268267 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3013/5959] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:04.275616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda20ad-3d7e-49ce-aecb-31f0962a5209 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:04.304039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda20ad-3d7e-49ce-aecb-31f0962a5209 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:04.315553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce401f1-cf81-45cc-803f-3abcc1fbf0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:04.316425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce401f1-cf81-45cc-803f-3abcc1fbf0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:04.316719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce401f1-cf81-45cc-803f-3abcc1fbf0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:04.317307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce401f1-cf81-45cc-803f-3abcc1fbf0a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:04.318164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce401f1-cf81-45cc-803f-3abcc1fbf0a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:04:04.318502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce401f1-cf81-45cc-803f-3abcc1fbf0a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:04.326486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce401f1-cf81-45cc-803f-3abcc1fbf0a4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:04.360780 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3014/5960] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:04:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:04:04.362797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce401f1-cf81-45cc-803f-3abcc1fbf0a4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:04.369202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f2700-3e01-4336-a965-2ec886bc87fe tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:04.380976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca10039-6f89-45fd-baa4-62ec0f1d1f57 tempest-TokensV3TestJSON-1447120515 tempest-TokensV3TestJSON-1447120515-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a85d8d2aead4e47b14f5215c4e88073', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d72caaccdd34f848a660bf4f9270474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:04.382592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca10039-6f89-45fd-baa4-62ec0f1d1f57 tempest-TokensV3TestJSON-1447120515 tempest-TokensV3TestJSON-1447120515-project] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:04.384192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca10039-6f89-45fd-baa4-62ec0f1d1f57 tempest-TokensV3TestJSON-1447120515 tempest-TokensV3TestJSON-1447120515-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:04.385548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca10039-6f89-45fd-baa4-62ec0f1d1f57 tempest-TokensV3TestJSON-1447120515 tempest-TokensV3TestJSON-1447120515-project] PATH_INFO: `/v3/auth/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:04.388982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca10039-6f89-45fd-baa4-62ec0f1d1f57 tempest-TokensV3TestJSON-1447120515 tempest-TokensV3TestJSON-1447120515-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:04.391793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca10039-6f89-45fd-baa4-62ec0f1d1f57 tempest-TokensV3TestJSON-1447120515 tempest-TokensV3TestJSON-1447120515-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:04.398878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce401f1-cf81-45cc-803f-3abcc1fbf0a4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:04.406919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe95723-7599-40d6-ba84-7583dc8c2f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:04.407595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe95723-7599-40d6-ba84-7583dc8c2f71 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:04.407883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe95723-7599-40d6-ba84-7583dc8c2f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:04.408171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe95723-7599-40d6-ba84-7583dc8c2f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:04.409046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe95723-7599-40d6-ba84-7583dc8c2f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:04.411134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe95723-7599-40d6-ba84-7583dc8c2f71 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:04.462234 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3015/5961] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:04:04 2021] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:04.466168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe95723-7599-40d6-ba84-7583dc8c2f71 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:04.580327 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2947/5962] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Dec 18 21:04:04 2021] GET /identity/v3/auth/domains => generated 1172 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:04:04.581435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca10039-6f89-45fd-baa4-62ec0f1d1f57 tempest-TokensV3TestJSON-1447120515 tempest-TokensV3TestJSON-1447120515-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:04.583225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe95723-7599-40d6-ba84-7583dc8c2f71 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:04.590392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199d9d8-4612-4e9f-8ed3-ad91d1dfe520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:04.591192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199d9d8-4612-4e9f-8ed3-ad91d1dfe520 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:04.591481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199d9d8-4612-4e9f-8ed3-ad91d1dfe520 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:04.591770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199d9d8-4612-4e9f-8ed3-ad91d1dfe520 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:04.592237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0ca10039-6f89-45fd-baa4-62ec0f1d1f57 tempest-TokensV3TestJSON-1447120515 tempest-TokensV3TestJSON-1447120515-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:04.592487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199d9d8-4612-4e9f-8ed3-ad91d1dfe520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:04.595871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199d9d8-4612-4e9f-8ed3-ad91d1dfe520 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:04.627744 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3016/5963] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:04:04 2021] POST /identity/v3/users => generated 284 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:04.628695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199d9d8-4612-4e9f-8ed3-ad91d1dfe520 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:04.644785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199d9d8-4612-4e9f-8ed3-ad91d1dfe520 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:04.653220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c750966-32ec-4b98-b106-bf4d7247097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:04.653907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c750966-32ec-4b98-b106-bf4d7247097a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:04.654194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c750966-32ec-4b98-b106-bf4d7247097a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:04.654531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c750966-32ec-4b98-b106-bf4d7247097a admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:04.655275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c750966-32ec-4b98-b106-bf4d7247097a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:04.656894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c750966-32ec-4b98-b106-bf4d7247097a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:04.675627 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3017/5964] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:04 2021] GET /identity/v3/roles => generated 2343 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:04.680992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c750966-32ec-4b98-b106-bf4d7247097a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:04.696683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c750966-32ec-4b98-b106-bf4d7247097a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:04.702919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7b495-c5b5-4ce8-a38e-78d323f6942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:04.704219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7b495-c5b5-4ce8-a38e-78d323f6942d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:04.704517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7b495-c5b5-4ce8-a38e-78d323f6942d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:04.704907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7b495-c5b5-4ce8-a38e-78d323f6942d admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:04.705716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7b495-c5b5-4ce8-a38e-78d323f6942d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:04.707495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7b495-c5b5-4ce8-a38e-78d323f6942d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:04.724765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca10039-6f89-45fd-baa4-62ec0f1d1f57 tempest-TokensV3TestJSON-1447120515 tempest-TokensV3TestJSON-1447120515-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:04.741959 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3018/5965] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:04 2021] GET /identity/v3/roles => generated 2343 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:04.743055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7b495-c5b5-4ce8-a38e-78d323f6942d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:04.757432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7b495-c5b5-4ce8-a38e-78d323f6942d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:04.767127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddaa17-cfdc-419b-a3a4-1a7e66117af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:04.768058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddaa17-cfdc-419b-a3a4-1a7e66117af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:04.768344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddaa17-cfdc-419b-a3a4-1a7e66117af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:04.768630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddaa17-cfdc-419b-a3a4-1a7e66117af8 admin admin] PATH_INFO: `/v3/projects/3ada50ccbe004ac887658264d222db1f/users/5b0a5c690279418faa8fb5506ca47389/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:04.797248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddaa17-cfdc-419b-a3a4-1a7e66117af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ada50ccbe004ac887658264d222db1f, user_id=5b0a5c690279418faa8fb5506ca47389, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:04.799965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddaa17-cfdc-419b-a3a4-1a7e66117af8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:04.819592 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3019/5966] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:04 2021] PUT /identity/v3/projects/3ada50ccbe004ac887658264d222db1f/users/5b0a5c690279418faa8fb5506ca47389/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:04.830019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfbf88-b07b-423e-b43c-7e614936de6e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:04.831696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfbf88-b07b-423e-b43c-7e614936de6e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:04.833199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfbf88-b07b-423e-b43c-7e614936de6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:04.845872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecd79f-3333-4c34-86ba-31115363e8ea tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:04.847135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecd79f-3333-4c34-86ba-31115363e8ea tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:04.847589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecd79f-3333-4c34-86ba-31115363e8ea tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:04.848034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecd79f-3333-4c34-86ba-31115363e8ea tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/48553605f3bd49579b39c4440674a358/groups/b6699238e0ed401481589475ffbeb9df/roles/773e67a87ca44065a3467e627b545383` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:04.858273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecd79f-3333-4c34-86ba-31115363e8ea tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=48553605f3bd49579b39c4440674a358, group_id=b6699238e0ed401481589475ffbeb9df, role_id=773e67a87ca44065a3467e627b545383)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:04.862238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecd79f-3333-4c34-86ba-31115363e8ea tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:04.878020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c6ecd79f-3333-4c34-86ba-31115363e8ea tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invalidating the token cache because role 773e67a87ca44065a3467e627b545383 was removed from group b6699238e0ed401481589475ffbeb9df on domain 48553605f3bd49579b39c4440674a358. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:04.878397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c6ecd79f-3333-4c34-86ba-31115363e8ea tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:04.879682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c6ecd79f-3333-4c34-86ba-31115363e8ea tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:04.911227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-10dfbf88-b07b-423e-b43c-7e614936de6e None None] MFA Rules not processed for user `5b0a5c690279418faa8fb5506ca47389`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:04.911620 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2948/5967] 10.222.0.13 () {58 vars in 1466 bytes} [Sat Dec 18 21:04:04 2021] DELETE /identity/v3/domains/48553605f3bd49579b39c4440674a358/groups/b6699238e0ed401481589475ffbeb9df/roles/773e67a87ca44065a3467e627b545383 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:04.914741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-10dfbf88-b07b-423e-b43c-7e614936de6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:04.918754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecd79f-3333-4c34-86ba-31115363e8ea tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:04.921306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c6ecd79f-3333-4c34-86ba-31115363e8ea tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:05.097935 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3020/5968] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:04 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:04:05.134311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfbf88-b07b-423e-b43c-7e614936de6e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:05.135807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-10dfbf88-b07b-423e-b43c-7e614936de6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:05.148091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecd79f-3333-4c34-86ba-31115363e8ea tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:05.165855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0b19a-aa52-4499-acd4-6970346978e4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:05.170858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0b19a-aa52-4499-acd4-6970346978e4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:05.179845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0b19a-aa52-4499-acd4-6970346978e4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:05.184690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0b19a-aa52-4499-acd4-6970346978e4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/groups/b6699238e0ed401481589475ffbeb9df/users/0a85d8d2aead4e47b14f5215c4e88073` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:05.196642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0b19a-aa52-4499-acd4-6970346978e4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=b6699238e0ed401481589475ffbeb9df, user_id=0a85d8d2aead4e47b14f5215c4e88073)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:05.199157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0b19a-aa52-4499-acd4-6970346978e4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:05.219662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d9d0b19a-aa52-4499-acd4-6970346978e4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0a85d8d2aead4e47b14f5215c4e88073'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:05.288188 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2949/5969] 10.222.0.13 () {58 vars in 1343 bytes} [Sat Dec 18 21:04:04 2021] DELETE /identity/v3/groups/b6699238e0ed401481589475ffbeb9df/users/0a85d8d2aead4e47b14f5215c4e88073 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:05.289440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0b19a-aa52-4499-acd4-6970346978e4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:05.298685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfbf88-b07b-423e-b43c-7e614936de6e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:05.418820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36661ce3-f7f7-4ce9-b515-68baab64ff4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:05.419520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36661ce3-f7f7-4ce9-b515-68baab64ff4a service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:05.419748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36661ce3-f7f7-4ce9-b515-68baab64ff4a service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:05.420023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36661ce3-f7f7-4ce9-b515-68baab64ff4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:05.508970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0b19a-aa52-4499-acd4-6970346978e4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:05.529287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36661ce3-f7f7-4ce9-b515-68baab64ff4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:05.531245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf00067-e231-4a0b-9282-17fe882b4a4c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:05.531442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36661ce3-f7f7-4ce9-b515-68baab64ff4a service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:05.533841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf00067-e231-4a0b-9282-17fe882b4a4c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:05.535292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf00067-e231-4a0b-9282-17fe882b4a4c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:05.538490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf00067-e231-4a0b-9282-17fe882b4a4c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/groups/b6699238e0ed401481589475ffbeb9df` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:05.542359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf00067-e231-4a0b-9282-17fe882b4a4c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b6699238e0ed401481589475ffbeb9df)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:05.545997 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3021/5970] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:05 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:04:05.549372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf00067-e231-4a0b-9282-17fe882b4a4c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:05.696405 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2950/5971] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 21:04:05 2021] DELETE /identity/v3/groups/b6699238e0ed401481589475ffbeb9df => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:05.703723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36661ce3-f7f7-4ce9-b515-68baab64ff4a service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:05.718590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36661ce3-f7f7-4ce9-b515-68baab64ff4a service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:05.843167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce0a1f-d51a-44fc-9f4c-26f7923d168f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:05.844226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce0a1f-d51a-44fc-9f4c-26f7923d168f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:05.844627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce0a1f-d51a-44fc-9f4c-26f7923d168f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:05.845021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce0a1f-d51a-44fc-9f4c-26f7923d168f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/roles/773e67a87ca44065a3467e627b545383` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:05.846704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce0a1f-d51a-44fc-9f4c-26f7923d168f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:delete_role(role_id=773e67a87ca44065a3467e627b545383)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:05.848419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce0a1f-d51a-44fc-9f4c-26f7923d168f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:05.940745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0ce0a1f-d51a-44fc-9f4c-26f7923d168f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invalidating the token cache because role 773e67a87ca44065a3467e627b545383 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:05.941209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0ce0a1f-d51a-44fc-9f4c-26f7923d168f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:05.944480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d0ce0a1f-d51a-44fc-9f4c-26f7923d168f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:05.947202 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3022/5972] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:05 2021] DELETE /identity/v3/roles/773e67a87ca44065a3467e627b545383 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:05.951178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf00067-e231-4a0b-9282-17fe882b4a4c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:05.953355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1bf00067-e231-4a0b-9282-17fe882b4a4c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:05.967784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf00067-e231-4a0b-9282-17fe882b4a4c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:06.126564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038c77b-087d-48ae-8375-a2ebb87f6535 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:06.130340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038c77b-087d-48ae-8375-a2ebb87f6535 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:06.130648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038c77b-087d-48ae-8375-a2ebb87f6535 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:06.130930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038c77b-087d-48ae-8375-a2ebb87f6535 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/48553605f3bd49579b39c4440674a358` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:06.137412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038c77b-087d-48ae-8375-a2ebb87f6535 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=48553605f3bd49579b39c4440674a358)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:06.148561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038c77b-087d-48ae-8375-a2ebb87f6535 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:06.197662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3038c77b-087d-48ae-8375-a2ebb87f6535 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '48553605f3bd49579b39c4440674a358'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:06.200063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3038c77b-087d-48ae-8375-a2ebb87f6535 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '48553605f3bd49579b39c4440674a358'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:06.254665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3038c77b-087d-48ae-8375-a2ebb87f6535 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '48553605f3bd49579b39c4440674a358'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:06.257200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3038c77b-087d-48ae-8375-a2ebb87f6535 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '48553605f3bd49579b39c4440674a358'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:06.264347 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2951/5973] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:04:05 2021] PATCH /identity/v3/domains/48553605f3bd49579b39c4440674a358 => generated 277 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:04:06.266664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce0a1f-d51a-44fc-9f4c-26f7923d168f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:06.289184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce0a1f-d51a-44fc-9f4c-26f7923d168f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:06.456450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:06.457570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:06.457864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:06.458146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/48553605f3bd49579b39c4440674a358` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:06.473516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=48553605f3bd49579b39c4440674a358)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:06.475715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:06.514943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '48553605f3bd49579b39c4440674a358'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:06.519786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '48553605f3bd49579b39c4440674a358'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:06.620480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48553605f3bd49579b39c4440674a358', 'request_id': 'req-ba9de73c-14b3-45d8-ada1-36690cc6e05a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:06.634434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48553605f3bd49579b39c4440674a358', 'request_id': 'req-ba9de73c-14b3-45d8-ada1-36690cc6e05a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:06.658057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48553605f3bd49579b39c4440674a358', 'request_id': 'req-ba9de73c-14b3-45d8-ada1-36690cc6e05a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:06.681570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] The token cache is being invalidate because project 48553605f3bd49579b39c4440674a358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:06.681966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:06.684598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:06.703213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '48553605f3bd49579b39c4440674a358', 'request_id': 'req-ba9de73c-14b3-45d8-ada1-36690cc6e05a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:06.717229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '48553605f3bd49579b39c4440674a358', 'request_id': 'req-ba9de73c-14b3-45d8-ada1-36690cc6e05a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:06.717762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '48553605f3bd49579b39c4440674a358', 'request_id': 'req-ba9de73c-14b3-45d8-ada1-36690cc6e05a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:06.724452 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3023/5974] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:04:06 2021] DELETE /identity/v3/domains/48553605f3bd49579b39c4440674a358 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:06.729038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038c77b-087d-48ae-8375-a2ebb87f6535 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:06.730504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3038c77b-087d-48ae-8375-a2ebb87f6535 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:06.749556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038c77b-087d-48ae-8375-a2ebb87f6535 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:06.838501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6bec7-afff-4030-9889-5aad32bebadb tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:06.839455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6bec7-afff-4030-9889-5aad32bebadb tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:06.839742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6bec7-afff-4030-9889-5aad32bebadb tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:06.840026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6bec7-afff-4030-9889-5aad32bebadb tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/fbe97574489b4e71b62206f3488e78a2/users/0a85d8d2aead4e47b14f5215c4e88073/roles/1d8051ee696448e08cb0a05d80d5f5e5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:06.845663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6bec7-afff-4030-9889-5aad32bebadb tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=fbe97574489b4e71b62206f3488e78a2, user_id=0a85d8d2aead4e47b14f5215c4e88073, role_id=1d8051ee696448e08cb0a05d80d5f5e5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:06.848559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6bec7-afff-4030-9889-5aad32bebadb tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:06.858657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a5f6bec7-afff-4030-9889-5aad32bebadb tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invalidating the token cache because role 1d8051ee696448e08cb0a05d80d5f5e5 was removed from user 0a85d8d2aead4e47b14f5215c4e88073 on domain fbe97574489b4e71b62206f3488e78a2. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:06.859200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a5f6bec7-afff-4030-9889-5aad32bebadb tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:06.859935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a5f6bec7-afff-4030-9889-5aad32bebadb tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:06.906058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:06.909148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:06.914396 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2952/5975] 10.222.0.13 () {58 vars in 1463 bytes} [Sat Dec 18 21:04:06 2021] DELETE /identity/v3/domains/fbe97574489b4e71b62206f3488e78a2/users/0a85d8d2aead4e47b14f5215c4e88073/roles/1d8051ee696448e08cb0a05d80d5f5e5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:06.948656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9de73c-14b3-45d8-ada1-36690cc6e05a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:07.108325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0fd88-037a-4426-81d0-0aa7c444882d tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:07.109330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0fd88-037a-4426-81d0-0aa7c444882d tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:07.109734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0fd88-037a-4426-81d0-0aa7c444882d tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:07.110129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0fd88-037a-4426-81d0-0aa7c444882d tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/roles/1d8051ee696448e08cb0a05d80d5f5e5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:07.114446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0fd88-037a-4426-81d0-0aa7c444882d tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1d8051ee696448e08cb0a05d80d5f5e5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:07.120109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0fd88-037a-4426-81d0-0aa7c444882d tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:07.204008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2fc0fd88-037a-4426-81d0-0aa7c444882d tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invalidating the token cache because role 1d8051ee696448e08cb0a05d80d5f5e5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:07.204456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2fc0fd88-037a-4426-81d0-0aa7c444882d tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.205303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2fc0fd88-037a-4426-81d0-0aa7c444882d tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.211099 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3024/5976] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:06 2021] DELETE /identity/v3/roles/1d8051ee696448e08cb0a05d80d5f5e5 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:07.212316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6bec7-afff-4030-9889-5aad32bebadb tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:07.213963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a5f6bec7-afff-4030-9889-5aad32bebadb tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:07.227721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6bec7-afff-4030-9889-5aad32bebadb tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:07.380095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1bebf-60b5-481b-8596-2ca5f57d95ab tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:07.386511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1bebf-60b5-481b-8596-2ca5f57d95ab tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:07.386918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1bebf-60b5-481b-8596-2ca5f57d95ab tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:07.387702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1bebf-60b5-481b-8596-2ca5f57d95ab tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/fbe97574489b4e71b62206f3488e78a2` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:07.391692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1bebf-60b5-481b-8596-2ca5f57d95ab tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=fbe97574489b4e71b62206f3488e78a2)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:07.396341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1bebf-60b5-481b-8596-2ca5f57d95ab tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:07.425350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-abc1bebf-60b5-481b-8596-2ca5f57d95ab tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'fbe97574489b4e71b62206f3488e78a2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.426225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-abc1bebf-60b5-481b-8596-2ca5f57d95ab tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'fbe97574489b4e71b62206f3488e78a2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.467178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-abc1bebf-60b5-481b-8596-2ca5f57d95ab tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'fbe97574489b4e71b62206f3488e78a2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.468144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-abc1bebf-60b5-481b-8596-2ca5f57d95ab tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'fbe97574489b4e71b62206f3488e78a2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.475176 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2953/5977] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:04:07 2021] PATCH /identity/v3/domains/fbe97574489b4e71b62206f3488e78a2 => generated 276 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:04:07.476669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0fd88-037a-4426-81d0-0aa7c444882d tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:07.478234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2fc0fd88-037a-4426-81d0-0aa7c444882d tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:07.500422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0fd88-037a-4426-81d0-0aa7c444882d tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:07.585626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:07.586866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:07.587399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:07.587936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/fbe97574489b4e71b62206f3488e78a2` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:07.616620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fbe97574489b4e71b62206f3488e78a2)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:07.618177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:07.647918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fbe97574489b4e71b62206f3488e78a2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.651550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fbe97574489b4e71b62206f3488e78a2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.726013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe97574489b4e71b62206f3488e78a2', 'request_id': 'req-e7d75f1d-f25d-438a-a433-c4b20012be42'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.734458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe97574489b4e71b62206f3488e78a2', 'request_id': 'req-e7d75f1d-f25d-438a-a433-c4b20012be42'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.751932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe97574489b4e71b62206f3488e78a2', 'request_id': 'req-e7d75f1d-f25d-438a-a433-c4b20012be42'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.787263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] The token cache is being invalidate because project fbe97574489b4e71b62206f3488e78a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:07.787740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.792457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.803868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fbe97574489b4e71b62206f3488e78a2', 'request_id': 'req-e7d75f1d-f25d-438a-a433-c4b20012be42'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.810626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fbe97574489b4e71b62206f3488e78a2', 'request_id': 'req-e7d75f1d-f25d-438a-a433-c4b20012be42'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.815247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fbe97574489b4e71b62206f3488e78a2', 'request_id': 'req-e7d75f1d-f25d-438a-a433-c4b20012be42'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.826462 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3025/5978] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:04:07 2021] DELETE /identity/v3/domains/fbe97574489b4e71b62206f3488e78a2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:07.827395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1bebf-60b5-481b-8596-2ca5f57d95ab tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:07.828936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-abc1bebf-60b5-481b-8596-2ca5f57d95ab tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:07.844668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1bebf-60b5-481b-8596-2ca5f57d95ab tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:07.921440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb35a8-2dba-4792-ad2b-f23863fdc0b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:07.922719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb35a8-2dba-4792-ad2b-f23863fdc0b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:07.923816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb35a8-2dba-4792-ad2b-f23863fdc0b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:07.924273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb35a8-2dba-4792-ad2b-f23863fdc0b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/d95226c3b5044921b6f7c03b6333d4b9/groups/eb54327397e146af943ad37c1ce0c2d0/roles/49324fb5e54b499d82a738850168bdc6` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:07.929677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb35a8-2dba-4792-ad2b-f23863fdc0b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d95226c3b5044921b6f7c03b6333d4b9, group_id=eb54327397e146af943ad37c1ce0c2d0, role_id=49324fb5e54b499d82a738850168bdc6)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:07.932574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb35a8-2dba-4792-ad2b-f23863fdc0b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:07.939797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-00eb35a8-2dba-4792-ad2b-f23863fdc0b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invalidating the token cache because role 49324fb5e54b499d82a738850168bdc6 was removed from group eb54327397e146af943ad37c1ce0c2d0 on domain d95226c3b5044921b6f7c03b6333d4b9. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:07.940240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-00eb35a8-2dba-4792-ad2b-f23863fdc0b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.941058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-00eb35a8-2dba-4792-ad2b-f23863fdc0b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:07.958792 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2954/5979] 10.222.0.13 () {58 vars in 1466 bytes} [Sat Dec 18 21:04:07 2021] DELETE /identity/v3/domains/d95226c3b5044921b6f7c03b6333d4b9/groups/eb54327397e146af943ad37c1ce0c2d0/roles/49324fb5e54b499d82a738850168bdc6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:07.963074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:07.965155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:07.982237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d75f1d-f25d-438a-a433-c4b20012be42 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:08.051086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886d626-2ddf-496b-a263-614293387022 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:08.058318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886d626-2ddf-496b-a263-614293387022 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:08.061264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886d626-2ddf-496b-a263-614293387022 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:08.061693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886d626-2ddf-496b-a263-614293387022 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/groups/eb54327397e146af943ad37c1ce0c2d0/users/0a85d8d2aead4e47b14f5215c4e88073` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:08.072987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886d626-2ddf-496b-a263-614293387022 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=eb54327397e146af943ad37c1ce0c2d0, user_id=0a85d8d2aead4e47b14f5215c4e88073)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:08.074975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886d626-2ddf-496b-a263-614293387022 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:08.087290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c886d626-2ddf-496b-a263-614293387022 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0a85d8d2aead4e47b14f5215c4e88073'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:08.105894 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3026/5980] 10.222.0.13 () {58 vars in 1343 bytes} [Sat Dec 18 21:04:07 2021] DELETE /identity/v3/groups/eb54327397e146af943ad37c1ce0c2d0/users/0a85d8d2aead4e47b14f5215c4e88073 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:04:08.110358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb35a8-2dba-4792-ad2b-f23863fdc0b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:08.111984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-00eb35a8-2dba-4792-ad2b-f23863fdc0b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:08.127848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb35a8-2dba-4792-ad2b-f23863fdc0b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:08.231643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f41bcb-3fe4-465f-9bd6-3c14ca9a5bc3 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:08.233768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f41bcb-3fe4-465f-9bd6-3c14ca9a5bc3 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:08.234743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f41bcb-3fe4-465f-9bd6-3c14ca9a5bc3 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:08.236040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f41bcb-3fe4-465f-9bd6-3c14ca9a5bc3 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/groups/eb54327397e146af943ad37c1ce0c2d0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:08.238678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f41bcb-3fe4-465f-9bd6-3c14ca9a5bc3 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:delete_group(group_id=eb54327397e146af943ad37c1ce0c2d0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:08.241362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f41bcb-3fe4-465f-9bd6-3c14ca9a5bc3 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:08.312649 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2955/5981] 10.222.0.13 () {58 vars in 1226 bytes} [Sat Dec 18 21:04:08 2021] DELETE /identity/v3/groups/eb54327397e146af943ad37c1ce0c2d0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:08.316132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886d626-2ddf-496b-a263-614293387022 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:08.329454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886d626-2ddf-496b-a263-614293387022 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:08.449268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570839a-1848-4ef4-b7f5-2bdbdcfb9898 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:08.457790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570839a-1848-4ef4-b7f5-2bdbdcfb9898 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:08.460509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570839a-1848-4ef4-b7f5-2bdbdcfb9898 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:08.461877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570839a-1848-4ef4-b7f5-2bdbdcfb9898 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/roles/49324fb5e54b499d82a738850168bdc6` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:08.467415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570839a-1848-4ef4-b7f5-2bdbdcfb9898 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:delete_role(role_id=49324fb5e54b499d82a738850168bdc6)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:08.471732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570839a-1848-4ef4-b7f5-2bdbdcfb9898 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:08.563938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e570839a-1848-4ef4-b7f5-2bdbdcfb9898 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invalidating the token cache because role 49324fb5e54b499d82a738850168bdc6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:08.564529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e570839a-1848-4ef4-b7f5-2bdbdcfb9898 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:08.565049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e570839a-1848-4ef4-b7f5-2bdbdcfb9898 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:08.567789 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3027/5982] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:08 2021] DELETE /identity/v3/roles/49324fb5e54b499d82a738850168bdc6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:08.572219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f41bcb-3fe4-465f-9bd6-3c14ca9a5bc3 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:08.577310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e4f41bcb-3fe4-465f-9bd6-3c14ca9a5bc3 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:08.599006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f41bcb-3fe4-465f-9bd6-3c14ca9a5bc3 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:08.750287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01efd1-9dde-49b8-93a8-adf9617a86b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:08.751377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01efd1-9dde-49b8-93a8-adf9617a86b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:08.751784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01efd1-9dde-49b8-93a8-adf9617a86b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:08.752452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01efd1-9dde-49b8-93a8-adf9617a86b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/d95226c3b5044921b6f7c03b6333d4b9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:08.754219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01efd1-9dde-49b8-93a8-adf9617a86b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d95226c3b5044921b6f7c03b6333d4b9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:08.756892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01efd1-9dde-49b8-93a8-adf9617a86b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:08.795296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ce01efd1-9dde-49b8-93a8-adf9617a86b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd95226c3b5044921b6f7c03b6333d4b9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:08.796374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ce01efd1-9dde-49b8-93a8-adf9617a86b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd95226c3b5044921b6f7c03b6333d4b9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:08.833039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ce01efd1-9dde-49b8-93a8-adf9617a86b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd95226c3b5044921b6f7c03b6333d4b9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:08.838503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ce01efd1-9dde-49b8-93a8-adf9617a86b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd95226c3b5044921b6f7c03b6333d4b9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:08.851835 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2956/5983] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:04:08 2021] PATCH /identity/v3/domains/d95226c3b5044921b6f7c03b6333d4b9 => generated 277 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:04:08.853474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570839a-1848-4ef4-b7f5-2bdbdcfb9898 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:08.874374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570839a-1848-4ef4-b7f5-2bdbdcfb9898 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:08.974182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:08.975968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:08.977295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:08.977742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/d95226c3b5044921b6f7c03b6333d4b9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:08.996459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d95226c3b5044921b6f7c03b6333d4b9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:08.999072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:09.099397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd95226c3b5044921b6f7c03b6333d4b9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.110452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd95226c3b5044921b6f7c03b6333d4b9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.200485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95226c3b5044921b6f7c03b6333d4b9', 'request_id': 'req-31867ef9-3083-409f-a871-ad3a76670e16'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.212270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95226c3b5044921b6f7c03b6333d4b9', 'request_id': 'req-31867ef9-3083-409f-a871-ad3a76670e16'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.221569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95226c3b5044921b6f7c03b6333d4b9', 'request_id': 'req-31867ef9-3083-409f-a871-ad3a76670e16'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.237330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] The token cache is being invalidate because project d95226c3b5044921b6f7c03b6333d4b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:09.237619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.238811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.251712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd95226c3b5044921b6f7c03b6333d4b9', 'request_id': 'req-31867ef9-3083-409f-a871-ad3a76670e16'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.259489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd95226c3b5044921b6f7c03b6333d4b9', 'request_id': 'req-31867ef9-3083-409f-a871-ad3a76670e16'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.260564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd95226c3b5044921b6f7c03b6333d4b9', 'request_id': 'req-31867ef9-3083-409f-a871-ad3a76670e16'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.270130 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3028/5984] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:04:08 2021] DELETE /identity/v3/domains/d95226c3b5044921b6f7c03b6333d4b9 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:09.275294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01efd1-9dde-49b8-93a8-adf9617a86b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:09.277495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ce01efd1-9dde-49b8-93a8-adf9617a86b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:09.297889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01efd1-9dde-49b8-93a8-adf9617a86b2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:09.389328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504d88b-6d1c-4fcb-a114-5d4631125b91 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:09.390417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504d88b-6d1c-4fcb-a114-5d4631125b91 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:09.390909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504d88b-6d1c-4fcb-a114-5d4631125b91 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:09.391389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504d88b-6d1c-4fcb-a114-5d4631125b91 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/0772371eee26427dae8ba84e9dff6814/users/0a85d8d2aead4e47b14f5215c4e88073/roles/b9d03f8c0e6e45e79f1e2b612711c811` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:09.394076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504d88b-6d1c-4fcb-a114-5d4631125b91 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0772371eee26427dae8ba84e9dff6814, user_id=0a85d8d2aead4e47b14f5215c4e88073, role_id=b9d03f8c0e6e45e79f1e2b612711c811)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:09.397494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504d88b-6d1c-4fcb-a114-5d4631125b91 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:09.406856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1504d88b-6d1c-4fcb-a114-5d4631125b91 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invalidating the token cache because role b9d03f8c0e6e45e79f1e2b612711c811 was removed from user 0a85d8d2aead4e47b14f5215c4e88073 on domain 0772371eee26427dae8ba84e9dff6814. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:09.407747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1504d88b-6d1c-4fcb-a114-5d4631125b91 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.408699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1504d88b-6d1c-4fcb-a114-5d4631125b91 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.435444 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2957/5985] 10.222.0.13 () {58 vars in 1463 bytes} [Sat Dec 18 21:04:09 2021] DELETE /identity/v3/domains/0772371eee26427dae8ba84e9dff6814/users/0a85d8d2aead4e47b14f5215c4e88073/roles/b9d03f8c0e6e45e79f1e2b612711c811 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:04:09.439482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:09.441192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:09.476394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31867ef9-3083-409f-a871-ad3a76670e16 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:09.622395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe80de4-c55c-4f54-8b28-9df2892f6233 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:09.624430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe80de4-c55c-4f54-8b28-9df2892f6233 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:09.624720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe80de4-c55c-4f54-8b28-9df2892f6233 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:09.625858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe80de4-c55c-4f54-8b28-9df2892f6233 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/roles/b9d03f8c0e6e45e79f1e2b612711c811` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:09.628981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe80de4-c55c-4f54-8b28-9df2892f6233 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b9d03f8c0e6e45e79f1e2b612711c811)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:09.631809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe80de4-c55c-4f54-8b28-9df2892f6233 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:09.728155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fbe80de4-c55c-4f54-8b28-9df2892f6233 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invalidating the token cache because role b9d03f8c0e6e45e79f1e2b612711c811 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:09.728615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fbe80de4-c55c-4f54-8b28-9df2892f6233 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.730320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fbe80de4-c55c-4f54-8b28-9df2892f6233 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.746217 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3029/5986] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:09 2021] DELETE /identity/v3/roles/b9d03f8c0e6e45e79f1e2b612711c811 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:04:09.750377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504d88b-6d1c-4fcb-a114-5d4631125b91 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:09.751845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1504d88b-6d1c-4fcb-a114-5d4631125b91 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:09.765597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504d88b-6d1c-4fcb-a114-5d4631125b91 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:09.872443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ecd60-58c9-468c-a472-99db1777bb31 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:09.873338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ecd60-58c9-468c-a472-99db1777bb31 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:09.873631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ecd60-58c9-468c-a472-99db1777bb31 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:09.873915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ecd60-58c9-468c-a472-99db1777bb31 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/0772371eee26427dae8ba84e9dff6814` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:09.876149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ecd60-58c9-468c-a472-99db1777bb31 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0772371eee26427dae8ba84e9dff6814)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:09.878782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ecd60-58c9-468c-a472-99db1777bb31 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:09.903948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-385ecd60-58c9-468c-a472-99db1777bb31 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0772371eee26427dae8ba84e9dff6814'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.905229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-385ecd60-58c9-468c-a472-99db1777bb31 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0772371eee26427dae8ba84e9dff6814'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.940408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-385ecd60-58c9-468c-a472-99db1777bb31 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0772371eee26427dae8ba84e9dff6814'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.941298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-385ecd60-58c9-468c-a472-99db1777bb31 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0772371eee26427dae8ba84e9dff6814'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:09.946139 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2958/5987] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:04:09 2021] PATCH /identity/v3/domains/0772371eee26427dae8ba84e9dff6814 => generated 278 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:04:09.950006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe80de4-c55c-4f54-8b28-9df2892f6233 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:09.951710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fbe80de4-c55c-4f54-8b28-9df2892f6233 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:09.983813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe80de4-c55c-4f54-8b28-9df2892f6233 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:10.125570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:10.126682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:10.127080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:10.127465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/0772371eee26427dae8ba84e9dff6814` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:10.142470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0772371eee26427dae8ba84e9dff6814)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:10.144521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:10.172846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0772371eee26427dae8ba84e9dff6814'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:10.178073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0772371eee26427dae8ba84e9dff6814'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:10.249569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0772371eee26427dae8ba84e9dff6814', 'request_id': 'req-10ccc867-60ab-4e88-9cec-5fadf1245702'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:10.259074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0772371eee26427dae8ba84e9dff6814', 'request_id': 'req-10ccc867-60ab-4e88-9cec-5fadf1245702'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:10.273459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0772371eee26427dae8ba84e9dff6814', 'request_id': 'req-10ccc867-60ab-4e88-9cec-5fadf1245702'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:10.291493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] The token cache is being invalidate because project 0772371eee26427dae8ba84e9dff6814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:10.291832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:10.293037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:10.311416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0772371eee26427dae8ba84e9dff6814', 'request_id': 'req-10ccc867-60ab-4e88-9cec-5fadf1245702'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:10.327318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0772371eee26427dae8ba84e9dff6814', 'request_id': 'req-10ccc867-60ab-4e88-9cec-5fadf1245702'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:10.328915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0772371eee26427dae8ba84e9dff6814', 'request_id': 'req-10ccc867-60ab-4e88-9cec-5fadf1245702'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:10.360281 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3030/5988] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:04:09 2021] DELETE /identity/v3/domains/0772371eee26427dae8ba84e9dff6814 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:10.368704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ecd60-58c9-468c-a472-99db1777bb31 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:10.371721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-385ecd60-58c9-468c-a472-99db1777bb31 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:10.438003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ecd60-58c9-468c-a472-99db1777bb31 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:10.603744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896400d-0166-41ad-8034-d3a178689ca1 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:10.604440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896400d-0166-41ad-8034-d3a178689ca1 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:10.604739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896400d-0166-41ad-8034-d3a178689ca1 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:10.605030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896400d-0166-41ad-8034-d3a178689ca1 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:10.605944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896400d-0166-41ad-8034-d3a178689ca1 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:10.607932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896400d-0166-41ad-8034-d3a178689ca1 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:10.623566 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2959/5989] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:10 2021] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:10.625036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:10.626543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:10.641381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccc867-60ab-4e88-9cec-5fadf1245702 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:10.653882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ba730-26c5-4dc1-a2c1-83a30fdcf3a2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:10.655031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ba730-26c5-4dc1-a2c1-83a30fdcf3a2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:10.656664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ba730-26c5-4dc1-a2c1-83a30fdcf3a2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:10.657060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ba730-26c5-4dc1-a2c1-83a30fdcf3a2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/projects/0be5fc4b78af42f590c93cb522566c73/users/7e0c576a62814be6a556c959402ebcb2/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:10.660542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ba730-26c5-4dc1-a2c1-83a30fdcf3a2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0be5fc4b78af42f590c93cb522566c73, user_id=7e0c576a62814be6a556c959402ebcb2, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:10.664265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ba730-26c5-4dc1-a2c1-83a30fdcf3a2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:10.690270 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3031/5990] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:10 2021] PUT /identity/v3/projects/0be5fc4b78af42f590c93cb522566c73/users/7e0c576a62814be6a556c959402ebcb2/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:10.695213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896400d-0166-41ad-8034-d3a178689ca1 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:10.719031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896400d-0166-41ad-8034-d3a178689ca1 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:10.833008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a67c4e-2eea-4035-9018-decb1697e0bf tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:10.833008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a67c4e-2eea-4035-9018-decb1697e0bf tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:10.833008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a67c4e-2eea-4035-9018-decb1697e0bf tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:10.833469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a67c4e-2eea-4035-9018-decb1697e0bf tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:10.833469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a67c4e-2eea-4035-9018-decb1697e0bf tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:10.834128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a67c4e-2eea-4035-9018-decb1697e0bf tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:10.922226 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2960/5991] 10.222.0.13 () {58 vars in 1145 bytes} [Sat Dec 18 21:04:10 2021] GET /identity/v3/auth/projects => generated 826 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:04:10.926406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ba730-26c5-4dc1-a2c1-83a30fdcf3a2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:10.945833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ba730-26c5-4dc1-a2c1-83a30fdcf3a2 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:10.957210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6aad5-71db-4dec-a959-7c08b0c5dfe5 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:10.959478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6aad5-71db-4dec-a959-7c08b0c5dfe5 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:10.959985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6aad5-71db-4dec-a959-7c08b0c5dfe5 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:10.960593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6aad5-71db-4dec-a959-7c08b0c5dfe5 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/projects/0be5fc4b78af42f590c93cb522566c73/users/7e0c576a62814be6a556c959402ebcb2/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:10.964983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6aad5-71db-4dec-a959-7c08b0c5dfe5 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=0be5fc4b78af42f590c93cb522566c73, user_id=7e0c576a62814be6a556c959402ebcb2, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:10.969108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6aad5-71db-4dec-a959-7c08b0c5dfe5 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:10.979282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6fa6aad5-71db-4dec-a959-7c08b0c5dfe5 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invalidating the token cache because role 422f56dd2e5b4c57a3e3decac47f893e was removed from user 7e0c576a62814be6a556c959402ebcb2 on project 0be5fc4b78af42f590c93cb522566c73. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:10.979964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6fa6aad5-71db-4dec-a959-7c08b0c5dfe5 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:10.981123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6fa6aad5-71db-4dec-a959-7c08b0c5dfe5 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:11.000772 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3032/5992] 10.222.0.13 () {58 vars in 1466 bytes} [Sat Dec 18 21:04:10 2021] DELETE /identity/v3/projects/0be5fc4b78af42f590c93cb522566c73/users/7e0c576a62814be6a556c959402ebcb2/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:04:11.006710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a67c4e-2eea-4035-9018-decb1697e0bf tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:11.009301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c9a67c4e-2eea-4035-9018-decb1697e0bf tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:11.033244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a67c4e-2eea-4035-9018-decb1697e0bf tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:11.116319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647d61e-b2a8-4f45-8c21-5361d0d8c966 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:11.117928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647d61e-b2a8-4f45-8c21-5361d0d8c966 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:11.118214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647d61e-b2a8-4f45-8c21-5361d0d8c966 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:11.118559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647d61e-b2a8-4f45-8c21-5361d0d8c966 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:11.119297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647d61e-b2a8-4f45-8c21-5361d0d8c966 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:11.121905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647d61e-b2a8-4f45-8c21-5361d0d8c966 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:11.148635 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2961/5993] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:04:11 2021] POST /identity/v3/users => generated 321 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:11.152584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6aad5-71db-4dec-a959-7c08b0c5dfe5 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:11.165344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6aad5-71db-4dec-a959-7c08b0c5dfe5 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:11.170929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1536e7-04e2-4a62-81ba-7275bc3a494f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:11.177653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1536e7-04e2-4a62-81ba-7275bc3a494f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:11.178054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1536e7-04e2-4a62-81ba-7275bc3a494f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:11.178820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1536e7-04e2-4a62-81ba-7275bc3a494f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:11.179541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1536e7-04e2-4a62-81ba-7275bc3a494f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:11.188395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1536e7-04e2-4a62-81ba-7275bc3a494f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:11.244112 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3033/5994] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:04:11 2021] POST /identity/v3/projects => generated 362 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:11.247388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647d61e-b2a8-4f45-8c21-5361d0d8c966 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:11.261856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647d61e-b2a8-4f45-8c21-5361d0d8c966 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:11.350759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddda8b-0ee7-4974-9a28-5ad73a113984 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:11.351901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddda8b-0ee7-4974-9a28-5ad73a113984 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:11.353297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddda8b-0ee7-4974-9a28-5ad73a113984 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:11.353943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddda8b-0ee7-4974-9a28-5ad73a113984 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:11.357320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddda8b-0ee7-4974-9a28-5ad73a113984 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:11.362968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddda8b-0ee7-4974-9a28-5ad73a113984 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:11.409107 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2962/5995] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:04:11 2021] POST /identity/v3/projects => generated 362 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:11.413938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1536e7-04e2-4a62-81ba-7275bc3a494f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:11.434944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1536e7-04e2-4a62-81ba-7275bc3a494f tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:11.511799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a0c50-efdb-47f3-991d-e520f046a90a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:11.512753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a0c50-efdb-47f3-991d-e520f046a90a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:11.513078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a0c50-efdb-47f3-991d-e520f046a90a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:11.513484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a0c50-efdb-47f3-991d-e520f046a90a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:11.514357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a0c50-efdb-47f3-991d-e520f046a90a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:11.517688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a0c50-efdb-47f3-991d-e520f046a90a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:11.548072 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3034/5996] 10.222.0.13 () {60 vars in 1142 bytes} [Sat Dec 18 21:04:11 2021] POST /identity/v3/roles => generated 239 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:04:11.554535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddda8b-0ee7-4974-9a28-5ad73a113984 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:11.577177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddda8b-0ee7-4974-9a28-5ad73a113984 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:11.589559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcd000-c65b-418c-b609-732d4767c1cd tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:11.590896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcd000-c65b-418c-b609-732d4767c1cd tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:11.591248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcd000-c65b-418c-b609-732d4767c1cd tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:11.591537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcd000-c65b-418c-b609-732d4767c1cd tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/projects/d45065664f8c4ef7871a302147c71d36/users/3cba7c78d23546549b98d02ed7989f26/roles/1b86dc816c0c414b8d84e1e8b5bfba2d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:11.629088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcd000-c65b-418c-b609-732d4767c1cd tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d45065664f8c4ef7871a302147c71d36, user_id=3cba7c78d23546549b98d02ed7989f26, role_id=1b86dc816c0c414b8d84e1e8b5bfba2d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:11.636029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcd000-c65b-418c-b609-732d4767c1cd tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:11.662202 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2963/5997] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:11 2021] PUT /identity/v3/projects/d45065664f8c4ef7871a302147c71d36/users/3cba7c78d23546549b98d02ed7989f26/roles/1b86dc816c0c414b8d84e1e8b5bfba2d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:11.666395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a0c50-efdb-47f3-991d-e520f046a90a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:11.686115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a0c50-efdb-47f3-991d-e520f046a90a tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:11.838084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ab132-107c-48eb-82d4-57752a118c78 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:11.839879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ab132-107c-48eb-82d4-57752a118c78 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:11.840833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ab132-107c-48eb-82d4-57752a118c78 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:11.841224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ab132-107c-48eb-82d4-57752a118c78 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/projects/3d6fdf75cce146758ee61afd78f087bc/users/3cba7c78d23546549b98d02ed7989f26/roles/1b86dc816c0c414b8d84e1e8b5bfba2d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:11.844972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ab132-107c-48eb-82d4-57752a118c78 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3d6fdf75cce146758ee61afd78f087bc, user_id=3cba7c78d23546549b98d02ed7989f26, role_id=1b86dc816c0c414b8d84e1e8b5bfba2d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:11.854793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ab132-107c-48eb-82d4-57752a118c78 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:11.886849 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3035/5998] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:11 2021] PUT /identity/v3/projects/3d6fdf75cce146758ee61afd78f087bc/users/3cba7c78d23546549b98d02ed7989f26/roles/1b86dc816c0c414b8d84e1e8b5bfba2d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:11.888111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82355b-96c1-4686-92eb-3a714f5fa408 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:11.888408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82355b-96c1-4686-92eb-3a714f5fa408 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:11.888709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82355b-96c1-4686-92eb-3a714f5fa408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:11.944346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5e82355b-96c1-4686-92eb-3a714f5fa408 None None] MFA Rules not processed for user `3cba7c78d23546549b98d02ed7989f26`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:11.946205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5e82355b-96c1-4686-92eb-3a714f5fa408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:11.962169 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2964/5999] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:11 2021] POST /identity/v3/auth/tokens => generated 334 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Dec 18 21:04:11.967466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c85ea-2c2b-40b7-9524-dee05b519e54 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:11.968342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c85ea-2c2b-40b7-9524-dee05b519e54 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:11.968993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c85ea-2c2b-40b7-9524-dee05b519e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:11.981224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6d4c85ea-2c2b-40b7-9524-dee05b519e54 None None] MFA Rules not processed for user `3cba7c78d23546549b98d02ed7989f26`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:11.983236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6d4c85ea-2c2b-40b7-9524-dee05b519e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:12.127692 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3036/6000] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:11 2021] POST /identity/v3/auth/tokens => generated 3213 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Dec 18 21:04:12.129432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82355b-96c1-4686-92eb-3a714f5fa408 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:12.255051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82355b-96c1-4686-92eb-3a714f5fa408 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:12.265562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbd728-6a68-4639-8abe-5d05bc9679ae tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:12.266785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbd728-6a68-4639-8abe-5d05bc9679ae tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:12.267531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbd728-6a68-4639-8abe-5d05bc9679ae tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:12.268050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbd728-6a68-4639-8abe-5d05bc9679ae tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:12.285629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbd728-6a68-4639-8abe-5d05bc9679ae tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:12.290483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbd728-6a68-4639-8abe-5d05bc9679ae tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:12.325703 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2965/6001] 10.222.0.13 () {56 vars in 1307 bytes} [Sat Dec 18 21:04:12 2021] DELETE /identity/v3/auth/tokens => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:12.329646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa826a1-ff39-4af5-8026-d8e8043b858e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:12.329928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa826a1-ff39-4af5-8026-d8e8043b858e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:12.330242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa826a1-ff39-4af5-8026-d8e8043b858e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:12.346921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-aaa826a1-ff39-4af5-8026-d8e8043b858e None None] MFA Rules not processed for user `3cba7c78d23546549b98d02ed7989f26`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:12.348103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-aaa826a1-ff39-4af5-8026-d8e8043b858e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:12.578658 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3037/6002] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:12 2021] POST /identity/v3/auth/tokens => generated 3213 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Dec 18 21:04:12.582274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbd728-6a68-4639-8abe-5d05bc9679ae tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:12.598966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbd728-6a68-4639-8abe-5d05bc9679ae tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:12.622852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e990d-6e74-47a2-83cc-00f9ca26fc6c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:12.623817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e990d-6e74-47a2-83cc-00f9ca26fc6c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:12.624178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e990d-6e74-47a2-83cc-00f9ca26fc6c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:12.624459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e990d-6e74-47a2-83cc-00f9ca26fc6c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/roles/1b86dc816c0c414b8d84e1e8b5bfba2d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:12.636813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e990d-6e74-47a2-83cc-00f9ca26fc6c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1b86dc816c0c414b8d84e1e8b5bfba2d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:12.640599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e990d-6e74-47a2-83cc-00f9ca26fc6c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:12.757199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b13e990d-6e74-47a2-83cc-00f9ca26fc6c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invalidating the token cache because role 1b86dc816c0c414b8d84e1e8b5bfba2d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:12.757561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b13e990d-6e74-47a2-83cc-00f9ca26fc6c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:12.759635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b13e990d-6e74-47a2-83cc-00f9ca26fc6c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:12.764779 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2966/6003] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:12 2021] DELETE /identity/v3/roles/1b86dc816c0c414b8d84e1e8b5bfba2d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:12.769496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa826a1-ff39-4af5-8026-d8e8043b858e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:12.793211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa826a1-ff39-4af5-8026-d8e8043b858e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:13.005129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d6646-1161-4864-8ec3-68247fd321de tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:13.006060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d6646-1161-4864-8ec3-68247fd321de tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:13.009354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d6646-1161-4864-8ec3-68247fd321de tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:13.010334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d6646-1161-4864-8ec3-68247fd321de tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/projects/3d6fdf75cce146758ee61afd78f087bc` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:13.011859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d6646-1161-4864-8ec3-68247fd321de tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3d6fdf75cce146758ee61afd78f087bc)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:13.016103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d6646-1161-4864-8ec3-68247fd321de tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:13.140201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf8d6646-1161-4864-8ec3-68247fd321de tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d6fdf75cce146758ee61afd78f087bc', 'request_id': 'req-bf8d6646-1161-4864-8ec3-68247fd321de'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:13.152601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf8d6646-1161-4864-8ec3-68247fd321de tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d6fdf75cce146758ee61afd78f087bc', 'request_id': 'req-bf8d6646-1161-4864-8ec3-68247fd321de'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:13.186646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf8d6646-1161-4864-8ec3-68247fd321de tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d6fdf75cce146758ee61afd78f087bc', 'request_id': 'req-bf8d6646-1161-4864-8ec3-68247fd321de'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:13.221684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf8d6646-1161-4864-8ec3-68247fd321de tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] The token cache is being invalidate because project 3d6fdf75cce146758ee61afd78f087bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:13.222097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf8d6646-1161-4864-8ec3-68247fd321de tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:13.223320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf8d6646-1161-4864-8ec3-68247fd321de tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:13.229313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e990d-6e74-47a2-83cc-00f9ca26fc6c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:13.230383 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3038/6004] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:04:12 2021] DELETE /identity/v3/projects/3d6fdf75cce146758ee61afd78f087bc => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:13.231465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b13e990d-6e74-47a2-83cc-00f9ca26fc6c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:13.255076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e990d-6e74-47a2-83cc-00f9ca26fc6c tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:13.423377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba85201-eded-4cae-9603-32e8a3960a46 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:13.424699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba85201-eded-4cae-9603-32e8a3960a46 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:13.425189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba85201-eded-4cae-9603-32e8a3960a46 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:13.426755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba85201-eded-4cae-9603-32e8a3960a46 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/projects/3d6fdf75cce146758ee61afd78f087bc` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:13.449108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba85201-eded-4cae-9603-32e8a3960a46 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3d6fdf75cce146758ee61afd78f087bc)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:13.453264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba85201-eded-4cae-9603-32e8a3960a46 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:13.493994 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-3ba85201-eded-4cae-9603-32e8a3960a46 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Could not find project: 3d6fdf75cce146758ee61afd78f087bc.: keystone.exception.ProjectNotFound: Could not find project: 3d6fdf75cce146758ee61afd78f087bc. Dec 18 21:04:13.495510 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2967/6005] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:04:13 2021] DELETE /identity/v3/projects/3d6fdf75cce146758ee61afd78f087bc => generated 113 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 18 21:04:13.499939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d6646-1161-4864-8ec3-68247fd321de tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:13.502376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bf8d6646-1161-4864-8ec3-68247fd321de tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:13.556380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d6646-1161-4864-8ec3-68247fd321de tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:13.574627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2288a9b-b283-46c2-8cee-2f80609e9bd6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:13.575891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2288a9b-b283-46c2-8cee-2f80609e9bd6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:13.578892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2288a9b-b283-46c2-8cee-2f80609e9bd6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:13.579348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2288a9b-b283-46c2-8cee-2f80609e9bd6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/projects/d45065664f8c4ef7871a302147c71d36` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:13.585863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2288a9b-b283-46c2-8cee-2f80609e9bd6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d45065664f8c4ef7871a302147c71d36)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:13.588067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2288a9b-b283-46c2-8cee-2f80609e9bd6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:13.696729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e2288a9b-b283-46c2-8cee-2f80609e9bd6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd45065664f8c4ef7871a302147c71d36', 'request_id': 'req-e2288a9b-b283-46c2-8cee-2f80609e9bd6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:13.706525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e2288a9b-b283-46c2-8cee-2f80609e9bd6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd45065664f8c4ef7871a302147c71d36', 'request_id': 'req-e2288a9b-b283-46c2-8cee-2f80609e9bd6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:13.723722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e2288a9b-b283-46c2-8cee-2f80609e9bd6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd45065664f8c4ef7871a302147c71d36', 'request_id': 'req-e2288a9b-b283-46c2-8cee-2f80609e9bd6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:13.765087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e2288a9b-b283-46c2-8cee-2f80609e9bd6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] The token cache is being invalidate because project d45065664f8c4ef7871a302147c71d36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:13.765402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e2288a9b-b283-46c2-8cee-2f80609e9bd6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:13.767556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e2288a9b-b283-46c2-8cee-2f80609e9bd6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:13.769736 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3039/6006] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:04:13 2021] DELETE /identity/v3/projects/d45065664f8c4ef7871a302147c71d36 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:04:13.777545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba85201-eded-4cae-9603-32e8a3960a46 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:13.780981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3ba85201-eded-4cae-9603-32e8a3960a46 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:13.806002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba85201-eded-4cae-9603-32e8a3960a46 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:13.973567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9aaf8a-4871-416b-9f26-d04c2afc2eb4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:13.974527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9aaf8a-4871-416b-9f26-d04c2afc2eb4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:13.975617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9aaf8a-4871-416b-9f26-d04c2afc2eb4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:13.975816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9aaf8a-4871-416b-9f26-d04c2afc2eb4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/users/3cba7c78d23546549b98d02ed7989f26` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:13.978189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9aaf8a-4871-416b-9f26-d04c2afc2eb4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3cba7c78d23546549b98d02ed7989f26)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:13.984092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9aaf8a-4871-416b-9f26-d04c2afc2eb4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:14.095204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2f9aaf8a-4871-416b-9f26-d04c2afc2eb4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cba7c78d23546549b98d02ed7989f26'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:14.119873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2f9aaf8a-4871-416b-9f26-d04c2afc2eb4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cba7c78d23546549b98d02ed7989f26'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:14.144194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2f9aaf8a-4871-416b-9f26-d04c2afc2eb4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cba7c78d23546549b98d02ed7989f26'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:14.144952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2f9aaf8a-4871-416b-9f26-d04c2afc2eb4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cba7c78d23546549b98d02ed7989f26'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:14.163352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2f9aaf8a-4871-416b-9f26-d04c2afc2eb4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cba7c78d23546549b98d02ed7989f26'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:14.183002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2288a9b-b283-46c2-8cee-2f80609e9bd6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:14.183589 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2968/6007] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:13 2021] DELETE /identity/v3/users/3cba7c78d23546549b98d02ed7989f26 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:14.200058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2288a9b-b283-46c2-8cee-2f80609e9bd6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:14.395354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5fe0c-24de-45e2-9b57-7812bf3dfd7e tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:14.398132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5fe0c-24de-45e2-9b57-7812bf3dfd7e tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:14.398792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5fe0c-24de-45e2-9b57-7812bf3dfd7e tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:14.398792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5fe0c-24de-45e2-9b57-7812bf3dfd7e tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/48553605f3bd49579b39c4440674a358` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:14.412653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5fe0c-24de-45e2-9b57-7812bf3dfd7e tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:04:14.422910 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-3fa5fe0c-24de-45e2-9b57-7812bf3dfd7e tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Could not find domain: 48553605f3bd49579b39c4440674a358.: keystone.exception.DomainNotFound: Could not find domain: 48553605f3bd49579b39c4440674a358. Dec 18 21:04:14.431606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9aaf8a-4871-416b-9f26-d04c2afc2eb4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:14.433749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2f9aaf8a-4871-416b-9f26-d04c2afc2eb4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:14.440117 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3040/6008] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:04:14 2021] PATCH /identity/v3/domains/48553605f3bd49579b39c4440674a358 => generated 112 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:04:14.452068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9aaf8a-4871-416b-9f26-d04c2afc2eb4 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:14.458538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f72930-cc3a-431f-a241-bb289dba17c6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:14.459681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f72930-cc3a-431f-a241-bb289dba17c6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:14.460159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f72930-cc3a-431f-a241-bb289dba17c6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:14.460599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f72930-cc3a-431f-a241-bb289dba17c6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/fbe97574489b4e71b62206f3488e78a2` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:14.472494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f72930-cc3a-431f-a241-bb289dba17c6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:04:14.483219 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-a4f72930-cc3a-431f-a241-bb289dba17c6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Could not find domain: fbe97574489b4e71b62206f3488e78a2.: keystone.exception.DomainNotFound: Could not find domain: fbe97574489b4e71b62206f3488e78a2. Dec 18 21:04:14.489243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5fe0c-24de-45e2-9b57-7812bf3dfd7e tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:14.501314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5fe0c-24de-45e2-9b57-7812bf3dfd7e tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:14.501940 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2969/6009] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:04:14 2021] PATCH /identity/v3/domains/fbe97574489b4e71b62206f3488e78a2 => generated 112 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:04:14.509893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24114e3-f4f9-42cf-b9b9-9d47dd9aef66 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:14.511308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24114e3-f4f9-42cf-b9b9-9d47dd9aef66 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:14.512140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24114e3-f4f9-42cf-b9b9-9d47dd9aef66 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:14.512610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24114e3-f4f9-42cf-b9b9-9d47dd9aef66 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/d95226c3b5044921b6f7c03b6333d4b9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:14.523583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24114e3-f4f9-42cf-b9b9-9d47dd9aef66 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:04:14.542976 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-b24114e3-f4f9-42cf-b9b9-9d47dd9aef66 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Could not find domain: d95226c3b5044921b6f7c03b6333d4b9.: keystone.exception.DomainNotFound: Could not find domain: d95226c3b5044921b6f7c03b6333d4b9. Dec 18 21:04:14.548690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f72930-cc3a-431f-a241-bb289dba17c6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:14.562530 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3041/6010] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:04:14 2021] PATCH /identity/v3/domains/d95226c3b5044921b6f7c03b6333d4b9 => generated 112 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:04:14.564729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f72930-cc3a-431f-a241-bb289dba17c6 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:14.576138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b07492-d6ad-4ac9-a2b4-b4b7e38187b8 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0c576a62814be6a556c959402ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f23331b912248c5b965584a6ed47838', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:14.578141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b07492-d6ad-4ac9-a2b4-b4b7e38187b8 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:14.578609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b07492-d6ad-4ac9-a2b4-b4b7e38187b8 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:14.578902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b07492-d6ad-4ac9-a2b4-b4b7e38187b8 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] PATH_INFO: `/v3/domains/0772371eee26427dae8ba84e9dff6814` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:14.605593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b07492-d6ad-4ac9-a2b4-b4b7e38187b8 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:04:14.627634 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-a7b07492-d6ad-4ac9-a2b4-b4b7e38187b8 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Could not find domain: 0772371eee26427dae8ba84e9dff6814.: keystone.exception.DomainNotFound: Could not find domain: 0772371eee26427dae8ba84e9dff6814. Dec 18 21:04:14.635239 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2970/6011] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:04:14 2021] PATCH /identity/v3/domains/0772371eee26427dae8ba84e9dff6814 => generated 112 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:04:14.640035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24114e3-f4f9-42cf-b9b9-9d47dd9aef66 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:14.641911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b24114e3-f4f9-42cf-b9b9-9d47dd9aef66 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:14.742987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24114e3-f4f9-42cf-b9b9-9d47dd9aef66 tempest-TokensV3TestJSON-454616761 tempest-TokensV3TestJSON-454616761-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:14.758078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ae5de-84b9-44cf-9646-927190be19ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:14.759024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ae5de-84b9-44cf-9646-927190be19ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:14.759314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ae5de-84b9-44cf-9646-927190be19ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:14.760660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ae5de-84b9-44cf-9646-927190be19ae admin admin] PATH_INFO: `/v3/users/780f6512450249e68f772a0f3991b091` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:14.764106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ae5de-84b9-44cf-9646-927190be19ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=780f6512450249e68f772a0f3991b091)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:14.767073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ae5de-84b9-44cf-9646-927190be19ae admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:14.864221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3b4ae5de-84b9-44cf-9646-927190be19ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '780f6512450249e68f772a0f3991b091'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:14.876051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3b4ae5de-84b9-44cf-9646-927190be19ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '780f6512450249e68f772a0f3991b091'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:14.877164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3b4ae5de-84b9-44cf-9646-927190be19ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '780f6512450249e68f772a0f3991b091'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:14.896527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3b4ae5de-84b9-44cf-9646-927190be19ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '780f6512450249e68f772a0f3991b091'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:14.914344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3b4ae5de-84b9-44cf-9646-927190be19ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '780f6512450249e68f772a0f3991b091'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:14.924022 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3042/6012] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:14 2021] DELETE /identity/v3/users/780f6512450249e68f772a0f3991b091 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:14.929119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5265a74-69b9-4828-a6ed-e79a737f4a43 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:14.929950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5265a74-69b9-4828-a6ed-e79a737f4a43 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:14.931124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5265a74-69b9-4828-a6ed-e79a737f4a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:14.952332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f5265a74-69b9-4828-a6ed-e79a737f4a43 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:14.954519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f5265a74-69b9-4828-a6ed-e79a737f4a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:15.041315 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2971/6013] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:15.052726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ae5de-84b9-44cf-9646-927190be19ae admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:15.055536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3b4ae5de-84b9-44cf-9646-927190be19ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:15.150096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ae5de-84b9-44cf-9646-927190be19ae admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:15.155151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095dace-8a2f-4551-9e8f-e73b6d58f30b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:15.155821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095dace-8a2f-4551-9e8f-e73b6d58f30b service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:15.156114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095dace-8a2f-4551-9e8f-e73b6d58f30b service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:15.156391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095dace-8a2f-4551-9e8f-e73b6d58f30b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:15.169598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095dace-8a2f-4551-9e8f-e73b6d58f30b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:15.171306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095dace-8a2f-4551-9e8f-e73b6d58f30b service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:15.194805 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3043/6014] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:04:15.956944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5265a74-69b9-4828-a6ed-e79a737f4a43 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:15.959103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f5265a74-69b9-4828-a6ed-e79a737f4a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:15.976249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5265a74-69b9-4828-a6ed-e79a737f4a43 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:15.993858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a246b4-8336-40b4-bac2-d41e68f176ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:15.996601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a246b4-8336-40b4-bac2-d41e68f176ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:15.997199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a246b4-8336-40b4-bac2-d41e68f176ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:15.997923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a246b4-8336-40b4-bac2-d41e68f176ca admin admin] PATH_INFO: `/v3/projects/0be5fc4b78af42f590c93cb522566c73` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:16.000934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a246b4-8336-40b4-bac2-d41e68f176ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be5fc4b78af42f590c93cb522566c73)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:16.004904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a246b4-8336-40b4-bac2-d41e68f176ca admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:16.156335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-55a246b4-8336-40b4-bac2-d41e68f176ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be5fc4b78af42f590c93cb522566c73', 'request_id': 'req-55a246b4-8336-40b4-bac2-d41e68f176ca'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:16.165932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-55a246b4-8336-40b4-bac2-d41e68f176ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be5fc4b78af42f590c93cb522566c73', 'request_id': 'req-55a246b4-8336-40b4-bac2-d41e68f176ca'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:16.193466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-55a246b4-8336-40b4-bac2-d41e68f176ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be5fc4b78af42f590c93cb522566c73', 'request_id': 'req-55a246b4-8336-40b4-bac2-d41e68f176ca'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:16.234866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-55a246b4-8336-40b4-bac2-d41e68f176ca admin admin] The token cache is being invalidate because project 0be5fc4b78af42f590c93cb522566c73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:16.235424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-55a246b4-8336-40b4-bac2-d41e68f176ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:16.236467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-55a246b4-8336-40b4-bac2-d41e68f176ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:16.243090 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2972/6015] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:04:15 2021] DELETE /identity/v3/projects/0be5fc4b78af42f590c93cb522566c73 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:16.243529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095dace-8a2f-4551-9e8f-e73b6d58f30b service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:16.254950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095dace-8a2f-4551-9e8f-e73b6d58f30b service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:16.402767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86451a-7514-4110-84c7-8d39576f9924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:16.403897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86451a-7514-4110-84c7-8d39576f9924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:16.404193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86451a-7514-4110-84c7-8d39576f9924 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:16.404575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86451a-7514-4110-84c7-8d39576f9924 admin admin] PATH_INFO: `/v3/users/7e0c576a62814be6a556c959402ebcb2` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:16.407634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86451a-7514-4110-84c7-8d39576f9924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e0c576a62814be6a556c959402ebcb2)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:16.409783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86451a-7514-4110-84c7-8d39576f9924 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:16.489032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ef86451a-7514-4110-84c7-8d39576f9924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e0c576a62814be6a556c959402ebcb2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:16.500281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ef86451a-7514-4110-84c7-8d39576f9924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e0c576a62814be6a556c959402ebcb2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:16.501908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ef86451a-7514-4110-84c7-8d39576f9924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e0c576a62814be6a556c959402ebcb2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:16.518357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ef86451a-7514-4110-84c7-8d39576f9924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e0c576a62814be6a556c959402ebcb2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:16.535123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ef86451a-7514-4110-84c7-8d39576f9924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e0c576a62814be6a556c959402ebcb2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:16.553354 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3044/6016] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:16 2021] DELETE /identity/v3/users/7e0c576a62814be6a556c959402ebcb2 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:17.388527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a246b4-8336-40b4-bac2-d41e68f176ca admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:17.391616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-55a246b4-8336-40b4-bac2-d41e68f176ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:17.461096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a246b4-8336-40b4-bac2-d41e68f176ca admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:17.612464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc141a-a762-4f75-8b8d-9d340435d238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:17.613289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc141a-a762-4f75-8b8d-9d340435d238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:17.613860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc141a-a762-4f75-8b8d-9d340435d238 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:17.614184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc141a-a762-4f75-8b8d-9d340435d238 admin admin] PATH_INFO: `/v3/projects/1f23331b912248c5b965584a6ed47838` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:17.623314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc141a-a762-4f75-8b8d-9d340435d238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f23331b912248c5b965584a6ed47838)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:17.626324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc141a-a762-4f75-8b8d-9d340435d238 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:17.730113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f5bc141a-a762-4f75-8b8d-9d340435d238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f23331b912248c5b965584a6ed47838', 'request_id': 'req-f5bc141a-a762-4f75-8b8d-9d340435d238'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:17.745488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f5bc141a-a762-4f75-8b8d-9d340435d238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f23331b912248c5b965584a6ed47838', 'request_id': 'req-f5bc141a-a762-4f75-8b8d-9d340435d238'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:17.767408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f5bc141a-a762-4f75-8b8d-9d340435d238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f23331b912248c5b965584a6ed47838', 'request_id': 'req-f5bc141a-a762-4f75-8b8d-9d340435d238'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:17.800277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f5bc141a-a762-4f75-8b8d-9d340435d238 admin admin] The token cache is being invalidate because project 1f23331b912248c5b965584a6ed47838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:17.801082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f5bc141a-a762-4f75-8b8d-9d340435d238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:17.802029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f5bc141a-a762-4f75-8b8d-9d340435d238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:17.804692 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2973/6017] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:04:17 2021] DELETE /identity/v3/projects/1f23331b912248c5b965584a6ed47838 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:04:17.808376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86451a-7514-4110-84c7-8d39576f9924 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:17.811362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ef86451a-7514-4110-84c7-8d39576f9924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:17.846611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86451a-7514-4110-84c7-8d39576f9924 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:17.982312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d139cc-0ca2-42ed-a0a1-3a60feebb169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:17.983969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d139cc-0ca2-42ed-a0a1-3a60feebb169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:17.984269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d139cc-0ca2-42ed-a0a1-3a60feebb169 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:17.984554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d139cc-0ca2-42ed-a0a1-3a60feebb169 admin admin] PATH_INFO: `/v3/users/0a85d8d2aead4e47b14f5215c4e88073` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:17.986005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d139cc-0ca2-42ed-a0a1-3a60feebb169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a85d8d2aead4e47b14f5215c4e88073)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:17.989122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d139cc-0ca2-42ed-a0a1-3a60feebb169 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:18.103037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f9d139cc-0ca2-42ed-a0a1-3a60feebb169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a85d8d2aead4e47b14f5215c4e88073'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:18.121512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f9d139cc-0ca2-42ed-a0a1-3a60feebb169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a85d8d2aead4e47b14f5215c4e88073'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:18.124061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f9d139cc-0ca2-42ed-a0a1-3a60feebb169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a85d8d2aead4e47b14f5215c4e88073'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:18.156367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f9d139cc-0ca2-42ed-a0a1-3a60feebb169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a85d8d2aead4e47b14f5215c4e88073'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:18.178933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f9d139cc-0ca2-42ed-a0a1-3a60feebb169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a85d8d2aead4e47b14f5215c4e88073'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:18.190565 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3045/6018] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:17 2021] DELETE /identity/v3/users/0a85d8d2aead4e47b14f5215c4e88073 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:18.808305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc141a-a762-4f75-8b8d-9d340435d238 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:18.810645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f5bc141a-a762-4f75-8b8d-9d340435d238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:18.825405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc141a-a762-4f75-8b8d-9d340435d238 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:18.908160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff4107-76a5-4a5f-8b69-36f93baee1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:18.909226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff4107-76a5-4a5f-8b69-36f93baee1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:18.909750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff4107-76a5-4a5f-8b69-36f93baee1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:18.910096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff4107-76a5-4a5f-8b69-36f93baee1a7 admin admin] PATH_INFO: `/v3/projects/5d72caaccdd34f848a660bf4f9270474` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:18.911930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff4107-76a5-4a5f-8b69-36f93baee1a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d72caaccdd34f848a660bf4f9270474)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:18.916991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff4107-76a5-4a5f-8b69-36f93baee1a7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:18.994584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-57ff4107-76a5-4a5f-8b69-36f93baee1a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d72caaccdd34f848a660bf4f9270474', 'request_id': 'req-57ff4107-76a5-4a5f-8b69-36f93baee1a7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:19.003562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-57ff4107-76a5-4a5f-8b69-36f93baee1a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d72caaccdd34f848a660bf4f9270474', 'request_id': 'req-57ff4107-76a5-4a5f-8b69-36f93baee1a7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:19.013085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-57ff4107-76a5-4a5f-8b69-36f93baee1a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d72caaccdd34f848a660bf4f9270474', 'request_id': 'req-57ff4107-76a5-4a5f-8b69-36f93baee1a7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:19.032024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-57ff4107-76a5-4a5f-8b69-36f93baee1a7 admin admin] The token cache is being invalidate because project 5d72caaccdd34f848a660bf4f9270474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:19.032945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-57ff4107-76a5-4a5f-8b69-36f93baee1a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:19.033996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-57ff4107-76a5-4a5f-8b69-36f93baee1a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:19.036327 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2974/6019] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:04:18 2021] DELETE /identity/v3/projects/5d72caaccdd34f848a660bf4f9270474 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:19.045868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d0a4d-030c-4376-b089-0a0dd5c6915f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:19.046685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d0a4d-030c-4376-b089-0a0dd5c6915f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:19.046685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d0a4d-030c-4376-b089-0a0dd5c6915f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:19.070627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ca7d0a4d-030c-4376-b089-0a0dd5c6915f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:19.072168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ca7d0a4d-030c-4376-b089-0a0dd5c6915f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:19.150555 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3046/6020] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:19.160367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832f042-7a95-458c-bdaa-3f793f2d7806 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:19.160683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832f042-7a95-458c-bdaa-3f793f2d7806 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:19.160924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832f042-7a95-458c-bdaa-3f793f2d7806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:19.182740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8832f042-7a95-458c-bdaa-3f793f2d7806 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:19.184049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8832f042-7a95-458c-bdaa-3f793f2d7806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:19.194696 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2975/6021] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:19.199128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d0a4d-030c-4376-b089-0a0dd5c6915f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:19.210511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d0a4d-030c-4376-b089-0a0dd5c6915f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:19.217525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222c5f2-5bf9-4ea9-acbb-b4a72e104b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:19.218484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c5f2-5bf9-4ea9-acbb-b4a72e104b84 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:19.219010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c5f2-5bf9-4ea9-acbb-b4a72e104b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:19.221066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c5f2-5bf9-4ea9-acbb-b4a72e104b84 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:19.222101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222c5f2-5bf9-4ea9-acbb-b4a72e104b84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:04:19.222981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222c5f2-5bf9-4ea9-acbb-b4a72e104b84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:19.225423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222c5f2-5bf9-4ea9-acbb-b4a72e104b84 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:19.244682 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3047/6022] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:04:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:04:19.249307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832f042-7a95-458c-bdaa-3f793f2d7806 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:19.260963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832f042-7a95-458c-bdaa-3f793f2d7806 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:19.266568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8ebee-1936-4f1e-9eae-ae983c994482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:19.267182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ebee-1936-4f1e-9eae-ae983c994482 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:19.267974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ebee-1936-4f1e-9eae-ae983c994482 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:19.267974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ebee-1936-4f1e-9eae-ae983c994482 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:19.270997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8ebee-1936-4f1e-9eae-ae983c994482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:19.273173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8ebee-1936-4f1e-9eae-ae983c994482 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:19.306885 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2976/6023] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:04:19 2021] POST /identity/v3/projects => generated 393 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:19.310988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222c5f2-5bf9-4ea9-acbb-b4a72e104b84 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:19.321626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222c5f2-5bf9-4ea9-acbb-b4a72e104b84 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:19.390345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b09c3a-e788-4818-8b2e-63e7327ce573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:19.391162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b09c3a-e788-4818-8b2e-63e7327ce573 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:19.391417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b09c3a-e788-4818-8b2e-63e7327ce573 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:19.391696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b09c3a-e788-4818-8b2e-63e7327ce573 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:19.392408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b09c3a-e788-4818-8b2e-63e7327ce573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:19.394675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b09c3a-e788-4818-8b2e-63e7327ce573 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:19.433127 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3048/6024] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:04:19 2021] POST /identity/v3/users => generated 303 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:19.434964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8ebee-1936-4f1e-9eae-ae983c994482 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:19.459598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8ebee-1936-4f1e-9eae-ae983c994482 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:19.468231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb07a5-9042-43dd-a43d-f8e33801110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:19.468921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb07a5-9042-43dd-a43d-f8e33801110f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:19.469208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb07a5-9042-43dd-a43d-f8e33801110f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:19.469563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb07a5-9042-43dd-a43d-f8e33801110f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:19.471522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb07a5-9042-43dd-a43d-f8e33801110f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:19.474338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb07a5-9042-43dd-a43d-f8e33801110f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:19.492386 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2977/6025] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:19 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:19.494141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b09c3a-e788-4818-8b2e-63e7327ce573 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:19.507951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b09c3a-e788-4818-8b2e-63e7327ce573 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:19.522847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34203531-04f9-4cf9-877c-72b088344ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:19.523886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34203531-04f9-4cf9-877c-72b088344ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:19.527236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34203531-04f9-4cf9-877c-72b088344ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:19.527236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34203531-04f9-4cf9-877c-72b088344ea0 admin admin] PATH_INFO: `/v3/projects/4c0c68fc254e472c82291c7b8c058591/users/44e91020cdbc4313b0ce7fe7c22aeee7/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:19.550984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34203531-04f9-4cf9-877c-72b088344ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0c68fc254e472c82291c7b8c058591, user_id=44e91020cdbc4313b0ce7fe7c22aeee7, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:19.553954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34203531-04f9-4cf9-877c-72b088344ea0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:19.576233 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3049/6026] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:19 2021] PUT /identity/v3/projects/4c0c68fc254e472c82291c7b8c058591/users/44e91020cdbc4313b0ce7fe7c22aeee7/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:19.581232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb07a5-9042-43dd-a43d-f8e33801110f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:19.601131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb07a5-9042-43dd-a43d-f8e33801110f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:19.728947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddf2a8-7ecc-43a2-a664-55dcd7ba3146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:19.731318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddf2a8-7ecc-43a2-a664-55dcd7ba3146 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:19.731318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddf2a8-7ecc-43a2-a664-55dcd7ba3146 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:19.731318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddf2a8-7ecc-43a2-a664-55dcd7ba3146 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:19.745482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddf2a8-7ecc-43a2-a664-55dcd7ba3146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:19.747673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddf2a8-7ecc-43a2-a664-55dcd7ba3146 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:19.770393 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2978/6027] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:19 2021] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:19.774743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34203531-04f9-4cf9-877c-72b088344ea0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:19.790234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34203531-04f9-4cf9-877c-72b088344ea0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:19.811561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74ca0d-e5b3-45b2-a63c-370b792e12e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:19.812519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74ca0d-e5b3-45b2-a63c-370b792e12e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:19.812757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74ca0d-e5b3-45b2-a63c-370b792e12e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:19.813792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74ca0d-e5b3-45b2-a63c-370b792e12e0 admin admin] PATH_INFO: `/v3/projects/4c0c68fc254e472c82291c7b8c058591/users/44e91020cdbc4313b0ce7fe7c22aeee7/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:19.820701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74ca0d-e5b3-45b2-a63c-370b792e12e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0c68fc254e472c82291c7b8c058591, user_id=44e91020cdbc4313b0ce7fe7c22aeee7, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:19.823559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74ca0d-e5b3-45b2-a63c-370b792e12e0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:19.851547 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3050/6028] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:19 2021] PUT /identity/v3/projects/4c0c68fc254e472c82291c7b8c058591/users/44e91020cdbc4313b0ce7fe7c22aeee7/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:19.853568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9ddbe-dac7-4c81-a2c1-6cfa4f667547 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:19.854460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9ddbe-dac7-4c81-a2c1-6cfa4f667547 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:19.855031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9ddbe-dac7-4c81-a2c1-6cfa4f667547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:19.949728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-87e9ddbe-dac7-4c81-a2c1-6cfa4f667547 None None] MFA Rules not processed for user `44e91020cdbc4313b0ce7fe7c22aeee7`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:19.957444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-87e9ddbe-dac7-4c81-a2c1-6cfa4f667547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:20.194384 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2979/6029] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:19 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:20.198777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74ca0d-e5b3-45b2-a63c-370b792e12e0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:20.334724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74ca0d-e5b3-45b2-a63c-370b792e12e0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:20.340651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b8cb9-b4e4-44c4-90fb-1e96013ed660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:20.341428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b8cb9-b4e4-44c4-90fb-1e96013ed660 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:20.341779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b8cb9-b4e4-44c4-90fb-1e96013ed660 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:20.342167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b8cb9-b4e4-44c4-90fb-1e96013ed660 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:20.343946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b8cb9-b4e4-44c4-90fb-1e96013ed660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:20.349033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b8cb9-b4e4-44c4-90fb-1e96013ed660 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:20.416855 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3051/6030] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:04:20 2021] POST /identity/v3/projects => generated 391 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:20.417717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9ddbe-dac7-4c81-a2c1-6cfa4f667547 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:20.438973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9ddbe-dac7-4c81-a2c1-6cfa4f667547 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:20.548167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c44f8-32b7-4421-844c-9bd60a67db97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:20.549429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c44f8-32b7-4421-844c-9bd60a67db97 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:20.549429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c44f8-32b7-4421-844c-9bd60a67db97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:20.549908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c44f8-32b7-4421-844c-9bd60a67db97 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:20.551157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c44f8-32b7-4421-844c-9bd60a67db97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:20.554960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c44f8-32b7-4421-844c-9bd60a67db97 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:20.591637 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2980/6031] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:04:20 2021] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:20.594004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b8cb9-b4e4-44c4-90fb-1e96013ed660 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:20.610762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b8cb9-b4e4-44c4-90fb-1e96013ed660 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:20.631722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba52f0-3744-4fe7-8279-e7afdbb9db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:20.632433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba52f0-3744-4fe7-8279-e7afdbb9db17 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:20.632699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba52f0-3744-4fe7-8279-e7afdbb9db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:20.633160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba52f0-3744-4fe7-8279-e7afdbb9db17 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:20.634453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba52f0-3744-4fe7-8279-e7afdbb9db17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:20.635363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba52f0-3744-4fe7-8279-e7afdbb9db17 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:20.678817 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3052/6032] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:20 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:20.682491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c44f8-32b7-4421-844c-9bd60a67db97 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:20.693550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c44f8-32b7-4421-844c-9bd60a67db97 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:20.698731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cb20e-4d37-428f-ad6c-80b4fc2f37db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:20.699419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cb20e-4d37-428f-ad6c-80b4fc2f37db admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:20.699747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cb20e-4d37-428f-ad6c-80b4fc2f37db admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:20.700034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cb20e-4d37-428f-ad6c-80b4fc2f37db admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:20.700779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cb20e-4d37-428f-ad6c-80b4fc2f37db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:20.702416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cb20e-4d37-428f-ad6c-80b4fc2f37db admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:20.715571 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2981/6033] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:20 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:20.720068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba52f0-3744-4fe7-8279-e7afdbb9db17 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:20.737550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba52f0-3744-4fe7-8279-e7afdbb9db17 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:20.746092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f9c49-6d9d-4252-bd6d-81bb00f68d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:20.747760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f9c49-6d9d-4252-bd6d-81bb00f68d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:20.748351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f9c49-6d9d-4252-bd6d-81bb00f68d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:20.748926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f9c49-6d9d-4252-bd6d-81bb00f68d71 admin admin] PATH_INFO: `/v3/projects/a1f5aa6147d443ca9f78b27928a1caa7/users/16947b1d79c243b6b05ad48d7544c25f/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:20.775355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f9c49-6d9d-4252-bd6d-81bb00f68d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f5aa6147d443ca9f78b27928a1caa7, user_id=16947b1d79c243b6b05ad48d7544c25f, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:20.783167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f9c49-6d9d-4252-bd6d-81bb00f68d71 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:20.810294 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3053/6034] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:20 2021] PUT /identity/v3/projects/a1f5aa6147d443ca9f78b27928a1caa7/users/16947b1d79c243b6b05ad48d7544c25f/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:04:20.819747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cd2c9-d5ca-40dc-9663-9d3eb21ce77e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:20.820047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cd2c9-d5ca-40dc-9663-9d3eb21ce77e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:20.820336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cd2c9-d5ca-40dc-9663-9d3eb21ce77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:20.886139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-017cd2c9-d5ca-40dc-9663-9d3eb21ce77e None None] MFA Rules not processed for user `16947b1d79c243b6b05ad48d7544c25f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:20.887406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-017cd2c9-d5ca-40dc-9663-9d3eb21ce77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:21.064154 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2982/6035] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:20 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:21.072832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f9c49-6d9d-4252-bd6d-81bb00f68d71 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:21.075334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-703f9c49-6d9d-4252-bd6d-81bb00f68d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:21.198946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f9c49-6d9d-4252-bd6d-81bb00f68d71 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:21.206044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272b19e-8f05-42ff-a617-21e5f8da397c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:21.207162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272b19e-8f05-42ff-a617-21e5f8da397c service glance] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:21.207660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272b19e-8f05-42ff-a617-21e5f8da397c service glance] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:21.208120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272b19e-8f05-42ff-a617-21e5f8da397c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:21.289932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272b19e-8f05-42ff-a617-21e5f8da397c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:21.292002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272b19e-8f05-42ff-a617-21e5f8da397c service glance] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:21.309050 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3054/6036] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:21 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:04:22.476567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cd2c9-d5ca-40dc-9663-9d3eb21ce77e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:22.647053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cd2c9-d5ca-40dc-9663-9d3eb21ce77e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:22.664909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b0d79-5083-4f93-9717-4de949fe5a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:22.676361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b0d79-5083-4f93-9717-4de949fe5a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:22.677185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b0d79-5083-4f93-9717-4de949fe5a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:22.678468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b0d79-5083-4f93-9717-4de949fe5a5e admin admin] PATH_INFO: `/v3/users/44e91020cdbc4313b0ce7fe7c22aeee7` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:22.680365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b0d79-5083-4f93-9717-4de949fe5a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e91020cdbc4313b0ce7fe7c22aeee7)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:22.683507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b0d79-5083-4f93-9717-4de949fe5a5e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:22.788343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ac5b0d79-5083-4f93-9717-4de949fe5a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e91020cdbc4313b0ce7fe7c22aeee7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:22.800688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ac5b0d79-5083-4f93-9717-4de949fe5a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e91020cdbc4313b0ce7fe7c22aeee7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:22.820299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ac5b0d79-5083-4f93-9717-4de949fe5a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e91020cdbc4313b0ce7fe7c22aeee7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:22.821359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ac5b0d79-5083-4f93-9717-4de949fe5a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e91020cdbc4313b0ce7fe7c22aeee7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:22.835652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ac5b0d79-5083-4f93-9717-4de949fe5a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e91020cdbc4313b0ce7fe7c22aeee7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:22.866350 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2983/6037] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:22 2021] DELETE /identity/v3/users/44e91020cdbc4313b0ce7fe7c22aeee7 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:22.871210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1adb4-a178-4184-9c4f-a7c171851f8c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:22.871750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1adb4-a178-4184-9c4f-a7c171851f8c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:22.871750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1adb4-a178-4184-9c4f-a7c171851f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:22.948011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-61a1adb4-a178-4184-9c4f-a7c171851f8c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:22.949312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-61a1adb4-a178-4184-9c4f-a7c171851f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:23.060934 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3055/6038] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:23.109570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b0d79-5083-4f93-9717-4de949fe5a5e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:23.112525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ac5b0d79-5083-4f93-9717-4de949fe5a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:23.221613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b0d79-5083-4f93-9717-4de949fe5a5e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:23.228670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a917e0-09d7-4b34-8119-e3154b25b29d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:23.229483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a917e0-09d7-4b34-8119-e3154b25b29d service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:23.229796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a917e0-09d7-4b34-8119-e3154b25b29d service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:23.230076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a917e0-09d7-4b34-8119-e3154b25b29d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:23.245774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a917e0-09d7-4b34-8119-e3154b25b29d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:23.247267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a917e0-09d7-4b34-8119-e3154b25b29d service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:23.259564 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2984/6039] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:04:25.037161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1adb4-a178-4184-9c4f-a7c171851f8c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:25.040205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-61a1adb4-a178-4184-9c4f-a7c171851f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:25.059891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1adb4-a178-4184-9c4f-a7c171851f8c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:25.080716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39d7e7-4d54-4765-808f-2264f7b665cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:25.082307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39d7e7-4d54-4765-808f-2264f7b665cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:25.082830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39d7e7-4d54-4765-808f-2264f7b665cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:25.083347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39d7e7-4d54-4765-808f-2264f7b665cf admin admin] PATH_INFO: `/v3/projects/4c0c68fc254e472c82291c7b8c058591` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:25.090356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39d7e7-4d54-4765-808f-2264f7b665cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0c68fc254e472c82291c7b8c058591)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:25.093911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39d7e7-4d54-4765-808f-2264f7b665cf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:25.175070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-eb39d7e7-4d54-4765-808f-2264f7b665cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0c68fc254e472c82291c7b8c058591', 'request_id': 'req-eb39d7e7-4d54-4765-808f-2264f7b665cf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:25.185961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-eb39d7e7-4d54-4765-808f-2264f7b665cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0c68fc254e472c82291c7b8c058591', 'request_id': 'req-eb39d7e7-4d54-4765-808f-2264f7b665cf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:25.201370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-eb39d7e7-4d54-4765-808f-2264f7b665cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0c68fc254e472c82291c7b8c058591', 'request_id': 'req-eb39d7e7-4d54-4765-808f-2264f7b665cf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:25.230351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-eb39d7e7-4d54-4765-808f-2264f7b665cf admin admin] The token cache is being invalidate because project 4c0c68fc254e472c82291c7b8c058591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:25.231054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-eb39d7e7-4d54-4765-808f-2264f7b665cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:25.232178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-eb39d7e7-4d54-4765-808f-2264f7b665cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:25.237592 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3056/6040] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:04:25 2021] DELETE /identity/v3/projects/4c0c68fc254e472c82291c7b8c058591 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:25.238349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a917e0-09d7-4b34-8119-e3154b25b29d service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:25.251090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a917e0-09d7-4b34-8119-e3154b25b29d service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:25.358600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21931e8a-898f-41c9-8689-10478fc1fe45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:25.359889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21931e8a-898f-41c9-8689-10478fc1fe45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:25.360386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21931e8a-898f-41c9-8689-10478fc1fe45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:25.360672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21931e8a-898f-41c9-8689-10478fc1fe45 admin admin] PATH_INFO: `/v3/users/16947b1d79c243b6b05ad48d7544c25f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:25.362034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21931e8a-898f-41c9-8689-10478fc1fe45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16947b1d79c243b6b05ad48d7544c25f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:25.364398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21931e8a-898f-41c9-8689-10478fc1fe45 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:25.443762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-21931e8a-898f-41c9-8689-10478fc1fe45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16947b1d79c243b6b05ad48d7544c25f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:25.452490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-21931e8a-898f-41c9-8689-10478fc1fe45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16947b1d79c243b6b05ad48d7544c25f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:25.480775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-21931e8a-898f-41c9-8689-10478fc1fe45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16947b1d79c243b6b05ad48d7544c25f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:25.483389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-21931e8a-898f-41c9-8689-10478fc1fe45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16947b1d79c243b6b05ad48d7544c25f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:25.494904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-21931e8a-898f-41c9-8689-10478fc1fe45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16947b1d79c243b6b05ad48d7544c25f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:25.506689 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2985/6041] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:25 2021] DELETE /identity/v3/users/16947b1d79c243b6b05ad48d7544c25f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:26.028055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39d7e7-4d54-4765-808f-2264f7b665cf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:26.029819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-eb39d7e7-4d54-4765-808f-2264f7b665cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:26.052294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39d7e7-4d54-4765-808f-2264f7b665cf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:26.200082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc8dfa-5532-463f-b2cc-271d36bc377e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:26.201775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc8dfa-5532-463f-b2cc-271d36bc377e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:26.203486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc8dfa-5532-463f-b2cc-271d36bc377e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:26.204181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc8dfa-5532-463f-b2cc-271d36bc377e admin admin] PATH_INFO: `/v3/projects/a1f5aa6147d443ca9f78b27928a1caa7` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:26.207670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc8dfa-5532-463f-b2cc-271d36bc377e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f5aa6147d443ca9f78b27928a1caa7)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:26.214612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc8dfa-5532-463f-b2cc-271d36bc377e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:26.265765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1fdc8dfa-5532-463f-b2cc-271d36bc377e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f5aa6147d443ca9f78b27928a1caa7', 'request_id': 'req-1fdc8dfa-5532-463f-b2cc-271d36bc377e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:26.272626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1fdc8dfa-5532-463f-b2cc-271d36bc377e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f5aa6147d443ca9f78b27928a1caa7', 'request_id': 'req-1fdc8dfa-5532-463f-b2cc-271d36bc377e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:26.283228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1fdc8dfa-5532-463f-b2cc-271d36bc377e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f5aa6147d443ca9f78b27928a1caa7', 'request_id': 'req-1fdc8dfa-5532-463f-b2cc-271d36bc377e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:26.296394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1fdc8dfa-5532-463f-b2cc-271d36bc377e admin admin] The token cache is being invalidate because project a1f5aa6147d443ca9f78b27928a1caa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:26.296934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1fdc8dfa-5532-463f-b2cc-271d36bc377e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:26.297905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1fdc8dfa-5532-463f-b2cc-271d36bc377e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:26.299778 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3057/6042] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:04:26 2021] DELETE /identity/v3/projects/a1f5aa6147d443ca9f78b27928a1caa7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:26.306441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c8781-3fa0-4726-a048-daca0ddf19db None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:26.306959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c8781-3fa0-4726-a048-daca0ddf19db None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:26.307109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c8781-3fa0-4726-a048-daca0ddf19db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:26.326870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4e9c8781-3fa0-4726-a048-daca0ddf19db None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:26.328382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4e9c8781-3fa0-4726-a048-daca0ddf19db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:26.397482 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2986/6043] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:26.409276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6f77a-9e4c-40fc-9f97-7ae105fab4af None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:26.409616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6f77a-9e4c-40fc-9f97-7ae105fab4af None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:26.409842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6f77a-9e4c-40fc-9f97-7ae105fab4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:26.430205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6db6f77a-9e4c-40fc-9f97-7ae105fab4af None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:26.431468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6db6f77a-9e4c-40fc-9f97-7ae105fab4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:26.440707 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3058/6044] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:26.447906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c8781-3fa0-4726-a048-daca0ddf19db None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:26.459721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c8781-3fa0-4726-a048-daca0ddf19db None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:26.466815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268f0f5-42d9-4a1f-b60d-b77cb2fba04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:26.468010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268f0f5-42d9-4a1f-b60d-b77cb2fba04e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:26.468535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268f0f5-42d9-4a1f-b60d-b77cb2fba04e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:26.468821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268f0f5-42d9-4a1f-b60d-b77cb2fba04e admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:26.469731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268f0f5-42d9-4a1f-b60d-b77cb2fba04e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:04:26.470041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268f0f5-42d9-4a1f-b60d-b77cb2fba04e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:26.471788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268f0f5-42d9-4a1f-b60d-b77cb2fba04e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:26.490500 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2987/6045] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:04:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:04:26.492264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6f77a-9e4c-40fc-9f97-7ae105fab4af None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:26.503111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6f77a-9e4c-40fc-9f97-7ae105fab4af None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:26.520012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad93c55-1939-4695-a4db-0c2d1bfd57b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:26.520736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad93c55-1939-4695-a4db-0c2d1bfd57b7 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:26.521020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad93c55-1939-4695-a4db-0c2d1bfd57b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:26.522440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad93c55-1939-4695-a4db-0c2d1bfd57b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:26.524631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad93c55-1939-4695-a4db-0c2d1bfd57b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:26.527365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad93c55-1939-4695-a4db-0c2d1bfd57b7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:26.556219 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3059/6046] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:04:26 2021] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:04:26.560741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268f0f5-42d9-4a1f-b60d-b77cb2fba04e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:26.576465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268f0f5-42d9-4a1f-b60d-b77cb2fba04e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:26.650488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e307b-ce68-46fc-89cc-12467e86566d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:26.651178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e307b-ce68-46fc-89cc-12467e86566d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:26.651461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e307b-ce68-46fc-89cc-12467e86566d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:26.651736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e307b-ce68-46fc-89cc-12467e86566d admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:26.652472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e307b-ce68-46fc-89cc-12467e86566d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:26.654685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e307b-ce68-46fc-89cc-12467e86566d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:26.682336 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2988/6047] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:04:26 2021] POST /identity/v3/users => generated 285 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:26.683660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad93c55-1939-4695-a4db-0c2d1bfd57b7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:26.695682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad93c55-1939-4695-a4db-0c2d1bfd57b7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:26.700887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3aec7-9be1-4cef-b710-398f5db882c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:26.701784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3aec7-9be1-4cef-b710-398f5db882c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:26.702169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3aec7-9be1-4cef-b710-398f5db882c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:26.703297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3aec7-9be1-4cef-b710-398f5db882c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:26.704655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3aec7-9be1-4cef-b710-398f5db882c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:26.706973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3aec7-9be1-4cef-b710-398f5db882c3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:26.728665 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3060/6048] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:26 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:26.733248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e307b-ce68-46fc-89cc-12467e86566d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:26.744694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e307b-ce68-46fc-89cc-12467e86566d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:26.749809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b020a5-938b-4311-9ae4-bdf5790928df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:26.750457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b020a5-938b-4311-9ae4-bdf5790928df admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:26.750748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b020a5-938b-4311-9ae4-bdf5790928df admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:26.751062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b020a5-938b-4311-9ae4-bdf5790928df admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:26.751827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b020a5-938b-4311-9ae4-bdf5790928df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:26.753421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b020a5-938b-4311-9ae4-bdf5790928df admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:26.764713 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2989/6049] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:26 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:26.768253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3aec7-9be1-4cef-b710-398f5db882c3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:26.778571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3aec7-9be1-4cef-b710-398f5db882c3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:26.783763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a6783-a976-433c-8a73-e0ecf3e439cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:26.784672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a6783-a976-433c-8a73-e0ecf3e439cc admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:26.785074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a6783-a976-433c-8a73-e0ecf3e439cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:26.785461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a6783-a976-433c-8a73-e0ecf3e439cc admin admin] PATH_INFO: `/v3/projects/82e6c16d614a43fda241483dc6cc4ff9/users/a2d448950a5a482d9edad6e070ba9735/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:26.801978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a6783-a976-433c-8a73-e0ecf3e439cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e6c16d614a43fda241483dc6cc4ff9, user_id=a2d448950a5a482d9edad6e070ba9735, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:26.805340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a6783-a976-433c-8a73-e0ecf3e439cc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:26.822625 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3061/6050] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:26 2021] PUT /identity/v3/projects/82e6c16d614a43fda241483dc6cc4ff9/users/a2d448950a5a482d9edad6e070ba9735/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:26.833047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557ae13-1431-4e59-8dde-28f0a34c30b6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:26.833738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557ae13-1431-4e59-8dde-28f0a34c30b6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:26.834210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557ae13-1431-4e59-8dde-28f0a34c30b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:26.867069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9557ae13-1431-4e59-8dde-28f0a34c30b6 None None] MFA Rules not processed for user `a2d448950a5a482d9edad6e070ba9735`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:26.868285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9557ae13-1431-4e59-8dde-28f0a34c30b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:26.870012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a6783-a976-433c-8a73-e0ecf3e439cc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:26.871654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-708a6783-a976-433c-8a73-e0ecf3e439cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:26.943852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a6783-a976-433c-8a73-e0ecf3e439cc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:26.944148 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2990/6051] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:26 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:26.948772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557ae13-1431-4e59-8dde-28f0a34c30b6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:26.950151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33e78a-ce26-4a98-856b-d82a4f18dde9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:26.951097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33e78a-ce26-4a98-856b-d82a4f18dde9 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:26.951600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33e78a-ce26-4a98-856b-d82a4f18dde9 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:26.952075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33e78a-ce26-4a98-856b-d82a4f18dde9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:26.954093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bc33e78a-ce26-4a98-856b-d82a4f18dde9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:26.971528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33e78a-ce26-4a98-856b-d82a4f18dde9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:26.973494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33e78a-ce26-4a98-856b-d82a4f18dde9 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:26.990860 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3062/6052] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:26 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:04:27.016518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557ae13-1431-4e59-8dde-28f0a34c30b6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:27.022122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef6f23-d6a2-4f6a-b73a-04346dee2105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:27.022964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef6f23-d6a2-4f6a-b73a-04346dee2105 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:27.023251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef6f23-d6a2-4f6a-b73a-04346dee2105 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:27.023531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef6f23-d6a2-4f6a-b73a-04346dee2105 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:27.024237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef6f23-d6a2-4f6a-b73a-04346dee2105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:27.026145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef6f23-d6a2-4f6a-b73a-04346dee2105 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:27.060813 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2991/6053] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:04:26 2021] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:04:27.064957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33e78a-ce26-4a98-856b-d82a4f18dde9 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:27.082283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33e78a-ce26-4a98-856b-d82a4f18dde9 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:27.148250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627f73b-f66f-4df4-8222-02f4d0dd5bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:27.149070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627f73b-f66f-4df4-8222-02f4d0dd5bcd admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:27.149452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627f73b-f66f-4df4-8222-02f4d0dd5bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:27.149826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627f73b-f66f-4df4-8222-02f4d0dd5bcd admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:27.150707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627f73b-f66f-4df4-8222-02f4d0dd5bcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:27.152734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627f73b-f66f-4df4-8222-02f4d0dd5bcd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:27.186950 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3063/6054] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:04:27 2021] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:27.187847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef6f23-d6a2-4f6a-b73a-04346dee2105 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:27.199718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef6f23-d6a2-4f6a-b73a-04346dee2105 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:27.204655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3de73-df88-4cc3-bd5a-7ff22bf7ab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:27.205522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3de73-df88-4cc3-bd5a-7ff22bf7ab30 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:27.206214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3de73-df88-4cc3-bd5a-7ff22bf7ab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:27.206677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3de73-df88-4cc3-bd5a-7ff22bf7ab30 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:27.207842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3de73-df88-4cc3-bd5a-7ff22bf7ab30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:27.210332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3de73-df88-4cc3-bd5a-7ff22bf7ab30 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:27.226300 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2992/6055] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:27 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:27.229084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627f73b-f66f-4df4-8222-02f4d0dd5bcd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:27.240068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627f73b-f66f-4df4-8222-02f4d0dd5bcd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:27.245792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231a966-33c6-4aa0-903d-5776551cebe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:27.246626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231a966-33c6-4aa0-903d-5776551cebe0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:27.248288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231a966-33c6-4aa0-903d-5776551cebe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:27.248578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231a966-33c6-4aa0-903d-5776551cebe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:27.249334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231a966-33c6-4aa0-903d-5776551cebe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:27.251167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231a966-33c6-4aa0-903d-5776551cebe0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:27.264026 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3064/6056] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:27 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:27.268149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3de73-df88-4cc3-bd5a-7ff22bf7ab30 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:27.283335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3de73-df88-4cc3-bd5a-7ff22bf7ab30 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:27.290820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb96dc-805c-4df1-93cc-632518a70ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:27.291323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb96dc-805c-4df1-93cc-632518a70ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:27.292093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb96dc-805c-4df1-93cc-632518a70ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:27.292468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb96dc-805c-4df1-93cc-632518a70ef3 admin admin] PATH_INFO: `/v3/projects/219916b4d5d948d7be763d8b8f611060/users/714d0bd48c594931ab77309fc229078d/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:27.313251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb96dc-805c-4df1-93cc-632518a70ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219916b4d5d948d7be763d8b8f611060, user_id=714d0bd48c594931ab77309fc229078d, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:27.317497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb96dc-805c-4df1-93cc-632518a70ef3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:27.350317 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2993/6057] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:27 2021] PUT /identity/v3/projects/219916b4d5d948d7be763d8b8f611060/users/714d0bd48c594931ab77309fc229078d/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:27.355198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739849a-83b9-4323-8fbc-38b0b509a629 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:27.355584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739849a-83b9-4323-8fbc-38b0b509a629 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:27.355958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739849a-83b9-4323-8fbc-38b0b509a629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:27.401027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8739849a-83b9-4323-8fbc-38b0b509a629 None None] MFA Rules not processed for user `714d0bd48c594931ab77309fc229078d`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:27.402685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8739849a-83b9-4323-8fbc-38b0b509a629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:27.513804 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3065/6058] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:27 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:27.539711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb96dc-805c-4df1-93cc-632518a70ef3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:27.545206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1bfb96dc-805c-4df1-93cc-632518a70ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:27.644183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739849a-83b9-4323-8fbc-38b0b509a629 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:27.646928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8739849a-83b9-4323-8fbc-38b0b509a629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:27.678911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb96dc-805c-4df1-93cc-632518a70ef3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:27.686504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eae6d0-eba3-41cb-a7fe-4ab0b73a8f4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:27.687614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae6d0-eba3-41cb-a7fe-4ab0b73a8f4a service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:27.688459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae6d0-eba3-41cb-a7fe-4ab0b73a8f4a service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:27.689395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae6d0-eba3-41cb-a7fe-4ab0b73a8f4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:27.787188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eae6d0-eba3-41cb-a7fe-4ab0b73a8f4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:27.790992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739849a-83b9-4323-8fbc-38b0b509a629 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:27.792395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eae6d0-eba3-41cb-a7fe-4ab0b73a8f4a service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:27.805146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b736d13-0fa2-4c12-90e4-894f3a0c14b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:27.808503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b736d13-0fa2-4c12-90e4-894f3a0c14b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:27.809008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b736d13-0fa2-4c12-90e4-894f3a0c14b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:27.809478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b736d13-0fa2-4c12-90e4-894f3a0c14b7 admin admin] PATH_INFO: `/v3/users/1e53da7af08747da895b06ecc262508a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:27.812946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b736d13-0fa2-4c12-90e4-894f3a0c14b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e53da7af08747da895b06ecc262508a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:27.817199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b736d13-0fa2-4c12-90e4-894f3a0c14b7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:27.819734 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2994/6059] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:27 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:04:27.944627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0b736d13-0fa2-4c12-90e4-894f3a0c14b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e53da7af08747da895b06ecc262508a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:27.985806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0b736d13-0fa2-4c12-90e4-894f3a0c14b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e53da7af08747da895b06ecc262508a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:27.987083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0b736d13-0fa2-4c12-90e4-894f3a0c14b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e53da7af08747da895b06ecc262508a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:28.023277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0b736d13-0fa2-4c12-90e4-894f3a0c14b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e53da7af08747da895b06ecc262508a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:28.042675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0b736d13-0fa2-4c12-90e4-894f3a0c14b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e53da7af08747da895b06ecc262508a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:28.048780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eae6d0-eba3-41cb-a7fe-4ab0b73a8f4a service glance] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:28.062147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eae6d0-eba3-41cb-a7fe-4ab0b73a8f4a service glance] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:28.064643 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3066/6060] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:27 2021] DELETE /identity/v3/users/1e53da7af08747da895b06ecc262508a => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:28.071308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f73b33-f577-40ab-8f10-1947bf34f1ab None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:28.071973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f73b33-f577-40ab-8f10-1947bf34f1ab None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:28.071973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f73b33-f577-40ab-8f10-1947bf34f1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:28.095570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-16f73b33-f577-40ab-8f10-1947bf34f1ab None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:28.097533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-16f73b33-f577-40ab-8f10-1947bf34f1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:28.142988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56df469-f3ab-4f29-9afd-b8cecee25365 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:28.143854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56df469-f3ab-4f29-9afd-b8cecee25365 service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:28.144156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56df469-f3ab-4f29-9afd-b8cecee25365 service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:28.144586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56df469-f3ab-4f29-9afd-b8cecee25365 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:28.149111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c56df469-f3ab-4f29-9afd-b8cecee25365 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:28.206580 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3067/6061] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:28.225337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f73b33-f577-40ab-8f10-1947bf34f1ab None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:28.228606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-16f73b33-f577-40ab-8f10-1947bf34f1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:28.267030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56df469-f3ab-4f29-9afd-b8cecee25365 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:28.276051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56df469-f3ab-4f29-9afd-b8cecee25365 service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:28.293842 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2995/6062] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:28 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:04:28.341752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f73b33-f577-40ab-8f10-1947bf34f1ab None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:28.346771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf2bec-da09-486b-a9ad-2827b516fe16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:28.348524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf2bec-da09-486b-a9ad-2827b516fe16 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:28.349054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf2bec-da09-486b-a9ad-2827b516fe16 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:28.355642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf2bec-da09-486b-a9ad-2827b516fe16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:28.375403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf2bec-da09-486b-a9ad-2827b516fe16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:28.379051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf2bec-da09-486b-a9ad-2827b516fe16 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:28.393780 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3068/6063] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:04:28.899797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56df469-f3ab-4f29-9afd-b8cecee25365 service glance] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:28.902217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c56df469-f3ab-4f29-9afd-b8cecee25365 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:28.923577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56df469-f3ab-4f29-9afd-b8cecee25365 service glance] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:28.932604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc78fbf-f7c3-4634-84f0-453a3676402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:28.933966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc78fbf-f7c3-4634-84f0-453a3676402b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:28.934690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc78fbf-f7c3-4634-84f0-453a3676402b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:28.935455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc78fbf-f7c3-4634-84f0-453a3676402b admin admin] PATH_INFO: `/v3/projects/d7c94b08c98f49b6b734eda4021909b9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:28.937617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc78fbf-f7c3-4634-84f0-453a3676402b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c94b08c98f49b6b734eda4021909b9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:28.945736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc78fbf-f7c3-4634-84f0-453a3676402b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:29.036349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbc78fbf-f7c3-4634-84f0-453a3676402b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c94b08c98f49b6b734eda4021909b9', 'request_id': 'req-cbc78fbf-f7c3-4634-84f0-453a3676402b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:29.051600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbc78fbf-f7c3-4634-84f0-453a3676402b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c94b08c98f49b6b734eda4021909b9', 'request_id': 'req-cbc78fbf-f7c3-4634-84f0-453a3676402b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:29.064331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbc78fbf-f7c3-4634-84f0-453a3676402b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c94b08c98f49b6b734eda4021909b9', 'request_id': 'req-cbc78fbf-f7c3-4634-84f0-453a3676402b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:29.087603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbc78fbf-f7c3-4634-84f0-453a3676402b admin admin] The token cache is being invalidate because project d7c94b08c98f49b6b734eda4021909b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:29.087603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbc78fbf-f7c3-4634-84f0-453a3676402b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:29.089053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbc78fbf-f7c3-4634-84f0-453a3676402b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:29.091743 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2996/6064] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:04:28 2021] DELETE /identity/v3/projects/d7c94b08c98f49b6b734eda4021909b9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:04:29.097677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98db0e-78fe-4615-bf03-ca8bfa4e72a7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:29.098282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98db0e-78fe-4615-bf03-ca8bfa4e72a7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:29.098816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98db0e-78fe-4615-bf03-ca8bfa4e72a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:29.141589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-db98db0e-78fe-4615-bf03-ca8bfa4e72a7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:29.143146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-db98db0e-78fe-4615-bf03-ca8bfa4e72a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:29.259864 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3069/6065] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:04:29.284406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cabde-ecfe-40c1-9b2c-cce14b4d8f96 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:29.285194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cabde-ecfe-40c1-9b2c-cce14b4d8f96 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:29.285895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cabde-ecfe-40c1-9b2c-cce14b4d8f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:29.312935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-cb3cabde-ecfe-40c1-9b2c-cce14b4d8f96 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:29.314578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cb3cabde-ecfe-40c1-9b2c-cce14b4d8f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:29.326080 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2997/6066] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:29.331371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98db0e-78fe-4615-bf03-ca8bfa4e72a7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:29.356187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98db0e-78fe-4615-bf03-ca8bfa4e72a7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:29.366757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a137985-2565-40a4-ab3b-a9eb2747d67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:29.369330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a137985-2565-40a4-ab3b-a9eb2747d67b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:29.369699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a137985-2565-40a4-ab3b-a9eb2747d67b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:29.370085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a137985-2565-40a4-ab3b-a9eb2747d67b admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:29.370975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a137985-2565-40a4-ab3b-a9eb2747d67b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:04:29.371396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a137985-2565-40a4-ab3b-a9eb2747d67b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:29.373149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a137985-2565-40a4-ab3b-a9eb2747d67b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:29.394305 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3070/6067] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:04:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:04:29.397193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cabde-ecfe-40c1-9b2c-cce14b4d8f96 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:29.408457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cabde-ecfe-40c1-9b2c-cce14b4d8f96 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:29.414349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f878545-3ca5-4967-b3bd-515144f0ddca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:29.415449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f878545-3ca5-4967-b3bd-515144f0ddca admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:29.415967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f878545-3ca5-4967-b3bd-515144f0ddca admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:29.416477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f878545-3ca5-4967-b3bd-515144f0ddca admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:29.418846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f878545-3ca5-4967-b3bd-515144f0ddca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:29.421180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f878545-3ca5-4967-b3bd-515144f0ddca admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:29.482959 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2998/6068] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:04:29 2021] POST /identity/v3/projects => generated 393 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:29.487090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a137985-2565-40a4-ab3b-a9eb2747d67b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:29.506576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a137985-2565-40a4-ab3b-a9eb2747d67b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:29.657284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb58b0e-8c0a-4af8-a616-5a2b512b138c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:29.660309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb58b0e-8c0a-4af8-a616-5a2b512b138c admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:29.661255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb58b0e-8c0a-4af8-a616-5a2b512b138c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:29.661547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb58b0e-8c0a-4af8-a616-5a2b512b138c admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:29.663682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb58b0e-8c0a-4af8-a616-5a2b512b138c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:29.668705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb58b0e-8c0a-4af8-a616-5a2b512b138c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:29.718143 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3071/6069] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:04:29 2021] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:04:29.722875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f878545-3ca5-4967-b3bd-515144f0ddca admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:29.750843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f878545-3ca5-4967-b3bd-515144f0ddca admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:29.764268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83656c68-2131-40be-8f36-87c3d109dcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:29.764964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83656c68-2131-40be-8f36-87c3d109dcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:29.765257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83656c68-2131-40be-8f36-87c3d109dcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:29.765553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83656c68-2131-40be-8f36-87c3d109dcd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:29.766327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83656c68-2131-40be-8f36-87c3d109dcd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:29.768059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83656c68-2131-40be-8f36-87c3d109dcd7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:29.808887 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 2999/6070] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:29 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:29.811529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb58b0e-8c0a-4af8-a616-5a2b512b138c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:29.833611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb58b0e-8c0a-4af8-a616-5a2b512b138c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:29.846469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa1cbd-1493-4b52-bc47-2bddae86c83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:29.847166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa1cbd-1493-4b52-bc47-2bddae86c83c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:29.847463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa1cbd-1493-4b52-bc47-2bddae86c83c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:29.847754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa1cbd-1493-4b52-bc47-2bddae86c83c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:29.848982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa1cbd-1493-4b52-bc47-2bddae86c83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:29.855885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa1cbd-1493-4b52-bc47-2bddae86c83c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:29.878698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83656c68-2131-40be-8f36-87c3d109dcd7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:29.881848 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3072/6071] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:29 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:29.901073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83656c68-2131-40be-8f36-87c3d109dcd7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:29.924310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128425a-18ba-44f1-8105-7a73d6ec0d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:29.925949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128425a-18ba-44f1-8105-7a73d6ec0d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:29.925949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128425a-18ba-44f1-8105-7a73d6ec0d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:29.925949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128425a-18ba-44f1-8105-7a73d6ec0d7d admin admin] PATH_INFO: `/v3/projects/080440e3f2634c21949255c525aa91c6/users/74f5438a009546f7b55a12e9d1d431aa/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:29.971676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128425a-18ba-44f1-8105-7a73d6ec0d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=080440e3f2634c21949255c525aa91c6, user_id=74f5438a009546f7b55a12e9d1d431aa, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:29.979015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128425a-18ba-44f1-8105-7a73d6ec0d7d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:30.014271 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3000/6072] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:29 2021] PUT /identity/v3/projects/080440e3f2634c21949255c525aa91c6/users/74f5438a009546f7b55a12e9d1d431aa/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:04:30.018791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d2170-86e0-426a-b2d7-9340e74558ba None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:30.018920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d2170-86e0-426a-b2d7-9340e74558ba None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:30.019090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d2170-86e0-426a-b2d7-9340e74558ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:30.050715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c87d2170-86e0-426a-b2d7-9340e74558ba None None] MFA Rules not processed for user `74f5438a009546f7b55a12e9d1d431aa`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:30.055369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c87d2170-86e0-426a-b2d7-9340e74558ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:30.160184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128425a-18ba-44f1-8105-7a73d6ec0d7d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:30.164147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0128425a-18ba-44f1-8105-7a73d6ec0d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:30.192160 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3073/6073] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:30 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:30.266919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128425a-18ba-44f1-8105-7a73d6ec0d7d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:30.275080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706bee4-a933-4502-b989-613929ca67ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:30.276126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706bee4-a933-4502-b989-613929ca67ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:30.276553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706bee4-a933-4502-b989-613929ca67ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:30.276838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706bee4-a933-4502-b989-613929ca67ec admin admin] PATH_INFO: `/v3/users/a2d448950a5a482d9edad6e070ba9735` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:30.278103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706bee4-a933-4502-b989-613929ca67ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d448950a5a482d9edad6e070ba9735)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:30.280390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706bee4-a933-4502-b989-613929ca67ec admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:30.352668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2706bee4-a933-4502-b989-613929ca67ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d448950a5a482d9edad6e070ba9735'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:30.362606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2706bee4-a933-4502-b989-613929ca67ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d448950a5a482d9edad6e070ba9735'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:30.378544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2706bee4-a933-4502-b989-613929ca67ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d448950a5a482d9edad6e070ba9735'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:30.379557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2706bee4-a933-4502-b989-613929ca67ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d448950a5a482d9edad6e070ba9735'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:30.404441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2706bee4-a933-4502-b989-613929ca67ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d448950a5a482d9edad6e070ba9735'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:30.404595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d2170-86e0-426a-b2d7-9340e74558ba None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:30.406087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c87d2170-86e0-426a-b2d7-9340e74558ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:30.415099 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3001/6074] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:30 2021] DELETE /identity/v3/users/a2d448950a5a482d9edad6e070ba9735 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:30.424191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30bfaf-0085-4754-ae28-8a291d566a6d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:30.424673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30bfaf-0085-4754-ae28-8a291d566a6d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:30.425202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30bfaf-0085-4754-ae28-8a291d566a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:30.452442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-aa30bfaf-0085-4754-ae28-8a291d566a6d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:30.454273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-aa30bfaf-0085-4754-ae28-8a291d566a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:30.554078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d2170-86e0-426a-b2d7-9340e74558ba None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:30.590202 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3002/6075] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:30.604426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30bfaf-0085-4754-ae28-8a291d566a6d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:30.606624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-aa30bfaf-0085-4754-ae28-8a291d566a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:30.685179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca84e4a-f323-4b0f-ae38-514b28577f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:30.686376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84e4a-f323-4b0f-ae38-514b28577f47 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:30.688190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84e4a-f323-4b0f-ae38-514b28577f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:30.688707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84e4a-f323-4b0f-ae38-514b28577f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:30.696113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-aca84e4a-f323-4b0f-ae38-514b28577f47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:30.757374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30bfaf-0085-4754-ae28-8a291d566a6d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:30.762581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c230f7e-3dc5-41bf-8072-7e78360810a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:30.763357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c230f7e-3dc5-41bf-8072-7e78360810a2 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:30.763650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c230f7e-3dc5-41bf-8072-7e78360810a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:30.764002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c230f7e-3dc5-41bf-8072-7e78360810a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:30.778228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c230f7e-3dc5-41bf-8072-7e78360810a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:30.780115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c230f7e-3dc5-41bf-8072-7e78360810a2 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:30.794570 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3003/6076] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:04:30.818970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca84e4a-f323-4b0f-ae38-514b28577f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:30.820428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca84e4a-f323-4b0f-ae38-514b28577f47 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:30.837109 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3074/6077] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:30 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:04:32.382084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c230f7e-3dc5-41bf-8072-7e78360810a2 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:32.386796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5c230f7e-3dc5-41bf-8072-7e78360810a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:32.415280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c230f7e-3dc5-41bf-8072-7e78360810a2 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:32.422007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15b999-34a2-4031-be75-a31f07540b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:32.423309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15b999-34a2-4031-be75-a31f07540b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:32.423800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15b999-34a2-4031-be75-a31f07540b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:32.424252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15b999-34a2-4031-be75-a31f07540b4f admin admin] PATH_INFO: `/v3/projects/82e6c16d614a43fda241483dc6cc4ff9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:32.425849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15b999-34a2-4031-be75-a31f07540b4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e6c16d614a43fda241483dc6cc4ff9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:32.428960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15b999-34a2-4031-be75-a31f07540b4f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:32.504161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9e15b999-34a2-4031-be75-a31f07540b4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e6c16d614a43fda241483dc6cc4ff9', 'request_id': 'req-9e15b999-34a2-4031-be75-a31f07540b4f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:32.524042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9e15b999-34a2-4031-be75-a31f07540b4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e6c16d614a43fda241483dc6cc4ff9', 'request_id': 'req-9e15b999-34a2-4031-be75-a31f07540b4f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:32.534387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9e15b999-34a2-4031-be75-a31f07540b4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e6c16d614a43fda241483dc6cc4ff9', 'request_id': 'req-9e15b999-34a2-4031-be75-a31f07540b4f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:32.555922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9e15b999-34a2-4031-be75-a31f07540b4f admin admin] The token cache is being invalidate because project 82e6c16d614a43fda241483dc6cc4ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:32.556591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9e15b999-34a2-4031-be75-a31f07540b4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:32.557479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9e15b999-34a2-4031-be75-a31f07540b4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:32.559676 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3004/6078] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:04:32 2021] DELETE /identity/v3/projects/82e6c16d614a43fda241483dc6cc4ff9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:32.563489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca84e4a-f323-4b0f-ae38-514b28577f47 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:32.584270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca84e4a-f323-4b0f-ae38-514b28577f47 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:32.778779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85dbaa-384f-49e3-87c8-702170f97c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:32.780012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85dbaa-384f-49e3-87c8-702170f97c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:32.780468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85dbaa-384f-49e3-87c8-702170f97c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:32.780932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85dbaa-384f-49e3-87c8-702170f97c81 admin admin] PATH_INFO: `/v3/users/714d0bd48c594931ab77309fc229078d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:32.786373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85dbaa-384f-49e3-87c8-702170f97c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=714d0bd48c594931ab77309fc229078d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:32.789151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85dbaa-384f-49e3-87c8-702170f97c81 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:32.889245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0e85dbaa-384f-49e3-87c8-702170f97c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '714d0bd48c594931ab77309fc229078d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:32.903240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0e85dbaa-384f-49e3-87c8-702170f97c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '714d0bd48c594931ab77309fc229078d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:32.904121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0e85dbaa-384f-49e3-87c8-702170f97c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '714d0bd48c594931ab77309fc229078d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:32.939261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0e85dbaa-384f-49e3-87c8-702170f97c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '714d0bd48c594931ab77309fc229078d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:32.955910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0e85dbaa-384f-49e3-87c8-702170f97c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '714d0bd48c594931ab77309fc229078d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:32.964746 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3075/6079] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:32 2021] DELETE /identity/v3/users/714d0bd48c594931ab77309fc229078d => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:33.194044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84cb73-b518-4862-973b-230c77387220 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:33.194044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84cb73-b518-4862-973b-230c77387220 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:33.194316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84cb73-b518-4862-973b-230c77387220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:33.219356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2d84cb73-b518-4862-973b-230c77387220 None None] MFA Rules not processed for user `0a98795bdb7447c5b2a4930173b3c56d`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:33.220681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2d84cb73-b518-4862-973b-230c77387220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:33.298562 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3005/6080] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:33 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:34.221237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85dbaa-384f-49e3-87c8-702170f97c81 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:34.224953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0e85dbaa-384f-49e3-87c8-702170f97c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:34.377223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85dbaa-384f-49e3-87c8-702170f97c81 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:34.383788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf76dae-c330-470e-afca-922b3f74b67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:34.385414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf76dae-c330-470e-afca-922b3f74b67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:34.385913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf76dae-c330-470e-afca-922b3f74b67b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:34.386616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf76dae-c330-470e-afca-922b3f74b67b admin admin] PATH_INFO: `/v3/projects/219916b4d5d948d7be763d8b8f611060` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:34.388132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf76dae-c330-470e-afca-922b3f74b67b admin admin] RBAC: Authorizing `identity:delete_project(project_id=219916b4d5d948d7be763d8b8f611060)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:34.390973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf76dae-c330-470e-afca-922b3f74b67b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:34.535405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ddf76dae-c330-470e-afca-922b3f74b67b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219916b4d5d948d7be763d8b8f611060', 'request_id': 'req-ddf76dae-c330-470e-afca-922b3f74b67b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:34.555380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ddf76dae-c330-470e-afca-922b3f74b67b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219916b4d5d948d7be763d8b8f611060', 'request_id': 'req-ddf76dae-c330-470e-afca-922b3f74b67b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:34.571406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ddf76dae-c330-470e-afca-922b3f74b67b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219916b4d5d948d7be763d8b8f611060', 'request_id': 'req-ddf76dae-c330-470e-afca-922b3f74b67b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:34.589453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ddf76dae-c330-470e-afca-922b3f74b67b admin admin] The token cache is being invalidate because project 219916b4d5d948d7be763d8b8f611060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:34.590571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ddf76dae-c330-470e-afca-922b3f74b67b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:34.591070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ddf76dae-c330-470e-afca-922b3f74b67b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:34.599758 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3076/6081] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:04:34 2021] DELETE /identity/v3/projects/219916b4d5d948d7be763d8b8f611060 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:34.601699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27609cc-f69c-4466-a6bc-fe0222886828 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:34.602814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27609cc-f69c-4466-a6bc-fe0222886828 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:34.603027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27609cc-f69c-4466-a6bc-fe0222886828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:34.643584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d27609cc-f69c-4466-a6bc-fe0222886828 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:34.644860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d27609cc-f69c-4466-a6bc-fe0222886828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:34.777217 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3006/6082] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:34.787341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f7f02-f764-4d40-8f29-6fb545d5ddf0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:34.787506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f7f02-f764-4d40-8f29-6fb545d5ddf0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:34.787771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f7f02-f764-4d40-8f29-6fb545d5ddf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:34.827305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a34f7f02-f764-4d40-8f29-6fb545d5ddf0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:34.828614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a34f7f02-f764-4d40-8f29-6fb545d5ddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:34.872324 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3077/6083] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:04:34.876877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27609cc-f69c-4466-a6bc-fe0222886828 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:34.891863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27609cc-f69c-4466-a6bc-fe0222886828 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:34.903629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3a2bc-1ecb-42bf-8fe9-25f8913cc243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:34.904785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3a2bc-1ecb-42bf-8fe9-25f8913cc243 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:34.905247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3a2bc-1ecb-42bf-8fe9-25f8913cc243 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:34.905697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3a2bc-1ecb-42bf-8fe9-25f8913cc243 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:34.906657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3a2bc-1ecb-42bf-8fe9-25f8913cc243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:04:34.907161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3a2bc-1ecb-42bf-8fe9-25f8913cc243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:34.908997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3a2bc-1ecb-42bf-8fe9-25f8913cc243 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:34.932119 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3007/6084] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:04:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:04:34.936952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f7f02-f764-4d40-8f29-6fb545d5ddf0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:34.950172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f7f02-f764-4d40-8f29-6fb545d5ddf0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:34.956538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0847b9e-81a0-4e4a-a712-7438129a24da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:34.957684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0847b9e-81a0-4e4a-a712-7438129a24da admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:34.958409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0847b9e-81a0-4e4a-a712-7438129a24da admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:34.959380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0847b9e-81a0-4e4a-a712-7438129a24da admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:34.960340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0847b9e-81a0-4e4a-a712-7438129a24da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:34.962481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0847b9e-81a0-4e4a-a712-7438129a24da admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:35.008464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3a2bc-1ecb-42bf-8fe9-25f8913cc243 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:35.020898 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3078/6085] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:04:34 2021] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:35.031794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3a2bc-1ecb-42bf-8fe9-25f8913cc243 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:35.113788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d04d6-bd07-4f03-8659-25cb831ec4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:35.114067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d04d6-bd07-4f03-8659-25cb831ec4fe admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:35.114697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d04d6-bd07-4f03-8659-25cb831ec4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:35.115131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d04d6-bd07-4f03-8659-25cb831ec4fe admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:35.115915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d04d6-bd07-4f03-8659-25cb831ec4fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:35.118200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d04d6-bd07-4f03-8659-25cb831ec4fe admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:35.166790 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3008/6086] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:04:35 2021] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:35.170986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0847b9e-81a0-4e4a-a712-7438129a24da admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:35.186909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0847b9e-81a0-4e4a-a712-7438129a24da admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:35.209264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844e9ad-b4a2-4f13-baf1-34c5e8a1ce46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:35.210532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844e9ad-b4a2-4f13-baf1-34c5e8a1ce46 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:35.211281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844e9ad-b4a2-4f13-baf1-34c5e8a1ce46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:35.211855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844e9ad-b4a2-4f13-baf1-34c5e8a1ce46 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:35.213137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844e9ad-b4a2-4f13-baf1-34c5e8a1ce46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:35.215190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844e9ad-b4a2-4f13-baf1-34c5e8a1ce46 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:35.237938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d04d6-bd07-4f03-8659-25cb831ec4fe admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:35.248705 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3079/6087] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:35 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:35.252607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d04d6-bd07-4f03-8659-25cb831ec4fe admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:35.260392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79790d1e-2c08-489b-9209-2993795ab21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:35.261379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79790d1e-2c08-489b-9209-2993795ab21f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:35.261989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79790d1e-2c08-489b-9209-2993795ab21f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:35.263114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79790d1e-2c08-489b-9209-2993795ab21f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:35.264186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79790d1e-2c08-489b-9209-2993795ab21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:35.266454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79790d1e-2c08-489b-9209-2993795ab21f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:35.282495 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3009/6088] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:35 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:35.283048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844e9ad-b4a2-4f13-baf1-34c5e8a1ce46 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:35.298516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844e9ad-b4a2-4f13-baf1-34c5e8a1ce46 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:35.312628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dfbf6-1bc3-4a5a-bcc6-fea54a913537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:35.314697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dfbf6-1bc3-4a5a-bcc6-fea54a913537 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:35.315258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dfbf6-1bc3-4a5a-bcc6-fea54a913537 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:35.315772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dfbf6-1bc3-4a5a-bcc6-fea54a913537 admin admin] PATH_INFO: `/v3/projects/4bd3004b09cc43788ab39a3fdee80229/users/53873a619e044efb98445226c0b62e4e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:35.338686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612dfbf6-1bc3-4a5a-bcc6-fea54a913537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd3004b09cc43788ab39a3fdee80229, user_id=53873a619e044efb98445226c0b62e4e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:35.342227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612dfbf6-1bc3-4a5a-bcc6-fea54a913537 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:35.392290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539ae7f-52e2-41bb-9a1d-5816c59e297f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:35.392924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539ae7f-52e2-41bb-9a1d-5816c59e297f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:35.393450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539ae7f-52e2-41bb-9a1d-5816c59e297f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:35.395597 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3080/6089] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:35 2021] PUT /identity/v3/projects/4bd3004b09cc43788ab39a3fdee80229/users/53873a619e044efb98445226c0b62e4e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:35.428712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d539ae7f-52e2-41bb-9a1d-5816c59e297f None None] MFA Rules not processed for user `53873a619e044efb98445226c0b62e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:35.430204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d539ae7f-52e2-41bb-9a1d-5816c59e297f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:35.527757 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3010/6090] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:35 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:35.532627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dfbf6-1bc3-4a5a-bcc6-fea54a913537 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:35.618575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dfbf6-1bc3-4a5a-bcc6-fea54a913537 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:35.624270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58ff74-076d-47af-aa15-5f5529cf528a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:35.625151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58ff74-076d-47af-aa15-5f5529cf528a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:35.626032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58ff74-076d-47af-aa15-5f5529cf528a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:35.626889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58ff74-076d-47af-aa15-5f5529cf528a admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:35.627778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58ff74-076d-47af-aa15-5f5529cf528a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:35.630227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58ff74-076d-47af-aa15-5f5529cf528a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:35.683172 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3081/6091] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:04:35 2021] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:35.684947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539ae7f-52e2-41bb-9a1d-5816c59e297f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:35.713742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539ae7f-52e2-41bb-9a1d-5816c59e297f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:35.828702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1ea5e-317f-4b46-b53f-375df2830f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:35.829959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1ea5e-317f-4b46-b53f-375df2830f3b admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:35.830541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1ea5e-317f-4b46-b53f-375df2830f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:35.831874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1ea5e-317f-4b46-b53f-375df2830f3b admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:35.834668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1ea5e-317f-4b46-b53f-375df2830f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:35.838942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1ea5e-317f-4b46-b53f-375df2830f3b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:35.930128 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3011/6092] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:04:35 2021] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:35.934373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58ff74-076d-47af-aa15-5f5529cf528a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:35.948693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58ff74-076d-47af-aa15-5f5529cf528a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:35.968418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5becd4-4c7a-49ef-9348-8d3927b32164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:35.969206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5becd4-4c7a-49ef-9348-8d3927b32164 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:35.969552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5becd4-4c7a-49ef-9348-8d3927b32164 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:35.969908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5becd4-4c7a-49ef-9348-8d3927b32164 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:35.970941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5becd4-4c7a-49ef-9348-8d3927b32164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:35.973408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5becd4-4c7a-49ef-9348-8d3927b32164 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:35.996573 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3082/6093] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:35 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:36.001274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1ea5e-317f-4b46-b53f-375df2830f3b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:36.019053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1ea5e-317f-4b46-b53f-375df2830f3b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:36.031840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed30cb-e75d-4e55-97c6-692f40f0ec6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:36.032963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed30cb-e75d-4e55-97c6-692f40f0ec6d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:36.034785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed30cb-e75d-4e55-97c6-692f40f0ec6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:36.036067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed30cb-e75d-4e55-97c6-692f40f0ec6d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:36.037566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed30cb-e75d-4e55-97c6-692f40f0ec6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:36.051733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed30cb-e75d-4e55-97c6-692f40f0ec6d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:36.075573 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3012/6094] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:36 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:36.076545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5becd4-4c7a-49ef-9348-8d3927b32164 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:36.098578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5becd4-4c7a-49ef-9348-8d3927b32164 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:36.111906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595db72-e737-4caa-b82a-358bb6f68902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:36.113169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595db72-e737-4caa-b82a-358bb6f68902 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:36.113555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595db72-e737-4caa-b82a-358bb6f68902 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:36.114370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595db72-e737-4caa-b82a-358bb6f68902 admin admin] PATH_INFO: `/v3/projects/9bee35aa33f543b78c8b94015c82519b/users/ec8bf5b08c2b4553b607fdd0d9ecc551/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:36.157315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595db72-e737-4caa-b82a-358bb6f68902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bee35aa33f543b78c8b94015c82519b, user_id=ec8bf5b08c2b4553b607fdd0d9ecc551, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:36.160285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595db72-e737-4caa-b82a-358bb6f68902 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:36.198926 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3083/6095] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:36 2021] PUT /identity/v3/projects/9bee35aa33f543b78c8b94015c82519b/users/ec8bf5b08c2b4553b607fdd0d9ecc551/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:04:36.210504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf17d4c-619a-4c4d-a176-d246c0500c50 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:36.211088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf17d4c-619a-4c4d-a176-d246c0500c50 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:36.211539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf17d4c-619a-4c4d-a176-d246c0500c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:36.242010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595db72-e737-4caa-b82a-358bb6f68902 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:36.246765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1595db72-e737-4caa-b82a-358bb6f68902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:36.285860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2bf17d4c-619a-4c4d-a176-d246c0500c50 None None] MFA Rules not processed for user `ec8bf5b08c2b4553b607fdd0d9ecc551`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:36.287890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2bf17d4c-619a-4c4d-a176-d246c0500c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:36.375945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595db72-e737-4caa-b82a-358bb6f68902 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:36.383773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe91a3-38e3-4988-827f-6f2cd15505c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:36.384704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe91a3-38e3-4988-827f-6f2cd15505c3 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:36.385195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe91a3-38e3-4988-827f-6f2cd15505c3 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:36.386207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe91a3-38e3-4988-827f-6f2cd15505c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:36.389520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-eefe91a3-38e3-4988-827f-6f2cd15505c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:36.406823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe91a3-38e3-4988-827f-6f2cd15505c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:36.409654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe91a3-38e3-4988-827f-6f2cd15505c3 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:36.414205 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3013/6096] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:36 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:04:36.415490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf17d4c-619a-4c4d-a176-d246c0500c50 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:36.417592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2bf17d4c-619a-4c4d-a176-d246c0500c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:36.434771 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3084/6097] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:36 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:04:36.436669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe91a3-38e3-4988-827f-6f2cd15505c3 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:36.443674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-eefe91a3-38e3-4988-827f-6f2cd15505c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:36.454857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf17d4c-619a-4c4d-a176-d246c0500c50 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:36.463730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbea79d-ea5f-4423-967b-a14e90120945 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:36.464868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbea79d-ea5f-4423-967b-a14e90120945 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:36.468257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbea79d-ea5f-4423-967b-a14e90120945 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:36.469260 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbea79d-ea5f-4423-967b-a14e90120945 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:36.472339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-abbea79d-ea5f-4423-967b-a14e90120945 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:36.498805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbea79d-ea5f-4423-967b-a14e90120945 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:36.500949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbea79d-ea5f-4423-967b-a14e90120945 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:36.567110 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3014/6098] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:36 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:04:36.569299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95818c0-e20c-4bff-af5d-3c21ec622ca3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:36.569622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95818c0-e20c-4bff-af5d-3c21ec622ca3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:36.569977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95818c0-e20c-4bff-af5d-3c21ec622ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:36.586088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe91a3-38e3-4988-827f-6f2cd15505c3 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:36.597828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad12595-9de7-4467-b6c4-c87dd710a86f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:36.598568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad12595-9de7-4467-b6c4-c87dd710a86f service glance] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:36.598852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad12595-9de7-4467-b6c4-c87dd710a86f service glance] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:36.599164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad12595-9de7-4467-b6c4-c87dd710a86f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:36.602124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b95818c0-e20c-4bff-af5d-3c21ec622ca3 None None] MFA Rules not processed for user `0a98795bdb7447c5b2a4930173b3c56d`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:36.603940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b95818c0-e20c-4bff-af5d-3c21ec622ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:36.701179 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3015/6099] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:36 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:36.710319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad12595-9de7-4467-b6c4-c87dd710a86f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:36.711888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad12595-9de7-4467-b6c4-c87dd710a86f service glance] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:36.730798 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3085/6100] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:36 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:04:36.864487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95818c0-e20c-4bff-af5d-3c21ec622ca3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:36.866628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b95818c0-e20c-4bff-af5d-3c21ec622ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:36.886580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95818c0-e20c-4bff-af5d-3c21ec622ca3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:36.892931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2890d-323b-477e-a2fc-545a7a3bb151 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:36.893920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2890d-323b-477e-a2fc-545a7a3bb151 service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:36.894476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2890d-323b-477e-a2fc-545a7a3bb151 service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:36.895027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2890d-323b-477e-a2fc-545a7a3bb151 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:36.909209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2890d-323b-477e-a2fc-545a7a3bb151 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:36.910992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2890d-323b-477e-a2fc-545a7a3bb151 service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:36.921376 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3016/6101] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:36 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:04:37.453578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad12595-9de7-4467-b6c4-c87dd710a86f service glance] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:37.552296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad12595-9de7-4467-b6c4-c87dd710a86f service glance] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:37.560255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10d855-3b86-4134-b75a-a6a7354202be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:37.569261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10d855-3b86-4134-b75a-a6a7354202be admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:37.569967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10d855-3b86-4134-b75a-a6a7354202be admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:37.570567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10d855-3b86-4134-b75a-a6a7354202be admin admin] PATH_INFO: `/v3/users/53873a619e044efb98445226c0b62e4e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:37.572301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10d855-3b86-4134-b75a-a6a7354202be admin admin] RBAC: Authorizing `identity:delete_user(user_id=53873a619e044efb98445226c0b62e4e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:37.575306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10d855-3b86-4134-b75a-a6a7354202be admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:37.669362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6c10d855-3b86-4134-b75a-a6a7354202be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53873a619e044efb98445226c0b62e4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:37.681842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6c10d855-3b86-4134-b75a-a6a7354202be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53873a619e044efb98445226c0b62e4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:37.682666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6c10d855-3b86-4134-b75a-a6a7354202be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53873a619e044efb98445226c0b62e4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:37.703401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6c10d855-3b86-4134-b75a-a6a7354202be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53873a619e044efb98445226c0b62e4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:37.720587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6c10d855-3b86-4134-b75a-a6a7354202be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53873a619e044efb98445226c0b62e4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:37.730581 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3086/6102] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:37 2021] DELETE /identity/v3/users/53873a619e044efb98445226c0b62e4e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:37.742279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87940751-c11a-4bfc-bc01-9044464a9a08 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:37.743187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87940751-c11a-4bfc-bc01-9044464a9a08 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:37.743676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87940751-c11a-4bfc-bc01-9044464a9a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:37.767611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-87940751-c11a-4bfc-bc01-9044464a9a08 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:37.769181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-87940751-c11a-4bfc-bc01-9044464a9a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:37.859854 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3017/6103] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:37.900548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10d855-3b86-4134-b75a-a6a7354202be admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:37.902360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6c10d855-3b86-4134-b75a-a6a7354202be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:38.037900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10d855-3b86-4134-b75a-a6a7354202be admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:38.052388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14ddc7-9d37-4856-b9f4-22628ce32467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:38.053075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14ddc7-9d37-4856-b9f4-22628ce32467 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:38.053462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14ddc7-9d37-4856-b9f4-22628ce32467 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:38.053670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14ddc7-9d37-4856-b9f4-22628ce32467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:38.077940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14ddc7-9d37-4856-b9f4-22628ce32467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:38.079363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14ddc7-9d37-4856-b9f4-22628ce32467 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:38.094577 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3087/6104] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:04:39.622993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87940751-c11a-4bfc-bc01-9044464a9a08 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:39.625382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-87940751-c11a-4bfc-bc01-9044464a9a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:39.674625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87940751-c11a-4bfc-bc01-9044464a9a08 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:39.683195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11defdeb-a955-4e32-88df-883443b0d36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:39.684265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11defdeb-a955-4e32-88df-883443b0d36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:39.684829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11defdeb-a955-4e32-88df-883443b0d36c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:39.685395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11defdeb-a955-4e32-88df-883443b0d36c admin admin] PATH_INFO: `/v3/projects/4bd3004b09cc43788ab39a3fdee80229` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:39.687023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11defdeb-a955-4e32-88df-883443b0d36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd3004b09cc43788ab39a3fdee80229)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:39.689685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11defdeb-a955-4e32-88df-883443b0d36c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:39.841103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-11defdeb-a955-4e32-88df-883443b0d36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd3004b09cc43788ab39a3fdee80229', 'request_id': 'req-11defdeb-a955-4e32-88df-883443b0d36c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:39.851534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-11defdeb-a955-4e32-88df-883443b0d36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd3004b09cc43788ab39a3fdee80229', 'request_id': 'req-11defdeb-a955-4e32-88df-883443b0d36c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:39.879842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-11defdeb-a955-4e32-88df-883443b0d36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd3004b09cc43788ab39a3fdee80229', 'request_id': 'req-11defdeb-a955-4e32-88df-883443b0d36c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:39.882758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14ddc7-9d37-4856-b9f4-22628ce32467 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:39.884183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5d14ddc7-9d37-4856-b9f4-22628ce32467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:39.921947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-11defdeb-a955-4e32-88df-883443b0d36c admin admin] The token cache is being invalidate because project 4bd3004b09cc43788ab39a3fdee80229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:39.922274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-11defdeb-a955-4e32-88df-883443b0d36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:39.933931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-11defdeb-a955-4e32-88df-883443b0d36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:39.941205 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3018/6105] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:04:39 2021] DELETE /identity/v3/projects/4bd3004b09cc43788ab39a3fdee80229 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:39.945964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11defdeb-a955-4e32-88df-883443b0d36c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:39.948828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-11defdeb-a955-4e32-88df-883443b0d36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:40.112659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14ddc7-9d37-4856-b9f4-22628ce32467 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:40.246243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11defdeb-a955-4e32-88df-883443b0d36c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:40.263448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2068b5-09f6-4903-ae60-815ee6611012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:40.264270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2068b5-09f6-4903-ae60-815ee6611012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:40.264553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2068b5-09f6-4903-ae60-815ee6611012 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:40.264830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2068b5-09f6-4903-ae60-815ee6611012 admin admin] PATH_INFO: `/v3/users/ec8bf5b08c2b4553b607fdd0d9ecc551` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:40.272182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2068b5-09f6-4903-ae60-815ee6611012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8bf5b08c2b4553b607fdd0d9ecc551)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:40.281060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2068b5-09f6-4903-ae60-815ee6611012 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:40.294276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380debc-8ef3-4edb-bd7f-6007b32856e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:40.301756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380debc-8ef3-4edb-bd7f-6007b32856e3 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:40.307722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380debc-8ef3-4edb-bd7f-6007b32856e3 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:40.311776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380debc-8ef3-4edb-bd7f-6007b32856e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:40.315713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6380debc-8ef3-4edb-bd7f-6007b32856e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:40.348175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380debc-8ef3-4edb-bd7f-6007b32856e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:40.349938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380debc-8ef3-4edb-bd7f-6007b32856e3 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:40.376491 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3088/6106] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:39 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:04:40.387321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380debc-8ef3-4edb-bd7f-6007b32856e3 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:40.389194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6380debc-8ef3-4edb-bd7f-6007b32856e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:40.415891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380debc-8ef3-4edb-bd7f-6007b32856e3 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:40.433704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15caf15-8b97-49c5-bd3a-49ec8f2a0450 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:40.434880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15caf15-8b97-49c5-bd3a-49ec8f2a0450 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:40.434880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15caf15-8b97-49c5-bd3a-49ec8f2a0450 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:40.435253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15caf15-8b97-49c5-bd3a-49ec8f2a0450 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:40.447158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3d2068b5-09f6-4903-ae60-815ee6611012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8bf5b08c2b4553b607fdd0d9ecc551'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:40.462040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15caf15-8b97-49c5-bd3a-49ec8f2a0450 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:40.464181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15caf15-8b97-49c5-bd3a-49ec8f2a0450 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:40.464709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3d2068b5-09f6-4903-ae60-815ee6611012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8bf5b08c2b4553b607fdd0d9ecc551'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:40.489337 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3089/6107] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:40 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:04:40.490767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3d2068b5-09f6-4903-ae60-815ee6611012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8bf5b08c2b4553b607fdd0d9ecc551'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:40.493958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3d2068b5-09f6-4903-ae60-815ee6611012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8bf5b08c2b4553b607fdd0d9ecc551'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:40.504052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3d2068b5-09f6-4903-ae60-815ee6611012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8bf5b08c2b4553b607fdd0d9ecc551'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:40.519462 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3019/6108] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:39 2021] DELETE /identity/v3/users/ec8bf5b08c2b4553b607fdd0d9ecc551 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:04:42.225872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15caf15-8b97-49c5-bd3a-49ec8f2a0450 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:42.241686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15caf15-8b97-49c5-bd3a-49ec8f2a0450 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:42.409258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5476502-f1f7-45f2-98d7-958571a69b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:42.410781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5476502-f1f7-45f2-98d7-958571a69b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:42.411925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5476502-f1f7-45f2-98d7-958571a69b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:42.413011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5476502-f1f7-45f2-98d7-958571a69b4e admin admin] PATH_INFO: `/v3/projects/9bee35aa33f543b78c8b94015c82519b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:42.414855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5476502-f1f7-45f2-98d7-958571a69b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bee35aa33f543b78c8b94015c82519b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:42.418107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5476502-f1f7-45f2-98d7-958571a69b4e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:42.499534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e5476502-f1f7-45f2-98d7-958571a69b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bee35aa33f543b78c8b94015c82519b', 'request_id': 'req-e5476502-f1f7-45f2-98d7-958571a69b4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:42.509910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e5476502-f1f7-45f2-98d7-958571a69b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bee35aa33f543b78c8b94015c82519b', 'request_id': 'req-e5476502-f1f7-45f2-98d7-958571a69b4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:42.525228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e5476502-f1f7-45f2-98d7-958571a69b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bee35aa33f543b78c8b94015c82519b', 'request_id': 'req-e5476502-f1f7-45f2-98d7-958571a69b4e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:42.543060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e5476502-f1f7-45f2-98d7-958571a69b4e admin admin] The token cache is being invalidate because project 9bee35aa33f543b78c8b94015c82519b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:42.545211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e5476502-f1f7-45f2-98d7-958571a69b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:42.547704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e5476502-f1f7-45f2-98d7-958571a69b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:42.550889 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3090/6109] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:04:42 2021] DELETE /identity/v3/projects/9bee35aa33f543b78c8b94015c82519b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:42.558413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b223e-28ec-406d-a72d-acc51a537713 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:42.558937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b223e-28ec-406d-a72d-acc51a537713 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:42.559052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b223e-28ec-406d-a72d-acc51a537713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:42.578498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5e4b223e-28ec-406d-a72d-acc51a537713 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:42.579740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5e4b223e-28ec-406d-a72d-acc51a537713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:42.661841 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3020/6110] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:42.670287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac4ad6-1230-433f-9ba2-29ac37f612e5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:42.670610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac4ad6-1230-433f-9ba2-29ac37f612e5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:42.670934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac4ad6-1230-433f-9ba2-29ac37f612e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:42.693909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2aac4ad6-1230-433f-9ba2-29ac37f612e5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:42.696262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2aac4ad6-1230-433f-9ba2-29ac37f612e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:42.713113 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3091/6111] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:42.713665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b223e-28ec-406d-a72d-acc51a537713 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:42.727460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b223e-28ec-406d-a72d-acc51a537713 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:42.736072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36884a6c-68fa-4e75-abc1-71c590c8e33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:42.737151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36884a6c-68fa-4e75-abc1-71c590c8e33f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:42.737784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36884a6c-68fa-4e75-abc1-71c590c8e33f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:42.738441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36884a6c-68fa-4e75-abc1-71c590c8e33f admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:42.739940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36884a6c-68fa-4e75-abc1-71c590c8e33f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:04:42.740537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36884a6c-68fa-4e75-abc1-71c590c8e33f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:42.743777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36884a6c-68fa-4e75-abc1-71c590c8e33f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:42.761165 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3021/6112] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:04:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:04:42.766124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac4ad6-1230-433f-9ba2-29ac37f612e5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:42.778764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac4ad6-1230-433f-9ba2-29ac37f612e5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:42.790621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe5bad-a0f6-4ce8-8ad0-bfc90396d7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:42.792066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe5bad-a0f6-4ce8-8ad0-bfc90396d7cc admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:42.792484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe5bad-a0f6-4ce8-8ad0-bfc90396d7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:42.793025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe5bad-a0f6-4ce8-8ad0-bfc90396d7cc admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:42.794138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe5bad-a0f6-4ce8-8ad0-bfc90396d7cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:42.797005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe5bad-a0f6-4ce8-8ad0-bfc90396d7cc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:42.891746 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3092/6113] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:04:42 2021] POST /identity/v3/projects => generated 407 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:42.896310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36884a6c-68fa-4e75-abc1-71c590c8e33f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:42.912316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36884a6c-68fa-4e75-abc1-71c590c8e33f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:43.038028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2ec75-1f44-456a-98d6-7886f3decb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:43.038520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2ec75-1f44-456a-98d6-7886f3decb93 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:43.038812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2ec75-1f44-456a-98d6-7886f3decb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:43.039091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2ec75-1f44-456a-98d6-7886f3decb93 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:43.039812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2ec75-1f44-456a-98d6-7886f3decb93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:43.041786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2ec75-1f44-456a-98d6-7886f3decb93 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:43.099846 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3022/6114] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:04:42 2021] POST /identity/v3/users => generated 304 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:43.101170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe5bad-a0f6-4ce8-8ad0-bfc90396d7cc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:43.121126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe5bad-a0f6-4ce8-8ad0-bfc90396d7cc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:43.130725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260813f-279c-41ff-8024-be2911017c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:43.131564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260813f-279c-41ff-8024-be2911017c5b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:43.131942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260813f-279c-41ff-8024-be2911017c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:43.132313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260813f-279c-41ff-8024-be2911017c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:43.133172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260813f-279c-41ff-8024-be2911017c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:43.135625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260813f-279c-41ff-8024-be2911017c5b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:43.159352 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3093/6115] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:43 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:43.161321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2ec75-1f44-456a-98d6-7886f3decb93 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:43.181301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2ec75-1f44-456a-98d6-7886f3decb93 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:43.189465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3b420-5d00-4140-9e5e-f3005697abf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:43.191091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3b420-5d00-4140-9e5e-f3005697abf3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:43.191693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3b420-5d00-4140-9e5e-f3005697abf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:43.193050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3b420-5d00-4140-9e5e-f3005697abf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:43.194606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3b420-5d00-4140-9e5e-f3005697abf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:43.196644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3b420-5d00-4140-9e5e-f3005697abf3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:43.221404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260813f-279c-41ff-8024-be2911017c5b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:43.228880 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3023/6116] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:43 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:43.235540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260813f-279c-41ff-8024-be2911017c5b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:43.243752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36c4da-2a80-4af7-ab1f-76441168a663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:43.244848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36c4da-2a80-4af7-ab1f-76441168a663 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:43.245132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36c4da-2a80-4af7-ab1f-76441168a663 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:43.245557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36c4da-2a80-4af7-ab1f-76441168a663 admin admin] PATH_INFO: `/v3/projects/158bb719e22c4eebb0703aa8f4251ce2/users/21fdd9b4fa3a4b308d5304be8cddb8fe/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:43.279379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36c4da-2a80-4af7-ab1f-76441168a663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=158bb719e22c4eebb0703aa8f4251ce2, user_id=21fdd9b4fa3a4b308d5304be8cddb8fe, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:43.283278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36c4da-2a80-4af7-ab1f-76441168a663 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:43.344288 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3094/6117] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:43 2021] PUT /identity/v3/projects/158bb719e22c4eebb0703aa8f4251ce2/users/21fdd9b4fa3a4b308d5304be8cddb8fe/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:43.356759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fee8c0-2a06-439f-86ec-6e6d0885a313 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:43.357139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fee8c0-2a06-439f-86ec-6e6d0885a313 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:43.357493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fee8c0-2a06-439f-86ec-6e6d0885a313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:43.388658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-49fee8c0-2a06-439f-86ec-6e6d0885a313 None None] MFA Rules not processed for user `21fdd9b4fa3a4b308d5304be8cddb8fe`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:43.389982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-49fee8c0-2a06-439f-86ec-6e6d0885a313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:43.510126 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3024/6118] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:43 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:43.515367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36c4da-2a80-4af7-ab1f-76441168a663 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:43.686421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36c4da-2a80-4af7-ab1f-76441168a663 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:43.701638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca21b53-9884-45c4-b5e2-517f41516e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:43.702678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca21b53-9884-45c4-b5e2-517f41516e5c admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:43.703232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca21b53-9884-45c4-b5e2-517f41516e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:43.703414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca21b53-9884-45c4-b5e2-517f41516e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:43.704359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca21b53-9884-45c4-b5e2-517f41516e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:43.707098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca21b53-9884-45c4-b5e2-517f41516e5c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:43.778975 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3095/6119] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:04:43 2021] POST /identity/v3/projects => generated 407 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:43.783853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fee8c0-2a06-439f-86ec-6e6d0885a313 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:43.800205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fee8c0-2a06-439f-86ec-6e6d0885a313 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:43.917023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b21c4-fac5-4f58-9afc-8d6d5cddf556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:43.917914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b21c4-fac5-4f58-9afc-8d6d5cddf556 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:43.918346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b21c4-fac5-4f58-9afc-8d6d5cddf556 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:43.918722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b21c4-fac5-4f58-9afc-8d6d5cddf556 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:43.919812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b21c4-fac5-4f58-9afc-8d6d5cddf556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:43.922880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b21c4-fac5-4f58-9afc-8d6d5cddf556 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:43.963570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca21b53-9884-45c4-b5e2-517f41516e5c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:43.965329 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3025/6120] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:04:43 2021] POST /identity/v3/users => generated 310 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:43.996462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca21b53-9884-45c4-b5e2-517f41516e5c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:44.007966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61b360-c728-4dbd-b7b1-0bbd49aba5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:44.008959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61b360-c728-4dbd-b7b1-0bbd49aba5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:44.009690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61b360-c728-4dbd-b7b1-0bbd49aba5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:44.010035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61b360-c728-4dbd-b7b1-0bbd49aba5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:44.010944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61b360-c728-4dbd-b7b1-0bbd49aba5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:44.013365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61b360-c728-4dbd-b7b1-0bbd49aba5c5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:44.054241 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3096/6121] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:43 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:44.065717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b21c4-fac5-4f58-9afc-8d6d5cddf556 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:44.107381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b21c4-fac5-4f58-9afc-8d6d5cddf556 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:44.144101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6a545-28ec-4546-bab2-2c721719cb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:44.146496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6a545-28ec-4546-bab2-2c721719cb56 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:44.147056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6a545-28ec-4546-bab2-2c721719cb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:44.150285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6a545-28ec-4546-bab2-2c721719cb56 admin admin] PATH_INFO: `/v3/projects/a896dbe6d5e04936beef4d9a2e198e42/users/b1b3ddd31bc444d28290b5b15ef13ffe/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:44.181014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6a545-28ec-4546-bab2-2c721719cb56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a896dbe6d5e04936beef4d9a2e198e42, user_id=b1b3ddd31bc444d28290b5b15ef13ffe, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:44.184862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6a545-28ec-4546-bab2-2c721719cb56 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:44.215205 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3026/6122] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:44 2021] PUT /identity/v3/projects/a896dbe6d5e04936beef4d9a2e198e42/users/b1b3ddd31bc444d28290b5b15ef13ffe/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:44.216222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61b360-c728-4dbd-b7b1-0bbd49aba5c5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:44.233281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61b360-c728-4dbd-b7b1-0bbd49aba5c5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:44.329919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ff932-1d5d-4ed9-8f2d-65718670eb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:44.330691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ff932-1d5d-4ed9-8f2d-65718670eb2f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:44.331255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ff932-1d5d-4ed9-8f2d-65718670eb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:44.331612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ff932-1d5d-4ed9-8f2d-65718670eb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:44.332403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ff932-1d5d-4ed9-8f2d-65718670eb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:44.334599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ff932-1d5d-4ed9-8f2d-65718670eb2f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:44.370523 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3097/6123] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:44 2021] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:44.377537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6a545-28ec-4546-bab2-2c721719cb56 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:44.392091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6a545-28ec-4546-bab2-2c721719cb56 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:44.400582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee60e0-718a-40cb-be10-8c42b80f8ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:44.401714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee60e0-718a-40cb-be10-8c42b80f8ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:44.402116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee60e0-718a-40cb-be10-8c42b80f8ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:44.402544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee60e0-718a-40cb-be10-8c42b80f8ae9 admin admin] PATH_INFO: `/v3/projects/a896dbe6d5e04936beef4d9a2e198e42/users/b1b3ddd31bc444d28290b5b15ef13ffe/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:44.405597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee60e0-718a-40cb-be10-8c42b80f8ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a896dbe6d5e04936beef4d9a2e198e42, user_id=b1b3ddd31bc444d28290b5b15ef13ffe, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:44.420297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee60e0-718a-40cb-be10-8c42b80f8ae9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:44.464533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f39d-064d-4fd0-b2b2-ba6730da0214 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:44.464832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f39d-064d-4fd0-b2b2-ba6730da0214 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:44.465919 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3027/6124] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:44 2021] PUT /identity/v3/projects/a896dbe6d5e04936beef4d9a2e198e42/users/b1b3ddd31bc444d28290b5b15ef13ffe/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:44.466987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f39d-064d-4fd0-b2b2-ba6730da0214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:44.522896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f419f39d-064d-4fd0-b2b2-ba6730da0214 None None] MFA Rules not processed for user `b1b3ddd31bc444d28290b5b15ef13ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:44.527208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f419f39d-064d-4fd0-b2b2-ba6730da0214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:44.749282 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3098/6125] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:44 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:44.781300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee60e0-718a-40cb-be10-8c42b80f8ae9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:44.782621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-28ee60e0-718a-40cb-be10-8c42b80f8ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:44.894741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee60e0-718a-40cb-be10-8c42b80f8ae9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:44.900149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292039d-b516-4fca-80b5-4faf0e1d8fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:44.900909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292039d-b516-4fca-80b5-4faf0e1d8fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:44.901263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292039d-b516-4fca-80b5-4faf0e1d8fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:44.901606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292039d-b516-4fca-80b5-4faf0e1d8fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:45.025007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292039d-b516-4fca-80b5-4faf0e1d8fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:45.027329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292039d-b516-4fca-80b5-4faf0e1d8fd5 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:45.043670 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3028/6126] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:44 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:04:46.628800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419f39d-064d-4fd0-b2b2-ba6730da0214 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:46.632855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f419f39d-064d-4fd0-b2b2-ba6730da0214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:46.808756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419f39d-064d-4fd0-b2b2-ba6730da0214 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:46.830064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f82010-6750-4f61-a6f0-300836af1348 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:46.830854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f82010-6750-4f61-a6f0-300836af1348 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:46.831140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f82010-6750-4f61-a6f0-300836af1348 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:46.831507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f82010-6750-4f61-a6f0-300836af1348 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:46.856916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f82010-6750-4f61-a6f0-300836af1348 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:46.859003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f82010-6750-4f61-a6f0-300836af1348 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:46.892482 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3099/6127] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:46 2021] GET /identity/v3/auth/tokens => generated 3341 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:04:48.943075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292039d-b516-4fca-80b5-4faf0e1d8fd5 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:48.944607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d292039d-b516-4fca-80b5-4faf0e1d8fd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:49.025069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292039d-b516-4fca-80b5-4faf0e1d8fd5 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:49.032243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d201c-1dd4-4e3c-9b82-9e099928b1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:49.033396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d201c-1dd4-4e3c-9b82-9e099928b1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:49.033692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d201c-1dd4-4e3c-9b82-9e099928b1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:49.033974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d201c-1dd4-4e3c-9b82-9e099928b1f7 admin admin] PATH_INFO: `/v3/users/74f5438a009546f7b55a12e9d1d431aa` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:49.035253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d201c-1dd4-4e3c-9b82-9e099928b1f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f5438a009546f7b55a12e9d1d431aa)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:49.037742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d201c-1dd4-4e3c-9b82-9e099928b1f7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:49.114196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-af2d201c-1dd4-4e3c-9b82-9e099928b1f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f5438a009546f7b55a12e9d1d431aa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:49.125667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-af2d201c-1dd4-4e3c-9b82-9e099928b1f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f5438a009546f7b55a12e9d1d431aa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:49.139131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-af2d201c-1dd4-4e3c-9b82-9e099928b1f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f5438a009546f7b55a12e9d1d431aa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:49.139864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-af2d201c-1dd4-4e3c-9b82-9e099928b1f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f5438a009546f7b55a12e9d1d431aa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:49.152014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-af2d201c-1dd4-4e3c-9b82-9e099928b1f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f5438a009546f7b55a12e9d1d431aa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:49.161777 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3029/6128] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:04:48 2021] DELETE /identity/v3/users/74f5438a009546f7b55a12e9d1d431aa => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:49.163600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca18cd-90be-4821-adbf-1708c47e7e28 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:49.164162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca18cd-90be-4821-adbf-1708c47e7e28 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:49.164162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca18cd-90be-4821-adbf-1708c47e7e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:49.181998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-00ca18cd-90be-4821-adbf-1708c47e7e28 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:49.183258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-00ca18cd-90be-4821-adbf-1708c47e7e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:49.262130 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3100/6129] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:49.274465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d201c-1dd4-4e3c-9b82-9e099928b1f7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:49.277520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-af2d201c-1dd4-4e3c-9b82-9e099928b1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:49.370654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d201c-1dd4-4e3c-9b82-9e099928b1f7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:49.375331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3b021-944a-4532-a438-579b5bfb28b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:49.376106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3b021-944a-4532-a438-579b5bfb28b0 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:49.376492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3b021-944a-4532-a438-579b5bfb28b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:49.377205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3b021-944a-4532-a438-579b5bfb28b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:49.391386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3b021-944a-4532-a438-579b5bfb28b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:49.393162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3b021-944a-4532-a438-579b5bfb28b0 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:49.410674 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3030/6130] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:04:49.772742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca18cd-90be-4821-adbf-1708c47e7e28 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:49.774213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-00ca18cd-90be-4821-adbf-1708c47e7e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:49.789675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca18cd-90be-4821-adbf-1708c47e7e28 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:49.802808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66065988-3bfa-4b47-b7e5-22dc91723752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:49.803680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66065988-3bfa-4b47-b7e5-22dc91723752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:49.803956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66065988-3bfa-4b47-b7e5-22dc91723752 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:49.804641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66065988-3bfa-4b47-b7e5-22dc91723752 admin admin] PATH_INFO: `/v3/projects/080440e3f2634c21949255c525aa91c6` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:49.807030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66065988-3bfa-4b47-b7e5-22dc91723752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=080440e3f2634c21949255c525aa91c6)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:49.810082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66065988-3bfa-4b47-b7e5-22dc91723752 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:49.876092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-66065988-3bfa-4b47-b7e5-22dc91723752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '080440e3f2634c21949255c525aa91c6', 'request_id': 'req-66065988-3bfa-4b47-b7e5-22dc91723752'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:49.884460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-66065988-3bfa-4b47-b7e5-22dc91723752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '080440e3f2634c21949255c525aa91c6', 'request_id': 'req-66065988-3bfa-4b47-b7e5-22dc91723752'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:49.893557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-66065988-3bfa-4b47-b7e5-22dc91723752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '080440e3f2634c21949255c525aa91c6', 'request_id': 'req-66065988-3bfa-4b47-b7e5-22dc91723752'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:49.911628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-66065988-3bfa-4b47-b7e5-22dc91723752 admin admin] The token cache is being invalidate because project 080440e3f2634c21949255c525aa91c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:04:49.911935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-66065988-3bfa-4b47-b7e5-22dc91723752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:49.912620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-66065988-3bfa-4b47-b7e5-22dc91723752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:04:49.915221 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3101/6131] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:04:49 2021] DELETE /identity/v3/projects/080440e3f2634c21949255c525aa91c6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:04:49.920560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52782c0-bd6e-4aea-a540-c48c74e7ecb7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:49.920864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52782c0-bd6e-4aea-a540-c48c74e7ecb7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:49.921129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52782c0-bd6e-4aea-a540-c48c74e7ecb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:49.941035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d52782c0-bd6e-4aea-a540-c48c74e7ecb7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:49.942574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d52782c0-bd6e-4aea-a540-c48c74e7ecb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:50.053719 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3031/6132] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:50.061328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e3450-a42d-4515-808f-3a23d811e9c5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:50.061843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e3450-a42d-4515-808f-3a23d811e9c5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:50.062322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e3450-a42d-4515-808f-3a23d811e9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:50.084739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ae6e3450-a42d-4515-808f-3a23d811e9c5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:50.085977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ae6e3450-a42d-4515-808f-3a23d811e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:50.094181 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3102/6133] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:50.099755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52782c0-bd6e-4aea-a540-c48c74e7ecb7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:50.109383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52782c0-bd6e-4aea-a540-c48c74e7ecb7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:50.113981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59decec-b12c-4e29-a28d-bc6307a6a655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:50.115286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59decec-b12c-4e29-a28d-bc6307a6a655 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:50.115634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59decec-b12c-4e29-a28d-bc6307a6a655 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:50.115976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59decec-b12c-4e29-a28d-bc6307a6a655 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:50.116784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59decec-b12c-4e29-a28d-bc6307a6a655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:04:50.117153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59decec-b12c-4e29-a28d-bc6307a6a655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:50.118858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59decec-b12c-4e29-a28d-bc6307a6a655 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:50.130938 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3032/6134] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:04:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:04:50.135415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e3450-a42d-4515-808f-3a23d811e9c5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:50.145239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e3450-a42d-4515-808f-3a23d811e9c5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:50.150028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc70bf-bb0b-4496-846c-f8512585ec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:50.150718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc70bf-bb0b-4496-846c-f8512585ec0f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:50.151004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc70bf-bb0b-4496-846c-f8512585ec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:50.151280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc70bf-bb0b-4496-846c-f8512585ec0f admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:50.152024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc70bf-bb0b-4496-846c-f8512585ec0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:50.153919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc70bf-bb0b-4496-846c-f8512585ec0f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:50.182126 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3103/6135] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:04:50 2021] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:04:50.186268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59decec-b12c-4e29-a28d-bc6307a6a655 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:50.196564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59decec-b12c-4e29-a28d-bc6307a6a655 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:50.260751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15919b-d476-4744-8a4e-6589d472b39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:50.261493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15919b-d476-4744-8a4e-6589d472b39c admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:50.261785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15919b-d476-4744-8a4e-6589d472b39c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:50.262064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15919b-d476-4744-8a4e-6589d472b39c admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:50.262818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15919b-d476-4744-8a4e-6589d472b39c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:50.264740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15919b-d476-4744-8a4e-6589d472b39c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:50.288408 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3033/6136] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:04:50 2021] POST /identity/v3/users => generated 279 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:04:50.292415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc70bf-bb0b-4496-846c-f8512585ec0f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:50.303681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc70bf-bb0b-4496-846c-f8512585ec0f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:50.309734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103278ca-9345-4ae4-a837-c9d294373b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:50.310534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103278ca-9345-4ae4-a837-c9d294373b2b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:50.311069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103278ca-9345-4ae4-a837-c9d294373b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:50.311444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103278ca-9345-4ae4-a837-c9d294373b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:50.312407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103278ca-9345-4ae4-a837-c9d294373b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:50.314235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103278ca-9345-4ae4-a837-c9d294373b2b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:50.325995 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3104/6137] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:50 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:50.330242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15919b-d476-4744-8a4e-6589d472b39c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:50.342762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15919b-d476-4744-8a4e-6589d472b39c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:50.349381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94450a3-6dad-4d7f-a33e-c95d2e543148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:50.350158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94450a3-6dad-4d7f-a33e-c95d2e543148 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:50.350544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94450a3-6dad-4d7f-a33e-c95d2e543148 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:50.350884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94450a3-6dad-4d7f-a33e-c95d2e543148 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:50.352067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94450a3-6dad-4d7f-a33e-c95d2e543148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:50.354056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94450a3-6dad-4d7f-a33e-c95d2e543148 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:50.365953 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3034/6138] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:04:50 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:04:50.370470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103278ca-9345-4ae4-a837-c9d294373b2b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:50.381693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103278ca-9345-4ae4-a837-c9d294373b2b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:50.388232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cbd66-dc78-4dd2-814b-ba22ce1717e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:50.389290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cbd66-dc78-4dd2-814b-ba22ce1717e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:50.389846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cbd66-dc78-4dd2-814b-ba22ce1717e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:50.390426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cbd66-dc78-4dd2-814b-ba22ce1717e4 admin admin] PATH_INFO: `/v3/projects/601f039e95d94afdbbb097bf19996949/users/a03dfb1dff39427d8c116732d536787a/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:50.408364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cbd66-dc78-4dd2-814b-ba22ce1717e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=601f039e95d94afdbbb097bf19996949, user_id=a03dfb1dff39427d8c116732d536787a, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:50.411958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cbd66-dc78-4dd2-814b-ba22ce1717e4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:50.427859 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3105/6139] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:04:50 2021] PUT /identity/v3/projects/601f039e95d94afdbbb097bf19996949/users/a03dfb1dff39427d8c116732d536787a/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:04:50.439692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151341f3-d0bd-4779-96a3-28662f51679f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:50.440234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151341f3-d0bd-4779-96a3-28662f51679f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:50.440589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151341f3-d0bd-4779-96a3-28662f51679f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:50.476565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-151341f3-d0bd-4779-96a3-28662f51679f None None] MFA Rules not processed for user `a03dfb1dff39427d8c116732d536787a`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:04:50.478302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-151341f3-d0bd-4779-96a3-28662f51679f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:50.578146 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3035/6140] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:04:50 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:04:50.585641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cbd66-dc78-4dd2-814b-ba22ce1717e4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:04:50.587572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c26cbd66-dc78-4dd2-814b-ba22ce1717e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:04:50.658920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cbd66-dc78-4dd2-814b-ba22ce1717e4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:04:50.663952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf3750-c354-4b59-a4e5-b92f3535338e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:04:50.664170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf3750-c354-4b59-a4e5-b92f3535338e service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:04:50.664468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf3750-c354-4b59-a4e5-b92f3535338e service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:04:50.664818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf3750-c354-4b59-a4e5-b92f3535338e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:04:50.674641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf3750-c354-4b59-a4e5-b92f3535338e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:04:50.677586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf3750-c354-4b59-a4e5-b92f3535338e service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:04:50.688937 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3106/6141] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:04:50 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:05:03.782448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151341f3-d0bd-4779-96a3-28662f51679f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:03.784378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-151341f3-d0bd-4779-96a3-28662f51679f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:03.903618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151341f3-d0bd-4779-96a3-28662f51679f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:03.938209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9069a-092f-48fc-b226-94394dbbcff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:03.939413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9069a-092f-48fc-b226-94394dbbcff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:03.951698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9069a-092f-48fc-b226-94394dbbcff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:03.953561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9069a-092f-48fc-b226-94394dbbcff5 admin admin] PATH_INFO: `/v3/users/21fdd9b4fa3a4b308d5304be8cddb8fe` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:03.958106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9069a-092f-48fc-b226-94394dbbcff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21fdd9b4fa3a4b308d5304be8cddb8fe)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:03.964919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9069a-092f-48fc-b226-94394dbbcff5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:04.070759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ead9069a-092f-48fc-b226-94394dbbcff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21fdd9b4fa3a4b308d5304be8cddb8fe'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:04.078527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ead9069a-092f-48fc-b226-94394dbbcff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21fdd9b4fa3a4b308d5304be8cddb8fe'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:04.092692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ead9069a-092f-48fc-b226-94394dbbcff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21fdd9b4fa3a4b308d5304be8cddb8fe'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:04.094089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ead9069a-092f-48fc-b226-94394dbbcff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21fdd9b4fa3a4b308d5304be8cddb8fe'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:04.106688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ead9069a-092f-48fc-b226-94394dbbcff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21fdd9b4fa3a4b308d5304be8cddb8fe'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:04.121066 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3036/6142] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:05:03 2021] DELETE /identity/v3/users/21fdd9b4fa3a4b308d5304be8cddb8fe => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:05:04.125726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211a33e-fa2b-4126-a7f1-8390c084a74b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:04.126203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211a33e-fa2b-4126-a7f1-8390c084a74b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:04.126453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211a33e-fa2b-4126-a7f1-8390c084a74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:04.163174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3211a33e-fa2b-4126-a7f1-8390c084a74b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:04.175746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3211a33e-fa2b-4126-a7f1-8390c084a74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:04.272736 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3107/6143] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:04.308351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9069a-092f-48fc-b226-94394dbbcff5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:04.317409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ead9069a-092f-48fc-b226-94394dbbcff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:04.445779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9069a-092f-48fc-b226-94394dbbcff5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:04.452110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c643b4-80f0-4afa-b1dc-cabbc58da1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:04.453217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c643b4-80f0-4afa-b1dc-cabbc58da1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:04.453685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c643b4-80f0-4afa-b1dc-cabbc58da1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:04.454127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c643b4-80f0-4afa-b1dc-cabbc58da1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:04.466401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c643b4-80f0-4afa-b1dc-cabbc58da1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:04.468801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c643b4-80f0-4afa-b1dc-cabbc58da1f5 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:04.485569 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3037/6144] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:05:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:05:05.125754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211a33e-fa2b-4126-a7f1-8390c084a74b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:05.128482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3211a33e-fa2b-4126-a7f1-8390c084a74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:05.141852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211a33e-fa2b-4126-a7f1-8390c084a74b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:05.154440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:05.155846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:05.156526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:05.157021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf admin admin] PATH_INFO: `/v3/projects/158bb719e22c4eebb0703aa8f4251ce2` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:05.158805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=158bb719e22c4eebb0703aa8f4251ce2)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:05.161579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:05.276009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '158bb719e22c4eebb0703aa8f4251ce2', 'request_id': 'req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:05.285405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '158bb719e22c4eebb0703aa8f4251ce2', 'request_id': 'req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:05.297443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '158bb719e22c4eebb0703aa8f4251ce2', 'request_id': 'req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:05.326638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf admin admin] The token cache is being invalidate because project 158bb719e22c4eebb0703aa8f4251ce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:05:05.327023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:05.327802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:05.330799 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3108/6145] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:05:05 2021] DELETE /identity/v3/projects/158bb719e22c4eebb0703aa8f4251ce2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:05:05.335363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c643b4-80f0-4afa-b1dc-cabbc58da1f5 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:05.345699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c643b4-80f0-4afa-b1dc-cabbc58da1f5 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:05.432702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75c6b6-c7b5-441c-9a0c-89859140efa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:05.434625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75c6b6-c7b5-441c-9a0c-89859140efa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:05.435257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75c6b6-c7b5-441c-9a0c-89859140efa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:05.436149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75c6b6-c7b5-441c-9a0c-89859140efa6 admin admin] PATH_INFO: `/v3/users/b1b3ddd31bc444d28290b5b15ef13ffe` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:05.438110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75c6b6-c7b5-441c-9a0c-89859140efa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1b3ddd31bc444d28290b5b15ef13ffe)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:05.443660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75c6b6-c7b5-441c-9a0c-89859140efa6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:05.517874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0c75c6b6-c7b5-441c-9a0c-89859140efa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1b3ddd31bc444d28290b5b15ef13ffe'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:05.528142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0c75c6b6-c7b5-441c-9a0c-89859140efa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1b3ddd31bc444d28290b5b15ef13ffe'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:05.547447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0c75c6b6-c7b5-441c-9a0c-89859140efa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1b3ddd31bc444d28290b5b15ef13ffe'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:05.548201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0c75c6b6-c7b5-441c-9a0c-89859140efa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1b3ddd31bc444d28290b5b15ef13ffe'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:05.565252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0c75c6b6-c7b5-441c-9a0c-89859140efa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1b3ddd31bc444d28290b5b15ef13ffe'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:05.574723 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3038/6146] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:05:05 2021] DELETE /identity/v3/users/b1b3ddd31bc444d28290b5b15ef13ffe => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:05:06.320771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:06.322305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:06.344631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d4813-0b1a-4756-8d8f-12c5d02b6ccf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:06.459478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028aa7ed-3cb2-4fac-8800-b0bb859cd82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:06.461399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aa7ed-3cb2-4fac-8800-b0bb859cd82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:06.462278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aa7ed-3cb2-4fac-8800-b0bb859cd82c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:06.462473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aa7ed-3cb2-4fac-8800-b0bb859cd82c admin admin] PATH_INFO: `/v3/projects/a896dbe6d5e04936beef4d9a2e198e42` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:06.464201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028aa7ed-3cb2-4fac-8800-b0bb859cd82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a896dbe6d5e04936beef4d9a2e198e42)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:06.467901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028aa7ed-3cb2-4fac-8800-b0bb859cd82c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:06.544287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-028aa7ed-3cb2-4fac-8800-b0bb859cd82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a896dbe6d5e04936beef4d9a2e198e42', 'request_id': 'req-028aa7ed-3cb2-4fac-8800-b0bb859cd82c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:06.555799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-028aa7ed-3cb2-4fac-8800-b0bb859cd82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a896dbe6d5e04936beef4d9a2e198e42', 'request_id': 'req-028aa7ed-3cb2-4fac-8800-b0bb859cd82c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:06.568379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-028aa7ed-3cb2-4fac-8800-b0bb859cd82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a896dbe6d5e04936beef4d9a2e198e42', 'request_id': 'req-028aa7ed-3cb2-4fac-8800-b0bb859cd82c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:06.584901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-028aa7ed-3cb2-4fac-8800-b0bb859cd82c admin admin] The token cache is being invalidate because project a896dbe6d5e04936beef4d9a2e198e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:05:06.585558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-028aa7ed-3cb2-4fac-8800-b0bb859cd82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:06.586413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-028aa7ed-3cb2-4fac-8800-b0bb859cd82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:06.588607 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3109/6147] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:05:06 2021] DELETE /identity/v3/projects/a896dbe6d5e04936beef4d9a2e198e42 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:05:06.595367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e4fd8-266e-4635-a28c-8a53999bbe6a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:06.595920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e4fd8-266e-4635-a28c-8a53999bbe6a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:06.595920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e4fd8-266e-4635-a28c-8a53999bbe6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:06.619456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0a7e4fd8-266e-4635-a28c-8a53999bbe6a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:06.620986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0a7e4fd8-266e-4635-a28c-8a53999bbe6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:06.750538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672785cc-6221-4ed9-b01d-95244e43b839 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:06.750863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672785cc-6221-4ed9-b01d-95244e43b839 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:06.751147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672785cc-6221-4ed9-b01d-95244e43b839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:06.760652 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3039/6148] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:06.773171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-672785cc-6221-4ed9-b01d-95244e43b839 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:06.774733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-672785cc-6221-4ed9-b01d-95244e43b839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:06.790779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e4fd8-266e-4635-a28c-8a53999bbe6a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:06.798523 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3110/6149] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:06.803895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e4fd8-266e-4635-a28c-8a53999bbe6a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:06.810940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a801b8-6457-443f-a975-cf64e7befc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:06.811762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a801b8-6457-443f-a975-cf64e7befc03 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:06.812248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a801b8-6457-443f-a975-cf64e7befc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:06.812665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a801b8-6457-443f-a975-cf64e7befc03 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:06.813625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a801b8-6457-443f-a975-cf64e7befc03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:05:06.814040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a801b8-6457-443f-a975-cf64e7befc03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:06.815910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a801b8-6457-443f-a975-cf64e7befc03 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:06.838872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672785cc-6221-4ed9-b01d-95244e43b839 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:06.849008 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3040/6150] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:05:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:05:06.855540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672785cc-6221-4ed9-b01d-95244e43b839 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:06.871797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb8255-6755-4f4a-a0ed-99cd31f1faa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:06.873720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb8255-6755-4f4a-a0ed-99cd31f1faa0 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:06.874014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb8255-6755-4f4a-a0ed-99cd31f1faa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:06.874319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb8255-6755-4f4a-a0ed-99cd31f1faa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:06.875050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb8255-6755-4f4a-a0ed-99cd31f1faa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:06.877016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb8255-6755-4f4a-a0ed-99cd31f1faa0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:06.943528 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3111/6151] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:05:06 2021] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:05:06.947788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a801b8-6457-443f-a975-cf64e7befc03 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:06.962144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a801b8-6457-443f-a975-cf64e7befc03 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:07.048613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c1088-701d-4895-8fb9-6dbdae71bf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:07.049785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c1088-701d-4895-8fb9-6dbdae71bf42 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:07.050345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c1088-701d-4895-8fb9-6dbdae71bf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:07.051861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c1088-701d-4895-8fb9-6dbdae71bf42 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:07.052927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c1088-701d-4895-8fb9-6dbdae71bf42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:07.055833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c1088-701d-4895-8fb9-6dbdae71bf42 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:07.093991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb8255-6755-4f4a-a0ed-99cd31f1faa0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:07.101440 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3041/6152] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:05:06 2021] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:05:07.113572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb8255-6755-4f4a-a0ed-99cd31f1faa0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:07.128017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539f6ce-f3a5-4754-b424-32b991cde261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:07.129406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539f6ce-f3a5-4754-b424-32b991cde261 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:07.129951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539f6ce-f3a5-4754-b424-32b991cde261 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:07.130526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539f6ce-f3a5-4754-b424-32b991cde261 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:07.131540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539f6ce-f3a5-4754-b424-32b991cde261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:07.133435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539f6ce-f3a5-4754-b424-32b991cde261 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:07.150768 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3112/6153] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:05:07 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:05:07.153834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c1088-701d-4895-8fb9-6dbdae71bf42 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:07.251442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c1088-701d-4895-8fb9-6dbdae71bf42 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:07.251442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c05e89-ba98-4d3a-82df-3cd0a66898d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:07.251442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c05e89-ba98-4d3a-82df-3cd0a66898d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:07.251442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c05e89-ba98-4d3a-82df-3cd0a66898d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:07.252273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c05e89-ba98-4d3a-82df-3cd0a66898d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:07.252273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c05e89-ba98-4d3a-82df-3cd0a66898d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:07.252273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c05e89-ba98-4d3a-82df-3cd0a66898d7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:07.252273 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3042/6154] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:05:07 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:05:07.252496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539f6ce-f3a5-4754-b424-32b991cde261 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:07.262779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539f6ce-f3a5-4754-b424-32b991cde261 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:07.279255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9fa84-2b0c-4367-88b6-4bcca8387aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:07.280121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9fa84-2b0c-4367-88b6-4bcca8387aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:07.280406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9fa84-2b0c-4367-88b6-4bcca8387aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:07.280692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9fa84-2b0c-4367-88b6-4bcca8387aa0 admin admin] PATH_INFO: `/v3/projects/b301a57504de4e029f29acd4a49a969e/users/fbee57655bdf4468a424f26308f60aef/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:07.323269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9fa84-2b0c-4367-88b6-4bcca8387aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b301a57504de4e029f29acd4a49a969e, user_id=fbee57655bdf4468a424f26308f60aef, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:07.325954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9fa84-2b0c-4367-88b6-4bcca8387aa0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:07.356781 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3113/6155] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:05:07 2021] PUT /identity/v3/projects/b301a57504de4e029f29acd4a49a969e/users/fbee57655bdf4468a424f26308f60aef/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:05:07.368259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb89b3-e971-420a-aa8c-68a94bade497 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:07.368648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb89b3-e971-420a-aa8c-68a94bade497 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:07.369212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb89b3-e971-420a-aa8c-68a94bade497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:07.492250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-19eb89b3-e971-420a-aa8c-68a94bade497 None None] MFA Rules not processed for user `fbee57655bdf4468a424f26308f60aef`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:07.493587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-19eb89b3-e971-420a-aa8c-68a94bade497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:07.496317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9fa84-2b0c-4367-88b6-4bcca8387aa0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:07.498182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cdc9fa84-2b0c-4367-88b6-4bcca8387aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:07.661209 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3043/6156] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:07 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:07.719243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9fa84-2b0c-4367-88b6-4bcca8387aa0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:07.730992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854408ef-a9f6-4919-bec2-26673ee9ddbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:07.737905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854408ef-a9f6-4919-bec2-26673ee9ddbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:07.737905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854408ef-a9f6-4919-bec2-26673ee9ddbd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:07.737905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854408ef-a9f6-4919-bec2-26673ee9ddbd admin admin] PATH_INFO: `/v3/users/0012ccb14865485192056087c9926493` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:07.737905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854408ef-a9f6-4919-bec2-26673ee9ddbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0012ccb14865485192056087c9926493)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:07.737905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854408ef-a9f6-4919-bec2-26673ee9ddbd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:07.803950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb89b3-e971-420a-aa8c-68a94bade497 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:07.805747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-19eb89b3-e971-420a-aa8c-68a94bade497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:07.842524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-854408ef-a9f6-4919-bec2-26673ee9ddbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0012ccb14865485192056087c9926493'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:07.869465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-854408ef-a9f6-4919-bec2-26673ee9ddbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0012ccb14865485192056087c9926493'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:07.871565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-854408ef-a9f6-4919-bec2-26673ee9ddbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0012ccb14865485192056087c9926493'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:07.902777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-854408ef-a9f6-4919-bec2-26673ee9ddbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0012ccb14865485192056087c9926493'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:07.921585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-854408ef-a9f6-4919-bec2-26673ee9ddbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0012ccb14865485192056087c9926493'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:07.934003 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3114/6157] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:05:07 2021] DELETE /identity/v3/users/0012ccb14865485192056087c9926493 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:05:08.009471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb89b3-e971-420a-aa8c-68a94bade497 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:08.120507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1b006-7d4b-4c5d-8917-905d4e3158a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:08.122006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1b006-7d4b-4c5d-8917-905d4e3158a3 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:08.123586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1b006-7d4b-4c5d-8917-905d4e3158a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:08.124750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1b006-7d4b-4c5d-8917-905d4e3158a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:08.129777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-73d1b006-7d4b-4c5d-8917-905d4e3158a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:08.273303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1b006-7d4b-4c5d-8917-905d4e3158a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:08.274889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1b006-7d4b-4c5d-8917-905d4e3158a3 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:08.296460 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3044/6158] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:05:07 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:05:09.078213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854408ef-a9f6-4919-bec2-26673ee9ddbd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:09.079906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-854408ef-a9f6-4919-bec2-26673ee9ddbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:09.265280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854408ef-a9f6-4919-bec2-26673ee9ddbd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:09.276058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe340b-0b4c-47fb-88ca-75467e1cb037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:09.277294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe340b-0b4c-47fb-88ca-75467e1cb037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:09.277866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe340b-0b4c-47fb-88ca-75467e1cb037 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:09.278513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe340b-0b4c-47fb-88ca-75467e1cb037 admin admin] PATH_INFO: `/v3/projects/4b037c54b761428db4df46b975b70574` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:09.280880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe340b-0b4c-47fb-88ca-75467e1cb037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b037c54b761428db4df46b975b70574)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:09.288545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe340b-0b4c-47fb-88ca-75467e1cb037 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:09.331183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16135a45-0d89-4da9-b8fb-6b98b0ec2788 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:09.331691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16135a45-0d89-4da9-b8fb-6b98b0ec2788 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:09.331762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16135a45-0d89-4da9-b8fb-6b98b0ec2788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:09.355582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-16135a45-0d89-4da9-b8fb-6b98b0ec2788 None None] MFA Rules not processed for user `0a98795bdb7447c5b2a4930173b3c56d`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:09.357209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-16135a45-0d89-4da9-b8fb-6b98b0ec2788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:09.431701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a3fe340b-0b4c-47fb-88ca-75467e1cb037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b037c54b761428db4df46b975b70574', 'request_id': 'req-a3fe340b-0b4c-47fb-88ca-75467e1cb037'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:09.439630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a3fe340b-0b4c-47fb-88ca-75467e1cb037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b037c54b761428db4df46b975b70574', 'request_id': 'req-a3fe340b-0b4c-47fb-88ca-75467e1cb037'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:09.462932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a3fe340b-0b4c-47fb-88ca-75467e1cb037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b037c54b761428db4df46b975b70574', 'request_id': 'req-a3fe340b-0b4c-47fb-88ca-75467e1cb037'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:09.498761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a3fe340b-0b4c-47fb-88ca-75467e1cb037 admin admin] The token cache is being invalidate because project 4b037c54b761428db4df46b975b70574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:05:09.499555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a3fe340b-0b4c-47fb-88ca-75467e1cb037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:09.501038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a3fe340b-0b4c-47fb-88ca-75467e1cb037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:09.503556 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3115/6159] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:05:09 2021] DELETE /identity/v3/projects/4b037c54b761428db4df46b975b70574 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:05:09.517420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f951d38-1540-4c05-9721-55d6c113bd58 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:09.517979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f951d38-1540-4c05-9721-55d6c113bd58 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:09.518645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f951d38-1540-4c05-9721-55d6c113bd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:09.526668 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3045/6160] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:09 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:05:09.567930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6f951d38-1540-4c05-9721-55d6c113bd58 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:09.570583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6f951d38-1540-4c05-9721-55d6c113bd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:09.714729 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3116/6161] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:09.721917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b39a-3464-4efd-86a3-5424c0033906 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:09.721917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b39a-3464-4efd-86a3-5424c0033906 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:09.721917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b39a-3464-4efd-86a3-5424c0033906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:09.752351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d2f9b39a-3464-4efd-86a3-5424c0033906 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:09.755578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d2f9b39a-3464-4efd-86a3-5424c0033906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:09.771974 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3046/6162] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:09.776242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f951d38-1540-4c05-9721-55d6c113bd58 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:09.790302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f951d38-1540-4c05-9721-55d6c113bd58 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:09.798746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875630a-fa67-48c9-9dec-6736d1cbb332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:09.799426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875630a-fa67-48c9-9dec-6736d1cbb332 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:09.799710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875630a-fa67-48c9-9dec-6736d1cbb332 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:09.800037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875630a-fa67-48c9-9dec-6736d1cbb332 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:09.802182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875630a-fa67-48c9-9dec-6736d1cbb332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:05:09.802530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875630a-fa67-48c9-9dec-6736d1cbb332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:09.804945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875630a-fa67-48c9-9dec-6736d1cbb332 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:09.824132 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3117/6163] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:05:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:05:09.828211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9b39a-3464-4efd-86a3-5424c0033906 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:09.840432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9b39a-3464-4efd-86a3-5424c0033906 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:09.848256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326520f0-1794-4d71-8456-78ecb2dde613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:09.848670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326520f0-1794-4d71-8456-78ecb2dde613 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:09.848956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326520f0-1794-4d71-8456-78ecb2dde613 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:09.849238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326520f0-1794-4d71-8456-78ecb2dde613 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:09.850045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326520f0-1794-4d71-8456-78ecb2dde613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:09.852810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326520f0-1794-4d71-8456-78ecb2dde613 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:09.905821 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3047/6164] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:05:09 2021] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:05:09.909836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875630a-fa67-48c9-9dec-6736d1cbb332 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:09.927639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875630a-fa67-48c9-9dec-6736d1cbb332 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:10.056495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cecf3-506d-46a4-bbff-9cd44b0d78af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:10.057496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cecf3-506d-46a4-bbff-9cd44b0d78af admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:10.057629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cecf3-506d-46a4-bbff-9cd44b0d78af admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:10.057887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cecf3-506d-46a4-bbff-9cd44b0d78af admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:10.059469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cecf3-506d-46a4-bbff-9cd44b0d78af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:10.061801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cecf3-506d-46a4-bbff-9cd44b0d78af admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:10.086695 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3118/6165] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:05:09 2021] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:05:10.092180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326520f0-1794-4d71-8456-78ecb2dde613 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:10.104761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326520f0-1794-4d71-8456-78ecb2dde613 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:10.109628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3329dd6-109d-4fda-aee2-f480d7eab776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:10.110354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3329dd6-109d-4fda-aee2-f480d7eab776 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:10.110644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3329dd6-109d-4fda-aee2-f480d7eab776 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:10.110924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3329dd6-109d-4fda-aee2-f480d7eab776 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:10.111672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3329dd6-109d-4fda-aee2-f480d7eab776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:10.113291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3329dd6-109d-4fda-aee2-f480d7eab776 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:10.130613 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3048/6166] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:05:10 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:05:10.132590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cecf3-506d-46a4-bbff-9cd44b0d78af admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:10.145483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cecf3-506d-46a4-bbff-9cd44b0d78af admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:10.151295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e15cd-4021-4683-b8a4-33f43b460269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:10.152439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e15cd-4021-4683-b8a4-33f43b460269 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:10.152713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e15cd-4021-4683-b8a4-33f43b460269 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:10.153059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e15cd-4021-4683-b8a4-33f43b460269 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:10.153862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e15cd-4021-4683-b8a4-33f43b460269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:10.155883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e15cd-4021-4683-b8a4-33f43b460269 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:10.171440 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3119/6167] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:05:10 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:05:10.172610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3329dd6-109d-4fda-aee2-f480d7eab776 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:10.183788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3329dd6-109d-4fda-aee2-f480d7eab776 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:10.189880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28680731-e06b-44d9-805c-1f343f0e725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:10.190938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28680731-e06b-44d9-805c-1f343f0e725c admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:10.191289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28680731-e06b-44d9-805c-1f343f0e725c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:10.193275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28680731-e06b-44d9-805c-1f343f0e725c admin admin] PATH_INFO: `/v3/projects/a7fbf6906e5d404c916ff274e95066ba/users/1715a99625764d63a18f2191e297ae1d/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:10.209683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28680731-e06b-44d9-805c-1f343f0e725c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7fbf6906e5d404c916ff274e95066ba, user_id=1715a99625764d63a18f2191e297ae1d, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:10.212608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28680731-e06b-44d9-805c-1f343f0e725c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:10.233195 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3049/6168] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:05:10 2021] PUT /identity/v3/projects/a7fbf6906e5d404c916ff274e95066ba/users/1715a99625764d63a18f2191e297ae1d/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:05:10.236479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618199d-3c5a-4353-90cc-808e3e890aeb None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:10.237038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618199d-3c5a-4353-90cc-808e3e890aeb None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:10.237541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618199d-3c5a-4353-90cc-808e3e890aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:10.258623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c618199d-3c5a-4353-90cc-808e3e890aeb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:10.259858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c618199d-3c5a-4353-90cc-808e3e890aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:10.325546 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3120/6169] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:10.363761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28680731-e06b-44d9-805c-1f343f0e725c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:10.366282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-28680731-e06b-44d9-805c-1f343f0e725c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:10.447250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28680731-e06b-44d9-805c-1f343f0e725c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:10.454795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24a860-0216-4788-bcaf-b82f65843d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:10.455741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24a860-0216-4788-bcaf-b82f65843d65 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:10.456255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24a860-0216-4788-bcaf-b82f65843d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:10.456812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24a860-0216-4788-bcaf-b82f65843d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:10.472371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24a860-0216-4788-bcaf-b82f65843d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:10.475261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24a860-0216-4788-bcaf-b82f65843d65 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:10.491952 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3050/6170] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:05:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:05:13.274368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18cbfe-6f6b-4996-a3a1-cba97a2cb070 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:13.274892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18cbfe-6f6b-4996-a3a1-cba97a2cb070 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:13.276395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18cbfe-6f6b-4996-a3a1-cba97a2cb070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:13.323994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7a18cbfe-6f6b-4996-a3a1-cba97a2cb070 None None] MFA Rules not processed for user `1715a99625764d63a18f2191e297ae1d`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:13.325474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7a18cbfe-6f6b-4996-a3a1-cba97a2cb070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:13.414781 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3121/6171] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:13 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:13.424947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324a55e-f080-46ac-b9a4-ccba5b7aa363 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:13.425816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324a55e-f080-46ac-b9a4-ccba5b7aa363 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:13.426760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324a55e-f080-46ac-b9a4-ccba5b7aa363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:13.456685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6324a55e-f080-46ac-b9a4-ccba5b7aa363 None None] MFA Rules not processed for user `1715a99625764d63a18f2191e297ae1d`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:13.458512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6324a55e-f080-46ac-b9a4-ccba5b7aa363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:13.475102 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3051/6172] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:13 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:13.488704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18cbfe-6f6b-4996-a3a1-cba97a2cb070 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:13.490862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7a18cbfe-6f6b-4996-a3a1-cba97a2cb070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:13.639682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18cbfe-6f6b-4996-a3a1-cba97a2cb070 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:13.649740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137ece9-c3dd-4ded-9481-fbbf20f707cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:13.650623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137ece9-c3dd-4ded-9481-fbbf20f707cd service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:13.651133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137ece9-c3dd-4ded-9481-fbbf20f707cd service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:13.651600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137ece9-c3dd-4ded-9481-fbbf20f707cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:13.662356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137ece9-c3dd-4ded-9481-fbbf20f707cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:13.664727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137ece9-c3dd-4ded-9481-fbbf20f707cd service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:13.682812 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3122/6173] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:05:13 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:05:32.130517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324a55e-f080-46ac-b9a4-ccba5b7aa363 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:32.132386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6324a55e-f080-46ac-b9a4-ccba5b7aa363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:32.157304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324a55e-f080-46ac-b9a4-ccba5b7aa363 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:32.169668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7fbb0-fbb3-4f2f-a7bc-3d74df7b0ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:32.174016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7fbb0-fbb3-4f2f-a7bc-3d74df7b0ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:32.174727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7fbb0-fbb3-4f2f-a7bc-3d74df7b0ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:32.175867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7fbb0-fbb3-4f2f-a7bc-3d74df7b0ae7 admin admin] PATH_INFO: `/v3/users/fbee57655bdf4468a424f26308f60aef` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:32.178585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7fbb0-fbb3-4f2f-a7bc-3d74df7b0ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbee57655bdf4468a424f26308f60aef)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:32.182054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7fbb0-fbb3-4f2f-a7bc-3d74df7b0ae7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:32.287222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b9d7fbb0-fbb3-4f2f-a7bc-3d74df7b0ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbee57655bdf4468a424f26308f60aef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:32.295793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b9d7fbb0-fbb3-4f2f-a7bc-3d74df7b0ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbee57655bdf4468a424f26308f60aef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:32.313000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b9d7fbb0-fbb3-4f2f-a7bc-3d74df7b0ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbee57655bdf4468a424f26308f60aef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:32.313968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b9d7fbb0-fbb3-4f2f-a7bc-3d74df7b0ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbee57655bdf4468a424f26308f60aef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:32.326924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b9d7fbb0-fbb3-4f2f-a7bc-3d74df7b0ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbee57655bdf4468a424f26308f60aef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:32.336712 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3052/6174] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:05:32 2021] DELETE /identity/v3/users/fbee57655bdf4468a424f26308f60aef => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:05:32.340469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1034de-1104-45cb-a610-c1d89ebc7975 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:32.340950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1034de-1104-45cb-a610-c1d89ebc7975 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:32.341050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1034de-1104-45cb-a610-c1d89ebc7975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:32.376305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9f1034de-1104-45cb-a610-c1d89ebc7975 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:32.377791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9f1034de-1104-45cb-a610-c1d89ebc7975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:32.519369 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3123/6175] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:32.545497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7fbb0-fbb3-4f2f-a7bc-3d74df7b0ae7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:32.548569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b9d7fbb0-fbb3-4f2f-a7bc-3d74df7b0ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:32.708447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7fbb0-fbb3-4f2f-a7bc-3d74df7b0ae7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:32.723346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670117b-4a23-4608-895b-11a5684a9e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:32.724063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670117b-4a23-4608-895b-11a5684a9e1b service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:32.724404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670117b-4a23-4608-895b-11a5684a9e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:32.724685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670117b-4a23-4608-895b-11a5684a9e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:32.746856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670117b-4a23-4608-895b-11a5684a9e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:32.753864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670117b-4a23-4608-895b-11a5684a9e1b service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:32.792399 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3053/6176] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:05:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:05:33.943624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1034de-1104-45cb-a610-c1d89ebc7975 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:33.945551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9f1034de-1104-45cb-a610-c1d89ebc7975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:33.961796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1034de-1104-45cb-a610-c1d89ebc7975 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:33.974170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098c59e-4079-46a7-9f16-197e890fb22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:33.975282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c59e-4079-46a7-9f16-197e890fb22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:33.975863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c59e-4079-46a7-9f16-197e890fb22f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:33.976288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c59e-4079-46a7-9f16-197e890fb22f admin admin] PATH_INFO: `/v3/projects/b301a57504de4e029f29acd4a49a969e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:33.977702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098c59e-4079-46a7-9f16-197e890fb22f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b301a57504de4e029f29acd4a49a969e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:33.980877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098c59e-4079-46a7-9f16-197e890fb22f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:34.053391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5098c59e-4079-46a7-9f16-197e890fb22f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b301a57504de4e029f29acd4a49a969e', 'request_id': 'req-5098c59e-4079-46a7-9f16-197e890fb22f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:34.062479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5098c59e-4079-46a7-9f16-197e890fb22f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b301a57504de4e029f29acd4a49a969e', 'request_id': 'req-5098c59e-4079-46a7-9f16-197e890fb22f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:34.078127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5098c59e-4079-46a7-9f16-197e890fb22f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b301a57504de4e029f29acd4a49a969e', 'request_id': 'req-5098c59e-4079-46a7-9f16-197e890fb22f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:34.090661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5098c59e-4079-46a7-9f16-197e890fb22f admin admin] The token cache is being invalidate because project b301a57504de4e029f29acd4a49a969e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:05:34.090958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5098c59e-4079-46a7-9f16-197e890fb22f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:34.091675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5098c59e-4079-46a7-9f16-197e890fb22f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:34.093453 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3124/6177] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:05:33 2021] DELETE /identity/v3/projects/b301a57504de4e029f29acd4a49a969e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:05:34.100370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f30ef-4711-4de1-8a1b-ccfa2457770f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:34.104651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f30ef-4711-4de1-8a1b-ccfa2457770f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:34.105110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f30ef-4711-4de1-8a1b-ccfa2457770f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:34.131993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fe6f30ef-4711-4de1-8a1b-ccfa2457770f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:34.133435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fe6f30ef-4711-4de1-8a1b-ccfa2457770f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:34.201248 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3054/6178] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:34.209355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ba105-ccb9-4204-8343-86f4bff979a9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:34.209355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ba105-ccb9-4204-8343-86f4bff979a9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:34.209814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ba105-ccb9-4204-8343-86f4bff979a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:34.240124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2f5ba105-ccb9-4204-8343-86f4bff979a9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:34.242194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2f5ba105-ccb9-4204-8343-86f4bff979a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:34.267783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f30ef-4711-4de1-8a1b-ccfa2457770f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:34.268530 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3125/6179] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:34.290814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f30ef-4711-4de1-8a1b-ccfa2457770f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:34.296667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7734b11-eb81-44e0-911b-bd3589650a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:34.297652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7734b11-eb81-44e0-911b-bd3589650a74 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:34.298114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7734b11-eb81-44e0-911b-bd3589650a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:34.298607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7734b11-eb81-44e0-911b-bd3589650a74 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:34.299576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7734b11-eb81-44e0-911b-bd3589650a74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:05:34.300752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7734b11-eb81-44e0-911b-bd3589650a74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:34.302850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7734b11-eb81-44e0-911b-bd3589650a74 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:34.318130 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3055/6180] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:05:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:05:34.325693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ba105-ccb9-4204-8343-86f4bff979a9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:34.336492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ba105-ccb9-4204-8343-86f4bff979a9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:34.349704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f815535-2ab3-4503-93e3-fcfcd869a648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:34.351110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f815535-2ab3-4503-93e3-fcfcd869a648 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:34.351396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f815535-2ab3-4503-93e3-fcfcd869a648 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:34.351677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f815535-2ab3-4503-93e3-fcfcd869a648 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:34.352393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f815535-2ab3-4503-93e3-fcfcd869a648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:34.356931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f815535-2ab3-4503-93e3-fcfcd869a648 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:34.433544 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3126/6181] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:05:34 2021] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:05:34.436822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7734b11-eb81-44e0-911b-bd3589650a74 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:34.448473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7734b11-eb81-44e0-911b-bd3589650a74 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:34.562163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9519858-5853-4934-a137-954fb4b10034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:34.562978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9519858-5853-4934-a137-954fb4b10034 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:34.563271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9519858-5853-4934-a137-954fb4b10034 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:34.563557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9519858-5853-4934-a137-954fb4b10034 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:34.565865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9519858-5853-4934-a137-954fb4b10034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:34.568390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9519858-5853-4934-a137-954fb4b10034 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:34.609036 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3056/6182] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:05:34 2021] POST /identity/v3/users => generated 284 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:05:34.613384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f815535-2ab3-4503-93e3-fcfcd869a648 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:34.629600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f815535-2ab3-4503-93e3-fcfcd869a648 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:34.644716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3d798-0368-4b51-bdae-ada0c1182a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:34.645525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d798-0368-4b51-bdae-ada0c1182a88 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:34.646070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d798-0368-4b51-bdae-ada0c1182a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:34.646481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d798-0368-4b51-bdae-ada0c1182a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:34.647365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3d798-0368-4b51-bdae-ada0c1182a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:34.649086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3d798-0368-4b51-bdae-ada0c1182a88 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:34.674177 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3127/6183] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:05:34 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:05:34.678185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9519858-5853-4934-a137-954fb4b10034 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:34.693728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9519858-5853-4934-a137-954fb4b10034 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:34.701707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323debc0-c507-41c8-9cf3-0d128e87856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:34.702568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323debc0-c507-41c8-9cf3-0d128e87856d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:34.703421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323debc0-c507-41c8-9cf3-0d128e87856d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:34.703856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323debc0-c507-41c8-9cf3-0d128e87856d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:34.704887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323debc0-c507-41c8-9cf3-0d128e87856d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:34.707815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323debc0-c507-41c8-9cf3-0d128e87856d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:34.725480 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3057/6184] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:05:34 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:05:34.729501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3d798-0368-4b51-bdae-ada0c1182a88 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:34.748614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3d798-0368-4b51-bdae-ada0c1182a88 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:34.757206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f5831-137e-4553-86ac-b849cadda083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:34.758926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f5831-137e-4553-86ac-b849cadda083 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:34.759439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f5831-137e-4553-86ac-b849cadda083 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:34.760555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f5831-137e-4553-86ac-b849cadda083 admin admin] PATH_INFO: `/v3/projects/cc75b17b82984a1cb881458e991ff08c/users/1da73203dd044377927545a5232eab4b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:34.782200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f5831-137e-4553-86ac-b849cadda083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc75b17b82984a1cb881458e991ff08c, user_id=1da73203dd044377927545a5232eab4b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:34.786716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f5831-137e-4553-86ac-b849cadda083 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:34.816836 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3128/6185] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:05:34 2021] PUT /identity/v3/projects/cc75b17b82984a1cb881458e991ff08c/users/1da73203dd044377927545a5232eab4b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:05:34.827941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab191a9-12f3-430a-95c4-f75f11e322ca None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:34.828247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab191a9-12f3-430a-95c4-f75f11e322ca None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:34.828733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab191a9-12f3-430a-95c4-f75f11e322ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:34.884502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-eab191a9-12f3-430a-95c4-f75f11e322ca None None] MFA Rules not processed for user `1da73203dd044377927545a5232eab4b`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:34.886073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eab191a9-12f3-430a-95c4-f75f11e322ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:34.997242 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3058/6186] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:34 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:35.010178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f5831-137e-4553-86ac-b849cadda083 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:35.012772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-045f5831-137e-4553-86ac-b849cadda083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:35.108903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f5831-137e-4553-86ac-b849cadda083 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:35.113343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c29d7-b65f-4d87-ab67-4ddab8e5bb27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:35.114530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c29d7-b65f-4d87-ab67-4ddab8e5bb27 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:35.115024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c29d7-b65f-4d87-ab67-4ddab8e5bb27 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:35.115499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c29d7-b65f-4d87-ab67-4ddab8e5bb27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:35.128800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c29d7-b65f-4d87-ab67-4ddab8e5bb27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:35.130643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c29d7-b65f-4d87-ab67-4ddab8e5bb27 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:35.149863 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3129/6187] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:05:35 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:05:39.872122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab191a9-12f3-430a-95c4-f75f11e322ca None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:39.874165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eab191a9-12f3-430a-95c4-f75f11e322ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:40.008626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab191a9-12f3-430a-95c4-f75f11e322ca None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:40.017917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bd6a1-373e-4e4f-ace7-505370ea69b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:40.018945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bd6a1-373e-4e4f-ace7-505370ea69b9 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:40.019439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bd6a1-373e-4e4f-ace7-505370ea69b9 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:40.019886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bd6a1-373e-4e4f-ace7-505370ea69b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:40.022547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8c8bd6a1-373e-4e4f-ace7-505370ea69b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:40.201736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bd6a1-373e-4e4f-ace7-505370ea69b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:40.204434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bd6a1-373e-4e4f-ace7-505370ea69b9 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:40.275207 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3059/6188] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:05:39 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:05:44.075858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c29d7-b65f-4d87-ab67-4ddab8e5bb27 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:44.077576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-601c29d7-b65f-4d87-ab67-4ddab8e5bb27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:44.187663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c29d7-b65f-4d87-ab67-4ddab8e5bb27 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:44.195001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057cb386-2868-4117-b761-7a69bfd7d9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:44.196419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cb386-2868-4117-b761-7a69bfd7d9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:44.196953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cb386-2868-4117-b761-7a69bfd7d9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:44.197390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cb386-2868-4117-b761-7a69bfd7d9ca admin admin] PATH_INFO: `/v3/users/1715a99625764d63a18f2191e297ae1d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:44.199391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057cb386-2868-4117-b761-7a69bfd7d9ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=1715a99625764d63a18f2191e297ae1d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:44.201963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057cb386-2868-4117-b761-7a69bfd7d9ca admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:44.271147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-057cb386-2868-4117-b761-7a69bfd7d9ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1715a99625764d63a18f2191e297ae1d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:44.283060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-057cb386-2868-4117-b761-7a69bfd7d9ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1715a99625764d63a18f2191e297ae1d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:44.285655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-057cb386-2868-4117-b761-7a69bfd7d9ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1715a99625764d63a18f2191e297ae1d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:44.320740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-057cb386-2868-4117-b761-7a69bfd7d9ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1715a99625764d63a18f2191e297ae1d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:44.339922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-057cb386-2868-4117-b761-7a69bfd7d9ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1715a99625764d63a18f2191e297ae1d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:44.358775 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3130/6189] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:05:44 2021] DELETE /identity/v3/users/1715a99625764d63a18f2191e297ae1d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:05:44.906074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bd6a1-373e-4e4f-ace7-505370ea69b9 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:44.923425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bd6a1-373e-4e4f-ace7-505370ea69b9 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:44.985778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a54e8-0c3f-4932-bf51-ea928e344855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:44.986969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a54e8-0c3f-4932-bf51-ea928e344855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:44.987459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a54e8-0c3f-4932-bf51-ea928e344855 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:44.987906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a54e8-0c3f-4932-bf51-ea928e344855 admin admin] PATH_INFO: `/v3/projects/a7fbf6906e5d404c916ff274e95066ba` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:44.989864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a54e8-0c3f-4932-bf51-ea928e344855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7fbf6906e5d404c916ff274e95066ba)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:44.992342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a54e8-0c3f-4932-bf51-ea928e344855 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:45.055868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da8a54e8-0c3f-4932-bf51-ea928e344855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7fbf6906e5d404c916ff274e95066ba', 'request_id': 'req-da8a54e8-0c3f-4932-bf51-ea928e344855'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:45.062987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da8a54e8-0c3f-4932-bf51-ea928e344855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7fbf6906e5d404c916ff274e95066ba', 'request_id': 'req-da8a54e8-0c3f-4932-bf51-ea928e344855'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:45.070755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da8a54e8-0c3f-4932-bf51-ea928e344855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7fbf6906e5d404c916ff274e95066ba', 'request_id': 'req-da8a54e8-0c3f-4932-bf51-ea928e344855'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:45.084376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da8a54e8-0c3f-4932-bf51-ea928e344855 admin admin] The token cache is being invalidate because project a7fbf6906e5d404c916ff274e95066ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:05:45.084901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da8a54e8-0c3f-4932-bf51-ea928e344855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:45.085779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-da8a54e8-0c3f-4932-bf51-ea928e344855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:05:45.087609 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3060/6190] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:05:44 2021] DELETE /identity/v3/projects/a7fbf6906e5d404c916ff274e95066ba => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:05:45.093866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510eb560-c39f-4968-bdfb-74a2b87af9cf None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:45.094380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510eb560-c39f-4968-bdfb-74a2b87af9cf None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:45.094684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510eb560-c39f-4968-bdfb-74a2b87af9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:45.119073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-510eb560-c39f-4968-bdfb-74a2b87af9cf None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:45.120895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-510eb560-c39f-4968-bdfb-74a2b87af9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:45.206937 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3131/6191] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:45.209081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb19361-3a09-45fa-8c9f-404fb52fb5a8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:45.209909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb19361-3a09-45fa-8c9f-404fb52fb5a8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:45.210300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb19361-3a09-45fa-8c9f-404fb52fb5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:45.232006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9bb19361-3a09-45fa-8c9f-404fb52fb5a8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:45.233433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9bb19361-3a09-45fa-8c9f-404fb52fb5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:45.244893 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3061/6192] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:45.251090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510eb560-c39f-4968-bdfb-74a2b87af9cf None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:45.267727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510eb560-c39f-4968-bdfb-74a2b87af9cf None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:45.274775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560cb28-9663-4d6b-ae18-652dd9315d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:45.275695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560cb28-9663-4d6b-ae18-652dd9315d2a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:45.275989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560cb28-9663-4d6b-ae18-652dd9315d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:45.276277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560cb28-9663-4d6b-ae18-652dd9315d2a admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:45.277140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560cb28-9663-4d6b-ae18-652dd9315d2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:05:45.277508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560cb28-9663-4d6b-ae18-652dd9315d2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:45.280010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560cb28-9663-4d6b-ae18-652dd9315d2a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:45.309706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb19361-3a09-45fa-8c9f-404fb52fb5a8 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:45.326519 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3132/6193] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:05:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:05:45.349454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb19361-3a09-45fa-8c9f-404fb52fb5a8 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:45.365117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd681dd7-bdcf-49ef-b926-3288eeeb77b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:45.366055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd681dd7-bdcf-49ef-b926-3288eeeb77b5 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:45.369352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd681dd7-bdcf-49ef-b926-3288eeeb77b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:45.369648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd681dd7-bdcf-49ef-b926-3288eeeb77b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:45.370566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd681dd7-bdcf-49ef-b926-3288eeeb77b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:45.372514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd681dd7-bdcf-49ef-b926-3288eeeb77b5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:45.425893 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3062/6194] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:05:45 2021] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:05:45.431929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560cb28-9663-4d6b-ae18-652dd9315d2a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:45.445317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560cb28-9663-4d6b-ae18-652dd9315d2a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:45.538132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286b00b-dbd6-4828-a096-b852c02476cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:45.541447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286b00b-dbd6-4828-a096-b852c02476cd admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:45.541781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286b00b-dbd6-4828-a096-b852c02476cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:45.542086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286b00b-dbd6-4828-a096-b852c02476cd admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:45.542846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286b00b-dbd6-4828-a096-b852c02476cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:45.544850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286b00b-dbd6-4828-a096-b852c02476cd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:45.571153 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3133/6195] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:05:45 2021] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:05:45.575541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd681dd7-bdcf-49ef-b926-3288eeeb77b5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:45.592921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd681dd7-bdcf-49ef-b926-3288eeeb77b5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:45.601960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb9cc4-66f4-45bc-b282-9e1c9e6ba1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:45.603643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb9cc4-66f4-45bc-b282-9e1c9e6ba1ac admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:45.603955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb9cc4-66f4-45bc-b282-9e1c9e6ba1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:45.604468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb9cc4-66f4-45bc-b282-9e1c9e6ba1ac admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:45.605926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb9cc4-66f4-45bc-b282-9e1c9e6ba1ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:45.609286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb9cc4-66f4-45bc-b282-9e1c9e6ba1ac admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:45.623683 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3063/6196] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:05:45 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:05:45.630564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286b00b-dbd6-4828-a096-b852c02476cd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:45.647269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286b00b-dbd6-4828-a096-b852c02476cd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:45.663363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf042c-975f-4f76-811e-abf6de5c98c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:45.665842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf042c-975f-4f76-811e-abf6de5c98c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:45.666975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf042c-975f-4f76-811e-abf6de5c98c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:45.667458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf042c-975f-4f76-811e-abf6de5c98c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:45.668486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf042c-975f-4f76-811e-abf6de5c98c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:45.683411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf042c-975f-4f76-811e-abf6de5c98c6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:45.707865 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3134/6197] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:05:45 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:05:45.721197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb9cc4-66f4-45bc-b282-9e1c9e6ba1ac admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:45.744077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb9cc4-66f4-45bc-b282-9e1c9e6ba1ac admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:45.754648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcae33-1b26-4e0e-83af-9b4ce6b3d8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:45.755500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcae33-1b26-4e0e-83af-9b4ce6b3d8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:45.755791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcae33-1b26-4e0e-83af-9b4ce6b3d8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:45.756077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcae33-1b26-4e0e-83af-9b4ce6b3d8b4 admin admin] PATH_INFO: `/v3/projects/ea26536b064a4650b9c08f4b5ce6fadf/users/d6278aefb6d5497aad3d74b47b2e95d9/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:45.774302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcae33-1b26-4e0e-83af-9b4ce6b3d8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea26536b064a4650b9c08f4b5ce6fadf, user_id=d6278aefb6d5497aad3d74b47b2e95d9, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:45.777082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcae33-1b26-4e0e-83af-9b4ce6b3d8b4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:45.805822 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3064/6198] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:05:45 2021] PUT /identity/v3/projects/ea26536b064a4650b9c08f4b5ce6fadf/users/d6278aefb6d5497aad3d74b47b2e95d9/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:05:45.811241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e9b92-ca3d-44e3-bae7-cd12fd226246 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:45.811567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e9b92-ca3d-44e3-bae7-cd12fd226246 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:45.812351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e9b92-ca3d-44e3-bae7-cd12fd226246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:45.853794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0e7e9b92-ca3d-44e3-bae7-cd12fd226246 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:45.856796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0e7e9b92-ca3d-44e3-bae7-cd12fd226246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:45.956498 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3135/6199] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:45.974221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcae33-1b26-4e0e-83af-9b4ce6b3d8b4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:45.976868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f0fcae33-1b26-4e0e-83af-9b4ce6b3d8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:46.066239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcae33-1b26-4e0e-83af-9b4ce6b3d8b4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:46.096041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e056d9c-fc38-44f9-9deb-673ecd3b3b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:46.097279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e056d9c-fc38-44f9-9deb-673ecd3b3b7a service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:46.097576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e056d9c-fc38-44f9-9deb-673ecd3b3b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:46.101139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e056d9c-fc38-44f9-9deb-673ecd3b3b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:46.117181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e056d9c-fc38-44f9-9deb-673ecd3b3b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:46.118363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e056d9c-fc38-44f9-9deb-673ecd3b3b7a service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:46.130113 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3065/6200] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:05:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:05:48.153261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3267d-5a9f-4d57-93b8-9a8595ec30d0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:48.154125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3267d-5a9f-4d57-93b8-9a8595ec30d0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:48.154574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3267d-5a9f-4d57-93b8-9a8595ec30d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:48.207490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-15c3267d-5a9f-4d57-93b8-9a8595ec30d0 None None] MFA Rules not processed for user `d6278aefb6d5497aad3d74b47b2e95d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:48.208735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-15c3267d-5a9f-4d57-93b8-9a8595ec30d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:48.375779 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3136/6201] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:48 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:48.385970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f790b86-29bd-4ebf-a5e1-709791371922 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:48.386531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f790b86-29bd-4ebf-a5e1-709791371922 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:48.386628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f790b86-29bd-4ebf-a5e1-709791371922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:48.420174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0f790b86-29bd-4ebf-a5e1-709791371922 None None] MFA Rules not processed for user `d6278aefb6d5497aad3d74b47b2e95d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:05:48.421542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0f790b86-29bd-4ebf-a5e1-709791371922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:48.443089 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3066/6202] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:05:48 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:05:48.455182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3267d-5a9f-4d57-93b8-9a8595ec30d0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:05:48.457314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-15c3267d-5a9f-4d57-93b8-9a8595ec30d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:05:48.607077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3267d-5a9f-4d57-93b8-9a8595ec30d0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:05:48.615959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449f22e-a3ef-40b6-a861-1e65459341e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:05:48.616853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449f22e-a3ef-40b6-a861-1e65459341e5 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:05:48.617277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449f22e-a3ef-40b6-a861-1e65459341e5 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:05:48.617706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449f22e-a3ef-40b6-a861-1e65459341e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:05:48.628298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449f22e-a3ef-40b6-a861-1e65459341e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:05:48.631172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449f22e-a3ef-40b6-a861-1e65459341e5 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:05:48.677687 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3137/6203] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:05:48 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:06:00.871918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f790b86-29bd-4ebf-a5e1-709791371922 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:00.874073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0f790b86-29bd-4ebf-a5e1-709791371922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:00.919326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f790b86-29bd-4ebf-a5e1-709791371922 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:00.926859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379d996-6f75-44db-918d-e4ddfa69f297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:00.928276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379d996-6f75-44db-918d-e4ddfa69f297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:00.928774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379d996-6f75-44db-918d-e4ddfa69f297 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:00.929287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379d996-6f75-44db-918d-e4ddfa69f297 admin admin] PATH_INFO: `/v3/users/1da73203dd044377927545a5232eab4b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:00.935054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379d996-6f75-44db-918d-e4ddfa69f297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da73203dd044377927545a5232eab4b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:00.942507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379d996-6f75-44db-918d-e4ddfa69f297 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:01.030784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f379d996-6f75-44db-918d-e4ddfa69f297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da73203dd044377927545a5232eab4b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:01.038875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f379d996-6f75-44db-918d-e4ddfa69f297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da73203dd044377927545a5232eab4b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:01.052863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f379d996-6f75-44db-918d-e4ddfa69f297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da73203dd044377927545a5232eab4b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:01.053613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f379d996-6f75-44db-918d-e4ddfa69f297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da73203dd044377927545a5232eab4b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:01.066376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f379d996-6f75-44db-918d-e4ddfa69f297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da73203dd044377927545a5232eab4b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:01.078809 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3067/6204] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:06:00 2021] DELETE /identity/v3/users/1da73203dd044377927545a5232eab4b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:01.083037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d205b-1e7e-460b-b1ff-d276c0f207a3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:01.083570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d205b-1e7e-460b-b1ff-d276c0f207a3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:01.083674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d205b-1e7e-460b-b1ff-d276c0f207a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:01.119274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6c1d205b-1e7e-460b-b1ff-d276c0f207a3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:01.120457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6c1d205b-1e7e-460b-b1ff-d276c0f207a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:01.230449 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3138/6205] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:01.258325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379d996-6f75-44db-918d-e4ddfa69f297 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:01.260231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f379d996-6f75-44db-918d-e4ddfa69f297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:01.411051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379d996-6f75-44db-918d-e4ddfa69f297 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:01.416058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb40ce-dc04-4fe5-8bde-fbc974dd4d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:01.417164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb40ce-dc04-4fe5-8bde-fbc974dd4d7a service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:01.417646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb40ce-dc04-4fe5-8bde-fbc974dd4d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:01.418092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb40ce-dc04-4fe5-8bde-fbc974dd4d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:01.436249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb40ce-dc04-4fe5-8bde-fbc974dd4d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:01.437699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb40ce-dc04-4fe5-8bde-fbc974dd4d7a service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:01.461912 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3068/6206] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:06:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:06:02.151990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d205b-1e7e-460b-b1ff-d276c0f207a3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:02.155911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6c1d205b-1e7e-460b-b1ff-d276c0f207a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:02.179134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d205b-1e7e-460b-b1ff-d276c0f207a3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:02.187247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770b2bc-8488-45b3-8a2b-f88891fb56e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:02.188501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770b2bc-8488-45b3-8a2b-f88891fb56e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:02.188968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770b2bc-8488-45b3-8a2b-f88891fb56e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:02.191609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770b2bc-8488-45b3-8a2b-f88891fb56e2 admin admin] PATH_INFO: `/v3/projects/cc75b17b82984a1cb881458e991ff08c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:02.194158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770b2bc-8488-45b3-8a2b-f88891fb56e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc75b17b82984a1cb881458e991ff08c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:02.197586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770b2bc-8488-45b3-8a2b-f88891fb56e2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:02.323383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0770b2bc-8488-45b3-8a2b-f88891fb56e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc75b17b82984a1cb881458e991ff08c', 'request_id': 'req-0770b2bc-8488-45b3-8a2b-f88891fb56e2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:02.336025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0770b2bc-8488-45b3-8a2b-f88891fb56e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc75b17b82984a1cb881458e991ff08c', 'request_id': 'req-0770b2bc-8488-45b3-8a2b-f88891fb56e2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:02.349544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0770b2bc-8488-45b3-8a2b-f88891fb56e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc75b17b82984a1cb881458e991ff08c', 'request_id': 'req-0770b2bc-8488-45b3-8a2b-f88891fb56e2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:02.368616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0770b2bc-8488-45b3-8a2b-f88891fb56e2 admin admin] The token cache is being invalidate because project cc75b17b82984a1cb881458e991ff08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:06:02.369247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0770b2bc-8488-45b3-8a2b-f88891fb56e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:02.374321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0770b2bc-8488-45b3-8a2b-f88891fb56e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:02.381347 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3139/6207] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:06:02 2021] DELETE /identity/v3/projects/cc75b17b82984a1cb881458e991ff08c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:02.382561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea5b5-e53e-4f7d-b903-47d3550c6c20 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:02.383026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea5b5-e53e-4f7d-b903-47d3550c6c20 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:02.383118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea5b5-e53e-4f7d-b903-47d3550c6c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:02.416444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ad9ea5b5-e53e-4f7d-b903-47d3550c6c20 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:02.417676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ad9ea5b5-e53e-4f7d-b903-47d3550c6c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:02.563272 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3069/6208] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:06:02.573124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadc648-9a37-4146-8fea-9ca727766170 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:02.573834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadc648-9a37-4146-8fea-9ca727766170 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:02.574471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadc648-9a37-4146-8fea-9ca727766170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:02.607216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2dadc648-9a37-4146-8fea-9ca727766170 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:02.617178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2dadc648-9a37-4146-8fea-9ca727766170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:02.641897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ea5b5-e53e-4f7d-b903-47d3550c6c20 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:02.651989 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3140/6209] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:06:02.655203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ea5b5-e53e-4f7d-b903-47d3550c6c20 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:02.661561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddafabd-b69b-456a-92e9-5292b1434b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:02.662582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddafabd-b69b-456a-92e9-5292b1434b24 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:02.663076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddafabd-b69b-456a-92e9-5292b1434b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:02.663581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddafabd-b69b-456a-92e9-5292b1434b24 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:02.664537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddafabd-b69b-456a-92e9-5292b1434b24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:06:02.665272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddafabd-b69b-456a-92e9-5292b1434b24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:02.667142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddafabd-b69b-456a-92e9-5292b1434b24 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:02.682194 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3070/6210] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:06:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:06:02.686497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadc648-9a37-4146-8fea-9ca727766170 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:02.714789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadc648-9a37-4146-8fea-9ca727766170 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:02.725225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889ce0d-487f-4cf2-b1d5-954eedd23d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:02.727285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889ce0d-487f-4cf2-b1d5-954eedd23d7b admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:02.728695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889ce0d-487f-4cf2-b1d5-954eedd23d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:02.730315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889ce0d-487f-4cf2-b1d5-954eedd23d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:02.732754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889ce0d-487f-4cf2-b1d5-954eedd23d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:02.737950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889ce0d-487f-4cf2-b1d5-954eedd23d7b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:02.784808 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3141/6211] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:06:02 2021] POST /identity/v3/projects => generated 353 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:06:02.789426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddafabd-b69b-456a-92e9-5292b1434b24 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:02.804229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddafabd-b69b-456a-92e9-5292b1434b24 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:02.900188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494a5da-5dd5-4c8c-843b-ad4946c2e329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:02.901402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494a5da-5dd5-4c8c-843b-ad4946c2e329 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:02.901876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494a5da-5dd5-4c8c-843b-ad4946c2e329 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:02.902534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494a5da-5dd5-4c8c-843b-ad4946c2e329 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:02.904831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494a5da-5dd5-4c8c-843b-ad4946c2e329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:02.911959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494a5da-5dd5-4c8c-843b-ad4946c2e329 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:02.963083 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3071/6212] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:06:02 2021] POST /identity/v3/users => generated 277 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:06:02.966727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889ce0d-487f-4cf2-b1d5-954eedd23d7b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:02.987278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889ce0d-487f-4cf2-b1d5-954eedd23d7b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:02.994800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4c05b-98e5-4e41-a91e-e9a0f5c7f536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:02.997279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4c05b-98e5-4e41-a91e-e9a0f5c7f536 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:02.997851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4c05b-98e5-4e41-a91e-e9a0f5c7f536 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:02.998524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4c05b-98e5-4e41-a91e-e9a0f5c7f536 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:02.999478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4c05b-98e5-4e41-a91e-e9a0f5c7f536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:03.001462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4c05b-98e5-4e41-a91e-e9a0f5c7f536 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:03.016017 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3142/6213] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:02 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:06:03.021065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494a5da-5dd5-4c8c-843b-ad4946c2e329 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:03.040109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494a5da-5dd5-4c8c-843b-ad4946c2e329 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:03.049209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff478a0a-e5aa-4757-95fc-e6ed6d0bee5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:03.051455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff478a0a-e5aa-4757-95fc-e6ed6d0bee5b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:03.052394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff478a0a-e5aa-4757-95fc-e6ed6d0bee5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:03.052886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff478a0a-e5aa-4757-95fc-e6ed6d0bee5b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:03.053851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff478a0a-e5aa-4757-95fc-e6ed6d0bee5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:03.057043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff478a0a-e5aa-4757-95fc-e6ed6d0bee5b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:03.087840 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3072/6214] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:03 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:03.091515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4c05b-98e5-4e41-a91e-e9a0f5c7f536 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:03.106936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4c05b-98e5-4e41-a91e-e9a0f5c7f536 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:03.114077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cb23d-01c0-4f1f-b0ae-3ceabbd713a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:03.116326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cb23d-01c0-4f1f-b0ae-3ceabbd713a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:03.116697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cb23d-01c0-4f1f-b0ae-3ceabbd713a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:03.117032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cb23d-01c0-4f1f-b0ae-3ceabbd713a1 admin admin] PATH_INFO: `/v3/projects/7b528b658d1d4b2b9e31d97935c5876a/users/77b450217de14fa18ddbdc37a7e0ca6f/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:03.136605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cb23d-01c0-4f1f-b0ae-3ceabbd713a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b528b658d1d4b2b9e31d97935c5876a, user_id=77b450217de14fa18ddbdc37a7e0ca6f, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:03.140249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cb23d-01c0-4f1f-b0ae-3ceabbd713a1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:03.178794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f25bd-6237-43e5-9fee-b92f29a6ac02 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:03.179012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f25bd-6237-43e5-9fee-b92f29a6ac02 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:03.179276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f25bd-6237-43e5-9fee-b92f29a6ac02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:03.190378 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3143/6215] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:06:03 2021] PUT /identity/v3/projects/7b528b658d1d4b2b9e31d97935c5876a/users/77b450217de14fa18ddbdc37a7e0ca6f/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:03.223053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-412f25bd-6237-43e5-9fee-b92f29a6ac02 None None] MFA Rules not processed for user `77b450217de14fa18ddbdc37a7e0ca6f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:03.225591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-412f25bd-6237-43e5-9fee-b92f29a6ac02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:03.342927 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3073/6216] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:03 2021] POST /identity/v3/auth/tokens => generated 3220 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:03.355304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cb23d-01c0-4f1f-b0ae-3ceabbd713a1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:03.357216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9a3cb23d-01c0-4f1f-b0ae-3ceabbd713a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:03.479093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cb23d-01c0-4f1f-b0ae-3ceabbd713a1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:03.485064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43710751-e862-44d5-b9cf-8ed9320287b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:03.485990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43710751-e862-44d5-b9cf-8ed9320287b5 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:03.487594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43710751-e862-44d5-b9cf-8ed9320287b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:03.488364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43710751-e862-44d5-b9cf-8ed9320287b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:03.501944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43710751-e862-44d5-b9cf-8ed9320287b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:03.504414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43710751-e862-44d5-b9cf-8ed9320287b5 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:03.516945 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3144/6217] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:06:03 2021] GET /identity/v3/auth/tokens => generated 3220 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:06:06.856310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015333b9-f651-4775-b6e9-89af924303f6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:06.856867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015333b9-f651-4775-b6e9-89af924303f6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:06.857440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015333b9-f651-4775-b6e9-89af924303f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:06.905317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-015333b9-f651-4775-b6e9-89af924303f6 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:06.919074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-015333b9-f651-4775-b6e9-89af924303f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:07.059641 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3074/6218] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:06:06 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:07.160704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43710751-e862-44d5-b9cf-8ed9320287b5 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:07.163331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-43710751-e862-44d5-b9cf-8ed9320287b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:07.292679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43710751-e862-44d5-b9cf-8ed9320287b5 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:07.310540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9405fd-dbb0-4840-82e0-84ef19b982d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:07.311308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9405fd-dbb0-4840-82e0-84ef19b982d5 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:07.311458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9405fd-dbb0-4840-82e0-84ef19b982d5 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:07.311731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9405fd-dbb0-4840-82e0-84ef19b982d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:07.342348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9405fd-dbb0-4840-82e0-84ef19b982d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:07.344095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9405fd-dbb0-4840-82e0-84ef19b982d5 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:07.362938 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3145/6219] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:06:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:06:11.296416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015333b9-f651-4775-b6e9-89af924303f6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:11.491459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015333b9-f651-4775-b6e9-89af924303f6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:11.513162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58d7fc-d1cd-4763-9390-45cd697db498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:11.514045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58d7fc-d1cd-4763-9390-45cd697db498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:11.514366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58d7fc-d1cd-4763-9390-45cd697db498 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:11.514656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58d7fc-d1cd-4763-9390-45cd697db498 admin admin] PATH_INFO: `/v3/users/77b450217de14fa18ddbdc37a7e0ca6f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:11.519337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58d7fc-d1cd-4763-9390-45cd697db498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b450217de14fa18ddbdc37a7e0ca6f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:11.522076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58d7fc-d1cd-4763-9390-45cd697db498 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:11.671590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8d58d7fc-d1cd-4763-9390-45cd697db498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b450217de14fa18ddbdc37a7e0ca6f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:11.699077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8d58d7fc-d1cd-4763-9390-45cd697db498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b450217de14fa18ddbdc37a7e0ca6f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:11.746777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8d58d7fc-d1cd-4763-9390-45cd697db498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b450217de14fa18ddbdc37a7e0ca6f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:11.747650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8d58d7fc-d1cd-4763-9390-45cd697db498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b450217de14fa18ddbdc37a7e0ca6f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:11.776886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8d58d7fc-d1cd-4763-9390-45cd697db498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b450217de14fa18ddbdc37a7e0ca6f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:11.791320 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3075/6220] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:06:11 2021] DELETE /identity/v3/users/77b450217de14fa18ddbdc37a7e0ca6f => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:11.793158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139f909-7ff8-4999-8944-f82df604237c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:11.793650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139f909-7ff8-4999-8944-f82df604237c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:11.793750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139f909-7ff8-4999-8944-f82df604237c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:11.848428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c139f909-7ff8-4999-8944-f82df604237c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:11.851451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c139f909-7ff8-4999-8944-f82df604237c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:12.003309 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3146/6221] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:12.030099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58d7fc-d1cd-4763-9390-45cd697db498 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:12.031937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8d58d7fc-d1cd-4763-9390-45cd697db498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:12.229003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58d7fc-d1cd-4763-9390-45cd697db498 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:12.240228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4e110-7747-4a15-8d18-d669379b533c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:12.240784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4e110-7747-4a15-8d18-d669379b533c service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:12.241178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4e110-7747-4a15-8d18-d669379b533c service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:12.241401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4e110-7747-4a15-8d18-d669379b533c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:12.264840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4e110-7747-4a15-8d18-d669379b533c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:12.266331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4e110-7747-4a15-8d18-d669379b533c service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:12.291890 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3076/6222] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:06:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:06:13.200313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139f909-7ff8-4999-8944-f82df604237c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:13.202602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c139f909-7ff8-4999-8944-f82df604237c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:13.232427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139f909-7ff8-4999-8944-f82df604237c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:13.256255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eea175-539d-41ab-8e92-bcb23a42f727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:13.259420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eea175-539d-41ab-8e92-bcb23a42f727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:13.259705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eea175-539d-41ab-8e92-bcb23a42f727 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:13.259990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eea175-539d-41ab-8e92-bcb23a42f727 admin admin] PATH_INFO: `/v3/projects/7b528b658d1d4b2b9e31d97935c5876a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:13.263821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eea175-539d-41ab-8e92-bcb23a42f727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b528b658d1d4b2b9e31d97935c5876a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:13.265775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eea175-539d-41ab-8e92-bcb23a42f727 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:13.377617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-34eea175-539d-41ab-8e92-bcb23a42f727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b528b658d1d4b2b9e31d97935c5876a', 'request_id': 'req-34eea175-539d-41ab-8e92-bcb23a42f727'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:13.386706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-34eea175-539d-41ab-8e92-bcb23a42f727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b528b658d1d4b2b9e31d97935c5876a', 'request_id': 'req-34eea175-539d-41ab-8e92-bcb23a42f727'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:13.408742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-34eea175-539d-41ab-8e92-bcb23a42f727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b528b658d1d4b2b9e31d97935c5876a', 'request_id': 'req-34eea175-539d-41ab-8e92-bcb23a42f727'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:13.425225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-34eea175-539d-41ab-8e92-bcb23a42f727 admin admin] The token cache is being invalidate because project 7b528b658d1d4b2b9e31d97935c5876a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:06:13.425754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-34eea175-539d-41ab-8e92-bcb23a42f727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:13.429336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-34eea175-539d-41ab-8e92-bcb23a42f727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:13.431640 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3147/6223] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:06:13 2021] DELETE /identity/v3/projects/7b528b658d1d4b2b9e31d97935c5876a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:13.438078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb944c-22ab-4803-a44d-956cc4a11611 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:13.438646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb944c-22ab-4803-a44d-956cc4a11611 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:13.438646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb944c-22ab-4803-a44d-956cc4a11611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:13.484033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-08cb944c-22ab-4803-a44d-956cc4a11611 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:13.485287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-08cb944c-22ab-4803-a44d-956cc4a11611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:13.585703 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3077/6224] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:13.604916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539ab06-4a09-41af-bf64-b3962880f3f4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:13.605202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539ab06-4a09-41af-bf64-b3962880f3f4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:13.605475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539ab06-4a09-41af-bf64-b3962880f3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:13.665131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2539ab06-4a09-41af-bf64-b3962880f3f4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:13.666801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2539ab06-4a09-41af-bf64-b3962880f3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:13.714038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb944c-22ab-4803-a44d-956cc4a11611 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:13.718997 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3148/6225] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:13.742244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb944c-22ab-4803-a44d-956cc4a11611 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:13.757731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf20c5-0d13-48bb-8994-bad7789bc16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:13.759415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf20c5-0d13-48bb-8994-bad7789bc16b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:13.759934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf20c5-0d13-48bb-8994-bad7789bc16b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:13.760405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf20c5-0d13-48bb-8994-bad7789bc16b admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:13.761690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf20c5-0d13-48bb-8994-bad7789bc16b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:06:13.762228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf20c5-0d13-48bb-8994-bad7789bc16b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:13.764478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf20c5-0d13-48bb-8994-bad7789bc16b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:13.793310 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3078/6226] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:06:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:06:13.797316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539ab06-4a09-41af-bf64-b3962880f3f4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:13.815831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539ab06-4a09-41af-bf64-b3962880f3f4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:13.822832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597c06f-b867-49ff-84d9-e9e841043c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:13.823679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597c06f-b867-49ff-84d9-e9e841043c7c admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:13.824070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597c06f-b867-49ff-84d9-e9e841043c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:13.824470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597c06f-b867-49ff-84d9-e9e841043c7c admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:13.825324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597c06f-b867-49ff-84d9-e9e841043c7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:13.827420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597c06f-b867-49ff-84d9-e9e841043c7c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:13.890640 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3149/6227] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:06:13 2021] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:06:13.892888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf20c5-0d13-48bb-8994-bad7789bc16b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:13.914046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf20c5-0d13-48bb-8994-bad7789bc16b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:14.092444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d2aad-31d3-42f7-9403-fcc7e58aecb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:14.106306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d2aad-31d3-42f7-9403-fcc7e58aecb4 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:14.106306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d2aad-31d3-42f7-9403-fcc7e58aecb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:14.106306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d2aad-31d3-42f7-9403-fcc7e58aecb4 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:14.106306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d2aad-31d3-42f7-9403-fcc7e58aecb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:14.106723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d2aad-31d3-42f7-9403-fcc7e58aecb4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:14.172192 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3079/6228] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:06:13 2021] POST /identity/v3/users => generated 291 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:06:14.175848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597c06f-b867-49ff-84d9-e9e841043c7c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:14.197631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597c06f-b867-49ff-84d9-e9e841043c7c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:14.215838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c86904-9121-483d-9466-2095db02c023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:14.216878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c86904-9121-483d-9466-2095db02c023 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:14.218576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c86904-9121-483d-9466-2095db02c023 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:14.218971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c86904-9121-483d-9466-2095db02c023 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:14.219813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c86904-9121-483d-9466-2095db02c023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:14.230858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c86904-9121-483d-9466-2095db02c023 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:14.271362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d2aad-31d3-42f7-9403-fcc7e58aecb4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:14.279180 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3150/6229] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:14 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:14.302913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d2aad-31d3-42f7-9403-fcc7e58aecb4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:14.320732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b0b3b-cce7-4f01-97aa-692838ba8c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:14.323094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0b3b-cce7-4f01-97aa-692838ba8c36 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:14.324057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0b3b-cce7-4f01-97aa-692838ba8c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:14.326697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0b3b-cce7-4f01-97aa-692838ba8c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:14.329071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b0b3b-cce7-4f01-97aa-692838ba8c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:14.335645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b0b3b-cce7-4f01-97aa-692838ba8c36 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:14.367269 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3080/6230] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:14 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:14.370954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c86904-9121-483d-9466-2095db02c023 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:14.387168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c86904-9121-483d-9466-2095db02c023 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:14.398220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceae063-8d83-4bc2-8681-35721d139dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:14.399540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceae063-8d83-4bc2-8681-35721d139dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:14.400042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceae063-8d83-4bc2-8681-35721d139dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:14.400635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceae063-8d83-4bc2-8681-35721d139dc5 admin admin] PATH_INFO: `/v3/projects/a7771ebe256e4721a6fca2f2285fe1d1/users/d9aca39e5e5d46529c78376a310d35b7/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:14.444322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceae063-8d83-4bc2-8681-35721d139dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7771ebe256e4721a6fca2f2285fe1d1, user_id=d9aca39e5e5d46529c78376a310d35b7, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:14.447488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceae063-8d83-4bc2-8681-35721d139dc5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:14.475899 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3151/6231] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:06:14 2021] PUT /identity/v3/projects/a7771ebe256e4721a6fca2f2285fe1d1/users/d9aca39e5e5d46529c78376a310d35b7/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:06:14.485726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724c37c-62c1-4983-8484-2a9aa5936229 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:14.487323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724c37c-62c1-4983-8484-2a9aa5936229 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:14.487820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724c37c-62c1-4983-8484-2a9aa5936229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:14.555809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d724c37c-62c1-4983-8484-2a9aa5936229 None None] MFA Rules not processed for user `d9aca39e5e5d46529c78376a310d35b7`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:14.557936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d724c37c-62c1-4983-8484-2a9aa5936229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:14.696624 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3081/6232] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:14 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:14.701038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceae063-8d83-4bc2-8681-35721d139dc5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:14.813590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548daa3-cb4c-4e36-89b1-27486369872d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:14.814029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548daa3-cb4c-4e36-89b1-27486369872d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:14.814480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548daa3-cb4c-4e36-89b1-27486369872d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:14.868386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b548daa3-cb4c-4e36-89b1-27486369872d None None] MFA Rules not processed for user `d6278aefb6d5497aad3d74b47b2e95d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:14.870654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceae063-8d83-4bc2-8681-35721d139dc5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:14.872701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b548daa3-cb4c-4e36-89b1-27486369872d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:14.887844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37aeb59-e328-4233-96b0-0852640650b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:14.888527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37aeb59-e328-4233-96b0-0852640650b4 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:14.888836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37aeb59-e328-4233-96b0-0852640650b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:14.889112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37aeb59-e328-4233-96b0-0852640650b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:14.889823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37aeb59-e328-4233-96b0-0852640650b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:14.892286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37aeb59-e328-4233-96b0-0852640650b4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:14.958724 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3152/6233] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:06:14 2021] POST /identity/v3/projects => generated 381 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:06:14.959675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37aeb59-e328-4233-96b0-0852640650b4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:15.081803 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3082/6234] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:14 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:06:15.150205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37aeb59-e328-4233-96b0-0852640650b4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:15.170611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf8a57-e0a0-4acf-8047-f439a8ab2b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:15.175117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf8a57-e0a0-4acf-8047-f439a8ab2b6a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:15.175238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf8a57-e0a0-4acf-8047-f439a8ab2b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:15.175526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf8a57-e0a0-4acf-8047-f439a8ab2b6a admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:15.176400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf8a57-e0a0-4acf-8047-f439a8ab2b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:15.182568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf8a57-e0a0-4acf-8047-f439a8ab2b6a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:15.254799 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3153/6235] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:06:14 2021] POST /identity/v3/users => generated 297 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:06:15.256099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548daa3-cb4c-4e36-89b1-27486369872d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:15.275020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548daa3-cb4c-4e36-89b1-27486369872d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:15.287892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6824b-e455-4e2e-a4de-08208b64a940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:15.288590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6824b-e455-4e2e-a4de-08208b64a940 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:15.291008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6824b-e455-4e2e-a4de-08208b64a940 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:15.291327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6824b-e455-4e2e-a4de-08208b64a940 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:15.296871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6824b-e455-4e2e-a4de-08208b64a940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:15.299211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6824b-e455-4e2e-a4de-08208b64a940 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:15.328418 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3083/6236] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:15 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:15.331281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf8a57-e0a0-4acf-8047-f439a8ab2b6a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:15.355595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf8a57-e0a0-4acf-8047-f439a8ab2b6a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:15.372009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f4f2d-03b5-4d98-9bcf-8b206dfaf1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:15.373472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f4f2d-03b5-4d98-9bcf-8b206dfaf1e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:15.373765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f4f2d-03b5-4d98-9bcf-8b206dfaf1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:15.376236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f4f2d-03b5-4d98-9bcf-8b206dfaf1e2 admin admin] PATH_INFO: `/v3/projects/df585f845a704e128f607776c6b88e64/users/0742620e7d4c45ed8a6526562cc28df2/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:15.411503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f4f2d-03b5-4d98-9bcf-8b206dfaf1e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df585f845a704e128f607776c6b88e64, user_id=0742620e7d4c45ed8a6526562cc28df2, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:15.427808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f4f2d-03b5-4d98-9bcf-8b206dfaf1e2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:15.462988 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3154/6237] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:06:15 2021] PUT /identity/v3/projects/df585f845a704e128f607776c6b88e64/users/0742620e7d4c45ed8a6526562cc28df2/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:06:15.467072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6824b-e455-4e2e-a4de-08208b64a940 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:15.485600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6824b-e455-4e2e-a4de-08208b64a940 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:15.684697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802015d7-8a28-4062-a290-44e9071c4efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:15.685437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802015d7-8a28-4062-a290-44e9071c4efd admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:15.685678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802015d7-8a28-4062-a290-44e9071c4efd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:15.685960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802015d7-8a28-4062-a290-44e9071c4efd admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:15.689689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802015d7-8a28-4062-a290-44e9071c4efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:15.693803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802015d7-8a28-4062-a290-44e9071c4efd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:15.748697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f4f2d-03b5-4d98-9bcf-8b206dfaf1e2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:15.749866 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3084/6238] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:15 2021] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:15.767546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f4f2d-03b5-4d98-9bcf-8b206dfaf1e2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:15.772783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329711c-95b8-4440-a727-98cda2a9c2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:15.774027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329711c-95b8-4440-a727-98cda2a9c2b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:15.774568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329711c-95b8-4440-a727-98cda2a9c2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:15.775591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329711c-95b8-4440-a727-98cda2a9c2b3 admin admin] PATH_INFO: `/v3/projects/df585f845a704e128f607776c6b88e64/users/0742620e7d4c45ed8a6526562cc28df2/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:15.778936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329711c-95b8-4440-a727-98cda2a9c2b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df585f845a704e128f607776c6b88e64, user_id=0742620e7d4c45ed8a6526562cc28df2, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:15.781844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329711c-95b8-4440-a727-98cda2a9c2b3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:15.820125 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3155/6239] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:06:15 2021] PUT /identity/v3/projects/df585f845a704e128f607776c6b88e64/users/0742620e7d4c45ed8a6526562cc28df2/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:06:15.832578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9fb6d-5e14-4f94-b719-5f1886819d99 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:15.833175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9fb6d-5e14-4f94-b719-5f1886819d99 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:15.833503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9fb6d-5e14-4f94-b719-5f1886819d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:15.901264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-38e9fb6d-5e14-4f94-b719-5f1886819d99 None None] MFA Rules not processed for user `0742620e7d4c45ed8a6526562cc28df2`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:15.903178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-38e9fb6d-5e14-4f94-b719-5f1886819d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:16.090014 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3085/6240] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:15 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:16.094002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329711c-95b8-4440-a727-98cda2a9c2b3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:16.257865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329711c-95b8-4440-a727-98cda2a9c2b3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:16.271733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4df06-86ab-4b42-ab25-a5bfa82143aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:16.273686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4df06-86ab-4b42-ab25-a5bfa82143aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:16.273983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4df06-86ab-4b42-ab25-a5bfa82143aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:16.274285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4df06-86ab-4b42-ab25-a5bfa82143aa admin admin] PATH_INFO: `/v3/users/d9aca39e5e5d46529c78376a310d35b7` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:16.279529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4df06-86ab-4b42-ab25-a5bfa82143aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9aca39e5e5d46529c78376a310d35b7)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:16.292717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4df06-86ab-4b42-ab25-a5bfa82143aa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:16.407549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-14f4df06-86ab-4b42-ab25-a5bfa82143aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9aca39e5e5d46529c78376a310d35b7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:16.416497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-14f4df06-86ab-4b42-ab25-a5bfa82143aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9aca39e5e5d46529c78376a310d35b7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:16.417251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-14f4df06-86ab-4b42-ab25-a5bfa82143aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9aca39e5e5d46529c78376a310d35b7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:16.433838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-14f4df06-86ab-4b42-ab25-a5bfa82143aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9aca39e5e5d46529c78376a310d35b7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:16.444929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-14f4df06-86ab-4b42-ab25-a5bfa82143aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9aca39e5e5d46529c78376a310d35b7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:16.456179 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3156/6241] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:06:16 2021] DELETE /identity/v3/users/d9aca39e5e5d46529c78376a310d35b7 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:16.461421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2d1a-1acd-494a-ba8e-9aac7c69a38e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:16.462610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2d1a-1acd-494a-ba8e-9aac7c69a38e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:16.464825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2d1a-1acd-494a-ba8e-9aac7c69a38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:16.488306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b5bd2d1a-1acd-494a-ba8e-9aac7c69a38e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:16.491166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b5bd2d1a-1acd-494a-ba8e-9aac7c69a38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:16.597953 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3086/6242] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:16.653236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4df06-86ab-4b42-ab25-a5bfa82143aa admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:16.655183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-14f4df06-86ab-4b42-ab25-a5bfa82143aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:16.859423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4df06-86ab-4b42-ab25-a5bfa82143aa admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:16.871183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0ec97-e1ec-4879-9655-7f40018841c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:16.874887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0ec97-e1ec-4879-9655-7f40018841c8 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:16.874887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0ec97-e1ec-4879-9655-7f40018841c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:16.875163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0ec97-e1ec-4879-9655-7f40018841c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:16.947699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0ec97-e1ec-4879-9655-7f40018841c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:16.947699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0ec97-e1ec-4879-9655-7f40018841c8 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:17.002512 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3157/6243] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:06:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:06:19.259170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd2d1a-1acd-494a-ba8e-9aac7c69a38e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:19.262592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b5bd2d1a-1acd-494a-ba8e-9aac7c69a38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:19.305393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd2d1a-1acd-494a-ba8e-9aac7c69a38e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:19.343831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d0a55-dd26-44d8-bab7-0de7618b25ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:19.345021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0a55-dd26-44d8-bab7-0de7618b25ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:19.345554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0a55-dd26-44d8-bab7-0de7618b25ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:19.347118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d0a55-dd26-44d8-bab7-0de7618b25ae admin admin] PATH_INFO: `/v3/projects/a7771ebe256e4721a6fca2f2285fe1d1` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:19.351675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d0a55-dd26-44d8-bab7-0de7618b25ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7771ebe256e4721a6fca2f2285fe1d1)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:19.358202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d0a55-dd26-44d8-bab7-0de7618b25ae admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:19.519035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e67d0a55-dd26-44d8-bab7-0de7618b25ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7771ebe256e4721a6fca2f2285fe1d1', 'request_id': 'req-e67d0a55-dd26-44d8-bab7-0de7618b25ae'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:19.538196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e67d0a55-dd26-44d8-bab7-0de7618b25ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7771ebe256e4721a6fca2f2285fe1d1', 'request_id': 'req-e67d0a55-dd26-44d8-bab7-0de7618b25ae'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:19.555336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e67d0a55-dd26-44d8-bab7-0de7618b25ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7771ebe256e4721a6fca2f2285fe1d1', 'request_id': 'req-e67d0a55-dd26-44d8-bab7-0de7618b25ae'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:19.644120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e67d0a55-dd26-44d8-bab7-0de7618b25ae admin admin] The token cache is being invalidate because project a7771ebe256e4721a6fca2f2285fe1d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:06:19.644337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e67d0a55-dd26-44d8-bab7-0de7618b25ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:19.645801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e67d0a55-dd26-44d8-bab7-0de7618b25ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:19.648576 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3087/6244] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:06:19 2021] DELETE /identity/v3/projects/a7771ebe256e4721a6fca2f2285fe1d1 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:19.652540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0ec97-e1ec-4879-9655-7f40018841c8 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:19.670901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0ec97-e1ec-4879-9655-7f40018841c8 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:19.892494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0049aa-485b-4504-8b8e-82fba901c370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:19.893515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0049aa-485b-4504-8b8e-82fba901c370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:19.893942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0049aa-485b-4504-8b8e-82fba901c370 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:19.894627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0049aa-485b-4504-8b8e-82fba901c370 admin admin] PATH_INFO: `/v3/users/0742620e7d4c45ed8a6526562cc28df2` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:19.895666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0049aa-485b-4504-8b8e-82fba901c370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0742620e7d4c45ed8a6526562cc28df2)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:19.897645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0049aa-485b-4504-8b8e-82fba901c370 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:20.061902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6d0049aa-485b-4504-8b8e-82fba901c370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0742620e7d4c45ed8a6526562cc28df2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:20.080447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6d0049aa-485b-4504-8b8e-82fba901c370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0742620e7d4c45ed8a6526562cc28df2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:20.083702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6d0049aa-485b-4504-8b8e-82fba901c370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0742620e7d4c45ed8a6526562cc28df2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:20.132650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6d0049aa-485b-4504-8b8e-82fba901c370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0742620e7d4c45ed8a6526562cc28df2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:20.153055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6d0049aa-485b-4504-8b8e-82fba901c370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0742620e7d4c45ed8a6526562cc28df2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:20.165511 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3158/6245] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:06:19 2021] DELETE /identity/v3/users/0742620e7d4c45ed8a6526562cc28df2 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:21.049230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d0a55-dd26-44d8-bab7-0de7618b25ae admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:21.051137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e67d0a55-dd26-44d8-bab7-0de7618b25ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:21.077786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d0a55-dd26-44d8-bab7-0de7618b25ae admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:21.215429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfeb8e-5359-447d-b9e7-3639f5add352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:21.216916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfeb8e-5359-447d-b9e7-3639f5add352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:21.220089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfeb8e-5359-447d-b9e7-3639f5add352 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:21.220583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfeb8e-5359-447d-b9e7-3639f5add352 admin admin] PATH_INFO: `/v3/projects/df585f845a704e128f607776c6b88e64` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:21.222572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfeb8e-5359-447d-b9e7-3639f5add352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df585f845a704e128f607776c6b88e64)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:21.227620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfeb8e-5359-447d-b9e7-3639f5add352 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:21.357150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-51cfeb8e-5359-447d-b9e7-3639f5add352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df585f845a704e128f607776c6b88e64', 'request_id': 'req-51cfeb8e-5359-447d-b9e7-3639f5add352'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:21.375213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-51cfeb8e-5359-447d-b9e7-3639f5add352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df585f845a704e128f607776c6b88e64', 'request_id': 'req-51cfeb8e-5359-447d-b9e7-3639f5add352'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:21.394006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-51cfeb8e-5359-447d-b9e7-3639f5add352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df585f845a704e128f607776c6b88e64', 'request_id': 'req-51cfeb8e-5359-447d-b9e7-3639f5add352'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:21.425934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-51cfeb8e-5359-447d-b9e7-3639f5add352 admin admin] The token cache is being invalidate because project df585f845a704e128f607776c6b88e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:06:21.425934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-51cfeb8e-5359-447d-b9e7-3639f5add352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:21.425934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-51cfeb8e-5359-447d-b9e7-3639f5add352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:21.426927 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3088/6246] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:06:21 2021] DELETE /identity/v3/projects/df585f845a704e128f607776c6b88e64 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:21.432983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b87f8-2380-4ecc-8de6-02dc7aa0d4c0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:21.433481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b87f8-2380-4ecc-8de6-02dc7aa0d4c0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:21.433908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b87f8-2380-4ecc-8de6-02dc7aa0d4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:21.489646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-137b87f8-2380-4ecc-8de6-02dc7aa0d4c0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:21.493966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-137b87f8-2380-4ecc-8de6-02dc7aa0d4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:21.586339 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3159/6247] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:21.594039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a973da-3665-42ae-9d78-0b17baa13497 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:21.594539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a973da-3665-42ae-9d78-0b17baa13497 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:21.595620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a973da-3665-42ae-9d78-0b17baa13497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:21.660407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-92a973da-3665-42ae-9d78-0b17baa13497 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:21.662054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-92a973da-3665-42ae-9d78-0b17baa13497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:21.683589 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3089/6248] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:21.688151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b87f8-2380-4ecc-8de6-02dc7aa0d4c0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:21.708325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b87f8-2380-4ecc-8de6-02dc7aa0d4c0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:21.723114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d60cce-2ec3-4164-bf41-a04d791301ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:21.724867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d60cce-2ec3-4164-bf41-a04d791301ab admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:21.724867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d60cce-2ec3-4164-bf41-a04d791301ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:21.725137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d60cce-2ec3-4164-bf41-a04d791301ab admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:21.725885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d60cce-2ec3-4164-bf41-a04d791301ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:06:21.726236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d60cce-2ec3-4164-bf41-a04d791301ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:21.728551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d60cce-2ec3-4164-bf41-a04d791301ab admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:21.745377 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3160/6249] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:06:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:06:21.749881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a973da-3665-42ae-9d78-0b17baa13497 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:21.767659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a973da-3665-42ae-9d78-0b17baa13497 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:21.783463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca57b3-9961-4e0f-a929-98d7a25a3684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:21.786221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca57b3-9961-4e0f-a929-98d7a25a3684 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:21.786760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca57b3-9961-4e0f-a929-98d7a25a3684 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:21.787762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca57b3-9961-4e0f-a929-98d7a25a3684 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:21.791224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca57b3-9961-4e0f-a929-98d7a25a3684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:21.796741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca57b3-9961-4e0f-a929-98d7a25a3684 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:21.863511 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3090/6250] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:06:21 2021] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:06:21.865521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d60cce-2ec3-4164-bf41-a04d791301ab admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:21.886043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d60cce-2ec3-4164-bf41-a04d791301ab admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:22.063637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881d272-df81-4548-a175-a0eed20488f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:22.065752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d272-df81-4548-a175-a0eed20488f6 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:22.067518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d272-df81-4548-a175-a0eed20488f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:22.068115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d272-df81-4548-a175-a0eed20488f6 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:22.069529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881d272-df81-4548-a175-a0eed20488f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:22.078246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881d272-df81-4548-a175-a0eed20488f6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:22.135049 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3161/6251] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:06:21 2021] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:06:22.136519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca57b3-9961-4e0f-a929-98d7a25a3684 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:22.155897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca57b3-9961-4e0f-a929-98d7a25a3684 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:22.172588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd5e37-da6f-449a-949e-396abbacc17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:22.177942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd5e37-da6f-449a-949e-396abbacc17a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:22.178604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd5e37-da6f-449a-949e-396abbacc17a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:22.181239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd5e37-da6f-449a-949e-396abbacc17a admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:22.182224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd5e37-da6f-449a-949e-396abbacc17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:22.183994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd5e37-da6f-449a-949e-396abbacc17a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:22.233615 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3091/6252] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:22 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:22.239494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881d272-df81-4548-a175-a0eed20488f6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:22.265736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881d272-df81-4548-a175-a0eed20488f6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:22.296616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16601ded-7ce6-45a2-bfbe-28f7b2b74df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:22.297317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16601ded-7ce6-45a2-bfbe-28f7b2b74df1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:22.297605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16601ded-7ce6-45a2-bfbe-28f7b2b74df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:22.297887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16601ded-7ce6-45a2-bfbe-28f7b2b74df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:22.310549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16601ded-7ce6-45a2-bfbe-28f7b2b74df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:22.312301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16601ded-7ce6-45a2-bfbe-28f7b2b74df1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:22.358513 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3162/6253] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:22 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:22.362330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd5e37-da6f-449a-949e-396abbacc17a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:22.379421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd5e37-da6f-449a-949e-396abbacc17a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:22.401751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdd13e-4af1-4a42-8231-a77f0f5fe97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:22.401751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdd13e-4af1-4a42-8231-a77f0f5fe97c admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:22.401751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdd13e-4af1-4a42-8231-a77f0f5fe97c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:22.401751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdd13e-4af1-4a42-8231-a77f0f5fe97c admin admin] PATH_INFO: `/v3/projects/6ad6048fe60046e0a146ce06bfdae8bb/users/210d17b917fc4126aca683d592b285b5/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:22.449998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdd13e-4af1-4a42-8231-a77f0f5fe97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad6048fe60046e0a146ce06bfdae8bb, user_id=210d17b917fc4126aca683d592b285b5, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:22.460486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdd13e-4af1-4a42-8231-a77f0f5fe97c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:22.514831 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3092/6254] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:06:22 2021] PUT /identity/v3/projects/6ad6048fe60046e0a146ce06bfdae8bb/users/210d17b917fc4126aca683d592b285b5/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:22.516146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a3fb0-3faf-4063-8c8e-2dcaac2583c9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:22.516146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a3fb0-3faf-4063-8c8e-2dcaac2583c9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:22.516710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a3fb0-3faf-4063-8c8e-2dcaac2583c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:22.597135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d77a3fb0-3faf-4063-8c8e-2dcaac2583c9 None None] MFA Rules not processed for user `210d17b917fc4126aca683d592b285b5`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:22.598340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d77a3fb0-3faf-4063-8c8e-2dcaac2583c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:22.785535 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3163/6255] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:22 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:22.790748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdd13e-4af1-4a42-8231-a77f0f5fe97c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:22.977134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdd13e-4af1-4a42-8231-a77f0f5fe97c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:22.983307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693f4a4-d5de-42f3-afcc-01b41182533d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:22.984216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693f4a4-d5de-42f3-afcc-01b41182533d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:22.984732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693f4a4-d5de-42f3-afcc-01b41182533d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:22.985373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693f4a4-d5de-42f3-afcc-01b41182533d admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:22.987156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693f4a4-d5de-42f3-afcc-01b41182533d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:22.989843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693f4a4-d5de-42f3-afcc-01b41182533d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:23.042161 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3093/6256] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:06:22 2021] POST /identity/v3/projects => generated 363 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:06:23.045970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a3fb0-3faf-4063-8c8e-2dcaac2583c9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:23.064327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a3fb0-3faf-4063-8c8e-2dcaac2583c9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:23.317707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89091bac-8923-40c6-bfd1-ceb7bea8f0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:23.319188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89091bac-8923-40c6-bfd1-ceb7bea8f0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:23.319685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89091bac-8923-40c6-bfd1-ceb7bea8f0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:23.320219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89091bac-8923-40c6-bfd1-ceb7bea8f0f0 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:23.321201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89091bac-8923-40c6-bfd1-ceb7bea8f0f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:23.324815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89091bac-8923-40c6-bfd1-ceb7bea8f0f0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:23.403557 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3164/6257] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:06:23 2021] POST /identity/v3/users => generated 288 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:06:23.407919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693f4a4-d5de-42f3-afcc-01b41182533d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:23.424593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693f4a4-d5de-42f3-afcc-01b41182533d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:23.440324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7a12b-8489-4566-9491-d4dc5d9069ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:23.441275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7a12b-8489-4566-9491-d4dc5d9069ba admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:23.441745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7a12b-8489-4566-9491-d4dc5d9069ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:23.442668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7a12b-8489-4566-9491-d4dc5d9069ba admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:23.443652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7a12b-8489-4566-9491-d4dc5d9069ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:23.449056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7a12b-8489-4566-9491-d4dc5d9069ba admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:23.481128 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3094/6258] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:23 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:23.485084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89091bac-8923-40c6-bfd1-ceb7bea8f0f0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:23.503186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89091bac-8923-40c6-bfd1-ceb7bea8f0f0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:23.519323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aba9cd-eb67-4f04-9470-68d1217ca407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:23.521092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aba9cd-eb67-4f04-9470-68d1217ca407 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:23.521914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aba9cd-eb67-4f04-9470-68d1217ca407 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:23.529798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aba9cd-eb67-4f04-9470-68d1217ca407 admin admin] PATH_INFO: `/v3/projects/4eccb24efc8e499fb64a708fc392aa66/users/cd06892092e54ae69eeb33e90f9af761/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:23.566268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aba9cd-eb67-4f04-9470-68d1217ca407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eccb24efc8e499fb64a708fc392aa66, user_id=cd06892092e54ae69eeb33e90f9af761, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:23.573938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aba9cd-eb67-4f04-9470-68d1217ca407 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:23.596162 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3165/6259] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:06:23 2021] PUT /identity/v3/projects/4eccb24efc8e499fb64a708fc392aa66/users/cd06892092e54ae69eeb33e90f9af761/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:23.599907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7a12b-8489-4566-9491-d4dc5d9069ba admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:23.617291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7a12b-8489-4566-9491-d4dc5d9069ba admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:23.760144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087de882-2299-4d1b-9a13-2a088db7ee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:23.760861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087de882-2299-4d1b-9a13-2a088db7ee95 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:23.762294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087de882-2299-4d1b-9a13-2a088db7ee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:23.762604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087de882-2299-4d1b-9a13-2a088db7ee95 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:23.765568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087de882-2299-4d1b-9a13-2a088db7ee95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:23.767899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087de882-2299-4d1b-9a13-2a088db7ee95 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:23.792730 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3095/6260] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:23 2021] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:23.795211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aba9cd-eb67-4f04-9470-68d1217ca407 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:23.811071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aba9cd-eb67-4f04-9470-68d1217ca407 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:23.821835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c6ada-5e68-4512-ad07-17161ee68489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:23.822823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c6ada-5e68-4512-ad07-17161ee68489 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:23.823152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c6ada-5e68-4512-ad07-17161ee68489 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:23.823438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c6ada-5e68-4512-ad07-17161ee68489 admin admin] PATH_INFO: `/v3/projects/4eccb24efc8e499fb64a708fc392aa66/users/cd06892092e54ae69eeb33e90f9af761/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:23.831685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c6ada-5e68-4512-ad07-17161ee68489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eccb24efc8e499fb64a708fc392aa66, user_id=cd06892092e54ae69eeb33e90f9af761, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:23.834685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c6ada-5e68-4512-ad07-17161ee68489 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:23.884710 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3166/6261] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:06:23 2021] PUT /identity/v3/projects/4eccb24efc8e499fb64a708fc392aa66/users/cd06892092e54ae69eeb33e90f9af761/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:23.891457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e7d9c-b2dc-4893-b438-6ce62934296e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:23.892274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e7d9c-b2dc-4893-b438-6ce62934296e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:23.892811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e7d9c-b2dc-4893-b438-6ce62934296e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:24.027473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-396e7d9c-b2dc-4893-b438-6ce62934296e None None] MFA Rules not processed for user `cd06892092e54ae69eeb33e90f9af761`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:24.029005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-396e7d9c-b2dc-4893-b438-6ce62934296e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:24.251720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c6ada-5e68-4512-ad07-17161ee68489 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:24.252169 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3096/6262] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:23 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:24.253516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b86c6ada-5e68-4512-ad07-17161ee68489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:24.352824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c6ada-5e68-4512-ad07-17161ee68489 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:24.359266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3f606-88f3-4bc8-828f-3b3400a42fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:24.360212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3f606-88f3-4bc8-828f-3b3400a42fbc service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:24.360721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3f606-88f3-4bc8-828f-3b3400a42fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:24.361147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3f606-88f3-4bc8-828f-3b3400a42fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:24.374723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3f606-88f3-4bc8-828f-3b3400a42fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:24.377278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3f606-88f3-4bc8-828f-3b3400a42fbc service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:24.390142 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3167/6263] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:06:24 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:06:24.653093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e7d9c-b2dc-4893-b438-6ce62934296e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:24.817768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e7d9c-b2dc-4893-b438-6ce62934296e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:24.830962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deab843-9d5c-45e3-b161-0ce1e7d8478d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:24.831101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deab843-9d5c-45e3-b161-0ce1e7d8478d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:24.831290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deab843-9d5c-45e3-b161-0ce1e7d8478d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:24.831569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deab843-9d5c-45e3-b161-0ce1e7d8478d admin admin] PATH_INFO: `/v3/users/210d17b917fc4126aca683d592b285b5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:24.832912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deab843-9d5c-45e3-b161-0ce1e7d8478d admin admin] RBAC: Authorizing `identity:delete_user(user_id=210d17b917fc4126aca683d592b285b5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:24.835221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deab843-9d5c-45e3-b161-0ce1e7d8478d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:24.973869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4deab843-9d5c-45e3-b161-0ce1e7d8478d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '210d17b917fc4126aca683d592b285b5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:24.999255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4deab843-9d5c-45e3-b161-0ce1e7d8478d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '210d17b917fc4126aca683d592b285b5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:25.056220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4deab843-9d5c-45e3-b161-0ce1e7d8478d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '210d17b917fc4126aca683d592b285b5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:25.061260 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4deab843-9d5c-45e3-b161-0ce1e7d8478d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '210d17b917fc4126aca683d592b285b5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:25.090152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4deab843-9d5c-45e3-b161-0ce1e7d8478d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '210d17b917fc4126aca683d592b285b5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:25.104067 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3097/6264] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:06:24 2021] DELETE /identity/v3/users/210d17b917fc4126aca683d592b285b5 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:25.105795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86694a-8319-4a8d-918e-7fb947489dcb None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:25.106275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86694a-8319-4a8d-918e-7fb947489dcb None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:25.106393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86694a-8319-4a8d-918e-7fb947489dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:25.145410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0f86694a-8319-4a8d-918e-7fb947489dcb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:25.146855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0f86694a-8319-4a8d-918e-7fb947489dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:25.299458 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3168/6265] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:25.315476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deab843-9d5c-45e3-b161-0ce1e7d8478d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:25.317583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4deab843-9d5c-45e3-b161-0ce1e7d8478d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:25.441228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deab843-9d5c-45e3-b161-0ce1e7d8478d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:25.445407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e762acc-5b73-4975-8c18-ae6a5586f85e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:25.446216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e762acc-5b73-4975-8c18-ae6a5586f85e service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:25.446536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e762acc-5b73-4975-8c18-ae6a5586f85e service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:25.446821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e762acc-5b73-4975-8c18-ae6a5586f85e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:25.460595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e762acc-5b73-4975-8c18-ae6a5586f85e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:25.462057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e762acc-5b73-4975-8c18-ae6a5586f85e service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:25.474908 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3098/6266] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:06:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:06:27.095627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86694a-8319-4a8d-918e-7fb947489dcb None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:27.098442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0f86694a-8319-4a8d-918e-7fb947489dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:27.116953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86694a-8319-4a8d-918e-7fb947489dcb None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:27.130886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b9c02-c9f0-4858-84a5-9e9095451da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:27.136250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b9c02-c9f0-4858-84a5-9e9095451da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:27.136717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b9c02-c9f0-4858-84a5-9e9095451da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:27.137221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b9c02-c9f0-4858-84a5-9e9095451da1 admin admin] PATH_INFO: `/v3/projects/6ad6048fe60046e0a146ce06bfdae8bb` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:27.139495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b9c02-c9f0-4858-84a5-9e9095451da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad6048fe60046e0a146ce06bfdae8bb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:27.142048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b9c02-c9f0-4858-84a5-9e9095451da1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:27.218938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-672b9c02-c9f0-4858-84a5-9e9095451da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad6048fe60046e0a146ce06bfdae8bb', 'request_id': 'req-672b9c02-c9f0-4858-84a5-9e9095451da1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:27.227909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-672b9c02-c9f0-4858-84a5-9e9095451da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad6048fe60046e0a146ce06bfdae8bb', 'request_id': 'req-672b9c02-c9f0-4858-84a5-9e9095451da1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:27.242354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-672b9c02-c9f0-4858-84a5-9e9095451da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad6048fe60046e0a146ce06bfdae8bb', 'request_id': 'req-672b9c02-c9f0-4858-84a5-9e9095451da1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:27.274227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-672b9c02-c9f0-4858-84a5-9e9095451da1 admin admin] The token cache is being invalidate because project 6ad6048fe60046e0a146ce06bfdae8bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:06:27.278408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-672b9c02-c9f0-4858-84a5-9e9095451da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:27.283494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-672b9c02-c9f0-4858-84a5-9e9095451da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:27.291140 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3169/6267] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:06:27 2021] DELETE /identity/v3/projects/6ad6048fe60046e0a146ce06bfdae8bb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:27.292071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e762acc-5b73-4975-8c18-ae6a5586f85e service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:27.310274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e762acc-5b73-4975-8c18-ae6a5586f85e service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:27.520057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f26d9f-fa9b-4d4d-b64d-11cdf48b8c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:27.521268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f26d9f-fa9b-4d4d-b64d-11cdf48b8c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:27.521268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f26d9f-fa9b-4d4d-b64d-11cdf48b8c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:27.521501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f26d9f-fa9b-4d4d-b64d-11cdf48b8c8f admin admin] PATH_INFO: `/v3/users/cd06892092e54ae69eeb33e90f9af761` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:27.523306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f26d9f-fa9b-4d4d-b64d-11cdf48b8c8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd06892092e54ae69eeb33e90f9af761)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:27.525208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f26d9f-fa9b-4d4d-b64d-11cdf48b8c8f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:27.644847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-50f26d9f-fa9b-4d4d-b64d-11cdf48b8c8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd06892092e54ae69eeb33e90f9af761'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:27.659292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-50f26d9f-fa9b-4d4d-b64d-11cdf48b8c8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd06892092e54ae69eeb33e90f9af761'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:27.693893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-50f26d9f-fa9b-4d4d-b64d-11cdf48b8c8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd06892092e54ae69eeb33e90f9af761'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:27.696103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-50f26d9f-fa9b-4d4d-b64d-11cdf48b8c8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd06892092e54ae69eeb33e90f9af761'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:27.724627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-50f26d9f-fa9b-4d4d-b64d-11cdf48b8c8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd06892092e54ae69eeb33e90f9af761'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:27.738973 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3099/6268] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:06:27 2021] DELETE /identity/v3/users/cd06892092e54ae69eeb33e90f9af761 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:29.278989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b9c02-c9f0-4858-84a5-9e9095451da1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:29.281278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-672b9c02-c9f0-4858-84a5-9e9095451da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:29.314478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b9c02-c9f0-4858-84a5-9e9095451da1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:29.455480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa14b0-8fe7-48b9-8c59-ed5540005943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:29.456641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa14b0-8fe7-48b9-8c59-ed5540005943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:29.461173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa14b0-8fe7-48b9-8c59-ed5540005943 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:29.461752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa14b0-8fe7-48b9-8c59-ed5540005943 admin admin] PATH_INFO: `/v3/projects/4eccb24efc8e499fb64a708fc392aa66` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:29.464077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa14b0-8fe7-48b9-8c59-ed5540005943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eccb24efc8e499fb64a708fc392aa66)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:29.467763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa14b0-8fe7-48b9-8c59-ed5540005943 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:29.589284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f1aa14b0-8fe7-48b9-8c59-ed5540005943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eccb24efc8e499fb64a708fc392aa66', 'request_id': 'req-f1aa14b0-8fe7-48b9-8c59-ed5540005943'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:29.608023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f1aa14b0-8fe7-48b9-8c59-ed5540005943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eccb24efc8e499fb64a708fc392aa66', 'request_id': 'req-f1aa14b0-8fe7-48b9-8c59-ed5540005943'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:29.630503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f1aa14b0-8fe7-48b9-8c59-ed5540005943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eccb24efc8e499fb64a708fc392aa66', 'request_id': 'req-f1aa14b0-8fe7-48b9-8c59-ed5540005943'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:29.652492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f1aa14b0-8fe7-48b9-8c59-ed5540005943 admin admin] The token cache is being invalidate because project 4eccb24efc8e499fb64a708fc392aa66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:06:29.652852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f1aa14b0-8fe7-48b9-8c59-ed5540005943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:29.653859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f1aa14b0-8fe7-48b9-8c59-ed5540005943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:29.664989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa690-84ff-4fda-a400-231297c0f942 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:29.664989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa690-84ff-4fda-a400-231297c0f942 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:29.665597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa690-84ff-4fda-a400-231297c0f942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:29.666675 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3170/6269] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:06:29 2021] DELETE /identity/v3/projects/4eccb24efc8e499fb64a708fc392aa66 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:29.703613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-46eaa690-84ff-4fda-a400-231297c0f942 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:29.706517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-46eaa690-84ff-4fda-a400-231297c0f942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:29.869797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af4c1-b5be-42c1-a5e5-42faae218304 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:29.869983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af4c1-b5be-42c1-a5e5-42faae218304 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:29.870300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af4c1-b5be-42c1-a5e5-42faae218304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:29.888473 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3100/6270] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:29.909804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e06af4c1-b5be-42c1-a5e5-42faae218304 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:29.911204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e06af4c1-b5be-42c1-a5e5-42faae218304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:29.936778 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3171/6271] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:29.940855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eaa690-84ff-4fda-a400-231297c0f942 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:29.954761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eaa690-84ff-4fda-a400-231297c0f942 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:29.968529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6cd39-23a7-41e2-a963-4f774113ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:29.969221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6cd39-23a7-41e2-a963-4f774113ab1c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:29.969504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6cd39-23a7-41e2-a963-4f774113ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:29.969781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6cd39-23a7-41e2-a963-4f774113ab1c admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:29.974186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6cd39-23a7-41e2-a963-4f774113ab1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:06:29.977595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6cd39-23a7-41e2-a963-4f774113ab1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:29.980249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6cd39-23a7-41e2-a963-4f774113ab1c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:30.014446 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3101/6272] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:06:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:06:30.018980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af4c1-b5be-42c1-a5e5-42faae218304 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:30.031905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af4c1-b5be-42c1-a5e5-42faae218304 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:30.051851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642a4ba-b2d8-4d75-96be-fe450c6bed9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:30.052562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642a4ba-b2d8-4d75-96be-fe450c6bed9c admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:30.052864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642a4ba-b2d8-4d75-96be-fe450c6bed9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:30.053144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642a4ba-b2d8-4d75-96be-fe450c6bed9c admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:30.054121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642a4ba-b2d8-4d75-96be-fe450c6bed9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:30.056120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642a4ba-b2d8-4d75-96be-fe450c6bed9c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:30.118056 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3172/6273] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:06:30 2021] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:06:30.121989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6cd39-23a7-41e2-a963-4f774113ab1c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:30.139458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6cd39-23a7-41e2-a963-4f774113ab1c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:30.362584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fa8d1-574a-417e-a23f-d7c46dc644ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:30.363803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fa8d1-574a-417e-a23f-d7c46dc644ac admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:30.364286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fa8d1-574a-417e-a23f-d7c46dc644ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:30.364763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fa8d1-574a-417e-a23f-d7c46dc644ac admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:30.366239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fa8d1-574a-417e-a23f-d7c46dc644ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:30.372752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fa8d1-574a-417e-a23f-d7c46dc644ac admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:30.423726 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3102/6274] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:06:30 2021] POST /identity/v3/users => generated 282 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:06:30.428236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642a4ba-b2d8-4d75-96be-fe450c6bed9c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:30.445162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642a4ba-b2d8-4d75-96be-fe450c6bed9c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:30.457934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d706c60-bbf8-461f-a5f4-67ebac12a1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:30.459503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d706c60-bbf8-461f-a5f4-67ebac12a1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:30.459949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d706c60-bbf8-461f-a5f4-67ebac12a1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:30.460761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d706c60-bbf8-461f-a5f4-67ebac12a1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:30.462172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d706c60-bbf8-461f-a5f4-67ebac12a1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:30.468567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d706c60-bbf8-461f-a5f4-67ebac12a1b1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:30.503402 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3173/6275] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:30 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:30.504204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fa8d1-574a-417e-a23f-d7c46dc644ac admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:30.523148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fa8d1-574a-417e-a23f-d7c46dc644ac admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:30.538899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833261e-82c8-4fda-9340-935ba2206884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:30.539712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833261e-82c8-4fda-9340-935ba2206884 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:30.540108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833261e-82c8-4fda-9340-935ba2206884 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:30.540497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833261e-82c8-4fda-9340-935ba2206884 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:30.542018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833261e-82c8-4fda-9340-935ba2206884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:30.544897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833261e-82c8-4fda-9340-935ba2206884 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:30.571712 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3103/6276] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:30 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:30.573020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d706c60-bbf8-461f-a5f4-67ebac12a1b1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:30.595706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d706c60-bbf8-461f-a5f4-67ebac12a1b1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:30.608735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236df4a-d2e9-4156-a2a5-8e10267e9ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:30.610126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236df4a-d2e9-4156-a2a5-8e10267e9ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:30.610715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236df4a-d2e9-4156-a2a5-8e10267e9ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:30.611329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236df4a-d2e9-4156-a2a5-8e10267e9ba3 admin admin] PATH_INFO: `/v3/projects/dcb241800f9c4dc496d2fde2a4f123bc/users/dd60467c56204d1da096e07e2f788e35/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:30.650458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236df4a-d2e9-4156-a2a5-8e10267e9ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb241800f9c4dc496d2fde2a4f123bc, user_id=dd60467c56204d1da096e07e2f788e35, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:30.656213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236df4a-d2e9-4156-a2a5-8e10267e9ba3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:30.697774 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3174/6277] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:06:30 2021] PUT /identity/v3/projects/dcb241800f9c4dc496d2fde2a4f123bc/users/dd60467c56204d1da096e07e2f788e35/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:30.699698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d735f6-030d-4703-b142-ea9e5d00c71b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:30.700177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d735f6-030d-4703-b142-ea9e5d00c71b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:30.700859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d735f6-030d-4703-b142-ea9e5d00c71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:30.792167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d8d735f6-030d-4703-b142-ea9e5d00c71b None None] MFA Rules not processed for user `dd60467c56204d1da096e07e2f788e35`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:30.793661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d8d735f6-030d-4703-b142-ea9e5d00c71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:30.980917 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3104/6278] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:30 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:30.982523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236df4a-d2e9-4156-a2a5-8e10267e9ba3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:31.073268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236df4a-d2e9-4156-a2a5-8e10267e9ba3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:31.078470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a654f-e1cc-4f45-97f9-d7adc9b380e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:31.078965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a654f-e1cc-4f45-97f9-d7adc9b380e1 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:31.079295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a654f-e1cc-4f45-97f9-d7adc9b380e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:31.079572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a654f-e1cc-4f45-97f9-d7adc9b380e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:31.080295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a654f-e1cc-4f45-97f9-d7adc9b380e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:31.082661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a654f-e1cc-4f45-97f9-d7adc9b380e1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:31.121804 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3175/6279] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:06:30 2021] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:06:31.123333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d735f6-030d-4703-b142-ea9e5d00c71b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:31.148142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d735f6-030d-4703-b142-ea9e5d00c71b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:31.302676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47420f-38d9-43b8-b2a3-e3e813cb1850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:31.303896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47420f-38d9-43b8-b2a3-e3e813cb1850 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:31.304375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47420f-38d9-43b8-b2a3-e3e813cb1850 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:31.304826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47420f-38d9-43b8-b2a3-e3e813cb1850 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:31.306747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47420f-38d9-43b8-b2a3-e3e813cb1850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:31.313100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47420f-38d9-43b8-b2a3-e3e813cb1850 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:31.361921 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3105/6280] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:06:31 2021] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:06:31.364626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a654f-e1cc-4f45-97f9-d7adc9b380e1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:31.377687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a654f-e1cc-4f45-97f9-d7adc9b380e1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:31.402843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6896f-90d0-4d57-9970-f8f0cc65686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:31.403561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6896f-90d0-4d57-9970-f8f0cc65686c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:31.403936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6896f-90d0-4d57-9970-f8f0cc65686c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:31.404368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6896f-90d0-4d57-9970-f8f0cc65686c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:31.405335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6896f-90d0-4d57-9970-f8f0cc65686c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:31.411565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6896f-90d0-4d57-9970-f8f0cc65686c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:31.443243 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3176/6281] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:31 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:31.447118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47420f-38d9-43b8-b2a3-e3e813cb1850 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:31.461316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47420f-38d9-43b8-b2a3-e3e813cb1850 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:31.478516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf849f2d-a0e5-448c-906e-0366a340ea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:31.479645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf849f2d-a0e5-448c-906e-0366a340ea67 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:31.480029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf849f2d-a0e5-448c-906e-0366a340ea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:31.480416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf849f2d-a0e5-448c-906e-0366a340ea67 admin admin] PATH_INFO: `/v3/projects/ed845350e26245d198f99d889e094fa1/users/a0307fd23f0f42b6ae86b38dc9aee338/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:31.520149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf849f2d-a0e5-448c-906e-0366a340ea67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed845350e26245d198f99d889e094fa1, user_id=a0307fd23f0f42b6ae86b38dc9aee338, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:31.522507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf849f2d-a0e5-448c-906e-0366a340ea67 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:31.556794 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3106/6282] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:06:31 2021] PUT /identity/v3/projects/ed845350e26245d198f99d889e094fa1/users/a0307fd23f0f42b6ae86b38dc9aee338/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:31.558043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6896f-90d0-4d57-9970-f8f0cc65686c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:31.582117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6896f-90d0-4d57-9970-f8f0cc65686c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:31.721566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d19c07-d5f3-454d-a64a-b7ce75fcf1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:31.722340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d19c07-d5f3-454d-a64a-b7ce75fcf1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:31.722635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d19c07-d5f3-454d-a64a-b7ce75fcf1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:31.722964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d19c07-d5f3-454d-a64a-b7ce75fcf1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:31.723961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d19c07-d5f3-454d-a64a-b7ce75fcf1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:31.725669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d19c07-d5f3-454d-a64a-b7ce75fcf1c6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:31.738368 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3177/6283] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:31 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:31.742665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf849f2d-a0e5-448c-906e-0366a340ea67 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:31.756178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf849f2d-a0e5-448c-906e-0366a340ea67 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:31.777004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acd401-a44c-4371-9b51-3f53c81a4762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:31.780884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acd401-a44c-4371-9b51-3f53c81a4762 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:31.781845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acd401-a44c-4371-9b51-3f53c81a4762 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:31.782349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acd401-a44c-4371-9b51-3f53c81a4762 admin admin] PATH_INFO: `/v3/projects/ed845350e26245d198f99d889e094fa1/users/a0307fd23f0f42b6ae86b38dc9aee338/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:31.799246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8acd401-a44c-4371-9b51-3f53c81a4762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed845350e26245d198f99d889e094fa1, user_id=a0307fd23f0f42b6ae86b38dc9aee338, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:31.802184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8acd401-a44c-4371-9b51-3f53c81a4762 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:31.842710 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3107/6284] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:06:31 2021] PUT /identity/v3/projects/ed845350e26245d198f99d889e094fa1/users/a0307fd23f0f42b6ae86b38dc9aee338/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:31.854740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff418b-3617-47e0-9173-a4cac79cea75 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:31.855165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff418b-3617-47e0-9173-a4cac79cea75 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:31.858031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff418b-3617-47e0-9173-a4cac79cea75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:31.972152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-41ff418b-3617-47e0-9173-a4cac79cea75 None None] MFA Rules not processed for user `a0307fd23f0f42b6ae86b38dc9aee338`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:31.976582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-41ff418b-3617-47e0-9173-a4cac79cea75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:32.182921 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3178/6285] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:31 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:32.194766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acd401-a44c-4371-9b51-3f53c81a4762 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:32.196514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d8acd401-a44c-4371-9b51-3f53c81a4762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:32.319501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acd401-a44c-4371-9b51-3f53c81a4762 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:32.330822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03838a53-21c4-4291-ab94-8edc919b34d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:32.331633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838a53-21c4-4291-ab94-8edc919b34d0 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:32.332015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838a53-21c4-4291-ab94-8edc919b34d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:32.332390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838a53-21c4-4291-ab94-8edc919b34d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:32.362672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03838a53-21c4-4291-ab94-8edc919b34d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:32.364412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03838a53-21c4-4291-ab94-8edc919b34d0 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:32.382668 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3108/6286] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:06:32 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:06:32.518219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff418b-3617-47e0-9173-a4cac79cea75 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:32.540140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff418b-3617-47e0-9173-a4cac79cea75 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:32.570180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca989d-d928-4d55-b911-56bf510317b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:32.571418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca989d-d928-4d55-b911-56bf510317b3 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:32.571782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca989d-d928-4d55-b911-56bf510317b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:32.572191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca989d-d928-4d55-b911-56bf510317b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:32.731860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca989d-d928-4d55-b911-56bf510317b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:32.734089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca989d-d928-4d55-b911-56bf510317b3 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:32.756212 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3179/6287] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:06:32 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:06:36.122692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03838a53-21c4-4291-ab94-8edc919b34d0 service cinder] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:36.267859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03838a53-21c4-4291-ab94-8edc919b34d0 service cinder] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:36.275724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33227b97-a6dc-45b9-b6d2-b2c092949b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:36.276796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33227b97-a6dc-45b9-b6d2-b2c092949b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:36.277138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33227b97-a6dc-45b9-b6d2-b2c092949b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:36.277427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33227b97-a6dc-45b9-b6d2-b2c092949b44 admin admin] PATH_INFO: `/v3/users/dd60467c56204d1da096e07e2f788e35` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:36.278796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33227b97-a6dc-45b9-b6d2-b2c092949b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd60467c56204d1da096e07e2f788e35)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:36.280742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33227b97-a6dc-45b9-b6d2-b2c092949b44 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:36.349389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-33227b97-a6dc-45b9-b6d2-b2c092949b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd60467c56204d1da096e07e2f788e35'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:36.359576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-33227b97-a6dc-45b9-b6d2-b2c092949b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd60467c56204d1da096e07e2f788e35'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:36.375649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-33227b97-a6dc-45b9-b6d2-b2c092949b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd60467c56204d1da096e07e2f788e35'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:36.377423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-33227b97-a6dc-45b9-b6d2-b2c092949b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd60467c56204d1da096e07e2f788e35'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:36.394711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-33227b97-a6dc-45b9-b6d2-b2c092949b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd60467c56204d1da096e07e2f788e35'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:36.401959 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3109/6288] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:06:36 2021] DELETE /identity/v3/users/dd60467c56204d1da096e07e2f788e35 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:36.407030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4894c-f944-4d88-9c49-79a827650f54 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:36.407674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4894c-f944-4d88-9c49-79a827650f54 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:36.407674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4894c-f944-4d88-9c49-79a827650f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:36.434037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-40d4894c-f944-4d88-9c49-79a827650f54 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:36.435919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-40d4894c-f944-4d88-9c49-79a827650f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:36.517939 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3180/6289] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:06:36.567302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33227b97-a6dc-45b9-b6d2-b2c092949b44 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:36.568995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-33227b97-a6dc-45b9-b6d2-b2c092949b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:36.720457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33227b97-a6dc-45b9-b6d2-b2c092949b44 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:36.732360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40691804-d1bb-4f17-b9bc-4a2f54fe683f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:36.742488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40691804-d1bb-4f17-b9bc-4a2f54fe683f service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:36.743901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40691804-d1bb-4f17-b9bc-4a2f54fe683f service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:36.743901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40691804-d1bb-4f17-b9bc-4a2f54fe683f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:36.771088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40691804-d1bb-4f17-b9bc-4a2f54fe683f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:36.775457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40691804-d1bb-4f17-b9bc-4a2f54fe683f service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:36.803030 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3110/6290] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:06:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:06:38.126825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4894c-f944-4d88-9c49-79a827650f54 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:38.128284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-40d4894c-f944-4d88-9c49-79a827650f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:38.142688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4894c-f944-4d88-9c49-79a827650f54 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:38.147793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea0219-39f6-48cc-829a-2f0071469f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:38.148648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea0219-39f6-48cc-829a-2f0071469f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:38.148937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea0219-39f6-48cc-829a-2f0071469f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:38.149219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea0219-39f6-48cc-829a-2f0071469f8d admin admin] PATH_INFO: `/v3/projects/dcb241800f9c4dc496d2fde2a4f123bc` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:38.150579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea0219-39f6-48cc-829a-2f0071469f8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb241800f9c4dc496d2fde2a4f123bc)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:38.152618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea0219-39f6-48cc-829a-2f0071469f8d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:38.218632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a8ea0219-39f6-48cc-829a-2f0071469f8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb241800f9c4dc496d2fde2a4f123bc', 'request_id': 'req-a8ea0219-39f6-48cc-829a-2f0071469f8d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:38.234027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a8ea0219-39f6-48cc-829a-2f0071469f8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb241800f9c4dc496d2fde2a4f123bc', 'request_id': 'req-a8ea0219-39f6-48cc-829a-2f0071469f8d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:38.253444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a8ea0219-39f6-48cc-829a-2f0071469f8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb241800f9c4dc496d2fde2a4f123bc', 'request_id': 'req-a8ea0219-39f6-48cc-829a-2f0071469f8d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:38.277576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a8ea0219-39f6-48cc-829a-2f0071469f8d admin admin] The token cache is being invalidate because project dcb241800f9c4dc496d2fde2a4f123bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:06:38.278003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a8ea0219-39f6-48cc-829a-2f0071469f8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:38.278954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a8ea0219-39f6-48cc-829a-2f0071469f8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:38.281608 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3181/6291] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:06:38 2021] DELETE /identity/v3/projects/dcb241800f9c4dc496d2fde2a4f123bc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:38.285694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40691804-d1bb-4f17-b9bc-4a2f54fe683f service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:38.300979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40691804-d1bb-4f17-b9bc-4a2f54fe683f service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:38.391286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37233d-13c4-487e-8ec4-8b670d845ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:38.393030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37233d-13c4-487e-8ec4-8b670d845ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:38.393258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37233d-13c4-487e-8ec4-8b670d845ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:38.393521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37233d-13c4-487e-8ec4-8b670d845ddb admin admin] PATH_INFO: `/v3/users/a0307fd23f0f42b6ae86b38dc9aee338` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:38.395550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37233d-13c4-487e-8ec4-8b670d845ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0307fd23f0f42b6ae86b38dc9aee338)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:38.399085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37233d-13c4-487e-8ec4-8b670d845ddb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:38.474472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-fd37233d-13c4-487e-8ec4-8b670d845ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0307fd23f0f42b6ae86b38dc9aee338'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:38.494915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-fd37233d-13c4-487e-8ec4-8b670d845ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0307fd23f0f42b6ae86b38dc9aee338'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:38.511776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-fd37233d-13c4-487e-8ec4-8b670d845ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0307fd23f0f42b6ae86b38dc9aee338'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:38.513255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-fd37233d-13c4-487e-8ec4-8b670d845ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0307fd23f0f42b6ae86b38dc9aee338'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:38.531184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-fd37233d-13c4-487e-8ec4-8b670d845ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0307fd23f0f42b6ae86b38dc9aee338'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:38.556922 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3111/6292] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:06:38 2021] DELETE /identity/v3/users/a0307fd23f0f42b6ae86b38dc9aee338 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:39.377539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea0219-39f6-48cc-829a-2f0071469f8d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:39.379390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a8ea0219-39f6-48cc-829a-2f0071469f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:39.403952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea0219-39f6-48cc-829a-2f0071469f8d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:39.517036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11d7ea-ce92-457a-bd97-6ecf3b57eb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:39.520350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11d7ea-ce92-457a-bd97-6ecf3b57eb69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:39.520876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11d7ea-ce92-457a-bd97-6ecf3b57eb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:39.521268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11d7ea-ce92-457a-bd97-6ecf3b57eb69 admin admin] PATH_INFO: `/v3/projects/ed845350e26245d198f99d889e094fa1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:39.534134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11d7ea-ce92-457a-bd97-6ecf3b57eb69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed845350e26245d198f99d889e094fa1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:39.537237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11d7ea-ce92-457a-bd97-6ecf3b57eb69 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:39.615463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5f11d7ea-ce92-457a-bd97-6ecf3b57eb69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed845350e26245d198f99d889e094fa1', 'request_id': 'req-5f11d7ea-ce92-457a-bd97-6ecf3b57eb69'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:39.624324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5f11d7ea-ce92-457a-bd97-6ecf3b57eb69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed845350e26245d198f99d889e094fa1', 'request_id': 'req-5f11d7ea-ce92-457a-bd97-6ecf3b57eb69'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:39.638899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5f11d7ea-ce92-457a-bd97-6ecf3b57eb69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed845350e26245d198f99d889e094fa1', 'request_id': 'req-5f11d7ea-ce92-457a-bd97-6ecf3b57eb69'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:39.669737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5f11d7ea-ce92-457a-bd97-6ecf3b57eb69 admin admin] The token cache is being invalidate because project ed845350e26245d198f99d889e094fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:06:39.670424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5f11d7ea-ce92-457a-bd97-6ecf3b57eb69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:39.672326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5f11d7ea-ce92-457a-bd97-6ecf3b57eb69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:39.676135 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3182/6293] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:06:39 2021] DELETE /identity/v3/projects/ed845350e26245d198f99d889e094fa1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:39.681930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aab6fc-7b8a-4ca9-80eb-73afa84f0982 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:39.682494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aab6fc-7b8a-4ca9-80eb-73afa84f0982 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:39.682494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aab6fc-7b8a-4ca9-80eb-73afa84f0982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:39.712046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-04aab6fc-7b8a-4ca9-80eb-73afa84f0982 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:39.713842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-04aab6fc-7b8a-4ca9-80eb-73afa84f0982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:39.832465 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3112/6294] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:39.833373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c8be2-9656-491a-92c1-fc520b3dada3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:39.833736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c8be2-9656-491a-92c1-fc520b3dada3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:39.834096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c8be2-9656-491a-92c1-fc520b3dada3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:39.856862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-375c8be2-9656-491a-92c1-fc520b3dada3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:39.858355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-375c8be2-9656-491a-92c1-fc520b3dada3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:39.879367 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3183/6295] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:06:39.881366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aab6fc-7b8a-4ca9-80eb-73afa84f0982 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:39.894908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aab6fc-7b8a-4ca9-80eb-73afa84f0982 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:39.901441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4590b9-8900-40f8-9368-02bf2023dc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:39.902711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4590b9-8900-40f8-9368-02bf2023dc74 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:39.903160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4590b9-8900-40f8-9368-02bf2023dc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:39.903580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4590b9-8900-40f8-9368-02bf2023dc74 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:39.905329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4590b9-8900-40f8-9368-02bf2023dc74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:06:39.906126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4590b9-8900-40f8-9368-02bf2023dc74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:39.908008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4590b9-8900-40f8-9368-02bf2023dc74 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:39.941010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c8be2-9656-491a-92c1-fc520b3dada3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:39.942964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-375c8be2-9656-491a-92c1-fc520b3dada3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:39.958503 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3113/6296] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:06:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:06:39.967481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4590b9-8900-40f8-9368-02bf2023dc74 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:39.997512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4590b9-8900-40f8-9368-02bf2023dc74 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:40.014213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bac4e-87a1-4ecd-97a3-5f25fdee84f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:40.014942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bac4e-87a1-4ecd-97a3-5f25fdee84f0 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:40.015997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bac4e-87a1-4ecd-97a3-5f25fdee84f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:40.019105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bac4e-87a1-4ecd-97a3-5f25fdee84f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:40.022636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bac4e-87a1-4ecd-97a3-5f25fdee84f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:40.024590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bac4e-87a1-4ecd-97a3-5f25fdee84f0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:40.044382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c8be2-9656-491a-92c1-fc520b3dada3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:40.056926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8649c-4ee9-49ec-8116-9206f5890f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:40.057887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8649c-4ee9-49ec-8116-9206f5890f7d service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:40.062080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8649c-4ee9-49ec-8116-9206f5890f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:40.062608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8649c-4ee9-49ec-8116-9206f5890f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:40.069856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-24c8649c-4ee9-49ec-8116-9206f5890f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:40.096275 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3114/6297] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:06:39 2021] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:06:40.101044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bac4e-87a1-4ecd-97a3-5f25fdee84f0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:40.249836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8649c-4ee9-49ec-8116-9206f5890f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:40.252135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8649c-4ee9-49ec-8116-9206f5890f7d service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:40.269975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bac4e-87a1-4ecd-97a3-5f25fdee84f0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:40.289326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2a775-6960-4121-b86a-66e958b82c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:40.290167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2a775-6960-4121-b86a-66e958b82c61 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:40.291324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2a775-6960-4121-b86a-66e958b82c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:40.291614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2a775-6960-4121-b86a-66e958b82c61 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:40.292358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2a775-6960-4121-b86a-66e958b82c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:40.294343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2a775-6960-4121-b86a-66e958b82c61 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:40.298071 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3184/6298] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:06:39 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:06:40.324983 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3115/6299] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:06:40 2021] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:06:40.329455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8649c-4ee9-49ec-8116-9206f5890f7d service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:40.347024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8649c-4ee9-49ec-8116-9206f5890f7d service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:40.352087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e6e83-00c8-427f-aff3-0e4c6fd76e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:40.353426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e6e83-00c8-427f-aff3-0e4c6fd76e57 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:40.353795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e6e83-00c8-427f-aff3-0e4c6fd76e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:40.354198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e6e83-00c8-427f-aff3-0e4c6fd76e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:40.355177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e6e83-00c8-427f-aff3-0e4c6fd76e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:40.356983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e6e83-00c8-427f-aff3-0e4c6fd76e57 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:40.368276 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3185/6300] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:40 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:40.372165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2a775-6960-4121-b86a-66e958b82c61 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:40.385642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2a775-6960-4121-b86a-66e958b82c61 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:40.391125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe06e0-b975-4f2e-a45b-6be15ebc472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:40.392561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe06e0-b975-4f2e-a45b-6be15ebc472c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:40.393168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe06e0-b975-4f2e-a45b-6be15ebc472c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:40.393168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe06e0-b975-4f2e-a45b-6be15ebc472c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:40.393925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe06e0-b975-4f2e-a45b-6be15ebc472c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:40.396350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe06e0-b975-4f2e-a45b-6be15ebc472c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:40.412837 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3116/6301] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:40 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:40.416488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e6e83-00c8-427f-aff3-0e4c6fd76e57 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:40.428758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e6e83-00c8-427f-aff3-0e4c6fd76e57 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:40.433394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86888b3-c9d6-48b3-8278-6735634b580c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:40.434310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86888b3-c9d6-48b3-8278-6735634b580c admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:40.434602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86888b3-c9d6-48b3-8278-6735634b580c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:40.434879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86888b3-c9d6-48b3-8278-6735634b580c admin admin] PATH_INFO: `/v3/projects/c532cc90b02c49449cb03e27e1614862/users/f027b547c51549b3809b6dcd53913294/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:40.454941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86888b3-c9d6-48b3-8278-6735634b580c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c532cc90b02c49449cb03e27e1614862, user_id=f027b547c51549b3809b6dcd53913294, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:40.457586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86888b3-c9d6-48b3-8278-6735634b580c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:40.474098 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3186/6302] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:06:40 2021] PUT /identity/v3/projects/c532cc90b02c49449cb03e27e1614862/users/f027b547c51549b3809b6dcd53913294/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:40.485838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f130af8-0c25-47b6-b239-a6a6de81c89e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:40.486451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f130af8-0c25-47b6-b239-a6a6de81c89e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:40.487325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f130af8-0c25-47b6-b239-a6a6de81c89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:40.529045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9f130af8-0c25-47b6-b239-a6a6de81c89e None None] MFA Rules not processed for user `f027b547c51549b3809b6dcd53913294`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:40.531706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9f130af8-0c25-47b6-b239-a6a6de81c89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:40.671720 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3117/6303] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:40 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:40.676385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86888b3-c9d6-48b3-8278-6735634b580c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:40.841473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86888b3-c9d6-48b3-8278-6735634b580c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:40.858015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e600748-fde9-4b5a-b705-2ab009b0aee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:40.858749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e600748-fde9-4b5a-b705-2ab009b0aee7 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:40.859041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e600748-fde9-4b5a-b705-2ab009b0aee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:40.859324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e600748-fde9-4b5a-b705-2ab009b0aee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:40.860760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e600748-fde9-4b5a-b705-2ab009b0aee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:40.862983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e600748-fde9-4b5a-b705-2ab009b0aee7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:40.939233 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3187/6304] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:06:40 2021] POST /identity/v3/projects => generated 373 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:06:40.943588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f130af8-0c25-47b6-b239-a6a6de81c89e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:40.963533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f130af8-0c25-47b6-b239-a6a6de81c89e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:41.076481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598aaf36-d7d3-4e8e-93a6-0d71361d3aec None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:41.076748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598aaf36-d7d3-4e8e-93a6-0d71361d3aec None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:41.077002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598aaf36-d7d3-4e8e-93a6-0d71361d3aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:41.089072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8727f0-187f-41e3-ad07-5470ee862b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:41.090156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8727f0-187f-41e3-ad07-5470ee862b60 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:41.091036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8727f0-187f-41e3-ad07-5470ee862b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:41.091563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8727f0-187f-41e3-ad07-5470ee862b60 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:41.092556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8727f0-187f-41e3-ad07-5470ee862b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:41.096033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8727f0-187f-41e3-ad07-5470ee862b60 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:41.115711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-598aaf36-d7d3-4e8e-93a6-0d71361d3aec None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:41.116845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-598aaf36-d7d3-4e8e-93a6-0d71361d3aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:41.140142 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3118/6305] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:06:40 2021] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:06:41.142018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8727f0-187f-41e3-ad07-5470ee862b60 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:41.178867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8727f0-187f-41e3-ad07-5470ee862b60 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:41.197572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4dba5-3670-491d-9916-474d7361d726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:41.198261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4dba5-3670-491d-9916-474d7361d726 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:41.198547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4dba5-3670-491d-9916-474d7361d726 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:41.198845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4dba5-3670-491d-9916-474d7361d726 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:41.199586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4dba5-3670-491d-9916-474d7361d726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:41.220985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4dba5-3670-491d-9916-474d7361d726 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:41.268665 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3119/6306] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:41 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:06:41.269933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4dba5-3670-491d-9916-474d7361d726 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:41.295369 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3188/6307] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 21:06:41 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:06:41.304177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598aaf36-d7d3-4e8e-93a6-0d71361d3aec None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:41.305209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-598aaf36-d7d3-4e8e-93a6-0d71361d3aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:41.315070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4dba5-3670-491d-9916-474d7361d726 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:41.331600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3788612-b9c6-4e30-afa1-fcf0debb3946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:41.333621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3788612-b9c6-4e30-afa1-fcf0debb3946 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:41.334286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3788612-b9c6-4e30-afa1-fcf0debb3946 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:41.336636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3788612-b9c6-4e30-afa1-fcf0debb3946 admin admin] PATH_INFO: `/v3/projects/569b15186e144022a318ddf803fb25d7/users/53f636001fe94de0af92612fe766a77d/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:41.389455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3788612-b9c6-4e30-afa1-fcf0debb3946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=569b15186e144022a318ddf803fb25d7, user_id=53f636001fe94de0af92612fe766a77d, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:41.394603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3788612-b9c6-4e30-afa1-fcf0debb3946 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:41.428212 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3120/6308] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:06:41 2021] PUT /identity/v3/projects/569b15186e144022a318ddf803fb25d7/users/53f636001fe94de0af92612fe766a77d/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:41.431558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3788612-b9c6-4e30-afa1-fcf0debb3946 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:41.485977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598aaf36-d7d3-4e8e-93a6-0d71361d3aec None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:41.572941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3788612-b9c6-4e30-afa1-fcf0debb3946 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:41.587036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2705e-6be2-4d08-a316-3547b8282f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:41.587697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2705e-6be2-4d08-a316-3547b8282f41 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:41.587989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2705e-6be2-4d08-a316-3547b8282f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:41.588274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2705e-6be2-4d08-a316-3547b8282f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:41.589299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2705e-6be2-4d08-a316-3547b8282f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:41.592485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2705e-6be2-4d08-a316-3547b8282f41 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:41.616907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0ca4b-5484-4e1a-be0c-e543208f68c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:41.617625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ca4b-5484-4e1a-be0c-e543208f68c7 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:41.617833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ca4b-5484-4e1a-be0c-e543208f68c7 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:41.618118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ca4b-5484-4e1a-be0c-e543208f68c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:41.628770 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3121/6309] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:41 2021] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:41.630986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2705e-6be2-4d08-a316-3547b8282f41 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:41.653324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2705e-6be2-4d08-a316-3547b8282f41 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:41.683597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aba5fc-3d3f-46ab-9bd0-7a843f21b6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:41.684213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aba5fc-3d3f-46ab-9bd0-7a843f21b6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:41.684504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aba5fc-3d3f-46ab-9bd0-7a843f21b6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:41.684795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aba5fc-3d3f-46ab-9bd0-7a843f21b6ea admin admin] PATH_INFO: `/v3/projects/569b15186e144022a318ddf803fb25d7/users/53f636001fe94de0af92612fe766a77d/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:41.688054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aba5fc-3d3f-46ab-9bd0-7a843f21b6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=569b15186e144022a318ddf803fb25d7, user_id=53f636001fe94de0af92612fe766a77d, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:41.699625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aba5fc-3d3f-46ab-9bd0-7a843f21b6ea admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:41.731987 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3122/6310] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:06:41 2021] PUT /identity/v3/projects/569b15186e144022a318ddf803fb25d7/users/53f636001fe94de0af92612fe766a77d/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:41.744810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f120fda-8727-4071-97ba-1014db7842c2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:41.745109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f120fda-8727-4071-97ba-1014db7842c2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:41.746149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f120fda-8727-4071-97ba-1014db7842c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:41.752364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0ca4b-5484-4e1a-be0c-e543208f68c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:41.754271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0ca4b-5484-4e1a-be0c-e543208f68c7 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:41.769726 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3189/6311] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:06:41 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 21:06:41.841918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8f120fda-8727-4071-97ba-1014db7842c2 None None] MFA Rules not processed for user `53f636001fe94de0af92612fe766a77d`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:41.843420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8f120fda-8727-4071-97ba-1014db7842c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:42.138938 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3123/6312] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:41 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:06:42.149427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0ca4b-5484-4e1a-be0c-e543208f68c7 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:42.151079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d1f0ca4b-5484-4e1a-be0c-e543208f68c7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:42.374406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0ca4b-5484-4e1a-be0c-e543208f68c7 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:42.485898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c0965-644e-4756-8a79-5e5989a27459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:42.487837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c0965-644e-4756-8a79-5e5989a27459 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:42.488765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c0965-644e-4756-8a79-5e5989a27459 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:42.490002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c0965-644e-4756-8a79-5e5989a27459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:42.603699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c0965-644e-4756-8a79-5e5989a27459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:42.607197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c0965-644e-4756-8a79-5e5989a27459 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:42.621971 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3190/6313] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:06:42 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:06:42.727546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f120fda-8727-4071-97ba-1014db7842c2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:42.832246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f120fda-8727-4071-97ba-1014db7842c2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:42.835987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cac88a-1643-4546-9092-385797d3d7ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:42.840925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cac88a-1643-4546-9092-385797d3d7ff service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:42.841122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cac88a-1643-4546-9092-385797d3d7ff service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:42.841440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cac88a-1643-4546-9092-385797d3d7ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:42.843655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c3cac88a-1643-4546-9092-385797d3d7ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:42.908812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c0965-644e-4756-8a79-5e5989a27459 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:42.910507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ec1c0965-644e-4756-8a79-5e5989a27459 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:42.973807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cac88a-1643-4546-9092-385797d3d7ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:42.976309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cac88a-1643-4546-9092-385797d3d7ff service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:42.993313 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3124/6314] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:06:42 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:06:43.094283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c0965-644e-4756-8a79-5e5989a27459 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:43.103206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e38c0-6290-4bb0-a99e-4f40c2e8d873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:43.103956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e38c0-6290-4bb0-a99e-4f40c2e8d873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:43.104145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e38c0-6290-4bb0-a99e-4f40c2e8d873 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:43.104410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e38c0-6290-4bb0-a99e-4f40c2e8d873 admin admin] PATH_INFO: `/v3/users/716e310ad9334ee2b6dcbc95b30275b4` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:43.107317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e38c0-6290-4bb0-a99e-4f40c2e8d873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=716e310ad9334ee2b6dcbc95b30275b4)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:43.109266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e38c0-6290-4bb0-a99e-4f40c2e8d873 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:43.235162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-167e38c0-6290-4bb0-a99e-4f40c2e8d873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716e310ad9334ee2b6dcbc95b30275b4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:43.249596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-167e38c0-6290-4bb0-a99e-4f40c2e8d873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716e310ad9334ee2b6dcbc95b30275b4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:43.250290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-167e38c0-6290-4bb0-a99e-4f40c2e8d873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716e310ad9334ee2b6dcbc95b30275b4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:43.270026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-167e38c0-6290-4bb0-a99e-4f40c2e8d873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716e310ad9334ee2b6dcbc95b30275b4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:43.280911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-167e38c0-6290-4bb0-a99e-4f40c2e8d873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716e310ad9334ee2b6dcbc95b30275b4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:43.291898 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3191/6315] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:06:42 2021] DELETE /identity/v3/users/716e310ad9334ee2b6dcbc95b30275b4 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:43.296995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4445e-caa4-4e00-b8b8-e031f783a4a5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:43.297519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4445e-caa4-4e00-b8b8-e031f783a4a5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:43.298054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4445e-caa4-4e00-b8b8-e031f783a4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:43.322213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-55c4445e-caa4-4e00-b8b8-e031f783a4a5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:43.324218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-55c4445e-caa4-4e00-b8b8-e031f783a4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:43.464518 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3125/6316] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:43.472412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e38c0-6290-4bb0-a99e-4f40c2e8d873 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:43.473825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-167e38c0-6290-4bb0-a99e-4f40c2e8d873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:43.568060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e38c0-6290-4bb0-a99e-4f40c2e8d873 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:43.571778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8af85c-9020-4cb1-848c-07a11baa3d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:43.572440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8af85c-9020-4cb1-848c-07a11baa3d3f service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:43.572729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8af85c-9020-4cb1-848c-07a11baa3d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:43.573009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8af85c-9020-4cb1-848c-07a11baa3d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:43.584294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8af85c-9020-4cb1-848c-07a11baa3d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:43.585957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8af85c-9020-4cb1-848c-07a11baa3d3f service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:43.603461 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3192/6317] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:06:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:06:43.834469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0aaec-131b-452c-8c6c-17715505fa48 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:43.834771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0aaec-131b-452c-8c6c-17715505fa48 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:43.835066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0aaec-131b-452c-8c6c-17715505fa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:43.857767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a1e0aaec-131b-452c-8c6c-17715505fa48 None None] MFA Rules not processed for user `d6278aefb6d5497aad3d74b47b2e95d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:43.859024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a1e0aaec-131b-452c-8c6c-17715505fa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:43.973745 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3126/6318] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:43 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:44.231684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8af85c-9020-4cb1-848c-07a11baa3d3f service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:44.235226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ea8af85c-9020-4cb1-848c-07a11baa3d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:44.259121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8af85c-9020-4cb1-848c-07a11baa3d3f service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:44.273227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0653e1-9535-4748-9634-db5aaa442a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:44.274451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0653e1-9535-4748-9634-db5aaa442a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:44.274744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0653e1-9535-4748-9634-db5aaa442a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:44.275027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0653e1-9535-4748-9634-db5aaa442a69 admin admin] PATH_INFO: `/v3/projects/50ba8bfbb7404ca3af1621fb54b33317` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:44.277331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0653e1-9535-4748-9634-db5aaa442a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50ba8bfbb7404ca3af1621fb54b33317)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:44.282931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0653e1-9535-4748-9634-db5aaa442a69 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:44.397275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5f0653e1-9535-4748-9634-db5aaa442a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50ba8bfbb7404ca3af1621fb54b33317', 'request_id': 'req-5f0653e1-9535-4748-9634-db5aaa442a69'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:44.411634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5f0653e1-9535-4748-9634-db5aaa442a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50ba8bfbb7404ca3af1621fb54b33317', 'request_id': 'req-5f0653e1-9535-4748-9634-db5aaa442a69'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:44.425058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5f0653e1-9535-4748-9634-db5aaa442a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50ba8bfbb7404ca3af1621fb54b33317', 'request_id': 'req-5f0653e1-9535-4748-9634-db5aaa442a69'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:44.445809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5f0653e1-9535-4748-9634-db5aaa442a69 admin admin] The token cache is being invalidate because project 50ba8bfbb7404ca3af1621fb54b33317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:06:44.446535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5f0653e1-9535-4748-9634-db5aaa442a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:44.447535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5f0653e1-9535-4748-9634-db5aaa442a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:06:44.453118 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3193/6319] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:06:44 2021] DELETE /identity/v3/projects/50ba8bfbb7404ca3af1621fb54b33317 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:44.459286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db02f-921e-4551-be96-0637e1a9aabd None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:44.460199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db02f-921e-4551-be96-0637e1a9aabd None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:44.460694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db02f-921e-4551-be96-0637e1a9aabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:44.503364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b96db02f-921e-4551-be96-0637e1a9aabd None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:44.507060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b96db02f-921e-4551-be96-0637e1a9aabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:44.665996 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3127/6320] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:44.675007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1379d-6c2f-4724-8599-d00a5f55543a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:44.675477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1379d-6c2f-4724-8599-d00a5f55543a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:44.675619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1379d-6c2f-4724-8599-d00a5f55543a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:44.726059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e3f1379d-6c2f-4724-8599-d00a5f55543a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:44.731444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e3f1379d-6c2f-4724-8599-d00a5f55543a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:44.757304 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3194/6321] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:44.761458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96db02f-921e-4551-be96-0637e1a9aabd None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:44.774062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96db02f-921e-4551-be96-0637e1a9aabd None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:44.782541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68edea-8eef-46cc-b626-75f2e155a35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:44.783642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68edea-8eef-46cc-b626-75f2e155a35c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:44.783980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68edea-8eef-46cc-b626-75f2e155a35c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:44.784429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68edea-8eef-46cc-b626-75f2e155a35c admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:44.785187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68edea-8eef-46cc-b626-75f2e155a35c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:06:44.785495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68edea-8eef-46cc-b626-75f2e155a35c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:44.791183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68edea-8eef-46cc-b626-75f2e155a35c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:44.828118 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3128/6322] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:06:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:06:44.832789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1379d-6c2f-4724-8599-d00a5f55543a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:44.850799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1379d-6c2f-4724-8599-d00a5f55543a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:44.861494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d3ce7-a435-444a-854b-96732c18f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:44.862640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d3ce7-a435-444a-854b-96732c18f442 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:44.863115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d3ce7-a435-444a-854b-96732c18f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:44.863755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d3ce7-a435-444a-854b-96732c18f442 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:44.865705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d3ce7-a435-444a-854b-96732c18f442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:44.871237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d3ce7-a435-444a-854b-96732c18f442 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:44.916637 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3195/6323] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:06:44 2021] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:06:44.920645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68edea-8eef-46cc-b626-75f2e155a35c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:44.935153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68edea-8eef-46cc-b626-75f2e155a35c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:45.050917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ce036-2e41-4286-b7b0-c38765659e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:45.051526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ce036-2e41-4286-b7b0-c38765659e46 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:45.051865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ce036-2e41-4286-b7b0-c38765659e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:45.052615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ce036-2e41-4286-b7b0-c38765659e46 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:45.054078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ce036-2e41-4286-b7b0-c38765659e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:45.056453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ce036-2e41-4286-b7b0-c38765659e46 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:45.090388 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3129/6324] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:06:44 2021] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:06:45.098417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d3ce7-a435-444a-854b-96732c18f442 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:45.121025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d3ce7-a435-444a-854b-96732c18f442 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:45.128705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fa432-2827-41a6-9714-4a1ea1d36d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:45.129852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fa432-2827-41a6-9714-4a1ea1d36d28 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:45.130141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fa432-2827-41a6-9714-4a1ea1d36d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:45.130475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fa432-2827-41a6-9714-4a1ea1d36d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:45.131420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fa432-2827-41a6-9714-4a1ea1d36d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:45.133073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fa432-2827-41a6-9714-4a1ea1d36d28 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:45.150676 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3196/6325] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:45 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:45.155313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ce036-2e41-4286-b7b0-c38765659e46 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:45.192275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ce036-2e41-4286-b7b0-c38765659e46 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:45.212836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fa385-2fde-4434-936a-fc1c77849d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:45.214425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fa385-2fde-4434-936a-fc1c77849d13 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:45.215191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fa385-2fde-4434-936a-fc1c77849d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:45.215477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fa385-2fde-4434-936a-fc1c77849d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:45.221720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fa385-2fde-4434-936a-fc1c77849d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:45.225938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fa385-2fde-4434-936a-fc1c77849d13 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:45.255191 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3130/6326] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:06:45 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:06:45.259154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fa432-2827-41a6-9714-4a1ea1d36d28 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:45.274379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fa432-2827-41a6-9714-4a1ea1d36d28 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:45.308882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82da0dc-3bab-4ec3-b8fd-fdd6acb923f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:45.315576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82da0dc-3bab-4ec3-b8fd-fdd6acb923f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:45.316770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82da0dc-3bab-4ec3-b8fd-fdd6acb923f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:45.318138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82da0dc-3bab-4ec3-b8fd-fdd6acb923f3 admin admin] PATH_INFO: `/v3/projects/be6e867991a3454cb4a23e489f0b6f12/users/004fe35715cd4dd593ea1f310173de82/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:45.361076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82da0dc-3bab-4ec3-b8fd-fdd6acb923f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6e867991a3454cb4a23e489f0b6f12, user_id=004fe35715cd4dd593ea1f310173de82, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:45.372755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82da0dc-3bab-4ec3-b8fd-fdd6acb923f3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:45.422188 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3197/6327] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:06:45 2021] PUT /identity/v3/projects/be6e867991a3454cb4a23e489f0b6f12/users/004fe35715cd4dd593ea1f310173de82/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:06:45.435286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec4f3a-22ef-4c57-8d70-60fbfd479e5a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:45.435890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec4f3a-22ef-4c57-8d70-60fbfd479e5a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:45.437403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec4f3a-22ef-4c57-8d70-60fbfd479e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:45.511857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d53f5-2327-4ff3-a29d-87e9a2bd5369 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:45.512152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d53f5-2327-4ff3-a29d-87e9a2bd5369 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:45.512885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d53f5-2327-4ff3-a29d-87e9a2bd5369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:45.521619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-65ec4f3a-22ef-4c57-8d70-60fbfd479e5a None None] MFA Rules not processed for user `004fe35715cd4dd593ea1f310173de82`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:45.523895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-65ec4f3a-22ef-4c57-8d70-60fbfd479e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:45.582368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-555d53f5-2327-4ff3-a29d-87e9a2bd5369 None None] MFA Rules not processed for user `0a98795bdb7447c5b2a4930173b3c56d`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:45.584278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-555d53f5-2327-4ff3-a29d-87e9a2bd5369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:45.729568 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3131/6328] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:45 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:45.746761 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3198/6329] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:45 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:45.773217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec4f3a-22ef-4c57-8d70-60fbfd479e5a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:45.787136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-65ec4f3a-22ef-4c57-8d70-60fbfd479e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:45.911644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec4f3a-22ef-4c57-8d70-60fbfd479e5a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:45.916430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091479c-9538-4cc1-b04b-eabcc1089705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:45.917415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091479c-9538-4cc1-b04b-eabcc1089705 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:45.917415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091479c-9538-4cc1-b04b-eabcc1089705 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:45.918631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091479c-9538-4cc1-b04b-eabcc1089705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:45.947728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091479c-9538-4cc1-b04b-eabcc1089705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:45.950119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091479c-9538-4cc1-b04b-eabcc1089705 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:45.989385 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3132/6330] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:06:45 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:06:46.799260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d53f5-2327-4ff3-a29d-87e9a2bd5369 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:46.802292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-555d53f5-2327-4ff3-a29d-87e9a2bd5369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:46.873443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d53f5-2327-4ff3-a29d-87e9a2bd5369 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:46.880942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae75fd-f0c3-4898-ac77-92eab0e9be5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:46.881899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae75fd-f0c3-4898-ac77-92eab0e9be5d service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:46.882366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae75fd-f0c3-4898-ac77-92eab0e9be5d service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:46.883080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae75fd-f0c3-4898-ac77-92eab0e9be5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:46.885468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-36ae75fd-f0c3-4898-ac77-92eab0e9be5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:47.015085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae75fd-f0c3-4898-ac77-92eab0e9be5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:47.017003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae75fd-f0c3-4898-ac77-92eab0e9be5d service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:47.051277 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3199/6331] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:06:46 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:06:47.175611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3cc5b-0aac-40b0-b07f-033e96e16bea None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:47.176057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3cc5b-0aac-40b0-b07f-033e96e16bea None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:47.176182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3cc5b-0aac-40b0-b07f-033e96e16bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:47.213285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-17d3cc5b-0aac-40b0-b07f-033e96e16bea None None] MFA Rules not processed for user `d6278aefb6d5497aad3d74b47b2e95d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:47.214590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-17d3cc5b-0aac-40b0-b07f-033e96e16bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:47.338993 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3133/6332] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:47 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:50.538071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381621e-24fd-4e8c-8aa5-3216f7219016 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:50.538746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381621e-24fd-4e8c-8aa5-3216f7219016 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:50.539081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381621e-24fd-4e8c-8aa5-3216f7219016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:50.580911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f381621e-24fd-4e8c-8aa5-3216f7219016 None None] MFA Rules not processed for user `d6278aefb6d5497aad3d74b47b2e95d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:50.582142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f381621e-24fd-4e8c-8aa5-3216f7219016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:50.603677 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3200/6333] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:50 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:52.008432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83f845-882d-461f-8533-5e5eaf137955 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:52.008973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83f845-882d-461f-8533-5e5eaf137955 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:52.008973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83f845-882d-461f-8533-5e5eaf137955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:52.029445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2d83f845-882d-461f-8533-5e5eaf137955 None None] MFA Rules not processed for user `d6278aefb6d5497aad3d74b47b2e95d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:52.030815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2d83f845-882d-461f-8533-5e5eaf137955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:52.052425 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3134/6334] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:52 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:53.947066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e408481-526e-4355-b6cb-def25c791e12 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:53.947790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e408481-526e-4355-b6cb-def25c791e12 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:53.948310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e408481-526e-4355-b6cb-def25c791e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:53.987999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9e408481-526e-4355-b6cb-def25c791e12 None None] MFA Rules not processed for user `d6278aefb6d5497aad3d74b47b2e95d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:53.995751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9e408481-526e-4355-b6cb-def25c791e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:54.032077 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3201/6335] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:53 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:55.134334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141a7eb-19be-4bf6-87eb-837e2d0202e3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:55.135174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141a7eb-19be-4bf6-87eb-837e2d0202e3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:55.135690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141a7eb-19be-4bf6-87eb-837e2d0202e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:55.169205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f141a7eb-19be-4bf6-87eb-837e2d0202e3 None None] MFA Rules not processed for user `d6278aefb6d5497aad3d74b47b2e95d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:55.173267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f141a7eb-19be-4bf6-87eb-837e2d0202e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:55.193701 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3135/6336] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:55 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:06:55.546039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e408481-526e-4355-b6cb-def25c791e12 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:06:55.549278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9e408481-526e-4355-b6cb-def25c791e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:55.861106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e408481-526e-4355-b6cb-def25c791e12 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:06:55.887940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e2505-9432-4327-be57-8698f4aa0bc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:06:55.890615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e2505-9432-4327-be57-8698f4aa0bc2 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:55.894118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e2505-9432-4327-be57-8698f4aa0bc2 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:55.895414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e2505-9432-4327-be57-8698f4aa0bc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:55.899588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ce1e2505-9432-4327-be57-8698f4aa0bc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:55.936984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e2505-9432-4327-be57-8698f4aa0bc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:06:55.940345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e2505-9432-4327-be57-8698f4aa0bc2 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:06:55.973020 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3202/6337] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:06:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:06:57.351091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf19739-c567-4651-8d09-eec04fb538f5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:57.353491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf19739-c567-4651-8d09-eec04fb538f5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:57.353952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf19739-c567-4651-8d09-eec04fb538f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:57.399520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9cf19739-c567-4651-8d09-eec04fb538f5 None None] MFA Rules not processed for user `d6278aefb6d5497aad3d74b47b2e95d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:57.401325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9cf19739-c567-4651-8d09-eec04fb538f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:57.428405 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3136/6338] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:57 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:06:58.808216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722dbf5-f71c-439f-9849-86283568becf None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:06:58.808765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722dbf5-f71c-439f-9849-86283568becf None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:06:58.808765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722dbf5-f71c-439f-9849-86283568becf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:06:58.865444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8722dbf5-f71c-439f-9849-86283568becf None None] MFA Rules not processed for user `d6278aefb6d5497aad3d74b47b2e95d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:06:58.877014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8722dbf5-f71c-439f-9849-86283568becf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:06:58.909915 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3203/6339] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:06:58 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:00.120589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf19739-c567-4651-8d09-eec04fb538f5 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:00.122995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9cf19739-c567-4651-8d09-eec04fb538f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:00.324760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427abbb9-0810-4618-bc46-1670bfc0a179 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:00.325305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427abbb9-0810-4618-bc46-1670bfc0a179 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:00.325305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427abbb9-0810-4618-bc46-1670bfc0a179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:00.350792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf19739-c567-4651-8d09-eec04fb538f5 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:00.356414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afd9ac-194e-44f8-9f7f-156ec8643eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:00.356758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-427abbb9-0810-4618-bc46-1670bfc0a179 None None] MFA Rules not processed for user `d6278aefb6d5497aad3d74b47b2e95d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:00.357444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afd9ac-194e-44f8-9f7f-156ec8643eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:00.357736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afd9ac-194e-44f8-9f7f-156ec8643eda admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:00.358139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-427abbb9-0810-4618-bc46-1670bfc0a179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:00.359179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afd9ac-194e-44f8-9f7f-156ec8643eda admin admin] PATH_INFO: `/v3/users/5b0a5c690279418faa8fb5506ca47389` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:00.361173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afd9ac-194e-44f8-9f7f-156ec8643eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0a5c690279418faa8fb5506ca47389)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:00.363790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afd9ac-194e-44f8-9f7f-156ec8643eda admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:00.375894 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3204/6340] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:00 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:00.482797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e4afd9ac-194e-44f8-9f7f-156ec8643eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0a5c690279418faa8fb5506ca47389'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:00.497572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e4afd9ac-194e-44f8-9f7f-156ec8643eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0a5c690279418faa8fb5506ca47389'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:00.512774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e4afd9ac-194e-44f8-9f7f-156ec8643eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0a5c690279418faa8fb5506ca47389'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:00.514006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e4afd9ac-194e-44f8-9f7f-156ec8643eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0a5c690279418faa8fb5506ca47389'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:00.524536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e4afd9ac-194e-44f8-9f7f-156ec8643eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0a5c690279418faa8fb5506ca47389'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:00.538460 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3137/6341] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:00 2021] DELETE /identity/v3/users/5b0a5c690279418faa8fb5506ca47389 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:00.540269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75976a12-c791-4ed6-8544-85b42c478de5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:00.540904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75976a12-c791-4ed6-8544-85b42c478de5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:00.541263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75976a12-c791-4ed6-8544-85b42c478de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:00.574528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-75976a12-c791-4ed6-8544-85b42c478de5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:00.576633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-75976a12-c791-4ed6-8544-85b42c478de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:00.694665 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3205/6342] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:07:00.714664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afd9ac-194e-44f8-9f7f-156ec8643eda admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:00.718197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e4afd9ac-194e-44f8-9f7f-156ec8643eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:00.881153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afd9ac-194e-44f8-9f7f-156ec8643eda admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:00.890115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9a6cf-9bf7-4a31-9c2a-11b8d8442b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:00.890969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9a6cf-9bf7-4a31-9c2a-11b8d8442b95 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:00.891286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9a6cf-9bf7-4a31-9c2a-11b8d8442b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:00.891577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9a6cf-9bf7-4a31-9c2a-11b8d8442b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:00.911847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9a6cf-9bf7-4a31-9c2a-11b8d8442b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:00.913367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9a6cf-9bf7-4a31-9c2a-11b8d8442b95 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:00.925997 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3138/6343] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:01.574690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75976a12-c791-4ed6-8544-85b42c478de5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:01.576843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-75976a12-c791-4ed6-8544-85b42c478de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:01.596600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75976a12-c791-4ed6-8544-85b42c478de5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:01.613987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100ddce-0b9f-45f5-9b57-d0fba0c94c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:01.615228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100ddce-0b9f-45f5-9b57-d0fba0c94c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:01.615818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100ddce-0b9f-45f5-9b57-d0fba0c94c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:01.616297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100ddce-0b9f-45f5-9b57-d0fba0c94c30 admin admin] PATH_INFO: `/v3/projects/3ada50ccbe004ac887658264d222db1f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:01.617815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100ddce-0b9f-45f5-9b57-d0fba0c94c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ada50ccbe004ac887658264d222db1f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:01.620460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100ddce-0b9f-45f5-9b57-d0fba0c94c30 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:01.684211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0100ddce-0b9f-45f5-9b57-d0fba0c94c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ada50ccbe004ac887658264d222db1f', 'request_id': 'req-0100ddce-0b9f-45f5-9b57-d0fba0c94c30'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:01.700211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0100ddce-0b9f-45f5-9b57-d0fba0c94c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ada50ccbe004ac887658264d222db1f', 'request_id': 'req-0100ddce-0b9f-45f5-9b57-d0fba0c94c30'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:01.719460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0100ddce-0b9f-45f5-9b57-d0fba0c94c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ada50ccbe004ac887658264d222db1f', 'request_id': 'req-0100ddce-0b9f-45f5-9b57-d0fba0c94c30'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:01.743059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0100ddce-0b9f-45f5-9b57-d0fba0c94c30 admin admin] The token cache is being invalidate because project 3ada50ccbe004ac887658264d222db1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:01.743727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0100ddce-0b9f-45f5-9b57-d0fba0c94c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:01.745314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0100ddce-0b9f-45f5-9b57-d0fba0c94c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:01.753730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d054ea-ae36-4f72-b72c-c4e81dfe0a06 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:01.754300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d054ea-ae36-4f72-b72c-c4e81dfe0a06 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:01.754746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d054ea-ae36-4f72-b72c-c4e81dfe0a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:01.756441 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3206/6344] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:01 2021] DELETE /identity/v3/projects/3ada50ccbe004ac887658264d222db1f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:01.777915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-72d054ea-ae36-4f72-b72c-c4e81dfe0a06 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:01.779348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-72d054ea-ae36-4f72-b72c-c4e81dfe0a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:01.862372 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3139/6345] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:01.872140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443baaa9-b817-4ab6-b4b9-7012861bfbe3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:01.872775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443baaa9-b817-4ab6-b4b9-7012861bfbe3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:01.873165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443baaa9-b817-4ab6-b4b9-7012861bfbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:01.897605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-443baaa9-b817-4ab6-b4b9-7012861bfbe3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:01.900074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-443baaa9-b817-4ab6-b4b9-7012861bfbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:01.926691 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3207/6346] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:01.931289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d054ea-ae36-4f72-b72c-c4e81dfe0a06 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:01.941794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d011aa-9879-48c0-98e5-1fcbee6a7af1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:01.946919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d011aa-9879-48c0-98e5-1fcbee6a7af1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:01.950009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d011aa-9879-48c0-98e5-1fcbee6a7af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:01.960895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d054ea-ae36-4f72-b72c-c4e81dfe0a06 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:01.973695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a295c27-cb0a-4c56-b06f-2dd8ea4d2228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:01.974483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a295c27-cb0a-4c56-b06f-2dd8ea4d2228 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:01.975228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a295c27-cb0a-4c56-b06f-2dd8ea4d2228 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:01.975694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a295c27-cb0a-4c56-b06f-2dd8ea4d2228 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:01.976641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a295c27-cb0a-4c56-b06f-2dd8ea4d2228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:07:01.977132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a295c27-cb0a-4c56-b06f-2dd8ea4d2228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:01.979148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a295c27-cb0a-4c56-b06f-2dd8ea4d2228 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:02.003199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b2d011aa-9879-48c0-98e5-1fcbee6a7af1 None None] MFA Rules not processed for user `d6278aefb6d5497aad3d74b47b2e95d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:02.004855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b2d011aa-9879-48c0-98e5-1fcbee6a7af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:02.005243 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3140/6347] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:07:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:07:02.009184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a295c27-cb0a-4c56-b06f-2dd8ea4d2228 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:02.025143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a295c27-cb0a-4c56-b06f-2dd8ea4d2228 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:02.033547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a19f0-a4c3-4a7f-abd3-761e49f61d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:02.035485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a19f0-a4c3-4a7f-abd3-761e49f61d08 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:02.035949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a19f0-a4c3-4a7f-abd3-761e49f61d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:02.036498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a19f0-a4c3-4a7f-abd3-761e49f61d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:02.037423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a19f0-a4c3-4a7f-abd3-761e49f61d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:02.040126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a19f0-a4c3-4a7f-abd3-761e49f61d08 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:02.110611 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3141/6348] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:02 2021] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:07:02.111832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a19f0-a4c3-4a7f-abd3-761e49f61d08 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:02.116940 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3208/6349] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:01 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:02.247246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a19f0-a4c3-4a7f-abd3-761e49f61d08 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:02.257253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711621e1-f35a-4b14-acd8-4ea3e751cc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:02.259672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711621e1-f35a-4b14-acd8-4ea3e751cc76 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:02.259903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711621e1-f35a-4b14-acd8-4ea3e751cc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:02.260191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711621e1-f35a-4b14-acd8-4ea3e751cc76 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:02.262612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711621e1-f35a-4b14-acd8-4ea3e751cc76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:02.264555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711621e1-f35a-4b14-acd8-4ea3e751cc76 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:02.308845 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3142/6350] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:02 2021] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:07:02.313711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d011aa-9879-48c0-98e5-1fcbee6a7af1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:02.334086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d011aa-9879-48c0-98e5-1fcbee6a7af1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:02.339722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12db89b-3f43-49a7-94e8-989485515cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:02.340486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12db89b-3f43-49a7-94e8-989485515cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:02.340832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12db89b-3f43-49a7-94e8-989485515cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:02.341100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12db89b-3f43-49a7-94e8-989485515cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:02.341937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12db89b-3f43-49a7-94e8-989485515cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:02.343985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12db89b-3f43-49a7-94e8-989485515cb9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:02.360104 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3209/6351] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:02 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:02.361152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711621e1-f35a-4b14-acd8-4ea3e751cc76 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:02.373925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711621e1-f35a-4b14-acd8-4ea3e751cc76 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:02.391448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be7860-cfec-4887-89d5-d859de3275ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:02.395142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be7860-cfec-4887-89d5-d859de3275ec admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:02.395142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be7860-cfec-4887-89d5-d859de3275ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:02.398368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be7860-cfec-4887-89d5-d859de3275ec admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:02.402417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be7860-cfec-4887-89d5-d859de3275ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:02.406033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be7860-cfec-4887-89d5-d859de3275ec admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:02.436379 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3143/6352] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:02 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:02.440983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12db89b-3f43-49a7-94e8-989485515cb9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:02.454194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12db89b-3f43-49a7-94e8-989485515cb9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:02.466606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73e191-e84e-4fc0-b88b-2b41532326b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:02.467780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73e191-e84e-4fc0-b88b-2b41532326b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:02.469858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73e191-e84e-4fc0-b88b-2b41532326b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:02.469858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73e191-e84e-4fc0-b88b-2b41532326b6 admin admin] PATH_INFO: `/v3/projects/f3476949244f4f9ebede2f76f2c96233/users/f6b37a795a7d4adbbd8fe4bc74c72961/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:02.531780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73e191-e84e-4fc0-b88b-2b41532326b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3476949244f4f9ebede2f76f2c96233, user_id=f6b37a795a7d4adbbd8fe4bc74c72961, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:02.536956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73e191-e84e-4fc0-b88b-2b41532326b6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:02.584146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56c2bc-6f47-4767-af7a-83bc16c77a32 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:02.584323 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3210/6353] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:02 2021] PUT /identity/v3/projects/f3476949244f4f9ebede2f76f2c96233/users/f6b37a795a7d4adbbd8fe4bc74c72961/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:02.584774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56c2bc-6f47-4767-af7a-83bc16c77a32 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:02.584774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56c2bc-6f47-4767-af7a-83bc16c77a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:02.670963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fc56c2bc-6f47-4767-af7a-83bc16c77a32 None None] MFA Rules not processed for user `f6b37a795a7d4adbbd8fe4bc74c72961`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:02.673150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fc56c2bc-6f47-4767-af7a-83bc16c77a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:02.845774 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3144/6354] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:02 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:07:02.859687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73e191-e84e-4fc0-b88b-2b41532326b6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:02.864950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-de73e191-e84e-4fc0-b88b-2b41532326b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:03.056772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73e191-e84e-4fc0-b88b-2b41532326b6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:03.061750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841bb64-979c-48dd-ad64-6e89f9ec3433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:03.063219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841bb64-979c-48dd-ad64-6e89f9ec3433 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:03.063700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841bb64-979c-48dd-ad64-6e89f9ec3433 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:03.064058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841bb64-979c-48dd-ad64-6e89f9ec3433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:03.094789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841bb64-979c-48dd-ad64-6e89f9ec3433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:03.099409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841bb64-979c-48dd-ad64-6e89f9ec3433 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:03.122573 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3211/6355] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:02 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:03.164230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56c2bc-6f47-4767-af7a-83bc16c77a32 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:03.277935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56c2bc-6f47-4767-af7a-83bc16c77a32 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:03.284038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185dbc0-75e1-42d0-b85a-802318a7bf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:03.284788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185dbc0-75e1-42d0-b85a-802318a7bf55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:03.285362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185dbc0-75e1-42d0-b85a-802318a7bf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:03.285362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185dbc0-75e1-42d0-b85a-802318a7bf55 admin admin] PATH_INFO: `/v3/users/f6b37a795a7d4adbbd8fe4bc74c72961` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:03.286586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185dbc0-75e1-42d0-b85a-802318a7bf55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b37a795a7d4adbbd8fe4bc74c72961)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:03.289337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185dbc0-75e1-42d0-b85a-802318a7bf55 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:03.374918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6185dbc0-75e1-42d0-b85a-802318a7bf55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b37a795a7d4adbbd8fe4bc74c72961'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:03.392087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6185dbc0-75e1-42d0-b85a-802318a7bf55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b37a795a7d4adbbd8fe4bc74c72961'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:03.421272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6185dbc0-75e1-42d0-b85a-802318a7bf55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b37a795a7d4adbbd8fe4bc74c72961'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:03.423349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6185dbc0-75e1-42d0-b85a-802318a7bf55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b37a795a7d4adbbd8fe4bc74c72961'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:03.448779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6185dbc0-75e1-42d0-b85a-802318a7bf55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b37a795a7d4adbbd8fe4bc74c72961'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:03.459941 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3145/6356] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:03 2021] DELETE /identity/v3/users/f6b37a795a7d4adbbd8fe4bc74c72961 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:03.461636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cc217-b214-4267-9d53-e576a3941f14 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:03.461965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cc217-b214-4267-9d53-e576a3941f14 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:03.462234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cc217-b214-4267-9d53-e576a3941f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:03.502528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-cc0cc217-b214-4267-9d53-e576a3941f14 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:03.507071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cc0cc217-b214-4267-9d53-e576a3941f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:03.715387 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3212/6357] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:03.773325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185dbc0-75e1-42d0-b85a-802318a7bf55 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:03.775044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6185dbc0-75e1-42d0-b85a-802318a7bf55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:03.892336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185dbc0-75e1-42d0-b85a-802318a7bf55 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:03.906979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fdbe2-88b7-40fa-8326-b3086c082748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:03.907657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fdbe2-88b7-40fa-8326-b3086c082748 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:03.907939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fdbe2-88b7-40fa-8326-b3086c082748 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:03.908214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fdbe2-88b7-40fa-8326-b3086c082748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:03.923814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fdbe2-88b7-40fa-8326-b3086c082748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:03.934197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fdbe2-88b7-40fa-8326-b3086c082748 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:03.951104 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3146/6358] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:05.330789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cc217-b214-4267-9d53-e576a3941f14 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:05.333121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cc0cc217-b214-4267-9d53-e576a3941f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:05.357633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cc217-b214-4267-9d53-e576a3941f14 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:05.365198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee83d33-ddda-4423-a55f-2ef0f14104d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:05.366810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee83d33-ddda-4423-a55f-2ef0f14104d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:05.367282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee83d33-ddda-4423-a55f-2ef0f14104d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:05.367857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee83d33-ddda-4423-a55f-2ef0f14104d3 admin admin] PATH_INFO: `/v3/projects/f3476949244f4f9ebede2f76f2c96233` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:05.369509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee83d33-ddda-4423-a55f-2ef0f14104d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3476949244f4f9ebede2f76f2c96233)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:05.372502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee83d33-ddda-4423-a55f-2ef0f14104d3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:05.552803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ee83d33-ddda-4423-a55f-2ef0f14104d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3476949244f4f9ebede2f76f2c96233', 'request_id': 'req-2ee83d33-ddda-4423-a55f-2ef0f14104d3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:05.561418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ee83d33-ddda-4423-a55f-2ef0f14104d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3476949244f4f9ebede2f76f2c96233', 'request_id': 'req-2ee83d33-ddda-4423-a55f-2ef0f14104d3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:05.581701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ee83d33-ddda-4423-a55f-2ef0f14104d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3476949244f4f9ebede2f76f2c96233', 'request_id': 'req-2ee83d33-ddda-4423-a55f-2ef0f14104d3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:05.598165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ee83d33-ddda-4423-a55f-2ef0f14104d3 admin admin] The token cache is being invalidate because project f3476949244f4f9ebede2f76f2c96233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:05.598709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ee83d33-ddda-4423-a55f-2ef0f14104d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:05.604682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ee83d33-ddda-4423-a55f-2ef0f14104d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:05.607896 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3213/6359] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:05 2021] DELETE /identity/v3/projects/f3476949244f4f9ebede2f76f2c96233 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:05.615260 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0414c-c9fb-485c-b262-a36bebbf9198 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:05.615723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0414c-c9fb-485c-b262-a36bebbf9198 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:05.616029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0414c-c9fb-485c-b262-a36bebbf9198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:05.660469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a2b0414c-c9fb-485c-b262-a36bebbf9198 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:05.662103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a2b0414c-c9fb-485c-b262-a36bebbf9198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:05.746140 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3147/6360] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:05.757637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f3736-fe85-4bcc-a2d1-42b9e6633c96 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:05.758649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f3736-fe85-4bcc-a2d1-42b9e6633c96 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:05.759014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f3736-fe85-4bcc-a2d1-42b9e6633c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:05.785116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4e1f3736-fe85-4bcc-a2d1-42b9e6633c96 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:05.786809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4e1f3736-fe85-4bcc-a2d1-42b9e6633c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:05.802144 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3214/6361] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:05.805785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0414c-c9fb-485c-b262-a36bebbf9198 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:05.825112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0414c-c9fb-485c-b262-a36bebbf9198 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:05.831050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3218b-a5d6-4cd7-9521-f5bb420201dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:05.832263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3218b-a5d6-4cd7-9521-f5bb420201dc admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:05.832796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3218b-a5d6-4cd7-9521-f5bb420201dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:05.833273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3218b-a5d6-4cd7-9521-f5bb420201dc admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:05.834160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3218b-a5d6-4cd7-9521-f5bb420201dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:07:05.834643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3218b-a5d6-4cd7-9521-f5bb420201dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:05.836604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3218b-a5d6-4cd7-9521-f5bb420201dc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:05.850803 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3148/6362] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:07:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:07:05.855058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f3736-fe85-4bcc-a2d1-42b9e6633c96 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:05.865839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f3736-fe85-4bcc-a2d1-42b9e6633c96 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:05.876418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19b7e9-1d86-4f5f-a1a6-2b9015be48c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:05.877243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19b7e9-1d86-4f5f-a1a6-2b9015be48c6 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:05.877760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19b7e9-1d86-4f5f-a1a6-2b9015be48c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:05.878408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19b7e9-1d86-4f5f-a1a6-2b9015be48c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:05.881843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19b7e9-1d86-4f5f-a1a6-2b9015be48c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:05.884224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19b7e9-1d86-4f5f-a1a6-2b9015be48c6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:05.931683 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3215/6363] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:05 2021] POST /identity/v3/projects => generated 359 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:07:05.936054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3218b-a5d6-4cd7-9521-f5bb420201dc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:05.949734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3218b-a5d6-4cd7-9521-f5bb420201dc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:06.027758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c123b-cbb0-4676-9b37-4269830fef12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:06.028445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c123b-cbb0-4676-9b37-4269830fef12 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:06.029098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c123b-cbb0-4676-9b37-4269830fef12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:06.029395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c123b-cbb0-4676-9b37-4269830fef12 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:06.030116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c123b-cbb0-4676-9b37-4269830fef12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:06.033734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c123b-cbb0-4676-9b37-4269830fef12 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:06.071957 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3149/6364] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:05 2021] POST /identity/v3/users => generated 280 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:06.073184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19b7e9-1d86-4f5f-a1a6-2b9015be48c6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:06.103842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19b7e9-1d86-4f5f-a1a6-2b9015be48c6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:06.120486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfda8f-39d7-4ac9-be07-326d7511bdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:06.121206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfda8f-39d7-4ac9-be07-326d7511bdc4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:06.121495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfda8f-39d7-4ac9-be07-326d7511bdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:06.122541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfda8f-39d7-4ac9-be07-326d7511bdc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:06.123309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfda8f-39d7-4ac9-be07-326d7511bdc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:06.127895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfda8f-39d7-4ac9-be07-326d7511bdc4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:06.154604 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3216/6365] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:06 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:06.159768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c123b-cbb0-4676-9b37-4269830fef12 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:06.176555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c123b-cbb0-4676-9b37-4269830fef12 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:06.184146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda37bd-4ffc-4648-ac28-0bcdc22279db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:06.185092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda37bd-4ffc-4648-ac28-0bcdc22279db admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:06.187392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda37bd-4ffc-4648-ac28-0bcdc22279db admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:06.187870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda37bd-4ffc-4648-ac28-0bcdc22279db admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:06.188945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda37bd-4ffc-4648-ac28-0bcdc22279db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:06.190625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda37bd-4ffc-4648-ac28-0bcdc22279db admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:06.212549 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3150/6366] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:06 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:06.215920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfda8f-39d7-4ac9-be07-326d7511bdc4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:06.231766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfda8f-39d7-4ac9-be07-326d7511bdc4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:06.245818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdd5e8-e9ae-44df-afcd-1ee9c9440e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:06.247303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdd5e8-e9ae-44df-afcd-1ee9c9440e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:06.247801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdd5e8-e9ae-44df-afcd-1ee9c9440e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:06.247916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdd5e8-e9ae-44df-afcd-1ee9c9440e33 admin admin] PATH_INFO: `/v3/projects/4e20596c0aee4a2b9017d526f9148e8b/users/8323a0a31029427cb4a63eeadfe2a777/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:06.263747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdd5e8-e9ae-44df-afcd-1ee9c9440e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e20596c0aee4a2b9017d526f9148e8b, user_id=8323a0a31029427cb4a63eeadfe2a777, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:06.270912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdd5e8-e9ae-44df-afcd-1ee9c9440e33 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:06.288226 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3217/6367] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:06 2021] PUT /identity/v3/projects/4e20596c0aee4a2b9017d526f9148e8b/users/8323a0a31029427cb4a63eeadfe2a777/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:07:06.301621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41814ef8-25cd-4f43-880d-7a5c6cad55f1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:06.301917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41814ef8-25cd-4f43-880d-7a5c6cad55f1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:06.302198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41814ef8-25cd-4f43-880d-7a5c6cad55f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:06.336560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-41814ef8-25cd-4f43-880d-7a5c6cad55f1 None None] MFA Rules not processed for user `8323a0a31029427cb4a63eeadfe2a777`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:06.339080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-41814ef8-25cd-4f43-880d-7a5c6cad55f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:06.428069 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3151/6368] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:06 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:06.439807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdd5e8-e9ae-44df-afcd-1ee9c9440e33 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:06.441761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9cfdd5e8-e9ae-44df-afcd-1ee9c9440e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:06.532492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41814ef8-25cd-4f43-880d-7a5c6cad55f1 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:06.534117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-41814ef8-25cd-4f43-880d-7a5c6cad55f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:06.542737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdd5e8-e9ae-44df-afcd-1ee9c9440e33 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:06.547753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4ee65-4d89-4f22-a43d-7d3829e5fb34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:06.548892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4ee65-4d89-4f22-a43d-7d3829e5fb34 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:06.549408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4ee65-4d89-4f22-a43d-7d3829e5fb34 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:06.550027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4ee65-4d89-4f22-a43d-7d3829e5fb34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:06.575770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4ee65-4d89-4f22-a43d-7d3829e5fb34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:06.577750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4ee65-4d89-4f22-a43d-7d3829e5fb34 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:06.613754 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3218/6369] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:06 2021] GET /identity/v3/auth/tokens => generated 3226 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:06.658451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41814ef8-25cd-4f43-880d-7a5c6cad55f1 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:06.665913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa036c-042e-4414-ae2c-8dec39f744ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:06.667069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa036c-042e-4414-ae2c-8dec39f744ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:06.683052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa036c-042e-4414-ae2c-8dec39f744ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:06.684362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa036c-042e-4414-ae2c-8dec39f744ef admin admin] PATH_INFO: `/v3/users/f027b547c51549b3809b6dcd53913294` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:06.686909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa036c-042e-4414-ae2c-8dec39f744ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f027b547c51549b3809b6dcd53913294)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:06.693793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa036c-042e-4414-ae2c-8dec39f744ef admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:06.872896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f2aa036c-042e-4414-ae2c-8dec39f744ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f027b547c51549b3809b6dcd53913294'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:06.892880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f2aa036c-042e-4414-ae2c-8dec39f744ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f027b547c51549b3809b6dcd53913294'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:06.914845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f2aa036c-042e-4414-ae2c-8dec39f744ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f027b547c51549b3809b6dcd53913294'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:06.915875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f2aa036c-042e-4414-ae2c-8dec39f744ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f027b547c51549b3809b6dcd53913294'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:06.936911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f2aa036c-042e-4414-ae2c-8dec39f744ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f027b547c51549b3809b6dcd53913294'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:06.950030 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3152/6370] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:06 2021] DELETE /identity/v3/users/f027b547c51549b3809b6dcd53913294 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:06.960389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4777555-c5ee-4a62-b32b-dfd03b840a8a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:06.961303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4777555-c5ee-4a62-b32b-dfd03b840a8a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:06.962245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4777555-c5ee-4a62-b32b-dfd03b840a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:06.989073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c4777555-c5ee-4a62-b32b-dfd03b840a8a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:06.990736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c4777555-c5ee-4a62-b32b-dfd03b840a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:07.112598 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3219/6371] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:07:07.233735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa036c-042e-4414-ae2c-8dec39f744ef admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:07.236345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f2aa036c-042e-4414-ae2c-8dec39f744ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:07.371094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa036c-042e-4414-ae2c-8dec39f744ef admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:07.378854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7cd78-9ed3-4833-9f0b-6356f7e49970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:07.379523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7cd78-9ed3-4833-9f0b-6356f7e49970 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:07.379807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7cd78-9ed3-4833-9f0b-6356f7e49970 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:07.380221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7cd78-9ed3-4833-9f0b-6356f7e49970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:07.403885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7cd78-9ed3-4833-9f0b-6356f7e49970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:07.406601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7cd78-9ed3-4833-9f0b-6356f7e49970 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:07.439171 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3153/6372] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:09.036788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27866f61-3375-401b-a19e-8015a5827cd6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:09.037677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27866f61-3375-401b-a19e-8015a5827cd6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:09.037970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27866f61-3375-401b-a19e-8015a5827cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:09.060002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7cd78-9ed3-4833-9f0b-6356f7e49970 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:09.061451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d3a7cd78-9ed3-4833-9f0b-6356f7e49970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:09.071393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-27866f61-3375-401b-a19e-8015a5827cd6 None None] MFA Rules not processed for user `d6278aefb6d5497aad3d74b47b2e95d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:09.072654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-27866f61-3375-401b-a19e-8015a5827cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:09.079946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7cd78-9ed3-4833-9f0b-6356f7e49970 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:09.091178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e415a-0095-4245-95e8-55e07e5e71c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:09.092066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e415a-0095-4245-95e8-55e07e5e71c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:09.092382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e415a-0095-4245-95e8-55e07e5e71c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:09.092659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e415a-0095-4245-95e8-55e07e5e71c3 admin admin] PATH_INFO: `/v3/projects/c532cc90b02c49449cb03e27e1614862` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:09.094613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e415a-0095-4245-95e8-55e07e5e71c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c532cc90b02c49449cb03e27e1614862)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:09.096415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e415a-0095-4245-95e8-55e07e5e71c3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:09.196459 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3220/6373] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:09 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:09.210469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4f6e415a-0095-4245-95e8-55e07e5e71c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c532cc90b02c49449cb03e27e1614862', 'request_id': 'req-4f6e415a-0095-4245-95e8-55e07e5e71c3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:09.219430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4f6e415a-0095-4245-95e8-55e07e5e71c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c532cc90b02c49449cb03e27e1614862', 'request_id': 'req-4f6e415a-0095-4245-95e8-55e07e5e71c3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:09.226007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4f6e415a-0095-4245-95e8-55e07e5e71c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c532cc90b02c49449cb03e27e1614862', 'request_id': 'req-4f6e415a-0095-4245-95e8-55e07e5e71c3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:09.247450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4f6e415a-0095-4245-95e8-55e07e5e71c3 admin admin] The token cache is being invalidate because project c532cc90b02c49449cb03e27e1614862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:09.248166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4f6e415a-0095-4245-95e8-55e07e5e71c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:09.251562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4f6e415a-0095-4245-95e8-55e07e5e71c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:09.258486 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3154/6374] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:09 2021] DELETE /identity/v3/projects/c532cc90b02c49449cb03e27e1614862 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:09.259924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27866f61-3375-401b-a19e-8015a5827cd6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:09.274862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27866f61-3375-401b-a19e-8015a5827cd6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:09.365677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b982d-50f4-4449-8623-043fb0d15e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:09.367422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b982d-50f4-4449-8623-043fb0d15e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:09.367930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b982d-50f4-4449-8623-043fb0d15e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:09.369023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b982d-50f4-4449-8623-043fb0d15e47 admin admin] PATH_INFO: `/v3/users/53f636001fe94de0af92612fe766a77d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:09.371294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b982d-50f4-4449-8623-043fb0d15e47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f636001fe94de0af92612fe766a77d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:09.375666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b982d-50f4-4449-8623-043fb0d15e47 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:09.434361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f4b982d-50f4-4449-8623-043fb0d15e47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f636001fe94de0af92612fe766a77d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:09.444514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f4b982d-50f4-4449-8623-043fb0d15e47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f636001fe94de0af92612fe766a77d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:09.446480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f4b982d-50f4-4449-8623-043fb0d15e47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f636001fe94de0af92612fe766a77d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:09.461735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f4b982d-50f4-4449-8623-043fb0d15e47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f636001fe94de0af92612fe766a77d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:09.474651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f4b982d-50f4-4449-8623-043fb0d15e47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f636001fe94de0af92612fe766a77d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:09.484914 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3221/6375] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:09 2021] DELETE /identity/v3/users/53f636001fe94de0af92612fe766a77d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:09.891605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b042b4f-2183-47be-af2d-d76c27e17a37 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:09.893029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b042b4f-2183-47be-af2d-d76c27e17a37 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:09.893505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b042b4f-2183-47be-af2d-d76c27e17a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:09.945518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6b042b4f-2183-47be-af2d-d76c27e17a37 None None] MFA Rules not processed for user `d6278aefb6d5497aad3d74b47b2e95d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:09.946783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6b042b4f-2183-47be-af2d-d76c27e17a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:10.103337 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3155/6376] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:09 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:10.263917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b982d-50f4-4449-8623-043fb0d15e47 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:10.267749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2f4b982d-50f4-4449-8623-043fb0d15e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:10.494886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b982d-50f4-4449-8623-043fb0d15e47 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:10.513841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba8578-f465-4ac0-a43f-e6db178477b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:10.515028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba8578-f465-4ac0-a43f-e6db178477b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:10.515586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba8578-f465-4ac0-a43f-e6db178477b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:10.516013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba8578-f465-4ac0-a43f-e6db178477b4 admin admin] PATH_INFO: `/v3/projects/569b15186e144022a318ddf803fb25d7` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:10.517442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba8578-f465-4ac0-a43f-e6db178477b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=569b15186e144022a318ddf803fb25d7)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:10.519603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba8578-f465-4ac0-a43f-e6db178477b4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:10.581084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6eba8578-f465-4ac0-a43f-e6db178477b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569b15186e144022a318ddf803fb25d7', 'request_id': 'req-6eba8578-f465-4ac0-a43f-e6db178477b4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:10.589599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6eba8578-f465-4ac0-a43f-e6db178477b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569b15186e144022a318ddf803fb25d7', 'request_id': 'req-6eba8578-f465-4ac0-a43f-e6db178477b4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:10.607670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6eba8578-f465-4ac0-a43f-e6db178477b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569b15186e144022a318ddf803fb25d7', 'request_id': 'req-6eba8578-f465-4ac0-a43f-e6db178477b4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:10.621537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6eba8578-f465-4ac0-a43f-e6db178477b4 admin admin] The token cache is being invalidate because project 569b15186e144022a318ddf803fb25d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:10.621835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6eba8578-f465-4ac0-a43f-e6db178477b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:10.622550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6eba8578-f465-4ac0-a43f-e6db178477b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:10.633644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2018ac-bf73-4b61-b55a-c0760274da1d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:10.633946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2018ac-bf73-4b61-b55a-c0760274da1d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:10.634233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2018ac-bf73-4b61-b55a-c0760274da1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:10.638273 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3222/6377] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:10 2021] DELETE /identity/v3/projects/569b15186e144022a318ddf803fb25d7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:10.658106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6b2018ac-bf73-4b61-b55a-c0760274da1d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:10.659503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6b2018ac-bf73-4b61-b55a-c0760274da1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:10.763220 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3156/6378] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:10.771543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562504e8-0ba9-42d3-ae39-3915d5e86f10 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:10.774502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562504e8-0ba9-42d3-ae39-3915d5e86f10 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:10.774502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562504e8-0ba9-42d3-ae39-3915d5e86f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:10.819324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-562504e8-0ba9-42d3-ae39-3915d5e86f10 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:10.820561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-562504e8-0ba9-42d3-ae39-3915d5e86f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:10.838880 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3223/6379] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:10.843821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2018ac-bf73-4b61-b55a-c0760274da1d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:10.855660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2018ac-bf73-4b61-b55a-c0760274da1d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:10.861781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be435e-4602-4c8f-a95a-b017e9ca6c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:10.862848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be435e-4602-4c8f-a95a-b017e9ca6c63 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:10.863035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be435e-4602-4c8f-a95a-b017e9ca6c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:10.863322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be435e-4602-4c8f-a95a-b017e9ca6c63 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:10.864081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be435e-4602-4c8f-a95a-b017e9ca6c63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:07:10.864426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be435e-4602-4c8f-a95a-b017e9ca6c63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:10.867019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be435e-4602-4c8f-a95a-b017e9ca6c63 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:10.908518 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3157/6380] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:07:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:07:10.914172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562504e8-0ba9-42d3-ae39-3915d5e86f10 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:10.928352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562504e8-0ba9-42d3-ae39-3915d5e86f10 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:10.940750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014c92e-68ed-4b0b-a9aa-58c63198f544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:10.941511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014c92e-68ed-4b0b-a9aa-58c63198f544 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:10.941794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014c92e-68ed-4b0b-a9aa-58c63198f544 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:10.942780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014c92e-68ed-4b0b-a9aa-58c63198f544 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:10.943641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014c92e-68ed-4b0b-a9aa-58c63198f544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:10.946848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014c92e-68ed-4b0b-a9aa-58c63198f544 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:10.990724 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3224/6381] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:10 2021] POST /identity/v3/projects => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:10.994999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be435e-4602-4c8f-a95a-b017e9ca6c63 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:11.015624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be435e-4602-4c8f-a95a-b017e9ca6c63 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:11.169609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfcf33-7678-483e-8953-28ad1fb068cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:11.170331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfcf33-7678-483e-8953-28ad1fb068cb admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:11.170627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfcf33-7678-483e-8953-28ad1fb068cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:11.173316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfcf33-7678-483e-8953-28ad1fb068cb admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:11.180213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfcf33-7678-483e-8953-28ad1fb068cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:11.183097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfcf33-7678-483e-8953-28ad1fb068cb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:11.235336 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3158/6382] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:10 2021] POST /identity/v3/users => generated 284 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:11.241485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014c92e-68ed-4b0b-a9aa-58c63198f544 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:11.257809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014c92e-68ed-4b0b-a9aa-58c63198f544 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:11.264012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c0544-b82b-49df-9f98-56053c78fbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:11.265915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c0544-b82b-49df-9f98-56053c78fbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:11.266401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c0544-b82b-49df-9f98-56053c78fbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:11.267494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c0544-b82b-49df-9f98-56053c78fbc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:11.276207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c0544-b82b-49df-9f98-56053c78fbc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:11.279381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c0544-b82b-49df-9f98-56053c78fbc0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:11.308695 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3225/6383] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:11 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:11.315174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfcf33-7678-483e-8953-28ad1fb068cb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:11.340091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfcf33-7678-483e-8953-28ad1fb068cb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:11.355157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493bc57-9bf5-49f8-b914-5a7281fbc4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:11.356271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493bc57-9bf5-49f8-b914-5a7281fbc4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:11.356757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493bc57-9bf5-49f8-b914-5a7281fbc4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:11.357225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493bc57-9bf5-49f8-b914-5a7281fbc4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:11.358187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493bc57-9bf5-49f8-b914-5a7281fbc4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:11.365082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493bc57-9bf5-49f8-b914-5a7281fbc4d0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:11.404400 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3159/6384] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:11 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:11.405676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c0544-b82b-49df-9f98-56053c78fbc0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:11.419746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c0544-b82b-49df-9f98-56053c78fbc0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:11.434336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf7398-b217-4c4c-9aa6-27b17c52beb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:11.435664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf7398-b217-4c4c-9aa6-27b17c52beb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:11.436005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf7398-b217-4c4c-9aa6-27b17c52beb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:11.436499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf7398-b217-4c4c-9aa6-27b17c52beb4 admin admin] PATH_INFO: `/v3/projects/84b0c3aa41b541ccbc42515abe1c4150/users/602a24ee2aa14b33a5914ee2b11c2b80/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:11.489406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf7398-b217-4c4c-9aa6-27b17c52beb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b0c3aa41b541ccbc42515abe1c4150, user_id=602a24ee2aa14b33a5914ee2b11c2b80, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:11.492969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf7398-b217-4c4c-9aa6-27b17c52beb4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:11.534410 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3226/6385] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:11 2021] PUT /identity/v3/projects/84b0c3aa41b541ccbc42515abe1c4150/users/602a24ee2aa14b33a5914ee2b11c2b80/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:11.537709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2ac74-509e-4abd-b212-1daad741140b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:11.538031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2ac74-509e-4abd-b212-1daad741140b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:11.538366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2ac74-509e-4abd-b212-1daad741140b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:11.573668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-59d2ac74-509e-4abd-b212-1daad741140b None None] MFA Rules not processed for user `602a24ee2aa14b33a5914ee2b11c2b80`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:11.575982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-59d2ac74-509e-4abd-b212-1daad741140b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:11.673556 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3160/6386] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:11 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:07:11.678245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf7398-b217-4c4c-9aa6-27b17c52beb4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:11.832223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf7398-b217-4c4c-9aa6-27b17c52beb4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:11.846175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab3d75-a3db-4215-9af9-f869453f2fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:11.847192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab3d75-a3db-4215-9af9-f869453f2fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:11.847630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab3d75-a3db-4215-9af9-f869453f2fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:11.848058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab3d75-a3db-4215-9af9-f869453f2fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:11.848936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab3d75-a3db-4215-9af9-f869453f2fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:11.852020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab3d75-a3db-4215-9af9-f869453f2fa9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:11.908143 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3227/6387] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:11 2021] POST /identity/v3/projects => generated 369 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:11.912001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2ac74-509e-4abd-b212-1daad741140b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:11.929178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2ac74-509e-4abd-b212-1daad741140b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:12.023680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98d4bc-88b8-4664-893c-cbb39a3e17df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:12.024760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98d4bc-88b8-4664-893c-cbb39a3e17df admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:12.025432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98d4bc-88b8-4664-893c-cbb39a3e17df admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:12.025955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98d4bc-88b8-4664-893c-cbb39a3e17df admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:12.027486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98d4bc-88b8-4664-893c-cbb39a3e17df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:12.029726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98d4bc-88b8-4664-893c-cbb39a3e17df admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:12.059184 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3161/6388] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:11 2021] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:07:12.063649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab3d75-a3db-4215-9af9-f869453f2fa9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:12.081856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab3d75-a3db-4215-9af9-f869453f2fa9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:12.087737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c27a6-2fa9-4f02-bf61-9499068d9abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:12.089395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c27a6-2fa9-4f02-bf61-9499068d9abf admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:12.089947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c27a6-2fa9-4f02-bf61-9499068d9abf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:12.090507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c27a6-2fa9-4f02-bf61-9499068d9abf admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:12.091593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c27a6-2fa9-4f02-bf61-9499068d9abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:12.098075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c27a6-2fa9-4f02-bf61-9499068d9abf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:12.113150 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3228/6389] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:12 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:07:12.117093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98d4bc-88b8-4664-893c-cbb39a3e17df admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:12.139462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98d4bc-88b8-4664-893c-cbb39a3e17df admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:12.146665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aaf110-0fff-4f10-8237-f1a5a6d7b57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:12.147955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf110-0fff-4f10-8237-f1a5a6d7b57a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:12.148457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf110-0fff-4f10-8237-f1a5a6d7b57a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:12.148947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf110-0fff-4f10-8237-f1a5a6d7b57a admin admin] PATH_INFO: `/v3/projects/7b6426a00c3047b3994c2bfd3f63692c/users/9415d66255b54e00aa0450cdb428ca32/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:12.170573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aaf110-0fff-4f10-8237-f1a5a6d7b57a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b6426a00c3047b3994c2bfd3f63692c, user_id=9415d66255b54e00aa0450cdb428ca32, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:12.177992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aaf110-0fff-4f10-8237-f1a5a6d7b57a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:12.198814 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3162/6390] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:12 2021] PUT /identity/v3/projects/7b6426a00c3047b3994c2bfd3f63692c/users/9415d66255b54e00aa0450cdb428ca32/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:12.207424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c27a6-2fa9-4f02-bf61-9499068d9abf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:12.225017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c27a6-2fa9-4f02-bf61-9499068d9abf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:12.318845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df179a9-9870-4725-8708-3b1ec4c812f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:12.322239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df179a9-9870-4725-8708-3b1ec4c812f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:12.324011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df179a9-9870-4725-8708-3b1ec4c812f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:12.325095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df179a9-9870-4725-8708-3b1ec4c812f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:12.327099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df179a9-9870-4725-8708-3b1ec4c812f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:12.332056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df179a9-9870-4725-8708-3b1ec4c812f3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:12.356737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aaf110-0fff-4f10-8237-f1a5a6d7b57a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:12.357352 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3229/6391] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:12 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:12.372328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aaf110-0fff-4f10-8237-f1a5a6d7b57a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:12.391052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a94e0-798f-4311-9f2f-f7bb1de6d034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:12.391998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a94e0-798f-4311-9f2f-f7bb1de6d034 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:12.393159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a94e0-798f-4311-9f2f-f7bb1de6d034 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:12.393159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a94e0-798f-4311-9f2f-f7bb1de6d034 admin admin] PATH_INFO: `/v3/projects/7b6426a00c3047b3994c2bfd3f63692c/users/9415d66255b54e00aa0450cdb428ca32/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:12.397462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a94e0-798f-4311-9f2f-f7bb1de6d034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b6426a00c3047b3994c2bfd3f63692c, user_id=9415d66255b54e00aa0450cdb428ca32, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:12.400255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a94e0-798f-4311-9f2f-f7bb1de6d034 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:12.421118 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3163/6392] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:12 2021] PUT /identity/v3/projects/7b6426a00c3047b3994c2bfd3f63692c/users/9415d66255b54e00aa0450cdb428ca32/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:12.423757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56109172-ba58-4a48-8314-829570311dfe None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:12.424125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56109172-ba58-4a48-8314-829570311dfe None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:12.424498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56109172-ba58-4a48-8314-829570311dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:12.468162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-56109172-ba58-4a48-8314-829570311dfe None None] MFA Rules not processed for user `9415d66255b54e00aa0450cdb428ca32`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:12.469813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-56109172-ba58-4a48-8314-829570311dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:12.638678 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3230/6393] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:12 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:12.648549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a94e0-798f-4311-9f2f-f7bb1de6d034 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:12.650939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-380a94e0-798f-4311-9f2f-f7bb1de6d034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:12.834779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a94e0-798f-4311-9f2f-f7bb1de6d034 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:12.841045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63abc15-7728-4bf7-b37b-9070f071c308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:12.841961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63abc15-7728-4bf7-b37b-9070f071c308 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:12.842587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63abc15-7728-4bf7-b37b-9070f071c308 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:12.843251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63abc15-7728-4bf7-b37b-9070f071c308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:12.855529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63abc15-7728-4bf7-b37b-9070f071c308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:12.857333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63abc15-7728-4bf7-b37b-9070f071c308 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:12.885533 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3164/6394] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:12 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:12.969913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56109172-ba58-4a48-8314-829570311dfe None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:12.971515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-56109172-ba58-4a48-8314-829570311dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:12.993413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56109172-ba58-4a48-8314-829570311dfe None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:13.000449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473284e9-6d92-4638-9496-0ad9f8235f5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:13.001373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473284e9-6d92-4638-9496-0ad9f8235f5a service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:13.001826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473284e9-6d92-4638-9496-0ad9f8235f5a service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:13.002214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473284e9-6d92-4638-9496-0ad9f8235f5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:13.090563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473284e9-6d92-4638-9496-0ad9f8235f5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:13.092222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473284e9-6d92-4638-9496-0ad9f8235f5a service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:13.106126 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3231/6395] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:12 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:15.089368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63abc15-7728-4bf7-b37b-9070f071c308 service cinder] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:15.089368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e63abc15-7728-4bf7-b37b-9070f071c308 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:15.236338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63abc15-7728-4bf7-b37b-9070f071c308 service cinder] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:15.242172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6403fdc-8983-402a-9016-c8c735afca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:15.243025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6403fdc-8983-402a-9016-c8c735afca7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:15.243331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6403fdc-8983-402a-9016-c8c735afca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:15.243733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6403fdc-8983-402a-9016-c8c735afca7b admin admin] PATH_INFO: `/v3/users/004fe35715cd4dd593ea1f310173de82` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:15.244979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6403fdc-8983-402a-9016-c8c735afca7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=004fe35715cd4dd593ea1f310173de82)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:15.247139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6403fdc-8983-402a-9016-c8c735afca7b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:15.293427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a6403fdc-8983-402a-9016-c8c735afca7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '004fe35715cd4dd593ea1f310173de82'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:15.300969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a6403fdc-8983-402a-9016-c8c735afca7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '004fe35715cd4dd593ea1f310173de82'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:15.313420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a6403fdc-8983-402a-9016-c8c735afca7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '004fe35715cd4dd593ea1f310173de82'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:15.314167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a6403fdc-8983-402a-9016-c8c735afca7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '004fe35715cd4dd593ea1f310173de82'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:15.322205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a6403fdc-8983-402a-9016-c8c735afca7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '004fe35715cd4dd593ea1f310173de82'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:15.329326 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3165/6396] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:15 2021] DELETE /identity/v3/users/004fe35715cd4dd593ea1f310173de82 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:15.334332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a57ec-bba4-4d8c-ac1a-da5d296141a9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:15.334805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a57ec-bba4-4d8c-ac1a-da5d296141a9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:15.334915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a57ec-bba4-4d8c-ac1a-da5d296141a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:15.364251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0a5a57ec-bba4-4d8c-ac1a-da5d296141a9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:15.365513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0a5a57ec-bba4-4d8c-ac1a-da5d296141a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:15.424000 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3232/6397] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:15.434810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6403fdc-8983-402a-9016-c8c735afca7b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:15.437709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a6403fdc-8983-402a-9016-c8c735afca7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:15.541630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6403fdc-8983-402a-9016-c8c735afca7b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:15.546102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00f0e8-773c-4b00-9bdc-04400f48c545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:15.547401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00f0e8-773c-4b00-9bdc-04400f48c545 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:15.547822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00f0e8-773c-4b00-9bdc-04400f48c545 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:15.547963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00f0e8-773c-4b00-9bdc-04400f48c545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:15.559169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00f0e8-773c-4b00-9bdc-04400f48c545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:15.561486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00f0e8-773c-4b00-9bdc-04400f48c545 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:15.572929 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3166/6398] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:07:15.844107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a57ec-bba4-4d8c-ac1a-da5d296141a9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:15.845554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0a5a57ec-bba4-4d8c-ac1a-da5d296141a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:15.868287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a57ec-bba4-4d8c-ac1a-da5d296141a9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:15.881464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533b9a2-52a9-4cc1-ae44-64e51da399a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:15.882921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533b9a2-52a9-4cc1-ae44-64e51da399a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:15.883339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533b9a2-52a9-4cc1-ae44-64e51da399a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:15.883759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533b9a2-52a9-4cc1-ae44-64e51da399a0 admin admin] PATH_INFO: `/v3/projects/be6e867991a3454cb4a23e489f0b6f12` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:15.885166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533b9a2-52a9-4cc1-ae44-64e51da399a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be6e867991a3454cb4a23e489f0b6f12)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:15.887606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533b9a2-52a9-4cc1-ae44-64e51da399a0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:15.984368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3533b9a2-52a9-4cc1-ae44-64e51da399a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be6e867991a3454cb4a23e489f0b6f12', 'request_id': 'req-3533b9a2-52a9-4cc1-ae44-64e51da399a0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:15.992168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3533b9a2-52a9-4cc1-ae44-64e51da399a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be6e867991a3454cb4a23e489f0b6f12', 'request_id': 'req-3533b9a2-52a9-4cc1-ae44-64e51da399a0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:16.006953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3533b9a2-52a9-4cc1-ae44-64e51da399a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be6e867991a3454cb4a23e489f0b6f12', 'request_id': 'req-3533b9a2-52a9-4cc1-ae44-64e51da399a0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:16.020264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3533b9a2-52a9-4cc1-ae44-64e51da399a0 admin admin] The token cache is being invalidate because project be6e867991a3454cb4a23e489f0b6f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:16.020560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3533b9a2-52a9-4cc1-ae44-64e51da399a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:16.021239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3533b9a2-52a9-4cc1-ae44-64e51da399a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:16.023069 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3233/6399] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:15 2021] DELETE /identity/v3/projects/be6e867991a3454cb4a23e489f0b6f12 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:16.029493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be88a4-d032-4550-80e6-f3bb2fe753dd None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:16.029781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be88a4-d032-4550-80e6-f3bb2fe753dd None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:16.030061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be88a4-d032-4550-80e6-f3bb2fe753dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:16.054139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-94be88a4-d032-4550-80e6-f3bb2fe753dd None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:16.055314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-94be88a4-d032-4550-80e6-f3bb2fe753dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:16.123284 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3167/6400] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:07:16.131236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07e66d-c337-48a6-b52c-cf07a80d2b58 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:16.131655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07e66d-c337-48a6-b52c-cf07a80d2b58 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:16.132008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07e66d-c337-48a6-b52c-cf07a80d2b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:16.153517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5c07e66d-c337-48a6-b52c-cf07a80d2b58 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:16.154261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5c07e66d-c337-48a6-b52c-cf07a80d2b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:16.165776 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3234/6401] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:16.170195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be88a4-d032-4550-80e6-f3bb2fe753dd None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:16.198832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be88a4-d032-4550-80e6-f3bb2fe753dd None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:16.224927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d616ca-0dfd-4a0a-81dc-6eb141f0623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:16.226352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d616ca-0dfd-4a0a-81dc-6eb141f0623e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:16.226798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d616ca-0dfd-4a0a-81dc-6eb141f0623e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:16.227232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d616ca-0dfd-4a0a-81dc-6eb141f0623e admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:16.228668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d616ca-0dfd-4a0a-81dc-6eb141f0623e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:07:16.229141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d616ca-0dfd-4a0a-81dc-6eb141f0623e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:16.231225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d616ca-0dfd-4a0a-81dc-6eb141f0623e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:16.250719 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3168/6402] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:07:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:07:16.254548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07e66d-c337-48a6-b52c-cf07a80d2b58 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:16.265122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07e66d-c337-48a6-b52c-cf07a80d2b58 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:16.282439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8ded9-dac8-476d-be8c-8db781e02e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:16.283176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8ded9-dac8-476d-be8c-8db781e02e92 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:16.283466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8ded9-dac8-476d-be8c-8db781e02e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:16.283745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8ded9-dac8-476d-be8c-8db781e02e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:16.284462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8ded9-dac8-476d-be8c-8db781e02e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:16.287484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8ded9-dac8-476d-be8c-8db781e02e92 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:16.338920 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3235/6403] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:16 2021] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:16.346238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d616ca-0dfd-4a0a-81dc-6eb141f0623e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:16.359518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d616ca-0dfd-4a0a-81dc-6eb141f0623e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:16.490914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe511c-adb7-4e70-89e9-0a7c955da80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:16.492699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe511c-adb7-4e70-89e9-0a7c955da80c admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:16.493201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe511c-adb7-4e70-89e9-0a7c955da80c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:16.493664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe511c-adb7-4e70-89e9-0a7c955da80c admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:16.494989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe511c-adb7-4e70-89e9-0a7c955da80c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:16.498208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe511c-adb7-4e70-89e9-0a7c955da80c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:16.532055 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3169/6404] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:16 2021] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:16.532396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8ded9-dac8-476d-be8c-8db781e02e92 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:16.545904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8ded9-dac8-476d-be8c-8db781e02e92 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:16.552994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab265d5d-18ef-413b-b915-0644b9c56f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:16.553655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab265d5d-18ef-413b-b915-0644b9c56f27 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:16.553944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab265d5d-18ef-413b-b915-0644b9c56f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:16.554222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab265d5d-18ef-413b-b915-0644b9c56f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:16.554998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab265d5d-18ef-413b-b915-0644b9c56f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:16.556773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab265d5d-18ef-413b-b915-0644b9c56f27 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:16.568497 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3236/6405] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:16 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:16.573855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe511c-adb7-4e70-89e9-0a7c955da80c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:16.585386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe511c-adb7-4e70-89e9-0a7c955da80c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:16.598113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2239ba-b995-440f-b74e-404767c01cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:16.599097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2239ba-b995-440f-b74e-404767c01cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:16.599385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2239ba-b995-440f-b74e-404767c01cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:16.599872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2239ba-b995-440f-b74e-404767c01cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:16.600797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2239ba-b995-440f-b74e-404767c01cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:16.602723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2239ba-b995-440f-b74e-404767c01cd3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:16.617058 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3170/6406] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:16 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:16.617776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab265d5d-18ef-413b-b915-0644b9c56f27 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:16.628090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab265d5d-18ef-413b-b915-0644b9c56f27 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:16.633964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d66e62-8a1e-4143-ada7-f8d51344e7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:16.634899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d66e62-8a1e-4143-ada7-f8d51344e7ca admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:16.635184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d66e62-8a1e-4143-ada7-f8d51344e7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:16.635466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d66e62-8a1e-4143-ada7-f8d51344e7ca admin admin] PATH_INFO: `/v3/projects/3ba00a5a39804c41938903a7fff9e157/users/a12f2c5b14fb4544ae7269c88f4eaad0/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:16.652801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d66e62-8a1e-4143-ada7-f8d51344e7ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba00a5a39804c41938903a7fff9e157, user_id=a12f2c5b14fb4544ae7269c88f4eaad0, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:16.655679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d66e62-8a1e-4143-ada7-f8d51344e7ca admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:16.672412 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3237/6407] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:16 2021] PUT /identity/v3/projects/3ba00a5a39804c41938903a7fff9e157/users/a12f2c5b14fb4544ae7269c88f4eaad0/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:07:16.685402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa81661-729c-4728-acb8-119353bbd130 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:16.685701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa81661-729c-4728-acb8-119353bbd130 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:16.686138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa81661-729c-4728-acb8-119353bbd130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:16.729602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2aa81661-729c-4728-acb8-119353bbd130 None None] MFA Rules not processed for user `a12f2c5b14fb4544ae7269c88f4eaad0`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:16.731376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2aa81661-729c-4728-acb8-119353bbd130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:16.911030 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3171/6408] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:16 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:16.974347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d66e62-8a1e-4143-ada7-f8d51344e7ca admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:16.976544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-72d66e62-8a1e-4143-ada7-f8d51344e7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:16.980948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa81661-729c-4728-acb8-119353bbd130 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:16.982783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2aa81661-729c-4728-acb8-119353bbd130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:17.103707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa81661-729c-4728-acb8-119353bbd130 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:17.107826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d66e62-8a1e-4143-ada7-f8d51344e7ca admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:17.111625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6c9c9-2a47-42b8-aad9-3532047762c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:17.112619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6c9c9-2a47-42b8-aad9-3532047762c1 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:17.113108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6c9c9-2a47-42b8-aad9-3532047762c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:17.113589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6c9c9-2a47-42b8-aad9-3532047762c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:17.123756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6c9c9-2a47-42b8-aad9-3532047762c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:17.126494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6c9c9-2a47-42b8-aad9-3532047762c1 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:17.126966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346971b9-2813-4bfe-bd73-2cdadae877cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:17.127981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346971b9-2813-4bfe-bd73-2cdadae877cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:17.128281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346971b9-2813-4bfe-bd73-2cdadae877cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:17.128565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346971b9-2813-4bfe-bd73-2cdadae877cc admin admin] PATH_INFO: `/v3/users/602a24ee2aa14b33a5914ee2b11c2b80` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:17.130023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346971b9-2813-4bfe-bd73-2cdadae877cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=602a24ee2aa14b33a5914ee2b11c2b80)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:17.131989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346971b9-2813-4bfe-bd73-2cdadae877cc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:17.143075 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3172/6409] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:16 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:17.209047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-346971b9-2813-4bfe-bd73-2cdadae877cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602a24ee2aa14b33a5914ee2b11c2b80'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:17.232262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-346971b9-2813-4bfe-bd73-2cdadae877cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602a24ee2aa14b33a5914ee2b11c2b80'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:17.237629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-346971b9-2813-4bfe-bd73-2cdadae877cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602a24ee2aa14b33a5914ee2b11c2b80'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:17.271558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-346971b9-2813-4bfe-bd73-2cdadae877cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602a24ee2aa14b33a5914ee2b11c2b80'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:17.282216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-346971b9-2813-4bfe-bd73-2cdadae877cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602a24ee2aa14b33a5914ee2b11c2b80'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:17.295686 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3238/6410] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:16 2021] DELETE /identity/v3/users/602a24ee2aa14b33a5914ee2b11c2b80 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:17.301150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36eda8-8a44-47ee-b63a-ed2c2f99e40f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:17.301496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36eda8-8a44-47ee-b63a-ed2c2f99e40f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:17.301779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36eda8-8a44-47ee-b63a-ed2c2f99e40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:17.330650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7b36eda8-8a44-47ee-b63a-ed2c2f99e40f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:17.332982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7b36eda8-8a44-47ee-b63a-ed2c2f99e40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:17.420219 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3173/6411] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:17.434828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346971b9-2813-4bfe-bd73-2cdadae877cc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:17.436528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-346971b9-2813-4bfe-bd73-2cdadae877cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:17.520663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346971b9-2813-4bfe-bd73-2cdadae877cc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:17.525258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900b673-b47e-4a44-b184-14d75fe31719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:17.526053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900b673-b47e-4a44-b184-14d75fe31719 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:17.526407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900b673-b47e-4a44-b184-14d75fe31719 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:17.526694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900b673-b47e-4a44-b184-14d75fe31719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:17.544008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900b673-b47e-4a44-b184-14d75fe31719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:17.547625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900b673-b47e-4a44-b184-14d75fe31719 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:17.561664 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3239/6412] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:19.174159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36eda8-8a44-47ee-b63a-ed2c2f99e40f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:19.176413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7b36eda8-8a44-47ee-b63a-ed2c2f99e40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:19.192958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36eda8-8a44-47ee-b63a-ed2c2f99e40f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:19.210890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d06298-870f-446f-81e4-20d417484dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:19.226118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d06298-870f-446f-81e4-20d417484dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:19.226591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d06298-870f-446f-81e4-20d417484dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:19.226832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d06298-870f-446f-81e4-20d417484dd5 admin admin] PATH_INFO: `/v3/projects/84b0c3aa41b541ccbc42515abe1c4150` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:19.239417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d06298-870f-446f-81e4-20d417484dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b0c3aa41b541ccbc42515abe1c4150)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:19.241294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d06298-870f-446f-81e4-20d417484dd5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:19.340499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-44d06298-870f-446f-81e4-20d417484dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b0c3aa41b541ccbc42515abe1c4150', 'request_id': 'req-44d06298-870f-446f-81e4-20d417484dd5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:19.351170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-44d06298-870f-446f-81e4-20d417484dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b0c3aa41b541ccbc42515abe1c4150', 'request_id': 'req-44d06298-870f-446f-81e4-20d417484dd5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:19.369610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-44d06298-870f-446f-81e4-20d417484dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b0c3aa41b541ccbc42515abe1c4150', 'request_id': 'req-44d06298-870f-446f-81e4-20d417484dd5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:19.386073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-44d06298-870f-446f-81e4-20d417484dd5 admin admin] The token cache is being invalidate because project 84b0c3aa41b541ccbc42515abe1c4150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:19.386400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-44d06298-870f-446f-81e4-20d417484dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:19.387046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-44d06298-870f-446f-81e4-20d417484dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:19.388611 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3174/6413] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:19 2021] DELETE /identity/v3/projects/84b0c3aa41b541ccbc42515abe1c4150 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:19.393249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900b673-b47e-4a44-b184-14d75fe31719 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:19.409518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900b673-b47e-4a44-b184-14d75fe31719 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:19.507910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05136f12-f348-4c8f-9fe1-550d9f4db6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:19.508787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05136f12-f348-4c8f-9fe1-550d9f4db6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:19.509513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05136f12-f348-4c8f-9fe1-550d9f4db6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:19.509658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05136f12-f348-4c8f-9fe1-550d9f4db6b3 admin admin] PATH_INFO: `/v3/users/9415d66255b54e00aa0450cdb428ca32` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:19.514638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05136f12-f348-4c8f-9fe1-550d9f4db6b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9415d66255b54e00aa0450cdb428ca32)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:19.516658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05136f12-f348-4c8f-9fe1-550d9f4db6b3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:19.594374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-05136f12-f348-4c8f-9fe1-550d9f4db6b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9415d66255b54e00aa0450cdb428ca32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:19.607980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-05136f12-f348-4c8f-9fe1-550d9f4db6b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9415d66255b54e00aa0450cdb428ca32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:19.609505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-05136f12-f348-4c8f-9fe1-550d9f4db6b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9415d66255b54e00aa0450cdb428ca32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:19.634732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-05136f12-f348-4c8f-9fe1-550d9f4db6b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9415d66255b54e00aa0450cdb428ca32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:19.659170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-05136f12-f348-4c8f-9fe1-550d9f4db6b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9415d66255b54e00aa0450cdb428ca32'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:19.674378 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3240/6414] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:19 2021] DELETE /identity/v3/users/9415d66255b54e00aa0450cdb428ca32 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:20.307104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d06298-870f-446f-81e4-20d417484dd5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:20.310557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-44d06298-870f-446f-81e4-20d417484dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:20.368680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d06298-870f-446f-81e4-20d417484dd5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:20.488063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ace18d-e777-4ece-a854-e9b6f8e86930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:20.490315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ace18d-e777-4ece-a854-e9b6f8e86930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:20.490777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ace18d-e777-4ece-a854-e9b6f8e86930 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:20.491127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ace18d-e777-4ece-a854-e9b6f8e86930 admin admin] PATH_INFO: `/v3/projects/7b6426a00c3047b3994c2bfd3f63692c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:20.492491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ace18d-e777-4ece-a854-e9b6f8e86930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b6426a00c3047b3994c2bfd3f63692c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:20.494830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ace18d-e777-4ece-a854-e9b6f8e86930 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:20.562501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-54ace18d-e777-4ece-a854-e9b6f8e86930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b6426a00c3047b3994c2bfd3f63692c', 'request_id': 'req-54ace18d-e777-4ece-a854-e9b6f8e86930'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:20.573689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-54ace18d-e777-4ece-a854-e9b6f8e86930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b6426a00c3047b3994c2bfd3f63692c', 'request_id': 'req-54ace18d-e777-4ece-a854-e9b6f8e86930'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:20.581702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-54ace18d-e777-4ece-a854-e9b6f8e86930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b6426a00c3047b3994c2bfd3f63692c', 'request_id': 'req-54ace18d-e777-4ece-a854-e9b6f8e86930'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:20.631035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-54ace18d-e777-4ece-a854-e9b6f8e86930 admin admin] The token cache is being invalidate because project 7b6426a00c3047b3994c2bfd3f63692c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:20.631313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-54ace18d-e777-4ece-a854-e9b6f8e86930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:20.636732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-54ace18d-e777-4ece-a854-e9b6f8e86930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:20.639307 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3175/6415] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:20 2021] DELETE /identity/v3/projects/7b6426a00c3047b3994c2bfd3f63692c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:20.645167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3111188-9382-45c7-88a8-33db63ccfb02 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:20.645652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3111188-9382-45c7-88a8-33db63ccfb02 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:20.647569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3111188-9382-45c7-88a8-33db63ccfb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:20.706150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b3111188-9382-45c7-88a8-33db63ccfb02 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:20.710169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b3111188-9382-45c7-88a8-33db63ccfb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:20.797123 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3241/6416] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:20.809533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d8e7-c175-4d9f-ab5b-c5465d74f23d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:20.810065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d8e7-c175-4d9f-ab5b-c5465d74f23d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:20.810594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d8e7-c175-4d9f-ab5b-c5465d74f23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:20.837063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-bed0d8e7-c175-4d9f-ab5b-c5465d74f23d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:20.838235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bed0d8e7-c175-4d9f-ab5b-c5465d74f23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:20.854913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3111188-9382-45c7-88a8-33db63ccfb02 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:20.861912 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3176/6417] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:20.869103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3111188-9382-45c7-88a8-33db63ccfb02 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:20.891689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcdbd9-837c-4fa1-bc3a-978b3dc5dfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:20.893453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcdbd9-837c-4fa1-bc3a-978b3dc5dfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:20.893931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcdbd9-837c-4fa1-bc3a-978b3dc5dfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:20.894854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcdbd9-837c-4fa1-bc3a-978b3dc5dfb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:20.895786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fcdbd9-837c-4fa1-bc3a-978b3dc5dfb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:07:20.896251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fcdbd9-837c-4fa1-bc3a-978b3dc5dfb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:20.899998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fcdbd9-837c-4fa1-bc3a-978b3dc5dfb5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:20.929731 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3242/6418] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:07:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:07:20.934824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0d8e7-c175-4d9f-ab5b-c5465d74f23d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:20.956858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0d8e7-c175-4d9f-ab5b-c5465d74f23d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:20.979181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a2b8f-f6de-4c37-80e8-80f9c84b91e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:20.980560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a2b8f-f6de-4c37-80e8-80f9c84b91e3 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:20.981180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a2b8f-f6de-4c37-80e8-80f9c84b91e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:20.981990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a2b8f-f6de-4c37-80e8-80f9c84b91e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:20.983016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a2b8f-f6de-4c37-80e8-80f9c84b91e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:20.989481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a2b8f-f6de-4c37-80e8-80f9c84b91e3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:21.056799 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3177/6419] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:20 2021] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:21.061271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcdbd9-837c-4fa1-bc3a-978b3dc5dfb5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:21.073999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcdbd9-837c-4fa1-bc3a-978b3dc5dfb5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:21.251718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6740c0e-3dbf-4183-9806-841d66fd6e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:21.253074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6740c0e-3dbf-4183-9806-841d66fd6e53 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:21.253347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6740c0e-3dbf-4183-9806-841d66fd6e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:21.253622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6740c0e-3dbf-4183-9806-841d66fd6e53 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:21.254371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6740c0e-3dbf-4183-9806-841d66fd6e53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:21.257933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6740c0e-3dbf-4183-9806-841d66fd6e53 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:21.309307 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3243/6420] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:21 2021] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:21.313992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a2b8f-f6de-4c37-80e8-80f9c84b91e3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:21.329194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a2b8f-f6de-4c37-80e8-80f9c84b91e3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:21.334869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaef16b-087d-4aa6-a3be-ecaf56a1c904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:21.335756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaef16b-087d-4aa6-a3be-ecaf56a1c904 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:21.336203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaef16b-087d-4aa6-a3be-ecaf56a1c904 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:21.336796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaef16b-087d-4aa6-a3be-ecaf56a1c904 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:21.337853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaef16b-087d-4aa6-a3be-ecaf56a1c904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:21.339897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaef16b-087d-4aa6-a3be-ecaf56a1c904 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:21.358475 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3178/6421] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:21 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:21.359288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6740c0e-3dbf-4183-9806-841d66fd6e53 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:21.371980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6740c0e-3dbf-4183-9806-841d66fd6e53 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:21.377590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361689c-42c1-431a-b877-803c5f27b5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:21.378297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361689c-42c1-431a-b877-803c5f27b5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:21.378622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361689c-42c1-431a-b877-803c5f27b5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:21.378976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361689c-42c1-431a-b877-803c5f27b5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:21.379722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361689c-42c1-431a-b877-803c5f27b5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:21.382934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361689c-42c1-431a-b877-803c5f27b5d0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:21.397782 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3244/6422] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:21 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:07:21.404246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaef16b-087d-4aa6-a3be-ecaf56a1c904 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:21.418132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaef16b-087d-4aa6-a3be-ecaf56a1c904 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:21.425516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa93827-0b79-4cc6-ad4a-da572c0ae134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:21.426990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa93827-0b79-4cc6-ad4a-da572c0ae134 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:21.427283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa93827-0b79-4cc6-ad4a-da572c0ae134 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:21.427576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa93827-0b79-4cc6-ad4a-da572c0ae134 admin admin] PATH_INFO: `/v3/projects/e339ef82bc39461dabd675419b8e591c/users/a8e583ad9fc14e4d81ebbf714f89f56b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:21.493933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa93827-0b79-4cc6-ad4a-da572c0ae134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e339ef82bc39461dabd675419b8e591c, user_id=a8e583ad9fc14e4d81ebbf714f89f56b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:21.497750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa93827-0b79-4cc6-ad4a-da572c0ae134 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:21.531740 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3179/6423] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:21 2021] PUT /identity/v3/projects/e339ef82bc39461dabd675419b8e591c/users/a8e583ad9fc14e4d81ebbf714f89f56b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:21.543400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9135a5-cfbf-4e28-900e-b0c5c1c8fa97 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:21.544372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9135a5-cfbf-4e28-900e-b0c5c1c8fa97 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:21.544741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9135a5-cfbf-4e28-900e-b0c5c1c8fa97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:21.604895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5e9135a5-cfbf-4e28-900e-b0c5c1c8fa97 None None] MFA Rules not processed for user `a8e583ad9fc14e4d81ebbf714f89f56b`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:21.611665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5e9135a5-cfbf-4e28-900e-b0c5c1c8fa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:21.753533 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3245/6424] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:21 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:07:21.758519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa93827-0b79-4cc6-ad4a-da572c0ae134 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:21.849962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa93827-0b79-4cc6-ad4a-da572c0ae134 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:21.856460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d788ad-deba-4f5e-b4d0-65f0b60f4da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:21.857464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d788ad-deba-4f5e-b4d0-65f0b60f4da8 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:21.859426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d788ad-deba-4f5e-b4d0-65f0b60f4da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:21.859958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d788ad-deba-4f5e-b4d0-65f0b60f4da8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:21.861009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d788ad-deba-4f5e-b4d0-65f0b60f4da8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:21.863224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d788ad-deba-4f5e-b4d0-65f0b60f4da8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:21.902406 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3180/6425] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:21 2021] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:21.906644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9135a5-cfbf-4e28-900e-b0c5c1c8fa97 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:21.922915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9135a5-cfbf-4e28-900e-b0c5c1c8fa97 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:22.069230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b39dea-30ed-484b-b0f5-a4d05707e2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:22.069940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b39dea-30ed-484b-b0f5-a4d05707e2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:22.070229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b39dea-30ed-484b-b0f5-a4d05707e2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:22.070555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b39dea-30ed-484b-b0f5-a4d05707e2a2 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:22.072290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b39dea-30ed-484b-b0f5-a4d05707e2a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:22.075805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b39dea-30ed-484b-b0f5-a4d05707e2a2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:22.124489 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3246/6426] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:21 2021] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:22.127719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d788ad-deba-4f5e-b4d0-65f0b60f4da8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:22.141113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d788ad-deba-4f5e-b4d0-65f0b60f4da8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:22.154441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20506720-a15c-40b7-bb53-fc1afecf7d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:22.155990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20506720-a15c-40b7-bb53-fc1afecf7d98 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:22.156213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20506720-a15c-40b7-bb53-fc1afecf7d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:22.156740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20506720-a15c-40b7-bb53-fc1afecf7d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:22.157714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20506720-a15c-40b7-bb53-fc1afecf7d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:22.159626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20506720-a15c-40b7-bb53-fc1afecf7d98 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:22.184438 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3181/6427] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:22 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:22.188524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b39dea-30ed-484b-b0f5-a4d05707e2a2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:22.205429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b39dea-30ed-484b-b0f5-a4d05707e2a2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:22.214876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bd982-581d-4e06-b2d6-e3bf14241b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:22.215791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bd982-581d-4e06-b2d6-e3bf14241b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:22.216078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bd982-581d-4e06-b2d6-e3bf14241b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:22.216360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bd982-581d-4e06-b2d6-e3bf14241b2d admin admin] PATH_INFO: `/v3/projects/e9441fe30504435180b744da14d9da33/users/1a1270bfab5448e297212c7edce096ef/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:22.252291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bd982-581d-4e06-b2d6-e3bf14241b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9441fe30504435180b744da14d9da33, user_id=1a1270bfab5448e297212c7edce096ef, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:22.255063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bd982-581d-4e06-b2d6-e3bf14241b2d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:22.286413 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3247/6428] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:22 2021] PUT /identity/v3/projects/e9441fe30504435180b744da14d9da33/users/1a1270bfab5448e297212c7edce096ef/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:22.290017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20506720-a15c-40b7-bb53-fc1afecf7d98 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:22.306668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20506720-a15c-40b7-bb53-fc1afecf7d98 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:22.390909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62b44d-b67b-4470-a545-448659d061be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:22.392435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62b44d-b67b-4470-a545-448659d061be admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:22.392938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62b44d-b67b-4470-a545-448659d061be admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:22.393430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62b44d-b67b-4470-a545-448659d061be admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:22.394401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62b44d-b67b-4470-a545-448659d061be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:22.396214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62b44d-b67b-4470-a545-448659d061be admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:22.418735 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3182/6429] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:22 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:22.423808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bd982-581d-4e06-b2d6-e3bf14241b2d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:22.438111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bd982-581d-4e06-b2d6-e3bf14241b2d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:22.467015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15c57b-06c4-484b-a6ac-1a29d77c3600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:22.468866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15c57b-06c4-484b-a6ac-1a29d77c3600 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:22.469374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15c57b-06c4-484b-a6ac-1a29d77c3600 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:22.470080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15c57b-06c4-484b-a6ac-1a29d77c3600 admin admin] PATH_INFO: `/v3/projects/e9441fe30504435180b744da14d9da33/users/1a1270bfab5448e297212c7edce096ef/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:22.494676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15c57b-06c4-484b-a6ac-1a29d77c3600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9441fe30504435180b744da14d9da33, user_id=1a1270bfab5448e297212c7edce096ef, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:22.500598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15c57b-06c4-484b-a6ac-1a29d77c3600 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:22.522554 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3248/6430] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:22 2021] PUT /identity/v3/projects/e9441fe30504435180b744da14d9da33/users/1a1270bfab5448e297212c7edce096ef/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:22.533433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d1c8f-3908-41b7-99d5-1dd237122165 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:22.533900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d1c8f-3908-41b7-99d5-1dd237122165 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:22.534443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d1c8f-3908-41b7-99d5-1dd237122165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:22.574528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fe3d1c8f-3908-41b7-99d5-1dd237122165 None None] MFA Rules not processed for user `1a1270bfab5448e297212c7edce096ef`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:22.576519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fe3d1c8f-3908-41b7-99d5-1dd237122165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:22.704827 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3183/6431] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:22 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:22.726025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15c57b-06c4-484b-a6ac-1a29d77c3600 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:22.728217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fd15c57b-06c4-484b-a6ac-1a29d77c3600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:22.892291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15c57b-06c4-484b-a6ac-1a29d77c3600 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:22.902353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c80c7f-2070-4de5-9da5-0421908d8bf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:22.903197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c80c7f-2070-4de5-9da5-0421908d8bf8 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:22.903578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c80c7f-2070-4de5-9da5-0421908d8bf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:22.903953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c80c7f-2070-4de5-9da5-0421908d8bf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:22.992100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c80c7f-2070-4de5-9da5-0421908d8bf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:22.996345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c80c7f-2070-4de5-9da5-0421908d8bf8 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:23.007957 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3249/6432] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:22 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:23.652015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fa81b-bccd-4a9c-b006-3b221bac0134 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:23.652934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fa81b-bccd-4a9c-b006-3b221bac0134 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:23.653541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fa81b-bccd-4a9c-b006-3b221bac0134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:23.674468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b71fa81b-bccd-4a9c-b006-3b221bac0134 None None] MFA Rules not processed for user `d6278aefb6d5497aad3d74b47b2e95d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:23.676037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b71fa81b-bccd-4a9c-b006-3b221bac0134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:23.882476 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3184/6433] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:23 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:27.880645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c80c7f-2070-4de5-9da5-0421908d8bf8 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:27.882171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f6c80c7f-2070-4de5-9da5-0421908d8bf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:28.025027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c80c7f-2070-4de5-9da5-0421908d8bf8 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:28.037719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cd674-8aa8-4741-a2ab-c558b95475a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:28.038643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cd674-8aa8-4741-a2ab-c558b95475a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:28.038929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cd674-8aa8-4741-a2ab-c558b95475a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:28.039204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cd674-8aa8-4741-a2ab-c558b95475a8 admin admin] PATH_INFO: `/v3/users/8323a0a31029427cb4a63eeadfe2a777` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:28.040491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cd674-8aa8-4741-a2ab-c558b95475a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8323a0a31029427cb4a63eeadfe2a777)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:28.042494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cd674-8aa8-4741-a2ab-c558b95475a8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:28.144063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d25cd674-8aa8-4741-a2ab-c558b95475a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8323a0a31029427cb4a63eeadfe2a777'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:28.157323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d25cd674-8aa8-4741-a2ab-c558b95475a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8323a0a31029427cb4a63eeadfe2a777'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:28.170961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d25cd674-8aa8-4741-a2ab-c558b95475a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8323a0a31029427cb4a63eeadfe2a777'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:28.188474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d25cd674-8aa8-4741-a2ab-c558b95475a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8323a0a31029427cb4a63eeadfe2a777'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:28.214154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d25cd674-8aa8-4741-a2ab-c558b95475a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8323a0a31029427cb4a63eeadfe2a777'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:28.225452 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3250/6434] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:27 2021] DELETE /identity/v3/users/8323a0a31029427cb4a63eeadfe2a777 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:28.229980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a44b1-6749-429c-a849-272b44f98c8c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:28.230503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a44b1-6749-429c-a849-272b44f98c8c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:28.230781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a44b1-6749-429c-a849-272b44f98c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:28.233310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cd674-8aa8-4741-a2ab-c558b95475a8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:28.234919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d25cd674-8aa8-4741-a2ab-c558b95475a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:28.249848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-914a44b1-6749-429c-a849-272b44f98c8c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:28.251435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-914a44b1-6749-429c-a849-272b44f98c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:28.315944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cd674-8aa8-4741-a2ab-c558b95475a8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:28.323637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed931fbd-5ce6-49a4-8499-133f85ae8a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:28.324490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed931fbd-5ce6-49a4-8499-133f85ae8a48 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:28.324875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed931fbd-5ce6-49a4-8499-133f85ae8a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:28.325276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed931fbd-5ce6-49a4-8499-133f85ae8a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:28.327861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ed931fbd-5ce6-49a4-8499-133f85ae8a48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:28.329604 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3185/6435] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:28.339296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a44b1-6749-429c-a849-272b44f98c8c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:28.342515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-914a44b1-6749-429c-a849-272b44f98c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:28.435041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed931fbd-5ce6-49a4-8499-133f85ae8a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:28.436052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed931fbd-5ce6-49a4-8499-133f85ae8a48 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:28.448187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a44b1-6749-429c-a849-272b44f98c8c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:28.449636 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3251/6436] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:28 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:28.455151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d3cdb-9ab9-491b-b624-78864c6e94c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:28.455815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d3cdb-9ab9-491b-b624-78864c6e94c1 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:28.456135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d3cdb-9ab9-491b-b624-78864c6e94c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:28.456479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d3cdb-9ab9-491b-b624-78864c6e94c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:28.468499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d3cdb-9ab9-491b-b624-78864c6e94c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:28.469937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d3cdb-9ab9-491b-b624-78864c6e94c1 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:28.481037 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3186/6437] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:28.628272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed931fbd-5ce6-49a4-8499-133f85ae8a48 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:28.641650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed931fbd-5ce6-49a4-8499-133f85ae8a48 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:28.647830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33cea4-c6f4-4c04-9d41-4757487dfe6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:28.648714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33cea4-c6f4-4c04-9d41-4757487dfe6c service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:28.649009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33cea4-c6f4-4c04-9d41-4757487dfe6c service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:28.649386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33cea4-c6f4-4c04-9d41-4757487dfe6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:28.651236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bc33cea4-c6f4-4c04-9d41-4757487dfe6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:28.664851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33cea4-c6f4-4c04-9d41-4757487dfe6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:28.666518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33cea4-c6f4-4c04-9d41-4757487dfe6c service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:28.693749 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3252/6438] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:28 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:29.345392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d3cdb-9ab9-491b-b624-78864c6e94c1 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:29.347410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-509d3cdb-9ab9-491b-b624-78864c6e94c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:29.363780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d3cdb-9ab9-491b-b624-78864c6e94c1 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:29.370044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71d311-9426-47e8-a45f-bacfb05e5817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:29.371416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71d311-9426-47e8-a45f-bacfb05e5817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:29.372467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71d311-9426-47e8-a45f-bacfb05e5817 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:29.373008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71d311-9426-47e8-a45f-bacfb05e5817 admin admin] PATH_INFO: `/v3/projects/4e20596c0aee4a2b9017d526f9148e8b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:29.375869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71d311-9426-47e8-a45f-bacfb05e5817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e20596c0aee4a2b9017d526f9148e8b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:29.379483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71d311-9426-47e8-a45f-bacfb05e5817 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:29.441620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6a71d311-9426-47e8-a45f-bacfb05e5817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e20596c0aee4a2b9017d526f9148e8b', 'request_id': 'req-6a71d311-9426-47e8-a45f-bacfb05e5817'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:29.451314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6a71d311-9426-47e8-a45f-bacfb05e5817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e20596c0aee4a2b9017d526f9148e8b', 'request_id': 'req-6a71d311-9426-47e8-a45f-bacfb05e5817'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:29.459295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6a71d311-9426-47e8-a45f-bacfb05e5817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e20596c0aee4a2b9017d526f9148e8b', 'request_id': 'req-6a71d311-9426-47e8-a45f-bacfb05e5817'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:29.480212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6a71d311-9426-47e8-a45f-bacfb05e5817 admin admin] The token cache is being invalidate because project 4e20596c0aee4a2b9017d526f9148e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:29.480564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6a71d311-9426-47e8-a45f-bacfb05e5817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:29.481228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6a71d311-9426-47e8-a45f-bacfb05e5817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:29.492514 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3187/6439] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:29 2021] DELETE /identity/v3/projects/4e20596c0aee4a2b9017d526f9148e8b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:29.493900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992af5e-f1a7-44e1-b29a-83608e125943 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:29.494385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992af5e-f1a7-44e1-b29a-83608e125943 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:29.494473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992af5e-f1a7-44e1-b29a-83608e125943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:29.515808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8992af5e-f1a7-44e1-b29a-83608e125943 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:29.527706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8992af5e-f1a7-44e1-b29a-83608e125943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:29.615734 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3253/6440] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:29.617195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310057fe-51a9-4e17-b9ee-cf8305901406 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:29.617500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310057fe-51a9-4e17-b9ee-cf8305901406 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:29.617791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310057fe-51a9-4e17-b9ee-cf8305901406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:29.638380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-310057fe-51a9-4e17-b9ee-cf8305901406 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:29.639902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-310057fe-51a9-4e17-b9ee-cf8305901406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:29.649143 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3188/6441] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:29.653273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992af5e-f1a7-44e1-b29a-83608e125943 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:29.666191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992af5e-f1a7-44e1-b29a-83608e125943 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:29.672694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfae98e-419e-40ed-b29e-0434af8f469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:29.673678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfae98e-419e-40ed-b29e-0434af8f469a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:29.674298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfae98e-419e-40ed-b29e-0434af8f469a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:29.674845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfae98e-419e-40ed-b29e-0434af8f469a admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:29.675749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfae98e-419e-40ed-b29e-0434af8f469a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:07:29.676383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfae98e-419e-40ed-b29e-0434af8f469a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:29.678438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfae98e-419e-40ed-b29e-0434af8f469a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:29.695770 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3254/6442] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:07:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:07:29.697395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310057fe-51a9-4e17-b9ee-cf8305901406 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:29.707456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310057fe-51a9-4e17-b9ee-cf8305901406 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:29.720677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65b0e3-58b0-4b68-986c-cf33c1bfed22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:29.721592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65b0e3-58b0-4b68-986c-cf33c1bfed22 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:29.722118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65b0e3-58b0-4b68-986c-cf33c1bfed22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:29.722600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65b0e3-58b0-4b68-986c-cf33c1bfed22 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:29.723483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65b0e3-58b0-4b68-986c-cf33c1bfed22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:29.725607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65b0e3-58b0-4b68-986c-cf33c1bfed22 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:29.766635 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3189/6443] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:29 2021] POST /identity/v3/projects => generated 387 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:07:29.770673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfae98e-419e-40ed-b29e-0434af8f469a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:29.784946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfae98e-419e-40ed-b29e-0434af8f469a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:29.860992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e0c5a-5530-44d9-8b51-b967cdb802f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:29.862000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e0c5a-5530-44d9-8b51-b967cdb802f7 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:29.862795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e0c5a-5530-44d9-8b51-b967cdb802f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:29.863301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e0c5a-5530-44d9-8b51-b967cdb802f7 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:29.865405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e0c5a-5530-44d9-8b51-b967cdb802f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:29.868017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e0c5a-5530-44d9-8b51-b967cdb802f7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:29.911929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65b0e3-58b0-4b68-986c-cf33c1bfed22 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:29.918358 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3255/6444] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:29 2021] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:29.937122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65b0e3-58b0-4b68-986c-cf33c1bfed22 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:29.957788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ef7dc-06ca-4c77-83b3-263b1e804d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:29.959405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ef7dc-06ca-4c77-83b3-263b1e804d11 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:29.959816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ef7dc-06ca-4c77-83b3-263b1e804d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:29.961621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ef7dc-06ca-4c77-83b3-263b1e804d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:29.962596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ef7dc-06ca-4c77-83b3-263b1e804d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:29.965208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ef7dc-06ca-4c77-83b3-263b1e804d11 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:29.988195 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3190/6445] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:29 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:07:29.990869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e0c5a-5530-44d9-8b51-b967cdb802f7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:30.016528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e0c5a-5530-44d9-8b51-b967cdb802f7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:30.027509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecba73-49f8-47f8-888b-9377d556ae40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:30.028249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecba73-49f8-47f8-888b-9377d556ae40 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:30.028539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecba73-49f8-47f8-888b-9377d556ae40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:30.029137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecba73-49f8-47f8-888b-9377d556ae40 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:30.029936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecba73-49f8-47f8-888b-9377d556ae40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:30.032772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecba73-49f8-47f8-888b-9377d556ae40 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:30.048834 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3256/6446] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:29 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:07:30.050552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ef7dc-06ca-4c77-83b3-263b1e804d11 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:30.063445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ef7dc-06ca-4c77-83b3-263b1e804d11 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:30.101667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c349bb-0a5e-450f-a0c0-85cb893b786a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:30.102955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c349bb-0a5e-450f-a0c0-85cb893b786a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:30.103415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c349bb-0a5e-450f-a0c0-85cb893b786a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:30.103861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c349bb-0a5e-450f-a0c0-85cb893b786a admin admin] PATH_INFO: `/v3/projects/acea01b4f65f48c293ebed946c7a40f3/users/0d84c26a51ff42899ea8720f725b75a0/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:30.126011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c349bb-0a5e-450f-a0c0-85cb893b786a admin admin] RBAC: Authorizing `identity:create_grant(project_id=acea01b4f65f48c293ebed946c7a40f3, user_id=0d84c26a51ff42899ea8720f725b75a0, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:30.128703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c349bb-0a5e-450f-a0c0-85cb893b786a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:30.144887 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3191/6447] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:30 2021] PUT /identity/v3/projects/acea01b4f65f48c293ebed946c7a40f3/users/0d84c26a51ff42899ea8720f725b75a0/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:30.160101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c03f4-e9b7-4b38-9504-a960b782982f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:30.160395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c03f4-e9b7-4b38-9504-a960b782982f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:30.160682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c03f4-e9b7-4b38-9504-a960b782982f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:30.236879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e60c03f4-e9b7-4b38-9504-a960b782982f None None] MFA Rules not processed for user `0d84c26a51ff42899ea8720f725b75a0`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:30.238107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e60c03f4-e9b7-4b38-9504-a960b782982f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:30.470307 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3257/6448] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:30 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:30.473772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c349bb-0a5e-450f-a0c0-85cb893b786a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:30.701067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c349bb-0a5e-450f-a0c0-85cb893b786a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:30.730935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c95a0e-061f-4605-b178-c05ccaf7b16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:30.732795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c95a0e-061f-4605-b178-c05ccaf7b16e admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:30.734891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c95a0e-061f-4605-b178-c05ccaf7b16e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:30.735470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c95a0e-061f-4605-b178-c05ccaf7b16e admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:30.736971 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c95a0e-061f-4605-b178-c05ccaf7b16e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:30.740589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c95a0e-061f-4605-b178-c05ccaf7b16e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:30.791694 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3192/6449] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:30 2021] POST /identity/v3/projects => generated 387 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:30.796545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c03f4-e9b7-4b38-9504-a960b782982f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:30.815557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c03f4-e9b7-4b38-9504-a960b782982f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:30.915524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e890b8-714d-4847-894e-1ed5d03716be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:30.916569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e890b8-714d-4847-894e-1ed5d03716be admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:30.917235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e890b8-714d-4847-894e-1ed5d03716be admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:30.917988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e890b8-714d-4847-894e-1ed5d03716be admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:30.919007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e890b8-714d-4847-894e-1ed5d03716be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:30.923210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e890b8-714d-4847-894e-1ed5d03716be admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:30.955290 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3258/6450] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:30 2021] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:07:30.959124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c95a0e-061f-4605-b178-c05ccaf7b16e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:30.976518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c95a0e-061f-4605-b178-c05ccaf7b16e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:30.985733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38486ff-f5d9-4e19-a7f6-3a45409ffe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:30.987224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38486ff-f5d9-4e19-a7f6-3a45409ffe20 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:30.987692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38486ff-f5d9-4e19-a7f6-3a45409ffe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:30.988289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38486ff-f5d9-4e19-a7f6-3a45409ffe20 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:30.990598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38486ff-f5d9-4e19-a7f6-3a45409ffe20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:30.994214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38486ff-f5d9-4e19-a7f6-3a45409ffe20 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:31.022850 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3193/6451] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:30 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:31.027437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e890b8-714d-4847-894e-1ed5d03716be admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:31.048729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e890b8-714d-4847-894e-1ed5d03716be admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:31.056244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8327ee9-9aeb-48a1-9106-80df46b49054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:31.057168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8327ee9-9aeb-48a1-9106-80df46b49054 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:31.057836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8327ee9-9aeb-48a1-9106-80df46b49054 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:31.058126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8327ee9-9aeb-48a1-9106-80df46b49054 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:31.059231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8327ee9-9aeb-48a1-9106-80df46b49054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:31.062688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8327ee9-9aeb-48a1-9106-80df46b49054 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:31.081550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38486ff-f5d9-4e19-a7f6-3a45409ffe20 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:31.081723 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3259/6452] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:31 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:31.100136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38486ff-f5d9-4e19-a7f6-3a45409ffe20 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:31.120713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8fd4f-097e-4a73-ae67-38d2cea500b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:31.122024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8fd4f-097e-4a73-ae67-38d2cea500b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:31.122541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8fd4f-097e-4a73-ae67-38d2cea500b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:31.123393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8fd4f-097e-4a73-ae67-38d2cea500b5 admin admin] PATH_INFO: `/v3/projects/e41fd9da7e4246f4bd682f0be1b1a543/users/aa71e0d9a91c47c2bb55b0bbdce20c71/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:31.162672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8fd4f-097e-4a73-ae67-38d2cea500b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41fd9da7e4246f4bd682f0be1b1a543, user_id=aa71e0d9a91c47c2bb55b0bbdce20c71, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:31.167615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8fd4f-097e-4a73-ae67-38d2cea500b5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:31.199093 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3194/6453] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:31 2021] PUT /identity/v3/projects/e41fd9da7e4246f4bd682f0be1b1a543/users/aa71e0d9a91c47c2bb55b0bbdce20c71/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:31.210504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c747c4-b7d2-44b7-be11-fa7740c4e2e6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:31.211046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c747c4-b7d2-44b7-be11-fa7740c4e2e6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:31.211490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c747c4-b7d2-44b7-be11-fa7740c4e2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:31.247844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-01c747c4-b7d2-44b7-be11-fa7740c4e2e6 None None] MFA Rules not processed for user `aa71e0d9a91c47c2bb55b0bbdce20c71`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:31.254688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-01c747c4-b7d2-44b7-be11-fa7740c4e2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:31.335304 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3260/6454] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:31 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:31.339462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8fd4f-097e-4a73-ae67-38d2cea500b5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:31.552030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8fd4f-097e-4a73-ae67-38d2cea500b5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:31.558753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43422c-99ff-455f-a6df-6666de26a7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:31.559757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43422c-99ff-455f-a6df-6666de26a7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:31.560231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43422c-99ff-455f-a6df-6666de26a7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:31.560865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43422c-99ff-455f-a6df-6666de26a7e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:31.562265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43422c-99ff-455f-a6df-6666de26a7e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:31.565932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43422c-99ff-455f-a6df-6666de26a7e9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:31.617144 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3195/6455] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:31 2021] POST /identity/v3/projects => generated 385 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:31.621664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c747c4-b7d2-44b7-be11-fa7740c4e2e6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:31.642387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c747c4-b7d2-44b7-be11-fa7740c4e2e6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:31.741713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca19c17-dee8-402a-88f9-d19c8489cc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:31.742973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca19c17-dee8-402a-88f9-d19c8489cc31 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:31.743483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca19c17-dee8-402a-88f9-d19c8489cc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:31.744835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca19c17-dee8-402a-88f9-d19c8489cc31 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:31.747214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca19c17-dee8-402a-88f9-d19c8489cc31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:31.749978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca19c17-dee8-402a-88f9-d19c8489cc31 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:31.782342 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3261/6456] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:31 2021] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:31.783255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43422c-99ff-455f-a6df-6666de26a7e9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:31.798174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43422c-99ff-455f-a6df-6666de26a7e9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:31.803919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084cc1c-e97c-4a0d-a8cd-009022ad8680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:31.804756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084cc1c-e97c-4a0d-a8cd-009022ad8680 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:31.805012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084cc1c-e97c-4a0d-a8cd-009022ad8680 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:31.805413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084cc1c-e97c-4a0d-a8cd-009022ad8680 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:31.807384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084cc1c-e97c-4a0d-a8cd-009022ad8680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:31.809300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084cc1c-e97c-4a0d-a8cd-009022ad8680 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:31.825138 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3196/6457] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:31 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:31.831305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca19c17-dee8-402a-88f9-d19c8489cc31 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:31.851873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca19c17-dee8-402a-88f9-d19c8489cc31 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:31.857666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068cceb-cf5c-42ba-9ec9-6a2143c68b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:31.859196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068cceb-cf5c-42ba-9ec9-6a2143c68b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:31.859656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068cceb-cf5c-42ba-9ec9-6a2143c68b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:31.859976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068cceb-cf5c-42ba-9ec9-6a2143c68b8b admin admin] PATH_INFO: `/v3/projects/e7244bebc1484e25b915fe2f96863288/users/e61e150242dc4f32a76d17f0fcef9fb8/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:31.877823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068cceb-cf5c-42ba-9ec9-6a2143c68b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7244bebc1484e25b915fe2f96863288, user_id=e61e150242dc4f32a76d17f0fcef9fb8, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:31.880548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068cceb-cf5c-42ba-9ec9-6a2143c68b8b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:31.898590 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3262/6458] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:31 2021] PUT /identity/v3/projects/e7244bebc1484e25b915fe2f96863288/users/e61e150242dc4f32a76d17f0fcef9fb8/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:31.903835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084cc1c-e97c-4a0d-a8cd-009022ad8680 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:31.916168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084cc1c-e97c-4a0d-a8cd-009022ad8680 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:32.021126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4dc1d-0993-4b7a-9f89-37af722325ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:32.021821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4dc1d-0993-4b7a-9f89-37af722325ea admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:32.022107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4dc1d-0993-4b7a-9f89-37af722325ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:32.022422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4dc1d-0993-4b7a-9f89-37af722325ea admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:32.023279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4dc1d-0993-4b7a-9f89-37af722325ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:32.025160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4dc1d-0993-4b7a-9f89-37af722325ea admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:32.039370 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3197/6459] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:31 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:32.043721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068cceb-cf5c-42ba-9ec9-6a2143c68b8b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:32.060089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068cceb-cf5c-42ba-9ec9-6a2143c68b8b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:32.065974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30423fe9-9d88-406b-9017-bb7d3ed93b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:32.067722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30423fe9-9d88-406b-9017-bb7d3ed93b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:32.068197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30423fe9-9d88-406b-9017-bb7d3ed93b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:32.068474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30423fe9-9d88-406b-9017-bb7d3ed93b58 admin admin] PATH_INFO: `/v3/projects/e7244bebc1484e25b915fe2f96863288/users/e61e150242dc4f32a76d17f0fcef9fb8/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:32.070915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30423fe9-9d88-406b-9017-bb7d3ed93b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7244bebc1484e25b915fe2f96863288, user_id=e61e150242dc4f32a76d17f0fcef9fb8, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:32.073734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30423fe9-9d88-406b-9017-bb7d3ed93b58 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:32.089554 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3263/6460] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:32 2021] PUT /identity/v3/projects/e7244bebc1484e25b915fe2f96863288/users/e61e150242dc4f32a76d17f0fcef9fb8/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:32.100569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeebe1c-014e-4301-98a0-90ce9fc80465 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:32.100907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeebe1c-014e-4301-98a0-90ce9fc80465 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:32.101396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeebe1c-014e-4301-98a0-90ce9fc80465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:32.141460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ceeebe1c-014e-4301-98a0-90ce9fc80465 None None] MFA Rules not processed for user `e61e150242dc4f32a76d17f0fcef9fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:32.147491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ceeebe1c-014e-4301-98a0-90ce9fc80465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:32.250337 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3198/6461] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:32 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:32.258407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30423fe9-9d88-406b-9017-bb7d3ed93b58 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:32.264284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-30423fe9-9d88-406b-9017-bb7d3ed93b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:32.338570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30423fe9-9d88-406b-9017-bb7d3ed93b58 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:32.342661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275abfe-3b49-4f60-95e2-665a7b743f52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:32.343840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275abfe-3b49-4f60-95e2-665a7b743f52 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:32.344376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275abfe-3b49-4f60-95e2-665a7b743f52 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:32.344809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275abfe-3b49-4f60-95e2-665a7b743f52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:32.354795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275abfe-3b49-4f60-95e2-665a7b743f52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:32.356474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275abfe-3b49-4f60-95e2-665a7b743f52 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:32.367766 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3264/6462] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:32 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:33.024271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeebe1c-014e-4301-98a0-90ce9fc80465 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:33.027673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ceeebe1c-014e-4301-98a0-90ce9fc80465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:33.056168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeebe1c-014e-4301-98a0-90ce9fc80465 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:33.083729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c7e6b-97b2-4208-82f4-76b082537949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:33.085520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c7e6b-97b2-4208-82f4-76b082537949 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:33.086279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c7e6b-97b2-4208-82f4-76b082537949 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:33.086775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c7e6b-97b2-4208-82f4-76b082537949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:33.166375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c7e6b-97b2-4208-82f4-76b082537949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:33.168305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c7e6b-97b2-4208-82f4-76b082537949 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:33.182195 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3199/6463] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:33 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:33.820730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275abfe-3b49-4f60-95e2-665a7b743f52 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:33.822630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5275abfe-3b49-4f60-95e2-665a7b743f52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:33.910483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275abfe-3b49-4f60-95e2-665a7b743f52 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:33.916057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7265fb-ca8f-45af-b408-b0d813c33008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:33.918532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7265fb-ca8f-45af-b408-b0d813c33008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:33.919024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7265fb-ca8f-45af-b408-b0d813c33008 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:33.919501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7265fb-ca8f-45af-b408-b0d813c33008 admin admin] PATH_INFO: `/v3/users/a8e583ad9fc14e4d81ebbf714f89f56b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:33.921604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7265fb-ca8f-45af-b408-b0d813c33008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e583ad9fc14e4d81ebbf714f89f56b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:33.923828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7265fb-ca8f-45af-b408-b0d813c33008 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:34.002872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4c7265fb-ca8f-45af-b408-b0d813c33008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e583ad9fc14e4d81ebbf714f89f56b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:34.015575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4c7265fb-ca8f-45af-b408-b0d813c33008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e583ad9fc14e4d81ebbf714f89f56b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:34.016613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4c7265fb-ca8f-45af-b408-b0d813c33008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e583ad9fc14e4d81ebbf714f89f56b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:34.033879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4c7265fb-ca8f-45af-b408-b0d813c33008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e583ad9fc14e4d81ebbf714f89f56b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:34.048264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4c7265fb-ca8f-45af-b408-b0d813c33008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e583ad9fc14e4d81ebbf714f89f56b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:34.059464 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3265/6464] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:33 2021] DELETE /identity/v3/users/a8e583ad9fc14e4d81ebbf714f89f56b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:34.065213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24146da6-9401-46e1-aedd-545ddd2f6537 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:34.065760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24146da6-9401-46e1-aedd-545ddd2f6537 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:34.065845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24146da6-9401-46e1-aedd-545ddd2f6537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:34.102444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-24146da6-9401-46e1-aedd-545ddd2f6537 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:34.103692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-24146da6-9401-46e1-aedd-545ddd2f6537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:34.244607 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3200/6465] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:34.258373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7265fb-ca8f-45af-b408-b0d813c33008 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:34.260059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4c7265fb-ca8f-45af-b408-b0d813c33008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:34.378871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7265fb-ca8f-45af-b408-b0d813c33008 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:34.385203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27b466-b8ad-4c2a-bac9-1282a94067a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:34.396509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27b466-b8ad-4c2a-bac9-1282a94067a2 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:34.397499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27b466-b8ad-4c2a-bac9-1282a94067a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:34.398223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27b466-b8ad-4c2a-bac9-1282a94067a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:34.414279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27b466-b8ad-4c2a-bac9-1282a94067a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:34.416211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27b466-b8ad-4c2a-bac9-1282a94067a2 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:34.444576 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3266/6466] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:35.168526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24146da6-9401-46e1-aedd-545ddd2f6537 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:35.171219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-24146da6-9401-46e1-aedd-545ddd2f6537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:35.190526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24146da6-9401-46e1-aedd-545ddd2f6537 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:35.197193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22768c7-d6c4-4356-a2db-b8f779e04d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:35.198360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22768c7-d6c4-4356-a2db-b8f779e04d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:35.198813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22768c7-d6c4-4356-a2db-b8f779e04d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:35.199106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22768c7-d6c4-4356-a2db-b8f779e04d9e admin admin] PATH_INFO: `/v3/projects/e339ef82bc39461dabd675419b8e591c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:35.200368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22768c7-d6c4-4356-a2db-b8f779e04d9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e339ef82bc39461dabd675419b8e591c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:35.202495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22768c7-d6c4-4356-a2db-b8f779e04d9e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:35.307157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c22768c7-d6c4-4356-a2db-b8f779e04d9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e339ef82bc39461dabd675419b8e591c', 'request_id': 'req-c22768c7-d6c4-4356-a2db-b8f779e04d9e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:35.319054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c22768c7-d6c4-4356-a2db-b8f779e04d9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e339ef82bc39461dabd675419b8e591c', 'request_id': 'req-c22768c7-d6c4-4356-a2db-b8f779e04d9e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:35.330743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c22768c7-d6c4-4356-a2db-b8f779e04d9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e339ef82bc39461dabd675419b8e591c', 'request_id': 'req-c22768c7-d6c4-4356-a2db-b8f779e04d9e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:35.354204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c22768c7-d6c4-4356-a2db-b8f779e04d9e admin admin] The token cache is being invalidate because project e339ef82bc39461dabd675419b8e591c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:35.357436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c22768c7-d6c4-4356-a2db-b8f779e04d9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:35.359627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c22768c7-d6c4-4356-a2db-b8f779e04d9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:35.368048 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3201/6467] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:35 2021] DELETE /identity/v3/projects/e339ef82bc39461dabd675419b8e591c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:35.372530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27b466-b8ad-4c2a-bac9-1282a94067a2 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:35.385771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27b466-b8ad-4c2a-bac9-1282a94067a2 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:35.538070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfee98-6cde-4ced-b116-cd81dd40f457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:35.539535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfee98-6cde-4ced-b116-cd81dd40f457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:35.540136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfee98-6cde-4ced-b116-cd81dd40f457 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:35.540573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfee98-6cde-4ced-b116-cd81dd40f457 admin admin] PATH_INFO: `/v3/users/1a1270bfab5448e297212c7edce096ef` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:35.543021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfee98-6cde-4ced-b116-cd81dd40f457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a1270bfab5448e297212c7edce096ef)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:35.547434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfee98-6cde-4ced-b116-cd81dd40f457 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:35.650979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-52bfee98-6cde-4ced-b116-cd81dd40f457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a1270bfab5448e297212c7edce096ef'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:35.684519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-52bfee98-6cde-4ced-b116-cd81dd40f457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a1270bfab5448e297212c7edce096ef'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:35.689729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-52bfee98-6cde-4ced-b116-cd81dd40f457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a1270bfab5448e297212c7edce096ef'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:35.708757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-52bfee98-6cde-4ced-b116-cd81dd40f457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a1270bfab5448e297212c7edce096ef'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:35.736169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-52bfee98-6cde-4ced-b116-cd81dd40f457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a1270bfab5448e297212c7edce096ef'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:35.749281 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3267/6468] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:35 2021] DELETE /identity/v3/users/1a1270bfab5448e297212c7edce096ef => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:07:36.225978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22768c7-d6c4-4356-a2db-b8f779e04d9e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:36.228698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c22768c7-d6c4-4356-a2db-b8f779e04d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:36.255425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22768c7-d6c4-4356-a2db-b8f779e04d9e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:36.346931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24453af4-8cda-4eae-b6fc-494dcb8d7e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:36.348020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24453af4-8cda-4eae-b6fc-494dcb8d7e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:36.349335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24453af4-8cda-4eae-b6fc-494dcb8d7e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:36.349457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24453af4-8cda-4eae-b6fc-494dcb8d7e3c admin admin] PATH_INFO: `/v3/projects/e9441fe30504435180b744da14d9da33` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:36.369836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24453af4-8cda-4eae-b6fc-494dcb8d7e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9441fe30504435180b744da14d9da33)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:36.375171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24453af4-8cda-4eae-b6fc-494dcb8d7e3c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:36.465150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-24453af4-8cda-4eae-b6fc-494dcb8d7e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9441fe30504435180b744da14d9da33', 'request_id': 'req-24453af4-8cda-4eae-b6fc-494dcb8d7e3c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:36.474049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-24453af4-8cda-4eae-b6fc-494dcb8d7e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9441fe30504435180b744da14d9da33', 'request_id': 'req-24453af4-8cda-4eae-b6fc-494dcb8d7e3c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:36.483935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-24453af4-8cda-4eae-b6fc-494dcb8d7e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9441fe30504435180b744da14d9da33', 'request_id': 'req-24453af4-8cda-4eae-b6fc-494dcb8d7e3c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:36.507368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-24453af4-8cda-4eae-b6fc-494dcb8d7e3c admin admin] The token cache is being invalidate because project e9441fe30504435180b744da14d9da33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:36.507669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-24453af4-8cda-4eae-b6fc-494dcb8d7e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:36.511581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-24453af4-8cda-4eae-b6fc-494dcb8d7e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:36.513937 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3202/6469] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:36 2021] DELETE /identity/v3/projects/e9441fe30504435180b744da14d9da33 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:36.522650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5fcd4-0b04-4077-9ee3-c9d2bac0af85 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:36.523095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5fcd4-0b04-4077-9ee3-c9d2bac0af85 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:36.523201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5fcd4-0b04-4077-9ee3-c9d2bac0af85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:36.567324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f8b5fcd4-0b04-4077-9ee3-c9d2bac0af85 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:36.568647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f8b5fcd4-0b04-4077-9ee3-c9d2bac0af85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:36.659800 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3268/6470] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:36.668119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533d072-ab69-4ad2-a405-16a76470f5ba None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:36.668405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533d072-ab69-4ad2-a405-16a76470f5ba None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:36.668687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533d072-ab69-4ad2-a405-16a76470f5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:36.692351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3533d072-ab69-4ad2-a405-16a76470f5ba None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:36.700498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3533d072-ab69-4ad2-a405-16a76470f5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:36.711596 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3203/6471] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:07:36.715607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5fcd4-0b04-4077-9ee3-c9d2bac0af85 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:36.727278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5fcd4-0b04-4077-9ee3-c9d2bac0af85 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:36.751990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9fcd9-2249-4425-bc0a-1b373dbc537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:36.752693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9fcd9-2249-4425-bc0a-1b373dbc537d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:36.752978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9fcd9-2249-4425-bc0a-1b373dbc537d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:36.753260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9fcd9-2249-4425-bc0a-1b373dbc537d admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:36.754163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9fcd9-2249-4425-bc0a-1b373dbc537d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:07:36.754716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9fcd9-2249-4425-bc0a-1b373dbc537d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:36.759104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9fcd9-2249-4425-bc0a-1b373dbc537d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:36.784512 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3269/6472] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:07:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:07:36.789047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533d072-ab69-4ad2-a405-16a76470f5ba None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:36.799587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533d072-ab69-4ad2-a405-16a76470f5ba None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:36.807356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daa22e-994f-4765-9693-5cdc0484d450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:36.808024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daa22e-994f-4765-9693-5cdc0484d450 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:36.808303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daa22e-994f-4765-9693-5cdc0484d450 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:36.808587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daa22e-994f-4765-9693-5cdc0484d450 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:36.809304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20daa22e-994f-4765-9693-5cdc0484d450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:36.811813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20daa22e-994f-4765-9693-5cdc0484d450 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:36.854020 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3204/6473] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:36 2021] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:36.854921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9fcd9-2249-4425-bc0a-1b373dbc537d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:36.868050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9fcd9-2249-4425-bc0a-1b373dbc537d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:36.946826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd9fc2-d41e-479c-9fe7-a66fadeebd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:36.947812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9fc2-d41e-479c-9fe7-a66fadeebd13 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:36.948103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9fc2-d41e-479c-9fe7-a66fadeebd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:36.948383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9fc2-d41e-479c-9fe7-a66fadeebd13 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:36.949087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd9fc2-d41e-479c-9fe7-a66fadeebd13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:36.951413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd9fc2-d41e-479c-9fe7-a66fadeebd13 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:36.974853 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3270/6474] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:36 2021] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:36.979493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daa22e-994f-4765-9693-5cdc0484d450 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:37.005391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daa22e-994f-4765-9693-5cdc0484d450 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:37.023151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e84a0-1861-4b39-9e81-ab784ae63740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:37.024077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e84a0-1861-4b39-9e81-ab784ae63740 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:37.024537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e84a0-1861-4b39-9e81-ab784ae63740 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:37.024952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e84a0-1861-4b39-9e81-ab784ae63740 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:37.025885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e84a0-1861-4b39-9e81-ab784ae63740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:37.028642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e84a0-1861-4b39-9e81-ab784ae63740 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:37.043666 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3205/6475] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:36 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:07:37.048318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd9fc2-d41e-479c-9fe7-a66fadeebd13 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:37.059491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd9fc2-d41e-479c-9fe7-a66fadeebd13 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:37.066013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e103bc-7b34-4122-97ee-f7e741deca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:37.066732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e103bc-7b34-4122-97ee-f7e741deca14 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:37.067267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e103bc-7b34-4122-97ee-f7e741deca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:37.067726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e103bc-7b34-4122-97ee-f7e741deca14 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:37.068467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e103bc-7b34-4122-97ee-f7e741deca14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:37.070095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e103bc-7b34-4122-97ee-f7e741deca14 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:37.082684 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3271/6476] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:37 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:37.086591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e84a0-1861-4b39-9e81-ab784ae63740 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:37.098369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e84a0-1861-4b39-9e81-ab784ae63740 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:37.104515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9138b-61b2-4a0f-ac5c-0140e51c7c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:37.105602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9138b-61b2-4a0f-ac5c-0140e51c7c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:37.106059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9138b-61b2-4a0f-ac5c-0140e51c7c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:37.106584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9138b-61b2-4a0f-ac5c-0140e51c7c08 admin admin] PATH_INFO: `/v3/projects/08bcff41c7054632b8308278820559a3/users/5465787a1dcf4d4faa4cbb2308658670/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:37.133605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9138b-61b2-4a0f-ac5c-0140e51c7c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08bcff41c7054632b8308278820559a3, user_id=5465787a1dcf4d4faa4cbb2308658670, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:37.137052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9138b-61b2-4a0f-ac5c-0140e51c7c08 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:37.163840 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3206/6477] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:37 2021] PUT /identity/v3/projects/08bcff41c7054632b8308278820559a3/users/5465787a1dcf4d4faa4cbb2308658670/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:37.175897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa851a-4746-442f-b0da-0d8d5ea08e29 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:37.176514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa851a-4746-442f-b0da-0d8d5ea08e29 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:37.177708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa851a-4746-442f-b0da-0d8d5ea08e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:37.212728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-35fa851a-4746-442f-b0da-0d8d5ea08e29 None None] MFA Rules not processed for user `5465787a1dcf4d4faa4cbb2308658670`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:37.214267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-35fa851a-4746-442f-b0da-0d8d5ea08e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:37.294383 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3272/6478] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:37 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:07:37.299878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9138b-61b2-4a0f-ac5c-0140e51c7c08 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:37.370827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9138b-61b2-4a0f-ac5c-0140e51c7c08 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:37.378521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451cba0-dfb8-4679-b620-d9a7ab640767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:37.379201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451cba0-dfb8-4679-b620-d9a7ab640767 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:37.379694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451cba0-dfb8-4679-b620-d9a7ab640767 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:37.379979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451cba0-dfb8-4679-b620-d9a7ab640767 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:37.382718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451cba0-dfb8-4679-b620-d9a7ab640767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:37.384644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451cba0-dfb8-4679-b620-d9a7ab640767 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:37.411708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa851a-4746-442f-b0da-0d8d5ea08e29 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:37.413253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-35fa851a-4746-442f-b0da-0d8d5ea08e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:37.416968 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3207/6479] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:37 2021] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:37.417619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451cba0-dfb8-4679-b620-d9a7ab640767 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:37.433219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa851a-4746-442f-b0da-0d8d5ea08e29 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:37.526574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451cba0-dfb8-4679-b620-d9a7ab640767 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:37.533400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a9e70-f778-4f6b-9f7a-7b11dc9f764a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:37.534975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a9e70-f778-4f6b-9f7a-7b11dc9f764a admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:37.535393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a9e70-f778-4f6b-9f7a-7b11dc9f764a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:37.535685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a9e70-f778-4f6b-9f7a-7b11dc9f764a admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:37.536614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a9e70-f778-4f6b-9f7a-7b11dc9f764a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:37.539583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a9e70-f778-4f6b-9f7a-7b11dc9f764a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:37.557927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4963b-e290-4be8-b563-388b3e2a5b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:37.560145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4963b-e290-4be8-b563-388b3e2a5b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:37.561455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4963b-e290-4be8-b563-388b3e2a5b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:37.566558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4963b-e290-4be8-b563-388b3e2a5b7c admin admin] PATH_INFO: `/v3/users/a03dfb1dff39427d8c116732d536787a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:37.570602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4963b-e290-4be8-b563-388b3e2a5b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a03dfb1dff39427d8c116732d536787a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:37.574185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4963b-e290-4be8-b563-388b3e2a5b7c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:37.591942 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3208/6480] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:37 2021] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:07:37.595623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a9e70-f778-4f6b-9f7a-7b11dc9f764a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:37.619098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a9e70-f778-4f6b-9f7a-7b11dc9f764a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:37.635175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfbacd-958e-4561-9950-b05f0217ab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:37.635175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfbacd-958e-4561-9950-b05f0217ab86 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:37.635175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfbacd-958e-4561-9950-b05f0217ab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:37.635536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfbacd-958e-4561-9950-b05f0217ab86 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:37.636270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfbacd-958e-4561-9950-b05f0217ab86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:37.638203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfbacd-958e-4561-9950-b05f0217ab86 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:37.662555 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3209/6481] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:37 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:37.669200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfbacd-958e-4561-9950-b05f0217ab86 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:37.672916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-26c4963b-e290-4be8-b563-388b3e2a5b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a03dfb1dff39427d8c116732d536787a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:37.692566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-26c4963b-e290-4be8-b563-388b3e2a5b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a03dfb1dff39427d8c116732d536787a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:37.694426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-26c4963b-e290-4be8-b563-388b3e2a5b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a03dfb1dff39427d8c116732d536787a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:37.696272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfbacd-958e-4561-9950-b05f0217ab86 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:37.714934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc181183-fbfc-4ec0-8a5b-cd090d2f5cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:37.716629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181183-fbfc-4ec0-8a5b-cd090d2f5cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:37.718228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181183-fbfc-4ec0-8a5b-cd090d2f5cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:37.718563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181183-fbfc-4ec0-8a5b-cd090d2f5cb5 admin admin] PATH_INFO: `/v3/projects/4adbb3dfc5fe490597d25b85f5482baa/users/7f2c22e5831a492c9aa44548794904ba/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:37.728037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-26c4963b-e290-4be8-b563-388b3e2a5b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a03dfb1dff39427d8c116732d536787a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:37.746096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-26c4963b-e290-4be8-b563-388b3e2a5b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a03dfb1dff39427d8c116732d536787a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:37.751290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc181183-fbfc-4ec0-8a5b-cd090d2f5cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4adbb3dfc5fe490597d25b85f5482baa, user_id=7f2c22e5831a492c9aa44548794904ba, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:37.753136 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3273/6482] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:37 2021] DELETE /identity/v3/users/a03dfb1dff39427d8c116732d536787a => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:07:37.754066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4963b-e290-4be8-b563-388b3e2a5b7c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:37.755179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc181183-fbfc-4ec0-8a5b-cd090d2f5cb5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:37.755546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-26c4963b-e290-4be8-b563-388b3e2a5b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:37.790794 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3210/6483] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:37 2021] PUT /identity/v3/projects/4adbb3dfc5fe490597d25b85f5482baa/users/7f2c22e5831a492c9aa44548794904ba/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:37.792525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d6f82-e7ab-499a-beac-852fb0f22ac6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:37.793106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d6f82-e7ab-499a-beac-852fb0f22ac6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:37.793653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d6f82-e7ab-499a-beac-852fb0f22ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:37.816488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0b9d6f82-e7ab-499a-beac-852fb0f22ac6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:37.819339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0b9d6f82-e7ab-499a-beac-852fb0f22ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:37.891987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4963b-e290-4be8-b563-388b3e2a5b7c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:37.911284 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3211/6484] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:37.911967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d6f82-e7ab-499a-beac-852fb0f22ac6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:37.913392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0b9d6f82-e7ab-499a-beac-852fb0f22ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:37.939223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d6f82-e7ab-499a-beac-852fb0f22ac6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:37.945819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5787ee-0dab-4c5a-ae60-3378dac29b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:37.946588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5787ee-0dab-4c5a-ae60-3378dac29b97 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:37.947331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5787ee-0dab-4c5a-ae60-3378dac29b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:37.947618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5787ee-0dab-4c5a-ae60-3378dac29b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:37.948583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5787ee-0dab-4c5a-ae60-3378dac29b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:37.952655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5787ee-0dab-4c5a-ae60-3378dac29b97 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:37.958876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426052e-f59e-4afb-b764-4d9301dac419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:37.959701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426052e-f59e-4afb-b764-4d9301dac419 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:37.960808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426052e-f59e-4afb-b764-4d9301dac419 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:37.961161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426052e-f59e-4afb-b764-4d9301dac419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:37.963307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5426052e-f59e-4afb-b764-4d9301dac419 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:37.970112 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3212/6485] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:37 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:37.971543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5787ee-0dab-4c5a-ae60-3378dac29b97 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:37.974205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9a5787ee-0dab-4c5a-ae60-3378dac29b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:38.057892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426052e-f59e-4afb-b764-4d9301dac419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:38.062738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426052e-f59e-4afb-b764-4d9301dac419 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:38.076175 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3274/6486] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:37 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:38.078065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426052e-f59e-4afb-b764-4d9301dac419 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:38.096041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426052e-f59e-4afb-b764-4d9301dac419 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:38.098025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5787ee-0dab-4c5a-ae60-3378dac29b97 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:38.101999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbad857-9019-482a-93d5-d72b8ae82e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:38.104039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbad857-9019-482a-93d5-d72b8ae82e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:38.105291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbad857-9019-482a-93d5-d72b8ae82e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:38.105675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbad857-9019-482a-93d5-d72b8ae82e0b admin admin] PATH_INFO: `/v3/projects/4adbb3dfc5fe490597d25b85f5482baa/users/7f2c22e5831a492c9aa44548794904ba/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:38.108092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbad857-9019-482a-93d5-d72b8ae82e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4adbb3dfc5fe490597d25b85f5482baa, user_id=7f2c22e5831a492c9aa44548794904ba, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:38.113136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbad857-9019-482a-93d5-d72b8ae82e0b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:38.121016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ebb3f-eb50-4854-a97b-3fa037001770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:38.121714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ebb3f-eb50-4854-a97b-3fa037001770 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:38.122007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ebb3f-eb50-4854-a97b-3fa037001770 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:38.127129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ebb3f-eb50-4854-a97b-3fa037001770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:38.148584 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3275/6487] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:38 2021] PUT /identity/v3/projects/4adbb3dfc5fe490597d25b85f5482baa/users/7f2c22e5831a492c9aa44548794904ba/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:38.151142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f91f8-33ce-4351-b942-6837943d1059 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:38.151753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f91f8-33ce-4351-b942-6837943d1059 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:38.152580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f91f8-33ce-4351-b942-6837943d1059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:38.161265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ebb3f-eb50-4854-a97b-3fa037001770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:38.165409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ebb3f-eb50-4854-a97b-3fa037001770 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:38.190507 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3213/6488] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:38.214021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c83f91f8-33ce-4351-b942-6837943d1059 None None] MFA Rules not processed for user `7f2c22e5831a492c9aa44548794904ba`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:38.215557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c83f91f8-33ce-4351-b942-6837943d1059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:38.344952 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3276/6489] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:38 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:38.357230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ebb3f-eb50-4854-a97b-3fa037001770 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:38.360043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-168ebb3f-eb50-4854-a97b-3fa037001770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:38.387170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ebb3f-eb50-4854-a97b-3fa037001770 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:38.446878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c11780-e9b3-4fd7-85c4-7f0dc83308e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:38.447884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c11780-e9b3-4fd7-85c4-7f0dc83308e2 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:38.448291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c11780-e9b3-4fd7-85c4-7f0dc83308e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:38.449792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c11780-e9b3-4fd7-85c4-7f0dc83308e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:38.451809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-85c11780-e9b3-4fd7-85c4-7f0dc83308e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:38.518798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f91f8-33ce-4351-b942-6837943d1059 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:38.521041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c83f91f8-33ce-4351-b942-6837943d1059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:38.542167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c11780-e9b3-4fd7-85c4-7f0dc83308e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:38.544274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c11780-e9b3-4fd7-85c4-7f0dc83308e2 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:38.559356 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3214/6490] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:38 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:07:38.618299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f91f8-33ce-4351-b942-6837943d1059 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:38.623151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c90a1-6a1d-4b51-a22d-dc930fa856cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:38.624281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c90a1-6a1d-4b51-a22d-dc930fa856cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:38.624783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c90a1-6a1d-4b51-a22d-dc930fa856cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:38.625298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c90a1-6a1d-4b51-a22d-dc930fa856cd admin admin] PATH_INFO: `/v3/projects/601f039e95d94afdbbb097bf19996949` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:38.628231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c90a1-6a1d-4b51-a22d-dc930fa856cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=601f039e95d94afdbbb097bf19996949)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:38.631624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c90a1-6a1d-4b51-a22d-dc930fa856cd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:38.744624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f06c90a1-6a1d-4b51-a22d-dc930fa856cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '601f039e95d94afdbbb097bf19996949', 'request_id': 'req-f06c90a1-6a1d-4b51-a22d-dc930fa856cd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:38.760467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f06c90a1-6a1d-4b51-a22d-dc930fa856cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '601f039e95d94afdbbb097bf19996949', 'request_id': 'req-f06c90a1-6a1d-4b51-a22d-dc930fa856cd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:38.772949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f06c90a1-6a1d-4b51-a22d-dc930fa856cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '601f039e95d94afdbbb097bf19996949', 'request_id': 'req-f06c90a1-6a1d-4b51-a22d-dc930fa856cd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:38.793270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f06c90a1-6a1d-4b51-a22d-dc930fa856cd admin admin] The token cache is being invalidate because project 601f039e95d94afdbbb097bf19996949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:38.793481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f06c90a1-6a1d-4b51-a22d-dc930fa856cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:38.800582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f06c90a1-6a1d-4b51-a22d-dc930fa856cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:38.806412 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3277/6491] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:38 2021] DELETE /identity/v3/projects/601f039e95d94afdbbb097bf19996949 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:38.812606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed1356-e115-4a82-9dd2-650e13318039 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:38.812900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed1356-e115-4a82-9dd2-650e13318039 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:38.813184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed1356-e115-4a82-9dd2-650e13318039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:38.852904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-64ed1356-e115-4a82-9dd2-650e13318039 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:38.855005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-64ed1356-e115-4a82-9dd2-650e13318039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:38.981117 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3215/6492] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:38.989436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba96afb-5f3f-4989-8523-f97f87d07b2f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:38.989532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba96afb-5f3f-4989-8523-f97f87d07b2f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:38.989859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba96afb-5f3f-4989-8523-f97f87d07b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:39.020786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9ba96afb-5f3f-4989-8523-f97f87d07b2f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:39.022414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9ba96afb-5f3f-4989-8523-f97f87d07b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:39.039899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed1356-e115-4a82-9dd2-650e13318039 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:39.041038 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3278/6493] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:39.055716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed1356-e115-4a82-9dd2-650e13318039 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:39.062729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c3dd2-e0d0-4ef0-81f8-7e79e6e68b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:39.063784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c3dd2-e0d0-4ef0-81f8-7e79e6e68b7e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:39.064172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c3dd2-e0d0-4ef0-81f8-7e79e6e68b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:39.064580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c3dd2-e0d0-4ef0-81f8-7e79e6e68b7e admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:39.065460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c3dd2-e0d0-4ef0-81f8-7e79e6e68b7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:07:39.065869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c3dd2-e0d0-4ef0-81f8-7e79e6e68b7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:39.068460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c3dd2-e0d0-4ef0-81f8-7e79e6e68b7e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:39.093622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba96afb-5f3f-4989-8523-f97f87d07b2f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:39.102324 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3216/6494] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:07:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:07:39.108052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba96afb-5f3f-4989-8523-f97f87d07b2f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:39.112848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da583144-6d85-4e84-a984-32c62c354e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:39.113586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da583144-6d85-4e84-a984-32c62c354e33 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:39.113849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da583144-6d85-4e84-a984-32c62c354e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:39.114132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da583144-6d85-4e84-a984-32c62c354e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:39.118822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da583144-6d85-4e84-a984-32c62c354e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:39.120796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da583144-6d85-4e84-a984-32c62c354e33 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:39.157887 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3279/6495] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:39 2021] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:39.162094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c3dd2-e0d0-4ef0-81f8-7e79e6e68b7e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:39.173729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c3dd2-e0d0-4ef0-81f8-7e79e6e68b7e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:39.266789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f13ce-f77d-4d93-9445-36ee88613744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:39.267780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f13ce-f77d-4d93-9445-36ee88613744 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:39.268145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f13ce-f77d-4d93-9445-36ee88613744 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:39.268432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f13ce-f77d-4d93-9445-36ee88613744 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:39.269251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f13ce-f77d-4d93-9445-36ee88613744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:39.271626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f13ce-f77d-4d93-9445-36ee88613744 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:39.304724 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3217/6496] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:39 2021] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:39.309271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da583144-6d85-4e84-a984-32c62c354e33 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:39.329166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da583144-6d85-4e84-a984-32c62c354e33 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:39.335460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33e3f3-6fe4-4e13-a549-7b069ddfe2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:39.336173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33e3f3-6fe4-4e13-a549-7b069ddfe2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:39.336501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33e3f3-6fe4-4e13-a549-7b069ddfe2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:39.336790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33e3f3-6fe4-4e13-a549-7b069ddfe2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:39.337593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33e3f3-6fe4-4e13-a549-7b069ddfe2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:39.339388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33e3f3-6fe4-4e13-a549-7b069ddfe2f7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:39.362818 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3280/6497] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:39 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:07:39.366433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f13ce-f77d-4d93-9445-36ee88613744 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:39.396960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f13ce-f77d-4d93-9445-36ee88613744 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:39.403443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85938a7a-d1b7-477f-8fcb-4c1ab6acad78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:39.410053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85938a7a-d1b7-477f-8fcb-4c1ab6acad78 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:39.410176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85938a7a-d1b7-477f-8fcb-4c1ab6acad78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:39.414457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85938a7a-d1b7-477f-8fcb-4c1ab6acad78 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:39.415573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85938a7a-d1b7-477f-8fcb-4c1ab6acad78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:39.417053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85938a7a-d1b7-477f-8fcb-4c1ab6acad78 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:39.436859 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3218/6498] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:39 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:39.441597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33e3f3-6fe4-4e13-a549-7b069ddfe2f7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:39.456729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33e3f3-6fe4-4e13-a549-7b069ddfe2f7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:39.462695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724b92f-1dd9-4091-a78a-173022fb91b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:39.463947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724b92f-1dd9-4091-a78a-173022fb91b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:39.464504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724b92f-1dd9-4091-a78a-173022fb91b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:39.464983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724b92f-1dd9-4091-a78a-173022fb91b0 admin admin] PATH_INFO: `/v3/projects/87a46355eeaf4513b6ec952f4e4586f5/users/1edf58bf651a4a49882b72e21fac8518/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:39.484958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724b92f-1dd9-4091-a78a-173022fb91b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a46355eeaf4513b6ec952f4e4586f5, user_id=1edf58bf651a4a49882b72e21fac8518, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:39.490317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724b92f-1dd9-4091-a78a-173022fb91b0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:39.518296 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3281/6499] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:39 2021] PUT /identity/v3/projects/87a46355eeaf4513b6ec952f4e4586f5/users/1edf58bf651a4a49882b72e21fac8518/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:39.523693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251a469-aab8-40e9-9bf0-e67cccdbc633 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:39.524272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251a469-aab8-40e9-9bf0-e67cccdbc633 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:39.524634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251a469-aab8-40e9-9bf0-e67cccdbc633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:39.578535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b251a469-aab8-40e9-9bf0-e67cccdbc633 None None] MFA Rules not processed for user `1edf58bf651a4a49882b72e21fac8518`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:39.580706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b251a469-aab8-40e9-9bf0-e67cccdbc633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:39.684199 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3219/6500] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:39 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:39.698890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724b92f-1dd9-4091-a78a-173022fb91b0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:39.701186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a724b92f-1dd9-4091-a78a-173022fb91b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:39.793194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724b92f-1dd9-4091-a78a-173022fb91b0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:39.798614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229b9ea-3b5a-4370-b707-3aa88c2b37e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:39.799369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229b9ea-3b5a-4370-b707-3aa88c2b37e9 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:39.799759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229b9ea-3b5a-4370-b707-3aa88c2b37e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:39.800146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229b9ea-3b5a-4370-b707-3aa88c2b37e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:39.814155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229b9ea-3b5a-4370-b707-3aa88c2b37e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:39.816048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229b9ea-3b5a-4370-b707-3aa88c2b37e9 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:39.833685 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3282/6501] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:39 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:07:40.851283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251a469-aab8-40e9-9bf0-e67cccdbc633 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:40.853598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b251a469-aab8-40e9-9bf0-e67cccdbc633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:40.977117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251a469-aab8-40e9-9bf0-e67cccdbc633 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:40.982880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32383cca-9a24-4083-b9f5-96ddcd1ed86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:40.984751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32383cca-9a24-4083-b9f5-96ddcd1ed86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:40.985193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32383cca-9a24-4083-b9f5-96ddcd1ed86b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:40.985659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32383cca-9a24-4083-b9f5-96ddcd1ed86b admin admin] PATH_INFO: `/v3/users/0d84c26a51ff42899ea8720f725b75a0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:40.987915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32383cca-9a24-4083-b9f5-96ddcd1ed86b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d84c26a51ff42899ea8720f725b75a0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:40.991056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32383cca-9a24-4083-b9f5-96ddcd1ed86b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:41.085280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-32383cca-9a24-4083-b9f5-96ddcd1ed86b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d84c26a51ff42899ea8720f725b75a0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:41.102528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-32383cca-9a24-4083-b9f5-96ddcd1ed86b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d84c26a51ff42899ea8720f725b75a0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:41.147370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-32383cca-9a24-4083-b9f5-96ddcd1ed86b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d84c26a51ff42899ea8720f725b75a0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:41.148948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-32383cca-9a24-4083-b9f5-96ddcd1ed86b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d84c26a51ff42899ea8720f725b75a0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:41.168196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-32383cca-9a24-4083-b9f5-96ddcd1ed86b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d84c26a51ff42899ea8720f725b75a0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:41.184543 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3220/6502] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:40 2021] DELETE /identity/v3/users/0d84c26a51ff42899ea8720f725b75a0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:41.190148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400a00e-2d25-422d-941c-09d2dd02df3f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:41.190669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400a00e-2d25-422d-941c-09d2dd02df3f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:41.190767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400a00e-2d25-422d-941c-09d2dd02df3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:41.255279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f400a00e-2d25-422d-941c-09d2dd02df3f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:41.256510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f400a00e-2d25-422d-941c-09d2dd02df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:41.349007 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3283/6503] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:41.372942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32383cca-9a24-4083-b9f5-96ddcd1ed86b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:41.374945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-32383cca-9a24-4083-b9f5-96ddcd1ed86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:41.400254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400a00e-2d25-422d-941c-09d2dd02df3f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:41.401894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f400a00e-2d25-422d-941c-09d2dd02df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:41.417723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400a00e-2d25-422d-941c-09d2dd02df3f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:41.425413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2140c-f039-4e4d-b93e-d70ac58de330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:41.427660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2140c-f039-4e4d-b93e-d70ac58de330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:41.428181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2140c-f039-4e4d-b93e-d70ac58de330 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:41.428717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2140c-f039-4e4d-b93e-d70ac58de330 admin admin] PATH_INFO: `/v3/users/5465787a1dcf4d4faa4cbb2308658670` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:41.430400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2140c-f039-4e4d-b93e-d70ac58de330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5465787a1dcf4d4faa4cbb2308658670)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:41.434345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2140c-f039-4e4d-b93e-d70ac58de330 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:41.496828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32383cca-9a24-4083-b9f5-96ddcd1ed86b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:41.503203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8d38b-d56c-42bb-8732-f82e481f3bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:41.503975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8d38b-d56c-42bb-8732-f82e481f3bfb service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:41.504330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8d38b-d56c-42bb-8732-f82e481f3bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:41.504674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8d38b-d56c-42bb-8732-f82e481f3bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:41.517176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8d38b-d56c-42bb-8732-f82e481f3bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:41.518776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8d38b-d56c-42bb-8732-f82e481f3bfb service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:41.542509 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3221/6504] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:41.553543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-10a2140c-f039-4e4d-b93e-d70ac58de330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5465787a1dcf4d4faa4cbb2308658670'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:41.561865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-10a2140c-f039-4e4d-b93e-d70ac58de330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5465787a1dcf4d4faa4cbb2308658670'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:41.562641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-10a2140c-f039-4e4d-b93e-d70ac58de330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5465787a1dcf4d4faa4cbb2308658670'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:41.576481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-10a2140c-f039-4e4d-b93e-d70ac58de330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5465787a1dcf4d4faa4cbb2308658670'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:41.590861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-10a2140c-f039-4e4d-b93e-d70ac58de330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5465787a1dcf4d4faa4cbb2308658670'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:41.599728 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3284/6505] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:41 2021] DELETE /identity/v3/users/5465787a1dcf4d4faa4cbb2308658670 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:07:41.611279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765f8b-da1e-49da-bd8c-d4f905d8bbb1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:41.611781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765f8b-da1e-49da-bd8c-d4f905d8bbb1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:41.612078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765f8b-da1e-49da-bd8c-d4f905d8bbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:41.631760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-97765f8b-da1e-49da-bd8c-d4f905d8bbb1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:41.633070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-97765f8b-da1e-49da-bd8c-d4f905d8bbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:41.709754 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3222/6506] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:41.736144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2140c-f039-4e4d-b93e-d70ac58de330 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:41.737599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-10a2140c-f039-4e4d-b93e-d70ac58de330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:41.822622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2140c-f039-4e4d-b93e-d70ac58de330 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:41.827722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f77e9-0a6e-4a83-8d96-9bc9d550ee6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:41.829050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f77e9-0a6e-4a83-8d96-9bc9d550ee6c service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:41.829513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f77e9-0a6e-4a83-8d96-9bc9d550ee6c service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:41.830232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f77e9-0a6e-4a83-8d96-9bc9d550ee6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:41.843852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f77e9-0a6e-4a83-8d96-9bc9d550ee6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:41.846173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f77e9-0a6e-4a83-8d96-9bc9d550ee6c service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:41.861842 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3285/6507] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:42.234728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97765f8b-da1e-49da-bd8c-d4f905d8bbb1 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:42.236203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-97765f8b-da1e-49da-bd8c-d4f905d8bbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:42.251303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97765f8b-da1e-49da-bd8c-d4f905d8bbb1 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:42.257337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eea127-9d87-4132-8cc3-807a968387d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:42.258866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea127-9d87-4132-8cc3-807a968387d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:42.259302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea127-9d87-4132-8cc3-807a968387d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:42.259939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea127-9d87-4132-8cc3-807a968387d5 admin admin] PATH_INFO: `/v3/projects/acea01b4f65f48c293ebed946c7a40f3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:42.261747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eea127-9d87-4132-8cc3-807a968387d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acea01b4f65f48c293ebed946c7a40f3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:42.264014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eea127-9d87-4132-8cc3-807a968387d5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:42.294167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f77e9-0a6e-4a83-8d96-9bc9d550ee6c service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:42.296676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7c3f77e9-0a6e-4a83-8d96-9bc9d550ee6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:42.316694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f77e9-0a6e-4a83-8d96-9bc9d550ee6c service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:42.324029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b83b00-cdb8-4c92-93f9-104a6ca6aae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:42.325523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b83b00-cdb8-4c92-93f9-104a6ca6aae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:42.327155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b83b00-cdb8-4c92-93f9-104a6ca6aae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:42.329323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b83b00-cdb8-4c92-93f9-104a6ca6aae1 admin admin] PATH_INFO: `/v3/projects/08bcff41c7054632b8308278820559a3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:42.330903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b83b00-cdb8-4c92-93f9-104a6ca6aae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08bcff41c7054632b8308278820559a3)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:42.336987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b83b00-cdb8-4c92-93f9-104a6ca6aae1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:42.348586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b3eea127-9d87-4132-8cc3-807a968387d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acea01b4f65f48c293ebed946c7a40f3', 'request_id': 'req-b3eea127-9d87-4132-8cc3-807a968387d5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.356353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b3eea127-9d87-4132-8cc3-807a968387d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acea01b4f65f48c293ebed946c7a40f3', 'request_id': 'req-b3eea127-9d87-4132-8cc3-807a968387d5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.378979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b3eea127-9d87-4132-8cc3-807a968387d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acea01b4f65f48c293ebed946c7a40f3', 'request_id': 'req-b3eea127-9d87-4132-8cc3-807a968387d5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.423379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b3eea127-9d87-4132-8cc3-807a968387d5 admin admin] The token cache is being invalidate because project acea01b4f65f48c293ebed946c7a40f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:42.423680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b3eea127-9d87-4132-8cc3-807a968387d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.424481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b3eea127-9d87-4132-8cc3-807a968387d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.433695 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3223/6508] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:42 2021] DELETE /identity/v3/projects/acea01b4f65f48c293ebed946c7a40f3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:42.434677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eea127-9d87-4132-8cc3-807a968387d5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:42.437427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b3eea127-9d87-4132-8cc3-807a968387d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:42.446285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-54b83b00-cdb8-4c92-93f9-104a6ca6aae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08bcff41c7054632b8308278820559a3', 'request_id': 'req-54b83b00-cdb8-4c92-93f9-104a6ca6aae1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.462908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-54b83b00-cdb8-4c92-93f9-104a6ca6aae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08bcff41c7054632b8308278820559a3', 'request_id': 'req-54b83b00-cdb8-4c92-93f9-104a6ca6aae1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.490740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-54b83b00-cdb8-4c92-93f9-104a6ca6aae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08bcff41c7054632b8308278820559a3', 'request_id': 'req-54b83b00-cdb8-4c92-93f9-104a6ca6aae1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.505843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-54b83b00-cdb8-4c92-93f9-104a6ca6aae1 admin admin] The token cache is being invalidate because project 08bcff41c7054632b8308278820559a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:42.506149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-54b83b00-cdb8-4c92-93f9-104a6ca6aae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.506887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-54b83b00-cdb8-4c92-93f9-104a6ca6aae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.509121 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3286/6509] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:42 2021] DELETE /identity/v3/projects/08bcff41c7054632b8308278820559a3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:07:42.510824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e68ddc-ec70-497a-8cda-44000d7bc3f4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:42.511314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e68ddc-ec70-497a-8cda-44000d7bc3f4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:42.511754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e68ddc-ec70-497a-8cda-44000d7bc3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:42.531782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eea127-9d87-4132-8cc3-807a968387d5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:42.536188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d1e68ddc-ec70-497a-8cda-44000d7bc3f4 None None] MFA Rules not processed for user `0a98795bdb7447c5b2a4930173b3c56d`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:42.538082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d1e68ddc-ec70-497a-8cda-44000d7bc3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:42.605306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a21fd-041c-42ff-ab67-cc9fd8dfa5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:42.608944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a21fd-041c-42ff-ab67-cc9fd8dfa5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:42.608944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a21fd-041c-42ff-ab67-cc9fd8dfa5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:42.608944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a21fd-041c-42ff-ab67-cc9fd8dfa5c0 admin admin] PATH_INFO: `/v3/users/aa71e0d9a91c47c2bb55b0bbdce20c71` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:42.608944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a21fd-041c-42ff-ab67-cc9fd8dfa5c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa71e0d9a91c47c2bb55b0bbdce20c71)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:42.611036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a21fd-041c-42ff-ab67-cc9fd8dfa5c0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:42.621811 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3287/6510] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:42 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:42.622848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e68ddc-ec70-497a-8cda-44000d7bc3f4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:42.624352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d1e68ddc-ec70-497a-8cda-44000d7bc3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:42.640220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e68ddc-ec70-497a-8cda-44000d7bc3f4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:42.649309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80839ea-ce6d-40e3-8482-e29d22c096bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:42.650389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80839ea-ce6d-40e3-8482-e29d22c096bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:42.650840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80839ea-ce6d-40e3-8482-e29d22c096bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:42.651129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80839ea-ce6d-40e3-8482-e29d22c096bf admin admin] PATH_INFO: `/v3/users/7f2c22e5831a492c9aa44548794904ba` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:42.652452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80839ea-ce6d-40e3-8482-e29d22c096bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2c22e5831a492c9aa44548794904ba)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:42.655501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80839ea-ce6d-40e3-8482-e29d22c096bf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:42.744702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d29a21fd-041c-42ff-ab67-cc9fd8dfa5c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa71e0d9a91c47c2bb55b0bbdce20c71'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.754827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e80839ea-ce6d-40e3-8482-e29d22c096bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2c22e5831a492c9aa44548794904ba'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.766827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d29a21fd-041c-42ff-ab67-cc9fd8dfa5c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa71e0d9a91c47c2bb55b0bbdce20c71'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.773135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e80839ea-ce6d-40e3-8482-e29d22c096bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2c22e5831a492c9aa44548794904ba'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.774172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e80839ea-ce6d-40e3-8482-e29d22c096bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2c22e5831a492c9aa44548794904ba'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.804393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e80839ea-ce6d-40e3-8482-e29d22c096bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2c22e5831a492c9aa44548794904ba'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.806345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d29a21fd-041c-42ff-ab67-cc9fd8dfa5c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa71e0d9a91c47c2bb55b0bbdce20c71'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.807651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d29a21fd-041c-42ff-ab67-cc9fd8dfa5c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa71e0d9a91c47c2bb55b0bbdce20c71'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.824410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d29a21fd-041c-42ff-ab67-cc9fd8dfa5c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa71e0d9a91c47c2bb55b0bbdce20c71'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.834118 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3224/6511] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:42 2021] DELETE /identity/v3/users/aa71e0d9a91c47c2bb55b0bbdce20c71 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:42.834445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e80839ea-ce6d-40e3-8482-e29d22c096bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2c22e5831a492c9aa44548794904ba'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:42.851113 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3288/6512] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:42 2021] DELETE /identity/v3/users/7f2c22e5831a492c9aa44548794904ba => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:43.242174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a21fd-041c-42ff-ab67-cc9fd8dfa5c0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:43.244615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d29a21fd-041c-42ff-ab67-cc9fd8dfa5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:43.318315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a21fd-041c-42ff-ab67-cc9fd8dfa5c0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:43.379330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922220a-2b6d-4883-8de5-e27d12a8218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:43.379330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922220a-2b6d-4883-8de5-e27d12a8218c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:43.380801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922220a-2b6d-4883-8de5-e27d12a8218c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:43.381058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922220a-2b6d-4883-8de5-e27d12a8218c admin admin] PATH_INFO: `/v3/projects/e41fd9da7e4246f4bd682f0be1b1a543` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:43.382552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922220a-2b6d-4883-8de5-e27d12a8218c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e41fd9da7e4246f4bd682f0be1b1a543)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:43.384638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922220a-2b6d-4883-8de5-e27d12a8218c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:43.433450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a922220a-2b6d-4883-8de5-e27d12a8218c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e41fd9da7e4246f4bd682f0be1b1a543', 'request_id': 'req-a922220a-2b6d-4883-8de5-e27d12a8218c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:43.439508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a922220a-2b6d-4883-8de5-e27d12a8218c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e41fd9da7e4246f4bd682f0be1b1a543', 'request_id': 'req-a922220a-2b6d-4883-8de5-e27d12a8218c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:43.445133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a922220a-2b6d-4883-8de5-e27d12a8218c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e41fd9da7e4246f4bd682f0be1b1a543', 'request_id': 'req-a922220a-2b6d-4883-8de5-e27d12a8218c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:43.459101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a922220a-2b6d-4883-8de5-e27d12a8218c admin admin] The token cache is being invalidate because project e41fd9da7e4246f4bd682f0be1b1a543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:43.459399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a922220a-2b6d-4883-8de5-e27d12a8218c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:43.460121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a922220a-2b6d-4883-8de5-e27d12a8218c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:43.461782 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3225/6513] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:43 2021] DELETE /identity/v3/projects/e41fd9da7e4246f4bd682f0be1b1a543 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:43.465932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80839ea-ce6d-40e3-8482-e29d22c096bf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:43.467978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e80839ea-ce6d-40e3-8482-e29d22c096bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:43.486783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80839ea-ce6d-40e3-8482-e29d22c096bf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:43.552736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e12e3-60ec-47e5-9697-228e8b463b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:43.553621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e12e3-60ec-47e5-9697-228e8b463b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:43.553908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e12e3-60ec-47e5-9697-228e8b463b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:43.554187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e12e3-60ec-47e5-9697-228e8b463b9c admin admin] PATH_INFO: `/v3/users/e61e150242dc4f32a76d17f0fcef9fb8` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:43.555449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e12e3-60ec-47e5-9697-228e8b463b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e61e150242dc4f32a76d17f0fcef9fb8)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:43.557356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e12e3-60ec-47e5-9697-228e8b463b9c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:43.625217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-377e12e3-60ec-47e5-9697-228e8b463b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e61e150242dc4f32a76d17f0fcef9fb8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:43.634280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-377e12e3-60ec-47e5-9697-228e8b463b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e61e150242dc4f32a76d17f0fcef9fb8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:43.635091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-377e12e3-60ec-47e5-9697-228e8b463b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e61e150242dc4f32a76d17f0fcef9fb8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:43.649205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-377e12e3-60ec-47e5-9697-228e8b463b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e61e150242dc4f32a76d17f0fcef9fb8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:43.660701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-377e12e3-60ec-47e5-9697-228e8b463b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e61e150242dc4f32a76d17f0fcef9fb8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:43.668927 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3289/6514] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:43 2021] DELETE /identity/v3/users/e61e150242dc4f32a76d17f0fcef9fb8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:07:43.720158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922220a-2b6d-4883-8de5-e27d12a8218c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:43.724194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a922220a-2b6d-4883-8de5-e27d12a8218c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:43.744167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922220a-2b6d-4883-8de5-e27d12a8218c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:43.812495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75afb8a-370a-4f19-a54b-d3971b977b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:43.812999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75afb8a-370a-4f19-a54b-d3971b977b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:43.813290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75afb8a-370a-4f19-a54b-d3971b977b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:43.813567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75afb8a-370a-4f19-a54b-d3971b977b61 admin admin] PATH_INFO: `/v3/projects/4adbb3dfc5fe490597d25b85f5482baa` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:43.815772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75afb8a-370a-4f19-a54b-d3971b977b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4adbb3dfc5fe490597d25b85f5482baa)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:43.817953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75afb8a-370a-4f19-a54b-d3971b977b61 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:43.899453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e75afb8a-370a-4f19-a54b-d3971b977b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4adbb3dfc5fe490597d25b85f5482baa', 'request_id': 'req-e75afb8a-370a-4f19-a54b-d3971b977b61'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:43.909176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e75afb8a-370a-4f19-a54b-d3971b977b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4adbb3dfc5fe490597d25b85f5482baa', 'request_id': 'req-e75afb8a-370a-4f19-a54b-d3971b977b61'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:43.916532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e75afb8a-370a-4f19-a54b-d3971b977b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4adbb3dfc5fe490597d25b85f5482baa', 'request_id': 'req-e75afb8a-370a-4f19-a54b-d3971b977b61'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:43.935116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e75afb8a-370a-4f19-a54b-d3971b977b61 admin admin] The token cache is being invalidate because project 4adbb3dfc5fe490597d25b85f5482baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:43.935418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e75afb8a-370a-4f19-a54b-d3971b977b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:43.936809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e75afb8a-370a-4f19-a54b-d3971b977b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:43.943011 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3226/6515] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:43 2021] DELETE /identity/v3/projects/4adbb3dfc5fe490597d25b85f5482baa => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:43.944755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4e5d6-ead6-4ad9-a1b1-6e552ab558ba None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:43.945112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4e5d6-ead6-4ad9-a1b1-6e552ab558ba None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:43.945856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4e5d6-ead6-4ad9-a1b1-6e552ab558ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:43.982123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b2d4e5d6-ead6-4ad9-a1b1-6e552ab558ba None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:43.984077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b2d4e5d6-ead6-4ad9-a1b1-6e552ab558ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:44.082982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75afb8a-370a-4f19-a54b-d3971b977b61 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:44.086519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e75afb8a-370a-4f19-a54b-d3971b977b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:44.101051 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3290/6516] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:44.109225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9282d9-1a19-45b6-9279-2588c1d8c144 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:44.109515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9282d9-1a19-45b6-9279-2588c1d8c144 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:44.109797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9282d9-1a19-45b6-9279-2588c1d8c144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:44.133454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4c9282d9-1a19-45b6-9279-2588c1d8c144 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:44.134721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4c9282d9-1a19-45b6-9279-2588c1d8c144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:44.147308 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3291/6517] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:44.148211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9282d9-1a19-45b6-9279-2588c1d8c144 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:44.173036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9282d9-1a19-45b6-9279-2588c1d8c144 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:44.191219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a715ca2-19bd-498b-b263-ba3a0a166150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:44.192544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a715ca2-19bd-498b-b263-ba3a0a166150 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:44.193206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a715ca2-19bd-498b-b263-ba3a0a166150 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:44.194460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a715ca2-19bd-498b-b263-ba3a0a166150 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:44.197787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a715ca2-19bd-498b-b263-ba3a0a166150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:07:44.198111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a715ca2-19bd-498b-b263-ba3a0a166150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:44.200917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a715ca2-19bd-498b-b263-ba3a0a166150 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:44.233560 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3292/6518] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:07:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:07:44.234928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a715ca2-19bd-498b-b263-ba3a0a166150 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:44.237411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0a715ca2-19bd-498b-b263-ba3a0a166150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:44.259424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a715ca2-19bd-498b-b263-ba3a0a166150 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:44.261105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75afb8a-370a-4f19-a54b-d3971b977b61 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:44.266650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b860a0-09d1-41d7-a14b-8c1956538a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:44.268170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b860a0-09d1-41d7-a14b-8c1956538a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:44.268600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b860a0-09d1-41d7-a14b-8c1956538a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:44.268894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b860a0-09d1-41d7-a14b-8c1956538a02 admin admin] PATH_INFO: `/v3/projects/e7244bebc1484e25b915fe2f96863288` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:44.269674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61ff40-a5c8-4c7b-ade7-75b3ecb1ad8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:44.270680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b860a0-09d1-41d7-a14b-8c1956538a02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7244bebc1484e25b915fe2f96863288)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:44.271299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61ff40-a5c8-4c7b-ade7-75b3ecb1ad8c service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:44.271771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61ff40-a5c8-4c7b-ade7-75b3ecb1ad8c service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:44.272402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61ff40-a5c8-4c7b-ade7-75b3ecb1ad8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:44.272931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b860a0-09d1-41d7-a14b-8c1956538a02 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:44.279386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ef61ff40-a5c8-4c7b-ade7-75b3ecb1ad8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:44.298885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61ff40-a5c8-4c7b-ade7-75b3ecb1ad8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:44.300450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61ff40-a5c8-4c7b-ade7-75b3ecb1ad8c service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:44.324105 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3227/6519] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:44 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:07:44.325675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61ff40-a5c8-4c7b-ade7-75b3ecb1ad8c service placement] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:44.339097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61ff40-a5c8-4c7b-ade7-75b3ecb1ad8c service placement] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:44.339895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-60b860a0-09d1-41d7-a14b-8c1956538a02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7244bebc1484e25b915fe2f96863288', 'request_id': 'req-60b860a0-09d1-41d7-a14b-8c1956538a02'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:44.347329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-60b860a0-09d1-41d7-a14b-8c1956538a02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7244bebc1484e25b915fe2f96863288', 'request_id': 'req-60b860a0-09d1-41d7-a14b-8c1956538a02'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:44.357362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-60b860a0-09d1-41d7-a14b-8c1956538a02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7244bebc1484e25b915fe2f96863288', 'request_id': 'req-60b860a0-09d1-41d7-a14b-8c1956538a02'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:44.374826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-60b860a0-09d1-41d7-a14b-8c1956538a02 admin admin] The token cache is being invalidate because project e7244bebc1484e25b915fe2f96863288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:44.375124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-60b860a0-09d1-41d7-a14b-8c1956538a02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:44.380693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-60b860a0-09d1-41d7-a14b-8c1956538a02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:44.382899 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3293/6520] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:44 2021] DELETE /identity/v3/projects/e7244bebc1484e25b915fe2f96863288 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:44.388322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b860a0-09d1-41d7-a14b-8c1956538a02 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:44.388322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-60b860a0-09d1-41d7-a14b-8c1956538a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:44.463363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc439b-9a86-4fac-a46d-890b556a5d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:44.464193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc439b-9a86-4fac-a46d-890b556a5d7a admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:44.464753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc439b-9a86-4fac-a46d-890b556a5d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:44.465128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc439b-9a86-4fac-a46d-890b556a5d7a admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:44.466658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc439b-9a86-4fac-a46d-890b556a5d7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:44.468947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc439b-9a86-4fac-a46d-890b556a5d7a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:44.480761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b860a0-09d1-41d7-a14b-8c1956538a02 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:44.486263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd2b95-dff8-4793-8a8d-f6d34c1f65dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:44.487152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd2b95-dff8-4793-8a8d-f6d34c1f65dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:44.487451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd2b95-dff8-4793-8a8d-f6d34c1f65dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:44.487839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd2b95-dff8-4793-8a8d-f6d34c1f65dd admin admin] PATH_INFO: `/v3/users/a12f2c5b14fb4544ae7269c88f4eaad0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:44.489255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd2b95-dff8-4793-8a8d-f6d34c1f65dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12f2c5b14fb4544ae7269c88f4eaad0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:44.491139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd2b95-dff8-4793-8a8d-f6d34c1f65dd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:44.529018 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3228/6521] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:44 2021] POST /identity/v3/projects => generated 371 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:44.529018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8333a1b-7f27-4da9-8ad8-0137bdeaaf6c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:44.529018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8333a1b-7f27-4da9-8ad8-0137bdeaaf6c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:44.529018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8333a1b-7f27-4da9-8ad8-0137bdeaaf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:44.564465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8cd2b95-dff8-4793-8a8d-f6d34c1f65dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12f2c5b14fb4544ae7269c88f4eaad0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:44.567961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b8333a1b-7f27-4da9-8ad8-0137bdeaaf6c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:44.569504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b8333a1b-7f27-4da9-8ad8-0137bdeaaf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:44.577469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8cd2b95-dff8-4793-8a8d-f6d34c1f65dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12f2c5b14fb4544ae7269c88f4eaad0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:44.582523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8cd2b95-dff8-4793-8a8d-f6d34c1f65dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12f2c5b14fb4544ae7269c88f4eaad0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:44.616186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8cd2b95-dff8-4793-8a8d-f6d34c1f65dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12f2c5b14fb4544ae7269c88f4eaad0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:44.628009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d8cd2b95-dff8-4793-8a8d-f6d34c1f65dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12f2c5b14fb4544ae7269c88f4eaad0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:44.636180 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3294/6522] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:44 2021] DELETE /identity/v3/users/a12f2c5b14fb4544ae7269c88f4eaad0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:44.637225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd2b95-dff8-4793-8a8d-f6d34c1f65dd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:44.638683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d8cd2b95-dff8-4793-8a8d-f6d34c1f65dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:44.677136 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3229/6523] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:44.683717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d236c7-9d27-4b98-9b38-abaf193444c1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:44.684013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d236c7-9d27-4b98-9b38-abaf193444c1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:44.685276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d236c7-9d27-4b98-9b38-abaf193444c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:44.707777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-04d236c7-9d27-4b98-9b38-abaf193444c1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:44.709071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-04d236c7-9d27-4b98-9b38-abaf193444c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:44.746494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd2b95-dff8-4793-8a8d-f6d34c1f65dd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:44.751900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4f65e-3452-4a04-8551-4c50d44fc0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:44.753079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4f65e-3452-4a04-8551-4c50d44fc0cd admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:44.753364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4f65e-3452-4a04-8551-4c50d44fc0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:44.754009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4f65e-3452-4a04-8551-4c50d44fc0cd admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:44.754768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4f65e-3452-4a04-8551-4c50d44fc0cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:44.757831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4f65e-3452-4a04-8551-4c50d44fc0cd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:44.785478 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3230/6524] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:44.787117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3678481-caa3-44dc-af5b-6d105b073624 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:44.787412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3678481-caa3-44dc-af5b-6d105b073624 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:44.790477 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3295/6525] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:44 2021] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:44.790715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3678481-caa3-44dc-af5b-6d105b073624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:44.797003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4f65e-3452-4a04-8551-4c50d44fc0cd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:44.806595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4f65e-3452-4a04-8551-4c50d44fc0cd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:44.808728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d3678481-caa3-44dc-af5b-6d105b073624 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:44.810898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d3678481-caa3-44dc-af5b-6d105b073624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:44.824302 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3231/6526] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:44.824302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3678481-caa3-44dc-af5b-6d105b073624 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:44.831265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b6301-8572-480a-a9ed-1021f3fe4d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:44.833298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b6301-8572-480a-a9ed-1021f3fe4d43 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:44.834875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b6301-8572-480a-a9ed-1021f3fe4d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:44.835241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b6301-8572-480a-a9ed-1021f3fe4d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:44.836064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b6301-8572-480a-a9ed-1021f3fe4d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:44.838202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d3678481-caa3-44dc-af5b-6d105b073624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:44.839006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b6301-8572-480a-a9ed-1021f3fe4d43 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:44.853216 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3296/6527] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:44 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:44.854244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b6301-8572-480a-a9ed-1021f3fe4d43 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:44.870124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b6301-8572-480a-a9ed-1021f3fe4d43 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:44.875872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10164c-5e82-43ad-85a5-9fa9af4ab2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:44.877008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10164c-5e82-43ad-85a5-9fa9af4ab2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:44.877358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10164c-5e82-43ad-85a5-9fa9af4ab2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:44.877712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10164c-5e82-43ad-85a5-9fa9af4ab2a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:44.879449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10164c-5e82-43ad-85a5-9fa9af4ab2a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:07:44.879886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10164c-5e82-43ad-85a5-9fa9af4ab2a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:44.882240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10164c-5e82-43ad-85a5-9fa9af4ab2a3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:44.914982 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3297/6528] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:07:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:07:44.916453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10164c-5e82-43ad-85a5-9fa9af4ab2a3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:44.940555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10164c-5e82-43ad-85a5-9fa9af4ab2a3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:44.962341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea104d5e-4e02-4a66-8c1a-cb66e6d60a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:44.962964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea104d5e-4e02-4a66-8c1a-cb66e6d60a2a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:44.963222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea104d5e-4e02-4a66-8c1a-cb66e6d60a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:44.963540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea104d5e-4e02-4a66-8c1a-cb66e6d60a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:44.967897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea104d5e-4e02-4a66-8c1a-cb66e6d60a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:44.970344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea104d5e-4e02-4a66-8c1a-cb66e6d60a2a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:44.970469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3678481-caa3-44dc-af5b-6d105b073624 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:44.975181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a41e9-81c2-4513-993f-5830148b4b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:44.975842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a41e9-81c2-4513-993f-5830148b4b8c service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:44.976127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a41e9-81c2-4513-993f-5830148b4b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:44.976405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a41e9-81c2-4513-993f-5830148b4b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:44.984964 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3298/6529] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:44 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:44.986069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea104d5e-4e02-4a66-8c1a-cb66e6d60a2a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:44.989820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a41e9-81c2-4513-993f-5830148b4b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:44.992797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a41e9-81c2-4513-993f-5830148b4b8c service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:45.006500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea104d5e-4e02-4a66-8c1a-cb66e6d60a2a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:45.006904 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3232/6530] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:45.007862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a41e9-81c2-4513-993f-5830148b4b8c service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:45.011608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967f520-3215-4c12-97c4-9c2569898193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:45.012542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967f520-3215-4c12-97c4-9c2569898193 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:45.013244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967f520-3215-4c12-97c4-9c2569898193 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:45.013406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967f520-3215-4c12-97c4-9c2569898193 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:45.014677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967f520-3215-4c12-97c4-9c2569898193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:45.016606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967f520-3215-4c12-97c4-9c2569898193 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:45.022710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a41e9-81c2-4513-993f-5830148b4b8c service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:45.027908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aeedd4-e2aa-48a7-aec9-505d7ead7cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:45.029077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeedd4-e2aa-48a7-aec9-505d7ead7cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:45.029077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeedd4-e2aa-48a7-aec9-505d7ead7cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:45.029362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeedd4-e2aa-48a7-aec9-505d7ead7cb8 admin admin] PATH_INFO: `/v3/projects/3b888baac6cf4b2aaff70b2f05bfe934/users/50a3aaa73fbc48f691b0ed513fdd36cf/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:45.049530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aeedd4-e2aa-48a7-aec9-505d7ead7cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b888baac6cf4b2aaff70b2f05bfe934, user_id=50a3aaa73fbc48f691b0ed513fdd36cf, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:45.051784 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3299/6531] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:44 2021] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:45.055804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967f520-3215-4c12-97c4-9c2569898193 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:45.056238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aeedd4-e2aa-48a7-aec9-505d7ead7cb8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:45.083577 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3233/6532] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:45 2021] PUT /identity/v3/projects/3b888baac6cf4b2aaff70b2f05bfe934/users/50a3aaa73fbc48f691b0ed513fdd36cf/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:45.094561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59640455-8110-4c1d-9082-92c71d73563b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:45.094859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59640455-8110-4c1d-9082-92c71d73563b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:45.095136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59640455-8110-4c1d-9082-92c71d73563b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:45.131019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-59640455-8110-4c1d-9082-92c71d73563b None None] MFA Rules not processed for user `50a3aaa73fbc48f691b0ed513fdd36cf`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:45.132516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-59640455-8110-4c1d-9082-92c71d73563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:45.180997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967f520-3215-4c12-97c4-9c2569898193 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:45.236970 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3234/6533] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:45 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:45.250501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59640455-8110-4c1d-9082-92c71d73563b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:45.251942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-59640455-8110-4c1d-9082-92c71d73563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:45.275184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa905f2-a9eb-4a54-ac64-b40d856fb1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:45.276013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa905f2-a9eb-4a54-ac64-b40d856fb1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:45.276348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa905f2-a9eb-4a54-ac64-b40d856fb1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:45.277290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa905f2-a9eb-4a54-ac64-b40d856fb1b8 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:45.278009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa905f2-a9eb-4a54-ac64-b40d856fb1b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:45.281263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa905f2-a9eb-4a54-ac64-b40d856fb1b8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:45.307868 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3300/6534] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:45 2021] POST /identity/v3/users => generated 290 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:45.312416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa905f2-a9eb-4a54-ac64-b40d856fb1b8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:45.326345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa905f2-a9eb-4a54-ac64-b40d856fb1b8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:45.335350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c580a-a50c-4bea-93c3-86b8bab5c0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:45.336885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c580a-a50c-4bea-93c3-86b8bab5c0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:45.337210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c580a-a50c-4bea-93c3-86b8bab5c0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:45.337618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c580a-a50c-4bea-93c3-86b8bab5c0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:45.338696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c580a-a50c-4bea-93c3-86b8bab5c0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:45.338816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59640455-8110-4c1d-9082-92c71d73563b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:45.341079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c580a-a50c-4bea-93c3-86b8bab5c0f6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:45.343603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ea9b2-8e21-401f-be4f-537ab0addb29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:45.344375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ea9b2-8e21-401f-be4f-537ab0addb29 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:45.344667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ea9b2-8e21-401f-be4f-537ab0addb29 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:45.344957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ea9b2-8e21-401f-be4f-537ab0addb29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:45.354521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ea9b2-8e21-401f-be4f-537ab0addb29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:45.356083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ea9b2-8e21-401f-be4f-537ab0addb29 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:45.358232 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3301/6535] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:45 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:45.363584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c580a-a50c-4bea-93c3-86b8bab5c0f6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:45.369330 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3235/6536] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:45 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:45.381065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c580a-a50c-4bea-93c3-86b8bab5c0f6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:45.399409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302e998-83fb-4472-9788-ae5bf4201d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:45.401142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ea9b2-8e21-401f-be4f-537ab0addb29 service cinder] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:45.402932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d70ea9b2-8e21-401f-be4f-537ab0addb29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:45.410629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302e998-83fb-4472-9788-ae5bf4201d2c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:45.410988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302e998-83fb-4472-9788-ae5bf4201d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:45.411222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302e998-83fb-4472-9788-ae5bf4201d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:45.411982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302e998-83fb-4472-9788-ae5bf4201d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:45.425671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302e998-83fb-4472-9788-ae5bf4201d2c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:45.456586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ea9b2-8e21-401f-be4f-537ab0addb29 service cinder] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:45.462993 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3302/6537] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:45 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:07:45.467401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302e998-83fb-4472-9788-ae5bf4201d2c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:45.469106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d408f4d-875a-4035-9148-7321039e2533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:45.470021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d408f4d-875a-4035-9148-7321039e2533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:45.471455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d408f4d-875a-4035-9148-7321039e2533 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:45.471745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d408f4d-875a-4035-9148-7321039e2533 admin admin] PATH_INFO: `/v3/projects/3ba00a5a39804c41938903a7fff9e157` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:45.474993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d408f4d-875a-4035-9148-7321039e2533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ba00a5a39804c41938903a7fff9e157)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:45.481590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d408f4d-875a-4035-9148-7321039e2533 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:45.482095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302e998-83fb-4472-9788-ae5bf4201d2c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:45.495028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2afb1-4b35-4904-9dd5-1cebb4e5a08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:45.495806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2afb1-4b35-4904-9dd5-1cebb4e5a08b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:45.496158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2afb1-4b35-4904-9dd5-1cebb4e5a08b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:45.496474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2afb1-4b35-4904-9dd5-1cebb4e5a08b admin admin] PATH_INFO: `/v3/projects/e60600edf12344cc92541fd4f78df827/users/5b9f1842c1fc4d84b1975a3814c2da30/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:45.518740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2afb1-4b35-4904-9dd5-1cebb4e5a08b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60600edf12344cc92541fd4f78df827, user_id=5b9f1842c1fc4d84b1975a3814c2da30, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:45.524372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2afb1-4b35-4904-9dd5-1cebb4e5a08b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:45.543737 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3303/6538] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:45 2021] PUT /identity/v3/projects/e60600edf12344cc92541fd4f78df827/users/5b9f1842c1fc4d84b1975a3814c2da30/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:45.559914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a424a5-139c-4ed5-b2e1-ddf20d79c15e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:45.560592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a424a5-139c-4ed5-b2e1-ddf20d79c15e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:45.561918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a424a5-139c-4ed5-b2e1-ddf20d79c15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:45.570216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6d408f4d-875a-4035-9148-7321039e2533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ba00a5a39804c41938903a7fff9e157', 'request_id': 'req-6d408f4d-875a-4035-9148-7321039e2533'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:45.578973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6d408f4d-875a-4035-9148-7321039e2533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ba00a5a39804c41938903a7fff9e157', 'request_id': 'req-6d408f4d-875a-4035-9148-7321039e2533'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:45.586748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6d408f4d-875a-4035-9148-7321039e2533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ba00a5a39804c41938903a7fff9e157', 'request_id': 'req-6d408f4d-875a-4035-9148-7321039e2533'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:45.604482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-08a424a5-139c-4ed5-b2e1-ddf20d79c15e None None] MFA Rules not processed for user `5b9f1842c1fc4d84b1975a3814c2da30`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:45.605805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-08a424a5-139c-4ed5-b2e1-ddf20d79c15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:45.612314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6d408f4d-875a-4035-9148-7321039e2533 admin admin] The token cache is being invalidate because project 3ba00a5a39804c41938903a7fff9e157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:45.612612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6d408f4d-875a-4035-9148-7321039e2533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:45.614875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6d408f4d-875a-4035-9148-7321039e2533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:45.617636 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3236/6539] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:45 2021] DELETE /identity/v3/projects/3ba00a5a39804c41938903a7fff9e157 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:45.624892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c4921-6472-413a-a389-ad5138b1b786 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:45.625325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c4921-6472-413a-a389-ad5138b1b786 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:45.632708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c4921-6472-413a-a389-ad5138b1b786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:45.685070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f47c4921-6472-413a-a389-ad5138b1b786 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:45.690391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f47c4921-6472-413a-a389-ad5138b1b786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:45.710463 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3304/6540] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:45 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:45.716702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a424a5-139c-4ed5-b2e1-ddf20d79c15e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:45.728852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-08a424a5-139c-4ed5-b2e1-ddf20d79c15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:45.863164 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3237/6541] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:45.874246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccac8e-5497-40a7-853e-469e55b21453 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:45.874599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccac8e-5497-40a7-853e-469e55b21453 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:45.878044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccac8e-5497-40a7-853e-469e55b21453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:45.888362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a424a5-139c-4ed5-b2e1-ddf20d79c15e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:45.904003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beccd0d-5be9-4223-a430-8e4e0567f9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:45.904741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beccd0d-5be9-4223-a430-8e4e0567f9a8 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:45.905036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beccd0d-5be9-4223-a430-8e4e0567f9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:45.905315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beccd0d-5be9-4223-a430-8e4e0567f9a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:45.906047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beccd0d-5be9-4223-a430-8e4e0567f9a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:45.906160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f1ccac8e-5497-40a7-853e-469e55b21453 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:45.908131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beccd0d-5be9-4223-a430-8e4e0567f9a8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:45.908537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f1ccac8e-5497-40a7-853e-469e55b21453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:45.931387 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3238/6542] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:45.932865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccac8e-5497-40a7-853e-469e55b21453 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:45.972644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccac8e-5497-40a7-853e-469e55b21453 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:45.977783 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3305/6543] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:45 2021] POST /identity/v3/projects => generated 377 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:45.981382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beccd0d-5be9-4223-a430-8e4e0567f9a8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:46.074661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76796899-7cb4-46e8-aa00-259fdca5fb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:46.075856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76796899-7cb4-46e8-aa00-259fdca5fb05 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:46.076382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76796899-7cb4-46e8-aa00-259fdca5fb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:46.076929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76796899-7cb4-46e8-aa00-259fdca5fb05 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:46.077976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76796899-7cb4-46e8-aa00-259fdca5fb05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:07:46.078880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76796899-7cb4-46e8-aa00-259fdca5fb05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:46.081407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76796899-7cb4-46e8-aa00-259fdca5fb05 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:46.088644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beccd0d-5be9-4223-a430-8e4e0567f9a8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:46.097631 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3239/6544] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:07:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:07:46.098185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c89226-aa3f-4016-ae00-11f647672df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:46.098902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c89226-aa3f-4016-ae00-11f647672df9 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:46.099195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c89226-aa3f-4016-ae00-11f647672df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:46.099501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c89226-aa3f-4016-ae00-11f647672df9 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:46.100233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c89226-aa3f-4016-ae00-11f647672df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:46.101975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76796899-7cb4-46e8-aa00-259fdca5fb05 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:46.102517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c89226-aa3f-4016-ae00-11f647672df9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:46.114899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76796899-7cb4-46e8-aa00-259fdca5fb05 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:46.121207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaffdf-fc57-40a9-8d77-9924d8624718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:46.122223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaffdf-fc57-40a9-8d77-9924d8624718 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:46.122223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaffdf-fc57-40a9-8d77-9924d8624718 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:46.122590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaffdf-fc57-40a9-8d77-9924d8624718 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:46.123537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaffdf-fc57-40a9-8d77-9924d8624718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:46.126231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaffdf-fc57-40a9-8d77-9924d8624718 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:46.132002 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3306/6545] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:45 2021] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:46.136422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c89226-aa3f-4016-ae00-11f647672df9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:46.149430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c89226-aa3f-4016-ae00-11f647672df9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:46.156871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522edc33-1003-47f6-9f36-1e58f2958d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:46.157616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522edc33-1003-47f6-9f36-1e58f2958d6b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:46.157896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522edc33-1003-47f6-9f36-1e58f2958d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:46.158407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522edc33-1003-47f6-9f36-1e58f2958d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:46.159358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522edc33-1003-47f6-9f36-1e58f2958d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:46.161013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522edc33-1003-47f6-9f36-1e58f2958d6b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:46.165914 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3240/6546] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:46 2021] POST /identity/v3/projects => generated 405 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:46.167182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaffdf-fc57-40a9-8d77-9924d8624718 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:46.175360 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3307/6547] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:46 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:07:46.179283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522edc33-1003-47f6-9f36-1e58f2958d6b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:46.201489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522edc33-1003-47f6-9f36-1e58f2958d6b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:46.252829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaffdf-fc57-40a9-8d77-9924d8624718 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:46.260680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561ee8b-a3cb-499d-8b36-208ef01dfcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:46.261425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561ee8b-a3cb-499d-8b36-208ef01dfcf5 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:46.261781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561ee8b-a3cb-499d-8b36-208ef01dfcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:46.262233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561ee8b-a3cb-499d-8b36-208ef01dfcf5 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:46.262968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561ee8b-a3cb-499d-8b36-208ef01dfcf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:46.265165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a7500-2309-476f-8ad8-88fb4ef89e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:46.265421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561ee8b-a3cb-499d-8b36-208ef01dfcf5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:46.265934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a7500-2309-476f-8ad8-88fb4ef89e3f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:46.266282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a7500-2309-476f-8ad8-88fb4ef89e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:46.266583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a7500-2309-476f-8ad8-88fb4ef89e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:46.267795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a7500-2309-476f-8ad8-88fb4ef89e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:46.269717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a7500-2309-476f-8ad8-88fb4ef89e3f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:46.282296 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3308/6548] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:46 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:46.286536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a7500-2309-476f-8ad8-88fb4ef89e3f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:46.294021 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3241/6549] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:46 2021] POST /identity/v3/users => generated 303 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:46.295953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561ee8b-a3cb-499d-8b36-208ef01dfcf5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:46.308976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a7500-2309-476f-8ad8-88fb4ef89e3f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:46.309143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561ee8b-a3cb-499d-8b36-208ef01dfcf5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:46.314559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd7289-2a1c-4f83-9b7a-01c4926dde3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:46.315511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7289-2a1c-4f83-9b7a-01c4926dde3b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:46.315940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7289-2a1c-4f83-9b7a-01c4926dde3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:46.316294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7289-2a1c-4f83-9b7a-01c4926dde3b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:46.317425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd7289-2a1c-4f83-9b7a-01c4926dde3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:46.318358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17687ca8-88d3-465e-8eac-29ee81bfc37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:46.319336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd7289-2a1c-4f83-9b7a-01c4926dde3b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:46.319457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17687ca8-88d3-465e-8eac-29ee81bfc37f admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:46.319811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17687ca8-88d3-465e-8eac-29ee81bfc37f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:46.320271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17687ca8-88d3-465e-8eac-29ee81bfc37f admin admin] PATH_INFO: `/v3/projects/1c16be93be55410bbdf8eca25d05ff27/users/15ba7470a904451a984ad9ac3433f856/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:46.344855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17687ca8-88d3-465e-8eac-29ee81bfc37f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c16be93be55410bbdf8eca25d05ff27, user_id=15ba7470a904451a984ad9ac3433f856, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:46.347756 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3242/6550] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:46 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:07:46.351089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17687ca8-88d3-465e-8eac-29ee81bfc37f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:46.351970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd7289-2a1c-4f83-9b7a-01c4926dde3b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:46.374297 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3309/6551] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:46 2021] PUT /identity/v3/projects/1c16be93be55410bbdf8eca25d05ff27/users/15ba7470a904451a984ad9ac3433f856/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:46.376537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd7289-2a1c-4f83-9b7a-01c4926dde3b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:46.385505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c3749-f08d-46ef-9da4-1d10c68e6231 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:46.385868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c3749-f08d-46ef-9da4-1d10c68e6231 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:46.387107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c3749-f08d-46ef-9da4-1d10c68e6231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:46.445390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-908c3749-f08d-46ef-9da4-1d10c68e6231 None None] MFA Rules not processed for user `15ba7470a904451a984ad9ac3433f856`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:46.448181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-908c3749-f08d-46ef-9da4-1d10c68e6231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:46.511810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51bc4a-0975-4c53-b9e7-5a1ebcf770e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:46.513390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51bc4a-0975-4c53-b9e7-5a1ebcf770e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:46.513790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51bc4a-0975-4c53-b9e7-5a1ebcf770e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:46.514706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51bc4a-0975-4c53-b9e7-5a1ebcf770e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:46.515625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51bc4a-0975-4c53-b9e7-5a1ebcf770e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:46.518147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51bc4a-0975-4c53-b9e7-5a1ebcf770e9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:46.535508 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3243/6552] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:46 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:46.536536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51bc4a-0975-4c53-b9e7-5a1ebcf770e9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:46.549084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51bc4a-0975-4c53-b9e7-5a1ebcf770e9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:46.549830 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3310/6553] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:46 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:46.556143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c3749-f08d-46ef-9da4-1d10c68e6231 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:46.561476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a539262-3eca-42dd-b426-21b27eeb1c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:46.562898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a539262-3eca-42dd-b426-21b27eeb1c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:46.563190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a539262-3eca-42dd-b426-21b27eeb1c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:46.563991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a539262-3eca-42dd-b426-21b27eeb1c8d admin admin] PATH_INFO: `/v3/projects/40830f131f4f4c8f9795130d392a377c/users/41899747ad854568b0d9cfd6f4f2ad63/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:46.575006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c3749-f08d-46ef-9da4-1d10c68e6231 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:46.587502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a539262-3eca-42dd-b426-21b27eeb1c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=40830f131f4f4c8f9795130d392a377c, user_id=41899747ad854568b0d9cfd6f4f2ad63, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:46.587686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70557d50-1269-4f8f-8e00-5f5804b6f418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:46.588580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70557d50-1269-4f8f-8e00-5f5804b6f418 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:46.588889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70557d50-1269-4f8f-8e00-5f5804b6f418 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:46.589153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70557d50-1269-4f8f-8e00-5f5804b6f418 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:46.589839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70557d50-1269-4f8f-8e00-5f5804b6f418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:46.591850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70557d50-1269-4f8f-8e00-5f5804b6f418 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:46.592743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a539262-3eca-42dd-b426-21b27eeb1c8d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:46.615517 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3244/6554] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:46 2021] PUT /identity/v3/projects/40830f131f4f4c8f9795130d392a377c/users/41899747ad854568b0d9cfd6f4f2ad63/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:46.620310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363b49a-ed29-424e-b40f-0b5ae0ee0589 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:46.620605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363b49a-ed29-424e-b40f-0b5ae0ee0589 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:46.620895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363b49a-ed29-424e-b40f-0b5ae0ee0589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:46.627121 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3311/6555] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:46 2021] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:46.631447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70557d50-1269-4f8f-8e00-5f5804b6f418 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:46.647961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a363b49a-ed29-424e-b40f-0b5ae0ee0589 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:46.650663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a363b49a-ed29-424e-b40f-0b5ae0ee0589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:46.750628 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3245/6556] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:07:46.759841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363b49a-ed29-424e-b40f-0b5ae0ee0589 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:46.762849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a363b49a-ed29-424e-b40f-0b5ae0ee0589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:46.767213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70557d50-1269-4f8f-8e00-5f5804b6f418 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:46.772383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed531ca-c6c4-476d-a7c8-2b1022b51a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:46.773123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed531ca-c6c4-476d-a7c8-2b1022b51a10 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:46.773468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed531ca-c6c4-476d-a7c8-2b1022b51a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:46.773753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed531ca-c6c4-476d-a7c8-2b1022b51a10 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:46.774552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed531ca-c6c4-476d-a7c8-2b1022b51a10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:46.776879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed531ca-c6c4-476d-a7c8-2b1022b51a10 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:46.806121 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3312/6557] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:46 2021] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:07:46.808714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed531ca-c6c4-476d-a7c8-2b1022b51a10 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:46.824759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed531ca-c6c4-476d-a7c8-2b1022b51a10 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:46.832951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c60719-5345-4dca-b779-984f26dedec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:46.833632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c60719-5345-4dca-b779-984f26dedec0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:46.834602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c60719-5345-4dca-b779-984f26dedec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:46.834602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c60719-5345-4dca-b779-984f26dedec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:46.835444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c60719-5345-4dca-b779-984f26dedec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:46.838004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c60719-5345-4dca-b779-984f26dedec0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:46.866784 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3313/6558] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:46 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:46.869454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c60719-5345-4dca-b779-984f26dedec0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:46.875109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363b49a-ed29-424e-b40f-0b5ae0ee0589 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:46.881881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d798e3-4c70-468a-8bc1-bc1837d28f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:46.882860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d798e3-4c70-468a-8bc1-bc1837d28f57 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:46.883009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d798e3-4c70-468a-8bc1-bc1837d28f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:46.883962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d798e3-4c70-468a-8bc1-bc1837d28f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:46.895030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d798e3-4c70-468a-8bc1-bc1837d28f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:46.895651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c60719-5345-4dca-b779-984f26dedec0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:46.898402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d798e3-4c70-468a-8bc1-bc1837d28f57 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:46.906110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0010b-c69c-440c-81d4-5a6b3e7d15d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:46.908624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0010b-c69c-440c-81d4-5a6b3e7d15d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:46.911030 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3246/6559] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:46.911169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0010b-c69c-440c-81d4-5a6b3e7d15d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:46.911351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0010b-c69c-440c-81d4-5a6b3e7d15d9 admin admin] PATH_INFO: `/v3/projects/c61df95a88b54b6bb5d2906f54abe43b/users/a9f431db509c476ba225e7b5f3bbd284/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:46.938594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0010b-c69c-440c-81d4-5a6b3e7d15d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c61df95a88b54b6bb5d2906f54abe43b, user_id=a9f431db509c476ba225e7b5f3bbd284, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:46.941303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0010b-c69c-440c-81d4-5a6b3e7d15d9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:46.974848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d798e3-4c70-468a-8bc1-bc1837d28f57 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:46.975425 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3314/6560] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:46 2021] PUT /identity/v3/projects/c61df95a88b54b6bb5d2906f54abe43b/users/a9f431db509c476ba225e7b5f3bbd284/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:46.987551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d798e3-4c70-468a-8bc1-bc1837d28f57 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:47.071845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0af821-e354-4779-823b-537cf3587f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:47.073108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af821-e354-4779-823b-537cf3587f3c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:47.073409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af821-e354-4779-823b-537cf3587f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:47.073696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af821-e354-4779-823b-537cf3587f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:47.075005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0af821-e354-4779-823b-537cf3587f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:47.077667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0af821-e354-4779-823b-537cf3587f3c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:47.090786 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3247/6561] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:46 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:47.094778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0010b-c69c-440c-81d4-5a6b3e7d15d9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:47.111687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0010b-c69c-440c-81d4-5a6b3e7d15d9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:47.120406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8dcc0-2446-4573-9d3b-e3198697b756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:47.121437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8dcc0-2446-4573-9d3b-e3198697b756 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:47.123858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8dcc0-2446-4573-9d3b-e3198697b756 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:47.124242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8dcc0-2446-4573-9d3b-e3198697b756 admin admin] PATH_INFO: `/v3/projects/c61df95a88b54b6bb5d2906f54abe43b/users/a9f431db509c476ba225e7b5f3bbd284/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:47.126897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8dcc0-2446-4573-9d3b-e3198697b756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c61df95a88b54b6bb5d2906f54abe43b, user_id=a9f431db509c476ba225e7b5f3bbd284, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:47.130516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8dcc0-2446-4573-9d3b-e3198697b756 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:47.146299 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3315/6562] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:47 2021] PUT /identity/v3/projects/c61df95a88b54b6bb5d2906f54abe43b/users/a9f431db509c476ba225e7b5f3bbd284/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:47.242320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f5bb8-752a-436c-8a1e-c533aee7e818 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:47.242633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f5bb8-752a-436c-8a1e-c533aee7e818 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:47.242945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f5bb8-752a-436c-8a1e-c533aee7e818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:47.276187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f44f5bb8-752a-436c-8a1e-c533aee7e818 None None] MFA Rules not processed for user `a9f431db509c476ba225e7b5f3bbd284`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:47.277413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f44f5bb8-752a-436c-8a1e-c533aee7e818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:47.388031 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3248/6563] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:47 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:47.399832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8dcc0-2446-4573-9d3b-e3198697b756 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:47.401530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-23d8dcc0-2446-4573-9d3b-e3198697b756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:47.488973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8dcc0-2446-4573-9d3b-e3198697b756 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:47.493582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f147b1d-c63e-4f41-82c3-517bf913a324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:47.494627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f147b1d-c63e-4f41-82c3-517bf913a324 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:47.494982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f147b1d-c63e-4f41-82c3-517bf913a324 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:47.495338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f147b1d-c63e-4f41-82c3-517bf913a324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:47.526385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f147b1d-c63e-4f41-82c3-517bf913a324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:47.529444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f147b1d-c63e-4f41-82c3-517bf913a324 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:47.563708 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3316/6564] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:47 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:47.659408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f5bb8-752a-436c-8a1e-c533aee7e818 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:47.681598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f5bb8-752a-436c-8a1e-c533aee7e818 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:47.699060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c47315-16a5-4a0c-b442-ae653822e34e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:47.703625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c47315-16a5-4a0c-b442-ae653822e34e service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:47.703625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c47315-16a5-4a0c-b442-ae653822e34e service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:47.704350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c47315-16a5-4a0c-b442-ae653822e34e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:47.852909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c47315-16a5-4a0c-b442-ae653822e34e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:47.854684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c47315-16a5-4a0c-b442-ae653822e34e service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:47.880430 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3249/6565] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:47 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:48.901694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f147b1d-c63e-4f41-82c3-517bf913a324 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:48.903875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8f147b1d-c63e-4f41-82c3-517bf913a324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:48.982296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f147b1d-c63e-4f41-82c3-517bf913a324 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:48.989806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e63dc-1a76-43f5-adbd-c97605ec0d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:48.990731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e63dc-1a76-43f5-adbd-c97605ec0d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:48.991021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e63dc-1a76-43f5-adbd-c97605ec0d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:48.991497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e63dc-1a76-43f5-adbd-c97605ec0d7b admin admin] PATH_INFO: `/v3/users/50a3aaa73fbc48f691b0ed513fdd36cf` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:48.992792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e63dc-1a76-43f5-adbd-c97605ec0d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a3aaa73fbc48f691b0ed513fdd36cf)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:48.995119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e63dc-1a76-43f5-adbd-c97605ec0d7b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:49.083820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fb1e63dc-1a76-43f5-adbd-c97605ec0d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a3aaa73fbc48f691b0ed513fdd36cf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:49.095460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fb1e63dc-1a76-43f5-adbd-c97605ec0d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a3aaa73fbc48f691b0ed513fdd36cf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:49.096582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fb1e63dc-1a76-43f5-adbd-c97605ec0d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a3aaa73fbc48f691b0ed513fdd36cf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:49.111662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fb1e63dc-1a76-43f5-adbd-c97605ec0d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a3aaa73fbc48f691b0ed513fdd36cf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:49.122912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fb1e63dc-1a76-43f5-adbd-c97605ec0d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a3aaa73fbc48f691b0ed513fdd36cf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:49.129940 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3317/6566] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:48 2021] DELETE /identity/v3/users/50a3aaa73fbc48f691b0ed513fdd36cf => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:49.134901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb103566-400e-41eb-a9de-7aa3471e8031 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:49.135380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb103566-400e-41eb-a9de-7aa3471e8031 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:49.135752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb103566-400e-41eb-a9de-7aa3471e8031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:49.169348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-eb103566-400e-41eb-a9de-7aa3471e8031 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:49.172033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eb103566-400e-41eb-a9de-7aa3471e8031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:49.184424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb1c2b-e866-4431-b031-0ee5d2179a38 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:49.185583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb1c2b-e866-4431-b031-0ee5d2179a38 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:49.186162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb1c2b-e866-4431-b031-0ee5d2179a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:49.217400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a9cb1c2b-e866-4431-b031-0ee5d2179a38 None None] MFA Rules not processed for user `41899747ad854568b0d9cfd6f4f2ad63`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:49.218970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a9cb1c2b-e866-4431-b031-0ee5d2179a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:49.282449 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3250/6567] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:49.333055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb103566-400e-41eb-a9de-7aa3471e8031 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:49.334497 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3318/6568] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:49 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:07:49.337052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb1c2b-e866-4431-b031-0ee5d2179a38 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:49.340574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eb103566-400e-41eb-a9de-7aa3471e8031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:49.341009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a9cb1c2b-e866-4431-b031-0ee5d2179a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:49.361077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb1c2b-e866-4431-b031-0ee5d2179a38 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:49.366843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb4bf8-b082-4f76-9c2b-5225f4d29662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:49.367971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb4bf8-b082-4f76-9c2b-5225f4d29662 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:49.368480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb4bf8-b082-4f76-9c2b-5225f4d29662 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:49.368975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb4bf8-b082-4f76-9c2b-5225f4d29662 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:49.370092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb4bf8-b082-4f76-9c2b-5225f4d29662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:49.372506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb4bf8-b082-4f76-9c2b-5225f4d29662 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:49.414600 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3319/6569] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:49 2021] POST /identity/v3/projects => generated 401 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:49.415663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb4bf8-b082-4f76-9c2b-5225f4d29662 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:49.456453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb103566-400e-41eb-a9de-7aa3471e8031 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:49.523640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eab4bb-334d-4e51-a7ea-259ad461ec9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:49.524716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eab4bb-334d-4e51-a7ea-259ad461ec9c service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:49.525107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eab4bb-334d-4e51-a7ea-259ad461ec9c service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:49.525476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eab4bb-334d-4e51-a7ea-259ad461ec9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:49.629124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eab4bb-334d-4e51-a7ea-259ad461ec9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:49.634084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eab4bb-334d-4e51-a7ea-259ad461ec9c service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:49.639307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb4bf8-b082-4f76-9c2b-5225f4d29662 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:49.651939 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3251/6570] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:49.652219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939ac93-3558-4290-8e39-57470853cabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:49.652906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939ac93-3558-4290-8e39-57470853cabb admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:49.653191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939ac93-3558-4290-8e39-57470853cabb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:49.653537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939ac93-3558-4290-8e39-57470853cabb admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:49.654188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939ac93-3558-4290-8e39-57470853cabb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:49.661076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939ac93-3558-4290-8e39-57470853cabb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:49.683148 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3320/6571] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:49 2021] POST /identity/v3/users => generated 307 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:49.687006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eab4bb-334d-4e51-a7ea-259ad461ec9c service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:49.697468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eab4bb-334d-4e51-a7ea-259ad461ec9c service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:49.704424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7ed6d-808d-4ab4-b610-b1d94e902631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:49.705030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7ed6d-808d-4ab4-b610-b1d94e902631 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:49.705315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7ed6d-808d-4ab4-b610-b1d94e902631 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:49.705590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7ed6d-808d-4ab4-b610-b1d94e902631 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:49.706389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7ed6d-808d-4ab4-b610-b1d94e902631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:49.707951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7ed6d-808d-4ab4-b610-b1d94e902631 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:49.734299 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3252/6572] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:49 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:07:49.741825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939ac93-3558-4290-8e39-57470853cabb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:49.756208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7ed6d-808d-4ab4-b610-b1d94e902631 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:49.760860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939ac93-3558-4290-8e39-57470853cabb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:49.761827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-93d7ed6d-808d-4ab4-b610-b1d94e902631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:49.774868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac83212-9255-4fb5-9c40-6f2ce1db9fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:49.776221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac83212-9255-4fb5-9c40-6f2ce1db9fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:49.776515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac83212-9255-4fb5-9c40-6f2ce1db9fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:49.776800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac83212-9255-4fb5-9c40-6f2ce1db9fb9 admin admin] PATH_INFO: `/v3/projects/5d21e200e1514211883e9b81c0a6b006/users/ebde756079de4b8b91fef57d80167dd9/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:49.777706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7ed6d-808d-4ab4-b610-b1d94e902631 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:49.783226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82166b4-d166-4486-9e51-abe97934d685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:49.784214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82166b4-d166-4486-9e51-abe97934d685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:49.784584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82166b4-d166-4486-9e51-abe97934d685 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:49.784930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82166b4-d166-4486-9e51-abe97934d685 admin admin] PATH_INFO: `/v3/users/1edf58bf651a4a49882b72e21fac8518` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:49.786430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82166b4-d166-4486-9e51-abe97934d685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1edf58bf651a4a49882b72e21fac8518)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:49.788460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82166b4-d166-4486-9e51-abe97934d685 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:49.799037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac83212-9255-4fb5-9c40-6f2ce1db9fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d21e200e1514211883e9b81c0a6b006, user_id=ebde756079de4b8b91fef57d80167dd9, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:49.802739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac83212-9255-4fb5-9c40-6f2ce1db9fb9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:49.833886 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3321/6573] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:49 2021] PUT /identity/v3/projects/5d21e200e1514211883e9b81c0a6b006/users/ebde756079de4b8b91fef57d80167dd9/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:49.837894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac83212-9255-4fb5-9c40-6f2ce1db9fb9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:49.848881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c82166b4-d166-4486-9e51-abe97934d685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1edf58bf651a4a49882b72e21fac8518'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:49.859224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c82166b4-d166-4486-9e51-abe97934d685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1edf58bf651a4a49882b72e21fac8518'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:49.879486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c82166b4-d166-4486-9e51-abe97934d685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1edf58bf651a4a49882b72e21fac8518'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:49.880590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c82166b4-d166-4486-9e51-abe97934d685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1edf58bf651a4a49882b72e21fac8518'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:49.893623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c82166b4-d166-4486-9e51-abe97934d685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1edf58bf651a4a49882b72e21fac8518'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:49.905728 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3253/6574] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:49 2021] DELETE /identity/v3/users/1edf58bf651a4a49882b72e21fac8518 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:49.911909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfdb91-ccd7-43d6-905a-e2f326074a26 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:49.913163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfdb91-ccd7-43d6-905a-e2f326074a26 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:49.913449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfdb91-ccd7-43d6-905a-e2f326074a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:49.926911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac83212-9255-4fb5-9c40-6f2ce1db9fb9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:49.939514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-cfbfdb91-ccd7-43d6-905a-e2f326074a26 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:49.940857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cfbfdb91-ccd7-43d6-905a-e2f326074a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:50.029031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4009027-6462-4e1f-8c11-b9aa957e2b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:50.030115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4009027-6462-4e1f-8c11-b9aa957e2b61 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:50.030436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4009027-6462-4e1f-8c11-b9aa957e2b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:50.030719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4009027-6462-4e1f-8c11-b9aa957e2b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:50.031462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4009027-6462-4e1f-8c11-b9aa957e2b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:50.032787 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3254/6575] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:50.033290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4009027-6462-4e1f-8c11-b9aa957e2b61 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:50.041884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfdb91-ccd7-43d6-905a-e2f326074a26 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:50.044752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cfbfdb91-ccd7-43d6-905a-e2f326074a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:50.045116 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3322/6576] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:49 2021] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:07:50.048857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4009027-6462-4e1f-8c11-b9aa957e2b61 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:50.055420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c4009027-6462-4e1f-8c11-b9aa957e2b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:50.079012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4009027-6462-4e1f-8c11-b9aa957e2b61 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:50.086620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab907c52-b9ea-4835-8c0c-1dbd6d9f01b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:50.087877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab907c52-b9ea-4835-8c0c-1dbd6d9f01b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:50.088426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab907c52-b9ea-4835-8c0c-1dbd6d9f01b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:50.089050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab907c52-b9ea-4835-8c0c-1dbd6d9f01b8 admin admin] PATH_INFO: `/v3/projects/5d21e200e1514211883e9b81c0a6b006/users/ebde756079de4b8b91fef57d80167dd9/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:50.091590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab907c52-b9ea-4835-8c0c-1dbd6d9f01b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d21e200e1514211883e9b81c0a6b006, user_id=ebde756079de4b8b91fef57d80167dd9, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:50.094646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab907c52-b9ea-4835-8c0c-1dbd6d9f01b8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:50.118310 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3323/6577] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:50 2021] PUT /identity/v3/projects/5d21e200e1514211883e9b81c0a6b006/users/ebde756079de4b8b91fef57d80167dd9/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:50.171242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfdb91-ccd7-43d6-905a-e2f326074a26 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:50.237529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7a527-16b4-41cd-bff2-503579ea0a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:50.238199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a527-16b4-41cd-bff2-503579ea0a42 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:50.238889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a527-16b4-41cd-bff2-503579ea0a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:50.239181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a527-16b4-41cd-bff2-503579ea0a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:50.250302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab907c52-b9ea-4835-8c0c-1dbd6d9f01b8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:50.253449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ab907c52-b9ea-4835-8c0c-1dbd6d9f01b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:50.344008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7a527-16b4-41cd-bff2-503579ea0a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:50.346771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7a527-16b4-41cd-bff2-503579ea0a42 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:50.362811 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3255/6578] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:07:50.376614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab907c52-b9ea-4835-8c0c-1dbd6d9f01b8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:50.383623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eadc01-ea46-49c9-81d3-a388e703fe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:50.385713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eadc01-ea46-49c9-81d3-a388e703fe44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:50.386064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eadc01-ea46-49c9-81d3-a388e703fe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:50.386419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eadc01-ea46-49c9-81d3-a388e703fe44 admin admin] PATH_INFO: `/v3/projects/3b888baac6cf4b2aaff70b2f05bfe934` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:50.388173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eadc01-ea46-49c9-81d3-a388e703fe44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b888baac6cf4b2aaff70b2f05bfe934)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:50.390483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eadc01-ea46-49c9-81d3-a388e703fe44 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:50.453198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-95eadc01-ea46-49c9-81d3-a388e703fe44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b888baac6cf4b2aaff70b2f05bfe934', 'request_id': 'req-95eadc01-ea46-49c9-81d3-a388e703fe44'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:50.461992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-95eadc01-ea46-49c9-81d3-a388e703fe44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b888baac6cf4b2aaff70b2f05bfe934', 'request_id': 'req-95eadc01-ea46-49c9-81d3-a388e703fe44'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:50.471524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-95eadc01-ea46-49c9-81d3-a388e703fe44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b888baac6cf4b2aaff70b2f05bfe934', 'request_id': 'req-95eadc01-ea46-49c9-81d3-a388e703fe44'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:50.485454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-95eadc01-ea46-49c9-81d3-a388e703fe44 admin admin] The token cache is being invalidate because project 3b888baac6cf4b2aaff70b2f05bfe934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:50.485970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-95eadc01-ea46-49c9-81d3-a388e703fe44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:50.486978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-95eadc01-ea46-49c9-81d3-a388e703fe44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:50.488853 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3324/6579] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:50 2021] DELETE /identity/v3/projects/3b888baac6cf4b2aaff70b2f05bfe934 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:07:50.495228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db1a45-0df2-46a2-bb69-f45e33a67b39 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:50.495228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db1a45-0df2-46a2-bb69-f45e33a67b39 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:50.495228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db1a45-0df2-46a2-bb69-f45e33a67b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:50.519871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b0db1a45-0df2-46a2-bb69-f45e33a67b39 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:50.521088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b0db1a45-0df2-46a2-bb69-f45e33a67b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:50.617700 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3256/6580] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:50.626594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257d971-e1b0-4a52-a566-19c311dd920c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:50.627334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257d971-e1b0-4a52-a566-19c311dd920c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:50.627827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257d971-e1b0-4a52-a566-19c311dd920c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:50.676283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db1a45-0df2-46a2-bb69-f45e33a67b39 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:50.677840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b0db1a45-0df2-46a2-bb69-f45e33a67b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:50.681192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2257d971-e1b0-4a52-a566-19c311dd920c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:50.683972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2257d971-e1b0-4a52-a566-19c311dd920c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:50.697139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db1a45-0df2-46a2-bb69-f45e33a67b39 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:50.704956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0668331-c274-48fd-9112-591b7a33015a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:50.706017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0668331-c274-48fd-9112-591b7a33015a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:50.706415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0668331-c274-48fd-9112-591b7a33015a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:50.706759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0668331-c274-48fd-9112-591b7a33015a admin admin] PATH_INFO: `/v3/projects/87a46355eeaf4513b6ec952f4e4586f5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:50.708171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0668331-c274-48fd-9112-591b7a33015a admin admin] RBAC: Authorizing `identity:delete_project(project_id=87a46355eeaf4513b6ec952f4e4586f5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:50.710970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0668331-c274-48fd-9112-591b7a33015a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:50.720377 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3325/6581] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:07:50.724282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257d971-e1b0-4a52-a566-19c311dd920c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:50.749595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257d971-e1b0-4a52-a566-19c311dd920c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:50.769039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9c8f9-bce8-4925-9ffd-0dbcbd872055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:50.769853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9c8f9-bce8-4925-9ffd-0dbcbd872055 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:50.770241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9c8f9-bce8-4925-9ffd-0dbcbd872055 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:50.770667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9c8f9-bce8-4925-9ffd-0dbcbd872055 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:50.771526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9c8f9-bce8-4925-9ffd-0dbcbd872055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:07:50.775007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9c8f9-bce8-4925-9ffd-0dbcbd872055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:50.777641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9c8f9-bce8-4925-9ffd-0dbcbd872055 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:50.799490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0668331-c274-48fd-9112-591b7a33015a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a46355eeaf4513b6ec952f4e4586f5', 'request_id': 'req-d0668331-c274-48fd-9112-591b7a33015a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:50.801053 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3326/6582] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:07:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:07:50.805922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9c8f9-bce8-4925-9ffd-0dbcbd872055 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:50.814422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0668331-c274-48fd-9112-591b7a33015a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a46355eeaf4513b6ec952f4e4586f5', 'request_id': 'req-d0668331-c274-48fd-9112-591b7a33015a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:50.818756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9c8f9-bce8-4925-9ffd-0dbcbd872055 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:50.822031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0668331-c274-48fd-9112-591b7a33015a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a46355eeaf4513b6ec952f4e4586f5', 'request_id': 'req-d0668331-c274-48fd-9112-591b7a33015a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:50.848797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0668331-c274-48fd-9112-591b7a33015a admin admin] The token cache is being invalidate because project 87a46355eeaf4513b6ec952f4e4586f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:50.849179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0668331-c274-48fd-9112-591b7a33015a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:50.849779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d0668331-c274-48fd-9112-591b7a33015a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:50.851749 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3257/6583] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:50 2021] DELETE /identity/v3/projects/87a46355eeaf4513b6ec952f4e4586f5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:07:50.862996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1d29f-2f3e-47a1-8b04-92fafcbe02d3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:50.863666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1d29f-2f3e-47a1-8b04-92fafcbe02d3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:50.864256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1d29f-2f3e-47a1-8b04-92fafcbe02d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:50.893157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-22f1d29f-2f3e-47a1-8b04-92fafcbe02d3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:50.895855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-22f1d29f-2f3e-47a1-8b04-92fafcbe02d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:50.930867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec23ad1-9a3a-404e-9ece-382119ddcfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:50.931905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec23ad1-9a3a-404e-9ece-382119ddcfe4 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:50.932347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec23ad1-9a3a-404e-9ece-382119ddcfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:50.932796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec23ad1-9a3a-404e-9ece-382119ddcfe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:50.933742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec23ad1-9a3a-404e-9ece-382119ddcfe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:50.936644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec23ad1-9a3a-404e-9ece-382119ddcfe4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:50.986033 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3327/6584] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:50 2021] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:50.991021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec23ad1-9a3a-404e-9ece-382119ddcfe4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:50.993392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5ec23ad1-9a3a-404e-9ece-382119ddcfe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:51.033053 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3258/6585] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:51.042108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b385b2b-7445-468e-90da-e77e7938718b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.042673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b385b2b-7445-468e-90da-e77e7938718b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.043052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b385b2b-7445-468e-90da-e77e7938718b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.070594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7b385b2b-7445-468e-90da-e77e7938718b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:51.070594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7b385b2b-7445-468e-90da-e77e7938718b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:51.118725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec23ad1-9a3a-404e-9ece-382119ddcfe4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:51.131254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f52b5e-6627-430e-b11d-5292385dabca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:51.131254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f52b5e-6627-430e-b11d-5292385dabca admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.131254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f52b5e-6627-430e-b11d-5292385dabca admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.131254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f52b5e-6627-430e-b11d-5292385dabca admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.132883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f52b5e-6627-430e-b11d-5292385dabca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:51.140308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f52b5e-6627-430e-b11d-5292385dabca admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:51.162565 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3259/6586] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:07:51.163491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b385b2b-7445-468e-90da-e77e7938718b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:51.164773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7b385b2b-7445-468e-90da-e77e7938718b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:51.172725 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3328/6587] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:50 2021] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:51.174291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f52b5e-6627-430e-b11d-5292385dabca admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:51.178663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b385b2b-7445-468e-90da-e77e7938718b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:51.183700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84295b-30e0-4286-85aa-4ff13142dfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:51.184569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84295b-30e0-4286-85aa-4ff13142dfc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.185039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84295b-30e0-4286-85aa-4ff13142dfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.185318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84295b-30e0-4286-85aa-4ff13142dfc9 admin admin] PATH_INFO: `/v3/users/5b9f1842c1fc4d84b1975a3814c2da30` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.186631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84295b-30e0-4286-85aa-4ff13142dfc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b9f1842c1fc4d84b1975a3814c2da30)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:51.189135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84295b-30e0-4286-85aa-4ff13142dfc9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:51.189262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f52b5e-6627-430e-b11d-5292385dabca admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:51.194980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52771d9-24c7-40f2-9c4a-2a572e25bd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:51.195741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52771d9-24c7-40f2-9c4a-2a572e25bd61 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.196181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52771d9-24c7-40f2-9c4a-2a572e25bd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.196607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52771d9-24c7-40f2-9c4a-2a572e25bd61 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.197490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52771d9-24c7-40f2-9c4a-2a572e25bd61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:07:51.197958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52771d9-24c7-40f2-9c4a-2a572e25bd61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:51.199873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52771d9-24c7-40f2-9c4a-2a572e25bd61 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:51.214154 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3329/6588] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:07:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:07:51.219736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52771d9-24c7-40f2-9c4a-2a572e25bd61 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:51.231787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52771d9-24c7-40f2-9c4a-2a572e25bd61 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:51.238047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590217c-00ce-4a65-852e-c43458641495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:51.238880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590217c-00ce-4a65-852e-c43458641495 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.239229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590217c-00ce-4a65-852e-c43458641495 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.239715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590217c-00ce-4a65-852e-c43458641495 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.240633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590217c-00ce-4a65-852e-c43458641495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:51.242844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3a84295b-30e0-4286-85aa-4ff13142dfc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b9f1842c1fc4d84b1975a3814c2da30'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:51.243066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590217c-00ce-4a65-852e-c43458641495 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:51.250056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3a84295b-30e0-4286-85aa-4ff13142dfc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b9f1842c1fc4d84b1975a3814c2da30'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:51.256042 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3330/6589] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:51 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:51.257980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590217c-00ce-4a65-852e-c43458641495 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:51.263475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3a84295b-30e0-4286-85aa-4ff13142dfc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b9f1842c1fc4d84b1975a3814c2da30'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:51.264936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3a84295b-30e0-4286-85aa-4ff13142dfc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b9f1842c1fc4d84b1975a3814c2da30'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:51.271397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590217c-00ce-4a65-852e-c43458641495 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:51.276855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b34e95-78e9-45ca-b94d-b3ae7bcfd276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:51.277543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b34e95-78e9-45ca-b94d-b3ae7bcfd276 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.277825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b34e95-78e9-45ca-b94d-b3ae7bcfd276 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.278286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b34e95-78e9-45ca-b94d-b3ae7bcfd276 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.279139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b34e95-78e9-45ca-b94d-b3ae7bcfd276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:51.281913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b34e95-78e9-45ca-b94d-b3ae7bcfd276 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:51.285185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3a84295b-30e0-4286-85aa-4ff13142dfc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b9f1842c1fc4d84b1975a3814c2da30'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:51.296029 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3260/6590] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:51 2021] DELETE /identity/v3/users/5b9f1842c1fc4d84b1975a3814c2da30 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:51.297258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84295b-30e0-4286-85aa-4ff13142dfc9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:51.299095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3a84295b-30e0-4286-85aa-4ff13142dfc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:51.316627 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3331/6591] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:51 2021] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:51.318442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0445d16-2188-4785-9857-f9afed5e4032 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.318735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0445d16-2188-4785-9857-f9afed5e4032 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.319016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0445d16-2188-4785-9857-f9afed5e4032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.340418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c0445d16-2188-4785-9857-f9afed5e4032 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:51.341620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c0445d16-2188-4785-9857-f9afed5e4032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:51.377784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84295b-30e0-4286-85aa-4ff13142dfc9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:51.409308 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3332/6592] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:51.414305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f347d-f1c6-49f0-b7d4-639f93646203 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.414735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f347d-f1c6-49f0-b7d4-639f93646203 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.415118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f347d-f1c6-49f0-b7d4-639f93646203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.448558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-453f347d-f1c6-49f0-b7d4-639f93646203 None None] MFA Rules not processed for user `ebde756079de4b8b91fef57d80167dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:51.448773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e7731-8021-4a95-a415-2e17f493eddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:51.449411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e7731-8021-4a95-a415-2e17f493eddf admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.449771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e7731-8021-4a95-a415-2e17f493eddf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.450093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-453f347d-f1c6-49f0-b7d4-639f93646203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:51.450199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e7731-8021-4a95-a415-2e17f493eddf admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.451813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e7731-8021-4a95-a415-2e17f493eddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:51.453522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e7731-8021-4a95-a415-2e17f493eddf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:51.467910 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3261/6593] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:51 2021] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:51.469206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e7731-8021-4a95-a415-2e17f493eddf admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:51.470811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-299e7731-8021-4a95-a415-2e17f493eddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:51.484000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e7731-8021-4a95-a415-2e17f493eddf admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:51.490526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791220e-d41a-48e3-b1f5-5049c5267d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:51.492252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791220e-d41a-48e3-b1f5-5049c5267d6c admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.492252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791220e-d41a-48e3-b1f5-5049c5267d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.492460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791220e-d41a-48e3-b1f5-5049c5267d6c admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.493105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791220e-d41a-48e3-b1f5-5049c5267d6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:51.495267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791220e-d41a-48e3-b1f5-5049c5267d6c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:51.521492 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3262/6594] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:51 2021] POST /identity/v3/users => generated 286 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:51.523115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791220e-d41a-48e3-b1f5-5049c5267d6c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:51.524886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6791220e-d41a-48e3-b1f5-5049c5267d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:51.530356 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3333/6595] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:51 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:51.532180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f347d-f1c6-49f0-b7d4-639f93646203 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:51.544660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f347d-f1c6-49f0-b7d4-639f93646203 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:51.551543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fd89c-392b-4aaf-8ccc-1340c428d463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:51.552808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fd89c-392b-4aaf-8ccc-1340c428d463 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.553190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fd89c-392b-4aaf-8ccc-1340c428d463 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.553573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fd89c-392b-4aaf-8ccc-1340c428d463 admin admin] PATH_INFO: `/v3/projects/59ca1dfad3564b5ab798abcccc7333fe/users/c3c2db616c524b5d98c030f87fd74034/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.572635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fd89c-392b-4aaf-8ccc-1340c428d463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ca1dfad3564b5ab798abcccc7333fe, user_id=c3c2db616c524b5d98c030f87fd74034, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:51.575428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fd89c-392b-4aaf-8ccc-1340c428d463 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:51.594569 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3334/6596] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:51 2021] PUT /identity/v3/projects/59ca1dfad3564b5ab798abcccc7333fe/users/c3c2db616c524b5d98c030f87fd74034/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:51.595767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fd89c-392b-4aaf-8ccc-1340c428d463 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:51.614402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791220e-d41a-48e3-b1f5-5049c5267d6c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:51.673358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fd89c-392b-4aaf-8ccc-1340c428d463 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:51.677896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe7452-d846-4f2f-9fe3-8a3cf4c013ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:51.678340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0a7d2-ce2a-4d0e-b5f5-513619212980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:51.679088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe7452-d846-4f2f-9fe3-8a3cf4c013ff service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.679231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0a7d2-ce2a-4d0e-b5f5-513619212980 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.679705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe7452-d846-4f2f-9fe3-8a3cf4c013ff service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.679987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0a7d2-ce2a-4d0e-b5f5-513619212980 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.680334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe7452-d846-4f2f-9fe3-8a3cf4c013ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.680464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0a7d2-ce2a-4d0e-b5f5-513619212980 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.681690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0a7d2-ce2a-4d0e-b5f5-513619212980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:51.683390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0a7d2-ce2a-4d0e-b5f5-513619212980 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:51.693964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe7452-d846-4f2f-9fe3-8a3cf4c013ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:51.695056 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3335/6597] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:51 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:51.695892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe7452-d846-4f2f-9fe3-8a3cf4c013ff service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:51.699458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3945e1-89e8-4a6e-8961-4f24b111e6d9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.699749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3945e1-89e8-4a6e-8961-4f24b111e6d9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.700035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3945e1-89e8-4a6e-8961-4f24b111e6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.709648 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3263/6598] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:51.710837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe7452-d846-4f2f-9fe3-8a3cf4c013ff service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:51.728776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe7452-d846-4f2f-9fe3-8a3cf4c013ff service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:51.730642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7b3945e1-89e8-4a6e-8961-4f24b111e6d9 None None] MFA Rules not processed for user `c3c2db616c524b5d98c030f87fd74034`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:51.733279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7b3945e1-89e8-4a6e-8961-4f24b111e6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:51.739298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197587b-4e05-4ea2-9159-d8965f9413e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:51.742284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197587b-4e05-4ea2-9159-d8965f9413e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.742622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197587b-4e05-4ea2-9159-d8965f9413e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.742918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197587b-4e05-4ea2-9159-d8965f9413e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.743701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197587b-4e05-4ea2-9159-d8965f9413e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:51.745333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197587b-4e05-4ea2-9159-d8965f9413e5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:51.757422 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3264/6599] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:51 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:51.762363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197587b-4e05-4ea2-9159-d8965f9413e5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:51.773081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197587b-4e05-4ea2-9159-d8965f9413e5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:51.778684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cb8c9-1328-42f9-8223-4a9f76176a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:51.779781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cb8c9-1328-42f9-8223-4a9f76176a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.780137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cb8c9-1328-42f9-8223-4a9f76176a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.780533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cb8c9-1328-42f9-8223-4a9f76176a2f admin admin] PATH_INFO: `/v3/projects/b6f9d061ccdf4b87a4d12ecae54d71cf/users/f73fe5c27b1d4366ac0bb7d3d669ffe9/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.797823 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cb8c9-1328-42f9-8223-4a9f76176a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f9d061ccdf4b87a4d12ecae54d71cf, user_id=f73fe5c27b1d4366ac0bb7d3d669ffe9, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:51.800555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cb8c9-1328-42f9-8223-4a9f76176a2f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:51.816443 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3265/6600] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:51 2021] PUT /identity/v3/projects/b6f9d061ccdf4b87a4d12ecae54d71cf/users/f73fe5c27b1d4366ac0bb7d3d669ffe9/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:51.823133 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3336/6601] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:51 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:51.827624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cb8c9-1328-42f9-8223-4a9f76176a2f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:51.828193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9bddb-9658-48a6-9fc1-cc1ba215d315 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.828565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9bddb-9658-48a6-9fc1-cc1ba215d315 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.828951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9bddb-9658-48a6-9fc1-cc1ba215d315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.859232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-94b9bddb-9658-48a6-9fc1-cc1ba215d315 None None] MFA Rules not processed for user `f73fe5c27b1d4366ac0bb7d3d669ffe9`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:51.860621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-94b9bddb-9658-48a6-9fc1-cc1ba215d315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:51.893520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cb8c9-1328-42f9-8223-4a9f76176a2f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:51.899661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0dc735-8fd4-4697-878a-c7d10bab656d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:51.900322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0dc735-8fd4-4697-878a-c7d10bab656d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:51.900608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0dc735-8fd4-4697-878a-c7d10bab656d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:51.900886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0dc735-8fd4-4697-878a-c7d10bab656d admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:51.902032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0dc735-8fd4-4697-878a-c7d10bab656d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:51.904002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0dc735-8fd4-4697-878a-c7d10bab656d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:51.934557 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3337/6602] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:51 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:51.947489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9bddb-9658-48a6-9fc1-cc1ba215d315 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:51.948899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-94b9bddb-9658-48a6-9fc1-cc1ba215d315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:51.959535 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3266/6603] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:51 2021] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:51.960953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0dc735-8fd4-4697-878a-c7d10bab656d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:52.032125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9bddb-9658-48a6-9fc1-cc1ba215d315 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:52.047856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0dc735-8fd4-4697-878a-c7d10bab656d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:52.052861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d980f-07d7-4abb-8e21-ce8f41bcb861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:52.053653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d980f-07d7-4abb-8e21-ce8f41bcb861 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:52.054040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d980f-07d7-4abb-8e21-ce8f41bcb861 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:52.055129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d980f-07d7-4abb-8e21-ce8f41bcb861 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:52.056166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d980f-07d7-4abb-8e21-ce8f41bcb861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:52.058961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d980f-07d7-4abb-8e21-ce8f41bcb861 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:52.083275 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3267/6604] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:51 2021] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:52.087803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d980f-07d7-4abb-8e21-ce8f41bcb861 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:52.105058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d980f-07d7-4abb-8e21-ce8f41bcb861 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:52.108184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e1cf6-eb36-49a4-9962-6d7c365bd929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:52.109134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e1cf6-eb36-49a4-9962-6d7c365bd929 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:52.109982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e1cf6-eb36-49a4-9962-6d7c365bd929 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:52.110519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e1cf6-eb36-49a4-9962-6d7c365bd929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:52.120396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b25b1a-c7ee-4c69-b712-50f1e20f6f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:52.121152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b25b1a-c7ee-4c69-b712-50f1e20f6f49 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:52.122226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b25b1a-c7ee-4c69-b712-50f1e20f6f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:52.122695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b25b1a-c7ee-4c69-b712-50f1e20f6f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:52.124262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b25b1a-c7ee-4c69-b712-50f1e20f6f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:52.126806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b25b1a-c7ee-4c69-b712-50f1e20f6f49 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:52.144018 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3268/6605] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:52 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:52.145343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b25b1a-c7ee-4c69-b712-50f1e20f6f49 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:52.156787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b25b1a-c7ee-4c69-b712-50f1e20f6f49 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:52.162623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b780dc-a1a3-4af8-beee-0d83f317f9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:52.163456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b780dc-a1a3-4af8-beee-0d83f317f9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:52.163861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b780dc-a1a3-4af8-beee-0d83f317f9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:52.164265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b780dc-a1a3-4af8-beee-0d83f317f9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:52.165120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b780dc-a1a3-4af8-beee-0d83f317f9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:52.167152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b780dc-a1a3-4af8-beee-0d83f317f9b6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:52.180273 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3269/6606] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:52 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:52.184469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b780dc-a1a3-4af8-beee-0d83f317f9b6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:52.195847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b780dc-a1a3-4af8-beee-0d83f317f9b6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:52.201233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e1cf6-eb36-49a4-9962-6d7c365bd929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:52.201744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06625d2-7119-45d6-829b-6ec4b0e8a2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:52.202728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e1cf6-eb36-49a4-9962-6d7c365bd929 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:52.202846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06625d2-7119-45d6-829b-6ec4b0e8a2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:52.203490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06625d2-7119-45d6-829b-6ec4b0e8a2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:52.203610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06625d2-7119-45d6-829b-6ec4b0e8a2f4 admin admin] PATH_INFO: `/v3/projects/e24f90f562d842a3b3dd577c91ddfdd5/users/8b2ee23cbc5b42ad83c32c74f1f73d41/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:52.212941 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3338/6607] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:51 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:52.223787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06625d2-7119-45d6-829b-6ec4b0e8a2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e24f90f562d842a3b3dd577c91ddfdd5, user_id=8b2ee23cbc5b42ad83c32c74f1f73d41, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:52.226508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06625d2-7119-45d6-829b-6ec4b0e8a2f4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:52.253389 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3270/6608] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:52 2021] PUT /identity/v3/projects/e24f90f562d842a3b3dd577c91ddfdd5/users/8b2ee23cbc5b42ad83c32c74f1f73d41/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:07:52.263853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799710c8-cd5a-41fe-a10a-9195dcd638dd None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:52.264302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799710c8-cd5a-41fe-a10a-9195dcd638dd None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:52.264618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799710c8-cd5a-41fe-a10a-9195dcd638dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:52.303224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-799710c8-cd5a-41fe-a10a-9195dcd638dd None None] MFA Rules not processed for user `8b2ee23cbc5b42ad83c32c74f1f73d41`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:52.304907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-799710c8-cd5a-41fe-a10a-9195dcd638dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:52.392703 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3339/6609] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:52 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:07:52.397506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06625d2-7119-45d6-829b-6ec4b0e8a2f4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:52.481243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06625d2-7119-45d6-829b-6ec4b0e8a2f4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:52.488303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e655c4-1daf-4579-84b8-867c46c6c222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:52.489157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e655c4-1daf-4579-84b8-867c46c6c222 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:52.489402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e655c4-1daf-4579-84b8-867c46c6c222 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:52.489686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e655c4-1daf-4579-84b8-867c46c6c222 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:52.490443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e655c4-1daf-4579-84b8-867c46c6c222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:52.492359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e655c4-1daf-4579-84b8-867c46c6c222 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:52.525168 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3271/6610] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:52 2021] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:52.526183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799710c8-cd5a-41fe-a10a-9195dcd638dd None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:52.537374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799710c8-cd5a-41fe-a10a-9195dcd638dd None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:52.608748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02312513-dcd2-43b3-aac1-d3a2afaf4032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:52.610763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312513-dcd2-43b3-aac1-d3a2afaf4032 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:52.611226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312513-dcd2-43b3-aac1-d3a2afaf4032 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:52.611663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312513-dcd2-43b3-aac1-d3a2afaf4032 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:52.612474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02312513-dcd2-43b3-aac1-d3a2afaf4032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:52.614343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02312513-dcd2-43b3-aac1-d3a2afaf4032 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:52.644183 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3340/6611] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:52 2021] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:52.648395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e655c4-1daf-4579-84b8-867c46c6c222 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:52.663272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e655c4-1daf-4579-84b8-867c46c6c222 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:52.670700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154436f3-d77d-4158-a3c5-8a9b8b39377f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:52.672119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154436f3-d77d-4158-a3c5-8a9b8b39377f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:52.672624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154436f3-d77d-4158-a3c5-8a9b8b39377f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:52.673877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154436f3-d77d-4158-a3c5-8a9b8b39377f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:52.674954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154436f3-d77d-4158-a3c5-8a9b8b39377f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:52.676683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154436f3-d77d-4158-a3c5-8a9b8b39377f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:52.696748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02312513-dcd2-43b3-aac1-d3a2afaf4032 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:52.697356 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3272/6612] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:52 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:07:52.699184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154436f3-d77d-4158-a3c5-8a9b8b39377f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:52.701873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-154436f3-d77d-4158-a3c5-8a9b8b39377f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:52.722945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02312513-dcd2-43b3-aac1-d3a2afaf4032 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:52.729246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154436f3-d77d-4158-a3c5-8a9b8b39377f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:52.754240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65b678-7013-43b5-8173-1f23432772e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:52.754240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65b678-7013-43b5-8173-1f23432772e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:52.754715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:52.754822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65b678-7013-43b5-8173-1f23432772e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:52.754822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65b678-7013-43b5-8173-1f23432772e2 admin admin] PATH_INFO: `/v3/projects/051d73b6a502477ab57deef694352d33/users/ba89d362342c4faaa6ae74f2e4c6d110/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:52.754996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:52.754996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:52.754996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87 admin admin] PATH_INFO: `/v3/projects/e60600edf12344cc92541fd4f78df827` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:52.754996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e60600edf12344cc92541fd4f78df827)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:52.754996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:52.770624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65b678-7013-43b5-8173-1f23432772e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=051d73b6a502477ab57deef694352d33, user_id=ba89d362342c4faaa6ae74f2e4c6d110, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:52.776135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65b678-7013-43b5-8173-1f23432772e2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:52.816424 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3341/6613] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:52 2021] PUT /identity/v3/projects/051d73b6a502477ab57deef694352d33/users/ba89d362342c4faaa6ae74f2e4c6d110/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:07:52.818832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65b678-7013-43b5-8173-1f23432772e2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:52.837423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e60600edf12344cc92541fd4f78df827', 'request_id': 'req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:52.846038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e60600edf12344cc92541fd4f78df827', 'request_id': 'req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:52.853770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e60600edf12344cc92541fd4f78df827', 'request_id': 'req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:52.874111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87 admin admin] The token cache is being invalidate because project e60600edf12344cc92541fd4f78df827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:52.874635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:52.875406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:52.881861 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3273/6614] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:52 2021] DELETE /identity/v3/projects/e60600edf12344cc92541fd4f78df827 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:52.883043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:52.885714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:52.917273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65b678-7013-43b5-8173-1f23432772e2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:53.004664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1092fc6-e136-4074-aea7-284454667d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:53.006143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1092fc6-e136-4074-aea7-284454667d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:53.006577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1092fc6-e136-4074-aea7-284454667d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:53.007155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1092fc6-e136-4074-aea7-284454667d1d admin admin] PATH_INFO: `/v3/users/f73fe5c27b1d4366ac0bb7d3d669ffe9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:53.009509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1092fc6-e136-4074-aea7-284454667d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f73fe5c27b1d4366ac0bb7d3d669ffe9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:53.013360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1092fc6-e136-4074-aea7-284454667d1d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:53.039611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f9408-c89d-4cb7-855c-4c0befa9ac87 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:53.047050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e1c84-27c7-4747-b248-56695a084ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:53.047852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e1c84-27c7-4747-b248-56695a084ffd admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:53.048220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e1c84-27c7-4747-b248-56695a084ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:53.048526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e1c84-27c7-4747-b248-56695a084ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:53.049482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e1c84-27c7-4747-b248-56695a084ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:53.051489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e1c84-27c7-4747-b248-56695a084ffd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:53.065554 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3274/6615] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:52 2021] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:53.069825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e1c84-27c7-4747-b248-56695a084ffd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:53.072372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8b5e1c84-27c7-4747-b248-56695a084ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:53.081871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a1092fc6-e136-4074-aea7-284454667d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f73fe5c27b1d4366ac0bb7d3d669ffe9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.087714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e1c84-27c7-4747-b248-56695a084ffd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:53.092672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a1092fc6-e136-4074-aea7-284454667d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f73fe5c27b1d4366ac0bb7d3d669ffe9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.093407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a1092fc6-e136-4074-aea7-284454667d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f73fe5c27b1d4366ac0bb7d3d669ffe9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.095381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd5d80-cc44-4ddc-9efd-3467d52a0973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:53.096794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd5d80-cc44-4ddc-9efd-3467d52a0973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:53.097128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd5d80-cc44-4ddc-9efd-3467d52a0973 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:53.097514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd5d80-cc44-4ddc-9efd-3467d52a0973 admin admin] PATH_INFO: `/v3/users/15ba7470a904451a984ad9ac3433f856` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:53.098950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd5d80-cc44-4ddc-9efd-3467d52a0973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ba7470a904451a984ad9ac3433f856)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:53.101334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd5d80-cc44-4ddc-9efd-3467d52a0973 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:53.107981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a1092fc6-e136-4074-aea7-284454667d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f73fe5c27b1d4366ac0bb7d3d669ffe9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.119344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a1092fc6-e136-4074-aea7-284454667d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f73fe5c27b1d4366ac0bb7d3d669ffe9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.127111 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3342/6616] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:52 2021] DELETE /identity/v3/users/f73fe5c27b1d4366ac0bb7d3d669ffe9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:53.128162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1092fc6-e136-4074-aea7-284454667d1d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:53.129633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a1092fc6-e136-4074-aea7-284454667d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:53.163442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4fcd5d80-cc44-4ddc-9efd-3467d52a0973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ba7470a904451a984ad9ac3433f856'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.171610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4fcd5d80-cc44-4ddc-9efd-3467d52a0973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ba7470a904451a984ad9ac3433f856'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.185419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4fcd5d80-cc44-4ddc-9efd-3467d52a0973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ba7470a904451a984ad9ac3433f856'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.186593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4fcd5d80-cc44-4ddc-9efd-3467d52a0973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ba7470a904451a984ad9ac3433f856'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.197688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4fcd5d80-cc44-4ddc-9efd-3467d52a0973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ba7470a904451a984ad9ac3433f856'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.211280 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3275/6617] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:53 2021] DELETE /identity/v3/users/15ba7470a904451a984ad9ac3433f856 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:53.212195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd5d80-cc44-4ddc-9efd-3467d52a0973 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:53.214085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4fcd5d80-cc44-4ddc-9efd-3467d52a0973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:53.307523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd5d80-cc44-4ddc-9efd-3467d52a0973 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:53.315931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593578f5-9a1d-4bfa-b3bd-2e88a44cc691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:53.317265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593578f5-9a1d-4bfa-b3bd-2e88a44cc691 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:53.317823 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593578f5-9a1d-4bfa-b3bd-2e88a44cc691 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:53.319614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593578f5-9a1d-4bfa-b3bd-2e88a44cc691 admin admin] PATH_INFO: `/v3/projects/051d73b6a502477ab57deef694352d33/users/ba89d362342c4faaa6ae74f2e4c6d110/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:53.320109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1092fc6-e136-4074-aea7-284454667d1d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:53.322242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593578f5-9a1d-4bfa-b3bd-2e88a44cc691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=051d73b6a502477ab57deef694352d33, user_id=ba89d362342c4faaa6ae74f2e4c6d110, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:53.325959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593578f5-9a1d-4bfa-b3bd-2e88a44cc691 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:53.341247 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3276/6618] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:53 2021] PUT /identity/v3/projects/051d73b6a502477ab57deef694352d33/users/ba89d362342c4faaa6ae74f2e4c6d110/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:53.355288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f8742-5222-46bd-9067-12576aa12c94 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:53.355787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f8742-5222-46bd-9067-12576aa12c94 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:53.356226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f8742-5222-46bd-9067-12576aa12c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:53.386122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-220f8742-5222-46bd-9067-12576aa12c94 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:53.388003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-220f8742-5222-46bd-9067-12576aa12c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:53.447769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da8348-0252-4767-a216-c5898d990444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:53.449392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da8348-0252-4767-a216-c5898d990444 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:53.449999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da8348-0252-4767-a216-c5898d990444 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:53.450394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da8348-0252-4767-a216-c5898d990444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:53.453504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-32da8348-0252-4767-a216-c5898d990444 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:53.488389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da8348-0252-4767-a216-c5898d990444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:53.490779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da8348-0252-4767-a216-c5898d990444 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:53.493858 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3277/6619] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:53.495860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46222fb-5807-4a33-8e31-1c6e488175a7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:53.496321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46222fb-5807-4a33-8e31-1c6e488175a7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:53.497110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46222fb-5807-4a33-8e31-1c6e488175a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:53.513406 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3343/6620] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:53 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:53.521116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da8348-0252-4767-a216-c5898d990444 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:53.522511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-32da8348-0252-4767-a216-c5898d990444 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:53.545310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f46222fb-5807-4a33-8e31-1c6e488175a7 None None] MFA Rules not processed for user `ba89d362342c4faaa6ae74f2e4c6d110`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:53.550494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f46222fb-5807-4a33-8e31-1c6e488175a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:53.624744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da8348-0252-4767-a216-c5898d990444 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:53.735737 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3278/6621] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:53 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:53.735737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46222fb-5807-4a33-8e31-1c6e488175a7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:53.735737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f46222fb-5807-4a33-8e31-1c6e488175a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:53.752931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b48abf-f021-46f4-a941-b34b045a014a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:53.754358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b48abf-f021-46f4-a941-b34b045a014a service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:53.754977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b48abf-f021-46f4-a941-b34b045a014a service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:53.755467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b48abf-f021-46f4-a941-b34b045a014a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:53.768165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b48abf-f021-46f4-a941-b34b045a014a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:53.769614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b48abf-f021-46f4-a941-b34b045a014a service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:53.778319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46222fb-5807-4a33-8e31-1c6e488175a7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:53.781305 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3344/6622] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:07:53.782319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b48abf-f021-46f4-a941-b34b045a014a service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:53.783758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-01b48abf-f021-46f4-a941-b34b045a014a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:53.785812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7155b3-0b46-440a-9a5e-6790e22bb15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:53.786845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7155b3-0b46-440a-9a5e-6790e22bb15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:53.787139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7155b3-0b46-440a-9a5e-6790e22bb15d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:53.787433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7155b3-0b46-440a-9a5e-6790e22bb15d admin admin] PATH_INFO: `/v3/projects/1c16be93be55410bbdf8eca25d05ff27` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:53.788815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7155b3-0b46-440a-9a5e-6790e22bb15d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c16be93be55410bbdf8eca25d05ff27)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:53.791454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7155b3-0b46-440a-9a5e-6790e22bb15d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:53.798288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b48abf-f021-46f4-a941-b34b045a014a service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:53.804216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f52f2d-50b9-4b52-910d-f8654759339a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:53.805539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f52f2d-50b9-4b52-910d-f8654759339a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:53.806341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f52f2d-50b9-4b52-910d-f8654759339a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:53.806635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f52f2d-50b9-4b52-910d-f8654759339a admin admin] PATH_INFO: `/v3/users/41899747ad854568b0d9cfd6f4f2ad63` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:53.808108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f52f2d-50b9-4b52-910d-f8654759339a admin admin] RBAC: Authorizing `identity:delete_user(user_id=41899747ad854568b0d9cfd6f4f2ad63)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:53.810469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f52f2d-50b9-4b52-910d-f8654759339a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:53.852379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5b7155b3-0b46-440a-9a5e-6790e22bb15d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c16be93be55410bbdf8eca25d05ff27', 'request_id': 'req-5b7155b3-0b46-440a-9a5e-6790e22bb15d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.860194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5b7155b3-0b46-440a-9a5e-6790e22bb15d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c16be93be55410bbdf8eca25d05ff27', 'request_id': 'req-5b7155b3-0b46-440a-9a5e-6790e22bb15d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.865983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5b7155b3-0b46-440a-9a5e-6790e22bb15d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c16be93be55410bbdf8eca25d05ff27', 'request_id': 'req-5b7155b3-0b46-440a-9a5e-6790e22bb15d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.869798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-20f52f2d-50b9-4b52-910d-f8654759339a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41899747ad854568b0d9cfd6f4f2ad63'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.879597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5b7155b3-0b46-440a-9a5e-6790e22bb15d admin admin] The token cache is being invalidate because project 1c16be93be55410bbdf8eca25d05ff27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:53.879888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5b7155b3-0b46-440a-9a5e-6790e22bb15d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.880522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5b7155b3-0b46-440a-9a5e-6790e22bb15d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.880932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-20f52f2d-50b9-4b52-910d-f8654759339a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41899747ad854568b0d9cfd6f4f2ad63'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.881785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-20f52f2d-50b9-4b52-910d-f8654759339a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41899747ad854568b0d9cfd6f4f2ad63'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.882073 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3279/6623] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:53 2021] DELETE /identity/v3/projects/1c16be93be55410bbdf8eca25d05ff27 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:53.885884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7155b3-0b46-440a-9a5e-6790e22bb15d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:53.887279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5b7155b3-0b46-440a-9a5e-6790e22bb15d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:53.900874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-20f52f2d-50b9-4b52-910d-f8654759339a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41899747ad854568b0d9cfd6f4f2ad63'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.917899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-20f52f2d-50b9-4b52-910d-f8654759339a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41899747ad854568b0d9cfd6f4f2ad63'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:53.927702 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3345/6624] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:53 2021] DELETE /identity/v3/users/41899747ad854568b0d9cfd6f4f2ad63 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:53.928725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f52f2d-50b9-4b52-910d-f8654759339a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:53.930122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-20f52f2d-50b9-4b52-910d-f8654759339a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:53.966197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7155b3-0b46-440a-9a5e-6790e22bb15d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:54.037904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f52f2d-50b9-4b52-910d-f8654759339a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:54.042700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707483f9-5aa7-49e2-9668-78dbd99a50f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:54.043361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707483f9-5aa7-49e2-9668-78dbd99a50f6 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:54.043643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707483f9-5aa7-49e2-9668-78dbd99a50f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:54.044280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707483f9-5aa7-49e2-9668-78dbd99a50f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:54.045493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61dc59-ab49-41bc-a200-e32c984f714c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:54.045723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-707483f9-5aa7-49e2-9668-78dbd99a50f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:54.046831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61dc59-ab49-41bc-a200-e32c984f714c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:54.047301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61dc59-ab49-41bc-a200-e32c984f714c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:54.047751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61dc59-ab49-41bc-a200-e32c984f714c admin admin] PATH_INFO: `/v3/users/a9f431db509c476ba225e7b5f3bbd284` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:54.050006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61dc59-ab49-41bc-a200-e32c984f714c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f431db509c476ba225e7b5f3bbd284)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:54.052729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61dc59-ab49-41bc-a200-e32c984f714c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:54.109905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707483f9-5aa7-49e2-9668-78dbd99a50f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:54.111443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707483f9-5aa7-49e2-9668-78dbd99a50f6 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:54.113323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ad61dc59-ab49-41bc-a200-e32c984f714c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f431db509c476ba225e7b5f3bbd284'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.121108 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3280/6625] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:53 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:54.122956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ad61dc59-ab49-41bc-a200-e32c984f714c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f431db509c476ba225e7b5f3bbd284'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.123866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ad61dc59-ab49-41bc-a200-e32c984f714c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f431db509c476ba225e7b5f3bbd284'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.138218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ad61dc59-ab49-41bc-a200-e32c984f714c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f431db509c476ba225e7b5f3bbd284'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.147765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ad61dc59-ab49-41bc-a200-e32c984f714c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f431db509c476ba225e7b5f3bbd284'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.160877 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3346/6626] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:53 2021] DELETE /identity/v3/users/a9f431db509c476ba225e7b5f3bbd284 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:54.234963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707483f9-5aa7-49e2-9668-78dbd99a50f6 service cinder] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:54.236721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-707483f9-5aa7-49e2-9668-78dbd99a50f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:54.257859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61dc59-ab49-41bc-a200-e32c984f714c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:54.262836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ad61dc59-ab49-41bc-a200-e32c984f714c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:54.267085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707483f9-5aa7-49e2-9668-78dbd99a50f6 service cinder] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:54.374811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebd541-5069-47e2-a72c-2174d06c896f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:54.375021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61dc59-ab49-41bc-a200-e32c984f714c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:54.375800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebd541-5069-47e2-a72c-2174d06c896f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:54.376388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebd541-5069-47e2-a72c-2174d06c896f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:54.376539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebd541-5069-47e2-a72c-2174d06c896f admin admin] PATH_INFO: `/v3/projects/40830f131f4f4c8f9795130d392a377c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:54.379133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebd541-5069-47e2-a72c-2174d06c896f admin admin] RBAC: Authorizing `identity:delete_project(project_id=40830f131f4f4c8f9795130d392a377c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:54.380857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2c58b-78d1-4fff-878a-beb0829b0834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:54.381600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2c58b-78d1-4fff-878a-beb0829b0834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:54.381751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebd541-5069-47e2-a72c-2174d06c896f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:54.382234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2c58b-78d1-4fff-878a-beb0829b0834 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:54.382378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2c58b-78d1-4fff-878a-beb0829b0834 admin admin] PATH_INFO: `/v3/projects/b6f9d061ccdf4b87a4d12ecae54d71cf` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:54.383984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2c58b-78d1-4fff-878a-beb0829b0834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f9d061ccdf4b87a4d12ecae54d71cf)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:54.386230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2c58b-78d1-4fff-878a-beb0829b0834 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:54.452903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3fa2c58b-78d1-4fff-878a-beb0829b0834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f9d061ccdf4b87a4d12ecae54d71cf', 'request_id': 'req-3fa2c58b-78d1-4fff-878a-beb0829b0834'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.461649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3fa2c58b-78d1-4fff-878a-beb0829b0834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f9d061ccdf4b87a4d12ecae54d71cf', 'request_id': 'req-3fa2c58b-78d1-4fff-878a-beb0829b0834'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.473922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3fa2c58b-78d1-4fff-878a-beb0829b0834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f9d061ccdf4b87a4d12ecae54d71cf', 'request_id': 'req-3fa2c58b-78d1-4fff-878a-beb0829b0834'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.502300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-afebd541-5069-47e2-a72c-2174d06c896f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40830f131f4f4c8f9795130d392a377c', 'request_id': 'req-afebd541-5069-47e2-a72c-2174d06c896f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.510428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3fa2c58b-78d1-4fff-878a-beb0829b0834 admin admin] The token cache is being invalidate because project b6f9d061ccdf4b87a4d12ecae54d71cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:54.510428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3fa2c58b-78d1-4fff-878a-beb0829b0834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.513242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3fa2c58b-78d1-4fff-878a-beb0829b0834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.515995 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3347/6627] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:54 2021] DELETE /identity/v3/projects/b6f9d061ccdf4b87a4d12ecae54d71cf => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:54.520413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-afebd541-5069-47e2-a72c-2174d06c896f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40830f131f4f4c8f9795130d392a377c', 'request_id': 'req-afebd541-5069-47e2-a72c-2174d06c896f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.522152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489bf71-2664-4c56-819a-623901b13433 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:54.522473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489bf71-2664-4c56-819a-623901b13433 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:54.522855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489bf71-2664-4c56-819a-623901b13433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:54.532733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-afebd541-5069-47e2-a72c-2174d06c896f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40830f131f4f4c8f9795130d392a377c', 'request_id': 'req-afebd541-5069-47e2-a72c-2174d06c896f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.563026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d489bf71-2664-4c56-819a-623901b13433 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:54.565578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-afebd541-5069-47e2-a72c-2174d06c896f admin admin] The token cache is being invalidate because project 40830f131f4f4c8f9795130d392a377c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:54.565717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-afebd541-5069-47e2-a72c-2174d06c896f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.567397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d489bf71-2664-4c56-819a-623901b13433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:54.568544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-afebd541-5069-47e2-a72c-2174d06c896f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.572761 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3281/6628] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:54 2021] DELETE /identity/v3/projects/40830f131f4f4c8f9795130d392a377c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:54.577068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebd541-5069-47e2-a72c-2174d06c896f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:54.579651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-afebd541-5069-47e2-a72c-2174d06c896f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:54.656002 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3348/6629] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:54.657606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489bf71-2664-4c56-819a-623901b13433 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:54.660705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d489bf71-2664-4c56-819a-623901b13433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:54.684067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489bf71-2664-4c56-819a-623901b13433 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:54.690681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436406a-206d-44bb-ac23-898f1e9d6a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:54.691674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436406a-206d-44bb-ac23-898f1e9d6a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:54.692379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436406a-206d-44bb-ac23-898f1e9d6a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:54.692733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436406a-206d-44bb-ac23-898f1e9d6a76 admin admin] PATH_INFO: `/v3/projects/c61df95a88b54b6bb5d2906f54abe43b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:54.694099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436406a-206d-44bb-ac23-898f1e9d6a76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c61df95a88b54b6bb5d2906f54abe43b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:54.704240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436406a-206d-44bb-ac23-898f1e9d6a76 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:54.718501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebd541-5069-47e2-a72c-2174d06c896f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:54.724666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94cd74-5d42-4ceb-9fc0-b36817554719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:54.726498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94cd74-5d42-4ceb-9fc0-b36817554719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:54.727591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94cd74-5d42-4ceb-9fc0-b36817554719 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:54.728023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94cd74-5d42-4ceb-9fc0-b36817554719 admin admin] PATH_INFO: `/v3/users/ebde756079de4b8b91fef57d80167dd9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:54.729535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94cd74-5d42-4ceb-9fc0-b36817554719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebde756079de4b8b91fef57d80167dd9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:54.731746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94cd74-5d42-4ceb-9fc0-b36817554719 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:54.774426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3436406a-206d-44bb-ac23-898f1e9d6a76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c61df95a88b54b6bb5d2906f54abe43b', 'request_id': 'req-3436406a-206d-44bb-ac23-898f1e9d6a76'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.799340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3436406a-206d-44bb-ac23-898f1e9d6a76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c61df95a88b54b6bb5d2906f54abe43b', 'request_id': 'req-3436406a-206d-44bb-ac23-898f1e9d6a76'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.818460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3436406a-206d-44bb-ac23-898f1e9d6a76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c61df95a88b54b6bb5d2906f54abe43b', 'request_id': 'req-3436406a-206d-44bb-ac23-898f1e9d6a76'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.836053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3436406a-206d-44bb-ac23-898f1e9d6a76 admin admin] The token cache is being invalidate because project c61df95a88b54b6bb5d2906f54abe43b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:54.836419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3436406a-206d-44bb-ac23-898f1e9d6a76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.837449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3436406a-206d-44bb-ac23-898f1e9d6a76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.839605 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3349/6630] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:54 2021] DELETE /identity/v3/projects/c61df95a88b54b6bb5d2906f54abe43b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:54.840849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd571-3ede-4750-84d5-62d7ecfcc2e0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:54.841241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd571-3ede-4750-84d5-62d7ecfcc2e0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:54.842383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd571-3ede-4750-84d5-62d7ecfcc2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:54.846490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cb94cd74-5d42-4ceb-9fc0-b36817554719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebde756079de4b8b91fef57d80167dd9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.863090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cb94cd74-5d42-4ceb-9fc0-b36817554719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebde756079de4b8b91fef57d80167dd9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.877658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-cd9dd571-3ede-4750-84d5-62d7ecfcc2e0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:54.880094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cd9dd571-3ede-4750-84d5-62d7ecfcc2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:54.895484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cb94cd74-5d42-4ceb-9fc0-b36817554719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebde756079de4b8b91fef57d80167dd9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.896840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cb94cd74-5d42-4ceb-9fc0-b36817554719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebde756079de4b8b91fef57d80167dd9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.920780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cb94cd74-5d42-4ceb-9fc0-b36817554719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebde756079de4b8b91fef57d80167dd9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:54.943180 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3282/6631] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:54 2021] DELETE /identity/v3/users/ebde756079de4b8b91fef57d80167dd9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:54.950798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f36f3f-16dd-4c60-a8db-81659b643997 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:54.951624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f36f3f-16dd-4c60-a8db-81659b643997 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:54.951910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f36f3f-16dd-4c60-a8db-81659b643997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:54.964441 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3350/6632] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:54.969968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dd571-3ede-4750-84d5-62d7ecfcc2e0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:54.993134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dd571-3ede-4750-84d5-62d7ecfcc2e0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:55.028202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e8f36f3f-16dd-4c60-a8db-81659b643997 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:55.030373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e8f36f3f-16dd-4c60-a8db-81659b643997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:55.110933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936bbb7-cf14-4022-82de-da477d0229d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:55.111714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936bbb7-cf14-4022-82de-da477d0229d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.112144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936bbb7-cf14-4022-82de-da477d0229d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.112609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936bbb7-cf14-4022-82de-da477d0229d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:55.113658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936bbb7-cf14-4022-82de-da477d0229d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:07:55.114040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936bbb7-cf14-4022-82de-da477d0229d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:55.116315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936bbb7-cf14-4022-82de-da477d0229d7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:55.136577 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3351/6633] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:07:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:07:55.136577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5a1d5-c861-4b49-8432-1d24f3468946 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.136577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5a1d5-c861-4b49-8432-1d24f3468946 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.136577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5a1d5-c861-4b49-8432-1d24f3468946 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:55.137650 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3352/6634] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 21:07:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 21:07:55.139354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5a1d5-c861-4b49-8432-1d24f3468946 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:55.144248 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3283/6635] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:55.154266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5a1d5-c861-4b49-8432-1d24f3468946 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:55.159807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8e0f1-6d33-4c23-a588-16dad28ccbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:55.160476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8e0f1-6d33-4c23-a588-16dad28ccbdc admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.160766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8e0f1-6d33-4c23-a588-16dad28ccbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.161046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8e0f1-6d33-4c23-a588-16dad28ccbdc admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:55.161911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8e0f1-6d33-4c23-a588-16dad28ccbdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:55.162310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433340e9-b595-4915-91ec-b6c75c72b504 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.162763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433340e9-b595-4915-91ec-b6c75c72b504 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.164125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8e0f1-6d33-4c23-a588-16dad28ccbdc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:55.165164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433340e9-b595-4915-91ec-b6c75c72b504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:55.209020 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3353/6636] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:55 2021] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:55.213375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4895a2f-6451-4ef8-aa0d-0174cb6ae583 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.213669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4895a2f-6451-4ef8-aa0d-0174cb6ae583 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.213951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4895a2f-6451-4ef8-aa0d-0174cb6ae583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:55.218954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-433340e9-b595-4915-91ec-b6c75c72b504 None None] MFA Rules not processed for user `6f8eeb55c523480fb45d4bbb8afe8e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:55.220188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-433340e9-b595-4915-91ec-b6c75c72b504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:55.251710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c4895a2f-6451-4ef8-aa0d-0174cb6ae583 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:55.253039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c4895a2f-6451-4ef8-aa0d-0174cb6ae583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:55.363382 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3284/6637] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:07:55 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:55.364916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433340e9-b595-4915-91ec-b6c75c72b504 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:55.377568 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3354/6638] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:55.378699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4895a2f-6451-4ef8-aa0d-0174cb6ae583 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:55.381325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433340e9-b595-4915-91ec-b6c75c72b504 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:55.381937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c4895a2f-6451-4ef8-aa0d-0174cb6ae583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:55.394626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a187da9-c7da-49c4-81aa-d148f7d1922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:55.395586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a187da9-c7da-49c4-81aa-d148f7d1922c admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.396117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a187da9-c7da-49c4-81aa-d148f7d1922c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.396235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a187da9-c7da-49c4-81aa-d148f7d1922c admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:55.396318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4895a2f-6451-4ef8-aa0d-0174cb6ae583 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:55.396855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a187da9-c7da-49c4-81aa-d148f7d1922c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:55.399107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a187da9-c7da-49c4-81aa-d148f7d1922c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:55.401808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc08ec-2799-4bff-9e06-143251cb1482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:55.403119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc08ec-2799-4bff-9e06-143251cb1482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.403670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc08ec-2799-4bff-9e06-143251cb1482 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.404448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc08ec-2799-4bff-9e06-143251cb1482 admin admin] PATH_INFO: `/v3/projects/5d21e200e1514211883e9b81c0a6b006` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:55.406231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc08ec-2799-4bff-9e06-143251cb1482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d21e200e1514211883e9b81c0a6b006)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:55.410846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc08ec-2799-4bff-9e06-143251cb1482 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:55.436112 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3285/6639] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:55 2021] POST /identity/v3/users => generated 285 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:55.437172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a187da9-c7da-49c4-81aa-d148f7d1922c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:55.454390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a187da9-c7da-49c4-81aa-d148f7d1922c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:55.461102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face2d23-01bb-4536-a960-8886be584982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:55.462229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face2d23-01bb-4536-a960-8886be584982 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.462827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face2d23-01bb-4536-a960-8886be584982 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.463374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face2d23-01bb-4536-a960-8886be584982 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:55.464438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face2d23-01bb-4536-a960-8886be584982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:07:55.464969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face2d23-01bb-4536-a960-8886be584982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:55.467184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face2d23-01bb-4536-a960-8886be584982 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:55.487893 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3286/6640] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:07:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:07:55.488781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face2d23-01bb-4536-a960-8886be584982 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:55.490532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-face2d23-01bb-4536-a960-8886be584982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:55.493541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e3bc08ec-2799-4bff-9e06-143251cb1482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d21e200e1514211883e9b81c0a6b006', 'request_id': 'req-e3bc08ec-2799-4bff-9e06-143251cb1482'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:55.502004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e3bc08ec-2799-4bff-9e06-143251cb1482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d21e200e1514211883e9b81c0a6b006', 'request_id': 'req-e3bc08ec-2799-4bff-9e06-143251cb1482'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:55.507820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face2d23-01bb-4536-a960-8886be584982 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:55.511896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e3bc08ec-2799-4bff-9e06-143251cb1482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d21e200e1514211883e9b81c0a6b006', 'request_id': 'req-e3bc08ec-2799-4bff-9e06-143251cb1482'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:55.523346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e3bc08ec-2799-4bff-9e06-143251cb1482 admin admin] The token cache is being invalidate because project 5d21e200e1514211883e9b81c0a6b006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:55.523638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e3bc08ec-2799-4bff-9e06-143251cb1482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:55.524377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e3bc08ec-2799-4bff-9e06-143251cb1482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:55.527081 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3355/6641] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:55 2021] DELETE /identity/v3/projects/5d21e200e1514211883e9b81c0a6b006 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:55.527320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc08ec-2799-4bff-9e06-143251cb1482 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:55.528759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e3bc08ec-2799-4bff-9e06-143251cb1482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:55.563193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda515c-a269-40b4-bbcd-1bb56bd0ccf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:55.563841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda515c-a269-40b4-bbcd-1bb56bd0ccf1 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.564131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda515c-a269-40b4-bbcd-1bb56bd0ccf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.564386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda515c-a269-40b4-bbcd-1bb56bd0ccf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:55.566275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eeda515c-a269-40b4-bbcd-1bb56bd0ccf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:55.576970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda515c-a269-40b4-bbcd-1bb56bd0ccf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:55.578797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda515c-a269-40b4-bbcd-1bb56bd0ccf1 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:55.588087 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3287/6642] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:55 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:55.588269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda515c-a269-40b4-bbcd-1bb56bd0ccf1 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:55.589819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eeda515c-a269-40b4-bbcd-1bb56bd0ccf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:55.608332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc08ec-2799-4bff-9e06-143251cb1482 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:55.614191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea2302-1946-46cd-b867-680d20e820bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:55.614895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea2302-1946-46cd-b867-680d20e820bd admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.615500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea2302-1946-46cd-b867-680d20e820bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.615619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea2302-1946-46cd-b867-680d20e820bd admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:55.616316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea2302-1946-46cd-b867-680d20e820bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:55.618094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea2302-1946-46cd-b867-680d20e820bd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:55.633015 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3356/6643] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:55 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:55.634312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b6ddf-1357-4192-a71e-e67e1080ff49 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.634585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b6ddf-1357-4192-a71e-e67e1080ff49 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.634868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b6ddf-1357-4192-a71e-e67e1080ff49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:55.661753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d19b6ddf-1357-4192-a71e-e67e1080ff49 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:55.663454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d19b6ddf-1357-4192-a71e-e67e1080ff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:55.704880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda515c-a269-40b4-bbcd-1bb56bd0ccf1 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:55.716083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38478d6a-2498-4937-83d7-c22cbfe58e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:55.716961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38478d6a-2498-4937-83d7-c22cbfe58e37 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.717255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38478d6a-2498-4937-83d7-c22cbfe58e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.718437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38478d6a-2498-4937-83d7-c22cbfe58e37 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:55.719203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38478d6a-2498-4937-83d7-c22cbfe58e37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:55.721117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38478d6a-2498-4937-83d7-c22cbfe58e37 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:55.731895 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3357/6644] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:07:55 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:55.736552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613ee08-5ec3-42f9-9db9-edf687e05a35 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.736552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613ee08-5ec3-42f9-9db9-edf687e05a35 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.736552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613ee08-5ec3-42f9-9db9-edf687e05a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:55.755902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1613ee08-5ec3-42f9-9db9-edf687e05a35 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:55.757435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1613ee08-5ec3-42f9-9db9-edf687e05a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:55.767091 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3358/6645] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:55.773793 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3288/6646] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:55 2021] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:55.774143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613ee08-5ec3-42f9-9db9-edf687e05a35 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:55.774243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38478d6a-2498-4937-83d7-c22cbfe58e37 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:55.790543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613ee08-5ec3-42f9-9db9-edf687e05a35 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:55.849281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38478d6a-2498-4937-83d7-c22cbfe58e37 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:55.854350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986008a-4993-48df-914e-f2246c3f54a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:55.855025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986008a-4993-48df-914e-f2246c3f54a2 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.855664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986008a-4993-48df-914e-f2246c3f54a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.855664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986008a-4993-48df-914e-f2246c3f54a2 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:55.856262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986008a-4993-48df-914e-f2246c3f54a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:55.858806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986008a-4993-48df-914e-f2246c3f54a2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:55.859827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad112b-796c-448e-b28e-f07f7d1782b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:55.860494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad112b-796c-448e-b28e-f07f7d1782b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.860780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad112b-796c-448e-b28e-f07f7d1782b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.861062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad112b-796c-448e-b28e-f07f7d1782b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:55.861795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad112b-796c-448e-b28e-f07f7d1782b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:55.863403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad112b-796c-448e-b28e-f07f7d1782b6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:55.873835 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3359/6647] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:55 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:55.875604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35150dfb-f4a2-4bd3-8cd0-68dcfaa762bc None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.876054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35150dfb-f4a2-4bd3-8cd0-68dcfaa762bc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.876493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35150dfb-f4a2-4bd3-8cd0-68dcfaa762bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:55.879361 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3289/6648] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:55 2021] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:07:55.880272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986008a-4993-48df-914e-f2246c3f54a2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:55.882484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3986008a-4993-48df-914e-f2246c3f54a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:55.897074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-35150dfb-f4a2-4bd3-8cd0-68dcfaa762bc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:55.898279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-35150dfb-f4a2-4bd3-8cd0-68dcfaa762bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:55.907010 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3360/6649] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:55.907866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35150dfb-f4a2-4bd3-8cd0-68dcfaa762bc None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:55.911710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-35150dfb-f4a2-4bd3-8cd0-68dcfaa762bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:55.945685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986008a-4993-48df-914e-f2246c3f54a2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:55.950772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79414a9d-fc35-4e5c-8979-245c76a04382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:55.951603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79414a9d-fc35-4e5c-8979-245c76a04382 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.951902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79414a9d-fc35-4e5c-8979-245c76a04382 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.952475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79414a9d-fc35-4e5c-8979-245c76a04382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:55.954353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-79414a9d-fc35-4e5c-8979-245c76a04382 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:55.985367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35150dfb-f4a2-4bd3-8cd0-68dcfaa762bc None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:55.990802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13630add-84f1-46d7-b9e0-2bd856d8de10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:55.991454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13630add-84f1-46d7-b9e0-2bd856d8de10 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:55.991861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13630add-84f1-46d7-b9e0-2bd856d8de10 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:55.992141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13630add-84f1-46d7-b9e0-2bd856d8de10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:56.012220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79414a9d-fc35-4e5c-8979-245c76a04382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:56.013803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79414a9d-fc35-4e5c-8979-245c76a04382 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:56.023357 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3290/6650] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:55 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:56.023928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79414a9d-fc35-4e5c-8979-245c76a04382 service cinder] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:56.034922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79414a9d-fc35-4e5c-8979-245c76a04382 service cinder] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:56.040857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b407a5-b424-4f8e-98bd-f58023875843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:56.042105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b407a5-b424-4f8e-98bd-f58023875843 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:56.042567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b407a5-b424-4f8e-98bd-f58023875843 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:56.042989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b407a5-b424-4f8e-98bd-f58023875843 admin admin] PATH_INFO: `/v3/projects/004eaca0de364bf0b1eb98b07cca5371/users/d3603c9356e04d0386f3693fce17edbf/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:56.059712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13630add-84f1-46d7-b9e0-2bd856d8de10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:56.060096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b407a5-b424-4f8e-98bd-f58023875843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004eaca0de364bf0b1eb98b07cca5371, user_id=d3603c9356e04d0386f3693fce17edbf, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:56.061505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13630add-84f1-46d7-b9e0-2bd856d8de10 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:56.064397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b407a5-b424-4f8e-98bd-f58023875843 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:56.071737 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3361/6651] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:07:55 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:07:56.072586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13630add-84f1-46d7-b9e0-2bd856d8de10 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:56.083415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13630add-84f1-46d7-b9e0-2bd856d8de10 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:56.096746 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3291/6652] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:56 2021] PUT /identity/v3/projects/004eaca0de364bf0b1eb98b07cca5371/users/d3603c9356e04d0386f3693fce17edbf/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:56.097676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b407a5-b424-4f8e-98bd-f58023875843 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:56.174683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac84409-d525-4805-91f3-2a7d3bbb2611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:56.175519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac84409-d525-4805-91f3-2a7d3bbb2611 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:56.175842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac84409-d525-4805-91f3-2a7d3bbb2611 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:56.176124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac84409-d525-4805-91f3-2a7d3bbb2611 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:56.176945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac84409-d525-4805-91f3-2a7d3bbb2611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:56.179367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac84409-d525-4805-91f3-2a7d3bbb2611 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:56.191630 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3362/6653] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:56 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:56.193751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74cb17-5d50-4516-a49d-7a1daa1f0a48 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:56.193988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74cb17-5d50-4516-a49d-7a1daa1f0a48 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:56.194553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74cb17-5d50-4516-a49d-7a1daa1f0a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:56.238827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bd74cb17-5d50-4516-a49d-7a1daa1f0a48 None None] MFA Rules not processed for user `d3603c9356e04d0386f3693fce17edbf`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:56.240388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bd74cb17-5d50-4516-a49d-7a1daa1f0a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:56.259949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b407a5-b424-4f8e-98bd-f58023875843 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:56.280406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8faf910-ab00-4126-ba5f-9a807481884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:56.281598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faf910-ab00-4126-ba5f-9a807481884e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:56.283975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faf910-ab00-4126-ba5f-9a807481884e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:56.284332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faf910-ab00-4126-ba5f-9a807481884e admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:56.285170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8faf910-ab00-4126-ba5f-9a807481884e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:07:56.285750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8faf910-ab00-4126-ba5f-9a807481884e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:56.290951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8faf910-ab00-4126-ba5f-9a807481884e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:56.322600 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3292/6654] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:07:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:07:56.322600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8faf910-ab00-4126-ba5f-9a807481884e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:56.344407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8faf910-ab00-4126-ba5f-9a807481884e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:56.357257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2d52a-7d40-4efc-9d31-84ec47019df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:56.358005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2d52a-7d40-4efc-9d31-84ec47019df7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:56.358367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2d52a-7d40-4efc-9d31-84ec47019df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:56.362028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2d52a-7d40-4efc-9d31-84ec47019df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:56.363033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2d52a-7d40-4efc-9d31-84ec47019df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:56.367533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2d52a-7d40-4efc-9d31-84ec47019df7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:56.376885 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3363/6655] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:56 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:56.380590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74cb17-5d50-4516-a49d-7a1daa1f0a48 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:56.390300 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3293/6656] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:56 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:56.391187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2d52a-7d40-4efc-9d31-84ec47019df7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:56.415020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74cb17-5d50-4516-a49d-7a1daa1f0a48 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:56.416840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2d52a-7d40-4efc-9d31-84ec47019df7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:56.424258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13a2f1-98a9-4e27-a64f-4cbe91dde955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:56.424916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13a2f1-98a9-4e27-a64f-4cbe91dde955 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:56.425197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13a2f1-98a9-4e27-a64f-4cbe91dde955 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:56.425478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13a2f1-98a9-4e27-a64f-4cbe91dde955 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:56.426185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13a2f1-98a9-4e27-a64f-4cbe91dde955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:56.428908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13a2f1-98a9-4e27-a64f-4cbe91dde955 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:56.430802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ff659-b3a9-4d06-bf77-b09dd1582186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:56.431469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ff659-b3a9-4d06-bf77-b09dd1582186 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:56.431752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ff659-b3a9-4d06-bf77-b09dd1582186 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:56.432027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ff659-b3a9-4d06-bf77-b09dd1582186 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:56.432726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ff659-b3a9-4d06-bf77-b09dd1582186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:56.435558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ff659-b3a9-4d06-bf77-b09dd1582186 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:56.474727 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3294/6657] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:56 2021] POST /identity/v3/projects => generated 369 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:56.475830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ff659-b3a9-4d06-bf77-b09dd1582186 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:56.513128 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3364/6658] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:56 2021] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:56.514023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13a2f1-98a9-4e27-a64f-4cbe91dde955 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:56.653603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ff659-b3a9-4d06-bf77-b09dd1582186 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:56.679913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13a2f1-98a9-4e27-a64f-4cbe91dde955 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:56.685518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f845a-0b1b-4bbd-a375-3efda6000729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:56.686379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f845a-0b1b-4bbd-a375-3efda6000729 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:56.686665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f845a-0b1b-4bbd-a375-3efda6000729 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:56.686943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f845a-0b1b-4bbd-a375-3efda6000729 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:56.687906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f845a-0b1b-4bbd-a375-3efda6000729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:56.689556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f845a-0b1b-4bbd-a375-3efda6000729 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:56.724463 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3365/6659] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:56 2021] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:56.727670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f845a-0b1b-4bbd-a375-3efda6000729 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:56.744925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f845a-0b1b-4bbd-a375-3efda6000729 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:56.757999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8353e4c-81cd-4857-b7c6-c3ad5636ff16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:56.760112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8353e4c-81cd-4857-b7c6-c3ad5636ff16 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:56.760461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8353e4c-81cd-4857-b7c6-c3ad5636ff16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:56.760748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8353e4c-81cd-4857-b7c6-c3ad5636ff16 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:56.762721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8353e4c-81cd-4857-b7c6-c3ad5636ff16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:56.769435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8353e4c-81cd-4857-b7c6-c3ad5636ff16 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:56.820941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f43cc-3624-41c4-99a0-d8cda9896be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:56.821999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f43cc-3624-41c4-99a0-d8cda9896be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:56.828148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f43cc-3624-41c4-99a0-d8cda9896be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:56.828148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f43cc-3624-41c4-99a0-d8cda9896be9 admin admin] PATH_INFO: `/v3/projects/5303a957070e4de5a5e183010242b274/users/5fbb9ad9460647a59c2444f5b5835fe0/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:56.852031 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3366/6660] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:56 2021] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:56.853266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8353e4c-81cd-4857-b7c6-c3ad5636ff16 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:56.863455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f43cc-3624-41c4-99a0-d8cda9896be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5303a957070e4de5a5e183010242b274, user_id=5fbb9ad9460647a59c2444f5b5835fe0, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:56.868388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f43cc-3624-41c4-99a0-d8cda9896be9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:56.872215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8353e4c-81cd-4857-b7c6-c3ad5636ff16 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:56.887088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6d473-3a3a-4a7c-ae8b-cf35418c2106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:56.888125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6d473-3a3a-4a7c-ae8b-cf35418c2106 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:56.899740 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3295/6661] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:56 2021] PUT /identity/v3/projects/5303a957070e4de5a5e183010242b274/users/5fbb9ad9460647a59c2444f5b5835fe0/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:56.901257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6d473-3a3a-4a7c-ae8b-cf35418c2106 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:56.902642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6d473-3a3a-4a7c-ae8b-cf35418c2106 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:56.907102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6d473-3a3a-4a7c-ae8b-cf35418c2106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:56.909015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6d473-3a3a-4a7c-ae8b-cf35418c2106 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:56.914050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f43cc-3624-41c4-99a0-d8cda9896be9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:56.931500 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3367/6662] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:56 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:56.936582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956d62c-f148-4d51-a6c6-da67d6811e2a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:56.936748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956d62c-f148-4d51-a6c6-da67d6811e2a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:56.941499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956d62c-f148-4d51-a6c6-da67d6811e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:56.986441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f43cc-3624-41c4-99a0-d8cda9896be9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:56.991868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88696b78-ca08-4dd7-aefc-d53942d1cba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:56.992155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88696b78-ca08-4dd7-aefc-d53942d1cba1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:56.992436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88696b78-ca08-4dd7-aefc-d53942d1cba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:56.992719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88696b78-ca08-4dd7-aefc-d53942d1cba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:56.993613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88696b78-ca08-4dd7-aefc-d53942d1cba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:56.995234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88696b78-ca08-4dd7-aefc-d53942d1cba1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:57.002182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e956d62c-f148-4d51-a6c6-da67d6811e2a None None] MFA Rules not processed for user `5fbb9ad9460647a59c2444f5b5835fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:57.003697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e956d62c-f148-4d51-a6c6-da67d6811e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:57.010300 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3296/6663] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:56 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:57.011192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88696b78-ca08-4dd7-aefc-d53942d1cba1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:57.028343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88696b78-ca08-4dd7-aefc-d53942d1cba1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:57.044057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7b29b-1328-472a-a694-0b04b5819fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:57.045486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7b29b-1328-472a-a694-0b04b5819fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:57.045773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7b29b-1328-472a-a694-0b04b5819fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:57.046050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7b29b-1328-472a-a694-0b04b5819fa4 admin admin] PATH_INFO: `/v3/projects/e4d18f9fdaf94bd18c0bd9d50321f873/users/edb51c7f4b35449fb28187bec826edae/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:57.070857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7b29b-1328-472a-a694-0b04b5819fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d18f9fdaf94bd18c0bd9d50321f873, user_id=edb51c7f4b35449fb28187bec826edae, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:57.074203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7b29b-1328-472a-a694-0b04b5819fa4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:57.092166 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3297/6664] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:57 2021] PUT /identity/v3/projects/e4d18f9fdaf94bd18c0bd9d50321f873/users/edb51c7f4b35449fb28187bec826edae/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:57.092166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7b29b-1328-472a-a694-0b04b5819fa4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:57.121360 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3368/6665] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:56 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:57.122623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956d62c-f148-4d51-a6c6-da67d6811e2a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:57.158397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956d62c-f148-4d51-a6c6-da67d6811e2a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:57.187209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7b29b-1328-472a-a694-0b04b5819fa4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:57.192341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41cf9b-70a6-427b-b0ec-a9a762072b0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:57.193005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41cf9b-70a6-427b-b0ec-a9a762072b0c service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:57.193344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41cf9b-70a6-427b-b0ec-a9a762072b0c service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:57.193835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41cf9b-70a6-427b-b0ec-a9a762072b0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:57.195845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0f41cf9b-70a6-427b-b0ec-a9a762072b0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:57.255576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adb5ec-3ece-44ed-abe5-0b0d30b551f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:57.256315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adb5ec-3ece-44ed-abe5-0b0d30b551f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:57.256544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adb5ec-3ece-44ed-abe5-0b0d30b551f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:57.256822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adb5ec-3ece-44ed-abe5-0b0d30b551f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:57.257570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adb5ec-3ece-44ed-abe5-0b0d30b551f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:57.259307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adb5ec-3ece-44ed-abe5-0b0d30b551f6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:57.271270 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3369/6666] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:57 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:57.272347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adb5ec-3ece-44ed-abe5-0b0d30b551f6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:57.287825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41cf9b-70a6-427b-b0ec-a9a762072b0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:57.289329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41cf9b-70a6-427b-b0ec-a9a762072b0c service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:57.292468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adb5ec-3ece-44ed-abe5-0b0d30b551f6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:57.301608 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3298/6667] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:57 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:57.302518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41cf9b-70a6-427b-b0ec-a9a762072b0c service cinder] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:57.303464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77053675-611c-4da4-bfef-242253d37949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:57.303925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0f41cf9b-70a6-427b-b0ec-a9a762072b0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:57.304389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77053675-611c-4da4-bfef-242253d37949 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:57.304742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77053675-611c-4da4-bfef-242253d37949 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:57.305088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77053675-611c-4da4-bfef-242253d37949 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:57.306025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77053675-611c-4da4-bfef-242253d37949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:57.307785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77053675-611c-4da4-bfef-242253d37949 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:57.318677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41cf9b-70a6-427b-b0ec-a9a762072b0c service cinder] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:57.322569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f772777-a1ff-4475-8d90-df4c307efba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:57.323224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f772777-a1ff-4475-8d90-df4c307efba7 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:57.326740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f772777-a1ff-4475-8d90-df4c307efba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:57.326880 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3370/6668] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:57 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:57.327067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f772777-a1ff-4475-8d90-df4c307efba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:57.327151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77053675-611c-4da4-bfef-242253d37949 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:57.341340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77053675-611c-4da4-bfef-242253d37949 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:57.349272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06df2f-809c-4f77-8616-e72e35687f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:57.351147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06df2f-809c-4f77-8616-e72e35687f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:57.351273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06df2f-809c-4f77-8616-e72e35687f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:57.351567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06df2f-809c-4f77-8616-e72e35687f94 admin admin] PATH_INFO: `/v3/projects/c1514713159343eb853b2abb7f6fd02d/users/95577dedf95a4c09a2c63f2f2f0ad9ce/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:57.383202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06df2f-809c-4f77-8616-e72e35687f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1514713159343eb853b2abb7f6fd02d, user_id=95577dedf95a4c09a2c63f2f2f0ad9ce, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:57.390928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06df2f-809c-4f77-8616-e72e35687f94 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:57.400051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f772777-a1ff-4475-8d90-df4c307efba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:57.401569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f772777-a1ff-4475-8d90-df4c307efba7 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:57.417732 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3371/6669] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:57 2021] PUT /identity/v3/projects/c1514713159343eb853b2abb7f6fd02d/users/95577dedf95a4c09a2c63f2f2f0ad9ce/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:57.418972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06df2f-809c-4f77-8616-e72e35687f94 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:57.423631 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3299/6670] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:57 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:57.433982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09495f8-0921-4e00-90ae-59d234042b5f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:57.434292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09495f8-0921-4e00-90ae-59d234042b5f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:57.434621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09495f8-0921-4e00-90ae-59d234042b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:57.498020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a09495f8-0921-4e00-90ae-59d234042b5f None None] MFA Rules not processed for user `95577dedf95a4c09a2c63f2f2f0ad9ce`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:57.499926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a09495f8-0921-4e00-90ae-59d234042b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:57.544584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06df2f-809c-4f77-8616-e72e35687f94 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:57.552359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e459bf-0c51-48df-9f3d-322229aec6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:57.553594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e459bf-0c51-48df-9f3d-322229aec6f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:57.553951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e459bf-0c51-48df-9f3d-322229aec6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:57.554337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e459bf-0c51-48df-9f3d-322229aec6f4 admin admin] PATH_INFO: `/v3/projects/e4d18f9fdaf94bd18c0bd9d50321f873/users/edb51c7f4b35449fb28187bec826edae/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:57.556559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e459bf-0c51-48df-9f3d-322229aec6f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d18f9fdaf94bd18c0bd9d50321f873, user_id=edb51c7f4b35449fb28187bec826edae, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:57.559241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e459bf-0c51-48df-9f3d-322229aec6f4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:57.570880 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3372/6671] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:57 2021] PUT /identity/v3/projects/e4d18f9fdaf94bd18c0bd9d50321f873/users/edb51c7f4b35449fb28187bec826edae/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:57.572072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e459bf-0c51-48df-9f3d-322229aec6f4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:57.619049 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3300/6672] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:57 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:57.620824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac89d5a-4703-4b43-ac8d-2a1b1e46c06d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:57.621126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac89d5a-4703-4b43-ac8d-2a1b1e46c06d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:57.621557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac89d5a-4703-4b43-ac8d-2a1b1e46c06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:57.685081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0ac89d5a-4703-4b43-ac8d-2a1b1e46c06d None None] MFA Rules not processed for user `edb51c7f4b35449fb28187bec826edae`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:57.687537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0ac89d5a-4703-4b43-ac8d-2a1b1e46c06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:57.693099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e459bf-0c51-48df-9f3d-322229aec6f4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:57.703738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17b53a-c303-4d8e-8ae6-1db80cba6f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:57.704610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17b53a-c303-4d8e-8ae6-1db80cba6f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:57.704992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17b53a-c303-4d8e-8ae6-1db80cba6f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:57.705441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17b53a-c303-4d8e-8ae6-1db80cba6f7d admin admin] PATH_INFO: `/v3/users/5fbb9ad9460647a59c2444f5b5835fe0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:57.712553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17b53a-c303-4d8e-8ae6-1db80cba6f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fbb9ad9460647a59c2444f5b5835fe0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:57.715325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17b53a-c303-4d8e-8ae6-1db80cba6f7d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:57.834386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cd17b53a-c303-4d8e-8ae6-1db80cba6f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fbb9ad9460647a59c2444f5b5835fe0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:57.851379 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3301/6673] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:57 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:57.853415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cd17b53a-c303-4d8e-8ae6-1db80cba6f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fbb9ad9460647a59c2444f5b5835fe0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:57.853943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac89d5a-4703-4b43-ac8d-2a1b1e46c06d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:57.855221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cd17b53a-c303-4d8e-8ae6-1db80cba6f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fbb9ad9460647a59c2444f5b5835fe0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:57.882056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac89d5a-4703-4b43-ac8d-2a1b1e46c06d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:57.886023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cd17b53a-c303-4d8e-8ae6-1db80cba6f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fbb9ad9460647a59c2444f5b5835fe0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:57.903122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54241845-3e69-4137-9ad3-bc0a859b53dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:57.905207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cd17b53a-c303-4d8e-8ae6-1db80cba6f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fbb9ad9460647a59c2444f5b5835fe0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:57.906472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54241845-3e69-4137-9ad3-bc0a859b53dd admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:57.907219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54241845-3e69-4137-9ad3-bc0a859b53dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:57.908703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54241845-3e69-4137-9ad3-bc0a859b53dd admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:57.910396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54241845-3e69-4137-9ad3-bc0a859b53dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:57.916673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54241845-3e69-4137-9ad3-bc0a859b53dd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:57.932996 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3373/6674] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:57 2021] DELETE /identity/v3/users/5fbb9ad9460647a59c2444f5b5835fe0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:57.934656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17b53a-c303-4d8e-8ae6-1db80cba6f7d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:57.940291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cd17b53a-c303-4d8e-8ae6-1db80cba6f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:57.995453 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3302/6675] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:07:57 2021] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:57.995453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a4950-2dad-4c1e-a149-36ee6cb8d32f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:57.995453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a4950-2dad-4c1e-a149-36ee6cb8d32f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:57.995453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a4950-2dad-4c1e-a149-36ee6cb8d32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:58.055299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17b53a-c303-4d8e-8ae6-1db80cba6f7d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:58.056551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d71a4950-2dad-4c1e-a149-36ee6cb8d32f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:58.059127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d71a4950-2dad-4c1e-a149-36ee6cb8d32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:58.175060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26eecc-a8ee-4f95-96cd-7742df273786 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:58.177310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26eecc-a8ee-4f95-96cd-7742df273786 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:58.181908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26eecc-a8ee-4f95-96cd-7742df273786 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:58.182763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26eecc-a8ee-4f95-96cd-7742df273786 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:58.187739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1e26eecc-a8ee-4f95-96cd-7742df273786 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:58.211868 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3303/6676] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:58.211868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a4950-2dad-4c1e-a149-36ee6cb8d32f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:58.222560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d71a4950-2dad-4c1e-a149-36ee6cb8d32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:58.245124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a4950-2dad-4c1e-a149-36ee6cb8d32f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:58.250863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade7aed-dcdf-4f1e-9422-b9f78a42ae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:58.251616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade7aed-dcdf-4f1e-9422-b9f78a42ae92 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:58.251975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade7aed-dcdf-4f1e-9422-b9f78a42ae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:58.252314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade7aed-dcdf-4f1e-9422-b9f78a42ae92 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:58.254919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade7aed-dcdf-4f1e-9422-b9f78a42ae92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:58.258574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade7aed-dcdf-4f1e-9422-b9f78a42ae92 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:58.301082 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3304/6677] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:07:58 2021] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:07:58.303594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade7aed-dcdf-4f1e-9422-b9f78a42ae92 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:58.308012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4ade7aed-dcdf-4f1e-9422-b9f78a42ae92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:58.321383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26eecc-a8ee-4f95-96cd-7742df273786 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:58.323601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26eecc-a8ee-4f95-96cd-7742df273786 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:58.336598 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3374/6678] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:57 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:58.338004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26eecc-a8ee-4f95-96cd-7742df273786 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:58.352375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26eecc-a8ee-4f95-96cd-7742df273786 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:58.360157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e752f2f-39bd-43aa-8ab0-6830faeb5ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:58.360922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e752f2f-39bd-43aa-8ab0-6830faeb5ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:58.367280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e752f2f-39bd-43aa-8ab0-6830faeb5ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:58.367628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e752f2f-39bd-43aa-8ab0-6830faeb5ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:58.368648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e752f2f-39bd-43aa-8ab0-6830faeb5ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:58.370514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e752f2f-39bd-43aa-8ab0-6830faeb5ef0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:58.389030 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3375/6679] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:58 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:58.390150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e752f2f-39bd-43aa-8ab0-6830faeb5ef0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:58.406433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e752f2f-39bd-43aa-8ab0-6830faeb5ef0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:58.423510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4840c-4271-40e6-83ed-465747c7f873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:58.426906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4840c-4271-40e6-83ed-465747c7f873 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:58.427541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4840c-4271-40e6-83ed-465747c7f873 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:58.429066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4840c-4271-40e6-83ed-465747c7f873 admin admin] PATH_INFO: `/v3/projects/3c79c775668a4efc8bc07fbc92fe5473/users/e81d205745534b73ae54657ee9bde8c9/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:58.457581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4840c-4271-40e6-83ed-465747c7f873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c79c775668a4efc8bc07fbc92fe5473, user_id=e81d205745534b73ae54657ee9bde8c9, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:58.461475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4840c-4271-40e6-83ed-465747c7f873 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:58.473546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade7aed-dcdf-4f1e-9422-b9f78a42ae92 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:58.480927 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3376/6680] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:58 2021] PUT /identity/v3/projects/3c79c775668a4efc8bc07fbc92fe5473/users/e81d205745534b73ae54657ee9bde8c9/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:58.488549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4840c-4271-40e6-83ed-465747c7f873 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:58.577615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a497047-0eea-4b52-b5d2-7a883c235e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:58.578640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497047-0eea-4b52-b5d2-7a883c235e60 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:58.579067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497047-0eea-4b52-b5d2-7a883c235e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:58.579454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497047-0eea-4b52-b5d2-7a883c235e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:58.580459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4840c-4271-40e6-83ed-465747c7f873 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:58.589162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e6769-e583-492a-b6d2-1665b042a24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:58.591072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e6769-e583-492a-b6d2-1665b042a24c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:58.591376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e6769-e583-492a-b6d2-1665b042a24c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:58.592480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e6769-e583-492a-b6d2-1665b042a24c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:58.593242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e6769-e583-492a-b6d2-1665b042a24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:58.595394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e6769-e583-492a-b6d2-1665b042a24c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:58.595794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a497047-0eea-4b52-b5d2-7a883c235e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:58.600471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a497047-0eea-4b52-b5d2-7a883c235e60 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:58.613532 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3377/6681] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:07:58 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:07:58.615305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e6769-e583-492a-b6d2-1665b042a24c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:58.629211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e6769-e583-492a-b6d2-1665b042a24c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:58.635131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39a8ab-eb71-4053-a981-1b24682dda01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:58.636236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39a8ab-eb71-4053-a981-1b24682dda01 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:58.636621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39a8ab-eb71-4053-a981-1b24682dda01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:58.638035 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3305/6682] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:58.638286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39a8ab-eb71-4053-a981-1b24682dda01 admin admin] PATH_INFO: `/v3/projects/3c79c775668a4efc8bc07fbc92fe5473/users/e81d205745534b73ae54657ee9bde8c9/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:58.647781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39a8ab-eb71-4053-a981-1b24682dda01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c79c775668a4efc8bc07fbc92fe5473, user_id=e81d205745534b73ae54657ee9bde8c9, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:58.650456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39a8ab-eb71-4053-a981-1b24682dda01 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:58.674710 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3378/6683] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:07:58 2021] PUT /identity/v3/projects/3c79c775668a4efc8bc07fbc92fe5473/users/e81d205745534b73ae54657ee9bde8c9/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:58.686964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc5dba-a40b-437e-8e8b-c01d238b741a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:58.687538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc5dba-a40b-437e-8e8b-c01d238b741a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:58.688006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc5dba-a40b-437e-8e8b-c01d238b741a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:58.734157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d4cc5dba-a40b-437e-8e8b-c01d238b741a None None] MFA Rules not processed for user `e81d205745534b73ae54657ee9bde8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:58.735797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d4cc5dba-a40b-437e-8e8b-c01d238b741a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:58.930921 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3306/6684] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:58 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:07:58.976409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39a8ab-eb71-4053-a981-1b24682dda01 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:59.039551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39a8ab-eb71-4053-a981-1b24682dda01 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:59.043486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6d4c4-2c78-4bcc-a66a-785928219a9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:59.044146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6d4c4-2c78-4bcc-a66a-785928219a9f service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:59.044428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6d4c4-2c78-4bcc-a66a-785928219a9f service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:59.044746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6d4c4-2c78-4bcc-a66a-785928219a9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:59.054835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6d4c4-2c78-4bcc-a66a-785928219a9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:59.056494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6d4c4-2c78-4bcc-a66a-785928219a9f service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:59.072627 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3379/6685] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:07:58 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:07:59.517006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc5dba-a40b-437e-8e8b-c01d238b741a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:59.587121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6d4c4-2c78-4bcc-a66a-785928219a9f service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:07:59.589246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-aaa6d4c4-2c78-4bcc-a66a-785928219a9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:59.648412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc5dba-a40b-437e-8e8b-c01d238b741a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:59.654657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832228a-4a8a-47e5-870f-f509ecc2f053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:59.655873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832228a-4a8a-47e5-870f-f509ecc2f053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:59.656374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832228a-4a8a-47e5-870f-f509ecc2f053 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:59.657007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832228a-4a8a-47e5-870f-f509ecc2f053 admin admin] PATH_INFO: `/v3/users/95577dedf95a4c09a2c63f2f2f0ad9ce` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:59.662849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832228a-4a8a-47e5-870f-f509ecc2f053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95577dedf95a4c09a2c63f2f2f0ad9ce)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:59.664893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832228a-4a8a-47e5-870f-f509ecc2f053 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:59.703534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6d4c4-2c78-4bcc-a66a-785928219a9f service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:07:59.715551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fa5c6-ae4c-4e1b-9956-ac4ad1e8a1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:07:59.720246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fa5c6-ae4c-4e1b-9956-ac4ad1e8a1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:59.720380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fa5c6-ae4c-4e1b-9956-ac4ad1e8a1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:59.720582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fa5c6-ae4c-4e1b-9956-ac4ad1e8a1f9 admin admin] PATH_INFO: `/v3/projects/5303a957070e4de5a5e183010242b274` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:59.722158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fa5c6-ae4c-4e1b-9956-ac4ad1e8a1f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5303a957070e4de5a5e183010242b274)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:07:59.724312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fa5c6-ae4c-4e1b-9956-ac4ad1e8a1f9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:07:59.748221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d832228a-4a8a-47e5-870f-f509ecc2f053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95577dedf95a4c09a2c63f2f2f0ad9ce'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:59.776427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d832228a-4a8a-47e5-870f-f509ecc2f053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95577dedf95a4c09a2c63f2f2f0ad9ce'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:59.799557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d832228a-4a8a-47e5-870f-f509ecc2f053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95577dedf95a4c09a2c63f2f2f0ad9ce'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:59.800427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d832228a-4a8a-47e5-870f-f509ecc2f053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95577dedf95a4c09a2c63f2f2f0ad9ce'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:59.816589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d832228a-4a8a-47e5-870f-f509ecc2f053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95577dedf95a4c09a2c63f2f2f0ad9ce'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:59.824844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a29fa5c6-ae4c-4e1b-9956-ac4ad1e8a1f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5303a957070e4de5a5e183010242b274', 'request_id': 'req-a29fa5c6-ae4c-4e1b-9956-ac4ad1e8a1f9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:59.836255 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3307/6686] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:07:59 2021] DELETE /identity/v3/users/95577dedf95a4c09a2c63f2f2f0ad9ce => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:59.838313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588fe2b-56dc-4236-993f-c2461415fa3f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:59.838591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588fe2b-56dc-4236-993f-c2461415fa3f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:59.838880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588fe2b-56dc-4236-993f-c2461415fa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:59.840579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a29fa5c6-ae4c-4e1b-9956-ac4ad1e8a1f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5303a957070e4de5a5e183010242b274', 'request_id': 'req-a29fa5c6-ae4c-4e1b-9956-ac4ad1e8a1f9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:59.864641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a29fa5c6-ae4c-4e1b-9956-ac4ad1e8a1f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5303a957070e4de5a5e183010242b274', 'request_id': 'req-a29fa5c6-ae4c-4e1b-9956-ac4ad1e8a1f9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:59.886403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6588fe2b-56dc-4236-993f-c2461415fa3f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:59.891251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a29fa5c6-ae4c-4e1b-9956-ac4ad1e8a1f9 admin admin] The token cache is being invalidate because project 5303a957070e4de5a5e183010242b274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:07:59.891564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a29fa5c6-ae4c-4e1b-9956-ac4ad1e8a1f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:59.903834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a29fa5c6-ae4c-4e1b-9956-ac4ad1e8a1f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:07:59.908950 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3380/6687] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:07:59 2021] DELETE /identity/v3/projects/5303a957070e4de5a5e183010242b274 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:07:59.914985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b897f-e530-462a-8537-1b08485da10b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:07:59.915537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b897f-e530-462a-8537-1b08485da10b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:07:59.915909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6588fe2b-56dc-4236-993f-c2461415fa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:07:59.916281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b897f-e530-462a-8537-1b08485da10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:07:59.974567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c95b897f-e530-462a-8537-1b08485da10b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:07:59.977528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c95b897f-e530-462a-8537-1b08485da10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:00.062973 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3381/6688] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:08:00.077653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132ae70-ce21-4167-b7c8-e6b188ffe9ff None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:00.086431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132ae70-ce21-4167-b7c8-e6b188ffe9ff None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:00.086878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132ae70-ce21-4167-b7c8-e6b188ffe9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:00.089767 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3308/6689] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:07:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:00.102224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588fe2b-56dc-4236-993f-c2461415fa3f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:00.104026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6588fe2b-56dc-4236-993f-c2461415fa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:00.136158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d132ae70-ce21-4167-b7c8-e6b188ffe9ff None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:00.137511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d132ae70-ce21-4167-b7c8-e6b188ffe9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:00.157355 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3382/6690] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:00.161239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132ae70-ce21-4167-b7c8-e6b188ffe9ff None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:00.180877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132ae70-ce21-4167-b7c8-e6b188ffe9ff None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:00.191139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8213a-6b51-4f14-a0be-435d7d84150d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:00.202309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8213a-6b51-4f14-a0be-435d7d84150d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:00.202715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8213a-6b51-4f14-a0be-435d7d84150d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:00.203099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8213a-6b51-4f14-a0be-435d7d84150d admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:00.204490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8213a-6b51-4f14-a0be-435d7d84150d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:08:00.204908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8213a-6b51-4f14-a0be-435d7d84150d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:00.207186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8213a-6b51-4f14-a0be-435d7d84150d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:00.225545 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3383/6691] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:08:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:08:00.226774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8213a-6b51-4f14-a0be-435d7d84150d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:00.238127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8213a-6b51-4f14-a0be-435d7d84150d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:00.243648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c75fc3-a367-4345-8038-4b6f8430bf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:00.244459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c75fc3-a367-4345-8038-4b6f8430bf42 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:00.245006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c75fc3-a367-4345-8038-4b6f8430bf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:00.245298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c75fc3-a367-4345-8038-4b6f8430bf42 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:00.246160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c75fc3-a367-4345-8038-4b6f8430bf42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:00.248628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c75fc3-a367-4345-8038-4b6f8430bf42 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:00.287661 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3384/6692] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:08:00 2021] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:00.288612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c75fc3-a367-4345-8038-4b6f8430bf42 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:00.313621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588fe2b-56dc-4236-993f-c2461415fa3f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:00.366066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c75fc3-a367-4345-8038-4b6f8430bf42 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:00.377135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083686d1-16a6-4666-aa3d-71f7bf09e201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:00.377791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083686d1-16a6-4666-aa3d-71f7bf09e201 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:00.378075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083686d1-16a6-4666-aa3d-71f7bf09e201 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:00.378465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083686d1-16a6-4666-aa3d-71f7bf09e201 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:00.379213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083686d1-16a6-4666-aa3d-71f7bf09e201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:00.382831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083686d1-16a6-4666-aa3d-71f7bf09e201 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:00.424402 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3385/6693] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:08:00 2021] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:00.428658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083686d1-16a6-4666-aa3d-71f7bf09e201 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:00.429848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b18dfe-a644-48ad-b36a-97062eaebe08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:00.433606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b18dfe-a644-48ad-b36a-97062eaebe08 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:00.433917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b18dfe-a644-48ad-b36a-97062eaebe08 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:00.434206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b18dfe-a644-48ad-b36a-97062eaebe08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:00.439659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083686d1-16a6-4666-aa3d-71f7bf09e201 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:00.444850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0296e-c15c-4f86-aba7-0ecd105442e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:00.445518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0296e-c15c-4f86-aba7-0ecd105442e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:00.445805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0296e-c15c-4f86-aba7-0ecd105442e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:00.446085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0296e-c15c-4f86-aba7-0ecd105442e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:00.446896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0296e-c15c-4f86-aba7-0ecd105442e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:00.448569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0296e-c15c-4f86-aba7-0ecd105442e3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:00.459821 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3386/6694] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:00.460459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b18dfe-a644-48ad-b36a-97062eaebe08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:00.462072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b18dfe-a644-48ad-b36a-97062eaebe08 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:00.464512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0296e-c15c-4f86-aba7-0ecd105442e3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:00.476752 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3309/6695] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:00.477903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0296e-c15c-4f86-aba7-0ecd105442e3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:00.489019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f979766-5dae-4579-ad56-5aaf0e14bf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:00.493846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f979766-5dae-4579-ad56-5aaf0e14bf91 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:00.493846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f979766-5dae-4579-ad56-5aaf0e14bf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:00.493846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f979766-5dae-4579-ad56-5aaf0e14bf91 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:00.499045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f979766-5dae-4579-ad56-5aaf0e14bf91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:00.503901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f979766-5dae-4579-ad56-5aaf0e14bf91 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:00.531714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b18dfe-a644-48ad-b36a-97062eaebe08 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:00.535137 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3387/6696] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:00 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:00.543674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b18dfe-a644-48ad-b36a-97062eaebe08 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:00.563939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d6e24-58e9-47d2-ae70-e61198d39bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:00.566433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d6e24-58e9-47d2-ae70-e61198d39bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:00.569023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d6e24-58e9-47d2-ae70-e61198d39bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:00.569820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d6e24-58e9-47d2-ae70-e61198d39bb3 admin admin] PATH_INFO: `/v3/projects/1993bfd02e94412d835129f98b8e529d/users/9467ccf6f7494cdc811aaa555a657cca/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:00.614628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d6e24-58e9-47d2-ae70-e61198d39bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1993bfd02e94412d835129f98b8e529d, user_id=9467ccf6f7494cdc811aaa555a657cca, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:00.619407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d6e24-58e9-47d2-ae70-e61198d39bb3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:00.668278 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3310/6697] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:00 2021] PUT /identity/v3/projects/1993bfd02e94412d835129f98b8e529d/users/9467ccf6f7494cdc811aaa555a657cca/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:00.678688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482538ec-caf0-4c40-8269-8b28f57d202a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:00.679240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482538ec-caf0-4c40-8269-8b28f57d202a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:00.679240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482538ec-caf0-4c40-8269-8b28f57d202a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:00.722906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-482538ec-caf0-4c40-8269-8b28f57d202a None None] MFA Rules not processed for user `9467ccf6f7494cdc811aaa555a657cca`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:00.724366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-482538ec-caf0-4c40-8269-8b28f57d202a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:00.886292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d6e24-58e9-47d2-ae70-e61198d39bb3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:00.888757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-256d6e24-58e9-47d2-ae70-e61198d39bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:00.903580 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3388/6698] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:00 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:00.919523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482538ec-caf0-4c40-8269-8b28f57d202a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:00.921673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-482538ec-caf0-4c40-8269-8b28f57d202a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:01.033912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482538ec-caf0-4c40-8269-8b28f57d202a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:01.035596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d6e24-58e9-47d2-ae70-e61198d39bb3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:01.038984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d607b4-8825-47f6-b6a1-91ca8d6e70e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:01.040895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d607b4-8825-47f6-b6a1-91ca8d6e70e3 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:01.041356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d607b4-8825-47f6-b6a1-91ca8d6e70e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:01.041799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d607b4-8825-47f6-b6a1-91ca8d6e70e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:01.043333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa258b-127c-40bf-98e0-5d1cc5a7348e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:01.045493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa258b-127c-40bf-98e0-5d1cc5a7348e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:01.046295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa258b-127c-40bf-98e0-5d1cc5a7348e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:01.046295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa258b-127c-40bf-98e0-5d1cc5a7348e admin admin] PATH_INFO: `/v3/users/d3603c9356e04d0386f3693fce17edbf` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:01.051142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa258b-127c-40bf-98e0-5d1cc5a7348e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3603c9356e04d0386f3693fce17edbf)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:01.055401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa258b-127c-40bf-98e0-5d1cc5a7348e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:01.059086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d607b4-8825-47f6-b6a1-91ca8d6e70e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:01.061558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d607b4-8825-47f6-b6a1-91ca8d6e70e3 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:01.102927 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3389/6699] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:00 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:08:01.134173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8cfa258b-127c-40bf-98e0-5d1cc5a7348e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3603c9356e04d0386f3693fce17edbf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:01.161334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8cfa258b-127c-40bf-98e0-5d1cc5a7348e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3603c9356e04d0386f3693fce17edbf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:01.205408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8cfa258b-127c-40bf-98e0-5d1cc5a7348e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3603c9356e04d0386f3693fce17edbf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:01.206732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8cfa258b-127c-40bf-98e0-5d1cc5a7348e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3603c9356e04d0386f3693fce17edbf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:01.240264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8cfa258b-127c-40bf-98e0-5d1cc5a7348e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3603c9356e04d0386f3693fce17edbf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:01.253320 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3311/6700] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:08:00 2021] DELETE /identity/v3/users/d3603c9356e04d0386f3693fce17edbf => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:01.258802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad6f9b-a928-4d38-a0f0-6da7442c2867 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:01.259274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad6f9b-a928-4d38-a0f0-6da7442c2867 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:01.259980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad6f9b-a928-4d38-a0f0-6da7442c2867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:01.321841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-27ad6f9b-a928-4d38-a0f0-6da7442c2867 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:01.324434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-27ad6f9b-a928-4d38-a0f0-6da7442c2867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:01.407749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa258b-127c-40bf-98e0-5d1cc5a7348e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:01.412661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8cfa258b-127c-40bf-98e0-5d1cc5a7348e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:01.579609 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3390/6701] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:01.591209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad6f9b-a928-4d38-a0f0-6da7442c2867 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:01.594042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-27ad6f9b-a928-4d38-a0f0-6da7442c2867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:01.697833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa258b-127c-40bf-98e0-5d1cc5a7348e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:01.708368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe182e-ce85-48f8-b737-435f6ea639a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:01.709570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe182e-ce85-48f8-b737-435f6ea639a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:01.710023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe182e-ce85-48f8-b737-435f6ea639a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:01.710537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe182e-ce85-48f8-b737-435f6ea639a7 admin admin] PATH_INFO: `/v3/projects/c1514713159343eb853b2abb7f6fd02d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:01.712182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe182e-ce85-48f8-b737-435f6ea639a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1514713159343eb853b2abb7f6fd02d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:01.714535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe182e-ce85-48f8-b737-435f6ea639a7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:01.718321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad6f9b-a928-4d38-a0f0-6da7442c2867 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:01.728454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba292d3-ea82-45e9-a269-80de1200c50a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:01.729318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba292d3-ea82-45e9-a269-80de1200c50a service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:01.729667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba292d3-ea82-45e9-a269-80de1200c50a service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:01.730014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba292d3-ea82-45e9-a269-80de1200c50a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:01.759932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba292d3-ea82-45e9-a269-80de1200c50a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:01.761396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba292d3-ea82-45e9-a269-80de1200c50a service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:01.782354 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3391/6702] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:08:01.785729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bffe182e-ce85-48f8-b737-435f6ea639a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1514713159343eb853b2abb7f6fd02d', 'request_id': 'req-bffe182e-ce85-48f8-b737-435f6ea639a7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:01.792899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bffe182e-ce85-48f8-b737-435f6ea639a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1514713159343eb853b2abb7f6fd02d', 'request_id': 'req-bffe182e-ce85-48f8-b737-435f6ea639a7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:01.802201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bffe182e-ce85-48f8-b737-435f6ea639a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1514713159343eb853b2abb7f6fd02d', 'request_id': 'req-bffe182e-ce85-48f8-b737-435f6ea639a7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:01.822305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bffe182e-ce85-48f8-b737-435f6ea639a7 admin admin] The token cache is being invalidate because project c1514713159343eb853b2abb7f6fd02d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:01.822440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bffe182e-ce85-48f8-b737-435f6ea639a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:01.823082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bffe182e-ce85-48f8-b737-435f6ea639a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:01.824785 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3312/6703] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:01 2021] DELETE /identity/v3/projects/c1514713159343eb853b2abb7f6fd02d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:01.829231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba292d3-ea82-45e9-a269-80de1200c50a service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:01.846027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba292d3-ea82-45e9-a269-80de1200c50a service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:01.982783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b198a-df05-4b3c-93a6-be24ebbd6f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:01.983965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b198a-df05-4b3c-93a6-be24ebbd6f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:01.984201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b198a-df05-4b3c-93a6-be24ebbd6f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:01.985445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b198a-df05-4b3c-93a6-be24ebbd6f6e admin admin] PATH_INFO: `/v3/users/e81d205745534b73ae54657ee9bde8c9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:01.986930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b198a-df05-4b3c-93a6-be24ebbd6f6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81d205745534b73ae54657ee9bde8c9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:01.989701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b198a-df05-4b3c-93a6-be24ebbd6f6e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:02.046094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe182e-ce85-48f8-b737-435f6ea639a7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:02.048117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bffe182e-ce85-48f8-b737-435f6ea639a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:02.069115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe182e-ce85-48f8-b737-435f6ea639a7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:02.074496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3807cc8-2730-41a0-b421-9ca41354a8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:02.075853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3807cc8-2730-41a0-b421-9ca41354a8c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:02.076718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3807cc8-2730-41a0-b421-9ca41354a8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:02.077094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3807cc8-2730-41a0-b421-9ca41354a8c9 admin admin] PATH_INFO: `/v3/users/c3c2db616c524b5d98c030f87fd74034` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:02.078652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3807cc8-2730-41a0-b421-9ca41354a8c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c2db616c524b5d98c030f87fd74034)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:02.080853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3807cc8-2730-41a0-b421-9ca41354a8c9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:02.116766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b26b198a-df05-4b3c-93a6-be24ebbd6f6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81d205745534b73ae54657ee9bde8c9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:02.138206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b26b198a-df05-4b3c-93a6-be24ebbd6f6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81d205745534b73ae54657ee9bde8c9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:02.142650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b26b198a-df05-4b3c-93a6-be24ebbd6f6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81d205745534b73ae54657ee9bde8c9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:02.180303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b26b198a-df05-4b3c-93a6-be24ebbd6f6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81d205745534b73ae54657ee9bde8c9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:02.187274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e3807cc8-2730-41a0-b421-9ca41354a8c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c2db616c524b5d98c030f87fd74034'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:02.194672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b26b198a-df05-4b3c-93a6-be24ebbd6f6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81d205745534b73ae54657ee9bde8c9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:02.203221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e3807cc8-2730-41a0-b421-9ca41354a8c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c2db616c524b5d98c030f87fd74034'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:02.203512 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3392/6704] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:08:01 2021] DELETE /identity/v3/users/e81d205745534b73ae54657ee9bde8c9 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:02.246475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e3807cc8-2730-41a0-b421-9ca41354a8c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c2db616c524b5d98c030f87fd74034'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:02.247731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e3807cc8-2730-41a0-b421-9ca41354a8c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c2db616c524b5d98c030f87fd74034'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:02.265409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e3807cc8-2730-41a0-b421-9ca41354a8c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c2db616c524b5d98c030f87fd74034'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:02.274942 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3313/6705] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:08:02 2021] DELETE /identity/v3/users/c3c2db616c524b5d98c030f87fd74034 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:02.282237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9d588-2a7a-4cb8-8e59-bc1059b2ab8a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:02.284428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9d588-2a7a-4cb8-8e59-bc1059b2ab8a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:02.284715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9d588-2a7a-4cb8-8e59-bc1059b2ab8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:02.305722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3807cc8-2730-41a0-b421-9ca41354a8c9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:02.307015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e3807cc8-2730-41a0-b421-9ca41354a8c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:02.313233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-dea9d588-2a7a-4cb8-8e59-bc1059b2ab8a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:02.314624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dea9d588-2a7a-4cb8-8e59-bc1059b2ab8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:02.403466 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3393/6706] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:02.429296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9d588-2a7a-4cb8-8e59-bc1059b2ab8a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:02.431201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dea9d588-2a7a-4cb8-8e59-bc1059b2ab8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:02.480844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3807cc8-2730-41a0-b421-9ca41354a8c9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:02.492506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d3445-3d2a-4bf7-b15f-7ef700daf120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:02.493621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d3445-3d2a-4bf7-b15f-7ef700daf120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:02.494012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d3445-3d2a-4bf7-b15f-7ef700daf120 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:02.494575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d3445-3d2a-4bf7-b15f-7ef700daf120 admin admin] PATH_INFO: `/v3/projects/004eaca0de364bf0b1eb98b07cca5371` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:02.496124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d3445-3d2a-4bf7-b15f-7ef700daf120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=004eaca0de364bf0b1eb98b07cca5371)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:02.500330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d3445-3d2a-4bf7-b15f-7ef700daf120 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:02.540731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9d588-2a7a-4cb8-8e59-bc1059b2ab8a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:02.558854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13f387-6c98-4222-a8d6-29c5b5788772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:02.559596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13f387-6c98-4222-a8d6-29c5b5788772 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:02.559986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13f387-6c98-4222-a8d6-29c5b5788772 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:02.560818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13f387-6c98-4222-a8d6-29c5b5788772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:02.590628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13f387-6c98-4222-a8d6-29c5b5788772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:02.593184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13f387-6c98-4222-a8d6-29c5b5788772 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:02.606990 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3394/6707] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:02.611452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-668d3445-3d2a-4bf7-b15f-7ef700daf120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '004eaca0de364bf0b1eb98b07cca5371', 'request_id': 'req-668d3445-3d2a-4bf7-b15f-7ef700daf120'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:02.618803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-668d3445-3d2a-4bf7-b15f-7ef700daf120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '004eaca0de364bf0b1eb98b07cca5371', 'request_id': 'req-668d3445-3d2a-4bf7-b15f-7ef700daf120'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:02.635545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-668d3445-3d2a-4bf7-b15f-7ef700daf120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '004eaca0de364bf0b1eb98b07cca5371', 'request_id': 'req-668d3445-3d2a-4bf7-b15f-7ef700daf120'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:02.658102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-668d3445-3d2a-4bf7-b15f-7ef700daf120 admin admin] The token cache is being invalidate because project 004eaca0de364bf0b1eb98b07cca5371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:02.658504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-668d3445-3d2a-4bf7-b15f-7ef700daf120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:02.659543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-668d3445-3d2a-4bf7-b15f-7ef700daf120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:02.665716 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3314/6708] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:02 2021] DELETE /identity/v3/projects/004eaca0de364bf0b1eb98b07cca5371 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:08:02.666793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13f387-6c98-4222-a8d6-29c5b5788772 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:02.684057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13f387-6c98-4222-a8d6-29c5b5788772 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:02.818704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d3445-3d2a-4bf7-b15f-7ef700daf120 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:02.821992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-668d3445-3d2a-4bf7-b15f-7ef700daf120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:02.884406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dcb4d-115f-499c-b97d-80af34c118d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:02.887277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dcb4d-115f-499c-b97d-80af34c118d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:02.888016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dcb4d-115f-499c-b97d-80af34c118d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:02.888738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dcb4d-115f-499c-b97d-80af34c118d5 admin admin] PATH_INFO: `/v3/users/edb51c7f4b35449fb28187bec826edae` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:02.921869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dcb4d-115f-499c-b97d-80af34c118d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edb51c7f4b35449fb28187bec826edae)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:02.930453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dcb4d-115f-499c-b97d-80af34c118d5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:03.040611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ab9dcb4d-115f-499c-b97d-80af34c118d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edb51c7f4b35449fb28187bec826edae'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.077552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ab9dcb4d-115f-499c-b97d-80af34c118d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edb51c7f4b35449fb28187bec826edae'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.079405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d3445-3d2a-4bf7-b15f-7ef700daf120 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:03.079989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ab9dcb4d-115f-499c-b97d-80af34c118d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edb51c7f4b35449fb28187bec826edae'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.097495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf897a22-8b16-4abe-baa3-743b754929f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:03.100985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf897a22-8b16-4abe-baa3-743b754929f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:03.101691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf897a22-8b16-4abe-baa3-743b754929f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:03.102333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf897a22-8b16-4abe-baa3-743b754929f0 admin admin] PATH_INFO: `/v3/projects/3c79c775668a4efc8bc07fbc92fe5473` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:03.107213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf897a22-8b16-4abe-baa3-743b754929f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c79c775668a4efc8bc07fbc92fe5473)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:03.109336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf897a22-8b16-4abe-baa3-743b754929f0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:03.113652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ab9dcb4d-115f-499c-b97d-80af34c118d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edb51c7f4b35449fb28187bec826edae'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.143748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ab9dcb4d-115f-499c-b97d-80af34c118d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edb51c7f4b35449fb28187bec826edae'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.157884 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3395/6709] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:08:02 2021] DELETE /identity/v3/users/edb51c7f4b35449fb28187bec826edae => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:03.235805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cf897a22-8b16-4abe-baa3-743b754929f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c79c775668a4efc8bc07fbc92fe5473', 'request_id': 'req-cf897a22-8b16-4abe-baa3-743b754929f0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.278214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dcb4d-115f-499c-b97d-80af34c118d5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:03.281258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ab9dcb4d-115f-499c-b97d-80af34c118d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:03.293284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cf897a22-8b16-4abe-baa3-743b754929f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c79c775668a4efc8bc07fbc92fe5473', 'request_id': 'req-cf897a22-8b16-4abe-baa3-743b754929f0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.337268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cf897a22-8b16-4abe-baa3-743b754929f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c79c775668a4efc8bc07fbc92fe5473', 'request_id': 'req-cf897a22-8b16-4abe-baa3-743b754929f0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.368471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cf897a22-8b16-4abe-baa3-743b754929f0 admin admin] The token cache is being invalidate because project 3c79c775668a4efc8bc07fbc92fe5473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:03.369080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cf897a22-8b16-4abe-baa3-743b754929f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.374425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cf897a22-8b16-4abe-baa3-743b754929f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.378631 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3315/6710] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:02 2021] DELETE /identity/v3/projects/3c79c775668a4efc8bc07fbc92fe5473 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:03.385409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bbc8e-d4da-42b7-8aea-3a6ae6335370 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:03.386064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bbc8e-d4da-42b7-8aea-3a6ae6335370 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:03.386651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bbc8e-d4da-42b7-8aea-3a6ae6335370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:03.457707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-308bbc8e-d4da-42b7-8aea-3a6ae6335370 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:03.458997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-308bbc8e-d4da-42b7-8aea-3a6ae6335370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:03.478130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dcb4d-115f-499c-b97d-80af34c118d5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:03.567525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbde269-f330-4f9a-8130-6c4929d1aa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:03.568523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbde269-f330-4f9a-8130-6c4929d1aa2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:03.568982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbde269-f330-4f9a-8130-6c4929d1aa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:03.569357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbde269-f330-4f9a-8130-6c4929d1aa2c admin admin] PATH_INFO: `/v3/projects/59ca1dfad3564b5ab798abcccc7333fe` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:03.570748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbde269-f330-4f9a-8130-6c4929d1aa2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ca1dfad3564b5ab798abcccc7333fe)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:03.572826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbde269-f330-4f9a-8130-6c4929d1aa2c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:03.600164 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3316/6711] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:03.608510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ba834-d8b1-44a4-a849-d9bf6addffc6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:03.609155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ba834-d8b1-44a4-a849-d9bf6addffc6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:03.609741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ba834-d8b1-44a4-a849-d9bf6addffc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:03.643868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b38ba834-d8b1-44a4-a849-d9bf6addffc6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:03.650033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b38ba834-d8b1-44a4-a849-d9bf6addffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:03.673229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2fbde269-f330-4f9a-8130-6c4929d1aa2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ca1dfad3564b5ab798abcccc7333fe', 'request_id': 'req-2fbde269-f330-4f9a-8130-6c4929d1aa2c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.681572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2fbde269-f330-4f9a-8130-6c4929d1aa2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ca1dfad3564b5ab798abcccc7333fe', 'request_id': 'req-2fbde269-f330-4f9a-8130-6c4929d1aa2c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.696927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2fbde269-f330-4f9a-8130-6c4929d1aa2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ca1dfad3564b5ab798abcccc7333fe', 'request_id': 'req-2fbde269-f330-4f9a-8130-6c4929d1aa2c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.712122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2fbde269-f330-4f9a-8130-6c4929d1aa2c admin admin] The token cache is being invalidate because project 59ca1dfad3564b5ab798abcccc7333fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:03.713781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2fbde269-f330-4f9a-8130-6c4929d1aa2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.716462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2fbde269-f330-4f9a-8130-6c4929d1aa2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.722875 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3396/6712] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:03 2021] DELETE /identity/v3/projects/59ca1dfad3564b5ab798abcccc7333fe => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:03.723897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbde269-f330-4f9a-8130-6c4929d1aa2c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:03.728376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2fbde269-f330-4f9a-8130-6c4929d1aa2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:03.800280 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3317/6713] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:08:03.802569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ba834-d8b1-44a4-a849-d9bf6addffc6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:03.804144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b38ba834-d8b1-44a4-a849-d9bf6addffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:03.821728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ba834-d8b1-44a4-a849-d9bf6addffc6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:03.832081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60b2eb-9631-4a6e-bdcf-ce5c9d1b12a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:03.835443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60b2eb-9631-4a6e-bdcf-ce5c9d1b12a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:03.836081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60b2eb-9631-4a6e-bdcf-ce5c9d1b12a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:03.836498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60b2eb-9631-4a6e-bdcf-ce5c9d1b12a8 admin admin] PATH_INFO: `/v3/users/8b2ee23cbc5b42ad83c32c74f1f73d41` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:03.841172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60b2eb-9631-4a6e-bdcf-ce5c9d1b12a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2ee23cbc5b42ad83c32c74f1f73d41)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:03.845389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60b2eb-9631-4a6e-bdcf-ce5c9d1b12a8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:03.905522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbde269-f330-4f9a-8130-6c4929d1aa2c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:03.919256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41513393-d493-4e63-b021-992472af77a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:03.925209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41513393-d493-4e63-b021-992472af77a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:03.925662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41513393-d493-4e63-b021-992472af77a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:03.926219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41513393-d493-4e63-b021-992472af77a6 admin admin] PATH_INFO: `/v3/projects/e4d18f9fdaf94bd18c0bd9d50321f873` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:03.927726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41513393-d493-4e63-b021-992472af77a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d18f9fdaf94bd18c0bd9d50321f873)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:03.930096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41513393-d493-4e63-b021-992472af77a6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:03.962064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-eb60b2eb-9631-4a6e-bdcf-ce5c9d1b12a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2ee23cbc5b42ad83c32c74f1f73d41'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.977135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-eb60b2eb-9631-4a6e-bdcf-ce5c9d1b12a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2ee23cbc5b42ad83c32c74f1f73d41'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.991936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-eb60b2eb-9631-4a6e-bdcf-ce5c9d1b12a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2ee23cbc5b42ad83c32c74f1f73d41'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:03.992828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-eb60b2eb-9631-4a6e-bdcf-ce5c9d1b12a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2ee23cbc5b42ad83c32c74f1f73d41'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:04.004315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-eb60b2eb-9631-4a6e-bdcf-ce5c9d1b12a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2ee23cbc5b42ad83c32c74f1f73d41'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:04.016201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-41513393-d493-4e63-b021-992472af77a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d18f9fdaf94bd18c0bd9d50321f873', 'request_id': 'req-41513393-d493-4e63-b021-992472af77a6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:04.020631 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3318/6714] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:08:03 2021] DELETE /identity/v3/users/8b2ee23cbc5b42ad83c32c74f1f73d41 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:04.021718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60b2eb-9631-4a6e-bdcf-ce5c9d1b12a8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:04.024758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eb60b2eb-9631-4a6e-bdcf-ce5c9d1b12a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:04.039248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-41513393-d493-4e63-b021-992472af77a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d18f9fdaf94bd18c0bd9d50321f873', 'request_id': 'req-41513393-d493-4e63-b021-992472af77a6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:04.058447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-41513393-d493-4e63-b021-992472af77a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d18f9fdaf94bd18c0bd9d50321f873', 'request_id': 'req-41513393-d493-4e63-b021-992472af77a6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:04.088101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-41513393-d493-4e63-b021-992472af77a6 admin admin] The token cache is being invalidate because project e4d18f9fdaf94bd18c0bd9d50321f873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:04.089111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-41513393-d493-4e63-b021-992472af77a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:04.092280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-41513393-d493-4e63-b021-992472af77a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:04.096413 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3397/6715] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:03 2021] DELETE /identity/v3/projects/e4d18f9fdaf94bd18c0bd9d50321f873 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:04.102665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc301875-ec26-4ec2-959e-6252073eaa0b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:04.103059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc301875-ec26-4ec2-959e-6252073eaa0b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:04.103358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc301875-ec26-4ec2-959e-6252073eaa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:04.128374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bc301875-ec26-4ec2-959e-6252073eaa0b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:04.130058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bc301875-ec26-4ec2-959e-6252073eaa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:04.162896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60b2eb-9631-4a6e-bdcf-ce5c9d1b12a8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:04.193419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9776d5-f18e-47da-b2e9-89e023dab175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:04.196411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9776d5-f18e-47da-b2e9-89e023dab175 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:04.196944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9776d5-f18e-47da-b2e9-89e023dab175 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:04.198123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9776d5-f18e-47da-b2e9-89e023dab175 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:04.199886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9776d5-f18e-47da-b2e9-89e023dab175 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:08:04.202666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9776d5-f18e-47da-b2e9-89e023dab175 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:04.204646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9776d5-f18e-47da-b2e9-89e023dab175 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:04.234960 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3319/6716] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:08:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:08:04.235529 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3398/6717] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:08:04.240006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecc93b-6229-4fe7-9919-96706ec29874 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:04.240429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecc93b-6229-4fe7-9919-96706ec29874 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:04.240846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecc93b-6229-4fe7-9919-96706ec29874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:04.242842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc301875-ec26-4ec2-959e-6252073eaa0b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:04.246467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bc301875-ec26-4ec2-959e-6252073eaa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:04.272814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc301875-ec26-4ec2-959e-6252073eaa0b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:04.278594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39118d48-8798-46b5-8c8e-543d8c2f55bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:04.279911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39118d48-8798-46b5-8c8e-543d8c2f55bc admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:04.280198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39118d48-8798-46b5-8c8e-543d8c2f55bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:04.280480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39118d48-8798-46b5-8c8e-543d8c2f55bc admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:04.281187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39118d48-8798-46b5-8c8e-543d8c2f55bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:04.283420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39118d48-8798-46b5-8c8e-543d8c2f55bc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:04.289480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1eecc93b-6229-4fe7-9919-96706ec29874 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:04.292396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1eecc93b-6229-4fe7-9919-96706ec29874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:04.320618 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3320/6718] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:04.321864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecc93b-6229-4fe7-9919-96706ec29874 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:04.340927 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3399/6719] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:08:04 2021] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:04.346073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39118d48-8798-46b5-8c8e-543d8c2f55bc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:04.348566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecc93b-6229-4fe7-9919-96706ec29874 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:04.473281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990b49a-47ba-45ea-bf8c-245b2b40614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:04.476280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990b49a-47ba-45ea-bf8c-245b2b40614e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:04.476887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990b49a-47ba-45ea-bf8c-245b2b40614e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:04.477809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990b49a-47ba-45ea-bf8c-245b2b40614e admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:04.480075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990b49a-47ba-45ea-bf8c-245b2b40614e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:08:04.480563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990b49a-47ba-45ea-bf8c-245b2b40614e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:04.487391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990b49a-47ba-45ea-bf8c-245b2b40614e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:04.500579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39118d48-8798-46b5-8c8e-543d8c2f55bc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:04.507474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f042726-74ff-4db9-96ed-b168cb707db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:04.508742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f042726-74ff-4db9-96ed-b168cb707db3 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:04.509095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f042726-74ff-4db9-96ed-b168cb707db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:04.509474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f042726-74ff-4db9-96ed-b168cb707db3 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:04.511287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f042726-74ff-4db9-96ed-b168cb707db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:04.518570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f042726-74ff-4db9-96ed-b168cb707db3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:04.521580 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3321/6720] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:08:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:08:04.528253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990b49a-47ba-45ea-bf8c-245b2b40614e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:04.550909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990b49a-47ba-45ea-bf8c-245b2b40614e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:04.578397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eef37a-637c-4e76-9212-d1f9b86f344e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:04.579076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eef37a-637c-4e76-9212-d1f9b86f344e admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:04.579367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eef37a-637c-4e76-9212-d1f9b86f344e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:04.579648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eef37a-637c-4e76-9212-d1f9b86f344e admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:04.580360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eef37a-637c-4e76-9212-d1f9b86f344e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:04.582423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eef37a-637c-4e76-9212-d1f9b86f344e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:04.586813 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3400/6721] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:08:04 2021] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:04.587706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f042726-74ff-4db9-96ed-b168cb707db3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:04.592662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6f042726-74ff-4db9-96ed-b168cb707db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:04.608101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f042726-74ff-4db9-96ed-b168cb707db3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:04.613898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720a764-08a1-4a3d-b9da-23aeb97255f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:04.615010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720a764-08a1-4a3d-b9da-23aeb97255f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:04.615208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720a764-08a1-4a3d-b9da-23aeb97255f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:04.615585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720a764-08a1-4a3d-b9da-23aeb97255f9 admin admin] PATH_INFO: `/v3/projects/e24f90f562d842a3b3dd577c91ddfdd5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:04.616962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720a764-08a1-4a3d-b9da-23aeb97255f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e24f90f562d842a3b3dd577c91ddfdd5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:04.619017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720a764-08a1-4a3d-b9da-23aeb97255f9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:04.661262 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3322/6722] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:08:04 2021] POST /identity/v3/projects => generated 359 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:04.662713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eef37a-637c-4e76-9212-d1f9b86f344e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:04.736120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7720a764-08a1-4a3d-b9da-23aeb97255f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e24f90f562d842a3b3dd577c91ddfdd5', 'request_id': 'req-7720a764-08a1-4a3d-b9da-23aeb97255f9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:04.748376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7720a764-08a1-4a3d-b9da-23aeb97255f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e24f90f562d842a3b3dd577c91ddfdd5', 'request_id': 'req-7720a764-08a1-4a3d-b9da-23aeb97255f9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:04.766153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7720a764-08a1-4a3d-b9da-23aeb97255f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e24f90f562d842a3b3dd577c91ddfdd5', 'request_id': 'req-7720a764-08a1-4a3d-b9da-23aeb97255f9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:04.787982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7720a764-08a1-4a3d-b9da-23aeb97255f9 admin admin] The token cache is being invalidate because project e24f90f562d842a3b3dd577c91ddfdd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:04.788286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7720a764-08a1-4a3d-b9da-23aeb97255f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:04.789108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7720a764-08a1-4a3d-b9da-23aeb97255f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:04.791567 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3401/6723] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:04 2021] DELETE /identity/v3/projects/e24f90f562d842a3b3dd577c91ddfdd5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:04.792451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720a764-08a1-4a3d-b9da-23aeb97255f9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:04.793701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7720a764-08a1-4a3d-b9da-23aeb97255f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:04.841413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eef37a-637c-4e76-9212-d1f9b86f344e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:04.885489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720a764-08a1-4a3d-b9da-23aeb97255f9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:04.901192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b149c-6d75-4cce-9bb9-f82510cc914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:04.901881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b149c-6d75-4cce-9bb9-f82510cc914f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:04.902170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b149c-6d75-4cce-9bb9-f82510cc914f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:04.902492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b149c-6d75-4cce-9bb9-f82510cc914f admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:04.903208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b149c-6d75-4cce-9bb9-f82510cc914f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:04.905569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b149c-6d75-4cce-9bb9-f82510cc914f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:04.937064 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3402/6724] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:08:04 2021] POST /identity/v3/users => generated 280 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:04.937064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b149c-6d75-4cce-9bb9-f82510cc914f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:04.941972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-232b149c-6d75-4cce-9bb9-f82510cc914f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:04.966695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b149c-6d75-4cce-9bb9-f82510cc914f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:04.973592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8df28-277f-4560-9ff4-4577ce7cda0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:04.973933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8df28-277f-4560-9ff4-4577ce7cda0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:04.974147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8df28-277f-4560-9ff4-4577ce7cda0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:04.974461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8df28-277f-4560-9ff4-4577ce7cda0c admin admin] PATH_INFO: `/v3/users/ba89d362342c4faaa6ae74f2e4c6d110` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:04.975769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8df28-277f-4560-9ff4-4577ce7cda0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba89d362342c4faaa6ae74f2e4c6d110)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:04.977713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8df28-277f-4560-9ff4-4577ce7cda0c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:05.004976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735370b-fc39-4ca7-85f5-f35a5272ef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:05.006196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735370b-fc39-4ca7-85f5-f35a5272ef38 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:05.006599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735370b-fc39-4ca7-85f5-f35a5272ef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:05.007301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735370b-fc39-4ca7-85f5-f35a5272ef38 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:05.008213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735370b-fc39-4ca7-85f5-f35a5272ef38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:05.010965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735370b-fc39-4ca7-85f5-f35a5272ef38 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:05.030029 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3323/6725] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:04 2021] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:05.031309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735370b-fc39-4ca7-85f5-f35a5272ef38 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:05.041831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735370b-fc39-4ca7-85f5-f35a5272ef38 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:05.046136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cfe8df28-277f-4560-9ff4-4577ce7cda0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba89d362342c4faaa6ae74f2e4c6d110'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:05.049311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76971544-1a0b-49cd-afb7-c7c69bfbc9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:05.050388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76971544-1a0b-49cd-afb7-c7c69bfbc9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:05.050783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76971544-1a0b-49cd-afb7-c7c69bfbc9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:05.051850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76971544-1a0b-49cd-afb7-c7c69bfbc9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:05.052773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76971544-1a0b-49cd-afb7-c7c69bfbc9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:05.054545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76971544-1a0b-49cd-afb7-c7c69bfbc9a1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:05.056308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cfe8df28-277f-4560-9ff4-4577ce7cda0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba89d362342c4faaa6ae74f2e4c6d110'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:05.057535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cfe8df28-277f-4560-9ff4-4577ce7cda0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba89d362342c4faaa6ae74f2e4c6d110'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:05.071955 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3324/6726] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:05 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:05.073074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76971544-1a0b-49cd-afb7-c7c69bfbc9a1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:05.074239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cfe8df28-277f-4560-9ff4-4577ce7cda0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba89d362342c4faaa6ae74f2e4c6d110'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:05.079083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-76971544-1a0b-49cd-afb7-c7c69bfbc9a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:05.091908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cfe8df28-277f-4560-9ff4-4577ce7cda0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba89d362342c4faaa6ae74f2e4c6d110'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:05.095186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76971544-1a0b-49cd-afb7-c7c69bfbc9a1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:05.101894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4338313-e13c-4314-92bc-d1a05c1a9a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:05.102126 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3403/6727] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:08:04 2021] DELETE /identity/v3/users/ba89d362342c4faaa6ae74f2e4c6d110 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:05.102896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4338313-e13c-4314-92bc-d1a05c1a9a49 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:05.103433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4338313-e13c-4314-92bc-d1a05c1a9a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:05.103826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4338313-e13c-4314-92bc-d1a05c1a9a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:05.104696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4338313-e13c-4314-92bc-d1a05c1a9a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:05.107934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8df28-277f-4560-9ff4-4577ce7cda0c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:05.109558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cfe8df28-277f-4560-9ff4-4577ce7cda0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:05.120036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4338313-e13c-4314-92bc-d1a05c1a9a49 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:05.159936 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3325/6728] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:05 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:05.161965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4338313-e13c-4314-92bc-d1a05c1a9a49 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:05.165382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d4338313-e13c-4314-92bc-d1a05c1a9a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:05.186811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4338313-e13c-4314-92bc-d1a05c1a9a49 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:05.271428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8df28-277f-4560-9ff4-4577ce7cda0c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:05.290712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8a83e-3632-462d-92a7-86a2e9b6aebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:05.296054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8a83e-3632-462d-92a7-86a2e9b6aebb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:05.301699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8a83e-3632-462d-92a7-86a2e9b6aebb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:05.306701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8a83e-3632-462d-92a7-86a2e9b6aebb admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:05.308763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8a83e-3632-462d-92a7-86a2e9b6aebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:05.335179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8a83e-3632-462d-92a7-86a2e9b6aebb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:05.363895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74111e9d-7f37-40ef-aabb-90fe3f9522e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:05.366322 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3404/6729] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:05 2021] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:05.370269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8a83e-3632-462d-92a7-86a2e9b6aebb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:05.372433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74111e9d-7f37-40ef-aabb-90fe3f9522e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:05.373234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74111e9d-7f37-40ef-aabb-90fe3f9522e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:05.373527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74111e9d-7f37-40ef-aabb-90fe3f9522e5 admin admin] PATH_INFO: `/v3/projects/3646d355864d48a285d5986fb3e43b1a/users/f273233bcb2a4326abc9722dfd663978/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:05.392610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8a83e-3632-462d-92a7-86a2e9b6aebb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:05.392860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74111e9d-7f37-40ef-aabb-90fe3f9522e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3646d355864d48a285d5986fb3e43b1a, user_id=f273233bcb2a4326abc9722dfd663978, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:05.399004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74111e9d-7f37-40ef-aabb-90fe3f9522e5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:05.400081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6e131-b392-408b-ad12-dffe741305cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:05.401082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6e131-b392-408b-ad12-dffe741305cd admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:05.401483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6e131-b392-408b-ad12-dffe741305cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:05.401855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6e131-b392-408b-ad12-dffe741305cd admin admin] PATH_INFO: `/v3/projects/ec50735fd0a249aa9dde91f7ff7f2feb/users/3bcae6166115448cabc7b9e23af17fd5/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:05.420286 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3326/6730] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:05 2021] PUT /identity/v3/projects/3646d355864d48a285d5986fb3e43b1a/users/f273233bcb2a4326abc9722dfd663978/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:05.434847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4777ee3-181f-4670-897a-e338ebe21068 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:05.434847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4777ee3-181f-4670-897a-e338ebe21068 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:05.436208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4777ee3-181f-4670-897a-e338ebe21068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:05.440346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6e131-b392-408b-ad12-dffe741305cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec50735fd0a249aa9dde91f7ff7f2feb, user_id=3bcae6166115448cabc7b9e23af17fd5, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:05.443408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6e131-b392-408b-ad12-dffe741305cd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:05.473245 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3405/6731] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:05 2021] PUT /identity/v3/projects/ec50735fd0a249aa9dde91f7ff7f2feb/users/3bcae6166115448cabc7b9e23af17fd5/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:05.484061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1205fc-b734-41b2-907d-de4e6ab3a1b4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:05.484397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1205fc-b734-41b2-907d-de4e6ab3a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:05.484780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1205fc-b734-41b2-907d-de4e6ab3a1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:05.498799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e4777ee3-181f-4670-897a-e338ebe21068 None None] MFA Rules not processed for user `f273233bcb2a4326abc9722dfd663978`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:05.500214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e4777ee3-181f-4670-897a-e338ebe21068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:05.539735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3c1205fc-b734-41b2-907d-de4e6ab3a1b4 None None] MFA Rules not processed for user `3bcae6166115448cabc7b9e23af17fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:05.541380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3c1205fc-b734-41b2-907d-de4e6ab3a1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:05.606108 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3327/6732] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:05 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:05.611633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4777ee3-181f-4670-897a-e338ebe21068 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:05.694838 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3406/6733] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:05 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:05.721064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4777ee3-181f-4670-897a-e338ebe21068 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:05.727571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d83b5-0af8-453c-abf3-b444ccc9e65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:05.728265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d83b5-0af8-453c-abf3-b444ccc9e65d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:05.728556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d83b5-0af8-453c-abf3-b444ccc9e65d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:05.728845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d83b5-0af8-453c-abf3-b444ccc9e65d admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:05.729475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1205fc-b734-41b2-907d-de4e6ab3a1b4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:05.729591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d83b5-0af8-453c-abf3-b444ccc9e65d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:05.731141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3c1205fc-b734-41b2-907d-de4e6ab3a1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:05.733461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d83b5-0af8-453c-abf3-b444ccc9e65d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:05.782233 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3328/6734] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:08:05 2021] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:05.784963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d83b5-0af8-453c-abf3-b444ccc9e65d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:05.879462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d83b5-0af8-453c-abf3-b444ccc9e65d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:05.889325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1205fc-b734-41b2-907d-de4e6ab3a1b4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:05.898876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab25ed8-b751-4549-a0ba-727a61ccfd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:05.900062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab25ed8-b751-4549-a0ba-727a61ccfd2f admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:05.900365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab25ed8-b751-4549-a0ba-727a61ccfd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:05.900720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab25ed8-b751-4549-a0ba-727a61ccfd2f admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:05.901464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab25ed8-b751-4549-a0ba-727a61ccfd2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:05.905877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab25ed8-b751-4549-a0ba-727a61ccfd2f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:05.982930 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3329/6735] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:08:05 2021] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:05.983999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab25ed8-b751-4549-a0ba-727a61ccfd2f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:05.986887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6ab25ed8-b751-4549-a0ba-727a61ccfd2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:06.015325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4debf9-cf15-4343-a2e8-1f64376ead47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:06.016219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4debf9-cf15-4343-a2e8-1f64376ead47 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:06.016591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4debf9-cf15-4343-a2e8-1f64376ead47 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:06.017902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4debf9-cf15-4343-a2e8-1f64376ead47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:06.037839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab25ed8-b751-4549-a0ba-727a61ccfd2f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:06.062484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b0b16-2371-4e46-8ff2-491fb5c7475e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:06.063393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b0b16-2371-4e46-8ff2-491fb5c7475e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:06.063683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b0b16-2371-4e46-8ff2-491fb5c7475e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:06.063969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b0b16-2371-4e46-8ff2-491fb5c7475e admin admin] PATH_INFO: `/v3/projects/051d73b6a502477ab57deef694352d33` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:06.067298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b0b16-2371-4e46-8ff2-491fb5c7475e admin admin] RBAC: Authorizing `identity:delete_project(project_id=051d73b6a502477ab57deef694352d33)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:06.069265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b0b16-2371-4e46-8ff2-491fb5c7475e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:06.160377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4debf9-cf15-4343-a2e8-1f64376ead47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:06.162536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4debf9-cf15-4343-a2e8-1f64376ead47 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:06.164051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-331b0b16-2371-4e46-8ff2-491fb5c7475e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '051d73b6a502477ab57deef694352d33', 'request_id': 'req-331b0b16-2371-4e46-8ff2-491fb5c7475e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:06.173549 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3407/6736] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:05 2021] GET /identity/v3/auth/tokens => generated 3226 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:08:06.174464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4debf9-cf15-4343-a2e8-1f64376ead47 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:06.182858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-331b0b16-2371-4e46-8ff2-491fb5c7475e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '051d73b6a502477ab57deef694352d33', 'request_id': 'req-331b0b16-2371-4e46-8ff2-491fb5c7475e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:06.193213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4debf9-cf15-4343-a2e8-1f64376ead47 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:06.205063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-331b0b16-2371-4e46-8ff2-491fb5c7475e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '051d73b6a502477ab57deef694352d33', 'request_id': 'req-331b0b16-2371-4e46-8ff2-491fb5c7475e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:06.223878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-331b0b16-2371-4e46-8ff2-491fb5c7475e admin admin] The token cache is being invalidate because project 051d73b6a502477ab57deef694352d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:06.224897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-331b0b16-2371-4e46-8ff2-491fb5c7475e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:06.227251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-331b0b16-2371-4e46-8ff2-491fb5c7475e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:06.233631 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3330/6737] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:05 2021] DELETE /identity/v3/projects/051d73b6a502477ab57deef694352d33 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:06.233631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b0b16-2371-4e46-8ff2-491fb5c7475e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:06.235264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-331b0b16-2371-4e46-8ff2-491fb5c7475e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:06.285116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656883e-ff17-4ff4-9ccb-253cd346f54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:06.286120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656883e-ff17-4ff4-9ccb-253cd346f54f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:06.286552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656883e-ff17-4ff4-9ccb-253cd346f54f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:06.286973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656883e-ff17-4ff4-9ccb-253cd346f54f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:06.287796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656883e-ff17-4ff4-9ccb-253cd346f54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:06.290303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656883e-ff17-4ff4-9ccb-253cd346f54f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:06.303504 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3408/6738] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:06 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:06.304626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656883e-ff17-4ff4-9ccb-253cd346f54f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:06.306758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e656883e-ff17-4ff4-9ccb-253cd346f54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:06.314314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b0b16-2371-4e46-8ff2-491fb5c7475e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:06.320452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656883e-ff17-4ff4-9ccb-253cd346f54f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:06.321764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d2231-7a24-4837-95f0-4c6ce5379087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:06.322829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2231-7a24-4837-95f0-4c6ce5379087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:06.323075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2231-7a24-4837-95f0-4c6ce5379087 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:06.323671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2231-7a24-4837-95f0-4c6ce5379087 admin admin] PATH_INFO: `/v3/users/0a98795bdb7447c5b2a4930173b3c56d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:06.324993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d2231-7a24-4837-95f0-4c6ce5379087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a98795bdb7447c5b2a4930173b3c56d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:06.327860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d2231-7a24-4837-95f0-4c6ce5379087 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:06.329925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae6973-e888-4a38-99ff-58b895efa66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:06.331692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae6973-e888-4a38-99ff-58b895efa66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:06.332052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae6973-e888-4a38-99ff-58b895efa66b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:06.332379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae6973-e888-4a38-99ff-58b895efa66b admin admin] PATH_INFO: `/v3/users/3bcae6166115448cabc7b9e23af17fd5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:06.333640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae6973-e888-4a38-99ff-58b895efa66b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bcae6166115448cabc7b9e23af17fd5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:06.336281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae6973-e888-4a38-99ff-58b895efa66b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:06.403407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-93ae6973-e888-4a38-99ff-58b895efa66b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bcae6166115448cabc7b9e23af17fd5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:06.411822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-93ae6973-e888-4a38-99ff-58b895efa66b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bcae6166115448cabc7b9e23af17fd5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:06.412628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-93ae6973-e888-4a38-99ff-58b895efa66b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bcae6166115448cabc7b9e23af17fd5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:06.417486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-771d2231-7a24-4837-95f0-4c6ce5379087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a98795bdb7447c5b2a4930173b3c56d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:06.425747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-771d2231-7a24-4837-95f0-4c6ce5379087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a98795bdb7447c5b2a4930173b3c56d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:06.425946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-93ae6973-e888-4a38-99ff-58b895efa66b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bcae6166115448cabc7b9e23af17fd5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:06.441135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-93ae6973-e888-4a38-99ff-58b895efa66b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bcae6166115448cabc7b9e23af17fd5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:06.442469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-771d2231-7a24-4837-95f0-4c6ce5379087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a98795bdb7447c5b2a4930173b3c56d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:06.443350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-771d2231-7a24-4837-95f0-4c6ce5379087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a98795bdb7447c5b2a4930173b3c56d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:06.454319 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3409/6739] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:08:06 2021] DELETE /identity/v3/users/3bcae6166115448cabc7b9e23af17fd5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:06.454319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710023bb-9f3f-4b91-bfb4-23497439f0c3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:06.454319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710023bb-9f3f-4b91-bfb4-23497439f0c3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:06.454319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710023bb-9f3f-4b91-bfb4-23497439f0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:06.455983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-771d2231-7a24-4837-95f0-4c6ce5379087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a98795bdb7447c5b2a4930173b3c56d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:06.472680 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3331/6740] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:08:06 2021] DELETE /identity/v3/users/0a98795bdb7447c5b2a4930173b3c56d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:06.473756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d2231-7a24-4837-95f0-4c6ce5379087 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:06.475345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-771d2231-7a24-4837-95f0-4c6ce5379087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:06.497183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-710023bb-9f3f-4b91-bfb4-23497439f0c3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:06.501122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-710023bb-9f3f-4b91-bfb4-23497439f0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:06.586063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d2231-7a24-4837-95f0-4c6ce5379087 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:06.592189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6efe7-0594-4565-b12f-45d81caf1c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:06.593168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6efe7-0594-4565-b12f-45d81caf1c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:06.593531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6efe7-0594-4565-b12f-45d81caf1c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:06.593887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6efe7-0594-4565-b12f-45d81caf1c70 admin admin] PATH_INFO: `/v3/projects/019d5d0e36f94b2b9f1a37d5ca1b7aee/users/0eae9947c3e745b7ac16747e5676ea54/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:06.596136 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3410/6741] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:06.598225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa58744-6e79-44f3-8e1a-22caf2964e3f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:06.598748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa58744-6e79-44f3-8e1a-22caf2964e3f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:06.599211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa58744-6e79-44f3-8e1a-22caf2964e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:06.611933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6efe7-0594-4565-b12f-45d81caf1c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=019d5d0e36f94b2b9f1a37d5ca1b7aee, user_id=0eae9947c3e745b7ac16747e5676ea54, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:06.614908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6efe7-0594-4565-b12f-45d81caf1c70 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:06.621026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5aa58744-6e79-44f3-8e1a-22caf2964e3f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:06.623050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5aa58744-6e79-44f3-8e1a-22caf2964e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:06.632017 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3411/6742] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:06.633429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c57dc-be16-4737-bb04-bdb9010f4f40 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:06.633836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c57dc-be16-4737-bb04-bdb9010f4f40 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:06.634214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c57dc-be16-4737-bb04-bdb9010f4f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:06.657930 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3332/6743] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:06 2021] PUT /identity/v3/projects/019d5d0e36f94b2b9f1a37d5ca1b7aee/users/0eae9947c3e745b7ac16747e5676ea54/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:06.658908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6efe7-0594-4565-b12f-45d81caf1c70 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:06.660595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8ba6efe7-0594-4565-b12f-45d81caf1c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:06.662190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d43c57dc-be16-4737-bb04-bdb9010f4f40 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:06.663904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d43c57dc-be16-4737-bb04-bdb9010f4f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:06.760151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6efe7-0594-4565-b12f-45d81caf1c70 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:06.764199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8938113-650b-4f1f-9ed8-b9309790b21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:06.764996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8938113-650b-4f1f-9ed8-b9309790b21f service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:06.765289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8938113-650b-4f1f-9ed8-b9309790b21f service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:06.765573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8938113-650b-4f1f-9ed8-b9309790b21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:06.776707 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3412/6744] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:06.779797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c57dc-be16-4737-bb04-bdb9010f4f40 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:06.780313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8938113-650b-4f1f-9ed8-b9309790b21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:06.781756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8938113-650b-4f1f-9ed8-b9309790b21f service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:06.791787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c57dc-be16-4737-bb04-bdb9010f4f40 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:06.799991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33203f8e-8deb-49cf-a80f-82e4a6347ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:06.800677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33203f8e-8deb-49cf-a80f-82e4a6347ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:06.800964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33203f8e-8deb-49cf-a80f-82e4a6347ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:06.801252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33203f8e-8deb-49cf-a80f-82e4a6347ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:06.802005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33203f8e-8deb-49cf-a80f-82e4a6347ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:06.803686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33203f8e-8deb-49cf-a80f-82e4a6347ca9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:06.804563 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3333/6745] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:06.811478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8938113-650b-4f1f-9ed8-b9309790b21f service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:06.814799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f8938113-650b-4f1f-9ed8-b9309790b21f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:06.818902 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3413/6746] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:06 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:06.819909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33203f8e-8deb-49cf-a80f-82e4a6347ca9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:06.831322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33203f8e-8deb-49cf-a80f-82e4a6347ca9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:06.837353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d74cd2-fa06-488c-9f37-8201e7d593af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:06.838155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d74cd2-fa06-488c-9f37-8201e7d593af admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:06.838568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d74cd2-fa06-488c-9f37-8201e7d593af admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:06.838947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d74cd2-fa06-488c-9f37-8201e7d593af admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:06.839798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d74cd2-fa06-488c-9f37-8201e7d593af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:08:06.840272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d74cd2-fa06-488c-9f37-8201e7d593af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:06.842868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d74cd2-fa06-488c-9f37-8201e7d593af admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:06.842985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8938113-650b-4f1f-9ed8-b9309790b21f service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:06.849002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd9e32-a996-426f-a29b-1827b1d7a0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:06.850141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd9e32-a996-426f-a29b-1827b1d7a0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:06.850638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd9e32-a996-426f-a29b-1827b1d7a0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:06.851557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd9e32-a996-426f-a29b-1827b1d7a0d7 admin admin] PATH_INFO: `/v3/projects/58d1ab8b81784fb2ad1b6c9a7d9efc37` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:06.852983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd9e32-a996-426f-a29b-1827b1d7a0d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58d1ab8b81784fb2ad1b6c9a7d9efc37)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:06.855533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd9e32-a996-426f-a29b-1827b1d7a0d7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:06.861481 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3414/6747] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:08:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:08:06.868377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d74cd2-fa06-488c-9f37-8201e7d593af admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:06.886600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d74cd2-fa06-488c-9f37-8201e7d593af admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:06.894758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2827fe7-be5a-4fe2-895f-6e882b5c5915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:06.895981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827fe7-be5a-4fe2-895f-6e882b5c5915 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:06.896470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827fe7-be5a-4fe2-895f-6e882b5c5915 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:06.896904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827fe7-be5a-4fe2-895f-6e882b5c5915 admin admin] PATH_INFO: `/v3/projects/019d5d0e36f94b2b9f1a37d5ca1b7aee/users/0eae9947c3e745b7ac16747e5676ea54/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:06.899748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2827fe7-be5a-4fe2-895f-6e882b5c5915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=019d5d0e36f94b2b9f1a37d5ca1b7aee, user_id=0eae9947c3e745b7ac16747e5676ea54, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:06.902874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2827fe7-be5a-4fe2-895f-6e882b5c5915 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:06.929251 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3415/6748] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:06 2021] PUT /identity/v3/projects/019d5d0e36f94b2b9f1a37d5ca1b7aee/users/0eae9947c3e745b7ac16747e5676ea54/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:06.930530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2827fe7-be5a-4fe2-895f-6e882b5c5915 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:06.951368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e7dd9e32-a996-426f-a29b-1827b1d7a0d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'request_id': 'req-e7dd9e32-a996-426f-a29b-1827b1d7a0d7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:06.971869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e7dd9e32-a996-426f-a29b-1827b1d7a0d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'request_id': 'req-e7dd9e32-a996-426f-a29b-1827b1d7a0d7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:06.984175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e7dd9e32-a996-426f-a29b-1827b1d7a0d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d1ab8b81784fb2ad1b6c9a7d9efc37', 'request_id': 'req-e7dd9e32-a996-426f-a29b-1827b1d7a0d7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:07.002544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e7dd9e32-a996-426f-a29b-1827b1d7a0d7 admin admin] The token cache is being invalidate because project 58d1ab8b81784fb2ad1b6c9a7d9efc37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:07.002954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e7dd9e32-a996-426f-a29b-1827b1d7a0d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:07.003810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e7dd9e32-a996-426f-a29b-1827b1d7a0d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:07.006467 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3334/6749] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:06 2021] DELETE /identity/v3/projects/58d1ab8b81784fb2ad1b6c9a7d9efc37 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:07.007844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b74e4-56de-4cb8-9025-8a591193bc03 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:07.008204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b74e4-56de-4cb8-9025-8a591193bc03 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:07.008555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b74e4-56de-4cb8-9025-8a591193bc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:07.044179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d68b74e4-56de-4cb8-9025-8a591193bc03 None None] MFA Rules not processed for user `0eae9947c3e745b7ac16747e5676ea54`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:07.045984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d68b74e4-56de-4cb8-9025-8a591193bc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:07.074818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2827fe7-be5a-4fe2-895f-6e882b5c5915 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:07.156030 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3335/6750] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:07 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:07.159641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3570def-cc88-480b-ad5b-303f4cb04fcb None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:07.159641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3570def-cc88-480b-ad5b-303f4cb04fcb None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:07.159641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3570def-cc88-480b-ad5b-303f4cb04fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:07.173770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17927c53-7683-4dbf-afab-c103a773f649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:07.173770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17927c53-7683-4dbf-afab-c103a773f649 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:07.173770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17927c53-7683-4dbf-afab-c103a773f649 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:07.174379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17927c53-7683-4dbf-afab-c103a773f649 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:07.176137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17927c53-7683-4dbf-afab-c103a773f649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:07.177714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17927c53-7683-4dbf-afab-c103a773f649 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:07.190522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e3570def-cc88-480b-ad5b-303f4cb04fcb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:07.191731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e3570def-cc88-480b-ad5b-303f4cb04fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:07.204469 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3336/6751] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:07.205385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3570def-cc88-480b-ad5b-303f4cb04fcb None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:07.207888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e3570def-cc88-480b-ad5b-303f4cb04fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:07.230220 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3416/6752] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:08:06 2021] POST /identity/v3/projects => generated 373 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:07.232617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a192-8581-46a9-b9a3-3ea50a180e2e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:07.233142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a192-8581-46a9-b9a3-3ea50a180e2e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:07.233706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a192-8581-46a9-b9a3-3ea50a180e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:07.273316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b213a192-8581-46a9-b9a3-3ea50a180e2e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:07.275112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b213a192-8581-46a9-b9a3-3ea50a180e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:07.317642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3570def-cc88-480b-ad5b-303f4cb04fcb None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:07.487940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20351fe6-49e6-4315-923e-3639c9cab0c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:07.488986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20351fe6-49e6-4315-923e-3639c9cab0c7 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:07.489473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20351fe6-49e6-4315-923e-3639c9cab0c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:07.489923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20351fe6-49e6-4315-923e-3639c9cab0c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:07.629414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20351fe6-49e6-4315-923e-3639c9cab0c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:07.630915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20351fe6-49e6-4315-923e-3639c9cab0c7 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:07.647219 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3337/6753] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:07 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:07.648103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20351fe6-49e6-4315-923e-3639c9cab0c7 service cinder] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:07.657668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-20351fe6-49e6-4315-923e-3639c9cab0c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:07.667864 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3417/6754] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:07.670574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213a192-8581-46a9-b9a3-3ea50a180e2e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:07.677767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b213a192-8581-46a9-b9a3-3ea50a180e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:07.690562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20351fe6-49e6-4315-923e-3639c9cab0c7 service cinder] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:07.707808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c2240-b82f-4aaa-ae5e-f531b4ffd98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:07.708426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c2240-b82f-4aaa-ae5e-f531b4ffd98f admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:07.708678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c2240-b82f-4aaa-ae5e-f531b4ffd98f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:07.710648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c2240-b82f-4aaa-ae5e-f531b4ffd98f admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:07.711255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c2240-b82f-4aaa-ae5e-f531b4ffd98f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:07.715914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c2240-b82f-4aaa-ae5e-f531b4ffd98f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:07.736852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213a192-8581-46a9-b9a3-3ea50a180e2e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:07.758012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:07.759516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:07.759942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:07.760223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb admin admin] PATH_INFO: `/v3/projects/ec50735fd0a249aa9dde91f7ff7f2feb` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:07.761616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec50735fd0a249aa9dde91f7ff7f2feb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:07.770192 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3338/6755] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:08:07 2021] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:07.771584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:07.772447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c2240-b82f-4aaa-ae5e-f531b4ffd98f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:07.813241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c2240-b82f-4aaa-ae5e-f531b4ffd98f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:07.824851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3145d-af17-4290-bcd6-ce17f72212e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:07.825669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3145d-af17-4290-bcd6-ce17f72212e8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:07.830580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3145d-af17-4290-bcd6-ce17f72212e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:07.832571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3145d-af17-4290-bcd6-ce17f72212e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:07.833503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3145d-af17-4290-bcd6-ce17f72212e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:08:07.837584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3145d-af17-4290-bcd6-ce17f72212e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:07.839282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3145d-af17-4290-bcd6-ce17f72212e8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:07.865296 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3339/6756] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:08:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:08:07.869516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3145d-af17-4290-bcd6-ce17f72212e8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:07.882864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec50735fd0a249aa9dde91f7ff7f2feb', 'request_id': 'req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:07.897506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3145d-af17-4290-bcd6-ce17f72212e8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:07.900880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec50735fd0a249aa9dde91f7ff7f2feb', 'request_id': 'req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:07.928582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec50735fd0a249aa9dde91f7ff7f2feb', 'request_id': 'req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:07.956533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb admin admin] The token cache is being invalidate because project ec50735fd0a249aa9dde91f7ff7f2feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:07.956764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:07.957464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:07.959507 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3418/6757] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:07 2021] DELETE /identity/v3/projects/ec50735fd0a249aa9dde91f7ff7f2feb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:07.960957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:07.962976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:08.026121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad2cb0-def3-4634-92c3-2e38f35cce0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:08.026847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad2cb0-def3-4634-92c3-2e38f35cce0d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:08.027193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad2cb0-def3-4634-92c3-2e38f35cce0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:08.027479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad2cb0-def3-4634-92c3-2e38f35cce0d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:08.028267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad2cb0-def3-4634-92c3-2e38f35cce0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:08.033681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad2cb0-def3-4634-92c3-2e38f35cce0d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:08.049643 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3340/6758] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:07 2021] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:08.051152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bb6b5-6a31-4533-ac3b-ec55e653f306 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:08.051499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bb6b5-6a31-4533-ac3b-ec55e653f306 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:08.051791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bb6b5-6a31-4533-ac3b-ec55e653f306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:08.093028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1e2bb6b5-6a31-4533-ac3b-ec55e653f306 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:08.096030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1e2bb6b5-6a31-4533-ac3b-ec55e653f306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:08.116123 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3341/6759] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:08.117103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bb6b5-6a31-4533-ac3b-ec55e653f306 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:08.118743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1e2bb6b5-6a31-4533-ac3b-ec55e653f306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:08.120743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3cad-e659-4617-bbe9-d3f3d4fe6efb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:08.147473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda15d6-346c-494c-9fed-943414633ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:08.148824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda15d6-346c-494c-9fed-943414633ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:08.150094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda15d6-346c-494c-9fed-943414633ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:08.150619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda15d6-346c-494c-9fed-943414633ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:08.152746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda15d6-346c-494c-9fed-943414633ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:08.155990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda15d6-346c-494c-9fed-943414633ff0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:08.164600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bb6b5-6a31-4533-ac3b-ec55e653f306 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:08.170043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c69e7-e337-4a12-adc0-ba0e9ec896be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:08.170750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c69e7-e337-4a12-adc0-ba0e9ec896be admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:08.171036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c69e7-e337-4a12-adc0-ba0e9ec896be admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:08.171315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c69e7-e337-4a12-adc0-ba0e9ec896be admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:08.172061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c69e7-e337-4a12-adc0-ba0e9ec896be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:08.173645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c69e7-e337-4a12-adc0-ba0e9ec896be admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:08.193908 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3342/6760] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:08 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:08.198704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00444ed-9673-4771-a216-8045b98438ee None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:08.198999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00444ed-9673-4771-a216-8045b98438ee None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:08.199325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00444ed-9673-4771-a216-8045b98438ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:08.204160 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3419/6761] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:08:07 2021] POST /identity/v3/projects => generated 399 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:08.205159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda15d6-346c-494c-9fed-943414633ff0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:08.244590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a00444ed-9673-4771-a216-8045b98438ee None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:08.246451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a00444ed-9673-4771-a216-8045b98438ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:08.361234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda15d6-346c-494c-9fed-943414633ff0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:08.370184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231ec1d-8b17-431e-90fe-b7b80092c219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:08.370184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231ec1d-8b17-431e-90fe-b7b80092c219 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:08.370184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231ec1d-8b17-431e-90fe-b7b80092c219 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:08.370184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231ec1d-8b17-431e-90fe-b7b80092c219 admin admin] PATH_INFO: `/v3/projects/fc15ab93a1a344af95f50aa5b332630b/users/4bea83943caf47a892c4c8902fefc855/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:08.394558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231ec1d-8b17-431e-90fe-b7b80092c219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc15ab93a1a344af95f50aa5b332630b, user_id=4bea83943caf47a892c4c8902fefc855, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:08.401556 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3343/6762] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:08.401556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00444ed-9673-4771-a216-8045b98438ee None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:08.402008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231ec1d-8b17-431e-90fe-b7b80092c219 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:08.431484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00444ed-9673-4771-a216-8045b98438ee None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:08.432336 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3420/6763] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:08 2021] PUT /identity/v3/projects/fc15ab93a1a344af95f50aa5b332630b/users/4bea83943caf47a892c4c8902fefc855/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:08.433204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231ec1d-8b17-431e-90fe-b7b80092c219 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:08.617687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be550f2-f39a-4a2d-84da-4ff886ea07cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:08.618654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be550f2-f39a-4a2d-84da-4ff886ea07cf admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:08.618945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be550f2-f39a-4a2d-84da-4ff886ea07cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:08.619408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be550f2-f39a-4a2d-84da-4ff886ea07cf admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:08.620168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be550f2-f39a-4a2d-84da-4ff886ea07cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:08.623038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be550f2-f39a-4a2d-84da-4ff886ea07cf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:08.659222 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3344/6764] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:08:08 2021] POST /identity/v3/users => generated 300 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:08.660803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530a032-9129-4f75-b32f-daa036200692 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:08.661439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530a032-9129-4f75-b32f-daa036200692 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:08.663356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530a032-9129-4f75-b32f-daa036200692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:08.681653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231ec1d-8b17-431e-90fe-b7b80092c219 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:08.708574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a530a032-9129-4f75-b32f-daa036200692 None None] MFA Rules not processed for user `4bea83943caf47a892c4c8902fefc855`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:08.712569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d5753-ecbe-4b85-9e89-42169c8e2fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:08.713272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d5753-ecbe-4b85-9e89-42169c8e2fcd admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:08.713566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d5753-ecbe-4b85-9e89-42169c8e2fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:08.713849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d5753-ecbe-4b85-9e89-42169c8e2fcd admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:08.714649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d5753-ecbe-4b85-9e89-42169c8e2fcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:08:08.714955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d5753-ecbe-4b85-9e89-42169c8e2fcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:08.716622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d5753-ecbe-4b85-9e89-42169c8e2fcd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:08.716847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a530a032-9129-4f75-b32f-daa036200692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:08.747187 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3421/6765] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:08:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:08:08.748916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d5753-ecbe-4b85-9e89-42169c8e2fcd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:08.772850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d5753-ecbe-4b85-9e89-42169c8e2fcd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:08.788827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4955a-8156-483b-b3de-227fc5c57649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:08.791520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4955a-8156-483b-b3de-227fc5c57649 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:08.791520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4955a-8156-483b-b3de-227fc5c57649 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:08.791520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4955a-8156-483b-b3de-227fc5c57649 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:08.791520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4955a-8156-483b-b3de-227fc5c57649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:08.794505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4955a-8156-483b-b3de-227fc5c57649 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:08.809379 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3422/6766] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:08 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:08.811651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4955a-8156-483b-b3de-227fc5c57649 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:08.815135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-72a4955a-8156-483b-b3de-227fc5c57649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:08.820656 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3345/6767] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:08 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:08.820656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530a032-9129-4f75-b32f-daa036200692 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:08.835222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530a032-9129-4f75-b32f-daa036200692 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:08.837219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4955a-8156-483b-b3de-227fc5c57649 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:08.842802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b1a60-f635-44df-ac3a-646f4b467060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:08.843696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b1a60-f635-44df-ac3a-646f4b467060 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:08.844061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b1a60-f635-44df-ac3a-646f4b467060 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:08.844468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b1a60-f635-44df-ac3a-646f4b467060 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:08.844775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4b7ea-b026-4309-b880-90fadaa5c314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:08.845421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b1a60-f635-44df-ac3a-646f4b467060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:08.845838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4b7ea-b026-4309-b880-90fadaa5c314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:08.846364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4b7ea-b026-4309-b880-90fadaa5c314 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:08.846891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4b7ea-b026-4309-b880-90fadaa5c314 admin admin] PATH_INFO: `/v3/users/f273233bcb2a4326abc9722dfd663978` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:08.848934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b1a60-f635-44df-ac3a-646f4b467060 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:08.849215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4b7ea-b026-4309-b880-90fadaa5c314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f273233bcb2a4326abc9722dfd663978)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:08.852073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4b7ea-b026-4309-b880-90fadaa5c314 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:08.886764 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3346/6768] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:08:08 2021] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:08.887849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b1a60-f635-44df-ac3a-646f4b467060 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:08.916857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e0a4b7ea-b026-4309-b880-90fadaa5c314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f273233bcb2a4326abc9722dfd663978'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:08.926951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e0a4b7ea-b026-4309-b880-90fadaa5c314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f273233bcb2a4326abc9722dfd663978'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:08.927945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e0a4b7ea-b026-4309-b880-90fadaa5c314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f273233bcb2a4326abc9722dfd663978'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:08.944097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e0a4b7ea-b026-4309-b880-90fadaa5c314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f273233bcb2a4326abc9722dfd663978'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:08.955301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e0a4b7ea-b026-4309-b880-90fadaa5c314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f273233bcb2a4326abc9722dfd663978'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:08.966227 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3423/6769] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:08:08 2021] DELETE /identity/v3/users/f273233bcb2a4326abc9722dfd663978 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:08.969860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4b7ea-b026-4309-b880-90fadaa5c314 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:08.971551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e0a4b7ea-b026-4309-b880-90fadaa5c314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:08.991664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b1a60-f635-44df-ac3a-646f4b467060 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:09.090764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14939c99-5820-440c-9690-c2143bb4622b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:09.092147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939c99-5820-440c-9690-c2143bb4622b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:09.092435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939c99-5820-440c-9690-c2143bb4622b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:09.092715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939c99-5820-440c-9690-c2143bb4622b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:09.102731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14939c99-5820-440c-9690-c2143bb4622b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:09.104459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14939c99-5820-440c-9690-c2143bb4622b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:09.107886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4b7ea-b026-4309-b880-90fadaa5c314 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:09.112012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b43563-8a4d-435a-a9d3-5f60e4e0406e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:09.112763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b43563-8a4d-435a-a9d3-5f60e4e0406e service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:09.113093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b43563-8a4d-435a-a9d3-5f60e4e0406e service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:09.113374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b43563-8a4d-435a-a9d3-5f60e4e0406e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:09.115221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-63b43563-8a4d-435a-a9d3-5f60e4e0406e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:09.123948 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3347/6770] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:08 2021] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:09.125451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14939c99-5820-440c-9690-c2143bb4622b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:09.127585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-14939c99-5820-440c-9690-c2143bb4622b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:09.150891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14939c99-5820-440c-9690-c2143bb4622b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:09.157537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e6405-03a0-49d4-b832-bbd9b908bea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:09.159059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e6405-03a0-49d4-b832-bbd9b908bea4 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:09.159698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e6405-03a0-49d4-b832-bbd9b908bea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:09.160143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e6405-03a0-49d4-b832-bbd9b908bea4 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:09.161428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e6405-03a0-49d4-b832-bbd9b908bea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:09.163858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e6405-03a0-49d4-b832-bbd9b908bea4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:09.221132 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3348/6771] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:08:09 2021] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:09.225567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6d705-7d66-46d7-ba04-30aae378c1bb None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:09.225824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6d705-7d66-46d7-ba04-30aae378c1bb None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:09.226104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6d705-7d66-46d7-ba04-30aae378c1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:09.247919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b43563-8a4d-435a-a9d3-5f60e4e0406e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:09.250125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b43563-8a4d-435a-a9d3-5f60e4e0406e service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:09.261496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-90f6d705-7d66-46d7-ba04-30aae378c1bb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:09.262899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-90f6d705-7d66-46d7-ba04-30aae378c1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:09.264078 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3424/6772] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:08 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:09.265103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b43563-8a4d-435a-a9d3-5f60e4e0406e service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:09.266819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-63b43563-8a4d-435a-a9d3-5f60e4e0406e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:09.287023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b43563-8a4d-435a-a9d3-5f60e4e0406e service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:09.293990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad6268-3ccf-480c-801d-bea482652afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:09.295606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad6268-3ccf-480c-801d-bea482652afa admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:09.296669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad6268-3ccf-480c-801d-bea482652afa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:09.297602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad6268-3ccf-480c-801d-bea482652afa admin admin] PATH_INFO: `/v3/projects/78970748663c43d7956bc64b493acfae/users/35e8d9677fae4bebb8ec386e90349f76/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:09.300756 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3349/6773] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:09.300756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6d705-7d66-46d7-ba04-30aae378c1bb None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:09.317973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6d705-7d66-46d7-ba04-30aae378c1bb None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:09.329393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c384fa-4613-4b78-8fbf-e67a5ff21b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:09.330442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c384fa-4613-4b78-8fbf-e67a5ff21b15 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:09.333394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c384fa-4613-4b78-8fbf-e67a5ff21b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:09.333394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c384fa-4613-4b78-8fbf-e67a5ff21b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:09.333888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c384fa-4613-4b78-8fbf-e67a5ff21b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:09.338161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c384fa-4613-4b78-8fbf-e67a5ff21b15 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:09.354959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad6268-3ccf-480c-801d-bea482652afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=78970748663c43d7956bc64b493acfae, user_id=35e8d9677fae4bebb8ec386e90349f76, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:09.361534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad6268-3ccf-480c-801d-bea482652afa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:09.383629 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3350/6774] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:09 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:09.383629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c384fa-4613-4b78-8fbf-e67a5ff21b15 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:09.387261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-31c384fa-4613-4b78-8fbf-e67a5ff21b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:09.387378 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3425/6775] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:09 2021] PUT /identity/v3/projects/78970748663c43d7956bc64b493acfae/users/35e8d9677fae4bebb8ec386e90349f76/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:09.387378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad6268-3ccf-480c-801d-bea482652afa admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:09.389442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5bad6268-3ccf-480c-801d-bea482652afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:09.485363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad6268-3ccf-480c-801d-bea482652afa admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:09.487280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c384fa-4613-4b78-8fbf-e67a5ff21b15 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:09.490981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74508d8c-5c72-4b21-85a4-10b0964ac870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:09.492578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74508d8c-5c72-4b21-85a4-10b0964ac870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:09.492869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74508d8c-5c72-4b21-85a4-10b0964ac870 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:09.493151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74508d8c-5c72-4b21-85a4-10b0964ac870 admin admin] PATH_INFO: `/v3/users/4bea83943caf47a892c4c8902fefc855` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:09.494759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74508d8c-5c72-4b21-85a4-10b0964ac870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bea83943caf47a892c4c8902fefc855)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:09.498301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74508d8c-5c72-4b21-85a4-10b0964ac870 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:09.558752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec9263-93c9-4114-8875-4b19da2b809b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:09.559417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec9263-93c9-4114-8875-4b19da2b809b service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:09.559709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec9263-93c9-4114-8875-4b19da2b809b service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:09.560519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec9263-93c9-4114-8875-4b19da2b809b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:09.567442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-74508d8c-5c72-4b21-85a4-10b0964ac870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bea83943caf47a892c4c8902fefc855'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:09.574877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec9263-93c9-4114-8875-4b19da2b809b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:09.576924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec9263-93c9-4114-8875-4b19da2b809b service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:09.577385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-74508d8c-5c72-4b21-85a4-10b0964ac870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bea83943caf47a892c4c8902fefc855'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:09.578178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-74508d8c-5c72-4b21-85a4-10b0964ac870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bea83943caf47a892c4c8902fefc855'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:09.591502 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3351/6776] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:09.592374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec9263-93c9-4114-8875-4b19da2b809b service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:09.593336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-74508d8c-5c72-4b21-85a4-10b0964ac870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bea83943caf47a892c4c8902fefc855'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:09.604925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec9263-93c9-4114-8875-4b19da2b809b service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:09.605467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-74508d8c-5c72-4b21-85a4-10b0964ac870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bea83943caf47a892c4c8902fefc855'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:09.609901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d499d89-eae6-44b1-8bbc-f1d91b0789b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:09.611016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d499d89-eae6-44b1-8bbc-f1d91b0789b9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:09.611306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d499d89-eae6-44b1-8bbc-f1d91b0789b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:09.611580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d499d89-eae6-44b1-8bbc-f1d91b0789b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:09.612322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d499d89-eae6-44b1-8bbc-f1d91b0789b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:09.613981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d499d89-eae6-44b1-8bbc-f1d91b0789b9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:09.616413 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3426/6777] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:08:09 2021] DELETE /identity/v3/users/4bea83943caf47a892c4c8902fefc855 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:09.618442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df077296-81b9-4fed-96c5-4e2ef83a877a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:09.618940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df077296-81b9-4fed-96c5-4e2ef83a877a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:09.620003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df077296-81b9-4fed-96c5-4e2ef83a877a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:09.633661 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3352/6778] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:09 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:09.634853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d499d89-eae6-44b1-8bbc-f1d91b0789b9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:09.637863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5d499d89-eae6-44b1-8bbc-f1d91b0789b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:09.647974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-df077296-81b9-4fed-96c5-4e2ef83a877a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:09.650766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-df077296-81b9-4fed-96c5-4e2ef83a877a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:09.657616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d499d89-eae6-44b1-8bbc-f1d91b0789b9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:09.752313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935cd67-59c2-4bfb-9ca0-fe49156beeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:09.753494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935cd67-59c2-4bfb-9ca0-fe49156beeca admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:09.754048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935cd67-59c2-4bfb-9ca0-fe49156beeca admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:09.754667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935cd67-59c2-4bfb-9ca0-fe49156beeca admin admin] PATH_INFO: `/v3/users/9467ccf6f7494cdc811aaa555a657cca` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:09.755104 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3427/6779] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:09.756626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb9df-8a89-494e-b03a-b4f500308396 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:09.757046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb9df-8a89-494e-b03a-b4f500308396 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:09.757880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb9df-8a89-494e-b03a-b4f500308396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:09.758953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935cd67-59c2-4bfb-9ca0-fe49156beeca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9467ccf6f7494cdc811aaa555a657cca)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:09.761481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935cd67-59c2-4bfb-9ca0-fe49156beeca admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:09.787350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b05bb9df-8a89-494e-b03a-b4f500308396 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:09.788963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b05bb9df-8a89-494e-b03a-b4f500308396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:09.802804 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3428/6780] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:09.802804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bb9df-8a89-494e-b03a-b4f500308396 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:09.802804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b05bb9df-8a89-494e-b03a-b4f500308396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:09.813058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bb9df-8a89-494e-b03a-b4f500308396 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:09.819009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff7ed2-9ac9-4753-9845-7295a21f24cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:09.820030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff7ed2-9ac9-4753-9845-7295a21f24cf admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:09.820409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff7ed2-9ac9-4753-9845-7295a21f24cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:09.820782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff7ed2-9ac9-4753-9845-7295a21f24cf admin admin] PATH_INFO: `/v3/projects/b95f79502f564ca1ac30fb7eeaa4d0c8/users/cef85da08a92421382f7ebd7a3e9af66/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:09.840943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff7ed2-9ac9-4753-9845-7295a21f24cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95f79502f564ca1ac30fb7eeaa4d0c8, user_id=cef85da08a92421382f7ebd7a3e9af66, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:09.844793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff7ed2-9ac9-4753-9845-7295a21f24cf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:09.860806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2935cd67-59c2-4bfb-9ca0-fe49156beeca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9467ccf6f7494cdc811aaa555a657cca'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:09.871016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2935cd67-59c2-4bfb-9ca0-fe49156beeca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9467ccf6f7494cdc811aaa555a657cca'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:09.875603 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3429/6781] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:09 2021] PUT /identity/v3/projects/b95f79502f564ca1ac30fb7eeaa4d0c8/users/cef85da08a92421382f7ebd7a3e9af66/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:09.877358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff7ed2-9ac9-4753-9845-7295a21f24cf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:09.884842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8eff7ed2-9ac9-4753-9845-7295a21f24cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:09.888201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2935cd67-59c2-4bfb-9ca0-fe49156beeca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9467ccf6f7494cdc811aaa555a657cca'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:09.890301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2935cd67-59c2-4bfb-9ca0-fe49156beeca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9467ccf6f7494cdc811aaa555a657cca'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:09.911140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2935cd67-59c2-4bfb-9ca0-fe49156beeca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9467ccf6f7494cdc811aaa555a657cca'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:09.919825 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3353/6782] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:08:09 2021] DELETE /identity/v3/users/9467ccf6f7494cdc811aaa555a657cca => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:09.920811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935cd67-59c2-4bfb-9ca0-fe49156beeca admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:09.922686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2935cd67-59c2-4bfb-9ca0-fe49156beeca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:09.983874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff7ed2-9ac9-4753-9845-7295a21f24cf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:10.025939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935cd67-59c2-4bfb-9ca0-fe49156beeca admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:10.030105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7215eec-0871-4749-a078-df9b567c2286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:10.031092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7215eec-0871-4749-a078-df9b567c2286 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:10.031482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7215eec-0871-4749-a078-df9b567c2286 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:10.031882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7215eec-0871-4749-a078-df9b567c2286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:10.033956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f7215eec-0871-4749-a078-df9b567c2286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:10.064292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbf244-fcca-4361-86d6-2dc3a3c6e8cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:10.064950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbf244-fcca-4361-86d6-2dc3a3c6e8cc service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:10.065239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbf244-fcca-4361-86d6-2dc3a3c6e8cc service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:10.065522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbf244-fcca-4361-86d6-2dc3a3c6e8cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:10.068227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a5fbf244-fcca-4361-86d6-2dc3a3c6e8cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:10.147266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7215eec-0871-4749-a078-df9b567c2286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:10.150074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7215eec-0871-4749-a078-df9b567c2286 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:10.163974 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3354/6783] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:10.165403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bd96-15e8-455a-ae96-c8e71bbbdb92 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:10.165696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bd96-15e8-455a-ae96-c8e71bbbdb92 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:10.166235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bd96-15e8-455a-ae96-c8e71bbbdb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:10.183818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbf244-fcca-4361-86d6-2dc3a3c6e8cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:10.185389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbf244-fcca-4361-86d6-2dc3a3c6e8cc service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:10.197285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1476bd96-15e8-455a-ae96-c8e71bbbdb92 None None] MFA Rules not processed for user `cef85da08a92421382f7ebd7a3e9af66`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:10.197515 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3430/6784] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:10.198639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1476bd96-15e8-455a-ae96-c8e71bbbdb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:10.199233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53a07f-ecfe-4091-bdb3-c95ed206e5c0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:10.199527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53a07f-ecfe-4091-bdb3-c95ed206e5c0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:10.199812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53a07f-ecfe-4091-bdb3-c95ed206e5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:10.228652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fc53a07f-ecfe-4091-bdb3-c95ed206e5c0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:10.230734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fc53a07f-ecfe-4091-bdb3-c95ed206e5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:10.251192 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3431/6785] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:10.252322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53a07f-ecfe-4091-bdb3-c95ed206e5c0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:10.254545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fc53a07f-ecfe-4091-bdb3-c95ed206e5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:10.272520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53a07f-ecfe-4091-bdb3-c95ed206e5c0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:10.281151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00366f-5dde-41ae-a59a-fbc18f294451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:10.282502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00366f-5dde-41ae-a59a-fbc18f294451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:10.282846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00366f-5dde-41ae-a59a-fbc18f294451 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:10.283137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00366f-5dde-41ae-a59a-fbc18f294451 admin admin] PATH_INFO: `/v3/projects/3646d355864d48a285d5986fb3e43b1a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:10.285157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00366f-5dde-41ae-a59a-fbc18f294451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3646d355864d48a285d5986fb3e43b1a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:10.287592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00366f-5dde-41ae-a59a-fbc18f294451 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:10.312794 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3355/6786] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:10 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:10.314355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476bd96-15e8-455a-ae96-c8e71bbbdb92 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:10.345174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476bd96-15e8-455a-ae96-c8e71bbbdb92 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:10.353343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f078cb-0345-4644-a8bc-ffd2b716414d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:10.354769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f078cb-0345-4644-a8bc-ffd2b716414d service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:10.355286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f078cb-0345-4644-a8bc-ffd2b716414d service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:10.355773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f078cb-0345-4644-a8bc-ffd2b716414d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:10.394046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-db00366f-5dde-41ae-a59a-fbc18f294451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3646d355864d48a285d5986fb3e43b1a', 'request_id': 'req-db00366f-5dde-41ae-a59a-fbc18f294451'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:10.394408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f078cb-0345-4644-a8bc-ffd2b716414d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:10.398299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f078cb-0345-4644-a8bc-ffd2b716414d service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:10.403058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-db00366f-5dde-41ae-a59a-fbc18f294451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3646d355864d48a285d5986fb3e43b1a', 'request_id': 'req-db00366f-5dde-41ae-a59a-fbc18f294451'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:10.433861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-db00366f-5dde-41ae-a59a-fbc18f294451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3646d355864d48a285d5986fb3e43b1a', 'request_id': 'req-db00366f-5dde-41ae-a59a-fbc18f294451'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:10.449706 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3356/6787] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:10.454208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f078cb-0345-4644-a8bc-ffd2b716414d service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:10.459681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-db00366f-5dde-41ae-a59a-fbc18f294451 admin admin] The token cache is being invalidate because project 3646d355864d48a285d5986fb3e43b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:10.460134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-db00366f-5dde-41ae-a59a-fbc18f294451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:10.461301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-db00366f-5dde-41ae-a59a-fbc18f294451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:10.466793 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3432/6788] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:10 2021] DELETE /identity/v3/projects/3646d355864d48a285d5986fb3e43b1a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:10.466986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-81f078cb-0345-4644-a8bc-ffd2b716414d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:10.468146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00366f-5dde-41ae-a59a-fbc18f294451 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:10.471943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-db00366f-5dde-41ae-a59a-fbc18f294451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:10.601952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f078cb-0345-4644-a8bc-ffd2b716414d service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:10.631642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00366f-5dde-41ae-a59a-fbc18f294451 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:10.651394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ac934-c7e8-4c24-be54-dc40e53b9dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:10.653760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ac934-c7e8-4c24-be54-dc40e53b9dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:10.653760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ac934-c7e8-4c24-be54-dc40e53b9dab admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:10.653760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ac934-c7e8-4c24-be54-dc40e53b9dab admin admin] PATH_INFO: `/v3/users/0eae9947c3e745b7ac16747e5676ea54` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:10.655597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ac934-c7e8-4c24-be54-dc40e53b9dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eae9947c3e745b7ac16747e5676ea54)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:10.658572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ac934-c7e8-4c24-be54-dc40e53b9dab admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:10.725213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d4cc1-b001-4861-bfca-40d383755301 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:10.725521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d4cc1-b001-4861-bfca-40d383755301 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:10.725810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d4cc1-b001-4861-bfca-40d383755301 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:10.726096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d4cc1-b001-4861-bfca-40d383755301 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:10.730042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e82d4cc1-b001-4861-bfca-40d383755301 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:10.775700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1c4ac934-c7e8-4c24-be54-dc40e53b9dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eae9947c3e745b7ac16747e5676ea54'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:10.804813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1c4ac934-c7e8-4c24-be54-dc40e53b9dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eae9947c3e745b7ac16747e5676ea54'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:10.806243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1c4ac934-c7e8-4c24-be54-dc40e53b9dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eae9947c3e745b7ac16747e5676ea54'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:10.855612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1c4ac934-c7e8-4c24-be54-dc40e53b9dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eae9947c3e745b7ac16747e5676ea54'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:10.876621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d4cc1-b001-4861-bfca-40d383755301 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:10.879965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d4cc1-b001-4861-bfca-40d383755301 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:10.892924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1c4ac934-c7e8-4c24-be54-dc40e53b9dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eae9947c3e745b7ac16747e5676ea54'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:10.905916 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3433/6789] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:08:10 2021] DELETE /identity/v3/users/0eae9947c3e745b7ac16747e5676ea54 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:10.906801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ac934-c7e8-4c24-be54-dc40e53b9dab admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:10.908726 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3357/6790] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:10 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:10.910595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1c4ac934-c7e8-4c24-be54-dc40e53b9dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:11.093465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ac934-c7e8-4c24-be54-dc40e53b9dab admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:11.100972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d11648-6428-406b-9461-423f95971b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:11.102546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11648-6428-406b-9461-423f95971b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:11.102925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11648-6428-406b-9461-423f95971b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:11.105177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11648-6428-406b-9461-423f95971b30 admin admin] PATH_INFO: `/v3/projects/fc15ab93a1a344af95f50aa5b332630b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:11.108722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d11648-6428-406b-9461-423f95971b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc15ab93a1a344af95f50aa5b332630b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:11.112665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d11648-6428-406b-9461-423f95971b30 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:11.246677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f1d11648-6428-406b-9461-423f95971b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc15ab93a1a344af95f50aa5b332630b', 'request_id': 'req-f1d11648-6428-406b-9461-423f95971b30'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:11.255402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f1d11648-6428-406b-9461-423f95971b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc15ab93a1a344af95f50aa5b332630b', 'request_id': 'req-f1d11648-6428-406b-9461-423f95971b30'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:11.273984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f1d11648-6428-406b-9461-423f95971b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc15ab93a1a344af95f50aa5b332630b', 'request_id': 'req-f1d11648-6428-406b-9461-423f95971b30'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:11.291822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f1d11648-6428-406b-9461-423f95971b30 admin admin] The token cache is being invalidate because project fc15ab93a1a344af95f50aa5b332630b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:11.292051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f1d11648-6428-406b-9461-423f95971b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:11.296133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f1d11648-6428-406b-9461-423f95971b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:11.298936 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3434/6791] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:10 2021] DELETE /identity/v3/projects/fc15ab93a1a344af95f50aa5b332630b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:11.305781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9126e07-62c1-4753-b667-2161ba46519a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:11.306367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9126e07-62c1-4753-b667-2161ba46519a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:11.306367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9126e07-62c1-4753-b667-2161ba46519a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:11.336812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d9126e07-62c1-4753-b667-2161ba46519a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:11.337876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d9126e07-62c1-4753-b667-2161ba46519a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:11.429038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d11648-6428-406b-9461-423f95971b30 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:11.430987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f1d11648-6428-406b-9461-423f95971b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:11.540488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d11648-6428-406b-9461-423f95971b30 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:11.546409 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3358/6792] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:11.555119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58d6ad-8f05-4596-8ba6-510b33ddbce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:11.558484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58d6ad-8f05-4596-8ba6-510b33ddbce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:11.558713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee3b70-c08d-44c2-a35b-b9a3c22b7ca3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:11.559114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee3b70-c08d-44c2-a35b-b9a3c22b7ca3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:11.559349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58d6ad-8f05-4596-8ba6-510b33ddbce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:11.559866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58d6ad-8f05-4596-8ba6-510b33ddbce0 admin admin] PATH_INFO: `/v3/projects/1993bfd02e94412d835129f98b8e529d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:11.560854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee3b70-c08d-44c2-a35b-b9a3c22b7ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:11.563638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58d6ad-8f05-4596-8ba6-510b33ddbce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1993bfd02e94412d835129f98b8e529d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:11.567703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58d6ad-8f05-4596-8ba6-510b33ddbce0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:11.652480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cd58d6ad-8f05-4596-8ba6-510b33ddbce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1993bfd02e94412d835129f98b8e529d', 'request_id': 'req-cd58d6ad-8f05-4596-8ba6-510b33ddbce0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:11.660207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-13ee3b70-c08d-44c2-a35b-b9a3c22b7ca3 None None] MFA Rules not processed for user `35e8d9677fae4bebb8ec386e90349f76`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:11.660431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cd58d6ad-8f05-4596-8ba6-510b33ddbce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1993bfd02e94412d835129f98b8e529d', 'request_id': 'req-cd58d6ad-8f05-4596-8ba6-510b33ddbce0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:11.666280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-13ee3b70-c08d-44c2-a35b-b9a3c22b7ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:11.684628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cd58d6ad-8f05-4596-8ba6-510b33ddbce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1993bfd02e94412d835129f98b8e529d', 'request_id': 'req-cd58d6ad-8f05-4596-8ba6-510b33ddbce0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:11.735582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cd58d6ad-8f05-4596-8ba6-510b33ddbce0 admin admin] The token cache is being invalidate because project 1993bfd02e94412d835129f98b8e529d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:11.736163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cd58d6ad-8f05-4596-8ba6-510b33ddbce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:11.739373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cd58d6ad-8f05-4596-8ba6-510b33ddbce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:11.763023 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3435/6793] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:11 2021] DELETE /identity/v3/projects/1993bfd02e94412d835129f98b8e529d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:08:11.770866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c38aca-31f4-4513-a061-f358224010f0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:11.774675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c38aca-31f4-4513-a061-f358224010f0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:11.775181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c38aca-31f4-4513-a061-f358224010f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:11.852980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-14c38aca-31f4-4513-a061-f358224010f0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:11.855161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-14c38aca-31f4-4513-a061-f358224010f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:11.933703 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3359/6794] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:11 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:11.933703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee3b70-c08d-44c2-a35b-b9a3c22b7ca3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:11.935414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-13ee3b70-c08d-44c2-a35b-b9a3c22b7ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:12.023153 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3436/6795] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:12.026819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f28f4-4d84-4f0a-8faf-3a7c60fc9aa9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:12.029323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f28f4-4d84-4f0a-8faf-3a7c60fc9aa9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:12.029892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f28f4-4d84-4f0a-8faf-3a7c60fc9aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:12.070137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-082f28f4-4d84-4f0a-8faf-3a7c60fc9aa9 None None] MFA Rules not processed for user `35e8d9677fae4bebb8ec386e90349f76`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:12.072130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-082f28f4-4d84-4f0a-8faf-3a7c60fc9aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:12.100614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee3b70-c08d-44c2-a35b-b9a3c22b7ca3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:12.100862 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3437/6796] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:12 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:12.100862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f28f4-4d84-4f0a-8faf-3a7c60fc9aa9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:12.119277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:12.124698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:12.126144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:12.126554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f admin admin] PATH_INFO: `/v3/projects/019d5d0e36f94b2b9f1a37d5ca1b7aee` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:12.130886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=019d5d0e36f94b2b9f1a37d5ca1b7aee)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:12.135337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:12.137465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f28f4-4d84-4f0a-8faf-3a7c60fc9aa9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:12.152254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bb08c-988f-4d02-921b-6148276bbe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:12.153087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bb08c-988f-4d02-921b-6148276bbe04 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:12.153462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bb08c-988f-4d02-921b-6148276bbe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:12.154496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bb08c-988f-4d02-921b-6148276bbe04 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:12.155347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bb08c-988f-4d02-921b-6148276bbe04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:08:12.155758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bb08c-988f-4d02-921b-6148276bbe04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:12.162317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bb08c-988f-4d02-921b-6148276bbe04 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:12.195120 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3438/6797] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:08:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:08:12.196207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bb08c-988f-4d02-921b-6148276bbe04 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:12.201494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f03bb08c-988f-4d02-921b-6148276bbe04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:12.237255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '019d5d0e36f94b2b9f1a37d5ca1b7aee', 'request_id': 'req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:12.264353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '019d5d0e36f94b2b9f1a37d5ca1b7aee', 'request_id': 'req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:12.281050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '019d5d0e36f94b2b9f1a37d5ca1b7aee', 'request_id': 'req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:12.305243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f admin admin] The token cache is being invalidate because project 019d5d0e36f94b2b9f1a37d5ca1b7aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:12.305906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:12.306917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:12.312895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bb08c-988f-4d02-921b-6148276bbe04 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:12.314044 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3360/6798] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:11 2021] DELETE /identity/v3/projects/019d5d0e36f94b2b9f1a37d5ca1b7aee => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:12.316103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:12.317750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:12.384627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d8ca3-fc21-4837-83c2-5d938ece7e89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:12.385290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d8ca3-fc21-4837-83c2-5d938ece7e89 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:12.385575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d8ca3-fc21-4837-83c2-5d938ece7e89 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:12.385855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d8ca3-fc21-4837-83c2-5d938ece7e89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:12.389650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-348d8ca3-fc21-4837-83c2-5d938ece7e89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:12.391177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfcbc0-52a2-4b31-8323-5bda7142cf0f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:12.395974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfae156-ac54-40ef-9a27-aa9dd19db3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:12.396936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfae156-ac54-40ef-9a27-aa9dd19db3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:12.396936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfae156-ac54-40ef-9a27-aa9dd19db3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:12.397189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfae156-ac54-40ef-9a27-aa9dd19db3a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:12.397898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfae156-ac54-40ef-9a27-aa9dd19db3a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:12.399957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfae156-ac54-40ef-9a27-aa9dd19db3a6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:12.438419 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3361/6799] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:08:12 2021] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:12.439920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904b533-7e3b-430f-bd0d-bc18ebf5d5ad None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:12.440219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904b533-7e3b-430f-bd0d-bc18ebf5d5ad None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:12.440509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904b533-7e3b-430f-bd0d-bc18ebf5d5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:12.461644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4904b533-7e3b-430f-bd0d-bc18ebf5d5ad None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:12.462893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4904b533-7e3b-430f-bd0d-bc18ebf5d5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:12.468655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d8ca3-fc21-4837-83c2-5d938ece7e89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:12.470528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d8ca3-fc21-4837-83c2-5d938ece7e89 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:12.484402 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3439/6800] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:12 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:12.485629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d8ca3-fc21-4837-83c2-5d938ece7e89 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:12.520391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d8ca3-fc21-4837-83c2-5d938ece7e89 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:12.543469 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3362/6801] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:12.545562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6c5cf-eb9d-4ad3-ba60-defc4fa135a4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:12.545921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6c5cf-eb9d-4ad3-ba60-defc4fa135a4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:12.546457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6c5cf-eb9d-4ad3-ba60-defc4fa135a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:12.571942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-80d6c5cf-eb9d-4ad3-ba60-defc4fa135a4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:12.573170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-80d6c5cf-eb9d-4ad3-ba60-defc4fa135a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:12.604526 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3363/6802] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:12.605755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b183b3-f24d-432f-b8c2-8de0c606b019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:12.606026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6c5cf-eb9d-4ad3-ba60-defc4fa135a4 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:12.606780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b183b3-f24d-432f-b8c2-8de0c606b019 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:12.607268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b183b3-f24d-432f-b8c2-8de0c606b019 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:12.607622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b183b3-f24d-432f-b8c2-8de0c606b019 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:12.608390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b183b3-f24d-432f-b8c2-8de0c606b019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:12.610427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b183b3-f24d-432f-b8c2-8de0c606b019 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:12.635819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6c5cf-eb9d-4ad3-ba60-defc4fa135a4 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:12.642091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b918a-1229-411f-8e10-b05200b285bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:12.642925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b918a-1229-411f-8e10-b05200b285bf admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:12.643216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b918a-1229-411f-8e10-b05200b285bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:12.643549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b918a-1229-411f-8e10-b05200b285bf admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:12.644681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b918a-1229-411f-8e10-b05200b285bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:08:12.645001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b918a-1229-411f-8e10-b05200b285bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:12.646723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b918a-1229-411f-8e10-b05200b285bf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:12.650491 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3440/6803] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:08:12 2021] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:12.652649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b183b3-f24d-432f-b8c2-8de0c606b019 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:12.663175 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3364/6804] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:08:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:08:12.664025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b183b3-f24d-432f-b8c2-8de0c606b019 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:12.666691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b918a-1229-411f-8e10-b05200b285bf admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:12.670368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abfae9-bbf8-493d-9d2a-890cd004bed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:12.671100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abfae9-bbf8-493d-9d2a-890cd004bed2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:12.671387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abfae9-bbf8-493d-9d2a-890cd004bed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:12.671666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abfae9-bbf8-493d-9d2a-890cd004bed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:12.672565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abfae9-bbf8-493d-9d2a-890cd004bed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:12.674439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abfae9-bbf8-493d-9d2a-890cd004bed2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:12.678710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b918a-1229-411f-8e10-b05200b285bf admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:12.685912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685abea-5464-4e1e-bb93-f9bd351c2b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:12.686484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685abea-5464-4e1e-bb93-f9bd351c2b62 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:12.686865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685abea-5464-4e1e-bb93-f9bd351c2b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:12.687215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685abea-5464-4e1e-bb93-f9bd351c2b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:12.688142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685abea-5464-4e1e-bb93-f9bd351c2b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:12.690175 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3441/6805] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:12 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:12.690440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685abea-5464-4e1e-bb93-f9bd351c2b62 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:12.691232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abfae9-bbf8-493d-9d2a-890cd004bed2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:12.702325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abfae9-bbf8-493d-9d2a-890cd004bed2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:12.707598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d398fa-cbcb-4818-af82-5d54b72bfa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:12.708528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d398fa-cbcb-4818-af82-5d54b72bfa32 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:12.708528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d398fa-cbcb-4818-af82-5d54b72bfa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:12.708810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d398fa-cbcb-4818-af82-5d54b72bfa32 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:12.709642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d398fa-cbcb-4818-af82-5d54b72bfa32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:12.712126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d398fa-cbcb-4818-af82-5d54b72bfa32 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:12.726438 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3442/6806] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:12 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:12.729602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d398fa-cbcb-4818-af82-5d54b72bfa32 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:12.742535 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3365/6807] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:08:12 2021] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:12.752240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685abea-5464-4e1e-bb93-f9bd351c2b62 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:12.763010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d398fa-cbcb-4818-af82-5d54b72bfa32 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:12.892204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685abea-5464-4e1e-bb93-f9bd351c2b62 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:12.904158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d6e55-ce02-4a9c-b814-f8ca16baf769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:12.904843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d6e55-ce02-4a9c-b814-f8ca16baf769 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:12.905128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d6e55-ce02-4a9c-b814-f8ca16baf769 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:12.905495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d6e55-ce02-4a9c-b814-f8ca16baf769 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:12.906107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d6e55-ce02-4a9c-b814-f8ca16baf769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:12.908091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d6e55-ce02-4a9c-b814-f8ca16baf769 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:12.912061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de414c7-65da-4826-a195-af4fd0b949f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:12.913781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de414c7-65da-4826-a195-af4fd0b949f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:12.914293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de414c7-65da-4826-a195-af4fd0b949f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:12.914768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de414c7-65da-4826-a195-af4fd0b949f7 admin admin] PATH_INFO: `/v3/projects/db0a151197c34e75ad90ebd190b55865/users/746602a47af1420ea9d7a02aa379a4eb/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:12.944333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de414c7-65da-4826-a195-af4fd0b949f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0a151197c34e75ad90ebd190b55865, user_id=746602a47af1420ea9d7a02aa379a4eb, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:12.948695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de414c7-65da-4826-a195-af4fd0b949f7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:12.962493 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3366/6808] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:08:12 2021] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:12.964081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d6e55-ce02-4a9c-b814-f8ca16baf769 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:12.981323 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3443/6809] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:12 2021] PUT /identity/v3/projects/db0a151197c34e75ad90ebd190b55865/users/746602a47af1420ea9d7a02aa379a4eb/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:12.983643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d6e55-ce02-4a9c-b814-f8ca16baf769 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:12.983972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a413c-2a6e-4361-84f8-ad4fd6f20964 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:12.984609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a413c-2a6e-4361-84f8-ad4fd6f20964 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:12.985111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a413c-2a6e-4361-84f8-ad4fd6f20964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:13.018228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d41a413c-2a6e-4361-84f8-ad4fd6f20964 None None] MFA Rules not processed for user `746602a47af1420ea9d7a02aa379a4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:13.020179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d41a413c-2a6e-4361-84f8-ad4fd6f20964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:13.101241 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3444/6810] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:12 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:13.108284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a413c-2a6e-4361-84f8-ad4fd6f20964 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:13.108454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ed68a-9fcc-431c-b78f-64807739225c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:13.110038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ed68a-9fcc-431c-b78f-64807739225c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:13.110580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ed68a-9fcc-431c-b78f-64807739225c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:13.111084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ed68a-9fcc-431c-b78f-64807739225c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:13.112273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ed68a-9fcc-431c-b78f-64807739225c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:13.114366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ed68a-9fcc-431c-b78f-64807739225c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:13.123793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a413c-2a6e-4361-84f8-ad4fd6f20964 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:13.132180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd722ea-004f-4b50-934b-c160b8543dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:13.133260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd722ea-004f-4b50-934b-c160b8543dff admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:13.133552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd722ea-004f-4b50-934b-c160b8543dff admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:13.134087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd722ea-004f-4b50-934b-c160b8543dff admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:13.134858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd722ea-004f-4b50-934b-c160b8543dff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:13.137542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd722ea-004f-4b50-934b-c160b8543dff admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:13.144333 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3367/6811] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:12 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:08:13.149287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ed68a-9fcc-431c-b78f-64807739225c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:13.172647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ed68a-9fcc-431c-b78f-64807739225c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:13.179570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366381b3-43c8-4834-93e7-9debcc439070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:13.180293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366381b3-43c8-4834-93e7-9debcc439070 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:13.180674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366381b3-43c8-4834-93e7-9debcc439070 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:13.180960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366381b3-43c8-4834-93e7-9debcc439070 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:13.181768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366381b3-43c8-4834-93e7-9debcc439070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:13.183640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366381b3-43c8-4834-93e7-9debcc439070 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:13.187134 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3445/6812] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:08:13 2021] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:13.188376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd722ea-004f-4b50-934b-c160b8543dff admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:13.230432 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3368/6813] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:13 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:13.234968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366381b3-43c8-4834-93e7-9debcc439070 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:13.268473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366381b3-43c8-4834-93e7-9debcc439070 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:13.323990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd722ea-004f-4b50-934b-c160b8543dff admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:13.333602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0b087-43bc-45e0-899f-70f092673af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:13.334318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0b087-43bc-45e0-899f-70f092673af8 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:13.334618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0b087-43bc-45e0-899f-70f092673af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:13.334876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0b087-43bc-45e0-899f-70f092673af8 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:13.335608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0b087-43bc-45e0-899f-70f092673af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:13.340659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0b087-43bc-45e0-899f-70f092673af8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:13.405064 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3446/6814] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:08:13 2021] POST /identity/v3/users => generated 301 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:13.409230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0b087-43bc-45e0-899f-70f092673af8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:13.427781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0b087-43bc-45e0-899f-70f092673af8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:13.443253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd61e8b-1e60-4866-9795-a511ad962745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:13.443933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd61e8b-1e60-4866-9795-a511ad962745 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:13.444453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd61e8b-1e60-4866-9795-a511ad962745 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:13.444729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd61e8b-1e60-4866-9795-a511ad962745 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:13.445470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd61e8b-1e60-4866-9795-a511ad962745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:13.446288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d40041-0b7b-45a2-a79a-878a0fa2e756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:13.447102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd61e8b-1e60-4866-9795-a511ad962745 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:13.449073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d40041-0b7b-45a2-a79a-878a0fa2e756 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:13.449613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d40041-0b7b-45a2-a79a-878a0fa2e756 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:13.450005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d40041-0b7b-45a2-a79a-878a0fa2e756 admin admin] PATH_INFO: `/v3/projects/c48b8b9635104eafab5295b3b8709c14/users/e8150e994a4f42e3b014e5e51265213a/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:13.487149 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3447/6815] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:13 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:13.488838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd61e8b-1e60-4866-9795-a511ad962745 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:13.503120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d40041-0b7b-45a2-a79a-878a0fa2e756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48b8b9635104eafab5295b3b8709c14, user_id=e8150e994a4f42e3b014e5e51265213a, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:13.508320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d40041-0b7b-45a2-a79a-878a0fa2e756 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:13.524638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd61e8b-1e60-4866-9795-a511ad962745 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:13.546422 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3369/6816] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:13 2021] PUT /identity/v3/projects/c48b8b9635104eafab5295b3b8709c14/users/e8150e994a4f42e3b014e5e51265213a/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:08:13.552735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f1f00-b122-4f15-bfe6-363bec8386e9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:13.553191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f1f00-b122-4f15-bfe6-363bec8386e9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:13.553579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f1f00-b122-4f15-bfe6-363bec8386e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:13.555567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24063bc3-c987-412c-a746-346250bdbd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:13.556651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24063bc3-c987-412c-a746-346250bdbd97 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:13.557079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24063bc3-c987-412c-a746-346250bdbd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:13.557753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24063bc3-c987-412c-a746-346250bdbd97 admin admin] PATH_INFO: `/v3/projects/e8644f42c5534a2493f7cbc1c7a650a5/users/f5127599f74148b380c440f39f28e372/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:13.620815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-163f1f00-b122-4f15-bfe6-363bec8386e9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:13.622915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-163f1f00-b122-4f15-bfe6-363bec8386e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:13.638113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24063bc3-c987-412c-a746-346250bdbd97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8644f42c5534a2493f7cbc1c7a650a5, user_id=f5127599f74148b380c440f39f28e372, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:13.640937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24063bc3-c987-412c-a746-346250bdbd97 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:13.685590 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3448/6817] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:13 2021] PUT /identity/v3/projects/e8644f42c5534a2493f7cbc1c7a650a5/users/f5127599f74148b380c440f39f28e372/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:13.705628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1966909-4131-43ff-96e0-0c8d9c5f5de6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:13.705999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1966909-4131-43ff-96e0-0c8d9c5f5de6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:13.706565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1966909-4131-43ff-96e0-0c8d9c5f5de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:13.751446 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3370/6818] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:13.766134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f1f00-b122-4f15-bfe6-363bec8386e9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:13.767932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-163f1f00-b122-4f15-bfe6-363bec8386e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:13.775836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a1966909-4131-43ff-96e0-0c8d9c5f5de6 None None] MFA Rules not processed for user `f5127599f74148b380c440f39f28e372`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:13.777111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a1966909-4131-43ff-96e0-0c8d9c5f5de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:13.870621 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3449/6819] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:13 2021] POST /identity/v3/auth/tokens => generated 3261 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:08:13.879186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f1f00-b122-4f15-bfe6-363bec8386e9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:13.948966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7445b5c-28ee-47ad-b82c-35ae7b3d911d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:13.949727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7445b5c-28ee-47ad-b82c-35ae7b3d911d service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:13.950021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7445b5c-28ee-47ad-b82c-35ae7b3d911d service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:13.950342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7445b5c-28ee-47ad-b82c-35ae7b3d911d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:13.963736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1966909-4131-43ff-96e0-0c8d9c5f5de6 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:13.966917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a1966909-4131-43ff-96e0-0c8d9c5f5de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:14.054043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7445b5c-28ee-47ad-b82c-35ae7b3d911d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:14.055892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7445b5c-28ee-47ad-b82c-35ae7b3d911d service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:14.060078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1966909-4131-43ff-96e0-0c8d9c5f5de6 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:14.069163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c6dd9-b3fa-4a1a-bef7-e293d0ff4fb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:14.071587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c6dd9-b3fa-4a1a-bef7-e293d0ff4fb3 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:14.072139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c6dd9-b3fa-4a1a-bef7-e293d0ff4fb3 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:14.072613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c6dd9-b3fa-4a1a-bef7-e293d0ff4fb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:14.086090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c6dd9-b3fa-4a1a-bef7-e293d0ff4fb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:14.086322 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3371/6820] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:08:14.087956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c6dd9-b3fa-4a1a-bef7-e293d0ff4fb3 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:14.108024 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3450/6821] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:08:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:15.202142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a081369-aa6a-4582-be1f-b5ca0813b9a2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:15.203116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a081369-aa6a-4582-be1f-b5ca0813b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:15.203855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a081369-aa6a-4582-be1f-b5ca0813b9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:15.243507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2a081369-aa6a-4582-be1f-b5ca0813b9a2 None None] MFA Rules not processed for user `e8150e994a4f42e3b014e5e51265213a`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:15.246024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2a081369-aa6a-4582-be1f-b5ca0813b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:15.356466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c6dd9-b3fa-4a1a-bef7-e293d0ff4fb3 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:15.371280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c6dd9-b3fa-4a1a-bef7-e293d0ff4fb3 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:15.384040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100d1b1-21a1-42b6-8c1e-65a83765228f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:15.385505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100d1b1-21a1-42b6-8c1e-65a83765228f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:15.385925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100d1b1-21a1-42b6-8c1e-65a83765228f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:15.386217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100d1b1-21a1-42b6-8c1e-65a83765228f admin admin] PATH_INFO: `/v3/users/746602a47af1420ea9d7a02aa379a4eb` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:15.389038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100d1b1-21a1-42b6-8c1e-65a83765228f admin admin] RBAC: Authorizing `identity:delete_user(user_id=746602a47af1420ea9d7a02aa379a4eb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:15.394359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100d1b1-21a1-42b6-8c1e-65a83765228f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:15.399471 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3372/6822] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:15 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:15.402497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a081369-aa6a-4582-be1f-b5ca0813b9a2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:15.428613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a081369-aa6a-4582-be1f-b5ca0813b9a2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:15.447716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0890c3-32ff-481d-b882-d7853aa685d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:15.451499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0890c3-32ff-481d-b882-d7853aa685d6 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:15.451774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0890c3-32ff-481d-b882-d7853aa685d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:15.454463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0890c3-32ff-481d-b882-d7853aa685d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:15.455309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0890c3-32ff-481d-b882-d7853aa685d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:15.457257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0890c3-32ff-481d-b882-d7853aa685d6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:15.480519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c100d1b1-21a1-42b6-8c1e-65a83765228f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '746602a47af1420ea9d7a02aa379a4eb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:15.492528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c100d1b1-21a1-42b6-8c1e-65a83765228f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '746602a47af1420ea9d7a02aa379a4eb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:15.497758 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3373/6823] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:08:15 2021] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:15.497913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c100d1b1-21a1-42b6-8c1e-65a83765228f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '746602a47af1420ea9d7a02aa379a4eb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:15.499482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0890c3-32ff-481d-b882-d7853aa685d6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:15.514779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c100d1b1-21a1-42b6-8c1e-65a83765228f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '746602a47af1420ea9d7a02aa379a4eb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:15.526404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c100d1b1-21a1-42b6-8c1e-65a83765228f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '746602a47af1420ea9d7a02aa379a4eb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:15.533005 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3451/6824] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:08:15 2021] DELETE /identity/v3/users/746602a47af1420ea9d7a02aa379a4eb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:15.537717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d583be9-770a-4926-9408-8135500a80d0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:15.538008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d583be9-770a-4926-9408-8135500a80d0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:15.538462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d583be9-770a-4926-9408-8135500a80d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:15.561031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1d583be9-770a-4926-9408-8135500a80d0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:15.563305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1d583be9-770a-4926-9408-8135500a80d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:15.598349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0890c3-32ff-481d-b882-d7853aa685d6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:15.663033 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3452/6825] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:15.664551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d583be9-770a-4926-9408-8135500a80d0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:15.672550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1d583be9-770a-4926-9408-8135500a80d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:15.687854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a05f91-32f8-4b19-bca3-cae185a08de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:15.688731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a05f91-32f8-4b19-bca3-cae185a08de1 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:15.689173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a05f91-32f8-4b19-bca3-cae185a08de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:15.689642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a05f91-32f8-4b19-bca3-cae185a08de1 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:15.690390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a05f91-32f8-4b19-bca3-cae185a08de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:15.692714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a05f91-32f8-4b19-bca3-cae185a08de1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:15.722548 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3374/6826] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:08:15 2021] POST /identity/v3/users => generated 292 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:15.723361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a05f91-32f8-4b19-bca3-cae185a08de1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:15.725106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-35a05f91-32f8-4b19-bca3-cae185a08de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:15.749905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d583be9-770a-4926-9408-8135500a80d0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:15.753614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13dad05-4089-411c-99f5-a20bb26822e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:15.754270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dad05-4089-411c-99f5-a20bb26822e9 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:15.754566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dad05-4089-411c-99f5-a20bb26822e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:15.754842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dad05-4089-411c-99f5-a20bb26822e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:15.756598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c13dad05-4089-411c-99f5-a20bb26822e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:15.769265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13dad05-4089-411c-99f5-a20bb26822e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:15.770740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13dad05-4089-411c-99f5-a20bb26822e9 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:15.787937 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3453/6827] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:15 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:15.788610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13dad05-4089-411c-99f5-a20bb26822e9 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:15.789906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c13dad05-4089-411c-99f5-a20bb26822e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:15.807790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13dad05-4089-411c-99f5-a20bb26822e9 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:15.814367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fe663-f198-408f-9477-36b0d0e529ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:15.815151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fe663-f198-408f-9477-36b0d0e529ef admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:15.815697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fe663-f198-408f-9477-36b0d0e529ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:15.816068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fe663-f198-408f-9477-36b0d0e529ef admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:15.817765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fe663-f198-408f-9477-36b0d0e529ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:15.819542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fe663-f198-408f-9477-36b0d0e529ef admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:15.821202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a05f91-32f8-4b19-bca3-cae185a08de1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:15.828407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e39544-318f-4daa-9d77-f9b7c51d0049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:15.829071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e39544-318f-4daa-9d77-f9b7c51d0049 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:15.829557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e39544-318f-4daa-9d77-f9b7c51d0049 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:15.830000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e39544-318f-4daa-9d77-f9b7c51d0049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:15.833158 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3454/6828] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:15 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:15.837238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fe663-f198-408f-9477-36b0d0e529ef admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:15.842706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e39544-318f-4daa-9d77-f9b7c51d0049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:15.844763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e39544-318f-4daa-9d77-f9b7c51d0049 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:15.849179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fe663-f198-408f-9477-36b0d0e529ef admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:15.855001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6908c85-9ee9-4663-b01c-f054c6c5f6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:15.855896 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3375/6829] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:15.856388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6908c85-9ee9-4663-b01c-f054c6c5f6d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:15.856541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6908c85-9ee9-4663-b01c-f054c6c5f6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:15.856870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6908c85-9ee9-4663-b01c-f054c6c5f6d5 admin admin] PATH_INFO: `/v3/projects/8c7702c20e184901a92a1480029e7730/users/0b99b11c3ec3437eb506b24e483e6957/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:15.874866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6908c85-9ee9-4663-b01c-f054c6c5f6d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7702c20e184901a92a1480029e7730, user_id=0b99b11c3ec3437eb506b24e483e6957, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:15.878466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6908c85-9ee9-4663-b01c-f054c6c5f6d5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:15.892844 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3455/6830] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:15 2021] PUT /identity/v3/projects/8c7702c20e184901a92a1480029e7730/users/0b99b11c3ec3437eb506b24e483e6957/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:15.896839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e39544-318f-4daa-9d77-f9b7c51d0049 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:15.909580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e39544-318f-4daa-9d77-f9b7c51d0049 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:15.989314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affd624-b03f-4ade-ad72-4df4f870cc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:15.990087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affd624-b03f-4ade-ad72-4df4f870cc34 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:15.990413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affd624-b03f-4ade-ad72-4df4f870cc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:15.990690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affd624-b03f-4ade-ad72-4df4f870cc34 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:15.991527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affd624-b03f-4ade-ad72-4df4f870cc34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:15.993404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affd624-b03f-4ade-ad72-4df4f870cc34 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:16.006002 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3376/6831] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:15 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:16.009800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6908c85-9ee9-4663-b01c-f054c6c5f6d5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:16.021716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6908c85-9ee9-4663-b01c-f054c6c5f6d5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:16.028230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77f002-994f-4dbd-b6ed-03498a61e182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:16.030036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77f002-994f-4dbd-b6ed-03498a61e182 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:16.030277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77f002-994f-4dbd-b6ed-03498a61e182 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:16.030564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77f002-994f-4dbd-b6ed-03498a61e182 admin admin] PATH_INFO: `/v3/projects/8c7702c20e184901a92a1480029e7730/users/0b99b11c3ec3437eb506b24e483e6957/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:16.032724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77f002-994f-4dbd-b6ed-03498a61e182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7702c20e184901a92a1480029e7730, user_id=0b99b11c3ec3437eb506b24e483e6957, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:16.036319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77f002-994f-4dbd-b6ed-03498a61e182 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:16.049906 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3456/6832] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:16 2021] PUT /identity/v3/projects/8c7702c20e184901a92a1480029e7730/users/0b99b11c3ec3437eb506b24e483e6957/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:16.580055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affd624-b03f-4ade-ad72-4df4f870cc34 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:16.581944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6affd624-b03f-4ade-ad72-4df4f870cc34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:16.597567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affd624-b03f-4ade-ad72-4df4f870cc34 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:16.693815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcc958-206f-4cea-b705-f41db790d3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:16.695998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcc958-206f-4cea-b705-f41db790d3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:16.696275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcc958-206f-4cea-b705-f41db790d3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:16.696811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcc958-206f-4cea-b705-f41db790d3dc admin admin] PATH_INFO: `/v3/projects/db0a151197c34e75ad90ebd190b55865` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:16.698275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcc958-206f-4cea-b705-f41db790d3dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0a151197c34e75ad90ebd190b55865)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:16.700372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcc958-206f-4cea-b705-f41db790d3dc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:16.768320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-32dcc958-206f-4cea-b705-f41db790d3dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0a151197c34e75ad90ebd190b55865', 'request_id': 'req-32dcc958-206f-4cea-b705-f41db790d3dc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:16.777654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-32dcc958-206f-4cea-b705-f41db790d3dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0a151197c34e75ad90ebd190b55865', 'request_id': 'req-32dcc958-206f-4cea-b705-f41db790d3dc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:16.788727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-32dcc958-206f-4cea-b705-f41db790d3dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0a151197c34e75ad90ebd190b55865', 'request_id': 'req-32dcc958-206f-4cea-b705-f41db790d3dc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:16.819416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-32dcc958-206f-4cea-b705-f41db790d3dc admin admin] The token cache is being invalidate because project db0a151197c34e75ad90ebd190b55865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:16.819650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-32dcc958-206f-4cea-b705-f41db790d3dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:16.820376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-32dcc958-206f-4cea-b705-f41db790d3dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:16.822322 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3377/6833] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:16 2021] DELETE /identity/v3/projects/db0a151197c34e75ad90ebd190b55865 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:16.827613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77f002-994f-4dbd-b6ed-03498a61e182 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:16.830193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6a77f002-994f-4dbd-b6ed-03498a61e182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:16.861928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77f002-994f-4dbd-b6ed-03498a61e182 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:16.948382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a694576-2dce-4f33-83b1-d06294740575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:16.949332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a694576-2dce-4f33-83b1-d06294740575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:16.949622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a694576-2dce-4f33-83b1-d06294740575 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:16.949897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a694576-2dce-4f33-83b1-d06294740575 admin admin] PATH_INFO: `/v3/users/f5127599f74148b380c440f39f28e372` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:16.951920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a694576-2dce-4f33-83b1-d06294740575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5127599f74148b380c440f39f28e372)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:16.953851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a694576-2dce-4f33-83b1-d06294740575 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:17.058030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0a694576-2dce-4f33-83b1-d06294740575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5127599f74148b380c440f39f28e372'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:17.066936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0a694576-2dce-4f33-83b1-d06294740575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5127599f74148b380c440f39f28e372'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:17.068423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0a694576-2dce-4f33-83b1-d06294740575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5127599f74148b380c440f39f28e372'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:17.082993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0a694576-2dce-4f33-83b1-d06294740575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5127599f74148b380c440f39f28e372'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:17.092603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0a694576-2dce-4f33-83b1-d06294740575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5127599f74148b380c440f39f28e372'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:17.100299 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3457/6834] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:08:16 2021] DELETE /identity/v3/users/f5127599f74148b380c440f39f28e372 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:17.293111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd0d42-e273-4ec9-a5f1-e87f0bf7033c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:17.293406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd0d42-e273-4ec9-a5f1-e87f0bf7033c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:17.293998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd0d42-e273-4ec9-a5f1-e87f0bf7033c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:17.334055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-aacd0d42-e273-4ec9-a5f1-e87f0bf7033c None None] MFA Rules not processed for user `0b99b11c3ec3437eb506b24e483e6957`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:17.335431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-aacd0d42-e273-4ec9-a5f1-e87f0bf7033c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:17.445518 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3378/6835] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:17 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:17.456228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ebd51-237f-4252-a5be-04798cbe0e0c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:17.456517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ebd51-237f-4252-a5be-04798cbe0e0c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:17.456799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ebd51-237f-4252-a5be-04798cbe0e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:17.479438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b38ebd51-237f-4252-a5be-04798cbe0e0c None None] MFA Rules not processed for user `e8150e994a4f42e3b014e5e51265213a`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:17.480896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b38ebd51-237f-4252-a5be-04798cbe0e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:17.576289 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3458/6836] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:17 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:17.584376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd0d42-e273-4ec9-a5f1-e87f0bf7033c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:17.586412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-aacd0d42-e273-4ec9-a5f1-e87f0bf7033c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:17.687181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd0d42-e273-4ec9-a5f1-e87f0bf7033c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:17.692474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fee80-2c49-44db-83d0-4af8f2f0a411 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:17.693299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fee80-2c49-44db-83d0-4af8f2f0a411 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:17.693677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fee80-2c49-44db-83d0-4af8f2f0a411 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:17.695557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fee80-2c49-44db-83d0-4af8f2f0a411 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:17.699317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-452fee80-2c49-44db-83d0-4af8f2f0a411 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:17.721782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fee80-2c49-44db-83d0-4af8f2f0a411 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:17.723587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fee80-2c49-44db-83d0-4af8f2f0a411 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:17.759220 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3379/6837] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:17 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:18.163016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ebd51-237f-4252-a5be-04798cbe0e0c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:18.165534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b38ebd51-237f-4252-a5be-04798cbe0e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:18.247280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ebd51-237f-4252-a5be-04798cbe0e0c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:18.253038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d79d7a-214c-43e9-b41e-3159edfc6050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:18.253542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fee80-2c49-44db-83d0-4af8f2f0a411 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:18.254996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d79d7a-214c-43e9-b41e-3159edfc6050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:18.255119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-452fee80-2c49-44db-83d0-4af8f2f0a411 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:18.255607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d79d7a-214c-43e9-b41e-3159edfc6050 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:18.256102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d79d7a-214c-43e9-b41e-3159edfc6050 admin admin] PATH_INFO: `/v3/projects/e8644f42c5534a2493f7cbc1c7a650a5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:18.258853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d79d7a-214c-43e9-b41e-3159edfc6050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8644f42c5534a2493f7cbc1c7a650a5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:18.261197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d79d7a-214c-43e9-b41e-3159edfc6050 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:18.340533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-94d79d7a-214c-43e9-b41e-3159edfc6050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8644f42c5534a2493f7cbc1c7a650a5', 'request_id': 'req-94d79d7a-214c-43e9-b41e-3159edfc6050'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:18.344868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fee80-2c49-44db-83d0-4af8f2f0a411 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:18.355248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-94d79d7a-214c-43e9-b41e-3159edfc6050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8644f42c5534a2493f7cbc1c7a650a5', 'request_id': 'req-94d79d7a-214c-43e9-b41e-3159edfc6050'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:18.386123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-94d79d7a-214c-43e9-b41e-3159edfc6050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8644f42c5534a2493f7cbc1c7a650a5', 'request_id': 'req-94d79d7a-214c-43e9-b41e-3159edfc6050'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:18.406096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674148b-3ccc-4889-8014-b1bc947ca6e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:18.407099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674148b-3ccc-4889-8014-b1bc947ca6e7 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:18.407594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674148b-3ccc-4889-8014-b1bc947ca6e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:18.407751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674148b-3ccc-4889-8014-b1bc947ca6e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:18.408210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-94d79d7a-214c-43e9-b41e-3159edfc6050 admin admin] The token cache is being invalidate because project e8644f42c5534a2493f7cbc1c7a650a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:18.408516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-94d79d7a-214c-43e9-b41e-3159edfc6050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:18.409624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-94d79d7a-214c-43e9-b41e-3159edfc6050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:18.410369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7674148b-3ccc-4889-8014-b1bc947ca6e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:18.412484 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3459/6838] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:18 2021] DELETE /identity/v3/projects/e8644f42c5534a2493f7cbc1c7a650a5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:18.421694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c6cc6-8362-48d3-98c9-627b70dcff19 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:18.421694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c6cc6-8362-48d3-98c9-627b70dcff19 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:18.421694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c6cc6-8362-48d3-98c9-627b70dcff19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:18.426216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674148b-3ccc-4889-8014-b1bc947ca6e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:18.428724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674148b-3ccc-4889-8014-b1bc947ca6e7 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:18.441060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-823c6cc6-8362-48d3-98c9-627b70dcff19 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:18.442607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-823c6cc6-8362-48d3-98c9-627b70dcff19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:18.443416 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3380/6839] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:18 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:18.527622 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3460/6840] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:18.535207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476e305-5355-495d-996a-447600f6319b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:18.535581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476e305-5355-495d-996a-447600f6319b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:18.535782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476e305-5355-495d-996a-447600f6319b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:18.560546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c476e305-5355-495d-996a-447600f6319b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:18.561480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c476e305-5355-495d-996a-447600f6319b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:18.574400 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3381/6841] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:18.576151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c6cc6-8362-48d3-98c9-627b70dcff19 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:18.591738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c6cc6-8362-48d3-98c9-627b70dcff19 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:18.603681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd68a2d-9622-432e-9bb9-d42c60ce0014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:18.606433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd68a2d-9622-432e-9bb9-d42c60ce0014 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:18.606433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd68a2d-9622-432e-9bb9-d42c60ce0014 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:18.606433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd68a2d-9622-432e-9bb9-d42c60ce0014 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:18.606433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd68a2d-9622-432e-9bb9-d42c60ce0014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:08:18.606433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd68a2d-9622-432e-9bb9-d42c60ce0014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:18.608274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd68a2d-9622-432e-9bb9-d42c60ce0014 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:18.634728 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3461/6842] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:08:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:08:18.635892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476e305-5355-495d-996a-447600f6319b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:18.650954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476e305-5355-495d-996a-447600f6319b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:18.663403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8843bc2-1541-4538-a4da-01b039297124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:18.664099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8843bc2-1541-4538-a4da-01b039297124 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:18.664389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8843bc2-1541-4538-a4da-01b039297124 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:18.664671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8843bc2-1541-4538-a4da-01b039297124 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:18.665409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8843bc2-1541-4538-a4da-01b039297124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:18.667420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8843bc2-1541-4538-a4da-01b039297124 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:18.711033 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3382/6843] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:08:18 2021] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:18.718817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd68a2d-9622-432e-9bb9-d42c60ce0014 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:18.728824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd68a2d-9622-432e-9bb9-d42c60ce0014 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:18.824965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d80f6-a1c4-43c5-8313-fde04fbc93f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:18.825859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d80f6-a1c4-43c5-8313-fde04fbc93f8 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:18.826113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d80f6-a1c4-43c5-8313-fde04fbc93f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:18.826438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d80f6-a1c4-43c5-8313-fde04fbc93f8 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:18.827145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d80f6-a1c4-43c5-8313-fde04fbc93f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:18.829105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d80f6-a1c4-43c5-8313-fde04fbc93f8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:18.868788 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3462/6844] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:08:18 2021] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:18.875003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8843bc2-1541-4538-a4da-01b039297124 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:18.885793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8843bc2-1541-4538-a4da-01b039297124 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:18.893867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902da122-a741-4249-bd6e-98c37581eeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:18.894664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902da122-a741-4249-bd6e-98c37581eeea admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:18.895034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902da122-a741-4249-bd6e-98c37581eeea admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:18.895408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902da122-a741-4249-bd6e-98c37581eeea admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:18.896214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902da122-a741-4249-bd6e-98c37581eeea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:18.897916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902da122-a741-4249-bd6e-98c37581eeea admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:18.924815 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3383/6845] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:18 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:18.935432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d80f6-a1c4-43c5-8313-fde04fbc93f8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:18.949364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d80f6-a1c4-43c5-8313-fde04fbc93f8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:18.955650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea303d11-76ca-47a7-87a5-637ae12c9397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:18.956444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea303d11-76ca-47a7-87a5-637ae12c9397 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:18.956826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea303d11-76ca-47a7-87a5-637ae12c9397 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:18.957203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea303d11-76ca-47a7-87a5-637ae12c9397 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:18.958028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea303d11-76ca-47a7-87a5-637ae12c9397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:18.960216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea303d11-76ca-47a7-87a5-637ae12c9397 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:18.982828 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3463/6846] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:18 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:18.984576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902da122-a741-4249-bd6e-98c37581eeea admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:19.001976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902da122-a741-4249-bd6e-98c37581eeea admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:19.008215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579fdfc-c37c-4226-94aa-67cc08438846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:19.009278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579fdfc-c37c-4226-94aa-67cc08438846 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:19.009604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579fdfc-c37c-4226-94aa-67cc08438846 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:19.011012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579fdfc-c37c-4226-94aa-67cc08438846 admin admin] PATH_INFO: `/v3/projects/de79cd87d023436a80d3cc5428586e21/users/d32598482c834073b8fe24c84cb57d2f/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:19.031883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579fdfc-c37c-4226-94aa-67cc08438846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de79cd87d023436a80d3cc5428586e21, user_id=d32598482c834073b8fe24c84cb57d2f, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:19.034894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579fdfc-c37c-4226-94aa-67cc08438846 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:19.054541 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3384/6847] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:18 2021] PUT /identity/v3/projects/de79cd87d023436a80d3cc5428586e21/users/d32598482c834073b8fe24c84cb57d2f/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:19.060405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dac86-d50a-4b02-9a4a-a49efa90a640 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:19.060702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dac86-d50a-4b02-9a4a-a49efa90a640 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:19.061253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dac86-d50a-4b02-9a4a-a49efa90a640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:19.095010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0d1dac86-d50a-4b02-9a4a-a49efa90a640 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:19.107841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0d1dac86-d50a-4b02-9a4a-a49efa90a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:19.291949 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3464/6848] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:08:19.306397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579fdfc-c37c-4226-94aa-67cc08438846 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:19.308304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f579fdfc-c37c-4226-94aa-67cc08438846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:19.439329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579fdfc-c37c-4226-94aa-67cc08438846 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:19.467494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5e319-4c7b-46c1-b0b8-5231df5d1e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:19.468671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5e319-4c7b-46c1-b0b8-5231df5d1e21 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:19.468905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5e319-4c7b-46c1-b0b8-5231df5d1e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:19.469188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5e319-4c7b-46c1-b0b8-5231df5d1e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:19.495288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5e319-4c7b-46c1-b0b8-5231df5d1e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:19.496767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5e319-4c7b-46c1-b0b8-5231df5d1e21 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:19.527894 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3385/6849] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:20.079031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dac86-d50a-4b02-9a4a-a49efa90a640 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:20.081200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0d1dac86-d50a-4b02-9a4a-a49efa90a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:20.195497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dac86-d50a-4b02-9a4a-a49efa90a640 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:20.201795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828601f5-b322-4311-a6fa-f11fd1453273 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:20.202993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828601f5-b322-4311-a6fa-f11fd1453273 service glance] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:20.211306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828601f5-b322-4311-a6fa-f11fd1453273 service glance] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:20.215721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828601f5-b322-4311-a6fa-f11fd1453273 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:20.219850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-828601f5-b322-4311-a6fa-f11fd1453273 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:20.344392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828601f5-b322-4311-a6fa-f11fd1453273 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:20.346941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828601f5-b322-4311-a6fa-f11fd1453273 service glance] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:20.363910 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3465/6850] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:20 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:20.467297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5e319-4c7b-46c1-b0b8-5231df5d1e21 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:20.469470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-24a5e319-4c7b-46c1-b0b8-5231df5d1e21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:20.498017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5e319-4c7b-46c1-b0b8-5231df5d1e21 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:20.505910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c693869-5196-444a-a744-cd2649b67551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:20.507006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c693869-5196-444a-a744-cd2649b67551 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:20.507604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c693869-5196-444a-a744-cd2649b67551 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:20.508041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c693869-5196-444a-a744-cd2649b67551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:20.510032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4c693869-5196-444a-a744-cd2649b67551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:20.525475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c693869-5196-444a-a744-cd2649b67551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:20.527371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c693869-5196-444a-a744-cd2649b67551 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:20.544709 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3386/6851] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:20 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:23.104398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828601f5-b322-4311-a6fa-f11fd1453273 service glance] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:23.105888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-828601f5-b322-4311-a6fa-f11fd1453273 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:23.129621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828601f5-b322-4311-a6fa-f11fd1453273 service glance] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:23.146488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec8d0f-7318-4c8d-bba5-988a78aa9d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:23.147410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec8d0f-7318-4c8d-bba5-988a78aa9d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:23.148586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec8d0f-7318-4c8d-bba5-988a78aa9d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:23.148879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec8d0f-7318-4c8d-bba5-988a78aa9d1a admin admin] PATH_INFO: `/v3/users/cef85da08a92421382f7ebd7a3e9af66` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:23.158728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec8d0f-7318-4c8d-bba5-988a78aa9d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef85da08a92421382f7ebd7a3e9af66)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:23.160863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec8d0f-7318-4c8d-bba5-988a78aa9d1a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:23.220474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c693869-5196-444a-a744-cd2649b67551 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:23.222950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4c693869-5196-444a-a744-cd2649b67551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:23.269241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c693869-5196-444a-a744-cd2649b67551 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:23.292066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86950b2d-e3e0-42c9-b8f7-77a72297959a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:23.292753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86950b2d-e3e0-42c9-b8f7-77a72297959a service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:23.293042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86950b2d-e3e0-42c9-b8f7-77a72297959a service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:23.293325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86950b2d-e3e0-42c9-b8f7-77a72297959a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:23.305247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-86950b2d-e3e0-42c9-b8f7-77a72297959a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:23.312209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-02ec8d0f-7318-4c8d-bba5-988a78aa9d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef85da08a92421382f7ebd7a3e9af66'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:23.372705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-02ec8d0f-7318-4c8d-bba5-988a78aa9d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef85da08a92421382f7ebd7a3e9af66'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:23.379391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-02ec8d0f-7318-4c8d-bba5-988a78aa9d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef85da08a92421382f7ebd7a3e9af66'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:23.414334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86950b2d-e3e0-42c9-b8f7-77a72297959a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:23.423650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86950b2d-e3e0-42c9-b8f7-77a72297959a service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:23.424245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-02ec8d0f-7318-4c8d-bba5-988a78aa9d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef85da08a92421382f7ebd7a3e9af66'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:23.443776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-02ec8d0f-7318-4c8d-bba5-988a78aa9d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef85da08a92421382f7ebd7a3e9af66'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:23.452251 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3466/6852] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:08:23 2021] DELETE /identity/v3/users/cef85da08a92421382f7ebd7a3e9af66 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:23.457685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82875d0d-52cb-43a3-8f89-663728497e76 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:23.458107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82875d0d-52cb-43a3-8f89-663728497e76 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:23.458732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82875d0d-52cb-43a3-8f89-663728497e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:23.474673 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3387/6853] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:23 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:08:23.502328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-82875d0d-52cb-43a3-8f89-663728497e76 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:23.505673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-82875d0d-52cb-43a3-8f89-663728497e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:23.596537 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3467/6854] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:08:23.644304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86950b2d-e3e0-42c9-b8f7-77a72297959a service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:23.679604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86950b2d-e3e0-42c9-b8f7-77a72297959a service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:23.836318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1aafe-615a-4f79-acb5-2b269a2b54b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:23.836993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1aafe-615a-4f79-acb5-2b269a2b54b0 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:23.837287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1aafe-615a-4f79-acb5-2b269a2b54b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:23.837574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1aafe-615a-4f79-acb5-2b269a2b54b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:23.858346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1aafe-615a-4f79-acb5-2b269a2b54b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:23.859816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1aafe-615a-4f79-acb5-2b269a2b54b0 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:23.872661 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3388/6855] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:25.049933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db69e3a-d57e-4094-a02f-9da8efd9d5fd None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:25.050546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db69e3a-d57e-4094-a02f-9da8efd9d5fd None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:25.050546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db69e3a-d57e-4094-a02f-9da8efd9d5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:25.101192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2db69e3a-d57e-4094-a02f-9da8efd9d5fd None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:25.111611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2db69e3a-d57e-4094-a02f-9da8efd9d5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:25.244028 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3468/6856] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:08:25 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:25.260099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1aafe-615a-4f79-acb5-2b269a2b54b0 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:25.261589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0bf1aafe-615a-4f79-acb5-2b269a2b54b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:25.405910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1aafe-615a-4f79-acb5-2b269a2b54b0 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:25.414916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf08c2-4a67-4285-9a52-89699e0d28a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:25.415610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf08c2-4a67-4285-9a52-89699e0d28a6 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:25.415894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf08c2-4a67-4285-9a52-89699e0d28a6 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:25.416356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf08c2-4a67-4285-9a52-89699e0d28a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:25.428737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf08c2-4a67-4285-9a52-89699e0d28a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:25.430834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf08c2-4a67-4285-9a52-89699e0d28a6 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:25.441513 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3389/6857] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:08:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:25.571952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db69e3a-d57e-4094-a02f-9da8efd9d5fd None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:25.573975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2db69e3a-d57e-4094-a02f-9da8efd9d5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:25.599591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db69e3a-d57e-4094-a02f-9da8efd9d5fd None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:25.626718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509aa4b2-baf7-400b-b9c2-34902bccf667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:25.628677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509aa4b2-baf7-400b-b9c2-34902bccf667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:25.629810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509aa4b2-baf7-400b-b9c2-34902bccf667 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:25.630396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509aa4b2-baf7-400b-b9c2-34902bccf667 admin admin] PATH_INFO: `/v3/projects/b95f79502f564ca1ac30fb7eeaa4d0c8` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:25.633280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509aa4b2-baf7-400b-b9c2-34902bccf667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95f79502f564ca1ac30fb7eeaa4d0c8)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:25.637270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509aa4b2-baf7-400b-b9c2-34902bccf667 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:25.776540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-509aa4b2-baf7-400b-b9c2-34902bccf667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95f79502f564ca1ac30fb7eeaa4d0c8', 'request_id': 'req-509aa4b2-baf7-400b-b9c2-34902bccf667'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:25.795073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-509aa4b2-baf7-400b-b9c2-34902bccf667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95f79502f564ca1ac30fb7eeaa4d0c8', 'request_id': 'req-509aa4b2-baf7-400b-b9c2-34902bccf667'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:25.815115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-509aa4b2-baf7-400b-b9c2-34902bccf667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95f79502f564ca1ac30fb7eeaa4d0c8', 'request_id': 'req-509aa4b2-baf7-400b-b9c2-34902bccf667'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:25.837603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-509aa4b2-baf7-400b-b9c2-34902bccf667 admin admin] The token cache is being invalidate because project b95f79502f564ca1ac30fb7eeaa4d0c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:25.843765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-509aa4b2-baf7-400b-b9c2-34902bccf667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:25.846483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-509aa4b2-baf7-400b-b9c2-34902bccf667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:25.851547 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3469/6858] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:25 2021] DELETE /identity/v3/projects/b95f79502f564ca1ac30fb7eeaa4d0c8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:25.858293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a86e6-a406-4c91-87cf-0373a511a169 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:25.858780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a86e6-a406-4c91-87cf-0373a511a169 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:25.859217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a86e6-a406-4c91-87cf-0373a511a169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:25.904246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-051a86e6-a406-4c91-87cf-0373a511a169 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:25.905652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-051a86e6-a406-4c91-87cf-0373a511a169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:26.087319 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3390/6859] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:26.095479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68ea8a-a357-4e7d-9745-9f62c0210081 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:26.096703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68ea8a-a357-4e7d-9745-9f62c0210081 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:26.097200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68ea8a-a357-4e7d-9745-9f62c0210081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:26.157218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fe68ea8a-a357-4e7d-9745-9f62c0210081 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:26.159284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fe68ea8a-a357-4e7d-9745-9f62c0210081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:26.183003 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3470/6860] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:26.188894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a86e6-a406-4c91-87cf-0373a511a169 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:26.229014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a86e6-a406-4c91-87cf-0373a511a169 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:26.241710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea8521-e93e-4908-b4b5-7093684e2f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:26.242826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea8521-e93e-4908-b4b5-7093684e2f91 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:26.243333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea8521-e93e-4908-b4b5-7093684e2f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:26.243866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea8521-e93e-4908-b4b5-7093684e2f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:26.244982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea8521-e93e-4908-b4b5-7093684e2f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:08:26.245537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea8521-e93e-4908-b4b5-7093684e2f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:26.247608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea8521-e93e-4908-b4b5-7093684e2f91 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:26.304032 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3391/6861] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:08:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:08:26.308524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68ea8a-a357-4e7d-9745-9f62c0210081 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:26.328407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68ea8a-a357-4e7d-9745-9f62c0210081 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:26.343084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a5444-eb06-4213-8abc-f0b071f73117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:26.344150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a5444-eb06-4213-8abc-f0b071f73117 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:26.344668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a5444-eb06-4213-8abc-f0b071f73117 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:26.345158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a5444-eb06-4213-8abc-f0b071f73117 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:26.346068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a5444-eb06-4213-8abc-f0b071f73117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:26.348231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a5444-eb06-4213-8abc-f0b071f73117 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:26.395043 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3471/6862] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:08:26 2021] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:08:26.399805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea8521-e93e-4908-b4b5-7093684e2f91 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:26.415203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea8521-e93e-4908-b4b5-7093684e2f91 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:26.583471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984078b0-3789-458a-bef1-be0366515ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:26.583987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984078b0-3789-458a-bef1-be0366515ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:26.584525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984078b0-3789-458a-bef1-be0366515ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:26.584863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984078b0-3789-458a-bef1-be0366515ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:26.585584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984078b0-3789-458a-bef1-be0366515ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:26.587729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984078b0-3789-458a-bef1-be0366515ee3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:26.621419 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3392/6863] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:08:26 2021] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:08:26.625795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a5444-eb06-4213-8abc-f0b071f73117 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:26.641190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a5444-eb06-4213-8abc-f0b071f73117 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:26.649270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2609129-7f29-443a-bc4a-d645588cd8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:26.650201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2609129-7f29-443a-bc4a-d645588cd8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:26.650851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2609129-7f29-443a-bc4a-d645588cd8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:26.650975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2609129-7f29-443a-bc4a-d645588cd8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:26.651814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2609129-7f29-443a-bc4a-d645588cd8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:26.654643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe380d-10d8-4602-af70-12d97f233d18 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:26.654784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2609129-7f29-443a-bc4a-d645588cd8c3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:26.655261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe380d-10d8-4602-af70-12d97f233d18 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:26.655760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe380d-10d8-4602-af70-12d97f233d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:26.666872 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3472/6864] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:26 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:26.673044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2609129-7f29-443a-bc4a-d645588cd8c3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:26.704909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2609129-7f29-443a-bc4a-d645588cd8c3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:26.720004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a04d69-4be6-42a8-9017-38f0856d0f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:26.720961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a04d69-4be6-42a8-9017-38f0856d0f3e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:26.721313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a04d69-4be6-42a8-9017-38f0856d0f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:26.721661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a04d69-4be6-42a8-9017-38f0856d0f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:26.722739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a04d69-4be6-42a8-9017-38f0856d0f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:26.725945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a04d69-4be6-42a8-9017-38f0856d0f3e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:26.732880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e8fe380d-10d8-4602-af70-12d97f233d18 None None] MFA Rules not processed for user `d32598482c834073b8fe24c84cb57d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:26.735259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e8fe380d-10d8-4602-af70-12d97f233d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:26.762525 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3473/6865] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:26 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:26.764063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a04d69-4be6-42a8-9017-38f0856d0f3e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:26.784238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a04d69-4be6-42a8-9017-38f0856d0f3e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:26.796894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658217c-42c0-4147-a611-7d75205c777d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:26.797797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658217c-42c0-4147-a611-7d75205c777d admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:26.798079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658217c-42c0-4147-a611-7d75205c777d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:26.798386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658217c-42c0-4147-a611-7d75205c777d admin admin] PATH_INFO: `/v3/projects/6df650339f864e028604b27467d14de8/users/4669c1de603a448a91c3b979a632468b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:26.830233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658217c-42c0-4147-a611-7d75205c777d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df650339f864e028604b27467d14de8, user_id=4669c1de603a448a91c3b979a632468b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:26.835066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658217c-42c0-4147-a611-7d75205c777d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:26.858023 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3474/6866] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:26 2021] PUT /identity/v3/projects/6df650339f864e028604b27467d14de8/users/4669c1de603a448a91c3b979a632468b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:26.869204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d351962-2d61-472b-b798-b3e34eae3614 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:26.869496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d351962-2d61-472b-b798-b3e34eae3614 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:26.869761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d351962-2d61-472b-b798-b3e34eae3614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:26.877801 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3393/6867] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:26 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:26.878718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe380d-10d8-4602-af70-12d97f233d18 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:26.880065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e8fe380d-10d8-4602-af70-12d97f233d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:26.895138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe380d-10d8-4602-af70-12d97f233d18 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:26.910065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3d351962-2d61-472b-b798-b3e34eae3614 None None] MFA Rules not processed for user `4669c1de603a448a91c3b979a632468b`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:26.916409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3d351962-2d61-472b-b798-b3e34eae3614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:26.987304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1787d-2c60-48ca-a9ee-420a0fdfd4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:26.988221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1787d-2c60-48ca-a9ee-420a0fdfd4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:26.988761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1787d-2c60-48ca-a9ee-420a0fdfd4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:26.989120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1787d-2c60-48ca-a9ee-420a0fdfd4c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:26.989840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1787d-2c60-48ca-a9ee-420a0fdfd4c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:26.992069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1787d-2c60-48ca-a9ee-420a0fdfd4c4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:27.025394 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3394/6868] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:08:26 2021] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:27.030738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1787d-2c60-48ca-a9ee-420a0fdfd4c4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:27.038550 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3475/6869] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:26 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:08:27.047497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d351962-2d61-472b-b798-b3e34eae3614 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:27.050450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3d351962-2d61-472b-b798-b3e34eae3614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:27.201296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d351962-2d61-472b-b798-b3e34eae3614 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:27.246788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1787d-2c60-48ca-a9ee-420a0fdfd4c4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:27.261556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4ce40-3039-4bf5-83b1-47581867e493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:27.263159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4ce40-3039-4bf5-83b1-47581867e493 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:27.263159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4ce40-3039-4bf5-83b1-47581867e493 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:27.265432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4ce40-3039-4bf5-83b1-47581867e493 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:27.265913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4ce40-3039-4bf5-83b1-47581867e493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:27.267952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4ce40-3039-4bf5-83b1-47581867e493 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:27.318361 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3395/6870] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:08:27 2021] POST /identity/v3/users => generated 295 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:27.321949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4ce40-3039-4bf5-83b1-47581867e493 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:27.342002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922456c4-bb40-4e65-8988-9e2d196c583e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:27.342848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922456c4-bb40-4e65-8988-9e2d196c583e service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:27.343133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922456c4-bb40-4e65-8988-9e2d196c583e service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:27.343409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922456c4-bb40-4e65-8988-9e2d196c583e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:27.347238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4ce40-3039-4bf5-83b1-47581867e493 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:27.362960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4ff7f-37f5-4bf2-a081-cdaed7e9c055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:27.372300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4ff7f-37f5-4bf2-a081-cdaed7e9c055 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:27.375081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4ff7f-37f5-4bf2-a081-cdaed7e9c055 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:27.376113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4ff7f-37f5-4bf2-a081-cdaed7e9c055 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:27.379562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4ff7f-37f5-4bf2-a081-cdaed7e9c055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:27.386182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4ff7f-37f5-4bf2-a081-cdaed7e9c055 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:27.420138 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3396/6871] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:27 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:27.422563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4ff7f-37f5-4bf2-a081-cdaed7e9c055 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:27.439956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922456c4-bb40-4e65-8988-9e2d196c583e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:27.441758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922456c4-bb40-4e65-8988-9e2d196c583e service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:27.446963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4ff7f-37f5-4bf2-a081-cdaed7e9c055 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:27.452422 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3476/6872] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:27 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:08:27.458277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff176930-e79d-4b03-8c5f-d958cffd234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:27.459474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff176930-e79d-4b03-8c5f-d958cffd234f admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:27.460068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff176930-e79d-4b03-8c5f-d958cffd234f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:27.460448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff176930-e79d-4b03-8c5f-d958cffd234f admin admin] PATH_INFO: `/v3/projects/b21789afba8948ae88ea829b75a3eedc/users/b5c4ff3ea3e14de683a0a64bd9e75d46/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:27.488278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff176930-e79d-4b03-8c5f-d958cffd234f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21789afba8948ae88ea829b75a3eedc, user_id=b5c4ff3ea3e14de683a0a64bd9e75d46, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:27.491404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff176930-e79d-4b03-8c5f-d958cffd234f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:27.514396 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3397/6873] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:27 2021] PUT /identity/v3/projects/b21789afba8948ae88ea829b75a3eedc/users/b5c4ff3ea3e14de683a0a64bd9e75d46/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:27.518724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922456c4-bb40-4e65-8988-9e2d196c583e service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:27.564496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922456c4-bb40-4e65-8988-9e2d196c583e service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:27.661415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43befd61-9fa6-412e-96fb-5a4d1fdf03c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:27.662313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43befd61-9fa6-412e-96fb-5a4d1fdf03c9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:27.662653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43befd61-9fa6-412e-96fb-5a4d1fdf03c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:27.663010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43befd61-9fa6-412e-96fb-5a4d1fdf03c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:27.663956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43befd61-9fa6-412e-96fb-5a4d1fdf03c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:27.665810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43befd61-9fa6-412e-96fb-5a4d1fdf03c9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:27.683953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff176930-e79d-4b03-8c5f-d958cffd234f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:27.684342 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3477/6874] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:27 2021] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:27.711473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff176930-e79d-4b03-8c5f-d958cffd234f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:27.736658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cedd6-7b0e-42a8-bd46-28c6c84c8f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:27.738144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cedd6-7b0e-42a8-bd46-28c6c84c8f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:27.738637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cedd6-7b0e-42a8-bd46-28c6c84c8f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:27.739125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cedd6-7b0e-42a8-bd46-28c6c84c8f97 admin admin] PATH_INFO: `/v3/projects/b21789afba8948ae88ea829b75a3eedc/users/b5c4ff3ea3e14de683a0a64bd9e75d46/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:27.748695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cedd6-7b0e-42a8-bd46-28c6c84c8f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21789afba8948ae88ea829b75a3eedc, user_id=b5c4ff3ea3e14de683a0a64bd9e75d46, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:27.757213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cedd6-7b0e-42a8-bd46-28c6c84c8f97 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:27.818622 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3398/6875] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:27 2021] PUT /identity/v3/projects/b21789afba8948ae88ea829b75a3eedc/users/b5c4ff3ea3e14de683a0a64bd9e75d46/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:29.330427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647a611-ad87-4573-b5bd-28319c161c4c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:29.330989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647a611-ad87-4573-b5bd-28319c161c4c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:29.330989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647a611-ad87-4573-b5bd-28319c161c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:29.374273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c647a611-ad87-4573-b5bd-28319c161c4c None None] MFA Rules not processed for user `4669c1de603a448a91c3b979a632468b`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:29.375494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c647a611-ad87-4573-b5bd-28319c161c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:29.446195 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3478/6876] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:29 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:38.495312 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80053822-365b-4d50-838c-7cf65f325586 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:38.495891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80053822-365b-4d50-838c-7cf65f325586 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:38.495891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80053822-365b-4d50-838c-7cf65f325586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:38.553857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-80053822-365b-4d50-838c-7cf65f325586 None None] MFA Rules not processed for user `b5c4ff3ea3e14de683a0a64bd9e75d46`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:38.556048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-80053822-365b-4d50-838c-7cf65f325586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:38.703220 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3399/6877] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:38 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:38.732463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647a611-ad87-4573-b5bd-28319c161c4c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:38.742010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c647a611-ad87-4573-b5bd-28319c161c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:38.858736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647a611-ad87-4573-b5bd-28319c161c4c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:38.866146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff44964-2be7-48b1-93cc-b69e3fe8d1ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:38.867133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff44964-2be7-48b1-93cc-b69e3fe8d1ae service glance] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:38.867627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff44964-2be7-48b1-93cc-b69e3fe8d1ae service glance] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:38.868079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff44964-2be7-48b1-93cc-b69e3fe8d1ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:39.020633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff44964-2be7-48b1-93cc-b69e3fe8d1ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:39.022934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff44964-2be7-48b1-93cc-b69e3fe8d1ae service glance] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:39.038191 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3479/6878] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:38 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:39.342311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80053822-365b-4d50-838c-7cf65f325586 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:39.569439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80053822-365b-4d50-838c-7cf65f325586 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:39.580026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4469b6-2c3a-4697-bd8e-0f6dba12ce87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:39.581162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4469b6-2c3a-4697-bd8e-0f6dba12ce87 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:39.583326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4469b6-2c3a-4697-bd8e-0f6dba12ce87 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:39.583874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4469b6-2c3a-4697-bd8e-0f6dba12ce87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:39.611010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ef4469b6-2c3a-4697-bd8e-0f6dba12ce87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:39.797485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4469b6-2c3a-4697-bd8e-0f6dba12ce87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:39.808699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4469b6-2c3a-4697-bd8e-0f6dba12ce87 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:39.836785 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3400/6879] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:39 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:08:42.025055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff44964-2be7-48b1-93cc-b69e3fe8d1ae service glance] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:42.026610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0ff44964-2be7-48b1-93cc-b69e3fe8d1ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:42.115245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff44964-2be7-48b1-93cc-b69e3fe8d1ae service glance] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:42.120831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57ffb5-9eb4-47c2-8489-a719c8749cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:42.121765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57ffb5-9eb4-47c2-8489-a719c8749cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:42.122047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57ffb5-9eb4-47c2-8489-a719c8749cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:42.122354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57ffb5-9eb4-47c2-8489-a719c8749cb8 admin admin] PATH_INFO: `/v3/users/35e8d9677fae4bebb8ec386e90349f76` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:42.123627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57ffb5-9eb4-47c2-8489-a719c8749cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e8d9677fae4bebb8ec386e90349f76)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:42.125584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57ffb5-9eb4-47c2-8489-a719c8749cb8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:42.183921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ec57ffb5-9eb4-47c2-8489-a719c8749cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e8d9677fae4bebb8ec386e90349f76'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:42.190850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ec57ffb5-9eb4-47c2-8489-a719c8749cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e8d9677fae4bebb8ec386e90349f76'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:42.191581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ec57ffb5-9eb4-47c2-8489-a719c8749cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e8d9677fae4bebb8ec386e90349f76'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:42.204308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ec57ffb5-9eb4-47c2-8489-a719c8749cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e8d9677fae4bebb8ec386e90349f76'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:42.211950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ec57ffb5-9eb4-47c2-8489-a719c8749cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e8d9677fae4bebb8ec386e90349f76'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:42.222976 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3480/6880] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:08:42 2021] DELETE /identity/v3/users/35e8d9677fae4bebb8ec386e90349f76 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:42.483236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4469b6-2c3a-4697-bd8e-0f6dba12ce87 service cinder] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:42.495204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4469b6-2c3a-4697-bd8e-0f6dba12ce87 service cinder] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:42.597847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a36a9d-bf09-419e-8a59-9d591cf7547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:42.598859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a36a9d-bf09-419e-8a59-9d591cf7547a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:42.599224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a36a9d-bf09-419e-8a59-9d591cf7547a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:42.599604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a36a9d-bf09-419e-8a59-9d591cf7547a admin admin] PATH_INFO: `/v3/projects/78970748663c43d7956bc64b493acfae` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:42.601066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a36a9d-bf09-419e-8a59-9d591cf7547a admin admin] RBAC: Authorizing `identity:delete_project(project_id=78970748663c43d7956bc64b493acfae)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:42.603574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a36a9d-bf09-419e-8a59-9d591cf7547a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:42.657106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-59a36a9d-bf09-419e-8a59-9d591cf7547a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78970748663c43d7956bc64b493acfae', 'request_id': 'req-59a36a9d-bf09-419e-8a59-9d591cf7547a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:42.663942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-59a36a9d-bf09-419e-8a59-9d591cf7547a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78970748663c43d7956bc64b493acfae', 'request_id': 'req-59a36a9d-bf09-419e-8a59-9d591cf7547a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:42.671429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-59a36a9d-bf09-419e-8a59-9d591cf7547a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78970748663c43d7956bc64b493acfae', 'request_id': 'req-59a36a9d-bf09-419e-8a59-9d591cf7547a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:42.685965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-59a36a9d-bf09-419e-8a59-9d591cf7547a admin admin] The token cache is being invalidate because project 78970748663c43d7956bc64b493acfae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:42.686709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-59a36a9d-bf09-419e-8a59-9d591cf7547a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:42.687492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-59a36a9d-bf09-419e-8a59-9d591cf7547a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:42.689343 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3401/6881] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:42 2021] DELETE /identity/v3/projects/78970748663c43d7956bc64b493acfae => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:42.695370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4adcf6-691b-4842-beeb-9fab6f83e9ba None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:42.695940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4adcf6-691b-4842-beeb-9fab6f83e9ba None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:42.696405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4adcf6-691b-4842-beeb-9fab6f83e9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:42.720302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3a4adcf6-691b-4842-beeb-9fab6f83e9ba None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:42.721917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3a4adcf6-691b-4842-beeb-9fab6f83e9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:42.799723 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3481/6882] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:08:42.810691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b767c3-6719-42ac-a2da-e02e7aab7421 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:42.811967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b767c3-6719-42ac-a2da-e02e7aab7421 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:42.812811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b767c3-6719-42ac-a2da-e02e7aab7421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:42.837557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-39b767c3-6719-42ac-a2da-e02e7aab7421 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:42.839332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-39b767c3-6719-42ac-a2da-e02e7aab7421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:42.849237 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3402/6883] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:42.852658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4adcf6-691b-4842-beeb-9fab6f83e9ba None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:42.881053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4adcf6-691b-4842-beeb-9fab6f83e9ba None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:42.890155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a1995-2b09-4f53-ae3d-0e4a51258966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:42.890960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a1995-2b09-4f53-ae3d-0e4a51258966 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:42.891320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a1995-2b09-4f53-ae3d-0e4a51258966 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:42.891675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a1995-2b09-4f53-ae3d-0e4a51258966 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:42.892543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a1995-2b09-4f53-ae3d-0e4a51258966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:08:42.892923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a1995-2b09-4f53-ae3d-0e4a51258966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:42.898330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a1995-2b09-4f53-ae3d-0e4a51258966 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:42.921101 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3482/6884] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:08:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:08:42.925642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b767c3-6719-42ac-a2da-e02e7aab7421 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:42.936215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b767c3-6719-42ac-a2da-e02e7aab7421 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:42.948335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c23b04-acce-4af9-ae01-7d468d75ede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:42.949295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c23b04-acce-4af9-ae01-7d468d75ede6 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:42.951134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c23b04-acce-4af9-ae01-7d468d75ede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:42.951613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c23b04-acce-4af9-ae01-7d468d75ede6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:42.952918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c23b04-acce-4af9-ae01-7d468d75ede6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:42.957156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c23b04-acce-4af9-ae01-7d468d75ede6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:43.006342 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3403/6885] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:08:42 2021] POST /identity/v3/projects => generated 397 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:43.007865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a1995-2b09-4f53-ae3d-0e4a51258966 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:43.019048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a1995-2b09-4f53-ae3d-0e4a51258966 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:43.070008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9c1cb-73b8-4f47-8bd2-75f2d2145723 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:43.070401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9c1cb-73b8-4f47-8bd2-75f2d2145723 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:43.070677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9c1cb-73b8-4f47-8bd2-75f2d2145723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:43.114161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-30a9c1cb-73b8-4f47-8bd2-75f2d2145723 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:43.118674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-30a9c1cb-73b8-4f47-8bd2-75f2d2145723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:43.178485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf6284-d901-4a35-b5a0-d8243e49662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:43.179753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf6284-d901-4a35-b5a0-d8243e49662b admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:43.180179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf6284-d901-4a35-b5a0-d8243e49662b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:43.180839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf6284-d901-4a35-b5a0-d8243e49662b admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:43.181620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf6284-d901-4a35-b5a0-d8243e49662b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:43.184436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf6284-d901-4a35-b5a0-d8243e49662b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:43.239291 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3483/6886] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:08:43 2021] POST /identity/v3/users => generated 299 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:43.242133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf6284-d901-4a35-b5a0-d8243e49662b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:43.255428 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3404/6887] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 21:08:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:08:43.269815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9c1cb-73b8-4f47-8bd2-75f2d2145723 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:43.271711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-30a9c1cb-73b8-4f47-8bd2-75f2d2145723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:43.283088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf6284-d901-4a35-b5a0-d8243e49662b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:43.296832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec3714-27fd-4462-b20c-3d8e4da4929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:43.297544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec3714-27fd-4462-b20c-3d8e4da4929e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:43.297824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec3714-27fd-4462-b20c-3d8e4da4929e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:43.300417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec3714-27fd-4462-b20c-3d8e4da4929e admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:43.301872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec3714-27fd-4462-b20c-3d8e4da4929e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:43.304976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec3714-27fd-4462-b20c-3d8e4da4929e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:43.333857 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3484/6888] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:43 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:43.341893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec3714-27fd-4462-b20c-3d8e4da4929e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:43.362524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec3714-27fd-4462-b20c-3d8e4da4929e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:43.369720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c32d6-5e61-49fa-a3c3-6a661a6363ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:43.370670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c32d6-5e61-49fa-a3c3-6a661a6363ca admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:43.370957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c32d6-5e61-49fa-a3c3-6a661a6363ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:43.371543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c32d6-5e61-49fa-a3c3-6a661a6363ca admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:43.372358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c32d6-5e61-49fa-a3c3-6a661a6363ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:43.374706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c32d6-5e61-49fa-a3c3-6a661a6363ca admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:43.389990 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3485/6889] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:43 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:43.394030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c32d6-5e61-49fa-a3c3-6a661a6363ca admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:43.407477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c32d6-5e61-49fa-a3c3-6a661a6363ca admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:43.414050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d321b0-a9c3-4e89-91bf-6d5cb092fee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:43.415581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d321b0-a9c3-4e89-91bf-6d5cb092fee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:43.415963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d321b0-a9c3-4e89-91bf-6d5cb092fee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:43.416337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d321b0-a9c3-4e89-91bf-6d5cb092fee8 admin admin] PATH_INFO: `/v3/projects/88b33c528aa7484e8069e68727cd6e27/users/4de10fac4f814ac9a78d8f18ff231b7c/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:43.429898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9c1cb-73b8-4f47-8bd2-75f2d2145723 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:43.434898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d321b0-a9c3-4e89-91bf-6d5cb092fee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b33c528aa7484e8069e68727cd6e27, user_id=4de10fac4f814ac9a78d8f18ff231b7c, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:43.437970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d321b0-a9c3-4e89-91bf-6d5cb092fee8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:43.444931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8a305-05b5-4b4d-ac50-3e2adb4592b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:43.445582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8a305-05b5-4b4d-ac50-3e2adb4592b7 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:43.445881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8a305-05b5-4b4d-ac50-3e2adb4592b7 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:43.446160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8a305-05b5-4b4d-ac50-3e2adb4592b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:43.457487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8a305-05b5-4b4d-ac50-3e2adb4592b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:43.459204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8a305-05b5-4b4d-ac50-3e2adb4592b7 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:43.464413 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3486/6890] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:43 2021] PUT /identity/v3/projects/88b33c528aa7484e8069e68727cd6e27/users/4de10fac4f814ac9a78d8f18ff231b7c/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:08:43.466950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83409f5b-65c0-4edf-86f7-c35dfe6a6d2f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:43.467363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83409f5b-65c0-4edf-86f7-c35dfe6a6d2f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:43.467814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83409f5b-65c0-4edf-86f7-c35dfe6a6d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:43.472350 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3405/6891] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:08:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 21:08:43.526474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-83409f5b-65c0-4edf-86f7-c35dfe6a6d2f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:43.528475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-83409f5b-65c0-4edf-86f7-c35dfe6a6d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:43.679427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54746947-5cd3-4d7c-baac-b97c6b219a8b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:43.679427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54746947-5cd3-4d7c-baac-b97c6b219a8b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:43.679427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54746947-5cd3-4d7c-baac-b97c6b219a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:43.691774 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3487/6892] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:43.703367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83409f5b-65c0-4edf-86f7-c35dfe6a6d2f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:43.705012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-83409f5b-65c0-4edf-86f7-c35dfe6a6d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:43.705173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-54746947-5cd3-4d7c-baac-b97c6b219a8b None None] MFA Rules not processed for user `d32598482c834073b8fe24c84cb57d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:43.706476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-54746947-5cd3-4d7c-baac-b97c6b219a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:43.840516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83409f5b-65c0-4edf-86f7-c35dfe6a6d2f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:43.851724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e30384-4bf1-43b3-bae7-e0379f8bef7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:43.853243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e30384-4bf1-43b3-bae7-e0379f8bef7c service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:43.853524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e30384-4bf1-43b3-bae7-e0379f8bef7c service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:43.853870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e30384-4bf1-43b3-bae7-e0379f8bef7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:43.876158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e30384-4bf1-43b3-bae7-e0379f8bef7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:43.877689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e30384-4bf1-43b3-bae7-e0379f8bef7c service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:43.891942 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3488/6893] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:43.904282 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3406/6894] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:43 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:44.353724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e30384-4bf1-43b3-bae7-e0379f8bef7c service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:44.355338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-92e30384-4bf1-43b3-bae7-e0379f8bef7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:44.385791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e30384-4bf1-43b3-bae7-e0379f8bef7c service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:44.396510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff7084-39e4-46b5-986a-ea6487cccfe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:44.397177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff7084-39e4-46b5-986a-ea6487cccfe1 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:44.397461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff7084-39e4-46b5-986a-ea6487cccfe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:44.397747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff7084-39e4-46b5-986a-ea6487cccfe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:44.405898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-90ff7084-39e4-46b5-986a-ea6487cccfe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:44.429593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff7084-39e4-46b5-986a-ea6487cccfe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:44.431190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff7084-39e4-46b5-986a-ea6487cccfe1 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:44.458191 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3489/6895] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:44 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:44.966184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5e71d-f65f-4b4e-946b-7e6d2cf94f10 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:44.966739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5e71d-f65f-4b4e-946b-7e6d2cf94f10 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:44.967046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5e71d-f65f-4b4e-946b-7e6d2cf94f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:45.018067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-00a5e71d-f65f-4b4e-946b-7e6d2cf94f10 None None] MFA Rules not processed for user `4de10fac4f814ac9a78d8f18ff231b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:45.019634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-00a5e71d-f65f-4b4e-946b-7e6d2cf94f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:45.193971 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3407/6896] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:44 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:08:45.272257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea72eb1-2d73-4c7b-89f6-cf89cbdae0f7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:45.272904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea72eb1-2d73-4c7b-89f6-cf89cbdae0f7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:45.273408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea72eb1-2d73-4c7b-89f6-cf89cbdae0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:45.306203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-eea72eb1-2d73-4c7b-89f6-cf89cbdae0f7 None None] MFA Rules not processed for user `4de10fac4f814ac9a78d8f18ff231b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:45.310965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-eea72eb1-2d73-4c7b-89f6-cf89cbdae0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:45.352608 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3490/6897] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:45 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:45.451080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5e71d-f65f-4b4e-946b-7e6d2cf94f10 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:45.453998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-00a5e71d-f65f-4b4e-946b-7e6d2cf94f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:45.576834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5e71d-f65f-4b4e-946b-7e6d2cf94f10 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:45.586152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdd0ae-1c7d-4155-bb84-27e345c59f95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:45.588320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdd0ae-1c7d-4155-bb84-27e345c59f95 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:45.588617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdd0ae-1c7d-4155-bb84-27e345c59f95 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:45.588909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdd0ae-1c7d-4155-bb84-27e345c59f95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:45.602464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdd0ae-1c7d-4155-bb84-27e345c59f95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:45.606305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdd0ae-1c7d-4155-bb84-27e345c59f95 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:45.617732 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3408/6898] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:45 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:54.002779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d8377-c744-4a02-9c8d-24b65116bf00 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:54.003256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d8377-c744-4a02-9c8d-24b65116bf00 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:54.003515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d8377-c744-4a02-9c8d-24b65116bf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:54.022298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-766d8377-c744-4a02-9c8d-24b65116bf00 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:54.023768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-766d8377-c744-4a02-9c8d-24b65116bf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:54.080438 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3491/6899] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:08:54 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:54.093960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdd0ae-1c7d-4155-bb84-27e345c59f95 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:54.164973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdd0ae-1c7d-4155-bb84-27e345c59f95 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:54.170016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6b4be-083f-4fd6-ba89-76e33b29d5ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:54.171094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b4be-083f-4fd6-ba89-76e33b29d5ac service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:54.171385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b4be-083f-4fd6-ba89-76e33b29d5ac service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:54.171679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b4be-083f-4fd6-ba89-76e33b29d5ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:54.180991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6b4be-083f-4fd6-ba89-76e33b29d5ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:54.182582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6b4be-083f-4fd6-ba89-76e33b29d5ac service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:54.191482 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3409/6900] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:08:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:54.759961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc41c5-ea24-4c0f-b737-ded5d8a1fe52 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:54.760417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc41c5-ea24-4c0f-b737-ded5d8a1fe52 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:54.760704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc41c5-ea24-4c0f-b737-ded5d8a1fe52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:54.784484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4ccc41c5-ea24-4c0f-b737-ded5d8a1fe52 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:54.786023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4ccc41c5-ea24-4c0f-b737-ded5d8a1fe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:54.796441 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3492/6901] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 21:08:54 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:08:54.827819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6b4be-083f-4fd6-ba89-76e33b29d5ac service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:54.842277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6b4be-083f-4fd6-ba89-76e33b29d5ac service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:54.851576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10f698-6f73-498f-8954-7d74f657c3c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:54.852483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10f698-6f73-498f-8954-7d74f657c3c3 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:54.852961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10f698-6f73-498f-8954-7d74f657c3c3 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:54.853250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10f698-6f73-498f-8954-7d74f657c3c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:54.863161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10f698-6f73-498f-8954-7d74f657c3c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:54.864935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10f698-6f73-498f-8954-7d74f657c3c3 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:54.875330 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3410/6902] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:08:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:55.129946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7eab2d-a12f-4592-9a9a-7f9ea384fb58 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:55.130472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7eab2d-a12f-4592-9a9a-7f9ea384fb58 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:55.131402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7eab2d-a12f-4592-9a9a-7f9ea384fb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:55.149922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5a7eab2d-a12f-4592-9a9a-7f9ea384fb58 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:55.151445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5a7eab2d-a12f-4592-9a9a-7f9ea384fb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:55.161679 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3493/6903] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:08:55 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:55.180860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10f698-6f73-498f-8954-7d74f657c3c3 service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:55.201796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10f698-6f73-498f-8954-7d74f657c3c3 service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:55.209042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24649a63-8c56-4201-9d06-2b3b30adee8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:55.209901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24649a63-8c56-4201-9d06-2b3b30adee8d service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:55.210276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24649a63-8c56-4201-9d06-2b3b30adee8d service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:55.210642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24649a63-8c56-4201-9d06-2b3b30adee8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:55.221114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24649a63-8c56-4201-9d06-2b3b30adee8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:55.222853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24649a63-8c56-4201-9d06-2b3b30adee8d service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:55.233421 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3411/6904] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:08:55 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:08:55.604001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0af5c1-8fb1-4f4e-a903-bc744115d29b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:55.604288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0af5c1-8fb1-4f4e-a903-bc744115d29b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:55.604562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0af5c1-8fb1-4f4e-a903-bc744115d29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:55.628411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5d0af5c1-8fb1-4f4e-a903-bc744115d29b None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:55.630438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5d0af5c1-8fb1-4f4e-a903-bc744115d29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:55.640530 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3494/6905] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 21:08:55 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:55.663167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24649a63-8c56-4201-9d06-2b3b30adee8d service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:55.678417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24649a63-8c56-4201-9d06-2b3b30adee8d service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:55.685133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1baf8-55a4-440d-8cec-21296fdda1ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:55.686184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1baf8-55a4-440d-8cec-21296fdda1ef service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:55.686669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1baf8-55a4-440d-8cec-21296fdda1ef service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:55.687156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1baf8-55a4-440d-8cec-21296fdda1ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:55.703043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1baf8-55a4-440d-8cec-21296fdda1ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:55.704707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1baf8-55a4-440d-8cec-21296fdda1ef service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:55.742186 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3412/6906] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:08:55 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 21:08:57.817977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0af5c1-8fb1-4f4e-a903-bc744115d29b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:57.822763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5d0af5c1-8fb1-4f4e-a903-bc744115d29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:57.853771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0af5c1-8fb1-4f4e-a903-bc744115d29b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:57.860946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afca7f2-5661-4398-81c2-d907a3e94b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:57.861839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afca7f2-5661-4398-81c2-d907a3e94b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:57.862127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afca7f2-5661-4398-81c2-d907a3e94b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:57.862443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afca7f2-5661-4398-81c2-d907a3e94b13 admin admin] PATH_INFO: `/v3/users/4669c1de603a448a91c3b979a632468b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:57.863890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afca7f2-5661-4398-81c2-d907a3e94b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4669c1de603a448a91c3b979a632468b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:57.865997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afca7f2-5661-4398-81c2-d907a3e94b13 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:57.930611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9afca7f2-5661-4398-81c2-d907a3e94b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4669c1de603a448a91c3b979a632468b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:57.940276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9afca7f2-5661-4398-81c2-d907a3e94b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4669c1de603a448a91c3b979a632468b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:57.941434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9afca7f2-5661-4398-81c2-d907a3e94b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4669c1de603a448a91c3b979a632468b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:57.956939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9afca7f2-5661-4398-81c2-d907a3e94b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4669c1de603a448a91c3b979a632468b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:57.966492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9afca7f2-5661-4398-81c2-d907a3e94b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4669c1de603a448a91c3b979a632468b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:57.973693 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3495/6907] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:08:57 2021] DELETE /identity/v3/users/4669c1de603a448a91c3b979a632468b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:57.978246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4001f-7b8c-40bd-8941-eefafe13c3a2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:57.978833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4001f-7b8c-40bd-8941-eefafe13c3a2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:57.978984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4001f-7b8c-40bd-8941-eefafe13c3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:58.001342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ccc4001f-7b8c-40bd-8941-eefafe13c3a2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:58.002728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ccc4001f-7b8c-40bd-8941-eefafe13c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:58.072750 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3413/6908] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:58.084429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afca7f2-5661-4398-81c2-d907a3e94b13 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:58.085855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9afca7f2-5661-4398-81c2-d907a3e94b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:58.153535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afca7f2-5661-4398-81c2-d907a3e94b13 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:58.160789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a20a4-7434-49fb-be0e-2f668d082c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:58.161559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a20a4-7434-49fb-be0e-2f668d082c91 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:58.161854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a20a4-7434-49fb-be0e-2f668d082c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:58.162134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a20a4-7434-49fb-be0e-2f668d082c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:58.174292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a20a4-7434-49fb-be0e-2f668d082c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:58.175818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a20a4-7434-49fb-be0e-2f668d082c91 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:58.187172 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3496/6909] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:08:58.369049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4001f-7b8c-40bd-8941-eefafe13c3a2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:58.370448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ccc4001f-7b8c-40bd-8941-eefafe13c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:58.383405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4001f-7b8c-40bd-8941-eefafe13c3a2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:58.395459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4aeb59-b835-466b-b021-92b2c49025dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:58.398712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aeb59-b835-466b-b021-92b2c49025dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:58.399430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aeb59-b835-466b-b021-92b2c49025dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:58.399738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aeb59-b835-466b-b021-92b2c49025dc admin admin] PATH_INFO: `/v3/projects/6df650339f864e028604b27467d14de8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:58.400982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4aeb59-b835-466b-b021-92b2c49025dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6df650339f864e028604b27467d14de8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:58.403203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4aeb59-b835-466b-b021-92b2c49025dc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:58.456174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6f4aeb59-b835-466b-b021-92b2c49025dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6df650339f864e028604b27467d14de8', 'request_id': 'req-6f4aeb59-b835-466b-b021-92b2c49025dc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:58.462329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6f4aeb59-b835-466b-b021-92b2c49025dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6df650339f864e028604b27467d14de8', 'request_id': 'req-6f4aeb59-b835-466b-b021-92b2c49025dc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:58.467679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6f4aeb59-b835-466b-b021-92b2c49025dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6df650339f864e028604b27467d14de8', 'request_id': 'req-6f4aeb59-b835-466b-b021-92b2c49025dc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:58.481113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6f4aeb59-b835-466b-b021-92b2c49025dc admin admin] The token cache is being invalidate because project 6df650339f864e028604b27467d14de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:08:58.481410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6f4aeb59-b835-466b-b021-92b2c49025dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:58.482050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6f4aeb59-b835-466b-b021-92b2c49025dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:08:58.483630 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3414/6910] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:08:58 2021] DELETE /identity/v3/projects/6df650339f864e028604b27467d14de8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:58.489358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692b164-d06b-4adf-80ba-3b7a862fe088 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:58.489686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692b164-d06b-4adf-80ba-3b7a862fe088 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:58.489964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692b164-d06b-4adf-80ba-3b7a862fe088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:58.508854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2692b164-d06b-4adf-80ba-3b7a862fe088 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:58.510030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2692b164-d06b-4adf-80ba-3b7a862fe088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:58.570919 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3497/6911] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:08:58.578246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918884e8-5eaa-4a3b-8490-2aa832e39eb1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:58.578575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918884e8-5eaa-4a3b-8490-2aa832e39eb1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:58.578891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918884e8-5eaa-4a3b-8490-2aa832e39eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:58.597228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-918884e8-5eaa-4a3b-8490-2aa832e39eb1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:58.598469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-918884e8-5eaa-4a3b-8490-2aa832e39eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:58.607321 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3415/6912] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:58.611353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692b164-d06b-4adf-80ba-3b7a862fe088 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:58.622743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692b164-d06b-4adf-80ba-3b7a862fe088 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:58.627756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b47a57-82ee-463c-bb98-4d7818ded4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:58.628417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47a57-82ee-463c-bb98-4d7818ded4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:58.628818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47a57-82ee-463c-bb98-4d7818ded4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:58.629124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47a57-82ee-463c-bb98-4d7818ded4c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:58.629888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b47a57-82ee-463c-bb98-4d7818ded4c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:08:58.630292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b47a57-82ee-463c-bb98-4d7818ded4c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:58.631956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b47a57-82ee-463c-bb98-4d7818ded4c7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:58.644008 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3498/6913] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:08:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:08:58.648352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918884e8-5eaa-4a3b-8490-2aa832e39eb1 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:58.658470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918884e8-5eaa-4a3b-8490-2aa832e39eb1 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:58.663919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29af4c-bb5b-4b12-b516-75967ff4cdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:58.664789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29af4c-bb5b-4b12-b516-75967ff4cdd5 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:58.665079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29af4c-bb5b-4b12-b516-75967ff4cdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:58.665389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29af4c-bb5b-4b12-b516-75967ff4cdd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:58.666109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29af4c-bb5b-4b12-b516-75967ff4cdd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:58.668723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29af4c-bb5b-4b12-b516-75967ff4cdd5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:58.703614 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3416/6914] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:08:58 2021] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:58.707596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b47a57-82ee-463c-bb98-4d7818ded4c7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:58.717967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b47a57-82ee-463c-bb98-4d7818ded4c7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:58.790478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a30937-e498-45e1-b4cb-fce27c151c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:58.791153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a30937-e498-45e1-b4cb-fce27c151c9e admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:58.791593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a30937-e498-45e1-b4cb-fce27c151c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:58.791876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a30937-e498-45e1-b4cb-fce27c151c9e admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:58.793111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a30937-e498-45e1-b4cb-fce27c151c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:58.795059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a30937-e498-45e1-b4cb-fce27c151c9e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:58.822487 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3499/6915] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:08:58 2021] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:08:58.827070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29af4c-bb5b-4b12-b516-75967ff4cdd5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:58.841384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29af4c-bb5b-4b12-b516-75967ff4cdd5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:58.845561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2368afe-567a-4ab0-929c-87519dd2912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:58.846485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2368afe-567a-4ab0-929c-87519dd2912b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:58.846840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2368afe-567a-4ab0-929c-87519dd2912b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:58.847191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2368afe-567a-4ab0-929c-87519dd2912b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:58.848020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2368afe-567a-4ab0-929c-87519dd2912b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:58.849608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2368afe-567a-4ab0-929c-87519dd2912b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:58.865956 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3417/6916] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:58 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:58.869844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a30937-e498-45e1-b4cb-fce27c151c9e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:58.885596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a30937-e498-45e1-b4cb-fce27c151c9e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:58.899280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7aa31-2665-4510-a0e5-a3afd08e55e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:58.899989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7aa31-2665-4510-a0e5-a3afd08e55e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:58.900524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7aa31-2665-4510-a0e5-a3afd08e55e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:58.901556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7aa31-2665-4510-a0e5-a3afd08e55e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:58.903181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7aa31-2665-4510-a0e5-a3afd08e55e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:58.911831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7aa31-2665-4510-a0e5-a3afd08e55e2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:58.939665 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3500/6917] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:08:58 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:08:58.946305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2368afe-567a-4ab0-929c-87519dd2912b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:58.971918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2368afe-567a-4ab0-929c-87519dd2912b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:58.986292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7cc99-6b2d-4e46-aaf8-753fa1bbe10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:58.987408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7cc99-6b2d-4e46-aaf8-753fa1bbe10f admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:58.987804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7cc99-6b2d-4e46-aaf8-753fa1bbe10f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:58.988196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7cc99-6b2d-4e46-aaf8-753fa1bbe10f admin admin] PATH_INFO: `/v3/projects/8d050b91d2cd43cfbff6d3e27cd18b5d/users/814200cf33934d1b88ab3e9c2fd4859f/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:59.007146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7cc99-6b2d-4e46-aaf8-753fa1bbe10f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d050b91d2cd43cfbff6d3e27cd18b5d, user_id=814200cf33934d1b88ab3e9c2fd4859f, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:59.010854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7cc99-6b2d-4e46-aaf8-753fa1bbe10f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:59.050670 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3418/6918] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:08:58 2021] PUT /identity/v3/projects/8d050b91d2cd43cfbff6d3e27cd18b5d/users/814200cf33934d1b88ab3e9c2fd4859f/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:08:59.056174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646effb-a5c7-4401-865b-9fc51c5e4f47 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:59.056483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646effb-a5c7-4401-865b-9fc51c5e4f47 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:59.056751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646effb-a5c7-4401-865b-9fc51c5e4f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:59.090280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9646effb-a5c7-4401-865b-9fc51c5e4f47 None None] MFA Rules not processed for user `814200cf33934d1b88ab3e9c2fd4859f`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:08:59.091653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9646effb-a5c7-4401-865b-9fc51c5e4f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:59.162699 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3501/6919] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:08:59 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:08:59.173513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7cc99-6b2d-4e46-aaf8-753fa1bbe10f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:08:59.177332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bfa7cc99-6b2d-4e46-aaf8-753fa1bbe10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:08:59.251434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7cc99-6b2d-4e46-aaf8-753fa1bbe10f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:08:59.256387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6392ebd-cddf-4419-b2cf-0e645b6a59bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:08:59.257163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6392ebd-cddf-4419-b2cf-0e645b6a59bd service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:08:59.257624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6392ebd-cddf-4419-b2cf-0e645b6a59bd service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:08:59.257918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6392ebd-cddf-4419-b2cf-0e645b6a59bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:08:59.279097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6392ebd-cddf-4419-b2cf-0e645b6a59bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:08:59.282669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6392ebd-cddf-4419-b2cf-0e645b6a59bd service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:08:59.295010 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3419/6920] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:08:59 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:09:01.236601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646effb-a5c7-4401-865b-9fc51c5e4f47 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:01.238424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9646effb-a5c7-4401-865b-9fc51c5e4f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:01.323619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646effb-a5c7-4401-865b-9fc51c5e4f47 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:01.329101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf96f1-0348-4b10-8167-ae10938cc22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:01.330107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf96f1-0348-4b10-8167-ae10938cc22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:01.330490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf96f1-0348-4b10-8167-ae10938cc22d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:01.330850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf96f1-0348-4b10-8167-ae10938cc22d admin admin] PATH_INFO: `/v3/users/e8150e994a4f42e3b014e5e51265213a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:01.332133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf96f1-0348-4b10-8167-ae10938cc22d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8150e994a4f42e3b014e5e51265213a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:01.334157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf96f1-0348-4b10-8167-ae10938cc22d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:01.387364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6caf96f1-0348-4b10-8167-ae10938cc22d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8150e994a4f42e3b014e5e51265213a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:01.394846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6caf96f1-0348-4b10-8167-ae10938cc22d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8150e994a4f42e3b014e5e51265213a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:01.395571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6caf96f1-0348-4b10-8167-ae10938cc22d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8150e994a4f42e3b014e5e51265213a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:01.410444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6caf96f1-0348-4b10-8167-ae10938cc22d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8150e994a4f42e3b014e5e51265213a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:01.419780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6caf96f1-0348-4b10-8167-ae10938cc22d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8150e994a4f42e3b014e5e51265213a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:01.427888 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3502/6921] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:09:01 2021] DELETE /identity/v3/users/e8150e994a4f42e3b014e5e51265213a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:01.467311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd562c-02a0-4a5d-bc76-35840802cca2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:01.468284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd562c-02a0-4a5d-bc76-35840802cca2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:01.469292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd562c-02a0-4a5d-bc76-35840802cca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:01.490361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7cdd562c-02a0-4a5d-bc76-35840802cca2 None None] MFA Rules not processed for user `4de10fac4f814ac9a78d8f18ff231b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:01.491568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7cdd562c-02a0-4a5d-bc76-35840802cca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:01.547725 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3420/6922] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:01 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:01.591824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8df4da-fd4c-445f-bfb6-f5670d8337c2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:01.592122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8df4da-fd4c-445f-bfb6-f5670d8337c2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:01.592431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8df4da-fd4c-445f-bfb6-f5670d8337c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:01.608084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd562c-02a0-4a5d-bc76-35840802cca2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:01.609569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7cdd562c-02a0-4a5d-bc76-35840802cca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:01.614012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3b8df4da-fd4c-445f-bfb6-f5670d8337c2 None None] MFA Rules not processed for user `4de10fac4f814ac9a78d8f18ff231b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:01.615611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3b8df4da-fd4c-445f-bfb6-f5670d8337c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:01.626749 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3503/6923] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:01 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:01.649526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9d63-f02f-4787-9fea-7c4e5d337e4b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:01.650026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9d63-f02f-4787-9fea-7c4e5d337e4b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:01.650350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9d63-f02f-4787-9fea-7c4e5d337e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:01.668117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c86f9d63-f02f-4787-9fea-7c4e5d337e4b None None] MFA Rules not processed for user `4de10fac4f814ac9a78d8f18ff231b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:01.669377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c86f9d63-f02f-4787-9fea-7c4e5d337e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:01.680672 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3504/6924] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:01 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:01.687534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd562c-02a0-4a5d-bc76-35840802cca2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:01.697159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e6335-72d7-4861-88c5-09155e0d95cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:01.697159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e6335-72d7-4861-88c5-09155e0d95cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:01.697159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e6335-72d7-4861-88c5-09155e0d95cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:01.697159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e6335-72d7-4861-88c5-09155e0d95cd admin admin] PATH_INFO: `/v3/projects/c48b8b9635104eafab5295b3b8709c14` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:01.697553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e6335-72d7-4861-88c5-09155e0d95cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48b8b9635104eafab5295b3b8709c14)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:01.697553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e6335-72d7-4861-88c5-09155e0d95cd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:01.698882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f965ed-537a-4155-bf64-7f0a2009a0cf None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:01.699175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f965ed-537a-4155-bf64-7f0a2009a0cf None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:01.699510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f965ed-537a-4155-bf64-7f0a2009a0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:01.717400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-97f965ed-537a-4155-bf64-7f0a2009a0cf None None] MFA Rules not processed for user `4de10fac4f814ac9a78d8f18ff231b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:01.718563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-97f965ed-537a-4155-bf64-7f0a2009a0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:01.726295 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3505/6925] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:01 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:01.749718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c69e6335-72d7-4861-88c5-09155e0d95cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48b8b9635104eafab5295b3b8709c14', 'request_id': 'req-c69e6335-72d7-4861-88c5-09155e0d95cd'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:01.752381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d93ec-c33e-4a67-8d94-79541297b0b3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:01.752680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d93ec-c33e-4a67-8d94-79541297b0b3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:01.752962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d93ec-c33e-4a67-8d94-79541297b0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:01.756120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c69e6335-72d7-4861-88c5-09155e0d95cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48b8b9635104eafab5295b3b8709c14', 'request_id': 'req-c69e6335-72d7-4861-88c5-09155e0d95cd'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:01.761439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c69e6335-72d7-4861-88c5-09155e0d95cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48b8b9635104eafab5295b3b8709c14', 'request_id': 'req-c69e6335-72d7-4861-88c5-09155e0d95cd'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:01.770720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-972d93ec-c33e-4a67-8d94-79541297b0b3 None None] MFA Rules not processed for user `4de10fac4f814ac9a78d8f18ff231b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:01.771945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-972d93ec-c33e-4a67-8d94-79541297b0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:01.774733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c69e6335-72d7-4861-88c5-09155e0d95cd admin admin] The token cache is being invalidate because project c48b8b9635104eafab5295b3b8709c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:09:01.775260 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c69e6335-72d7-4861-88c5-09155e0d95cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:01.775903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c69e6335-72d7-4861-88c5-09155e0d95cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:01.777517 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3421/6926] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:09:01 2021] DELETE /identity/v3/projects/c48b8b9635104eafab5295b3b8709c14 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:01.782176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e6335-72d7-4861-88c5-09155e0d95cd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:01.783542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c69e6335-72d7-4861-88c5-09155e0d95cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:01.826562 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3506/6927] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:01 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:09:01.848696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e6335-72d7-4861-88c5-09155e0d95cd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:01.858723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd468564-8c85-4bf7-90ef-49a0c87a8fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:01.859500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd468564-8c85-4bf7-90ef-49a0c87a8fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:01.859783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd468564-8c85-4bf7-90ef-49a0c87a8fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:01.860059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd468564-8c85-4bf7-90ef-49a0c87a8fa7 admin admin] PATH_INFO: `/v3/users/0b99b11c3ec3437eb506b24e483e6957` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:01.861292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd468564-8c85-4bf7-90ef-49a0c87a8fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b99b11c3ec3437eb506b24e483e6957)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:01.863448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd468564-8c85-4bf7-90ef-49a0c87a8fa7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:01.933892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dd468564-8c85-4bf7-90ef-49a0c87a8fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b99b11c3ec3437eb506b24e483e6957'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:01.941584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dd468564-8c85-4bf7-90ef-49a0c87a8fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b99b11c3ec3437eb506b24e483e6957'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:01.955745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dd468564-8c85-4bf7-90ef-49a0c87a8fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b99b11c3ec3437eb506b24e483e6957'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:01.956944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dd468564-8c85-4bf7-90ef-49a0c87a8fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b99b11c3ec3437eb506b24e483e6957'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:01.977194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dd468564-8c85-4bf7-90ef-49a0c87a8fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b99b11c3ec3437eb506b24e483e6957'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:01.997571 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3422/6928] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:09:01 2021] DELETE /identity/v3/users/0b99b11c3ec3437eb506b24e483e6957 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:09:02.221021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d93ec-c33e-4a67-8d94-79541297b0b3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:02.232456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d93ec-c33e-4a67-8d94-79541297b0b3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:02.295819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad2675-b8e9-41b2-9442-f37f60fb6417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:02.296673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad2675-b8e9-41b2-9442-f37f60fb6417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:02.296953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad2675-b8e9-41b2-9442-f37f60fb6417 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:02.297228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad2675-b8e9-41b2-9442-f37f60fb6417 admin admin] PATH_INFO: `/v3/projects/8c7702c20e184901a92a1480029e7730` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:02.298477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad2675-b8e9-41b2-9442-f37f60fb6417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c7702c20e184901a92a1480029e7730)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:02.300432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad2675-b8e9-41b2-9442-f37f60fb6417 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:02.355737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a8ad2675-b8e9-41b2-9442-f37f60fb6417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c7702c20e184901a92a1480029e7730', 'request_id': 'req-a8ad2675-b8e9-41b2-9442-f37f60fb6417'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:02.362082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a8ad2675-b8e9-41b2-9442-f37f60fb6417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c7702c20e184901a92a1480029e7730', 'request_id': 'req-a8ad2675-b8e9-41b2-9442-f37f60fb6417'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:02.371100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a8ad2675-b8e9-41b2-9442-f37f60fb6417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c7702c20e184901a92a1480029e7730', 'request_id': 'req-a8ad2675-b8e9-41b2-9442-f37f60fb6417'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:02.384676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a8ad2675-b8e9-41b2-9442-f37f60fb6417 admin admin] The token cache is being invalidate because project 8c7702c20e184901a92a1480029e7730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:09:02.385510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a8ad2675-b8e9-41b2-9442-f37f60fb6417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:02.386497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a8ad2675-b8e9-41b2-9442-f37f60fb6417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:02.388349 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3507/6929] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:09:02 2021] DELETE /identity/v3/projects/8c7702c20e184901a92a1480029e7730 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:02.394053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d00ef5-06ed-4222-8c22-e0ebb242caf2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:02.394377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d00ef5-06ed-4222-8c22-e0ebb242caf2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:02.394660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d00ef5-06ed-4222-8c22-e0ebb242caf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:02.413610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c1d00ef5-06ed-4222-8c22-e0ebb242caf2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:02.415445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c1d00ef5-06ed-4222-8c22-e0ebb242caf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:02.483793 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3423/6930] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:02.491799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6e2ef-3145-47fc-9b06-4733da4123c7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:02.492148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6e2ef-3145-47fc-9b06-4733da4123c7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:02.492435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6e2ef-3145-47fc-9b06-4733da4123c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:02.513532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d8f6e2ef-3145-47fc-9b06-4733da4123c7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:02.515156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d8f6e2ef-3145-47fc-9b06-4733da4123c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:02.528081 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3508/6931] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:02.532565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d00ef5-06ed-4222-8c22-e0ebb242caf2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:02.542526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d00ef5-06ed-4222-8c22-e0ebb242caf2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:02.548622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf71679-a03c-4de4-a1c0-2f65af1a582b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:02.549752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf71679-a03c-4de4-a1c0-2f65af1a582b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:02.550084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf71679-a03c-4de4-a1c0-2f65af1a582b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:02.550528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf71679-a03c-4de4-a1c0-2f65af1a582b admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:02.551433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf71679-a03c-4de4-a1c0-2f65af1a582b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:09:02.552198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf71679-a03c-4de4-a1c0-2f65af1a582b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:02.554483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf71679-a03c-4de4-a1c0-2f65af1a582b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:02.570991 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3424/6932] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:09:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:09:02.576092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6e2ef-3145-47fc-9b06-4733da4123c7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:02.586460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6e2ef-3145-47fc-9b06-4733da4123c7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:02.593271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd717b-dd48-449e-b39b-4e142fac88ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:02.595051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd717b-dd48-449e-b39b-4e142fac88ba admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:02.596731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd717b-dd48-449e-b39b-4e142fac88ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:02.599345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd717b-dd48-449e-b39b-4e142fac88ba admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:02.600214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd717b-dd48-449e-b39b-4e142fac88ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:02.602428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd717b-dd48-449e-b39b-4e142fac88ba admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:02.631874 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3509/6933] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:09:02 2021] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:09:02.636612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf71679-a03c-4de4-a1c0-2f65af1a582b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:02.646957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf71679-a03c-4de4-a1c0-2f65af1a582b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:02.727456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399eb1c-7376-49ff-b6e8-14fedf900170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:02.731269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399eb1c-7376-49ff-b6e8-14fedf900170 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:02.734655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399eb1c-7376-49ff-b6e8-14fedf900170 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:02.734918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399eb1c-7376-49ff-b6e8-14fedf900170 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:02.735699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399eb1c-7376-49ff-b6e8-14fedf900170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:02.737692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399eb1c-7376-49ff-b6e8-14fedf900170 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:02.767559 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3425/6934] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:09:02 2021] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:09:02.771854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd717b-dd48-449e-b39b-4e142fac88ba admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:02.785344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd717b-dd48-449e-b39b-4e142fac88ba admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:02.795539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7171e28-21e9-4747-989a-be6ff6c30eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:02.796353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7171e28-21e9-4747-989a-be6ff6c30eeb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:02.796638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7171e28-21e9-4747-989a-be6ff6c30eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:02.796966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7171e28-21e9-4747-989a-be6ff6c30eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:02.797802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7171e28-21e9-4747-989a-be6ff6c30eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:02.799932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7171e28-21e9-4747-989a-be6ff6c30eeb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:02.814370 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3510/6935] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:02 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:09:02.818033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399eb1c-7376-49ff-b6e8-14fedf900170 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:02.830751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399eb1c-7376-49ff-b6e8-14fedf900170 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:02.842892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcac02-fdc6-44eb-9d70-2da93cb33611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:02.843641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcac02-fdc6-44eb-9d70-2da93cb33611 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:02.843935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcac02-fdc6-44eb-9d70-2da93cb33611 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:02.844216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcac02-fdc6-44eb-9d70-2da93cb33611 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:02.844962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcac02-fdc6-44eb-9d70-2da93cb33611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:02.846879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcac02-fdc6-44eb-9d70-2da93cb33611 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:02.861086 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3426/6936] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:02 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:09:02.862298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7171e28-21e9-4747-989a-be6ff6c30eeb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:02.876214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7171e28-21e9-4747-989a-be6ff6c30eeb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:02.883654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491f811-2cb9-4828-8620-3dee9122eefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:02.884821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491f811-2cb9-4828-8620-3dee9122eefb admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:02.885284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491f811-2cb9-4828-8620-3dee9122eefb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:02.885684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491f811-2cb9-4828-8620-3dee9122eefb admin admin] PATH_INFO: `/v3/projects/32d10bb7beb946509e177dc1af08150a/users/b1de2008a7f1422e82754ababeb2c20e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:02.923213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491f811-2cb9-4828-8620-3dee9122eefb admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d10bb7beb946509e177dc1af08150a, user_id=b1de2008a7f1422e82754ababeb2c20e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:02.927427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491f811-2cb9-4828-8620-3dee9122eefb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:02.959307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcac02-fdc6-44eb-9d70-2da93cb33611 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:02.961406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d8fcac02-fdc6-44eb-9d70-2da93cb33611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:02.969141 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3511/6937] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:09:02 2021] PUT /identity/v3/projects/32d10bb7beb946509e177dc1af08150a/users/b1de2008a7f1422e82754ababeb2c20e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:02.980833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c670cc-729e-412f-ab6e-f544870b51f7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:02.981344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c670cc-729e-412f-ab6e-f544870b51f7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:02.982415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c670cc-729e-412f-ab6e-f544870b51f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:02.986350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcac02-fdc6-44eb-9d70-2da93cb33611 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:03.012814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-78c670cc-729e-412f-ab6e-f544870b51f7 None None] MFA Rules not processed for user `b1de2008a7f1422e82754ababeb2c20e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:03.014526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-78c670cc-729e-412f-ab6e-f544870b51f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:03.053181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616797d0-2fad-4dda-bb49-c72adf7c4e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:03.055044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616797d0-2fad-4dda-bb49-c72adf7c4e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:03.055336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616797d0-2fad-4dda-bb49-c72adf7c4e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:03.055706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616797d0-2fad-4dda-bb49-c72adf7c4e2f admin admin] PATH_INFO: `/v3/users/d6278aefb6d5497aad3d74b47b2e95d9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:03.059256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616797d0-2fad-4dda-bb49-c72adf7c4e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6278aefb6d5497aad3d74b47b2e95d9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:03.061371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616797d0-2fad-4dda-bb49-c72adf7c4e2f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:03.097844 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3512/6938] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:02 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:03.115955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c670cc-729e-412f-ab6e-f544870b51f7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:03.117502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-78c670cc-729e-412f-ab6e-f544870b51f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:03.123069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-616797d0-2fad-4dda-bb49-c72adf7c4e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6278aefb6d5497aad3d74b47b2e95d9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:03.132336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-616797d0-2fad-4dda-bb49-c72adf7c4e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6278aefb6d5497aad3d74b47b2e95d9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:03.146563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-616797d0-2fad-4dda-bb49-c72adf7c4e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6278aefb6d5497aad3d74b47b2e95d9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:03.147398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-616797d0-2fad-4dda-bb49-c72adf7c4e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6278aefb6d5497aad3d74b47b2e95d9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:03.159231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-616797d0-2fad-4dda-bb49-c72adf7c4e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6278aefb6d5497aad3d74b47b2e95d9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:03.169362 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3427/6939] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:09:02 2021] DELETE /identity/v3/users/d6278aefb6d5497aad3d74b47b2e95d9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:09:03.211794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c670cc-729e-412f-ab6e-f544870b51f7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:03.275176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3742c-312d-4386-ba6c-be8e719e20a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:03.276206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3742c-312d-4386-ba6c-be8e719e20a5 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:03.277371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3742c-312d-4386-ba6c-be8e719e20a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:03.278044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3742c-312d-4386-ba6c-be8e719e20a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:03.280728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-03d3742c-312d-4386-ba6c-be8e719e20a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:03.374488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3742c-312d-4386-ba6c-be8e719e20a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:03.376317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3742c-312d-4386-ba6c-be8e719e20a5 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:03.389256 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3513/6940] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:03 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:09:03.414243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616797d0-2fad-4dda-bb49-c72adf7c4e2f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:03.419806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-616797d0-2fad-4dda-bb49-c72adf7c4e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:03.461261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3742c-312d-4386-ba6c-be8e719e20a5 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:03.464428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-03d3742c-312d-4386-ba6c-be8e719e20a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:03.584463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3742c-312d-4386-ba6c-be8e719e20a5 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:03.591814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ea96f-6a72-4612-98d7-1de97fc34140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:03.593395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ea96f-6a72-4612-98d7-1de97fc34140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:03.593395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ea96f-6a72-4612-98d7-1de97fc34140 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:03.593395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ea96f-6a72-4612-98d7-1de97fc34140 admin admin] PATH_INFO: `/v3/projects/ea26536b064a4650b9c08f4b5ce6fadf` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:03.594799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ea96f-6a72-4612-98d7-1de97fc34140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea26536b064a4650b9c08f4b5ce6fadf)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:03.596928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ea96f-6a72-4612-98d7-1de97fc34140 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:03.639543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616797d0-2fad-4dda-bb49-c72adf7c4e2f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:03.651318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee3453-4412-44c7-9a60-a289cb3071a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:03.653437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee3453-4412-44c7-9a60-a289cb3071a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:03.654194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee3453-4412-44c7-9a60-a289cb3071a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:03.655187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee3453-4412-44c7-9a60-a289cb3071a8 admin admin] PATH_INFO: `/v3/users/b1de2008a7f1422e82754ababeb2c20e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:03.656756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee3453-4412-44c7-9a60-a289cb3071a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1de2008a7f1422e82754ababeb2c20e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:03.659267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee3453-4412-44c7-9a60-a289cb3071a8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:03.679155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e8ea96f-6a72-4612-98d7-1de97fc34140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea26536b064a4650b9c08f4b5ce6fadf', 'request_id': 'req-3e8ea96f-6a72-4612-98d7-1de97fc34140'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:03.687675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e8ea96f-6a72-4612-98d7-1de97fc34140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea26536b064a4650b9c08f4b5ce6fadf', 'request_id': 'req-3e8ea96f-6a72-4612-98d7-1de97fc34140'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:03.700332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e8ea96f-6a72-4612-98d7-1de97fc34140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea26536b064a4650b9c08f4b5ce6fadf', 'request_id': 'req-3e8ea96f-6a72-4612-98d7-1de97fc34140'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:03.718440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e8ea96f-6a72-4612-98d7-1de97fc34140 admin admin] The token cache is being invalidate because project ea26536b064a4650b9c08f4b5ce6fadf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:09:03.718923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e8ea96f-6a72-4612-98d7-1de97fc34140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:03.719810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e8ea96f-6a72-4612-98d7-1de97fc34140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:03.726345 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3514/6941] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:09:03 2021] DELETE /identity/v3/projects/ea26536b064a4650b9c08f4b5ce6fadf => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:09:03.740139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90d6bb-4702-40e1-b726-56f2fbf2af2b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:03.740428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90d6bb-4702-40e1-b726-56f2fbf2af2b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:03.740770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90d6bb-4702-40e1-b726-56f2fbf2af2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:03.747688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-84ee3453-4412-44c7-9a60-a289cb3071a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1de2008a7f1422e82754ababeb2c20e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:03.767647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-84ee3453-4412-44c7-9a60-a289cb3071a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1de2008a7f1422e82754ababeb2c20e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:03.772438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-cd90d6bb-4702-40e1-b726-56f2fbf2af2b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:03.774193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cd90d6bb-4702-40e1-b726-56f2fbf2af2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:03.782590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-84ee3453-4412-44c7-9a60-a289cb3071a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1de2008a7f1422e82754ababeb2c20e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:03.783627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-84ee3453-4412-44c7-9a60-a289cb3071a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1de2008a7f1422e82754ababeb2c20e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:03.791734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-84ee3453-4412-44c7-9a60-a289cb3071a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1de2008a7f1422e82754ababeb2c20e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:03.801239 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3428/6942] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:09:03 2021] DELETE /identity/v3/users/b1de2008a7f1422e82754ababeb2c20e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:03.805806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66881d7e-b24a-4f65-85ef-7594c414e6a4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:03.806239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66881d7e-b24a-4f65-85ef-7594c414e6a4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:03.806984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66881d7e-b24a-4f65-85ef-7594c414e6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:03.838684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-66881d7e-b24a-4f65-85ef-7594c414e6a4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:03.840793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-66881d7e-b24a-4f65-85ef-7594c414e6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:03.860290 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3515/6943] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:03.869859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee12320-11ef-4571-beb7-8edce63ff792 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:03.871116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee12320-11ef-4571-beb7-8edce63ff792 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:03.871579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee12320-11ef-4571-beb7-8edce63ff792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:03.895310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-cee12320-11ef-4571-beb7-8edce63ff792 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:03.896677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cee12320-11ef-4571-beb7-8edce63ff792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:03.921633 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3429/6944] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:09:03.931223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66881d7e-b24a-4f65-85ef-7594c414e6a4 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:03.933635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-66881d7e-b24a-4f65-85ef-7594c414e6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:03.964557 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3516/6945] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:09:03.968920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee12320-11ef-4571-beb7-8edce63ff792 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:03.978731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee12320-11ef-4571-beb7-8edce63ff792 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:03.985303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b5958-32e4-4957-9f8b-671c19596a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:03.986229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b5958-32e4-4957-9f8b-671c19596a94 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:03.986651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b5958-32e4-4957-9f8b-671c19596a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:03.986996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b5958-32e4-4957-9f8b-671c19596a94 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:03.987814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b5958-32e4-4957-9f8b-671c19596a94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:09:03.988189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b5958-32e4-4957-9f8b-671c19596a94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:03.990122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b5958-32e4-4957-9f8b-671c19596a94 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:03.997770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66881d7e-b24a-4f65-85ef-7594c414e6a4 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:04.002389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e164886-6500-4a05-9ac2-36f2de7dc69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:04.003209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e164886-6500-4a05-9ac2-36f2de7dc69d service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:04.003845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e164886-6500-4a05-9ac2-36f2de7dc69d service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:04.003989 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3517/6946] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:09:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:09:04.004112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e164886-6500-4a05-9ac2-36f2de7dc69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:04.008193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b5958-32e4-4957-9f8b-671c19596a94 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:04.016184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e164886-6500-4a05-9ac2-36f2de7dc69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:04.017939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e164886-6500-4a05-9ac2-36f2de7dc69d service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:04.018140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b5958-32e4-4957-9f8b-671c19596a94 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:04.023345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdceb020-1a20-40e0-8448-6e36d6445585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:04.024325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdceb020-1a20-40e0-8448-6e36d6445585 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:04.024325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdceb020-1a20-40e0-8448-6e36d6445585 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:04.024563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdceb020-1a20-40e0-8448-6e36d6445585 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:04.025313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdceb020-1a20-40e0-8448-6e36d6445585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:04.027413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdceb020-1a20-40e0-8448-6e36d6445585 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:04.029558 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3430/6947] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:09:04.057278 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3518/6948] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:09:04 2021] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:09:04.061775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e164886-6500-4a05-9ac2-36f2de7dc69d service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:04.073999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e164886-6500-4a05-9ac2-36f2de7dc69d service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:04.204953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be0f0a-e5a5-4f4a-8e1e-3c66260a66d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:04.205828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be0f0a-e5a5-4f4a-8e1e-3c66260a66d7 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:04.210699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be0f0a-e5a5-4f4a-8e1e-3c66260a66d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:04.211280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be0f0a-e5a5-4f4a-8e1e-3c66260a66d7 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:04.212432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be0f0a-e5a5-4f4a-8e1e-3c66260a66d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:04.218054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be0f0a-e5a5-4f4a-8e1e-3c66260a66d7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:04.250401 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3431/6949] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:09:04 2021] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:09:04.254212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdceb020-1a20-40e0-8448-6e36d6445585 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:04.266650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdceb020-1a20-40e0-8448-6e36d6445585 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:04.282320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a785c-e099-4945-bfe5-1de4e87f1f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:04.282708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a785c-e099-4945-bfe5-1de4e87f1f40 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:04.282996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a785c-e099-4945-bfe5-1de4e87f1f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:04.283377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a785c-e099-4945-bfe5-1de4e87f1f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:04.284007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a785c-e099-4945-bfe5-1de4e87f1f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:04.285599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a785c-e099-4945-bfe5-1de4e87f1f40 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:04.297868 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3519/6950] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:04 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:09:04.302009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be0f0a-e5a5-4f4a-8e1e-3c66260a66d7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:04.312218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be0f0a-e5a5-4f4a-8e1e-3c66260a66d7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:04.318223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce594b7-ad75-47fb-bb2e-1c34c6b604cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:04.320683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce594b7-ad75-47fb-bb2e-1c34c6b604cb admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:04.321234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce594b7-ad75-47fb-bb2e-1c34c6b604cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:04.321682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce594b7-ad75-47fb-bb2e-1c34c6b604cb admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:04.322646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce594b7-ad75-47fb-bb2e-1c34c6b604cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:04.324712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce594b7-ad75-47fb-bb2e-1c34c6b604cb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:04.336040 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3432/6951] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:04 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:09:04.341305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a785c-e099-4945-bfe5-1de4e87f1f40 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:04.351845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a785c-e099-4945-bfe5-1de4e87f1f40 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:04.358037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e960f-1e53-49e4-a7cc-d52ef1b001b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:04.358988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e960f-1e53-49e4-a7cc-d52ef1b001b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:04.359272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e960f-1e53-49e4-a7cc-d52ef1b001b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:04.359553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e960f-1e53-49e4-a7cc-d52ef1b001b5 admin admin] PATH_INFO: `/v3/projects/e271aa0214324c64befe829bc16370dc/users/3c028617c574456abaa8204ff4ea027b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:04.382563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e960f-1e53-49e4-a7cc-d52ef1b001b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e271aa0214324c64befe829bc16370dc, user_id=3c028617c574456abaa8204ff4ea027b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:04.385978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e960f-1e53-49e4-a7cc-d52ef1b001b5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:04.418292 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3520/6952] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:09:04 2021] PUT /identity/v3/projects/e271aa0214324c64befe829bc16370dc/users/3c028617c574456abaa8204ff4ea027b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:04.421056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae012-83a1-497c-b18b-c0901c530008 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:04.421387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae012-83a1-497c-b18b-c0901c530008 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:04.421667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae012-83a1-497c-b18b-c0901c530008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:04.433311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e960f-1e53-49e4-a7cc-d52ef1b001b5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:04.435027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-019e960f-1e53-49e4-a7cc-d52ef1b001b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:04.447770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-349ae012-83a1-497c-b18b-c0901c530008 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:04.449518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-349ae012-83a1-497c-b18b-c0901c530008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:04.528628 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3433/6953] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:04.538335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ae012-83a1-497c-b18b-c0901c530008 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:04.566309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e960f-1e53-49e4-a7cc-d52ef1b001b5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:04.574397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b448a7-64ae-479d-9b1d-0f9cf164fbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:04.574913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b448a7-64ae-479d-9b1d-0f9cf164fbc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:04.575273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b448a7-64ae-479d-9b1d-0f9cf164fbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:04.575623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b448a7-64ae-479d-9b1d-0f9cf164fbc5 admin admin] PATH_INFO: `/v3/projects/32d10bb7beb946509e177dc1af08150a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:04.577196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b448a7-64ae-479d-9b1d-0f9cf164fbc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d10bb7beb946509e177dc1af08150a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:04.579487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b448a7-64ae-479d-9b1d-0f9cf164fbc5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:04.628064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ae012-83a1-497c-b18b-c0901c530008 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:04.634945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5efd35-f8da-418e-ab3d-32b8766326be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:04.636456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5efd35-f8da-418e-ab3d-32b8766326be service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:04.637132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5efd35-f8da-418e-ab3d-32b8766326be service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:04.637590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5efd35-f8da-418e-ab3d-32b8766326be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:04.648391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-79b448a7-64ae-479d-9b1d-0f9cf164fbc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d10bb7beb946509e177dc1af08150a', 'request_id': 'req-79b448a7-64ae-479d-9b1d-0f9cf164fbc5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:04.648759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5efd35-f8da-418e-ab3d-32b8766326be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:04.650189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5efd35-f8da-418e-ab3d-32b8766326be service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:04.656033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-79b448a7-64ae-479d-9b1d-0f9cf164fbc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d10bb7beb946509e177dc1af08150a', 'request_id': 'req-79b448a7-64ae-479d-9b1d-0f9cf164fbc5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:04.667928 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3434/6954] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:09:04.669898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-79b448a7-64ae-479d-9b1d-0f9cf164fbc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d10bb7beb946509e177dc1af08150a', 'request_id': 'req-79b448a7-64ae-479d-9b1d-0f9cf164fbc5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:04.684557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-79b448a7-64ae-479d-9b1d-0f9cf164fbc5 admin admin] The token cache is being invalidate because project 32d10bb7beb946509e177dc1af08150a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:09:04.684868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-79b448a7-64ae-479d-9b1d-0f9cf164fbc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:04.686792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-79b448a7-64ae-479d-9b1d-0f9cf164fbc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:04.694048 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3521/6955] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:09:04 2021] DELETE /identity/v3/projects/32d10bb7beb946509e177dc1af08150a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:04.695713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc4ac7-9c03-4442-bec4-49c250ffaa21 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:04.696010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc4ac7-9c03-4442-bec4-49c250ffaa21 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:04.696295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc4ac7-9c03-4442-bec4-49c250ffaa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:04.741083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0ccc4ac7-9c03-4442-bec4-49c250ffaa21 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:04.742657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0ccc4ac7-9c03-4442-bec4-49c250ffaa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:04.838009 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3435/6956] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:09:04.847569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af273d-76ab-473e-a46a-107eff260450 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:04.847922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af273d-76ab-473e-a46a-107eff260450 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:04.848437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af273d-76ab-473e-a46a-107eff260450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:04.874524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-94af273d-76ab-473e-a46a-107eff260450 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:04.875756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-94af273d-76ab-473e-a46a-107eff260450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:04.893914 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3522/6957] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:04.898055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc4ac7-9c03-4442-bec4-49c250ffaa21 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:04.909818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc4ac7-9c03-4442-bec4-49c250ffaa21 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:04.915224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a13d68-d1ab-4b99-8eef-9e3dd5202f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:04.915964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a13d68-d1ab-4b99-8eef-9e3dd5202f42 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:04.916313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a13d68-d1ab-4b99-8eef-9e3dd5202f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:04.916657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a13d68-d1ab-4b99-8eef-9e3dd5202f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:04.917530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a13d68-d1ab-4b99-8eef-9e3dd5202f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:09:04.917840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a13d68-d1ab-4b99-8eef-9e3dd5202f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:04.919610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a13d68-d1ab-4b99-8eef-9e3dd5202f42 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:04.932100 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3436/6958] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:09:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:09:04.937662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af273d-76ab-473e-a46a-107eff260450 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:04.947982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af273d-76ab-473e-a46a-107eff260450 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:04.953444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b21cf2-1f55-415e-ac2b-8aa88938d6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:04.954117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b21cf2-1f55-415e-ac2b-8aa88938d6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:04.954432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b21cf2-1f55-415e-ac2b-8aa88938d6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:04.954707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b21cf2-1f55-415e-ac2b-8aa88938d6c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:04.955743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b21cf2-1f55-415e-ac2b-8aa88938d6c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:04.957678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b21cf2-1f55-415e-ac2b-8aa88938d6c8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:04.996220 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3523/6959] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:09:04 2021] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:09:05.000680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a13d68-d1ab-4b99-8eef-9e3dd5202f42 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:05.016549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a13d68-d1ab-4b99-8eef-9e3dd5202f42 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:05.102938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116960e-9e80-45a1-a5f3-9812e124e60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:05.103663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116960e-9e80-45a1-a5f3-9812e124e60a admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:05.103897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116960e-9e80-45a1-a5f3-9812e124e60a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:05.104207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116960e-9e80-45a1-a5f3-9812e124e60a admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:05.105126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116960e-9e80-45a1-a5f3-9812e124e60a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:05.110225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116960e-9e80-45a1-a5f3-9812e124e60a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:05.154895 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3437/6960] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:09:04 2021] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:09:05.159584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b21cf2-1f55-415e-ac2b-8aa88938d6c8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:05.177830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b21cf2-1f55-415e-ac2b-8aa88938d6c8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:05.186577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2bf9a-9177-436d-bd4d-1b07d273c4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:05.187702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2bf9a-9177-436d-bd4d-1b07d273c4de admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:05.187995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2bf9a-9177-436d-bd4d-1b07d273c4de admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:05.188311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2bf9a-9177-436d-bd4d-1b07d273c4de admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:05.189500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2bf9a-9177-436d-bd4d-1b07d273c4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:05.191882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2bf9a-9177-436d-bd4d-1b07d273c4de admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:05.214153 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3524/6961] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:05 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:09:05.216853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116960e-9e80-45a1-a5f3-9812e124e60a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:05.230585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116960e-9e80-45a1-a5f3-9812e124e60a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:05.237175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfad5a-9daf-4c69-87a7-1be831f0a269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:05.239947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfad5a-9daf-4c69-87a7-1be831f0a269 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:05.240495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfad5a-9daf-4c69-87a7-1be831f0a269 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:05.241006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfad5a-9daf-4c69-87a7-1be831f0a269 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:05.242221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfad5a-9daf-4c69-87a7-1be831f0a269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:05.244049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfad5a-9daf-4c69-87a7-1be831f0a269 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:05.256922 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3438/6962] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:05 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:09:05.261327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2bf9a-9177-436d-bd4d-1b07d273c4de admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:05.274454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2bf9a-9177-436d-bd4d-1b07d273c4de admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:05.279934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5786b9-48a5-4fb9-9d0f-78e6f22d2428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:05.280955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5786b9-48a5-4fb9-9d0f-78e6f22d2428 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:05.281258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5786b9-48a5-4fb9-9d0f-78e6f22d2428 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:05.281529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5786b9-48a5-4fb9-9d0f-78e6f22d2428 admin admin] PATH_INFO: `/v3/projects/e2128a151c944e66bc3b9d6bc11b3c10/users/15458d34364442e4891c1bc48d71196b/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:05.301798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5786b9-48a5-4fb9-9d0f-78e6f22d2428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2128a151c944e66bc3b9d6bc11b3c10, user_id=15458d34364442e4891c1bc48d71196b, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:05.304946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5786b9-48a5-4fb9-9d0f-78e6f22d2428 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:05.330881 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3525/6963] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:09:05 2021] PUT /identity/v3/projects/e2128a151c944e66bc3b9d6bc11b3c10/users/15458d34364442e4891c1bc48d71196b/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:05.342187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f2b4d-6b8b-4b6e-90f7-54eb14b8a0c0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:05.342187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f2b4d-6b8b-4b6e-90f7-54eb14b8a0c0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:05.342187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f2b4d-6b8b-4b6e-90f7-54eb14b8a0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:05.405578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f03f2b4d-6b8b-4b6e-90f7-54eb14b8a0c0 None None] MFA Rules not processed for user `15458d34364442e4891c1bc48d71196b`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:05.407255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f03f2b4d-6b8b-4b6e-90f7-54eb14b8a0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:05.462294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e880f5-14e7-4cad-b6da-7c3a94328caa None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:05.462761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e880f5-14e7-4cad-b6da-7c3a94328caa None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:05.462862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e880f5-14e7-4cad-b6da-7c3a94328caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:05.492546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-67e880f5-14e7-4cad-b6da-7c3a94328caa None None] MFA Rules not processed for user `3c028617c574456abaa8204ff4ea027b`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:05.493750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-67e880f5-14e7-4cad-b6da-7c3a94328caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:05.506212 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3439/6964] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:05 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:09:05.522520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f2b4d-6b8b-4b6e-90f7-54eb14b8a0c0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:05.524383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f03f2b4d-6b8b-4b6e-90f7-54eb14b8a0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:05.594325 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3526/6965] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:05 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:05.595059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f2b4d-6b8b-4b6e-90f7-54eb14b8a0c0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:05.602475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ea7a9-2542-4726-9554-a0166c4db00a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:05.603802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ea7a9-2542-4726-9554-a0166c4db00a service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:05.604437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ea7a9-2542-4726-9554-a0166c4db00a service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:05.605428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ea7a9-2542-4726-9554-a0166c4db00a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:05.616545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ea7a9-2542-4726-9554-a0166c4db00a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:05.619344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ea7a9-2542-4726-9554-a0166c4db00a service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:05.629877 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3440/6966] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:05 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:09:06.420256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e880f5-14e7-4cad-b6da-7c3a94328caa None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:06.422069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-67e880f5-14e7-4cad-b6da-7c3a94328caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:06.506964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e880f5-14e7-4cad-b6da-7c3a94328caa None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:06.514738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324e49e-e057-4818-b367-29cbd9e8c100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:06.515768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324e49e-e057-4818-b367-29cbd9e8c100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:06.516298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324e49e-e057-4818-b367-29cbd9e8c100 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:06.516847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324e49e-e057-4818-b367-29cbd9e8c100 admin admin] PATH_INFO: `/v3/users/3c028617c574456abaa8204ff4ea027b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:06.518234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324e49e-e057-4818-b367-29cbd9e8c100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c028617c574456abaa8204ff4ea027b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:06.520616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324e49e-e057-4818-b367-29cbd9e8c100 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:06.574042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6324e49e-e057-4818-b367-29cbd9e8c100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c028617c574456abaa8204ff4ea027b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:06.580895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6324e49e-e057-4818-b367-29cbd9e8c100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c028617c574456abaa8204ff4ea027b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:06.581621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6324e49e-e057-4818-b367-29cbd9e8c100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c028617c574456abaa8204ff4ea027b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:06.594304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6324e49e-e057-4818-b367-29cbd9e8c100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c028617c574456abaa8204ff4ea027b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:06.601873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6324e49e-e057-4818-b367-29cbd9e8c100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c028617c574456abaa8204ff4ea027b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:06.608102 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3527/6967] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:09:06 2021] DELETE /identity/v3/users/3c028617c574456abaa8204ff4ea027b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:06.662605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ea7a9-2542-4726-9554-a0166c4db00a service cinder] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:06.664772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a11ea7a9-2542-4726-9554-a0166c4db00a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:06.683414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ea7a9-2542-4726-9554-a0166c4db00a service cinder] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:06.742936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b224d1f-d705-413f-8102-37c8987bb51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:06.743809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b224d1f-d705-413f-8102-37c8987bb51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:06.744094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b224d1f-d705-413f-8102-37c8987bb51b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:06.744372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b224d1f-d705-413f-8102-37c8987bb51b admin admin] PATH_INFO: `/v3/users/4de10fac4f814ac9a78d8f18ff231b7c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:06.746240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b224d1f-d705-413f-8102-37c8987bb51b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de10fac4f814ac9a78d8f18ff231b7c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:06.748163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b224d1f-d705-413f-8102-37c8987bb51b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:06.787423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324e49e-e057-4818-b367-29cbd9e8c100 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:06.788938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6324e49e-e057-4818-b367-29cbd9e8c100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:06.799257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1b224d1f-d705-413f-8102-37c8987bb51b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de10fac4f814ac9a78d8f18ff231b7c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:06.803940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324e49e-e057-4818-b367-29cbd9e8c100 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:06.806549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1b224d1f-d705-413f-8102-37c8987bb51b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de10fac4f814ac9a78d8f18ff231b7c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:06.809700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869b207-6730-45a7-973e-c1d5ced10769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:06.810595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869b207-6730-45a7-973e-c1d5ced10769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:06.810879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869b207-6730-45a7-973e-c1d5ced10769 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:06.811195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869b207-6730-45a7-973e-c1d5ced10769 admin admin] PATH_INFO: `/v3/projects/e271aa0214324c64befe829bc16370dc` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:06.819049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869b207-6730-45a7-973e-c1d5ced10769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e271aa0214324c64befe829bc16370dc)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:06.819588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1b224d1f-d705-413f-8102-37c8987bb51b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de10fac4f814ac9a78d8f18ff231b7c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:06.820303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1b224d1f-d705-413f-8102-37c8987bb51b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de10fac4f814ac9a78d8f18ff231b7c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:06.821225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869b207-6730-45a7-973e-c1d5ced10769 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:06.827737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1b224d1f-d705-413f-8102-37c8987bb51b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de10fac4f814ac9a78d8f18ff231b7c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:06.834141 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3441/6968] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:09:06 2021] DELETE /identity/v3/users/4de10fac4f814ac9a78d8f18ff231b7c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:06.870866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4869b207-6730-45a7-973e-c1d5ced10769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e271aa0214324c64befe829bc16370dc', 'request_id': 'req-4869b207-6730-45a7-973e-c1d5ced10769'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:06.876841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4869b207-6730-45a7-973e-c1d5ced10769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e271aa0214324c64befe829bc16370dc', 'request_id': 'req-4869b207-6730-45a7-973e-c1d5ced10769'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:06.884466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4869b207-6730-45a7-973e-c1d5ced10769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e271aa0214324c64befe829bc16370dc', 'request_id': 'req-4869b207-6730-45a7-973e-c1d5ced10769'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:06.896285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4869b207-6730-45a7-973e-c1d5ced10769 admin admin] The token cache is being invalidate because project e271aa0214324c64befe829bc16370dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:09:06.896578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4869b207-6730-45a7-973e-c1d5ced10769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:06.897226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4869b207-6730-45a7-973e-c1d5ced10769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:06.899063 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3528/6969] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:09:06 2021] DELETE /identity/v3/projects/e271aa0214324c64befe829bc16370dc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:06.905928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb0814-15df-4649-b51b-0128657eb093 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:06.906222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb0814-15df-4649-b51b-0128657eb093 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:06.906864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb0814-15df-4649-b51b-0128657eb093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:06.925113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e7fb0814-15df-4649-b51b-0128657eb093 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:06.926335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e7fb0814-15df-4649-b51b-0128657eb093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:07.008843 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3442/6970] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:07.014877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869b207-6730-45a7-973e-c1d5ced10769 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:07.016413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64e6c6-c88f-4e7f-bae7-3aeda076c675 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.016532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4869b207-6730-45a7-973e-c1d5ced10769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:07.016696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64e6c6-c88f-4e7f-bae7-3aeda076c675 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.016981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64e6c6-c88f-4e7f-bae7-3aeda076c675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.033604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869b207-6730-45a7-973e-c1d5ced10769 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:07.035667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ce64e6c6-c88f-4e7f-bae7-3aeda076c675 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:07.037499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ce64e6c6-c88f-4e7f-bae7-3aeda076c675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:07.039878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2f210-b2bd-4be6-ba3a-6cfa57bf1956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:07.040816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2f210-b2bd-4be6-ba3a-6cfa57bf1956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.041189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2f210-b2bd-4be6-ba3a-6cfa57bf1956 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.041621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2f210-b2bd-4be6-ba3a-6cfa57bf1956 admin admin] PATH_INFO: `/v3/projects/88b33c528aa7484e8069e68727cd6e27` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.043409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2f210-b2bd-4be6-ba3a-6cfa57bf1956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b33c528aa7484e8069e68727cd6e27)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:07.045385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2f210-b2bd-4be6-ba3a-6cfa57bf1956 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:07.049752 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3443/6971] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:09:07.053168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64e6c6-c88f-4e7f-bae7-3aeda076c675 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:07.062862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64e6c6-c88f-4e7f-bae7-3aeda076c675 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:07.068192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76d34a-81e1-464d-addf-e5c7e8ce5408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:07.068819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76d34a-81e1-464d-addf-e5c7e8ce5408 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.069088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76d34a-81e1-464d-addf-e5c7e8ce5408 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.069369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76d34a-81e1-464d-addf-e5c7e8ce5408 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.070107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76d34a-81e1-464d-addf-e5c7e8ce5408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:09:07.070472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76d34a-81e1-464d-addf-e5c7e8ce5408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:07.072092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76d34a-81e1-464d-addf-e5c7e8ce5408 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:07.087615 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3444/6972] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:09:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:09:07.089860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76d34a-81e1-464d-addf-e5c7e8ce5408 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:07.100011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76d34a-81e1-464d-addf-e5c7e8ce5408 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:07.102394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3d2f210-b2bd-4be6-ba3a-6cfa57bf1956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b33c528aa7484e8069e68727cd6e27', 'request_id': 'req-d3d2f210-b2bd-4be6-ba3a-6cfa57bf1956'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:07.110074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3d2f210-b2bd-4be6-ba3a-6cfa57bf1956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b33c528aa7484e8069e68727cd6e27', 'request_id': 'req-d3d2f210-b2bd-4be6-ba3a-6cfa57bf1956'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:07.119590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3d2f210-b2bd-4be6-ba3a-6cfa57bf1956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b33c528aa7484e8069e68727cd6e27', 'request_id': 'req-d3d2f210-b2bd-4be6-ba3a-6cfa57bf1956'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:07.130894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3d2f210-b2bd-4be6-ba3a-6cfa57bf1956 admin admin] The token cache is being invalidate because project 88b33c528aa7484e8069e68727cd6e27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:09:07.131180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3d2f210-b2bd-4be6-ba3a-6cfa57bf1956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:07.142743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3d2f210-b2bd-4be6-ba3a-6cfa57bf1956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:07.148595 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3529/6973] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:09:07 2021] DELETE /identity/v3/projects/88b33c528aa7484e8069e68727cd6e27 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:07.160203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9d29d-2358-48e3-b691-5f0fd9155eb4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.160600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9d29d-2358-48e3-b691-5f0fd9155eb4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.161280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9d29d-2358-48e3-b691-5f0fd9155eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.193467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5af9d29d-2358-48e3-b691-5f0fd9155eb4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:07.195016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5af9d29d-2358-48e3-b691-5f0fd9155eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:07.204871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40441d-df80-4a14-9b22-940dbb7e5426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:07.205740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40441d-df80-4a14-9b22-940dbb7e5426 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.206038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40441d-df80-4a14-9b22-940dbb7e5426 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.206702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40441d-df80-4a14-9b22-940dbb7e5426 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.207069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40441d-df80-4a14-9b22-940dbb7e5426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:07.209272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40441d-df80-4a14-9b22-940dbb7e5426 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:07.244392 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3445/6974] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:09:07 2021] POST /identity/v3/projects => generated 401 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:09:07.249108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40441d-df80-4a14-9b22-940dbb7e5426 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:07.251651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3f40441d-df80-4a14-9b22-940dbb7e5426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:07.275690 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3530/6975] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:07.286512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d222d-0a08-477d-af8e-02e8a3a45ce5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.287390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d222d-0a08-477d-af8e-02e8a3a45ce5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.287685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d222d-0a08-477d-af8e-02e8a3a45ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.315242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a87d222d-0a08-477d-af8e-02e8a3a45ce5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:07.316476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a87d222d-0a08-477d-af8e-02e8a3a45ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:07.364941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40441d-df80-4a14-9b22-940dbb7e5426 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:07.372178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef5bde-4860-4703-973c-7ad4addea99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:07.374009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef5bde-4860-4703-973c-7ad4addea99b admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.374562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef5bde-4860-4703-973c-7ad4addea99b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.375000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef5bde-4860-4703-973c-7ad4addea99b admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.376005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef5bde-4860-4703-973c-7ad4addea99b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:07.378713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef5bde-4860-4703-973c-7ad4addea99b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:07.409621 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3446/6976] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:09:07 2021] POST /identity/v3/users => generated 301 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:09:07.414953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef5bde-4860-4703-973c-7ad4addea99b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:07.419731 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3531/6977] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:07.424051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d222d-0a08-477d-af8e-02e8a3a45ce5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:07.433464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef5bde-4860-4703-973c-7ad4addea99b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:07.435848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d222d-0a08-477d-af8e-02e8a3a45ce5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:07.439148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08d578-46ed-4435-996f-af572e8e6f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:07.439828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08d578-46ed-4435-996f-af572e8e6f13 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.440117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08d578-46ed-4435-996f-af572e8e6f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.440403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08d578-46ed-4435-996f-af572e8e6f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.440606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2a4bf-cf0e-4140-b035-c2882f698102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:07.441143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08d578-46ed-4435-996f-af572e8e6f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:07.441263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2a4bf-cf0e-4140-b035-c2882f698102 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.441528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2a4bf-cf0e-4140-b035-c2882f698102 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.441806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2a4bf-cf0e-4140-b035-c2882f698102 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.442986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2a4bf-cf0e-4140-b035-c2882f698102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:09:07.443108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08d578-46ed-4435-996f-af572e8e6f13 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:07.443297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2a4bf-cf0e-4140-b035-c2882f698102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:07.444884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2a4bf-cf0e-4140-b035-c2882f698102 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:07.460119 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3447/6978] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:07 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:09:07.460291 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3532/6979] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:09:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:09:07.464801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08d578-46ed-4435-996f-af572e8e6f13 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:07.465713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2a4bf-cf0e-4140-b035-c2882f698102 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:07.479032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08d578-46ed-4435-996f-af572e8e6f13 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:07.481596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2a4bf-cf0e-4140-b035-c2882f698102 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:07.487169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c97f9-6d5e-42b3-9e5d-9987c6231f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:07.487852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c97f9-6d5e-42b3-9e5d-9987c6231f38 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.488142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c97f9-6d5e-42b3-9e5d-9987c6231f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.488427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c97f9-6d5e-42b3-9e5d-9987c6231f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.489204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c97f9-6d5e-42b3-9e5d-9987c6231f38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:07.492377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c97f9-6d5e-42b3-9e5d-9987c6231f38 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:07.492954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd11000-b052-417f-bb34-b0e41712af45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:07.493682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd11000-b052-417f-bb34-b0e41712af45 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.493989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd11000-b052-417f-bb34-b0e41712af45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.494316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd11000-b052-417f-bb34-b0e41712af45 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.495104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd11000-b052-417f-bb34-b0e41712af45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:07.497876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd11000-b052-417f-bb34-b0e41712af45 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:07.510169 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3448/6980] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:07 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:09:07.519321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd11000-b052-417f-bb34-b0e41712af45 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:07.528989 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3533/6981] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:09:07 2021] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:09:07.532780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c97f9-6d5e-42b3-9e5d-9987c6231f38 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:07.533419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd11000-b052-417f-bb34-b0e41712af45 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:07.615075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68ea33-4e92-41a0-af71-45e0597d1d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:07.615986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68ea33-4e92-41a0-af71-45e0597d1d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.616264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68ea33-4e92-41a0-af71-45e0597d1d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.616544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68ea33-4e92-41a0-af71-45e0597d1d5a admin admin] PATH_INFO: `/v3/projects/362302cd06fc42e6950c07b8682ea8b5/users/ca76b11593b8431bb9fb94d73734b71c/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.620839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c97f9-6d5e-42b3-9e5d-9987c6231f38 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:07.625883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dde82b-4255-4894-b1e6-0363b4b6fa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:07.626733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dde82b-4255-4894-b1e6-0363b4b6fa61 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.627014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dde82b-4255-4894-b1e6-0363b4b6fa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.627292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dde82b-4255-4894-b1e6-0363b4b6fa61 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.628014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dde82b-4255-4894-b1e6-0363b4b6fa61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:07.630509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dde82b-4255-4894-b1e6-0363b4b6fa61 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:07.642388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68ea33-4e92-41a0-af71-45e0597d1d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=362302cd06fc42e6950c07b8682ea8b5, user_id=ca76b11593b8431bb9fb94d73734b71c, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:07.645559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68ea33-4e92-41a0-af71-45e0597d1d5a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:07.658403 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3534/6982] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:09:07 2021] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:09:07.662772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dde82b-4255-4894-b1e6-0363b4b6fa61 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:07.665694 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3449/6983] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:09:07 2021] PUT /identity/v3/projects/362302cd06fc42e6950c07b8682ea8b5/users/ca76b11593b8431bb9fb94d73734b71c/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:07.673677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dde82b-4255-4894-b1e6-0363b4b6fa61 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:07.677393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514380f8-b801-41b7-98c0-9b30f6ebc75f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.678017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514380f8-b801-41b7-98c0-9b30f6ebc75f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.678354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514380f8-b801-41b7-98c0-9b30f6ebc75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.715252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-514380f8-b801-41b7-98c0-9b30f6ebc75f None None] MFA Rules not processed for user `ca76b11593b8431bb9fb94d73734b71c`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:07.717239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-514380f8-b801-41b7-98c0-9b30f6ebc75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:07.739656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8ef78-71c3-43b1-847e-28a4d2b2122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:07.740732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8ef78-71c3-43b1-847e-28a4d2b2122b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.741023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8ef78-71c3-43b1-847e-28a4d2b2122b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.741305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8ef78-71c3-43b1-847e-28a4d2b2122b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.743614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8ef78-71c3-43b1-847e-28a4d2b2122b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:07.745310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8ef78-71c3-43b1-847e-28a4d2b2122b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:07.756752 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3535/6984] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:07 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:09:07.760542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8ef78-71c3-43b1-847e-28a4d2b2122b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:07.771867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8ef78-71c3-43b1-847e-28a4d2b2122b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:07.781846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38abdca-9c26-49a5-bf20-e15f739907f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:07.782587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38abdca-9c26-49a5-bf20-e15f739907f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.782869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38abdca-9c26-49a5-bf20-e15f739907f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.783147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38abdca-9c26-49a5-bf20-e15f739907f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.783883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38abdca-9c26-49a5-bf20-e15f739907f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:07.785495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38abdca-9c26-49a5-bf20-e15f739907f8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:07.796156 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3536/6985] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:07 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:09:07.800468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38abdca-9c26-49a5-bf20-e15f739907f8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:07.808846 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3450/6986] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:07 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:09:07.812955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38abdca-9c26-49a5-bf20-e15f739907f8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:07.819560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8faa112-5ef6-43a6-8cda-b4256969bcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:07.820855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faa112-5ef6-43a6-8cda-b4256969bcc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.821026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faa112-5ef6-43a6-8cda-b4256969bcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.821310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faa112-5ef6-43a6-8cda-b4256969bcc6 admin admin] PATH_INFO: `/v3/projects/0115052ed7dd4b60b9c729f1daa095c2/users/a3e6bef41b9948099215b02cdca829bf/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.821859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514380f8-b801-41b7-98c0-9b30f6ebc75f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:07.834080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514380f8-b801-41b7-98c0-9b30f6ebc75f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:07.840782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8faa112-5ef6-43a6-8cda-b4256969bcc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0115052ed7dd4b60b9c729f1daa095c2, user_id=a3e6bef41b9948099215b02cdca829bf, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:07.843919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8faa112-5ef6-43a6-8cda-b4256969bcc6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:07.845937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5f786-e3ad-4f03-9c35-f3dd5a46c4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:07.847508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5f786-e3ad-4f03-9c35-f3dd5a46c4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.847996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5f786-e3ad-4f03-9c35-f3dd5a46c4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.848475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5f786-e3ad-4f03-9c35-f3dd5a46c4e0 admin admin] PATH_INFO: `/v3/users/ca76b11593b8431bb9fb94d73734b71c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.849854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5f786-e3ad-4f03-9c35-f3dd5a46c4e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca76b11593b8431bb9fb94d73734b71c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:07.851948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5f786-e3ad-4f03-9c35-f3dd5a46c4e0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:07.860091 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3537/6987] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:09:07 2021] PUT /identity/v3/projects/0115052ed7dd4b60b9c729f1daa095c2/users/a3e6bef41b9948099215b02cdca829bf/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:09:07.865375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca64cac-fb13-429b-9740-52fade4ed10e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.865650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca64cac-fb13-429b-9740-52fade4ed10e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.865948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca64cac-fb13-429b-9740-52fade4ed10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.884144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4ca64cac-fb13-429b-9740-52fade4ed10e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:07.885452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4ca64cac-fb13-429b-9740-52fade4ed10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:07.912608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e1d5f786-e3ad-4f03-9c35-f3dd5a46c4e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca76b11593b8431bb9fb94d73734b71c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:07.922973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e1d5f786-e3ad-4f03-9c35-f3dd5a46c4e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca76b11593b8431bb9fb94d73734b71c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:07.947671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e1d5f786-e3ad-4f03-9c35-f3dd5a46c4e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca76b11593b8431bb9fb94d73734b71c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:07.949285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e1d5f786-e3ad-4f03-9c35-f3dd5a46c4e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca76b11593b8431bb9fb94d73734b71c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:07.955607 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3538/6988] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:09:07.962002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e1d5f786-e3ad-4f03-9c35-f3dd5a46c4e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca76b11593b8431bb9fb94d73734b71c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:07.971481 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3451/6989] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:09:07 2021] DELETE /identity/v3/users/ca76b11593b8431bb9fb94d73734b71c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:07.975459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca64cac-fb13-429b-9740-52fade4ed10e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:07.977295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8fcca-47fa-4bb8-8824-6b468cb8d93f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:07.977590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8fcca-47fa-4bb8-8824-6b468cb8d93f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:07.977872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8fcca-47fa-4bb8-8824-6b468cb8d93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:07.988082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4ca64cac-fb13-429b-9740-52fade4ed10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:08.016232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b9f8fcca-47fa-4bb8-8824-6b468cb8d93f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:08.017601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b9f8fcca-47fa-4bb8-8824-6b468cb8d93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:08.094565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca64cac-fb13-429b-9740-52fade4ed10e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:08.122634 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3452/6990] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:08.150316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8fcca-47fa-4bb8-8824-6b468cb8d93f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:08.153681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b9f8fcca-47fa-4bb8-8824-6b468cb8d93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:08.185998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e26821-78a9-4009-b7cd-aaa062a31050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:08.187393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e26821-78a9-4009-b7cd-aaa062a31050 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:08.187393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e26821-78a9-4009-b7cd-aaa062a31050 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:08.187907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e26821-78a9-4009-b7cd-aaa062a31050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:08.191325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-28e26821-78a9-4009-b7cd-aaa062a31050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:08.219576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e26821-78a9-4009-b7cd-aaa062a31050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:08.221256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e26821-78a9-4009-b7cd-aaa062a31050 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:08.237269 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3539/6991] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:09:08.318232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8fcca-47fa-4bb8-8824-6b468cb8d93f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:08.322693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ca992-bdcd-49e1-b283-567a87f2a6d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:08.323873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ca992-bdcd-49e1-b283-567a87f2a6d6 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:08.324162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ca992-bdcd-49e1-b283-567a87f2a6d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:08.324435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ca992-bdcd-49e1-b283-567a87f2a6d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:08.335775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ca992-bdcd-49e1-b283-567a87f2a6d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:08.337236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ca992-bdcd-49e1-b283-567a87f2a6d6 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:08.377202 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3453/6992] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:09:08.871180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e26821-78a9-4009-b7cd-aaa062a31050 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:08.873082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-28e26821-78a9-4009-b7cd-aaa062a31050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:08.893534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e26821-78a9-4009-b7cd-aaa062a31050 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:08.902380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc57729-f6aa-407f-9e94-5ae69825e544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:08.903840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57729-f6aa-407f-9e94-5ae69825e544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:08.904186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57729-f6aa-407f-9e94-5ae69825e544 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:08.904544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57729-f6aa-407f-9e94-5ae69825e544 admin admin] PATH_INFO: `/v3/projects/362302cd06fc42e6950c07b8682ea8b5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:08.906152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc57729-f6aa-407f-9e94-5ae69825e544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=362302cd06fc42e6950c07b8682ea8b5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:08.908172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc57729-f6aa-407f-9e94-5ae69825e544 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:08.967754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5dc57729-f6aa-407f-9e94-5ae69825e544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '362302cd06fc42e6950c07b8682ea8b5', 'request_id': 'req-5dc57729-f6aa-407f-9e94-5ae69825e544'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:08.974478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5dc57729-f6aa-407f-9e94-5ae69825e544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '362302cd06fc42e6950c07b8682ea8b5', 'request_id': 'req-5dc57729-f6aa-407f-9e94-5ae69825e544'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:08.984386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5dc57729-f6aa-407f-9e94-5ae69825e544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '362302cd06fc42e6950c07b8682ea8b5', 'request_id': 'req-5dc57729-f6aa-407f-9e94-5ae69825e544'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:09.000193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5dc57729-f6aa-407f-9e94-5ae69825e544 admin admin] The token cache is being invalidate because project 362302cd06fc42e6950c07b8682ea8b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:09:09.000444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5dc57729-f6aa-407f-9e94-5ae69825e544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:09.001222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5dc57729-f6aa-407f-9e94-5ae69825e544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:09.003715 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3540/6993] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:09:08 2021] DELETE /identity/v3/projects/362302cd06fc42e6950c07b8682ea8b5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:09.010196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e52cb-98ea-4464-899b-3a51579bc68a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:09.011256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e52cb-98ea-4464-899b-3a51579bc68a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:09.011365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e52cb-98ea-4464-899b-3a51579bc68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:09.032116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-740e52cb-98ea-4464-899b-3a51579bc68a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:09.033324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-740e52cb-98ea-4464-899b-3a51579bc68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:09.110015 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3454/6994] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:09.111633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3471187-55db-4d9a-ba28-7213b4ca141a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:09.111982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3471187-55db-4d9a-ba28-7213b4ca141a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:09.112244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3471187-55db-4d9a-ba28-7213b4ca141a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:09.133369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d3471187-55db-4d9a-ba28-7213b4ca141a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:09.134653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d3471187-55db-4d9a-ba28-7213b4ca141a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:09.144090 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3541/6995] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:09.149032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e52cb-98ea-4464-899b-3a51579bc68a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:09.161024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e52cb-98ea-4464-899b-3a51579bc68a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:09.167254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257648ce-ccb1-43b0-a58f-6b58096d3c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:09.167929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257648ce-ccb1-43b0-a58f-6b58096d3c64 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:09.168209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257648ce-ccb1-43b0-a58f-6b58096d3c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:09.168485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257648ce-ccb1-43b0-a58f-6b58096d3c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:09.169221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257648ce-ccb1-43b0-a58f-6b58096d3c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:09:09.169528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257648ce-ccb1-43b0-a58f-6b58096d3c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:09.171306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257648ce-ccb1-43b0-a58f-6b58096d3c64 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:09.184262 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3455/6996] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:09:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:09:09.189111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3471187-55db-4d9a-ba28-7213b4ca141a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:09.203035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3471187-55db-4d9a-ba28-7213b4ca141a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:09.213105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2c970-3db7-4caf-97fc-40b50c9be727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:09.215106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2c970-3db7-4caf-97fc-40b50c9be727 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:09.215811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2c970-3db7-4caf-97fc-40b50c9be727 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:09.216134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2c970-3db7-4caf-97fc-40b50c9be727 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:09.217392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2c970-3db7-4caf-97fc-40b50c9be727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:09.219632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2c970-3db7-4caf-97fc-40b50c9be727 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:09.258588 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3542/6997] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:09:09 2021] POST /identity/v3/projects => generated 387 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:09:09.263124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257648ce-ccb1-43b0-a58f-6b58096d3c64 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:09.276982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257648ce-ccb1-43b0-a58f-6b58096d3c64 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:09.368193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257b03c-4f05-4301-9eba-8c3729d05231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:09.369541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257b03c-4f05-4301-9eba-8c3729d05231 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:09.370012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257b03c-4f05-4301-9eba-8c3729d05231 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:09.371831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257b03c-4f05-4301-9eba-8c3729d05231 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:09.372741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257b03c-4f05-4301-9eba-8c3729d05231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:09.375714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257b03c-4f05-4301-9eba-8c3729d05231 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:09.419867 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3456/6998] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:09:09 2021] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:09:09.420977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2c970-3db7-4caf-97fc-40b50c9be727 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:09.453114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2c970-3db7-4caf-97fc-40b50c9be727 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:09.468575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5208d46-308f-461c-ac22-448c62974357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:09.469619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5208d46-308f-461c-ac22-448c62974357 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:09.470007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5208d46-308f-461c-ac22-448c62974357 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:09.471125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5208d46-308f-461c-ac22-448c62974357 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:09.472519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5208d46-308f-461c-ac22-448c62974357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:09.474183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5208d46-308f-461c-ac22-448c62974357 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:09.489893 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3543/6999] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:09 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:09:09.493942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257b03c-4f05-4301-9eba-8c3729d05231 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:09.504922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257b03c-4f05-4301-9eba-8c3729d05231 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:09.511636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ec191-a4cc-4412-926b-0d5e96f597b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:09.512482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ec191-a4cc-4412-926b-0d5e96f597b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:09.512926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ec191-a4cc-4412-926b-0d5e96f597b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:09.513396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ec191-a4cc-4412-926b-0d5e96f597b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:09.514437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ec191-a4cc-4412-926b-0d5e96f597b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:09.516224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ec191-a4cc-4412-926b-0d5e96f597b0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:09.534584 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3457/7000] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:09 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:09:09.538941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5208d46-308f-461c-ac22-448c62974357 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:09.551671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5208d46-308f-461c-ac22-448c62974357 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:09.559427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d34c2-1ecf-40cf-930c-51d3fe005cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:09.560612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d34c2-1ecf-40cf-930c-51d3fe005cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:09.561001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d34c2-1ecf-40cf-930c-51d3fe005cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:09.561423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d34c2-1ecf-40cf-930c-51d3fe005cc8 admin admin] PATH_INFO: `/v3/projects/64ef041cd6724458b053cde5c1afe4fa/users/bdd05da990fb4f7290fb926a258de4eb/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:09.582795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d34c2-1ecf-40cf-930c-51d3fe005cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ef041cd6724458b053cde5c1afe4fa, user_id=bdd05da990fb4f7290fb926a258de4eb, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:09.585414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d34c2-1ecf-40cf-930c-51d3fe005cc8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:09.601559 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3544/7001] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:09:09 2021] PUT /identity/v3/projects/64ef041cd6724458b053cde5c1afe4fa/users/bdd05da990fb4f7290fb926a258de4eb/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:09:09.607168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca918451-b0b3-45cc-a707-7542f7bcaff4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:09.607498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca918451-b0b3-45cc-a707-7542f7bcaff4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:09.607818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca918451-b0b3-45cc-a707-7542f7bcaff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:09.628764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ca918451-b0b3-45cc-a707-7542f7bcaff4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:09.630098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ca918451-b0b3-45cc-a707-7542f7bcaff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:09.694170 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3458/7002] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:09:09.704322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d34c2-1ecf-40cf-930c-51d3fe005cc8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:09.706280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-464d34c2-1ecf-40cf-930c-51d3fe005cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:09.774968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d34c2-1ecf-40cf-930c-51d3fe005cc8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:09.784939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49db9f-bf39-4f52-9602-f757dfc5928a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:09.785669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49db9f-bf39-4f52-9602-f757dfc5928a service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:09.785979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49db9f-bf39-4f52-9602-f757dfc5928a service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:09.786282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49db9f-bf39-4f52-9602-f757dfc5928a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:09.797035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49db9f-bf39-4f52-9602-f757dfc5928a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:09.798513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49db9f-bf39-4f52-9602-f757dfc5928a service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:09.821671 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3545/7003] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:09:10.963082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d7e85-feb7-4542-b2f5-f955bd30e641 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:10.963505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d7e85-feb7-4542-b2f5-f955bd30e641 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:10.963648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d7e85-feb7-4542-b2f5-f955bd30e641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:10.985438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fc4d7e85-feb7-4542-b2f5-f955bd30e641 None None] MFA Rules not processed for user `d32598482c834073b8fe24c84cb57d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:10.987009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fc4d7e85-feb7-4542-b2f5-f955bd30e641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:11.081867 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3459/7004] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:10 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:13.007316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49db9f-bf39-4f52-9602-f757dfc5928a service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:13.009779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ff49db9f-bf39-4f52-9602-f757dfc5928a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:13.050729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49db9f-bf39-4f52-9602-f757dfc5928a service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:13.062727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57b127-2fcc-4ba5-8e2d-285f7fbdad79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:13.073064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57b127-2fcc-4ba5-8e2d-285f7fbdad79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:13.074635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57b127-2fcc-4ba5-8e2d-285f7fbdad79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:13.075553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57b127-2fcc-4ba5-8e2d-285f7fbdad79 admin admin] PATH_INFO: `/v3/users/814200cf33934d1b88ab3e9c2fd4859f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:13.080698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57b127-2fcc-4ba5-8e2d-285f7fbdad79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=814200cf33934d1b88ab3e9c2fd4859f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:13.103611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57b127-2fcc-4ba5-8e2d-285f7fbdad79 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:13.306995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6e57b127-2fcc-4ba5-8e2d-285f7fbdad79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814200cf33934d1b88ab3e9c2fd4859f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:13.358408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6e57b127-2fcc-4ba5-8e2d-285f7fbdad79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814200cf33934d1b88ab3e9c2fd4859f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:13.359195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6e57b127-2fcc-4ba5-8e2d-285f7fbdad79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814200cf33934d1b88ab3e9c2fd4859f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:13.401836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6e57b127-2fcc-4ba5-8e2d-285f7fbdad79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814200cf33934d1b88ab3e9c2fd4859f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:13.414477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6e57b127-2fcc-4ba5-8e2d-285f7fbdad79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814200cf33934d1b88ab3e9c2fd4859f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:13.424557 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3546/7005] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:09:13 2021] DELETE /identity/v3/users/814200cf33934d1b88ab3e9c2fd4859f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:13.428056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b0435-4505-4bc4-b881-ca05c14bf998 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:13.428538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b0435-4505-4bc4-b881-ca05c14bf998 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:13.428656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b0435-4505-4bc4-b881-ca05c14bf998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:13.475295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f15b0435-4505-4bc4-b881-ca05c14bf998 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:13.475558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f15b0435-4505-4bc4-b881-ca05c14bf998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:13.610106 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3460/7006] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:13.621890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57b127-2fcc-4ba5-8e2d-285f7fbdad79 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:13.623873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6e57b127-2fcc-4ba5-8e2d-285f7fbdad79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:13.785006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57b127-2fcc-4ba5-8e2d-285f7fbdad79 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:13.802769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aab7e-7353-45a3-9a4c-22c5fb8a8d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:13.803732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aab7e-7353-45a3-9a4c-22c5fb8a8d14 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:13.804112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aab7e-7353-45a3-9a4c-22c5fb8a8d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:13.804612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aab7e-7353-45a3-9a4c-22c5fb8a8d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:13.827337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4aab7e-7353-45a3-9a4c-22c5fb8a8d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:13.830933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4aab7e-7353-45a3-9a4c-22c5fb8a8d14 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:13.862490 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3547/7007] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:09:14.525705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b0435-4505-4bc4-b881-ca05c14bf998 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:14.527702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f15b0435-4505-4bc4-b881-ca05c14bf998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:14.547136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b0435-4505-4bc4-b881-ca05c14bf998 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:14.563089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad6d57-3107-4772-bd46-e0bbdf9a455f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:14.564715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad6d57-3107-4772-bd46-e0bbdf9a455f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:14.565268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad6d57-3107-4772-bd46-e0bbdf9a455f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:14.565814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad6d57-3107-4772-bd46-e0bbdf9a455f admin admin] PATH_INFO: `/v3/projects/8d050b91d2cd43cfbff6d3e27cd18b5d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:14.567876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad6d57-3107-4772-bd46-e0bbdf9a455f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d050b91d2cd43cfbff6d3e27cd18b5d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:14.572215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad6d57-3107-4772-bd46-e0bbdf9a455f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:14.654430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f0ad6d57-3107-4772-bd46-e0bbdf9a455f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d050b91d2cd43cfbff6d3e27cd18b5d', 'request_id': 'req-f0ad6d57-3107-4772-bd46-e0bbdf9a455f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:14.662288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f0ad6d57-3107-4772-bd46-e0bbdf9a455f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d050b91d2cd43cfbff6d3e27cd18b5d', 'request_id': 'req-f0ad6d57-3107-4772-bd46-e0bbdf9a455f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:14.671149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f0ad6d57-3107-4772-bd46-e0bbdf9a455f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d050b91d2cd43cfbff6d3e27cd18b5d', 'request_id': 'req-f0ad6d57-3107-4772-bd46-e0bbdf9a455f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:14.695170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f0ad6d57-3107-4772-bd46-e0bbdf9a455f admin admin] The token cache is being invalidate because project 8d050b91d2cd43cfbff6d3e27cd18b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:09:14.695479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f0ad6d57-3107-4772-bd46-e0bbdf9a455f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:14.696875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f0ad6d57-3107-4772-bd46-e0bbdf9a455f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:14.698881 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3461/7008] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:09:14 2021] DELETE /identity/v3/projects/8d050b91d2cd43cfbff6d3e27cd18b5d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:14.706131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96e811-530c-4d57-8a7e-3fffc099e8b0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:14.707141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96e811-530c-4d57-8a7e-3fffc099e8b0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:14.707489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96e811-530c-4d57-8a7e-3fffc099e8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:14.738191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9d96e811-530c-4d57-8a7e-3fffc099e8b0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:14.739458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9d96e811-530c-4d57-8a7e-3fffc099e8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:14.903280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084c1e6-664f-45cd-a78f-91561836bce8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:14.903480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084c1e6-664f-45cd-a78f-91561836bce8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:14.903761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084c1e6-664f-45cd-a78f-91561836bce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:14.906106 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3548/7009] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:14.951456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9084c1e6-664f-45cd-a78f-91561836bce8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:14.953740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9084c1e6-664f-45cd-a78f-91561836bce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:15.017144 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3462/7010] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:09:15.021405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96e811-530c-4d57-8a7e-3fffc099e8b0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:15.062285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96e811-530c-4d57-8a7e-3fffc099e8b0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:15.085919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d170d4-bca4-43b6-92b4-f6877ddbf49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:15.086717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d170d4-bca4-43b6-92b4-f6877ddbf49d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:15.093627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d170d4-bca4-43b6-92b4-f6877ddbf49d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:15.093968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d170d4-bca4-43b6-92b4-f6877ddbf49d admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:15.097070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d170d4-bca4-43b6-92b4-f6877ddbf49d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:09:15.097420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d170d4-bca4-43b6-92b4-f6877ddbf49d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:15.102575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d170d4-bca4-43b6-92b4-f6877ddbf49d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:15.156773 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3549/7011] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:09:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:09:15.161068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084c1e6-664f-45cd-a78f-91561836bce8 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:15.177355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084c1e6-664f-45cd-a78f-91561836bce8 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:15.186045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b53b44-1e04-439b-99f1-beaeacb4e0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:15.187273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b53b44-1e04-439b-99f1-beaeacb4e0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:15.187787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b53b44-1e04-439b-99f1-beaeacb4e0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:15.188328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b53b44-1e04-439b-99f1-beaeacb4e0e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:15.189436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b53b44-1e04-439b-99f1-beaeacb4e0e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:15.192217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b53b44-1e04-439b-99f1-beaeacb4e0e6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:15.247905 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3463/7012] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:09:15 2021] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:09:15.252989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d170d4-bca4-43b6-92b4-f6877ddbf49d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:15.271799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d170d4-bca4-43b6-92b4-f6877ddbf49d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:15.420788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ca1a0-ff30-4257-9c85-4ad6c797d2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:15.421392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ca1a0-ff30-4257-9c85-4ad6c797d2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:15.422012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ca1a0-ff30-4257-9c85-4ad6c797d2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:15.422400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ca1a0-ff30-4257-9c85-4ad6c797d2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:15.430511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ca1a0-ff30-4257-9c85-4ad6c797d2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:15.433795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ca1a0-ff30-4257-9c85-4ad6c797d2a3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:15.478610 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3550/7013] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:09:15 2021] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:09:15.481856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b53b44-1e04-439b-99f1-beaeacb4e0e6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:15.504772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b53b44-1e04-439b-99f1-beaeacb4e0e6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:15.514331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f7397-fc7f-418e-a3db-3dd3b517639c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:15.515442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f7397-fc7f-418e-a3db-3dd3b517639c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:15.515442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f7397-fc7f-418e-a3db-3dd3b517639c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:15.515442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f7397-fc7f-418e-a3db-3dd3b517639c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:15.516039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f7397-fc7f-418e-a3db-3dd3b517639c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:15.528539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f7397-fc7f-418e-a3db-3dd3b517639c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:15.565614 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3464/7014] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:15 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:09:15.570191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ca1a0-ff30-4257-9c85-4ad6c797d2a3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:15.596954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ca1a0-ff30-4257-9c85-4ad6c797d2a3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:15.612145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e28da-7db3-4f5a-81f3-c113a93afc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:15.612833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e28da-7db3-4f5a-81f3-c113a93afc94 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:15.613127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e28da-7db3-4f5a-81f3-c113a93afc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:15.613412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e28da-7db3-4f5a-81f3-c113a93afc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:15.614166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e28da-7db3-4f5a-81f3-c113a93afc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:15.623425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e28da-7db3-4f5a-81f3-c113a93afc94 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:15.656008 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3551/7015] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:15 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:09:15.657263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f7397-fc7f-418e-a3db-3dd3b517639c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:15.684177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f7397-fc7f-418e-a3db-3dd3b517639c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:15.689770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03123e-b802-418a-9ec3-a773320b6d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:15.691005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03123e-b802-418a-9ec3-a773320b6d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:15.691452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03123e-b802-418a-9ec3-a773320b6d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:15.691892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03123e-b802-418a-9ec3-a773320b6d74 admin admin] PATH_INFO: `/v3/projects/8cd3a167092049489c79bc4681600124/users/b617862ad6f243249173f2c1eab95130/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:15.712051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03123e-b802-418a-9ec3-a773320b6d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd3a167092049489c79bc4681600124, user_id=b617862ad6f243249173f2c1eab95130, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:15.715794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03123e-b802-418a-9ec3-a773320b6d74 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:15.755524 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3465/7016] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:09:15 2021] PUT /identity/v3/projects/8cd3a167092049489c79bc4681600124/users/b617862ad6f243249173f2c1eab95130/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:09:15.757421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528c79e-4fe3-4613-b7c6-3e6cab81b393 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:15.757875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528c79e-4fe3-4613-b7c6-3e6cab81b393 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:15.757959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528c79e-4fe3-4613-b7c6-3e6cab81b393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:15.808364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6528c79e-4fe3-4613-b7c6-3e6cab81b393 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:15.812620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6528c79e-4fe3-4613-b7c6-3e6cab81b393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:15.968799 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3552/7017] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:15.996232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03123e-b802-418a-9ec3-a773320b6d74 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:15.999795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6d03123e-b802-418a-9ec3-a773320b6d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:16.132240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03123e-b802-418a-9ec3-a773320b6d74 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:16.145395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80e856-57ef-45a4-9817-d0dde6a8e9a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:16.146393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80e856-57ef-45a4-9817-d0dde6a8e9a8 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:16.146844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80e856-57ef-45a4-9817-d0dde6a8e9a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:16.147306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80e856-57ef-45a4-9817-d0dde6a8e9a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:16.162286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80e856-57ef-45a4-9817-d0dde6a8e9a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:16.164393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80e856-57ef-45a4-9817-d0dde6a8e9a8 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:16.167814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528c79e-4fe3-4613-b7c6-3e6cab81b393 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:16.169424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6528c79e-4fe3-4613-b7c6-3e6cab81b393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:16.186124 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3466/7018] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:09:16.187854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528c79e-4fe3-4613-b7c6-3e6cab81b393 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:16.194237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfb630-0e1e-4b52-b23a-b32d10d3cedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:16.196437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfb630-0e1e-4b52-b23a-b32d10d3cedf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:16.196897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfb630-0e1e-4b52-b23a-b32d10d3cedf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:16.197367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfb630-0e1e-4b52-b23a-b32d10d3cedf admin admin] PATH_INFO: `/v3/users/15458d34364442e4891c1bc48d71196b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:16.199602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfb630-0e1e-4b52-b23a-b32d10d3cedf admin admin] RBAC: Authorizing `identity:delete_user(user_id=15458d34364442e4891c1bc48d71196b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:16.201780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfb630-0e1e-4b52-b23a-b32d10d3cedf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:16.284149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b6cfb630-0e1e-4b52-b23a-b32d10d3cedf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15458d34364442e4891c1bc48d71196b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:16.299835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b6cfb630-0e1e-4b52-b23a-b32d10d3cedf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15458d34364442e4891c1bc48d71196b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:16.301701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b6cfb630-0e1e-4b52-b23a-b32d10d3cedf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15458d34364442e4891c1bc48d71196b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:16.333263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b6cfb630-0e1e-4b52-b23a-b32d10d3cedf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15458d34364442e4891c1bc48d71196b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:16.361545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b6cfb630-0e1e-4b52-b23a-b32d10d3cedf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15458d34364442e4891c1bc48d71196b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:16.374972 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3553/7019] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:09:16 2021] DELETE /identity/v3/users/15458d34364442e4891c1bc48d71196b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:16.379348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa39dc-3dec-4f09-a4c5-f95d7579ba9f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:16.379646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa39dc-3dec-4f09-a4c5-f95d7579ba9f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:16.379931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa39dc-3dec-4f09-a4c5-f95d7579ba9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:16.410733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fbfa39dc-3dec-4f09-a4c5-f95d7579ba9f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:16.418633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fbfa39dc-3dec-4f09-a4c5-f95d7579ba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:16.563625 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3467/7020] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:16.588417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfb630-0e1e-4b52-b23a-b32d10d3cedf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:16.590492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b6cfb630-0e1e-4b52-b23a-b32d10d3cedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:16.796674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfb630-0e1e-4b52-b23a-b32d10d3cedf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:16.828838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caeb969-d46c-4092-a316-5d00956da236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:16.829624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeb969-d46c-4092-a316-5d00956da236 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:16.829889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeb969-d46c-4092-a316-5d00956da236 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:16.830172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeb969-d46c-4092-a316-5d00956da236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:16.861487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caeb969-d46c-4092-a316-5d00956da236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:16.865015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caeb969-d46c-4092-a316-5d00956da236 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:16.878035 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3554/7021] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:09:17.470704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba25637-7623-483e-9458-ce6238719b5e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:17.471486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba25637-7623-483e-9458-ce6238719b5e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:17.471799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba25637-7623-483e-9458-ce6238719b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:17.520472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-eba25637-7623-483e-9458-ce6238719b5e None None] MFA Rules not processed for user `a3e6bef41b9948099215b02cdca829bf`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:17.522943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eba25637-7623-483e-9458-ce6238719b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:17.603928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caeb969-d46c-4092-a316-5d00956da236 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:17.607638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6caeb969-d46c-4092-a316-5d00956da236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:17.645513 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3468/7022] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:17 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:17.653138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caeb969-d46c-4092-a316-5d00956da236 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:17.659692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba25637-7623-483e-9458-ce6238719b5e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:17.661403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eba25637-7623-483e-9458-ce6238719b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:17.674451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133f320-adb1-4f13-b0a6-aa4b8cd7621e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:17.675322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133f320-adb1-4f13-b0a6-aa4b8cd7621e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:17.675606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133f320-adb1-4f13-b0a6-aa4b8cd7621e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:17.675885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133f320-adb1-4f13-b0a6-aa4b8cd7621e admin admin] PATH_INFO: `/v3/projects/e2128a151c944e66bc3b9d6bc11b3c10` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:17.678642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133f320-adb1-4f13-b0a6-aa4b8cd7621e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2128a151c944e66bc3b9d6bc11b3c10)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:17.685411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133f320-adb1-4f13-b0a6-aa4b8cd7621e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:17.787842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba25637-7623-483e-9458-ce6238719b5e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:17.799425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0133f320-adb1-4f13-b0a6-aa4b8cd7621e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2128a151c944e66bc3b9d6bc11b3c10', 'request_id': 'req-0133f320-adb1-4f13-b0a6-aa4b8cd7621e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:17.807816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0133f320-adb1-4f13-b0a6-aa4b8cd7621e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2128a151c944e66bc3b9d6bc11b3c10', 'request_id': 'req-0133f320-adb1-4f13-b0a6-aa4b8cd7621e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:17.820761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0133f320-adb1-4f13-b0a6-aa4b8cd7621e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2128a151c944e66bc3b9d6bc11b3c10', 'request_id': 'req-0133f320-adb1-4f13-b0a6-aa4b8cd7621e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:17.837335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0133f320-adb1-4f13-b0a6-aa4b8cd7621e admin admin] The token cache is being invalidate because project e2128a151c944e66bc3b9d6bc11b3c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:09:17.837852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0133f320-adb1-4f13-b0a6-aa4b8cd7621e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:17.839272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0133f320-adb1-4f13-b0a6-aa4b8cd7621e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:17.841486 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3555/7023] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:09:17 2021] DELETE /identity/v3/projects/e2128a151c944e66bc3b9d6bc11b3c10 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:17.867482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad487552-d5ed-4f68-8e27-b12150c62a5d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:17.868066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad487552-d5ed-4f68-8e27-b12150c62a5d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:17.868502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad487552-d5ed-4f68-8e27-b12150c62a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:17.894679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ad487552-d5ed-4f68-8e27-b12150c62a5d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:17.896327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ad487552-d5ed-4f68-8e27-b12150c62a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:17.906222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd40d1-fb57-4cf0-a592-84ae8fa4bd3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:17.907172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd40d1-fb57-4cf0-a592-84ae8fa4bd3f service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:17.907641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd40d1-fb57-4cf0-a592-84ae8fa4bd3f service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:17.908086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd40d1-fb57-4cf0-a592-84ae8fa4bd3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:17.910046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-39dd40d1-fb57-4cf0-a592-84ae8fa4bd3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:17.985181 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3556/7024] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:17.995078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365510ef-b89b-442c-8f10-c6a1e3778171 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:17.995496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365510ef-b89b-442c-8f10-c6a1e3778171 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:17.995899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365510ef-b89b-442c-8f10-c6a1e3778171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:18.037920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-365510ef-b89b-442c-8f10-c6a1e3778171 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:18.038951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-365510ef-b89b-442c-8f10-c6a1e3778171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:18.065036 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3557/7025] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:18.065270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365510ef-b89b-442c-8f10-c6a1e3778171 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:18.078447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365510ef-b89b-442c-8f10-c6a1e3778171 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:18.079949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd40d1-fb57-4cf0-a592-84ae8fa4bd3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:18.083924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97663df2-b1a3-45ba-8d3d-bc4860789e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:18.084432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd40d1-fb57-4cf0-a592-84ae8fa4bd3f service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:18.084822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97663df2-b1a3-45ba-8d3d-bc4860789e1e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:18.085241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97663df2-b1a3-45ba-8d3d-bc4860789e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:18.085615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97663df2-b1a3-45ba-8d3d-bc4860789e1e admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:18.086527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97663df2-b1a3-45ba-8d3d-bc4860789e1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:09:18.086915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97663df2-b1a3-45ba-8d3d-bc4860789e1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:18.089456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97663df2-b1a3-45ba-8d3d-bc4860789e1e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:18.106722 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3558/7026] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:09:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:09:18.107857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97663df2-b1a3-45ba-8d3d-bc4860789e1e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:18.120267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97663df2-b1a3-45ba-8d3d-bc4860789e1e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:18.123281 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3469/7027] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:17 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:09:18.141752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658abb33-26db-4a8d-96c3-ba8b458af369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:18.142815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658abb33-26db-4a8d-96c3-ba8b458af369 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:18.144561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658abb33-26db-4a8d-96c3-ba8b458af369 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:18.145001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658abb33-26db-4a8d-96c3-ba8b458af369 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:18.148095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658abb33-26db-4a8d-96c3-ba8b458af369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:18.150406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658abb33-26db-4a8d-96c3-ba8b458af369 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:18.191338 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3559/7028] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:09:18 2021] POST /identity/v3/projects => generated 367 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:09:18.196455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd40d1-fb57-4cf0-a592-84ae8fa4bd3f service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:18.214953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd40d1-fb57-4cf0-a592-84ae8fa4bd3f service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:18.341804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a29d6-6453-4bd7-9444-77339e8d0230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:18.343931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a29d6-6453-4bd7-9444-77339e8d0230 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:18.344449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a29d6-6453-4bd7-9444-77339e8d0230 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:18.344996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a29d6-6453-4bd7-9444-77339e8d0230 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:18.347752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a29d6-6453-4bd7-9444-77339e8d0230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:18.349947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a29d6-6453-4bd7-9444-77339e8d0230 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:18.384707 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3470/7029] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:09:18 2021] POST /identity/v3/users => generated 284 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:09:18.387715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658abb33-26db-4a8d-96c3-ba8b458af369 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:18.402105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658abb33-26db-4a8d-96c3-ba8b458af369 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:18.408919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba22ecd-1719-4a7f-84ab-9c6d70a4b004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:18.410144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba22ecd-1719-4a7f-84ab-9c6d70a4b004 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:18.410731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba22ecd-1719-4a7f-84ab-9c6d70a4b004 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:18.411216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba22ecd-1719-4a7f-84ab-9c6d70a4b004 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:18.412415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba22ecd-1719-4a7f-84ab-9c6d70a4b004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:18.414731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba22ecd-1719-4a7f-84ab-9c6d70a4b004 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:18.426699 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3560/7030] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:18 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:09:18.431022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a29d6-6453-4bd7-9444-77339e8d0230 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:18.446021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a29d6-6453-4bd7-9444-77339e8d0230 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:18.455374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7b3f7-eb22-435f-b7b8-f2ce6e7ef61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:18.456068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7b3f7-eb22-435f-b7b8-f2ce6e7ef61d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:18.456356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7b3f7-eb22-435f-b7b8-f2ce6e7ef61d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:18.456635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7b3f7-eb22-435f-b7b8-f2ce6e7ef61d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:18.457379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7b3f7-eb22-435f-b7b8-f2ce6e7ef61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:18.464621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7b3f7-eb22-435f-b7b8-f2ce6e7ef61d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:18.490435 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3471/7031] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:18 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:09:18.491681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba22ecd-1719-4a7f-84ab-9c6d70a4b004 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:18.525056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba22ecd-1719-4a7f-84ab-9c6d70a4b004 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:18.540196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09114e64-cfa2-4056-aa68-aeabcf4b27f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:18.542377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09114e64-cfa2-4056-aa68-aeabcf4b27f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:18.542750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09114e64-cfa2-4056-aa68-aeabcf4b27f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:18.543047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09114e64-cfa2-4056-aa68-aeabcf4b27f9 admin admin] PATH_INFO: `/v3/projects/5673f3a012384b3d82feb722bb93a642/users/94da636659af412bac820f5ef326ce8d/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:18.578805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09114e64-cfa2-4056-aa68-aeabcf4b27f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5673f3a012384b3d82feb722bb93a642, user_id=94da636659af412bac820f5ef326ce8d, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:18.585396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09114e64-cfa2-4056-aa68-aeabcf4b27f9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:18.610846 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3561/7032] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:09:18 2021] PUT /identity/v3/projects/5673f3a012384b3d82feb722bb93a642/users/94da636659af412bac820f5ef326ce8d/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:18.623004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5e925-e739-4a0d-ad62-fe204b09a3c9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:18.623610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5e925-e739-4a0d-ad62-fe204b09a3c9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:18.624113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5e925-e739-4a0d-ad62-fe204b09a3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:18.658939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-dff5e925-e739-4a0d-ad62-fe204b09a3c9 None None] MFA Rules not processed for user `94da636659af412bac820f5ef326ce8d`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:18.660981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-dff5e925-e739-4a0d-ad62-fe204b09a3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:18.788102 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3472/7033] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:18 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:18.803294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09114e64-cfa2-4056-aa68-aeabcf4b27f9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:18.805616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-09114e64-cfa2-4056-aa68-aeabcf4b27f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:18.890921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09114e64-cfa2-4056-aa68-aeabcf4b27f9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:18.911668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abd3bf-fd9e-4485-8ade-5e36eafe99a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:18.912954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abd3bf-fd9e-4485-8ade-5e36eafe99a9 service glance] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:18.914226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abd3bf-fd9e-4485-8ade-5e36eafe99a9 service glance] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:18.915851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abd3bf-fd9e-4485-8ade-5e36eafe99a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:18.930898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abd3bf-fd9e-4485-8ade-5e36eafe99a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:18.933775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abd3bf-fd9e-4485-8ade-5e36eafe99a9 service glance] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:19.003285 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3562/7034] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:18 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:09:23.949883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c991-c468-4ea4-ab62-f539a028d9af None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:23.950415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c991-c468-4ea4-ab62-f539a028d9af None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:23.951288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c991-c468-4ea4-ab62-f539a028d9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:24.001992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-cda3c991-c468-4ea4-ab62-f539a028d9af None None] MFA Rules not processed for user `bdd05da990fb4f7290fb926a258de4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:24.004033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cda3c991-c468-4ea4-ab62-f539a028d9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:24.135994 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3473/7035] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:23 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:24.148668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abd3bf-fd9e-4485-8ade-5e36eafe99a9 service glance] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:24.150074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-42abd3bf-fd9e-4485-8ade-5e36eafe99a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:24.298991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abd3bf-fd9e-4485-8ade-5e36eafe99a9 service glance] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:24.316911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e23144-0c41-44d0-9c67-1afb07a27df7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:24.318060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e23144-0c41-44d0-9c67-1afb07a27df7 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:24.318492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e23144-0c41-44d0-9c67-1afb07a27df7 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:24.319010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e23144-0c41-44d0-9c67-1afb07a27df7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:24.336242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e23144-0c41-44d0-9c67-1afb07a27df7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:24.338740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e23144-0c41-44d0-9c67-1afb07a27df7 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:24.368488 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3563/7036] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:24 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:09:24.894995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56de83-4274-4417-b7bb-c16e05f13172 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:24.895290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56de83-4274-4417-b7bb-c16e05f13172 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:24.895579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56de83-4274-4417-b7bb-c16e05f13172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:24.933973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8e56de83-4274-4417-b7bb-c16e05f13172 None None] MFA Rules not processed for user `a3e6bef41b9948099215b02cdca829bf`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:24.935502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8e56de83-4274-4417-b7bb-c16e05f13172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:25.074314 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3474/7037] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:24 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:26.582634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55149105-bcb7-4e9d-86a9-91464398a037 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:26.583541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55149105-bcb7-4e9d-86a9-91464398a037 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:26.584159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55149105-bcb7-4e9d-86a9-91464398a037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:26.659362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-55149105-bcb7-4e9d-86a9-91464398a037 None None] MFA Rules not processed for user `b617862ad6f243249173f2c1eab95130`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:26.660609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-55149105-bcb7-4e9d-86a9-91464398a037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:26.847966 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3564/7038] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:26 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:09:26.852601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56de83-4274-4417-b7bb-c16e05f13172 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:26.862632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8e56de83-4274-4417-b7bb-c16e05f13172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:27.108012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56de83-4274-4417-b7bb-c16e05f13172 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:27.116210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a993aea-214f-4bba-bdd7-e4648c5ac625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:27.117206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a993aea-214f-4bba-bdd7-e4648c5ac625 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:27.117706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a993aea-214f-4bba-bdd7-e4648c5ac625 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:27.118192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a993aea-214f-4bba-bdd7-e4648c5ac625 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:27.119233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a993aea-214f-4bba-bdd7-e4648c5ac625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:27.122719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a993aea-214f-4bba-bdd7-e4648c5ac625 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:27.179428 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3475/7039] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:09:26 2021] POST /identity/v3/projects => generated 379 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:09:27.183826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55149105-bcb7-4e9d-86a9-91464398a037 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:27.201274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55149105-bcb7-4e9d-86a9-91464398a037 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:27.373280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502a5d2-7b8a-4c97-95ca-3c08b92145c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:27.373980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502a5d2-7b8a-4c97-95ca-3c08b92145c1 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:27.374283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502a5d2-7b8a-4c97-95ca-3c08b92145c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:27.374577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502a5d2-7b8a-4c97-95ca-3c08b92145c1 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:27.376614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502a5d2-7b8a-4c97-95ca-3c08b92145c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:27.381913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502a5d2-7b8a-4c97-95ca-3c08b92145c1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:27.433769 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3565/7040] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:09:27 2021] POST /identity/v3/users => generated 296 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:09:27.435442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a993aea-214f-4bba-bdd7-e4648c5ac625 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:27.450455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a993aea-214f-4bba-bdd7-e4648c5ac625 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:27.460953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1fdfa-d227-4860-9299-5745f7e7c9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:27.465133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1fdfa-d227-4860-9299-5745f7e7c9ac admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:27.475854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1fdfa-d227-4860-9299-5745f7e7c9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:27.476331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1fdfa-d227-4860-9299-5745f7e7c9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:27.477833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1fdfa-d227-4860-9299-5745f7e7c9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:27.482777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1fdfa-d227-4860-9299-5745f7e7c9ac admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:27.536298 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3476/7041] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:27 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:09:27.542144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502a5d2-7b8a-4c97-95ca-3c08b92145c1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:27.607691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502a5d2-7b8a-4c97-95ca-3c08b92145c1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:27.620982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4ed81-44e6-467f-a435-23d7142752e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:27.622823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4ed81-44e6-467f-a435-23d7142752e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:27.625030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4ed81-44e6-467f-a435-23d7142752e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:27.625514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4ed81-44e6-467f-a435-23d7142752e3 admin admin] PATH_INFO: `/v3/projects/e361f6dac643438a9702f4b3c7dd9502/users/5b6c5f493055420abf17e11617df9ceb/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:27.647178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4ed81-44e6-467f-a435-23d7142752e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e361f6dac643438a9702f4b3c7dd9502, user_id=5b6c5f493055420abf17e11617df9ceb, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:27.651780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4ed81-44e6-467f-a435-23d7142752e3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:27.680415 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3566/7042] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:09:27 2021] PUT /identity/v3/projects/e361f6dac643438a9702f4b3c7dd9502/users/5b6c5f493055420abf17e11617df9ceb/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:27.684555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1fdfa-d227-4860-9299-5745f7e7c9ac admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:27.701492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1fdfa-d227-4860-9299-5745f7e7c9ac admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:27.789742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4ed81-44e6-467f-a435-23d7142752e3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:27.793749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-31f4ed81-44e6-467f-a435-23d7142752e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:27.868981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db4a55-c3b9-4330-884b-9579754845b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:27.871006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db4a55-c3b9-4330-884b-9579754845b4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:27.871477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db4a55-c3b9-4330-884b-9579754845b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:27.871900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db4a55-c3b9-4330-884b-9579754845b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:27.872812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db4a55-c3b9-4330-884b-9579754845b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:27.874630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db4a55-c3b9-4330-884b-9579754845b4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:27.937734 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3477/7043] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:27 2021] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:09:27.948599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db4a55-c3b9-4330-884b-9579754845b4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:27.991693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db4a55-c3b9-4330-884b-9579754845b4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:28.000800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d946465-a544-48b8-8a9e-eb168ae78a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:28.002170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d946465-a544-48b8-8a9e-eb168ae78a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:28.002775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d946465-a544-48b8-8a9e-eb168ae78a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:28.003257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d946465-a544-48b8-8a9e-eb168ae78a7b admin admin] PATH_INFO: `/v3/projects/e361f6dac643438a9702f4b3c7dd9502/users/5b6c5f493055420abf17e11617df9ceb/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:28.007482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d946465-a544-48b8-8a9e-eb168ae78a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e361f6dac643438a9702f4b3c7dd9502, user_id=5b6c5f493055420abf17e11617df9ceb, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:28.012030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d946465-a544-48b8-8a9e-eb168ae78a7b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:28.026152 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3478/7044] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:09:27 2021] PUT /identity/v3/projects/e361f6dac643438a9702f4b3c7dd9502/users/5b6c5f493055420abf17e11617df9ceb/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:28.033556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4ed81-44e6-467f-a435-23d7142752e3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:28.228161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8f81d-1aee-4131-8090-501e9e948fed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:28.230097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8f81d-1aee-4131-8090-501e9e948fed service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:28.230569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8f81d-1aee-4131-8090-501e9e948fed service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:28.231036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8f81d-1aee-4131-8090-501e9e948fed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:28.234400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1bc8f81d-1aee-4131-8090-501e9e948fed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:28.270705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8f81d-1aee-4131-8090-501e9e948fed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:28.272542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8f81d-1aee-4131-8090-501e9e948fed service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:28.315386 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3567/7045] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:27 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:09:28.883826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34984616-7521-4e5f-8bbc-d205a866fcd2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:28.884308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34984616-7521-4e5f-8bbc-d205a866fcd2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:28.884414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34984616-7521-4e5f-8bbc-d205a866fcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:28.908844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-34984616-7521-4e5f-8bbc-d205a866fcd2 None None] MFA Rules not processed for user `bdd05da990fb4f7290fb926a258de4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:28.910125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-34984616-7521-4e5f-8bbc-d205a866fcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:29.004352 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3479/7046] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:28 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:36.977205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9501275-8215-4e24-a557-d8b0b62a9327 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:36.979126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9501275-8215-4e24-a557-d8b0b62a9327 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:36.979626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9501275-8215-4e24-a557-d8b0b62a9327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:37.067627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f9501275-8215-4e24-a557-d8b0b62a9327 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:37.069425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f9501275-8215-4e24-a557-d8b0b62a9327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:37.173901 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3568/7047] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:09:36 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:37.190557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34984616-7521-4e5f-8bbc-d205a866fcd2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:37.192831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-34984616-7521-4e5f-8bbc-d205a866fcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:37.373053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34984616-7521-4e5f-8bbc-d205a866fcd2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:37.380487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3a8db-7653-49b2-b5f0-cebf621b8382 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:37.381527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3a8db-7653-49b2-b5f0-cebf621b8382 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:37.382023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3a8db-7653-49b2-b5f0-cebf621b8382 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:37.382703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3a8db-7653-49b2-b5f0-cebf621b8382 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:37.395203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3a8db-7653-49b2-b5f0-cebf621b8382 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:37.398084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3a8db-7653-49b2-b5f0-cebf621b8382 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:37.426459 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3480/7048] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:09:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:09:37.915921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b8241-2b6e-4a5e-beb4-7360291558b7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:37.916348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b8241-2b6e-4a5e-beb4-7360291558b7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:37.916734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b8241-2b6e-4a5e-beb4-7360291558b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:37.946477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-345b8241-2b6e-4a5e-beb4-7360291558b7 None None] MFA Rules not processed for user `d32598482c834073b8fe24c84cb57d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:37.951007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-345b8241-2b6e-4a5e-beb4-7360291558b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:38.057788 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3569/7049] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:37 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:38.401571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3a8db-7653-49b2-b5f0-cebf621b8382 service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:38.436134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33630ea7-c33a-4514-93d8-aacc9a809c53 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:38.436694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33630ea7-c33a-4514-93d8-aacc9a809c53 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:38.437141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33630ea7-c33a-4514-93d8-aacc9a809c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:38.487119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-33630ea7-c33a-4514-93d8-aacc9a809c53 None None] MFA Rules not processed for user `5b6c5f493055420abf17e11617df9ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:38.489177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-33630ea7-c33a-4514-93d8-aacc9a809c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:38.532194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3a8db-7653-49b2-b5f0-cebf621b8382 service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:38.540637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee02992-db25-4853-aa2d-da28f9e14c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:38.543781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee02992-db25-4853-aa2d-da28f9e14c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:38.544881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee02992-db25-4853-aa2d-da28f9e14c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:38.545349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee02992-db25-4853-aa2d-da28f9e14c14 admin admin] PATH_INFO: `/v3/users/94da636659af412bac820f5ef326ce8d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:38.549528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee02992-db25-4853-aa2d-da28f9e14c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94da636659af412bac820f5ef326ce8d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:38.554619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee02992-db25-4853-aa2d-da28f9e14c14 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:38.644252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dee02992-db25-4853-aa2d-da28f9e14c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94da636659af412bac820f5ef326ce8d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:38.665528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dee02992-db25-4853-aa2d-da28f9e14c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94da636659af412bac820f5ef326ce8d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:38.688098 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3570/7050] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:38 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:38.718371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dee02992-db25-4853-aa2d-da28f9e14c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94da636659af412bac820f5ef326ce8d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:38.719153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dee02992-db25-4853-aa2d-da28f9e14c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94da636659af412bac820f5ef326ce8d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:38.736351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dee02992-db25-4853-aa2d-da28f9e14c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94da636659af412bac820f5ef326ce8d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:38.746132 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3481/7051] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:09:38 2021] DELETE /identity/v3/users/94da636659af412bac820f5ef326ce8d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:38.751086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468edbaf-eed3-479f-a55e-87e32a4a5c19 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:38.751796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468edbaf-eed3-479f-a55e-87e32a4a5c19 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:38.752355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468edbaf-eed3-479f-a55e-87e32a4a5c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:38.806204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-468edbaf-eed3-479f-a55e-87e32a4a5c19 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:38.808132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-468edbaf-eed3-479f-a55e-87e32a4a5c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:38.902717 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3571/7052] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:38.928874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee02992-db25-4853-aa2d-da28f9e14c14 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:38.932203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-dee02992-db25-4853-aa2d-da28f9e14c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:39.067954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee02992-db25-4853-aa2d-da28f9e14c14 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:39.083694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77294e8-bff5-4636-bd0c-13825e317be6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:39.084493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77294e8-bff5-4636-bd0c-13825e317be6 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:39.084785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77294e8-bff5-4636-bd0c-13825e317be6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:39.085064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77294e8-bff5-4636-bd0c-13825e317be6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:39.107139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77294e8-bff5-4636-bd0c-13825e317be6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:39.114150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77294e8-bff5-4636-bd0c-13825e317be6 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:39.137517 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3482/7053] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:09:39.483995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468edbaf-eed3-479f-a55e-87e32a4a5c19 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:39.489281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-468edbaf-eed3-479f-a55e-87e32a4a5c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:39.604339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468edbaf-eed3-479f-a55e-87e32a4a5c19 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:39.614827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dc32e-0b04-4d7f-b4ea-676ac25ea2b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:39.615575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc32e-0b04-4d7f-b4ea-676ac25ea2b3 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:39.616062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc32e-0b04-4d7f-b4ea-676ac25ea2b3 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:39.616782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc32e-0b04-4d7f-b4ea-676ac25ea2b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:39.621939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-426dc32e-0b04-4d7f-b4ea-676ac25ea2b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:39.721111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dc32e-0b04-4d7f-b4ea-676ac25ea2b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:39.723126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dc32e-0b04-4d7f-b4ea-676ac25ea2b3 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:39.743577 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3572/7054] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:39 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:09:40.273855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77294e8-bff5-4636-bd0c-13825e317be6 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:40.276465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e77294e8-bff5-4636-bd0c-13825e317be6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:40.299549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77294e8-bff5-4636-bd0c-13825e317be6 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:40.306981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b8a40-277c-4047-9fb2-84331e68c7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:40.308730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b8a40-277c-4047-9fb2-84331e68c7eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:40.309169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b8a40-277c-4047-9fb2-84331e68c7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:40.309615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b8a40-277c-4047-9fb2-84331e68c7eb admin admin] PATH_INFO: `/v3/projects/5673f3a012384b3d82feb722bb93a642` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:40.342408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b8a40-277c-4047-9fb2-84331e68c7eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5673f3a012384b3d82feb722bb93a642)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:40.344450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b8a40-277c-4047-9fb2-84331e68c7eb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:40.542171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dc32e-0b04-4d7f-b4ea-676ac25ea2b3 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:40.544026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-426dc32e-0b04-4d7f-b4ea-676ac25ea2b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:40.565081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-846b8a40-277c-4047-9fb2-84331e68c7eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5673f3a012384b3d82feb722bb93a642', 'request_id': 'req-846b8a40-277c-4047-9fb2-84331e68c7eb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:40.590900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-846b8a40-277c-4047-9fb2-84331e68c7eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5673f3a012384b3d82feb722bb93a642', 'request_id': 'req-846b8a40-277c-4047-9fb2-84331e68c7eb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:40.612353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-846b8a40-277c-4047-9fb2-84331e68c7eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5673f3a012384b3d82feb722bb93a642', 'request_id': 'req-846b8a40-277c-4047-9fb2-84331e68c7eb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:40.639730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-846b8a40-277c-4047-9fb2-84331e68c7eb admin admin] The token cache is being invalidate because project 5673f3a012384b3d82feb722bb93a642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:09:40.640450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-846b8a40-277c-4047-9fb2-84331e68c7eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:40.641546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-846b8a40-277c-4047-9fb2-84331e68c7eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:40.644907 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3483/7055] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:09:40 2021] DELETE /identity/v3/projects/5673f3a012384b3d82feb722bb93a642 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:09:40.655648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bb75e-8d56-4244-84d9-5bd83d497bec None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:40.659745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bb75e-8d56-4244-84d9-5bd83d497bec None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:40.661809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bb75e-8d56-4244-84d9-5bd83d497bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:40.735723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3c5bb75e-8d56-4244-84d9-5bd83d497bec None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:40.743527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3c5bb75e-8d56-4244-84d9-5bd83d497bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:40.771930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dc32e-0b04-4d7f-b4ea-676ac25ea2b3 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:40.875036 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3484/7056] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:40.883928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0e485-2dcc-4568-83d4-56cccfd6e169 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:40.886461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0e485-2dcc-4568-83d4-56cccfd6e169 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:40.886461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0e485-2dcc-4568-83d4-56cccfd6e169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:40.944810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-48f0e485-2dcc-4568-83d4-56cccfd6e169 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:40.953585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-48f0e485-2dcc-4568-83d4-56cccfd6e169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:40.968253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e34d80-8dda-453d-9ae4-0d2c50b7b4f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:40.970233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e34d80-8dda-453d-9ae4-0d2c50b7b4f1 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:40.974131 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3485/7057] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:40.974344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e34d80-8dda-453d-9ae4-0d2c50b7b4f1 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:40.974344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e34d80-8dda-453d-9ae4-0d2c50b7b4f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:40.976194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-87e34d80-8dda-453d-9ae4-0d2c50b7b4f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:40.976457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0e485-2dcc-4568-83d4-56cccfd6e169 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:40.996415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0e485-2dcc-4568-83d4-56cccfd6e169 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:41.008427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df230c-fb08-43f8-b978-cd44710a3c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:41.009245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df230c-fb08-43f8-b978-cd44710a3c2d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:41.009551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df230c-fb08-43f8-b978-cd44710a3c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:41.009830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df230c-fb08-43f8-b978-cd44710a3c2d admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:41.010603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df230c-fb08-43f8-b978-cd44710a3c2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:09:41.010910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df230c-fb08-43f8-b978-cd44710a3c2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:41.012510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df230c-fb08-43f8-b978-cd44710a3c2d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:41.018143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e34d80-8dda-453d-9ae4-0d2c50b7b4f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:41.021914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e34d80-8dda-453d-9ae4-0d2c50b7b4f1 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:41.037881 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3486/7058] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:09:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:09:41.042796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df230c-fb08-43f8-b978-cd44710a3c2d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:41.070842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df230c-fb08-43f8-b978-cd44710a3c2d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:41.073101 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3573/7059] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:40 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:09:41.079454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b1ba8-92f9-4afe-87b4-16961250bc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:41.080397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b1ba8-92f9-4afe-87b4-16961250bc2f admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:41.080397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b1ba8-92f9-4afe-87b4-16961250bc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:41.080740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b1ba8-92f9-4afe-87b4-16961250bc2f admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:41.082064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b1ba8-92f9-4afe-87b4-16961250bc2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:41.084200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b1ba8-92f9-4afe-87b4-16961250bc2f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:41.165208 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3487/7060] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:09:41 2021] POST /identity/v3/projects => generated 393 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:09:41.169831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e34d80-8dda-453d-9ae4-0d2c50b7b4f1 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:41.188963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e34d80-8dda-453d-9ae4-0d2c50b7b4f1 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:41.301146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8407f1-4daa-40ba-8b13-f942056a6695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:41.302303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8407f1-4daa-40ba-8b13-f942056a6695 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:41.302661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8407f1-4daa-40ba-8b13-f942056a6695 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:41.303010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8407f1-4daa-40ba-8b13-f942056a6695 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:41.303810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8407f1-4daa-40ba-8b13-f942056a6695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:41.306452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8407f1-4daa-40ba-8b13-f942056a6695 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:41.346825 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3574/7061] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:09:41 2021] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:09:41.350306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b1ba8-92f9-4afe-87b4-16961250bc2f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:41.363150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b1ba8-92f9-4afe-87b4-16961250bc2f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:41.370776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e408f3c-c9d5-4263-bea4-35ef17b85267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:41.371700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e408f3c-c9d5-4263-bea4-35ef17b85267 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:41.372142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e408f3c-c9d5-4263-bea4-35ef17b85267 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:41.372701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e408f3c-c9d5-4263-bea4-35ef17b85267 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:41.373852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e408f3c-c9d5-4263-bea4-35ef17b85267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:41.377046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e408f3c-c9d5-4263-bea4-35ef17b85267 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:41.402275 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3488/7062] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:41 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:09:41.403150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8407f1-4daa-40ba-8b13-f942056a6695 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:41.427193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8407f1-4daa-40ba-8b13-f942056a6695 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:41.439434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea381eb-4a33-45fa-874a-2275b9c4d919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:41.443941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea381eb-4a33-45fa-874a-2275b9c4d919 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:41.444280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea381eb-4a33-45fa-874a-2275b9c4d919 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:41.444780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea381eb-4a33-45fa-874a-2275b9c4d919 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:41.447968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea381eb-4a33-45fa-874a-2275b9c4d919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:41.450138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea381eb-4a33-45fa-874a-2275b9c4d919 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:41.464906 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3575/7063] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:41 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:09:41.468721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e408f3c-c9d5-4263-bea4-35ef17b85267 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:41.481084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e408f3c-c9d5-4263-bea4-35ef17b85267 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:41.489285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090c001-9469-43ad-b4a0-2f6743d6d284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:41.490352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090c001-9469-43ad-b4a0-2f6743d6d284 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:41.490870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090c001-9469-43ad-b4a0-2f6743d6d284 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:41.493797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090c001-9469-43ad-b4a0-2f6743d6d284 admin admin] PATH_INFO: `/v3/projects/71c859bfcff54b5c85e6cb248341f37c/users/f292f8174a7a4de5bf8a848e49f85dbe/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:41.515798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090c001-9469-43ad-b4a0-2f6743d6d284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c859bfcff54b5c85e6cb248341f37c, user_id=f292f8174a7a4de5bf8a848e49f85dbe, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:41.518779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090c001-9469-43ad-b4a0-2f6743d6d284 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:41.546647 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3489/7064] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:09:41 2021] PUT /identity/v3/projects/71c859bfcff54b5c85e6cb248341f37c/users/f292f8174a7a4de5bf8a848e49f85dbe/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:41.559418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bb3dc-3fcf-445a-be36-21e4e319fb1e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:41.562122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bb3dc-3fcf-445a-be36-21e4e319fb1e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:41.564653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bb3dc-3fcf-445a-be36-21e4e319fb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:41.617004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-299bb3dc-3fcf-445a-be36-21e4e319fb1e None None] MFA Rules not processed for user `f292f8174a7a4de5bf8a848e49f85dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:41.620566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-299bb3dc-3fcf-445a-be36-21e4e319fb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:41.734809 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3576/7065] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:41 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:41.745913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090c001-9469-43ad-b4a0-2f6743d6d284 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:41.891561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090c001-9469-43ad-b4a0-2f6743d6d284 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:41.908251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8807c73-1657-4744-bdd3-6409514c04b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:41.938289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8807c73-1657-4744-bdd3-6409514c04b6 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:41.938652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8807c73-1657-4744-bdd3-6409514c04b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:41.938937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8807c73-1657-4744-bdd3-6409514c04b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:41.948572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8807c73-1657-4744-bdd3-6409514c04b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:41.968421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8807c73-1657-4744-bdd3-6409514c04b6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:42.014130 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3490/7066] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:09:41 2021] POST /identity/v3/projects => generated 391 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:09:42.017947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bb3dc-3fcf-445a-be36-21e4e319fb1e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:42.029464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bb3dc-3fcf-445a-be36-21e4e319fb1e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:42.109840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605eb0bc-e5ed-4991-b671-adb0019b81c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:42.110552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605eb0bc-e5ed-4991-b671-adb0019b81c8 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:42.110834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605eb0bc-e5ed-4991-b671-adb0019b81c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:42.111111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605eb0bc-e5ed-4991-b671-adb0019b81c8 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:42.112412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605eb0bc-e5ed-4991-b671-adb0019b81c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:42.116521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605eb0bc-e5ed-4991-b671-adb0019b81c8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:42.143693 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3577/7067] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:09:42 2021] POST /identity/v3/users => generated 302 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:09:42.147563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8807c73-1657-4744-bdd3-6409514c04b6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:42.164054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8807c73-1657-4744-bdd3-6409514c04b6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:42.169846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefed69-46c3-4b8d-81f1-061c112ad9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:42.170642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefed69-46c3-4b8d-81f1-061c112ad9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:42.171013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefed69-46c3-4b8d-81f1-061c112ad9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:42.171383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefed69-46c3-4b8d-81f1-061c112ad9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:42.172183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefed69-46c3-4b8d-81f1-061c112ad9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:42.174200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefed69-46c3-4b8d-81f1-061c112ad9f7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:42.191103 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3491/7068] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:42 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:09:42.193239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605eb0bc-e5ed-4991-b671-adb0019b81c8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:42.209604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605eb0bc-e5ed-4991-b671-adb0019b81c8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:42.226146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066452e-b5f2-44be-b23e-00dc5611cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:42.227154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066452e-b5f2-44be-b23e-00dc5611cec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:42.227438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066452e-b5f2-44be-b23e-00dc5611cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:42.227718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066452e-b5f2-44be-b23e-00dc5611cec0 admin admin] PATH_INFO: `/v3/projects/d534e25782c045aeb336ae118921c450/users/0532fa2fbc544ce09628c91a9b834a05/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:42.265532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066452e-b5f2-44be-b23e-00dc5611cec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d534e25782c045aeb336ae118921c450, user_id=0532fa2fbc544ce09628c91a9b834a05, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:42.269941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066452e-b5f2-44be-b23e-00dc5611cec0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:42.308803 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3578/7069] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:09:42 2021] PUT /identity/v3/projects/d534e25782c045aeb336ae118921c450/users/0532fa2fbc544ce09628c91a9b834a05/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:42.314308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefed69-46c3-4b8d-81f1-061c112ad9f7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:42.330116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefed69-46c3-4b8d-81f1-061c112ad9f7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:42.539236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f35232-89c1-40bb-a490-249846f92286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:42.540537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f35232-89c1-40bb-a490-249846f92286 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:42.540869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f35232-89c1-40bb-a490-249846f92286 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:42.542501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f35232-89c1-40bb-a490-249846f92286 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:42.544757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f35232-89c1-40bb-a490-249846f92286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:42.546690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f35232-89c1-40bb-a490-249846f92286 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:42.583840 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3492/7070] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:42 2021] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:09:42.588021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066452e-b5f2-44be-b23e-00dc5611cec0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:42.608979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066452e-b5f2-44be-b23e-00dc5611cec0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:42.638882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16696247-29fc-4134-a29a-e32040b3ffdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:42.639792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16696247-29fc-4134-a29a-e32040b3ffdb admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:42.641405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f35232-89c1-40bb-a490-249846f92286 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:42.644508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-71f35232-89c1-40bb-a490-249846f92286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:42.648804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16696247-29fc-4134-a29a-e32040b3ffdb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:42.649128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16696247-29fc-4134-a29a-e32040b3ffdb admin admin] PATH_INFO: `/v3/projects/d534e25782c045aeb336ae118921c450/users/0532fa2fbc544ce09628c91a9b834a05/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:42.653461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16696247-29fc-4134-a29a-e32040b3ffdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d534e25782c045aeb336ae118921c450, user_id=0532fa2fbc544ce09628c91a9b834a05, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:42.665433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16696247-29fc-4134-a29a-e32040b3ffdb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:42.704748 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3579/7071] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:09:42 2021] PUT /identity/v3/projects/d534e25782c045aeb336ae118921c450/users/0532fa2fbc544ce09628c91a9b834a05/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:42.706882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6d9ae-0513-4946-8fd0-b685a33f6c3f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:42.708072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6d9ae-0513-4946-8fd0-b685a33f6c3f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:42.708757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6d9ae-0513-4946-8fd0-b685a33f6c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:42.773722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-85e6d9ae-0513-4946-8fd0-b685a33f6c3f None None] MFA Rules not processed for user `0532fa2fbc544ce09628c91a9b834a05`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:42.776713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-85e6d9ae-0513-4946-8fd0-b685a33f6c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:42.793561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f35232-89c1-40bb-a490-249846f92286 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:42.905022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd17d51-1b68-4b82-8938-40be0b986b3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:42.906300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd17d51-1b68-4b82-8938-40be0b986b3d service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:42.906829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd17d51-1b68-4b82-8938-40be0b986b3d service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:42.908862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd17d51-1b68-4b82-8938-40be0b986b3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:42.916318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4fd17d51-1b68-4b82-8938-40be0b986b3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:42.942673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd17d51-1b68-4b82-8938-40be0b986b3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:42.947251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd17d51-1b68-4b82-8938-40be0b986b3d service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:42.961666 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3493/7072] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:42 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:09:42.999655 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3580/7073] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:42 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:09:43.146539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd17d51-1b68-4b82-8938-40be0b986b3d service placement] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:43.149808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4fd17d51-1b68-4b82-8938-40be0b986b3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:43.358558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd17d51-1b68-4b82-8938-40be0b986b3d service placement] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:43.386140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d75b2-6173-461e-aad9-d2c01af32d53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:43.394558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d75b2-6173-461e-aad9-d2c01af32d53 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:43.395027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d75b2-6173-461e-aad9-d2c01af32d53 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:43.396426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d75b2-6173-461e-aad9-d2c01af32d53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:43.589827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d75b2-6173-461e-aad9-d2c01af32d53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:43.594931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d75b2-6173-461e-aad9-d2c01af32d53 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:43.624380 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3494/7074] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:43 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:09:44.982023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6d9ae-0513-4946-8fd0-b685a33f6c3f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:44.985171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-85e6d9ae-0513-4946-8fd0-b685a33f6c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:45.023406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6d9ae-0513-4946-8fd0-b685a33f6c3f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:45.034981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c82a9-7ef2-4b81-924e-eb6ecd8389fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:45.036198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c82a9-7ef2-4b81-924e-eb6ecd8389fc service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:45.036498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c82a9-7ef2-4b81-924e-eb6ecd8389fc service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:45.037369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c82a9-7ef2-4b81-924e-eb6ecd8389fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:45.041788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-321c82a9-7ef2-4b81-924e-eb6ecd8389fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:45.060681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c82a9-7ef2-4b81-924e-eb6ecd8389fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:45.062795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c82a9-7ef2-4b81-924e-eb6ecd8389fc service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:45.081167 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3581/7075] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:44 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:09:50.769018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d75b2-6173-461e-aad9-d2c01af32d53 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:50.771063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3f8d75b2-6173-461e-aad9-d2c01af32d53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:50.870956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d75b2-6173-461e-aad9-d2c01af32d53 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:50.886402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92889f3-2a44-46aa-bdad-a5a69929b7eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:50.887427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92889f3-2a44-46aa-bdad-a5a69929b7eb service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:50.887966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92889f3-2a44-46aa-bdad-a5a69929b7eb service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:50.888364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92889f3-2a44-46aa-bdad-a5a69929b7eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:50.905035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92889f3-2a44-46aa-bdad-a5a69929b7eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:50.907687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92889f3-2a44-46aa-bdad-a5a69929b7eb service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:50.933338 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3495/7076] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:09:50 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:09:56.156882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6c973-ba20-4a7c-a007-baa731fb0ef3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:56.157453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6c973-ba20-4a7c-a007-baa731fb0ef3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:56.158040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6c973-ba20-4a7c-a007-baa731fb0ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:56.206056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fcb6c973-ba20-4a7c-a007-baa731fb0ef3 None None] MFA Rules not processed for user `f292f8174a7a4de5bf8a848e49f85dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:56.207616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fcb6c973-ba20-4a7c-a007-baa731fb0ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:56.226470 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3582/7077] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:56 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:57.467137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92889f3-2a44-46aa-bdad-a5a69929b7eb service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:57.469177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f92889f3-2a44-46aa-bdad-a5a69929b7eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:57.577301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92889f3-2a44-46aa-bdad-a5a69929b7eb service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:57.590522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb45fd-82fd-40f8-b4b1-12085afe0a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:57.591847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb45fd-82fd-40f8-b4b1-12085afe0a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:57.592336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb45fd-82fd-40f8-b4b1-12085afe0a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:57.593579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb45fd-82fd-40f8-b4b1-12085afe0a10 admin admin] PATH_INFO: `/v3/users/b617862ad6f243249173f2c1eab95130` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:57.595370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb45fd-82fd-40f8-b4b1-12085afe0a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b617862ad6f243249173f2c1eab95130)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:57.599475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb45fd-82fd-40f8-b4b1-12085afe0a10 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:57.689218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2adb45fd-82fd-40f8-b4b1-12085afe0a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b617862ad6f243249173f2c1eab95130'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:57.699795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2adb45fd-82fd-40f8-b4b1-12085afe0a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b617862ad6f243249173f2c1eab95130'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:57.738093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2adb45fd-82fd-40f8-b4b1-12085afe0a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b617862ad6f243249173f2c1eab95130'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:57.738949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2adb45fd-82fd-40f8-b4b1-12085afe0a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b617862ad6f243249173f2c1eab95130'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:57.752012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2adb45fd-82fd-40f8-b4b1-12085afe0a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b617862ad6f243249173f2c1eab95130'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:57.759229 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3496/7078] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:09:57 2021] DELETE /identity/v3/users/b617862ad6f243249173f2c1eab95130 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:58.101817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6c973-ba20-4a7c-a007-baa731fb0ef3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:58.127360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6c973-ba20-4a7c-a007-baa731fb0ef3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:58.292018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509aaa3-aca4-4989-a076-bcc859297162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:58.293391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509aaa3-aca4-4989-a076-bcc859297162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:58.293842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509aaa3-aca4-4989-a076-bcc859297162 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:58.294085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509aaa3-aca4-4989-a076-bcc859297162 admin admin] PATH_INFO: `/v3/projects/8cd3a167092049489c79bc4681600124` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:58.298701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509aaa3-aca4-4989-a076-bcc859297162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cd3a167092049489c79bc4681600124)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:58.300719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509aaa3-aca4-4989-a076-bcc859297162 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:58.424105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f509aaa3-aca4-4989-a076-bcc859297162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cd3a167092049489c79bc4681600124', 'request_id': 'req-f509aaa3-aca4-4989-a076-bcc859297162'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:58.433506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f509aaa3-aca4-4989-a076-bcc859297162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cd3a167092049489c79bc4681600124', 'request_id': 'req-f509aaa3-aca4-4989-a076-bcc859297162'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:58.459130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f509aaa3-aca4-4989-a076-bcc859297162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cd3a167092049489c79bc4681600124', 'request_id': 'req-f509aaa3-aca4-4989-a076-bcc859297162'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:58.482541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f509aaa3-aca4-4989-a076-bcc859297162 admin admin] The token cache is being invalidate because project 8cd3a167092049489c79bc4681600124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:09:58.482946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f509aaa3-aca4-4989-a076-bcc859297162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:58.483818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f509aaa3-aca4-4989-a076-bcc859297162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:58.488581 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3583/7079] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:09:58 2021] DELETE /identity/v3/projects/8cd3a167092049489c79bc4681600124 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:58.492243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb45fd-82fd-40f8-b4b1-12085afe0a10 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:58.496230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2adb45fd-82fd-40f8-b4b1-12085afe0a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:58.513765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb45fd-82fd-40f8-b4b1-12085afe0a10 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:58.606053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7aa74d-4495-46bf-85c8-25b1e2116edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:58.609065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7aa74d-4495-46bf-85c8-25b1e2116edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:58.609365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7aa74d-4495-46bf-85c8-25b1e2116edb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:58.609850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7aa74d-4495-46bf-85c8-25b1e2116edb admin admin] PATH_INFO: `/v3/users/5b6c5f493055420abf17e11617df9ceb` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:58.611918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7aa74d-4495-46bf-85c8-25b1e2116edb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6c5f493055420abf17e11617df9ceb)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:58.615583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7aa74d-4495-46bf-85c8-25b1e2116edb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:58.743999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cc7aa74d-4495-46bf-85c8-25b1e2116edb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6c5f493055420abf17e11617df9ceb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:58.784516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cc7aa74d-4495-46bf-85c8-25b1e2116edb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6c5f493055420abf17e11617df9ceb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:58.814148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cc7aa74d-4495-46bf-85c8-25b1e2116edb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6c5f493055420abf17e11617df9ceb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:58.815182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cc7aa74d-4495-46bf-85c8-25b1e2116edb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6c5f493055420abf17e11617df9ceb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:58.842167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cc7aa74d-4495-46bf-85c8-25b1e2116edb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6c5f493055420abf17e11617df9ceb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:58.853518 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3497/7080] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:09:58 2021] DELETE /identity/v3/users/5b6c5f493055420abf17e11617df9ceb => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:59.163701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509aaa3-aca4-4989-a076-bcc859297162 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:59.168741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f509aaa3-aca4-4989-a076-bcc859297162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:59.196209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509aaa3-aca4-4989-a076-bcc859297162 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:59.325566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c25c5-6590-4481-be09-8ffb97cb2655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:59.326598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c25c5-6590-4481-be09-8ffb97cb2655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:59.326882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c25c5-6590-4481-be09-8ffb97cb2655 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:59.327160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c25c5-6590-4481-be09-8ffb97cb2655 admin admin] PATH_INFO: `/v3/projects/e361f6dac643438a9702f4b3c7dd9502` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:59.329036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c25c5-6590-4481-be09-8ffb97cb2655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e361f6dac643438a9702f4b3c7dd9502)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:59.331344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c25c5-6590-4481-be09-8ffb97cb2655 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:59.397820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7e6c25c5-6590-4481-be09-8ffb97cb2655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e361f6dac643438a9702f4b3c7dd9502', 'request_id': 'req-7e6c25c5-6590-4481-be09-8ffb97cb2655'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:59.407579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7e6c25c5-6590-4481-be09-8ffb97cb2655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e361f6dac643438a9702f4b3c7dd9502', 'request_id': 'req-7e6c25c5-6590-4481-be09-8ffb97cb2655'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:59.418381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7e6c25c5-6590-4481-be09-8ffb97cb2655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e361f6dac643438a9702f4b3c7dd9502', 'request_id': 'req-7e6c25c5-6590-4481-be09-8ffb97cb2655'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:59.436516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7e6c25c5-6590-4481-be09-8ffb97cb2655 admin admin] The token cache is being invalidate because project e361f6dac643438a9702f4b3c7dd9502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:09:59.438004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7e6c25c5-6590-4481-be09-8ffb97cb2655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:59.440220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7e6c25c5-6590-4481-be09-8ffb97cb2655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:09:59.442953 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3584/7081] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:09:59 2021] DELETE /identity/v3/projects/e361f6dac643438a9702f4b3c7dd9502 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:09:59.449186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc0a8f-f76f-4262-aa8b-7d89261b4ff4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:59.449480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc0a8f-f76f-4262-aa8b-7d89261b4ff4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:59.453066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc0a8f-f76f-4262-aa8b-7d89261b4ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:59.507063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e7fc0a8f-f76f-4262-aa8b-7d89261b4ff4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:59.508319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e7fc0a8f-f76f-4262-aa8b-7d89261b4ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:59.618914 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3498/7082] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:59.628833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76a9c2-c004-432b-bde0-47ddedc561ac None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:59.630115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76a9c2-c004-432b-bde0-47ddedc561ac None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:59.630748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76a9c2-c004-432b-bde0-47ddedc561ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:59.657582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8e76a9c2-c004-432b-bde0-47ddedc561ac None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:09:59.659896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8e76a9c2-c004-432b-bde0-47ddedc561ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:09:59.679589 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3585/7083] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:09:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:09:59.680562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc0a8f-f76f-4262-aa8b-7d89261b4ff4 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:59.697787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc0a8f-f76f-4262-aa8b-7d89261b4ff4 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:59.715724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3282f1-2d24-429e-8e2c-3ba690bbd8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:59.717339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3282f1-2d24-429e-8e2c-3ba690bbd8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:59.723373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3282f1-2d24-429e-8e2c-3ba690bbd8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:59.723891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3282f1-2d24-429e-8e2c-3ba690bbd8e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:59.724801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3282f1-2d24-429e-8e2c-3ba690bbd8e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:09:59.725110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3282f1-2d24-429e-8e2c-3ba690bbd8e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:59.726911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3282f1-2d24-429e-8e2c-3ba690bbd8e0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:59.763236 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3499/7084] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:09:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:09:59.767868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76a9c2-c004-432b-bde0-47ddedc561ac None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:59.783989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76a9c2-c004-432b-bde0-47ddedc561ac None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:59.792830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dcf79-31e5-4609-a9ce-b46bc06724e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:59.795189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dcf79-31e5-4609-a9ce-b46bc06724e5 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:59.796396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dcf79-31e5-4609-a9ce-b46bc06724e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:59.796996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dcf79-31e5-4609-a9ce-b46bc06724e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:59.799854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2dcf79-31e5-4609-a9ce-b46bc06724e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:59.802701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2dcf79-31e5-4609-a9ce-b46bc06724e5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:59.842389 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3586/7085] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:09:59 2021] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:09:59.846852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3282f1-2d24-429e-8e2c-3ba690bbd8e0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:59.863079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3282f1-2d24-429e-8e2c-3ba690bbd8e0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:59.934471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe11d2-932e-43b2-90ed-f90cb8aa5693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:59.935515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe11d2-932e-43b2-90ed-f90cb8aa5693 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:59.936002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe11d2-932e-43b2-90ed-f90cb8aa5693 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:59.936349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe11d2-932e-43b2-90ed-f90cb8aa5693 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:09:59.937299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe11d2-932e-43b2-90ed-f90cb8aa5693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:09:59.939545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe11d2-932e-43b2-90ed-f90cb8aa5693 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:09:59.968715 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3500/7086] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:09:59 2021] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:09:59.972727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dcf79-31e5-4609-a9ce-b46bc06724e5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:09:59.987218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dcf79-31e5-4609-a9ce-b46bc06724e5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:09:59.996931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0766f0-9a00-4731-8ade-974f35c78f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:09:59.997622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0766f0-9a00-4731-8ade-974f35c78f04 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:09:59.998980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0766f0-9a00-4731-8ade-974f35c78f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:09:59.999739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0766f0-9a00-4731-8ade-974f35c78f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:00.001070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0766f0-9a00-4731-8ade-974f35c78f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:00.003311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0766f0-9a00-4731-8ade-974f35c78f04 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:00.018950 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3587/7087] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:09:59 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:10:00.023014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe11d2-932e-43b2-90ed-f90cb8aa5693 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:00.036207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe11d2-932e-43b2-90ed-f90cb8aa5693 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:00.043450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fe392-edf9-4963-a501-b620c71c0440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:00.044140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fe392-edf9-4963-a501-b620c71c0440 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:00.044434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fe392-edf9-4963-a501-b620c71c0440 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:00.044714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fe392-edf9-4963-a501-b620c71c0440 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:00.045463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fe392-edf9-4963-a501-b620c71c0440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:00.047451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fe392-edf9-4963-a501-b620c71c0440 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:00.062567 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3501/7088] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:10:00 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:10:00.068072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0766f0-9a00-4731-8ade-974f35c78f04 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:00.080740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0766f0-9a00-4731-8ade-974f35c78f04 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:00.087792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6790572-248f-460b-927a-eea61618a5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:00.089044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6790572-248f-460b-927a-eea61618a5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:00.089663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6790572-248f-460b-927a-eea61618a5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:00.090161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6790572-248f-460b-927a-eea61618a5b3 admin admin] PATH_INFO: `/v3/projects/62fd960aee2d408d8c9977b60fcabd61/users/0a9b1c58215046afb6974d9a4b654326/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:00.108691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6790572-248f-460b-927a-eea61618a5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62fd960aee2d408d8c9977b60fcabd61, user_id=0a9b1c58215046afb6974d9a4b654326, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:00.111876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6790572-248f-460b-927a-eea61618a5b3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:00.131163 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3588/7089] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:10:00 2021] PUT /identity/v3/projects/62fd960aee2d408d8c9977b60fcabd61/users/0a9b1c58215046afb6974d9a4b654326/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:10:00.137385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5cde9-59d3-4b98-a5cd-0e78856e9c7d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:00.137977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5cde9-59d3-4b98-a5cd-0e78856e9c7d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:00.138454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5cde9-59d3-4b98-a5cd-0e78856e9c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:00.166966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8ff5cde9-59d3-4b98-a5cd-0e78856e9c7d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:10:00.169365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8ff5cde9-59d3-4b98-a5cd-0e78856e9c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:00.258453 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3502/7090] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:10:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:10:00.268459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6790572-248f-460b-927a-eea61618a5b3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:00.270610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c6790572-248f-460b-927a-eea61618a5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:00.367007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6790572-248f-460b-927a-eea61618a5b3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:00.371994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074860b8-784a-44ef-860f-f51ca1727cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:00.372716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074860b8-784a-44ef-860f-f51ca1727cfb service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:00.373003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074860b8-784a-44ef-860f-f51ca1727cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:00.373282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074860b8-784a-44ef-860f-f51ca1727cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:00.390306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074860b8-784a-44ef-860f-f51ca1727cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:00.390306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074860b8-784a-44ef-860f-f51ca1727cfb service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:00.425669 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3589/7091] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:10:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:10:10.578004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090530eb-9b54-4deb-881b-97c3d777e81e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:10.578634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090530eb-9b54-4deb-881b-97c3d777e81e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:10.578760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090530eb-9b54-4deb-881b-97c3d777e81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:10.630054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-090530eb-9b54-4deb-881b-97c3d777e81e None None] MFA Rules not processed for user `0a9b1c58215046afb6974d9a4b654326`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:10:10.632740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-090530eb-9b54-4deb-881b-97c3d777e81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:10.774517 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3503/7092] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:10:10 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:10:10.776590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074860b8-784a-44ef-860f-f51ca1727cfb service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:10.789452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074860b8-784a-44ef-860f-f51ca1727cfb service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:10.796551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846b568-5a23-455a-b1e7-b822ffe57133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:10.797253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846b568-5a23-455a-b1e7-b822ffe57133 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:10.798002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846b568-5a23-455a-b1e7-b822ffe57133 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:10.798438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846b568-5a23-455a-b1e7-b822ffe57133 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:10.801645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846b568-5a23-455a-b1e7-b822ffe57133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:10.804127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846b568-5a23-455a-b1e7-b822ffe57133 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:10.854191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090530eb-9b54-4deb-881b-97c3d777e81e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:10.854433 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3590/7093] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:10:10 2021] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:10:10.870031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090530eb-9b54-4deb-881b-97c3d777e81e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:10.967234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5380e60-e7ee-4876-b4bb-c7e57e366120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:10.968996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5380e60-e7ee-4876-b4bb-c7e57e366120 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:10.969382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5380e60-e7ee-4876-b4bb-c7e57e366120 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:10.969936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5380e60-e7ee-4876-b4bb-c7e57e366120 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:10.971117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5380e60-e7ee-4876-b4bb-c7e57e366120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:10.974090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5380e60-e7ee-4876-b4bb-c7e57e366120 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:11.003378 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3504/7094] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:10:10 2021] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:10:11.007434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846b568-5a23-455a-b1e7-b822ffe57133 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:11.022305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846b568-5a23-455a-b1e7-b822ffe57133 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:11.032615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18df26-ec0a-4fbf-8835-37834b10ab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:11.033453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18df26-ec0a-4fbf-8835-37834b10ab40 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:11.033917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18df26-ec0a-4fbf-8835-37834b10ab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:11.034338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18df26-ec0a-4fbf-8835-37834b10ab40 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:11.035385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18df26-ec0a-4fbf-8835-37834b10ab40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:11.037623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18df26-ec0a-4fbf-8835-37834b10ab40 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:11.057145 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3591/7095] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:10:11 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:10:11.061317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5380e60-e7ee-4876-b4bb-c7e57e366120 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:11.083589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5380e60-e7ee-4876-b4bb-c7e57e366120 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:11.090309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe959fa2-5ee4-42a7-8a4b-6819420301af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:11.091527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe959fa2-5ee4-42a7-8a4b-6819420301af admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:11.092122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe959fa2-5ee4-42a7-8a4b-6819420301af admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:11.092293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe959fa2-5ee4-42a7-8a4b-6819420301af admin admin] PATH_INFO: `/v3/projects/5db10117831d4d9396e883590d0cf553/users/f028f89238aa4b1aa010d8fc205feea3/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:11.130017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe959fa2-5ee4-42a7-8a4b-6819420301af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db10117831d4d9396e883590d0cf553, user_id=f028f89238aa4b1aa010d8fc205feea3, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:11.135145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe959fa2-5ee4-42a7-8a4b-6819420301af admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:11.182718 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3505/7096] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:10:11 2021] PUT /identity/v3/projects/5db10117831d4d9396e883590d0cf553/users/f028f89238aa4b1aa010d8fc205feea3/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:10:11.185780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18df26-ec0a-4fbf-8835-37834b10ab40 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:11.199544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18df26-ec0a-4fbf-8835-37834b10ab40 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:11.354907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7401058-513e-49f2-8f6a-8c907c3ae9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:11.355533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7401058-513e-49f2-8f6a-8c907c3ae9fd admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:11.356016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7401058-513e-49f2-8f6a-8c907c3ae9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:11.356310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7401058-513e-49f2-8f6a-8c907c3ae9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:11.357074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7401058-513e-49f2-8f6a-8c907c3ae9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:11.360941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7401058-513e-49f2-8f6a-8c907c3ae9fd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:11.374347 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3592/7097] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:10:11 2021] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:10:11.378505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe959fa2-5ee4-42a7-8a4b-6819420301af admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:11.391869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe959fa2-5ee4-42a7-8a4b-6819420301af admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:11.397779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfabdb-568c-477d-bfff-43921d9bb2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:11.401172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfabdb-568c-477d-bfff-43921d9bb2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:11.401172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfabdb-568c-477d-bfff-43921d9bb2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:11.401172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfabdb-568c-477d-bfff-43921d9bb2b2 admin admin] PATH_INFO: `/v3/projects/5db10117831d4d9396e883590d0cf553/users/f028f89238aa4b1aa010d8fc205feea3/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:11.404501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfabdb-568c-477d-bfff-43921d9bb2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db10117831d4d9396e883590d0cf553, user_id=f028f89238aa4b1aa010d8fc205feea3, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:11.409274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfabdb-568c-477d-bfff-43921d9bb2b2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:11.425047 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3506/7098] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:10:11 2021] PUT /identity/v3/projects/5db10117831d4d9396e883590d0cf553/users/f028f89238aa4b1aa010d8fc205feea3/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:10:19.465601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74296e3-6e4b-4f3a-adf5-b5c1f994934b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:19.466147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74296e3-6e4b-4f3a-adf5-b5c1f994934b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:19.466881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74296e3-6e4b-4f3a-adf5-b5c1f994934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:19.516485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a74296e3-6e4b-4f3a-adf5-b5c1f994934b None None] MFA Rules not processed for user `f028f89238aa4b1aa010d8fc205feea3`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:10:19.517976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a74296e3-6e4b-4f3a-adf5-b5c1f994934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:19.631969 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3593/7099] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:10:19 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:10:19.649325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfabdb-568c-477d-bfff-43921d9bb2b2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:19.652710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b1cfabdb-568c-477d-bfff-43921d9bb2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:19.742468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfabdb-568c-477d-bfff-43921d9bb2b2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:19.747094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafdcec-5209-4043-a64b-b279fc0877e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:19.748348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafdcec-5209-4043-a64b-b279fc0877e0 service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:19.748348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafdcec-5209-4043-a64b-b279fc0877e0 service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:19.748713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafdcec-5209-4043-a64b-b279fc0877e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:19.828029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafdcec-5209-4043-a64b-b279fc0877e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:19.830020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafdcec-5209-4043-a64b-b279fc0877e0 service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:19.844935 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3507/7100] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:10:19 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:10:26.277075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74296e3-6e4b-4f3a-adf5-b5c1f994934b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:26.278992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a74296e3-6e4b-4f3a-adf5-b5c1f994934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:26.349185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74296e3-6e4b-4f3a-adf5-b5c1f994934b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:26.353082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba82163-5358-4a0e-b509-820c7c8873c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:26.353793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba82163-5358-4a0e-b509-820c7c8873c1 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:26.354181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba82163-5358-4a0e-b509-820c7c8873c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:26.354630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba82163-5358-4a0e-b509-820c7c8873c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:26.356473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fba82163-5358-4a0e-b509-820c7c8873c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:26.439962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba82163-5358-4a0e-b509-820c7c8873c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:26.441431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba82163-5358-4a0e-b509-820c7c8873c1 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:26.453678 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3594/7101] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:10:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:10:34.499856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafdcec-5209-4043-a64b-b279fc0877e0 service glance] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:34.501576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5cafdcec-5209-4043-a64b-b279fc0877e0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:34.518846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafdcec-5209-4043-a64b-b279fc0877e0 service glance] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:34.525107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca624e-5b0f-4c95-b4a9-11fb9fd13f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:34.526005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca624e-5b0f-4c95-b4a9-11fb9fd13f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:34.526347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca624e-5b0f-4c95-b4a9-11fb9fd13f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:34.526631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca624e-5b0f-4c95-b4a9-11fb9fd13f05 admin admin] PATH_INFO: `/v3/users/e80a2e31964348e7b4abd7c321e713b7` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:34.543511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca624e-5b0f-4c95-b4a9-11fb9fd13f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e80a2e31964348e7b4abd7c321e713b7)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:34.545858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca624e-5b0f-4c95-b4a9-11fb9fd13f05 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:34.599614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-77ca624e-5b0f-4c95-b4a9-11fb9fd13f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e80a2e31964348e7b4abd7c321e713b7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:34.607965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-77ca624e-5b0f-4c95-b4a9-11fb9fd13f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e80a2e31964348e7b4abd7c321e713b7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:34.622751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-77ca624e-5b0f-4c95-b4a9-11fb9fd13f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e80a2e31964348e7b4abd7c321e713b7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:34.623501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-77ca624e-5b0f-4c95-b4a9-11fb9fd13f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e80a2e31964348e7b4abd7c321e713b7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:34.633728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-77ca624e-5b0f-4c95-b4a9-11fb9fd13f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e80a2e31964348e7b4abd7c321e713b7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:34.645962 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3508/7102] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:10:34 2021] DELETE /identity/v3/users/e80a2e31964348e7b4abd7c321e713b7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:10:34.924628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba82163-5358-4a0e-b509-820c7c8873c1 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:34.939853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba82163-5358-4a0e-b509-820c7c8873c1 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:35.041541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0513633-dab0-4897-8882-e26cbc6a7f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:35.042436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0513633-dab0-4897-8882-e26cbc6a7f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:35.042718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0513633-dab0-4897-8882-e26cbc6a7f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:35.042993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0513633-dab0-4897-8882-e26cbc6a7f6a admin admin] PATH_INFO: `/v3/projects/08fc19b054a54a08aec65b0870725eb8` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:35.054022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0513633-dab0-4897-8882-e26cbc6a7f6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=08fc19b054a54a08aec65b0870725eb8)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:35.055937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0513633-dab0-4897-8882-e26cbc6a7f6a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:35.103934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a0513633-dab0-4897-8882-e26cbc6a7f6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08fc19b054a54a08aec65b0870725eb8', 'request_id': 'req-a0513633-dab0-4897-8882-e26cbc6a7f6a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:35.111452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a0513633-dab0-4897-8882-e26cbc6a7f6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08fc19b054a54a08aec65b0870725eb8', 'request_id': 'req-a0513633-dab0-4897-8882-e26cbc6a7f6a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:35.120016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a0513633-dab0-4897-8882-e26cbc6a7f6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08fc19b054a54a08aec65b0870725eb8', 'request_id': 'req-a0513633-dab0-4897-8882-e26cbc6a7f6a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:35.132351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a0513633-dab0-4897-8882-e26cbc6a7f6a admin admin] The token cache is being invalidate because project 08fc19b054a54a08aec65b0870725eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:10:35.132857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a0513633-dab0-4897-8882-e26cbc6a7f6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:35.133530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a0513633-dab0-4897-8882-e26cbc6a7f6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:35.135117 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3595/7103] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:10:34 2021] DELETE /identity/v3/projects/08fc19b054a54a08aec65b0870725eb8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:10:35.139020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca624e-5b0f-4c95-b4a9-11fb9fd13f05 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:35.140498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-77ca624e-5b0f-4c95-b4a9-11fb9fd13f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:35.157440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca624e-5b0f-4c95-b4a9-11fb9fd13f05 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:35.214367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16bb55-475e-4096-a3d1-6d2a08899ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:35.215266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16bb55-475e-4096-a3d1-6d2a08899ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:35.215548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16bb55-475e-4096-a3d1-6d2a08899ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:35.215874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16bb55-475e-4096-a3d1-6d2a08899ad7 admin admin] PATH_INFO: `/v3/users/fd8352549adc473a8578968edb4653b6` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:35.228804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16bb55-475e-4096-a3d1-6d2a08899ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd8352549adc473a8578968edb4653b6)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:35.230757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16bb55-475e-4096-a3d1-6d2a08899ad7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:35.274071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ed16bb55-475e-4096-a3d1-6d2a08899ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd8352549adc473a8578968edb4653b6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:35.280640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ed16bb55-475e-4096-a3d1-6d2a08899ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd8352549adc473a8578968edb4653b6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:35.291809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ed16bb55-475e-4096-a3d1-6d2a08899ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd8352549adc473a8578968edb4653b6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:35.292467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ed16bb55-475e-4096-a3d1-6d2a08899ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd8352549adc473a8578968edb4653b6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:35.299382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ed16bb55-475e-4096-a3d1-6d2a08899ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd8352549adc473a8578968edb4653b6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:35.305151 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3509/7104] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:10:35 2021] DELETE /identity/v3/users/fd8352549adc473a8578968edb4653b6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:10:35.474767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0513633-dab0-4897-8882-e26cbc6a7f6a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:35.476694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a0513633-dab0-4897-8882-e26cbc6a7f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:35.491547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0513633-dab0-4897-8882-e26cbc6a7f6a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:35.546168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d702ba-f9aa-41f8-8a2a-f8780d8a8d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:35.547225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d702ba-f9aa-41f8-8a2a-f8780d8a8d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:35.547517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d702ba-f9aa-41f8-8a2a-f8780d8a8d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:35.547825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d702ba-f9aa-41f8-8a2a-f8780d8a8d87 admin admin] PATH_INFO: `/v3/projects/b66794ba47ff4407b4073a90be2df125` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:35.558329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d702ba-f9aa-41f8-8a2a-f8780d8a8d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66794ba47ff4407b4073a90be2df125)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:35.560207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d702ba-f9aa-41f8-8a2a-f8780d8a8d87 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:35.606544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f2d702ba-f9aa-41f8-8a2a-f8780d8a8d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66794ba47ff4407b4073a90be2df125', 'request_id': 'req-f2d702ba-f9aa-41f8-8a2a-f8780d8a8d87'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:35.613029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f2d702ba-f9aa-41f8-8a2a-f8780d8a8d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66794ba47ff4407b4073a90be2df125', 'request_id': 'req-f2d702ba-f9aa-41f8-8a2a-f8780d8a8d87'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:35.619942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f2d702ba-f9aa-41f8-8a2a-f8780d8a8d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66794ba47ff4407b4073a90be2df125', 'request_id': 'req-f2d702ba-f9aa-41f8-8a2a-f8780d8a8d87'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:35.629896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f2d702ba-f9aa-41f8-8a2a-f8780d8a8d87 admin admin] The token cache is being invalidate because project b66794ba47ff4407b4073a90be2df125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:10:35.630185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f2d702ba-f9aa-41f8-8a2a-f8780d8a8d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:35.630845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f2d702ba-f9aa-41f8-8a2a-f8780d8a8d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:10:35.632650 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3596/7105] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:10:35 2021] DELETE /identity/v3/projects/b66794ba47ff4407b4073a90be2df125 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:10:35.638155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ac6e0-eda7-436e-8049-b4c7876142cc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:35.638669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ac6e0-eda7-436e-8049-b4c7876142cc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:35.638773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ac6e0-eda7-436e-8049-b4c7876142cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:35.657407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-398ac6e0-eda7-436e-8049-b4c7876142cc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:10:35.658639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-398ac6e0-eda7-436e-8049-b4c7876142cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:35.721519 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3510/7106] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:10:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:10:35.730708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10db15-e3be-440b-a276-430bb4a085da None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:35.730997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10db15-e3be-440b-a276-430bb4a085da None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:35.731294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10db15-e3be-440b-a276-430bb4a085da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:35.755822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7f10db15-e3be-440b-a276-430bb4a085da None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:10:35.757064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7f10db15-e3be-440b-a276-430bb4a085da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:35.769267 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3597/7107] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:10:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:10:35.773485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ac6e0-eda7-436e-8049-b4c7876142cc None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:35.785028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ac6e0-eda7-436e-8049-b4c7876142cc None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:35.790836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344b517-5fe1-44bb-9c0c-423c6546b098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:35.791509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344b517-5fe1-44bb-9c0c-423c6546b098 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:35.791800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344b517-5fe1-44bb-9c0c-423c6546b098 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:35.792084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344b517-5fe1-44bb-9c0c-423c6546b098 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:35.792831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344b517-5fe1-44bb-9c0c-423c6546b098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:10:35.793169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344b517-5fe1-44bb-9c0c-423c6546b098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:35.794780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344b517-5fe1-44bb-9c0c-423c6546b098 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:35.810521 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3511/7108] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:10:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:10:35.813286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10db15-e3be-440b-a276-430bb4a085da None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:35.823869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10db15-e3be-440b-a276-430bb4a085da None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:35.828618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ecaee-1db3-4d42-9a93-5e5525ea5791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:35.829286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ecaee-1db3-4d42-9a93-5e5525ea5791 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:35.829554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ecaee-1db3-4d42-9a93-5e5525ea5791 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:35.829831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ecaee-1db3-4d42-9a93-5e5525ea5791 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:35.830582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ecaee-1db3-4d42-9a93-5e5525ea5791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:35.836225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ecaee-1db3-4d42-9a93-5e5525ea5791 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:35.875978 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3598/7109] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:10:35 2021] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:10:35.879997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344b517-5fe1-44bb-9c0c-423c6546b098 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:35.891361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344b517-5fe1-44bb-9c0c-423c6546b098 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:35.949040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd19b55-4fe2-4cc7-a79f-b54cdb00f4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:35.949847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd19b55-4fe2-4cc7-a79f-b54cdb00f4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:35.950166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd19b55-4fe2-4cc7-a79f-b54cdb00f4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:35.950480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd19b55-4fe2-4cc7-a79f-b54cdb00f4a9 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:35.951189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd19b55-4fe2-4cc7-a79f-b54cdb00f4a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:35.953172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd19b55-4fe2-4cc7-a79f-b54cdb00f4a9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:35.978856 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3512/7110] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:10:35 2021] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:10:35.980386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ecaee-1db3-4d42-9a93-5e5525ea5791 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:35.992336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ecaee-1db3-4d42-9a93-5e5525ea5791 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:35.997317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f4597-ed73-4450-94a4-2183d4cb408c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:35.997979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f4597-ed73-4450-94a4-2183d4cb408c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:35.998508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f4597-ed73-4450-94a4-2183d4cb408c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:35.998845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f4597-ed73-4450-94a4-2183d4cb408c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:35.999729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f4597-ed73-4450-94a4-2183d4cb408c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:36.001380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f4597-ed73-4450-94a4-2183d4cb408c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:36.013075 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3599/7111] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:10:35 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:10:36.017458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd19b55-4fe2-4cc7-a79f-b54cdb00f4a9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:36.028230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd19b55-4fe2-4cc7-a79f-b54cdb00f4a9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:36.032872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140dafba-90cb-4a36-84fb-9aa7bf672dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:36.033531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dafba-90cb-4a36-84fb-9aa7bf672dec admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:36.033815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dafba-90cb-4a36-84fb-9aa7bf672dec admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:36.034122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dafba-90cb-4a36-84fb-9aa7bf672dec admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:36.034909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140dafba-90cb-4a36-84fb-9aa7bf672dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:36.036480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140dafba-90cb-4a36-84fb-9aa7bf672dec admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:36.046841 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3513/7112] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:10:36 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:10:36.050956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f4597-ed73-4450-94a4-2183d4cb408c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:36.061699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f4597-ed73-4450-94a4-2183d4cb408c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:36.066676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694df403-2d41-443e-af41-f023702f9adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:36.067820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694df403-2d41-443e-af41-f023702f9adc admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:36.068106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694df403-2d41-443e-af41-f023702f9adc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:36.068388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694df403-2d41-443e-af41-f023702f9adc admin admin] PATH_INFO: `/v3/projects/c36bc0b6ca0849f58c6b8f41df80db6f/users/b49bec6d90274fde9af81d52cc9bbf30/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:36.083279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694df403-2d41-443e-af41-f023702f9adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c36bc0b6ca0849f58c6b8f41df80db6f, user_id=b49bec6d90274fde9af81d52cc9bbf30, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:36.085953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694df403-2d41-443e-af41-f023702f9adc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:36.099351 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3600/7113] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:10:36 2021] PUT /identity/v3/projects/c36bc0b6ca0849f58c6b8f41df80db6f/users/b49bec6d90274fde9af81d52cc9bbf30/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:10:36.104789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67698cae-0045-4338-9001-5ebfb1a14caa None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:36.105083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67698cae-0045-4338-9001-5ebfb1a14caa None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:36.105366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67698cae-0045-4338-9001-5ebfb1a14caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:36.123779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-67698cae-0045-4338-9001-5ebfb1a14caa None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:10:36.124949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-67698cae-0045-4338-9001-5ebfb1a14caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:36.184102 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3514/7114] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:10:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:10:36.196411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694df403-2d41-443e-af41-f023702f9adc admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:36.198243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-694df403-2d41-443e-af41-f023702f9adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:36.261324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694df403-2d41-443e-af41-f023702f9adc admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:36.265186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda3d7c-ad5f-45bd-9eeb-80ec738449ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:36.265940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda3d7c-ad5f-45bd-9eeb-80ec738449ff service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:36.266367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda3d7c-ad5f-45bd-9eeb-80ec738449ff service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:36.266750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda3d7c-ad5f-45bd-9eeb-80ec738449ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:36.276838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda3d7c-ad5f-45bd-9eeb-80ec738449ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:36.278433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda3d7c-ad5f-45bd-9eeb-80ec738449ff service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:36.288927 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3601/7115] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:10:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:10:37.089886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277455f-60da-429b-84dc-ac89052eb699 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:37.090450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277455f-60da-429b-84dc-ac89052eb699 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:37.090538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277455f-60da-429b-84dc-ac89052eb699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:37.143491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d277455f-60da-429b-84dc-ac89052eb699 None None] MFA Rules not processed for user `b49bec6d90274fde9af81d52cc9bbf30`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:10:37.145115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d277455f-60da-429b-84dc-ac89052eb699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:37.317242 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3515/7116] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:10:37 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:10:37.327974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6bd24-9181-460b-9bee-061874a4f35e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:37.328938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6bd24-9181-460b-9bee-061874a4f35e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:37.329483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6bd24-9181-460b-9bee-061874a4f35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:37.356900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9ad6bd24-9181-460b-9bee-061874a4f35e None None] MFA Rules not processed for user `b49bec6d90274fde9af81d52cc9bbf30`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:10:37.358867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9ad6bd24-9181-460b-9bee-061874a4f35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:37.378606 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3602/7117] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:10:37 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:10:37.387225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277455f-60da-429b-84dc-ac89052eb699 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:37.389027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d277455f-60da-429b-84dc-ac89052eb699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:37.557813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277455f-60da-429b-84dc-ac89052eb699 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:37.581484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea80be-81b8-4f5d-afcd-5f70e22e13c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:37.581484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea80be-81b8-4f5d-afcd-5f70e22e13c3 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:37.581484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea80be-81b8-4f5d-afcd-5f70e22e13c3 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:37.581484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea80be-81b8-4f5d-afcd-5f70e22e13c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:37.595367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea80be-81b8-4f5d-afcd-5f70e22e13c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:37.599402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea80be-81b8-4f5d-afcd-5f70e22e13c3 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:37.610994 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3516/7118] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:10:37 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:10:41.186767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d23bc-9796-4bcb-bf90-5c491de8ff54 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:41.187294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d23bc-9796-4bcb-bf90-5c491de8ff54 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:41.187395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d23bc-9796-4bcb-bf90-5c491de8ff54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:41.206396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-852d23bc-9796-4bcb-bf90-5c491de8ff54 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:10:41.207674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-852d23bc-9796-4bcb-bf90-5c491de8ff54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:41.264957 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3603/7119] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 21:10:41 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:10:41.324219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea80be-81b8-4f5d-afcd-5f70e22e13c3 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:41.325695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-47ea80be-81b8-4f5d-afcd-5f70e22e13c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:41.425242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea80be-81b8-4f5d-afcd-5f70e22e13c3 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:41.431267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b147a96-0446-4f95-8761-f7fc89f061bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:41.431961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b147a96-0446-4f95-8761-f7fc89f061bc service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:41.432252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b147a96-0446-4f95-8761-f7fc89f061bc service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:41.432564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b147a96-0446-4f95-8761-f7fc89f061bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:41.441520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b147a96-0446-4f95-8761-f7fc89f061bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:41.443405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b147a96-0446-4f95-8761-f7fc89f061bc service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:41.452022 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3517/7120] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:10:41 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:10:44.631032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbcc6f-b7b2-4a15-bece-4e248ed83fc3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:44.631554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbcc6f-b7b2-4a15-bece-4e248ed83fc3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:44.631865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbcc6f-b7b2-4a15-bece-4e248ed83fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:44.650045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a7bbcc6f-b7b2-4a15-bece-4e248ed83fc3 None None] MFA Rules not processed for user `0a9b1c58215046afb6974d9a4b654326`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:10:44.651455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a7bbcc6f-b7b2-4a15-bece-4e248ed83fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:44.704329 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3604/7121] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:10:44 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:10:45.901255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be181ee2-bdd7-4aeb-bb08-82cec57e0640 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:45.901820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be181ee2-bdd7-4aeb-bb08-82cec57e0640 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:45.901922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be181ee2-bdd7-4aeb-bb08-82cec57e0640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:45.920862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-be181ee2-bdd7-4aeb-bb08-82cec57e0640 None None] MFA Rules not processed for user `d32598482c834073b8fe24c84cb57d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:10:45.922138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-be181ee2-bdd7-4aeb-bb08-82cec57e0640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:45.989415 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3518/7122] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:10:45 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:10:51.018289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa66c4-34d6-468c-b5f1-4075fcd5ae6f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:51.018802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa66c4-34d6-468c-b5f1-4075fcd5ae6f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:51.018802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa66c4-34d6-468c-b5f1-4075fcd5ae6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:51.048852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bcaa66c4-34d6-468c-b5f1-4075fcd5ae6f None None] MFA Rules not processed for user `b49bec6d90274fde9af81d52cc9bbf30`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:10:51.050509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bcaa66c4-34d6-468c-b5f1-4075fcd5ae6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:51.060827 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3605/7123] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:10:51 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:10:52.093998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c802e0-3cf2-4da6-b07a-b1a5515e3f7a None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:52.095043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c802e0-3cf2-4da6-b07a-b1a5515e3f7a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:52.095538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c802e0-3cf2-4da6-b07a-b1a5515e3f7a None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:52.098667 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3519/7124] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 21:10:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 21:10:52.106043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3af7-bb35-4aba-bdcc-1307efb8d528 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:52.106554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3af7-bb35-4aba-bdcc-1307efb8d528 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:52.106850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3af7-bb35-4aba-bdcc-1307efb8d528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:52.164951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-591b3af7-bb35-4aba-bdcc-1307efb8d528 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:10:52.166533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-591b3af7-bb35-4aba-bdcc-1307efb8d528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:52.250406 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3606/7125] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:10:52 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:10:52.278737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c802e0-3cf2-4da6-b07a-b1a5515e3f7a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:52.280909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c7c802e0-3cf2-4da6-b07a-b1a5515e3f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:52.294802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b3af7-bb35-4aba-bdcc-1307efb8d528 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:52.297408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-591b3af7-bb35-4aba-bdcc-1307efb8d528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:52.316739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c802e0-3cf2-4da6-b07a-b1a5515e3f7a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:52.318896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b3af7-bb35-4aba-bdcc-1307efb8d528 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:52.324039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe406cf-4e68-4b22-897d-34925bb4cdec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:52.325709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe406cf-4e68-4b22-897d-34925bb4cdec service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:52.326321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289299cc-3cdd-49f8-ae3b-dc62cfee440a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:52.326980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289299cc-3cdd-49f8-ae3b-dc62cfee440a service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:52.327241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe406cf-4e68-4b22-897d-34925bb4cdec service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:52.327361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289299cc-3cdd-49f8-ae3b-dc62cfee440a service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:52.327567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289299cc-3cdd-49f8-ae3b-dc62cfee440a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:52.327850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe406cf-4e68-4b22-897d-34925bb4cdec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:52.329668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-289299cc-3cdd-49f8-ae3b-dc62cfee440a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:52.345895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe406cf-4e68-4b22-897d-34925bb4cdec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:52.347744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289299cc-3cdd-49f8-ae3b-dc62cfee440a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:52.348262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe406cf-4e68-4b22-897d-34925bb4cdec service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:52.349210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289299cc-3cdd-49f8-ae3b-dc62cfee440a service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:52.363890 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3607/7126] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:10:52 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:10:52.382860 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3520/7127] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:10:52 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:10:52.520962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb3082-f214-4166-bf33-dfa714b9663b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:52.521401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb3082-f214-4166-bf33-dfa714b9663b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:52.521782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb3082-f214-4166-bf33-dfa714b9663b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:52.541114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5ceb3082-f214-4166-bf33-dfa714b9663b None None] MFA Rules not processed for user `b49bec6d90274fde9af81d52cc9bbf30`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:10:52.542486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5ceb3082-f214-4166-bf33-dfa714b9663b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:52.551034 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3608/7128] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:10:52 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:10:57.990954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe406cf-4e68-4b22-897d-34925bb4cdec service placement] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:58.003516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe406cf-4e68-4b22-897d-34925bb4cdec service placement] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:58.009136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2881e79-570c-4b8d-85af-35ec488cf953 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:58.009776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2881e79-570c-4b8d-85af-35ec488cf953 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:58.010082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2881e79-570c-4b8d-85af-35ec488cf953 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:58.010398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2881e79-570c-4b8d-85af-35ec488cf953 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:58.012114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c2881e79-570c-4b8d-85af-35ec488cf953 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:58.026178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2881e79-570c-4b8d-85af-35ec488cf953 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:58.027773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2881e79-570c-4b8d-85af-35ec488cf953 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:58.039523 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3521/7129] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:10:57 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:10:58.307531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c7b5c-f248-4cf1-844e-19b18e4d6961 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:58.308072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c7b5c-f248-4cf1-844e-19b18e4d6961 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:58.308072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c7b5c-f248-4cf1-844e-19b18e4d6961 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:58.309870 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3609/7130] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 21:10:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 21:10:58.315830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459d882-c900-4bcb-8970-bbcbc04e694c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:58.316198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459d882-c900-4bcb-8970-bbcbc04e694c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:58.316548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459d882-c900-4bcb-8970-bbcbc04e694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:58.336003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3459d882-c900-4bcb-8970-bbcbc04e694c None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:10:58.337192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3459d882-c900-4bcb-8970-bbcbc04e694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:58.346190 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3522/7131] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:10:58 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:10:58.384048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c7b5c-f248-4cf1-844e-19b18e4d6961 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:58.401983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c7b5c-f248-4cf1-844e-19b18e4d6961 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:58.407401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80236efa-30ae-44a3-9907-7bbee0d110e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:58.408038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236efa-30ae-44a3-9907-7bbee0d110e9 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:58.408321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236efa-30ae-44a3-9907-7bbee0d110e9 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:58.408600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236efa-30ae-44a3-9907-7bbee0d110e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:58.418169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80236efa-30ae-44a3-9907-7bbee0d110e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:58.419792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80236efa-30ae-44a3-9907-7bbee0d110e9 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:58.430417 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3610/7132] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:10:58 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:10:58.916609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459d882-c900-4bcb-8970-bbcbc04e694c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:10:58.928320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459d882-c900-4bcb-8970-bbcbc04e694c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:10:58.932044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022a094-8bf5-4cbf-aa96-d36670167509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:10:58.932781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022a094-8bf5-4cbf-aa96-d36670167509 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:10:58.933063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022a094-8bf5-4cbf-aa96-d36670167509 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:10:58.933337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022a094-8bf5-4cbf-aa96-d36670167509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:10:58.935097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c022a094-8bf5-4cbf-aa96-d36670167509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:10:59.004822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022a094-8bf5-4cbf-aa96-d36670167509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:10:59.006405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022a094-8bf5-4cbf-aa96-d36670167509 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:10:59.018579 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3523/7133] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:10:58 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:11:00.548510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80236efa-30ae-44a3-9907-7bbee0d110e9 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:11:00.549978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-80236efa-30ae-44a3-9907-7bbee0d110e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:11:00.564073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80236efa-30ae-44a3-9907-7bbee0d110e9 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:11:00.568118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044704e-eb8f-4f1e-a028-d3ff9d09ed3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:11:00.568902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044704e-eb8f-4f1e-a028-d3ff9d09ed3b service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:11:00.569189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044704e-eb8f-4f1e-a028-d3ff9d09ed3b service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:11:00.569470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044704e-eb8f-4f1e-a028-d3ff9d09ed3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:11:00.571303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c044704e-eb8f-4f1e-a028-d3ff9d09ed3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:11:00.634417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044704e-eb8f-4f1e-a028-d3ff9d09ed3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:11:00.635847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044704e-eb8f-4f1e-a028-d3ff9d09ed3b service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:11:00.645209 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3611/7134] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:11:00 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:11:07.997769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec202557-25ad-4635-867c-55e39efcd063 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:11:07.998494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec202557-25ad-4635-867c-55e39efcd063 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:11:07.998494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec202557-25ad-4635-867c-55e39efcd063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:11:08.015919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ec202557-25ad-4635-867c-55e39efcd063 None None] MFA Rules not processed for user `b49bec6d90274fde9af81d52cc9bbf30`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:11:08.017007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ec202557-25ad-4635-867c-55e39efcd063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:11:08.024087 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3524/7135] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:11:07 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:11:22.867688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9749d-7565-4b94-bcd6-9443ed591bf4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:11:22.868249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9749d-7565-4b94-bcd6-9443ed591bf4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:11:22.868249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9749d-7565-4b94-bcd6-9443ed591bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:11:22.890545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9fa9749d-7565-4b94-bcd6-9443ed591bf4 None None] MFA Rules not processed for user `b49bec6d90274fde9af81d52cc9bbf30`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:11:22.891747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9fa9749d-7565-4b94-bcd6-9443ed591bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:11:22.898738 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3612/7136] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:11:22 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:11:35.494408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce16de-ca16-40e8-b339-bc7b981c57db None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:11:35.495399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce16de-ca16-40e8-b339-bc7b981c57db None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:11:35.495700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce16de-ca16-40e8-b339-bc7b981c57db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:11:35.518943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-fcce16de-ca16-40e8-b339-bc7b981c57db None None] MFA Rules not processed for user `b49bec6d90274fde9af81d52cc9bbf30`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:11:35.520783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-fcce16de-ca16-40e8-b339-bc7b981c57db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:11:35.531574 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3525/7137] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:11:35 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:11:40.572506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9749d-7565-4b94-bcd6-9443ed591bf4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:11:40.586773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9749d-7565-4b94-bcd6-9443ed591bf4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:11:40.591238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3bc70-d34a-4fca-baaa-ae03b5aab222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:11:40.591873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3bc70-d34a-4fca-baaa-ae03b5aab222 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:11:40.592160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3bc70-d34a-4fca-baaa-ae03b5aab222 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:11:40.592432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3bc70-d34a-4fca-baaa-ae03b5aab222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:11:40.594534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8ae3bc70-d34a-4fca-baaa-ae03b5aab222 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:11:40.611923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3bc70-d34a-4fca-baaa-ae03b5aab222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:11:40.613398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3bc70-d34a-4fca-baaa-ae03b5aab222 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:11:40.628943 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3613/7138] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:11:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:11:42.230406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce16de-ca16-40e8-b339-bc7b981c57db None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:11:42.244696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce16de-ca16-40e8-b339-bc7b981c57db None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:11:42.249418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcefb94-369e-4efe-a5da-d5c9129fe8c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:11:42.250229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcefb94-369e-4efe-a5da-d5c9129fe8c1 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:11:42.250835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcefb94-369e-4efe-a5da-d5c9129fe8c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:11:42.251326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcefb94-369e-4efe-a5da-d5c9129fe8c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:11:42.253568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bdcefb94-369e-4efe-a5da-d5c9129fe8c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:11:42.272019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcefb94-369e-4efe-a5da-d5c9129fe8c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:11:42.273520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcefb94-369e-4efe-a5da-d5c9129fe8c1 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:11:42.288291 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3526/7139] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:11:42 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:11:46.444169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6994ba2-4b9e-4804-8996-b57e3a8d773c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:11:46.444704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6994ba2-4b9e-4804-8996-b57e3a8d773c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:11:46.444906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6994ba2-4b9e-4804-8996-b57e3a8d773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:11:46.465041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d6994ba2-4b9e-4804-8996-b57e3a8d773c None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:11:46.466244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d6994ba2-4b9e-4804-8996-b57e3a8d773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:11:46.473495 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3614/7140] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:11:46 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:11:46.525254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcefb94-369e-4efe-a5da-d5c9129fe8c1 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:11:46.539490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcefb94-369e-4efe-a5da-d5c9129fe8c1 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:11:46.545183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4ee95-a7b3-4b71-9f12-8dbdfe75364f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:11:46.545828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4ee95-a7b3-4b71-9f12-8dbdfe75364f service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:11:46.546110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4ee95-a7b3-4b71-9f12-8dbdfe75364f service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:11:46.546434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4ee95-a7b3-4b71-9f12-8dbdfe75364f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:11:46.555156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4ee95-a7b3-4b71-9f12-8dbdfe75364f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:11:46.557370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4ee95-a7b3-4b71-9f12-8dbdfe75364f service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:11:46.565268 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3527/7141] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:11:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:11:58.081503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6994ba2-4b9e-4804-8996-b57e3a8d773c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:11:58.117866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6994ba2-4b9e-4804-8996-b57e3a8d773c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:11:58.142889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406c609-54e3-4fb5-a06f-3b5b2c0503a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:11:58.143570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406c609-54e3-4fb5-a06f-3b5b2c0503a9 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:11:58.143841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406c609-54e3-4fb5-a06f-3b5b2c0503a9 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:11:58.144627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406c609-54e3-4fb5-a06f-3b5b2c0503a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:11:58.146767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a406c609-54e3-4fb5-a06f-3b5b2c0503a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:11:58.174551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c5e76-df74-40c4-9cb4-93c026545729 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:11:58.175193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c5e76-df74-40c4-9cb4-93c026545729 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:11:58.175193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c5e76-df74-40c4-9cb4-93c026545729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:11:58.208150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406c609-54e3-4fb5-a06f-3b5b2c0503a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:11:58.210606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406c609-54e3-4fb5-a06f-3b5b2c0503a9 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:11:58.230181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-862c5e76-df74-40c4-9cb4-93c026545729 None None] MFA Rules not processed for user `b49bec6d90274fde9af81d52cc9bbf30`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:11:58.231665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-862c5e76-df74-40c4-9cb4-93c026545729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:11:58.245118 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3615/7142] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:11:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:11:58.248856 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3528/7143] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:11:58 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:12:03.733175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406c609-54e3-4fb5-a06f-3b5b2c0503a9 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:12:03.735218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a406c609-54e3-4fb5-a06f-3b5b2c0503a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:12:03.838341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406c609-54e3-4fb5-a06f-3b5b2c0503a9 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:12:03.844126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760db90-40ff-4679-b301-20a07f4c26e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:12:03.844912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760db90-40ff-4679-b301-20a07f4c26e5 service glance] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:12:03.845293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760db90-40ff-4679-b301-20a07f4c26e5 service glance] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:12:03.846172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760db90-40ff-4679-b301-20a07f4c26e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:12:03.849624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8760db90-40ff-4679-b301-20a07f4c26e5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:12:03.872156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760db90-40ff-4679-b301-20a07f4c26e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:12:03.873913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760db90-40ff-4679-b301-20a07f4c26e5 service glance] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:12:03.892616 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3616/7144] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:12:03 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:12:03.999562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c5e76-df74-40c4-9cb4-93c026545729 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:12:04.040691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c5e76-df74-40c4-9cb4-93c026545729 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:12:04.052464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec555c-c229-450e-b247-83d22fbf1038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:12:04.054064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec555c-c229-450e-b247-83d22fbf1038 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:12:04.055005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec555c-c229-450e-b247-83d22fbf1038 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:12:04.055621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec555c-c229-450e-b247-83d22fbf1038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:12:04.075533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-aaec555c-c229-450e-b247-83d22fbf1038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:12:04.094833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec555c-c229-450e-b247-83d22fbf1038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:12:04.096577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec555c-c229-450e-b247-83d22fbf1038 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:12:04.116659 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3529/7145] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:12:03 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:12:10.658644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282dfa9-ac49-4737-86eb-23acc9ece2d5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:12:10.660161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282dfa9-ac49-4737-86eb-23acc9ece2d5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:12:10.660590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282dfa9-ac49-4737-86eb-23acc9ece2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:12:10.682418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2282dfa9-ac49-4737-86eb-23acc9ece2d5 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:12:10.683916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2282dfa9-ac49-4737-86eb-23acc9ece2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:12:10.700001 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3617/7146] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:12:10 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:12:10.709749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec555c-c229-450e-b247-83d22fbf1038 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:12:10.738955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec555c-c229-450e-b247-83d22fbf1038 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:12:10.744964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734fd8f-17c1-4fce-b942-7a00575e8823 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:12:10.745626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734fd8f-17c1-4fce-b942-7a00575e8823 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:12:10.745912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734fd8f-17c1-4fce-b942-7a00575e8823 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:12:10.746427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734fd8f-17c1-4fce-b942-7a00575e8823 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:12:10.755953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734fd8f-17c1-4fce-b942-7a00575e8823 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:12:10.757731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734fd8f-17c1-4fce-b942-7a00575e8823 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:12:10.767574 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3530/7147] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:12:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 21:12:19.026466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282dfa9-ac49-4737-86eb-23acc9ece2d5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:12:19.027391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2282dfa9-ac49-4737-86eb-23acc9ece2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:12:19.122657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282dfa9-ac49-4737-86eb-23acc9ece2d5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:12:19.131666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ea9a5-4738-4109-830c-864678fe10f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:12:19.132551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ea9a5-4738-4109-830c-864678fe10f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:12:19.132828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ea9a5-4738-4109-830c-864678fe10f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:12:19.133101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ea9a5-4738-4109-830c-864678fe10f3 admin admin] PATH_INFO: `/v3/users/0a9b1c58215046afb6974d9a4b654326` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:12:19.138589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ea9a5-4738-4109-830c-864678fe10f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a9b1c58215046afb6974d9a4b654326)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:12:19.140549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ea9a5-4738-4109-830c-864678fe10f3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:12:19.250353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0a1ea9a5-4738-4109-830c-864678fe10f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a9b1c58215046afb6974d9a4b654326'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:19.267172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0a1ea9a5-4738-4109-830c-864678fe10f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a9b1c58215046afb6974d9a4b654326'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:19.268193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0a1ea9a5-4738-4109-830c-864678fe10f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a9b1c58215046afb6974d9a4b654326'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:19.293886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0a1ea9a5-4738-4109-830c-864678fe10f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a9b1c58215046afb6974d9a4b654326'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:19.306102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0a1ea9a5-4738-4109-830c-864678fe10f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a9b1c58215046afb6974d9a4b654326'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:19.325429 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3618/7148] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:12:19 2021] DELETE /identity/v3/users/0a9b1c58215046afb6974d9a4b654326 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:12:19.766798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac447bf1-ff1e-4923-8487-7086b45fc442 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:12:19.767343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac447bf1-ff1e-4923-8487-7086b45fc442 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:12:19.767631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac447bf1-ff1e-4923-8487-7086b45fc442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:12:19.775733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ea9a5-4738-4109-830c-864678fe10f3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:12:19.778239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0a1ea9a5-4738-4109-830c-864678fe10f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:12:19.796888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ac447bf1-ff1e-4923-8487-7086b45fc442 None None] MFA Rules not processed for user `f292f8174a7a4de5bf8a848e49f85dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:12:19.798356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ac447bf1-ff1e-4923-8487-7086b45fc442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:12:19.884832 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3531/7149] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:12:19 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:12:20.012651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ea9a5-4738-4109-830c-864678fe10f3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:12:20.033118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083b3ae-4721-4743-a9d8-1754870800d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:12:20.033862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083b3ae-4721-4743-a9d8-1754870800d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:12:20.034133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083b3ae-4721-4743-a9d8-1754870800d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:12:20.034484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083b3ae-4721-4743-a9d8-1754870800d1 admin admin] PATH_INFO: `/v3/projects/62fd960aee2d408d8c9977b60fcabd61` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:12:20.038900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083b3ae-4721-4743-a9d8-1754870800d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62fd960aee2d408d8c9977b60fcabd61)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:12:20.041357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083b3ae-4721-4743-a9d8-1754870800d1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:12:20.133248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a083b3ae-4721-4743-a9d8-1754870800d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62fd960aee2d408d8c9977b60fcabd61', 'request_id': 'req-a083b3ae-4721-4743-a9d8-1754870800d1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:20.147211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a083b3ae-4721-4743-a9d8-1754870800d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62fd960aee2d408d8c9977b60fcabd61', 'request_id': 'req-a083b3ae-4721-4743-a9d8-1754870800d1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:20.183972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a083b3ae-4721-4743-a9d8-1754870800d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62fd960aee2d408d8c9977b60fcabd61', 'request_id': 'req-a083b3ae-4721-4743-a9d8-1754870800d1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:20.203603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a083b3ae-4721-4743-a9d8-1754870800d1 admin admin] The token cache is being invalidate because project 62fd960aee2d408d8c9977b60fcabd61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:12:20.203902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a083b3ae-4721-4743-a9d8-1754870800d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:20.207895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a083b3ae-4721-4743-a9d8-1754870800d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:20.211492 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3619/7150] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:12:19 2021] DELETE /identity/v3/projects/62fd960aee2d408d8c9977b60fcabd61 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:12:20.219806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac447bf1-ff1e-4923-8487-7086b45fc442 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:12:20.241172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac447bf1-ff1e-4923-8487-7086b45fc442 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:12:20.375284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b6d44-ba9b-4116-a9d5-e426ef85b8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:12:20.376233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b6d44-ba9b-4116-a9d5-e426ef85b8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:12:20.376529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b6d44-ba9b-4116-a9d5-e426ef85b8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:12:20.376862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b6d44-ba9b-4116-a9d5-e426ef85b8a0 admin admin] PATH_INFO: `/v3/users/f028f89238aa4b1aa010d8fc205feea3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:12:20.378223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b6d44-ba9b-4116-a9d5-e426ef85b8a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f028f89238aa4b1aa010d8fc205feea3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:12:20.380332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b6d44-ba9b-4116-a9d5-e426ef85b8a0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:12:20.511940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8c6b6d44-ba9b-4116-a9d5-e426ef85b8a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f028f89238aa4b1aa010d8fc205feea3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:20.526245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8c6b6d44-ba9b-4116-a9d5-e426ef85b8a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f028f89238aa4b1aa010d8fc205feea3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:20.543228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8c6b6d44-ba9b-4116-a9d5-e426ef85b8a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f028f89238aa4b1aa010d8fc205feea3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:20.544169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8c6b6d44-ba9b-4116-a9d5-e426ef85b8a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f028f89238aa4b1aa010d8fc205feea3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:20.561840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8c6b6d44-ba9b-4116-a9d5-e426ef85b8a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f028f89238aa4b1aa010d8fc205feea3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:20.573533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20013bba-1eff-451c-a13a-de0253c0b78e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:12:20.574192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20013bba-1eff-451c-a13a-de0253c0b78e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:12:20.574775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20013bba-1eff-451c-a13a-de0253c0b78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:12:20.591295 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3532/7151] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:12:20 2021] DELETE /identity/v3/users/f028f89238aa4b1aa010d8fc205feea3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:12:20.599869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-20013bba-1eff-451c-a13a-de0253c0b78e None None] MFA Rules not processed for user `b49bec6d90274fde9af81d52cc9bbf30`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:12:20.602461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-20013bba-1eff-451c-a13a-de0253c0b78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:12:20.695618 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3620/7152] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:12:20 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:12:20.908154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b6d44-ba9b-4116-a9d5-e426ef85b8a0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:12:20.913044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8c6b6d44-ba9b-4116-a9d5-e426ef85b8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:12:21.079644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b6d44-ba9b-4116-a9d5-e426ef85b8a0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:12:21.099619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae7994-d3a2-4801-bbb8-2f5d6ddcb7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:12:21.114847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae7994-d3a2-4801-bbb8-2f5d6ddcb7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:12:21.115207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae7994-d3a2-4801-bbb8-2f5d6ddcb7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:12:21.117861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae7994-d3a2-4801-bbb8-2f5d6ddcb7e7 admin admin] PATH_INFO: `/v3/projects/5db10117831d4d9396e883590d0cf553` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:12:21.122447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae7994-d3a2-4801-bbb8-2f5d6ddcb7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db10117831d4d9396e883590d0cf553)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:12:21.125171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae7994-d3a2-4801-bbb8-2f5d6ddcb7e7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:12:21.256319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7bae7994-d3a2-4801-bbb8-2f5d6ddcb7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db10117831d4d9396e883590d0cf553', 'request_id': 'req-7bae7994-d3a2-4801-bbb8-2f5d6ddcb7e7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:21.269663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7bae7994-d3a2-4801-bbb8-2f5d6ddcb7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db10117831d4d9396e883590d0cf553', 'request_id': 'req-7bae7994-d3a2-4801-bbb8-2f5d6ddcb7e7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:21.289306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7bae7994-d3a2-4801-bbb8-2f5d6ddcb7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db10117831d4d9396e883590d0cf553', 'request_id': 'req-7bae7994-d3a2-4801-bbb8-2f5d6ddcb7e7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:21.334168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7bae7994-d3a2-4801-bbb8-2f5d6ddcb7e7 admin admin] The token cache is being invalidate because project 5db10117831d4d9396e883590d0cf553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:12:21.337468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7bae7994-d3a2-4801-bbb8-2f5d6ddcb7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:21.342786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7bae7994-d3a2-4801-bbb8-2f5d6ddcb7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:12:21.353692 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3533/7153] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:12:20 2021] DELETE /identity/v3/projects/5db10117831d4d9396e883590d0cf553 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:12:28.424132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20013bba-1eff-451c-a13a-de0253c0b78e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:12:28.425557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-20013bba-1eff-451c-a13a-de0253c0b78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:12:28.485407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20013bba-1eff-451c-a13a-de0253c0b78e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:12:28.531201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa6487-b7a0-49a8-9200-9524a9358ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:12:28.531848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa6487-b7a0-49a8-9200-9524a9358ade service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:12:28.532129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa6487-b7a0-49a8-9200-9524a9358ade service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:12:28.532404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa6487-b7a0-49a8-9200-9524a9358ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:12:28.534302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-98fa6487-b7a0-49a8-9200-9524a9358ade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:12:28.550035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa6487-b7a0-49a8-9200-9524a9358ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:12:28.551519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa6487-b7a0-49a8-9200-9524a9358ade service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:12:28.562266 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3621/7154] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:12:28 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:12:29.703626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f51695-0a8a-4731-afcc-ccb38f826840 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:12:29.704164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f51695-0a8a-4731-afcc-ccb38f826840 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:12:29.704313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f51695-0a8a-4731-afcc-ccb38f826840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:12:29.723355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-25f51695-0a8a-4731-afcc-ccb38f826840 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:12:29.724111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-25f51695-0a8a-4731-afcc-ccb38f826840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:12:29.782572 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3534/7155] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 21:12:29 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:12:29.796130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa6487-b7a0-49a8-9200-9524a9358ade service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:12:29.797510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-98fa6487-b7a0-49a8-9200-9524a9358ade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:12:29.872637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa6487-b7a0-49a8-9200-9524a9358ade service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:12:29.880904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af63b25-35b4-407e-a294-89de06ad18af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:12:29.881578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af63b25-35b4-407e-a294-89de06ad18af service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:12:29.881867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af63b25-35b4-407e-a294-89de06ad18af service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:12:29.882149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af63b25-35b4-407e-a294-89de06ad18af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:12:29.895461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af63b25-35b4-407e-a294-89de06ad18af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:12:29.896831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af63b25-35b4-407e-a294-89de06ad18af service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:12:29.907156 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3622/7156] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:12:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:13:12.062185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eddc64-1014-427b-93ac-39ce9d6d5d77 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:12.062804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eddc64-1014-427b-93ac-39ce9d6d5d77 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:12.062928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eddc64-1014-427b-93ac-39ce9d6d5d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:12.081585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f8eddc64-1014-427b-93ac-39ce9d6d5d77 None None] MFA Rules not processed for user `bdd05da990fb4f7290fb926a258de4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:12.082919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f8eddc64-1014-427b-93ac-39ce9d6d5d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:12.155443 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3535/7157] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:12 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:12.807992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af63b25-35b4-407e-a294-89de06ad18af service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:12.809658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5af63b25-35b4-407e-a294-89de06ad18af service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:12.925505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af63b25-35b4-407e-a294-89de06ad18af service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:12.931540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1b8f3-f81d-47d0-9a27-82d7359dbc9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:12.932212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1b8f3-f81d-47d0-9a27-82d7359dbc9b service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:12.932516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1b8f3-f81d-47d0-9a27-82d7359dbc9b service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:12.932794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1b8f3-f81d-47d0-9a27-82d7359dbc9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:12.936902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-52d1b8f3-f81d-47d0-9a27-82d7359dbc9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:12.955637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1b8f3-f81d-47d0-9a27-82d7359dbc9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:12.957144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1b8f3-f81d-47d0-9a27-82d7359dbc9b service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:12.970136 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3623/7158] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:12 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:13:13.369703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eddc64-1014-427b-93ac-39ce9d6d5d77 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:13.371292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f8eddc64-1014-427b-93ac-39ce9d6d5d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:13.442486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eddc64-1014-427b-93ac-39ce9d6d5d77 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:13.449472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdcac3-fb44-4311-8511-41853015fec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:13.450873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdcac3-fb44-4311-8511-41853015fec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:13.451166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdcac3-fb44-4311-8511-41853015fec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:13.451450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdcac3-fb44-4311-8511-41853015fec0 admin admin] PATH_INFO: `/v3/users/b49bec6d90274fde9af81d52cc9bbf30` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:13.452675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdcac3-fb44-4311-8511-41853015fec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b49bec6d90274fde9af81d52cc9bbf30)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:13.454630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdcac3-fb44-4311-8511-41853015fec0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:13.507201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c1bdcac3-fb44-4311-8511-41853015fec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b49bec6d90274fde9af81d52cc9bbf30'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:13.515018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c1bdcac3-fb44-4311-8511-41853015fec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b49bec6d90274fde9af81d52cc9bbf30'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:13.531268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c1bdcac3-fb44-4311-8511-41853015fec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b49bec6d90274fde9af81d52cc9bbf30'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:13.532281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c1bdcac3-fb44-4311-8511-41853015fec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b49bec6d90274fde9af81d52cc9bbf30'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:13.542615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c1bdcac3-fb44-4311-8511-41853015fec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b49bec6d90274fde9af81d52cc9bbf30'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:13.545716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1b8f3-f81d-47d0-9a27-82d7359dbc9b service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:13.549814 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3536/7159] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:13:13 2021] DELETE /identity/v3/users/b49bec6d90274fde9af81d52cc9bbf30 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:13.561568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1b8f3-f81d-47d0-9a27-82d7359dbc9b service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:13.646330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ecf7c-ba46-4832-98b7-9eb2aae20f8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:13.647293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ecf7c-ba46-4832-98b7-9eb2aae20f8e service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:13.647725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ecf7c-ba46-4832-98b7-9eb2aae20f8e service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:13.648836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ecf7c-ba46-4832-98b7-9eb2aae20f8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:13.651315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-636ecf7c-ba46-4832-98b7-9eb2aae20f8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:13.666426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ecf7c-ba46-4832-98b7-9eb2aae20f8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:13.668153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ecf7c-ba46-4832-98b7-9eb2aae20f8e service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:13.681148 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3624/7160] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:13 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:13:13.738976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdcac3-fb44-4311-8511-41853015fec0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:13.740436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c1bdcac3-fb44-4311-8511-41853015fec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:13.814830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdcac3-fb44-4311-8511-41853015fec0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:13.820984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4950b2-d244-46ae-93c1-ba2c80c34966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:13.822148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4950b2-d244-46ae-93c1-ba2c80c34966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:13.822748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4950b2-d244-46ae-93c1-ba2c80c34966 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:13.823138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4950b2-d244-46ae-93c1-ba2c80c34966 admin admin] PATH_INFO: `/v3/projects/c36bc0b6ca0849f58c6b8f41df80db6f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:13.824647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4950b2-d244-46ae-93c1-ba2c80c34966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c36bc0b6ca0849f58c6b8f41df80db6f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:13.826849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4950b2-d244-46ae-93c1-ba2c80c34966 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:13.892652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0e4950b2-d244-46ae-93c1-ba2c80c34966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'request_id': 'req-0e4950b2-d244-46ae-93c1-ba2c80c34966'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:13.899218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0e4950b2-d244-46ae-93c1-ba2c80c34966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'request_id': 'req-0e4950b2-d244-46ae-93c1-ba2c80c34966'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:13.906734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0e4950b2-d244-46ae-93c1-ba2c80c34966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c36bc0b6ca0849f58c6b8f41df80db6f', 'request_id': 'req-0e4950b2-d244-46ae-93c1-ba2c80c34966'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:13.924187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0e4950b2-d244-46ae-93c1-ba2c80c34966 admin admin] The token cache is being invalidate because project c36bc0b6ca0849f58c6b8f41df80db6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:13.924747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0e4950b2-d244-46ae-93c1-ba2c80c34966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:13.925483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0e4950b2-d244-46ae-93c1-ba2c80c34966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:13.932484 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3537/7161] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:13 2021] DELETE /identity/v3/projects/c36bc0b6ca0849f58c6b8f41df80db6f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:13.934159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6380f9-e169-49ec-83cc-9d1252439979 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:13.934676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6380f9-e169-49ec-83cc-9d1252439979 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:13.934799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6380f9-e169-49ec-83cc-9d1252439979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:13.957262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ef6380f9-e169-49ec-83cc-9d1252439979 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:13.958988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ef6380f9-e169-49ec-83cc-9d1252439979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:14.037927 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3625/7162] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:14.038460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669fd56-35cb-4e48-b0f9-d5df6742a1ba None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:14.038460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669fd56-35cb-4e48-b0f9-d5df6742a1ba None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:14.038460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669fd56-35cb-4e48-b0f9-d5df6742a1ba None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:14.038460 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3538/7163] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 21:13:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 21:13:14.043368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174beb2-4f82-424d-a9d7-4a847fe20b9e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:14.043613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174beb2-4f82-424d-a9d7-4a847fe20b9e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:14.043891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174beb2-4f82-424d-a9d7-4a847fe20b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:14.067416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f174beb2-4f82-424d-a9d7-4a847fe20b9e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:14.069005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f174beb2-4f82-424d-a9d7-4a847fe20b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:14.069358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278da95-894c-4a6c-b4a5-b2b163bab253 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:14.069791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278da95-894c-4a6c-b4a5-b2b163bab253 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:14.070432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278da95-894c-4a6c-b4a5-b2b163bab253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:14.080262 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3626/7164] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:14.085220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174beb2-4f82-424d-a9d7-4a847fe20b9e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:14.097555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6278da95-894c-4a6c-b4a5-b2b163bab253 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:14.099668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6278da95-894c-4a6c-b4a5-b2b163bab253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:14.105051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174beb2-4f82-424d-a9d7-4a847fe20b9e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:14.112785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc638092-12fd-4190-8e2c-1bdf7893ff57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:14.113827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc638092-12fd-4190-8e2c-1bdf7893ff57 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:14.114350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc638092-12fd-4190-8e2c-1bdf7893ff57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:14.114804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc638092-12fd-4190-8e2c-1bdf7893ff57 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:14.115549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc638092-12fd-4190-8e2c-1bdf7893ff57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:13:14.116034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc638092-12fd-4190-8e2c-1bdf7893ff57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:14.118724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc638092-12fd-4190-8e2c-1bdf7893ff57 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:14.132349 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3627/7165] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:13:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:14.136853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc638092-12fd-4190-8e2c-1bdf7893ff57 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:14.148669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc638092-12fd-4190-8e2c-1bdf7893ff57 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:14.154733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfac4a-db71-4f84-832b-3c899d9883df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:14.155504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfac4a-db71-4f84-832b-3c899d9883df admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:14.155932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfac4a-db71-4f84-832b-3c899d9883df admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:14.156226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfac4a-db71-4f84-832b-3c899d9883df admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:14.156938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfac4a-db71-4f84-832b-3c899d9883df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:14.159103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfac4a-db71-4f84-832b-3c899d9883df admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:14.218560 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3628/7167] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:14 2021] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:13:14.218734 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3539/7167] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:13:14 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:14.220150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278da95-894c-4a6c-b4a5-b2b163bab253 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:14.233248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfac4a-db71-4f84-832b-3c899d9883df admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:14.234979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b5dfac4a-db71-4f84-832b-3c899d9883df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:14.240298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278da95-894c-4a6c-b4a5-b2b163bab253 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:14.328836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdd865-e080-4ae7-be33-f00571f2e97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:14.328836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdd865-e080-4ae7-be33-f00571f2e97a admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:14.328836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdd865-e080-4ae7-be33-f00571f2e97a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:14.328836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdd865-e080-4ae7-be33-f00571f2e97a admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:14.330864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdd865-e080-4ae7-be33-f00571f2e97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:14.333047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdd865-e080-4ae7-be33-f00571f2e97a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:14.343506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfac4a-db71-4f84-832b-3c899d9883df admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:14.353896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde5785-de0f-4028-b8c3-f2f16aefaaa9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:14.355234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde5785-de0f-4028-b8c3-f2f16aefaaa9 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:14.355598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde5785-de0f-4028-b8c3-f2f16aefaaa9 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:14.355949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde5785-de0f-4028-b8c3-f2f16aefaaa9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:14.364210 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3540/7168] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:13:14 2021] POST /identity/v3/users => generated 283 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:14.369394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdd865-e080-4ae7-be33-f00571f2e97a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:14.370958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde5785-de0f-4028-b8c3-f2f16aefaaa9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:14.374500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde5785-de0f-4028-b8c3-f2f16aefaaa9 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:14.385779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdd865-e080-4ae7-be33-f00571f2e97a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:14.386653 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3629/7169] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:14 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:13:14.390976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59c17e-ccd3-463b-b8ec-bbb0b0f02ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:14.391801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59c17e-ccd3-463b-b8ec-bbb0b0f02ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:14.392104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59c17e-ccd3-463b-b8ec-bbb0b0f02ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:14.392386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59c17e-ccd3-463b-b8ec-bbb0b0f02ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:14.393155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59c17e-ccd3-463b-b8ec-bbb0b0f02ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:14.394796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59c17e-ccd3-463b-b8ec-bbb0b0f02ed5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:14.406984 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3541/7170] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:14 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:14.411277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde5785-de0f-4028-b8c3-f2f16aefaaa9 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:14.425027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde5785-de0f-4028-b8c3-f2f16aefaaa9 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:14.430107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db31f3a-fa8b-4777-b699-bfad4915d75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:14.430875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db31f3a-fa8b-4777-b699-bfad4915d75f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:14.431249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db31f3a-fa8b-4777-b699-bfad4915d75f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:14.431796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db31f3a-fa8b-4777-b699-bfad4915d75f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:14.432624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db31f3a-fa8b-4777-b699-bfad4915d75f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:14.434370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db31f3a-fa8b-4777-b699-bfad4915d75f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:14.448024 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3630/7171] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:14 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:14.452072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59c17e-ccd3-463b-b8ec-bbb0b0f02ed5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:14.463746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59c17e-ccd3-463b-b8ec-bbb0b0f02ed5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:14.468910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92a203-7a9b-4169-a008-2ba2e5f68878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:14.469852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a203-7a9b-4169-a008-2ba2e5f68878 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:14.470142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a203-7a9b-4169-a008-2ba2e5f68878 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:14.470615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a203-7a9b-4169-a008-2ba2e5f68878 admin admin] PATH_INFO: `/v3/projects/e4b3cd7573af4210beec846fa29f3ff0/users/0b6b9e667c6b4bf795f8ca2fef92f9e9/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:14.491634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92a203-7a9b-4169-a008-2ba2e5f68878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b3cd7573af4210beec846fa29f3ff0, user_id=0b6b9e667c6b4bf795f8ca2fef92f9e9, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:14.494477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92a203-7a9b-4169-a008-2ba2e5f68878 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:14.514744 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3542/7172] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:14 2021] PUT /identity/v3/projects/e4b3cd7573af4210beec846fa29f3ff0/users/0b6b9e667c6b4bf795f8ca2fef92f9e9/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:14.526962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7f2f9-80e6-44e8-98a8-2cb44617daef None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:14.527321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7f2f9-80e6-44e8-98a8-2cb44617daef None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:14.527784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7f2f9-80e6-44e8-98a8-2cb44617daef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:14.563709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bcb7f2f9-80e6-44e8-98a8-2cb44617daef None None] MFA Rules not processed for user `0b6b9e667c6b4bf795f8ca2fef92f9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:14.565513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bcb7f2f9-80e6-44e8-98a8-2cb44617daef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:14.645121 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3631/7173] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:14 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:14.658016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92a203-7a9b-4169-a008-2ba2e5f68878 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:14.659911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ca92a203-7a9b-4169-a008-2ba2e5f68878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:14.763487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92a203-7a9b-4169-a008-2ba2e5f68878 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:14.769724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d6ca9-75aa-4f63-b3d9-958dc889d1cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:14.770346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d6ca9-75aa-4f63-b3d9-958dc889d1cc service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:14.770636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d6ca9-75aa-4f63-b3d9-958dc889d1cc service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:14.771149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d6ca9-75aa-4f63-b3d9-958dc889d1cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:14.780966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d6ca9-75aa-4f63-b3d9-958dc889d1cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:14.782729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d6ca9-75aa-4f63-b3d9-958dc889d1cc service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:14.793339 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3543/7174] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:14 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:13:14.848941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7f2f9-80e6-44e8-98a8-2cb44617daef None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:14.929273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7f2f9-80e6-44e8-98a8-2cb44617daef None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:14.938291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01470d-c532-4dea-ae54-58a7be0def2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:14.940150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01470d-c532-4dea-ae54-58a7be0def2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:14.940895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01470d-c532-4dea-ae54-58a7be0def2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:14.941529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01470d-c532-4dea-ae54-58a7be0def2a admin admin] PATH_INFO: `/v3/users/0b6b9e667c6b4bf795f8ca2fef92f9e9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:14.943912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01470d-c532-4dea-ae54-58a7be0def2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6b9e667c6b4bf795f8ca2fef92f9e9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:14.947294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01470d-c532-4dea-ae54-58a7be0def2a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:15.022596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e01470d-c532-4dea-ae54-58a7be0def2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6b9e667c6b4bf795f8ca2fef92f9e9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:15.031243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e01470d-c532-4dea-ae54-58a7be0def2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6b9e667c6b4bf795f8ca2fef92f9e9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:15.032191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e01470d-c532-4dea-ae54-58a7be0def2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6b9e667c6b4bf795f8ca2fef92f9e9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:15.046582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e01470d-c532-4dea-ae54-58a7be0def2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6b9e667c6b4bf795f8ca2fef92f9e9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:15.057876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3e01470d-c532-4dea-ae54-58a7be0def2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6b9e667c6b4bf795f8ca2fef92f9e9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:15.084307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcb205-bdbd-42a9-922e-f0a9f0d1a15e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:15.084605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcb205-bdbd-42a9-922e-f0a9f0d1a15e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:15.084887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcb205-bdbd-42a9-922e-f0a9f0d1a15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:15.087658 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3632/7175] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:13:14 2021] DELETE /identity/v3/users/0b6b9e667c6b4bf795f8ca2fef92f9e9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:15.114549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5ddcb205-bdbd-42a9-922e-f0a9f0d1a15e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:15.116043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5ddcb205-bdbd-42a9-922e-f0a9f0d1a15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:15.207944 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3544/7176] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:15.218800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01470d-c532-4dea-ae54-58a7be0def2a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:15.220319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3e01470d-c532-4dea-ae54-58a7be0def2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:15.303606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01470d-c532-4dea-ae54-58a7be0def2a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:15.309801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfb3cc-1bb9-49b3-9807-38576407a987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:15.310857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb3cc-1bb9-49b3-9807-38576407a987 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:15.311300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb3cc-1bb9-49b3-9807-38576407a987 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:15.311771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb3cc-1bb9-49b3-9807-38576407a987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:15.323352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfb3cc-1bb9-49b3-9807-38576407a987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:15.324828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfb3cc-1bb9-49b3-9807-38576407a987 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:15.334603 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3633/7177] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:13:15.542241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcb205-bdbd-42a9-922e-f0a9f0d1a15e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:15.566219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcb205-bdbd-42a9-922e-f0a9f0d1a15e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:15.570896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80d103-1236-4844-b543-5d52ea0ac9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:15.571553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80d103-1236-4844-b543-5d52ea0ac9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:15.571837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80d103-1236-4844-b543-5d52ea0ac9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:15.572114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80d103-1236-4844-b543-5d52ea0ac9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:15.575195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4f80d103-1236-4844-b543-5d52ea0ac9f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:15.589743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80d103-1236-4844-b543-5d52ea0ac9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:15.591346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80d103-1236-4844-b543-5d52ea0ac9f8 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:15.603248 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3545/7178] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:15 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:13:15.676691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfb3cc-1bb9-49b3-9807-38576407a987 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:15.678502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2ecfb3cc-1bb9-49b3-9807-38576407a987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:15.696876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfb3cc-1bb9-49b3-9807-38576407a987 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:15.703586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1274c6d-d898-4126-add1-ca5c2ccbd90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:15.704452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1274c6d-d898-4126-add1-ca5c2ccbd90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:15.704737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1274c6d-d898-4126-add1-ca5c2ccbd90f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:15.705015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1274c6d-d898-4126-add1-ca5c2ccbd90f admin admin] PATH_INFO: `/v3/projects/e4b3cd7573af4210beec846fa29f3ff0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:15.706235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1274c6d-d898-4126-add1-ca5c2ccbd90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b3cd7573af4210beec846fa29f3ff0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:15.708304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1274c6d-d898-4126-add1-ca5c2ccbd90f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:15.769722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e1274c6d-d898-4126-add1-ca5c2ccbd90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b3cd7573af4210beec846fa29f3ff0', 'request_id': 'req-e1274c6d-d898-4126-add1-ca5c2ccbd90f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:15.777622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e1274c6d-d898-4126-add1-ca5c2ccbd90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b3cd7573af4210beec846fa29f3ff0', 'request_id': 'req-e1274c6d-d898-4126-add1-ca5c2ccbd90f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:15.787701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e1274c6d-d898-4126-add1-ca5c2ccbd90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b3cd7573af4210beec846fa29f3ff0', 'request_id': 'req-e1274c6d-d898-4126-add1-ca5c2ccbd90f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:15.801668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e1274c6d-d898-4126-add1-ca5c2ccbd90f admin admin] The token cache is being invalidate because project e4b3cd7573af4210beec846fa29f3ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:15.801959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e1274c6d-d898-4126-add1-ca5c2ccbd90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:15.802683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e1274c6d-d898-4126-add1-ca5c2ccbd90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:15.811699 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3634/7179] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:15 2021] DELETE /identity/v3/projects/e4b3cd7573af4210beec846fa29f3ff0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:15.812990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62836d89-4f08-4f2b-bdfd-7eb5a769c959 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:15.813496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62836d89-4f08-4f2b-bdfd-7eb5a769c959 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:15.813857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62836d89-4f08-4f2b-bdfd-7eb5a769c959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:15.864390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-62836d89-4f08-4f2b-bdfd-7eb5a769c959 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:15.869469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-62836d89-4f08-4f2b-bdfd-7eb5a769c959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:15.963699 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3546/7180] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:15.971268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17221e2e-25c4-4427-b306-c8f74f2dd28a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:15.971831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17221e2e-25c4-4427-b306-c8f74f2dd28a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:15.971831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17221e2e-25c4-4427-b306-c8f74f2dd28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:15.995783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-17221e2e-25c4-4427-b306-c8f74f2dd28a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:15.997498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-17221e2e-25c4-4427-b306-c8f74f2dd28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:16.007978 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3635/7181] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:16.011376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62836d89-4f08-4f2b-bdfd-7eb5a769c959 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:16.037711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62836d89-4f08-4f2b-bdfd-7eb5a769c959 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:16.043084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c4081-a276-4b9e-9aa2-7dc4c181b316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:16.043755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4081-a276-4b9e-9aa2-7dc4c181b316 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:16.044052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4081-a276-4b9e-9aa2-7dc4c181b316 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:16.044329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4081-a276-4b9e-9aa2-7dc4c181b316 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:16.045069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c4081-a276-4b9e-9aa2-7dc4c181b316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:13:16.045550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c4081-a276-4b9e-9aa2-7dc4c181b316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:16.047193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c4081-a276-4b9e-9aa2-7dc4c181b316 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:16.076203 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3547/7182] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:13:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:16.077309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17221e2e-25c4-4427-b306-c8f74f2dd28a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:16.088717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17221e2e-25c4-4427-b306-c8f74f2dd28a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:16.095552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d9e14-cd6e-4843-8ed5-7d4d5e5fd908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:16.096282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d9e14-cd6e-4843-8ed5-7d4d5e5fd908 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:16.096480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d9e14-cd6e-4843-8ed5-7d4d5e5fd908 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:16.096947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d9e14-cd6e-4843-8ed5-7d4d5e5fd908 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:16.100628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d9e14-cd6e-4843-8ed5-7d4d5e5fd908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:16.104116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d9e14-cd6e-4843-8ed5-7d4d5e5fd908 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:16.158696 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3636/7183] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:16 2021] POST /identity/v3/projects => generated 387 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:13:16.163080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c4081-a276-4b9e-9aa2-7dc4c181b316 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:16.178129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c4081-a276-4b9e-9aa2-7dc4c181b316 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:16.268026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7e264-1821-495d-b161-06c7e88522a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:16.269125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7e264-1821-495d-b161-06c7e88522a2 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:16.269418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7e264-1821-495d-b161-06c7e88522a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:16.269699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7e264-1821-495d-b161-06c7e88522a2 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:16.270554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7e264-1821-495d-b161-06c7e88522a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:16.272414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7e264-1821-495d-b161-06c7e88522a2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:16.303099 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3548/7184] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:13:16 2021] POST /identity/v3/users => generated 294 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:13:16.308988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d9e14-cd6e-4843-8ed5-7d4d5e5fd908 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:16.321439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d9e14-cd6e-4843-8ed5-7d4d5e5fd908 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:16.327039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51bb10-75d8-456b-a3ac-69d50032732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:16.328038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51bb10-75d8-456b-a3ac-69d50032732c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:16.328580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51bb10-75d8-456b-a3ac-69d50032732c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:16.328940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51bb10-75d8-456b-a3ac-69d50032732c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:16.329921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51bb10-75d8-456b-a3ac-69d50032732c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:16.331805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51bb10-75d8-456b-a3ac-69d50032732c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:16.351555 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3637/7185] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:16 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:16.355600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7e264-1821-495d-b161-06c7e88522a2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:16.366289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7e264-1821-495d-b161-06c7e88522a2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:16.371827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa697f-6aef-44eb-bfa2-f3e45407a7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:16.372949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa697f-6aef-44eb-bfa2-f3e45407a7ab admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:16.372949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa697f-6aef-44eb-bfa2-f3e45407a7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:16.373171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa697f-6aef-44eb-bfa2-f3e45407a7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:16.373772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa697f-6aef-44eb-bfa2-f3e45407a7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:16.375414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa697f-6aef-44eb-bfa2-f3e45407a7ab admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:16.394123 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3549/7186] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:16 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:16.395376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51bb10-75d8-456b-a3ac-69d50032732c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:16.406004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51bb10-75d8-456b-a3ac-69d50032732c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:16.410748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ed052-2357-4735-8fb3-ddb78964accd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:16.411628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ed052-2357-4735-8fb3-ddb78964accd admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:16.411909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ed052-2357-4735-8fb3-ddb78964accd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:16.412185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ed052-2357-4735-8fb3-ddb78964accd admin admin] PATH_INFO: `/v3/projects/58b273f8fe954ef68fd69d06622b1824/users/f0aa9590b71e42dd97ce18c71f754d92/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:16.430889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ed052-2357-4735-8fb3-ddb78964accd admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b273f8fe954ef68fd69d06622b1824, user_id=f0aa9590b71e42dd97ce18c71f754d92, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:16.434408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ed052-2357-4735-8fb3-ddb78964accd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:16.456446 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3638/7187] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:16 2021] PUT /identity/v3/projects/58b273f8fe954ef68fd69d06622b1824/users/f0aa9590b71e42dd97ce18c71f754d92/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:16.461648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb360028-1016-4dd9-ab4a-6314314465d4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:16.462040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb360028-1016-4dd9-ab4a-6314314465d4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:16.462377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb360028-1016-4dd9-ab4a-6314314465d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:16.490708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-cb360028-1016-4dd9-ab4a-6314314465d4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:16.493027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cb360028-1016-4dd9-ab4a-6314314465d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:16.568494 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3550/7188] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:16.579388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ed052-2357-4735-8fb3-ddb78964accd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:16.581118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ac4ed052-2357-4735-8fb3-ddb78964accd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:16.672242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ed052-2357-4735-8fb3-ddb78964accd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:16.678212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d5fac-dd8a-49f5-a345-3d7003beaf81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:16.680386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d5fac-dd8a-49f5-a345-3d7003beaf81 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:16.680875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d5fac-dd8a-49f5-a345-3d7003beaf81 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:16.681362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d5fac-dd8a-49f5-a345-3d7003beaf81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:16.693674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d5fac-dd8a-49f5-a345-3d7003beaf81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:16.695977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d5fac-dd8a-49f5-a345-3d7003beaf81 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:16.716086 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3639/7189] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:13:17.397063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ec677-ff9d-4e40-909b-681355fcd8d4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:17.401712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ec677-ff9d-4e40-909b-681355fcd8d4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:17.401948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ec677-ff9d-4e40-909b-681355fcd8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:17.461944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ad7ec677-ff9d-4e40-909b-681355fcd8d4 None None] MFA Rules not processed for user `f0aa9590b71e42dd97ce18c71f754d92`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:17.463663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ad7ec677-ff9d-4e40-909b-681355fcd8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:17.539025 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3551/7190] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:17 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:17.550038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75e0f1-5e42-4f51-b89f-5d54c4e1dba7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:17.550595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75e0f1-5e42-4f51-b89f-5d54c4e1dba7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:17.550729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75e0f1-5e42-4f51-b89f-5d54c4e1dba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:17.571046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-da75e0f1-5e42-4f51-b89f-5d54c4e1dba7 None None] MFA Rules not processed for user `f0aa9590b71e42dd97ce18c71f754d92`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:17.572258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-da75e0f1-5e42-4f51-b89f-5d54c4e1dba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:17.579924 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3640/7191] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:17 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:17.590781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ec677-ff9d-4e40-909b-681355fcd8d4 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:17.592315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ad7ec677-ff9d-4e40-909b-681355fcd8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:17.673998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ec677-ff9d-4e40-909b-681355fcd8d4 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:17.682083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248427b-16d4-492d-9df1-0b6254871040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:17.682781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248427b-16d4-492d-9df1-0b6254871040 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:17.683101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248427b-16d4-492d-9df1-0b6254871040 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:17.683323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248427b-16d4-492d-9df1-0b6254871040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:17.696624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248427b-16d4-492d-9df1-0b6254871040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:17.698714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248427b-16d4-492d-9df1-0b6254871040 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:17.712167 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3552/7192] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:17 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:13:18.380964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75e0f1-5e42-4f51-b89f-5d54c4e1dba7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:18.393582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75e0f1-5e42-4f51-b89f-5d54c4e1dba7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:18.399236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d0a9d-5297-4722-87bc-4f2b18654ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:18.400052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d0a9d-5297-4722-87bc-4f2b18654ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:18.400327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d0a9d-5297-4722-87bc-4f2b18654ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:18.400602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d0a9d-5297-4722-87bc-4f2b18654ae8 admin admin] PATH_INFO: `/v3/users/f0aa9590b71e42dd97ce18c71f754d92` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:18.402046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d0a9d-5297-4722-87bc-4f2b18654ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0aa9590b71e42dd97ce18c71f754d92)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:18.404079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d0a9d-5297-4722-87bc-4f2b18654ae8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:18.459550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6a0d0a9d-5297-4722-87bc-4f2b18654ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0aa9590b71e42dd97ce18c71f754d92'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:18.469221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6a0d0a9d-5297-4722-87bc-4f2b18654ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0aa9590b71e42dd97ce18c71f754d92'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:18.470612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6a0d0a9d-5297-4722-87bc-4f2b18654ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0aa9590b71e42dd97ce18c71f754d92'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:18.487279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6a0d0a9d-5297-4722-87bc-4f2b18654ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0aa9590b71e42dd97ce18c71f754d92'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:18.496760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6a0d0a9d-5297-4722-87bc-4f2b18654ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0aa9590b71e42dd97ce18c71f754d92'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:18.506605 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3641/7193] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:13:18 2021] DELETE /identity/v3/users/f0aa9590b71e42dd97ce18c71f754d92 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:18.707022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248427b-16d4-492d-9df1-0b6254871040 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:18.729786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248427b-16d4-492d-9df1-0b6254871040 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:18.800084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ba8b6-cad0-4d8d-bb73-14eda2caaa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:18.802127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ba8b6-cad0-4d8d-bb73-14eda2caaa35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:18.802493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ba8b6-cad0-4d8d-bb73-14eda2caaa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:18.802781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ba8b6-cad0-4d8d-bb73-14eda2caaa35 admin admin] PATH_INFO: `/v3/projects/58b273f8fe954ef68fd69d06622b1824` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:18.804316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ba8b6-cad0-4d8d-bb73-14eda2caaa35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b273f8fe954ef68fd69d06622b1824)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:18.806224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ba8b6-cad0-4d8d-bb73-14eda2caaa35 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:18.859873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ac9ba8b6-cad0-4d8d-bb73-14eda2caaa35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b273f8fe954ef68fd69d06622b1824', 'request_id': 'req-ac9ba8b6-cad0-4d8d-bb73-14eda2caaa35'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:18.866017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ac9ba8b6-cad0-4d8d-bb73-14eda2caaa35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b273f8fe954ef68fd69d06622b1824', 'request_id': 'req-ac9ba8b6-cad0-4d8d-bb73-14eda2caaa35'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:18.872356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ac9ba8b6-cad0-4d8d-bb73-14eda2caaa35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b273f8fe954ef68fd69d06622b1824', 'request_id': 'req-ac9ba8b6-cad0-4d8d-bb73-14eda2caaa35'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:18.888510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ac9ba8b6-cad0-4d8d-bb73-14eda2caaa35 admin admin] The token cache is being invalidate because project 58b273f8fe954ef68fd69d06622b1824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:18.888836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ac9ba8b6-cad0-4d8d-bb73-14eda2caaa35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:18.889808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ac9ba8b6-cad0-4d8d-bb73-14eda2caaa35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:18.891579 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3553/7194] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:18 2021] DELETE /identity/v3/projects/58b273f8fe954ef68fd69d06622b1824 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:18.899755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361175da-fa4d-4532-918b-241b5b4d56f4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:18.900303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361175da-fa4d-4532-918b-241b5b4d56f4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:18.900464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361175da-fa4d-4532-918b-241b5b4d56f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:18.920486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-361175da-fa4d-4532-918b-241b5b4d56f4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:18.921642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-361175da-fa4d-4532-918b-241b5b4d56f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:18.992978 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3642/7195] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:19.001178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25596a6-5138-4505-b1eb-39c7d5aa6621 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:19.001470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25596a6-5138-4505-b1eb-39c7d5aa6621 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:19.001749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25596a6-5138-4505-b1eb-39c7d5aa6621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:19.020351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a25596a6-5138-4505-b1eb-39c7d5aa6621 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:19.021545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a25596a6-5138-4505-b1eb-39c7d5aa6621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:19.032193 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3554/7196] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:19.037682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361175da-fa4d-4532-918b-241b5b4d56f4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:19.047522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361175da-fa4d-4532-918b-241b5b4d56f4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:19.052376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971499a-aaf9-4ea5-a5c6-7b695e390f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:19.053331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971499a-aaf9-4ea5-a5c6-7b695e390f89 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:19.053666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971499a-aaf9-4ea5-a5c6-7b695e390f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:19.054657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971499a-aaf9-4ea5-a5c6-7b695e390f89 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:19.055491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971499a-aaf9-4ea5-a5c6-7b695e390f89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:13:19.055768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971499a-aaf9-4ea5-a5c6-7b695e390f89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:19.057453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971499a-aaf9-4ea5-a5c6-7b695e390f89 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:19.073857 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3643/7197] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:13:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:19.075241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25596a6-5138-4505-b1eb-39c7d5aa6621 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:19.085444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25596a6-5138-4505-b1eb-39c7d5aa6621 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:19.091166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf05ec-90d4-4fa2-9a58-350a02d90517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:19.092099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf05ec-90d4-4fa2-9a58-350a02d90517 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:19.092400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf05ec-90d4-4fa2-9a58-350a02d90517 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:19.092680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf05ec-90d4-4fa2-9a58-350a02d90517 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:19.093417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf05ec-90d4-4fa2-9a58-350a02d90517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:19.095381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf05ec-90d4-4fa2-9a58-350a02d90517 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:19.125051 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3555/7198] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:19 2021] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:19.129722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971499a-aaf9-4ea5-a5c6-7b695e390f89 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:19.141056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971499a-aaf9-4ea5-a5c6-7b695e390f89 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:19.198981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b9ad2-3c1f-4c28-a615-34a1a7a97a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:19.199656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b9ad2-3c1f-4c28-a615-34a1a7a97a43 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:19.199943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b9ad2-3c1f-4c28-a615-34a1a7a97a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:19.200227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b9ad2-3c1f-4c28-a615-34a1a7a97a43 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:19.200928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b9ad2-3c1f-4c28-a615-34a1a7a97a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:19.203003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b9ad2-3c1f-4c28-a615-34a1a7a97a43 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:19.226227 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3644/7199] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:13:19 2021] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:19.230677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf05ec-90d4-4fa2-9a58-350a02d90517 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:19.242317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf05ec-90d4-4fa2-9a58-350a02d90517 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:19.248587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f390b75-c5a7-4694-94d4-54dbbf134290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:19.249256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f390b75-c5a7-4694-94d4-54dbbf134290 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:19.249542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f390b75-c5a7-4694-94d4-54dbbf134290 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:19.249818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f390b75-c5a7-4694-94d4-54dbbf134290 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:19.250595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f390b75-c5a7-4694-94d4-54dbbf134290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:19.252324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f390b75-c5a7-4694-94d4-54dbbf134290 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:19.264413 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3556/7200] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:19 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:19.268521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b9ad2-3c1f-4c28-a615-34a1a7a97a43 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:19.280633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b9ad2-3c1f-4c28-a615-34a1a7a97a43 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:19.289843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e3c35-a4cc-41a9-90f8-cbb3861fef8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:19.291198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e3c35-a4cc-41a9-90f8-cbb3861fef8a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:19.291198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e3c35-a4cc-41a9-90f8-cbb3861fef8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:19.291448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e3c35-a4cc-41a9-90f8-cbb3861fef8a admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:19.292076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e3c35-a4cc-41a9-90f8-cbb3861fef8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:19.293913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e3c35-a4cc-41a9-90f8-cbb3861fef8a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:19.305900 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3645/7201] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:19 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:19.309836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f390b75-c5a7-4694-94d4-54dbbf134290 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:19.320278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f390b75-c5a7-4694-94d4-54dbbf134290 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:19.325132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943da96-5996-40c7-b50d-7428370d0af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:19.326019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943da96-5996-40c7-b50d-7428370d0af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:19.326339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943da96-5996-40c7-b50d-7428370d0af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:19.326656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943da96-5996-40c7-b50d-7428370d0af5 admin admin] PATH_INFO: `/v3/projects/64c0565b7a2043099dc12fe5d8814e10/users/e50af154211b4dd187653e3ce39383f3/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:19.343825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943da96-5996-40c7-b50d-7428370d0af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c0565b7a2043099dc12fe5d8814e10, user_id=e50af154211b4dd187653e3ce39383f3, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:19.347129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943da96-5996-40c7-b50d-7428370d0af5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:19.362791 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3557/7202] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:19 2021] PUT /identity/v3/projects/64c0565b7a2043099dc12fe5d8814e10/users/e50af154211b4dd187653e3ce39383f3/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:19.373370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d88c6a-dcf4-4924-8491-f5643f62b950 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:19.373668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d88c6a-dcf4-4924-8491-f5643f62b950 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:19.373953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d88c6a-dcf4-4924-8491-f5643f62b950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:19.406734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f7d88c6a-dcf4-4924-8491-f5643f62b950 None None] MFA Rules not processed for user `e50af154211b4dd187653e3ce39383f3`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:19.407994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f7d88c6a-dcf4-4924-8491-f5643f62b950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:19.478205 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3646/7203] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:19 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:19.480315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943da96-5996-40c7-b50d-7428370d0af5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:19.545985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943da96-5996-40c7-b50d-7428370d0af5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:19.551802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13377b9e-7229-4791-9929-a99ef5f4d2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:19.552460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13377b9e-7229-4791-9929-a99ef5f4d2aa admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:19.552747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13377b9e-7229-4791-9929-a99ef5f4d2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:19.553022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13377b9e-7229-4791-9929-a99ef5f4d2aa admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:19.553849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13377b9e-7229-4791-9929-a99ef5f4d2aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:19.556381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13377b9e-7229-4791-9929-a99ef5f4d2aa admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:19.585808 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3558/7204] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:19 2021] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:19.589830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d88c6a-dcf4-4924-8491-f5643f62b950 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:19.606098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d88c6a-dcf4-4924-8491-f5643f62b950 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:19.669261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fb740-4078-48d2-8fc0-57322ce35318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:19.669938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fb740-4078-48d2-8fc0-57322ce35318 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:19.670223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fb740-4078-48d2-8fc0-57322ce35318 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:19.670536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fb740-4078-48d2-8fc0-57322ce35318 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:19.671240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fb740-4078-48d2-8fc0-57322ce35318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:19.673159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fb740-4078-48d2-8fc0-57322ce35318 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:19.694719 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3647/7205] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:13:19 2021] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:13:19.698823 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13377b9e-7229-4791-9929-a99ef5f4d2aa admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:19.709528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13377b9e-7229-4791-9929-a99ef5f4d2aa admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:19.720963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ee0d7-8685-4a67-9b0c-e2dd3c88f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:19.721649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ee0d7-8685-4a67-9b0c-e2dd3c88f14f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:19.722317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ee0d7-8685-4a67-9b0c-e2dd3c88f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:19.722639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ee0d7-8685-4a67-9b0c-e2dd3c88f14f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:19.723760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ee0d7-8685-4a67-9b0c-e2dd3c88f14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:19.725521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ee0d7-8685-4a67-9b0c-e2dd3c88f14f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:19.738371 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3559/7206] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:19 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:13:19.742573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fb740-4078-48d2-8fc0-57322ce35318 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:19.752694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fb740-4078-48d2-8fc0-57322ce35318 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:19.758702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04178c01-a3fe-4365-96c7-68859d374a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:19.759636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04178c01-a3fe-4365-96c7-68859d374a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:19.759980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04178c01-a3fe-4365-96c7-68859d374a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:19.760269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04178c01-a3fe-4365-96c7-68859d374a08 admin admin] PATH_INFO: `/v3/projects/aef728331c83432dbf033cb18328235b/users/11df90f08f164835a44fa11761c76b71/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:19.778114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04178c01-a3fe-4365-96c7-68859d374a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef728331c83432dbf033cb18328235b, user_id=11df90f08f164835a44fa11761c76b71, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:19.781313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04178c01-a3fe-4365-96c7-68859d374a08 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:19.800036 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3648/7207] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:19 2021] PUT /identity/v3/projects/aef728331c83432dbf033cb18328235b/users/11df90f08f164835a44fa11761c76b71/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:19.800443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ee0d7-8685-4a67-9b0c-e2dd3c88f14f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:19.813254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ee0d7-8685-4a67-9b0c-e2dd3c88f14f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:19.874845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159dc4c-0778-4db2-afaf-acb3d4fdf422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:19.875690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159dc4c-0778-4db2-afaf-acb3d4fdf422 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:19.875992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159dc4c-0778-4db2-afaf-acb3d4fdf422 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:19.876299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159dc4c-0778-4db2-afaf-acb3d4fdf422 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:19.878284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159dc4c-0778-4db2-afaf-acb3d4fdf422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:19.878889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159dc4c-0778-4db2-afaf-acb3d4fdf422 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:19.890290 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3560/7208] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:19 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:13:19.894266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04178c01-a3fe-4365-96c7-68859d374a08 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:19.905342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04178c01-a3fe-4365-96c7-68859d374a08 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:19.912458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa1b84-2c18-4aac-9a9a-ed81e86a7410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:19.914100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1b84-2c18-4aac-9a9a-ed81e86a7410 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:19.914764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1b84-2c18-4aac-9a9a-ed81e86a7410 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:19.915223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1b84-2c18-4aac-9a9a-ed81e86a7410 admin admin] PATH_INFO: `/v3/projects/aef728331c83432dbf033cb18328235b/users/11df90f08f164835a44fa11761c76b71/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:19.917990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa1b84-2c18-4aac-9a9a-ed81e86a7410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef728331c83432dbf033cb18328235b, user_id=11df90f08f164835a44fa11761c76b71, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:19.920819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa1b84-2c18-4aac-9a9a-ed81e86a7410 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:19.931966 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3649/7209] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:19 2021] PUT /identity/v3/projects/aef728331c83432dbf033cb18328235b/users/11df90f08f164835a44fa11761c76b71/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:19.944134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a639-3722-496c-bceb-7275fa258d17 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:19.944802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a639-3722-496c-bceb-7275fa258d17 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:19.945363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a639-3722-496c-bceb-7275fa258d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:20.119462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8e64a639-3722-496c-bceb-7275fa258d17 None None] MFA Rules not processed for user `11df90f08f164835a44fa11761c76b71`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:20.120697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8e64a639-3722-496c-bceb-7275fa258d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:20.192240 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3561/7210] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:19 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:13:20.197054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa1b84-2c18-4aac-9a9a-ed81e86a7410 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:20.208067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa1b84-2c18-4aac-9a9a-ed81e86a7410 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:20.217019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028a819-f177-45da-9d4a-01375c89b3e0 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11df90f08f164835a44fa11761c76b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef728331c83432dbf033cb18328235b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:20.217732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028a819-f177-45da-9d4a-01375c89b3e0 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:20.218224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028a819-f177-45da-9d4a-01375c89b3e0 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:20.218726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028a819-f177-45da-9d4a-01375c89b3e0 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:20.219483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028a819-f177-45da-9d4a-01375c89b3e0 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:20.221559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028a819-f177-45da-9d4a-01375c89b3e0 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:20.255952 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3650/7211] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:13:20 2021] POST /identity/v3/projects => generated 349 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:20.260846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64a639-3722-496c-bceb-7275fa258d17 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:20.270746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64a639-3722-496c-bceb-7275fa258d17 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:20.338743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b1a67-685f-48e6-afc6-bd70edc42d4a tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11df90f08f164835a44fa11761c76b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef728331c83432dbf033cb18328235b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:20.339410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b1a67-685f-48e6-afc6-bd70edc42d4a tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:20.339693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b1a67-685f-48e6-afc6-bd70edc42d4a tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:20.339969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b1a67-685f-48e6-afc6-bd70edc42d4a tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:20.340666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b1a67-685f-48e6-afc6-bd70edc42d4a tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:20.342581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b1a67-685f-48e6-afc6-bd70edc42d4a tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:20.378917 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3562/7212] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:20 2021] POST /identity/v3/projects => generated 351 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:20.383644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028a819-f177-45da-9d4a-01375c89b3e0 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:20.394936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028a819-f177-45da-9d4a-01375c89b3e0 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:20.471786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20131b9-174c-40a4-b12c-722fd9885475 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11df90f08f164835a44fa11761c76b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef728331c83432dbf033cb18328235b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:20.472976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20131b9-174c-40a4-b12c-722fd9885475 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:20.473318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20131b9-174c-40a4-b12c-722fd9885475 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:20.473668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20131b9-174c-40a4-b12c-722fd9885475 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] PATH_INFO: `/v3/users/e50af154211b4dd187653e3ce39383f3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:20.475053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20131b9-174c-40a4-b12c-722fd9885475 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorizing `identity:get_user(user_id=e50af154211b4dd187653e3ce39383f3)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:20.477564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20131b9-174c-40a4-b12c-722fd9885475 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:20.479322 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3651/7213] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 21:13:20 2021] GET /identity/v3/users/e50af154211b4dd187653e3ce39383f3 => generated 288 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:20.484082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b1a67-685f-48e6-afc6-bd70edc42d4a tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:20.495688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b1a67-685f-48e6-afc6-bd70edc42d4a tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:20.500654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81df40-92fb-45d6-a6bb-ec895cdbf3c1 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11df90f08f164835a44fa11761c76b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef728331c83432dbf033cb18328235b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:20.501325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81df40-92fb-45d6-a6bb-ec895cdbf3c1 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:20.501610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81df40-92fb-45d6-a6bb-ec895cdbf3c1 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:20.501888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81df40-92fb-45d6-a6bb-ec895cdbf3c1 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] PATH_INFO: `/v3/credentials` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:20.502646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81df40-92fb-45d6-a6bb-ec895cdbf3c1 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:20.504674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81df40-92fb-45d6-a6bb-ec895cdbf3c1 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:20.526232 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3563/7214] 10.222.0.13 () {60 vars in 1161 bytes} [Sat Dec 18 21:13:20 2021] POST /identity/v3/credentials => generated 430 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:20.530182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20131b9-174c-40a4-b12c-722fd9885475 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:20.542506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20131b9-174c-40a4-b12c-722fd9885475 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:20.548715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb6e29-bea5-4755-b604-1498518b6fc6 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11df90f08f164835a44fa11761c76b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef728331c83432dbf033cb18328235b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:20.549720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb6e29-bea5-4755-b604-1498518b6fc6 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:20.550016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb6e29-bea5-4755-b604-1498518b6fc6 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:20.550336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb6e29-bea5-4755-b604-1498518b6fc6 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] PATH_INFO: `/v3/credentials/1fb83d65d4b42cab660f2ac6847363a5dad7d94b2bd667987e229c685deac81d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:20.552910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb6e29-bea5-4755-b604-1498518b6fc6 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=1fb83d65d4b42cab660f2ac6847363a5dad7d94b2bd667987e229c685deac81d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:20.555283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb6e29-bea5-4755-b604-1498518b6fc6 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:20.557461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb6e29-bea5-4755-b604-1498518b6fc6 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=1fb83d65d4b42cab660f2ac6847363a5dad7d94b2bd667987e229c685deac81d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:20.559353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb6e29-bea5-4755-b604-1498518b6fc6 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:20.577420 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3652/7215] 10.222.0.13 () {60 vars in 1357 bytes} [Sat Dec 18 21:13:20 2021] PATCH /identity/v3/credentials/1fb83d65d4b42cab660f2ac6847363a5dad7d94b2bd667987e229c685deac81d => generated 436 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:20.579006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81df40-92fb-45d6-a6bb-ec895cdbf3c1 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:20.590754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81df40-92fb-45d6-a6bb-ec895cdbf3c1 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:20.601682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff51b8-aa21-4395-a03d-fee68ad5c90a tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11df90f08f164835a44fa11761c76b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef728331c83432dbf033cb18328235b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:20.602743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff51b8-aa21-4395-a03d-fee68ad5c90a tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:20.603225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff51b8-aa21-4395-a03d-fee68ad5c90a tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:20.603438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff51b8-aa21-4395-a03d-fee68ad5c90a tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] PATH_INFO: `/v3/credentials/1fb83d65d4b42cab660f2ac6847363a5dad7d94b2bd667987e229c685deac81d` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:20.606772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff51b8-aa21-4395-a03d-fee68ad5c90a tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=1fb83d65d4b42cab660f2ac6847363a5dad7d94b2bd667987e229c685deac81d)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:20.611911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff51b8-aa21-4395-a03d-fee68ad5c90a tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:20.615800 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3564/7216] 10.222.0.13 () {58 vars in 1334 bytes} [Sat Dec 18 21:13:20 2021] GET /identity/v3/credentials/1fb83d65d4b42cab660f2ac6847363a5dad7d94b2bd667987e229c685deac81d => generated 436 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:13:20.620126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb6e29-bea5-4755-b604-1498518b6fc6 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:20.633194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb6e29-bea5-4755-b604-1498518b6fc6 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:20.639285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691438c6-4a0e-495d-87cf-300cf1aa6ca5 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11df90f08f164835a44fa11761c76b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef728331c83432dbf033cb18328235b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:20.640366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691438c6-4a0e-495d-87cf-300cf1aa6ca5 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:20.640652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691438c6-4a0e-495d-87cf-300cf1aa6ca5 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:20.641092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691438c6-4a0e-495d-87cf-300cf1aa6ca5 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] PATH_INFO: `/v3/credentials/1fb83d65d4b42cab660f2ac6847363a5dad7d94b2bd667987e229c685deac81d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:20.643549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691438c6-4a0e-495d-87cf-300cf1aa6ca5 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=1fb83d65d4b42cab660f2ac6847363a5dad7d94b2bd667987e229c685deac81d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:20.645746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691438c6-4a0e-495d-87cf-300cf1aa6ca5 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:20.670673 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3653/7217] 10.222.0.13 () {58 vars in 1337 bytes} [Sat Dec 18 21:13:20 2021] DELETE /identity/v3/credentials/1fb83d65d4b42cab660f2ac6847363a5dad7d94b2bd667987e229c685deac81d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:20.672303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff51b8-aa21-4395-a03d-fee68ad5c90a tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:20.685061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff51b8-aa21-4395-a03d-fee68ad5c90a tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:20.689900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8a49c-10c3-49d4-a5e8-752d27bdd1e4 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11df90f08f164835a44fa11761c76b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef728331c83432dbf033cb18328235b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:20.690593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8a49c-10c3-49d4-a5e8-752d27bdd1e4 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:20.690919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8a49c-10c3-49d4-a5e8-752d27bdd1e4 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:20.691187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8a49c-10c3-49d4-a5e8-752d27bdd1e4 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] PATH_INFO: `/v3/credentials` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:20.692470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8a49c-10c3-49d4-a5e8-752d27bdd1e4 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:20.694208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8a49c-10c3-49d4-a5e8-752d27bdd1e4 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:20.711857 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3565/7218] 10.222.0.13 () {60 vars in 1161 bytes} [Sat Dec 18 21:13:20 2021] POST /identity/v3/credentials => generated 430 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:13:20.715921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691438c6-4a0e-495d-87cf-300cf1aa6ca5 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:20.726455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691438c6-4a0e-495d-87cf-300cf1aa6ca5 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:20.731340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058e9b8-0b74-4cd6-aaef-1b9ba99fde86 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11df90f08f164835a44fa11761c76b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef728331c83432dbf033cb18328235b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:20.731993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058e9b8-0b74-4cd6-aaef-1b9ba99fde86 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:20.732279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058e9b8-0b74-4cd6-aaef-1b9ba99fde86 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:20.732565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058e9b8-0b74-4cd6-aaef-1b9ba99fde86 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] PATH_INFO: `/v3/credentials` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:20.733430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058e9b8-0b74-4cd6-aaef-1b9ba99fde86 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:20.735246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058e9b8-0b74-4cd6-aaef-1b9ba99fde86 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:20.758170 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3654/7219] 10.222.0.13 () {60 vars in 1161 bytes} [Sat Dec 18 21:13:20 2021] POST /identity/v3/credentials => generated 430 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:13:20.759769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8a49c-10c3-49d4-a5e8-752d27bdd1e4 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:20.769999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8a49c-10c3-49d4-a5e8-752d27bdd1e4 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:20.775258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72044a6a-b70b-4119-be37-11ed8b5771fe tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11df90f08f164835a44fa11761c76b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef728331c83432dbf033cb18328235b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:20.776098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72044a6a-b70b-4119-be37-11ed8b5771fe tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:20.777059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72044a6a-b70b-4119-be37-11ed8b5771fe tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:20.777362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72044a6a-b70b-4119-be37-11ed8b5771fe tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] PATH_INFO: `/v3/credentials` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:20.778295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72044a6a-b70b-4119-be37-11ed8b5771fe tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:20.779803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72044a6a-b70b-4119-be37-11ed8b5771fe tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:20.787155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72044a6a-b70b-4119-be37-11ed8b5771fe tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:20.789649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72044a6a-b70b-4119-be37-11ed8b5771fe tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:20.791083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72044a6a-b70b-4119-be37-11ed8b5771fe tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:20.792656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72044a6a-b70b-4119-be37-11ed8b5771fe tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:20.794723 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3566/7220] 10.222.0.13 () {58 vars in 1139 bytes} [Sat Dec 18 21:13:20 2021] GET /identity/v3/credentials => generated 945 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:20.798993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058e9b8-0b74-4cd6-aaef-1b9ba99fde86 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:20.809648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058e9b8-0b74-4cd6-aaef-1b9ba99fde86 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:20.814532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06771bf4-65f2-4984-8ca7-d4a1b3947bdb tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11df90f08f164835a44fa11761c76b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef728331c83432dbf033cb18328235b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:20.815459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06771bf4-65f2-4984-8ca7-d4a1b3947bdb tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:20.815740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06771bf4-65f2-4984-8ca7-d4a1b3947bdb tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:20.816019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06771bf4-65f2-4984-8ca7-d4a1b3947bdb tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] PATH_INFO: `/v3/credentials/c59f82877963952e0c931ef9b77cd36c73e32be1386c36f3370df697913b9406` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:20.818288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06771bf4-65f2-4984-8ca7-d4a1b3947bdb tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=c59f82877963952e0c931ef9b77cd36c73e32be1386c36f3370df697913b9406)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:20.820359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06771bf4-65f2-4984-8ca7-d4a1b3947bdb tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:20.836880 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3655/7221] 10.222.0.13 () {58 vars in 1337 bytes} [Sat Dec 18 21:13:20 2021] DELETE /identity/v3/credentials/c59f82877963952e0c931ef9b77cd36c73e32be1386c36f3370df697913b9406 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:13:20.840948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72044a6a-b70b-4119-be37-11ed8b5771fe tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:20.852674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72044a6a-b70b-4119-be37-11ed8b5771fe tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:20.857391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c4995-3e8b-49df-926f-44465c86365e tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11df90f08f164835a44fa11761c76b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef728331c83432dbf033cb18328235b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:20.858351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c4995-3e8b-49df-926f-44465c86365e tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:20.858637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c4995-3e8b-49df-926f-44465c86365e tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:20.858917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c4995-3e8b-49df-926f-44465c86365e tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] PATH_INFO: `/v3/credentials/2c94374205643ce3c003cb73ac79170faf20f75a422cd4d497e3660b49217be2` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:20.861077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c4995-3e8b-49df-926f-44465c86365e tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=2c94374205643ce3c003cb73ac79170faf20f75a422cd4d497e3660b49217be2)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:20.863249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c4995-3e8b-49df-926f-44465c86365e tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:20.882092 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3567/7222] 10.222.0.13 () {58 vars in 1337 bytes} [Sat Dec 18 21:13:20 2021] DELETE /identity/v3/credentials/2c94374205643ce3c003cb73ac79170faf20f75a422cd4d497e3660b49217be2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:20.886941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06771bf4-65f2-4984-8ca7-d4a1b3947bdb tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:20.897087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06771bf4-65f2-4984-8ca7-d4a1b3947bdb tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:20.902150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798ba8c-5663-4f11-ad6f-4951ca3c139d tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11df90f08f164835a44fa11761c76b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef728331c83432dbf033cb18328235b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:20.903661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798ba8c-5663-4f11-ad6f-4951ca3c139d tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:20.903954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798ba8c-5663-4f11-ad6f-4951ca3c139d tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:20.904238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798ba8c-5663-4f11-ad6f-4951ca3c139d tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] PATH_INFO: `/v3/projects/db63ec1f9272474eaedd8050380fd673` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:20.905470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798ba8c-5663-4f11-ad6f-4951ca3c139d tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorizing `identity:delete_project(project_id=db63ec1f9272474eaedd8050380fd673)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:20.907687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798ba8c-5663-4f11-ad6f-4951ca3c139d tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:20.957495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9798ba8c-5663-4f11-ad6f-4951ca3c139d tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db63ec1f9272474eaedd8050380fd673', 'request_id': 'req-9798ba8c-5663-4f11-ad6f-4951ca3c139d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:20.983891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9798ba8c-5663-4f11-ad6f-4951ca3c139d tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db63ec1f9272474eaedd8050380fd673', 'request_id': 'req-9798ba8c-5663-4f11-ad6f-4951ca3c139d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:20.992443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9798ba8c-5663-4f11-ad6f-4951ca3c139d tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db63ec1f9272474eaedd8050380fd673', 'request_id': 'req-9798ba8c-5663-4f11-ad6f-4951ca3c139d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:21.003007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9798ba8c-5663-4f11-ad6f-4951ca3c139d tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] The token cache is being invalidate because project db63ec1f9272474eaedd8050380fd673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:21.003304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9798ba8c-5663-4f11-ad6f-4951ca3c139d tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:21.004044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9798ba8c-5663-4f11-ad6f-4951ca3c139d tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:21.005669 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3656/7223] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:20 2021] DELETE /identity/v3/projects/db63ec1f9272474eaedd8050380fd673 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:13:21.009617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c4995-3e8b-49df-926f-44465c86365e tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:21.011426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3e8c4995-3e8b-49df-926f-44465c86365e tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:21.026002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c4995-3e8b-49df-926f-44465c86365e tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:21.088188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74daef70-309a-4b6f-842a-13289b74c916 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11df90f08f164835a44fa11761c76b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef728331c83432dbf033cb18328235b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:21.089041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daef70-309a-4b6f-842a-13289b74c916 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:21.089321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daef70-309a-4b6f-842a-13289b74c916 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:21.089636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daef70-309a-4b6f-842a-13289b74c916 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] PATH_INFO: `/v3/projects/72b96cce6b5e4521b726fbb670ac3717` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:21.090805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74daef70-309a-4b6f-842a-13289b74c916 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorizing `identity:delete_project(project_id=72b96cce6b5e4521b726fbb670ac3717)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:21.092744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74daef70-309a-4b6f-842a-13289b74c916 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:21.138567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74daef70-309a-4b6f-842a-13289b74c916 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b96cce6b5e4521b726fbb670ac3717', 'request_id': 'req-74daef70-309a-4b6f-842a-13289b74c916'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:21.145165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74daef70-309a-4b6f-842a-13289b74c916 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b96cce6b5e4521b726fbb670ac3717', 'request_id': 'req-74daef70-309a-4b6f-842a-13289b74c916'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:21.152032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74daef70-309a-4b6f-842a-13289b74c916 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b96cce6b5e4521b726fbb670ac3717', 'request_id': 'req-74daef70-309a-4b6f-842a-13289b74c916'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:21.167480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74daef70-309a-4b6f-842a-13289b74c916 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] The token cache is being invalidate because project 72b96cce6b5e4521b726fbb670ac3717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:21.167852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74daef70-309a-4b6f-842a-13289b74c916 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:21.168950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74daef70-309a-4b6f-842a-13289b74c916 tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:21.170715 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3568/7224] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:21 2021] DELETE /identity/v3/projects/72b96cce6b5e4521b726fbb670ac3717 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:21.174369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798ba8c-5663-4f11-ad6f-4951ca3c139d tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:21.176515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9798ba8c-5663-4f11-ad6f-4951ca3c139d tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:21.249415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798ba8c-5663-4f11-ad6f-4951ca3c139d tempest-CredentialsTestJSON-1275796847 tempest-CredentialsTestJSON-1275796847-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:21.321767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef14458-2d1b-4751-9cb3-c7bc98d97ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:21.322798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14458-2d1b-4751-9cb3-c7bc98d97ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:21.323307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14458-2d1b-4751-9cb3-c7bc98d97ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:21.323597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef14458-2d1b-4751-9cb3-c7bc98d97ab4 admin admin] PATH_INFO: `/v3/users/e50af154211b4dd187653e3ce39383f3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:21.325057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef14458-2d1b-4751-9cb3-c7bc98d97ab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e50af154211b4dd187653e3ce39383f3)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:21.327148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef14458-2d1b-4751-9cb3-c7bc98d97ab4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:21.378930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cef14458-2d1b-4751-9cb3-c7bc98d97ab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e50af154211b4dd187653e3ce39383f3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:21.385771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cef14458-2d1b-4751-9cb3-c7bc98d97ab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e50af154211b4dd187653e3ce39383f3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:21.386483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cef14458-2d1b-4751-9cb3-c7bc98d97ab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e50af154211b4dd187653e3ce39383f3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:21.398932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cef14458-2d1b-4751-9cb3-c7bc98d97ab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e50af154211b4dd187653e3ce39383f3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:21.406417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cef14458-2d1b-4751-9cb3-c7bc98d97ab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e50af154211b4dd187653e3ce39383f3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:21.413042 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3657/7225] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:13:21 2021] DELETE /identity/v3/users/e50af154211b4dd187653e3ce39383f3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:21.418376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9aec54-e27d-4dab-bbf0-1451ac72173d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:21.418772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9aec54-e27d-4dab-bbf0-1451ac72173d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:21.419067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9aec54-e27d-4dab-bbf0-1451ac72173d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:21.437960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8b9aec54-e27d-4dab-bbf0-1451ac72173d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:21.439238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8b9aec54-e27d-4dab-bbf0-1451ac72173d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:21.475513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748b933-888e-4de1-983a-15e5210712df None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:21.476477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748b933-888e-4de1-983a-15e5210712df None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:21.476860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748b933-888e-4de1-983a-15e5210712df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:21.495964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d748b933-888e-4de1-983a-15e5210712df None None] MFA Rules not processed for user `a3e6bef41b9948099215b02cdca829bf`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:21.497284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d748b933-888e-4de1-983a-15e5210712df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:21.507957 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3569/7226] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:13:21.517633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9aec54-e27d-4dab-bbf0-1451ac72173d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:21.519089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8b9aec54-e27d-4dab-bbf0-1451ac72173d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:21.555053 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3658/7227] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:21 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:13:21.577963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9aec54-e27d-4dab-bbf0-1451ac72173d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:21.582390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd01d52-5376-4b2d-85db-8356dfddb2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:21.583048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd01d52-5376-4b2d-85db-8356dfddb2fb service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:21.583336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd01d52-5376-4b2d-85db-8356dfddb2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:21.583645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd01d52-5376-4b2d-85db-8356dfddb2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:21.594020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd01d52-5376-4b2d-85db-8356dfddb2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:21.595802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd01d52-5376-4b2d-85db-8356dfddb2fb service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:21.606272 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3570/7228] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:13:22.000864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748b933-888e-4de1-983a-15e5210712df None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:22.002296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d748b933-888e-4de1-983a-15e5210712df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:22.027474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748b933-888e-4de1-983a-15e5210712df None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:22.034682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67373874-e99f-4eb6-bf75-9affb308ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:22.035582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67373874-e99f-4eb6-bf75-9affb308ceba admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:22.035907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67373874-e99f-4eb6-bf75-9affb308ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:22.036421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67373874-e99f-4eb6-bf75-9affb308ceba admin admin] PATH_INFO: `/v3/projects/64c0565b7a2043099dc12fe5d8814e10` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:22.037709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67373874-e99f-4eb6-bf75-9affb308ceba admin admin] RBAC: Authorizing `identity:delete_project(project_id=64c0565b7a2043099dc12fe5d8814e10)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:22.040797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67373874-e99f-4eb6-bf75-9affb308ceba admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:22.102185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-67373874-e99f-4eb6-bf75-9affb308ceba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64c0565b7a2043099dc12fe5d8814e10', 'request_id': 'req-67373874-e99f-4eb6-bf75-9affb308ceba'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:22.109803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-67373874-e99f-4eb6-bf75-9affb308ceba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64c0565b7a2043099dc12fe5d8814e10', 'request_id': 'req-67373874-e99f-4eb6-bf75-9affb308ceba'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:22.120932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-67373874-e99f-4eb6-bf75-9affb308ceba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64c0565b7a2043099dc12fe5d8814e10', 'request_id': 'req-67373874-e99f-4eb6-bf75-9affb308ceba'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:22.137516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-67373874-e99f-4eb6-bf75-9affb308ceba admin admin] The token cache is being invalidate because project 64c0565b7a2043099dc12fe5d8814e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:22.137972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-67373874-e99f-4eb6-bf75-9affb308ceba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:22.138772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-67373874-e99f-4eb6-bf75-9affb308ceba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:22.140765 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3659/7229] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:21 2021] DELETE /identity/v3/projects/64c0565b7a2043099dc12fe5d8814e10 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:22.144921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd01d52-5376-4b2d-85db-8356dfddb2fb service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:22.157544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd01d52-5376-4b2d-85db-8356dfddb2fb service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:22.236581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d6e0c-6b26-4d36-999b-9fa5987a2d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:22.237651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d6e0c-6b26-4d36-999b-9fa5987a2d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:22.237936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d6e0c-6b26-4d36-999b-9fa5987a2d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:22.238215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d6e0c-6b26-4d36-999b-9fa5987a2d1c admin admin] PATH_INFO: `/v3/users/11df90f08f164835a44fa11761c76b71` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:22.241108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d6e0c-6b26-4d36-999b-9fa5987a2d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=11df90f08f164835a44fa11761c76b71)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:22.243557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d6e0c-6b26-4d36-999b-9fa5987a2d1c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:22.321955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8c4d6e0c-6b26-4d36-999b-9fa5987a2d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11df90f08f164835a44fa11761c76b71'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:22.329572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8c4d6e0c-6b26-4d36-999b-9fa5987a2d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11df90f08f164835a44fa11761c76b71'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:22.349288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8c4d6e0c-6b26-4d36-999b-9fa5987a2d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11df90f08f164835a44fa11761c76b71'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:22.353515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8c4d6e0c-6b26-4d36-999b-9fa5987a2d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11df90f08f164835a44fa11761c76b71'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:22.364153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8c4d6e0c-6b26-4d36-999b-9fa5987a2d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11df90f08f164835a44fa11761c76b71'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:22.372622 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3571/7230] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:13:22 2021] DELETE /identity/v3/users/11df90f08f164835a44fa11761c76b71 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:22.392139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67373874-e99f-4eb6-bf75-9affb308ceba admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:22.393580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-67373874-e99f-4eb6-bf75-9affb308ceba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:22.530602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67373874-e99f-4eb6-bf75-9affb308ceba admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:22.647316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc99dbd-3685-4507-a3cf-5bbf32d1de9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:22.648876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc99dbd-3685-4507-a3cf-5bbf32d1de9f service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:22.649228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc99dbd-3685-4507-a3cf-5bbf32d1de9f service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:22.649576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc99dbd-3685-4507-a3cf-5bbf32d1de9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:22.651545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ffc99dbd-3685-4507-a3cf-5bbf32d1de9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:22.683533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc99dbd-3685-4507-a3cf-5bbf32d1de9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:22.686165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc99dbd-3685-4507-a3cf-5bbf32d1de9f service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:22.705250 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3660/7231] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:22 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:13:22.751797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d6e0c-6b26-4d36-999b-9fa5987a2d1c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:22.753614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8c4d6e0c-6b26-4d36-999b-9fa5987a2d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:22.847721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d6e0c-6b26-4d36-999b-9fa5987a2d1c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:22.853909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635bbd6-aa74-4b7f-a52f-8dd1286d3e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:22.854845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635bbd6-aa74-4b7f-a52f-8dd1286d3e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:22.855133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635bbd6-aa74-4b7f-a52f-8dd1286d3e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:22.855409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635bbd6-aa74-4b7f-a52f-8dd1286d3e62 admin admin] PATH_INFO: `/v3/projects/aef728331c83432dbf033cb18328235b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:22.856778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635bbd6-aa74-4b7f-a52f-8dd1286d3e62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef728331c83432dbf033cb18328235b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:22.858882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635bbd6-aa74-4b7f-a52f-8dd1286d3e62 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:22.912509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8635bbd6-aa74-4b7f-a52f-8dd1286d3e62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef728331c83432dbf033cb18328235b', 'request_id': 'req-8635bbd6-aa74-4b7f-a52f-8dd1286d3e62'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:22.919634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8635bbd6-aa74-4b7f-a52f-8dd1286d3e62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef728331c83432dbf033cb18328235b', 'request_id': 'req-8635bbd6-aa74-4b7f-a52f-8dd1286d3e62'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:22.927232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8635bbd6-aa74-4b7f-a52f-8dd1286d3e62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef728331c83432dbf033cb18328235b', 'request_id': 'req-8635bbd6-aa74-4b7f-a52f-8dd1286d3e62'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:22.940116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8635bbd6-aa74-4b7f-a52f-8dd1286d3e62 admin admin] The token cache is being invalidate because project aef728331c83432dbf033cb18328235b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:22.940414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8635bbd6-aa74-4b7f-a52f-8dd1286d3e62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:22.941198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8635bbd6-aa74-4b7f-a52f-8dd1286d3e62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:22.943110 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3572/7232] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:22 2021] DELETE /identity/v3/projects/aef728331c83432dbf033cb18328235b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:22.948899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fb04b-bbc0-46dc-a81f-df89e43cf92c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:22.949188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fb04b-bbc0-46dc-a81f-df89e43cf92c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:22.949470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fb04b-bbc0-46dc-a81f-df89e43cf92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:22.969249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c72fb04b-bbc0-46dc-a81f-df89e43cf92c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:22.970511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c72fb04b-bbc0-46dc-a81f-df89e43cf92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:23.037141 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3661/7233] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:13:23.046024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602be4dc-7715-4c7c-b9ef-b945a9924b36 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:23.046024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602be4dc-7715-4c7c-b9ef-b945a9924b36 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:23.046024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602be4dc-7715-4c7c-b9ef-b945a9924b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:23.065427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-602be4dc-7715-4c7c-b9ef-b945a9924b36 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:23.067023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-602be4dc-7715-4c7c-b9ef-b945a9924b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:23.077879 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3573/7234] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:23.081965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fb04b-bbc0-46dc-a81f-df89e43cf92c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:23.094517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fb04b-bbc0-46dc-a81f-df89e43cf92c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:23.101502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a9a68-406b-49cd-b91a-ae3f29ce4616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:23.102498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a9a68-406b-49cd-b91a-ae3f29ce4616 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:23.103015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a9a68-406b-49cd-b91a-ae3f29ce4616 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:23.103482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a9a68-406b-49cd-b91a-ae3f29ce4616 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:23.104481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a9a68-406b-49cd-b91a-ae3f29ce4616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:13:23.105458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a9a68-406b-49cd-b91a-ae3f29ce4616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:23.107279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a9a68-406b-49cd-b91a-ae3f29ce4616 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:23.122424 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3662/7235] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:13:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:23.126329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602be4dc-7715-4c7c-b9ef-b945a9924b36 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:23.137790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602be4dc-7715-4c7c-b9ef-b945a9924b36 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:23.143852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7219a-24c3-4624-a009-404053fed2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:23.144467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7219a-24c3-4624-a009-404053fed2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:23.144755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7219a-24c3-4624-a009-404053fed2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:23.145030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7219a-24c3-4624-a009-404053fed2f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:23.145734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7219a-24c3-4624-a009-404053fed2f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:23.148572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7219a-24c3-4624-a009-404053fed2f6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:23.176642 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3574/7236] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:23 2021] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:23.180641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a9a68-406b-49cd-b91a-ae3f29ce4616 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:23.190807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a9a68-406b-49cd-b91a-ae3f29ce4616 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:23.247112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06c484-031a-430e-b750-5dfcae5d6f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:23.248037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c484-031a-430e-b750-5dfcae5d6f99 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:23.248353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c484-031a-430e-b750-5dfcae5d6f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:23.248598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c484-031a-430e-b750-5dfcae5d6f99 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:23.249297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06c484-031a-430e-b750-5dfcae5d6f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:23.251408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06c484-031a-430e-b750-5dfcae5d6f99 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:23.276184 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3663/7237] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:13:23 2021] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:23.280744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7219a-24c3-4624-a009-404053fed2f6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:23.292643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7219a-24c3-4624-a009-404053fed2f6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:23.297612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6440e-4603-4c23-a039-dbf42b46ee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:23.298607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6440e-4603-4c23-a039-dbf42b46ee70 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:23.298966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6440e-4603-4c23-a039-dbf42b46ee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:23.299434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6440e-4603-4c23-a039-dbf42b46ee70 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:23.300263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6440e-4603-4c23-a039-dbf42b46ee70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:23.301920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6440e-4603-4c23-a039-dbf42b46ee70 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:23.320853 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3575/7238] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:23 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:23.321973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06c484-031a-430e-b750-5dfcae5d6f99 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:23.332612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06c484-031a-430e-b750-5dfcae5d6f99 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:23.340386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b1256-3949-4c9a-9f7f-5f542d821ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:23.341328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b1256-3949-4c9a-9f7f-5f542d821ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:23.341683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b1256-3949-4c9a-9f7f-5f542d821ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:23.342030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b1256-3949-4c9a-9f7f-5f542d821ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:23.343576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b1256-3949-4c9a-9f7f-5f542d821ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:23.345459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b1256-3949-4c9a-9f7f-5f542d821ec6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:23.360156 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3664/7239] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:23 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:13:23.361326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6440e-4603-4c23-a039-dbf42b46ee70 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:23.371895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6440e-4603-4c23-a039-dbf42b46ee70 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:23.376784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48068c4a-4dc9-4678-b31e-3a4a2ade9c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:23.377646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48068c4a-4dc9-4678-b31e-3a4a2ade9c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:23.377927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48068c4a-4dc9-4678-b31e-3a4a2ade9c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:23.378202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48068c4a-4dc9-4678-b31e-3a4a2ade9c94 admin admin] PATH_INFO: `/v3/projects/e1bcd95d1315482d8712d6394cb8d1b5/users/ca011fb036c74f2c9cb77c5bd2def858/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:23.395415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48068c4a-4dc9-4678-b31e-3a4a2ade9c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1bcd95d1315482d8712d6394cb8d1b5, user_id=ca011fb036c74f2c9cb77c5bd2def858, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:23.398604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48068c4a-4dc9-4678-b31e-3a4a2ade9c94 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:23.414473 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3576/7240] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:23 2021] PUT /identity/v3/projects/e1bcd95d1315482d8712d6394cb8d1b5/users/ca011fb036c74f2c9cb77c5bd2def858/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:23.424650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f1187-1833-4530-bf2e-51e50d788505 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:23.424953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f1187-1833-4530-bf2e-51e50d788505 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:23.425730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f1187-1833-4530-bf2e-51e50d788505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:23.455907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b48f1187-1833-4530-bf2e-51e50d788505 None None] MFA Rules not processed for user `ca011fb036c74f2c9cb77c5bd2def858`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:23.457216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b48f1187-1833-4530-bf2e-51e50d788505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:23.535236 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3665/7241] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:23 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:23.539948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48068c4a-4dc9-4678-b31e-3a4a2ade9c94 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:23.650787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48068c4a-4dc9-4678-b31e-3a4a2ade9c94 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:23.656629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285dcde-7c05-4a44-bf26-80f696ed5883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:23.657418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285dcde-7c05-4a44-bf26-80f696ed5883 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:23.657774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285dcde-7c05-4a44-bf26-80f696ed5883 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:23.658123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285dcde-7c05-4a44-bf26-80f696ed5883 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:23.658974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285dcde-7c05-4a44-bf26-80f696ed5883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:23.662596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285dcde-7c05-4a44-bf26-80f696ed5883 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:23.705796 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3577/7242] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:23 2021] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:23.714284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f1187-1833-4530-bf2e-51e50d788505 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:23.731679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f1187-1833-4530-bf2e-51e50d788505 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:23.834204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25428e58-8859-4dab-b9b9-66518c677fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:23.837209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25428e58-8859-4dab-b9b9-66518c677fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:23.837499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25428e58-8859-4dab-b9b9-66518c677fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:23.837784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25428e58-8859-4dab-b9b9-66518c677fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:23.839365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25428e58-8859-4dab-b9b9-66518c677fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:23.841514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25428e58-8859-4dab-b9b9-66518c677fb6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:23.873582 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3666/7243] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:13:23 2021] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:23.877411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285dcde-7c05-4a44-bf26-80f696ed5883 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:23.887903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285dcde-7c05-4a44-bf26-80f696ed5883 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:23.892726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e870d-bd0a-4292-a1d0-68bd654e3cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:23.893492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e870d-bd0a-4292-a1d0-68bd654e3cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:23.893874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e870d-bd0a-4292-a1d0-68bd654e3cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:23.894279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e870d-bd0a-4292-a1d0-68bd654e3cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:23.895108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e870d-bd0a-4292-a1d0-68bd654e3cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:23.896764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e870d-bd0a-4292-a1d0-68bd654e3cf9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:23.910345 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3578/7244] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:23 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:23.912882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25428e58-8859-4dab-b9b9-66518c677fb6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:23.942199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25428e58-8859-4dab-b9b9-66518c677fb6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:23.950277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e197c4-10e7-4b44-9410-c059c253daac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:23.951280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e197c4-10e7-4b44-9410-c059c253daac admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:23.951557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e197c4-10e7-4b44-9410-c059c253daac admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:23.951829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e197c4-10e7-4b44-9410-c059c253daac admin admin] PATH_INFO: `/v3/projects/e05cbff607cc40f893b6e22d8d50dce9/users/dfa1c53d0976471aac144addfe9b3fe8/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:23.979926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e197c4-10e7-4b44-9410-c059c253daac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05cbff607cc40f893b6e22d8d50dce9, user_id=dfa1c53d0976471aac144addfe9b3fe8, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:23.984281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e197c4-10e7-4b44-9410-c059c253daac admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:24.003527 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3667/7245] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:23 2021] PUT /identity/v3/projects/e05cbff607cc40f893b6e22d8d50dce9/users/dfa1c53d0976471aac144addfe9b3fe8/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:24.008359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e870d-bd0a-4292-a1d0-68bd654e3cf9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:24.022932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e870d-bd0a-4292-a1d0-68bd654e3cf9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:24.099777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7faf9fd-e945-481a-94ca-4434abd4ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:24.101602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7faf9fd-e945-481a-94ca-4434abd4ae1e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:24.102082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7faf9fd-e945-481a-94ca-4434abd4ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:24.102554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7faf9fd-e945-481a-94ca-4434abd4ae1e admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:24.103467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7faf9fd-e945-481a-94ca-4434abd4ae1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:24.105246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7faf9fd-e945-481a-94ca-4434abd4ae1e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:24.117344 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3579/7246] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:24 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:13:24.121847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e197c4-10e7-4b44-9410-c059c253daac admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:24.134101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e197c4-10e7-4b44-9410-c059c253daac admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:24.139646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c244db1-3be0-48be-ab70-f1bd7618f5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:24.141026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c244db1-3be0-48be-ab70-f1bd7618f5e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:24.141308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c244db1-3be0-48be-ab70-f1bd7618f5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:24.141583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c244db1-3be0-48be-ab70-f1bd7618f5e0 admin admin] PATH_INFO: `/v3/projects/e05cbff607cc40f893b6e22d8d50dce9/users/dfa1c53d0976471aac144addfe9b3fe8/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:24.144244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c244db1-3be0-48be-ab70-f1bd7618f5e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05cbff607cc40f893b6e22d8d50dce9, user_id=dfa1c53d0976471aac144addfe9b3fe8, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:24.146959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c244db1-3be0-48be-ab70-f1bd7618f5e0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:24.166318 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3668/7247] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:24 2021] PUT /identity/v3/projects/e05cbff607cc40f893b6e22d8d50dce9/users/dfa1c53d0976471aac144addfe9b3fe8/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:13:24.177736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ca7ff-2c50-41e3-9dfd-754ab88969b7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:24.178403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ca7ff-2c50-41e3-9dfd-754ab88969b7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:24.178637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ca7ff-2c50-41e3-9dfd-754ab88969b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:24.220693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f01ca7ff-2c50-41e3-9dfd-754ab88969b7 None None] MFA Rules not processed for user `dfa1c53d0976471aac144addfe9b3fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:24.223646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f01ca7ff-2c50-41e3-9dfd-754ab88969b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:24.306713 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3580/7248] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:24 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:24.312412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c244db1-3be0-48be-ab70-f1bd7618f5e0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:24.333863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c244db1-3be0-48be-ab70-f1bd7618f5e0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:24.349581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cd38e-228e-46dd-b9ce-8a3b94c9d3e4 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa1c53d0976471aac144addfe9b3fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e05cbff607cc40f893b6e22d8d50dce9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:24.350363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cd38e-228e-46dd-b9ce-8a3b94c9d3e4 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:24.350787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cd38e-228e-46dd-b9ce-8a3b94c9d3e4 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:24.351510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cd38e-228e-46dd-b9ce-8a3b94c9d3e4 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:24.352272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cd38e-228e-46dd-b9ce-8a3b94c9d3e4 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:24.354056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cd38e-228e-46dd-b9ce-8a3b94c9d3e4 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:24.360322 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-3b2cd38e-228e-46dd-b9ce-8a3b94c9d3e4 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invalid input for field 'name': '' is too short Dec 18 21:13:24.360322 ncdv-master-1 devstack@keystone.service[96646]: Failed validating 'minLength' in schema['properties']['name']: Dec 18 21:13:24.360322 ncdv-master-1 devstack@keystone.service[96646]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Dec 18 21:13:24.360322 ncdv-master-1 devstack@keystone.service[96646]: On instance['name']: Dec 18 21:13:24.360322 ncdv-master-1 devstack@keystone.service[96646]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Dec 18 21:13:24.361915 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3669/7249] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:13:24 2021] POST /identity/v3/domains => generated 283 bytes in 50 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 18 21:13:24.367579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ca7ff-2c50-41e3-9dfd-754ab88969b7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:24.379037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ca7ff-2c50-41e3-9dfd-754ab88969b7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:24.389809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d319537-9fa3-4d94-8619-b66bd4112d6c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa1c53d0976471aac144addfe9b3fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e05cbff607cc40f893b6e22d8d50dce9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:24.391028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d319537-9fa3-4d94-8619-b66bd4112d6c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:24.391410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d319537-9fa3-4d94-8619-b66bd4112d6c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:24.391851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d319537-9fa3-4d94-8619-b66bd4112d6c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:24.394824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d319537-9fa3-4d94-8619-b66bd4112d6c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:24.398186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d319537-9fa3-4d94-8619-b66bd4112d6c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:24.407823 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-7d319537-9fa3-4d94-8619-b66bd4112d6c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Dec 18 21:13:24.407823 ncdv-master-1 devstack@keystone.service[96645]: Failed validating 'maxLength' in schema['properties']['name']: Dec 18 21:13:24.407823 ncdv-master-1 devstack@keystone.service[96645]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Dec 18 21:13:24.407823 ncdv-master-1 devstack@keystone.service[96645]: On instance['name']: Dec 18 21:13:24.407823 ncdv-master-1 devstack@keystone.service[96645]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Dec 18 21:13:24.422400 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3581/7250] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:13:24 2021] POST /identity/v3/domains => generated 412 bytes in 55 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 18 21:13:24.422753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cd38e-228e-46dd-b9ce-8a3b94c9d3e4 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:24.433924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cd38e-228e-46dd-b9ce-8a3b94c9d3e4 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:24.438833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709233cc-0207-4bc4-b32c-75de518730ca tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa1c53d0976471aac144addfe9b3fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e05cbff607cc40f893b6e22d8d50dce9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:24.439494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709233cc-0207-4bc4-b32c-75de518730ca tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:24.439777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709233cc-0207-4bc4-b32c-75de518730ca tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:24.440263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709233cc-0207-4bc4-b32c-75de518730ca tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:24.441199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709233cc-0207-4bc4-b32c-75de518730ca tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:24.443417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709233cc-0207-4bc4-b32c-75de518730ca tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:24.469115 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3670/7251] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:13:24 2021] POST /identity/v3/domains => generated 276 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:13:24.473734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d319537-9fa3-4d94-8619-b66bd4112d6c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:24.504830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d319537-9fa3-4d94-8619-b66bd4112d6c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:24.625572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ee227-3e65-4713-b6c5-c533a11164ec tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa1c53d0976471aac144addfe9b3fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e05cbff607cc40f893b6e22d8d50dce9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:24.627029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ee227-3e65-4713-b6c5-c533a11164ec tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:24.627355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ee227-3e65-4713-b6c5-c533a11164ec tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:24.628069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ee227-3e65-4713-b6c5-c533a11164ec tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] PATH_INFO: `/v3/domains/cafb05ca592440e0be3a0626795ebddc` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:24.644180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ee227-3e65-4713-b6c5-c533a11164ec tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cafb05ca592440e0be3a0626795ebddc)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:24.647222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ee227-3e65-4713-b6c5-c533a11164ec tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:24.675386 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-578ee227-3e65-4713-b6c5-c533a11164ec tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Dec 18 21:13:24.680071 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3582/7252] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:13:24 2021] DELETE /identity/v3/domains/cafb05ca592440e0be3a0626795ebddc => generated 120 bytes in 208 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:13:24.681103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709233cc-0207-4bc4-b32c-75de518730ca tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:24.704725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709233cc-0207-4bc4-b32c-75de518730ca tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:24.721511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff5f06-b6f3-45dd-8b7f-3e14a9ca4ce9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa1c53d0976471aac144addfe9b3fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e05cbff607cc40f893b6e22d8d50dce9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:24.722429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff5f06-b6f3-45dd-8b7f-3e14a9ca4ce9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:24.722716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff5f06-b6f3-45dd-8b7f-3e14a9ca4ce9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:24.723184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff5f06-b6f3-45dd-8b7f-3e14a9ca4ce9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] PATH_INFO: `/v3/domains/cafb05ca592440e0be3a0626795ebddc` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:24.724554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff5f06-b6f3-45dd-8b7f-3e14a9ca4ce9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cafb05ca592440e0be3a0626795ebddc)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:24.726336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff5f06-b6f3-45dd-8b7f-3e14a9ca4ce9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:24.765426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d5ff5f06-b6f3-45dd-8b7f-3e14a9ca4ce9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cafb05ca592440e0be3a0626795ebddc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:24.766572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d5ff5f06-b6f3-45dd-8b7f-3e14a9ca4ce9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cafb05ca592440e0be3a0626795ebddc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:24.824090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d5ff5f06-b6f3-45dd-8b7f-3e14a9ca4ce9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cafb05ca592440e0be3a0626795ebddc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:24.824724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d5ff5f06-b6f3-45dd-8b7f-3e14a9ca4ce9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cafb05ca592440e0be3a0626795ebddc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:24.838237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ee227-3e65-4713-b6c5-c533a11164ec tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:24.840396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-578ee227-3e65-4713-b6c5-c533a11164ec tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:24.842609 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3671/7253] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:13:24 2021] PATCH /identity/v3/domains/cafb05ca592440e0be3a0626795ebddc => generated 277 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:24.864797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ee227-3e65-4713-b6c5-c533a11164ec tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:24.949011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa1c53d0976471aac144addfe9b3fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e05cbff607cc40f893b6e22d8d50dce9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:24.950424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:24.950811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:24.951455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] PATH_INFO: `/v3/domains/cafb05ca592440e0be3a0626795ebddc` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:24.977119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cafb05ca592440e0be3a0626795ebddc)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:24.979911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:25.011747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cafb05ca592440e0be3a0626795ebddc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.015825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cafb05ca592440e0be3a0626795ebddc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.070769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cafb05ca592440e0be3a0626795ebddc', 'request_id': 'req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.077572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cafb05ca592440e0be3a0626795ebddc', 'request_id': 'req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.083714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cafb05ca592440e0be3a0626795ebddc', 'request_id': 'req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.107324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] The token cache is being invalidate because project cafb05ca592440e0be3a0626795ebddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:25.107935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.110125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.122543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cafb05ca592440e0be3a0626795ebddc', 'request_id': 'req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.126193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cafb05ca592440e0be3a0626795ebddc', 'request_id': 'req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.127083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cafb05ca592440e0be3a0626795ebddc', 'request_id': 'req-5521e67b-8cc7-461e-b0b1-a88fc0846ad9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.140209 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3583/7254] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:13:24 2021] DELETE /identity/v3/domains/cafb05ca592440e0be3a0626795ebddc => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:25.141367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff5f06-b6f3-45dd-8b7f-3e14a9ca4ce9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:25.152985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff5f06-b6f3-45dd-8b7f-3e14a9ca4ce9 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:25.251680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6fd73-6291-4039-b999-f6871b3a132c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa1c53d0976471aac144addfe9b3fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e05cbff607cc40f893b6e22d8d50dce9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:25.253158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6fd73-6291-4039-b999-f6871b3a132c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:25.253455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6fd73-6291-4039-b999-f6871b3a132c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:25.254017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6fd73-6291-4039-b999-f6871b3a132c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] PATH_INFO: `/v3/domains/caf75b27f04946cf8a53530412a1d65f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:25.265464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6fd73-6291-4039-b999-f6871b3a132c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:13:25.276487 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-20d6fd73-6291-4039-b999-f6871b3a132c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Could not find domain: caf75b27f04946cf8a53530412a1d65f.: keystone.exception.DomainNotFound: Could not find domain: caf75b27f04946cf8a53530412a1d65f. Dec 18 21:13:25.286919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161f926-15e7-4906-8eff-aafe69fecc9d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:25.286919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161f926-15e7-4906-8eff-aafe69fecc9d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:25.287941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161f926-15e7-4906-8eff-aafe69fecc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:25.293227 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3672/7255] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:13:25 2021] DELETE /identity/v3/domains/caf75b27f04946cf8a53530412a1d65f => generated 112 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:13:25.294050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6fd73-6291-4039-b999-f6871b3a132c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:25.297130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-20d6fd73-6291-4039-b999-f6871b3a132c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:25.315453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6fd73-6291-4039-b999-f6871b3a132c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:25.319320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4161f926-15e7-4906-8eff-aafe69fecc9d None None] MFA Rules not processed for user `d32598482c834073b8fe24c84cb57d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:25.320574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4161f926-15e7-4906-8eff-aafe69fecc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:25.321970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59af9eb-99f4-4171-9f3c-881a838334f5 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa1c53d0976471aac144addfe9b3fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e05cbff607cc40f893b6e22d8d50dce9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:25.322718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59af9eb-99f4-4171-9f3c-881a838334f5 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:25.323134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59af9eb-99f4-4171-9f3c-881a838334f5 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:25.323479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59af9eb-99f4-4171-9f3c-881a838334f5 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:25.324889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59af9eb-99f4-4171-9f3c-881a838334f5 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:25.326917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59af9eb-99f4-4171-9f3c-881a838334f5 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:25.356141 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3673/7256] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:13:25 2021] POST /identity/v3/domains => generated 252 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:25.361769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59af9eb-99f4-4171-9f3c-881a838334f5 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:25.410768 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3584/7257] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:25 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:25.447924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59af9eb-99f4-4171-9f3c-881a838334f5 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:25.453057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657a244-e8db-46a1-8b74-7d104a55101e tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa1c53d0976471aac144addfe9b3fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e05cbff607cc40f893b6e22d8d50dce9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:25.453812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657a244-e8db-46a1-8b74-7d104a55101e tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:25.454175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657a244-e8db-46a1-8b74-7d104a55101e tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:25.454577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657a244-e8db-46a1-8b74-7d104a55101e tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:25.455504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657a244-e8db-46a1-8b74-7d104a55101e tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:25.457187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657a244-e8db-46a1-8b74-7d104a55101e tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:25.465776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.sql.core [None req-d657a244-e8db-46a1-8b74-7d104a55101e tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-910353207' for key 'project.ixu_project_name_domain_id'") Dec 18 21:13:25.465776 ncdv-master-1 devstack@keystone.service[96646]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 18 21:13:25.465776 ncdv-master-1 devstack@keystone.service[96646]: [parameters: {'id': '778c8342985d4414a8be930e7bf93772', 'name': 'tempest-domain-dup-910353207', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Dec 18 21:13:25.465776 ncdv-master-1 devstack@keystone.service[96646]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96646) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 18 21:13:25.472977 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-d657a244-e8db-46a1-8b74-7d104a55101e tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-910353207.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-910353207. Dec 18 21:13:25.478676 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3674/7258] 10.222.0.13 () {60 vars in 1148 bytes} [Sat Dec 18 21:13:25 2021] POST /identity/v3/domains => generated 211 bytes in 118 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 18 21:13:25.480064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161f926-15e7-4906-8eff-aafe69fecc9d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:25.505825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161f926-15e7-4906-8eff-aafe69fecc9d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:25.516687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416033d-0d97-4d3f-87c0-d74cdc905a5a tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa1c53d0976471aac144addfe9b3fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e05cbff607cc40f893b6e22d8d50dce9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:25.518472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416033d-0d97-4d3f-87c0-d74cdc905a5a tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:25.518769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416033d-0d97-4d3f-87c0-d74cdc905a5a tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:25.519055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416033d-0d97-4d3f-87c0-d74cdc905a5a tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] PATH_INFO: `/v3/domains/a9fa84cc157440e8ae24cda69da67bb9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:25.533720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416033d-0d97-4d3f-87c0-d74cdc905a5a tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a9fa84cc157440e8ae24cda69da67bb9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:25.535415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416033d-0d97-4d3f-87c0-d74cdc905a5a tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:25.561212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6416033d-0d97-4d3f-87c0-d74cdc905a5a tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a9fa84cc157440e8ae24cda69da67bb9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.562000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6416033d-0d97-4d3f-87c0-d74cdc905a5a tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a9fa84cc157440e8ae24cda69da67bb9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.604092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6416033d-0d97-4d3f-87c0-d74cdc905a5a tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a9fa84cc157440e8ae24cda69da67bb9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.604736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6416033d-0d97-4d3f-87c0-d74cdc905a5a tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a9fa84cc157440e8ae24cda69da67bb9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.609568 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3585/7259] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:13:25 2021] PATCH /identity/v3/domains/a9fa84cc157440e8ae24cda69da67bb9 => generated 253 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:13:25.615208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657a244-e8db-46a1-8b74-7d104a55101e tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:25.619044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d657a244-e8db-46a1-8b74-7d104a55101e tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:25.644065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657a244-e8db-46a1-8b74-7d104a55101e tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:25.760030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa1c53d0976471aac144addfe9b3fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e05cbff607cc40f893b6e22d8d50dce9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:25.761418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:25.762061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:25.762595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] PATH_INFO: `/v3/domains/a9fa84cc157440e8ae24cda69da67bb9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:25.789254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a9fa84cc157440e8ae24cda69da67bb9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:25.791231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:25.821937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a9fa84cc157440e8ae24cda69da67bb9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.825487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a9fa84cc157440e8ae24cda69da67bb9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.900968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9fa84cc157440e8ae24cda69da67bb9', 'request_id': 'req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.912696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9fa84cc157440e8ae24cda69da67bb9', 'request_id': 'req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.930149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9fa84cc157440e8ae24cda69da67bb9', 'request_id': 'req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.947251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] The token cache is being invalidate because project a9fa84cc157440e8ae24cda69da67bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:25.947626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.948374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.956899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a9fa84cc157440e8ae24cda69da67bb9', 'request_id': 'req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.960972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a9fa84cc157440e8ae24cda69da67bb9', 'request_id': 'req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.961993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a9fa84cc157440e8ae24cda69da67bb9', 'request_id': 'req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:25.968482 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3675/7260] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:13:25 2021] DELETE /identity/v3/domains/a9fa84cc157440e8ae24cda69da67bb9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:25.973998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416033d-0d97-4d3f-87c0-d74cdc905a5a tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:25.987775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416033d-0d97-4d3f-87c0-d74cdc905a5a tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:26.074983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820985ba-60b4-4186-8d50-24202d9e2412 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa1c53d0976471aac144addfe9b3fe8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e05cbff607cc40f893b6e22d8d50dce9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:26.076138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820985ba-60b4-4186-8d50-24202d9e2412 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:26.076588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820985ba-60b4-4186-8d50-24202d9e2412 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:26.076880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820985ba-60b4-4186-8d50-24202d9e2412 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] PATH_INFO: `/v3/domains/cafb05ca592440e0be3a0626795ebddc` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:26.087315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820985ba-60b4-4186-8d50-24202d9e2412 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:13:26.102753 ncdv-master-1 devstack@keystone.service[96645]: WARNING keystone.server.flask.application [None req-820985ba-60b4-4186-8d50-24202d9e2412 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Could not find domain: cafb05ca592440e0be3a0626795ebddc.: keystone.exception.DomainNotFound: Could not find domain: cafb05ca592440e0be3a0626795ebddc. Dec 18 21:13:26.104266 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3586/7261] 10.222.0.13 () {60 vars in 1248 bytes} [Sat Dec 18 21:13:25 2021] PATCH /identity/v3/domains/cafb05ca592440e0be3a0626795ebddc => generated 112 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:13:26.109552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:26.111183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:26.181700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820985ba-60b4-4186-8d50-24202d9e2412 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:26.186334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-820985ba-60b4-4186-8d50-24202d9e2412 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:26.226190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7071f-3061-40a5-b70b-b82fa1f9ce1c tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:26.233119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb8f9c-2852-4838-8c71-b119a8e47b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:26.234391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb8f9c-2852-4838-8c71-b119a8e47b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:26.235048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb8f9c-2852-4838-8c71-b119a8e47b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:26.235516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb8f9c-2852-4838-8c71-b119a8e47b2c admin admin] PATH_INFO: `/v3/users/ca011fb036c74f2c9cb77c5bd2def858` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:26.237115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb8f9c-2852-4838-8c71-b119a8e47b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca011fb036c74f2c9cb77c5bd2def858)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:26.240860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb8f9c-2852-4838-8c71-b119a8e47b2c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:26.336273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820985ba-60b4-4186-8d50-24202d9e2412 tempest-DomainsNegativeTestJSON-571621775 tempest-DomainsNegativeTestJSON-571621775-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:26.342500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aace34a-888f-4578-a01c-2b3138f2ae65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:26.343524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aace34a-888f-4578-a01c-2b3138f2ae65 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:26.343829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aace34a-888f-4578-a01c-2b3138f2ae65 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:26.344104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aace34a-888f-4578-a01c-2b3138f2ae65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:26.346125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4aace34a-888f-4578-a01c-2b3138f2ae65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:26.362455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aace34a-888f-4578-a01c-2b3138f2ae65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:26.362848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dbbb8f9c-2852-4838-8c71-b119a8e47b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca011fb036c74f2c9cb77c5bd2def858'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:26.364227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aace34a-888f-4578-a01c-2b3138f2ae65 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:26.370803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dbbb8f9c-2852-4838-8c71-b119a8e47b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca011fb036c74f2c9cb77c5bd2def858'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:26.371548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dbbb8f9c-2852-4838-8c71-b119a8e47b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca011fb036c74f2c9cb77c5bd2def858'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:26.380777 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3587/7262] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:13:26.408543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dbbb8f9c-2852-4838-8c71-b119a8e47b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca011fb036c74f2c9cb77c5bd2def858'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:26.428390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-dbbb8f9c-2852-4838-8c71-b119a8e47b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca011fb036c74f2c9cb77c5bd2def858'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:26.438384 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3676/7263] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:13:26 2021] DELETE /identity/v3/users/ca011fb036c74f2c9cb77c5bd2def858 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:26.441522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0c3ff-b1bd-4972-91df-35e1ec30639f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:26.442390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0c3ff-b1bd-4972-91df-35e1ec30639f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:26.442757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0c3ff-b1bd-4972-91df-35e1ec30639f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:26.467108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e3f0c3ff-b1bd-4972-91df-35e1ec30639f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:26.468848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e3f0c3ff-b1bd-4972-91df-35e1ec30639f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:26.560581 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3588/7264] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:26.573745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb8f9c-2852-4838-8c71-b119a8e47b2c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:26.577161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-dbbb8f9c-2852-4838-8c71-b119a8e47b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:26.678507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb8f9c-2852-4838-8c71-b119a8e47b2c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:26.686346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee283d-ce6e-4ca8-8f23-10002832414b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:26.687107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee283d-ce6e-4ca8-8f23-10002832414b service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:26.687459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee283d-ce6e-4ca8-8f23-10002832414b service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:26.687816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee283d-ce6e-4ca8-8f23-10002832414b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:26.705560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee283d-ce6e-4ca8-8f23-10002832414b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:26.710806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee283d-ce6e-4ca8-8f23-10002832414b service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:26.730159 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3677/7265] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:13:27.441503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0c3ff-b1bd-4972-91df-35e1ec30639f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:27.443878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e3f0c3ff-b1bd-4972-91df-35e1ec30639f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:27.466069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0c3ff-b1bd-4972-91df-35e1ec30639f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:27.481111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882de523-79b7-474e-ae5b-cb1b7c4bcabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:27.482184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882de523-79b7-474e-ae5b-cb1b7c4bcabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:27.482684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882de523-79b7-474e-ae5b-cb1b7c4bcabc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:27.482806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882de523-79b7-474e-ae5b-cb1b7c4bcabc admin admin] PATH_INFO: `/v3/projects/e1bcd95d1315482d8712d6394cb8d1b5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:27.487542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882de523-79b7-474e-ae5b-cb1b7c4bcabc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1bcd95d1315482d8712d6394cb8d1b5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:27.490936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882de523-79b7-474e-ae5b-cb1b7c4bcabc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:27.570729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-882de523-79b7-474e-ae5b-cb1b7c4bcabc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1bcd95d1315482d8712d6394cb8d1b5', 'request_id': 'req-882de523-79b7-474e-ae5b-cb1b7c4bcabc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:27.585748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-882de523-79b7-474e-ae5b-cb1b7c4bcabc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1bcd95d1315482d8712d6394cb8d1b5', 'request_id': 'req-882de523-79b7-474e-ae5b-cb1b7c4bcabc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:27.595059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-882de523-79b7-474e-ae5b-cb1b7c4bcabc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1bcd95d1315482d8712d6394cb8d1b5', 'request_id': 'req-882de523-79b7-474e-ae5b-cb1b7c4bcabc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:27.619513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-882de523-79b7-474e-ae5b-cb1b7c4bcabc admin admin] The token cache is being invalidate because project e1bcd95d1315482d8712d6394cb8d1b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:27.619870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-882de523-79b7-474e-ae5b-cb1b7c4bcabc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:27.620514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-882de523-79b7-474e-ae5b-cb1b7c4bcabc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:27.622497 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3589/7266] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:27 2021] DELETE /identity/v3/projects/e1bcd95d1315482d8712d6394cb8d1b5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:27.627027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee283d-ce6e-4ca8-8f23-10002832414b service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:27.645412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee283d-ce6e-4ca8-8f23-10002832414b service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:27.745990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942aa93a-8828-4ec2-97bf-47937acefc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:27.747286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aa93a-8828-4ec2-97bf-47937acefc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:27.747286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aa93a-8828-4ec2-97bf-47937acefc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:27.747522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aa93a-8828-4ec2-97bf-47937acefc86 admin admin] PATH_INFO: `/v3/users/dfa1c53d0976471aac144addfe9b3fe8` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:27.748848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942aa93a-8828-4ec2-97bf-47937acefc86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa1c53d0976471aac144addfe9b3fe8)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:27.751197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942aa93a-8828-4ec2-97bf-47937acefc86 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:27.830737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-942aa93a-8828-4ec2-97bf-47937acefc86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa1c53d0976471aac144addfe9b3fe8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:27.845343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-942aa93a-8828-4ec2-97bf-47937acefc86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa1c53d0976471aac144addfe9b3fe8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:27.846160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-942aa93a-8828-4ec2-97bf-47937acefc86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa1c53d0976471aac144addfe9b3fe8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:27.863719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-942aa93a-8828-4ec2-97bf-47937acefc86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa1c53d0976471aac144addfe9b3fe8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:27.881523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-942aa93a-8828-4ec2-97bf-47937acefc86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa1c53d0976471aac144addfe9b3fe8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:27.890286 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3678/7267] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:13:27 2021] DELETE /identity/v3/users/dfa1c53d0976471aac144addfe9b3fe8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:28.426759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882de523-79b7-474e-ae5b-cb1b7c4bcabc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:28.428178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-882de523-79b7-474e-ae5b-cb1b7c4bcabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:28.443346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882de523-79b7-474e-ae5b-cb1b7c4bcabc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:28.526117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637c34e-7ef0-4303-8588-a2aaf8eb3cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:28.527167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637c34e-7ef0-4303-8588-a2aaf8eb3cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:28.527658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637c34e-7ef0-4303-8588-a2aaf8eb3cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:28.528250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637c34e-7ef0-4303-8588-a2aaf8eb3cd7 admin admin] PATH_INFO: `/v3/projects/e05cbff607cc40f893b6e22d8d50dce9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:28.530077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637c34e-7ef0-4303-8588-a2aaf8eb3cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e05cbff607cc40f893b6e22d8d50dce9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:28.532089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637c34e-7ef0-4303-8588-a2aaf8eb3cd7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:28.609701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c637c34e-7ef0-4303-8588-a2aaf8eb3cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e05cbff607cc40f893b6e22d8d50dce9', 'request_id': 'req-c637c34e-7ef0-4303-8588-a2aaf8eb3cd7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:28.618660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c637c34e-7ef0-4303-8588-a2aaf8eb3cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e05cbff607cc40f893b6e22d8d50dce9', 'request_id': 'req-c637c34e-7ef0-4303-8588-a2aaf8eb3cd7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:28.626569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c637c34e-7ef0-4303-8588-a2aaf8eb3cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e05cbff607cc40f893b6e22d8d50dce9', 'request_id': 'req-c637c34e-7ef0-4303-8588-a2aaf8eb3cd7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:28.643335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c637c34e-7ef0-4303-8588-a2aaf8eb3cd7 admin admin] The token cache is being invalidate because project e05cbff607cc40f893b6e22d8d50dce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:28.643635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c637c34e-7ef0-4303-8588-a2aaf8eb3cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:28.644283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c637c34e-7ef0-4303-8588-a2aaf8eb3cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:28.646636 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3590/7268] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:28 2021] DELETE /identity/v3/projects/e05cbff607cc40f893b6e22d8d50dce9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:28.652110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89be19-9eb9-40be-84d4-3fbc86b4e4ed None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:28.652637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89be19-9eb9-40be-84d4-3fbc86b4e4ed None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:28.652902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89be19-9eb9-40be-84d4-3fbc86b4e4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:28.674735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5e89be19-9eb9-40be-84d4-3fbc86b4e4ed None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:28.676471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5e89be19-9eb9-40be-84d4-3fbc86b4e4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:28.770391 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3679/7269] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:28.776372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6e98b-34af-45f6-8816-b34f71106787 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:28.776694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6e98b-34af-45f6-8816-b34f71106787 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:28.777005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6e98b-34af-45f6-8816-b34f71106787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:28.802634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-73f6e98b-34af-45f6-8816-b34f71106787 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:28.804054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-73f6e98b-34af-45f6-8816-b34f71106787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:28.815952 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3591/7270] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:13:28.821256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89be19-9eb9-40be-84d4-3fbc86b4e4ed None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:28.832692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89be19-9eb9-40be-84d4-3fbc86b4e4ed None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:28.839385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18553c-96cf-4196-82ab-646099743a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:28.840293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18553c-96cf-4196-82ab-646099743a74 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:28.840795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18553c-96cf-4196-82ab-646099743a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:28.841283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18553c-96cf-4196-82ab-646099743a74 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:28.842234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18553c-96cf-4196-82ab-646099743a74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:13:28.842762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18553c-96cf-4196-82ab-646099743a74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:28.844680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18553c-96cf-4196-82ab-646099743a74 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:28.861730 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3680/7271] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:13:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:28.866297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6e98b-34af-45f6-8816-b34f71106787 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:28.876201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6e98b-34af-45f6-8816-b34f71106787 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:28.881388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf9ffb-a42f-4e2e-8e9c-ef49c2a77fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:28.882293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf9ffb-a42f-4e2e-8e9c-ef49c2a77fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:28.882852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf9ffb-a42f-4e2e-8e9c-ef49c2a77fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:28.883137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf9ffb-a42f-4e2e-8e9c-ef49c2a77fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:28.883841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf9ffb-a42f-4e2e-8e9c-ef49c2a77fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:28.886070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf9ffb-a42f-4e2e-8e9c-ef49c2a77fe0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:28.913982 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3592/7272] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:28 2021] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:28.918292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18553c-96cf-4196-82ab-646099743a74 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:28.930446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18553c-96cf-4196-82ab-646099743a74 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:28.989433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a1a91-4e2e-4685-b80e-c1fce4e3940c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:28.990222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a1a91-4e2e-4685-b80e-c1fce4e3940c admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:28.990685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a1a91-4e2e-4685-b80e-c1fce4e3940c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:28.991022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a1a91-4e2e-4685-b80e-c1fce4e3940c admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:28.991827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a1a91-4e2e-4685-b80e-c1fce4e3940c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:28.993796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a1a91-4e2e-4685-b80e-c1fce4e3940c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:29.018755 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3681/7273] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:13:28 2021] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:29.023875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf9ffb-a42f-4e2e-8e9c-ef49c2a77fe0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:29.035059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf9ffb-a42f-4e2e-8e9c-ef49c2a77fe0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:29.041958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baad59-2cd0-471c-b070-3ad8e84621e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:29.042899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baad59-2cd0-471c-b070-3ad8e84621e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:29.043250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baad59-2cd0-471c-b070-3ad8e84621e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:29.043594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baad59-2cd0-471c-b070-3ad8e84621e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:29.044401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0baad59-2cd0-471c-b070-3ad8e84621e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:29.046120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0baad59-2cd0-471c-b070-3ad8e84621e3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:29.058301 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3593/7274] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:29 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:29.062054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a1a91-4e2e-4685-b80e-c1fce4e3940c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:29.082479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a1a91-4e2e-4685-b80e-c1fce4e3940c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:29.088937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917356b-cac3-4cca-a5d4-0eec9f56736b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:29.089477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917356b-cac3-4cca-a5d4-0eec9f56736b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:29.089761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917356b-cac3-4cca-a5d4-0eec9f56736b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:29.090039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917356b-cac3-4cca-a5d4-0eec9f56736b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:29.091728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917356b-cac3-4cca-a5d4-0eec9f56736b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:29.094609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917356b-cac3-4cca-a5d4-0eec9f56736b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:29.116283 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3682/7275] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:29 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:13:29.117917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baad59-2cd0-471c-b070-3ad8e84621e3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:29.140540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baad59-2cd0-471c-b070-3ad8e84621e3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:29.157177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0c79e-fca4-4bff-8751-a1adfb42a62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:29.158075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0c79e-fca4-4bff-8751-a1adfb42a62c admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:29.158385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0c79e-fca4-4bff-8751-a1adfb42a62c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:29.158659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0c79e-fca4-4bff-8751-a1adfb42a62c admin admin] PATH_INFO: `/v3/projects/63ee1adb4f5b4e8fa7993ea37936ce44/users/b1bacb92dad04b33b3f8a76a2058534a/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:29.190014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0c79e-fca4-4bff-8751-a1adfb42a62c admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ee1adb4f5b4e8fa7993ea37936ce44, user_id=b1bacb92dad04b33b3f8a76a2058534a, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:29.193009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0c79e-fca4-4bff-8751-a1adfb42a62c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:29.222915 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3594/7276] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:29 2021] PUT /identity/v3/projects/63ee1adb4f5b4e8fa7993ea37936ce44/users/b1bacb92dad04b33b3f8a76a2058534a/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:29.235249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c84f8-bc84-4559-9eee-18603326c10b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:29.235611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c84f8-bc84-4559-9eee-18603326c10b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:29.235826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c84f8-bc84-4559-9eee-18603326c10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:29.272003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-132c84f8-bc84-4559-9eee-18603326c10b None None] MFA Rules not processed for user `b1bacb92dad04b33b3f8a76a2058534a`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:29.273843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-132c84f8-bc84-4559-9eee-18603326c10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:29.365086 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3683/7277] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:29 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:29.366180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0c79e-fca4-4bff-8751-a1adfb42a62c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:29.474495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0c79e-fca4-4bff-8751-a1adfb42a62c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:29.482034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea9351-34e6-4b6c-bfd3-f6872119eb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:29.482783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea9351-34e6-4b6c-bfd3-f6872119eb0e admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:29.483065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea9351-34e6-4b6c-bfd3-f6872119eb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:29.483344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea9351-34e6-4b6c-bfd3-f6872119eb0e admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:29.484108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea9351-34e6-4b6c-bfd3-f6872119eb0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:29.486469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea9351-34e6-4b6c-bfd3-f6872119eb0e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:29.533455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c84f8-bc84-4559-9eee-18603326c10b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:29.536129 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3595/7278] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:29 2021] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:13:29.549494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c84f8-bc84-4559-9eee-18603326c10b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:29.653145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034014d4-902a-4ff7-b505-84db52f2ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:29.654845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034014d4-902a-4ff7-b505-84db52f2ef19 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:29.655327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034014d4-902a-4ff7-b505-84db52f2ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:29.655839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034014d4-902a-4ff7-b505-84db52f2ef19 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:29.656795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034014d4-902a-4ff7-b505-84db52f2ef19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:29.659026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034014d4-902a-4ff7-b505-84db52f2ef19 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:29.688789 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3684/7279] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:13:29 2021] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:29.689244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea9351-34e6-4b6c-bfd3-f6872119eb0e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:29.704564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea9351-34e6-4b6c-bfd3-f6872119eb0e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:29.715144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fcced-877b-4d04-a911-be6a2c1b9282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:29.715920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fcced-877b-4d04-a911-be6a2c1b9282 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:29.716273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fcced-877b-4d04-a911-be6a2c1b9282 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:29.716649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fcced-877b-4d04-a911-be6a2c1b9282 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:29.717673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fcced-877b-4d04-a911-be6a2c1b9282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:29.719508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fcced-877b-4d04-a911-be6a2c1b9282 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:29.735035 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3596/7280] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:29 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:13:29.739837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034014d4-902a-4ff7-b505-84db52f2ef19 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:29.751884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034014d4-902a-4ff7-b505-84db52f2ef19 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:29.758415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04478dc9-e428-42cb-9cca-004c9fc4e266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:29.758671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04478dc9-e428-42cb-9cca-004c9fc4e266 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:29.759048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04478dc9-e428-42cb-9cca-004c9fc4e266 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:29.759404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04478dc9-e428-42cb-9cca-004c9fc4e266 admin admin] PATH_INFO: `/v3/projects/027e6287293f4324aea457cb8aeaf36a/users/4fce4069decc4301a9ea326533d7603f/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:29.778286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04478dc9-e428-42cb-9cca-004c9fc4e266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=027e6287293f4324aea457cb8aeaf36a, user_id=4fce4069decc4301a9ea326533d7603f, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:29.781569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04478dc9-e428-42cb-9cca-004c9fc4e266 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:29.805399 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3685/7281] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:29 2021] PUT /identity/v3/projects/027e6287293f4324aea457cb8aeaf36a/users/4fce4069decc4301a9ea326533d7603f/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:29.809339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fcced-877b-4d04-a911-be6a2c1b9282 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:29.821271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fcced-877b-4d04-a911-be6a2c1b9282 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:29.894603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d749961-7459-4e63-b062-0f1790f9726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:29.895486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d749961-7459-4e63-b062-0f1790f9726c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:29.895843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d749961-7459-4e63-b062-0f1790f9726c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:29.896231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d749961-7459-4e63-b062-0f1790f9726c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:29.897120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d749961-7459-4e63-b062-0f1790f9726c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:29.898936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d749961-7459-4e63-b062-0f1790f9726c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:29.916116 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3597/7282] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:29 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:29.920092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04478dc9-e428-42cb-9cca-004c9fc4e266 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:29.931721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04478dc9-e428-42cb-9cca-004c9fc4e266 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:29.937022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b1fd2-43a2-4ffb-8b82-1c6584c49e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:29.938299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b1fd2-43a2-4ffb-8b82-1c6584c49e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:29.938299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b1fd2-43a2-4ffb-8b82-1c6584c49e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:29.938594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b1fd2-43a2-4ffb-8b82-1c6584c49e18 admin admin] PATH_INFO: `/v3/projects/027e6287293f4324aea457cb8aeaf36a/users/4fce4069decc4301a9ea326533d7603f/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:29.940633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b1fd2-43a2-4ffb-8b82-1c6584c49e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=027e6287293f4324aea457cb8aeaf36a, user_id=4fce4069decc4301a9ea326533d7603f, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:29.943622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b1fd2-43a2-4ffb-8b82-1c6584c49e18 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:29.955850 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3686/7283] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:29 2021] PUT /identity/v3/projects/027e6287293f4324aea457cb8aeaf36a/users/4fce4069decc4301a9ea326533d7603f/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:13:29.966593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de193f8-957d-4bcc-a52c-c2e7a21d35bc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:29.966948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de193f8-957d-4bcc-a52c-c2e7a21d35bc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:29.967178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de193f8-957d-4bcc-a52c-c2e7a21d35bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:30.010723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8de193f8-957d-4bcc-a52c-c2e7a21d35bc None None] MFA Rules not processed for user `4fce4069decc4301a9ea326533d7603f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:30.021634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8de193f8-957d-4bcc-a52c-c2e7a21d35bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:30.109331 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3598/7284] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:29 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:30.113971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b1fd2-43a2-4ffb-8b82-1c6584c49e18 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:30.129397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b1fd2-43a2-4ffb-8b82-1c6584c49e18 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:30.137492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118d068-c6b0-4dae-9aa3-c04657106852 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:30.138813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d068-c6b0-4dae-9aa3-c04657106852 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:30.139325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d068-c6b0-4dae-9aa3-c04657106852 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:30.139967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d068-c6b0-4dae-9aa3-c04657106852 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/services` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:30.140889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118d068-c6b0-4dae-9aa3-c04657106852 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:30.143107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118d068-c6b0-4dae-9aa3-c04657106852 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:30.167726 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3687/7285] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:30 2021] POST /identity/v3/services => generated 288 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:30.172197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de193f8-957d-4bcc-a52c-c2e7a21d35bc None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:30.184847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de193f8-957d-4bcc-a52c-c2e7a21d35bc None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:30.204799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1985784-dd48-4b7d-ad8a-9ce7918d4a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:30.205646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1985784-dd48-4b7d-ad8a-9ce7918d4a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:30.205938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1985784-dd48-4b7d-ad8a-9ce7918d4a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:30.206214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1985784-dd48-4b7d-ad8a-9ce7918d4a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:30.207050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1985784-dd48-4b7d-ad8a-9ce7918d4a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:30.208689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1985784-dd48-4b7d-ad8a-9ce7918d4a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:30.226837 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-d1985784-dd48-4b7d-ad8a-9ce7918d4a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-25530694. To ensure interoperability, identifiers should be a valid uuid. Dec 18 21:13:30.226837 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 18 21:13:30.226837 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:13:30.259468 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3599/7286] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Dec 18 21:13:30 2021] POST /identity/v3/endpoints => generated 356 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:30.263620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118d068-c6b0-4dae-9aa3-c04657106852 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:30.274801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118d068-c6b0-4dae-9aa3-c04657106852 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:30.292823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b1c39-250e-4c2c-81f1-38a17649097b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:30.293940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b1c39-250e-4c2c-81f1-38a17649097b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:30.294442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b1c39-250e-4c2c-81f1-38a17649097b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:30.295012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b1c39-250e-4c2c-81f1-38a17649097b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/regions/tempest-region-25530694` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:30.295774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b1c39-250e-4c2c-81f1-38a17649097b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-25530694)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:30.297071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b1c39-250e-4c2c-81f1-38a17649097b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:30.302000 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3688/7287] 10.222.0.13 () {58 vars in 1199 bytes} [Sat Dec 18 21:13:30 2021] GET /identity/v3/regions/tempest-region-25530694 => generated 176 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:13:30.303175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1985784-dd48-4b7d-ad8a-9ce7918d4a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:30.316433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1985784-dd48-4b7d-ad8a-9ce7918d4a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:30.326569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61708a-6f85-4cc6-839a-637352810759 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:30.328052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61708a-6f85-4cc6-839a-637352810759 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:30.328345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61708a-6f85-4cc6-839a-637352810759 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:30.330019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61708a-6f85-4cc6-839a-637352810759 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:30.332269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61708a-6f85-4cc6-839a-637352810759 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:30.333667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61708a-6f85-4cc6-839a-637352810759 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:30.351245 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3600/7288] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:30 2021] POST /identity/v3/services => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:30.355396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b1c39-250e-4c2c-81f1-38a17649097b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:30.366576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b1c39-250e-4c2c-81f1-38a17649097b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:30.387694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b154ef5-a01d-4eec-9d38-038e461f4240 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:30.388363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b154ef5-a01d-4eec-9d38-038e461f4240 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:30.388656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b154ef5-a01d-4eec-9d38-038e461f4240 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:30.389393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b154ef5-a01d-4eec-9d38-038e461f4240 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:30.390193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b154ef5-a01d-4eec-9d38-038e461f4240 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:30.392101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b154ef5-a01d-4eec-9d38-038e461f4240 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:30.413029 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-5b154ef5-a01d-4eec-9d38-038e461f4240 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1801539432. To ensure interoperability, identifiers should be a valid uuid. Dec 18 21:13:30.413029 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 18 21:13:30.413029 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:13:30.465050 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3689/7289] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Dec 18 21:13:30 2021] POST /identity/v3/endpoints => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:13:30.466334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61708a-6f85-4cc6-839a-637352810759 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:30.495890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61708a-6f85-4cc6-839a-637352810759 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:30.528223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d67ae-f133-49f6-a6b4-46740f154be9 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:30.529109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d67ae-f133-49f6-a6b4-46740f154be9 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:30.529449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d67ae-f133-49f6-a6b4-46740f154be9 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:30.530025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d67ae-f133-49f6-a6b4-46740f154be9 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/regions/tempest-region-1801539432` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:30.530763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d67ae-f133-49f6-a6b4-46740f154be9 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1801539432)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:30.531996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d67ae-f133-49f6-a6b4-46740f154be9 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:30.538696 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3601/7290] 10.222.0.13 () {58 vars in 1205 bytes} [Sat Dec 18 21:13:30 2021] GET /identity/v3/regions/tempest-region-1801539432 => generated 180 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:13:30.540956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b154ef5-a01d-4eec-9d38-038e461f4240 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:30.554946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b154ef5-a01d-4eec-9d38-038e461f4240 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:30.561225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82795f6f-8223-44dd-bedf-4ad40c83b254 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:30.562183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82795f6f-8223-44dd-bedf-4ad40c83b254 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:30.562507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82795f6f-8223-44dd-bedf-4ad40c83b254 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:30.562802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82795f6f-8223-44dd-bedf-4ad40c83b254 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:30.563570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82795f6f-8223-44dd-bedf-4ad40c83b254 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:30.565213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82795f6f-8223-44dd-bedf-4ad40c83b254 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:30.585511 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-82795f6f-8223-44dd-bedf-4ad40c83b254 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1094838930. To ensure interoperability, identifiers should be a valid uuid. Dec 18 21:13:30.585511 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 18 21:13:30.585511 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:13:30.616878 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3690/7291] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Dec 18 21:13:30 2021] POST /identity/v3/endpoints => generated 361 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:13:30.621011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d67ae-f133-49f6-a6b4-46740f154be9 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:30.631531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d67ae-f133-49f6-a6b4-46740f154be9 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:30.649972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60b81a-7313-430a-ac6b-d718a1b71b70 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:30.651014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60b81a-7313-430a-ac6b-d718a1b71b70 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:30.651308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60b81a-7313-430a-ac6b-d718a1b71b70 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:30.651592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60b81a-7313-430a-ac6b-d718a1b71b70 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/regions/tempest-region-1094838930` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:30.652727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60b81a-7313-430a-ac6b-d718a1b71b70 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1094838930)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:30.653801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60b81a-7313-430a-ac6b-d718a1b71b70 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:30.658855 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3602/7292] 10.222.0.13 () {58 vars in 1205 bytes} [Sat Dec 18 21:13:30 2021] GET /identity/v3/regions/tempest-region-1094838930 => generated 180 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:30.660450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82795f6f-8223-44dd-bedf-4ad40c83b254 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:30.671932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82795f6f-8223-44dd-bedf-4ad40c83b254 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:30.677773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bc0d2-4de1-4465-b2a8-94bef84fcae3 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:30.679545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bc0d2-4de1-4465-b2a8-94bef84fcae3 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:30.679909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bc0d2-4de1-4465-b2a8-94bef84fcae3 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:30.680271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bc0d2-4de1-4465-b2a8-94bef84fcae3 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:30.681268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bc0d2-4de1-4465-b2a8-94bef84fcae3 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:30.683028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bc0d2-4de1-4465-b2a8-94bef84fcae3 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:30.699353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60b81a-7313-430a-ac6b-d718a1b71b70 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:30.705289 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3691/7293] 10.222.0.13 () {58 vars in 1133 bytes} [Sat Dec 18 21:13:30 2021] GET /identity/v3/endpoints => generated 4384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:30.711182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60b81a-7313-430a-ac6b-d718a1b71b70 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:30.728152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826a22b-8454-4f63-8338-061d19af5a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:30.729010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826a22b-8454-4f63-8338-061d19af5a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:30.729294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826a22b-8454-4f63-8338-061d19af5a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:30.729569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826a22b-8454-4f63-8338-061d19af5a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints/32dd826556a4419584618a990cafcca9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:30.743130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826a22b-8454-4f63-8338-061d19af5a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=32dd826556a4419584618a990cafcca9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:30.744163 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-f826a22b-8454-4f63-8338-061d19af5a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:30.744163 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(msg) Dec 18 21:13:30.744163 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:13:30.745079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826a22b-8454-4f63-8338-061d19af5a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:30.750297 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3603/7294] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:30 2021] GET /identity/v3/endpoints/32dd826556a4419584618a990cafcca9 => generated 361 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:13:30.752667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bc0d2-4de1-4465-b2a8-94bef84fcae3 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:30.769567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bc0d2-4de1-4465-b2a8-94bef84fcae3 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:30.775933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7645907-801c-452c-b78b-4cc35a5c6995 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:30.776799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7645907-801c-452c-b78b-4cc35a5c6995 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:30.777087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7645907-801c-452c-b78b-4cc35a5c6995 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:30.777369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7645907-801c-452c-b78b-4cc35a5c6995 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints/32dd826556a4419584618a990cafcca9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:30.778705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7645907-801c-452c-b78b-4cc35a5c6995 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=32dd826556a4419584618a990cafcca9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:30.779739 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-c7645907-801c-452c-b78b-4cc35a5c6995 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:30.779739 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:13:30.779739 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:13:30.780626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7645907-801c-452c-b78b-4cc35a5c6995 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:30.791798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c7645907-801c-452c-b78b-4cc35a5c6995 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '32dd826556a4419584618a990cafcca9', 'request_id': 'req-c7645907-801c-452c-b78b-4cc35a5c6995'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:30.807007 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3692/7295] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:30 2021] DELETE /identity/v3/endpoints/32dd826556a4419584618a990cafcca9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:30.808143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826a22b-8454-4f63-8338-061d19af5a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:30.820803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826a22b-8454-4f63-8338-061d19af5a8e tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:30.839932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af786b6f-d9b4-4a5a-9f2d-d3eaa31507bb tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:30.840744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af786b6f-d9b4-4a5a-9f2d-d3eaa31507bb tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:30.841102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af786b6f-d9b4-4a5a-9f2d-d3eaa31507bb tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:30.841388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af786b6f-d9b4-4a5a-9f2d-d3eaa31507bb tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:30.842343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af786b6f-d9b4-4a5a-9f2d-d3eaa31507bb tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:30.843914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af786b6f-d9b4-4a5a-9f2d-d3eaa31507bb tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:30.852726 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3604/7296] 10.222.0.13 () {58 vars in 1133 bytes} [Sat Dec 18 21:13:30 2021] GET /identity/v3/endpoints => generated 4036 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:13:30.857246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7645907-801c-452c-b78b-4cc35a5c6995 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:30.869754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7645907-801c-452c-b78b-4cc35a5c6995 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:30.876939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9ab7a-79bd-493c-a881-817dd9f02f2a tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:30.878554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9ab7a-79bd-493c-a881-817dd9f02f2a tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:30.879563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9ab7a-79bd-493c-a881-817dd9f02f2a tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:30.879858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9ab7a-79bd-493c-a881-817dd9f02f2a tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints/32dd826556a4419584618a990cafcca9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:30.885290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9ab7a-79bd-493c-a881-817dd9f02f2a tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 18 21:13:30.895680 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-23d9ab7a-79bd-493c-a881-817dd9f02f2a tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Could not find endpoint: 32dd826556a4419584618a990cafcca9.: keystone.exception.EndpointNotFound: Could not find endpoint: 32dd826556a4419584618a990cafcca9. Dec 18 21:13:30.896963 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3693/7297] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:30 2021] DELETE /identity/v3/endpoints/32dd826556a4419584618a990cafcca9 => generated 114 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:13:30.902123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af786b6f-d9b4-4a5a-9f2d-d3eaa31507bb tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:30.912462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af786b6f-d9b4-4a5a-9f2d-d3eaa31507bb tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:30.917869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda0a53-15ba-436f-b9e5-1256a6303520 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:30.918752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda0a53-15ba-436f-b9e5-1256a6303520 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:30.919043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda0a53-15ba-436f-b9e5-1256a6303520 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:30.919323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda0a53-15ba-436f-b9e5-1256a6303520 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/regions/tempest-region-1094838930` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:30.919996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda0a53-15ba-436f-b9e5-1256a6303520 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1094838930)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:30.921606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda0a53-15ba-436f-b9e5-1256a6303520 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:30.934504 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-1fda0a53-15ba-436f-b9e5-1256a6303520 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1094838930. To ensure interoperability, identifiers should be a valid uuid. Dec 18 21:13:30.934504 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 18 21:13:30.934504 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:13:30.941976 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3605/7298] 10.222.0.13 () {58 vars in 1208 bytes} [Sat Dec 18 21:13:30 2021] DELETE /identity/v3/regions/tempest-region-1094838930 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:30.947439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9ab7a-79bd-493c-a881-817dd9f02f2a tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:30.958930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9ab7a-79bd-493c-a881-817dd9f02f2a tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:30.975048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de85fe-3938-4c32-a22b-e8fe52eb6e68 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:30.976336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de85fe-3938-4c32-a22b-e8fe52eb6e68 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:30.976622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de85fe-3938-4c32-a22b-e8fe52eb6e68 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:30.976903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de85fe-3938-4c32-a22b-e8fe52eb6e68 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:30.977631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de85fe-3938-4c32-a22b-e8fe52eb6e68 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:30.979315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de85fe-3938-4c32-a22b-e8fe52eb6e68 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:30.989166 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3694/7299] 10.222.0.13 () {58 vars in 1133 bytes} [Sat Dec 18 21:13:30 2021] GET /identity/v3/endpoints => generated 4036 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:30.993366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda0a53-15ba-436f-b9e5-1256a6303520 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.004425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda0a53-15ba-436f-b9e5-1256a6303520 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.009344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529e89c-4021-44d0-8547-d3a11d49f138 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.010046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529e89c-4021-44d0-8547-d3a11d49f138 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.010375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529e89c-4021-44d0-8547-d3a11d49f138 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.010660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529e89c-4021-44d0-8547-d3a11d49f138 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.011412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529e89c-4021-44d0-8547-d3a11d49f138 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Adding query filter params (service_id=dae3157d58984b05a2fb885da8c56945) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:13:31.011723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529e89c-4021-44d0-8547-d3a11d49f138 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.013323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529e89c-4021-44d0-8547-d3a11d49f138 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.021152 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3606/7300] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 21:13:30 2021] GET /identity/v3/endpoints?service_id=dae3157d58984b05a2fb885da8c56945 => generated 498 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:31.027379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de85fe-3938-4c32-a22b-e8fe52eb6e68 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.038757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de85fe-3938-4c32-a22b-e8fe52eb6e68 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.044007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fa176-b7d1-4ab7-8482-25963927a44b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.044759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa176-b7d1-4ab7-8482-25963927a44b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.045118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa176-b7d1-4ab7-8482-25963927a44b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.045464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa176-b7d1-4ab7-8482-25963927a44b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.046310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fa176-b7d1-4ab7-8482-25963927a44b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Adding query filter params (service_id=204bd4970e9e4c92b5d49ae7457f58ce) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:13:31.046691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fa176-b7d1-4ab7-8482-25963927a44b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.048360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fa176-b7d1-4ab7-8482-25963927a44b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.057062 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3695/7301] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Dec 18 21:13:31 2021] GET /identity/v3/endpoints?service_id=204bd4970e9e4c92b5d49ae7457f58ce => generated 505 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:31.062051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529e89c-4021-44d0-8547-d3a11d49f138 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.074225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529e89c-4021-44d0-8547-d3a11d49f138 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.079989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b413a1-899e-4d5f-9b30-e01c8b176819 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.080699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b413a1-899e-4d5f-9b30-e01c8b176819 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.080991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b413a1-899e-4d5f-9b30-e01c8b176819 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.081282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b413a1-899e-4d5f-9b30-e01c8b176819 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.082040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b413a1-899e-4d5f-9b30-e01c8b176819 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:13:31.082402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b413a1-899e-4d5f-9b30-e01c8b176819 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.084062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b413a1-899e-4d5f-9b30-e01c8b176819 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.095876 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3607/7302] 10.222.0.13 () {58 vars in 1166 bytes} [Sat Dec 18 21:13:31 2021] GET /identity/v3/endpoints?interface=public => generated 3391 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:13:31.099551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fa176-b7d1-4ab7-8482-25963927a44b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.111032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fa176-b7d1-4ab7-8482-25963927a44b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.116822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b794f32-b2c9-4c7b-b03a-490556b2689f tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.117941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b794f32-b2c9-4c7b-b03a-490556b2689f tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.118102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b794f32-b2c9-4c7b-b03a-490556b2689f tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.118374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b794f32-b2c9-4c7b-b03a-490556b2689f tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.119211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b794f32-b2c9-4c7b-b03a-490556b2689f tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:13:31.119600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b794f32-b2c9-4c7b-b03a-490556b2689f tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.121339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b794f32-b2c9-4c7b-b03a-490556b2689f tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.128585 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3696/7303] 10.222.0.13 () {58 vars in 1170 bytes} [Sat Dec 18 21:13:31 2021] GET /identity/v3/endpoints?interface=internal => generated 480 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:31.133719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b413a1-899e-4d5f-9b30-e01c8b176819 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.150693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b413a1-899e-4d5f-9b30-e01c8b176819 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.155713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bdaa4-0b41-4681-b53c-8b11150e29ee tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.156435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bdaa4-0b41-4681-b53c-8b11150e29ee tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.157106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bdaa4-0b41-4681-b53c-8b11150e29ee tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.157106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bdaa4-0b41-4681-b53c-8b11150e29ee tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.157767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bdaa4-0b41-4681-b53c-8b11150e29ee tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.159421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bdaa4-0b41-4681-b53c-8b11150e29ee tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.181937 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3608/7304] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:31 2021] POST /identity/v3/services => generated 290 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:31.183285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b794f32-b2c9-4c7b-b03a-490556b2689f tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.194714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b794f32-b2c9-4c7b-b03a-490556b2689f tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.218179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bb8ae-9a25-4e9b-8416-9d54098d40a0 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.218859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bb8ae-9a25-4e9b-8416-9d54098d40a0 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.219142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bb8ae-9a25-4e9b-8416-9d54098d40a0 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.219418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bb8ae-9a25-4e9b-8416-9d54098d40a0 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.220154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bb8ae-9a25-4e9b-8416-9d54098d40a0 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.221723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bb8ae-9a25-4e9b-8416-9d54098d40a0 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.236698 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-871bb8ae-9a25-4e9b-8416-9d54098d40a0 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-338577967. To ensure interoperability, identifiers should be a valid uuid. Dec 18 21:13:31.236698 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 18 21:13:31.236698 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:13:31.264573 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3697/7305] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Dec 18 21:13:31 2021] POST /identity/v3/endpoints => generated 359 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:31.265899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bdaa4-0b41-4681-b53c-8b11150e29ee tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.276933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bdaa4-0b41-4681-b53c-8b11150e29ee tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.292723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf39e1-4e02-4e42-991d-750ae429cabc tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.293583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf39e1-4e02-4e42-991d-750ae429cabc tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.293871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf39e1-4e02-4e42-991d-750ae429cabc tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.294156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf39e1-4e02-4e42-991d-750ae429cabc tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/regions/tempest-region-338577967` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.294956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf39e1-4e02-4e42-991d-750ae429cabc tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-338577967)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.296239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf39e1-4e02-4e42-991d-750ae429cabc tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.298095 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3609/7306] 10.222.0.13 () {58 vars in 1202 bytes} [Sat Dec 18 21:13:31 2021] GET /identity/v3/regions/tempest-region-338577967 => generated 178 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:31.302691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bb8ae-9a25-4e9b-8416-9d54098d40a0 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.313213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bb8ae-9a25-4e9b-8416-9d54098d40a0 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.318439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2b2bc-b46a-4b08-a796-746f6bed1428 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.319907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2b2bc-b46a-4b08-a796-746f6bed1428 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.320265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2b2bc-b46a-4b08-a796-746f6bed1428 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.320616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2b2bc-b46a-4b08-a796-746f6bed1428 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints/edaf634c58194834a7bc065c5bcb6944` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.325961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2b2bc-b46a-4b08-a796-746f6bed1428 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=edaf634c58194834a7bc065c5bcb6944)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.327166 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-b6a2b2bc-b46a-4b08-a796-746f6bed1428 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 18 21:13:31.327166 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(msg) Dec 18 21:13:31.327166 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:13:31.328044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2b2bc-b46a-4b08-a796-746f6bed1428 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.343400 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-b6a2b2bc-b46a-4b08-a796-746f6bed1428 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-295741175. To ensure interoperability, identifiers should be a valid uuid. Dec 18 21:13:31.343400 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 18 21:13:31.343400 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:13:31.375753 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3698/7307] 10.222.0.13 () {60 vars in 1255 bytes} [Sat Dec 18 21:13:31 2021] PATCH /identity/v3/endpoints/edaf634c58194834a7bc065c5bcb6944 => generated 361 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:13:31.377322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf39e1-4e02-4e42-991d-750ae429cabc tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.389177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf39e1-4e02-4e42-991d-750ae429cabc tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.404709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc47438-33b2-4f09-87c4-2f8ad5377d5d tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.405626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47438-33b2-4f09-87c4-2f8ad5377d5d tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.406132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47438-33b2-4f09-87c4-2f8ad5377d5d tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.406456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47438-33b2-4f09-87c4-2f8ad5377d5d tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/regions/tempest-region-295741175` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.407116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc47438-33b2-4f09-87c4-2f8ad5377d5d tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-295741175)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.408180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc47438-33b2-4f09-87c4-2f8ad5377d5d tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.410289 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3610/7308] 10.222.0.13 () {58 vars in 1202 bytes} [Sat Dec 18 21:13:31 2021] GET /identity/v3/regions/tempest-region-295741175 => generated 178 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:31.414374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2b2bc-b46a-4b08-a796-746f6bed1428 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.426137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2b2bc-b46a-4b08-a796-746f6bed1428 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.433096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd255d-8327-4b6b-8398-314a299a2b96 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.434690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd255d-8327-4b6b-8398-314a299a2b96 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.435458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd255d-8327-4b6b-8398-314a299a2b96 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.435458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd255d-8327-4b6b-8398-314a299a2b96 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints/edaf634c58194834a7bc065c5bcb6944` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.442343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd255d-8327-4b6b-8398-314a299a2b96 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=edaf634c58194834a7bc065c5bcb6944)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.444049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd255d-8327-4b6b-8398-314a299a2b96 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.453142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f8bd255d-8327-4b6b-8398-314a299a2b96 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'edaf634c58194834a7bc065c5bcb6944', 'request_id': 'req-f8bd255d-8327-4b6b-8398-314a299a2b96'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:31.463663 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3699/7309] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:31 2021] DELETE /identity/v3/endpoints/edaf634c58194834a7bc065c5bcb6944 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:13:31.467868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc47438-33b2-4f09-87c4-2f8ad5377d5d tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.478303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc47438-33b2-4f09-87c4-2f8ad5377d5d tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.493507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada6cfe-a70f-492e-a110-39ca75d00544 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.494396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada6cfe-a70f-492e-a110-39ca75d00544 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.494739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada6cfe-a70f-492e-a110-39ca75d00544 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.495034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada6cfe-a70f-492e-a110-39ca75d00544 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/regions/tempest-region-295741175` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.495730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada6cfe-a70f-492e-a110-39ca75d00544 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-295741175)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.497380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada6cfe-a70f-492e-a110-39ca75d00544 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.509688 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-4ada6cfe-a70f-492e-a110-39ca75d00544 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-295741175. To ensure interoperability, identifiers should be a valid uuid. Dec 18 21:13:31.509688 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 18 21:13:31.509688 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:13:31.516533 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3611/7310] 10.222.0.13 () {58 vars in 1205 bytes} [Sat Dec 18 21:13:31 2021] DELETE /identity/v3/regions/tempest-region-295741175 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:31.520626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd255d-8327-4b6b-8398-314a299a2b96 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.531668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd255d-8327-4b6b-8398-314a299a2b96 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.546455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36cb55-b992-4301-a4c3-2da7bcdfed4b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.547269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36cb55-b992-4301-a4c3-2da7bcdfed4b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.547556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36cb55-b992-4301-a4c3-2da7bcdfed4b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.547834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36cb55-b992-4301-a4c3-2da7bcdfed4b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/regions/tempest-region-338577967` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.548494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36cb55-b992-4301-a4c3-2da7bcdfed4b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-338577967)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.550078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36cb55-b992-4301-a4c3-2da7bcdfed4b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.568058 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3700/7311] 10.222.0.13 () {58 vars in 1205 bytes} [Sat Dec 18 21:13:31 2021] DELETE /identity/v3/regions/tempest-region-338577967 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:31.572789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada6cfe-a70f-492e-a110-39ca75d00544 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.583364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada6cfe-a70f-492e-a110-39ca75d00544 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.600731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1e9e1-fac8-490d-bbcd-6452e8518d79 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.601514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1e9e1-fac8-490d-bbcd-6452e8518d79 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.601802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1e9e1-fac8-490d-bbcd-6452e8518d79 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.602079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1e9e1-fac8-490d-bbcd-6452e8518d79 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/services/4213a895ba09414c925636267edb6c0e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.602782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1e9e1-fac8-490d-bbcd-6452e8518d79 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4213a895ba09414c925636267edb6c0e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.604358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1e9e1-fac8-490d-bbcd-6452e8518d79 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.623855 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3612/7312] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:31 2021] DELETE /identity/v3/services/4213a895ba09414c925636267edb6c0e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:31.629595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36cb55-b992-4301-a4c3-2da7bcdfed4b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.640565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36cb55-b992-4301-a4c3-2da7bcdfed4b tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.655635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48d94f-9f98-4380-ab3e-9a38333a2ba9 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.656467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48d94f-9f98-4380-ab3e-9a38333a2ba9 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.656753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48d94f-9f98-4380-ab3e-9a38333a2ba9 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.657030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48d94f-9f98-4380-ab3e-9a38333a2ba9 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints/39f86112af9f4aacb009eace627a2d22` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.661840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48d94f-9f98-4380-ab3e-9a38333a2ba9 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=39f86112af9f4aacb009eace627a2d22)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.663498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48d94f-9f98-4380-ab3e-9a38333a2ba9 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.671134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7d48d94f-9f98-4380-ab3e-9a38333a2ba9 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '39f86112af9f4aacb009eace627a2d22', 'request_id': 'req-7d48d94f-9f98-4380-ab3e-9a38333a2ba9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:31.680950 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3701/7313] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:31 2021] DELETE /identity/v3/endpoints/39f86112af9f4aacb009eace627a2d22 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:13:31.684713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1e9e1-fac8-490d-bbcd-6452e8518d79 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.695638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1e9e1-fac8-490d-bbcd-6452e8518d79 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.709840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79e81b-ccb1-4507-87f1-a50df076c853 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.710703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79e81b-ccb1-4507-87f1-a50df076c853 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.710991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79e81b-ccb1-4507-87f1-a50df076c853 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.711270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79e81b-ccb1-4507-87f1-a50df076c853 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/regions/tempest-region-1801539432` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.711968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79e81b-ccb1-4507-87f1-a50df076c853 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1801539432)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.713553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79e81b-ccb1-4507-87f1-a50df076c853 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.725894 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-2b79e81b-ccb1-4507-87f1-a50df076c853 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1801539432. To ensure interoperability, identifiers should be a valid uuid. Dec 18 21:13:31.725894 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 18 21:13:31.725894 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:13:31.733307 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3613/7314] 10.222.0.13 () {58 vars in 1208 bytes} [Sat Dec 18 21:13:31 2021] DELETE /identity/v3/regions/tempest-region-1801539432 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:31.737491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48d94f-9f98-4380-ab3e-9a38333a2ba9 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.752304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48d94f-9f98-4380-ab3e-9a38333a2ba9 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.768397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91fe20-2a56-4eb1-886f-96097dc2c9e2 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.769227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91fe20-2a56-4eb1-886f-96097dc2c9e2 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.769508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91fe20-2a56-4eb1-886f-96097dc2c9e2 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.769782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91fe20-2a56-4eb1-886f-96097dc2c9e2 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/services/204bd4970e9e4c92b5d49ae7457f58ce` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.770476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91fe20-2a56-4eb1-886f-96097dc2c9e2 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:delete_service(service_id=204bd4970e9e4c92b5d49ae7457f58ce)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.772053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91fe20-2a56-4eb1-886f-96097dc2c9e2 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.797460 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3702/7315] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:31 2021] DELETE /identity/v3/services/204bd4970e9e4c92b5d49ae7457f58ce => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:13:31.801464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79e81b-ccb1-4507-87f1-a50df076c853 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.812295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79e81b-ccb1-4507-87f1-a50df076c853 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.827790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed82f9-afa8-49b8-8389-d2414ca41c35 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.828656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed82f9-afa8-49b8-8389-d2414ca41c35 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.828945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed82f9-afa8-49b8-8389-d2414ca41c35 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.829219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed82f9-afa8-49b8-8389-d2414ca41c35 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/endpoints/b7270121f88a47d19b889981865bde3b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.835552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed82f9-afa8-49b8-8389-d2414ca41c35 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=b7270121f88a47d19b889981865bde3b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.837407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed82f9-afa8-49b8-8389-d2414ca41c35 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.845486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0fed82f9-afa8-49b8-8389-d2414ca41c35 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'b7270121f88a47d19b889981865bde3b', 'request_id': 'req-0fed82f9-afa8-49b8-8389-d2414ca41c35'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:31.855133 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3614/7316] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Dec 18 21:13:31 2021] DELETE /identity/v3/endpoints/b7270121f88a47d19b889981865bde3b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:31.859161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91fe20-2a56-4eb1-886f-96097dc2c9e2 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.870682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91fe20-2a56-4eb1-886f-96097dc2c9e2 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.886392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb757aa4-2621-48ef-b06e-566daf891cc3 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.887234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb757aa4-2621-48ef-b06e-566daf891cc3 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.887523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb757aa4-2621-48ef-b06e-566daf891cc3 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.888344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb757aa4-2621-48ef-b06e-566daf891cc3 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/regions/tempest-region-25530694` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.888512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb757aa4-2621-48ef-b06e-566daf891cc3 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-25530694)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.890121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb757aa4-2621-48ef-b06e-566daf891cc3 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.902123 ncdv-master-1 devstack@keystone.service[96646]: WARNING py.warnings [None req-eb757aa4-2621-48ef-b06e-566daf891cc3 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-25530694. To ensure interoperability, identifiers should be a valid uuid. Dec 18 21:13:31.902123 ncdv-master-1 devstack@keystone.service[96646]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 18 21:13:31.902123 ncdv-master-1 devstack@keystone.service[96646]: Dec 18 21:13:31.909105 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3703/7317] 10.222.0.13 () {58 vars in 1202 bytes} [Sat Dec 18 21:13:31 2021] DELETE /identity/v3/regions/tempest-region-25530694 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:31.913126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed82f9-afa8-49b8-8389-d2414ca41c35 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:31.923612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed82f9-afa8-49b8-8389-d2414ca41c35 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:31.939094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7f761-30c8-447f-be82-c62bba410ef4 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fce4069decc4301a9ea326533d7603f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '027e6287293f4324aea457cb8aeaf36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:31.939978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7f761-30c8-447f-be82-c62bba410ef4 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:31.940263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7f761-30c8-447f-be82-c62bba410ef4 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:31.940539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7f761-30c8-447f-be82-c62bba410ef4 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] PATH_INFO: `/v3/services/dae3157d58984b05a2fb885da8c56945` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:31.941192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7f761-30c8-447f-be82-c62bba410ef4 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorizing `identity:delete_service(service_id=dae3157d58984b05a2fb885da8c56945)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:31.943086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7f761-30c8-447f-be82-c62bba410ef4 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:31.974972 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3615/7318] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:31 2021] DELETE /identity/v3/services/dae3157d58984b05a2fb885da8c56945 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:31.979171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb757aa4-2621-48ef-b06e-566daf891cc3 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:32.048817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb757aa4-2621-48ef-b06e-566daf891cc3 tempest-EndPointsTestJSON-1686276920 tempest-EndPointsTestJSON-1686276920-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:32.062872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde2150-82c7-457b-9cc8-1e5961f3c806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:32.063724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde2150-82c7-457b-9cc8-1e5961f3c806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:32.064007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde2150-82c7-457b-9cc8-1e5961f3c806 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:32.064284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde2150-82c7-457b-9cc8-1e5961f3c806 admin admin] PATH_INFO: `/v3/users/b1bacb92dad04b33b3f8a76a2058534a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:32.065487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde2150-82c7-457b-9cc8-1e5961f3c806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1bacb92dad04b33b3f8a76a2058534a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:32.067688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde2150-82c7-457b-9cc8-1e5961f3c806 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:32.113296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bfde2150-82c7-457b-9cc8-1e5961f3c806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1bacb92dad04b33b3f8a76a2058534a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:32.120271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bfde2150-82c7-457b-9cc8-1e5961f3c806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1bacb92dad04b33b3f8a76a2058534a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:32.120963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bfde2150-82c7-457b-9cc8-1e5961f3c806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1bacb92dad04b33b3f8a76a2058534a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:32.133327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bfde2150-82c7-457b-9cc8-1e5961f3c806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1bacb92dad04b33b3f8a76a2058534a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:32.144853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bfde2150-82c7-457b-9cc8-1e5961f3c806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1bacb92dad04b33b3f8a76a2058534a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:32.151265 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3704/7319] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:13:31 2021] DELETE /identity/v3/users/b1bacb92dad04b33b3f8a76a2058534a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:32.155820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802ff92-5d06-47dc-b8dd-2c0b8418078c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:32.156115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802ff92-5d06-47dc-b8dd-2c0b8418078c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:32.156401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802ff92-5d06-47dc-b8dd-2c0b8418078c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:32.175658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3802ff92-5d06-47dc-b8dd-2c0b8418078c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:32.176871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3802ff92-5d06-47dc-b8dd-2c0b8418078c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:32.239003 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3616/7320] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:32.249402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde2150-82c7-457b-9cc8-1e5961f3c806 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:32.251041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bfde2150-82c7-457b-9cc8-1e5961f3c806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:32.325250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde2150-82c7-457b-9cc8-1e5961f3c806 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:32.329126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c11ee6-b933-4187-b5b3-30313a336e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:32.329764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c11ee6-b933-4187-b5b3-30313a336e0f service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:32.330122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c11ee6-b933-4187-b5b3-30313a336e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:32.330437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c11ee6-b933-4187-b5b3-30313a336e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:32.341723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c11ee6-b933-4187-b5b3-30313a336e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:32.343675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c11ee6-b933-4187-b5b3-30313a336e0f service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:32.355582 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3705/7321] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:13:32.644554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802ff92-5d06-47dc-b8dd-2c0b8418078c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:32.646124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3802ff92-5d06-47dc-b8dd-2c0b8418078c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:32.658961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802ff92-5d06-47dc-b8dd-2c0b8418078c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:32.664426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:32.665295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:32.665655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:32.665941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f admin admin] PATH_INFO: `/v3/projects/63ee1adb4f5b4e8fa7993ea37936ce44` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:32.667219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ee1adb4f5b4e8fa7993ea37936ce44)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:32.669280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:32.717251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ee1adb4f5b4e8fa7993ea37936ce44', 'request_id': 'req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:32.722865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ee1adb4f5b4e8fa7993ea37936ce44', 'request_id': 'req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:32.729352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ee1adb4f5b4e8fa7993ea37936ce44', 'request_id': 'req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:32.742643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f admin admin] The token cache is being invalidate because project 63ee1adb4f5b4e8fa7993ea37936ce44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:32.742956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:32.743611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:32.745205 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3617/7322] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:32 2021] DELETE /identity/v3/projects/63ee1adb4f5b4e8fa7993ea37936ce44 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:32.749144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c11ee6-b933-4187-b5b3-30313a336e0f service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:32.760354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c11ee6-b933-4187-b5b3-30313a336e0f service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:32.830576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40929d-d959-457e-8ece-63cfa96858e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:32.831435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40929d-d959-457e-8ece-63cfa96858e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:32.831715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40929d-d959-457e-8ece-63cfa96858e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:32.831993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40929d-d959-457e-8ece-63cfa96858e4 admin admin] PATH_INFO: `/v3/users/4fce4069decc4301a9ea326533d7603f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:32.833190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40929d-d959-457e-8ece-63cfa96858e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fce4069decc4301a9ea326533d7603f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:32.835769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40929d-d959-457e-8ece-63cfa96858e4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:32.879691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f40929d-d959-457e-8ece-63cfa96858e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fce4069decc4301a9ea326533d7603f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:32.886953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f40929d-d959-457e-8ece-63cfa96858e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fce4069decc4301a9ea326533d7603f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:32.887564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f40929d-d959-457e-8ece-63cfa96858e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fce4069decc4301a9ea326533d7603f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:32.899578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f40929d-d959-457e-8ece-63cfa96858e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fce4069decc4301a9ea326533d7603f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:32.906048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2f40929d-d959-457e-8ece-63cfa96858e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fce4069decc4301a9ea326533d7603f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:32.911894 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3706/7323] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:13:32 2021] DELETE /identity/v3/users/4fce4069decc4301a9ea326533d7603f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:33.211205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:33.212951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:33.236459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd7101-d1f4-47fa-8567-bb0f5036e21f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:33.301318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df84ed-4fa0-41a8-8a1c-4ba268414958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:33.302171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df84ed-4fa0-41a8-8a1c-4ba268414958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:33.302487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df84ed-4fa0-41a8-8a1c-4ba268414958 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:33.302768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df84ed-4fa0-41a8-8a1c-4ba268414958 admin admin] PATH_INFO: `/v3/projects/027e6287293f4324aea457cb8aeaf36a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:33.304462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df84ed-4fa0-41a8-8a1c-4ba268414958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=027e6287293f4324aea457cb8aeaf36a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:33.306372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df84ed-4fa0-41a8-8a1c-4ba268414958 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:33.350048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-27df84ed-4fa0-41a8-8a1c-4ba268414958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027e6287293f4324aea457cb8aeaf36a', 'request_id': 'req-27df84ed-4fa0-41a8-8a1c-4ba268414958'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:33.355936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-27df84ed-4fa0-41a8-8a1c-4ba268414958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027e6287293f4324aea457cb8aeaf36a', 'request_id': 'req-27df84ed-4fa0-41a8-8a1c-4ba268414958'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:33.361158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-27df84ed-4fa0-41a8-8a1c-4ba268414958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027e6287293f4324aea457cb8aeaf36a', 'request_id': 'req-27df84ed-4fa0-41a8-8a1c-4ba268414958'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:33.373696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-27df84ed-4fa0-41a8-8a1c-4ba268414958 admin admin] The token cache is being invalidate because project 027e6287293f4324aea457cb8aeaf36a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:33.373980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-27df84ed-4fa0-41a8-8a1c-4ba268414958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:33.374615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-27df84ed-4fa0-41a8-8a1c-4ba268414958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:33.376163 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3618/7324] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:33 2021] DELETE /identity/v3/projects/027e6287293f4324aea457cb8aeaf36a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:33.383879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f72e9-5c48-4fff-a9dd-c9134f520b3a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:33.384164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f72e9-5c48-4fff-a9dd-c9134f520b3a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:33.384441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f72e9-5c48-4fff-a9dd-c9134f520b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:33.402150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-667f72e9-5c48-4fff-a9dd-c9134f520b3a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:33.403310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-667f72e9-5c48-4fff-a9dd-c9134f520b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:33.460287 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3707/7325] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:33.468178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571fdf2-bd01-4958-80c9-6f658387ea10 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:33.468467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571fdf2-bd01-4958-80c9-6f658387ea10 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:33.468744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571fdf2-bd01-4958-80c9-6f658387ea10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:33.486659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4571fdf2-bd01-4958-80c9-6f658387ea10 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:33.487843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4571fdf2-bd01-4958-80c9-6f658387ea10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:33.496635 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3619/7326] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:33.500605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f72e9-5c48-4fff-a9dd-c9134f520b3a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:33.510796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f72e9-5c48-4fff-a9dd-c9134f520b3a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:33.515297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b626e-1dd0-4048-b3c5-3b2a41285ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:33.515942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b626e-1dd0-4048-b3c5-3b2a41285ece admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:33.516220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b626e-1dd0-4048-b3c5-3b2a41285ece admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:33.516500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b626e-1dd0-4048-b3c5-3b2a41285ece admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:33.517221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b626e-1dd0-4048-b3c5-3b2a41285ece admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:13:33.517522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b626e-1dd0-4048-b3c5-3b2a41285ece admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:33.519334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b626e-1dd0-4048-b3c5-3b2a41285ece admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:33.531072 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3708/7327] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:13:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:33.535837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571fdf2-bd01-4958-80c9-6f658387ea10 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:33.545024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571fdf2-bd01-4958-80c9-6f658387ea10 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:33.550200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc5128-e966-4ff0-a9a2-296cdc86c157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:33.550965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc5128-e966-4ff0-a9a2-296cdc86c157 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:33.551325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc5128-e966-4ff0-a9a2-296cdc86c157 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:33.551607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc5128-e966-4ff0-a9a2-296cdc86c157 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:33.552320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc5128-e966-4ff0-a9a2-296cdc86c157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:33.554820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc5128-e966-4ff0-a9a2-296cdc86c157 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:33.583290 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3620/7328] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:33 2021] POST /identity/v3/projects => generated 395 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:13:33.587302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b626e-1dd0-4048-b3c5-3b2a41285ece admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:33.599043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b626e-1dd0-4048-b3c5-3b2a41285ece admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:33.655627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dccb31-72e3-4cbf-9b8c-5ce136f4592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:33.656214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dccb31-72e3-4cbf-9b8c-5ce136f4592b admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:33.656493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dccb31-72e3-4cbf-9b8c-5ce136f4592b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:33.656769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dccb31-72e3-4cbf-9b8c-5ce136f4592b admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:33.657496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dccb31-72e3-4cbf-9b8c-5ce136f4592b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:33.659630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dccb31-72e3-4cbf-9b8c-5ce136f4592b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:33.680212 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3709/7329] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:13:33 2021] POST /identity/v3/users => generated 304 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:33.684919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc5128-e966-4ff0-a9a2-296cdc86c157 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:33.701412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc5128-e966-4ff0-a9a2-296cdc86c157 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:33.706530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb9ee9-25f4-494c-b2df-28abb5909e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:33.707364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb9ee9-25f4-494c-b2df-28abb5909e3d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:33.707786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb9ee9-25f4-494c-b2df-28abb5909e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:33.707945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb9ee9-25f4-494c-b2df-28abb5909e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:33.708767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb9ee9-25f4-494c-b2df-28abb5909e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:33.714307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb9ee9-25f4-494c-b2df-28abb5909e3d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:33.723441 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3621/7330] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:33 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:33.728336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dccb31-72e3-4cbf-9b8c-5ce136f4592b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:33.749348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dccb31-72e3-4cbf-9b8c-5ce136f4592b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:33.754674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb902ec-6526-40a1-a300-3619063b633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:33.755801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb902ec-6526-40a1-a300-3619063b633a admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:33.756085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb902ec-6526-40a1-a300-3619063b633a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:33.756363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb902ec-6526-40a1-a300-3619063b633a admin admin] PATH_INFO: `/v3/projects/8908c58f0733484e91f9ef5e31d3c453/users/41f2939c59ba4ed1a9c894d46ecd2be0/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:33.774680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb902ec-6526-40a1-a300-3619063b633a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8908c58f0733484e91f9ef5e31d3c453, user_id=41f2939c59ba4ed1a9c894d46ecd2be0, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:33.777706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb902ec-6526-40a1-a300-3619063b633a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:33.790836 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3710/7331] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:33 2021] PUT /identity/v3/projects/8908c58f0733484e91f9ef5e31d3c453/users/41f2939c59ba4ed1a9c894d46ecd2be0/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:13:33.794779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb9ee9-25f4-494c-b2df-28abb5909e3d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:33.805332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb9ee9-25f4-494c-b2df-28abb5909e3d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:33.864157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaddf0-5165-48c8-a5f6-bd1b7c384c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:33.864818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaddf0-5165-48c8-a5f6-bd1b7c384c99 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:33.865822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaddf0-5165-48c8-a5f6-bd1b7c384c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:33.866707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaddf0-5165-48c8-a5f6-bd1b7c384c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:33.867434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eaddf0-5165-48c8-a5f6-bd1b7c384c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:33.869375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eaddf0-5165-48c8-a5f6-bd1b7c384c99 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:33.884821 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3622/7332] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:33 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:33.886293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb902ec-6526-40a1-a300-3619063b633a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:33.901637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb902ec-6526-40a1-a300-3619063b633a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:33.906880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cdd64-1ca6-4525-8c2b-21a7d1105263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:33.907707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cdd64-1ca6-4525-8c2b-21a7d1105263 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:33.908117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cdd64-1ca6-4525-8c2b-21a7d1105263 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:33.908424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cdd64-1ca6-4525-8c2b-21a7d1105263 admin admin] PATH_INFO: `/v3/projects/8908c58f0733484e91f9ef5e31d3c453/users/41f2939c59ba4ed1a9c894d46ecd2be0/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:33.910579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cdd64-1ca6-4525-8c2b-21a7d1105263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8908c58f0733484e91f9ef5e31d3c453, user_id=41f2939c59ba4ed1a9c894d46ecd2be0, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:33.913848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cdd64-1ca6-4525-8c2b-21a7d1105263 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:33.924464 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3711/7333] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:33 2021] PUT /identity/v3/projects/8908c58f0733484e91f9ef5e31d3c453/users/41f2939c59ba4ed1a9c894d46ecd2be0/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:13:33.935554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e29d0-efab-4ca5-ba19-7a64c147d009 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:33.935852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e29d0-efab-4ca5-ba19-7a64c147d009 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:33.936138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e29d0-efab-4ca5-ba19-7a64c147d009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:33.962755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f95e29d0-efab-4ca5-ba19-7a64c147d009 None None] MFA Rules not processed for user `41f2939c59ba4ed1a9c894d46ecd2be0`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:33.963974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f95e29d0-efab-4ca5-ba19-7a64c147d009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:34.030546 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3623/7334] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:33 2021] POST /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:34.034957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cdd64-1ca6-4525-8c2b-21a7d1105263 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:34.097241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cdd64-1ca6-4525-8c2b-21a7d1105263 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:34.104109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c39e02-c40f-4ac0-bfc7-14e4b471a0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:34.104109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c39e02-c40f-4ac0-bfc7-14e4b471a0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:34.104507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c39e02-c40f-4ac0-bfc7-14e4b471a0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:34.105684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c39e02-c40f-4ac0-bfc7-14e4b471a0d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:34.106507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c39e02-c40f-4ac0-bfc7-14e4b471a0d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:34.109885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c39e02-c40f-4ac0-bfc7-14e4b471a0d4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:34.142918 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3712/7335] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:34 2021] POST /identity/v3/projects => generated 395 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:34.144556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e29d0-efab-4ca5-ba19-7a64c147d009 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:34.156201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e29d0-efab-4ca5-ba19-7a64c147d009 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:34.218985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938427b-bc68-4cee-889e-e14558b101cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:34.219724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938427b-bc68-4cee-889e-e14558b101cd admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:34.220016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938427b-bc68-4cee-889e-e14558b101cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:34.220321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938427b-bc68-4cee-889e-e14558b101cd admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:34.221141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938427b-bc68-4cee-889e-e14558b101cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:34.223110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938427b-bc68-4cee-889e-e14558b101cd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:34.268695 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3624/7336] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:13:34 2021] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:13:34.273735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c39e02-c40f-4ac0-bfc7-14e4b471a0d4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:34.288965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c39e02-c40f-4ac0-bfc7-14e4b471a0d4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:34.301638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e033959-d685-44f4-9613-e93096be81b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:34.302730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e033959-d685-44f4-9613-e93096be81b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:34.303816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e033959-d685-44f4-9613-e93096be81b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:34.304111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e033959-d685-44f4-9613-e93096be81b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:34.304857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e033959-d685-44f4-9613-e93096be81b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:34.307194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e033959-d685-44f4-9613-e93096be81b6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:34.325163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938427b-bc68-4cee-889e-e14558b101cd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:34.326111 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3713/7337] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:34 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:34.336693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938427b-bc68-4cee-889e-e14558b101cd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:34.342076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ab355-dcdd-4a6f-b792-fdf8aa4a70ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:34.343087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ab355-dcdd-4a6f-b792-fdf8aa4a70ae admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:34.343963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ab355-dcdd-4a6f-b792-fdf8aa4a70ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:34.343963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ab355-dcdd-4a6f-b792-fdf8aa4a70ae admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:34.344383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ab355-dcdd-4a6f-b792-fdf8aa4a70ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:34.348967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ab355-dcdd-4a6f-b792-fdf8aa4a70ae admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:34.362130 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3625/7338] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:34 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:34.366223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e033959-d685-44f4-9613-e93096be81b6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:34.381370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e033959-d685-44f4-9613-e93096be81b6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:34.388015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332d84d-d77c-49cc-95b4-3ac643609b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:34.389172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d84d-d77c-49cc-95b4-3ac643609b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:34.389525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d84d-d77c-49cc-95b4-3ac643609b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:34.389867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d84d-d77c-49cc-95b4-3ac643609b9f admin admin] PATH_INFO: `/v3/projects/7b286a5093814e3bb18403acd34b55b5/users/40e44f534a044af58764e6dace5ea7b2/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:34.426767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332d84d-d77c-49cc-95b4-3ac643609b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b286a5093814e3bb18403acd34b55b5, user_id=40e44f534a044af58764e6dace5ea7b2, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:34.431750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332d84d-d77c-49cc-95b4-3ac643609b9f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:34.454511 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3714/7339] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:34 2021] PUT /identity/v3/projects/7b286a5093814e3bb18403acd34b55b5/users/40e44f534a044af58764e6dace5ea7b2/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:34.465917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ac659-54ef-4d64-af35-61b638288348 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:34.466304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ac659-54ef-4d64-af35-61b638288348 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:34.466529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ac659-54ef-4d64-af35-61b638288348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:34.552467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-eb4ac659-54ef-4d64-af35-61b638288348 None None] MFA Rules not processed for user `40e44f534a044af58764e6dace5ea7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:34.553907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eb4ac659-54ef-4d64-af35-61b638288348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:34.695856 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3626/7340] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:34 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:34.707823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332d84d-d77c-49cc-95b4-3ac643609b9f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:34.710383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e332d84d-d77c-49cc-95b4-3ac643609b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:34.845136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332d84d-d77c-49cc-95b4-3ac643609b9f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:34.849860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69d8f4-e110-4af7-9eb0-a28f9c307294 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:34.850828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69d8f4-e110-4af7-9eb0-a28f9c307294 service glance] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:34.851190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69d8f4-e110-4af7-9eb0-a28f9c307294 service glance] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:34.851560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69d8f4-e110-4af7-9eb0-a28f9c307294 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:34.939866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69d8f4-e110-4af7-9eb0-a28f9c307294 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:34.941941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69d8f4-e110-4af7-9eb0-a28f9c307294 service glance] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:34.959249 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3715/7341] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:34 2021] GET /identity/v3/auth/tokens => generated 3329 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:13:35.393286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ac659-54ef-4d64-af35-61b638288348 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:35.466474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ac659-54ef-4d64-af35-61b638288348 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:35.471520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64173333-a978-464b-89ad-ace66f6cc8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:35.474368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64173333-a978-464b-89ad-ace66f6cc8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:35.474924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64173333-a978-464b-89ad-ace66f6cc8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:35.476559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64173333-a978-464b-89ad-ace66f6cc8d1 admin admin] PATH_INFO: `/v3/users/41f2939c59ba4ed1a9c894d46ecd2be0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:35.477947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64173333-a978-464b-89ad-ace66f6cc8d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41f2939c59ba4ed1a9c894d46ecd2be0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:35.479908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64173333-a978-464b-89ad-ace66f6cc8d1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:35.535793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-64173333-a978-464b-89ad-ace66f6cc8d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41f2939c59ba4ed1a9c894d46ecd2be0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:35.544240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-64173333-a978-464b-89ad-ace66f6cc8d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41f2939c59ba4ed1a9c894d46ecd2be0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:35.557204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-64173333-a978-464b-89ad-ace66f6cc8d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41f2939c59ba4ed1a9c894d46ecd2be0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:35.558552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-64173333-a978-464b-89ad-ace66f6cc8d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41f2939c59ba4ed1a9c894d46ecd2be0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:35.569218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-64173333-a978-464b-89ad-ace66f6cc8d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41f2939c59ba4ed1a9c894d46ecd2be0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:35.588584 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3627/7342] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:13:35 2021] DELETE /identity/v3/users/41f2939c59ba4ed1a9c894d46ecd2be0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:35.591110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28e0eb-03bb-4b5d-ae6b-3b6d48a46e3a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:35.591522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28e0eb-03bb-4b5d-ae6b-3b6d48a46e3a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:35.592281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28e0eb-03bb-4b5d-ae6b-3b6d48a46e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:35.619873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7e28e0eb-03bb-4b5d-ae6b-3b6d48a46e3a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:35.621095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7e28e0eb-03bb-4b5d-ae6b-3b6d48a46e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:35.721705 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3716/7343] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:35.730139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64173333-a978-464b-89ad-ace66f6cc8d1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:35.732824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-64173333-a978-464b-89ad-ace66f6cc8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:35.804649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64173333-a978-464b-89ad-ace66f6cc8d1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:35.808509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc71eb-e868-4d91-9366-1a7f496408fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:35.809360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc71eb-e868-4d91-9366-1a7f496408fc service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:35.809678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc71eb-e868-4d91-9366-1a7f496408fc service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:35.810128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc71eb-e868-4d91-9366-1a7f496408fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:35.822877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc71eb-e868-4d91-9366-1a7f496408fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:35.824305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc71eb-e868-4d91-9366-1a7f496408fc service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:35.836673 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3628/7344] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:13:36.127542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28e0eb-03bb-4b5d-ae6b-3b6d48a46e3a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:36.129695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7e28e0eb-03bb-4b5d-ae6b-3b6d48a46e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:36.152860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28e0eb-03bb-4b5d-ae6b-3b6d48a46e3a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:36.160914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3cc2e-7534-4d6a-84b7-412f9daae733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:36.161781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3cc2e-7534-4d6a-84b7-412f9daae733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:36.162062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3cc2e-7534-4d6a-84b7-412f9daae733 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:36.162866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3cc2e-7534-4d6a-84b7-412f9daae733 admin admin] PATH_INFO: `/v3/projects/8908c58f0733484e91f9ef5e31d3c453` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:36.164643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3cc2e-7534-4d6a-84b7-412f9daae733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8908c58f0733484e91f9ef5e31d3c453)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:36.167223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3cc2e-7534-4d6a-84b7-412f9daae733 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:36.271636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-24b3cc2e-7534-4d6a-84b7-412f9daae733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8908c58f0733484e91f9ef5e31d3c453', 'request_id': 'req-24b3cc2e-7534-4d6a-84b7-412f9daae733'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:36.279196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-24b3cc2e-7534-4d6a-84b7-412f9daae733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8908c58f0733484e91f9ef5e31d3c453', 'request_id': 'req-24b3cc2e-7534-4d6a-84b7-412f9daae733'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:36.301960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-24b3cc2e-7534-4d6a-84b7-412f9daae733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8908c58f0733484e91f9ef5e31d3c453', 'request_id': 'req-24b3cc2e-7534-4d6a-84b7-412f9daae733'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:36.328372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-24b3cc2e-7534-4d6a-84b7-412f9daae733 admin admin] The token cache is being invalidate because project 8908c58f0733484e91f9ef5e31d3c453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:36.328741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-24b3cc2e-7534-4d6a-84b7-412f9daae733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:36.329711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-24b3cc2e-7534-4d6a-84b7-412f9daae733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:36.332273 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3717/7345] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:36 2021] DELETE /identity/v3/projects/8908c58f0733484e91f9ef5e31d3c453 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:36.336245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc71eb-e868-4d91-9366-1a7f496408fc service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:36.346370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc71eb-e868-4d91-9366-1a7f496408fc service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:36.413206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d667baa-98d0-4b86-b60b-9fb411e0a518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:36.414181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d667baa-98d0-4b86-b60b-9fb411e0a518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:36.414635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d667baa-98d0-4b86-b60b-9fb411e0a518 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:36.415024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d667baa-98d0-4b86-b60b-9fb411e0a518 admin admin] PATH_INFO: `/v3/users/40e44f534a044af58764e6dace5ea7b2` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:36.416590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d667baa-98d0-4b86-b60b-9fb411e0a518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e44f534a044af58764e6dace5ea7b2)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:36.418694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d667baa-98d0-4b86-b60b-9fb411e0a518 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:36.503819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0d667baa-98d0-4b86-b60b-9fb411e0a518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e44f534a044af58764e6dace5ea7b2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:36.525960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0d667baa-98d0-4b86-b60b-9fb411e0a518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e44f534a044af58764e6dace5ea7b2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:36.543995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0d667baa-98d0-4b86-b60b-9fb411e0a518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e44f534a044af58764e6dace5ea7b2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:36.544919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0d667baa-98d0-4b86-b60b-9fb411e0a518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e44f534a044af58764e6dace5ea7b2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:36.556658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0d667baa-98d0-4b86-b60b-9fb411e0a518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e44f534a044af58764e6dace5ea7b2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:36.564583 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3629/7346] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:13:36 2021] DELETE /identity/v3/users/40e44f534a044af58764e6dace5ea7b2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:37.203902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3cc2e-7534-4d6a-84b7-412f9daae733 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:37.205508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-24b3cc2e-7534-4d6a-84b7-412f9daae733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:37.229335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3cc2e-7534-4d6a-84b7-412f9daae733 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:37.304168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c24f7-2065-4cc9-91e9-333aef0f9192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:37.305310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c24f7-2065-4cc9-91e9-333aef0f9192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:37.305784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c24f7-2065-4cc9-91e9-333aef0f9192 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:37.306228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c24f7-2065-4cc9-91e9-333aef0f9192 admin admin] PATH_INFO: `/v3/projects/7b286a5093814e3bb18403acd34b55b5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:37.307666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c24f7-2065-4cc9-91e9-333aef0f9192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b286a5093814e3bb18403acd34b55b5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:37.312190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c24f7-2065-4cc9-91e9-333aef0f9192 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:37.368532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e94c24f7-2065-4cc9-91e9-333aef0f9192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b286a5093814e3bb18403acd34b55b5', 'request_id': 'req-e94c24f7-2065-4cc9-91e9-333aef0f9192'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:37.375386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e94c24f7-2065-4cc9-91e9-333aef0f9192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b286a5093814e3bb18403acd34b55b5', 'request_id': 'req-e94c24f7-2065-4cc9-91e9-333aef0f9192'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:37.384826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e94c24f7-2065-4cc9-91e9-333aef0f9192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b286a5093814e3bb18403acd34b55b5', 'request_id': 'req-e94c24f7-2065-4cc9-91e9-333aef0f9192'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:37.397362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e94c24f7-2065-4cc9-91e9-333aef0f9192 admin admin] The token cache is being invalidate because project 7b286a5093814e3bb18403acd34b55b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:37.397964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e94c24f7-2065-4cc9-91e9-333aef0f9192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:37.399301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e94c24f7-2065-4cc9-91e9-333aef0f9192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:37.401910 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3718/7347] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:37 2021] DELETE /identity/v3/projects/7b286a5093814e3bb18403acd34b55b5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:37.408838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70758125-3d4c-4539-9571-c8b77b1b65b9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:37.409351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70758125-3d4c-4539-9571-c8b77b1b65b9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:37.409512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70758125-3d4c-4539-9571-c8b77b1b65b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:37.428933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-70758125-3d4c-4539-9571-c8b77b1b65b9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:37.430578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-70758125-3d4c-4539-9571-c8b77b1b65b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:37.498303 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3630/7348] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:37.504253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7431a2-b18c-47e4-862f-063bcbad9497 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:37.505447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7431a2-b18c-47e4-862f-063bcbad9497 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:37.505904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7431a2-b18c-47e4-862f-063bcbad9497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:37.530278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fe7431a2-b18c-47e4-862f-063bcbad9497 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:37.531499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fe7431a2-b18c-47e4-862f-063bcbad9497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:37.541405 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3719/7349] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:37.545617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70758125-3d4c-4539-9571-c8b77b1b65b9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:37.559478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70758125-3d4c-4539-9571-c8b77b1b65b9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:37.565029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95248ed8-5fcc-438a-a1ea-d036e8bb41c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:37.565740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95248ed8-5fcc-438a-a1ea-d036e8bb41c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:37.566045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95248ed8-5fcc-438a-a1ea-d036e8bb41c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:37.570612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95248ed8-5fcc-438a-a1ea-d036e8bb41c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:37.572052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95248ed8-5fcc-438a-a1ea-d036e8bb41c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:13:37.572625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95248ed8-5fcc-438a-a1ea-d036e8bb41c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:37.575153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95248ed8-5fcc-438a-a1ea-d036e8bb41c6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:37.593786 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3631/7350] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:13:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:37.598475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7431a2-b18c-47e4-862f-063bcbad9497 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:37.609676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7431a2-b18c-47e4-862f-063bcbad9497 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:37.614869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a594e-0117-44cf-ba1f-21a2e040a8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:37.616417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a594e-0117-44cf-ba1f-21a2e040a8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:37.616713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a594e-0117-44cf-ba1f-21a2e040a8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:37.616986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a594e-0117-44cf-ba1f-21a2e040a8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:37.617838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a594e-0117-44cf-ba1f-21a2e040a8d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:37.619774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a594e-0117-44cf-ba1f-21a2e040a8d1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:37.648032 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3720/7351] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:37 2021] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:37.651903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95248ed8-5fcc-438a-a1ea-d036e8bb41c6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:37.662539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95248ed8-5fcc-438a-a1ea-d036e8bb41c6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:37.766975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d564c-69ff-4ba1-9f1a-5c1db250f25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:37.768010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d564c-69ff-4ba1-9f1a-5c1db250f25c admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:37.768426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d564c-69ff-4ba1-9f1a-5c1db250f25c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:37.768708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d564c-69ff-4ba1-9f1a-5c1db250f25c admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:37.769446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d564c-69ff-4ba1-9f1a-5c1db250f25c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:37.771589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d564c-69ff-4ba1-9f1a-5c1db250f25c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:37.796774 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3632/7352] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:13:37 2021] POST /identity/v3/users => generated 282 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:37.800483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a594e-0117-44cf-ba1f-21a2e040a8d1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:37.811830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a594e-0117-44cf-ba1f-21a2e040a8d1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:37.829539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342a4cc-4779-41f6-9eb0-c56a9207f638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:37.830243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342a4cc-4779-41f6-9eb0-c56a9207f638 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:37.830550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342a4cc-4779-41f6-9eb0-c56a9207f638 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:37.831013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342a4cc-4779-41f6-9eb0-c56a9207f638 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:37.837402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342a4cc-4779-41f6-9eb0-c56a9207f638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:37.839111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342a4cc-4779-41f6-9eb0-c56a9207f638 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:37.850761 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3721/7353] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:37 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:37.854590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d564c-69ff-4ba1-9f1a-5c1db250f25c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:37.871865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d564c-69ff-4ba1-9f1a-5c1db250f25c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:37.876735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363259c-cf7f-4733-ac3a-3305b189e3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:37.877433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363259c-cf7f-4733-ac3a-3305b189e3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:37.877718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363259c-cf7f-4733-ac3a-3305b189e3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:37.877995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363259c-cf7f-4733-ac3a-3305b189e3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:37.878768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363259c-cf7f-4733-ac3a-3305b189e3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:37.880348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363259c-cf7f-4733-ac3a-3305b189e3d7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:37.891643 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3633/7354] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:37 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:37.895129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342a4cc-4779-41f6-9eb0-c56a9207f638 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:37.906551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342a4cc-4779-41f6-9eb0-c56a9207f638 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:37.911545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7310518-b90d-45fa-93fb-339522fb7364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:37.912450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7310518-b90d-45fa-93fb-339522fb7364 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:37.913291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7310518-b90d-45fa-93fb-339522fb7364 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:37.913580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7310518-b90d-45fa-93fb-339522fb7364 admin admin] PATH_INFO: `/v3/projects/ecc85595078e4984a6ed0010a779f316/users/8890f0e87e4b45a4a5618da7302bc8fd/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:37.928635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7310518-b90d-45fa-93fb-339522fb7364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc85595078e4984a6ed0010a779f316, user_id=8890f0e87e4b45a4a5618da7302bc8fd, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:37.931323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7310518-b90d-45fa-93fb-339522fb7364 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:37.950704 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3722/7355] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:37 2021] PUT /identity/v3/projects/ecc85595078e4984a6ed0010a779f316/users/8890f0e87e4b45a4a5618da7302bc8fd/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:37.962169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c65f3-7076-49db-b4d5-cf49d46e7e79 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:37.963774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c65f3-7076-49db-b4d5-cf49d46e7e79 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:37.964097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c65f3-7076-49db-b4d5-cf49d46e7e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:37.995805 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-320c65f3-7076-49db-b4d5-cf49d46e7e79 None None] MFA Rules not processed for user `8890f0e87e4b45a4a5618da7302bc8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:38.000070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-320c65f3-7076-49db-b4d5-cf49d46e7e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:38.068340 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3634/7356] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:37 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:38.081495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7310518-b90d-45fa-93fb-339522fb7364 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:38.083976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a7310518-b90d-45fa-93fb-339522fb7364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:38.177420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7310518-b90d-45fa-93fb-339522fb7364 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:38.181482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb7f02-a36c-4a14-9371-d3ba1b66b12c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:38.182171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb7f02-a36c-4a14-9371-d3ba1b66b12c service glance] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:38.182520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb7f02-a36c-4a14-9371-d3ba1b66b12c service glance] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:38.182797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb7f02-a36c-4a14-9371-d3ba1b66b12c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:38.204363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb7f02-a36c-4a14-9371-d3ba1b66b12c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:38.208607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb7f02-a36c-4a14-9371-d3ba1b66b12c service glance] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:38.223743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c65f3-7076-49db-b4d5-cf49d46e7e79 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:38.225253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-320c65f3-7076-49db-b4d5-cf49d46e7e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:38.226222 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3723/7357] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:38 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:13:38.414641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c65f3-7076-49db-b4d5-cf49d46e7e79 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:38.420893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d233040-8d7e-4599-aefe-ea1e0fcb0617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:38.421698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233040-8d7e-4599-aefe-ea1e0fcb0617 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:38.422100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233040-8d7e-4599-aefe-ea1e0fcb0617 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:38.422486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233040-8d7e-4599-aefe-ea1e0fcb0617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:38.424488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3d233040-8d7e-4599-aefe-ea1e0fcb0617 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:38.507975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d233040-8d7e-4599-aefe-ea1e0fcb0617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:38.511101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d233040-8d7e-4599-aefe-ea1e0fcb0617 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:38.538168 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3635/7358] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:38 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:13:38.670815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb7f02-a36c-4a14-9371-d3ba1b66b12c service glance] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:38.813481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb7f02-a36c-4a14-9371-d3ba1b66b12c service glance] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:38.818882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d6569-fe09-4367-adf4-a0ff4b21fa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:38.819824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d6569-fe09-4367-adf4-a0ff4b21fa37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:38.820115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d6569-fe09-4367-adf4-a0ff4b21fa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:38.820453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d6569-fe09-4367-adf4-a0ff4b21fa37 admin admin] PATH_INFO: `/v3/users/8890f0e87e4b45a4a5618da7302bc8fd` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:38.822272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d6569-fe09-4367-adf4-a0ff4b21fa37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8890f0e87e4b45a4a5618da7302bc8fd)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:38.824482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d6569-fe09-4367-adf4-a0ff4b21fa37 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:38.891901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-758d6569-fe09-4367-adf4-a0ff4b21fa37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8890f0e87e4b45a4a5618da7302bc8fd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:38.899885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-758d6569-fe09-4367-adf4-a0ff4b21fa37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8890f0e87e4b45a4a5618da7302bc8fd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:38.900667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-758d6569-fe09-4367-adf4-a0ff4b21fa37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8890f0e87e4b45a4a5618da7302bc8fd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:38.918723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-758d6569-fe09-4367-adf4-a0ff4b21fa37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8890f0e87e4b45a4a5618da7302bc8fd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:38.928928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-758d6569-fe09-4367-adf4-a0ff4b21fa37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8890f0e87e4b45a4a5618da7302bc8fd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:38.935623 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3724/7359] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:13:38 2021] DELETE /identity/v3/users/8890f0e87e4b45a4a5618da7302bc8fd => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:38.940324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf336a-9289-42e7-acbf-46baa45683d2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:38.940614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf336a-9289-42e7-acbf-46baa45683d2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:38.940894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf336a-9289-42e7-acbf-46baa45683d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:38.958530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e0bf336a-9289-42e7-acbf-46baa45683d2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:38.959779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e0bf336a-9289-42e7-acbf-46baa45683d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:39.041641 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3636/7360] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:39.063384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d6569-fe09-4367-adf4-a0ff4b21fa37 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:39.064913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-758d6569-fe09-4367-adf4-a0ff4b21fa37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:39.157291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d6569-fe09-4367-adf4-a0ff4b21fa37 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:39.161532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c844cdd-3422-4c7f-8a17-cf6d8f64281e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:39.162314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c844cdd-3422-4c7f-8a17-cf6d8f64281e service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:39.163208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c844cdd-3422-4c7f-8a17-cf6d8f64281e service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:39.163496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c844cdd-3422-4c7f-8a17-cf6d8f64281e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:39.177355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c844cdd-3422-4c7f-8a17-cf6d8f64281e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:39.179390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c844cdd-3422-4c7f-8a17-cf6d8f64281e service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:39.192824 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3725/7361] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:13:39.633532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf336a-9289-42e7-acbf-46baa45683d2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:39.635145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e0bf336a-9289-42e7-acbf-46baa45683d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:39.658141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf336a-9289-42e7-acbf-46baa45683d2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:39.663349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95f642-64bd-430e-b2cf-2189bc8c6e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:39.664202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95f642-64bd-430e-b2cf-2189bc8c6e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:39.664480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95f642-64bd-430e-b2cf-2189bc8c6e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:39.664758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95f642-64bd-430e-b2cf-2189bc8c6e70 admin admin] PATH_INFO: `/v3/projects/ecc85595078e4984a6ed0010a779f316` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:39.666157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95f642-64bd-430e-b2cf-2189bc8c6e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc85595078e4984a6ed0010a779f316)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:39.668068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95f642-64bd-430e-b2cf-2189bc8c6e70 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:39.724065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7e95f642-64bd-430e-b2cf-2189bc8c6e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc85595078e4984a6ed0010a779f316', 'request_id': 'req-7e95f642-64bd-430e-b2cf-2189bc8c6e70'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:39.730279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7e95f642-64bd-430e-b2cf-2189bc8c6e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc85595078e4984a6ed0010a779f316', 'request_id': 'req-7e95f642-64bd-430e-b2cf-2189bc8c6e70'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:39.735818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7e95f642-64bd-430e-b2cf-2189bc8c6e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc85595078e4984a6ed0010a779f316', 'request_id': 'req-7e95f642-64bd-430e-b2cf-2189bc8c6e70'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:39.749600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7e95f642-64bd-430e-b2cf-2189bc8c6e70 admin admin] The token cache is being invalidate because project ecc85595078e4984a6ed0010a779f316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:39.749911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7e95f642-64bd-430e-b2cf-2189bc8c6e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:39.750595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7e95f642-64bd-430e-b2cf-2189bc8c6e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:39.752352 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3637/7362] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:39 2021] DELETE /identity/v3/projects/ecc85595078e4984a6ed0010a779f316 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:39.758334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e680e9-8dd7-4ce7-b07e-a85079160850 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:39.758831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e680e9-8dd7-4ce7-b07e-a85079160850 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:39.758935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e680e9-8dd7-4ce7-b07e-a85079160850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:39.778793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c8e680e9-8dd7-4ce7-b07e-a85079160850 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:39.779993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c8e680e9-8dd7-4ce7-b07e-a85079160850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:39.839493 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3726/7363] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:13:39.847441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12a817-c568-4ba4-bcb1-4bd5538c4fef None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:39.847738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12a817-c568-4ba4-bcb1-4bd5538c4fef None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:39.848025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12a817-c568-4ba4-bcb1-4bd5538c4fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:39.866430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1c12a817-c568-4ba4-bcb1-4bd5538c4fef None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:39.867630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1c12a817-c568-4ba4-bcb1-4bd5538c4fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:39.875877 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3638/7364] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:39.880109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e680e9-8dd7-4ce7-b07e-a85079160850 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:39.890479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e680e9-8dd7-4ce7-b07e-a85079160850 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:39.895234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63dd5f-7c37-4fe3-b8b2-5672f3074ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:39.895830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63dd5f-7c37-4fe3-b8b2-5672f3074ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:39.896119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63dd5f-7c37-4fe3-b8b2-5672f3074ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:39.896402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63dd5f-7c37-4fe3-b8b2-5672f3074ed9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:39.897774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63dd5f-7c37-4fe3-b8b2-5672f3074ed9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:13:39.898091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63dd5f-7c37-4fe3-b8b2-5672f3074ed9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:39.899724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63dd5f-7c37-4fe3-b8b2-5672f3074ed9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:39.911691 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3727/7365] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:13:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:39.915817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12a817-c568-4ba4-bcb1-4bd5538c4fef None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:39.925201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12a817-c568-4ba4-bcb1-4bd5538c4fef None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:39.930593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5654ff-9d2f-48d3-bb00-5a6b843ff3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:39.931246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5654ff-9d2f-48d3-bb00-5a6b843ff3df admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:39.931532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5654ff-9d2f-48d3-bb00-5a6b843ff3df admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:39.931833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5654ff-9d2f-48d3-bb00-5a6b843ff3df admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:39.932629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5654ff-9d2f-48d3-bb00-5a6b843ff3df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:39.934562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5654ff-9d2f-48d3-bb00-5a6b843ff3df admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:39.960691 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3639/7366] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:39 2021] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:39.964908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63dd5f-7c37-4fe3-b8b2-5672f3074ed9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:39.974969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63dd5f-7c37-4fe3-b8b2-5672f3074ed9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:40.030457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080b558-e753-4946-a3aa-49178f9f3a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:40.031131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080b558-e753-4946-a3aa-49178f9f3a3a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:40.031421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080b558-e753-4946-a3aa-49178f9f3a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:40.031844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080b558-e753-4946-a3aa-49178f9f3a3a admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:40.032548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080b558-e753-4946-a3aa-49178f9f3a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:40.034656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080b558-e753-4946-a3aa-49178f9f3a3a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:40.059011 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3728/7367] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:13:39 2021] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:40.060460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5654ff-9d2f-48d3-bb00-5a6b843ff3df admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:40.071887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5654ff-9d2f-48d3-bb00-5a6b843ff3df admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:40.076719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf10b69-2e8d-4985-b898-1e0a476a8369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:40.077376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf10b69-2e8d-4985-b898-1e0a476a8369 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:40.077664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf10b69-2e8d-4985-b898-1e0a476a8369 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:40.077988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf10b69-2e8d-4985-b898-1e0a476a8369 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:40.079090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf10b69-2e8d-4985-b898-1e0a476a8369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:40.080904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf10b69-2e8d-4985-b898-1e0a476a8369 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:40.091395 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3640/7368] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:40 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:40.096031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080b558-e753-4946-a3aa-49178f9f3a3a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:40.106056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080b558-e753-4946-a3aa-49178f9f3a3a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:40.110681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48389a9f-e267-4724-9ac9-7e763e11e499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:40.112441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389a9f-e267-4724-9ac9-7e763e11e499 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:40.112441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389a9f-e267-4724-9ac9-7e763e11e499 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:40.112441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389a9f-e267-4724-9ac9-7e763e11e499 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:40.112756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48389a9f-e267-4724-9ac9-7e763e11e499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:40.114136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48389a9f-e267-4724-9ac9-7e763e11e499 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:40.128603 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3729/7369] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:13:40.131045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf10b69-2e8d-4985-b898-1e0a476a8369 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:40.143444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf10b69-2e8d-4985-b898-1e0a476a8369 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:40.148381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38523a-338f-4bf4-b4a4-212ec304ec44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:40.149235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38523a-338f-4bf4-b4a4-212ec304ec44 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:40.149520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38523a-338f-4bf4-b4a4-212ec304ec44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:40.149801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38523a-338f-4bf4-b4a4-212ec304ec44 admin admin] PATH_INFO: `/v3/projects/700ce5a5fa1b4e66898ed285c0cf3b6b/users/1407dad169b141df89279d4356cf30e5/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:40.165772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38523a-338f-4bf4-b4a4-212ec304ec44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=700ce5a5fa1b4e66898ed285c0cf3b6b, user_id=1407dad169b141df89279d4356cf30e5, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:40.168061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38523a-338f-4bf4-b4a4-212ec304ec44 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:40.185642 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3641/7370] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:40 2021] PUT /identity/v3/projects/700ce5a5fa1b4e66898ed285c0cf3b6b/users/1407dad169b141df89279d4356cf30e5/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:13:40.196846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6ed19-896c-440c-85a1-00b74bea10cb None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:40.197238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6ed19-896c-440c-85a1-00b74bea10cb None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:40.197590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6ed19-896c-440c-85a1-00b74bea10cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:40.224465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e2e6ed19-896c-440c-85a1-00b74bea10cb None None] MFA Rules not processed for user `1407dad169b141df89279d4356cf30e5`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:40.226825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e2e6ed19-896c-440c-85a1-00b74bea10cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:40.298290 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3730/7371] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:40 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:40.302587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38523a-338f-4bf4-b4a4-212ec304ec44 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:40.372924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38523a-338f-4bf4-b4a4-212ec304ec44 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:40.379214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb873a4-ae47-4cbf-a03f-0ee7560bb8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:40.380024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb873a4-ae47-4cbf-a03f-0ee7560bb8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:40.380169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb873a4-ae47-4cbf-a03f-0ee7560bb8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:40.380498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb873a4-ae47-4cbf-a03f-0ee7560bb8a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:40.381389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb873a4-ae47-4cbf-a03f-0ee7560bb8a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:40.383336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb873a4-ae47-4cbf-a03f-0ee7560bb8a0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:40.437038 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3642/7372] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:40 2021] POST /identity/v3/projects => generated 397 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:40.439363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6ed19-896c-440c-85a1-00b74bea10cb None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:40.458505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6ed19-896c-440c-85a1-00b74bea10cb None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:40.622978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac32c5-9bd6-4480-a202-a5d80554f805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:40.623767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac32c5-9bd6-4480-a202-a5d80554f805 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:40.623978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac32c5-9bd6-4480-a202-a5d80554f805 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:40.624256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac32c5-9bd6-4480-a202-a5d80554f805 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:40.624977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac32c5-9bd6-4480-a202-a5d80554f805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:40.627117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac32c5-9bd6-4480-a202-a5d80554f805 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:40.650821 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3731/7373] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:13:40 2021] POST /identity/v3/users => generated 305 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:40.651973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb873a4-ae47-4cbf-a03f-0ee7560bb8a0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:40.665101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb873a4-ae47-4cbf-a03f-0ee7560bb8a0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:40.670145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56dc4c5-9163-4876-95ff-57fada61bf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:40.670845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56dc4c5-9163-4876-95ff-57fada61bf46 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:40.671134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56dc4c5-9163-4876-95ff-57fada61bf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:40.671525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56dc4c5-9163-4876-95ff-57fada61bf46 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:40.672131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56dc4c5-9163-4876-95ff-57fada61bf46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:40.673696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56dc4c5-9163-4876-95ff-57fada61bf46 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:40.685799 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3643/7374] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:40 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:13:40.689822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac32c5-9bd6-4480-a202-a5d80554f805 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:40.700203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac32c5-9bd6-4480-a202-a5d80554f805 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:40.705251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7161475-cac4-4824-b71d-e76fc61d4e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:40.706142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7161475-cac4-4824-b71d-e76fc61d4e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:40.706473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7161475-cac4-4824-b71d-e76fc61d4e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:40.706774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7161475-cac4-4824-b71d-e76fc61d4e70 admin admin] PATH_INFO: `/v3/projects/b4922673b3964dfb81e5f4c5433ebc9a/users/f6a03479afc44702b7f983206fb2af06/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:40.722382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7161475-cac4-4824-b71d-e76fc61d4e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4922673b3964dfb81e5f4c5433ebc9a, user_id=f6a03479afc44702b7f983206fb2af06, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:40.725656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7161475-cac4-4824-b71d-e76fc61d4e70 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:40.739883 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3732/7375] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:40 2021] PUT /identity/v3/projects/b4922673b3964dfb81e5f4c5433ebc9a/users/f6a03479afc44702b7f983206fb2af06/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:13:40.744152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56dc4c5-9163-4876-95ff-57fada61bf46 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:40.757255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56dc4c5-9163-4876-95ff-57fada61bf46 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:40.821342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc34eb4-f2c2-479b-8113-8a38e96af124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:40.822006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34eb4-f2c2-479b-8113-8a38e96af124 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:40.822323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34eb4-f2c2-479b-8113-8a38e96af124 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:40.822601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34eb4-f2c2-479b-8113-8a38e96af124 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:40.823321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc34eb4-f2c2-479b-8113-8a38e96af124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:40.824935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc34eb4-f2c2-479b-8113-8a38e96af124 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:40.838352 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3644/7376] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:40 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:40.839493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7161475-cac4-4824-b71d-e76fc61d4e70 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:40.849485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7161475-cac4-4824-b71d-e76fc61d4e70 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:40.854666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beefd17-b65c-4364-8185-dc65b0730b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:40.855540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beefd17-b65c-4364-8185-dc65b0730b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:40.855821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beefd17-b65c-4364-8185-dc65b0730b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:40.856096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beefd17-b65c-4364-8185-dc65b0730b6c admin admin] PATH_INFO: `/v3/projects/b4922673b3964dfb81e5f4c5433ebc9a/users/f6a03479afc44702b7f983206fb2af06/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:40.858060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beefd17-b65c-4364-8185-dc65b0730b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4922673b3964dfb81e5f4c5433ebc9a, user_id=f6a03479afc44702b7f983206fb2af06, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:40.860700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beefd17-b65c-4364-8185-dc65b0730b6c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:40.871077 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3733/7377] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:40 2021] PUT /identity/v3/projects/b4922673b3964dfb81e5f4c5433ebc9a/users/f6a03479afc44702b7f983206fb2af06/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:13:40.882295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9966878-cff0-4c84-98cb-69f032b6ec49 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:40.882618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9966878-cff0-4c84-98cb-69f032b6ec49 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:40.882850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9966878-cff0-4c84-98cb-69f032b6ec49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:40.911527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e9966878-cff0-4c84-98cb-69f032b6ec49 None None] MFA Rules not processed for user `f6a03479afc44702b7f983206fb2af06`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:40.913304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e9966878-cff0-4c84-98cb-69f032b6ec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:40.985389 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3645/7378] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:40 2021] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:40.995965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beefd17-b65c-4364-8185-dc65b0730b6c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:40.997659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3beefd17-b65c-4364-8185-dc65b0730b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:41.063657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beefd17-b65c-4364-8185-dc65b0730b6c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:41.067928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e986cd-569f-46b2-acd1-a75f6c59af61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:41.068632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e986cd-569f-46b2-acd1-a75f6c59af61 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:41.069461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e986cd-569f-46b2-acd1-a75f6c59af61 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:41.069737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e986cd-569f-46b2-acd1-a75f6c59af61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:41.135513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e986cd-569f-46b2-acd1-a75f6c59af61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:41.137282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e986cd-569f-46b2-acd1-a75f6c59af61 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:41.148502 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3734/7379] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:40 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:13:41.543615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9966878-cff0-4c84-98cb-69f032b6ec49 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:41.544611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e9966878-cff0-4c84-98cb-69f032b6ec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:41.684490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9966878-cff0-4c84-98cb-69f032b6ec49 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:41.692943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c519d-5aac-4e21-8fe6-596ba5ead72f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:41.694603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c519d-5aac-4e21-8fe6-596ba5ead72f service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:41.694919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c519d-5aac-4e21-8fe6-596ba5ead72f service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:41.695206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c519d-5aac-4e21-8fe6-596ba5ead72f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:41.706122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c519d-5aac-4e21-8fe6-596ba5ead72f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:41.708635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c519d-5aac-4e21-8fe6-596ba5ead72f service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:41.721896 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3646/7380] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:41 2021] GET /identity/v3/auth/tokens => generated 3331 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:13:47.233671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e986cd-569f-46b2-acd1-a75f6c59af61 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:47.293813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e986cd-569f-46b2-acd1-a75f6c59af61 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:47.298856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c5e8e-93cd-457a-852e-f97a2bc212e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:47.299679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c5e8e-93cd-457a-852e-f97a2bc212e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:47.299971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c5e8e-93cd-457a-852e-f97a2bc212e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:47.300233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c5e8e-93cd-457a-852e-f97a2bc212e2 admin admin] PATH_INFO: `/v3/users/1407dad169b141df89279d4356cf30e5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:47.301417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c5e8e-93cd-457a-852e-f97a2bc212e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1407dad169b141df89279d4356cf30e5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:47.303354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c5e8e-93cd-457a-852e-f97a2bc212e2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:47.349284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c71c5e8e-93cd-457a-852e-f97a2bc212e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1407dad169b141df89279d4356cf30e5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:47.355970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c71c5e8e-93cd-457a-852e-f97a2bc212e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1407dad169b141df89279d4356cf30e5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:47.356636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c71c5e8e-93cd-457a-852e-f97a2bc212e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1407dad169b141df89279d4356cf30e5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:47.367917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c71c5e8e-93cd-457a-852e-f97a2bc212e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1407dad169b141df89279d4356cf30e5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:47.375248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c71c5e8e-93cd-457a-852e-f97a2bc212e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1407dad169b141df89279d4356cf30e5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:47.381605 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3735/7381] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:13:47 2021] DELETE /identity/v3/users/1407dad169b141df89279d4356cf30e5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:47.386099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b48cd-4689-4cdd-980f-869640c25336 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:47.386659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b48cd-4689-4cdd-980f-869640c25336 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:47.386767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b48cd-4689-4cdd-980f-869640c25336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:47.403981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-867b48cd-4689-4cdd-980f-869640c25336 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:47.405163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-867b48cd-4689-4cdd-980f-869640c25336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:47.461050 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3647/7382] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:47.470843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c5e8e-93cd-457a-852e-f97a2bc212e2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:47.472205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c71c5e8e-93cd-457a-852e-f97a2bc212e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:47.535736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c5e8e-93cd-457a-852e-f97a2bc212e2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:47.539440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f63ff-7f72-4190-8ce5-0982368b7ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:47.540076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f63ff-7f72-4190-8ce5-0982368b7ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:47.540361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f63ff-7f72-4190-8ce5-0982368b7ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:47.540670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f63ff-7f72-4190-8ce5-0982368b7ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:47.550221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f63ff-7f72-4190-8ce5-0982368b7ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:47.551642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f63ff-7f72-4190-8ce5-0982368b7ce9 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:47.561669 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3736/7383] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:13:47.730127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b48cd-4689-4cdd-980f-869640c25336 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:47.731444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-867b48cd-4689-4cdd-980f-869640c25336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:47.743656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b48cd-4689-4cdd-980f-869640c25336 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:47.748327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e45a7-5a80-4e39-b152-41516df43a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:47.749187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e45a7-5a80-4e39-b152-41516df43a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:47.749495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e45a7-5a80-4e39-b152-41516df43a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:47.749969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e45a7-5a80-4e39-b152-41516df43a79 admin admin] PATH_INFO: `/v3/projects/700ce5a5fa1b4e66898ed285c0cf3b6b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:47.751213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e45a7-5a80-4e39-b152-41516df43a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=700ce5a5fa1b4e66898ed285c0cf3b6b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:47.753094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e45a7-5a80-4e39-b152-41516df43a79 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:47.800945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f97e45a7-5a80-4e39-b152-41516df43a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '700ce5a5fa1b4e66898ed285c0cf3b6b', 'request_id': 'req-f97e45a7-5a80-4e39-b152-41516df43a79'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:47.807420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f97e45a7-5a80-4e39-b152-41516df43a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '700ce5a5fa1b4e66898ed285c0cf3b6b', 'request_id': 'req-f97e45a7-5a80-4e39-b152-41516df43a79'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:47.812980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f97e45a7-5a80-4e39-b152-41516df43a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '700ce5a5fa1b4e66898ed285c0cf3b6b', 'request_id': 'req-f97e45a7-5a80-4e39-b152-41516df43a79'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:47.830090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f97e45a7-5a80-4e39-b152-41516df43a79 admin admin] The token cache is being invalidate because project 700ce5a5fa1b4e66898ed285c0cf3b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:47.830433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f97e45a7-5a80-4e39-b152-41516df43a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:47.831251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f97e45a7-5a80-4e39-b152-41516df43a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:47.833924 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3648/7384] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:47 2021] DELETE /identity/v3/projects/700ce5a5fa1b4e66898ed285c0cf3b6b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:47.838459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f63ff-7f72-4190-8ce5-0982368b7ce9 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:47.848625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f63ff-7f72-4190-8ce5-0982368b7ce9 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:47.905543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eceeb41-d365-4547-887f-90c06f4f6f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:47.906450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceeb41-d365-4547-887f-90c06f4f6f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:47.906740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceeb41-d365-4547-887f-90c06f4f6f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:47.907016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceeb41-d365-4547-887f-90c06f4f6f6e admin admin] PATH_INFO: `/v3/users/f6a03479afc44702b7f983206fb2af06` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:47.908286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eceeb41-d365-4547-887f-90c06f4f6f6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6a03479afc44702b7f983206fb2af06)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:47.910371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eceeb41-d365-4547-887f-90c06f4f6f6e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:47.956465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6eceeb41-d365-4547-887f-90c06f4f6f6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6a03479afc44702b7f983206fb2af06'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:47.963469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6eceeb41-d365-4547-887f-90c06f4f6f6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6a03479afc44702b7f983206fb2af06'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:47.964135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6eceeb41-d365-4547-887f-90c06f4f6f6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6a03479afc44702b7f983206fb2af06'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:47.976228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6eceeb41-d365-4547-887f-90c06f4f6f6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6a03479afc44702b7f983206fb2af06'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:47.982940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6eceeb41-d365-4547-887f-90c06f4f6f6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6a03479afc44702b7f983206fb2af06'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:47.988842 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3737/7385] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:13:47 2021] DELETE /identity/v3/users/f6a03479afc44702b7f983206fb2af06 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:13:48.174392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e45a7-5a80-4e39-b152-41516df43a79 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:48.175794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f97e45a7-5a80-4e39-b152-41516df43a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:48.191005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e45a7-5a80-4e39-b152-41516df43a79 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:48.250905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080f852-5557-4613-9cc0-9ba8309003be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:48.251762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080f852-5557-4613-9cc0-9ba8309003be admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:48.252048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080f852-5557-4613-9cc0-9ba8309003be admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:48.252321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080f852-5557-4613-9cc0-9ba8309003be admin admin] PATH_INFO: `/v3/projects/b4922673b3964dfb81e5f4c5433ebc9a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:48.253567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080f852-5557-4613-9cc0-9ba8309003be admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4922673b3964dfb81e5f4c5433ebc9a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:48.255796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080f852-5557-4613-9cc0-9ba8309003be admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:48.301573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c080f852-5557-4613-9cc0-9ba8309003be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4922673b3964dfb81e5f4c5433ebc9a', 'request_id': 'req-c080f852-5557-4613-9cc0-9ba8309003be'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:48.308630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c080f852-5557-4613-9cc0-9ba8309003be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4922673b3964dfb81e5f4c5433ebc9a', 'request_id': 'req-c080f852-5557-4613-9cc0-9ba8309003be'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:48.314135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c080f852-5557-4613-9cc0-9ba8309003be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4922673b3964dfb81e5f4c5433ebc9a', 'request_id': 'req-c080f852-5557-4613-9cc0-9ba8309003be'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:48.327316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c080f852-5557-4613-9cc0-9ba8309003be admin admin] The token cache is being invalidate because project b4922673b3964dfb81e5f4c5433ebc9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:13:48.327601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c080f852-5557-4613-9cc0-9ba8309003be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:48.328229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c080f852-5557-4613-9cc0-9ba8309003be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:13:48.329756 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3649/7386] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:13:48 2021] DELETE /identity/v3/projects/b4922673b3964dfb81e5f4c5433ebc9a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:48.335540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb81201-a8d1-4dd5-b32c-202c64812eb5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:48.336050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb81201-a8d1-4dd5-b32c-202c64812eb5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:48.336161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb81201-a8d1-4dd5-b32c-202c64812eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:48.353992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7fb81201-a8d1-4dd5-b32c-202c64812eb5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:48.355235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7fb81201-a8d1-4dd5-b32c-202c64812eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:48.416232 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3738/7387] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:48.424116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0140e-40fc-4cbe-8c80-020c938da95c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:48.424614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0140e-40fc-4cbe-8c80-020c938da95c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:48.424720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0140e-40fc-4cbe-8c80-020c938da95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:48.446386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d5d0140e-40fc-4cbe-8c80-020c938da95c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:48.447943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d5d0140e-40fc-4cbe-8c80-020c938da95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:48.456127 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3650/7388] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:48.461368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb81201-a8d1-4dd5-b32c-202c64812eb5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:48.472339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb81201-a8d1-4dd5-b32c-202c64812eb5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:48.477708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4267d-0560-44f5-a865-440b67c4018f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:48.478391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4267d-0560-44f5-a865-440b67c4018f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:48.478673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4267d-0560-44f5-a865-440b67c4018f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:48.478947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4267d-0560-44f5-a865-440b67c4018f admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:48.479673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4267d-0560-44f5-a865-440b67c4018f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:13:48.479976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4267d-0560-44f5-a865-440b67c4018f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:48.481873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4267d-0560-44f5-a865-440b67c4018f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:48.498220 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3739/7389] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:13:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:13:48.499558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0140e-40fc-4cbe-8c80-020c938da95c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:48.509273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0140e-40fc-4cbe-8c80-020c938da95c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:48.513883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd7c1a-7973-415f-b744-53403a508857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:48.514554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd7c1a-7973-415f-b744-53403a508857 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:48.514835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd7c1a-7973-415f-b744-53403a508857 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:48.515110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd7c1a-7973-415f-b744-53403a508857 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:48.515836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd7c1a-7973-415f-b744-53403a508857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:48.517700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd7c1a-7973-415f-b744-53403a508857 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:48.543071 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3651/7390] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:13:48 2021] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:13:48.547365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4267d-0560-44f5-a865-440b67c4018f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:48.557247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4267d-0560-44f5-a865-440b67c4018f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:48.613573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ceed4b-00d1-4f17-b984-535fd0d0f81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:48.614230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceed4b-00d1-4f17-b984-535fd0d0f81b admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:48.614548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceed4b-00d1-4f17-b984-535fd0d0f81b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:48.614825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceed4b-00d1-4f17-b984-535fd0d0f81b admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:48.615517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ceed4b-00d1-4f17-b984-535fd0d0f81b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:48.617442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ceed4b-00d1-4f17-b984-535fd0d0f81b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:48.636943 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3740/7391] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:13:48 2021] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:13:48.641065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd7c1a-7973-415f-b744-53403a508857 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:48.651865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd7c1a-7973-415f-b744-53403a508857 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:48.656491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7870de8-8deb-449c-9310-099b666af261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:48.657207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7870de8-8deb-449c-9310-099b666af261 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:48.657609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7870de8-8deb-449c-9310-099b666af261 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:48.657895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7870de8-8deb-449c-9310-099b666af261 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:48.658680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7870de8-8deb-449c-9310-099b666af261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:48.660316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7870de8-8deb-449c-9310-099b666af261 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:48.671542 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3652/7392] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:48.675560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ceed4b-00d1-4f17-b984-535fd0d0f81b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:48.685360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ceed4b-00d1-4f17-b984-535fd0d0f81b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:48.689994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae0eb7-23d5-4926-9496-b5471042611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:48.690675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae0eb7-23d5-4926-9496-b5471042611f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:48.690961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae0eb7-23d5-4926-9496-b5471042611f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:48.691239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae0eb7-23d5-4926-9496-b5471042611f admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:48.692223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae0eb7-23d5-4926-9496-b5471042611f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:48.693816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae0eb7-23d5-4926-9496-b5471042611f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:48.704002 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3741/7393] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:13:48 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:13:48.708123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7870de8-8deb-449c-9310-099b666af261 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:48.718959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7870de8-8deb-449c-9310-099b666af261 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:48.723819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1db570-bcac-4af6-9d1b-5604cc5a8fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:48.724721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1db570-bcac-4af6-9d1b-5604cc5a8fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:48.725010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1db570-bcac-4af6-9d1b-5604cc5a8fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:48.725371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1db570-bcac-4af6-9d1b-5604cc5a8fbb admin admin] PATH_INFO: `/v3/projects/ad0c7ce501d44ae091188abfb003a2de/users/eabbc70481e1450a9e2727689fb589dd/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:48.741927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1db570-bcac-4af6-9d1b-5604cc5a8fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0c7ce501d44ae091188abfb003a2de, user_id=eabbc70481e1450a9e2727689fb589dd, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:48.744567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1db570-bcac-4af6-9d1b-5604cc5a8fbb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:48.759148 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3653/7394] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:13:48 2021] PUT /identity/v3/projects/ad0c7ce501d44ae091188abfb003a2de/users/eabbc70481e1450a9e2727689fb589dd/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:13:48.769456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0baf37-0d10-4e07-bb9a-73450db4fd4a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:48.769831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0baf37-0d10-4e07-bb9a-73450db4fd4a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:48.770125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0baf37-0d10-4e07-bb9a-73450db4fd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:48.796852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4f0baf37-0d10-4e07-bb9a-73450db4fd4a None None] MFA Rules not processed for user `eabbc70481e1450a9e2727689fb589dd`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:13:48.798124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4f0baf37-0d10-4e07-bb9a-73450db4fd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:48.859285 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3742/7395] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:13:48 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:13:48.870029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1db570-bcac-4af6-9d1b-5604cc5a8fbb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:13:48.871676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ba1db570-bcac-4af6-9d1b-5604cc5a8fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:13:48.928023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1db570-bcac-4af6-9d1b-5604cc5a8fbb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:13:48.932157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721bd05-ffd4-4ab0-9035-befe8f385879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:13:48.932820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721bd05-ffd4-4ab0-9035-befe8f385879 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:13:48.933120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721bd05-ffd4-4ab0-9035-befe8f385879 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:13:48.933383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721bd05-ffd4-4ab0-9035-befe8f385879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:13:48.941954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721bd05-ffd4-4ab0-9035-befe8f385879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:13:48.943423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721bd05-ffd4-4ab0-9035-befe8f385879 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:13:48.952523 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3654/7396] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:13:48 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:14:12.970426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0baf37-0d10-4e07-bb9a-73450db4fd4a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:14:13.031613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0baf37-0d10-4e07-bb9a-73450db4fd4a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:14:13.036294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d911f4-5d9e-449a-84e4-9045a4ea0517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:14:13.037129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d911f4-5d9e-449a-84e4-9045a4ea0517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:13.037412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d911f4-5d9e-449a-84e4-9045a4ea0517 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:13.037690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d911f4-5d9e-449a-84e4-9045a4ea0517 admin admin] PATH_INFO: `/v3/users/eabbc70481e1450a9e2727689fb589dd` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:13.038894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d911f4-5d9e-449a-84e4-9045a4ea0517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eabbc70481e1450a9e2727689fb589dd)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:14:13.040799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d911f4-5d9e-449a-84e4-9045a4ea0517 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:14:13.084542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-73d911f4-5d9e-449a-84e4-9045a4ea0517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eabbc70481e1450a9e2727689fb589dd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:14:13.091144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-73d911f4-5d9e-449a-84e4-9045a4ea0517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eabbc70481e1450a9e2727689fb589dd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:14:13.091780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-73d911f4-5d9e-449a-84e4-9045a4ea0517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eabbc70481e1450a9e2727689fb589dd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:14:13.102954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-73d911f4-5d9e-449a-84e4-9045a4ea0517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eabbc70481e1450a9e2727689fb589dd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:14:13.109922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-73d911f4-5d9e-449a-84e4-9045a4ea0517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eabbc70481e1450a9e2727689fb589dd'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:14:13.116231 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3743/7397] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:14:12 2021] DELETE /identity/v3/users/eabbc70481e1450a9e2727689fb589dd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:14:13.120726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a812e7-e633-421e-8efb-9884721ae90a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:13.121252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a812e7-e633-421e-8efb-9884721ae90a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:13.121375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a812e7-e633-421e-8efb-9884721ae90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:13.143264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f9a812e7-e633-421e-8efb-9884721ae90a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:14:13.144626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f9a812e7-e633-421e-8efb-9884721ae90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:13.202141 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3655/7398] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:14:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:14:13.212072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d911f4-5d9e-449a-84e4-9045a4ea0517 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:14:13.213468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-73d911f4-5d9e-449a-84e4-9045a4ea0517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:13.273224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d911f4-5d9e-449a-84e4-9045a4ea0517 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:14:13.276839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76c161-5885-4493-864e-edf299de52d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:14:13.277478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76c161-5885-4493-864e-edf299de52d6 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:13.277778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76c161-5885-4493-864e-edf299de52d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:13.278169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76c161-5885-4493-864e-edf299de52d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:13.287002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76c161-5885-4493-864e-edf299de52d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:14:13.288969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76c161-5885-4493-864e-edf299de52d6 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:14:13.298213 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3744/7399] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:14:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:14:13.468576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a812e7-e633-421e-8efb-9884721ae90a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:14:13.470050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f9a812e7-e633-421e-8efb-9884721ae90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:13.483044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a812e7-e633-421e-8efb-9884721ae90a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:14:13.487671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83861be5-515c-47d3-9a9f-d1fda1b52384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:14:13.488532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83861be5-515c-47d3-9a9f-d1fda1b52384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:13.488910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83861be5-515c-47d3-9a9f-d1fda1b52384 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:13.489195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83861be5-515c-47d3-9a9f-d1fda1b52384 admin admin] PATH_INFO: `/v3/projects/ad0c7ce501d44ae091188abfb003a2de` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:13.491364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83861be5-515c-47d3-9a9f-d1fda1b52384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad0c7ce501d44ae091188abfb003a2de)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:14:13.492937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83861be5-515c-47d3-9a9f-d1fda1b52384 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:14:13.538310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-83861be5-515c-47d3-9a9f-d1fda1b52384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad0c7ce501d44ae091188abfb003a2de', 'request_id': 'req-83861be5-515c-47d3-9a9f-d1fda1b52384'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:14:13.544401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-83861be5-515c-47d3-9a9f-d1fda1b52384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad0c7ce501d44ae091188abfb003a2de', 'request_id': 'req-83861be5-515c-47d3-9a9f-d1fda1b52384'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:14:13.550021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-83861be5-515c-47d3-9a9f-d1fda1b52384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad0c7ce501d44ae091188abfb003a2de', 'request_id': 'req-83861be5-515c-47d3-9a9f-d1fda1b52384'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:14:13.565675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-83861be5-515c-47d3-9a9f-d1fda1b52384 admin admin] The token cache is being invalidate because project ad0c7ce501d44ae091188abfb003a2de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:14:13.565963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-83861be5-515c-47d3-9a9f-d1fda1b52384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:14:13.566854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-83861be5-515c-47d3-9a9f-d1fda1b52384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:14:13.568384 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3656/7400] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:14:13 2021] DELETE /identity/v3/projects/ad0c7ce501d44ae091188abfb003a2de => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:14:13.574998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa94e0-e23e-4de1-ab22-36730d167bfb None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:13.575285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa94e0-e23e-4de1-ab22-36730d167bfb None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:13.575560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa94e0-e23e-4de1-ab22-36730d167bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:13.594465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d5aa94e0-e23e-4de1-ab22-36730d167bfb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:14:13.595701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d5aa94e0-e23e-4de1-ab22-36730d167bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:13.653259 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3745/7401] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:14:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:14:13.660994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730148d-28ec-41f7-b864-f4f94d30b475 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:13.661286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730148d-28ec-41f7-b864-f4f94d30b475 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:13.661568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730148d-28ec-41f7-b864-f4f94d30b475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:13.680059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8730148d-28ec-41f7-b864-f4f94d30b475 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:14:13.681246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8730148d-28ec-41f7-b864-f4f94d30b475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:13.689080 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3657/7402] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:14:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:14:13.693351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa94e0-e23e-4de1-ab22-36730d167bfb None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:14:13.702853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa94e0-e23e-4de1-ab22-36730d167bfb None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:14:13.707368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e73f01-ff54-49d8-9d79-4ef7cfc94a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:14:13.708008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e73f01-ff54-49d8-9d79-4ef7cfc94a12 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:13.708291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e73f01-ff54-49d8-9d79-4ef7cfc94a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:13.708571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e73f01-ff54-49d8-9d79-4ef7cfc94a12 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:13.709823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e73f01-ff54-49d8-9d79-4ef7cfc94a12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:14:13.710128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e73f01-ff54-49d8-9d79-4ef7cfc94a12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:14:13.711755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e73f01-ff54-49d8-9d79-4ef7cfc94a12 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:14:13.723118 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3746/7403] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:14:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:14:13.728154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730148d-28ec-41f7-b864-f4f94d30b475 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:14:13.737432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730148d-28ec-41f7-b864-f4f94d30b475 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:14:13.742096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326c2f4-f418-4e6d-91ca-23ef804b9aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:14:13.742782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326c2f4-f418-4e6d-91ca-23ef804b9aed admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:13.743070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326c2f4-f418-4e6d-91ca-23ef804b9aed admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:13.743348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326c2f4-f418-4e6d-91ca-23ef804b9aed admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:13.744063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326c2f4-f418-4e6d-91ca-23ef804b9aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:14:13.745937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326c2f4-f418-4e6d-91ca-23ef804b9aed admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:14:13.772327 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3658/7404] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:14:13 2021] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:14:13.776461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e73f01-ff54-49d8-9d79-4ef7cfc94a12 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:14:13.786446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e73f01-ff54-49d8-9d79-4ef7cfc94a12 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:14:13.845339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45a4b7-e8ec-4685-8862-e7cd6bc1944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:14:13.845926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45a4b7-e8ec-4685-8862-e7cd6bc1944d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:13.846207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45a4b7-e8ec-4685-8862-e7cd6bc1944d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:13.846519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45a4b7-e8ec-4685-8862-e7cd6bc1944d admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:13.847212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45a4b7-e8ec-4685-8862-e7cd6bc1944d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:14:13.849103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45a4b7-e8ec-4685-8862-e7cd6bc1944d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:14:13.868548 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3747/7405] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:14:13 2021] POST /identity/v3/users => generated 281 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:14:13.872807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326c2f4-f418-4e6d-91ca-23ef804b9aed admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:14:13.883341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326c2f4-f418-4e6d-91ca-23ef804b9aed admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:14:13.887931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef031e-c901-409c-9eaf-7d731f5b1a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:14:13.888595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef031e-c901-409c-9eaf-7d731f5b1a85 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:13.888900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef031e-c901-409c-9eaf-7d731f5b1a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:13.889164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef031e-c901-409c-9eaf-7d731f5b1a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:13.889939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef031e-c901-409c-9eaf-7d731f5b1a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:14:13.891587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef031e-c901-409c-9eaf-7d731f5b1a85 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:14:13.903080 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3659/7406] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:14:13 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:14:13.907168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45a4b7-e8ec-4685-8862-e7cd6bc1944d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:14:13.917752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45a4b7-e8ec-4685-8862-e7cd6bc1944d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:14:13.922545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee85e6-5c60-4926-aba0-96651b79d002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:14:13.923191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee85e6-5c60-4926-aba0-96651b79d002 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:13.923475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee85e6-5c60-4926-aba0-96651b79d002 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:13.923755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee85e6-5c60-4926-aba0-96651b79d002 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:13.924480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee85e6-5c60-4926-aba0-96651b79d002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:14:13.926145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee85e6-5c60-4926-aba0-96651b79d002 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:14:13.936303 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3748/7407] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:14:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:14:13.940460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef031e-c901-409c-9eaf-7d731f5b1a85 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:14:13.950614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef031e-c901-409c-9eaf-7d731f5b1a85 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:14:13.955425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d89dc-e622-41e1-855b-968793ec1499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:14:13.956297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d89dc-e622-41e1-855b-968793ec1499 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:13.956580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d89dc-e622-41e1-855b-968793ec1499 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:13.956855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d89dc-e622-41e1-855b-968793ec1499 admin admin] PATH_INFO: `/v3/projects/8aa3b18c48524bfc9b3a232024b9ad75/users/1ff92ebf01084c0e9de64f18439c804a/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:13.972736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d89dc-e622-41e1-855b-968793ec1499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa3b18c48524bfc9b3a232024b9ad75, user_id=1ff92ebf01084c0e9de64f18439c804a, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:14:13.976392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d89dc-e622-41e1-855b-968793ec1499 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:14:13.990018 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3660/7408] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:14:13 2021] PUT /identity/v3/projects/8aa3b18c48524bfc9b3a232024b9ad75/users/1ff92ebf01084c0e9de64f18439c804a/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:14:13.999701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54f7cc-caac-4529-9f5a-e6817b759d60 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:14.000199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54f7cc-caac-4529-9f5a-e6817b759d60 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:14.000334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54f7cc-caac-4529-9f5a-e6817b759d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:14.026630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8b54f7cc-caac-4529-9f5a-e6817b759d60 None None] MFA Rules not processed for user `1ff92ebf01084c0e9de64f18439c804a`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:14:14.027813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8b54f7cc-caac-4529-9f5a-e6817b759d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:14.090207 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3749/7409] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:14:13 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:14:14.100292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d89dc-e622-41e1-855b-968793ec1499 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:14:14.101903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-448d89dc-e622-41e1-855b-968793ec1499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:14.161297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d89dc-e622-41e1-855b-968793ec1499 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:14:14.165003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c86c6-8f1f-4346-9b44-3c75e3830eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:14:14.165653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c86c6-8f1f-4346-9b44-3c75e3830eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:14.165941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c86c6-8f1f-4346-9b44-3c75e3830eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:14.166225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c86c6-8f1f-4346-9b44-3c75e3830eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:14.175029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c86c6-8f1f-4346-9b44-3c75e3830eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:14:14.176458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c86c6-8f1f-4346-9b44-3c75e3830eb3 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:14:14.185493 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3661/7410] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:14:14 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:14:18.214053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54f7cc-caac-4529-9f5a-e6817b759d60 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:14:18.215500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8b54f7cc-caac-4529-9f5a-e6817b759d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:18.318139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54f7cc-caac-4529-9f5a-e6817b759d60 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:14:18.332961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367975a6-0b88-42ea-abe1-d64f70a6037f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:14:18.333731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367975a6-0b88-42ea-abe1-d64f70a6037f service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:18.334125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367975a6-0b88-42ea-abe1-d64f70a6037f service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:18.334487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367975a6-0b88-42ea-abe1-d64f70a6037f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:18.336569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-367975a6-0b88-42ea-abe1-d64f70a6037f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:18.420970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367975a6-0b88-42ea-abe1-d64f70a6037f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:14:18.422650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367975a6-0b88-42ea-abe1-d64f70a6037f service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:14:18.444801 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3750/7411] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:14:18 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:14:24.155527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c86c6-8f1f-4346-9b44-3c75e3830eb3 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:14:24.172364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c86c6-8f1f-4346-9b44-3c75e3830eb3 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:14:24.180594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a02ee3-d7f8-447f-8e3d-86e60dd45db9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:14:24.181579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a02ee3-d7f8-447f-8e3d-86e60dd45db9 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:24.181993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a02ee3-d7f8-447f-8e3d-86e60dd45db9 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:24.182339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a02ee3-d7f8-447f-8e3d-86e60dd45db9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:24.184889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-74a02ee3-d7f8-447f-8e3d-86e60dd45db9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:24.249779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a02ee3-d7f8-447f-8e3d-86e60dd45db9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:14:24.251678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a02ee3-d7f8-447f-8e3d-86e60dd45db9 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:14:24.275934 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3662/7412] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:14:24 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:14:37.894343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367975a6-0b88-42ea-abe1-d64f70a6037f service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:14:37.896738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-367975a6-0b88-42ea-abe1-d64f70a6037f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:38.020049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367975a6-0b88-42ea-abe1-d64f70a6037f service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:14:38.027509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb99342-ea21-482f-820e-d13086ace277 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:14:38.028968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb99342-ea21-482f-820e-d13086ace277 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:38.029491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb99342-ea21-482f-820e-d13086ace277 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:38.030002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb99342-ea21-482f-820e-d13086ace277 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:38.032543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bcb99342-ea21-482f-820e-d13086ace277 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:38.053509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4a7f6-5e6e-4989-bb83-fa6a8d371b85 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:38.053982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4a7f6-5e6e-4989-bb83-fa6a8d371b85 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:38.054279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4a7f6-5e6e-4989-bb83-fa6a8d371b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:38.071367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb99342-ea21-482f-820e-d13086ace277 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:14:38.073265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb99342-ea21-482f-820e-d13086ace277 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:14:38.076955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-57c4a7f6-5e6e-4989-bb83-fa6a8d371b85 None None] MFA Rules not processed for user `f292f8174a7a4de5bf8a848e49f85dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:14:38.078207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-57c4a7f6-5e6e-4989-bb83-fa6a8d371b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:38.111078 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3751/7413] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:14:37 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:14:38.303208 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3663/7414] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:14:38 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:14:38.939170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb99342-ea21-482f-820e-d13086ace277 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:14:38.981122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb99342-ea21-482f-820e-d13086ace277 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:14:38.987078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86347f-de43-4bdd-b6e9-22f716af4516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:14:38.987765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86347f-de43-4bdd-b6e9-22f716af4516 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:38.990763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86347f-de43-4bdd-b6e9-22f716af4516 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:38.990763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86347f-de43-4bdd-b6e9-22f716af4516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:38.991700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-da86347f-de43-4bdd-b6e9-22f716af4516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:39.009349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86347f-de43-4bdd-b6e9-22f716af4516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:14:39.012014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86347f-de43-4bdd-b6e9-22f716af4516 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:14:39.038978 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3752/7415] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:14:38 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:14:43.591265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4a7f6-5e6e-4989-bb83-fa6a8d371b85 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:14:43.593679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-57c4a7f6-5e6e-4989-bb83-fa6a8d371b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:43.647526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4a7f6-5e6e-4989-bb83-fa6a8d371b85 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:14:43.663748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a3397-a21c-4883-81fe-75320465f7b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:14:43.680224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a3397-a21c-4883-81fe-75320465f7b9 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:43.686427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a3397-a21c-4883-81fe-75320465f7b9 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:43.687541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a3397-a21c-4883-81fe-75320465f7b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:43.690760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d74a3397-a21c-4883-81fe-75320465f7b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:43.722965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a3397-a21c-4883-81fe-75320465f7b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:14:43.729742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a3397-a21c-4883-81fe-75320465f7b9 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:14:43.752442 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3664/7416] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:14:43 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:14:50.964433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86347f-de43-4bdd-b6e9-22f716af4516 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:14:50.967080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-da86347f-de43-4bdd-b6e9-22f716af4516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:50.990688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86347f-de43-4bdd-b6e9-22f716af4516 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:14:50.997608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f865090-ef26-4bd3-9990-5da075ca8872 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:14:51.002774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f865090-ef26-4bd3-9990-5da075ca8872 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:51.003641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f865090-ef26-4bd3-9990-5da075ca8872 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:51.004099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f865090-ef26-4bd3-9990-5da075ca8872 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:51.006520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7f865090-ef26-4bd3-9990-5da075ca8872 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:51.025147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f865090-ef26-4bd3-9990-5da075ca8872 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:14:51.027085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f865090-ef26-4bd3-9990-5da075ca8872 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:14:51.050500 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3753/7417] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:14:50 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:14:52.264820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a3397-a21c-4883-81fe-75320465f7b9 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:14:52.266755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d74a3397-a21c-4883-81fe-75320465f7b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:52.283880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a3397-a21c-4883-81fe-75320465f7b9 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:14:52.287706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d9610-e571-4354-8c2c-a0e287b58ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:14:52.288529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d9610-e571-4354-8c2c-a0e287b58ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:14:52.289226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d9610-e571-4354-8c2c-a0e287b58ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:14:52.289732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d9610-e571-4354-8c2c-a0e287b58ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:14:52.292024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d20d9610-e571-4354-8c2c-a0e287b58ed6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:14:52.361661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d9610-e571-4354-8c2c-a0e287b58ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:14:52.363159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d9610-e571-4354-8c2c-a0e287b58ed6 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:14:52.387358 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3665/7418] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:14:52 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:15:06.282918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f865090-ef26-4bd3-9990-5da075ca8872 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:06.351302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f865090-ef26-4bd3-9990-5da075ca8872 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:06.357288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033b288-13cd-455b-ad5d-1185b9873309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:06.358202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033b288-13cd-455b-ad5d-1185b9873309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:06.358515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033b288-13cd-455b-ad5d-1185b9873309 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:06.358988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033b288-13cd-455b-ad5d-1185b9873309 admin admin] PATH_INFO: `/v3/users/1ff92ebf01084c0e9de64f18439c804a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:06.360266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033b288-13cd-455b-ad5d-1185b9873309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff92ebf01084c0e9de64f18439c804a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:06.362234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033b288-13cd-455b-ad5d-1185b9873309 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:06.415581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3033b288-13cd-455b-ad5d-1185b9873309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff92ebf01084c0e9de64f18439c804a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:06.424915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3033b288-13cd-455b-ad5d-1185b9873309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff92ebf01084c0e9de64f18439c804a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:06.425702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3033b288-13cd-455b-ad5d-1185b9873309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff92ebf01084c0e9de64f18439c804a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:06.438129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3033b288-13cd-455b-ad5d-1185b9873309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff92ebf01084c0e9de64f18439c804a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:06.447173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3033b288-13cd-455b-ad5d-1185b9873309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff92ebf01084c0e9de64f18439c804a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:06.454335 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3754/7419] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:15:06 2021] DELETE /identity/v3/users/1ff92ebf01084c0e9de64f18439c804a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:06.459499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bd4b2-bc4b-4b43-8068-914d27772fda None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:06.460046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bd4b2-bc4b-4b43-8068-914d27772fda None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:06.460198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bd4b2-bc4b-4b43-8068-914d27772fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:06.479022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0f6bd4b2-bc4b-4b43-8068-914d27772fda None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:06.480363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0f6bd4b2-bc4b-4b43-8068-914d27772fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:06.550010 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3666/7420] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:06.560981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033b288-13cd-455b-ad5d-1185b9873309 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:06.562747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3033b288-13cd-455b-ad5d-1185b9873309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:06.635651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033b288-13cd-455b-ad5d-1185b9873309 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:06.639342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf31b4-5bfa-480a-b779-4e76b8b01c79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:06.640020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf31b4-5bfa-480a-b779-4e76b8b01c79 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:06.640300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf31b4-5bfa-480a-b779-4e76b8b01c79 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:06.640576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf31b4-5bfa-480a-b779-4e76b8b01c79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:06.650359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf31b4-5bfa-480a-b779-4e76b8b01c79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:06.651822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf31b4-5bfa-480a-b779-4e76b8b01c79 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:06.662920 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3755/7421] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:15:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:15:06.834011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bd4b2-bc4b-4b43-8068-914d27772fda None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:06.835564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0f6bd4b2-bc4b-4b43-8068-914d27772fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:06.850523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bd4b2-bc4b-4b43-8068-914d27772fda None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:06.855167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61005722-717d-410b-9124-9a5f1aa96fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:06.856028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005722-717d-410b-9124-9a5f1aa96fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:06.856444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005722-717d-410b-9124-9a5f1aa96fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:06.856583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005722-717d-410b-9124-9a5f1aa96fe8 admin admin] PATH_INFO: `/v3/projects/8aa3b18c48524bfc9b3a232024b9ad75` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:06.857944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61005722-717d-410b-9124-9a5f1aa96fe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa3b18c48524bfc9b3a232024b9ad75)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:06.859919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61005722-717d-410b-9124-9a5f1aa96fe8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:06.906040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-61005722-717d-410b-9124-9a5f1aa96fe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa3b18c48524bfc9b3a232024b9ad75', 'request_id': 'req-61005722-717d-410b-9124-9a5f1aa96fe8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:06.914653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-61005722-717d-410b-9124-9a5f1aa96fe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa3b18c48524bfc9b3a232024b9ad75', 'request_id': 'req-61005722-717d-410b-9124-9a5f1aa96fe8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:06.920562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-61005722-717d-410b-9124-9a5f1aa96fe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa3b18c48524bfc9b3a232024b9ad75', 'request_id': 'req-61005722-717d-410b-9124-9a5f1aa96fe8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:06.932559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-61005722-717d-410b-9124-9a5f1aa96fe8 admin admin] The token cache is being invalidate because project 8aa3b18c48524bfc9b3a232024b9ad75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:15:06.932844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-61005722-717d-410b-9124-9a5f1aa96fe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:06.933489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-61005722-717d-410b-9124-9a5f1aa96fe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:06.935069 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3667/7422] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:15:06 2021] DELETE /identity/v3/projects/8aa3b18c48524bfc9b3a232024b9ad75 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:06.940591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bb8ab-034a-49d5-ae7a-ff2813ebfd0e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:06.940882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bb8ab-034a-49d5-ae7a-ff2813ebfd0e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:06.941183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bb8ab-034a-49d5-ae7a-ff2813ebfd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:06.960136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8a6bb8ab-034a-49d5-ae7a-ff2813ebfd0e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:06.961293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8a6bb8ab-034a-49d5-ae7a-ff2813ebfd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:07.041873 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3756/7423] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:07.049246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418e8d7-dfbd-4a0e-8bf1-125c8c420676 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:07.049654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418e8d7-dfbd-4a0e-8bf1-125c8c420676 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:07.050005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418e8d7-dfbd-4a0e-8bf1-125c8c420676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:07.068712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e418e8d7-dfbd-4a0e-8bf1-125c8c420676 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:07.069991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e418e8d7-dfbd-4a0e-8bf1-125c8c420676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:07.078047 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3668/7424] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:07.082824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6bb8ab-034a-49d5-ae7a-ff2813ebfd0e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:07.092325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6bb8ab-034a-49d5-ae7a-ff2813ebfd0e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:07.097479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2d946-31c9-4aeb-bedf-21cfa5937531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:07.098783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2d946-31c9-4aeb-bedf-21cfa5937531 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:07.099063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2d946-31c9-4aeb-bedf-21cfa5937531 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:07.099333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2d946-31c9-4aeb-bedf-21cfa5937531 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:07.100137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2d946-31c9-4aeb-bedf-21cfa5937531 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:15:07.100411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2d946-31c9-4aeb-bedf-21cfa5937531 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:07.102136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2d946-31c9-4aeb-bedf-21cfa5937531 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:07.114973 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3757/7425] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:15:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:15:07.118951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418e8d7-dfbd-4a0e-8bf1-125c8c420676 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:07.130791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418e8d7-dfbd-4a0e-8bf1-125c8c420676 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:07.135508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44228d-b875-4b99-8782-402e1407d89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:07.136179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44228d-b875-4b99-8782-402e1407d89f admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:07.136461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44228d-b875-4b99-8782-402e1407d89f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:07.136734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44228d-b875-4b99-8782-402e1407d89f admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:07.137437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44228d-b875-4b99-8782-402e1407d89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:07.139328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44228d-b875-4b99-8782-402e1407d89f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:07.166370 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3669/7426] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:15:07 2021] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:15:07.170645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2d946-31c9-4aeb-bedf-21cfa5937531 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:07.180378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2d946-31c9-4aeb-bedf-21cfa5937531 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:07.235937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04a15-5872-477e-876b-ec326d451776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:07.236665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04a15-5872-477e-876b-ec326d451776 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:07.236980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04a15-5872-477e-876b-ec326d451776 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:07.237260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04a15-5872-477e-876b-ec326d451776 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:07.237965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b04a15-5872-477e-876b-ec326d451776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:07.239971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b04a15-5872-477e-876b-ec326d451776 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:07.261743 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3758/7427] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:15:07 2021] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:15:07.266521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44228d-b875-4b99-8782-402e1407d89f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:07.277236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44228d-b875-4b99-8782-402e1407d89f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:07.282216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607574ee-86d7-4d1b-9aff-c5acca764ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:07.282964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607574ee-86d7-4d1b-9aff-c5acca764ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:07.283376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607574ee-86d7-4d1b-9aff-c5acca764ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:07.283714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607574ee-86d7-4d1b-9aff-c5acca764ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:07.284458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607574ee-86d7-4d1b-9aff-c5acca764ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:07.286649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607574ee-86d7-4d1b-9aff-c5acca764ed2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:07.304219 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3670/7428] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:07 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:07.305737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04a15-5872-477e-876b-ec326d451776 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:07.319022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04a15-5872-477e-876b-ec326d451776 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:07.327199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e16c52-475f-418e-bf05-b6c9c91859f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:07.327969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e16c52-475f-418e-bf05-b6c9c91859f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:07.328360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e16c52-475f-418e-bf05-b6c9c91859f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:07.329760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e16c52-475f-418e-bf05-b6c9c91859f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:07.329760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e16c52-475f-418e-bf05-b6c9c91859f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:07.331489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e16c52-475f-418e-bf05-b6c9c91859f1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:07.350147 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3759/7429] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:07 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:07.351525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607574ee-86d7-4d1b-9aff-c5acca764ed2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:07.364433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607574ee-86d7-4d1b-9aff-c5acca764ed2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:07.369261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342beb75-790d-4fea-bcc9-dbd136b0fd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:07.370152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342beb75-790d-4fea-bcc9-dbd136b0fd67 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:07.370476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342beb75-790d-4fea-bcc9-dbd136b0fd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:07.370764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342beb75-790d-4fea-bcc9-dbd136b0fd67 admin admin] PATH_INFO: `/v3/projects/88e02246549b48aca1836a31a1d9e699/users/40cb5ec79695418fa9b4a7c97ee69820/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:07.386446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342beb75-790d-4fea-bcc9-dbd136b0fd67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e02246549b48aca1836a31a1d9e699, user_id=40cb5ec79695418fa9b4a7c97ee69820, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:07.389137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342beb75-790d-4fea-bcc9-dbd136b0fd67 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:07.402373 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3671/7430] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:15:07 2021] PUT /identity/v3/projects/88e02246549b48aca1836a31a1d9e699/users/40cb5ec79695418fa9b4a7c97ee69820/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:07.414052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416e632-9243-40f8-a076-0f4d9eae7056 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:07.414367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416e632-9243-40f8-a076-0f4d9eae7056 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:07.414676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416e632-9243-40f8-a076-0f4d9eae7056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:07.442439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9416e632-9243-40f8-a076-0f4d9eae7056 None None] MFA Rules not processed for user `40cb5ec79695418fa9b4a7c97ee69820`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:07.443726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9416e632-9243-40f8-a076-0f4d9eae7056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:07.507554 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3760/7431] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:07 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:07.517869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342beb75-790d-4fea-bcc9-dbd136b0fd67 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:07.520110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-342beb75-790d-4fea-bcc9-dbd136b0fd67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:07.578614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342beb75-790d-4fea-bcc9-dbd136b0fd67 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:07.582233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c705f-83f4-4f15-a363-4a039f225b48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:07.582922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c705f-83f4-4f15-a363-4a039f225b48 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:07.583209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c705f-83f4-4f15-a363-4a039f225b48 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:07.583490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c705f-83f4-4f15-a363-4a039f225b48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:07.591606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c705f-83f4-4f15-a363-4a039f225b48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:07.593011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c705f-83f4-4f15-a363-4a039f225b48 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:07.602118 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3672/7432] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:15:07 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:15:07.616572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416e632-9243-40f8-a076-0f4d9eae7056 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:07.680822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416e632-9243-40f8-a076-0f4d9eae7056 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:07.687465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27022175-8ba3-4e37-808d-9e946865e3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:07.688771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27022175-8ba3-4e37-808d-9e946865e3e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:07.689187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27022175-8ba3-4e37-808d-9e946865e3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:07.689597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27022175-8ba3-4e37-808d-9e946865e3e2 admin admin] PATH_INFO: `/v3/users/40cb5ec79695418fa9b4a7c97ee69820` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:07.691931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27022175-8ba3-4e37-808d-9e946865e3e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40cb5ec79695418fa9b4a7c97ee69820)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:07.695434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27022175-8ba3-4e37-808d-9e946865e3e2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:07.748733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-27022175-8ba3-4e37-808d-9e946865e3e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40cb5ec79695418fa9b4a7c97ee69820'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:07.758672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-27022175-8ba3-4e37-808d-9e946865e3e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40cb5ec79695418fa9b4a7c97ee69820'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:07.759293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-27022175-8ba3-4e37-808d-9e946865e3e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40cb5ec79695418fa9b4a7c97ee69820'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:07.771206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-27022175-8ba3-4e37-808d-9e946865e3e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40cb5ec79695418fa9b4a7c97ee69820'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:07.778462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-27022175-8ba3-4e37-808d-9e946865e3e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40cb5ec79695418fa9b4a7c97ee69820'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:07.784490 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3761/7433] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:15:07 2021] DELETE /identity/v3/users/40cb5ec79695418fa9b4a7c97ee69820 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:07.789796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c8f77-50aa-4bed-a6bf-5b53148f8ac5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:07.790076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c8f77-50aa-4bed-a6bf-5b53148f8ac5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:07.790403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c8f77-50aa-4bed-a6bf-5b53148f8ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:07.808137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5e0c8f77-50aa-4bed-a6bf-5b53148f8ac5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:07.808822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5e0c8f77-50aa-4bed-a6bf-5b53148f8ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:07.867280 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3673/7434] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:07.877132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27022175-8ba3-4e37-808d-9e946865e3e2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:07.878573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-27022175-8ba3-4e37-808d-9e946865e3e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:07.935945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27022175-8ba3-4e37-808d-9e946865e3e2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:07.939596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e998ba0-55fa-4fcd-a813-26dc29521ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:07.940226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e998ba0-55fa-4fcd-a813-26dc29521ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:07.940503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e998ba0-55fa-4fcd-a813-26dc29521ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:07.940775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e998ba0-55fa-4fcd-a813-26dc29521ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:07.949846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e998ba0-55fa-4fcd-a813-26dc29521ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:07.951298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e998ba0-55fa-4fcd-a813-26dc29521ff9 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:07.960943 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3762/7435] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:15:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:15:08.226290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c8f77-50aa-4bed-a6bf-5b53148f8ac5 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:08.228844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5e0c8f77-50aa-4bed-a6bf-5b53148f8ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:08.240749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c8f77-50aa-4bed-a6bf-5b53148f8ac5 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:08.245460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd4e90-1979-4df3-bfbc-760ab6d6e027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:08.246356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd4e90-1979-4df3-bfbc-760ab6d6e027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:08.246652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd4e90-1979-4df3-bfbc-760ab6d6e027 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:08.246928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd4e90-1979-4df3-bfbc-760ab6d6e027 admin admin] PATH_INFO: `/v3/projects/88e02246549b48aca1836a31a1d9e699` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:08.248193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd4e90-1979-4df3-bfbc-760ab6d6e027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88e02246549b48aca1836a31a1d9e699)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:08.250170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd4e90-1979-4df3-bfbc-760ab6d6e027 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:08.302899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0ecd4e90-1979-4df3-bfbc-760ab6d6e027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88e02246549b48aca1836a31a1d9e699', 'request_id': 'req-0ecd4e90-1979-4df3-bfbc-760ab6d6e027'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:08.308745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0ecd4e90-1979-4df3-bfbc-760ab6d6e027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88e02246549b48aca1836a31a1d9e699', 'request_id': 'req-0ecd4e90-1979-4df3-bfbc-760ab6d6e027'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:08.314303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0ecd4e90-1979-4df3-bfbc-760ab6d6e027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88e02246549b48aca1836a31a1d9e699', 'request_id': 'req-0ecd4e90-1979-4df3-bfbc-760ab6d6e027'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:08.326507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0ecd4e90-1979-4df3-bfbc-760ab6d6e027 admin admin] The token cache is being invalidate because project 88e02246549b48aca1836a31a1d9e699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:15:08.326790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0ecd4e90-1979-4df3-bfbc-760ab6d6e027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:08.327397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0ecd4e90-1979-4df3-bfbc-760ab6d6e027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:08.328916 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3674/7436] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:15:08 2021] DELETE /identity/v3/projects/88e02246549b48aca1836a31a1d9e699 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:08.335286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbd7bc-86fb-47d3-aeda-05d0547acc16 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:08.335773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbd7bc-86fb-47d3-aeda-05d0547acc16 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:08.335927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbd7bc-86fb-47d3-aeda-05d0547acc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:08.355439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-92fbd7bc-86fb-47d3-aeda-05d0547acc16 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:08.356612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-92fbd7bc-86fb-47d3-aeda-05d0547acc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:08.415030 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3763/7437] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:08.422734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48549bb-97e6-4e7d-8db8-9e41ebd726f3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:08.423049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48549bb-97e6-4e7d-8db8-9e41ebd726f3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:08.423332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48549bb-97e6-4e7d-8db8-9e41ebd726f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:08.444128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d48549bb-97e6-4e7d-8db8-9e41ebd726f3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:08.445311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d48549bb-97e6-4e7d-8db8-9e41ebd726f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:08.453108 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3675/7438] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:08.457203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbd7bc-86fb-47d3-aeda-05d0547acc16 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:08.466948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbd7bc-86fb-47d3-aeda-05d0547acc16 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:08.471474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dad10-fd48-4fa1-885c-d913fe1af66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:08.472107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dad10-fd48-4fa1-885c-d913fe1af66c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:08.472388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dad10-fd48-4fa1-885c-d913fe1af66c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:08.472688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dad10-fd48-4fa1-885c-d913fe1af66c admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:08.473403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350dad10-fd48-4fa1-885c-d913fe1af66c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:15:08.473706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350dad10-fd48-4fa1-885c-d913fe1af66c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:08.475319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350dad10-fd48-4fa1-885c-d913fe1af66c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:08.486435 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3764/7439] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:15:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:15:08.490963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48549bb-97e6-4e7d-8db8-9e41ebd726f3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:08.499996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48549bb-97e6-4e7d-8db8-9e41ebd726f3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:08.505107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c718477-b26a-42c8-ac59-70013a9cbf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:08.505773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c718477-b26a-42c8-ac59-70013a9cbf65 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:08.506081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c718477-b26a-42c8-ac59-70013a9cbf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:08.506390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c718477-b26a-42c8-ac59-70013a9cbf65 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:08.507118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c718477-b26a-42c8-ac59-70013a9cbf65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:08.508981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c718477-b26a-42c8-ac59-70013a9cbf65 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:08.534990 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3676/7440] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:15:08 2021] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:15:08.539082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dad10-fd48-4fa1-885c-d913fe1af66c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:08.549729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dad10-fd48-4fa1-885c-d913fe1af66c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:08.608920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc524c8-a24b-49a2-b7ae-948164773123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:08.609723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc524c8-a24b-49a2-b7ae-948164773123 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:08.610510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc524c8-a24b-49a2-b7ae-948164773123 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:08.610510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc524c8-a24b-49a2-b7ae-948164773123 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:08.611017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc524c8-a24b-49a2-b7ae-948164773123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:08.612975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc524c8-a24b-49a2-b7ae-948164773123 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:08.637308 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3765/7441] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:15:08 2021] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:15:08.641602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c718477-b26a-42c8-ac59-70013a9cbf65 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:08.652004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c718477-b26a-42c8-ac59-70013a9cbf65 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:08.657127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4392cd1-2fc6-4a13-980a-32c1a67f373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:08.657914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4392cd1-2fc6-4a13-980a-32c1a67f373e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:08.658196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4392cd1-2fc6-4a13-980a-32c1a67f373e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:08.658520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4392cd1-2fc6-4a13-980a-32c1a67f373e admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:08.659258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4392cd1-2fc6-4a13-980a-32c1a67f373e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:08.660871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4392cd1-2fc6-4a13-980a-32c1a67f373e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:08.671636 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3677/7442] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:08 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:08.676267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc524c8-a24b-49a2-b7ae-948164773123 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:08.687566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc524c8-a24b-49a2-b7ae-948164773123 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:08.693505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb95be-d781-47fb-81d1-db2c1bfce363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:08.694214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb95be-d781-47fb-81d1-db2c1bfce363 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:08.694535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb95be-d781-47fb-81d1-db2c1bfce363 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:08.694842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb95be-d781-47fb-81d1-db2c1bfce363 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:08.695608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb95be-d781-47fb-81d1-db2c1bfce363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:08.697255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb95be-d781-47fb-81d1-db2c1bfce363 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:08.707285 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3766/7443] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:08 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:08.711522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4392cd1-2fc6-4a13-980a-32c1a67f373e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:08.722037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4392cd1-2fc6-4a13-980a-32c1a67f373e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:08.726725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb28de-e04c-4b10-ad73-9fbccfc23d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:08.727594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb28de-e04c-4b10-ad73-9fbccfc23d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:08.727875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb28de-e04c-4b10-ad73-9fbccfc23d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:08.728149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb28de-e04c-4b10-ad73-9fbccfc23d3a admin admin] PATH_INFO: `/v3/projects/4ee600a4d808413c894cb8ed99bb0124/users/527c450ac79448ae92229cd295d72261/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:08.742720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb28de-e04c-4b10-ad73-9fbccfc23d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee600a4d808413c894cb8ed99bb0124, user_id=527c450ac79448ae92229cd295d72261, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:08.745307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb28de-e04c-4b10-ad73-9fbccfc23d3a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:08.758613 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3678/7444] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:15:08 2021] PUT /identity/v3/projects/4ee600a4d808413c894cb8ed99bb0124/users/527c450ac79448ae92229cd295d72261/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:08.768328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187a0d2-571f-43fb-b7d3-cf77be423208 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:08.768619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187a0d2-571f-43fb-b7d3-cf77be423208 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:08.768903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187a0d2-571f-43fb-b7d3-cf77be423208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:08.794867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0187a0d2-571f-43fb-b7d3-cf77be423208 None None] MFA Rules not processed for user `527c450ac79448ae92229cd295d72261`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:08.796050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0187a0d2-571f-43fb-b7d3-cf77be423208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:08.856719 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3767/7445] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:08 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:08.861256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb28de-e04c-4b10-ad73-9fbccfc23d3a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:08.920619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb28de-e04c-4b10-ad73-9fbccfc23d3a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:08.925236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4081499-aedc-4d5b-9528-0aa3537c5c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:08.926527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4081499-aedc-4d5b-9528-0aa3537c5c4e admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:08.926809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4081499-aedc-4d5b-9528-0aa3537c5c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:08.927080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4081499-aedc-4d5b-9528-0aa3537c5c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:08.927764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4081499-aedc-4d5b-9528-0aa3537c5c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:08.929635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4081499-aedc-4d5b-9528-0aa3537c5c4e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:08.953965 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3679/7446] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:15:08 2021] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:15:08.957910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187a0d2-571f-43fb-b7d3-cf77be423208 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:08.968362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187a0d2-571f-43fb-b7d3-cf77be423208 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:09.022774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad6491-f80a-4419-9646-04b6a2d7c2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:09.023443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad6491-f80a-4419-9646-04b6a2d7c2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:09.023760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad6491-f80a-4419-9646-04b6a2d7c2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:09.024070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad6491-f80a-4419-9646-04b6a2d7c2e6 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:09.024833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad6491-f80a-4419-9646-04b6a2d7c2e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:09.026809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad6491-f80a-4419-9646-04b6a2d7c2e6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:09.045954 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3768/7447] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:15:08 2021] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:15:09.049847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4081499-aedc-4d5b-9528-0aa3537c5c4e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:09.060555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4081499-aedc-4d5b-9528-0aa3537c5c4e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:09.065125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b2bb2-29f8-4328-a6d5-1aa6f7bb6533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:09.065781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b2bb2-29f8-4328-a6d5-1aa6f7bb6533 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:09.066064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b2bb2-29f8-4328-a6d5-1aa6f7bb6533 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:09.066627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b2bb2-29f8-4328-a6d5-1aa6f7bb6533 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:09.067364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b2bb2-29f8-4328-a6d5-1aa6f7bb6533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:09.068935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b2bb2-29f8-4328-a6d5-1aa6f7bb6533 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:09.079040 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3680/7448] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:09.082882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad6491-f80a-4419-9646-04b6a2d7c2e6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:09.092790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad6491-f80a-4419-9646-04b6a2d7c2e6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:09.097990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74475790-11bb-4237-99bb-974e882dc938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:09.098920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74475790-11bb-4237-99bb-974e882dc938 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:09.099206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74475790-11bb-4237-99bb-974e882dc938 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:09.099483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74475790-11bb-4237-99bb-974e882dc938 admin admin] PATH_INFO: `/v3/projects/24a2d28c904a4d3988d32274adbf5916/users/e0fb23e09c4d4a0aa55b18f1b09d03a0/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:09.114728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74475790-11bb-4237-99bb-974e882dc938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a2d28c904a4d3988d32274adbf5916, user_id=e0fb23e09c4d4a0aa55b18f1b09d03a0, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:09.118186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74475790-11bb-4237-99bb-974e882dc938 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:09.131336 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3769/7449] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:15:09 2021] PUT /identity/v3/projects/24a2d28c904a4d3988d32274adbf5916/users/e0fb23e09c4d4a0aa55b18f1b09d03a0/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:09.135201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b2bb2-29f8-4328-a6d5-1aa6f7bb6533 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:09.145918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b2bb2-29f8-4328-a6d5-1aa6f7bb6533 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:09.200699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02abd0-0434-494b-be91-d4762a11e165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:09.201358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02abd0-0434-494b-be91-d4762a11e165 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:09.201645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02abd0-0434-494b-be91-d4762a11e165 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:09.201924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02abd0-0434-494b-be91-d4762a11e165 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:09.202708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02abd0-0434-494b-be91-d4762a11e165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:09.204311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02abd0-0434-494b-be91-d4762a11e165 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:09.214312 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3681/7450] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:09 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:15:09.218627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74475790-11bb-4237-99bb-974e882dc938 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:09.229691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74475790-11bb-4237-99bb-974e882dc938 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:09.234460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5865b0e-6b02-4caf-a320-b9afc584b869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:09.235330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5865b0e-6b02-4caf-a320-b9afc584b869 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:09.235615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5865b0e-6b02-4caf-a320-b9afc584b869 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:09.235897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5865b0e-6b02-4caf-a320-b9afc584b869 admin admin] PATH_INFO: `/v3/projects/24a2d28c904a4d3988d32274adbf5916/users/e0fb23e09c4d4a0aa55b18f1b09d03a0/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:09.237882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5865b0e-6b02-4caf-a320-b9afc584b869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a2d28c904a4d3988d32274adbf5916, user_id=e0fb23e09c4d4a0aa55b18f1b09d03a0, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:09.240554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5865b0e-6b02-4caf-a320-b9afc584b869 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:09.250473 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3770/7451] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:15:09 2021] PUT /identity/v3/projects/24a2d28c904a4d3988d32274adbf5916/users/e0fb23e09c4d4a0aa55b18f1b09d03a0/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:09.261075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d6e3-60cb-4266-b776-bd255a32f17f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:09.261371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d6e3-60cb-4266-b776-bd255a32f17f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:09.261657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d6e3-60cb-4266-b776-bd255a32f17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:09.287964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b983d6e3-60cb-4266-b776-bd255a32f17f None None] MFA Rules not processed for user `e0fb23e09c4d4a0aa55b18f1b09d03a0`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:09.289156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b983d6e3-60cb-4266-b776-bd255a32f17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:09.354277 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3682/7452] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:09 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:09.365392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5865b0e-6b02-4caf-a320-b9afc584b869 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:09.367704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e5865b0e-6b02-4caf-a320-b9afc584b869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:09.446909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5865b0e-6b02-4caf-a320-b9afc584b869 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:09.450710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37507b36-795d-46b5-b459-00521cf8e7e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:09.451353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37507b36-795d-46b5-b459-00521cf8e7e4 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:09.451640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37507b36-795d-46b5-b459-00521cf8e7e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:09.451935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37507b36-795d-46b5-b459-00521cf8e7e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:09.461404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37507b36-795d-46b5-b459-00521cf8e7e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:09.463018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37507b36-795d-46b5-b459-00521cf8e7e4 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:09.472271 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3771/7453] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:15:09 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:15:09.533034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983d6e3-60cb-4266-b776-bd255a32f17f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:09.593078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983d6e3-60cb-4266-b776-bd255a32f17f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:09.597722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d9273-7a00-42fc-a38d-ff6244f4621e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:09.598620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d9273-7a00-42fc-a38d-ff6244f4621e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:09.598907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d9273-7a00-42fc-a38d-ff6244f4621e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:09.599185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d9273-7a00-42fc-a38d-ff6244f4621e admin admin] PATH_INFO: `/v3/users/527c450ac79448ae92229cd295d72261` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:09.600431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d9273-7a00-42fc-a38d-ff6244f4621e admin admin] RBAC: Authorizing `identity:delete_user(user_id=527c450ac79448ae92229cd295d72261)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:09.602722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d9273-7a00-42fc-a38d-ff6244f4621e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:09.648019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1d7d9273-7a00-42fc-a38d-ff6244f4621e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '527c450ac79448ae92229cd295d72261'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:09.654451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1d7d9273-7a00-42fc-a38d-ff6244f4621e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '527c450ac79448ae92229cd295d72261'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:09.665525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1d7d9273-7a00-42fc-a38d-ff6244f4621e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '527c450ac79448ae92229cd295d72261'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:09.666576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1d7d9273-7a00-42fc-a38d-ff6244f4621e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '527c450ac79448ae92229cd295d72261'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:09.674085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1d7d9273-7a00-42fc-a38d-ff6244f4621e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '527c450ac79448ae92229cd295d72261'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:09.679823 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3683/7454] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:15:09 2021] DELETE /identity/v3/users/527c450ac79448ae92229cd295d72261 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:09.684483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5b5ed-8a5e-4d44-9f87-7269ab9da291 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:09.684856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5b5ed-8a5e-4d44-9f87-7269ab9da291 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:09.685144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5b5ed-8a5e-4d44-9f87-7269ab9da291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:09.707830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-60c5b5ed-8a5e-4d44-9f87-7269ab9da291 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:09.709386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-60c5b5ed-8a5e-4d44-9f87-7269ab9da291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:09.767565 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3772/7455] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:09.778413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d9273-7a00-42fc-a38d-ff6244f4621e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:09.779925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1d7d9273-7a00-42fc-a38d-ff6244f4621e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:09.839137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d9273-7a00-42fc-a38d-ff6244f4621e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:09.842821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca4cad-283a-4860-af33-6ba8efb32e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:09.843471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca4cad-283a-4860-af33-6ba8efb32e65 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:09.843760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca4cad-283a-4860-af33-6ba8efb32e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:09.844043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca4cad-283a-4860-af33-6ba8efb32e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:09.853574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca4cad-283a-4860-af33-6ba8efb32e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:09.855037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca4cad-283a-4860-af33-6ba8efb32e65 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:09.869355 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3684/7456] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:15:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:15:10.120566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5b5ed-8a5e-4d44-9f87-7269ab9da291 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:10.122084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-60c5b5ed-8a5e-4d44-9f87-7269ab9da291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:10.135660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5b5ed-8a5e-4d44-9f87-7269ab9da291 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:10.141073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a832ae-c294-4a46-b65d-dddb8d393c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:10.142183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a832ae-c294-4a46-b65d-dddb8d393c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:10.142492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a832ae-c294-4a46-b65d-dddb8d393c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:10.142785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a832ae-c294-4a46-b65d-dddb8d393c05 admin admin] PATH_INFO: `/v3/projects/4ee600a4d808413c894cb8ed99bb0124` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:10.143991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a832ae-c294-4a46-b65d-dddb8d393c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee600a4d808413c894cb8ed99bb0124)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:10.146038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a832ae-c294-4a46-b65d-dddb8d393c05 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:10.194094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-30a832ae-c294-4a46-b65d-dddb8d393c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee600a4d808413c894cb8ed99bb0124', 'request_id': 'req-30a832ae-c294-4a46-b65d-dddb8d393c05'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:10.200191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-30a832ae-c294-4a46-b65d-dddb8d393c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee600a4d808413c894cb8ed99bb0124', 'request_id': 'req-30a832ae-c294-4a46-b65d-dddb8d393c05'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:10.207852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-30a832ae-c294-4a46-b65d-dddb8d393c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee600a4d808413c894cb8ed99bb0124', 'request_id': 'req-30a832ae-c294-4a46-b65d-dddb8d393c05'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:10.219152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-30a832ae-c294-4a46-b65d-dddb8d393c05 admin admin] The token cache is being invalidate because project 4ee600a4d808413c894cb8ed99bb0124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:15:10.219466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-30a832ae-c294-4a46-b65d-dddb8d393c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:10.220103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-30a832ae-c294-4a46-b65d-dddb8d393c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:10.221624 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3773/7457] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:15:10 2021] DELETE /identity/v3/projects/4ee600a4d808413c894cb8ed99bb0124 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:15:10.225763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca4cad-283a-4860-af33-6ba8efb32e65 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:10.239066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca4cad-283a-4860-af33-6ba8efb32e65 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:10.294577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce61900-105a-45d1-ae5e-d0cd4c10b442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:10.295443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce61900-105a-45d1-ae5e-d0cd4c10b442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:10.295731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce61900-105a-45d1-ae5e-d0cd4c10b442 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:10.296016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce61900-105a-45d1-ae5e-d0cd4c10b442 admin admin] PATH_INFO: `/v3/users/e0fb23e09c4d4a0aa55b18f1b09d03a0` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:10.297213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce61900-105a-45d1-ae5e-d0cd4c10b442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0fb23e09c4d4a0aa55b18f1b09d03a0)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:10.299160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce61900-105a-45d1-ae5e-d0cd4c10b442 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:10.344360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3ce61900-105a-45d1-ae5e-d0cd4c10b442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0fb23e09c4d4a0aa55b18f1b09d03a0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:10.351607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3ce61900-105a-45d1-ae5e-d0cd4c10b442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0fb23e09c4d4a0aa55b18f1b09d03a0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:10.363643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3ce61900-105a-45d1-ae5e-d0cd4c10b442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0fb23e09c4d4a0aa55b18f1b09d03a0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:10.364318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3ce61900-105a-45d1-ae5e-d0cd4c10b442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0fb23e09c4d4a0aa55b18f1b09d03a0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:10.370961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-3ce61900-105a-45d1-ae5e-d0cd4c10b442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0fb23e09c4d4a0aa55b18f1b09d03a0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:10.376808 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3685/7458] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:15:10 2021] DELETE /identity/v3/users/e0fb23e09c4d4a0aa55b18f1b09d03a0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:10.647037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a832ae-c294-4a46-b65d-dddb8d393c05 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:10.648618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-30a832ae-c294-4a46-b65d-dddb8d393c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:10.662176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a832ae-c294-4a46-b65d-dddb8d393c05 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:10.724348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cf196-ecef-49e2-bafc-a6684dbb7e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:10.725148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cf196-ecef-49e2-bafc-a6684dbb7e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:10.725493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cf196-ecef-49e2-bafc-a6684dbb7e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:10.725712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cf196-ecef-49e2-bafc-a6684dbb7e19 admin admin] PATH_INFO: `/v3/projects/24a2d28c904a4d3988d32274adbf5916` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:10.727207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cf196-ecef-49e2-bafc-a6684dbb7e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a2d28c904a4d3988d32274adbf5916)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:10.730299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cf196-ecef-49e2-bafc-a6684dbb7e19 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:10.774995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-602cf196-ecef-49e2-bafc-a6684dbb7e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a2d28c904a4d3988d32274adbf5916', 'request_id': 'req-602cf196-ecef-49e2-bafc-a6684dbb7e19'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:10.780855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-602cf196-ecef-49e2-bafc-a6684dbb7e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a2d28c904a4d3988d32274adbf5916', 'request_id': 'req-602cf196-ecef-49e2-bafc-a6684dbb7e19'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:10.788140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-602cf196-ecef-49e2-bafc-a6684dbb7e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a2d28c904a4d3988d32274adbf5916', 'request_id': 'req-602cf196-ecef-49e2-bafc-a6684dbb7e19'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:10.798148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-602cf196-ecef-49e2-bafc-a6684dbb7e19 admin admin] The token cache is being invalidate because project 24a2d28c904a4d3988d32274adbf5916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:15:10.798467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-602cf196-ecef-49e2-bafc-a6684dbb7e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:10.799082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-602cf196-ecef-49e2-bafc-a6684dbb7e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:10.800595 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3774/7459] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:15:10 2021] DELETE /identity/v3/projects/24a2d28c904a4d3988d32274adbf5916 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:10.807731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb8bd5-4f65-40ec-be66-5c751365839e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:10.808223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb8bd5-4f65-40ec-be66-5c751365839e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:10.808355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb8bd5-4f65-40ec-be66-5c751365839e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:10.825886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5acb8bd5-4f65-40ec-be66-5c751365839e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:10.827148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5acb8bd5-4f65-40ec-be66-5c751365839e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:10.884239 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3686/7460] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:10.891851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a88909-4d7e-40cc-942a-421da4ddae92 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:10.892141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a88909-4d7e-40cc-942a-421da4ddae92 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:10.892419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a88909-4d7e-40cc-942a-421da4ddae92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:10.911533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-05a88909-4d7e-40cc-942a-421da4ddae92 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:10.912781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-05a88909-4d7e-40cc-942a-421da4ddae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:10.921098 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3775/7461] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:15:10.927763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb8bd5-4f65-40ec-be66-5c751365839e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:10.943240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb8bd5-4f65-40ec-be66-5c751365839e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:10.948715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fc43a-0373-41c6-9f9f-52e5acf53bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:10.949375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fc43a-0373-41c6-9f9f-52e5acf53bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:10.949655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fc43a-0373-41c6-9f9f-52e5acf53bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:10.949925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fc43a-0373-41c6-9f9f-52e5acf53bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:10.950691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fc43a-0373-41c6-9f9f-52e5acf53bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:15:10.951001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fc43a-0373-41c6-9f9f-52e5acf53bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:10.952574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fc43a-0373-41c6-9f9f-52e5acf53bd2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:10.966112 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3687/7462] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:15:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:15:10.970618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a88909-4d7e-40cc-942a-421da4ddae92 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:10.980976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a88909-4d7e-40cc-942a-421da4ddae92 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:10.987074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300653e9-90f7-4b61-ae79-b6972f54de1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:10.987791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300653e9-90f7-4b61-ae79-b6972f54de1d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:10.988218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300653e9-90f7-4b61-ae79-b6972f54de1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:10.988645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300653e9-90f7-4b61-ae79-b6972f54de1d admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:10.989369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300653e9-90f7-4b61-ae79-b6972f54de1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:10.991749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300653e9-90f7-4b61-ae79-b6972f54de1d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:11.022139 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3776/7463] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:15:10 2021] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:15:11.023399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fc43a-0373-41c6-9f9f-52e5acf53bd2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:11.033566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fc43a-0373-41c6-9f9f-52e5acf53bd2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:11.088522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5b42e-ca96-49b5-a78d-6508d701b227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:11.089217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5b42e-ca96-49b5-a78d-6508d701b227 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:11.089500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5b42e-ca96-49b5-a78d-6508d701b227 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:11.089772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5b42e-ca96-49b5-a78d-6508d701b227 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:11.090493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5b42e-ca96-49b5-a78d-6508d701b227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:11.092369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5b42e-ca96-49b5-a78d-6508d701b227 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:11.111744 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3688/7464] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:15:11 2021] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:15:11.115791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300653e9-90f7-4b61-ae79-b6972f54de1d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:11.125882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300653e9-90f7-4b61-ae79-b6972f54de1d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:11.131373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8d3d9-8045-4af0-be79-79ced49ce099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:11.132031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8d3d9-8045-4af0-be79-79ced49ce099 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:11.132319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8d3d9-8045-4af0-be79-79ced49ce099 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:11.132602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8d3d9-8045-4af0-be79-79ced49ce099 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:11.133335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8d3d9-8045-4af0-be79-79ced49ce099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:11.134986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8d3d9-8045-4af0-be79-79ced49ce099 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:11.145946 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3777/7465] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:11 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:11.149570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5b42e-ca96-49b5-a78d-6508d701b227 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:11.159314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5b42e-ca96-49b5-a78d-6508d701b227 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:11.164192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa3502-8d2d-4c96-beba-150b5ed74553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:11.164842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa3502-8d2d-4c96-beba-150b5ed74553 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:11.165128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa3502-8d2d-4c96-beba-150b5ed74553 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:11.165406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa3502-8d2d-4c96-beba-150b5ed74553 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:11.166130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa3502-8d2d-4c96-beba-150b5ed74553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:11.167806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa3502-8d2d-4c96-beba-150b5ed74553 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:11.177353 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3689/7466] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:11 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:15:11.181235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8d3d9-8045-4af0-be79-79ced49ce099 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:11.191040 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8d3d9-8045-4af0-be79-79ced49ce099 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:11.196188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c089f-69c0-49c1-b32e-d84c2d6b2b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:11.197051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c089f-69c0-49c1-b32e-d84c2d6b2b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:11.197338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c089f-69c0-49c1-b32e-d84c2d6b2b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:11.197618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c089f-69c0-49c1-b32e-d84c2d6b2b67 admin admin] PATH_INFO: `/v3/projects/7acad15b248e420fb6e2eb6e0775efa4/users/0c3227e7217343a48e9d7a5383dac028/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:11.212329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c089f-69c0-49c1-b32e-d84c2d6b2b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7acad15b248e420fb6e2eb6e0775efa4, user_id=0c3227e7217343a48e9d7a5383dac028, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:11.215016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c089f-69c0-49c1-b32e-d84c2d6b2b67 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:11.227766 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3778/7467] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:15:11 2021] PUT /identity/v3/projects/7acad15b248e420fb6e2eb6e0775efa4/users/0c3227e7217343a48e9d7a5383dac028/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:11.238402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c78e47-a1e8-4c14-a3cc-599a41ce6251 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:11.238715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c78e47-a1e8-4c14-a3cc-599a41ce6251 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:11.239071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c78e47-a1e8-4c14-a3cc-599a41ce6251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:11.268743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f2c78e47-a1e8-4c14-a3cc-599a41ce6251 None None] MFA Rules not processed for user `0c3227e7217343a48e9d7a5383dac028`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:11.270488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f2c78e47-a1e8-4c14-a3cc-599a41ce6251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:11.334114 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3690/7468] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:11 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:11.338612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c089f-69c0-49c1-b32e-d84c2d6b2b67 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:11.400004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c089f-69c0-49c1-b32e-d84c2d6b2b67 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:11.404762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a512f1-ebea-45f9-844f-02ec6cc6975b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:11.405413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a512f1-ebea-45f9-844f-02ec6cc6975b admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:11.405698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a512f1-ebea-45f9-844f-02ec6cc6975b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:11.405980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a512f1-ebea-45f9-844f-02ec6cc6975b admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:11.406723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a512f1-ebea-45f9-844f-02ec6cc6975b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:11.408619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a512f1-ebea-45f9-844f-02ec6cc6975b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:11.432887 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3779/7469] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:15:11 2021] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:15:11.437008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c78e47-a1e8-4c14-a3cc-599a41ce6251 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:11.447854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c78e47-a1e8-4c14-a3cc-599a41ce6251 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:11.502529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db91ed-e92d-4dad-8349-e6618dae2cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:11.503178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db91ed-e92d-4dad-8349-e6618dae2cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:11.503499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db91ed-e92d-4dad-8349-e6618dae2cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:11.503779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db91ed-e92d-4dad-8349-e6618dae2cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:11.504484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db91ed-e92d-4dad-8349-e6618dae2cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:11.506414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db91ed-e92d-4dad-8349-e6618dae2cf2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:11.525787 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3691/7470] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:15:11 2021] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:15:11.529833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a512f1-ebea-45f9-844f-02ec6cc6975b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:11.540746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a512f1-ebea-45f9-844f-02ec6cc6975b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:11.545647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c58103-fdb5-4210-a610-41245010e032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:11.546351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c58103-fdb5-4210-a610-41245010e032 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:11.546661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c58103-fdb5-4210-a610-41245010e032 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:11.546943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c58103-fdb5-4210-a610-41245010e032 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:11.547672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c58103-fdb5-4210-a610-41245010e032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:11.549278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c58103-fdb5-4210-a610-41245010e032 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:11.559994 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3780/7471] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:11 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:11.564092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db91ed-e92d-4dad-8349-e6618dae2cf2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:11.574045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db91ed-e92d-4dad-8349-e6618dae2cf2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:11.578629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b11b53-dab9-4a0d-8a1f-346982c3aac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:11.579494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b11b53-dab9-4a0d-8a1f-346982c3aac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:11.579775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b11b53-dab9-4a0d-8a1f-346982c3aac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:11.580048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b11b53-dab9-4a0d-8a1f-346982c3aac5 admin admin] PATH_INFO: `/v3/projects/6784e49be20e413289a82d37fd0b720a/users/121f162ffb864c1fb1ffd0a73ba029a6/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:11.594724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b11b53-dab9-4a0d-8a1f-346982c3aac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6784e49be20e413289a82d37fd0b720a, user_id=121f162ffb864c1fb1ffd0a73ba029a6, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:11.598042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b11b53-dab9-4a0d-8a1f-346982c3aac5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:11.611124 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3692/7472] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:15:11 2021] PUT /identity/v3/projects/6784e49be20e413289a82d37fd0b720a/users/121f162ffb864c1fb1ffd0a73ba029a6/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:11.615015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c58103-fdb5-4210-a610-41245010e032 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:11.624976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c58103-fdb5-4210-a610-41245010e032 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:11.678932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a1a8d-b5a7-4121-bbc9-98811f5cd6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:11.679605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a1a8d-b5a7-4121-bbc9-98811f5cd6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:11.679850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a1a8d-b5a7-4121-bbc9-98811f5cd6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:11.680124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a1a8d-b5a7-4121-bbc9-98811f5cd6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:11.680840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a1a8d-b5a7-4121-bbc9-98811f5cd6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:11.682639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a1a8d-b5a7-4121-bbc9-98811f5cd6c9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:11.692372 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3781/7473] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:11 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:11.696364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b11b53-dab9-4a0d-8a1f-346982c3aac5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:11.706500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b11b53-dab9-4a0d-8a1f-346982c3aac5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:11.711807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf01e9-4c78-4029-9044-60f2a0d5b25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:11.712753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf01e9-4c78-4029-9044-60f2a0d5b25c admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:11.713041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf01e9-4c78-4029-9044-60f2a0d5b25c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:11.713314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf01e9-4c78-4029-9044-60f2a0d5b25c admin admin] PATH_INFO: `/v3/projects/6784e49be20e413289a82d37fd0b720a/users/121f162ffb864c1fb1ffd0a73ba029a6/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:11.715423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf01e9-4c78-4029-9044-60f2a0d5b25c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6784e49be20e413289a82d37fd0b720a, user_id=121f162ffb864c1fb1ffd0a73ba029a6, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:11.718067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf01e9-4c78-4029-9044-60f2a0d5b25c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:11.729288 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3693/7474] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:15:11 2021] PUT /identity/v3/projects/6784e49be20e413289a82d37fd0b720a/users/121f162ffb864c1fb1ffd0a73ba029a6/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:11.739384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7a530-3601-489a-b544-ff42a08e7a1c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:11.739680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7a530-3601-489a-b544-ff42a08e7a1c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:11.739967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7a530-3601-489a-b544-ff42a08e7a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:11.766308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c8d7a530-3601-489a-b544-ff42a08e7a1c None None] MFA Rules not processed for user `121f162ffb864c1fb1ffd0a73ba029a6`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:11.767482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c8d7a530-3601-489a-b544-ff42a08e7a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:11.833288 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3782/7475] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:11 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:11.842873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf01e9-4c78-4029-9044-60f2a0d5b25c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:11.844582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9faf01e9-4c78-4029-9044-60f2a0d5b25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:11.901707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf01e9-4c78-4029-9044-60f2a0d5b25c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:11.905216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3851e-20ba-4e7b-b030-39b771dd40fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:11.905841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3851e-20ba-4e7b-b030-39b771dd40fb service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:11.906152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3851e-20ba-4e7b-b030-39b771dd40fb service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:11.906458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3851e-20ba-4e7b-b030-39b771dd40fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:11.915582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3851e-20ba-4e7b-b030-39b771dd40fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:11.916980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3851e-20ba-4e7b-b030-39b771dd40fb service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:11.926327 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3694/7476] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:15:11 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:15:12.260316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7a530-3601-489a-b544-ff42a08e7a1c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:12.321857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7a530-3601-489a-b544-ff42a08e7a1c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:12.326498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95bb21-1e48-49a9-816a-640913a3c64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:12.327354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95bb21-1e48-49a9-816a-640913a3c64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:12.327664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95bb21-1e48-49a9-816a-640913a3c64a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:12.327938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95bb21-1e48-49a9-816a-640913a3c64a admin admin] PATH_INFO: `/v3/users/0c3227e7217343a48e9d7a5383dac028` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:12.329133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95bb21-1e48-49a9-816a-640913a3c64a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3227e7217343a48e9d7a5383dac028)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:12.331070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95bb21-1e48-49a9-816a-640913a3c64a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:12.377549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3f95bb21-1e48-49a9-816a-640913a3c64a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3227e7217343a48e9d7a5383dac028'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:12.384235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3f95bb21-1e48-49a9-816a-640913a3c64a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3227e7217343a48e9d7a5383dac028'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:12.384900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3f95bb21-1e48-49a9-816a-640913a3c64a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3227e7217343a48e9d7a5383dac028'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:12.396827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3f95bb21-1e48-49a9-816a-640913a3c64a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3227e7217343a48e9d7a5383dac028'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:12.403957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3f95bb21-1e48-49a9-816a-640913a3c64a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3227e7217343a48e9d7a5383dac028'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:12.409768 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3783/7477] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:15:12 2021] DELETE /identity/v3/users/0c3227e7217343a48e9d7a5383dac028 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:12.415048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dfc7b-1bc2-49b5-9284-5db404e974a3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:12.415339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dfc7b-1bc2-49b5-9284-5db404e974a3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:12.415618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dfc7b-1bc2-49b5-9284-5db404e974a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:12.432810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9c0dfc7b-1bc2-49b5-9284-5db404e974a3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:12.433979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9c0dfc7b-1bc2-49b5-9284-5db404e974a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:12.488947 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3695/7478] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:12.498676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95bb21-1e48-49a9-816a-640913a3c64a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:12.500042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3f95bb21-1e48-49a9-816a-640913a3c64a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:12.557680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95bb21-1e48-49a9-816a-640913a3c64a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:12.561339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386c344-3db3-4b13-bff7-114a71ba5b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:12.561978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386c344-3db3-4b13-bff7-114a71ba5b23 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:12.562281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386c344-3db3-4b13-bff7-114a71ba5b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:12.562577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386c344-3db3-4b13-bff7-114a71ba5b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:12.573304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386c344-3db3-4b13-bff7-114a71ba5b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:12.574930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386c344-3db3-4b13-bff7-114a71ba5b23 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:12.585033 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3784/7479] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:15:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:15:12.842449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dfc7b-1bc2-49b5-9284-5db404e974a3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:12.843848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9c0dfc7b-1bc2-49b5-9284-5db404e974a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:12.855503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dfc7b-1bc2-49b5-9284-5db404e974a3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:12.860216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7cba0-98bb-48b2-906c-ac5d45680794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:12.861067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7cba0-98bb-48b2-906c-ac5d45680794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:12.861346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7cba0-98bb-48b2-906c-ac5d45680794 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:12.861623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7cba0-98bb-48b2-906c-ac5d45680794 admin admin] PATH_INFO: `/v3/projects/7acad15b248e420fb6e2eb6e0775efa4` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:12.862880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7cba0-98bb-48b2-906c-ac5d45680794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7acad15b248e420fb6e2eb6e0775efa4)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:12.865301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7cba0-98bb-48b2-906c-ac5d45680794 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:12.910659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-60d7cba0-98bb-48b2-906c-ac5d45680794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7acad15b248e420fb6e2eb6e0775efa4', 'request_id': 'req-60d7cba0-98bb-48b2-906c-ac5d45680794'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:12.916955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-60d7cba0-98bb-48b2-906c-ac5d45680794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7acad15b248e420fb6e2eb6e0775efa4', 'request_id': 'req-60d7cba0-98bb-48b2-906c-ac5d45680794'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:12.922546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-60d7cba0-98bb-48b2-906c-ac5d45680794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7acad15b248e420fb6e2eb6e0775efa4', 'request_id': 'req-60d7cba0-98bb-48b2-906c-ac5d45680794'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:12.935039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-60d7cba0-98bb-48b2-906c-ac5d45680794 admin admin] The token cache is being invalidate because project 7acad15b248e420fb6e2eb6e0775efa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:15:12.935355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-60d7cba0-98bb-48b2-906c-ac5d45680794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:12.935970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-60d7cba0-98bb-48b2-906c-ac5d45680794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:12.937476 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3696/7480] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:15:12 2021] DELETE /identity/v3/projects/7acad15b248e420fb6e2eb6e0775efa4 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:12.941671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386c344-3db3-4b13-bff7-114a71ba5b23 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:12.951831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386c344-3db3-4b13-bff7-114a71ba5b23 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:13.004566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a867a20-95ba-41e0-84ae-73a3ca45eb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:13.006016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867a20-95ba-41e0-84ae-73a3ca45eb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:13.006320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867a20-95ba-41e0-84ae-73a3ca45eb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:13.006596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867a20-95ba-41e0-84ae-73a3ca45eb5d admin admin] PATH_INFO: `/v3/users/121f162ffb864c1fb1ffd0a73ba029a6` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:13.007776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a867a20-95ba-41e0-84ae-73a3ca45eb5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=121f162ffb864c1fb1ffd0a73ba029a6)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:13.009681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a867a20-95ba-41e0-84ae-73a3ca45eb5d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:13.052875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3a867a20-95ba-41e0-84ae-73a3ca45eb5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121f162ffb864c1fb1ffd0a73ba029a6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:13.060212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3a867a20-95ba-41e0-84ae-73a3ca45eb5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121f162ffb864c1fb1ffd0a73ba029a6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:13.060936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3a867a20-95ba-41e0-84ae-73a3ca45eb5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121f162ffb864c1fb1ffd0a73ba029a6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:13.073191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3a867a20-95ba-41e0-84ae-73a3ca45eb5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121f162ffb864c1fb1ffd0a73ba029a6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:13.080329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3a867a20-95ba-41e0-84ae-73a3ca45eb5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121f162ffb864c1fb1ffd0a73ba029a6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:13.086058 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3785/7481] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:15:12 2021] DELETE /identity/v3/users/121f162ffb864c1fb1ffd0a73ba029a6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:13.350691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7cba0-98bb-48b2-906c-ac5d45680794 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:13.352265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-60d7cba0-98bb-48b2-906c-ac5d45680794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:13.368357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7cba0-98bb-48b2-906c-ac5d45680794 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:13.432738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933170f0-ca3c-46ad-8efd-c630cc18733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:13.433604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933170f0-ca3c-46ad-8efd-c630cc18733d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:13.433929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933170f0-ca3c-46ad-8efd-c630cc18733d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:13.434205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933170f0-ca3c-46ad-8efd-c630cc18733d admin admin] PATH_INFO: `/v3/projects/6784e49be20e413289a82d37fd0b720a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:13.435495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933170f0-ca3c-46ad-8efd-c630cc18733d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6784e49be20e413289a82d37fd0b720a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:13.437377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933170f0-ca3c-46ad-8efd-c630cc18733d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:13.483588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-933170f0-ca3c-46ad-8efd-c630cc18733d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6784e49be20e413289a82d37fd0b720a', 'request_id': 'req-933170f0-ca3c-46ad-8efd-c630cc18733d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:13.489533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-933170f0-ca3c-46ad-8efd-c630cc18733d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6784e49be20e413289a82d37fd0b720a', 'request_id': 'req-933170f0-ca3c-46ad-8efd-c630cc18733d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:13.494786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-933170f0-ca3c-46ad-8efd-c630cc18733d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6784e49be20e413289a82d37fd0b720a', 'request_id': 'req-933170f0-ca3c-46ad-8efd-c630cc18733d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:13.506981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-933170f0-ca3c-46ad-8efd-c630cc18733d admin admin] The token cache is being invalidate because project 6784e49be20e413289a82d37fd0b720a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:15:13.507268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-933170f0-ca3c-46ad-8efd-c630cc18733d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:13.507891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-933170f0-ca3c-46ad-8efd-c630cc18733d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:13.509397 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3697/7482] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:15:13 2021] DELETE /identity/v3/projects/6784e49be20e413289a82d37fd0b720a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:13.515380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e7d03-a681-4541-b7a2-9415e4969e66 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:13.515670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e7d03-a681-4541-b7a2-9415e4969e66 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:13.515952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e7d03-a681-4541-b7a2-9415e4969e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:13.534807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fe2e7d03-a681-4541-b7a2-9415e4969e66 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:13.535993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fe2e7d03-a681-4541-b7a2-9415e4969e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:13.593793 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3786/7483] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:13.601625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e0b92-79ac-4a7d-a802-4393fb292861 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:13.601891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e0b92-79ac-4a7d-a802-4393fb292861 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:13.602082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e0b92-79ac-4a7d-a802-4393fb292861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:13.621232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-583e0b92-79ac-4a7d-a802-4393fb292861 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:13.622449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-583e0b92-79ac-4a7d-a802-4393fb292861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:13.630749 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3698/7484] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:15:13.635026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e7d03-a681-4541-b7a2-9415e4969e66 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:13.644611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e7d03-a681-4541-b7a2-9415e4969e66 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:13.650168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c11c26-6462-4cd8-9deb-3b0ef1dc61f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:13.650841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c11c26-6462-4cd8-9deb-3b0ef1dc61f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:13.651127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c11c26-6462-4cd8-9deb-3b0ef1dc61f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:13.651526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c11c26-6462-4cd8-9deb-3b0ef1dc61f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:13.652264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c11c26-6462-4cd8-9deb-3b0ef1dc61f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:15:13.652692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c11c26-6462-4cd8-9deb-3b0ef1dc61f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:13.654171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c11c26-6462-4cd8-9deb-3b0ef1dc61f7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:13.665777 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3787/7485] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:15:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:15:13.670061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e0b92-79ac-4a7d-a802-4393fb292861 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:13.679532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e0b92-79ac-4a7d-a802-4393fb292861 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:13.684165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e76b5-6ddf-4ce9-8f60-fe64519e73ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:13.684799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e76b5-6ddf-4ce9-8f60-fe64519e73ef admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:13.685083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e76b5-6ddf-4ce9-8f60-fe64519e73ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:13.685356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e76b5-6ddf-4ce9-8f60-fe64519e73ef admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:13.686042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e76b5-6ddf-4ce9-8f60-fe64519e73ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:13.687961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e76b5-6ddf-4ce9-8f60-fe64519e73ef admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:13.712835 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3699/7486] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:15:13 2021] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:15:13.717014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c11c26-6462-4cd8-9deb-3b0ef1dc61f7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:13.727136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c11c26-6462-4cd8-9deb-3b0ef1dc61f7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:13.781917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3e9f7-9224-4ae4-80c6-6d9e4475ce51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:13.782611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3e9f7-9224-4ae4-80c6-6d9e4475ce51 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:13.782894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3e9f7-9224-4ae4-80c6-6d9e4475ce51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:13.783170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3e9f7-9224-4ae4-80c6-6d9e4475ce51 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:13.783866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3e9f7-9224-4ae4-80c6-6d9e4475ce51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:13.785753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3e9f7-9224-4ae4-80c6-6d9e4475ce51 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:13.805181 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3788/7487] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:15:13 2021] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:15:13.809173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e76b5-6ddf-4ce9-8f60-fe64519e73ef admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:13.820123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e76b5-6ddf-4ce9-8f60-fe64519e73ef admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:13.824612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4760b-4c29-48c1-9c4c-c2e8388589af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:13.825273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4760b-4c29-48c1-9c4c-c2e8388589af admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:13.825545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4760b-4c29-48c1-9c4c-c2e8388589af admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:13.825822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4760b-4c29-48c1-9c4c-c2e8388589af admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:13.826579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4760b-4c29-48c1-9c4c-c2e8388589af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:13.828136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4760b-4c29-48c1-9c4c-c2e8388589af admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:13.838389 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3700/7488] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:13.842412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3e9f7-9224-4ae4-80c6-6d9e4475ce51 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:13.852290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3e9f7-9224-4ae4-80c6-6d9e4475ce51 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:13.857670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582534db-703a-4627-b32c-572ae0ac655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:13.858344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582534db-703a-4627-b32c-572ae0ac655a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:13.858630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582534db-703a-4627-b32c-572ae0ac655a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:13.858942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582534db-703a-4627-b32c-572ae0ac655a admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:13.859660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582534db-703a-4627-b32c-572ae0ac655a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:13.861239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582534db-703a-4627-b32c-572ae0ac655a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:13.871387 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3789/7489] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:13.875187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4760b-4c29-48c1-9c4c-c2e8388589af admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:13.885438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4760b-4c29-48c1-9c4c-c2e8388589af admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:13.890011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919aef12-6407-4e99-a018-3c3297c6f261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:13.890907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aef12-6407-4e99-a018-3c3297c6f261 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:13.891187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aef12-6407-4e99-a018-3c3297c6f261 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:13.891462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aef12-6407-4e99-a018-3c3297c6f261 admin admin] PATH_INFO: `/v3/projects/a9189fc5b4594c02bd9ad50c5c5358ad/users/81dd7c2da3bd4ef2b639119c62f6bd8a/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:13.905621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919aef12-6407-4e99-a018-3c3297c6f261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9189fc5b4594c02bd9ad50c5c5358ad, user_id=81dd7c2da3bd4ef2b639119c62f6bd8a, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:13.908270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919aef12-6407-4e99-a018-3c3297c6f261 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:13.920796 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3701/7490] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:15:13 2021] PUT /identity/v3/projects/a9189fc5b4594c02bd9ad50c5c5358ad/users/81dd7c2da3bd4ef2b639119c62f6bd8a/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:13.931880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04176a2-403e-4f20-ae44-6681340f7a82 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:13.932197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04176a2-403e-4f20-ae44-6681340f7a82 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:13.932503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04176a2-403e-4f20-ae44-6681340f7a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:13.958905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c04176a2-403e-4f20-ae44-6681340f7a82 None None] MFA Rules not processed for user `81dd7c2da3bd4ef2b639119c62f6bd8a`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:13.960125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c04176a2-403e-4f20-ae44-6681340f7a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:14.021431 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3790/7491] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:13 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:15:14.032484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919aef12-6407-4e99-a018-3c3297c6f261 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:14.034130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-919aef12-6407-4e99-a018-3c3297c6f261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:14.090871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919aef12-6407-4e99-a018-3c3297c6f261 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:14.094481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fc841-f71e-4bb6-97db-db9a36a9eeff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:14.095115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fc841-f71e-4bb6-97db-db9a36a9eeff service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:14.095401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fc841-f71e-4bb6-97db-db9a36a9eeff service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:14.095679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fc841-f71e-4bb6-97db-db9a36a9eeff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:14.104920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fc841-f71e-4bb6-97db-db9a36a9eeff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:14.107632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fc841-f71e-4bb6-97db-db9a36a9eeff service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:14.118299 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3702/7492] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:15:14 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:15:18.026989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04176a2-403e-4f20-ae44-6681340f7a82 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:18.094331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04176a2-403e-4f20-ae44-6681340f7a82 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:18.099587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b956af9-c964-49b6-84af-4baf2b3decea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:18.100696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956af9-c964-49b6-84af-4baf2b3decea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:18.101050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956af9-c964-49b6-84af-4baf2b3decea admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:18.101394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956af9-c964-49b6-84af-4baf2b3decea admin admin] PATH_INFO: `/v3/users/81dd7c2da3bd4ef2b639119c62f6bd8a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:18.102807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b956af9-c964-49b6-84af-4baf2b3decea admin admin] RBAC: Authorizing `identity:delete_user(user_id=81dd7c2da3bd4ef2b639119c62f6bd8a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:18.104801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b956af9-c964-49b6-84af-4baf2b3decea admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:18.158336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9b956af9-c964-49b6-84af-4baf2b3decea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81dd7c2da3bd4ef2b639119c62f6bd8a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:18.166244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9b956af9-c964-49b6-84af-4baf2b3decea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81dd7c2da3bd4ef2b639119c62f6bd8a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:18.166960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9b956af9-c964-49b6-84af-4baf2b3decea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81dd7c2da3bd4ef2b639119c62f6bd8a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:18.179515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9b956af9-c964-49b6-84af-4baf2b3decea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81dd7c2da3bd4ef2b639119c62f6bd8a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:18.191147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9b956af9-c964-49b6-84af-4baf2b3decea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81dd7c2da3bd4ef2b639119c62f6bd8a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:18.197732 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3791/7493] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:15:18 2021] DELETE /identity/v3/users/81dd7c2da3bd4ef2b639119c62f6bd8a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:18.202288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d432c5-0328-47da-b0f9-46e2f3fd4847 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:18.202786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d432c5-0328-47da-b0f9-46e2f3fd4847 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:18.202898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d432c5-0328-47da-b0f9-46e2f3fd4847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:18.220980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b9d432c5-0328-47da-b0f9-46e2f3fd4847 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:18.222194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b9d432c5-0328-47da-b0f9-46e2f3fd4847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:18.287516 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3703/7494] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:18.294588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b956af9-c964-49b6-84af-4baf2b3decea admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:18.295966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9b956af9-c964-49b6-84af-4baf2b3decea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:18.359797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b956af9-c964-49b6-84af-4baf2b3decea admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:18.367272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda3a65-85a6-4098-90c3-e104f152804a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:18.368558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda3a65-85a6-4098-90c3-e104f152804a service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:18.368845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda3a65-85a6-4098-90c3-e104f152804a service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:18.369121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda3a65-85a6-4098-90c3-e104f152804a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:18.379148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda3a65-85a6-4098-90c3-e104f152804a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:18.380676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda3a65-85a6-4098-90c3-e104f152804a service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:18.395100 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3792/7495] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:15:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:15:18.730029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d432c5-0328-47da-b0f9-46e2f3fd4847 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:18.732083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b9d432c5-0328-47da-b0f9-46e2f3fd4847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:18.753118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d432c5-0328-47da-b0f9-46e2f3fd4847 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:18.761273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbca6c7-ba95-4907-b5bb-c40b96b1650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:18.762323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbca6c7-ba95-4907-b5bb-c40b96b1650e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:18.762833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbca6c7-ba95-4907-b5bb-c40b96b1650e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:18.763224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbca6c7-ba95-4907-b5bb-c40b96b1650e admin admin] PATH_INFO: `/v3/projects/a9189fc5b4594c02bd9ad50c5c5358ad` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:18.765815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbca6c7-ba95-4907-b5bb-c40b96b1650e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9189fc5b4594c02bd9ad50c5c5358ad)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:18.767883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbca6c7-ba95-4907-b5bb-c40b96b1650e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:18.827427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1bbca6c7-ba95-4907-b5bb-c40b96b1650e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9189fc5b4594c02bd9ad50c5c5358ad', 'request_id': 'req-1bbca6c7-ba95-4907-b5bb-c40b96b1650e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:18.834346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1bbca6c7-ba95-4907-b5bb-c40b96b1650e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9189fc5b4594c02bd9ad50c5c5358ad', 'request_id': 'req-1bbca6c7-ba95-4907-b5bb-c40b96b1650e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:18.841089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1bbca6c7-ba95-4907-b5bb-c40b96b1650e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9189fc5b4594c02bd9ad50c5c5358ad', 'request_id': 'req-1bbca6c7-ba95-4907-b5bb-c40b96b1650e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:18.854050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1bbca6c7-ba95-4907-b5bb-c40b96b1650e admin admin] The token cache is being invalidate because project a9189fc5b4594c02bd9ad50c5c5358ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:15:18.854718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1bbca6c7-ba95-4907-b5bb-c40b96b1650e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:18.856331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1bbca6c7-ba95-4907-b5bb-c40b96b1650e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:18.858170 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3704/7496] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:15:18 2021] DELETE /identity/v3/projects/a9189fc5b4594c02bd9ad50c5c5358ad => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:18.863696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd580c-75c5-4822-bcff-e7721f6b5602 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:18.863986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd580c-75c5-4822-bcff-e7721f6b5602 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:18.864784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd580c-75c5-4822-bcff-e7721f6b5602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:18.884336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fddd580c-75c5-4822-bcff-e7721f6b5602 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:18.885652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fddd580c-75c5-4822-bcff-e7721f6b5602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:18.946970 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3793/7497] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:15:18.954831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0ddd9-3019-4b53-bac9-93b2639372fd None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:18.954831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0ddd9-3019-4b53-bac9-93b2639372fd None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:18.955130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0ddd9-3019-4b53-bac9-93b2639372fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:18.974596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6fd0ddd9-3019-4b53-bac9-93b2639372fd None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:18.975429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6fd0ddd9-3019-4b53-bac9-93b2639372fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:18.983943 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3705/7498] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:18.988026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd580c-75c5-4822-bcff-e7721f6b5602 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:18.998468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd580c-75c5-4822-bcff-e7721f6b5602 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:19.003778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d056086-a8a1-4dc9-8e99-9a948e97e5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:19.004118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d056086-a8a1-4dc9-8e99-9a948e97e5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:19.004408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d056086-a8a1-4dc9-8e99-9a948e97e5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:19.004684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d056086-a8a1-4dc9-8e99-9a948e97e5c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:19.005965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d056086-a8a1-4dc9-8e99-9a948e97e5c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:15:19.006424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d056086-a8a1-4dc9-8e99-9a948e97e5c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:19.008139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d056086-a8a1-4dc9-8e99-9a948e97e5c6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:19.020103 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3794/7499] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:15:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:15:19.024175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0ddd9-3019-4b53-bac9-93b2639372fd None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:19.033701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0ddd9-3019-4b53-bac9-93b2639372fd None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:19.038620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f872fc-3e0e-4d75-b53b-efd37647609b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:19.039272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f872fc-3e0e-4d75-b53b-efd37647609b admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:19.039556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f872fc-3e0e-4d75-b53b-efd37647609b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:19.040070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f872fc-3e0e-4d75-b53b-efd37647609b admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:19.040780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f872fc-3e0e-4d75-b53b-efd37647609b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:19.042707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f872fc-3e0e-4d75-b53b-efd37647609b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:19.069958 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3706/7500] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:15:19 2021] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:15:19.073855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d056086-a8a1-4dc9-8e99-9a948e97e5c6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:19.084317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d056086-a8a1-4dc9-8e99-9a948e97e5c6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:19.139435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922cc92-5176-4288-b842-8f3c4e96d8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:19.140091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922cc92-5176-4288-b842-8f3c4e96d8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:19.140395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922cc92-5176-4288-b842-8f3c4e96d8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:19.140672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922cc92-5176-4288-b842-8f3c4e96d8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:19.141407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922cc92-5176-4288-b842-8f3c4e96d8e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:19.143341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922cc92-5176-4288-b842-8f3c4e96d8e0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:19.165531 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3795/7501] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:15:19 2021] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:15:19.166975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f872fc-3e0e-4d75-b53b-efd37647609b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:19.179747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f872fc-3e0e-4d75-b53b-efd37647609b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:19.185038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd1eb1-2edc-4d23-99af-3b1837c7ecfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:19.185898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1eb1-2edc-4d23-99af-3b1837c7ecfd admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:19.186383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1eb1-2edc-4d23-99af-3b1837c7ecfd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:19.186758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1eb1-2edc-4d23-99af-3b1837c7ecfd admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:19.187772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd1eb1-2edc-4d23-99af-3b1837c7ecfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:19.189466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd1eb1-2edc-4d23-99af-3b1837c7ecfd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:19.203841 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3707/7502] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:19 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:15:19.205290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922cc92-5176-4288-b842-8f3c4e96d8e0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:19.215085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922cc92-5176-4288-b842-8f3c4e96d8e0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:19.220007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f622df-c86d-43e9-aa10-a9dfc0909834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:19.220656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f622df-c86d-43e9-aa10-a9dfc0909834 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:19.220938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f622df-c86d-43e9-aa10-a9dfc0909834 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:19.221217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f622df-c86d-43e9-aa10-a9dfc0909834 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:19.221964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f622df-c86d-43e9-aa10-a9dfc0909834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:19.224200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f622df-c86d-43e9-aa10-a9dfc0909834 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:19.234692 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3796/7503] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:19 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:15:19.238949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd1eb1-2edc-4d23-99af-3b1837c7ecfd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:19.256186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd1eb1-2edc-4d23-99af-3b1837c7ecfd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:19.261510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049e9b4-cf2e-4589-b695-dbf0dd4c0844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:19.262661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049e9b4-cf2e-4589-b695-dbf0dd4c0844 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:19.263041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049e9b4-cf2e-4589-b695-dbf0dd4c0844 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:19.263507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049e9b4-cf2e-4589-b695-dbf0dd4c0844 admin admin] PATH_INFO: `/v3/projects/c3ff294c24f54faf9ba1592e4dd3ebaa/users/480f527dbe434218a49acb6095d4d66f/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:19.280289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049e9b4-cf2e-4589-b695-dbf0dd4c0844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ff294c24f54faf9ba1592e4dd3ebaa, user_id=480f527dbe434218a49acb6095d4d66f, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:19.283139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049e9b4-cf2e-4589-b695-dbf0dd4c0844 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:19.299733 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3708/7504] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:15:19 2021] PUT /identity/v3/projects/c3ff294c24f54faf9ba1592e4dd3ebaa/users/480f527dbe434218a49acb6095d4d66f/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:19.309923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaa864-d659-480b-9b87-d90092c4f17c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:19.310210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaa864-d659-480b-9b87-d90092c4f17c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:19.310707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaa864-d659-480b-9b87-d90092c4f17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:19.345197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5caaa864-d659-480b-9b87-d90092c4f17c None None] MFA Rules not processed for user `480f527dbe434218a49acb6095d4d66f`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:19.346615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5caaa864-d659-480b-9b87-d90092c4f17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:19.418644 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3797/7505] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:19 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:15:19.429745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049e9b4-cf2e-4589-b695-dbf0dd4c0844 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:19.431756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9049e9b4-cf2e-4589-b695-dbf0dd4c0844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:19.497924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049e9b4-cf2e-4589-b695-dbf0dd4c0844 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:19.501848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bea8b-18c9-4803-9766-aa995ee53e6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:19.502529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bea8b-18c9-4803-9766-aa995ee53e6d service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:19.502820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bea8b-18c9-4803-9766-aa995ee53e6d service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:19.503123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bea8b-18c9-4803-9766-aa995ee53e6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:19.511685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bea8b-18c9-4803-9766-aa995ee53e6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:19.513130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bea8b-18c9-4803-9766-aa995ee53e6d service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:19.522489 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3709/7506] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:15:19 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:15:19.728144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4207a-fdb0-447a-b0d7-3b54df83e1b8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:19.728439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4207a-fdb0-447a-b0d7-3b54df83e1b8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:19.728717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4207a-fdb0-447a-b0d7-3b54df83e1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:19.748350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5ce4207a-fdb0-447a-b0d7-3b54df83e1b8 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:19.749565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5ce4207a-fdb0-447a-b0d7-3b54df83e1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:19.820713 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3798/7507] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:15:19 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:19.874386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bea8b-18c9-4803-9766-aa995ee53e6d service cinder] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:19.875816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-343bea8b-18c9-4803-9766-aa995ee53e6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:19.967330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bea8b-18c9-4803-9766-aa995ee53e6d service cinder] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:19.973268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f4acf-4740-4f2d-bc8f-173249c43818 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:19.974178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f4acf-4740-4f2d-bc8f-173249c43818 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:19.974497 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f4acf-4740-4f2d-bc8f-173249c43818 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:19.974804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f4acf-4740-4f2d-bc8f-173249c43818 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:19.984526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f4acf-4740-4f2d-bc8f-173249c43818 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:19.986530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f4acf-4740-4f2d-bc8f-173249c43818 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:19.994839 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3710/7508] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:15:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:15:20.905904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327ff28-5349-40dc-ae16-dceb4495bbc0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:20.906492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327ff28-5349-40dc-ae16-dceb4495bbc0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:20.906720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327ff28-5349-40dc-ae16-dceb4495bbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:20.927985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9327ff28-5349-40dc-ae16-dceb4495bbc0 None None] MFA Rules not processed for user `480f527dbe434218a49acb6095d4d66f`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:20.930146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9327ff28-5349-40dc-ae16-dceb4495bbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:20.939506 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3799/7509] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:20 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:31.031578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a06648-1cd5-4de9-ba92-3895e7604b06 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:31.032539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a06648-1cd5-4de9-ba92-3895e7604b06 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:31.032829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a06648-1cd5-4de9-ba92-3895e7604b06 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:31.034648 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3711/7510] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 21:15:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 21:15:31.039783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c757b-19e1-41b4-8943-1ccaa041c15f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:31.040259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c757b-19e1-41b4-8943-1ccaa041c15f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:31.040691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c757b-19e1-41b4-8943-1ccaa041c15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:31.060045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9a7c757b-19e1-41b4-8943-1ccaa041c15f None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:31.061281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9a7c757b-19e1-41b4-8943-1ccaa041c15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:31.126923 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3800/7511] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:15:31 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:31.149354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a06648-1cd5-4de9-ba92-3895e7604b06 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:31.151038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-09a06648-1cd5-4de9-ba92-3895e7604b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:31.169535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a06648-1cd5-4de9-ba92-3895e7604b06 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:31.174528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a51a0-ceeb-472d-ba07-6d76234774c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:31.175177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a51a0-ceeb-472d-ba07-6d76234774c1 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:31.175461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a51a0-ceeb-472d-ba07-6d76234774c1 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:31.175738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a51a0-ceeb-472d-ba07-6d76234774c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:31.185749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a51a0-ceeb-472d-ba07-6d76234774c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:31.187378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a51a0-ceeb-472d-ba07-6d76234774c1 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:31.197845 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3712/7512] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:15:31 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:15:31.348816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c757b-19e1-41b4-8943-1ccaa041c15f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:31.350240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9a7c757b-19e1-41b4-8943-1ccaa041c15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:31.413351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c757b-19e1-41b4-8943-1ccaa041c15f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:31.417062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246dbce-28ca-4f41-acf7-cc9e211c038d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:31.417780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246dbce-28ca-4f41-acf7-cc9e211c038d service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:31.418070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246dbce-28ca-4f41-acf7-cc9e211c038d service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:31.418379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246dbce-28ca-4f41-acf7-cc9e211c038d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:31.420143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a246dbce-28ca-4f41-acf7-cc9e211c038d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:31.432333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246dbce-28ca-4f41-acf7-cc9e211c038d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:31.434311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246dbce-28ca-4f41-acf7-cc9e211c038d service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:31.444940 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3801/7513] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:15:31 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:15:38.817610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996caae0-4e52-4093-ab7a-90d1f5480da3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:38.819260 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996caae0-4e52-4093-ab7a-90d1f5480da3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:38.819770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996caae0-4e52-4093-ab7a-90d1f5480da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:38.847378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-996caae0-4e52-4093-ab7a-90d1f5480da3 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:38.849115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-996caae0-4e52-4093-ab7a-90d1f5480da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:38.859109 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3713/7514] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:15:38 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:15:38.875782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246dbce-28ca-4f41-acf7-cc9e211c038d service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:38.898532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246dbce-28ca-4f41-acf7-cc9e211c038d service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:38.906087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bca24c-6045-48ad-b9e0-c3b9b7d97d40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:38.906985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bca24c-6045-48ad-b9e0-c3b9b7d97d40 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:38.907215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bca24c-6045-48ad-b9e0-c3b9b7d97d40 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:38.907364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bca24c-6045-48ad-b9e0-c3b9b7d97d40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:38.920870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bca24c-6045-48ad-b9e0-c3b9b7d97d40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:38.922663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bca24c-6045-48ad-b9e0-c3b9b7d97d40 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:38.933597 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3802/7515] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:15:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:15:39.267123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e23365-3afb-45f3-85c3-c75eaf9a866b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:39.268249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e23365-3afb-45f3-85c3-c75eaf9a866b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:39.268846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e23365-3afb-45f3-85c3-c75eaf9a866b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:39.303579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d9e23365-3afb-45f3-85c3-c75eaf9a866b None None] MFA Rules not processed for user `d32598482c834073b8fe24c84cb57d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:39.305266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d9e23365-3afb-45f3-85c3-c75eaf9a866b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:39.388720 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3714/7516] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:39 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:41.232847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bca24c-6045-48ad-b9e0-c3b9b7d97d40 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:41.235300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-94bca24c-6045-48ad-b9e0-c3b9b7d97d40 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:41.251570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bca24c-6045-48ad-b9e0-c3b9b7d97d40 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:41.267375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d943dd-c5e7-4f21-8766-fa03a3ef0695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:41.268337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d943dd-c5e7-4f21-8766-fa03a3ef0695 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:41.268830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d943dd-c5e7-4f21-8766-fa03a3ef0695 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:41.269108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d943dd-c5e7-4f21-8766-fa03a3ef0695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:41.271190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-36d943dd-c5e7-4f21-8766-fa03a3ef0695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:41.334046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d943dd-c5e7-4f21-8766-fa03a3ef0695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:41.335523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d943dd-c5e7-4f21-8766-fa03a3ef0695 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:41.349930 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3803/7517] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:15:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:15:46.622742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e23365-3afb-45f3-85c3-c75eaf9a866b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:46.624527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d9e23365-3afb-45f3-85c3-c75eaf9a866b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:46.647162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e23365-3afb-45f3-85c3-c75eaf9a866b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:46.655020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebf8de-6756-423d-8f09-823fc531b103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:46.656358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebf8de-6756-423d-8f09-823fc531b103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:46.656640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebf8de-6756-423d-8f09-823fc531b103 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:46.657274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebf8de-6756-423d-8f09-823fc531b103 admin admin] PATH_INFO: `/v3/users/a3e6bef41b9948099215b02cdca829bf` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:46.658786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebf8de-6756-423d-8f09-823fc531b103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e6bef41b9948099215b02cdca829bf)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:46.661736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebf8de-6756-423d-8f09-823fc531b103 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:46.749395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-02ebf8de-6756-423d-8f09-823fc531b103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e6bef41b9948099215b02cdca829bf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:46.766153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-02ebf8de-6756-423d-8f09-823fc531b103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e6bef41b9948099215b02cdca829bf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:46.798165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-02ebf8de-6756-423d-8f09-823fc531b103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e6bef41b9948099215b02cdca829bf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:46.799210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-02ebf8de-6756-423d-8f09-823fc531b103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e6bef41b9948099215b02cdca829bf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:46.810505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-02ebf8de-6756-423d-8f09-823fc531b103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e6bef41b9948099215b02cdca829bf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:46.823613 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3715/7518] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:15:46 2021] DELETE /identity/v3/users/a3e6bef41b9948099215b02cdca829bf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:47.096720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d943dd-c5e7-4f21-8766-fa03a3ef0695 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:47.108750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d943dd-c5e7-4f21-8766-fa03a3ef0695 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:47.258793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40627cc2-4d82-47ed-8306-7653d03c1989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:47.259918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40627cc2-4d82-47ed-8306-7653d03c1989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:47.260379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40627cc2-4d82-47ed-8306-7653d03c1989 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:47.261067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40627cc2-4d82-47ed-8306-7653d03c1989 admin admin] PATH_INFO: `/v3/projects/0115052ed7dd4b60b9c729f1daa095c2` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:47.271038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40627cc2-4d82-47ed-8306-7653d03c1989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0115052ed7dd4b60b9c729f1daa095c2)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:47.272998 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40627cc2-4d82-47ed-8306-7653d03c1989 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:47.325311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-40627cc2-4d82-47ed-8306-7653d03c1989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0115052ed7dd4b60b9c729f1daa095c2', 'request_id': 'req-40627cc2-4d82-47ed-8306-7653d03c1989'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:47.333505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-40627cc2-4d82-47ed-8306-7653d03c1989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0115052ed7dd4b60b9c729f1daa095c2', 'request_id': 'req-40627cc2-4d82-47ed-8306-7653d03c1989'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:47.346729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-40627cc2-4d82-47ed-8306-7653d03c1989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0115052ed7dd4b60b9c729f1daa095c2', 'request_id': 'req-40627cc2-4d82-47ed-8306-7653d03c1989'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:47.364419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-40627cc2-4d82-47ed-8306-7653d03c1989 admin admin] The token cache is being invalidate because project 0115052ed7dd4b60b9c729f1daa095c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:15:47.364757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-40627cc2-4d82-47ed-8306-7653d03c1989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:47.366185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-40627cc2-4d82-47ed-8306-7653d03c1989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:47.368949 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3804/7519] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:15:47 2021] DELETE /identity/v3/projects/0115052ed7dd4b60b9c729f1daa095c2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:47.374510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ef8ab-c5d5-49fe-b8df-13ac19e16b5b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:47.375055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ef8ab-c5d5-49fe-b8df-13ac19e16b5b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:47.375510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ef8ab-c5d5-49fe-b8df-13ac19e16b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:47.403358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2d3ef8ab-c5d5-49fe-b8df-13ac19e16b5b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:47.405682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2d3ef8ab-c5d5-49fe-b8df-13ac19e16b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:47.539220 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3716/7520] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:15:47.548473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e34f56-5658-4b87-b3bc-884748d73f5b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:47.549284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e34f56-5658-4b87-b3bc-884748d73f5b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:47.549817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e34f56-5658-4b87-b3bc-884748d73f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:47.604513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-69e34f56-5658-4b87-b3bc-884748d73f5b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:47.610711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-69e34f56-5658-4b87-b3bc-884748d73f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:47.630377 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3805/7521] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:47.634541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ef8ab-c5d5-49fe-b8df-13ac19e16b5b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:47.650604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ef8ab-c5d5-49fe-b8df-13ac19e16b5b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:47.662091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d102590-848d-4ccc-b541-5cf4bdcc3693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:47.663918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d102590-848d-4ccc-b541-5cf4bdcc3693 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:47.664210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d102590-848d-4ccc-b541-5cf4bdcc3693 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:47.664483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d102590-848d-4ccc-b541-5cf4bdcc3693 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:47.665418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d102590-848d-4ccc-b541-5cf4bdcc3693 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:15:47.665724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d102590-848d-4ccc-b541-5cf4bdcc3693 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:47.667582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d102590-848d-4ccc-b541-5cf4bdcc3693 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:47.684009 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3717/7522] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:15:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:15:47.688373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e34f56-5658-4b87-b3bc-884748d73f5b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:47.699132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e34f56-5658-4b87-b3bc-884748d73f5b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:47.708370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2013a1f-5ba9-459e-a1ef-924068ac1089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:47.708370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2013a1f-5ba9-459e-a1ef-924068ac1089 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:47.708370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2013a1f-5ba9-459e-a1ef-924068ac1089 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:47.708370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2013a1f-5ba9-459e-a1ef-924068ac1089 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:47.723403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2013a1f-5ba9-459e-a1ef-924068ac1089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:47.729896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2013a1f-5ba9-459e-a1ef-924068ac1089 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:47.766296 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3806/7523] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:15:47 2021] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:15:47.768289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d102590-848d-4ccc-b541-5cf4bdcc3693 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:47.787044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d102590-848d-4ccc-b541-5cf4bdcc3693 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:47.858862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb13e7-c68c-427f-848f-cdd55cb57aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:47.863856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb13e7-c68c-427f-848f-cdd55cb57aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:47.864224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb13e7-c68c-427f-848f-cdd55cb57aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:47.864574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb13e7-c68c-427f-848f-cdd55cb57aa4 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:47.865409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb13e7-c68c-427f-848f-cdd55cb57aa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:47.867455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb13e7-c68c-427f-848f-cdd55cb57aa4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:47.908963 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3718/7524] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:15:47 2021] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:15:47.909777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2013a1f-5ba9-459e-a1ef-924068ac1089 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:47.920978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2013a1f-5ba9-459e-a1ef-924068ac1089 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:47.925833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8aa3c-7850-4ea1-8aee-fb6ee7d3e6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:47.926541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8aa3c-7850-4ea1-8aee-fb6ee7d3e6be admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:47.926833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8aa3c-7850-4ea1-8aee-fb6ee7d3e6be admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:47.927117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8aa3c-7850-4ea1-8aee-fb6ee7d3e6be admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:47.927850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8aa3c-7850-4ea1-8aee-fb6ee7d3e6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:47.929492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8aa3c-7850-4ea1-8aee-fb6ee7d3e6be admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:47.942301 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3807/7525] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:47 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:15:47.945059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb13e7-c68c-427f-848f-cdd55cb57aa4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:47.955329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb13e7-c68c-427f-848f-cdd55cb57aa4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:47.960678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ace5b5-7327-47a3-897a-b79a8cf025c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:47.961339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ace5b5-7327-47a3-897a-b79a8cf025c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:47.961653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ace5b5-7327-47a3-897a-b79a8cf025c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:47.961938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ace5b5-7327-47a3-897a-b79a8cf025c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:47.962716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ace5b5-7327-47a3-897a-b79a8cf025c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:47.964300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ace5b5-7327-47a3-897a-b79a8cf025c2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:47.974094 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3719/7526] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:47 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:47.978128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8aa3c-7850-4ea1-8aee-fb6ee7d3e6be admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:47.988012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8aa3c-7850-4ea1-8aee-fb6ee7d3e6be admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:47.992612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32d1e4-326d-495b-bb5f-a31afbf4576f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:47.993470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32d1e4-326d-495b-bb5f-a31afbf4576f admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:47.993752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32d1e4-326d-495b-bb5f-a31afbf4576f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:47.994032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32d1e4-326d-495b-bb5f-a31afbf4576f admin admin] PATH_INFO: `/v3/projects/f7c5cb1d08af40f7acd449ffa5c623c5/users/5fa3714fd30e44eabb89aee09b7d4f11/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:48.011524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32d1e4-326d-495b-bb5f-a31afbf4576f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c5cb1d08af40f7acd449ffa5c623c5, user_id=5fa3714fd30e44eabb89aee09b7d4f11, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:48.014936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32d1e4-326d-495b-bb5f-a31afbf4576f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:48.047665 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3808/7527] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:15:47 2021] PUT /identity/v3/projects/f7c5cb1d08af40f7acd449ffa5c623c5/users/5fa3714fd30e44eabb89aee09b7d4f11/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:48.055914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5c7f1-ae19-478b-9920-4383f4b66458 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:48.056204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5c7f1-ae19-478b-9920-4383f4b66458 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:48.056615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5c7f1-ae19-478b-9920-4383f4b66458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:48.087405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-01b5c7f1-ae19-478b-9920-4383f4b66458 None None] MFA Rules not processed for user `5fa3714fd30e44eabb89aee09b7d4f11`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:48.088678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-01b5c7f1-ae19-478b-9920-4383f4b66458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:48.152868 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3720/7528] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:48 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:48.163894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32d1e4-326d-495b-bb5f-a31afbf4576f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:48.165553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9e32d1e4-326d-495b-bb5f-a31afbf4576f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:48.263148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32d1e4-326d-495b-bb5f-a31afbf4576f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:48.268816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a91f2-1781-4edf-b484-0b90fee74a7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:48.269492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a91f2-1781-4edf-b484-0b90fee74a7c service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:48.269779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a91f2-1781-4edf-b484-0b90fee74a7c service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:48.270063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a91f2-1781-4edf-b484-0b90fee74a7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:48.277769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a91f2-1781-4edf-b484-0b90fee74a7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:48.279393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a91f2-1781-4edf-b484-0b90fee74a7c service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:48.288264 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3809/7529] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:15:48 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:15:52.325158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5c7f1-ae19-478b-9920-4383f4b66458 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:52.389931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5c7f1-ae19-478b-9920-4383f4b66458 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:52.395111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf04ce-f98b-431e-aa8e-d1dc8f65220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:52.396000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf04ce-f98b-431e-aa8e-d1dc8f65220a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:52.396372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf04ce-f98b-431e-aa8e-d1dc8f65220a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:52.396719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf04ce-f98b-431e-aa8e-d1dc8f65220a admin admin] PATH_INFO: `/v3/users/5fa3714fd30e44eabb89aee09b7d4f11` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:52.398010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf04ce-f98b-431e-aa8e-d1dc8f65220a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa3714fd30e44eabb89aee09b7d4f11)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:52.400127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf04ce-f98b-431e-aa8e-d1dc8f65220a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:52.452139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dacf04ce-f98b-431e-aa8e-d1dc8f65220a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa3714fd30e44eabb89aee09b7d4f11'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:52.459487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dacf04ce-f98b-431e-aa8e-d1dc8f65220a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa3714fd30e44eabb89aee09b7d4f11'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:52.471766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dacf04ce-f98b-431e-aa8e-d1dc8f65220a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa3714fd30e44eabb89aee09b7d4f11'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:52.473079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dacf04ce-f98b-431e-aa8e-d1dc8f65220a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa3714fd30e44eabb89aee09b7d4f11'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:52.482474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dacf04ce-f98b-431e-aa8e-d1dc8f65220a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa3714fd30e44eabb89aee09b7d4f11'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:52.490299 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3721/7530] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:15:52 2021] DELETE /identity/v3/users/5fa3714fd30e44eabb89aee09b7d4f11 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:15:52.494905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e16ef-527d-4b94-a898-b7d6b22cbaa9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:52.496023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e16ef-527d-4b94-a898-b7d6b22cbaa9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:52.496430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e16ef-527d-4b94-a898-b7d6b22cbaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:52.516883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-613e16ef-527d-4b94-a898-b7d6b22cbaa9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:52.518228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-613e16ef-527d-4b94-a898-b7d6b22cbaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:52.591706 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3810/7531] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:52.600552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf04ce-f98b-431e-aa8e-d1dc8f65220a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:52.603493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-dacf04ce-f98b-431e-aa8e-d1dc8f65220a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:52.684958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf04ce-f98b-431e-aa8e-d1dc8f65220a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:52.690134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d786692-edc1-418b-a96d-0652461e7822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:52.691925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786692-edc1-418b-a96d-0652461e7822 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:52.692419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786692-edc1-418b-a96d-0652461e7822 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:52.692878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786692-edc1-418b-a96d-0652461e7822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:52.704289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d786692-edc1-418b-a96d-0652461e7822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:52.705777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d786692-edc1-418b-a96d-0652461e7822 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:52.740676 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3722/7532] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:15:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:15:53.339422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e16ef-527d-4b94-a898-b7d6b22cbaa9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:53.341166 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-613e16ef-527d-4b94-a898-b7d6b22cbaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:53.363223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e16ef-527d-4b94-a898-b7d6b22cbaa9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:53.380023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109c98a-5687-409e-9ffa-ab7275f33e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:53.381224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109c98a-5687-409e-9ffa-ab7275f33e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:53.381696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109c98a-5687-409e-9ffa-ab7275f33e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:53.382158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109c98a-5687-409e-9ffa-ab7275f33e11 admin admin] PATH_INFO: `/v3/projects/f7c5cb1d08af40f7acd449ffa5c623c5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:53.385625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109c98a-5687-409e-9ffa-ab7275f33e11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7c5cb1d08af40f7acd449ffa5c623c5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:53.388014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109c98a-5687-409e-9ffa-ab7275f33e11 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:53.516476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6109c98a-5687-409e-9ffa-ab7275f33e11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c5cb1d08af40f7acd449ffa5c623c5', 'request_id': 'req-6109c98a-5687-409e-9ffa-ab7275f33e11'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:53.538984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6109c98a-5687-409e-9ffa-ab7275f33e11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c5cb1d08af40f7acd449ffa5c623c5', 'request_id': 'req-6109c98a-5687-409e-9ffa-ab7275f33e11'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:53.560939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6109c98a-5687-409e-9ffa-ab7275f33e11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c5cb1d08af40f7acd449ffa5c623c5', 'request_id': 'req-6109c98a-5687-409e-9ffa-ab7275f33e11'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:53.583985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6109c98a-5687-409e-9ffa-ab7275f33e11 admin admin] The token cache is being invalidate because project f7c5cb1d08af40f7acd449ffa5c623c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:15:53.583985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6109c98a-5687-409e-9ffa-ab7275f33e11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:53.583985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6109c98a-5687-409e-9ffa-ab7275f33e11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:53.583985 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3811/7533] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:15:53 2021] DELETE /identity/v3/projects/f7c5cb1d08af40f7acd449ffa5c623c5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:53.592122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988877c-67c5-42ed-8a9c-a4dac3c552d0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:53.594781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988877c-67c5-42ed-8a9c-a4dac3c552d0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:53.595705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988877c-67c5-42ed-8a9c-a4dac3c552d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:53.658712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2988877c-67c5-42ed-8a9c-a4dac3c552d0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:53.661176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2988877c-67c5-42ed-8a9c-a4dac3c552d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:53.783951 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3723/7534] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:53.793681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c1bb8-1363-4bb8-81b8-65e767b45f98 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:53.794186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c1bb8-1363-4bb8-81b8-65e767b45f98 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:53.794527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c1bb8-1363-4bb8-81b8-65e767b45f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:53.818804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c15c1bb8-1363-4bb8-81b8-65e767b45f98 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:53.820361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c15c1bb8-1363-4bb8-81b8-65e767b45f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:53.835901 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3812/7535] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:53.836244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988877c-67c5-42ed-8a9c-a4dac3c552d0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:53.852236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988877c-67c5-42ed-8a9c-a4dac3c552d0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:53.861801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7af16-6bc5-48a6-9c56-249154dd972b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:53.862601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7af16-6bc5-48a6-9c56-249154dd972b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:53.862946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7af16-6bc5-48a6-9c56-249154dd972b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:53.863756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7af16-6bc5-48a6-9c56-249154dd972b admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:53.864747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7af16-6bc5-48a6-9c56-249154dd972b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:15:53.865341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7af16-6bc5-48a6-9c56-249154dd972b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:53.867349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7af16-6bc5-48a6-9c56-249154dd972b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:53.887392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c1bb8-1363-4bb8-81b8-65e767b45f98 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:53.890466 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3724/7536] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:15:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:15:53.898174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c1bb8-1363-4bb8-81b8-65e767b45f98 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:53.904997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9392d-1f56-44a7-b6f8-8696c2a56f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:53.905995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9392d-1f56-44a7-b6f8-8696c2a56f56 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:53.906499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9392d-1f56-44a7-b6f8-8696c2a56f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:53.906956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9392d-1f56-44a7-b6f8-8696c2a56f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:53.907894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9392d-1f56-44a7-b6f8-8696c2a56f56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:53.912329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9392d-1f56-44a7-b6f8-8696c2a56f56 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:53.950916 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3813/7537] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:15:53 2021] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:15:53.952108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7af16-6bc5-48a6-9c56-249154dd972b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:53.964594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7af16-6bc5-48a6-9c56-249154dd972b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:54.028786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31735003-b6f7-4fb3-a8f6-1c1e1e5f7b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:54.029783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31735003-b6f7-4fb3-a8f6-1c1e1e5f7b38 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:54.030238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31735003-b6f7-4fb3-a8f6-1c1e1e5f7b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:54.030740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31735003-b6f7-4fb3-a8f6-1c1e1e5f7b38 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:54.031742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31735003-b6f7-4fb3-a8f6-1c1e1e5f7b38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:54.033896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31735003-b6f7-4fb3-a8f6-1c1e1e5f7b38 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:54.060951 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3725/7538] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:15:53 2021] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:15:54.062303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9392d-1f56-44a7-b6f8-8696c2a56f56 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:54.072946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9392d-1f56-44a7-b6f8-8696c2a56f56 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:54.078224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0223626-475f-4a30-8fbf-8a7b826c467e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:54.078919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0223626-475f-4a30-8fbf-8a7b826c467e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:54.079207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0223626-475f-4a30-8fbf-8a7b826c467e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:54.079486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0223626-475f-4a30-8fbf-8a7b826c467e admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:54.080219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0223626-475f-4a30-8fbf-8a7b826c467e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:54.082436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0223626-475f-4a30-8fbf-8a7b826c467e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:54.098723 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3814/7539] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:54 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:54.108950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31735003-b6f7-4fb3-a8f6-1c1e1e5f7b38 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:54.134095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31735003-b6f7-4fb3-a8f6-1c1e1e5f7b38 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:54.142491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9df0f-f63c-4ebd-b8da-a927d09b622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:54.143510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9df0f-f63c-4ebd-b8da-a927d09b622e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:54.143967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9df0f-f63c-4ebd-b8da-a927d09b622e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:54.144938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9df0f-f63c-4ebd-b8da-a927d09b622e admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:54.145915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9df0f-f63c-4ebd-b8da-a927d09b622e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:54.147793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9df0f-f63c-4ebd-b8da-a927d09b622e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:54.170641 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3726/7540] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:54 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:15:54.174892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0223626-475f-4a30-8fbf-8a7b826c467e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:54.212644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0223626-475f-4a30-8fbf-8a7b826c467e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:54.235955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5f23e-4683-4703-ab23-4927d30a1ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:54.236860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5f23e-4683-4703-ab23-4927d30a1ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:54.237144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5f23e-4683-4703-ab23-4927d30a1ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:54.237427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5f23e-4683-4703-ab23-4927d30a1ea3 admin admin] PATH_INFO: `/v3/projects/db778119f3bb4e02a98477d311228b8c/users/6867b458612045eab5afa30ab3e88f46/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:54.259899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5f23e-4683-4703-ab23-4927d30a1ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db778119f3bb4e02a98477d311228b8c, user_id=6867b458612045eab5afa30ab3e88f46, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:54.263064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5f23e-4683-4703-ab23-4927d30a1ea3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:54.282166 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3815/7541] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:15:54 2021] PUT /identity/v3/projects/db778119f3bb4e02a98477d311228b8c/users/6867b458612045eab5afa30ab3e88f46/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:54.293656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0365287-fdad-4962-83d9-146d38e260e7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:54.294197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0365287-fdad-4962-83d9-146d38e260e7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:54.294737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0365287-fdad-4962-83d9-146d38e260e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:54.347122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f0365287-fdad-4962-83d9-146d38e260e7 None None] MFA Rules not processed for user `6867b458612045eab5afa30ab3e88f46`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:54.350602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f0365287-fdad-4962-83d9-146d38e260e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:54.454093 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3727/7542] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:54 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:54.466131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5f23e-4683-4703-ab23-4927d30a1ea3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:54.468081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-37e5f23e-4683-4703-ab23-4927d30a1ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:54.596327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5f23e-4683-4703-ab23-4927d30a1ea3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:54.622473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253afebc-2503-44fb-8d6b-0c1e6b1c6a9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:54.622473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253afebc-2503-44fb-8d6b-0c1e6b1c6a9a service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:54.622473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253afebc-2503-44fb-8d6b-0c1e6b1c6a9a service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:54.622473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253afebc-2503-44fb-8d6b-0c1e6b1c6a9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:54.623851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253afebc-2503-44fb-8d6b-0c1e6b1c6a9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:54.625754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253afebc-2503-44fb-8d6b-0c1e6b1c6a9a service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:54.640334 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3816/7543] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:15:54 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:15:55.143494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0365287-fdad-4962-83d9-146d38e260e7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:55.253672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0365287-fdad-4962-83d9-146d38e260e7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:55.263331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc202d2-51ad-40e2-9380-3cf02cf5138c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:55.264272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc202d2-51ad-40e2-9380-3cf02cf5138c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:55.264766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc202d2-51ad-40e2-9380-3cf02cf5138c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:55.265045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc202d2-51ad-40e2-9380-3cf02cf5138c admin admin] PATH_INFO: `/v3/users/6867b458612045eab5afa30ab3e88f46` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:55.266504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc202d2-51ad-40e2-9380-3cf02cf5138c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6867b458612045eab5afa30ab3e88f46)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:55.268422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc202d2-51ad-40e2-9380-3cf02cf5138c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:55.322531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbc202d2-51ad-40e2-9380-3cf02cf5138c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6867b458612045eab5afa30ab3e88f46'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:55.329290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbc202d2-51ad-40e2-9380-3cf02cf5138c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6867b458612045eab5afa30ab3e88f46'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:55.341294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbc202d2-51ad-40e2-9380-3cf02cf5138c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6867b458612045eab5afa30ab3e88f46'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:55.342183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbc202d2-51ad-40e2-9380-3cf02cf5138c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6867b458612045eab5afa30ab3e88f46'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:55.351707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-cbc202d2-51ad-40e2-9380-3cf02cf5138c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6867b458612045eab5afa30ab3e88f46'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:55.357865 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3728/7544] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:15:55 2021] DELETE /identity/v3/users/6867b458612045eab5afa30ab3e88f46 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:15:55.362564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80bf7e-84f1-4bd2-854c-fb1cc8a9a11c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:55.363523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80bf7e-84f1-4bd2-854c-fb1cc8a9a11c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:55.363837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80bf7e-84f1-4bd2-854c-fb1cc8a9a11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:55.381763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4a80bf7e-84f1-4bd2-854c-fb1cc8a9a11c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:55.383376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4a80bf7e-84f1-4bd2-854c-fb1cc8a9a11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:55.445261 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3817/7545] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:55.456186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc202d2-51ad-40e2-9380-3cf02cf5138c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:55.458334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cbc202d2-51ad-40e2-9380-3cf02cf5138c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:55.519854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc202d2-51ad-40e2-9380-3cf02cf5138c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:55.523466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772fe62-614a-4f44-bed1-4c658096c08a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:55.524118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772fe62-614a-4f44-bed1-4c658096c08a service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:55.524533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772fe62-614a-4f44-bed1-4c658096c08a service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:55.524821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772fe62-614a-4f44-bed1-4c658096c08a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:55.539145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772fe62-614a-4f44-bed1-4c658096c08a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:55.540814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772fe62-614a-4f44-bed1-4c658096c08a service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:55.551721 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3729/7546] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:15:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:15:56.467563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80bf7e-84f1-4bd2-854c-fb1cc8a9a11c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:56.469039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4a80bf7e-84f1-4bd2-854c-fb1cc8a9a11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:56.484305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80bf7e-84f1-4bd2-854c-fb1cc8a9a11c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:56.493298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7a82c-e468-43ac-80bd-4d421860cf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:56.494825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7a82c-e468-43ac-80bd-4d421860cf17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:56.495116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7a82c-e468-43ac-80bd-4d421860cf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:56.495589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7a82c-e468-43ac-80bd-4d421860cf17 admin admin] PATH_INFO: `/v3/projects/db778119f3bb4e02a98477d311228b8c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:56.496933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7a82c-e468-43ac-80bd-4d421860cf17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db778119f3bb4e02a98477d311228b8c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:56.498935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7a82c-e468-43ac-80bd-4d421860cf17 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:56.585564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb7128-be7a-483b-aa45-848fd8fd9904 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:56.587347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb7128-be7a-483b-aa45-848fd8fd9904 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:56.587347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb7128-be7a-483b-aa45-848fd8fd9904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:56.624520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5dcb7128-be7a-483b-aa45-848fd8fd9904 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:56.626489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5dcb7128-be7a-483b-aa45-848fd8fd9904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:56.677931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e8e7a82c-e468-43ac-80bd-4d421860cf17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db778119f3bb4e02a98477d311228b8c', 'request_id': 'req-e8e7a82c-e468-43ac-80bd-4d421860cf17'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:56.706003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e8e7a82c-e468-43ac-80bd-4d421860cf17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db778119f3bb4e02a98477d311228b8c', 'request_id': 'req-e8e7a82c-e468-43ac-80bd-4d421860cf17'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:56.725185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e8e7a82c-e468-43ac-80bd-4d421860cf17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db778119f3bb4e02a98477d311228b8c', 'request_id': 'req-e8e7a82c-e468-43ac-80bd-4d421860cf17'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:56.758472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e8e7a82c-e468-43ac-80bd-4d421860cf17 admin admin] The token cache is being invalidate because project db778119f3bb4e02a98477d311228b8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:15:56.758891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e8e7a82c-e468-43ac-80bd-4d421860cf17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:56.759723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e8e7a82c-e468-43ac-80bd-4d421860cf17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:15:56.761694 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3818/7548] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:15:56 2021] DELETE /identity/v3/projects/db778119f3bb4e02a98477d311228b8c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:56.770684 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3730/7548] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 21:15:56 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:15:56.772649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c0479-d0dd-4eb0-b6ec-08afd0c95635 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:56.773271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c0479-d0dd-4eb0-b6ec-08afd0c95635 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:56.773887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c0479-d0dd-4eb0-b6ec-08afd0c95635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:56.780843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb7128-be7a-483b-aa45-848fd8fd9904 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:56.782662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5dcb7128-be7a-483b-aa45-848fd8fd9904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:56.799940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3e7c0479-d0dd-4eb0-b6ec-08afd0c95635 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:56.802298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3e7c0479-d0dd-4eb0-b6ec-08afd0c95635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:56.878180 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3819/7549] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:15:56.886323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bbee3-b06e-49e0-8fc1-17975b8e0103 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:56.886659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bbee3-b06e-49e0-8fc1-17975b8e0103 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:56.886900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bbee3-b06e-49e0-8fc1-17975b8e0103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:56.891842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb7128-be7a-483b-aa45-848fd8fd9904 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:56.901217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740f25d-208e-4cf8-94f5-8114fb6249b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:56.902352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740f25d-208e-4cf8-94f5-8114fb6249b9 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:56.902352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740f25d-208e-4cf8-94f5-8114fb6249b9 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:56.902612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740f25d-208e-4cf8-94f5-8114fb6249b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:56.905337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3740f25d-208e-4cf8-94f5-8114fb6249b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:56.910624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d97bbee3-b06e-49e0-8fc1-17975b8e0103 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:56.911888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d97bbee3-b06e-49e0-8fc1-17975b8e0103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:56.917403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740f25d-208e-4cf8-94f5-8114fb6249b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:56.920018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740f25d-208e-4cf8-94f5-8114fb6249b9 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:56.922112 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3820/7550] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:56.928146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bbee3-b06e-49e0-8fc1-17975b8e0103 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:56.937368 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3731/7551] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:15:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:15:56.955030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bbee3-b06e-49e0-8fc1-17975b8e0103 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:56.970211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec5734-2959-4fec-9c28-7b4a0da1df74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:56.971346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec5734-2959-4fec-9c28-7b4a0da1df74 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:56.971529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec5734-2959-4fec-9c28-7b4a0da1df74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:56.971824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec5734-2959-4fec-9c28-7b4a0da1df74 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:56.973610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec5734-2959-4fec-9c28-7b4a0da1df74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:15:56.973610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec5734-2959-4fec-9c28-7b4a0da1df74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:56.975517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec5734-2959-4fec-9c28-7b4a0da1df74 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:56.998517 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3821/7552] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:15:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:15:56.998754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740f25d-208e-4cf8-94f5-8114fb6249b9 service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:57.028496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740f25d-208e-4cf8-94f5-8114fb6249b9 service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:57.042964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0e770-ab00-4bf8-a7d0-48c85b8f50f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:57.043655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0e770-ab00-4bf8-a7d0-48c85b8f50f2 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:57.043937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0e770-ab00-4bf8-a7d0-48c85b8f50f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:57.044210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0e770-ab00-4bf8-a7d0-48c85b8f50f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:57.044926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0e770-ab00-4bf8-a7d0-48c85b8f50f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:57.051881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0e770-ab00-4bf8-a7d0-48c85b8f50f2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:57.121451 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3732/7553] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:15:56 2021] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:15:57.125195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec5734-2959-4fec-9c28-7b4a0da1df74 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:57.141927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec5734-2959-4fec-9c28-7b4a0da1df74 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:57.281608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb4b9d-5a8f-4f0b-9bc9-3589eb3f81f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:57.282854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb4b9d-5a8f-4f0b-9bc9-3589eb3f81f3 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:57.283235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb4b9d-5a8f-4f0b-9bc9-3589eb3f81f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:57.283783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb4b9d-5a8f-4f0b-9bc9-3589eb3f81f3 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:57.285301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb4b9d-5a8f-4f0b-9bc9-3589eb3f81f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:57.287615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb4b9d-5a8f-4f0b-9bc9-3589eb3f81f3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:57.326685 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3822/7554] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:15:57 2021] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:15:57.330890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0e770-ab00-4bf8-a7d0-48c85b8f50f2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:57.370334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0e770-ab00-4bf8-a7d0-48c85b8f50f2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:57.394590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d92e32-7968-4394-a7d6-bec906b0c26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:57.395821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d92e32-7968-4394-a7d6-bec906b0c26a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:57.396459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d92e32-7968-4394-a7d6-bec906b0c26a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:57.396965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d92e32-7968-4394-a7d6-bec906b0c26a admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:57.398456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d92e32-7968-4394-a7d6-bec906b0c26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:57.403393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d92e32-7968-4394-a7d6-bec906b0c26a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:57.448928 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3733/7555] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:57 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:57.449893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb4b9d-5a8f-4f0b-9bc9-3589eb3f81f3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:57.469701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb4b9d-5a8f-4f0b-9bc9-3589eb3f81f3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:57.494907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c8574-f3aa-4c5b-91b2-49ffe5f31b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:57.496031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c8574-f3aa-4c5b-91b2-49ffe5f31b8d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:57.496521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c8574-f3aa-4c5b-91b2-49ffe5f31b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:57.497073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c8574-f3aa-4c5b-91b2-49ffe5f31b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:57.498101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c8574-f3aa-4c5b-91b2-49ffe5f31b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:57.500131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c8574-f3aa-4c5b-91b2-49ffe5f31b8d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:57.531770 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3823/7556] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:57 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:57.533686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d92e32-7968-4394-a7d6-bec906b0c26a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:57.555110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d92e32-7968-4394-a7d6-bec906b0c26a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:57.572123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db481def-cb12-4a3c-b7b2-c2ae269db05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:57.573353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db481def-cb12-4a3c-b7b2-c2ae269db05b admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:57.573916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db481def-cb12-4a3c-b7b2-c2ae269db05b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:57.574433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db481def-cb12-4a3c-b7b2-c2ae269db05b admin admin] PATH_INFO: `/v3/projects/863f070438304159bdda33d864fc0ef5/users/c76f785c37734de0adf36215d5563990/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:57.652793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db481def-cb12-4a3c-b7b2-c2ae269db05b admin admin] RBAC: Authorizing `identity:create_grant(project_id=863f070438304159bdda33d864fc0ef5, user_id=c76f785c37734de0adf36215d5563990, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:57.656804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db481def-cb12-4a3c-b7b2-c2ae269db05b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:57.698606 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3734/7557] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:15:57 2021] PUT /identity/v3/projects/863f070438304159bdda33d864fc0ef5/users/c76f785c37734de0adf36215d5563990/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:57.715774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12299d1-0a54-4edb-bf2d-ac43790d96dc None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:57.716358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12299d1-0a54-4edb-bf2d-ac43790d96dc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:57.717024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12299d1-0a54-4edb-bf2d-ac43790d96dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:57.810763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a12299d1-0a54-4edb-bf2d-ac43790d96dc None None] MFA Rules not processed for user `c76f785c37734de0adf36215d5563990`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:57.817767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a12299d1-0a54-4edb-bf2d-ac43790d96dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:57.978154 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3824/7558] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:57 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:57.983155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db481def-cb12-4a3c-b7b2-c2ae269db05b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:58.195507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db481def-cb12-4a3c-b7b2-c2ae269db05b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:58.219030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff965ba-c524-4d65-81c5-e45d433a0aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:58.220126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff965ba-c524-4d65-81c5-e45d433a0aec admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:58.222564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff965ba-c524-4d65-81c5-e45d433a0aec admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:58.223646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff965ba-c524-4d65-81c5-e45d433a0aec admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:58.226010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff965ba-c524-4d65-81c5-e45d433a0aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:58.228226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff965ba-c524-4d65-81c5-e45d433a0aec admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:58.322197 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3735/7559] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:15:57 2021] POST /identity/v3/projects => generated 389 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:15:58.323659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12299d1-0a54-4edb-bf2d-ac43790d96dc None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:58.348126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12299d1-0a54-4edb-bf2d-ac43790d96dc None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:58.504968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada060e-7a91-4556-965e-cc0452f0329e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:58.505767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada060e-7a91-4556-965e-cc0452f0329e admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:58.505939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada060e-7a91-4556-965e-cc0452f0329e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:58.506223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada060e-7a91-4556-965e-cc0452f0329e admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:58.506956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada060e-7a91-4556-965e-cc0452f0329e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:58.511070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada060e-7a91-4556-965e-cc0452f0329e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:58.558312 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3825/7560] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:15:58 2021] POST /identity/v3/users => generated 301 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:15:58.562609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff965ba-c524-4d65-81c5-e45d433a0aec admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:58.576990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff965ba-c524-4d65-81c5-e45d433a0aec admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:58.591006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d1efe-3619-4926-9413-00ca996f36a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:58.591944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d1efe-3619-4926-9413-00ca996f36a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:58.592099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d1efe-3619-4926-9413-00ca996f36a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:58.592252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d1efe-3619-4926-9413-00ca996f36a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:58.595429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d1efe-3619-4926-9413-00ca996f36a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:58.600602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d1efe-3619-4926-9413-00ca996f36a9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:58.636438 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3736/7561] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:58 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:58.641427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada060e-7a91-4556-965e-cc0452f0329e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:58.656106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada060e-7a91-4556-965e-cc0452f0329e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:58.681475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565157-3e0a-4ba8-87a0-f0a54a36b606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:58.682886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565157-3e0a-4ba8-87a0-f0a54a36b606 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:58.683563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565157-3e0a-4ba8-87a0-f0a54a36b606 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:58.684242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565157-3e0a-4ba8-87a0-f0a54a36b606 admin admin] PATH_INFO: `/v3/projects/a4cb7730681e47a1b248895495a90e4b/users/82f778cd26294cf3805378271bdd1e87/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:58.716238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8565157-3e0a-4ba8-87a0-f0a54a36b606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4cb7730681e47a1b248895495a90e4b, user_id=82f778cd26294cf3805378271bdd1e87, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:58.726085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8565157-3e0a-4ba8-87a0-f0a54a36b606 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:58.750069 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3826/7562] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:15:58 2021] PUT /identity/v3/projects/a4cb7730681e47a1b248895495a90e4b/users/82f778cd26294cf3805378271bdd1e87/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:15:58.756427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d1efe-3619-4926-9413-00ca996f36a9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:58.769654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d1efe-3619-4926-9413-00ca996f36a9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:58.873199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b78d9-84dc-4e2d-ad42-e1dba98e6d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:58.874549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b78d9-84dc-4e2d-ad42-e1dba98e6d3e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:58.874838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b78d9-84dc-4e2d-ad42-e1dba98e6d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:58.875106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b78d9-84dc-4e2d-ad42-e1dba98e6d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:58.876102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b78d9-84dc-4e2d-ad42-e1dba98e6d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:58.879428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b78d9-84dc-4e2d-ad42-e1dba98e6d3e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:58.892286 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3737/7563] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:15:58 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:58.896888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565157-3e0a-4ba8-87a0-f0a54a36b606 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:58.909131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565157-3e0a-4ba8-87a0-f0a54a36b606 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:58.917508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eec81c-7344-4e32-83a2-4409f37c4571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:58.918609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eec81c-7344-4e32-83a2-4409f37c4571 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:58.918894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eec81c-7344-4e32-83a2-4409f37c4571 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:58.920023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eec81c-7344-4e32-83a2-4409f37c4571 admin admin] PATH_INFO: `/v3/projects/a4cb7730681e47a1b248895495a90e4b/users/82f778cd26294cf3805378271bdd1e87/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:58.922912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eec81c-7344-4e32-83a2-4409f37c4571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4cb7730681e47a1b248895495a90e4b, user_id=82f778cd26294cf3805378271bdd1e87, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:58.926948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eec81c-7344-4e32-83a2-4409f37c4571 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:58.952495 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3827/7564] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:15:58 2021] PUT /identity/v3/projects/a4cb7730681e47a1b248895495a90e4b/users/82f778cd26294cf3805378271bdd1e87/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:15:58.964004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9292f5-c08d-481b-9db3-02893e104bda None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:58.964533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9292f5-c08d-481b-9db3-02893e104bda None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:58.964815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9292f5-c08d-481b-9db3-02893e104bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:59.003587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2f9292f5-c08d-481b-9db3-02893e104bda None None] MFA Rules not processed for user `82f778cd26294cf3805378271bdd1e87`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:15:59.005203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2f9292f5-c08d-481b-9db3-02893e104bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:15:59.142286 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3738/7565] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:15:58 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:15:59.147893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eec81c-7344-4e32-83a2-4409f37c4571 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:59.178975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eec81c-7344-4e32-83a2-4409f37c4571 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:59.196061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010928e-67b0-4beb-b1d0-c266c2e4031b tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f778cd26294cf3805378271bdd1e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4cb7730681e47a1b248895495a90e4b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:59.197992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010928e-67b0-4beb-b1d0-c266c2e4031b tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:59.198499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010928e-67b0-4beb-b1d0-c266c2e4031b tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:59.198618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010928e-67b0-4beb-b1d0-c266c2e4031b tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] PATH_INFO: `/v3/projects/863f070438304159bdda33d864fc0ef5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:59.200662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010928e-67b0-4beb-b1d0-c266c2e4031b tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorizing `identity:get_project(project_id=863f070438304159bdda33d864fc0ef5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:59.203187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010928e-67b0-4beb-b1d0-c266c2e4031b tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:59.206979 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3828/7566] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:15:59 2021] GET /identity/v3/projects/863f070438304159bdda33d864fc0ef5 => generated 389 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:15:59.211297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9292f5-c08d-481b-9db3-02893e104bda None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:59.222492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9292f5-c08d-481b-9db3-02893e104bda None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:59.230286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dd986-0a76-463f-88dd-c72978988024 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f778cd26294cf3805378271bdd1e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4cb7730681e47a1b248895495a90e4b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:59.231269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dd986-0a76-463f-88dd-c72978988024 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:59.231558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dd986-0a76-463f-88dd-c72978988024 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:59.231861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dd986-0a76-463f-88dd-c72978988024 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:59.232579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1dd986-0a76-463f-88dd-c72978988024 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:59.237275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1dd986-0a76-463f-88dd-c72978988024 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:59.318548 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3739/7567] 10.222.0.13 () {60 vars in 1151 bytes} [Sat Dec 18 21:15:59 2021] POST /identity/v3/projects => generated 339 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:15:59.321615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010928e-67b0-4beb-b1d0-c266c2e4031b tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:59.338080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010928e-67b0-4beb-b1d0-c266c2e4031b tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:59.474845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9243fd-f5c3-4999-8593-3d2a34549094 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f778cd26294cf3805378271bdd1e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4cb7730681e47a1b248895495a90e4b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:59.477292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9243fd-f5c3-4999-8593-3d2a34549094 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:59.477292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9243fd-f5c3-4999-8593-3d2a34549094 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:59.477292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9243fd-f5c3-4999-8593-3d2a34549094 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:59.478870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9243fd-f5c3-4999-8593-3d2a34549094 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:59.480915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9243fd-f5c3-4999-8593-3d2a34549094 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:59.509998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dd986-0a76-463f-88dd-c72978988024 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:59.513451 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3829/7568] 10.222.0.13 () {58 vars in 1130 bytes} [Sat Dec 18 21:15:59 2021] GET /identity/v3/projects => generated 5862 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:59.522592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dd986-0a76-463f-88dd-c72978988024 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:59.528792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cb9e2-5cdf-45a0-8d02-e9527fe5afa1 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f778cd26294cf3805378271bdd1e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4cb7730681e47a1b248895495a90e4b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:59.529965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cb9e2-5cdf-45a0-8d02-e9527fe5afa1 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:59.532357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cb9e2-5cdf-45a0-8d02-e9527fe5afa1 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:59.532541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cb9e2-5cdf-45a0-8d02-e9527fe5afa1 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] PATH_INFO: `/v3/projects/863f070438304159bdda33d864fc0ef5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:59.533978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cb9e2-5cdf-45a0-8d02-e9527fe5afa1 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorizing `identity:get_project(project_id=863f070438304159bdda33d864fc0ef5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:59.537176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cb9e2-5cdf-45a0-8d02-e9527fe5afa1 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:59.539106 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3740/7569] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:15:59 2021] GET /identity/v3/projects/863f070438304159bdda33d864fc0ef5 => generated 389 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:15:59.561922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9243fd-f5c3-4999-8593-3d2a34549094 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:59.620726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9243fd-f5c3-4999-8593-3d2a34549094 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:59.628929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc606b1-1f63-4025-af89-a6457f2744ce tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f778cd26294cf3805378271bdd1e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4cb7730681e47a1b248895495a90e4b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:59.630078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc606b1-1f63-4025-af89-a6457f2744ce tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:59.630758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc606b1-1f63-4025-af89-a6457f2744ce tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:59.631260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc606b1-1f63-4025-af89-a6457f2744ce tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] PATH_INFO: `/v3/projects/198bed58d77847f7bfc0f39699fd2c26` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:59.632875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc606b1-1f63-4025-af89-a6457f2744ce tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorizing `identity:get_project(project_id=198bed58d77847f7bfc0f39699fd2c26)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:59.635234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc606b1-1f63-4025-af89-a6457f2744ce tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:59.637942 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3830/7570] 10.222.0.13 () {58 vars in 1229 bytes} [Sat Dec 18 21:15:59 2021] GET /identity/v3/projects/198bed58d77847f7bfc0f39699fd2c26 => generated 339 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:15:59.643345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cb9e2-5cdf-45a0-8d02-e9527fe5afa1 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:59.660858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cb9e2-5cdf-45a0-8d02-e9527fe5afa1 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:59.667981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a34d95-bba0-4144-ac04-6e876ccc5ba3 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f778cd26294cf3805378271bdd1e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4cb7730681e47a1b248895495a90e4b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:59.670894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a34d95-bba0-4144-ac04-6e876ccc5ba3 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:59.670894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a34d95-bba0-4144-ac04-6e876ccc5ba3 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:59.670894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a34d95-bba0-4144-ac04-6e876ccc5ba3 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:59.670894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a34d95-bba0-4144-ac04-6e876ccc5ba3 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:59.674196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a34d95-bba0-4144-ac04-6e876ccc5ba3 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:59.700907 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3741/7571] 10.222.0.13 () {58 vars in 1130 bytes} [Sat Dec 18 21:15:59 2021] GET /identity/v3/projects => generated 5862 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:15:59.706227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc606b1-1f63-4025-af89-a6457f2744ce tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:59.717471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc606b1-1f63-4025-af89-a6457f2744ce tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:59.740926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9bc83-6b3c-499b-9426-3b9ad8cec8aa tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f778cd26294cf3805378271bdd1e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4cb7730681e47a1b248895495a90e4b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:59.741839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9bc83-6b3c-499b-9426-3b9ad8cec8aa tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:59.742209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9bc83-6b3c-499b-9426-3b9ad8cec8aa tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:59.742553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9bc83-6b3c-499b-9426-3b9ad8cec8aa tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:59.743527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9bc83-6b3c-499b-9426-3b9ad8cec8aa tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:15:59.744703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9bc83-6b3c-499b-9426-3b9ad8cec8aa tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:59.746798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9bc83-6b3c-499b-9426-3b9ad8cec8aa tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:59.832130 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3831/7572] 10.222.0.13 () {58 vars in 1165 bytes} [Sat Dec 18 21:15:59 2021] GET /identity/v3/projects?domain_id=default => generated 5531 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:15:59.848874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a34d95-bba0-4144-ac04-6e876ccc5ba3 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:59.866017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a34d95-bba0-4144-ac04-6e876ccc5ba3 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:59.892044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860a731-a189-41ab-a29e-0e6ed246822e tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f778cd26294cf3805378271bdd1e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4cb7730681e47a1b248895495a90e4b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:59.892914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860a731-a189-41ab-a29e-0e6ed246822e tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:59.893217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860a731-a189-41ab-a29e-0e6ed246822e tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:59.893601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860a731-a189-41ab-a29e-0e6ed246822e tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:59.894517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860a731-a189-41ab-a29e-0e6ed246822e tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:59.896791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860a731-a189-41ab-a29e-0e6ed246822e tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:15:59.919621 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3742/7573] 10.222.0.13 () {58 vars in 1130 bytes} [Sat Dec 18 21:15:59 2021] GET /identity/v3/projects => generated 5862 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:15:59.924718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9bc83-6b3c-499b-9426-3b9ad8cec8aa tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:15:59.955336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9bc83-6b3c-499b-9426-3b9ad8cec8aa tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:15:59.965466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3155b1-31ff-46d5-bd12-72f1b0c02e36 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f778cd26294cf3805378271bdd1e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4cb7730681e47a1b248895495a90e4b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:15:59.966595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3155b1-31ff-46d5-bd12-72f1b0c02e36 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:15:59.966951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3155b1-31ff-46d5-bd12-72f1b0c02e36 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:15:59.967304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3155b1-31ff-46d5-bd12-72f1b0c02e36 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:15:59.968434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3155b1-31ff-46d5-bd12-72f1b0c02e36 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:15:59.968899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3155b1-31ff-46d5-bd12-72f1b0c02e36 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:15:59.971155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3155b1-31ff-46d5-bd12-72f1b0c02e36 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:00.008508 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3832/7574] 10.222.0.13 () {58 vars in 1165 bytes} [Sat Dec 18 21:15:59 2021] GET /identity/v3/projects?domain_id=default => generated 5531 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:00.014153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860a731-a189-41ab-a29e-0e6ed246822e tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:00.030649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860a731-a189-41ab-a29e-0e6ed246822e tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:00.040124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031bddb-fdb0-4222-a467-4fde12dce16b tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f778cd26294cf3805378271bdd1e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4cb7730681e47a1b248895495a90e4b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:00.041101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031bddb-fdb0-4222-a467-4fde12dce16b tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:00.041435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031bddb-fdb0-4222-a467-4fde12dce16b tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:00.041707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031bddb-fdb0-4222-a467-4fde12dce16b tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:00.042544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031bddb-fdb0-4222-a467-4fde12dce16b tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:00.044712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031bddb-fdb0-4222-a467-4fde12dce16b tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:00.063313 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3743/7575] 10.222.0.13 () {58 vars in 1130 bytes} [Sat Dec 18 21:16:00 2021] GET /identity/v3/projects => generated 5862 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:00.068961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3155b1-31ff-46d5-bd12-72f1b0c02e36 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:00.079441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3155b1-31ff-46d5-bd12-72f1b0c02e36 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:00.084666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22b9b6-c180-421b-9ffa-7d0fafd70601 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f778cd26294cf3805378271bdd1e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4cb7730681e47a1b248895495a90e4b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:00.085339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22b9b6-c180-421b-9ffa-7d0fafd70601 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:00.085624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22b9b6-c180-421b-9ffa-7d0fafd70601 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:00.085933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22b9b6-c180-421b-9ffa-7d0fafd70601 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:00.086740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22b9b6-c180-421b-9ffa-7d0fafd70601 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1055959814) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:00.087053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22b9b6-c180-421b-9ffa-7d0fafd70601 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:00.088919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22b9b6-c180-421b-9ffa-7d0fafd70601 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:00.106350 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3833/7576] 10.222.0.13 () {58 vars in 1231 bytes} [Sat Dec 18 21:16:00 2021] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1055959814 => generated 537 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:00.111482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031bddb-fdb0-4222-a467-4fde12dce16b tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:00.121768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031bddb-fdb0-4222-a467-4fde12dce16b tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:00.127169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb03c6-2811-4403-b3ba-5da56ee7dac0 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f778cd26294cf3805378271bdd1e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4cb7730681e47a1b248895495a90e4b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:00.128026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb03c6-2811-4403-b3ba-5da56ee7dac0 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:00.128851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb03c6-2811-4403-b3ba-5da56ee7dac0 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:00.129136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb03c6-2811-4403-b3ba-5da56ee7dac0 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] PATH_INFO: `/v3/projects/198bed58d77847f7bfc0f39699fd2c26` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:00.130370 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb03c6-2811-4403-b3ba-5da56ee7dac0 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorizing `identity:delete_project(project_id=198bed58d77847f7bfc0f39699fd2c26)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:00.132267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb03c6-2811-4403-b3ba-5da56ee7dac0 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:00.183176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c7cb03c6-2811-4403-b3ba-5da56ee7dac0 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198bed58d77847f7bfc0f39699fd2c26', 'request_id': 'req-c7cb03c6-2811-4403-b3ba-5da56ee7dac0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:00.189736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c7cb03c6-2811-4403-b3ba-5da56ee7dac0 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198bed58d77847f7bfc0f39699fd2c26', 'request_id': 'req-c7cb03c6-2811-4403-b3ba-5da56ee7dac0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:00.203158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c7cb03c6-2811-4403-b3ba-5da56ee7dac0 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198bed58d77847f7bfc0f39699fd2c26', 'request_id': 'req-c7cb03c6-2811-4403-b3ba-5da56ee7dac0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:00.221852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c7cb03c6-2811-4403-b3ba-5da56ee7dac0 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] The token cache is being invalidate because project 198bed58d77847f7bfc0f39699fd2c26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:00.223707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c7cb03c6-2811-4403-b3ba-5da56ee7dac0 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:00.224511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c7cb03c6-2811-4403-b3ba-5da56ee7dac0 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:00.230278 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3744/7577] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:00 2021] DELETE /identity/v3/projects/198bed58d77847f7bfc0f39699fd2c26 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:00.234544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22b9b6-c180-421b-9ffa-7d0fafd70601 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:00.236540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7a22b9b6-c180-421b-9ffa-7d0fafd70601 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:00.342941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22b9b6-c180-421b-9ffa-7d0fafd70601 tempest-ListProjectsStaticTestJSON-1232450429 tempest-ListProjectsStaticTestJSON-1232450429-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:00.451540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594d29b-2bdd-4805-9bcd-b1e5d4b64f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:00.453339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594d29b-2bdd-4805-9bcd-b1e5d4b64f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:00.453850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594d29b-2bdd-4805-9bcd-b1e5d4b64f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:00.454131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594d29b-2bdd-4805-9bcd-b1e5d4b64f1d admin admin] PATH_INFO: `/v3/users/c76f785c37734de0adf36215d5563990` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:00.455633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594d29b-2bdd-4805-9bcd-b1e5d4b64f1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c76f785c37734de0adf36215d5563990)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:00.458193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594d29b-2bdd-4805-9bcd-b1e5d4b64f1d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:00.505668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a594d29b-2bdd-4805-9bcd-b1e5d4b64f1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c76f785c37734de0adf36215d5563990'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:00.513526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a594d29b-2bdd-4805-9bcd-b1e5d4b64f1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c76f785c37734de0adf36215d5563990'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:00.515773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a594d29b-2bdd-4805-9bcd-b1e5d4b64f1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c76f785c37734de0adf36215d5563990'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:00.529271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a594d29b-2bdd-4805-9bcd-b1e5d4b64f1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c76f785c37734de0adf36215d5563990'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:00.536955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a594d29b-2bdd-4805-9bcd-b1e5d4b64f1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c76f785c37734de0adf36215d5563990'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:00.545975 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3834/7578] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:00 2021] DELETE /identity/v3/users/c76f785c37734de0adf36215d5563990 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:00.551850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aece5a-900e-459c-9e99-f5fa8fdb2215 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:00.552113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aece5a-900e-459c-9e99-f5fa8fdb2215 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:00.552554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aece5a-900e-459c-9e99-f5fa8fdb2215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:00.571327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-88aece5a-900e-459c-9e99-f5fa8fdb2215 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:00.572674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-88aece5a-900e-459c-9e99-f5fa8fdb2215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:00.686797 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3745/7579] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:00.703388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594d29b-2bdd-4805-9bcd-b1e5d4b64f1d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:00.703388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a594d29b-2bdd-4805-9bcd-b1e5d4b64f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:00.788438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594d29b-2bdd-4805-9bcd-b1e5d4b64f1d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:00.795359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b42d9e-6e1b-4480-85d5-18f0ff336041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:00.795359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42d9e-6e1b-4480-85d5-18f0ff336041 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:00.795746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42d9e-6e1b-4480-85d5-18f0ff336041 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:00.795861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42d9e-6e1b-4480-85d5-18f0ff336041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:00.808117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b42d9e-6e1b-4480-85d5-18f0ff336041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:00.809629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b42d9e-6e1b-4480-85d5-18f0ff336041 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:00.845225 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3835/7580] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:01.450945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aece5a-900e-459c-9e99-f5fa8fdb2215 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:01.453217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-88aece5a-900e-459c-9e99-f5fa8fdb2215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:01.468496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aece5a-900e-459c-9e99-f5fa8fdb2215 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:01.479803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca660bd-878e-487f-809f-2f4d34f0cb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:01.481351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca660bd-878e-487f-809f-2f4d34f0cb03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:01.481643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca660bd-878e-487f-809f-2f4d34f0cb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:01.482017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca660bd-878e-487f-809f-2f4d34f0cb03 admin admin] PATH_INFO: `/v3/projects/863f070438304159bdda33d864fc0ef5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:01.483662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca660bd-878e-487f-809f-2f4d34f0cb03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=863f070438304159bdda33d864fc0ef5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:01.493800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca660bd-878e-487f-809f-2f4d34f0cb03 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:01.584373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8ca660bd-878e-487f-809f-2f4d34f0cb03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863f070438304159bdda33d864fc0ef5', 'request_id': 'req-8ca660bd-878e-487f-809f-2f4d34f0cb03'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:01.601559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8ca660bd-878e-487f-809f-2f4d34f0cb03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863f070438304159bdda33d864fc0ef5', 'request_id': 'req-8ca660bd-878e-487f-809f-2f4d34f0cb03'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:01.613195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8ca660bd-878e-487f-809f-2f4d34f0cb03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863f070438304159bdda33d864fc0ef5', 'request_id': 'req-8ca660bd-878e-487f-809f-2f4d34f0cb03'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:01.667011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8ca660bd-878e-487f-809f-2f4d34f0cb03 admin admin] The token cache is being invalidate because project 863f070438304159bdda33d864fc0ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:01.668222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8ca660bd-878e-487f-809f-2f4d34f0cb03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:01.669539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8ca660bd-878e-487f-809f-2f4d34f0cb03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:01.671623 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3746/7581] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:01 2021] DELETE /identity/v3/projects/863f070438304159bdda33d864fc0ef5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:01.676050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b42d9e-6e1b-4480-85d5-18f0ff336041 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:01.691535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b42d9e-6e1b-4480-85d5-18f0ff336041 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:01.783943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7806952-dcbe-4b3d-ae91-9cf66d09206d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:01.785548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7806952-dcbe-4b3d-ae91-9cf66d09206d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:01.785840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7806952-dcbe-4b3d-ae91-9cf66d09206d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:01.786175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7806952-dcbe-4b3d-ae91-9cf66d09206d admin admin] PATH_INFO: `/v3/users/82f778cd26294cf3805378271bdd1e87` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:01.787762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7806952-dcbe-4b3d-ae91-9cf66d09206d admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f778cd26294cf3805378271bdd1e87)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:01.791164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7806952-dcbe-4b3d-ae91-9cf66d09206d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:01.859605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d7806952-dcbe-4b3d-ae91-9cf66d09206d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f778cd26294cf3805378271bdd1e87'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:01.873843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d7806952-dcbe-4b3d-ae91-9cf66d09206d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f778cd26294cf3805378271bdd1e87'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:01.876696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d7806952-dcbe-4b3d-ae91-9cf66d09206d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f778cd26294cf3805378271bdd1e87'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:01.893434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d7806952-dcbe-4b3d-ae91-9cf66d09206d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f778cd26294cf3805378271bdd1e87'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:01.906694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d7806952-dcbe-4b3d-ae91-9cf66d09206d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f778cd26294cf3805378271bdd1e87'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:01.924866 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3836/7582] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:01 2021] DELETE /identity/v3/users/82f778cd26294cf3805378271bdd1e87 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:02.244214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca660bd-878e-487f-809f-2f4d34f0cb03 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:02.245754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8ca660bd-878e-487f-809f-2f4d34f0cb03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:02.280011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca660bd-878e-487f-809f-2f4d34f0cb03 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:02.349923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4c0d9-b15e-44ae-90fe-21c5af4f6824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:02.350855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4c0d9-b15e-44ae-90fe-21c5af4f6824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:02.351140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4c0d9-b15e-44ae-90fe-21c5af4f6824 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:02.351419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4c0d9-b15e-44ae-90fe-21c5af4f6824 admin admin] PATH_INFO: `/v3/projects/a4cb7730681e47a1b248895495a90e4b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:02.352623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4c0d9-b15e-44ae-90fe-21c5af4f6824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4cb7730681e47a1b248895495a90e4b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:02.354585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4c0d9-b15e-44ae-90fe-21c5af4f6824 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:02.407924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-54c4c0d9-b15e-44ae-90fe-21c5af4f6824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4cb7730681e47a1b248895495a90e4b', 'request_id': 'req-54c4c0d9-b15e-44ae-90fe-21c5af4f6824'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:02.415738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-54c4c0d9-b15e-44ae-90fe-21c5af4f6824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4cb7730681e47a1b248895495a90e4b', 'request_id': 'req-54c4c0d9-b15e-44ae-90fe-21c5af4f6824'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:02.422422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-54c4c0d9-b15e-44ae-90fe-21c5af4f6824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4cb7730681e47a1b248895495a90e4b', 'request_id': 'req-54c4c0d9-b15e-44ae-90fe-21c5af4f6824'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:02.437667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-54c4c0d9-b15e-44ae-90fe-21c5af4f6824 admin admin] The token cache is being invalidate because project a4cb7730681e47a1b248895495a90e4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:02.438117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-54c4c0d9-b15e-44ae-90fe-21c5af4f6824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:02.439038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-54c4c0d9-b15e-44ae-90fe-21c5af4f6824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:02.440993 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3747/7583] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:02 2021] DELETE /identity/v3/projects/a4cb7730681e47a1b248895495a90e4b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:02.449227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b285e6-d382-4607-a7f5-3a43a2bda65e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:02.449606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b285e6-d382-4607-a7f5-3a43a2bda65e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:02.449985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b285e6-d382-4607-a7f5-3a43a2bda65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:02.472596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e8b285e6-d382-4607-a7f5-3a43a2bda65e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:02.474044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e8b285e6-d382-4607-a7f5-3a43a2bda65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:02.547835 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3837/7584] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:02.557486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e350b3-4b97-4684-8010-d453d224ce9a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:02.558031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e350b3-4b97-4684-8010-d453d224ce9a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:02.558336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e350b3-4b97-4684-8010-d453d224ce9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:02.601467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d4e350b3-4b97-4684-8010-d453d224ce9a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:02.602814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d4e350b3-4b97-4684-8010-d453d224ce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:02.622878 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3748/7585] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:16:02.627432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b285e6-d382-4607-a7f5-3a43a2bda65e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:02.647565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b285e6-d382-4607-a7f5-3a43a2bda65e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:02.655514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dc6de-42f4-438e-aaf1-ea0a4d88199d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:02.656761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dc6de-42f4-438e-aaf1-ea0a4d88199d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:02.657104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dc6de-42f4-438e-aaf1-ea0a4d88199d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:02.657387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dc6de-42f4-438e-aaf1-ea0a4d88199d admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:02.658780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695dc6de-42f4-438e-aaf1-ea0a4d88199d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:02.659122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695dc6de-42f4-438e-aaf1-ea0a4d88199d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:02.663735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695dc6de-42f4-438e-aaf1-ea0a4d88199d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:02.689543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e350b3-4b97-4684-8010-d453d224ce9a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:02.690350 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3838/7586] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:16:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:02.708303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e350b3-4b97-4684-8010-d453d224ce9a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:02.719778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620f0c0-597c-48c6-8af6-1e1cba69906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:02.720486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620f0c0-597c-48c6-8af6-1e1cba69906a admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:02.720969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620f0c0-597c-48c6-8af6-1e1cba69906a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:02.721245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620f0c0-597c-48c6-8af6-1e1cba69906a admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:02.722372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620f0c0-597c-48c6-8af6-1e1cba69906a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:02.724491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620f0c0-597c-48c6-8af6-1e1cba69906a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:02.775470 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3749/7587] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:02 2021] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:02.776735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dc6de-42f4-438e-aaf1-ea0a4d88199d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:02.790968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dc6de-42f4-438e-aaf1-ea0a4d88199d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:02.876313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa72521-eecd-48a3-804e-4bb126a53a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:02.877808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72521-eecd-48a3-804e-4bb126a53a55 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:02.877808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72521-eecd-48a3-804e-4bb126a53a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:02.879185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72521-eecd-48a3-804e-4bb126a53a55 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:02.880171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa72521-eecd-48a3-804e-4bb126a53a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:02.884471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa72521-eecd-48a3-804e-4bb126a53a55 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:02.919492 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3839/7588] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:02 2021] POST /identity/v3/users => generated 285 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:02.923921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620f0c0-597c-48c6-8af6-1e1cba69906a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:02.950295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620f0c0-597c-48c6-8af6-1e1cba69906a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:02.957935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa122d-7fce-4fcd-b6c9-8d5da4a912ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:02.959214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa122d-7fce-4fcd-b6c9-8d5da4a912ee admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:02.959773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa122d-7fce-4fcd-b6c9-8d5da4a912ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:02.960360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa122d-7fce-4fcd-b6c9-8d5da4a912ee admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:02.961530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa122d-7fce-4fcd-b6c9-8d5da4a912ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:02.965293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa122d-7fce-4fcd-b6c9-8d5da4a912ee admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:02.986376 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3750/7589] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:02 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:02.997631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa72521-eecd-48a3-804e-4bb126a53a55 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:03.022497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa72521-eecd-48a3-804e-4bb126a53a55 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:03.041433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7c250-9fc2-4af6-bc39-d4e05548ec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:03.042293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7c250-9fc2-4af6-bc39-d4e05548ec39 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:03.042617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7c250-9fc2-4af6-bc39-d4e05548ec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:03.042923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7c250-9fc2-4af6-bc39-d4e05548ec39 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:03.043777 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7c250-9fc2-4af6-bc39-d4e05548ec39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:03.058853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7c250-9fc2-4af6-bc39-d4e05548ec39 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:03.080154 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3840/7590] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:02 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:03.084903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa122d-7fce-4fcd-b6c9-8d5da4a912ee admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:03.097978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa122d-7fce-4fcd-b6c9-8d5da4a912ee admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:03.107758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69405f28-da04-4ffa-8af0-8f681ebdb57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:03.108867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69405f28-da04-4ffa-8af0-8f681ebdb57d admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:03.109291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69405f28-da04-4ffa-8af0-8f681ebdb57d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:03.109580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69405f28-da04-4ffa-8af0-8f681ebdb57d admin admin] PATH_INFO: `/v3/projects/9164a15de358435997c226640170f70b/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:03.144402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69405f28-da04-4ffa-8af0-8f681ebdb57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9164a15de358435997c226640170f70b, user_id=aff3ab61108b4b95bbf4a2e1d44f2fb8, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:03.147629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69405f28-da04-4ffa-8af0-8f681ebdb57d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:03.182395 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3751/7591] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:03 2021] PUT /identity/v3/projects/9164a15de358435997c226640170f70b/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:03.183468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ef24-7ce9-4139-b218-6fe59d2675a8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:03.183711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ef24-7ce9-4139-b218-6fe59d2675a8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:03.183991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ef24-7ce9-4139-b218-6fe59d2675a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:03.226373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e7b0ef24-7ce9-4139-b218-6fe59d2675a8 None None] MFA Rules not processed for user `aff3ab61108b4b95bbf4a2e1d44f2fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:03.229115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e7b0ef24-7ce9-4139-b218-6fe59d2675a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:03.330661 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3841/7592] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:03 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:16:03.335355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69405f28-da04-4ffa-8af0-8f681ebdb57d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:03.349775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69405f28-da04-4ffa-8af0-8f681ebdb57d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:03.355525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4175de4-2f2e-4d5b-a3d2-e73fec7bdaec tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff3ab61108b4b95bbf4a2e1d44f2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9164a15de358435997c226640170f70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:03.356626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4175de4-2f2e-4d5b-a3d2-e73fec7bdaec tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:03.357020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4175de4-2f2e-4d5b-a3d2-e73fec7bdaec tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:03.357418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4175de4-2f2e-4d5b-a3d2-e73fec7bdaec tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] PATH_INFO: `/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/application_credentials` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:03.358389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4175de4-2f2e-4d5b-a3d2-e73fec7bdaec tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorizing `identity:create_application_credential(user_id=aff3ab61108b4b95bbf4a2e1d44f2fb8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:03.359650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4175de4-2f2e-4d5b-a3d2-e73fec7bdaec tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:03.467030 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3752/7593] 10.222.0.13 () {60 vars in 1314 bytes} [Sat Dec 18 21:16:03 2021] POST /identity/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/application_credentials => generated 919 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:03.468390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0ef24-7ce9-4139-b218-6fe59d2675a8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:03.493616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0ef24-7ce9-4139-b218-6fe59d2675a8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:03.508661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402b383-7e3e-4551-9d24-40cefe07fd6f tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff3ab61108b4b95bbf4a2e1d44f2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9164a15de358435997c226640170f70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:03.509614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402b383-7e3e-4551-9d24-40cefe07fd6f tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:03.509899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402b383-7e3e-4551-9d24-40cefe07fd6f tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:03.510176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402b383-7e3e-4551-9d24-40cefe07fd6f tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] PATH_INFO: `/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/access_rules/10e51a1611cd4420964e5adb055d5eae` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:03.512590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402b383-7e3e-4551-9d24-40cefe07fd6f tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorizing `identity:delete_access_rule(user_id=aff3ab61108b4b95bbf4a2e1d44f2fb8, access_rule_id=10e51a1611cd4420964e5adb055d5eae)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:03.513972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402b383-7e3e-4551-9d24-40cefe07fd6f tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:03.582485 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-7402b383-7e3e-4551-9d24-40cefe07fd6f tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Dec 18 21:16:03.592985 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3842/7594] 10.222.0.13 () {58 vars in 1361 bytes} [Sat Dec 18 21:16:03 2021] DELETE /identity/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/access_rules/10e51a1611cd4420964e5adb055d5eae => generated 89 bytes in 125 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Dec 18 21:16:03.596561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4175de4-2f2e-4d5b-a3d2-e73fec7bdaec tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:03.610651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4175de4-2f2e-4d5b-a3d2-e73fec7bdaec tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:03.618219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c632469-c800-40db-9f55-430a2f5be6ef tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff3ab61108b4b95bbf4a2e1d44f2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9164a15de358435997c226640170f70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:03.619750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632469-c800-40db-9f55-430a2f5be6ef tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:03.620585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632469-c800-40db-9f55-430a2f5be6ef tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:03.620934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632469-c800-40db-9f55-430a2f5be6ef tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] PATH_INFO: `/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/application_credentials/f4965122aca9467db2fc45e6813e1764` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:03.634114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c632469-c800-40db-9f55-430a2f5be6ef tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorizing `identity:delete_application_credential(user_id=aff3ab61108b4b95bbf4a2e1d44f2fb8, application_credential_id=f4965122aca9467db2fc45e6813e1764)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:03.635687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c632469-c800-40db-9f55-430a2f5be6ef tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:03.664306 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3753/7595] 10.222.0.13 () {58 vars in 1394 bytes} [Sat Dec 18 21:16:03 2021] DELETE /identity/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/application_credentials/f4965122aca9467db2fc45e6813e1764 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:03.668228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402b383-7e3e-4551-9d24-40cefe07fd6f tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:03.681624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402b383-7e3e-4551-9d24-40cefe07fd6f tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:03.686478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a6093-263a-40a3-b5e4-8336707d0c30 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff3ab61108b4b95bbf4a2e1d44f2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9164a15de358435997c226640170f70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:03.687441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a6093-263a-40a3-b5e4-8336707d0c30 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:03.687765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a6093-263a-40a3-b5e4-8336707d0c30 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:03.688275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a6093-263a-40a3-b5e4-8336707d0c30 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] PATH_INFO: `/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/access_rules` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:03.689625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a6093-263a-40a3-b5e4-8336707d0c30 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorizing `identity:list_access_rules(user_id=aff3ab61108b4b95bbf4a2e1d44f2fb8)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:03.691533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a6093-263a-40a3-b5e4-8336707d0c30 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:03.701263 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3843/7596] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Dec 18 21:16:03 2021] GET /identity/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/access_rules => generated 369 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:03.702705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c632469-c800-40db-9f55-430a2f5be6ef tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:03.719145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c632469-c800-40db-9f55-430a2f5be6ef tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:03.724017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821da1f-bf06-46e1-a806-a9b2ffe3e0be tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff3ab61108b4b95bbf4a2e1d44f2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9164a15de358435997c226640170f70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:03.725097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821da1f-bf06-46e1-a806-a9b2ffe3e0be tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:03.725393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821da1f-bf06-46e1-a806-a9b2ffe3e0be tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:03.725684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821da1f-bf06-46e1-a806-a9b2ffe3e0be tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] PATH_INFO: `/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/access_rules/10e51a1611cd4420964e5adb055d5eae` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:03.726959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821da1f-bf06-46e1-a806-a9b2ffe3e0be tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorizing `identity:delete_access_rule(user_id=aff3ab61108b4b95bbf4a2e1d44f2fb8, access_rule_id=10e51a1611cd4420964e5adb055d5eae)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:03.728319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821da1f-bf06-46e1-a806-a9b2ffe3e0be tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:03.751176 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3754/7597] 10.222.0.13 () {58 vars in 1361 bytes} [Sat Dec 18 21:16:03 2021] DELETE /identity/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/access_rules/10e51a1611cd4420964e5adb055d5eae => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:03.755287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a6093-263a-40a3-b5e4-8336707d0c30 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:03.765168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a6093-263a-40a3-b5e4-8336707d0c30 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:03.769450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a869a32-89f3-478f-b38b-62f39af1f43d tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff3ab61108b4b95bbf4a2e1d44f2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9164a15de358435997c226640170f70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:03.770358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a869a32-89f3-478f-b38b-62f39af1f43d tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:03.770645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a869a32-89f3-478f-b38b-62f39af1f43d tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:03.770922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a869a32-89f3-478f-b38b-62f39af1f43d tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] PATH_INFO: `/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/access_rules` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:03.772200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a869a32-89f3-478f-b38b-62f39af1f43d tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorizing `identity:list_access_rules(user_id=aff3ab61108b4b95bbf4a2e1d44f2fb8)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:03.773661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a869a32-89f3-478f-b38b-62f39af1f43d tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:03.778613 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3844/7598] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Dec 18 21:16:03 2021] GET /identity/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/access_rules => generated 158 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:03.783813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821da1f-bf06-46e1-a806-a9b2ffe3e0be tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:03.793671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821da1f-bf06-46e1-a806-a9b2ffe3e0be tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:03.797885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b027562-bbdc-4158-8bee-ec331919f6f1 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff3ab61108b4b95bbf4a2e1d44f2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9164a15de358435997c226640170f70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:03.798825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b027562-bbdc-4158-8bee-ec331919f6f1 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:03.799087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b027562-bbdc-4158-8bee-ec331919f6f1 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:03.799371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b027562-bbdc-4158-8bee-ec331919f6f1 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] PATH_INFO: `/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/application_credentials` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:03.800737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b027562-bbdc-4158-8bee-ec331919f6f1 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorizing `identity:create_application_credential(user_id=aff3ab61108b4b95bbf4a2e1d44f2fb8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:03.801881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b027562-bbdc-4158-8bee-ec331919f6f1 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:03.921307 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3755/7599] 10.222.0.13 () {60 vars in 1314 bytes} [Sat Dec 18 21:16:03 2021] POST /identity/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/application_credentials => generated 921 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:03.925488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a869a32-89f3-478f-b38b-62f39af1f43d tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:03.939758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a869a32-89f3-478f-b38b-62f39af1f43d tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:03.950848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10684f9d-47d7-49b8-9261-badc250877e4 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff3ab61108b4b95bbf4a2e1d44f2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9164a15de358435997c226640170f70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:03.952560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10684f9d-47d7-49b8-9261-badc250877e4 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:03.953561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10684f9d-47d7-49b8-9261-badc250877e4 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:03.954003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10684f9d-47d7-49b8-9261-badc250877e4 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] PATH_INFO: `/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/access_rules` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:03.955614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10684f9d-47d7-49b8-9261-badc250877e4 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorizing `identity:list_access_rules(user_id=aff3ab61108b4b95bbf4a2e1d44f2fb8)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:03.958235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10684f9d-47d7-49b8-9261-badc250877e4 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:03.965505 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3845/7600] 10.222.0.13 () {58 vars in 1259 bytes} [Sat Dec 18 21:16:03 2021] GET /identity/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/access_rules => generated 369 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:03.970483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b027562-bbdc-4158-8bee-ec331919f6f1 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:03.983793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b027562-bbdc-4158-8bee-ec331919f6f1 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:03.991259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130bb18-871a-48c4-9ae0-b738b4ca8a30 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff3ab61108b4b95bbf4a2e1d44f2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9164a15de358435997c226640170f70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:03.992607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130bb18-871a-48c4-9ae0-b738b4ca8a30 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:03.992607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130bb18-871a-48c4-9ae0-b738b4ca8a30 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:03.993840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130bb18-871a-48c4-9ae0-b738b4ca8a30 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] PATH_INFO: `/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/application_credentials` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:03.994234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130bb18-871a-48c4-9ae0-b738b4ca8a30 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorizing `identity:create_application_credential(user_id=aff3ab61108b4b95bbf4a2e1d44f2fb8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:03.995514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130bb18-871a-48c4-9ae0-b738b4ca8a30 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:04.111141 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3756/7601] 10.222.0.13 () {60 vars in 1314 bytes} [Sat Dec 18 21:16:03 2021] POST /identity/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/application_credentials => generated 921 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:04.112021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10684f9d-47d7-49b8-9261-badc250877e4 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:04.126231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10684f9d-47d7-49b8-9261-badc250877e4 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:04.137104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d874740-ee23-4e5a-ab3a-6686769464de tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff3ab61108b4b95bbf4a2e1d44f2fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9164a15de358435997c226640170f70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:04.138141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d874740-ee23-4e5a-ab3a-6686769464de tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:04.138635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d874740-ee23-4e5a-ab3a-6686769464de tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:04.138996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d874740-ee23-4e5a-ab3a-6686769464de tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] PATH_INFO: `/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/access_rules/23aba2f7ec594b328f7cb1e60b43c58e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:04.142675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d874740-ee23-4e5a-ab3a-6686769464de tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorizing `identity:get_access_rule(user_id=aff3ab61108b4b95bbf4a2e1d44f2fb8, access_rule_id=23aba2f7ec594b328f7cb1e60b43c58e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:04.145895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d874740-ee23-4e5a-ab3a-6686769464de tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:04.156609 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3846/7602] 10.222.0.13 () {58 vars in 1358 bytes} [Sat Dec 18 21:16:04 2021] GET /identity/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8/access_rules/23aba2f7ec594b328f7cb1e60b43c58e => generated 229 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:16:04.162621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130bb18-871a-48c4-9ae0-b738b4ca8a30 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:04.228449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d874740-ee23-4e5a-ab3a-6686769464de tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:04.230735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4d874740-ee23-4e5a-ab3a-6686769464de tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:04.311940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130bb18-871a-48c4-9ae0-b738b4ca8a30 tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:04.321825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e9b00-6281-456c-bc10-57218fa8309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:04.323240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e9b00-6281-456c-bc10-57218fa8309a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:04.323717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e9b00-6281-456c-bc10-57218fa8309a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:04.324246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e9b00-6281-456c-bc10-57218fa8309a admin admin] PATH_INFO: `/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:04.325904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e9b00-6281-456c-bc10-57218fa8309a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff3ab61108b4b95bbf4a2e1d44f2fb8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:04.329064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d874740-ee23-4e5a-ab3a-6686769464de tempest-AccessRulesV3Test-980501595 tempest-AccessRulesV3Test-980501595-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:04.336485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9b364-7d54-40a6-aaad-9c40b635aaa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:04.337274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9b364-7d54-40a6-aaad-9c40b635aaa3 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:04.337613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9b364-7d54-40a6-aaad-9c40b635aaa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:04.338577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9b364-7d54-40a6-aaad-9c40b635aaa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:04.340821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-44b9b364-7d54-40a6-aaad-9c40b635aaa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:04.344339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e9b00-6281-456c-bc10-57218fa8309a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:04.448904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-122e9b00-6281-456c-bc10-57218fa8309a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff3ab61108b4b95bbf4a2e1d44f2fb8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:04.464378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-122e9b00-6281-456c-bc10-57218fa8309a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff3ab61108b4b95bbf4a2e1d44f2fb8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:04.473606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9b364-7d54-40a6-aaad-9c40b635aaa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:04.475548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9b364-7d54-40a6-aaad-9c40b635aaa3 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:04.509647 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3847/7603] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:04 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:04.528896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-122e9b00-6281-456c-bc10-57218fa8309a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff3ab61108b4b95bbf4a2e1d44f2fb8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:04.530107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-122e9b00-6281-456c-bc10-57218fa8309a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff3ab61108b4b95bbf4a2e1d44f2fb8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:04.540648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-122e9b00-6281-456c-bc10-57218fa8309a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff3ab61108b4b95bbf4a2e1d44f2fb8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:04.558866 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3757/7604] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:04 2021] DELETE /identity/v3/users/aff3ab61108b4b95bbf4a2e1d44f2fb8 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:04.563680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6b94c-4120-4fac-abf1-6e4d01fdeff4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:04.564072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6b94c-4120-4fac-abf1-6e4d01fdeff4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:04.564433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6b94c-4120-4fac-abf1-6e4d01fdeff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:04.592396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fef6b94c-4120-4fac-abf1-6e4d01fdeff4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:04.593667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fef6b94c-4120-4fac-abf1-6e4d01fdeff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:04.708280 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3848/7605] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:04.742541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e9b00-6281-456c-bc10-57218fa8309a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:04.744863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-122e9b00-6281-456c-bc10-57218fa8309a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:04.838490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e9b00-6281-456c-bc10-57218fa8309a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:04.845825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a2175-1b19-4c9f-a1b2-0e639d904836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:04.846621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a2175-1b19-4c9f-a1b2-0e639d904836 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:04.847535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a2175-1b19-4c9f-a1b2-0e639d904836 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:04.847907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a2175-1b19-4c9f-a1b2-0e639d904836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:04.863385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a2175-1b19-4c9f-a1b2-0e639d904836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:04.875556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a2175-1b19-4c9f-a1b2-0e639d904836 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:04.891687 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3758/7606] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:05.296209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6b94c-4120-4fac-abf1-6e4d01fdeff4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:05.298188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fef6b94c-4120-4fac-abf1-6e4d01fdeff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:05.313176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6b94c-4120-4fac-abf1-6e4d01fdeff4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:05.319438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc8617-9bea-4e6d-a258-235a3895ccfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:05.320010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc8617-9bea-4e6d-a258-235a3895ccfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:05.320144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc8617-9bea-4e6d-a258-235a3895ccfb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:05.320401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc8617-9bea-4e6d-a258-235a3895ccfb admin admin] PATH_INFO: `/v3/projects/9164a15de358435997c226640170f70b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:05.321738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc8617-9bea-4e6d-a258-235a3895ccfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9164a15de358435997c226640170f70b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:05.323798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc8617-9bea-4e6d-a258-235a3895ccfb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:05.384258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-74cc8617-9bea-4e6d-a258-235a3895ccfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9164a15de358435997c226640170f70b', 'request_id': 'req-74cc8617-9bea-4e6d-a258-235a3895ccfb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:05.391185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-74cc8617-9bea-4e6d-a258-235a3895ccfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9164a15de358435997c226640170f70b', 'request_id': 'req-74cc8617-9bea-4e6d-a258-235a3895ccfb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:05.401341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-74cc8617-9bea-4e6d-a258-235a3895ccfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9164a15de358435997c226640170f70b', 'request_id': 'req-74cc8617-9bea-4e6d-a258-235a3895ccfb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:05.414075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-74cc8617-9bea-4e6d-a258-235a3895ccfb admin admin] The token cache is being invalidate because project 9164a15de358435997c226640170f70b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:05.414964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-74cc8617-9bea-4e6d-a258-235a3895ccfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:05.415749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-74cc8617-9bea-4e6d-a258-235a3895ccfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:05.417494 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3849/7607] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:05 2021] DELETE /identity/v3/projects/9164a15de358435997c226640170f70b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:05.423439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a220d-6777-4874-ad46-6751bd702c5e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:05.423762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a220d-6777-4874-ad46-6751bd702c5e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:05.424038 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a220d-6777-4874-ad46-6751bd702c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:05.452809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-964a220d-6777-4874-ad46-6751bd702c5e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:05.454228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-964a220d-6777-4874-ad46-6751bd702c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:05.562042 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3759/7608] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:05.572465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d20f1-0430-41f5-9a53-2d0d964a5643 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:05.572805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d20f1-0430-41f5-9a53-2d0d964a5643 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:05.573256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d20f1-0430-41f5-9a53-2d0d964a5643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:05.600748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-677d20f1-0430-41f5-9a53-2d0d964a5643 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:05.602524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-677d20f1-0430-41f5-9a53-2d0d964a5643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:05.611949 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3850/7609] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:16:05.617561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a220d-6777-4874-ad46-6751bd702c5e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:05.634427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a220d-6777-4874-ad46-6751bd702c5e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:05.641993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb50f1-2977-4a50-a40f-4c59f472acf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:05.642770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb50f1-2977-4a50-a40f-4c59f472acf9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:05.644122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb50f1-2977-4a50-a40f-4c59f472acf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:05.644611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb50f1-2977-4a50-a40f-4c59f472acf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:05.645962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb50f1-2977-4a50-a40f-4c59f472acf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:05.646531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb50f1-2977-4a50-a40f-4c59f472acf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:05.665141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb50f1-2977-4a50-a40f-4c59f472acf9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:05.690435 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3760/7610] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:16:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:05.691517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d20f1-0430-41f5-9a53-2d0d964a5643 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:05.708521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d20f1-0430-41f5-9a53-2d0d964a5643 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:05.719687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cebc4f-971c-4eef-b5af-60f89d6f71cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:05.720079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cebc4f-971c-4eef-b5af-60f89d6f71cf admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:05.720285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cebc4f-971c-4eef-b5af-60f89d6f71cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:05.720865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cebc4f-971c-4eef-b5af-60f89d6f71cf admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:05.721690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cebc4f-971c-4eef-b5af-60f89d6f71cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:05.730118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cebc4f-971c-4eef-b5af-60f89d6f71cf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:05.781007 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3851/7611] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:05 2021] POST /identity/v3/projects => generated 387 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:05.782611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb50f1-2977-4a50-a40f-4c59f472acf9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:05.797890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb50f1-2977-4a50-a40f-4c59f472acf9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:05.885200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97bb1a-76ac-4357-a1c3-80f17074f6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:05.886425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97bb1a-76ac-4357-a1c3-80f17074f6eb admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:05.886947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97bb1a-76ac-4357-a1c3-80f17074f6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:05.887876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97bb1a-76ac-4357-a1c3-80f17074f6eb admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:05.888872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97bb1a-76ac-4357-a1c3-80f17074f6eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:05.891417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97bb1a-76ac-4357-a1c3-80f17074f6eb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:05.923179 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3761/7612] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:05 2021] POST /identity/v3/users => generated 300 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:05.928962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cebc4f-971c-4eef-b5af-60f89d6f71cf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:05.943770 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cebc4f-971c-4eef-b5af-60f89d6f71cf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:05.950801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a142b-1e66-40e8-af1a-ae7bb2076a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:05.951853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a142b-1e66-40e8-af1a-ae7bb2076a33 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:05.952387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a142b-1e66-40e8-af1a-ae7bb2076a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:05.952962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a142b-1e66-40e8-af1a-ae7bb2076a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:05.954435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a142b-1e66-40e8-af1a-ae7bb2076a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:05.956554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a142b-1e66-40e8-af1a-ae7bb2076a33 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:05.979755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97bb1a-76ac-4357-a1c3-80f17074f6eb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:05.980000 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3852/7613] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:05 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:05.992291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97bb1a-76ac-4357-a1c3-80f17074f6eb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:06.007815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a7f2d-0fe7-45ea-b2c6-e6bebb7a2e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:06.009237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a7f2d-0fe7-45ea-b2c6-e6bebb7a2e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:06.009694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a7f2d-0fe7-45ea-b2c6-e6bebb7a2e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:06.010208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a7f2d-0fe7-45ea-b2c6-e6bebb7a2e9c admin admin] PATH_INFO: `/v3/projects/9a2a7fe7ecb14f92a951153e19a88cd6/users/9b7d29916ee24f9fa7f69486ab6e4324/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:06.043208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a7f2d-0fe7-45ea-b2c6-e6bebb7a2e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2a7fe7ecb14f92a951153e19a88cd6, user_id=9b7d29916ee24f9fa7f69486ab6e4324, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:06.046982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a7f2d-0fe7-45ea-b2c6-e6bebb7a2e9c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:06.080391 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3762/7614] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:05 2021] PUT /identity/v3/projects/9a2a7fe7ecb14f92a951153e19a88cd6/users/9b7d29916ee24f9fa7f69486ab6e4324/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:06.085007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a142b-1e66-40e8-af1a-ae7bb2076a33 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:06.099493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a142b-1e66-40e8-af1a-ae7bb2076a33 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:06.172723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053512e5-fd26-46af-97b4-52e3b934de50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:06.174137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053512e5-fd26-46af-97b4-52e3b934de50 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:06.174682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053512e5-fd26-46af-97b4-52e3b934de50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:06.175445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053512e5-fd26-46af-97b4-52e3b934de50 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:06.176616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053512e5-fd26-46af-97b4-52e3b934de50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:06.179157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053512e5-fd26-46af-97b4-52e3b934de50 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:06.199559 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3853/7615] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:06 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:06.200496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a7f2d-0fe7-45ea-b2c6-e6bebb7a2e9c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:06.214828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a7f2d-0fe7-45ea-b2c6-e6bebb7a2e9c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:06.223674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a4843-8d2d-4595-a15b-a97e76bc7e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:06.225116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a4843-8d2d-4595-a15b-a97e76bc7e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:06.225401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a4843-8d2d-4595-a15b-a97e76bc7e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:06.226012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a4843-8d2d-4595-a15b-a97e76bc7e64 admin admin] PATH_INFO: `/v3/projects/9a2a7fe7ecb14f92a951153e19a88cd6/users/9b7d29916ee24f9fa7f69486ab6e4324/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:06.229933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a4843-8d2d-4595-a15b-a97e76bc7e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2a7fe7ecb14f92a951153e19a88cd6, user_id=9b7d29916ee24f9fa7f69486ab6e4324, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:06.233149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a4843-8d2d-4595-a15b-a97e76bc7e64 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:06.248671 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3763/7616] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:06 2021] PUT /identity/v3/projects/9a2a7fe7ecb14f92a951153e19a88cd6/users/9b7d29916ee24f9fa7f69486ab6e4324/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:06.260868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754c464-35ec-418e-b7db-7fa58d221213 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:06.261156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754c464-35ec-418e-b7db-7fa58d221213 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:06.261466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754c464-35ec-418e-b7db-7fa58d221213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:06.309934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a754c464-35ec-418e-b7db-7fa58d221213 None None] MFA Rules not processed for user `9b7d29916ee24f9fa7f69486ab6e4324`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:06.311527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a754c464-35ec-418e-b7db-7fa58d221213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:06.415746 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3854/7617] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:06 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:06.420613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a4843-8d2d-4595-a15b-a97e76bc7e64 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:06.513044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a4843-8d2d-4595-a15b-a97e76bc7e64 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:06.519303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96720172-cd0c-450a-a748-44af1ea024f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:06.520068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96720172-cd0c-450a-a748-44af1ea024f1 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:06.520559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96720172-cd0c-450a-a748-44af1ea024f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:06.521202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96720172-cd0c-450a-a748-44af1ea024f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:06.522287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96720172-cd0c-450a-a748-44af1ea024f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:06.524752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96720172-cd0c-450a-a748-44af1ea024f1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:06.583681 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3764/7618] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:06 2021] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:06.587483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754c464-35ec-418e-b7db-7fa58d221213 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:06.638017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754c464-35ec-418e-b7db-7fa58d221213 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:06.746119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc16a5-4936-4df2-a7e5-9e77e429baba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:06.747054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc16a5-4936-4df2-a7e5-9e77e429baba admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:06.747571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc16a5-4936-4df2-a7e5-9e77e429baba admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:06.748132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc16a5-4936-4df2-a7e5-9e77e429baba admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:06.749290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc16a5-4936-4df2-a7e5-9e77e429baba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:06.751725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc16a5-4936-4df2-a7e5-9e77e429baba admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:06.779961 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3855/7619] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:06 2021] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:06.781988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96720172-cd0c-450a-a748-44af1ea024f1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:06.796199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96720172-cd0c-450a-a748-44af1ea024f1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:06.806501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109658b9-dc3d-48ac-8a0d-cb10ccc29908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:06.808176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109658b9-dc3d-48ac-8a0d-cb10ccc29908 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:06.808691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109658b9-dc3d-48ac-8a0d-cb10ccc29908 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:06.809236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109658b9-dc3d-48ac-8a0d-cb10ccc29908 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:06.810546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109658b9-dc3d-48ac-8a0d-cb10ccc29908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:06.812616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109658b9-dc3d-48ac-8a0d-cb10ccc29908 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:06.832790 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3765/7620] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:06 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:06.837063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc16a5-4936-4df2-a7e5-9e77e429baba admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:06.853471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc16a5-4936-4df2-a7e5-9e77e429baba admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:06.861351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aad1d4-d6fb-4d5f-a740-b65d5de18b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:06.861945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aad1d4-d6fb-4d5f-a740-b65d5de18b65 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:06.862888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aad1d4-d6fb-4d5f-a740-b65d5de18b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:06.863242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aad1d4-d6fb-4d5f-a740-b65d5de18b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:06.864368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aad1d4-d6fb-4d5f-a740-b65d5de18b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:06.865993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aad1d4-d6fb-4d5f-a740-b65d5de18b65 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:06.888680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109658b9-dc3d-48ac-8a0d-cb10ccc29908 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:06.894894 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3856/7621] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:06 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:06.906923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109658b9-dc3d-48ac-8a0d-cb10ccc29908 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:06.915229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcc66b-3b35-4467-92b9-b01a455f67ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:06.916873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcc66b-3b35-4467-92b9-b01a455f67ec admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:06.917467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcc66b-3b35-4467-92b9-b01a455f67ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:06.918539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcc66b-3b35-4467-92b9-b01a455f67ec admin admin] PATH_INFO: `/v3/projects/d676c8f24721420e9ab88bbe1cfc0bff/users/bd83d505290f437bb339df3f33f4f454/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:06.948034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcc66b-3b35-4467-92b9-b01a455f67ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d676c8f24721420e9ab88bbe1cfc0bff, user_id=bd83d505290f437bb339df3f33f4f454, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:06.951714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcc66b-3b35-4467-92b9-b01a455f67ec admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:06.980860 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3766/7622] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:06 2021] PUT /identity/v3/projects/d676c8f24721420e9ab88bbe1cfc0bff/users/bd83d505290f437bb339df3f33f4f454/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:06.993973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810aedcd-2fbf-4581-835b-805b13d653e4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:06.994386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810aedcd-2fbf-4581-835b-805b13d653e4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:06.994599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810aedcd-2fbf-4581-835b-805b13d653e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:07.040562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-810aedcd-2fbf-4581-835b-805b13d653e4 None None] MFA Rules not processed for user `bd83d505290f437bb339df3f33f4f454`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:07.044355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-810aedcd-2fbf-4581-835b-805b13d653e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:07.242105 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3857/7623] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:06 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:07.263077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcc66b-3b35-4467-92b9-b01a455f67ec admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:07.266923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-98fcc66b-3b35-4467-92b9-b01a455f67ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:07.401795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcc66b-3b35-4467-92b9-b01a455f67ec admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:07.420089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ee9c4-728d-4ca1-ac72-27c749a654cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:07.428270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ee9c4-728d-4ca1-ac72-27c749a654cf service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:07.428804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ee9c4-728d-4ca1-ac72-27c749a654cf service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:07.429303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ee9c4-728d-4ca1-ac72-27c749a654cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:07.618759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ee9c4-728d-4ca1-ac72-27c749a654cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:07.622675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ee9c4-728d-4ca1-ac72-27c749a654cf service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:07.640091 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3767/7624] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:07 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:08.106813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810aedcd-2fbf-4581-835b-805b13d653e4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:08.263375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810aedcd-2fbf-4581-835b-805b13d653e4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:08.274757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddaf8d-8dc7-471a-833a-ac2eaba32c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:08.278660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddaf8d-8dc7-471a-833a-ac2eaba32c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:08.278949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddaf8d-8dc7-471a-833a-ac2eaba32c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:08.279246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddaf8d-8dc7-471a-833a-ac2eaba32c77 admin admin] PATH_INFO: `/v3/users/9b7d29916ee24f9fa7f69486ab6e4324` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:08.280713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddaf8d-8dc7-471a-833a-ac2eaba32c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b7d29916ee24f9fa7f69486ab6e4324)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:08.284610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddaf8d-8dc7-471a-833a-ac2eaba32c77 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:08.457779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ffddaf8d-8dc7-471a-833a-ac2eaba32c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b7d29916ee24f9fa7f69486ab6e4324'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:08.491108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ffddaf8d-8dc7-471a-833a-ac2eaba32c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b7d29916ee24f9fa7f69486ab6e4324'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:08.492417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ffddaf8d-8dc7-471a-833a-ac2eaba32c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b7d29916ee24f9fa7f69486ab6e4324'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:08.518090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ffddaf8d-8dc7-471a-833a-ac2eaba32c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b7d29916ee24f9fa7f69486ab6e4324'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:08.532746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ffddaf8d-8dc7-471a-833a-ac2eaba32c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b7d29916ee24f9fa7f69486ab6e4324'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:08.561137 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3858/7625] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:08 2021] DELETE /identity/v3/users/9b7d29916ee24f9fa7f69486ab6e4324 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:08.566489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493cf82-6af3-4fd0-a8e6-60cc43052c1f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:08.567090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493cf82-6af3-4fd0-a8e6-60cc43052c1f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:08.567090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493cf82-6af3-4fd0-a8e6-60cc43052c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:08.596006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5493cf82-6af3-4fd0-a8e6-60cc43052c1f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:08.597385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5493cf82-6af3-4fd0-a8e6-60cc43052c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:08.764112 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3768/7626] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:08.786752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddaf8d-8dc7-471a-833a-ac2eaba32c77 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:08.788696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ffddaf8d-8dc7-471a-833a-ac2eaba32c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:08.908411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddaf8d-8dc7-471a-833a-ac2eaba32c77 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:08.919423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14f1af-1637-4d8a-8c91-148ddbc2bc84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:08.925454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14f1af-1637-4d8a-8c91-148ddbc2bc84 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:08.926159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14f1af-1637-4d8a-8c91-148ddbc2bc84 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:08.931016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14f1af-1637-4d8a-8c91-148ddbc2bc84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:08.946671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14f1af-1637-4d8a-8c91-148ddbc2bc84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:08.948499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14f1af-1637-4d8a-8c91-148ddbc2bc84 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:08.960679 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3859/7627] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:09.498532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493cf82-6af3-4fd0-a8e6-60cc43052c1f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:09.501206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5493cf82-6af3-4fd0-a8e6-60cc43052c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:09.518224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493cf82-6af3-4fd0-a8e6-60cc43052c1f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:09.524302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306859d1-ebb7-45c4-aa97-83a184072760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:09.525309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306859d1-ebb7-45c4-aa97-83a184072760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:09.525650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306859d1-ebb7-45c4-aa97-83a184072760 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:09.526010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306859d1-ebb7-45c4-aa97-83a184072760 admin admin] PATH_INFO: `/v3/projects/9a2a7fe7ecb14f92a951153e19a88cd6` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:09.527143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306859d1-ebb7-45c4-aa97-83a184072760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a2a7fe7ecb14f92a951153e19a88cd6)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:09.529333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306859d1-ebb7-45c4-aa97-83a184072760 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:09.678642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-306859d1-ebb7-45c4-aa97-83a184072760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a2a7fe7ecb14f92a951153e19a88cd6', 'request_id': 'req-306859d1-ebb7-45c4-aa97-83a184072760'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:09.696933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-306859d1-ebb7-45c4-aa97-83a184072760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a2a7fe7ecb14f92a951153e19a88cd6', 'request_id': 'req-306859d1-ebb7-45c4-aa97-83a184072760'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:09.703869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-306859d1-ebb7-45c4-aa97-83a184072760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a2a7fe7ecb14f92a951153e19a88cd6', 'request_id': 'req-306859d1-ebb7-45c4-aa97-83a184072760'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:09.729376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-306859d1-ebb7-45c4-aa97-83a184072760 admin admin] The token cache is being invalidate because project 9a2a7fe7ecb14f92a951153e19a88cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:09.729832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-306859d1-ebb7-45c4-aa97-83a184072760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:09.730862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-306859d1-ebb7-45c4-aa97-83a184072760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:09.734136 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3769/7628] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:09 2021] DELETE /identity/v3/projects/9a2a7fe7ecb14f92a951153e19a88cd6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:09.738233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14f1af-1637-4d8a-8c91-148ddbc2bc84 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:09.771069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14f1af-1637-4d8a-8c91-148ddbc2bc84 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:09.882009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa7d15-41bf-4290-8c57-9d3187ef1149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:09.883125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa7d15-41bf-4290-8c57-9d3187ef1149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:09.883568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa7d15-41bf-4290-8c57-9d3187ef1149 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:09.883919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa7d15-41bf-4290-8c57-9d3187ef1149 admin admin] PATH_INFO: `/v3/users/bd83d505290f437bb339df3f33f4f454` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:09.897173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa7d15-41bf-4290-8c57-9d3187ef1149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd83d505290f437bb339df3f33f4f454)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:09.899333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa7d15-41bf-4290-8c57-9d3187ef1149 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:09.997162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f4aa7d15-41bf-4290-8c57-9d3187ef1149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd83d505290f437bb339df3f33f4f454'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:10.006236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f4aa7d15-41bf-4290-8c57-9d3187ef1149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd83d505290f437bb339df3f33f4f454'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:10.007574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f4aa7d15-41bf-4290-8c57-9d3187ef1149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd83d505290f437bb339df3f33f4f454'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:10.032292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f4aa7d15-41bf-4290-8c57-9d3187ef1149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd83d505290f437bb339df3f33f4f454'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:10.043730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f4aa7d15-41bf-4290-8c57-9d3187ef1149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd83d505290f437bb339df3f33f4f454'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:10.054328 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3860/7629] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:09 2021] DELETE /identity/v3/users/bd83d505290f437bb339df3f33f4f454 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:10.556690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306859d1-ebb7-45c4-aa97-83a184072760 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:10.558520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-306859d1-ebb7-45c4-aa97-83a184072760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:10.579132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306859d1-ebb7-45c4-aa97-83a184072760 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:10.697306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ad37f-76cb-4c6d-9a30-edb2cd11baf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:10.698888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad37f-76cb-4c6d-9a30-edb2cd11baf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:10.698888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad37f-76cb-4c6d-9a30-edb2cd11baf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:10.699189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad37f-76cb-4c6d-9a30-edb2cd11baf4 admin admin] PATH_INFO: `/v3/projects/d676c8f24721420e9ab88bbe1cfc0bff` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:10.700146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ad37f-76cb-4c6d-9a30-edb2cd11baf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d676c8f24721420e9ab88bbe1cfc0bff)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:10.702062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ad37f-76cb-4c6d-9a30-edb2cd11baf4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:10.805455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bb9ad37f-76cb-4c6d-9a30-edb2cd11baf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd676c8f24721420e9ab88bbe1cfc0bff', 'request_id': 'req-bb9ad37f-76cb-4c6d-9a30-edb2cd11baf4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:10.814237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bb9ad37f-76cb-4c6d-9a30-edb2cd11baf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd676c8f24721420e9ab88bbe1cfc0bff', 'request_id': 'req-bb9ad37f-76cb-4c6d-9a30-edb2cd11baf4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:10.825999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bb9ad37f-76cb-4c6d-9a30-edb2cd11baf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd676c8f24721420e9ab88bbe1cfc0bff', 'request_id': 'req-bb9ad37f-76cb-4c6d-9a30-edb2cd11baf4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:10.860278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bb9ad37f-76cb-4c6d-9a30-edb2cd11baf4 admin admin] The token cache is being invalidate because project d676c8f24721420e9ab88bbe1cfc0bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:10.860581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bb9ad37f-76cb-4c6d-9a30-edb2cd11baf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:10.862066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bb9ad37f-76cb-4c6d-9a30-edb2cd11baf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:10.867575 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3770/7630] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:10 2021] DELETE /identity/v3/projects/d676c8f24721420e9ab88bbe1cfc0bff => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:10.875204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ef772-ea6f-4793-a518-876613a69d87 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:10.875725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ef772-ea6f-4793-a518-876613a69d87 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:10.875881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ef772-ea6f-4793-a518-876613a69d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:10.926781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-775ef772-ea6f-4793-a518-876613a69d87 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:10.929479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-775ef772-ea6f-4793-a518-876613a69d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:11.077150 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3861/7631] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:16:11.089471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6a100-a7fb-495a-8001-4c7a170d60fb None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:11.089769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6a100-a7fb-495a-8001-4c7a170d60fb None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:11.090045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6a100-a7fb-495a-8001-4c7a170d60fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:11.131597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-55e6a100-a7fb-495a-8001-4c7a170d60fb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:11.132934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-55e6a100-a7fb-495a-8001-4c7a170d60fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:11.151838 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3771/7632] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:11.154608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ef772-ea6f-4793-a518-876613a69d87 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:11.186097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ef772-ea6f-4793-a518-876613a69d87 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:11.199830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d606f25-370f-4c6b-ad9e-7ddbf98fab56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:11.200873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d606f25-370f-4c6b-ad9e-7ddbf98fab56 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:11.201430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d606f25-370f-4c6b-ad9e-7ddbf98fab56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:11.201866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d606f25-370f-4c6b-ad9e-7ddbf98fab56 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:11.202965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d606f25-370f-4c6b-ad9e-7ddbf98fab56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:11.203945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d606f25-370f-4c6b-ad9e-7ddbf98fab56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:11.206306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d606f25-370f-4c6b-ad9e-7ddbf98fab56 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:11.232344 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3862/7633] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:16:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:11.232928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6a100-a7fb-495a-8001-4c7a170d60fb None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:11.248695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6a100-a7fb-495a-8001-4c7a170d60fb None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:11.261000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783b896-6a36-4365-a29e-6e2b1c5c672e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:11.261898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b896-6a36-4365-a29e-6e2b1c5c672e admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:11.263157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b896-6a36-4365-a29e-6e2b1c5c672e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:11.263760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b896-6a36-4365-a29e-6e2b1c5c672e admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:11.265981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783b896-6a36-4365-a29e-6e2b1c5c672e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:11.268526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783b896-6a36-4365-a29e-6e2b1c5c672e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:11.302292 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3772/7634] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:11 2021] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:11.305351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d606f25-370f-4c6b-ad9e-7ddbf98fab56 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:11.317244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d606f25-370f-4c6b-ad9e-7ddbf98fab56 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:11.382877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc42e6-7bb4-4d0a-89b7-2695bf7a8210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:11.383604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc42e6-7bb4-4d0a-89b7-2695bf7a8210 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:11.383925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc42e6-7bb4-4d0a-89b7-2695bf7a8210 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:11.384254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc42e6-7bb4-4d0a-89b7-2695bf7a8210 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:11.384957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc42e6-7bb4-4d0a-89b7-2695bf7a8210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:11.387027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc42e6-7bb4-4d0a-89b7-2695bf7a8210 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:11.412644 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3863/7635] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:11 2021] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:11.414455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783b896-6a36-4365-a29e-6e2b1c5c672e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:11.428517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783b896-6a36-4365-a29e-6e2b1c5c672e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:11.435778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd63ad3-92f6-404e-9a6b-dc3f77fdbff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:11.436578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd63ad3-92f6-404e-9a6b-dc3f77fdbff6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:11.436869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd63ad3-92f6-404e-9a6b-dc3f77fdbff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:11.437187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd63ad3-92f6-404e-9a6b-dc3f77fdbff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:11.437958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd63ad3-92f6-404e-9a6b-dc3f77fdbff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:11.439873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd63ad3-92f6-404e-9a6b-dc3f77fdbff6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:11.458339 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3773/7636] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:11 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:11.460593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc42e6-7bb4-4d0a-89b7-2695bf7a8210 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:11.471442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc42e6-7bb4-4d0a-89b7-2695bf7a8210 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:11.477679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d1349-0d0a-4d58-b75f-dd964b927612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:11.478356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d1349-0d0a-4d58-b75f-dd964b927612 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:11.478639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d1349-0d0a-4d58-b75f-dd964b927612 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:11.478910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d1349-0d0a-4d58-b75f-dd964b927612 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:11.479650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d1349-0d0a-4d58-b75f-dd964b927612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:11.481276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d1349-0d0a-4d58-b75f-dd964b927612 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:11.511382 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3864/7637] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:11 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:16:11.515786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd63ad3-92f6-404e-9a6b-dc3f77fdbff6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:11.527413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd63ad3-92f6-404e-9a6b-dc3f77fdbff6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:11.548857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3782c-0870-4d1d-8905-070d33343e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:11.550713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3782c-0870-4d1d-8905-070d33343e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:11.550851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3782c-0870-4d1d-8905-070d33343e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:11.551068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3782c-0870-4d1d-8905-070d33343e92 admin admin] PATH_INFO: `/v3/projects/e9d79076b8be4c1cab18d75c414b39c1/users/720450804dd347ed8c75b06d046b2ab6/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:11.580048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3782c-0870-4d1d-8905-070d33343e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d79076b8be4c1cab18d75c414b39c1, user_id=720450804dd347ed8c75b06d046b2ab6, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:11.583126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3782c-0870-4d1d-8905-070d33343e92 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:11.607441 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3774/7638] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:11 2021] PUT /identity/v3/projects/e9d79076b8be4c1cab18d75c414b39c1/users/720450804dd347ed8c75b06d046b2ab6/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:11.622313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08744941-6f11-4f49-9972-f71912edbdab None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:11.622999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08744941-6f11-4f49-9972-f71912edbdab None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:11.623511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08744941-6f11-4f49-9972-f71912edbdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:11.666819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-08744941-6f11-4f49-9972-f71912edbdab None None] MFA Rules not processed for user `720450804dd347ed8c75b06d046b2ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:11.668915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-08744941-6f11-4f49-9972-f71912edbdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:11.784843 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3865/7639] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:11 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:11.804117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3782c-0870-4d1d-8905-070d33343e92 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:11.806325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d0c3782c-0870-4d1d-8905-070d33343e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:11.906009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3782c-0870-4d1d-8905-070d33343e92 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:11.910522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b70a4b-49ab-48e4-b626-7ab7dce6deed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:11.911336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b70a4b-49ab-48e4-b626-7ab7dce6deed service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:11.911719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b70a4b-49ab-48e4-b626-7ab7dce6deed service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:11.912096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b70a4b-49ab-48e4-b626-7ab7dce6deed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:11.921808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b70a4b-49ab-48e4-b626-7ab7dce6deed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:11.923437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b70a4b-49ab-48e4-b626-7ab7dce6deed service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:11.933642 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3775/7640] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:11 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:16:12.863323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08744941-6f11-4f49-9972-f71912edbdab None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:12.950556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08744941-6f11-4f49-9972-f71912edbdab None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:12.958661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bf89c-87eb-4da6-bfc6-6ad28b70534a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:12.959541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bf89c-87eb-4da6-bfc6-6ad28b70534a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:12.959858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bf89c-87eb-4da6-bfc6-6ad28b70534a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:12.960140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bf89c-87eb-4da6-bfc6-6ad28b70534a admin admin] PATH_INFO: `/v3/users/720450804dd347ed8c75b06d046b2ab6` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:12.961771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bf89c-87eb-4da6-bfc6-6ad28b70534a admin admin] RBAC: Authorizing `identity:delete_user(user_id=720450804dd347ed8c75b06d046b2ab6)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:12.964026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bf89c-87eb-4da6-bfc6-6ad28b70534a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:13.022583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f74bf89c-87eb-4da6-bfc6-6ad28b70534a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '720450804dd347ed8c75b06d046b2ab6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:13.041999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f74bf89c-87eb-4da6-bfc6-6ad28b70534a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '720450804dd347ed8c75b06d046b2ab6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:13.042990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f74bf89c-87eb-4da6-bfc6-6ad28b70534a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '720450804dd347ed8c75b06d046b2ab6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:13.060385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f74bf89c-87eb-4da6-bfc6-6ad28b70534a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '720450804dd347ed8c75b06d046b2ab6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:13.071689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f74bf89c-87eb-4da6-bfc6-6ad28b70534a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '720450804dd347ed8c75b06d046b2ab6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:13.079241 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3866/7641] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:12 2021] DELETE /identity/v3/users/720450804dd347ed8c75b06d046b2ab6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:13.083758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0860160-6514-4a75-be51-5179043bffae None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:13.084365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0860160-6514-4a75-be51-5179043bffae None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:13.084631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0860160-6514-4a75-be51-5179043bffae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:13.106326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f0860160-6514-4a75-be51-5179043bffae None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:13.108391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f0860160-6514-4a75-be51-5179043bffae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:13.188921 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3776/7642] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:13.204111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bf89c-87eb-4da6-bfc6-6ad28b70534a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:13.205367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f74bf89c-87eb-4da6-bfc6-6ad28b70534a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:13.286456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bf89c-87eb-4da6-bfc6-6ad28b70534a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:13.290371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f958b4-59e0-4e61-9b86-a094a1891598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:13.291033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f958b4-59e0-4e61-9b86-a094a1891598 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:13.291319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f958b4-59e0-4e61-9b86-a094a1891598 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:13.291599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f958b4-59e0-4e61-9b86-a094a1891598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:13.302373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f958b4-59e0-4e61-9b86-a094a1891598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:13.303918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f958b4-59e0-4e61-9b86-a094a1891598 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:13.314666 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3867/7643] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:13.938867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0860160-6514-4a75-be51-5179043bffae None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:13.941475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f0860160-6514-4a75-be51-5179043bffae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:13.977086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0860160-6514-4a75-be51-5179043bffae None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:13.983716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e028ee-1d21-433b-bb13-1d45915772b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:13.984824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e028ee-1d21-433b-bb13-1d45915772b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:13.985294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e028ee-1d21-433b-bb13-1d45915772b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:13.985575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e028ee-1d21-433b-bb13-1d45915772b7 admin admin] PATH_INFO: `/v3/projects/e9d79076b8be4c1cab18d75c414b39c1` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:13.986958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e028ee-1d21-433b-bb13-1d45915772b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d79076b8be4c1cab18d75c414b39c1)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:13.989460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e028ee-1d21-433b-bb13-1d45915772b7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:14.063721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f6e028ee-1d21-433b-bb13-1d45915772b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d79076b8be4c1cab18d75c414b39c1', 'request_id': 'req-f6e028ee-1d21-433b-bb13-1d45915772b7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:14.076844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f6e028ee-1d21-433b-bb13-1d45915772b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d79076b8be4c1cab18d75c414b39c1', 'request_id': 'req-f6e028ee-1d21-433b-bb13-1d45915772b7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:14.084611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f6e028ee-1d21-433b-bb13-1d45915772b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d79076b8be4c1cab18d75c414b39c1', 'request_id': 'req-f6e028ee-1d21-433b-bb13-1d45915772b7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:14.108171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f6e028ee-1d21-433b-bb13-1d45915772b7 admin admin] The token cache is being invalidate because project e9d79076b8be4c1cab18d75c414b39c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:14.115341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f6e028ee-1d21-433b-bb13-1d45915772b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:14.116891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f6e028ee-1d21-433b-bb13-1d45915772b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:14.119394 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3777/7644] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:13 2021] DELETE /identity/v3/projects/e9d79076b8be4c1cab18d75c414b39c1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:14.130153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c79ec3-1aeb-4998-82c5-09e3bd8fba89 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:14.130704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c79ec3-1aeb-4998-82c5-09e3bd8fba89 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:14.130806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c79ec3-1aeb-4998-82c5-09e3bd8fba89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:14.164895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-70c79ec3-1aeb-4998-82c5-09e3bd8fba89 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:14.170971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-70c79ec3-1aeb-4998-82c5-09e3bd8fba89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:14.272170 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3868/7645] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:14.274101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35acdf8-d59b-42f4-bc09-a0b73552dc25 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:14.274432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35acdf8-d59b-42f4-bc09-a0b73552dc25 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:14.274800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35acdf8-d59b-42f4-bc09-a0b73552dc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:14.313512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e35acdf8-d59b-42f4-bc09-a0b73552dc25 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:14.315401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e35acdf8-d59b-42f4-bc09-a0b73552dc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:14.328824 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3778/7646] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:14.333769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c79ec3-1aeb-4998-82c5-09e3bd8fba89 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:14.347305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c79ec3-1aeb-4998-82c5-09e3bd8fba89 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:14.358702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf8239-8adc-4522-9783-14b686a7da50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:14.359308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf8239-8adc-4522-9783-14b686a7da50 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:14.359592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf8239-8adc-4522-9783-14b686a7da50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:14.359911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf8239-8adc-4522-9783-14b686a7da50 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:14.360610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf8239-8adc-4522-9783-14b686a7da50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:14.360917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf8239-8adc-4522-9783-14b686a7da50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:14.362639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf8239-8adc-4522-9783-14b686a7da50 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:14.379391 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3869/7647] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:16:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:14.383857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35acdf8-d59b-42f4-bc09-a0b73552dc25 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:14.395274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35acdf8-d59b-42f4-bc09-a0b73552dc25 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:14.402546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b13550-1cca-4dab-aa88-4f07f8ab9979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:14.403274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b13550-1cca-4dab-aa88-4f07f8ab9979 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:14.403743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b13550-1cca-4dab-aa88-4f07f8ab9979 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:14.404204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b13550-1cca-4dab-aa88-4f07f8ab9979 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:14.405107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b13550-1cca-4dab-aa88-4f07f8ab9979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:14.408752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b13550-1cca-4dab-aa88-4f07f8ab9979 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:14.446198 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3779/7648] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:14 2021] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:14.451031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf8239-8adc-4522-9783-14b686a7da50 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:14.466745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf8239-8adc-4522-9783-14b686a7da50 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:14.543206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3a638-7d4a-4f15-85ae-7681b3a7734f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:14.544073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3a638-7d4a-4f15-85ae-7681b3a7734f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:14.544651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3a638-7d4a-4f15-85ae-7681b3a7734f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:14.544926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3a638-7d4a-4f15-85ae-7681b3a7734f admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:14.547211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3a638-7d4a-4f15-85ae-7681b3a7734f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:14.550460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3a638-7d4a-4f15-85ae-7681b3a7734f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:14.578472 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3870/7649] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:14 2021] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:14.582965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b13550-1cca-4dab-aa88-4f07f8ab9979 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:14.594822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b13550-1cca-4dab-aa88-4f07f8ab9979 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:14.600389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ce554-809e-4c04-8bca-3f68d604e979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:14.601436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ce554-809e-4c04-8bca-3f68d604e979 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:14.602049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ce554-809e-4c04-8bca-3f68d604e979 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:14.602534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ce554-809e-4c04-8bca-3f68d604e979 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:14.603670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ce554-809e-4c04-8bca-3f68d604e979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:14.605540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ce554-809e-4c04-8bca-3f68d604e979 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:14.628975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3a638-7d4a-4f15-85ae-7681b3a7734f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:14.636513 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3780/7650] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:14 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:14.642062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3a638-7d4a-4f15-85ae-7681b3a7734f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:14.649408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6645b70-e462-4a2b-8f3d-2f95c78c5375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:14.654522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6645b70-e462-4a2b-8f3d-2f95c78c5375 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:14.654830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6645b70-e462-4a2b-8f3d-2f95c78c5375 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:14.655176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6645b70-e462-4a2b-8f3d-2f95c78c5375 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:14.656359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6645b70-e462-4a2b-8f3d-2f95c78c5375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:14.658389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6645b70-e462-4a2b-8f3d-2f95c78c5375 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:14.681695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ce554-809e-4c04-8bca-3f68d604e979 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:14.689601 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3871/7651] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:14 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:14.700616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ce554-809e-4c04-8bca-3f68d604e979 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:14.712350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fa041-0b13-4f5d-b05d-7f0e697ae53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:14.713856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fa041-0b13-4f5d-b05d-7f0e697ae53e admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:14.714865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fa041-0b13-4f5d-b05d-7f0e697ae53e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:14.715421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fa041-0b13-4f5d-b05d-7f0e697ae53e admin admin] PATH_INFO: `/v3/projects/90b500db3f92424eb30304f4042a382c/users/45b88a6784144a4f85c3f2e836ce0502/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:14.740477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fa041-0b13-4f5d-b05d-7f0e697ae53e admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b500db3f92424eb30304f4042a382c, user_id=45b88a6784144a4f85c3f2e836ce0502, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:14.745133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fa041-0b13-4f5d-b05d-7f0e697ae53e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:14.764336 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3781/7652] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:14 2021] PUT /identity/v3/projects/90b500db3f92424eb30304f4042a382c/users/45b88a6784144a4f85c3f2e836ce0502/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:14.775295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d3cf7-eb55-4a7a-804a-3ff4a1b3b24b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:14.776217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d3cf7-eb55-4a7a-804a-3ff4a1b3b24b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:14.776498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d3cf7-eb55-4a7a-804a-3ff4a1b3b24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:14.828276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-969d3cf7-eb55-4a7a-804a-3ff4a1b3b24b None None] MFA Rules not processed for user `45b88a6784144a4f85c3f2e836ce0502`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:14.830416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-969d3cf7-eb55-4a7a-804a-3ff4a1b3b24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:14.976440 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3872/7653] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:14 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:14.982340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fa041-0b13-4f5d-b05d-7f0e697ae53e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:15.112463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fa041-0b13-4f5d-b05d-7f0e697ae53e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:15.122045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894982c-b81a-42b5-9d95-7e333017200a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:15.123530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894982c-b81a-42b5-9d95-7e333017200a admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:15.124053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894982c-b81a-42b5-9d95-7e333017200a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:15.124484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894982c-b81a-42b5-9d95-7e333017200a admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:15.125884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894982c-b81a-42b5-9d95-7e333017200a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:15.131961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894982c-b81a-42b5-9d95-7e333017200a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:15.200628 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3782/7654] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:14 2021] POST /identity/v3/projects => generated 381 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:15.204355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d3cf7-eb55-4a7a-804a-3ff4a1b3b24b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:15.233491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d3cf7-eb55-4a7a-804a-3ff4a1b3b24b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:15.385573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268e501-823e-494d-abe5-780c584bb70e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:15.386029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268e501-823e-494d-abe5-780c584bb70e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:15.386619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268e501-823e-494d-abe5-780c584bb70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:15.391021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbeada-87e2-4430-bf78-0f524544dbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:15.391888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbeada-87e2-4430-bf78-0f524544dbe7 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:15.392453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbeada-87e2-4430-bf78-0f524544dbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:15.392891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbeada-87e2-4430-bf78-0f524544dbe7 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:15.394286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbeada-87e2-4430-bf78-0f524544dbe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:15.398577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbeada-87e2-4430-bf78-0f524544dbe7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:15.423192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3268e501-823e-494d-abe5-780c584bb70e None None] MFA Rules not processed for user `f292f8174a7a4de5bf8a848e49f85dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:15.426660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3268e501-823e-494d-abe5-780c584bb70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:15.431788 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3873/7655] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:15 2021] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:15.435695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbeada-87e2-4430-bf78-0f524544dbe7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:15.459721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbeada-87e2-4430-bf78-0f524544dbe7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:15.468452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671e8ef-0961-4c1e-8a94-0281660efa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:15.471587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671e8ef-0961-4c1e-8a94-0281660efa37 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:15.472063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671e8ef-0961-4c1e-8a94-0281660efa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:15.472928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671e8ef-0961-4c1e-8a94-0281660efa37 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:15.473870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671e8ef-0961-4c1e-8a94-0281660efa37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:15.476460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671e8ef-0961-4c1e-8a94-0281660efa37 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:15.508682 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3874/7656] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:15 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:16:15.510482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671e8ef-0961-4c1e-8a94-0281660efa37 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:15.526539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671e8ef-0961-4c1e-8a94-0281660efa37 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:15.536582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b9c06-968e-481f-be23-c226841867f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:15.537578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9c06-968e-481f-be23-c226841867f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:15.538698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9c06-968e-481f-be23-c226841867f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:15.539281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9c06-968e-481f-be23-c226841867f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:15.540178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b9c06-968e-481f-be23-c226841867f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:15.544296 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3783/7657] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:15 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:15.544445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b9c06-968e-481f-be23-c226841867f8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:15.566594 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3875/7658] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:15 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:15.570777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268e501-823e-494d-abe5-780c584bb70e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:15.585134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268e501-823e-494d-abe5-780c584bb70e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:15.590287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76477114-415b-499d-b6bb-7eca0eb4cf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:15.591646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76477114-415b-499d-b6bb-7eca0eb4cf18 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:15.592002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76477114-415b-499d-b6bb-7eca0eb4cf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:15.592352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76477114-415b-499d-b6bb-7eca0eb4cf18 admin admin] PATH_INFO: `/v3/projects/88c52143a9ba4611adbbc1a9c1180994/users/4bc602c3b44147a3b9f70f8b0f02c4d3/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:15.623881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76477114-415b-499d-b6bb-7eca0eb4cf18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c52143a9ba4611adbbc1a9c1180994, user_id=4bc602c3b44147a3b9f70f8b0f02c4d3, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:15.629748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76477114-415b-499d-b6bb-7eca0eb4cf18 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:15.648701 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3784/7659] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:15 2021] PUT /identity/v3/projects/88c52143a9ba4611adbbc1a9c1180994/users/4bc602c3b44147a3b9f70f8b0f02c4d3/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:15.661256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ad425-f712-435e-ae1c-920e39c58e04 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:15.661945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ad425-f712-435e-ae1c-920e39c58e04 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:15.662312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ad425-f712-435e-ae1c-920e39c58e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:15.711584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a88ad425-f712-435e-ae1c-920e39c58e04 None None] MFA Rules not processed for user `4bc602c3b44147a3b9f70f8b0f02c4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:15.712985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a88ad425-f712-435e-ae1c-920e39c58e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:15.836227 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3876/7660] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:15 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:15.841457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76477114-415b-499d-b6bb-7eca0eb4cf18 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:15.939069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76477114-415b-499d-b6bb-7eca0eb4cf18 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:15.944189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca62f2-3615-4e91-806d-747d75a403b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:15.944856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca62f2-3615-4e91-806d-747d75a403b4 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:15.945139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca62f2-3615-4e91-806d-747d75a403b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:15.945420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca62f2-3615-4e91-806d-747d75a403b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:15.946148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca62f2-3615-4e91-806d-747d75a403b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:15.948164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca62f2-3615-4e91-806d-747d75a403b4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:15.987364 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3785/7661] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:15 2021] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:15.993624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ad425-f712-435e-ae1c-920e39c58e04 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:16.018056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ad425-f712-435e-ae1c-920e39c58e04 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:16.120472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405587d0-3a49-4854-9583-c7c66ba01e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:16.121171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405587d0-3a49-4854-9583-c7c66ba01e24 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:16.121460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405587d0-3a49-4854-9583-c7c66ba01e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:16.121837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405587d0-3a49-4854-9583-c7c66ba01e24 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:16.122614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405587d0-3a49-4854-9583-c7c66ba01e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:16.125289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405587d0-3a49-4854-9583-c7c66ba01e24 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:16.159213 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3877/7662] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:15 2021] POST /identity/v3/users => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:16.160547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca62f2-3615-4e91-806d-747d75a403b4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:16.187799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca62f2-3615-4e91-806d-747d75a403b4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:16.196343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207a7f5-0f60-404e-a534-293334d45872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:16.197766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207a7f5-0f60-404e-a534-293334d45872 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:16.198670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207a7f5-0f60-404e-a534-293334d45872 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:16.199152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207a7f5-0f60-404e-a534-293334d45872 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:16.200363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207a7f5-0f60-404e-a534-293334d45872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:16.203160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207a7f5-0f60-404e-a534-293334d45872 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:16.222297 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3786/7663] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:16 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:16.225837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405587d0-3a49-4854-9583-c7c66ba01e24 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:16.237917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405587d0-3a49-4854-9583-c7c66ba01e24 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:16.252402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c23ef-54e7-4615-8367-a4a645281fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:16.254676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c23ef-54e7-4615-8367-a4a645281fba admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:16.255190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c23ef-54e7-4615-8367-a4a645281fba admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:16.256259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c23ef-54e7-4615-8367-a4a645281fba admin admin] PATH_INFO: `/v3/projects/9604c1083c0e41d0a822610757350876/users/f1c492e309a743e3a3dcd6b8ecc48e88/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:16.286402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c23ef-54e7-4615-8367-a4a645281fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9604c1083c0e41d0a822610757350876, user_id=f1c492e309a743e3a3dcd6b8ecc48e88, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:16.289462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c23ef-54e7-4615-8367-a4a645281fba admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:16.309029 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3878/7664] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:16 2021] PUT /identity/v3/projects/9604c1083c0e41d0a822610757350876/users/f1c492e309a743e3a3dcd6b8ecc48e88/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:16.313878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207a7f5-0f60-404e-a534-293334d45872 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:16.338611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207a7f5-0f60-404e-a534-293334d45872 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:16.439103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da2305-3f25-46fc-895b-fb6b6a206cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:16.442037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da2305-3f25-46fc-895b-fb6b6a206cfb admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:16.442556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da2305-3f25-46fc-895b-fb6b6a206cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:16.443381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da2305-3f25-46fc-895b-fb6b6a206cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:16.443708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da2305-3f25-46fc-895b-fb6b6a206cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:16.445421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da2305-3f25-46fc-895b-fb6b6a206cfb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:16.462929 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3787/7665] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:16 2021] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:16.467214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c23ef-54e7-4615-8367-a4a645281fba admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:16.481196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c23ef-54e7-4615-8367-a4a645281fba admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:16.488690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770693f-0b1f-4b54-8725-55466bb64543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:16.489663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770693f-0b1f-4b54-8725-55466bb64543 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:16.489949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770693f-0b1f-4b54-8725-55466bb64543 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:16.490228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770693f-0b1f-4b54-8725-55466bb64543 admin admin] PATH_INFO: `/v3/projects/9604c1083c0e41d0a822610757350876/users/f1c492e309a743e3a3dcd6b8ecc48e88/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:16.497292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770693f-0b1f-4b54-8725-55466bb64543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9604c1083c0e41d0a822610757350876, user_id=f1c492e309a743e3a3dcd6b8ecc48e88, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:16.500301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770693f-0b1f-4b54-8725-55466bb64543 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:16.525167 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3879/7666] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:16 2021] PUT /identity/v3/projects/9604c1083c0e41d0a822610757350876/users/f1c492e309a743e3a3dcd6b8ecc48e88/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:16.607194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d22c78-3230-4277-9932-bee25229a813 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:16.607650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d22c78-3230-4277-9932-bee25229a813 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:16.611399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d22c78-3230-4277-9932-bee25229a813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:16.653936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-06d22c78-3230-4277-9932-bee25229a813 None None] MFA Rules not processed for user `f1c492e309a743e3a3dcd6b8ecc48e88`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:16.655392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-06d22c78-3230-4277-9932-bee25229a813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:16.759903 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3788/7667] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:16 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:16.771772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770693f-0b1f-4b54-8725-55466bb64543 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:16.775290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1770693f-0b1f-4b54-8725-55466bb64543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:16.887645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770693f-0b1f-4b54-8725-55466bb64543 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:16.893318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b70e26-f655-4341-92db-e2394dc3c6ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:16.894297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b70e26-f655-4341-92db-e2394dc3c6ff service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:16.894594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b70e26-f655-4341-92db-e2394dc3c6ff service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:16.894921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b70e26-f655-4341-92db-e2394dc3c6ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:16.967508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b70e26-f655-4341-92db-e2394dc3c6ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:16.969093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b70e26-f655-4341-92db-e2394dc3c6ff service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:16.981229 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3880/7668] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:16 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:21.797590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d22c78-3230-4277-9932-bee25229a813 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:21.799021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-06d22c78-3230-4277-9932-bee25229a813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:21.864259 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d22c78-3230-4277-9932-bee25229a813 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:21.869651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b79fe7-ed19-457a-9d0c-d50abeb8a1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:21.870681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b79fe7-ed19-457a-9d0c-d50abeb8a1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:21.870860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b79fe7-ed19-457a-9d0c-d50abeb8a1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:21.871160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b79fe7-ed19-457a-9d0c-d50abeb8a1d1 admin admin] PATH_INFO: `/v3/users/480f527dbe434218a49acb6095d4d66f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:21.872372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b79fe7-ed19-457a-9d0c-d50abeb8a1d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=480f527dbe434218a49acb6095d4d66f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:21.874313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b79fe7-ed19-457a-9d0c-d50abeb8a1d1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:21.939916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-19b79fe7-ed19-457a-9d0c-d50abeb8a1d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '480f527dbe434218a49acb6095d4d66f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:21.949527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-19b79fe7-ed19-457a-9d0c-d50abeb8a1d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '480f527dbe434218a49acb6095d4d66f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:21.967744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-19b79fe7-ed19-457a-9d0c-d50abeb8a1d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '480f527dbe434218a49acb6095d4d66f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:21.968656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-19b79fe7-ed19-457a-9d0c-d50abeb8a1d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '480f527dbe434218a49acb6095d4d66f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:21.979384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-19b79fe7-ed19-457a-9d0c-d50abeb8a1d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '480f527dbe434218a49acb6095d4d66f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:21.986125 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3789/7669] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:21 2021] DELETE /identity/v3/users/480f527dbe434218a49acb6095d4d66f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:21.990833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc30b8-2b66-4759-9abd-81c9fcc52150 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:21.991287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc30b8-2b66-4759-9abd-81c9fcc52150 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:21.991580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc30b8-2b66-4759-9abd-81c9fcc52150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:22.009303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c1fc30b8-2b66-4759-9abd-81c9fcc52150 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:22.010624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c1fc30b8-2b66-4759-9abd-81c9fcc52150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:22.075567 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3881/7670] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:22.087372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b79fe7-ed19-457a-9d0c-d50abeb8a1d1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:22.089070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-19b79fe7-ed19-457a-9d0c-d50abeb8a1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:22.149537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b79fe7-ed19-457a-9d0c-d50abeb8a1d1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:22.153204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142da68-e0c0-43bf-9a6c-08fe53ef4249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:22.153950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142da68-e0c0-43bf-9a6c-08fe53ef4249 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:22.154239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142da68-e0c0-43bf-9a6c-08fe53ef4249 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:22.154562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142da68-e0c0-43bf-9a6c-08fe53ef4249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:22.164689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142da68-e0c0-43bf-9a6c-08fe53ef4249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:22.166113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142da68-e0c0-43bf-9a6c-08fe53ef4249 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:22.176013 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3790/7671] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:22.353342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc30b8-2b66-4759-9abd-81c9fcc52150 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:22.355282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c1fc30b8-2b66-4759-9abd-81c9fcc52150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:22.368420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc30b8-2b66-4759-9abd-81c9fcc52150 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:22.374556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f3caf-26a2-4276-aa43-6c85bb8c3f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:22.375295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f3caf-26a2-4276-aa43-6c85bb8c3f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:22.375771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f3caf-26a2-4276-aa43-6c85bb8c3f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:22.376114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f3caf-26a2-4276-aa43-6c85bb8c3f3d admin admin] PATH_INFO: `/v3/projects/c3ff294c24f54faf9ba1592e4dd3ebaa` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:22.377972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f3caf-26a2-4276-aa43-6c85bb8c3f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3ff294c24f54faf9ba1592e4dd3ebaa)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:22.380238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f3caf-26a2-4276-aa43-6c85bb8c3f3d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:22.433937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5b8f3caf-26a2-4276-aa43-6c85bb8c3f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3ff294c24f54faf9ba1592e4dd3ebaa', 'request_id': 'req-5b8f3caf-26a2-4276-aa43-6c85bb8c3f3d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:22.441705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5b8f3caf-26a2-4276-aa43-6c85bb8c3f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3ff294c24f54faf9ba1592e4dd3ebaa', 'request_id': 'req-5b8f3caf-26a2-4276-aa43-6c85bb8c3f3d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:22.449921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5b8f3caf-26a2-4276-aa43-6c85bb8c3f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3ff294c24f54faf9ba1592e4dd3ebaa', 'request_id': 'req-5b8f3caf-26a2-4276-aa43-6c85bb8c3f3d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:22.462667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5b8f3caf-26a2-4276-aa43-6c85bb8c3f3d admin admin] The token cache is being invalidate because project c3ff294c24f54faf9ba1592e4dd3ebaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:22.463047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5b8f3caf-26a2-4276-aa43-6c85bb8c3f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:22.463697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-5b8f3caf-26a2-4276-aa43-6c85bb8c3f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:22.465510 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3882/7672] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:22 2021] DELETE /identity/v3/projects/c3ff294c24f54faf9ba1592e4dd3ebaa => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:22.472499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625cd95-84d8-40d3-a755-96194cf458e4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:22.473065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625cd95-84d8-40d3-a755-96194cf458e4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:22.473776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625cd95-84d8-40d3-a755-96194cf458e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:22.492757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a625cd95-84d8-40d3-a755-96194cf458e4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:22.493978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a625cd95-84d8-40d3-a755-96194cf458e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:22.566472 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3791/7673] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:22.573336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096d307-67a0-4fb9-a5c7-be19393074f1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:22.573714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096d307-67a0-4fb9-a5c7-be19393074f1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:22.573970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096d307-67a0-4fb9-a5c7-be19393074f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:22.595406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e096d307-67a0-4fb9-a5c7-be19393074f1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:22.596847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e096d307-67a0-4fb9-a5c7-be19393074f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:22.606877 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3883/7674] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:16:22.611165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625cd95-84d8-40d3-a755-96194cf458e4 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:22.629728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625cd95-84d8-40d3-a755-96194cf458e4 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:22.635729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc73dc5-f670-439a-8b66-2dc3c63af082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:22.636785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc73dc5-f670-439a-8b66-2dc3c63af082 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:22.636969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc73dc5-f670-439a-8b66-2dc3c63af082 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:22.637530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc73dc5-f670-439a-8b66-2dc3c63af082 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:22.638868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc73dc5-f670-439a-8b66-2dc3c63af082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:22.639297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc73dc5-f670-439a-8b66-2dc3c63af082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:22.641902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc73dc5-f670-439a-8b66-2dc3c63af082 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:22.666297 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3792/7675] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:16:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:22.668750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096d307-67a0-4fb9-a5c7-be19393074f1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:22.689528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096d307-67a0-4fb9-a5c7-be19393074f1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:22.700176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d493a6-39fd-4114-8abf-b4fd7d1b769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:22.701044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d493a6-39fd-4114-8abf-b4fd7d1b769b admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:22.701410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d493a6-39fd-4114-8abf-b4fd7d1b769b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:22.701765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d493a6-39fd-4114-8abf-b4fd7d1b769b admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:22.707138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d493a6-39fd-4114-8abf-b4fd7d1b769b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:22.711247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d493a6-39fd-4114-8abf-b4fd7d1b769b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:22.778740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc73dc5-f670-439a-8b66-2dc3c63af082 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:22.778932 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3884/7676] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:22 2021] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:22.792622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc73dc5-f670-439a-8b66-2dc3c63af082 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:22.874542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be42dd-3a59-4f23-81e4-313aab54a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:22.877215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be42dd-3a59-4f23-81e4-313aab54a9ec admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:22.877807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be42dd-3a59-4f23-81e4-313aab54a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:22.878363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be42dd-3a59-4f23-81e4-313aab54a9ec admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:22.879694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be42dd-3a59-4f23-81e4-313aab54a9ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:22.882843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be42dd-3a59-4f23-81e4-313aab54a9ec admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:22.918008 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3793/7677] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:22 2021] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:22.919424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d493a6-39fd-4114-8abf-b4fd7d1b769b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:22.936449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d493a6-39fd-4114-8abf-b4fd7d1b769b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:22.949361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1525-a034-4a79-9aeb-3f2ef3844975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:22.950984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1525-a034-4a79-9aeb-3f2ef3844975 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:22.951848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1525-a034-4a79-9aeb-3f2ef3844975 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:22.952314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1525-a034-4a79-9aeb-3f2ef3844975 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:22.953931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd1525-a034-4a79-9aeb-3f2ef3844975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:22.958420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd1525-a034-4a79-9aeb-3f2ef3844975 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:22.971921 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3885/7678] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:22 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:22.976385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be42dd-3a59-4f23-81e4-313aab54a9ec admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:22.993969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be42dd-3a59-4f23-81e4-313aab54a9ec admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:23.003912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5e8a8-682b-4f20-863a-2fc1a1f8f46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:23.005086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5e8a8-682b-4f20-863a-2fc1a1f8f46d admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:23.005671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5e8a8-682b-4f20-863a-2fc1a1f8f46d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:23.006933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5e8a8-682b-4f20-863a-2fc1a1f8f46d admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:23.007720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5e8a8-682b-4f20-863a-2fc1a1f8f46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:23.011164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5e8a8-682b-4f20-863a-2fc1a1f8f46d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:23.027727 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3794/7679] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:22 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:23.032128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1525-a034-4a79-9aeb-3f2ef3844975 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:23.046888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1525-a034-4a79-9aeb-3f2ef3844975 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:23.053010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda3d08-18c5-4b0d-b9bb-809e8b31bb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:23.055174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda3d08-18c5-4b0d-b9bb-809e8b31bb0f admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:23.055455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda3d08-18c5-4b0d-b9bb-809e8b31bb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:23.055734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda3d08-18c5-4b0d-b9bb-809e8b31bb0f admin admin] PATH_INFO: `/v3/projects/99059ecc40914ada8844eb4371203cac/users/0259ba697b5240bcbf4ab8f023c18cdc/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:23.075259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda3d08-18c5-4b0d-b9bb-809e8b31bb0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=99059ecc40914ada8844eb4371203cac, user_id=0259ba697b5240bcbf4ab8f023c18cdc, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:23.078324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda3d08-18c5-4b0d-b9bb-809e8b31bb0f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:23.094083 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3886/7680] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:23 2021] PUT /identity/v3/projects/99059ecc40914ada8844eb4371203cac/users/0259ba697b5240bcbf4ab8f023c18cdc/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:23.104688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1ca5b-2ac2-47de-b6fb-719151aec44e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:23.104943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1ca5b-2ac2-47de-b6fb-719151aec44e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:23.105292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1ca5b-2ac2-47de-b6fb-719151aec44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:23.141777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6dc1ca5b-2ac2-47de-b6fb-719151aec44e None None] MFA Rules not processed for user `0259ba697b5240bcbf4ab8f023c18cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:23.144374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6dc1ca5b-2ac2-47de-b6fb-719151aec44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:23.281353 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3795/7681] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:23 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:23.294364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda3d08-18c5-4b0d-b9bb-809e8b31bb0f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:23.296285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-afda3d08-18c5-4b0d-b9bb-809e8b31bb0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:23.367720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda3d08-18c5-4b0d-b9bb-809e8b31bb0f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:23.371775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f599d-feb0-431b-8ab0-4be9b2d3c957 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:23.372674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f599d-feb0-431b-8ab0-4be9b2d3c957 service glance] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:23.373032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f599d-feb0-431b-8ab0-4be9b2d3c957 service glance] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:23.373394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f599d-feb0-431b-8ab0-4be9b2d3c957 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:23.383875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f599d-feb0-431b-8ab0-4be9b2d3c957 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:23.385501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f599d-feb0-431b-8ab0-4be9b2d3c957 service glance] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:23.397688 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3887/7682] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:23 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:25.740250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1ca5b-2ac2-47de-b6fb-719151aec44e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:25.741955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6dc1ca5b-2ac2-47de-b6fb-719151aec44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:25.810696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1ca5b-2ac2-47de-b6fb-719151aec44e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:25.814591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf82c4-c07d-42fd-b10f-6a20d98efc21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:25.815250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf82c4-c07d-42fd-b10f-6a20d98efc21 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:25.815530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf82c4-c07d-42fd-b10f-6a20d98efc21 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:25.815803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf82c4-c07d-42fd-b10f-6a20d98efc21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:25.817887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bdcf82c4-c07d-42fd-b10f-6a20d98efc21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:25.882416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf82c4-c07d-42fd-b10f-6a20d98efc21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:25.883835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf82c4-c07d-42fd-b10f-6a20d98efc21 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:25.893545 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3796/7683] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:25 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:31.017152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f599d-feb0-431b-8ab0-4be9b2d3c957 service glance] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:31.018727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a15f599d-feb0-431b-8ab0-4be9b2d3c957 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:31.034192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f599d-feb0-431b-8ab0-4be9b2d3c957 service glance] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:31.037898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337da937-eb3a-4235-a8a4-91fec8dfa0e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:31.038645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337da937-eb3a-4235-a8a4-91fec8dfa0e3 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:31.038928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337da937-eb3a-4235-a8a4-91fec8dfa0e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:31.039211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337da937-eb3a-4235-a8a4-91fec8dfa0e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:31.040972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-337da937-eb3a-4235-a8a4-91fec8dfa0e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:31.102889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337da937-eb3a-4235-a8a4-91fec8dfa0e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:31.104419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337da937-eb3a-4235-a8a4-91fec8dfa0e3 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:31.114367 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3888/7684] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:31 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:37.188330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf82c4-c07d-42fd-b10f-6a20d98efc21 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:37.283602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf82c4-c07d-42fd-b10f-6a20d98efc21 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:37.292889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07801ec-6952-44b1-a92a-3d846ff16e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:37.294238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07801ec-6952-44b1-a92a-3d846ff16e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:37.295176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07801ec-6952-44b1-a92a-3d846ff16e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:37.295822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07801ec-6952-44b1-a92a-3d846ff16e36 admin admin] PATH_INFO: `/v3/users/0259ba697b5240bcbf4ab8f023c18cdc` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:37.298384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07801ec-6952-44b1-a92a-3d846ff16e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0259ba697b5240bcbf4ab8f023c18cdc)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:37.300768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07801ec-6952-44b1-a92a-3d846ff16e36 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:37.402011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b07801ec-6952-44b1-a92a-3d846ff16e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0259ba697b5240bcbf4ab8f023c18cdc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:37.418625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b07801ec-6952-44b1-a92a-3d846ff16e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0259ba697b5240bcbf4ab8f023c18cdc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:37.442801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b07801ec-6952-44b1-a92a-3d846ff16e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0259ba697b5240bcbf4ab8f023c18cdc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:37.443536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b07801ec-6952-44b1-a92a-3d846ff16e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0259ba697b5240bcbf4ab8f023c18cdc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:37.454326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b07801ec-6952-44b1-a92a-3d846ff16e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0259ba697b5240bcbf4ab8f023c18cdc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:37.463961 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3797/7685] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:37 2021] DELETE /identity/v3/users/0259ba697b5240bcbf4ab8f023c18cdc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:37.468936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30387a52-9aec-49e9-b1c7-2a4ec724cd3f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:37.472286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30387a52-9aec-49e9-b1c7-2a4ec724cd3f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:37.473997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30387a52-9aec-49e9-b1c7-2a4ec724cd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:37.502761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-30387a52-9aec-49e9-b1c7-2a4ec724cd3f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:37.504110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-30387a52-9aec-49e9-b1c7-2a4ec724cd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:37.610366 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3889/7686] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:37.622723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07801ec-6952-44b1-a92a-3d846ff16e36 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:37.624729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b07801ec-6952-44b1-a92a-3d846ff16e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:37.745526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07801ec-6952-44b1-a92a-3d846ff16e36 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:37.751563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c41963-7763-4c3a-92a8-790bf43b5fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:37.753339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c41963-7763-4c3a-92a8-790bf43b5fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:37.753633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c41963-7763-4c3a-92a8-790bf43b5fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:37.754100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c41963-7763-4c3a-92a8-790bf43b5fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:37.769529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c41963-7763-4c3a-92a8-790bf43b5fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:37.771111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c41963-7763-4c3a-92a8-790bf43b5fd4 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:37.789408 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3798/7687] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:38.202609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30387a52-9aec-49e9-b1c7-2a4ec724cd3f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:38.205741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-30387a52-9aec-49e9-b1c7-2a4ec724cd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:38.224332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30387a52-9aec-49e9-b1c7-2a4ec724cd3f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:38.232689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f22df-930d-47fe-9cc7-53c13bf95eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:38.234160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f22df-930d-47fe-9cc7-53c13bf95eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:38.235709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f22df-930d-47fe-9cc7-53c13bf95eee admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:38.236961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f22df-930d-47fe-9cc7-53c13bf95eee admin admin] PATH_INFO: `/v3/projects/99059ecc40914ada8844eb4371203cac` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:38.239279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f22df-930d-47fe-9cc7-53c13bf95eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=99059ecc40914ada8844eb4371203cac)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:38.241406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f22df-930d-47fe-9cc7-53c13bf95eee admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:38.310048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf6f22df-930d-47fe-9cc7-53c13bf95eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99059ecc40914ada8844eb4371203cac', 'request_id': 'req-bf6f22df-930d-47fe-9cc7-53c13bf95eee'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:38.318003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf6f22df-930d-47fe-9cc7-53c13bf95eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99059ecc40914ada8844eb4371203cac', 'request_id': 'req-bf6f22df-930d-47fe-9cc7-53c13bf95eee'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:38.327750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf6f22df-930d-47fe-9cc7-53c13bf95eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99059ecc40914ada8844eb4371203cac', 'request_id': 'req-bf6f22df-930d-47fe-9cc7-53c13bf95eee'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:38.340971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf6f22df-930d-47fe-9cc7-53c13bf95eee admin admin] The token cache is being invalidate because project 99059ecc40914ada8844eb4371203cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:38.341402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf6f22df-930d-47fe-9cc7-53c13bf95eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:38.342139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf6f22df-930d-47fe-9cc7-53c13bf95eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:38.343992 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3890/7688] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:38 2021] DELETE /identity/v3/projects/99059ecc40914ada8844eb4371203cac => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:38.351389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d1590-9fd4-4afc-b08e-f72cf2a39200 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:38.351968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d1590-9fd4-4afc-b08e-f72cf2a39200 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:38.352142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d1590-9fd4-4afc-b08e-f72cf2a39200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:38.373188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-010d1590-9fd4-4afc-b08e-f72cf2a39200 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:38.374581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-010d1590-9fd4-4afc-b08e-f72cf2a39200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:38.460998 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3799/7689] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:16:38.463069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52024d90-e140-432f-9d5e-04405f7628c3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:38.463365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52024d90-e140-432f-9d5e-04405f7628c3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:38.463640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52024d90-e140-432f-9d5e-04405f7628c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:38.490659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-52024d90-e140-432f-9d5e-04405f7628c3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:38.492101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-52024d90-e140-432f-9d5e-04405f7628c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:38.505708 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3891/7690] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:16:38.507307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d1590-9fd4-4afc-b08e-f72cf2a39200 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:38.520893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d1590-9fd4-4afc-b08e-f72cf2a39200 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:38.529426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693d509-c8ee-43e4-8e6e-13b95719a4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:38.530219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693d509-c8ee-43e4-8e6e-13b95719a4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:38.530612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693d509-c8ee-43e4-8e6e-13b95719a4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:38.530975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693d509-c8ee-43e4-8e6e-13b95719a4a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:38.531853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693d509-c8ee-43e4-8e6e-13b95719a4a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:38.532160 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693d509-c8ee-43e4-8e6e-13b95719a4a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:38.534971 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693d509-c8ee-43e4-8e6e-13b95719a4a5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:38.559366 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3800/7691] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:16:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:38.562387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52024d90-e140-432f-9d5e-04405f7628c3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:38.585934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52024d90-e140-432f-9d5e-04405f7628c3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:38.595509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe81b8b-90dd-4b18-9f4b-fee35ef5d7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:38.596238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe81b8b-90dd-4b18-9f4b-fee35ef5d7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:38.596608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe81b8b-90dd-4b18-9f4b-fee35ef5d7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:38.596899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe81b8b-90dd-4b18-9f4b-fee35ef5d7a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:38.598406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe81b8b-90dd-4b18-9f4b-fee35ef5d7a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:38.601146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe81b8b-90dd-4b18-9f4b-fee35ef5d7a7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:38.636479 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3892/7692] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:38 2021] POST /identity/v3/projects => generated 365 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:38.640869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693d509-c8ee-43e4-8e6e-13b95719a4a5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:38.653647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693d509-c8ee-43e4-8e6e-13b95719a4a5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:38.742836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe81b8b-90dd-4b18-9f4b-fee35ef5d7a7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:38.744220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1a814-bcd2-4f31-a9a0-5b3fe6d64c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:38.744535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1fe81b8b-90dd-4b18-9f4b-fee35ef5d7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:38.745532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1a814-bcd2-4f31-a9a0-5b3fe6d64c67 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:38.745997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1a814-bcd2-4f31-a9a0-5b3fe6d64c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:38.746344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1a814-bcd2-4f31-a9a0-5b3fe6d64c67 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:38.747128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1a814-bcd2-4f31-a9a0-5b3fe6d64c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:38.749231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1a814-bcd2-4f31-a9a0-5b3fe6d64c67 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:38.759258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe81b8b-90dd-4b18-9f4b-fee35ef5d7a7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:38.765238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d7419-f3d1-4198-8c42-b0144ac64022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:38.766120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d7419-f3d1-4198-8c42-b0144ac64022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:38.766440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d7419-f3d1-4198-8c42-b0144ac64022 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:38.766720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d7419-f3d1-4198-8c42-b0144ac64022 admin admin] PATH_INFO: `/v3/users/45b88a6784144a4f85c3f2e836ce0502` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:38.767937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d7419-f3d1-4198-8c42-b0144ac64022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b88a6784144a4f85c3f2e836ce0502)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:38.770284 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3801/7693] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:38 2021] POST /identity/v3/users => generated 283 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:38.770403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d7419-f3d1-4198-8c42-b0144ac64022 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:38.773731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1a814-bcd2-4f31-a9a0-5b3fe6d64c67 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:38.783822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1a814-bcd2-4f31-a9a0-5b3fe6d64c67 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:38.788773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f01a4-3bab-4ce1-9e63-719a7a09e88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:38.789409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f01a4-3bab-4ce1-9e63-719a7a09e88f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:38.789691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f01a4-3bab-4ce1-9e63-719a7a09e88f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:38.789992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f01a4-3bab-4ce1-9e63-719a7a09e88f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:38.790762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f01a4-3bab-4ce1-9e63-719a7a09e88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:38.792366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f01a4-3bab-4ce1-9e63-719a7a09e88f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:38.805330 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3802/7694] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:38 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:16:38.809443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f01a4-3bab-4ce1-9e63-719a7a09e88f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:38.818128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-928d7419-f3d1-4198-8c42-b0144ac64022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b88a6784144a4f85c3f2e836ce0502'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:38.819206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f01a4-3bab-4ce1-9e63-719a7a09e88f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:38.823906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce551d27-2842-4c50-86d8-3f774a2b94d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:38.824569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce551d27-2842-4c50-86d8-3f774a2b94d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:38.824858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce551d27-2842-4c50-86d8-3f774a2b94d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:38.824944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-928d7419-f3d1-4198-8c42-b0144ac64022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b88a6784144a4f85c3f2e836ce0502'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:38.825136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce551d27-2842-4c50-86d8-3f774a2b94d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:38.825550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-928d7419-f3d1-4198-8c42-b0144ac64022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b88a6784144a4f85c3f2e836ce0502'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:38.825911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce551d27-2842-4c50-86d8-3f774a2b94d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:38.827511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce551d27-2842-4c50-86d8-3f774a2b94d6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:38.837362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-928d7419-f3d1-4198-8c42-b0144ac64022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b88a6784144a4f85c3f2e836ce0502'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:38.838517 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3803/7695] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:38 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:38.842619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce551d27-2842-4c50-86d8-3f774a2b94d6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:38.845017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-928d7419-f3d1-4198-8c42-b0144ac64022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b88a6784144a4f85c3f2e836ce0502'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:38.851923 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3893/7696] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:38 2021] DELETE /identity/v3/users/45b88a6784144a4f85c3f2e836ce0502 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:38.852940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce551d27-2842-4c50-86d8-3f774a2b94d6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:38.856000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513db284-75df-4325-8769-0bc36d6bcda3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:38.856242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513db284-75df-4325-8769-0bc36d6bcda3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:38.856555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513db284-75df-4325-8769-0bc36d6bcda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:38.875530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-513db284-75df-4325-8769-0bc36d6bcda3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:38.876786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-513db284-75df-4325-8769-0bc36d6bcda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:38.911389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2585b1c-c97d-4096-a907-1d364c864835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:38.912279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2585b1c-c97d-4096-a907-1d364c864835 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:38.912566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2585b1c-c97d-4096-a907-1d364c864835 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:38.912847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2585b1c-c97d-4096-a907-1d364c864835 admin admin] PATH_INFO: `/v3/projects/d33644610c5c4f1aae112d75d4c5cbc4/users/d4ca5004855f40c7b85944eefe85de93/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:38.928603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2585b1c-c97d-4096-a907-1d364c864835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33644610c5c4f1aae112d75d4c5cbc4, user_id=d4ca5004855f40c7b85944eefe85de93, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:38.931273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2585b1c-c97d-4096-a907-1d364c864835 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:38.938096 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3894/7697] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:16:38.946117 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3804/7698] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:38 2021] PUT /identity/v3/projects/d33644610c5c4f1aae112d75d4c5cbc4/users/d4ca5004855f40c7b85944eefe85de93/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:38.953719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513db284-75df-4325-8769-0bc36d6bcda3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:38.955163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-513db284-75df-4325-8769-0bc36d6bcda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:38.957830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bda63e-195f-470f-982f-501b41c89caa None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:38.958121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bda63e-195f-470f-982f-501b41c89caa None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:38.958679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bda63e-195f-470f-982f-501b41c89caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:38.994380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-41bda63e-195f-470f-982f-501b41c89caa None None] MFA Rules not processed for user `d4ca5004855f40c7b85944eefe85de93`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:38.994856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-41bda63e-195f-470f-982f-501b41c89caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:39.031233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513db284-75df-4325-8769-0bc36d6bcda3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:39.075588 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3805/7699] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:38 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:39.081043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bda63e-195f-470f-982f-501b41c89caa None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:39.088566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab543fd-70da-438a-bd60-091069acbe0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:39.089359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab543fd-70da-438a-bd60-091069acbe0c service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:39.090150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab543fd-70da-438a-bd60-091069acbe0c service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:39.090629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab543fd-70da-438a-bd60-091069acbe0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:39.143364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bda63e-195f-470f-982f-501b41c89caa None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:39.147137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ec346-9e99-4807-8158-ffe32d3f7de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:39.147834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ec346-9e99-4807-8158-ffe32d3f7de9 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:39.148167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ec346-9e99-4807-8158-ffe32d3f7de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:39.148393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ec346-9e99-4807-8158-ffe32d3f7de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:39.150220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cf1ec346-9e99-4807-8158-ffe32d3f7de9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:39.153138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab543fd-70da-438a-bd60-091069acbe0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:39.154640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab543fd-70da-438a-bd60-091069acbe0c service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:39.163050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ec346-9e99-4807-8158-ffe32d3f7de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:39.164595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ec346-9e99-4807-8158-ffe32d3f7de9 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:39.164848 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3895/7700] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:16:39.165655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab543fd-70da-438a-bd60-091069acbe0c service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:39.166991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1ab543fd-70da-438a-bd60-091069acbe0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:39.177901 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3806/7701] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:39.223895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab543fd-70da-438a-bd60-091069acbe0c service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:39.227591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb8929-5707-4a68-be81-9537ef586560 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:39.228235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb8929-5707-4a68-be81-9537ef586560 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:39.228521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb8929-5707-4a68-be81-9537ef586560 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:39.228804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb8929-5707-4a68-be81-9537ef586560 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:39.237523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb8929-5707-4a68-be81-9537ef586560 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:39.239011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb8929-5707-4a68-be81-9537ef586560 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:39.247795 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3896/7702] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:39 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:39.397184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ec346-9e99-4807-8158-ffe32d3f7de9 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:39.400093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cf1ec346-9e99-4807-8158-ffe32d3f7de9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:39.421500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ec346-9e99-4807-8158-ffe32d3f7de9 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:39.427830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34469805-d25d-4af8-96f6-3dc26d7e0435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:39.429140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34469805-d25d-4af8-96f6-3dc26d7e0435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:39.429594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34469805-d25d-4af8-96f6-3dc26d7e0435 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:39.429936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34469805-d25d-4af8-96f6-3dc26d7e0435 admin admin] PATH_INFO: `/v3/projects/90b500db3f92424eb30304f4042a382c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:39.433014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34469805-d25d-4af8-96f6-3dc26d7e0435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b500db3f92424eb30304f4042a382c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:39.437156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34469805-d25d-4af8-96f6-3dc26d7e0435 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:39.496392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-34469805-d25d-4af8-96f6-3dc26d7e0435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b500db3f92424eb30304f4042a382c', 'request_id': 'req-34469805-d25d-4af8-96f6-3dc26d7e0435'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:39.504717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-34469805-d25d-4af8-96f6-3dc26d7e0435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b500db3f92424eb30304f4042a382c', 'request_id': 'req-34469805-d25d-4af8-96f6-3dc26d7e0435'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:39.520983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-34469805-d25d-4af8-96f6-3dc26d7e0435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b500db3f92424eb30304f4042a382c', 'request_id': 'req-34469805-d25d-4af8-96f6-3dc26d7e0435'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:39.541655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-34469805-d25d-4af8-96f6-3dc26d7e0435 admin admin] The token cache is being invalidate because project 90b500db3f92424eb30304f4042a382c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:39.542023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-34469805-d25d-4af8-96f6-3dc26d7e0435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:39.542783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-34469805-d25d-4af8-96f6-3dc26d7e0435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:39.545326 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3807/7703] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:39 2021] DELETE /identity/v3/projects/90b500db3f92424eb30304f4042a382c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:39.549113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb8929-5707-4a68-be81-9537ef586560 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:39.561808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb8929-5707-4a68-be81-9537ef586560 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:39.629360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e108cf1-25fe-4370-8b19-e2ff30c14cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:39.631167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e108cf1-25fe-4370-8b19-e2ff30c14cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:39.631458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e108cf1-25fe-4370-8b19-e2ff30c14cac admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:39.631796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e108cf1-25fe-4370-8b19-e2ff30c14cac admin admin] PATH_INFO: `/v3/users/4bc602c3b44147a3b9f70f8b0f02c4d3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:39.633406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e108cf1-25fe-4370-8b19-e2ff30c14cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc602c3b44147a3b9f70f8b0f02c4d3)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:39.635788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e108cf1-25fe-4370-8b19-e2ff30c14cac admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:39.695924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7e108cf1-25fe-4370-8b19-e2ff30c14cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc602c3b44147a3b9f70f8b0f02c4d3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:39.704626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7e108cf1-25fe-4370-8b19-e2ff30c14cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc602c3b44147a3b9f70f8b0f02c4d3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:39.705958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7e108cf1-25fe-4370-8b19-e2ff30c14cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc602c3b44147a3b9f70f8b0f02c4d3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:39.726776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7e108cf1-25fe-4370-8b19-e2ff30c14cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc602c3b44147a3b9f70f8b0f02c4d3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:39.742704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7e108cf1-25fe-4370-8b19-e2ff30c14cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc602c3b44147a3b9f70f8b0f02c4d3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:39.750137 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3897/7704] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:39 2021] DELETE /identity/v3/users/4bc602c3b44147a3b9f70f8b0f02c4d3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:40.063899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34469805-d25d-4af8-96f6-3dc26d7e0435 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:40.067033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-34469805-d25d-4af8-96f6-3dc26d7e0435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:40.088220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34469805-d25d-4af8-96f6-3dc26d7e0435 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:40.158885 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dd872-0c1d-4dd0-88d0-1006338335d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:40.159911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dd872-0c1d-4dd0-88d0-1006338335d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:40.160254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dd872-0c1d-4dd0-88d0-1006338335d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:40.160520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dd872-0c1d-4dd0-88d0-1006338335d6 admin admin] PATH_INFO: `/v3/projects/88c52143a9ba4611adbbc1a9c1180994` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:40.161977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dd872-0c1d-4dd0-88d0-1006338335d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c52143a9ba4611adbbc1a9c1180994)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:40.163808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dd872-0c1d-4dd0-88d0-1006338335d6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:40.212230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-276dd872-0c1d-4dd0-88d0-1006338335d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c52143a9ba4611adbbc1a9c1180994', 'request_id': 'req-276dd872-0c1d-4dd0-88d0-1006338335d6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:40.218272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-276dd872-0c1d-4dd0-88d0-1006338335d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c52143a9ba4611adbbc1a9c1180994', 'request_id': 'req-276dd872-0c1d-4dd0-88d0-1006338335d6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:40.224209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-276dd872-0c1d-4dd0-88d0-1006338335d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c52143a9ba4611adbbc1a9c1180994', 'request_id': 'req-276dd872-0c1d-4dd0-88d0-1006338335d6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:40.237205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-276dd872-0c1d-4dd0-88d0-1006338335d6 admin admin] The token cache is being invalidate because project 88c52143a9ba4611adbbc1a9c1180994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:40.237498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-276dd872-0c1d-4dd0-88d0-1006338335d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:40.238134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-276dd872-0c1d-4dd0-88d0-1006338335d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:40.239695 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3808/7705] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:40 2021] DELETE /identity/v3/projects/88c52143a9ba4611adbbc1a9c1180994 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:40.243607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e108cf1-25fe-4370-8b19-e2ff30c14cac admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:40.245001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7e108cf1-25fe-4370-8b19-e2ff30c14cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:40.257618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e108cf1-25fe-4370-8b19-e2ff30c14cac admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:40.313212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f54fe-e77f-46ab-b621-22c97a655b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:40.314058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f54fe-e77f-46ab-b621-22c97a655b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:40.314294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f54fe-e77f-46ab-b621-22c97a655b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:40.314574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f54fe-e77f-46ab-b621-22c97a655b2b admin admin] PATH_INFO: `/v3/users/f1c492e309a743e3a3dcd6b8ecc48e88` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:40.315765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f54fe-e77f-46ab-b621-22c97a655b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c492e309a743e3a3dcd6b8ecc48e88)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:40.317916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f54fe-e77f-46ab-b621-22c97a655b2b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:40.365298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4b8f54fe-e77f-46ab-b621-22c97a655b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c492e309a743e3a3dcd6b8ecc48e88'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:40.372076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4b8f54fe-e77f-46ab-b621-22c97a655b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c492e309a743e3a3dcd6b8ecc48e88'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:40.372891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4b8f54fe-e77f-46ab-b621-22c97a655b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c492e309a743e3a3dcd6b8ecc48e88'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:40.384275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4b8f54fe-e77f-46ab-b621-22c97a655b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c492e309a743e3a3dcd6b8ecc48e88'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:40.391781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4b8f54fe-e77f-46ab-b621-22c97a655b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c492e309a743e3a3dcd6b8ecc48e88'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:40.397662 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3898/7706] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:40 2021] DELETE /identity/v3/users/f1c492e309a743e3a3dcd6b8ecc48e88 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:40.912211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dd872-0c1d-4dd0-88d0-1006338335d6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:40.913693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-276dd872-0c1d-4dd0-88d0-1006338335d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:40.925982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dd872-0c1d-4dd0-88d0-1006338335d6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:40.986240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8551d95-58a1-42d8-9c70-1c7334d4d6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:40.987140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8551d95-58a1-42d8-9c70-1c7334d4d6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:40.987424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8551d95-58a1-42d8-9c70-1c7334d4d6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:40.988409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8551d95-58a1-42d8-9c70-1c7334d4d6c2 admin admin] PATH_INFO: `/v3/projects/9604c1083c0e41d0a822610757350876` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:40.989633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8551d95-58a1-42d8-9c70-1c7334d4d6c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9604c1083c0e41d0a822610757350876)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:40.991629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8551d95-58a1-42d8-9c70-1c7334d4d6c2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:41.043694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e8551d95-58a1-42d8-9c70-1c7334d4d6c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9604c1083c0e41d0a822610757350876', 'request_id': 'req-e8551d95-58a1-42d8-9c70-1c7334d4d6c2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:41.051090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e8551d95-58a1-42d8-9c70-1c7334d4d6c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9604c1083c0e41d0a822610757350876', 'request_id': 'req-e8551d95-58a1-42d8-9c70-1c7334d4d6c2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:41.058510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e8551d95-58a1-42d8-9c70-1c7334d4d6c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9604c1083c0e41d0a822610757350876', 'request_id': 'req-e8551d95-58a1-42d8-9c70-1c7334d4d6c2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:41.073777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e8551d95-58a1-42d8-9c70-1c7334d4d6c2 admin admin] The token cache is being invalidate because project 9604c1083c0e41d0a822610757350876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:41.074054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e8551d95-58a1-42d8-9c70-1c7334d4d6c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:41.075228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e8551d95-58a1-42d8-9c70-1c7334d4d6c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:41.085224 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3809/7707] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:40 2021] DELETE /identity/v3/projects/9604c1083c0e41d0a822610757350876 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:41.087862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a793de-39ee-4fd2-a0f3-dc151c7260b8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:41.089432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a793de-39ee-4fd2-a0f3-dc151c7260b8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:41.089746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a793de-39ee-4fd2-a0f3-dc151c7260b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:41.113637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d0a793de-39ee-4fd2-a0f3-dc151c7260b8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:41.115383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d0a793de-39ee-4fd2-a0f3-dc151c7260b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:41.193406 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3899/7708] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:41.201810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ad636-c2f8-4841-8a5c-55ac31d689e7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:41.202101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ad636-c2f8-4841-8a5c-55ac31d689e7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:41.202443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ad636-c2f8-4841-8a5c-55ac31d689e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:41.230124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-203ad636-c2f8-4841-8a5c-55ac31d689e7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:41.231864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-203ad636-c2f8-4841-8a5c-55ac31d689e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:41.244374 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3810/7709] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:41.250681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a793de-39ee-4fd2-a0f3-dc151c7260b8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:41.270474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a793de-39ee-4fd2-a0f3-dc151c7260b8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:41.278494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ea651-909a-48f0-992f-bf4a311c4112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:41.279057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ea651-909a-48f0-992f-bf4a311c4112 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:41.279387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ea651-909a-48f0-992f-bf4a311c4112 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:41.279668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ea651-909a-48f0-992f-bf4a311c4112 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:41.280460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ea651-909a-48f0-992f-bf4a311c4112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:41.280821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ea651-909a-48f0-992f-bf4a311c4112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:41.283834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ea651-909a-48f0-992f-bf4a311c4112 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:41.301268 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3900/7710] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:16:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:41.303036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ad636-c2f8-4841-8a5c-55ac31d689e7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:41.317079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ad636-c2f8-4841-8a5c-55ac31d689e7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:41.322158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0edbb-4949-4471-b0d5-1b3fd7b58e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:41.323051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0edbb-4949-4471-b0d5-1b3fd7b58e10 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:41.323432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0edbb-4949-4471-b0d5-1b3fd7b58e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:41.323902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0edbb-4949-4471-b0d5-1b3fd7b58e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:41.324683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0edbb-4949-4471-b0d5-1b3fd7b58e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:41.326886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0edbb-4949-4471-b0d5-1b3fd7b58e10 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:41.363638 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3811/7711] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:41 2021] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:41.365063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ea651-909a-48f0-992f-bf4a311c4112 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:41.378596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ea651-909a-48f0-992f-bf4a311c4112 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:41.459903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb6c59-0fb9-4f4c-9286-d0774a7491fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:41.460793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb6c59-0fb9-4f4c-9286-d0774a7491fa admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:41.461334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb6c59-0fb9-4f4c-9286-d0774a7491fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:41.461660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb6c59-0fb9-4f4c-9286-d0774a7491fa admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:41.462796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb6c59-0fb9-4f4c-9286-d0774a7491fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:41.465202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb6c59-0fb9-4f4c-9286-d0774a7491fa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:41.496957 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3901/7712] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:41 2021] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:41.501246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0edbb-4949-4471-b0d5-1b3fd7b58e10 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:41.518168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0edbb-4949-4471-b0d5-1b3fd7b58e10 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:41.524294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c88da3-0e9a-40db-8984-8bfad36623cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:41.525060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c88da3-0e9a-40db-8984-8bfad36623cd admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:41.525377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c88da3-0e9a-40db-8984-8bfad36623cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:41.525656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c88da3-0e9a-40db-8984-8bfad36623cd admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:41.526461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c88da3-0e9a-40db-8984-8bfad36623cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:41.528057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c88da3-0e9a-40db-8984-8bfad36623cd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:41.539419 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3812/7713] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:41 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:41.543626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb6c59-0fb9-4f4c-9286-d0774a7491fa admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:41.554512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb6c59-0fb9-4f4c-9286-d0774a7491fa admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:41.559502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8b916-8424-4b2a-9033-080ed621aef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:41.560165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b916-8424-4b2a-9033-080ed621aef8 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:41.560450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b916-8424-4b2a-9033-080ed621aef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:41.560731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b916-8424-4b2a-9033-080ed621aef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:41.561463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8b916-8424-4b2a-9033-080ed621aef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:41.563083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8b916-8424-4b2a-9033-080ed621aef8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:41.578363 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3902/7714] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:41 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:41.579586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c88da3-0e9a-40db-8984-8bfad36623cd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:41.591204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c88da3-0e9a-40db-8984-8bfad36623cd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:41.596019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf1644-54ad-4b30-a94e-d6dcd38f4fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:41.596907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf1644-54ad-4b30-a94e-d6dcd38f4fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:41.597191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf1644-54ad-4b30-a94e-d6dcd38f4fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:41.597471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf1644-54ad-4b30-a94e-d6dcd38f4fe3 admin admin] PATH_INFO: `/v3/projects/ca31c96496dc47b5b46a3833f1d088bb/users/f3c89de7c6e643928a7d1209760ce45e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:41.621920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf1644-54ad-4b30-a94e-d6dcd38f4fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca31c96496dc47b5b46a3833f1d088bb, user_id=f3c89de7c6e643928a7d1209760ce45e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:41.627734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf1644-54ad-4b30-a94e-d6dcd38f4fe3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:41.642716 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3813/7715] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:41 2021] PUT /identity/v3/projects/ca31c96496dc47b5b46a3833f1d088bb/users/f3c89de7c6e643928a7d1209760ce45e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:41.654358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6279349-9cd6-4887-837a-1853c29a39cb None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:41.655144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6279349-9cd6-4887-837a-1853c29a39cb None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:41.655144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6279349-9cd6-4887-837a-1853c29a39cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:41.683185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d6279349-9cd6-4887-837a-1853c29a39cb None None] MFA Rules not processed for user `f3c89de7c6e643928a7d1209760ce45e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:41.684392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d6279349-9cd6-4887-837a-1853c29a39cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:41.757038 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3903/7716] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:41 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:41.761282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf1644-54ad-4b30-a94e-d6dcd38f4fe3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:41.832669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf1644-54ad-4b30-a94e-d6dcd38f4fe3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:41.837857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8c20b-ac53-4460-a38f-e75a2d4d79ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:41.838581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8c20b-ac53-4460-a38f-e75a2d4d79ec admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:41.838870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8c20b-ac53-4460-a38f-e75a2d4d79ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:41.839154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8c20b-ac53-4460-a38f-e75a2d4d79ec admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:41.839899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8c20b-ac53-4460-a38f-e75a2d4d79ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:41.841800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8c20b-ac53-4460-a38f-e75a2d4d79ec admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:41.871231 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3814/7717] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:41 2021] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:41.872440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6279349-9cd6-4887-837a-1853c29a39cb None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:41.883409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6279349-9cd6-4887-837a-1853c29a39cb None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:41.951792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6077e26-1c1a-466c-83bf-3a96476b23d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:41.952460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6077e26-1c1a-466c-83bf-3a96476b23d9 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:41.952741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6077e26-1c1a-466c-83bf-3a96476b23d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:41.953017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6077e26-1c1a-466c-83bf-3a96476b23d9 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:41.953726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6077e26-1c1a-466c-83bf-3a96476b23d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:41.955688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6077e26-1c1a-466c-83bf-3a96476b23d9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:41.975998 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3904/7718] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:41 2021] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:41.979873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8c20b-ac53-4460-a38f-e75a2d4d79ec admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:41.991050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8c20b-ac53-4460-a38f-e75a2d4d79ec admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:41.995726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1fcde-7cca-4bb7-ba62-2f9d3a3988a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:41.996382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1fcde-7cca-4bb7-ba62-2f9d3a3988a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:41.996667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1fcde-7cca-4bb7-ba62-2f9d3a3988a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:41.996946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1fcde-7cca-4bb7-ba62-2f9d3a3988a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:41.997674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1fcde-7cca-4bb7-ba62-2f9d3a3988a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:41.999406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1fcde-7cca-4bb7-ba62-2f9d3a3988a1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:42.013143 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3815/7719] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:41 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:16:42.014472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6077e26-1c1a-466c-83bf-3a96476b23d9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:42.024873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6077e26-1c1a-466c-83bf-3a96476b23d9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:42.031168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43418462-4532-4102-a44e-14755b179a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:42.032072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43418462-4532-4102-a44e-14755b179a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:42.032484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43418462-4532-4102-a44e-14755b179a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:42.033273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43418462-4532-4102-a44e-14755b179a94 admin admin] PATH_INFO: `/v3/projects/e3dc71fea0804c4a9ae8926990aea90c/users/07ae636405a34c3c8fecbda1df19d527/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:42.054598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43418462-4532-4102-a44e-14755b179a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3dc71fea0804c4a9ae8926990aea90c, user_id=07ae636405a34c3c8fecbda1df19d527, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:42.057348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43418462-4532-4102-a44e-14755b179a94 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:42.074686 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3905/7720] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:42 2021] PUT /identity/v3/projects/e3dc71fea0804c4a9ae8926990aea90c/users/07ae636405a34c3c8fecbda1df19d527/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:42.076083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1fcde-7cca-4bb7-ba62-2f9d3a3988a1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:42.087716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1fcde-7cca-4bb7-ba62-2f9d3a3988a1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:42.162421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e115b3a-a348-4434-b69e-3910393eb432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:42.163213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e115b3a-a348-4434-b69e-3910393eb432 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:42.163508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e115b3a-a348-4434-b69e-3910393eb432 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:42.163794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e115b3a-a348-4434-b69e-3910393eb432 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:42.164717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e115b3a-a348-4434-b69e-3910393eb432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:42.167345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e115b3a-a348-4434-b69e-3910393eb432 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:42.182795 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3816/7721] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:42 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:42.184811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43418462-4532-4102-a44e-14755b179a94 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:42.196723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43418462-4532-4102-a44e-14755b179a94 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:42.203160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79600a6-f850-4521-8bbc-371626149dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:42.204099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79600a6-f850-4521-8bbc-371626149dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:42.204383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79600a6-f850-4521-8bbc-371626149dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:42.205191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79600a6-f850-4521-8bbc-371626149dbf admin admin] PATH_INFO: `/v3/projects/e3dc71fea0804c4a9ae8926990aea90c/users/07ae636405a34c3c8fecbda1df19d527/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:42.207361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79600a6-f850-4521-8bbc-371626149dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3dc71fea0804c4a9ae8926990aea90c, user_id=07ae636405a34c3c8fecbda1df19d527, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:42.211759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79600a6-f850-4521-8bbc-371626149dbf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:42.225617 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3906/7722] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:42 2021] PUT /identity/v3/projects/e3dc71fea0804c4a9ae8926990aea90c/users/07ae636405a34c3c8fecbda1df19d527/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:42.235822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95663334-0adb-4342-bd68-06e15e48ae60 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:42.236375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95663334-0adb-4342-bd68-06e15e48ae60 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:42.236662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95663334-0adb-4342-bd68-06e15e48ae60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:42.273132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-95663334-0adb-4342-bd68-06e15e48ae60 None None] MFA Rules not processed for user `07ae636405a34c3c8fecbda1df19d527`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:42.274371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-95663334-0adb-4342-bd68-06e15e48ae60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:42.354407 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3817/7723] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:42 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:42.364011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79600a6-f850-4521-8bbc-371626149dbf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:42.366056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a79600a6-f850-4521-8bbc-371626149dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:42.478636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79600a6-f850-4521-8bbc-371626149dbf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:42.483541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5372b00-3129-4f65-989b-2fd5f2a83ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:42.484204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5372b00-3129-4f65-989b-2fd5f2a83ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:42.485094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5372b00-3129-4f65-989b-2fd5f2a83ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:42.485382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5372b00-3129-4f65-989b-2fd5f2a83ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:42.498623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5372b00-3129-4f65-989b-2fd5f2a83ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:42.500076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5372b00-3129-4f65-989b-2fd5f2a83ae2 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:42.515029 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3907/7724] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:42 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:43.974285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95663334-0adb-4342-bd68-06e15e48ae60 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:43.975739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-95663334-0adb-4342-bd68-06e15e48ae60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:44.042523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95663334-0adb-4342-bd68-06e15e48ae60 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:44.046981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b35452-35d3-4745-bf77-46219a8ed91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:44.047841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b35452-35d3-4745-bf77-46219a8ed91d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:44.048125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b35452-35d3-4745-bf77-46219a8ed91d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:44.049059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b35452-35d3-4745-bf77-46219a8ed91d admin admin] PATH_INFO: `/v3/users/bdd05da990fb4f7290fb926a258de4eb` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:44.050286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b35452-35d3-4745-bf77-46219a8ed91d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd05da990fb4f7290fb926a258de4eb)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:44.052250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b35452-35d3-4745-bf77-46219a8ed91d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:44.101843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-12b35452-35d3-4745-bf77-46219a8ed91d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd05da990fb4f7290fb926a258de4eb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:44.109042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-12b35452-35d3-4745-bf77-46219a8ed91d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd05da990fb4f7290fb926a258de4eb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:44.121330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-12b35452-35d3-4745-bf77-46219a8ed91d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd05da990fb4f7290fb926a258de4eb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:44.122084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-12b35452-35d3-4745-bf77-46219a8ed91d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd05da990fb4f7290fb926a258de4eb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:44.129556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-12b35452-35d3-4745-bf77-46219a8ed91d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd05da990fb4f7290fb926a258de4eb'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:44.135713 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3818/7725] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:43 2021] DELETE /identity/v3/users/bdd05da990fb4f7290fb926a258de4eb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:44.328481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5372b00-3129-4f65-989b-2fd5f2a83ae2 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:44.351038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5372b00-3129-4f65-989b-2fd5f2a83ae2 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:44.411604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741f9f1-678a-4128-a025-bde16d5fd9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:44.412496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741f9f1-678a-4128-a025-bde16d5fd9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:44.412785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741f9f1-678a-4128-a025-bde16d5fd9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:44.413067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741f9f1-678a-4128-a025-bde16d5fd9a4 admin admin] PATH_INFO: `/v3/projects/64ef041cd6724458b053cde5c1afe4fa` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:44.414763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741f9f1-678a-4128-a025-bde16d5fd9a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ef041cd6724458b053cde5c1afe4fa)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:44.417021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741f9f1-678a-4128-a025-bde16d5fd9a4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:44.462817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f741f9f1-678a-4128-a025-bde16d5fd9a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ef041cd6724458b053cde5c1afe4fa', 'request_id': 'req-f741f9f1-678a-4128-a025-bde16d5fd9a4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:44.468877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f741f9f1-678a-4128-a025-bde16d5fd9a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ef041cd6724458b053cde5c1afe4fa', 'request_id': 'req-f741f9f1-678a-4128-a025-bde16d5fd9a4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:44.476897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f741f9f1-678a-4128-a025-bde16d5fd9a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ef041cd6724458b053cde5c1afe4fa', 'request_id': 'req-f741f9f1-678a-4128-a025-bde16d5fd9a4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:44.487392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f741f9f1-678a-4128-a025-bde16d5fd9a4 admin admin] The token cache is being invalidate because project 64ef041cd6724458b053cde5c1afe4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:44.487625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f741f9f1-678a-4128-a025-bde16d5fd9a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:44.488259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f741f9f1-678a-4128-a025-bde16d5fd9a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:44.489892 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3908/7726] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:44 2021] DELETE /identity/v3/projects/64ef041cd6724458b053cde5c1afe4fa => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:44.495631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fde5bb-326a-48eb-8ad1-6c6c924b5903 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:44.495931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fde5bb-326a-48eb-8ad1-6c6c924b5903 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:44.496235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fde5bb-326a-48eb-8ad1-6c6c924b5903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:44.514937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-80fde5bb-326a-48eb-8ad1-6c6c924b5903 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:44.516133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-80fde5bb-326a-48eb-8ad1-6c6c924b5903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:44.573777 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3819/7727] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:44.583905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1bc13-9777-424f-a229-14794a2a5ae5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:44.584205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1bc13-9777-424f-a229-14794a2a5ae5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:44.584486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1bc13-9777-424f-a229-14794a2a5ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:44.603949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-59d1bc13-9777-424f-a229-14794a2a5ae5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:44.608034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-59d1bc13-9777-424f-a229-14794a2a5ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:44.616313 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3909/7728] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:44.620622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fde5bb-326a-48eb-8ad1-6c6c924b5903 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:44.631890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fde5bb-326a-48eb-8ad1-6c6c924b5903 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:44.638560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab240e-7d4a-487b-b10b-b41e136599de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:44.639609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab240e-7d4a-487b-b10b-b41e136599de admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:44.639905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab240e-7d4a-487b-b10b-b41e136599de admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:44.640791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab240e-7d4a-487b-b10b-b41e136599de admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:44.641999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab240e-7d4a-487b-b10b-b41e136599de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:44.642947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab240e-7d4a-487b-b10b-b41e136599de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:44.644750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab240e-7d4a-487b-b10b-b41e136599de admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:44.661403 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3820/7729] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:16:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:44.665449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1bc13-9777-424f-a229-14794a2a5ae5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:44.675639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1bc13-9777-424f-a229-14794a2a5ae5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:44.681013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed3c08-7672-4609-8e9b-fb7b5acc642a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:44.681663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed3c08-7672-4609-8e9b-fb7b5acc642a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:44.681945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed3c08-7672-4609-8e9b-fb7b5acc642a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:44.682221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed3c08-7672-4609-8e9b-fb7b5acc642a admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:44.682989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed3c08-7672-4609-8e9b-fb7b5acc642a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:44.684945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed3c08-7672-4609-8e9b-fb7b5acc642a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:44.708454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab240e-7d4a-487b-b10b-b41e136599de admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:44.710560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-43ab240e-7d4a-487b-b10b-b41e136599de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:44.718461 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3910/7730] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:44 2021] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:44.722561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed3c08-7672-4609-8e9b-fb7b5acc642a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:44.724899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab240e-7d4a-487b-b10b-b41e136599de admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:44.791591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed3c08-7672-4609-8e9b-fb7b5acc642a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:44.797175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703feff7-b00e-4156-ac6a-947efb8200b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:44.797688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd9413-cbf8-4d1d-b685-b392f39a0113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:44.798044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703feff7-b00e-4156-ac6a-947efb8200b3 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:44.798915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703feff7-b00e-4156-ac6a-947efb8200b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:44.799225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd9413-cbf8-4d1d-b685-b392f39a0113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:44.799433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703feff7-b00e-4156-ac6a-947efb8200b3 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:44.799544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd9413-cbf8-4d1d-b685-b392f39a0113 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:44.799828 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd9413-cbf8-4d1d-b685-b392f39a0113 admin admin] PATH_INFO: `/v3/users/f3c89de7c6e643928a7d1209760ce45e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:44.799993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703feff7-b00e-4156-ac6a-947efb8200b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:44.801621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd9413-cbf8-4d1d-b685-b392f39a0113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c89de7c6e643928a7d1209760ce45e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:44.801995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703feff7-b00e-4156-ac6a-947efb8200b3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:44.803018 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd9413-cbf8-4d1d-b685-b392f39a0113 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:44.822957 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3911/7731] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:44 2021] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:44.826556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703feff7-b00e-4156-ac6a-947efb8200b3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:44.838542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703feff7-b00e-4156-ac6a-947efb8200b3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:44.844499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b00ca-5a1b-482e-a9f7-ed714ca3cd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:44.845882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b00ca-5a1b-482e-a9f7-ed714ca3cd25 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:44.846375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b00ca-5a1b-482e-a9f7-ed714ca3cd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:44.846847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b00ca-5a1b-482e-a9f7-ed714ca3cd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:44.847856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b00ca-5a1b-482e-a9f7-ed714ca3cd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:44.851177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b00ca-5a1b-482e-a9f7-ed714ca3cd25 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:44.867659 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3912/7732] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:44 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:16:44.868643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b00ca-5a1b-482e-a9f7-ed714ca3cd25 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:44.877608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dafd9413-cbf8-4d1d-b685-b392f39a0113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c89de7c6e643928a7d1209760ce45e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:44.878848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b00ca-5a1b-482e-a9f7-ed714ca3cd25 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:44.885940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dafd9413-cbf8-4d1d-b685-b392f39a0113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c89de7c6e643928a7d1209760ce45e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:44.893602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84916308-3d3e-4a90-97b2-1ed9d8e07082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:44.894443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84916308-3d3e-4a90-97b2-1ed9d8e07082 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:44.894875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84916308-3d3e-4a90-97b2-1ed9d8e07082 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:44.895159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84916308-3d3e-4a90-97b2-1ed9d8e07082 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:44.895964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84916308-3d3e-4a90-97b2-1ed9d8e07082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:44.897724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84916308-3d3e-4a90-97b2-1ed9d8e07082 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:44.898680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dafd9413-cbf8-4d1d-b685-b392f39a0113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c89de7c6e643928a7d1209760ce45e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:44.899595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dafd9413-cbf8-4d1d-b685-b392f39a0113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c89de7c6e643928a7d1209760ce45e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:44.907483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dafd9413-cbf8-4d1d-b685-b392f39a0113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c89de7c6e643928a7d1209760ce45e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:44.910852 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3913/7733] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:44 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:44.918376 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3821/7734] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:44 2021] DELETE /identity/v3/users/f3c89de7c6e643928a7d1209760ce45e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:44.919565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84916308-3d3e-4a90-97b2-1ed9d8e07082 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:44.919977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb744a-a848-497a-b679-e4821b98517c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:44.920405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb744a-a848-497a-b679-e4821b98517c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:44.920567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb744a-a848-497a-b679-e4821b98517c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:44.921648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-84916308-3d3e-4a90-97b2-1ed9d8e07082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:44.939819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f8eb744a-a848-497a-b679-e4821b98517c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:44.941012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f8eb744a-a848-497a-b679-e4821b98517c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:44.941542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84916308-3d3e-4a90-97b2-1ed9d8e07082 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:45.004589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8129d57-7f0a-4758-9804-1156c4f8e519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:45.005728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8129d57-7f0a-4758-9804-1156c4f8e519 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:45.006010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8129d57-7f0a-4758-9804-1156c4f8e519 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:45.006325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8129d57-7f0a-4758-9804-1156c4f8e519 admin admin] PATH_INFO: `/v3/projects/757b8ebe833d422891a28187ee5b7887/users/66b65268b3834da5b1ee59f12dfc04c8/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:45.010288 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3822/7735] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:45.018402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb744a-a848-497a-b679-e4821b98517c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:45.019827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f8eb744a-a848-497a-b679-e4821b98517c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:45.021795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8129d57-7f0a-4758-9804-1156c4f8e519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=757b8ebe833d422891a28187ee5b7887, user_id=66b65268b3834da5b1ee59f12dfc04c8, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:45.024625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8129d57-7f0a-4758-9804-1156c4f8e519 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:45.041655 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3914/7736] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:44 2021] PUT /identity/v3/projects/757b8ebe833d422891a28187ee5b7887/users/66b65268b3834da5b1ee59f12dfc04c8/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:45.053304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b790ece-8426-4738-a375-ed4691a1dbb8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:45.053593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b790ece-8426-4738-a375-ed4691a1dbb8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:45.053970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b790ece-8426-4738-a375-ed4691a1dbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:45.085599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8b790ece-8426-4738-a375-ed4691a1dbb8 None None] MFA Rules not processed for user `66b65268b3834da5b1ee59f12dfc04c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:45.086345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8b790ece-8426-4738-a375-ed4691a1dbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:45.090503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb744a-a848-497a-b679-e4821b98517c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:45.141004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6843b4b-8538-4e43-82ad-63013b697f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:45.142444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6843b4b-8538-4e43-82ad-63013b697f11 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:45.142731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6843b4b-8538-4e43-82ad-63013b697f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:45.143008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6843b4b-8538-4e43-82ad-63013b697f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:45.152293 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3915/7737] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:45 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:16:45.164145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b790ece-8426-4738-a375-ed4691a1dbb8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:45.165692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8b790ece-8426-4738-a375-ed4691a1dbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:45.205214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6843b4b-8538-4e43-82ad-63013b697f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:45.206800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6843b4b-8538-4e43-82ad-63013b697f11 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:45.216446 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3823/7738] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:16:45.240799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b790ece-8426-4738-a375-ed4691a1dbb8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:45.246445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafd592-91a7-429c-9c06-6d5bbe4e6eac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:45.247033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafd592-91a7-429c-9c06-6d5bbe4e6eac service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:45.247318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafd592-91a7-429c-9c06-6d5bbe4e6eac service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:45.247598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafd592-91a7-429c-9c06-6d5bbe4e6eac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:45.256703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafd592-91a7-429c-9c06-6d5bbe4e6eac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:45.258309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafd592-91a7-429c-9c06-6d5bbe4e6eac service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:45.268066 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3916/7739] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:45 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:16:45.288932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6843b4b-8538-4e43-82ad-63013b697f11 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:45.290479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b6843b4b-8538-4e43-82ad-63013b697f11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:45.351219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6843b4b-8538-4e43-82ad-63013b697f11 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:45.354895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07930822-493c-4531-a6ae-2d60c93f51fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:45.355552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07930822-493c-4531-a6ae-2d60c93f51fa service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:45.355836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07930822-493c-4531-a6ae-2d60c93f51fa service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:45.356273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07930822-493c-4531-a6ae-2d60c93f51fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:45.358105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-07930822-493c-4531-a6ae-2d60c93f51fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:45.374616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07930822-493c-4531-a6ae-2d60c93f51fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:45.376066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07930822-493c-4531-a6ae-2d60c93f51fa service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:45.390426 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3824/7740] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:45 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:16:45.721470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafd592-91a7-429c-9c06-6d5bbe4e6eac service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:45.738368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafd592-91a7-429c-9c06-6d5bbe4e6eac service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:45.743562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93f5f2-7503-4c29-9b88-2f9511f87c09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:45.744248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93f5f2-7503-4c29-9b88-2f9511f87c09 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:45.744706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93f5f2-7503-4c29-9b88-2f9511f87c09 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:45.745026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93f5f2-7503-4c29-9b88-2f9511f87c09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:45.747013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7d93f5f2-7503-4c29-9b88-2f9511f87c09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:45.765868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93f5f2-7503-4c29-9b88-2f9511f87c09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:45.767900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93f5f2-7503-4c29-9b88-2f9511f87c09 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:45.769332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07930822-493c-4531-a6ae-2d60c93f51fa service cinder] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:45.770758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-07930822-493c-4531-a6ae-2d60c93f51fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:45.793640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07930822-493c-4531-a6ae-2d60c93f51fa service cinder] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:45.794723 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3917/7741] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:45 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:45.799504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f3243-c8da-4c63-9221-6f2d46157f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:45.800734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f3243-c8da-4c63-9221-6f2d46157f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:45.801035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f3243-c8da-4c63-9221-6f2d46157f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:45.801322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f3243-c8da-4c63-9221-6f2d46157f2a admin admin] PATH_INFO: `/v3/projects/ca31c96496dc47b5b46a3833f1d088bb` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:45.802720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f3243-c8da-4c63-9221-6f2d46157f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca31c96496dc47b5b46a3833f1d088bb)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:45.815310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f3243-c8da-4c63-9221-6f2d46157f2a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:45.869179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b32f3243-c8da-4c63-9221-6f2d46157f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca31c96496dc47b5b46a3833f1d088bb', 'request_id': 'req-b32f3243-c8da-4c63-9221-6f2d46157f2a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:45.875616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b32f3243-c8da-4c63-9221-6f2d46157f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca31c96496dc47b5b46a3833f1d088bb', 'request_id': 'req-b32f3243-c8da-4c63-9221-6f2d46157f2a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:45.882226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b32f3243-c8da-4c63-9221-6f2d46157f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca31c96496dc47b5b46a3833f1d088bb', 'request_id': 'req-b32f3243-c8da-4c63-9221-6f2d46157f2a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:45.899569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b32f3243-c8da-4c63-9221-6f2d46157f2a admin admin] The token cache is being invalidate because project ca31c96496dc47b5b46a3833f1d088bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:45.899965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b32f3243-c8da-4c63-9221-6f2d46157f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:45.900681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b32f3243-c8da-4c63-9221-6f2d46157f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:45.902471 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3825/7742] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:45 2021] DELETE /identity/v3/projects/ca31c96496dc47b5b46a3833f1d088bb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:45.906396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93f5f2-7503-4c29-9b88-2f9511f87c09 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:45.917825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93f5f2-7503-4c29-9b88-2f9511f87c09 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:45.977518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25326c06-8fa2-4efe-9d6f-8bb3b07b21d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:45.978421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326c06-8fa2-4efe-9d6f-8bb3b07b21d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:45.978712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326c06-8fa2-4efe-9d6f-8bb3b07b21d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:45.978993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326c06-8fa2-4efe-9d6f-8bb3b07b21d2 admin admin] PATH_INFO: `/v3/users/07ae636405a34c3c8fecbda1df19d527` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:45.980200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25326c06-8fa2-4efe-9d6f-8bb3b07b21d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ae636405a34c3c8fecbda1df19d527)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:45.982094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25326c06-8fa2-4efe-9d6f-8bb3b07b21d2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:46.027695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-25326c06-8fa2-4efe-9d6f-8bb3b07b21d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ae636405a34c3c8fecbda1df19d527'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:46.034198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-25326c06-8fa2-4efe-9d6f-8bb3b07b21d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ae636405a34c3c8fecbda1df19d527'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:46.034887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-25326c06-8fa2-4efe-9d6f-8bb3b07b21d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ae636405a34c3c8fecbda1df19d527'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:46.046675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-25326c06-8fa2-4efe-9d6f-8bb3b07b21d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ae636405a34c3c8fecbda1df19d527'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:46.054757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-25326c06-8fa2-4efe-9d6f-8bb3b07b21d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ae636405a34c3c8fecbda1df19d527'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:46.061643 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3918/7743] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:45 2021] DELETE /identity/v3/users/07ae636405a34c3c8fecbda1df19d527 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:46.343094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f3243-c8da-4c63-9221-6f2d46157f2a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:46.344541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b32f3243-c8da-4c63-9221-6f2d46157f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:46.359524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f3243-c8da-4c63-9221-6f2d46157f2a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:46.420752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd7866-f0de-4974-91e9-cf745fac951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:46.421921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd7866-f0de-4974-91e9-cf745fac951c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:46.422212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd7866-f0de-4974-91e9-cf745fac951c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:46.422530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd7866-f0de-4974-91e9-cf745fac951c admin admin] PATH_INFO: `/v3/projects/e3dc71fea0804c4a9ae8926990aea90c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:46.424412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd7866-f0de-4974-91e9-cf745fac951c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3dc71fea0804c4a9ae8926990aea90c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:46.426473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd7866-f0de-4974-91e9-cf745fac951c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:46.471536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d1bd7866-f0de-4974-91e9-cf745fac951c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3dc71fea0804c4a9ae8926990aea90c', 'request_id': 'req-d1bd7866-f0de-4974-91e9-cf745fac951c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:46.477375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d1bd7866-f0de-4974-91e9-cf745fac951c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3dc71fea0804c4a9ae8926990aea90c', 'request_id': 'req-d1bd7866-f0de-4974-91e9-cf745fac951c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:46.482636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d1bd7866-f0de-4974-91e9-cf745fac951c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3dc71fea0804c4a9ae8926990aea90c', 'request_id': 'req-d1bd7866-f0de-4974-91e9-cf745fac951c'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:46.494726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d1bd7866-f0de-4974-91e9-cf745fac951c admin admin] The token cache is being invalidate because project e3dc71fea0804c4a9ae8926990aea90c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:46.495011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d1bd7866-f0de-4974-91e9-cf745fac951c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:46.495672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d1bd7866-f0de-4974-91e9-cf745fac951c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:46.497186 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3826/7744] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:46 2021] DELETE /identity/v3/projects/e3dc71fea0804c4a9ae8926990aea90c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:46.502944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af4381-865d-4aa6-be46-9e8068241549 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:46.503238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af4381-865d-4aa6-be46-9e8068241549 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:46.503547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af4381-865d-4aa6-be46-9e8068241549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:46.521571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f7af4381-865d-4aa6-be46-9e8068241549 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:46.522793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f7af4381-865d-4aa6-be46-9e8068241549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:46.580866 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3919/7745] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:46.588753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb367ae-d3f2-415c-a46c-c600887923c3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:46.589043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb367ae-d3f2-415c-a46c-c600887923c3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:46.589325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb367ae-d3f2-415c-a46c-c600887923c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:46.609199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9bb367ae-d3f2-415c-a46c-c600887923c3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:46.610418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9bb367ae-d3f2-415c-a46c-c600887923c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:46.618327 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3827/7746] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:46.622545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af4381-865d-4aa6-be46-9e8068241549 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:46.632323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af4381-865d-4aa6-be46-9e8068241549 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:46.637044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803a550-40e5-4dd2-85a4-0c52d2cb4d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:46.637612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803a550-40e5-4dd2-85a4-0c52d2cb4d2f admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:46.637895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803a550-40e5-4dd2-85a4-0c52d2cb4d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:46.638177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803a550-40e5-4dd2-85a4-0c52d2cb4d2f admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:46.638949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803a550-40e5-4dd2-85a4-0c52d2cb4d2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:46.639259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803a550-40e5-4dd2-85a4-0c52d2cb4d2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:46.640849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803a550-40e5-4dd2-85a4-0c52d2cb4d2f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:46.652545 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3920/7747] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:16:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:16:46.656829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb367ae-d3f2-415c-a46c-c600887923c3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:46.666634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb367ae-d3f2-415c-a46c-c600887923c3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:46.671292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70db45-36b5-46ff-94cf-a884c06466fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:46.671963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70db45-36b5-46ff-94cf-a884c06466fd admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:46.672244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70db45-36b5-46ff-94cf-a884c06466fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:46.673583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70db45-36b5-46ff-94cf-a884c06466fd admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:46.674337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70db45-36b5-46ff-94cf-a884c06466fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:46.676222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70db45-36b5-46ff-94cf-a884c06466fd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:46.703322 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3828/7748] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:46 2021] POST /identity/v3/projects => generated 355 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:46.708380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803a550-40e5-4dd2-85a4-0c52d2cb4d2f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:46.719491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803a550-40e5-4dd2-85a4-0c52d2cb4d2f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:46.779939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35752f1-a02f-441e-9d44-520ba5d1b0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:46.780831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35752f1-a02f-441e-9d44-520ba5d1b0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:46.781120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35752f1-a02f-441e-9d44-520ba5d1b0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:46.781512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35752f1-a02f-441e-9d44-520ba5d1b0f6 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:46.782493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35752f1-a02f-441e-9d44-520ba5d1b0f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:46.785277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35752f1-a02f-441e-9d44-520ba5d1b0f6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:46.805927 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3921/7749] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:46 2021] POST /identity/v3/users => generated 278 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:46.810171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70db45-36b5-46ff-94cf-a884c06466fd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:46.822097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70db45-36b5-46ff-94cf-a884c06466fd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:46.827511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c960a-7175-4f1d-9e71-a50805739a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:46.828291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c960a-7175-4f1d-9e71-a50805739a33 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:46.828643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c960a-7175-4f1d-9e71-a50805739a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:46.828995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c960a-7175-4f1d-9e71-a50805739a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:46.830471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c960a-7175-4f1d-9e71-a50805739a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:46.832148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c960a-7175-4f1d-9e71-a50805739a33 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:46.845793 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3829/7750] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:46 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:46.848201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35752f1-a02f-441e-9d44-520ba5d1b0f6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:46.858589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35752f1-a02f-441e-9d44-520ba5d1b0f6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:46.863557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafbacf-146e-411f-8eca-bb23707ca72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:46.864215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafbacf-146e-411f-8eca-bb23707ca72c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:46.864498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafbacf-146e-411f-8eca-bb23707ca72c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:46.864788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafbacf-146e-411f-8eca-bb23707ca72c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:46.865516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafbacf-146e-411f-8eca-bb23707ca72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:46.867125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafbacf-146e-411f-8eca-bb23707ca72c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:46.878726 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3922/7751] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:46 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:46.883023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c960a-7175-4f1d-9e71-a50805739a33 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:46.893733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c960a-7175-4f1d-9e71-a50805739a33 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:46.898759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea02b1-adb6-46de-97f5-a821eca8fcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:46.899676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea02b1-adb6-46de-97f5-a821eca8fcab admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:46.899957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea02b1-adb6-46de-97f5-a821eca8fcab admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:46.900234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea02b1-adb6-46de-97f5-a821eca8fcab admin admin] PATH_INFO: `/v3/projects/ccb59047cbc24a8fa9003efc4aa7837b/users/78858cc0e17a462caf4a6e5f7627bece/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:46.916424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea02b1-adb6-46de-97f5-a821eca8fcab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb59047cbc24a8fa9003efc4aa7837b, user_id=78858cc0e17a462caf4a6e5f7627bece, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:46.919179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea02b1-adb6-46de-97f5-a821eca8fcab admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:46.936291 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3830/7752] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:46 2021] PUT /identity/v3/projects/ccb59047cbc24a8fa9003efc4aa7837b/users/78858cc0e17a462caf4a6e5f7627bece/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:46.947938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a1137-6c30-40b8-9765-b88015331883 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:46.948223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a1137-6c30-40b8-9765-b88015331883 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:46.948501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a1137-6c30-40b8-9765-b88015331883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:46.976193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-db3a1137-6c30-40b8-9765-b88015331883 None None] MFA Rules not processed for user `78858cc0e17a462caf4a6e5f7627bece`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:46.977393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-db3a1137-6c30-40b8-9765-b88015331883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:47.042340 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3923/7753] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:46 2021] POST /identity/v3/auth/tokens => generated 3222 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:47.046893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea02b1-adb6-46de-97f5-a821eca8fcab admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:47.129365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea02b1-adb6-46de-97f5-a821eca8fcab admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:47.134181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bee1bc-918d-43fe-aeac-54f4ee2c60bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:47.134875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bee1bc-918d-43fe-aeac-54f4ee2c60bb admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:47.135168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bee1bc-918d-43fe-aeac-54f4ee2c60bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:47.135582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bee1bc-918d-43fe-aeac-54f4ee2c60bb admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:47.136303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bee1bc-918d-43fe-aeac-54f4ee2c60bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:47.138222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bee1bc-918d-43fe-aeac-54f4ee2c60bb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:47.169666 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3831/7754] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:47 2021] POST /identity/v3/projects => generated 355 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:47.173841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a1137-6c30-40b8-9765-b88015331883 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:47.186727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a1137-6c30-40b8-9765-b88015331883 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:47.246917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0754e0-06e7-43e2-83e2-09172754ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:47.247591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0754e0-06e7-43e2-83e2-09172754ab96 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:47.247878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0754e0-06e7-43e2-83e2-09172754ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:47.248156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0754e0-06e7-43e2-83e2-09172754ab96 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:47.248850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0754e0-06e7-43e2-83e2-09172754ab96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:47.250810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0754e0-06e7-43e2-83e2-09172754ab96 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:47.274056 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3924/7755] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:47 2021] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:47.275338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bee1bc-918d-43fe-aeac-54f4ee2c60bb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:47.285682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bee1bc-918d-43fe-aeac-54f4ee2c60bb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:47.290800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988de9a-bbfd-4f91-9a7b-b7b8fa3fcd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:47.291547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988de9a-bbfd-4f91-9a7b-b7b8fa3fcd71 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:47.291903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988de9a-bbfd-4f91-9a7b-b7b8fa3fcd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:47.292250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988de9a-bbfd-4f91-9a7b-b7b8fa3fcd71 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:47.293055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988de9a-bbfd-4f91-9a7b-b7b8fa3fcd71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:47.294812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988de9a-bbfd-4f91-9a7b-b7b8fa3fcd71 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:47.306472 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3832/7756] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:47 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:47.310340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0754e0-06e7-43e2-83e2-09172754ab96 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:47.320962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0754e0-06e7-43e2-83e2-09172754ab96 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:47.325758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde23ed-b139-45ac-8f96-1af89ad4cf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:47.326677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde23ed-b139-45ac-8f96-1af89ad4cf86 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:47.326976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde23ed-b139-45ac-8f96-1af89ad4cf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:47.327253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde23ed-b139-45ac-8f96-1af89ad4cf86 admin admin] PATH_INFO: `/v3/projects/09ec5411a0a644e3b035bf193fa8b9b4/users/8c2bfb8a50de42e788b5c7574a91ac1b/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:47.343408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde23ed-b139-45ac-8f96-1af89ad4cf86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ec5411a0a644e3b035bf193fa8b9b4, user_id=8c2bfb8a50de42e788b5c7574a91ac1b, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:47.346122 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde23ed-b139-45ac-8f96-1af89ad4cf86 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:47.359111 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3925/7757] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:47 2021] PUT /identity/v3/projects/09ec5411a0a644e3b035bf193fa8b9b4/users/8c2bfb8a50de42e788b5c7574a91ac1b/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:47.363663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988de9a-bbfd-4f91-9a7b-b7b8fa3fcd71 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:47.373651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988de9a-bbfd-4f91-9a7b-b7b8fa3fcd71 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:47.432827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de5a50-550a-4a7e-9732-1c3f32468815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:47.433385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de5a50-550a-4a7e-9732-1c3f32468815 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:47.433806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de5a50-550a-4a7e-9732-1c3f32468815 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:47.434403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de5a50-550a-4a7e-9732-1c3f32468815 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:47.435772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de5a50-550a-4a7e-9732-1c3f32468815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:47.437391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de5a50-550a-4a7e-9732-1c3f32468815 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:47.448868 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3833/7758] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:47 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:47.453132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde23ed-b139-45ac-8f96-1af89ad4cf86 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:47.463798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde23ed-b139-45ac-8f96-1af89ad4cf86 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:47.468551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a24609-f4a2-4a2a-a4be-5d60ad4cd0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:47.469933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a24609-f4a2-4a2a-a4be-5d60ad4cd0be admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:47.470285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a24609-f4a2-4a2a-a4be-5d60ad4cd0be admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:47.470561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a24609-f4a2-4a2a-a4be-5d60ad4cd0be admin admin] PATH_INFO: `/v3/projects/09ec5411a0a644e3b035bf193fa8b9b4/users/8c2bfb8a50de42e788b5c7574a91ac1b/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:47.472719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a24609-f4a2-4a2a-a4be-5d60ad4cd0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ec5411a0a644e3b035bf193fa8b9b4, user_id=8c2bfb8a50de42e788b5c7574a91ac1b, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:47.475565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a24609-f4a2-4a2a-a4be-5d60ad4cd0be admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:47.486284 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3926/7759] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:47 2021] PUT /identity/v3/projects/09ec5411a0a644e3b035bf193fa8b9b4/users/8c2bfb8a50de42e788b5c7574a91ac1b/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:47.496007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a2ad3-9e0c-41b6-a01b-9ad201695d07 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:47.496296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a2ad3-9e0c-41b6-a01b-9ad201695d07 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:47.496573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a2ad3-9e0c-41b6-a01b-9ad201695d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:47.522797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a01a2ad3-9e0c-41b6-a01b-9ad201695d07 None None] MFA Rules not processed for user `8c2bfb8a50de42e788b5c7574a91ac1b`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:47.523995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a01a2ad3-9e0c-41b6-a01b-9ad201695d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:47.590935 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3834/7760] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:47 2021] POST /identity/v3/auth/tokens => generated 3289 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:47.595949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a24609-f4a2-4a2a-a4be-5d60ad4cd0be admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:47.606430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a24609-f4a2-4a2a-a4be-5d60ad4cd0be admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:47.611683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56577501-e87f-49bb-855e-8fbe32036757 tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2bfb8a50de42e788b5c7574a91ac1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ec5411a0a644e3b035bf193fa8b9b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:47.612323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56577501-e87f-49bb-855e-8fbe32036757 tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:47.612604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56577501-e87f-49bb-855e-8fbe32036757 tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:47.612896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56577501-e87f-49bb-855e-8fbe32036757 tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:47.613613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56577501-e87f-49bb-855e-8fbe32036757 tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:47.613949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56577501-e87f-49bb-855e-8fbe32036757 tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:47.615567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56577501-e87f-49bb-855e-8fbe32036757 tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:47.628549 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3927/7761] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:16:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:47.632869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a2ad3-9e0c-41b6-a01b-9ad201695d07 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:47.642069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a2ad3-9e0c-41b6-a01b-9ad201695d07 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:47.647479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad291f22-9e42-402c-838c-8c2cbd266d9d tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2bfb8a50de42e788b5c7574a91ac1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ec5411a0a644e3b035bf193fa8b9b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:47.648134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad291f22-9e42-402c-838c-8c2cbd266d9d tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:47.648424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad291f22-9e42-402c-838c-8c2cbd266d9d tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:47.648737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad291f22-9e42-402c-838c-8c2cbd266d9d tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:47.649415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad291f22-9e42-402c-838c-8c2cbd266d9d tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:47.651354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad291f22-9e42-402c-838c-8c2cbd266d9d tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:47.676182 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3835/7762] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:47 2021] POST /identity/v3/projects => generated 349 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:47.681183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56577501-e87f-49bb-855e-8fbe32036757 tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:47.697186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56577501-e87f-49bb-855e-8fbe32036757 tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:47.781705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3f86f-da30-4c5c-be29-1b2b91b7939c tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2bfb8a50de42e788b5c7574a91ac1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ec5411a0a644e3b035bf193fa8b9b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:47.782427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3f86f-da30-4c5c-be29-1b2b91b7939c tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:47.783324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3f86f-da30-4c5c-be29-1b2b91b7939c tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:47.783607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3f86f-da30-4c5c-be29-1b2b91b7939c tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:47.784358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3f86f-da30-4c5c-be29-1b2b91b7939c tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:47.784740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3f86f-da30-4c5c-be29-1b2b91b7939c tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:47.786566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3f86f-da30-4c5c-be29-1b2b91b7939c tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:47.801145 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3928/7763] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:16:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:16:47.811531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad291f22-9e42-402c-838c-8c2cbd266d9d tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:47.818899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ad291f22-9e42-402c-838c-8c2cbd266d9d tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:47.882558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad291f22-9e42-402c-838c-8c2cbd266d9d tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:47.886242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a46fa-4c62-4b49-a466-1cdb5fd5f724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:47.886947 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a46fa-4c62-4b49-a466-1cdb5fd5f724 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:47.887235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a46fa-4c62-4b49-a466-1cdb5fd5f724 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:47.887517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a46fa-4c62-4b49-a466-1cdb5fd5f724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:47.896889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a46fa-4c62-4b49-a466-1cdb5fd5f724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:47.898341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a46fa-4c62-4b49-a466-1cdb5fd5f724 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:47.908946 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3836/7764] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:47 2021] GET /identity/v3/auth/tokens => generated 3289 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:48.034666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3f86f-da30-4c5c-be29-1b2b91b7939c tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:48.044513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3f86f-da30-4c5c-be29-1b2b91b7939c tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:48.049636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e92049-227f-4906-b54b-e0ae8093342e tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c2bfb8a50de42e788b5c7574a91ac1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09ec5411a0a644e3b035bf193fa8b9b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:48.050505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92049-227f-4906-b54b-e0ae8093342e tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:48.050794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92049-227f-4906-b54b-e0ae8093342e tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:48.051072 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92049-227f-4906-b54b-e0ae8093342e tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] PATH_INFO: `/v3/projects/190349ee244244409924a2fbf8354b71` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:48.052264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e92049-227f-4906-b54b-e0ae8093342e tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] RBAC: Authorizing `identity:delete_project(project_id=190349ee244244409924a2fbf8354b71)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:48.054146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e92049-227f-4906-b54b-e0ae8093342e tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:48.099000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c5e92049-227f-4906-b54b-e0ae8093342e tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '190349ee244244409924a2fbf8354b71', 'request_id': 'req-c5e92049-227f-4906-b54b-e0ae8093342e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:48.105342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c5e92049-227f-4906-b54b-e0ae8093342e tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '190349ee244244409924a2fbf8354b71', 'request_id': 'req-c5e92049-227f-4906-b54b-e0ae8093342e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:48.112633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c5e92049-227f-4906-b54b-e0ae8093342e tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '190349ee244244409924a2fbf8354b71', 'request_id': 'req-c5e92049-227f-4906-b54b-e0ae8093342e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:48.122913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c5e92049-227f-4906-b54b-e0ae8093342e tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] The token cache is being invalidate because project 190349ee244244409924a2fbf8354b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:48.123203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c5e92049-227f-4906-b54b-e0ae8093342e tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:48.123826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c5e92049-227f-4906-b54b-e0ae8093342e tempest-QuotasTest-835092447 tempest-QuotasTest-835092447-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:48.125337 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3929/7765] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:48 2021] DELETE /identity/v3/projects/190349ee244244409924a2fbf8354b71 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:48.275553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a46fa-4c62-4b49-a466-1cdb5fd5f724 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:48.341235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a46fa-4c62-4b49-a466-1cdb5fd5f724 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:48.402845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638936ef-5373-41b9-bb8f-79e9cf7bce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:48.403730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638936ef-5373-41b9-bb8f-79e9cf7bce56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:48.404542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638936ef-5373-41b9-bb8f-79e9cf7bce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:48.404853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638936ef-5373-41b9-bb8f-79e9cf7bce56 admin admin] PATH_INFO: `/v3/users/78858cc0e17a462caf4a6e5f7627bece` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:48.406089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638936ef-5373-41b9-bb8f-79e9cf7bce56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78858cc0e17a462caf4a6e5f7627bece)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:48.408620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638936ef-5373-41b9-bb8f-79e9cf7bce56 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:48.453531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-638936ef-5373-41b9-bb8f-79e9cf7bce56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78858cc0e17a462caf4a6e5f7627bece'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:48.460811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-638936ef-5373-41b9-bb8f-79e9cf7bce56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78858cc0e17a462caf4a6e5f7627bece'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:48.472158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-638936ef-5373-41b9-bb8f-79e9cf7bce56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78858cc0e17a462caf4a6e5f7627bece'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:48.472829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-638936ef-5373-41b9-bb8f-79e9cf7bce56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78858cc0e17a462caf4a6e5f7627bece'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:48.479470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-638936ef-5373-41b9-bb8f-79e9cf7bce56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78858cc0e17a462caf4a6e5f7627bece'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:48.485506 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3837/7766] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:48 2021] DELETE /identity/v3/users/78858cc0e17a462caf4a6e5f7627bece => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:48.490109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1436ab3-98b3-402e-8f42-3fdfe76d9d73 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:48.490447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1436ab3-98b3-402e-8f42-3fdfe76d9d73 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:48.490733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1436ab3-98b3-402e-8f42-3fdfe76d9d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:48.508348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c1436ab3-98b3-402e-8f42-3fdfe76d9d73 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:48.509547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c1436ab3-98b3-402e-8f42-3fdfe76d9d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:48.565881 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3930/7767] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:48.575989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638936ef-5373-41b9-bb8f-79e9cf7bce56 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:48.577291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-638936ef-5373-41b9-bb8f-79e9cf7bce56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:48.636653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638936ef-5373-41b9-bb8f-79e9cf7bce56 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:48.640434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4cf9e-68ef-4458-bdb5-bb30affc70ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:48.641082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4cf9e-68ef-4458-bdb5-bb30affc70ae service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:48.641368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4cf9e-68ef-4458-bdb5-bb30affc70ae service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:48.641677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4cf9e-68ef-4458-bdb5-bb30affc70ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:48.651393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4cf9e-68ef-4458-bdb5-bb30affc70ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:48.652792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4cf9e-68ef-4458-bdb5-bb30affc70ae service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:48.662021 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3838/7768] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:48.978342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1436ab3-98b3-402e-8f42-3fdfe76d9d73 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:48.981337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c1436ab3-98b3-402e-8f42-3fdfe76d9d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:49.004079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1436ab3-98b3-402e-8f42-3fdfe76d9d73 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:49.011434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cb811-db75-45e4-8df3-534b6c2a3833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:49.012865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cb811-db75-45e4-8df3-534b6c2a3833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:49.013558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cb811-db75-45e4-8df3-534b6c2a3833 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:49.014143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cb811-db75-45e4-8df3-534b6c2a3833 admin admin] PATH_INFO: `/v3/projects/ccb59047cbc24a8fa9003efc4aa7837b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:49.016455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cb811-db75-45e4-8df3-534b6c2a3833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb59047cbc24a8fa9003efc4aa7837b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:49.019561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cb811-db75-45e4-8df3-534b6c2a3833 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:49.075280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb2cb811-db75-45e4-8df3-534b6c2a3833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb59047cbc24a8fa9003efc4aa7837b', 'request_id': 'req-cb2cb811-db75-45e4-8df3-534b6c2a3833'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:49.082056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb2cb811-db75-45e4-8df3-534b6c2a3833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb59047cbc24a8fa9003efc4aa7837b', 'request_id': 'req-cb2cb811-db75-45e4-8df3-534b6c2a3833'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:49.090243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb2cb811-db75-45e4-8df3-534b6c2a3833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb59047cbc24a8fa9003efc4aa7837b', 'request_id': 'req-cb2cb811-db75-45e4-8df3-534b6c2a3833'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:49.102145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb2cb811-db75-45e4-8df3-534b6c2a3833 admin admin] The token cache is being invalidate because project ccb59047cbc24a8fa9003efc4aa7837b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:49.102402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb2cb811-db75-45e4-8df3-534b6c2a3833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:49.103044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cb2cb811-db75-45e4-8df3-534b6c2a3833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:49.104699 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3931/7769] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:48 2021] DELETE /identity/v3/projects/ccb59047cbc24a8fa9003efc4aa7837b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:49.109153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4cf9e-68ef-4458-bdb5-bb30affc70ae service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:49.122181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4cf9e-68ef-4458-bdb5-bb30affc70ae service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:49.185302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046019-fb11-4d08-94fa-20d2d029d308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:49.186093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046019-fb11-4d08-94fa-20d2d029d308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:49.186493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046019-fb11-4d08-94fa-20d2d029d308 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:49.186756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046019-fb11-4d08-94fa-20d2d029d308 admin admin] PATH_INFO: `/v3/users/8c2bfb8a50de42e788b5c7574a91ac1b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:49.188335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a046019-fb11-4d08-94fa-20d2d029d308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2bfb8a50de42e788b5c7574a91ac1b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:49.191810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a046019-fb11-4d08-94fa-20d2d029d308 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:49.241266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8a046019-fb11-4d08-94fa-20d2d029d308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2bfb8a50de42e788b5c7574a91ac1b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:49.248838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8a046019-fb11-4d08-94fa-20d2d029d308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2bfb8a50de42e788b5c7574a91ac1b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:49.261658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8a046019-fb11-4d08-94fa-20d2d029d308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2bfb8a50de42e788b5c7574a91ac1b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:49.262405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8a046019-fb11-4d08-94fa-20d2d029d308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2bfb8a50de42e788b5c7574a91ac1b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:49.269994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8a046019-fb11-4d08-94fa-20d2d029d308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2bfb8a50de42e788b5c7574a91ac1b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:49.276102 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3839/7770] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:49 2021] DELETE /identity/v3/users/8c2bfb8a50de42e788b5c7574a91ac1b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:49.565671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cb811-db75-45e4-8df3-534b6c2a3833 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:49.567530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cb2cb811-db75-45e4-8df3-534b6c2a3833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:49.582684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cb811-db75-45e4-8df3-534b6c2a3833 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:49.651616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc039588-6e11-42f4-9faa-cd4479b6ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:49.652398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc039588-6e11-42f4-9faa-cd4479b6ed0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:49.652794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc039588-6e11-42f4-9faa-cd4479b6ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:49.653079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc039588-6e11-42f4-9faa-cd4479b6ed0b admin admin] PATH_INFO: `/v3/projects/09ec5411a0a644e3b035bf193fa8b9b4` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:49.654661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc039588-6e11-42f4-9faa-cd4479b6ed0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=09ec5411a0a644e3b035bf193fa8b9b4)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:49.657150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc039588-6e11-42f4-9faa-cd4479b6ed0b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:49.709351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bc039588-6e11-42f4-9faa-cd4479b6ed0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09ec5411a0a644e3b035bf193fa8b9b4', 'request_id': 'req-bc039588-6e11-42f4-9faa-cd4479b6ed0b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:49.715974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bc039588-6e11-42f4-9faa-cd4479b6ed0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09ec5411a0a644e3b035bf193fa8b9b4', 'request_id': 'req-bc039588-6e11-42f4-9faa-cd4479b6ed0b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:49.724716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bc039588-6e11-42f4-9faa-cd4479b6ed0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09ec5411a0a644e3b035bf193fa8b9b4', 'request_id': 'req-bc039588-6e11-42f4-9faa-cd4479b6ed0b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:49.736469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bc039588-6e11-42f4-9faa-cd4479b6ed0b admin admin] The token cache is being invalidate because project 09ec5411a0a644e3b035bf193fa8b9b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:49.736765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bc039588-6e11-42f4-9faa-cd4479b6ed0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:49.737419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bc039588-6e11-42f4-9faa-cd4479b6ed0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:49.739028 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3932/7771] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:49 2021] DELETE /identity/v3/projects/09ec5411a0a644e3b035bf193fa8b9b4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:49.746185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea613f-c095-4cb1-810a-ca77dae628b9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:49.746705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea613f-c095-4cb1-810a-ca77dae628b9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:49.747093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea613f-c095-4cb1-810a-ca77dae628b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:49.768672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e7ea613f-c095-4cb1-810a-ca77dae628b9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:49.770035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e7ea613f-c095-4cb1-810a-ca77dae628b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:49.832845 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3840/7772] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:49.843606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2e566-e308-486c-9777-adfbd8f3572a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:49.843889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2e566-e308-486c-9777-adfbd8f3572a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:49.844216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2e566-e308-486c-9777-adfbd8f3572a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:49.866020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8eb2e566-e308-486c-9777-adfbd8f3572a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:49.867259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8eb2e566-e308-486c-9777-adfbd8f3572a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:49.875872 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3933/7773] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:49.880218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea613f-c095-4cb1-810a-ca77dae628b9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:49.890193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea613f-c095-4cb1-810a-ca77dae628b9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:49.896302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f1ad6-79b0-49e1-a2b2-3faec9ba753e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:49.896970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f1ad6-79b0-49e1-a2b2-3faec9ba753e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:49.897261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f1ad6-79b0-49e1-a2b2-3faec9ba753e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:49.897540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f1ad6-79b0-49e1-a2b2-3faec9ba753e admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:49.898335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f1ad6-79b0-49e1-a2b2-3faec9ba753e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:49.898651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f1ad6-79b0-49e1-a2b2-3faec9ba753e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:49.900424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f1ad6-79b0-49e1-a2b2-3faec9ba753e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:49.913384 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3841/7774] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:16:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:49.919550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2e566-e308-486c-9777-adfbd8f3572a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:49.929227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2e566-e308-486c-9777-adfbd8f3572a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:49.933968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfa661-30d3-42d4-88d4-13d77dc66267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:49.934651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfa661-30d3-42d4-88d4-13d77dc66267 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:49.934938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfa661-30d3-42d4-88d4-13d77dc66267 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:49.935225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfa661-30d3-42d4-88d4-13d77dc66267 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:49.935925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfa661-30d3-42d4-88d4-13d77dc66267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:49.937822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfa661-30d3-42d4-88d4-13d77dc66267 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:49.963189 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3934/7775] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:49 2021] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:49.967432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f1ad6-79b0-49e1-a2b2-3faec9ba753e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:49.977550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f1ad6-79b0-49e1-a2b2-3faec9ba753e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:50.040875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4334109-2af3-456b-8e94-4485ae82e1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:50.041736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4334109-2af3-456b-8e94-4485ae82e1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:50.042023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4334109-2af3-456b-8e94-4485ae82e1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:50.042338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4334109-2af3-456b-8e94-4485ae82e1f6 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:50.043892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4334109-2af3-456b-8e94-4485ae82e1f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:50.046524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4334109-2af3-456b-8e94-4485ae82e1f6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:50.071233 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3842/7776] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:49 2021] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:50.075765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfa661-30d3-42d4-88d4-13d77dc66267 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:50.087517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfa661-30d3-42d4-88d4-13d77dc66267 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:50.092421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae253442-43e1-4678-aa69-c22e8aad4cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:50.093073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae253442-43e1-4678-aa69-c22e8aad4cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:50.093355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae253442-43e1-4678-aa69-c22e8aad4cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:50.093632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae253442-43e1-4678-aa69-c22e8aad4cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:50.094388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae253442-43e1-4678-aa69-c22e8aad4cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:50.095996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae253442-43e1-4678-aa69-c22e8aad4cf5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:50.106913 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3935/7777] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:50.110801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4334109-2af3-456b-8e94-4485ae82e1f6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:50.126771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4334109-2af3-456b-8e94-4485ae82e1f6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:50.132210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490541e-9054-41b9-9028-c8fef753294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:50.133261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490541e-9054-41b9-9028-c8fef753294c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:50.133547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490541e-9054-41b9-9028-c8fef753294c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:50.133827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490541e-9054-41b9-9028-c8fef753294c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:50.134615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490541e-9054-41b9-9028-c8fef753294c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:50.136210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490541e-9054-41b9-9028-c8fef753294c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:50.150345 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3843/7778] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:50 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:50.155714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae253442-43e1-4678-aa69-c22e8aad4cf5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:50.166956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae253442-43e1-4678-aa69-c22e8aad4cf5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:50.172397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc213eed-d3d3-4051-9e4d-8a5373f2412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:50.173374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc213eed-d3d3-4051-9e4d-8a5373f2412b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:50.173672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc213eed-d3d3-4051-9e4d-8a5373f2412b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:50.173951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc213eed-d3d3-4051-9e4d-8a5373f2412b admin admin] PATH_INFO: `/v3/projects/362a3b4aa8aa4069aa95325acaf0b117/users/b346794f665e4717b6d4d8723932e0fc/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:50.193490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc213eed-d3d3-4051-9e4d-8a5373f2412b admin admin] RBAC: Authorizing `identity:create_grant(project_id=362a3b4aa8aa4069aa95325acaf0b117, user_id=b346794f665e4717b6d4d8723932e0fc, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:50.196489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc213eed-d3d3-4051-9e4d-8a5373f2412b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:50.211357 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3936/7779] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:50 2021] PUT /identity/v3/projects/362a3b4aa8aa4069aa95325acaf0b117/users/b346794f665e4717b6d4d8723932e0fc/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:50.224042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfbcc8-4173-4121-98d2-021ea4929907 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:50.224042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfbcc8-4173-4121-98d2-021ea4929907 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:50.224307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfbcc8-4173-4121-98d2-021ea4929907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:50.254414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-50dfbcc8-4173-4121-98d2-021ea4929907 None None] MFA Rules not processed for user `b346794f665e4717b6d4d8723932e0fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:50.255789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-50dfbcc8-4173-4121-98d2-021ea4929907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:50.323446 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3844/7780] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:50 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:50.328103 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc213eed-d3d3-4051-9e4d-8a5373f2412b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:50.394214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc213eed-d3d3-4051-9e4d-8a5373f2412b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:50.399169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0033a-2f96-4859-a0a4-a2134dd95717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:50.400017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0033a-2f96-4859-a0a4-a2134dd95717 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:50.400304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0033a-2f96-4859-a0a4-a2134dd95717 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:50.400590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0033a-2f96-4859-a0a4-a2134dd95717 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:50.401303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0033a-2f96-4859-a0a4-a2134dd95717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:50.403345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0033a-2f96-4859-a0a4-a2134dd95717 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:50.431376 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3937/7781] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:50 2021] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:50.434427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfbcc8-4173-4121-98d2-021ea4929907 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:50.445808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfbcc8-4173-4121-98d2-021ea4929907 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:50.515394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf7989-644f-477f-805b-70dc0f8c4f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:50.516415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf7989-644f-477f-805b-70dc0f8c4f98 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:50.516744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf7989-644f-477f-805b-70dc0f8c4f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:50.517032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf7989-644f-477f-805b-70dc0f8c4f98 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:50.517758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf7989-644f-477f-805b-70dc0f8c4f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:50.520401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf7989-644f-477f-805b-70dc0f8c4f98 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:50.541512 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3845/7782] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:50 2021] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:50.544178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0033a-2f96-4859-a0a4-a2134dd95717 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:50.555269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0033a-2f96-4859-a0a4-a2134dd95717 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:50.559990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087d2a1-590a-4931-9a9f-31abcc76dcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:50.560645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087d2a1-590a-4931-9a9f-31abcc76dcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:50.560929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087d2a1-590a-4931-9a9f-31abcc76dcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:50.561433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087d2a1-590a-4931-9a9f-31abcc76dcf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:50.562117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087d2a1-590a-4931-9a9f-31abcc76dcf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:50.563601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087d2a1-590a-4931-9a9f-31abcc76dcf6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:50.578545 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3938/7783] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:50.582096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf7989-644f-477f-805b-70dc0f8c4f98 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:50.592933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf7989-644f-477f-805b-70dc0f8c4f98 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:50.597720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a0353-36cf-4bf1-9105-31fb5bab1b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:50.598766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0353-36cf-4bf1-9105-31fb5bab1b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:50.599057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0353-36cf-4bf1-9105-31fb5bab1b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:50.599339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0353-36cf-4bf1-9105-31fb5bab1b09 admin admin] PATH_INFO: `/v3/projects/96a623bef8b44ad09974033cdb95984b/users/c70a13320c234d8b8a355ebae1dd7fb2/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:50.619789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a0353-36cf-4bf1-9105-31fb5bab1b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a623bef8b44ad09974033cdb95984b, user_id=c70a13320c234d8b8a355ebae1dd7fb2, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:50.622499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a0353-36cf-4bf1-9105-31fb5bab1b09 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:50.641105 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3846/7784] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:50 2021] PUT /identity/v3/projects/96a623bef8b44ad09974033cdb95984b/users/c70a13320c234d8b8a355ebae1dd7fb2/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:50.645113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087d2a1-590a-4931-9a9f-31abcc76dcf6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:50.655007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087d2a1-590a-4931-9a9f-31abcc76dcf6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:50.666382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a0353-36cf-4bf1-9105-31fb5bab1b09 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:50.668074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b92a0353-36cf-4bf1-9105-31fb5bab1b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:50.714664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e8e38-c6a2-4554-8add-f73c048e133b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:50.715132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e8e38-c6a2-4554-8add-f73c048e133b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:50.717790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e8e38-c6a2-4554-8add-f73c048e133b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:50.717790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e8e38-c6a2-4554-8add-f73c048e133b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:50.718454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e8e38-c6a2-4554-8add-f73c048e133b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:50.720600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e8e38-c6a2-4554-8add-f73c048e133b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:50.731322 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3939/7785] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:50 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:16:50.735155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a0353-36cf-4bf1-9105-31fb5bab1b09 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:50.736454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e8e38-c6a2-4554-8add-f73c048e133b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:50.748307 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e8e38-c6a2-4554-8add-f73c048e133b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:50.752046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a34b5-a489-43cc-99d4-479f1ec96ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:50.753000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a34b5-a489-43cc-99d4-479f1ec96ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:50.753320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a34b5-a489-43cc-99d4-479f1ec96ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:50.753601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a34b5-a489-43cc-99d4-479f1ec96ed0 admin admin] PATH_INFO: `/v3/users/66b65268b3834da5b1ee59f12dfc04c8` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:50.755856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a34b5-a489-43cc-99d4-479f1ec96ed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b65268b3834da5b1ee59f12dfc04c8)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:50.758473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a34b5-a489-43cc-99d4-479f1ec96ed0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:50.759895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55656b76-e3c8-454c-8a5f-2918eb01725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:50.760782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55656b76-e3c8-454c-8a5f-2918eb01725d admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:50.761136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55656b76-e3c8-454c-8a5f-2918eb01725d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:50.761420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55656b76-e3c8-454c-8a5f-2918eb01725d admin admin] PATH_INFO: `/v3/projects/96a623bef8b44ad09974033cdb95984b/users/c70a13320c234d8b8a355ebae1dd7fb2/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:50.765543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55656b76-e3c8-454c-8a5f-2918eb01725d admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a623bef8b44ad09974033cdb95984b, user_id=c70a13320c234d8b8a355ebae1dd7fb2, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:50.768379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55656b76-e3c8-454c-8a5f-2918eb01725d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:50.781093 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3940/7786] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:50 2021] PUT /identity/v3/projects/96a623bef8b44ad09974033cdb95984b/users/c70a13320c234d8b8a355ebae1dd7fb2/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:50.792954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88222f0-7786-4353-84ce-af5a1059e7a5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:50.793296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88222f0-7786-4353-84ce-af5a1059e7a5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:50.793722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88222f0-7786-4353-84ce-af5a1059e7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:50.820216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ac9a34b5-a489-43cc-99d4-479f1ec96ed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b65268b3834da5b1ee59f12dfc04c8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:50.827216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c88222f0-7786-4353-84ce-af5a1059e7a5 None None] MFA Rules not processed for user `c70a13320c234d8b8a355ebae1dd7fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:50.828747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ac9a34b5-a489-43cc-99d4-479f1ec96ed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b65268b3834da5b1ee59f12dfc04c8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:50.828970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c88222f0-7786-4353-84ce-af5a1059e7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:50.841503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ac9a34b5-a489-43cc-99d4-479f1ec96ed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b65268b3834da5b1ee59f12dfc04c8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:50.842239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ac9a34b5-a489-43cc-99d4-479f1ec96ed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b65268b3834da5b1ee59f12dfc04c8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:50.851967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ac9a34b5-a489-43cc-99d4-479f1ec96ed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b65268b3834da5b1ee59f12dfc04c8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:50.858287 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3847/7787] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:50 2021] DELETE /identity/v3/users/66b65268b3834da5b1ee59f12dfc04c8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:50.863284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ad8ce-1e7e-41ac-a778-221a26a7253b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:50.863876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ad8ce-1e7e-41ac-a778-221a26a7253b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:50.863876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ad8ce-1e7e-41ac-a778-221a26a7253b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:50.881410 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e85ad8ce-1e7e-41ac-a778-221a26a7253b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:50.882674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e85ad8ce-1e7e-41ac-a778-221a26a7253b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:50.904661 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3941/7788] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:50 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:16:50.918319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88222f0-7786-4353-84ce-af5a1059e7a5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:50.919884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c88222f0-7786-4353-84ce-af5a1059e7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:50.945807 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3848/7789] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:50.958121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ad8ce-1e7e-41ac-a778-221a26a7253b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:50.959662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e85ad8ce-1e7e-41ac-a778-221a26a7253b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:50.991368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88222f0-7786-4353-84ce-af5a1059e7a5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:51.017130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ad8ce-1e7e-41ac-a778-221a26a7253b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:51.020882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939f3be-2730-46ee-9213-76e2eb9a8ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:51.021534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939f3be-2730-46ee-9213-76e2eb9a8ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:51.021819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939f3be-2730-46ee-9213-76e2eb9a8ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:51.022104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939f3be-2730-46ee-9213-76e2eb9a8ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:51.037223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939f3be-2730-46ee-9213-76e2eb9a8ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:51.038687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939f3be-2730-46ee-9213-76e2eb9a8ee9 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:51.039282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f1cae-2ef9-4c19-a1c7-8a41a87be7b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:51.039932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1cae-2ef9-4c19-a1c7-8a41a87be7b5 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:51.040244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1cae-2ef9-4c19-a1c7-8a41a87be7b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:51.040535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1cae-2ef9-4c19-a1c7-8a41a87be7b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:51.048018 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3849/7790] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:16:51.101388 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f1cae-2ef9-4c19-a1c7-8a41a87be7b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:51.103000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f1cae-2ef9-4c19-a1c7-8a41a87be7b5 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:51.113849 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3942/7791] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:50 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:16:51.369201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939f3be-2730-46ee-9213-76e2eb9a8ee9 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:51.370842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1939f3be-2730-46ee-9213-76e2eb9a8ee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:51.387146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939f3be-2730-46ee-9213-76e2eb9a8ee9 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:51.393646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc1fe2-39fb-4ca0-8e41-a137f88db27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:51.395057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc1fe2-39fb-4ca0-8e41-a137f88db27a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:51.395057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc1fe2-39fb-4ca0-8e41-a137f88db27a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:51.395467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc1fe2-39fb-4ca0-8e41-a137f88db27a admin admin] PATH_INFO: `/v3/projects/757b8ebe833d422891a28187ee5b7887` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:51.396931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc1fe2-39fb-4ca0-8e41-a137f88db27a admin admin] RBAC: Authorizing `identity:delete_project(project_id=757b8ebe833d422891a28187ee5b7887)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:51.406126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc1fe2-39fb-4ca0-8e41-a137f88db27a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:51.461455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1dcc1fe2-39fb-4ca0-8e41-a137f88db27a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '757b8ebe833d422891a28187ee5b7887', 'request_id': 'req-1dcc1fe2-39fb-4ca0-8e41-a137f88db27a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:51.469143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1dcc1fe2-39fb-4ca0-8e41-a137f88db27a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '757b8ebe833d422891a28187ee5b7887', 'request_id': 'req-1dcc1fe2-39fb-4ca0-8e41-a137f88db27a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:51.477655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1dcc1fe2-39fb-4ca0-8e41-a137f88db27a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '757b8ebe833d422891a28187ee5b7887', 'request_id': 'req-1dcc1fe2-39fb-4ca0-8e41-a137f88db27a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:51.492178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1dcc1fe2-39fb-4ca0-8e41-a137f88db27a admin admin] The token cache is being invalidate because project 757b8ebe833d422891a28187ee5b7887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:51.492468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1dcc1fe2-39fb-4ca0-8e41-a137f88db27a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:51.493591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1dcc1fe2-39fb-4ca0-8e41-a137f88db27a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:51.495010 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3850/7792] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:51 2021] DELETE /identity/v3/projects/757b8ebe833d422891a28187ee5b7887 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:51.503624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf82e9-d3fe-4c90-b1e9-dd680fcff758 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:51.503908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf82e9-d3fe-4c90-b1e9-dd680fcff758 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:51.504571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf82e9-d3fe-4c90-b1e9-dd680fcff758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:51.535067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0acf82e9-d3fe-4c90-b1e9-dd680fcff758 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:51.536389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0acf82e9-d3fe-4c90-b1e9-dd680fcff758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:51.634330 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3943/7793] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:16:51.641531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41955aa3-0108-4dc0-b04b-79a745de55b5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:51.642629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41955aa3-0108-4dc0-b04b-79a745de55b5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:51.642968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41955aa3-0108-4dc0-b04b-79a745de55b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:51.663490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-41955aa3-0108-4dc0-b04b-79a745de55b5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:51.664735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-41955aa3-0108-4dc0-b04b-79a745de55b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:51.676060 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3851/7794] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:51.680705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf82e9-d3fe-4c90-b1e9-dd680fcff758 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:51.697231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf82e9-d3fe-4c90-b1e9-dd680fcff758 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:51.705259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ef579-5c14-40c7-9668-bc3d73895773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:51.706141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ef579-5c14-40c7-9668-bc3d73895773 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:51.706429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ef579-5c14-40c7-9668-bc3d73895773 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:51.706808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ef579-5c14-40c7-9668-bc3d73895773 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:51.707651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ef579-5c14-40c7-9668-bc3d73895773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:51.708415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ef579-5c14-40c7-9668-bc3d73895773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:51.710157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ef579-5c14-40c7-9668-bc3d73895773 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:51.725591 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3944/7795] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:16:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:51.729784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41955aa3-0108-4dc0-b04b-79a745de55b5 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:51.739683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41955aa3-0108-4dc0-b04b-79a745de55b5 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:51.746437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dfa16-b237-423c-bcdd-e3bc7388c383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:51.747188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dfa16-b237-423c-bcdd-e3bc7388c383 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:51.747540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dfa16-b237-423c-bcdd-e3bc7388c383 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:51.747886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dfa16-b237-423c-bcdd-e3bc7388c383 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:51.748674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173dfa16-b237-423c-bcdd-e3bc7388c383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:51.751096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173dfa16-b237-423c-bcdd-e3bc7388c383 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:51.784980 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3852/7796] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:51 2021] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:51.786066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ef579-5c14-40c7-9668-bc3d73895773 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:51.796697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ef579-5c14-40c7-9668-bc3d73895773 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:51.868808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1673ee-0f34-43d3-9a9c-4ae3de42d5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:51.869644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1673ee-0f34-43d3-9a9c-4ae3de42d5ab admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:51.869933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1673ee-0f34-43d3-9a9c-4ae3de42d5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:51.870215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1673ee-0f34-43d3-9a9c-4ae3de42d5ab admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:51.877552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1673ee-0f34-43d3-9a9c-4ae3de42d5ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:51.879588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1673ee-0f34-43d3-9a9c-4ae3de42d5ab admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:51.903388 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3945/7797] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:51 2021] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:51.907094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dfa16-b237-423c-bcdd-e3bc7388c383 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:51.921473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dfa16-b237-423c-bcdd-e3bc7388c383 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:51.941512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d3518-233f-4047-b13a-3c83c741563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:51.942295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d3518-233f-4047-b13a-3c83c741563f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:51.942611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d3518-233f-4047-b13a-3c83c741563f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:51.942894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d3518-233f-4047-b13a-3c83c741563f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:51.943689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d3518-233f-4047-b13a-3c83c741563f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:51.945824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d3518-233f-4047-b13a-3c83c741563f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:51.957703 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3853/7798] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:51 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:51.961505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1673ee-0f34-43d3-9a9c-4ae3de42d5ab admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:51.972273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1673ee-0f34-43d3-9a9c-4ae3de42d5ab admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:51.977468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297146bd-0bc0-4936-b7e4-a4700b829ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:51.978129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297146bd-0bc0-4936-b7e4-a4700b829ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:51.978449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297146bd-0bc0-4936-b7e4-a4700b829ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:51.978734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297146bd-0bc0-4936-b7e4-a4700b829ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:51.979470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297146bd-0bc0-4936-b7e4-a4700b829ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:51.981069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297146bd-0bc0-4936-b7e4-a4700b829ab1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:51.992450 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3946/7799] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:51 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:16:51.996495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d3518-233f-4047-b13a-3c83c741563f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:52.009174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d3518-233f-4047-b13a-3c83c741563f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:52.014107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71844e0d-c2da-46e6-b42e-2277a12aed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:52.015037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71844e0d-c2da-46e6-b42e-2277a12aed1f admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:52.015326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71844e0d-c2da-46e6-b42e-2277a12aed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:52.015926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71844e0d-c2da-46e6-b42e-2277a12aed1f admin admin] PATH_INFO: `/v3/projects/7c9e69ed78c74b85b85181a235cada83/users/1ab46676c5da4bde9bbc47c04ee69ca4/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:52.031315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71844e0d-c2da-46e6-b42e-2277a12aed1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9e69ed78c74b85b85181a235cada83, user_id=1ab46676c5da4bde9bbc47c04ee69ca4, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:52.034340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71844e0d-c2da-46e6-b42e-2277a12aed1f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:52.063210 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3854/7800] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:51 2021] PUT /identity/v3/projects/7c9e69ed78c74b85b85181a235cada83/users/1ab46676c5da4bde9bbc47c04ee69ca4/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:52.076241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135e166-e82b-4ad9-9d33-d1583c4a6522 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:52.076530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135e166-e82b-4ad9-9d33-d1583c4a6522 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:52.076815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135e166-e82b-4ad9-9d33-d1583c4a6522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:52.114375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2135e166-e82b-4ad9-9d33-d1583c4a6522 None None] MFA Rules not processed for user `1ab46676c5da4bde9bbc47c04ee69ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:52.115992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2135e166-e82b-4ad9-9d33-d1583c4a6522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:52.191697 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3947/7801] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:52 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:52.195549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71844e0d-c2da-46e6-b42e-2277a12aed1f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:52.263172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71844e0d-c2da-46e6-b42e-2277a12aed1f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:52.267815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140acde-db2f-4ec3-be03-2cd6f4ce705b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:52.268480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140acde-db2f-4ec3-be03-2cd6f4ce705b admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:52.268817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140acde-db2f-4ec3-be03-2cd6f4ce705b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:52.269226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140acde-db2f-4ec3-be03-2cd6f4ce705b admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:52.269806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140acde-db2f-4ec3-be03-2cd6f4ce705b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:52.271767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140acde-db2f-4ec3-be03-2cd6f4ce705b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:52.304466 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3855/7802] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:52 2021] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:52.305625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135e166-e82b-4ad9-9d33-d1583c4a6522 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:52.317172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135e166-e82b-4ad9-9d33-d1583c4a6522 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:52.373300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb760f24-355a-4b7e-8d5b-6b18ff4ad603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:52.373971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb760f24-355a-4b7e-8d5b-6b18ff4ad603 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:52.374271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb760f24-355a-4b7e-8d5b-6b18ff4ad603 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:52.374570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb760f24-355a-4b7e-8d5b-6b18ff4ad603 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:52.375277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb760f24-355a-4b7e-8d5b-6b18ff4ad603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:52.377222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb760f24-355a-4b7e-8d5b-6b18ff4ad603 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:52.396528 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3948/7803] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:52 2021] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:52.400509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140acde-db2f-4ec3-be03-2cd6f4ce705b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:52.411606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140acde-db2f-4ec3-be03-2cd6f4ce705b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:52.416630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce4904-9522-479f-9c9b-6a7f72cee2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:52.417295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce4904-9522-479f-9c9b-6a7f72cee2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:52.417600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce4904-9522-479f-9c9b-6a7f72cee2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:52.417863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce4904-9522-479f-9c9b-6a7f72cee2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:52.418645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce4904-9522-479f-9c9b-6a7f72cee2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:52.420235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce4904-9522-479f-9c9b-6a7f72cee2d5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:52.431587 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3856/7804] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:52 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:52.435726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb760f24-355a-4b7e-8d5b-6b18ff4ad603 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:52.446993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb760f24-355a-4b7e-8d5b-6b18ff4ad603 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:52.453205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490ddfb-6084-4440-b1c9-d39960fbc08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:52.454341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490ddfb-6084-4440-b1c9-d39960fbc08c admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:52.454746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490ddfb-6084-4440-b1c9-d39960fbc08c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:52.455035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490ddfb-6084-4440-b1c9-d39960fbc08c admin admin] PATH_INFO: `/v3/projects/8f86687ccb1d498585f8c370dac5fae1/users/61e3dc02622349c08f6198871c76c3a0/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:52.470911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490ddfb-6084-4440-b1c9-d39960fbc08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f86687ccb1d498585f8c370dac5fae1, user_id=61e3dc02622349c08f6198871c76c3a0, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:52.473662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490ddfb-6084-4440-b1c9-d39960fbc08c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:52.488242 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3949/7805] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:52 2021] PUT /identity/v3/projects/8f86687ccb1d498585f8c370dac5fae1/users/61e3dc02622349c08f6198871c76c3a0/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:52.492180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce4904-9522-479f-9c9b-6a7f72cee2d5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:52.502702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce4904-9522-479f-9c9b-6a7f72cee2d5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:52.560031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1e3f8-2970-4856-99bd-f40e3d18b2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:52.560613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1e3f8-2970-4856-99bd-f40e3d18b2ff admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:52.560898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1e3f8-2970-4856-99bd-f40e3d18b2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:52.561179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1e3f8-2970-4856-99bd-f40e3d18b2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:52.561906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1e3f8-2970-4856-99bd-f40e3d18b2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:52.563633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1e3f8-2970-4856-99bd-f40e3d18b2ff admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:52.573689 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3857/7806] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:52 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:52.577794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490ddfb-6084-4440-b1c9-d39960fbc08c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:52.591325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490ddfb-6084-4440-b1c9-d39960fbc08c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:52.597127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01d6ad-c127-4497-b619-9c75138f2db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:52.598023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01d6ad-c127-4497-b619-9c75138f2db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:52.598344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01d6ad-c127-4497-b619-9c75138f2db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:52.598658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01d6ad-c127-4497-b619-9c75138f2db2 admin admin] PATH_INFO: `/v3/projects/8f86687ccb1d498585f8c370dac5fae1/users/61e3dc02622349c08f6198871c76c3a0/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:52.601265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01d6ad-c127-4497-b619-9c75138f2db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f86687ccb1d498585f8c370dac5fae1, user_id=61e3dc02622349c08f6198871c76c3a0, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:52.603680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01d6ad-c127-4497-b619-9c75138f2db2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:52.615709 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3950/7807] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:52 2021] PUT /identity/v3/projects/8f86687ccb1d498585f8c370dac5fae1/users/61e3dc02622349c08f6198871c76c3a0/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:52.625970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32da28-b01b-4473-b5b3-1447c123977d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:52.626336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32da28-b01b-4473-b5b3-1447c123977d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:52.626651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32da28-b01b-4473-b5b3-1447c123977d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:52.665637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0a32da28-b01b-4473-b5b3-1447c123977d None None] MFA Rules not processed for user `61e3dc02622349c08f6198871c76c3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:52.666951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0a32da28-b01b-4473-b5b3-1447c123977d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:52.738673 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3858/7808] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:52 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:16:52.743713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01d6ad-c127-4497-b619-9c75138f2db2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:52.757057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01d6ad-c127-4497-b619-9c75138f2db2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:52.764571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fdaf3-fda3-4467-bb62-e302fae6924c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e3dc02622349c08f6198871c76c3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86687ccb1d498585f8c370dac5fae1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:52.767228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fdaf3-fda3-4467-bb62-e302fae6924c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:52.767395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fdaf3-fda3-4467-bb62-e302fae6924c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:52.767784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fdaf3-fda3-4467-bb62-e302fae6924c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:52.768812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fdaf3-fda3-4467-bb62-e302fae6924c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:52.771041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fdaf3-fda3-4467-bb62-e302fae6924c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:52.805506 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3951/7809] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:52 2021] POST /identity/v3/projects => generated 358 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:52.814486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32da28-b01b-4473-b5b3-1447c123977d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:52.827708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32da28-b01b-4473-b5b3-1447c123977d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:52.895418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc381556-39e5-4b25-966c-fffc618bfb1c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e3dc02622349c08f6198871c76c3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86687ccb1d498585f8c370dac5fae1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:52.896587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc381556-39e5-4b25-966c-fffc618bfb1c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:52.896907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc381556-39e5-4b25-966c-fffc618bfb1c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:52.897190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc381556-39e5-4b25-966c-fffc618bfb1c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] PATH_INFO: `/v3/projects/0f531673721d4564bea8d64ca0881c94/tags/tempest-tag-1836364314` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:52.898573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc381556-39e5-4b25-966c-fffc618bfb1c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=0f531673721d4564bea8d64ca0881c94, value=tempest-tag-1836364314)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:52.900735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc381556-39e5-4b25-966c-fffc618bfb1c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:52.973857 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-fc381556-39e5-4b25-966c-fffc618bfb1c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1836364314. To ensure interoperability, identifiers should be a valid uuid. Dec 18 21:16:52.973857 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 18 21:16:52.973857 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:16:52.981487 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3859/7810] 10.222.0.13 () {60 vars in 1332 bytes} [Sat Dec 18 21:16:52 2021] PUT /identity/v3/projects/0f531673721d4564bea8d64ca0881c94/tags/tempest-tag-1836364314 => generated 0 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Dec 18 21:16:52.987014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fdaf3-fda3-4467-bb62-e302fae6924c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:53.000172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fdaf3-fda3-4467-bb62-e302fae6924c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:53.005472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9b0fb-ad89-4708-b17a-bfdf54b5d79c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e3dc02622349c08f6198871c76c3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86687ccb1d498585f8c370dac5fae1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:53.006395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9b0fb-ad89-4708-b17a-bfdf54b5d79c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:53.006682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9b0fb-ad89-4708-b17a-bfdf54b5d79c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:53.006967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9b0fb-ad89-4708-b17a-bfdf54b5d79c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] PATH_INFO: `/v3/projects/0f531673721d4564bea8d64ca0881c94/tags/tempest-tag-1836364314` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:53.021640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9b0fb-ad89-4708-b17a-bfdf54b5d79c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=0f531673721d4564bea8d64ca0881c94, value=tempest-tag-1836364314)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:53.024206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9b0fb-ad89-4708-b17a-bfdf54b5d79c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:53.038297 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3952/7811] 10.222.0.13 () {58 vars in 1313 bytes} [Sat Dec 18 21:16:52 2021] GET /identity/v3/projects/0f531673721d4564bea8d64ca0881c94/tags/tempest-tag-1836364314 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:53.042838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc381556-39e5-4b25-966c-fffc618bfb1c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:53.054650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc381556-39e5-4b25-966c-fffc618bfb1c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:53.060287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec932359-4efa-49f1-8faf-d1c8fa534f55 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e3dc02622349c08f6198871c76c3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86687ccb1d498585f8c370dac5fae1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:53.061225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec932359-4efa-49f1-8faf-d1c8fa534f55 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:53.061468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec932359-4efa-49f1-8faf-d1c8fa534f55 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:53.061755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec932359-4efa-49f1-8faf-d1c8fa534f55 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] PATH_INFO: `/v3/projects/0f531673721d4564bea8d64ca0881c94/tags` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:53.063320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec932359-4efa-49f1-8faf-d1c8fa534f55 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=0f531673721d4564bea8d64ca0881c94)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:53.066586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec932359-4efa-49f1-8faf-d1c8fa534f55 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:53.119241 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3860/7812] 10.222.0.13 () {60 vars in 1264 bytes} [Sat Dec 18 21:16:53 2021] PUT /identity/v3/projects/0f531673721d4564bea8d64ca0881c94/tags => generated 140 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:53.123240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9b0fb-ad89-4708-b17a-bfdf54b5d79c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:53.135106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9b0fb-ad89-4708-b17a-bfdf54b5d79c tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:53.140085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7b426-db94-48a6-96ef-78200e79f644 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e3dc02622349c08f6198871c76c3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86687ccb1d498585f8c370dac5fae1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:53.140913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7b426-db94-48a6-96ef-78200e79f644 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:53.141207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7b426-db94-48a6-96ef-78200e79f644 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:53.141490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7b426-db94-48a6-96ef-78200e79f644 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] PATH_INFO: `/v3/projects/0f531673721d4564bea8d64ca0881c94/tags` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:53.155478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7b426-db94-48a6-96ef-78200e79f644 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=0f531673721d4564bea8d64ca0881c94)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:53.157576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7b426-db94-48a6-96ef-78200e79f644 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:53.168937 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3953/7813] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:16:53 2021] GET /identity/v3/projects/0f531673721d4564bea8d64ca0881c94/tags => generated 140 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:53.173091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec932359-4efa-49f1-8faf-d1c8fa534f55 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:53.183731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec932359-4efa-49f1-8faf-d1c8fa534f55 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:53.189398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47422bb6-1263-4fda-be9f-4287d2ddcf55 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e3dc02622349c08f6198871c76c3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86687ccb1d498585f8c370dac5fae1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:53.190364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47422bb6-1263-4fda-be9f-4287d2ddcf55 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:53.190906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47422bb6-1263-4fda-be9f-4287d2ddcf55 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:53.191525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47422bb6-1263-4fda-be9f-4287d2ddcf55 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] PATH_INFO: `/v3/projects/0f531673721d4564bea8d64ca0881c94/tags/tempest-tag-1359468468` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:53.192967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47422bb6-1263-4fda-be9f-4287d2ddcf55 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=0f531673721d4564bea8d64ca0881c94, value=tempest-tag-1359468468)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:53.195201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47422bb6-1263-4fda-be9f-4287d2ddcf55 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:53.235069 ncdv-master-1 devstack@keystone.service[96645]: WARNING py.warnings [None req-47422bb6-1263-4fda-be9f-4287d2ddcf55 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1359468468. To ensure interoperability, identifiers should be a valid uuid. Dec 18 21:16:53.235069 ncdv-master-1 devstack@keystone.service[96645]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 18 21:16:53.235069 ncdv-master-1 devstack@keystone.service[96645]: Dec 18 21:16:53.239974 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3861/7814] 10.222.0.13 () {58 vars in 1316 bytes} [Sat Dec 18 21:16:53 2021] DELETE /identity/v3/projects/0f531673721d4564bea8d64ca0881c94/tags/tempest-tag-1359468468 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:53.244316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7b426-db94-48a6-96ef-78200e79f644 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:53.254812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7b426-db94-48a6-96ef-78200e79f644 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:53.259618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eae22f-8627-4fcf-a50f-75bb382799dd tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e3dc02622349c08f6198871c76c3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86687ccb1d498585f8c370dac5fae1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:53.260514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eae22f-8627-4fcf-a50f-75bb382799dd tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:53.260832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eae22f-8627-4fcf-a50f-75bb382799dd tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:53.261144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eae22f-8627-4fcf-a50f-75bb382799dd tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] PATH_INFO: `/v3/projects/0f531673721d4564bea8d64ca0881c94/tags/tempest-tag-1359468468` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:53.272681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eae22f-8627-4fcf-a50f-75bb382799dd tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=0f531673721d4564bea8d64ca0881c94, value=tempest-tag-1359468468)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:53.274789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eae22f-8627-4fcf-a50f-75bb382799dd tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:53.296491 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-62eae22f-8627-4fcf-a50f-75bb382799dd tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Could not find project tag: tempest-tag-1359468468.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1359468468. Dec 18 21:16:53.301455 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3954/7815] 10.222.0.13 () {58 vars in 1313 bytes} [Sat Dec 18 21:16:53 2021] GET /identity/v3/projects/0f531673721d4564bea8d64ca0881c94/tags/tempest-tag-1359468468 => generated 107 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 18 21:16:53.302510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47422bb6-1263-4fda-be9f-4287d2ddcf55 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:53.312554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47422bb6-1263-4fda-be9f-4287d2ddcf55 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:53.318464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09f0f1-7d6a-46f1-93f9-690c575ce6c8 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e3dc02622349c08f6198871c76c3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86687ccb1d498585f8c370dac5fae1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:53.319521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09f0f1-7d6a-46f1-93f9-690c575ce6c8 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:53.320211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09f0f1-7d6a-46f1-93f9-690c575ce6c8 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:53.320525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09f0f1-7d6a-46f1-93f9-690c575ce6c8 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] PATH_INFO: `/v3/projects/0f531673721d4564bea8d64ca0881c94/tags` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:53.321809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09f0f1-7d6a-46f1-93f9-690c575ce6c8 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=0f531673721d4564bea8d64ca0881c94)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:53.323955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09f0f1-7d6a-46f1-93f9-690c575ce6c8 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:53.365595 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3862/7816] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Dec 18 21:16:53 2021] DELETE /identity/v3/projects/0f531673721d4564bea8d64ca0881c94/tags => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:53.369731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eae22f-8627-4fcf-a50f-75bb382799dd tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:53.380282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eae22f-8627-4fcf-a50f-75bb382799dd tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:53.384974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d5343-8e85-49d3-9403-c9d50726654f tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e3dc02622349c08f6198871c76c3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86687ccb1d498585f8c370dac5fae1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:53.385790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d5343-8e85-49d3-9403-c9d50726654f tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:53.386075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d5343-8e85-49d3-9403-c9d50726654f tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:53.386394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d5343-8e85-49d3-9403-c9d50726654f tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] PATH_INFO: `/v3/projects/0f531673721d4564bea8d64ca0881c94/tags` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:53.396971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d5343-8e85-49d3-9403-c9d50726654f tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=0f531673721d4564bea8d64ca0881c94)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:53.399048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d5343-8e85-49d3-9403-c9d50726654f tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:53.409671 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3955/7817] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Dec 18 21:16:53 2021] GET /identity/v3/projects/0f531673721d4564bea8d64ca0881c94/tags => generated 66 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 18 21:16:53.414210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09f0f1-7d6a-46f1-93f9-690c575ce6c8 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:53.425102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09f0f1-7d6a-46f1-93f9-690c575ce6c8 tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:53.429658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afa0dd-fd3c-4d55-9b99-7dc3f5270eef tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e3dc02622349c08f6198871c76c3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f86687ccb1d498585f8c370dac5fae1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:53.430547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afa0dd-fd3c-4d55-9b99-7dc3f5270eef tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:53.430842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afa0dd-fd3c-4d55-9b99-7dc3f5270eef tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:53.431120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afa0dd-fd3c-4d55-9b99-7dc3f5270eef tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] PATH_INFO: `/v3/projects/0f531673721d4564bea8d64ca0881c94` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:53.432447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afa0dd-fd3c-4d55-9b99-7dc3f5270eef tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f531673721d4564bea8d64ca0881c94)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:53.434352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afa0dd-fd3c-4d55-9b99-7dc3f5270eef tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:53.481028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-17afa0dd-fd3c-4d55-9b99-7dc3f5270eef tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f531673721d4564bea8d64ca0881c94', 'request_id': 'req-17afa0dd-fd3c-4d55-9b99-7dc3f5270eef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:53.488115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-17afa0dd-fd3c-4d55-9b99-7dc3f5270eef tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f531673721d4564bea8d64ca0881c94', 'request_id': 'req-17afa0dd-fd3c-4d55-9b99-7dc3f5270eef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:53.493486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-17afa0dd-fd3c-4d55-9b99-7dc3f5270eef tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f531673721d4564bea8d64ca0881c94', 'request_id': 'req-17afa0dd-fd3c-4d55-9b99-7dc3f5270eef'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:53.505953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-17afa0dd-fd3c-4d55-9b99-7dc3f5270eef tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] The token cache is being invalidate because project 0f531673721d4564bea8d64ca0881c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:53.506245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-17afa0dd-fd3c-4d55-9b99-7dc3f5270eef tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:53.506932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-17afa0dd-fd3c-4d55-9b99-7dc3f5270eef tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:53.508461 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3863/7818] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:53 2021] DELETE /identity/v3/projects/0f531673721d4564bea8d64ca0881c94 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:53.513585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d5343-8e85-49d3-9403-c9d50726654f tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:53.515851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7b3d5343-8e85-49d3-9403-c9d50726654f tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:53.580616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d5343-8e85-49d3-9403-c9d50726654f tempest-IdentityV3ProjectTagsTest-96576705 tempest-IdentityV3ProjectTagsTest-96576705-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:53.641511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c1f4a-0c99-4dad-8e5a-165ce07719de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:53.642451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c1f4a-0c99-4dad-8e5a-165ce07719de admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:53.642734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c1f4a-0c99-4dad-8e5a-165ce07719de admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:53.643007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c1f4a-0c99-4dad-8e5a-165ce07719de admin admin] PATH_INFO: `/v3/users/1ab46676c5da4bde9bbc47c04ee69ca4` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:53.644246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c1f4a-0c99-4dad-8e5a-165ce07719de admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab46676c5da4bde9bbc47c04ee69ca4)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:53.646273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c1f4a-0c99-4dad-8e5a-165ce07719de admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:53.706563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9d9c1f4a-0c99-4dad-8e5a-165ce07719de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab46676c5da4bde9bbc47c04ee69ca4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:53.713625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9d9c1f4a-0c99-4dad-8e5a-165ce07719de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab46676c5da4bde9bbc47c04ee69ca4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:53.714519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9d9c1f4a-0c99-4dad-8e5a-165ce07719de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab46676c5da4bde9bbc47c04ee69ca4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:53.727674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9d9c1f4a-0c99-4dad-8e5a-165ce07719de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab46676c5da4bde9bbc47c04ee69ca4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:53.746640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9d9c1f4a-0c99-4dad-8e5a-165ce07719de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab46676c5da4bde9bbc47c04ee69ca4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:53.749433 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3956/7819] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:53 2021] DELETE /identity/v3/users/1ab46676c5da4bde9bbc47c04ee69ca4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:53.754449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510de281-3602-4c22-b2ef-15d91a5ba0e0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:53.754925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510de281-3602-4c22-b2ef-15d91a5ba0e0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:53.755138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510de281-3602-4c22-b2ef-15d91a5ba0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:53.773015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-510de281-3602-4c22-b2ef-15d91a5ba0e0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:53.774204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-510de281-3602-4c22-b2ef-15d91a5ba0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:53.837448 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3864/7820] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:53.849019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c1f4a-0c99-4dad-8e5a-165ce07719de admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:53.850456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9d9c1f4a-0c99-4dad-8e5a-165ce07719de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:53.919155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c1f4a-0c99-4dad-8e5a-165ce07719de admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:53.924125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488ef7d-be1c-40ef-a129-d14057050114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:53.924779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488ef7d-be1c-40ef-a129-d14057050114 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:53.925061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488ef7d-be1c-40ef-a129-d14057050114 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:53.925327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488ef7d-be1c-40ef-a129-d14057050114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:53.935963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488ef7d-be1c-40ef-a129-d14057050114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:53.937416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488ef7d-be1c-40ef-a129-d14057050114 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:53.948938 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3957/7821] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:16:54.246810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510de281-3602-4c22-b2ef-15d91a5ba0e0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:54.248358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-510de281-3602-4c22-b2ef-15d91a5ba0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:54.265846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510de281-3602-4c22-b2ef-15d91a5ba0e0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:54.271303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaa4a3-c801-43a5-8767-caa484bc2e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:54.272369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa4a3-c801-43a5-8767-caa484bc2e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:54.272812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa4a3-c801-43a5-8767-caa484bc2e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:54.273228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa4a3-c801-43a5-8767-caa484bc2e5a admin admin] PATH_INFO: `/v3/projects/7c9e69ed78c74b85b85181a235cada83` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:54.275232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aaa4a3-c801-43a5-8767-caa484bc2e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c9e69ed78c74b85b85181a235cada83)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:54.277489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aaa4a3-c801-43a5-8767-caa484bc2e5a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:54.342303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-53aaa4a3-c801-43a5-8767-caa484bc2e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c9e69ed78c74b85b85181a235cada83', 'request_id': 'req-53aaa4a3-c801-43a5-8767-caa484bc2e5a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:54.351980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-53aaa4a3-c801-43a5-8767-caa484bc2e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c9e69ed78c74b85b85181a235cada83', 'request_id': 'req-53aaa4a3-c801-43a5-8767-caa484bc2e5a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:54.358906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-53aaa4a3-c801-43a5-8767-caa484bc2e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c9e69ed78c74b85b85181a235cada83', 'request_id': 'req-53aaa4a3-c801-43a5-8767-caa484bc2e5a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:54.374175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-53aaa4a3-c801-43a5-8767-caa484bc2e5a admin admin] The token cache is being invalidate because project 7c9e69ed78c74b85b85181a235cada83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:54.374810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-53aaa4a3-c801-43a5-8767-caa484bc2e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:54.375649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-53aaa4a3-c801-43a5-8767-caa484bc2e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:54.377625 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3865/7822] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:54 2021] DELETE /identity/v3/projects/7c9e69ed78c74b85b85181a235cada83 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:54.381741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488ef7d-be1c-40ef-a129-d14057050114 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:54.393184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488ef7d-be1c-40ef-a129-d14057050114 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:54.450769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077b969-c519-4451-ae51-9b579b2883b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:54.451755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077b969-c519-4451-ae51-9b579b2883b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:54.452073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077b969-c519-4451-ae51-9b579b2883b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:54.452445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077b969-c519-4451-ae51-9b579b2883b0 admin admin] PATH_INFO: `/v3/users/61e3dc02622349c08f6198871c76c3a0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:54.453737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077b969-c519-4451-ae51-9b579b2883b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61e3dc02622349c08f6198871c76c3a0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:54.456258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077b969-c519-4451-ae51-9b579b2883b0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:54.504219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f077b969-c519-4451-ae51-9b579b2883b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61e3dc02622349c08f6198871c76c3a0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:54.511156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f077b969-c519-4451-ae51-9b579b2883b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61e3dc02622349c08f6198871c76c3a0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:54.511855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f077b969-c519-4451-ae51-9b579b2883b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61e3dc02622349c08f6198871c76c3a0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:54.526794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f077b969-c519-4451-ae51-9b579b2883b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61e3dc02622349c08f6198871c76c3a0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:54.534907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f077b969-c519-4451-ae51-9b579b2883b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61e3dc02622349c08f6198871c76c3a0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:54.541479 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3958/7823] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:54 2021] DELETE /identity/v3/users/61e3dc02622349c08f6198871c76c3a0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:55.051111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaa4a3-c801-43a5-8767-caa484bc2e5a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:55.053228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-53aaa4a3-c801-43a5-8767-caa484bc2e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:55.070359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaa4a3-c801-43a5-8767-caa484bc2e5a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:55.141684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9468e-ad16-4bdc-b83b-d873d88eca8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:55.143115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9468e-ad16-4bdc-b83b-d873d88eca8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:55.143568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9468e-ad16-4bdc-b83b-d873d88eca8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:55.144003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9468e-ad16-4bdc-b83b-d873d88eca8e admin admin] PATH_INFO: `/v3/projects/8f86687ccb1d498585f8c370dac5fae1` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:55.145652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9468e-ad16-4bdc-b83b-d873d88eca8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f86687ccb1d498585f8c370dac5fae1)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:55.148241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9468e-ad16-4bdc-b83b-d873d88eca8e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:55.215470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-80d9468e-ad16-4bdc-b83b-d873d88eca8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f86687ccb1d498585f8c370dac5fae1', 'request_id': 'req-80d9468e-ad16-4bdc-b83b-d873d88eca8e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:55.224481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-80d9468e-ad16-4bdc-b83b-d873d88eca8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f86687ccb1d498585f8c370dac5fae1', 'request_id': 'req-80d9468e-ad16-4bdc-b83b-d873d88eca8e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:55.232085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-80d9468e-ad16-4bdc-b83b-d873d88eca8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f86687ccb1d498585f8c370dac5fae1', 'request_id': 'req-80d9468e-ad16-4bdc-b83b-d873d88eca8e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:55.270004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-80d9468e-ad16-4bdc-b83b-d873d88eca8e admin admin] The token cache is being invalidate because project 8f86687ccb1d498585f8c370dac5fae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:55.270649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-80d9468e-ad16-4bdc-b83b-d873d88eca8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:55.273491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-80d9468e-ad16-4bdc-b83b-d873d88eca8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:55.277318 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3866/7824] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:55 2021] DELETE /identity/v3/projects/8f86687ccb1d498585f8c370dac5fae1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:55.283764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb430a8a-b39f-4cb4-9249-a0c93e4644b4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:55.284183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb430a8a-b39f-4cb4-9249-a0c93e4644b4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:55.284557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb430a8a-b39f-4cb4-9249-a0c93e4644b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:55.311255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bb430a8a-b39f-4cb4-9249-a0c93e4644b4 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:55.313087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bb430a8a-b39f-4cb4-9249-a0c93e4644b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:55.405271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee748f0-143e-45b2-925b-0ef8d6a03ebc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:55.405469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee748f0-143e-45b2-925b-0ef8d6a03ebc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:55.405734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee748f0-143e-45b2-925b-0ef8d6a03ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:55.407001 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3959/7825] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:16:55.447352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-eee748f0-143e-45b2-925b-0ef8d6a03ebc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:55.451475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eee748f0-143e-45b2-925b-0ef8d6a03ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:55.473125 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3867/7826] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:55.474445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb430a8a-b39f-4cb4-9249-a0c93e4644b4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:55.496393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb430a8a-b39f-4cb4-9249-a0c93e4644b4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:55.501664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73547f30-71d0-4997-aeaa-b6caf0906419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:55.502371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73547f30-71d0-4997-aeaa-b6caf0906419 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:55.502822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73547f30-71d0-4997-aeaa-b6caf0906419 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:55.503261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73547f30-71d0-4997-aeaa-b6caf0906419 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:55.504164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73547f30-71d0-4997-aeaa-b6caf0906419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:55.504628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73547f30-71d0-4997-aeaa-b6caf0906419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:55.506441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73547f30-71d0-4997-aeaa-b6caf0906419 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:55.523138 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3960/7827] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:16:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:55.527743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee748f0-143e-45b2-925b-0ef8d6a03ebc None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:55.542022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee748f0-143e-45b2-925b-0ef8d6a03ebc None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:55.554872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb8521-50f3-448e-936f-e05a0f9f276c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:55.555664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb8521-50f3-448e-936f-e05a0f9f276c admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:55.556021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb8521-50f3-448e-936f-e05a0f9f276c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:55.556371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb8521-50f3-448e-936f-e05a0f9f276c admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:55.556997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb8521-50f3-448e-936f-e05a0f9f276c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:55.559211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb8521-50f3-448e-936f-e05a0f9f276c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:55.591459 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3868/7828] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:55 2021] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:55.595666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73547f30-71d0-4997-aeaa-b6caf0906419 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:55.612857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73547f30-71d0-4997-aeaa-b6caf0906419 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:55.724420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c0fbf-094e-4bf7-b72a-98cc3a2c61e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:55.725720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c0fbf-094e-4bf7-b72a-98cc3a2c61e7 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:55.726794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c0fbf-094e-4bf7-b72a-98cc3a2c61e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:55.727579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c0fbf-094e-4bf7-b72a-98cc3a2c61e7 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:55.731238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c0fbf-094e-4bf7-b72a-98cc3a2c61e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:55.736952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c0fbf-094e-4bf7-b72a-98cc3a2c61e7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:55.766565 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3961/7829] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:55 2021] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:55.768840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb8521-50f3-448e-936f-e05a0f9f276c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:55.783115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb8521-50f3-448e-936f-e05a0f9f276c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:55.789205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e56d9-28f4-485b-a5fc-4a4ef0ece5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:55.790001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e56d9-28f4-485b-a5fc-4a4ef0ece5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:55.790438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e56d9-28f4-485b-a5fc-4a4ef0ece5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:55.790822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e56d9-28f4-485b-a5fc-4a4ef0ece5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:55.791975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e56d9-28f4-485b-a5fc-4a4ef0ece5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:55.794105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e56d9-28f4-485b-a5fc-4a4ef0ece5e3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:55.813025 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3869/7830] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:55 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:55.814293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c0fbf-094e-4bf7-b72a-98cc3a2c61e7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:55.830512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c0fbf-094e-4bf7-b72a-98cc3a2c61e7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:55.836094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abde5a2-fa07-4af6-9a7a-07b7cfcd9e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:55.836855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abde5a2-fa07-4af6-9a7a-07b7cfcd9e0b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:55.837062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abde5a2-fa07-4af6-9a7a-07b7cfcd9e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:55.837380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abde5a2-fa07-4af6-9a7a-07b7cfcd9e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:55.838086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abde5a2-fa07-4af6-9a7a-07b7cfcd9e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:55.839761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abde5a2-fa07-4af6-9a7a-07b7cfcd9e0b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:55.857023 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3962/7831] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:55 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:55.859076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e56d9-28f4-485b-a5fc-4a4ef0ece5e3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:55.871388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e56d9-28f4-485b-a5fc-4a4ef0ece5e3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:55.878408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d79a6f-57d2-41c3-99b6-fabf75082a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:55.879479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d79a6f-57d2-41c3-99b6-fabf75082a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:55.879861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d79a6f-57d2-41c3-99b6-fabf75082a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:55.880132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d79a6f-57d2-41c3-99b6-fabf75082a99 admin admin] PATH_INFO: `/v3/projects/2c15880a38944318ba245c17d71b8b1b/users/2d5f62d535504c908ba1f8416b2fa799/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:55.897177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d79a6f-57d2-41c3-99b6-fabf75082a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c15880a38944318ba245c17d71b8b1b, user_id=2d5f62d535504c908ba1f8416b2fa799, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:55.899849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d79a6f-57d2-41c3-99b6-fabf75082a99 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:55.915625 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3870/7832] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:55 2021] PUT /identity/v3/projects/2c15880a38944318ba245c17d71b8b1b/users/2d5f62d535504c908ba1f8416b2fa799/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:55.927168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8435d-5334-4919-a06f-507ea7dd45b5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:55.927425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8435d-5334-4919-a06f-507ea7dd45b5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:55.927733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8435d-5334-4919-a06f-507ea7dd45b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:55.962872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a3d8435d-5334-4919-a06f-507ea7dd45b5 None None] MFA Rules not processed for user `2d5f62d535504c908ba1f8416b2fa799`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:55.964144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a3d8435d-5334-4919-a06f-507ea7dd45b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:56.042548 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3963/7833] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:55 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:56.047219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d79a6f-57d2-41c3-99b6-fabf75082a99 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:56.113403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d79a6f-57d2-41c3-99b6-fabf75082a99 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:56.118182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768058e7-d4d6-4604-af1d-ee7cd0326934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:56.118923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768058e7-d4d6-4604-af1d-ee7cd0326934 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:56.119218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768058e7-d4d6-4604-af1d-ee7cd0326934 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:56.119496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768058e7-d4d6-4604-af1d-ee7cd0326934 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:56.120211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768058e7-d4d6-4604-af1d-ee7cd0326934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:56.122102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768058e7-d4d6-4604-af1d-ee7cd0326934 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:56.151231 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3871/7834] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:56 2021] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:56.152355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8435d-5334-4919-a06f-507ea7dd45b5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:56.163074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8435d-5334-4919-a06f-507ea7dd45b5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:56.220025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7833a4f-e3f5-46cd-818c-6ad4e9b73e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:56.220693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7833a4f-e3f5-46cd-818c-6ad4e9b73e05 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:56.221027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7833a4f-e3f5-46cd-818c-6ad4e9b73e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:56.221311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7833a4f-e3f5-46cd-818c-6ad4e9b73e05 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:56.222018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7833a4f-e3f5-46cd-818c-6ad4e9b73e05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:56.223988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7833a4f-e3f5-46cd-818c-6ad4e9b73e05 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:56.249643 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3964/7835] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:56 2021] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:56.250845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768058e7-d4d6-4604-af1d-ee7cd0326934 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:56.261588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768058e7-d4d6-4604-af1d-ee7cd0326934 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:56.266214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5435b4-a9e9-4256-98e5-96d09d307f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:56.267457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5435b4-a9e9-4256-98e5-96d09d307f0a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:56.267747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5435b4-a9e9-4256-98e5-96d09d307f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:56.268024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5435b4-a9e9-4256-98e5-96d09d307f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:56.268750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5435b4-a9e9-4256-98e5-96d09d307f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:56.270359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5435b4-a9e9-4256-98e5-96d09d307f0a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:56.280820 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3872/7836] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:56 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:56.284965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7833a4f-e3f5-46cd-818c-6ad4e9b73e05 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:56.294741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7833a4f-e3f5-46cd-818c-6ad4e9b73e05 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:56.299811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524331d-151e-4858-8747-8c072739fcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:56.301320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524331d-151e-4858-8747-8c072739fcf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:56.301706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524331d-151e-4858-8747-8c072739fcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:56.302134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524331d-151e-4858-8747-8c072739fcf1 admin admin] PATH_INFO: `/v3/projects/591bfaf2a69843b79d836310a67d0511/users/9fabd71893b74e8c97a1ef914279220e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:56.324820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524331d-151e-4858-8747-8c072739fcf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591bfaf2a69843b79d836310a67d0511, user_id=9fabd71893b74e8c97a1ef914279220e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:56.327931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524331d-151e-4858-8747-8c072739fcf1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:56.343637 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3965/7837] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:56 2021] PUT /identity/v3/projects/591bfaf2a69843b79d836310a67d0511/users/9fabd71893b74e8c97a1ef914279220e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:56.347786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5435b4-a9e9-4256-98e5-96d09d307f0a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:56.358307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5435b4-a9e9-4256-98e5-96d09d307f0a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:56.415796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443fc8f2-b582-4948-8c3f-cb706df960e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:56.416464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fc8f2-b582-4948-8c3f-cb706df960e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:56.416747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fc8f2-b582-4948-8c3f-cb706df960e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:56.417026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fc8f2-b582-4948-8c3f-cb706df960e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:56.417755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443fc8f2-b582-4948-8c3f-cb706df960e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:56.419371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443fc8f2-b582-4948-8c3f-cb706df960e7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:56.429700 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3873/7838] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:56 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:16:56.433774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524331d-151e-4858-8747-8c072739fcf1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:56.445015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524331d-151e-4858-8747-8c072739fcf1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:56.449773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0741277-6af7-449f-a632-84695c4aac00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:56.450780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0741277-6af7-449f-a632-84695c4aac00 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:56.451062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0741277-6af7-449f-a632-84695c4aac00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:56.451397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0741277-6af7-449f-a632-84695c4aac00 admin admin] PATH_INFO: `/v3/projects/591bfaf2a69843b79d836310a67d0511/users/9fabd71893b74e8c97a1ef914279220e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:56.453491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0741277-6af7-449f-a632-84695c4aac00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591bfaf2a69843b79d836310a67d0511, user_id=9fabd71893b74e8c97a1ef914279220e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:56.456490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0741277-6af7-449f-a632-84695c4aac00 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:56.467203 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3966/7839] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:56 2021] PUT /identity/v3/projects/591bfaf2a69843b79d836310a67d0511/users/9fabd71893b74e8c97a1ef914279220e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:56.477327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eeb67-7deb-43b5-b666-e83e957ac91d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:56.477627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eeb67-7deb-43b5-b666-e83e957ac91d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:56.477916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eeb67-7deb-43b5-b666-e83e957ac91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:56.506481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-731eeb67-7deb-43b5-b666-e83e957ac91d None None] MFA Rules not processed for user `9fabd71893b74e8c97a1ef914279220e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:56.507701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-731eeb67-7deb-43b5-b666-e83e957ac91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:56.553020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0741277-6af7-449f-a632-84695c4aac00 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:56.555033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f0741277-6af7-449f-a632-84695c4aac00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:56.649030 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3874/7840] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:56 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:56.650614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731eeb67-7deb-43b5-b666-e83e957ac91d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:56.653365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0741277-6af7-449f-a632-84695c4aac00 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:56.659084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4a229-1380-4625-94df-d1acc65e3889 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a13320c234d8b8a355ebae1dd7fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a623bef8b44ad09974033cdb95984b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:56.659854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4a229-1380-4625-94df-d1acc65e3889 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:56.660240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4a229-1380-4625-94df-d1acc65e3889 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:56.660620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4a229-1380-4625-94df-d1acc65e3889 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:56.661664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4a229-1380-4625-94df-d1acc65e3889 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:56.662195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4a229-1380-4625-94df-d1acc65e3889 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:56.664002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4a229-1380-4625-94df-d1acc65e3889 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:56.675029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731eeb67-7deb-43b5-b666-e83e957ac91d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:56.682581 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3967/7841] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:16:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:16:56.685738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ac9cc-1522-423f-8336-3ad7e3ed26ba tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fabd71893b74e8c97a1ef914279220e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591bfaf2a69843b79d836310a67d0511', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:56.685926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4a229-1380-4625-94df-d1acc65e3889 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:56.688005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac9cc-1522-423f-8336-3ad7e3ed26ba tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:56.688364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac9cc-1522-423f-8336-3ad7e3ed26ba tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:56.689234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac9cc-1522-423f-8336-3ad7e3ed26ba tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:56.691491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ac9cc-1522-423f-8336-3ad7e3ed26ba tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:56.696362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ac9cc-1522-423f-8336-3ad7e3ed26ba tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:56.702934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4a229-1380-4625-94df-d1acc65e3889 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:56.710052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee54932-a892-4442-a8f4-56b969b1547b tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a13320c234d8b8a355ebae1dd7fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a623bef8b44ad09974033cdb95984b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:56.711120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee54932-a892-4442-a8f4-56b969b1547b tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:56.711583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee54932-a892-4442-a8f4-56b969b1547b tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:56.712044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee54932-a892-4442-a8f4-56b969b1547b tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:56.713058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee54932-a892-4442-a8f4-56b969b1547b tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:56.716322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee54932-a892-4442-a8f4-56b969b1547b tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:56.761879 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3968/7842] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:56 2021] POST /identity/v3/projects => generated 349 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:56.762584 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3875/7843] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:56 2021] POST /identity/v3/projects => generated 359 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:56.766962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee54932-a892-4442-a8f4-56b969b1547b tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:56.772300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ac9cc-1522-423f-8336-3ad7e3ed26ba tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:56.866076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ac9cc-1522-423f-8336-3ad7e3ed26ba tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:56.870702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee54932-a892-4442-a8f4-56b969b1547b tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:56.877216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf55f7b-b2ba-43b1-95ff-957beb1c966a tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fabd71893b74e8c97a1ef914279220e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591bfaf2a69843b79d836310a67d0511', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:56.878231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf55f7b-b2ba-43b1-95ff-957beb1c966a tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:56.878590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf55f7b-b2ba-43b1-95ff-957beb1c966a tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:56.878870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf55f7b-b2ba-43b1-95ff-957beb1c966a tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:56.879593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf55f7b-b2ba-43b1-95ff-957beb1c966a tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:56.881445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf55f7b-b2ba-43b1-95ff-957beb1c966a tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:56.913810 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3969/7844] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:56 2021] POST /identity/v3/users => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:56.918098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf55f7b-b2ba-43b1-95ff-957beb1c966a tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:56.930289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf55f7b-b2ba-43b1-95ff-957beb1c966a tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:56.939143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052af09-683f-4415-8968-07a1b382a99b tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fabd71893b74e8c97a1ef914279220e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591bfaf2a69843b79d836310a67d0511', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:56.940176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052af09-683f-4415-8968-07a1b382a99b tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:56.940522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052af09-683f-4415-8968-07a1b382a99b tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:56.940775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052af09-683f-4415-8968-07a1b382a99b tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:56.942016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052af09-683f-4415-8968-07a1b382a99b tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:56.942431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052af09-683f-4415-8968-07a1b382a99b tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:56.945960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc7111-4b9c-4f0a-b026-75fe39649c78 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a13320c234d8b8a355ebae1dd7fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a623bef8b44ad09974033cdb95984b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:56.946205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052af09-683f-4415-8968-07a1b382a99b tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:56.947545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc7111-4b9c-4f0a-b026-75fe39649c78 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:56.948155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc7111-4b9c-4f0a-b026-75fe39649c78 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:56.948563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc7111-4b9c-4f0a-b026-75fe39649c78 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:56.949613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc7111-4b9c-4f0a-b026-75fe39649c78 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:56.950539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc7111-4b9c-4f0a-b026-75fe39649c78 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:56.952022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc7111-4b9c-4f0a-b026-75fe39649c78 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:56.970323 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3876/7845] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:16:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:56.984572 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3970/7846] 10.222.0.13 () {58 vars in 1156 bytes} [Sat Dec 18 21:16:56 2021] GET /identity/v3/users?domain_id=default => generated 7742 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:16:56.989365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc7111-4b9c-4f0a-b026-75fe39649c78 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:57.002356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc7111-4b9c-4f0a-b026-75fe39649c78 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:57.008185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304069ad-65d9-4cc2-acdc-d93797e94f75 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fabd71893b74e8c97a1ef914279220e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591bfaf2a69843b79d836310a67d0511', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:57.009167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304069ad-65d9-4cc2-acdc-d93797e94f75 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:57.009488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304069ad-65d9-4cc2-acdc-d93797e94f75 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:57.009776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304069ad-65d9-4cc2-acdc-d93797e94f75 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] PATH_INFO: `/v3/users/2b38a8aefc5040c68d30a5ab98ee01f3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:57.026679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304069ad-65d9-4cc2-acdc-d93797e94f75 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: Authorizing `identity:update_user(user_id=2b38a8aefc5040c68d30a5ab98ee01f3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:57.029317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304069ad-65d9-4cc2-acdc-d93797e94f75 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:57.062789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-304069ad-65d9-4cc2-acdc-d93797e94f75 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2b38a8aefc5040c68d30a5ab98ee01f3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.072511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-304069ad-65d9-4cc2-acdc-d93797e94f75 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Invalidating the token cache because user 2b38a8aefc5040c68d30a5ab98ee01f3 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:57.073162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-304069ad-65d9-4cc2-acdc-d93797e94f75 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.074464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-304069ad-65d9-4cc2-acdc-d93797e94f75 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.077299 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3877/7847] 10.222.0.13 () {60 vars in 1243 bytes} [Sat Dec 18 21:16:56 2021] PATCH /identity/v3/users/2b38a8aefc5040c68d30a5ab98ee01f3 => generated 488 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:57.082786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bb8a1-6e8f-4498-8850-0dc5a465c510 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:57.083078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bb8a1-6e8f-4498-8850-0dc5a465c510 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:57.083459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bb8a1-6e8f-4498-8850-0dc5a465c510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:57.101258 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.auth.plugins.core [None req-306bb8a1-6e8f-4498-8850-0dc5a465c510 None None] User is disabled: 2b38a8aefc5040c68d30a5ab98ee01f3: AssertionError: User is disabled: 2b38a8aefc5040c68d30a5ab98ee01f3 Dec 18 21:16:57.111088 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-306bb8a1-6e8f-4498-8850-0dc5a465c510 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Dec 18 21:16:57.113340 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3971/7848] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:57 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 31 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Dec 18 21:16:57.116898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304069ad-65d9-4cc2-acdc-d93797e94f75 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:57.119204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-304069ad-65d9-4cc2-acdc-d93797e94f75 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:57.134665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304069ad-65d9-4cc2-acdc-d93797e94f75 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:57.141015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394431f5-b6fb-4b41-bcac-69e193dcbd89 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fabd71893b74e8c97a1ef914279220e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591bfaf2a69843b79d836310a67d0511', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:57.142309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394431f5-b6fb-4b41-bcac-69e193dcbd89 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:57.142600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394431f5-b6fb-4b41-bcac-69e193dcbd89 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:57.142881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394431f5-b6fb-4b41-bcac-69e193dcbd89 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] PATH_INFO: `/v3/users/2b38a8aefc5040c68d30a5ab98ee01f3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:57.157839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394431f5-b6fb-4b41-bcac-69e193dcbd89 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2b38a8aefc5040c68d30a5ab98ee01f3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:57.159811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394431f5-b6fb-4b41-bcac-69e193dcbd89 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:57.201459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-394431f5-b6fb-4b41-bcac-69e193dcbd89 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b38a8aefc5040c68d30a5ab98ee01f3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.208615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-394431f5-b6fb-4b41-bcac-69e193dcbd89 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b38a8aefc5040c68d30a5ab98ee01f3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.220683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-394431f5-b6fb-4b41-bcac-69e193dcbd89 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b38a8aefc5040c68d30a5ab98ee01f3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.221385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-394431f5-b6fb-4b41-bcac-69e193dcbd89 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b38a8aefc5040c68d30a5ab98ee01f3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.228471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-394431f5-b6fb-4b41-bcac-69e193dcbd89 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b38a8aefc5040c68d30a5ab98ee01f3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.234919 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3878/7849] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:57 2021] DELETE /identity/v3/users/2b38a8aefc5040c68d30a5ab98ee01f3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:57.239093 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bb8a1-6e8f-4498-8850-0dc5a465c510 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:57.241092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-306bb8a1-6e8f-4498-8850-0dc5a465c510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:57.305918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bb8a1-6e8f-4498-8850-0dc5a465c510 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:57.310740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109970d6-a7f3-40a3-9247-07fbc605d46e tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fabd71893b74e8c97a1ef914279220e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591bfaf2a69843b79d836310a67d0511', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:57.311613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109970d6-a7f3-40a3-9247-07fbc605d46e tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:57.311896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109970d6-a7f3-40a3-9247-07fbc605d46e tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:57.312175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109970d6-a7f3-40a3-9247-07fbc605d46e tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] PATH_INFO: `/v3/projects/d433f6e54df44363ac6cf3bdf5d4a754` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:57.313383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109970d6-a7f3-40a3-9247-07fbc605d46e tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d433f6e54df44363ac6cf3bdf5d4a754)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:57.315352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109970d6-a7f3-40a3-9247-07fbc605d46e tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:57.362739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-109970d6-a7f3-40a3-9247-07fbc605d46e tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd433f6e54df44363ac6cf3bdf5d4a754', 'request_id': 'req-109970d6-a7f3-40a3-9247-07fbc605d46e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.368741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-109970d6-a7f3-40a3-9247-07fbc605d46e tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd433f6e54df44363ac6cf3bdf5d4a754', 'request_id': 'req-109970d6-a7f3-40a3-9247-07fbc605d46e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.376587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-109970d6-a7f3-40a3-9247-07fbc605d46e tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd433f6e54df44363ac6cf3bdf5d4a754', 'request_id': 'req-109970d6-a7f3-40a3-9247-07fbc605d46e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.387864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-109970d6-a7f3-40a3-9247-07fbc605d46e tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] The token cache is being invalidate because project d433f6e54df44363ac6cf3bdf5d4a754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:57.388036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-109970d6-a7f3-40a3-9247-07fbc605d46e tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.388982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-109970d6-a7f3-40a3-9247-07fbc605d46e tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.390857 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3972/7850] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:57 2021] DELETE /identity/v3/projects/d433f6e54df44363ac6cf3bdf5d4a754 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:57.395615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394431f5-b6fb-4b41-bcac-69e193dcbd89 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:57.396076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109970d6-a7f3-40a3-9247-07fbc605d46e tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:57.397409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-109970d6-a7f3-40a3-9247-07fbc605d46e tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:57.399188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-394431f5-b6fb-4b41-bcac-69e193dcbd89 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:57.462033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109970d6-a7f3-40a3-9247-07fbc605d46e tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:57.465784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394431f5-b6fb-4b41-bcac-69e193dcbd89 tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:57.466766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d404230-9a75-4a99-bdd7-ab94d1e6d2ca tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fabd71893b74e8c97a1ef914279220e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591bfaf2a69843b79d836310a67d0511', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:57.467426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d404230-9a75-4a99-bdd7-ab94d1e6d2ca tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:57.467707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d404230-9a75-4a99-bdd7-ab94d1e6d2ca tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:57.467984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d404230-9a75-4a99-bdd7-ab94d1e6d2ca tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:57.468679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d404230-9a75-4a99-bdd7-ab94d1e6d2ca tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:57.470642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d404230-9a75-4a99-bdd7-ab94d1e6d2ca tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:57.482159 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-9d404230-9a75-4a99-bdd7-ab94d1e6d2ca tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Could not find domain: 8b8b581e94424320bb9e1c072e6757ec.: keystone.exception.DomainNotFound: Could not find domain: 8b8b581e94424320bb9e1c072e6757ec. Dec 18 21:16:57.483273 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3973/7851] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:57 2021] POST /identity/v3/users => generated 112 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:16:57.487928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d404230-9a75-4a99-bdd7-ab94d1e6d2ca tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:57.489640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9d404230-9a75-4a99-bdd7-ab94d1e6d2ca tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:57.520648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c70a13320c234d8b8a355ebae1dd7fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96a623bef8b44ad09974033cdb95984b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:57.521515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:57.521802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:57.522286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] PATH_INFO: `/v3/projects/480303e9566b446e82f8f4a010882139` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:57.523336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] RBAC: Authorizing `identity:delete_project(project_id=480303e9566b446e82f8f4a010882139)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:57.525239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:57.553431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d404230-9a75-4a99-bdd7-ab94d1e6d2ca tempest-UsersNegativeTest-1182156202 tempest-UsersNegativeTest-1182156202-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:57.558339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96a7e1-d3c1-4a96-b20b-86af826f38dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:57.559240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96a7e1-d3c1-4a96-b20b-86af826f38dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:57.559528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96a7e1-d3c1-4a96-b20b-86af826f38dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:57.559830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96a7e1-d3c1-4a96-b20b-86af826f38dd admin admin] PATH_INFO: `/v3/users/2d5f62d535504c908ba1f8416b2fa799` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:57.561041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96a7e1-d3c1-4a96-b20b-86af826f38dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d5f62d535504c908ba1f8416b2fa799)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:57.563034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96a7e1-d3c1-4a96-b20b-86af826f38dd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:57.570114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480303e9566b446e82f8f4a010882139', 'request_id': 'req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.576067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480303e9566b446e82f8f4a010882139', 'request_id': 'req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.581958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480303e9566b446e82f8f4a010882139', 'request_id': 'req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.595326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] The token cache is being invalidate because project 480303e9566b446e82f8f4a010882139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:57.595621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.596318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.598935 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3879/7852] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:57 2021] DELETE /identity/v3/projects/480303e9566b446e82f8f4a010882139 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:57.609921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:57.611393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:57.614144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cc96a7e1-d3c1-4a96-b20b-86af826f38dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d5f62d535504c908ba1f8416b2fa799'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.621090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cc96a7e1-d3c1-4a96-b20b-86af826f38dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d5f62d535504c908ba1f8416b2fa799'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.621850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cc96a7e1-d3c1-4a96-b20b-86af826f38dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d5f62d535504c908ba1f8416b2fa799'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.635218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cc96a7e1-d3c1-4a96-b20b-86af826f38dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d5f62d535504c908ba1f8416b2fa799'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.642933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-cc96a7e1-d3c1-4a96-b20b-86af826f38dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d5f62d535504c908ba1f8416b2fa799'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:57.648746 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3974/7853] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:57 2021] DELETE /identity/v3/users/2d5f62d535504c908ba1f8416b2fa799 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:16:57.653130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0a2f1-0fc3-44ee-a054-6a940725d91c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:57.653427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0a2f1-0fc3-44ee-a054-6a940725d91c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:57.653735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0a2f1-0fc3-44ee-a054-6a940725d91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:57.673515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175f04a-9af1-4774-b8fc-362ab8b5f4c3 tempest-RoutersIpV6AdminTest-421644485 tempest-RoutersIpV6AdminTest-421644485-project-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:57.674905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8aa0a2f1-0fc3-44ee-a054-6a940725d91c None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:57.676137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8aa0a2f1-0fc3-44ee-a054-6a940725d91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:57.727488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e75039-9813-4ac1-80c8-c6d07a9c983d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:57.728149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e75039-9813-4ac1-80c8-c6d07a9c983d service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:57.728434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e75039-9813-4ac1-80c8-c6d07a9c983d service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:57.728709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e75039-9813-4ac1-80c8-c6d07a9c983d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:57.730561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c2e75039-9813-4ac1-80c8-c6d07a9c983d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:57.748937 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3975/7854] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:16:57.759391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0a2f1-0fc3-44ee-a054-6a940725d91c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:57.760835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8aa0a2f1-0fc3-44ee-a054-6a940725d91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:57.775616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0a2f1-0fc3-44ee-a054-6a940725d91c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:57.779403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bfb61-0a7f-4ddf-bcd7-514cfdb255a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:57.780069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bfb61-0a7f-4ddf-bcd7-514cfdb255a7 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:57.780382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bfb61-0a7f-4ddf-bcd7-514cfdb255a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:57.780667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bfb61-0a7f-4ddf-bcd7-514cfdb255a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:57.791421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bfb61-0a7f-4ddf-bcd7-514cfdb255a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:57.792857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bfb61-0a7f-4ddf-bcd7-514cfdb255a7 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:57.794124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e75039-9813-4ac1-80c8-c6d07a9c983d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:57.795982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e75039-9813-4ac1-80c8-c6d07a9c983d service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:57.805286 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3976/7855] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:16:57.810925 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3880/7856] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:16:57 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:16:58.273733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bfb61-0a7f-4ddf-bcd7-514cfdb255a7 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:58.275237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e24bfb61-0a7f-4ddf-bcd7-514cfdb255a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:58.296216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bfb61-0a7f-4ddf-bcd7-514cfdb255a7 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:58.303134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfab8f6-45db-41dd-8992-1715fe03c4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:58.304181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfab8f6-45db-41dd-8992-1715fe03c4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:58.304740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfab8f6-45db-41dd-8992-1715fe03c4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:58.305013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfab8f6-45db-41dd-8992-1715fe03c4f3 admin admin] PATH_INFO: `/v3/projects/2c15880a38944318ba245c17d71b8b1b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:58.306447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfab8f6-45db-41dd-8992-1715fe03c4f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c15880a38944318ba245c17d71b8b1b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:58.308410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfab8f6-45db-41dd-8992-1715fe03c4f3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:58.355258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8bfab8f6-45db-41dd-8992-1715fe03c4f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c15880a38944318ba245c17d71b8b1b', 'request_id': 'req-8bfab8f6-45db-41dd-8992-1715fe03c4f3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:58.365056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8bfab8f6-45db-41dd-8992-1715fe03c4f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c15880a38944318ba245c17d71b8b1b', 'request_id': 'req-8bfab8f6-45db-41dd-8992-1715fe03c4f3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:58.373435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8bfab8f6-45db-41dd-8992-1715fe03c4f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c15880a38944318ba245c17d71b8b1b', 'request_id': 'req-8bfab8f6-45db-41dd-8992-1715fe03c4f3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:58.384551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8bfab8f6-45db-41dd-8992-1715fe03c4f3 admin admin] The token cache is being invalidate because project 2c15880a38944318ba245c17d71b8b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:58.384551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8bfab8f6-45db-41dd-8992-1715fe03c4f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:58.385171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8bfab8f6-45db-41dd-8992-1715fe03c4f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:58.386991 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3977/7857] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:58 2021] DELETE /identity/v3/projects/2c15880a38944318ba245c17d71b8b1b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:58.392899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e75039-9813-4ac1-80c8-c6d07a9c983d service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:58.404210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e75039-9813-4ac1-80c8-c6d07a9c983d service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:58.468199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32efa2-f5e3-4d0f-9545-3a63cac0a59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:58.469561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32efa2-f5e3-4d0f-9545-3a63cac0a59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:58.470673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32efa2-f5e3-4d0f-9545-3a63cac0a59d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:58.470849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32efa2-f5e3-4d0f-9545-3a63cac0a59d admin admin] PATH_INFO: `/v3/users/9fabd71893b74e8c97a1ef914279220e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:58.472750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32efa2-f5e3-4d0f-9545-3a63cac0a59d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fabd71893b74e8c97a1ef914279220e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:58.475288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32efa2-f5e3-4d0f-9545-3a63cac0a59d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:58.526988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ca32efa2-f5e3-4d0f-9545-3a63cac0a59d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fabd71893b74e8c97a1ef914279220e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:58.541719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ca32efa2-f5e3-4d0f-9545-3a63cac0a59d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fabd71893b74e8c97a1ef914279220e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:58.557600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ca32efa2-f5e3-4d0f-9545-3a63cac0a59d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fabd71893b74e8c97a1ef914279220e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:58.559181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ca32efa2-f5e3-4d0f-9545-3a63cac0a59d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fabd71893b74e8c97a1ef914279220e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:58.572188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ca32efa2-f5e3-4d0f-9545-3a63cac0a59d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fabd71893b74e8c97a1ef914279220e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:58.587767 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3881/7858] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:58 2021] DELETE /identity/v3/users/9fabd71893b74e8c97a1ef914279220e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:59.069760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfab8f6-45db-41dd-8992-1715fe03c4f3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:59.073541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8bfab8f6-45db-41dd-8992-1715fe03c4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:59.093913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfab8f6-45db-41dd-8992-1715fe03c4f3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:59.164480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e8c03-d228-4ce7-a176-19a16450b139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:59.165477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e8c03-d228-4ce7-a176-19a16450b139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:59.166119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e8c03-d228-4ce7-a176-19a16450b139 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:59.166459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e8c03-d228-4ce7-a176-19a16450b139 admin admin] PATH_INFO: `/v3/projects/591bfaf2a69843b79d836310a67d0511` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:59.167838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e8c03-d228-4ce7-a176-19a16450b139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=591bfaf2a69843b79d836310a67d0511)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:59.170033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e8c03-d228-4ce7-a176-19a16450b139 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:59.230673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf4e8c03-d228-4ce7-a176-19a16450b139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '591bfaf2a69843b79d836310a67d0511', 'request_id': 'req-bf4e8c03-d228-4ce7-a176-19a16450b139'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:59.238974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf4e8c03-d228-4ce7-a176-19a16450b139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '591bfaf2a69843b79d836310a67d0511', 'request_id': 'req-bf4e8c03-d228-4ce7-a176-19a16450b139'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:59.247869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf4e8c03-d228-4ce7-a176-19a16450b139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '591bfaf2a69843b79d836310a67d0511', 'request_id': 'req-bf4e8c03-d228-4ce7-a176-19a16450b139'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:59.261010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf4e8c03-d228-4ce7-a176-19a16450b139 admin admin] The token cache is being invalidate because project 591bfaf2a69843b79d836310a67d0511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:16:59.261594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf4e8c03-d228-4ce7-a176-19a16450b139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:59.262701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-bf4e8c03-d228-4ce7-a176-19a16450b139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:16:59.264517 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3978/7859] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:16:59 2021] DELETE /identity/v3/projects/591bfaf2a69843b79d836310a67d0511 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:59.271271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7893484-d593-47e9-8dc5-6a33960ead08 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:59.271568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7893484-d593-47e9-8dc5-6a33960ead08 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:59.271853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7893484-d593-47e9-8dc5-6a33960ead08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:59.291075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a7893484-d593-47e9-8dc5-6a33960ead08 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:59.292381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a7893484-d593-47e9-8dc5-6a33960ead08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:59.361902 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3882/7860] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:59.370726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663ceca-c3d7-4e57-b3ae-1a7642a9aa1f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:59.371246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663ceca-c3d7-4e57-b3ae-1a7642a9aa1f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:59.371733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663ceca-c3d7-4e57-b3ae-1a7642a9aa1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:59.395081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1663ceca-c3d7-4e57-b3ae-1a7642a9aa1f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:59.396369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1663ceca-c3d7-4e57-b3ae-1a7642a9aa1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:59.405568 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3979/7861] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:16:59.409873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7893484-d593-47e9-8dc5-6a33960ead08 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:59.421387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7893484-d593-47e9-8dc5-6a33960ead08 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:59.429537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54b2e4-6656-49a5-97a5-2d057a7f1b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:59.429923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54b2e4-6656-49a5-97a5-2d057a7f1b1f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:59.430326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54b2e4-6656-49a5-97a5-2d057a7f1b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:59.430671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54b2e4-6656-49a5-97a5-2d057a7f1b1f admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:59.431568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54b2e4-6656-49a5-97a5-2d057a7f1b1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:16:59.431942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54b2e4-6656-49a5-97a5-2d057a7f1b1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:59.433740 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54b2e4-6656-49a5-97a5-2d057a7f1b1f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:59.451710 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3883/7862] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:16:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:59.452831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663ceca-c3d7-4e57-b3ae-1a7642a9aa1f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:59.462114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663ceca-c3d7-4e57-b3ae-1a7642a9aa1f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:59.467282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4b438-8554-4ff3-be83-91b40546e3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:59.467940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4b438-8554-4ff3-be83-91b40546e3ab admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:59.468224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4b438-8554-4ff3-be83-91b40546e3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:59.468504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4b438-8554-4ff3-be83-91b40546e3ab admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:59.469212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4b438-8554-4ff3-be83-91b40546e3ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:59.471190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4b438-8554-4ff3-be83-91b40546e3ab admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:59.497048 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3980/7863] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:16:59 2021] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:16:59.502039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54b2e4-6656-49a5-97a5-2d057a7f1b1f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:59.512211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54b2e4-6656-49a5-97a5-2d057a7f1b1f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:59.568706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16fe83-5135-463f-aed2-9c8e7891c6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:59.569385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16fe83-5135-463f-aed2-9c8e7891c6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:59.569678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16fe83-5135-463f-aed2-9c8e7891c6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:59.569964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16fe83-5135-463f-aed2-9c8e7891c6e9 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:59.570719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16fe83-5135-463f-aed2-9c8e7891c6e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:59.572644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16fe83-5135-463f-aed2-9c8e7891c6e9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:59.596570 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3884/7864] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:16:59 2021] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:16:59.597748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4b438-8554-4ff3-be83-91b40546e3ab admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:59.608339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4b438-8554-4ff3-be83-91b40546e3ab admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:59.613521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c5555-6c3b-415a-90c2-a302c8871cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:59.614177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c5555-6c3b-415a-90c2-a302c8871cdb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:59.614505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c5555-6c3b-415a-90c2-a302c8871cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:59.614823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c5555-6c3b-415a-90c2-a302c8871cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:59.615518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c5555-6c3b-415a-90c2-a302c8871cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:59.617112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c5555-6c3b-415a-90c2-a302c8871cdb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:59.630009 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3981/7865] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:59 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:59.633993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16fe83-5135-463f-aed2-9c8e7891c6e9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:59.643916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16fe83-5135-463f-aed2-9c8e7891c6e9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:59.648491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd86d5-d84b-4547-b82e-e202e7b636e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:59.649130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd86d5-d84b-4547-b82e-e202e7b636e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:59.649417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd86d5-d84b-4547-b82e-e202e7b636e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:59.649697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd86d5-d84b-4547-b82e-e202e7b636e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:59.650468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd86d5-d84b-4547-b82e-e202e7b636e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:59.652044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd86d5-d84b-4547-b82e-e202e7b636e4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:59.662082 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3885/7866] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:16:59 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:16:59.666061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c5555-6c3b-415a-90c2-a302c8871cdb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:59.676557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c5555-6c3b-415a-90c2-a302c8871cdb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:59.681371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2334bec-4756-4bca-a3a1-4aa66b201e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:59.682396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2334bec-4756-4bca-a3a1-4aa66b201e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:59.682792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2334bec-4756-4bca-a3a1-4aa66b201e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:59.683136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2334bec-4756-4bca-a3a1-4aa66b201e97 admin admin] PATH_INFO: `/v3/projects/b8302bf1988048c6a455468cd915decf/users/4927d361cf9f4a12b32a98dd2e948a44/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:59.698493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2334bec-4756-4bca-a3a1-4aa66b201e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8302bf1988048c6a455468cd915decf, user_id=4927d361cf9f4a12b32a98dd2e948a44, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:16:59.701172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2334bec-4756-4bca-a3a1-4aa66b201e97 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:16:59.715635 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3982/7867] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:16:59 2021] PUT /identity/v3/projects/b8302bf1988048c6a455468cd915decf/users/4927d361cf9f4a12b32a98dd2e948a44/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:16:59.728015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4559f-d3c9-4afd-8b8f-54e756dec465 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:59.728445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4559f-d3c9-4afd-8b8f-54e756dec465 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:59.728785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4559f-d3c9-4afd-8b8f-54e756dec465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:59.760340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-acd4559f-d3c9-4afd-8b8f-54e756dec465 None None] MFA Rules not processed for user `4927d361cf9f4a12b32a98dd2e948a44`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:16:59.761575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-acd4559f-d3c9-4afd-8b8f-54e756dec465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:16:59.826750 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3886/7868] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:16:59 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:16:59.831815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2334bec-4756-4bca-a3a1-4aa66b201e97 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:59.843003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2334bec-4756-4bca-a3a1-4aa66b201e97 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:59.848352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd1f08-3787-4d4a-9a79-a4afb3aa8e4b tempest-TestApiDiscovery-1174539644 tempest-TestApiDiscovery-1174539644-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4927d361cf9f4a12b32a98dd2e948a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8302bf1988048c6a455468cd915decf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:59.849067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd1f08-3787-4d4a-9a79-a4afb3aa8e4b tempest-TestApiDiscovery-1174539644 tempest-TestApiDiscovery-1174539644-project] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:59.849375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd1f08-3787-4d4a-9a79-a4afb3aa8e4b tempest-TestApiDiscovery-1174539644 tempest-TestApiDiscovery-1174539644-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:59.849654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd1f08-3787-4d4a-9a79-a4afb3aa8e4b tempest-TestApiDiscovery-1174539644 tempest-TestApiDiscovery-1174539644-project] PATH_INFO: `/v3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:59.851244 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3983/7869] 10.222.0.13 () {58 vars in 1103 bytes} [Sat Dec 18 21:16:59 2021] GET /identity/v3 => generated 255 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:59.857508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4559f-d3c9-4afd-8b8f-54e756dec465 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:59.867253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4559f-d3c9-4afd-8b8f-54e756dec465 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:59.871754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181999f4-d106-4de6-8e14-1b77d8c24602 tempest-TestApiDiscovery-1174539644 tempest-TestApiDiscovery-1174539644-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4927d361cf9f4a12b32a98dd2e948a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8302bf1988048c6a455468cd915decf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:59.872510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181999f4-d106-4de6-8e14-1b77d8c24602 tempest-TestApiDiscovery-1174539644 tempest-TestApiDiscovery-1174539644-project] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:59.872959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181999f4-d106-4de6-8e14-1b77d8c24602 tempest-TestApiDiscovery-1174539644 tempest-TestApiDiscovery-1174539644-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:59.873294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181999f4-d106-4de6-8e14-1b77d8c24602 tempest-TestApiDiscovery-1174539644 tempest-TestApiDiscovery-1174539644-project] PATH_INFO: `/v3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:59.878794 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3887/7870] 10.222.0.13 () {58 vars in 1103 bytes} [Sat Dec 18 21:16:59 2021] GET /identity/v3 => generated 255 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:16:59.879606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd1f08-3787-4d4a-9a79-a4afb3aa8e4b tempest-TestApiDiscovery-1174539644 tempest-TestApiDiscovery-1174539644-project] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:16:59.889978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd1f08-3787-4d4a-9a79-a4afb3aa8e4b tempest-TestApiDiscovery-1174539644 tempest-TestApiDiscovery-1174539644-project] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:16:59.895237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ac51d-d688-423c-abb9-31b5e16ebcbd tempest-TestApiDiscovery-1174539644 tempest-TestApiDiscovery-1174539644-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4927d361cf9f4a12b32a98dd2e948a44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8302bf1988048c6a455468cd915decf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:16:59.895887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ac51d-d688-423c-abb9-31b5e16ebcbd tempest-TestApiDiscovery-1174539644 tempest-TestApiDiscovery-1174539644-project] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:59.896423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ac51d-d688-423c-abb9-31b5e16ebcbd tempest-TestApiDiscovery-1174539644 tempest-TestApiDiscovery-1174539644-project] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:59.896710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ac51d-d688-423c-abb9-31b5e16ebcbd tempest-TestApiDiscovery-1174539644 tempest-TestApiDiscovery-1174539644-project] PATH_INFO: `/v3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:59.898301 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3984/7871] 10.222.0.13 () {58 vars in 1103 bytes} [Sat Dec 18 21:16:59 2021] GET /identity/v3 => generated 255 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:16:59.903817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b001a-dc66-46d2-b848-04247d9d8c26 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:59.904303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b001a-dc66-46d2-b848-04247d9d8c26 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:59.904879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b001a-dc66-46d2-b848-04247d9d8c26 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:59.910302 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3888/7872] 10.222.0.13 () {56 vars in 894 bytes} [Sat Dec 18 21:16:59 2021] GET /identity/ => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 18 21:16:59.912503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00748a04-ab20-4021-975b-54335cf9b5bd None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:16:59.912994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00748a04-ab20-4021-975b-54335cf9b5bd None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:16:59.913423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00748a04-ab20-4021-975b-54335cf9b5bd None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:16:59.918424 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3985/7873] 10.222.0.13 () {56 vars in 894 bytes} [Sat Dec 18 21:16:59 2021] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 21:16:59.919965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b001a-dc66-46d2-b848-04247d9d8c26 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:00.010219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00748a04-ab20-4021-975b-54335cf9b5bd None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:00.011926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b001a-dc66-46d2-b848-04247d9d8c26 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:00.013086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-00748a04-ab20-4021-975b-54335cf9b5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:00.018363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922ee9f-a6d7-4834-a335-208aa6bf490f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:00.019240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922ee9f-a6d7-4834-a335-208aa6bf490f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:00.020164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922ee9f-a6d7-4834-a335-208aa6bf490f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:00.020164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922ee9f-a6d7-4834-a335-208aa6bf490f admin admin] PATH_INFO: `/v3/users/4927d361cf9f4a12b32a98dd2e948a44` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:00.021229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922ee9f-a6d7-4834-a335-208aa6bf490f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4927d361cf9f4a12b32a98dd2e948a44)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:00.023583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922ee9f-a6d7-4834-a335-208aa6bf490f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:00.048968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00748a04-ab20-4021-975b-54335cf9b5bd None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:00.054039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe024c-2daf-4cf1-841a-58d0022462c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:00.055055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe024c-2daf-4cf1-841a-58d0022462c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:00.055451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe024c-2daf-4cf1-841a-58d0022462c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:00.055737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe024c-2daf-4cf1-841a-58d0022462c6 admin admin] PATH_INFO: `/v3/users/d4ca5004855f40c7b85944eefe85de93` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:00.057230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe024c-2daf-4cf1-841a-58d0022462c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ca5004855f40c7b85944eefe85de93)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:00.059262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe024c-2daf-4cf1-841a-58d0022462c6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:00.097284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4922ee9f-a6d7-4834-a335-208aa6bf490f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4927d361cf9f4a12b32a98dd2e948a44'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.104241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4922ee9f-a6d7-4834-a335-208aa6bf490f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4927d361cf9f4a12b32a98dd2e948a44'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.113110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f3fe024c-2daf-4cf1-841a-58d0022462c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ca5004855f40c7b85944eefe85de93'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.116227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4922ee9f-a6d7-4834-a335-208aa6bf490f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4927d361cf9f4a12b32a98dd2e948a44'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.116973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4922ee9f-a6d7-4834-a335-208aa6bf490f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4927d361cf9f4a12b32a98dd2e948a44'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.120752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f3fe024c-2daf-4cf1-841a-58d0022462c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ca5004855f40c7b85944eefe85de93'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.121567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f3fe024c-2daf-4cf1-841a-58d0022462c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ca5004855f40c7b85944eefe85de93'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.126271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4922ee9f-a6d7-4834-a335-208aa6bf490f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4927d361cf9f4a12b32a98dd2e948a44'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.133489 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3889/7874] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:16:59 2021] DELETE /identity/v3/users/4927d361cf9f4a12b32a98dd2e948a44 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:00.135126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f3fe024c-2daf-4cf1-841a-58d0022462c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ca5004855f40c7b85944eefe85de93'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.137757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5a24b-36fe-4797-a35f-794e635f3cb1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:00.138064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5a24b-36fe-4797-a35f-794e635f3cb1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:00.138548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5a24b-36fe-4797-a35f-794e635f3cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:00.145065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f3fe024c-2daf-4cf1-841a-58d0022462c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ca5004855f40c7b85944eefe85de93'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.151955 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3986/7875] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:17:00 2021] DELETE /identity/v3/users/d4ca5004855f40c7b85944eefe85de93 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:00.156152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df751814-0a69-4148-98cc-a6dfb29daff8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:00.156440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df751814-0a69-4148-98cc-a6dfb29daff8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:00.156727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df751814-0a69-4148-98cc-a6dfb29daff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:00.159610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-39d5a24b-36fe-4797-a35f-794e635f3cb1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:00.161037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-39d5a24b-36fe-4797-a35f-794e635f3cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:00.180929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-df751814-0a69-4148-98cc-a6dfb29daff8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:00.182317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-df751814-0a69-4148-98cc-a6dfb29daff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:00.228341 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3890/7876] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:17:00.235929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5a24b-36fe-4797-a35f-794e635f3cb1 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:00.237507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-39d5a24b-36fe-4797-a35f-794e635f3cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:00.248374 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3987/7877] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:00.255709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df751814-0a69-4148-98cc-a6dfb29daff8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:00.257507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-df751814-0a69-4148-98cc-a6dfb29daff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:00.300821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5a24b-36fe-4797-a35f-794e635f3cb1 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:00.305540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1d446-0cf3-404d-9d3b-b5fbe903d993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:00.306823 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1d446-0cf3-404d-9d3b-b5fbe903d993 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:00.306823 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1d446-0cf3-404d-9d3b-b5fbe903d993 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:00.307216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1d446-0cf3-404d-9d3b-b5fbe903d993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:00.317604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1d446-0cf3-404d-9d3b-b5fbe903d993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:00.319169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1d446-0cf3-404d-9d3b-b5fbe903d993 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:00.321113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df751814-0a69-4148-98cc-a6dfb29daff8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:00.325266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ae169-2729-4894-a7e4-eaf597431c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:00.326034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ae169-2729-4894-a7e4-eaf597431c2c service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:00.326314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ae169-2729-4894-a7e4-eaf597431c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:00.326606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ae169-2729-4894-a7e4-eaf597431c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:00.337563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ae169-2729-4894-a7e4-eaf597431c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:00.339042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ae169-2729-4894-a7e4-eaf597431c2c service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:00.342335 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3891/7878] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:17:00.350465 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3988/7879] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:17:00.808924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1d446-0cf3-404d-9d3b-b5fbe903d993 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:00.810814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-86a1d446-0cf3-404d-9d3b-b5fbe903d993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:00.832545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ae169-2729-4894-a7e4-eaf597431c2c service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:00.834272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-540ae169-2729-4894-a7e4-eaf597431c2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:00.845096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1d446-0cf3-404d-9d3b-b5fbe903d993 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:00.851704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e6472-2cc2-4354-bdc6-910d6787c3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:00.852701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e6472-2cc2-4354-bdc6-910d6787c3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:00.852952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e6472-2cc2-4354-bdc6-910d6787c3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:00.853261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e6472-2cc2-4354-bdc6-910d6787c3ec admin admin] PATH_INFO: `/v3/projects/b8302bf1988048c6a455468cd915decf` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:00.854557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e6472-2cc2-4354-bdc6-910d6787c3ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8302bf1988048c6a455468cd915decf)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:00.856512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e6472-2cc2-4354-bdc6-910d6787c3ec admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:00.864636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ae169-2729-4894-a7e4-eaf597431c2c service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:00.871946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9510b-1053-485d-89a4-4ac31b8232dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:00.872861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9510b-1053-485d-89a4-4ac31b8232dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:00.873154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9510b-1053-485d-89a4-4ac31b8232dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:00.873578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9510b-1053-485d-89a4-4ac31b8232dc admin admin] PATH_INFO: `/v3/projects/d33644610c5c4f1aae112d75d4c5cbc4` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:00.876677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9510b-1053-485d-89a4-4ac31b8232dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d33644610c5c4f1aae112d75d4c5cbc4)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:00.879044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9510b-1053-485d-89a4-4ac31b8232dc admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:00.923337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-622e6472-2cc2-4354-bdc6-910d6787c3ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8302bf1988048c6a455468cd915decf', 'request_id': 'req-622e6472-2cc2-4354-bdc6-910d6787c3ec'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.931228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-622e6472-2cc2-4354-bdc6-910d6787c3ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8302bf1988048c6a455468cd915decf', 'request_id': 'req-622e6472-2cc2-4354-bdc6-910d6787c3ec'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.939650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-622e6472-2cc2-4354-bdc6-910d6787c3ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8302bf1988048c6a455468cd915decf', 'request_id': 'req-622e6472-2cc2-4354-bdc6-910d6787c3ec'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.944135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-19a9510b-1053-485d-89a4-4ac31b8232dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd33644610c5c4f1aae112d75d4c5cbc4', 'request_id': 'req-19a9510b-1053-485d-89a4-4ac31b8232dc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.952986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-19a9510b-1053-485d-89a4-4ac31b8232dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd33644610c5c4f1aae112d75d4c5cbc4', 'request_id': 'req-19a9510b-1053-485d-89a4-4ac31b8232dc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.956838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-622e6472-2cc2-4354-bdc6-910d6787c3ec admin admin] The token cache is being invalidate because project b8302bf1988048c6a455468cd915decf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:17:00.957179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-622e6472-2cc2-4354-bdc6-910d6787c3ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.957762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-622e6472-2cc2-4354-bdc6-910d6787c3ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.963581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-19a9510b-1053-485d-89a4-4ac31b8232dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd33644610c5c4f1aae112d75d4c5cbc4', 'request_id': 'req-19a9510b-1053-485d-89a4-4ac31b8232dc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.964496 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3892/7880] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:17:00 2021] DELETE /identity/v3/projects/b8302bf1988048c6a455468cd915decf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:00.971402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917ecf-30b9-41fb-8ab7-d6c7ea492b3b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:00.973974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917ecf-30b9-41fb-8ab7-d6c7ea492b3b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:00.974372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917ecf-30b9-41fb-8ab7-d6c7ea492b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:00.978923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-19a9510b-1053-485d-89a4-4ac31b8232dc admin admin] The token cache is being invalidate because project d33644610c5c4f1aae112d75d4c5cbc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:17:00.979251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-19a9510b-1053-485d-89a4-4ac31b8232dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.980045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-19a9510b-1053-485d-89a4-4ac31b8232dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:00.981864 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3989/7881] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:17:00 2021] DELETE /identity/v3/projects/d33644610c5c4f1aae112d75d4c5cbc4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:00.988589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031d2c5-7f33-4732-9603-4bb50a673a40 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:00.988908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031d2c5-7f33-4732-9603-4bb50a673a40 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:00.989220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031d2c5-7f33-4732-9603-4bb50a673a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.004537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4f917ecf-30b9-41fb-8ab7-d6c7ea492b3b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:01.006510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4f917ecf-30b9-41fb-8ab7-d6c7ea492b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:01.016655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0031d2c5-7f33-4732-9603-4bb50a673a40 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:01.018339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0031d2c5-7f33-4732-9603-4bb50a673a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:01.085550 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3893/7882] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:01.095458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bed105-a7d7-4267-9940-92eb5a82bfa9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.096324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bed105-a7d7-4267-9940-92eb5a82bfa9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.096822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bed105-a7d7-4267-9940-92eb5a82bfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.098221 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3990/7883] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:01.106421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c3798-1820-4b10-b97f-f986a1df1cb0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.106665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c3798-1820-4b10-b97f-f986a1df1cb0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.107091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c3798-1820-4b10-b97f-f986a1df1cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.119112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-29bed105-a7d7-4267-9940-92eb5a82bfa9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:01.120486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-29bed105-a7d7-4267-9940-92eb5a82bfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:01.130573 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3894/7884] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:01.133520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7f2c3798-1820-4b10-b97f-f986a1df1cb0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:01.135087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bed105-a7d7-4267-9940-92eb5a82bfa9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:01.135965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7f2c3798-1820-4b10-b97f-f986a1df1cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:01.145175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bed105-a7d7-4267-9940-92eb5a82bfa9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:01.148612 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3991/7885] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:01.152595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c3798-1820-4b10-b97f-f986a1df1cb0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:01.152909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158e53d-4988-4270-a55c-712e19f9cf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:01.153693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158e53d-4988-4270-a55c-712e19f9cf6c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.153980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158e53d-4988-4270-a55c-712e19f9cf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.154492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158e53d-4988-4270-a55c-712e19f9cf6c admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.155464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158e53d-4988-4270-a55c-712e19f9cf6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:17:01.156343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158e53d-4988-4270-a55c-712e19f9cf6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:01.158735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158e53d-4988-4270-a55c-712e19f9cf6c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:01.163265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c3798-1820-4b10-b97f-f986a1df1cb0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:01.168376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99f82f-0657-48a9-aecc-276526ab410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:01.169433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99f82f-0657-48a9-aecc-276526ab410a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.169988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99f82f-0657-48a9-aecc-276526ab410a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.170358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99f82f-0657-48a9-aecc-276526ab410a admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.171204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99f82f-0657-48a9-aecc-276526ab410a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:17:01.171580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99f82f-0657-48a9-aecc-276526ab410a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:01.174213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99f82f-0657-48a9-aecc-276526ab410a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:01.175604 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3895/7886] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:17:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:17:01.188116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158e53d-4988-4270-a55c-712e19f9cf6c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:01.202033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158e53d-4988-4270-a55c-712e19f9cf6c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:01.208790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc1e2c-4bad-4050-8933-7709c40b759a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:01.209988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc1e2c-4bad-4050-8933-7709c40b759a admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.209988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc1e2c-4bad-4050-8933-7709c40b759a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.210725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc1e2c-4bad-4050-8933-7709c40b759a admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.211697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc1e2c-4bad-4050-8933-7709c40b759a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:01.214485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc1e2c-4bad-4050-8933-7709c40b759a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:01.216113 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3992/7887] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:17:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:17:01.221304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99f82f-0657-48a9-aecc-276526ab410a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:01.238756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99f82f-0657-48a9-aecc-276526ab410a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:01.248507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f2c5b-1827-4516-8314-7339a0854ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:01.249371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f2c5b-1827-4516-8314-7339a0854ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.252049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f2c5b-1827-4516-8314-7339a0854ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.253322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f2c5b-1827-4516-8314-7339a0854ab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.255092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f2c5b-1827-4516-8314-7339a0854ab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:01.257499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f2c5b-1827-4516-8314-7339a0854ab8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:01.258115 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3896/7888] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:17:01 2021] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:17:01.263003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc1e2c-4bad-4050-8933-7709c40b759a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:01.293927 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3993/7889] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:17:01 2021] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:17:01.295123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f2c5b-1827-4516-8314-7339a0854ab8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:01.345174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc1e2c-4bad-4050-8933-7709c40b759a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:01.386308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f2c5b-1827-4516-8314-7339a0854ab8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:01.392382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e553a-d233-453f-9990-0869db6eb0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:01.394595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e553a-d233-453f-9990-0869db6eb0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.394940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e553a-d233-453f-9990-0869db6eb0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.395218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e553a-d233-453f-9990-0869db6eb0e3 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.396078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e553a-d233-453f-9990-0869db6eb0e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:01.398403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e553a-d233-453f-9990-0869db6eb0e3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:01.429166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fe200-b9ca-4b3e-a35f-09136a6c7132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:01.429995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fe200-b9ca-4b3e-a35f-09136a6c7132 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.430313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fe200-b9ca-4b3e-a35f-09136a6c7132 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.430697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fe200-b9ca-4b3e-a35f-09136a6c7132 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.431462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fe200-b9ca-4b3e-a35f-09136a6c7132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:01.433486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fe200-b9ca-4b3e-a35f-09136a6c7132 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:01.442020 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3994/7890] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:17:01 2021] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:17:01.443110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e553a-d233-453f-9990-0869db6eb0e3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:01.457481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e553a-d233-453f-9990-0869db6eb0e3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:01.462106 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3897/7891] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:17:01 2021] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:17:01.464447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ea2c4-3a3f-4e75-8ecf-bb2e841e1c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:01.465497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ea2c4-3a3f-4e75-8ecf-bb2e841e1c37 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.466090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ea2c4-3a3f-4e75-8ecf-bb2e841e1c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.466215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fe200-b9ca-4b3e-a35f-09136a6c7132 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:01.466787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ea2c4-3a3f-4e75-8ecf-bb2e841e1c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.468138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ea2c4-3a3f-4e75-8ecf-bb2e841e1c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:01.470601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ea2c4-3a3f-4e75-8ecf-bb2e841e1c37 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:01.479742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fe200-b9ca-4b3e-a35f-09136a6c7132 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:01.483080 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3995/7892] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:01 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:17:01.487194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bf85c-af1d-45b8-b179-1b10dedbc6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:01.487965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bf85c-af1d-45b8-b179-1b10dedbc6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.488272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bf85c-af1d-45b8-b179-1b10dedbc6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.488529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bf85c-af1d-45b8-b179-1b10dedbc6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.488631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ea2c4-3a3f-4e75-8ecf-bb2e841e1c37 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:01.489708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bf85c-af1d-45b8-b179-1b10dedbc6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:01.491561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bf85c-af1d-45b8-b179-1b10dedbc6d2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:01.500921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ea2c4-3a3f-4e75-8ecf-bb2e841e1c37 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:01.503422 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3898/7893] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:01 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:17:01.507658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bf85c-af1d-45b8-b179-1b10dedbc6d2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:01.508710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654029b-e96f-4043-9617-fddc60ede532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:01.509675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654029b-e96f-4043-9617-fddc60ede532 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.510091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654029b-e96f-4043-9617-fddc60ede532 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.510610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654029b-e96f-4043-9617-fddc60ede532 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.511627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654029b-e96f-4043-9617-fddc60ede532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:01.513578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654029b-e96f-4043-9617-fddc60ede532 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:01.520598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bf85c-af1d-45b8-b179-1b10dedbc6d2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:01.525505 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3996/7894] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:01 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:17:01.529234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcfce2-cd56-4d6a-a0cf-19525fb3aca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:01.530734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654029b-e96f-4043-9617-fddc60ede532 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:01.531189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcfce2-cd56-4d6a-a0cf-19525fb3aca3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.531487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcfce2-cd56-4d6a-a0cf-19525fb3aca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.531768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcfce2-cd56-4d6a-a0cf-19525fb3aca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.533298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcfce2-cd56-4d6a-a0cf-19525fb3aca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:01.535712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcfce2-cd56-4d6a-a0cf-19525fb3aca3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:01.546634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654029b-e96f-4043-9617-fddc60ede532 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:01.549436 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3899/7895] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:01 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:17:01.553390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcfce2-cd56-4d6a-a0cf-19525fb3aca3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:01.554501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93376876-01f3-40e0-a49b-bbd5ac27e8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:01.555493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376876-01f3-40e0-a49b-bbd5ac27e8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.556088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376876-01f3-40e0-a49b-bbd5ac27e8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.556448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376876-01f3-40e0-a49b-bbd5ac27e8f1 admin admin] PATH_INFO: `/v3/projects/c2d14b131ac74307b9aa94aded5f3f5e/users/84883df65dac439a8c1e454b7ad570e2/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.565759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcfce2-cd56-4d6a-a0cf-19525fb3aca3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:01.574378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229b272-8ec9-4a88-b71e-f4b934b2aa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:01.575953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229b272-8ec9-4a88-b71e-f4b934b2aa64 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.576526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93376876-01f3-40e0-a49b-bbd5ac27e8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d14b131ac74307b9aa94aded5f3f5e, user_id=84883df65dac439a8c1e454b7ad570e2, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:01.576790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229b272-8ec9-4a88-b71e-f4b934b2aa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.577243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229b272-8ec9-4a88-b71e-f4b934b2aa64 admin admin] PATH_INFO: `/v3/projects/7ef310c4151146a79e2cacf1baa7fe17/users/07e7a43d7026494baafde97847891b70/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.579789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93376876-01f3-40e0-a49b-bbd5ac27e8f1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:01.597298 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3997/7896] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:17:01 2021] PUT /identity/v3/projects/c2d14b131ac74307b9aa94aded5f3f5e/users/84883df65dac439a8c1e454b7ad570e2/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:01.599246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229b272-8ec9-4a88-b71e-f4b934b2aa64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef310c4151146a79e2cacf1baa7fe17, user_id=07e7a43d7026494baafde97847891b70, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:01.601923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229b272-8ec9-4a88-b71e-f4b934b2aa64 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:01.602924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f442d9-224b-4f86-8f0c-caf4101e6c88 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.603177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f442d9-224b-4f86-8f0c-caf4101e6c88 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.603540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f442d9-224b-4f86-8f0c-caf4101e6c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.620333 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3900/7897] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:17:01 2021] PUT /identity/v3/projects/7ef310c4151146a79e2cacf1baa7fe17/users/07e7a43d7026494baafde97847891b70/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:17:01.622586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a7f442d9-224b-4f86-8f0c-caf4101e6c88 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:01.624035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a7f442d9-224b-4f86-8f0c-caf4101e6c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:01.630877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402eadc-ce7f-43cf-8dd7-c0d2616dad68 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.630877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402eadc-ce7f-43cf-8dd7-c0d2616dad68 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.631192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402eadc-ce7f-43cf-8dd7-c0d2616dad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.662778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a402eadc-ce7f-43cf-8dd7-c0d2616dad68 None None] MFA Rules not processed for user `07e7a43d7026494baafde97847891b70`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:01.664645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a402eadc-ce7f-43cf-8dd7-c0d2616dad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:01.700686 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3998/7898] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:17:01.712727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f442d9-224b-4f86-8f0c-caf4101e6c88 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:01.714972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a7f442d9-224b-4f86-8f0c-caf4101e6c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:01.751533 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3901/7899] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:01 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:17:01.756969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402eadc-ce7f-43cf-8dd7-c0d2616dad68 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:01.770101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402eadc-ce7f-43cf-8dd7-c0d2616dad68 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:01.776174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43823b72-81ae-46e6-b4d2-3061aa8eda47 tempest-IdentityCatalogTest-1490973953 tempest-IdentityCatalogTest-1490973953-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e7a43d7026494baafde97847891b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ef310c4151146a79e2cacf1baa7fe17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:01.776490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43823b72-81ae-46e6-b4d2-3061aa8eda47 tempest-IdentityCatalogTest-1490973953 tempest-IdentityCatalogTest-1490973953-project] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.776817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43823b72-81ae-46e6-b4d2-3061aa8eda47 tempest-IdentityCatalogTest-1490973953 tempest-IdentityCatalogTest-1490973953-project] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.777243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43823b72-81ae-46e6-b4d2-3061aa8eda47 tempest-IdentityCatalogTest-1490973953 tempest-IdentityCatalogTest-1490973953-project] PATH_INFO: `/v3/auth/catalog` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.777986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43823b72-81ae-46e6-b4d2-3061aa8eda47 tempest-IdentityCatalogTest-1490973953 tempest-IdentityCatalogTest-1490973953-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:01.779300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43823b72-81ae-46e6-b4d2-3061aa8eda47 tempest-IdentityCatalogTest-1490973953 tempest-IdentityCatalogTest-1490973953-project] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:01.787737 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3902/7900] 10.222.0.13 () {58 vars in 1142 bytes} [Sat Dec 18 21:17:01 2021] GET /identity/v3/auth/catalog => generated 2648 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:17:01.789561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43823b72-81ae-46e6-b4d2-3061aa8eda47 tempest-IdentityCatalogTest-1490973953 tempest-IdentityCatalogTest-1490973953-project] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:01.802883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f442d9-224b-4f86-8f0c-caf4101e6c88 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:01.803545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43823b72-81ae-46e6-b4d2-3061aa8eda47 tempest-IdentityCatalogTest-1490973953 tempest-IdentityCatalogTest-1490973953-project] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:01.807073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148058a-f64f-4529-b6ac-aa643ea1809b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:01.807853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148058a-f64f-4529-b6ac-aa643ea1809b service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.808235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148058a-f64f-4529-b6ac-aa643ea1809b service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.808612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148058a-f64f-4529-b6ac-aa643ea1809b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.809770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f412ac-6e06-42cc-8340-5660b8a42dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:01.810678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f412ac-6e06-42cc-8340-5660b8a42dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.810964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f412ac-6e06-42cc-8340-5660b8a42dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.811243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f412ac-6e06-42cc-8340-5660b8a42dd1 admin admin] PATH_INFO: `/v3/users/07e7a43d7026494baafde97847891b70` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:01.812525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f412ac-6e06-42cc-8340-5660b8a42dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e7a43d7026494baafde97847891b70)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:01.815025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f412ac-6e06-42cc-8340-5660b8a42dd1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:01.819392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148058a-f64f-4529-b6ac-aa643ea1809b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:01.820820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148058a-f64f-4529-b6ac-aa643ea1809b service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:01.833146 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 3999/7901] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:17:01.890760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a2f412ac-6e06-42cc-8340-5660b8a42dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e7a43d7026494baafde97847891b70'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:01.905325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a2f412ac-6e06-42cc-8340-5660b8a42dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e7a43d7026494baafde97847891b70'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:01.955442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a2f412ac-6e06-42cc-8340-5660b8a42dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e7a43d7026494baafde97847891b70'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:01.956973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a2f412ac-6e06-42cc-8340-5660b8a42dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e7a43d7026494baafde97847891b70'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:01.968689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a2f412ac-6e06-42cc-8340-5660b8a42dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e7a43d7026494baafde97847891b70'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:01.984404 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3903/7902] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:17:01 2021] DELETE /identity/v3/users/07e7a43d7026494baafde97847891b70 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:01.989278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8a397-1335-438f-b168-8af9a841de84 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:01.989566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8a397-1335-438f-b168-8af9a841de84 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:01.989840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8a397-1335-438f-b168-8af9a841de84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:02.012780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-67c8a397-1335-438f-b168-8af9a841de84 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:02.014037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-67c8a397-1335-438f-b168-8af9a841de84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:02.121711 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4000/7903] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:02.134893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f412ac-6e06-42cc-8340-5660b8a42dd1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:02.136625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a2f412ac-6e06-42cc-8340-5660b8a42dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:02.214290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f412ac-6e06-42cc-8340-5660b8a42dd1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:02.218665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c168b-76a5-4f3a-be5f-11307ea3f25e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:02.219446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c168b-76a5-4f3a-be5f-11307ea3f25e service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:02.219983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c168b-76a5-4f3a-be5f-11307ea3f25e service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:02.220252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c168b-76a5-4f3a-be5f-11307ea3f25e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:02.231184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c168b-76a5-4f3a-be5f-11307ea3f25e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:02.232994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c168b-76a5-4f3a-be5f-11307ea3f25e service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:02.245485 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3904/7904] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:17:02.772660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c3187-9d5b-4f3b-8559-b0a6f6dcf29b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:02.773257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c3187-9d5b-4f3b-8559-b0a6f6dcf29b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:02.773565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c3187-9d5b-4f3b-8559-b0a6f6dcf29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:02.807758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-438c3187-9d5b-4f3b-8559-b0a6f6dcf29b None None] MFA Rules not processed for user `84883df65dac439a8c1e454b7ad570e2`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:02.809441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-438c3187-9d5b-4f3b-8559-b0a6f6dcf29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:02.913498 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4001/7905] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:02 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:02.931109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c168b-76a5-4f3a-be5f-11307ea3f25e service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:02.933024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-110c168b-76a5-4f3a-be5f-11307ea3f25e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:02.958142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c3187-9d5b-4f3b-8559-b0a6f6dcf29b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:02.967056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-438c3187-9d5b-4f3b-8559-b0a6f6dcf29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:03.002885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c3187-9d5b-4f3b-8559-b0a6f6dcf29b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:03.033729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8c75d-8582-421c-883f-0a8ab215c96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:03.037173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8c75d-8582-421c-883f-0a8ab215c96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:03.039214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8c75d-8582-421c-883f-0a8ab215c96e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:03.039662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8c75d-8582-421c-883f-0a8ab215c96e admin admin] PATH_INFO: `/v3/projects/7ef310c4151146a79e2cacf1baa7fe17` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:03.042666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8c75d-8582-421c-883f-0a8ab215c96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef310c4151146a79e2cacf1baa7fe17)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:03.054945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8c75d-8582-421c-883f-0a8ab215c96e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:03.055499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c168b-76a5-4f3a-be5f-11307ea3f25e service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:03.060352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94bfab-226e-4ef2-8e8b-b9ce68ab2fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:03.061219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94bfab-226e-4ef2-8e8b-b9ce68ab2fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:03.061609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94bfab-226e-4ef2-8e8b-b9ce68ab2fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:03.062051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94bfab-226e-4ef2-8e8b-b9ce68ab2fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:03.081072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94bfab-226e-4ef2-8e8b-b9ce68ab2fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:03.082661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94bfab-226e-4ef2-8e8b-b9ce68ab2fc7 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:03.095338 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3905/7906] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:02 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:17:03.163982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-00c8c75d-8582-421c-883f-0a8ab215c96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef310c4151146a79e2cacf1baa7fe17', 'request_id': 'req-00c8c75d-8582-421c-883f-0a8ab215c96e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:03.176334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-00c8c75d-8582-421c-883f-0a8ab215c96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef310c4151146a79e2cacf1baa7fe17', 'request_id': 'req-00c8c75d-8582-421c-883f-0a8ab215c96e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:03.187740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-00c8c75d-8582-421c-883f-0a8ab215c96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef310c4151146a79e2cacf1baa7fe17', 'request_id': 'req-00c8c75d-8582-421c-883f-0a8ab215c96e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:03.208075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-00c8c75d-8582-421c-883f-0a8ab215c96e admin admin] The token cache is being invalidate because project 7ef310c4151146a79e2cacf1baa7fe17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:17:03.208884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-00c8c75d-8582-421c-883f-0a8ab215c96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:03.209776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-00c8c75d-8582-421c-883f-0a8ab215c96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:03.216331 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4002/7907] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:17:02 2021] DELETE /identity/v3/projects/7ef310c4151146a79e2cacf1baa7fe17 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:03.218800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afbdc3-fd1d-427b-9fa6-7ec8eb3cd55b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:03.219489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afbdc3-fd1d-427b-9fa6-7ec8eb3cd55b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:03.220349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afbdc3-fd1d-427b-9fa6-7ec8eb3cd55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:03.279940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-06afbdc3-fd1d-427b-9fa6-7ec8eb3cd55b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:03.282620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-06afbdc3-fd1d-427b-9fa6-7ec8eb3cd55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:03.375533 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3906/7908] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:03.465482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0668b-a128-47e3-9e97-2830d6f0d479 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:03.466013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0668b-a128-47e3-9e97-2830d6f0d479 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:03.466469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0668b-a128-47e3-9e97-2830d6f0d479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:03.494520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f3e0668b-a128-47e3-9e97-2830d6f0d479 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:03.495933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f3e0668b-a128-47e3-9e97-2830d6f0d479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:03.507624 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4003/7909] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:03.510955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afbdc3-fd1d-427b-9fa6-7ec8eb3cd55b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:03.523824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afbdc3-fd1d-427b-9fa6-7ec8eb3cd55b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:03.532098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fca71-e558-4cf6-979e-ff8c074a6ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:03.532950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fca71-e558-4cf6-979e-ff8c074a6ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:03.533484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fca71-e558-4cf6-979e-ff8c074a6ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:03.533804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fca71-e558-4cf6-979e-ff8c074a6ad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:03.534816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fca71-e558-4cf6-979e-ff8c074a6ad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:17:03.535701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fca71-e558-4cf6-979e-ff8c074a6ad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:03.537647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fca71-e558-4cf6-979e-ff8c074a6ad1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:03.557661 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3907/7910] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:17:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:17:03.562591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0668b-a128-47e3-9e97-2830d6f0d479 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:03.574636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0668b-a128-47e3-9e97-2830d6f0d479 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:03.581981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175b9c5-ae53-465a-b2c7-137b073d4760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:03.583233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175b9c5-ae53-465a-b2c7-137b073d4760 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:03.583948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175b9c5-ae53-465a-b2c7-137b073d4760 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:03.584421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175b9c5-ae53-465a-b2c7-137b073d4760 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:03.585321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175b9c5-ae53-465a-b2c7-137b073d4760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:03.587712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175b9c5-ae53-465a-b2c7-137b073d4760 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:03.623420 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4004/7911] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:17:03 2021] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:17:03.631632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fca71-e558-4cf6-979e-ff8c074a6ad1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:03.645924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fca71-e558-4cf6-979e-ff8c074a6ad1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:03.760516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c89160-f2b0-4690-abda-a8c87efb7c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:03.761536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c89160-f2b0-4690-abda-a8c87efb7c3f admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:03.761837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c89160-f2b0-4690-abda-a8c87efb7c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:03.762131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c89160-f2b0-4690-abda-a8c87efb7c3f admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:03.762966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c89160-f2b0-4690-abda-a8c87efb7c3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:03.765197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c89160-f2b0-4690-abda-a8c87efb7c3f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:03.801409 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3908/7912] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:17:03 2021] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:17:03.802589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175b9c5-ae53-465a-b2c7-137b073d4760 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:03.827312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175b9c5-ae53-465a-b2c7-137b073d4760 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:03.835139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d054e21-9910-4031-a506-6dd70526ee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:03.836600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d054e21-9910-4031-a506-6dd70526ee23 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:03.836895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d054e21-9910-4031-a506-6dd70526ee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:03.837217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d054e21-9910-4031-a506-6dd70526ee23 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:03.838055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d054e21-9910-4031-a506-6dd70526ee23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:03.840675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d054e21-9910-4031-a506-6dd70526ee23 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:03.860944 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4005/7913] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:03 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:17:03.867149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c89160-f2b0-4690-abda-a8c87efb7c3f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:03.887418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c89160-f2b0-4690-abda-a8c87efb7c3f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:03.893334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35135d-8fb2-43e3-8205-48067475439c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:03.894141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35135d-8fb2-43e3-8205-48067475439c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:03.894563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35135d-8fb2-43e3-8205-48067475439c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:03.894933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35135d-8fb2-43e3-8205-48067475439c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:03.895868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35135d-8fb2-43e3-8205-48067475439c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:03.897629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35135d-8fb2-43e3-8205-48067475439c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:03.909892 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3909/7914] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:03 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:17:03.913860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d054e21-9910-4031-a506-6dd70526ee23 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:03.927544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d054e21-9910-4031-a506-6dd70526ee23 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:03.935341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cee44-b38e-4610-9adb-90a9fd84e2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:03.936638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cee44-b38e-4610-9adb-90a9fd84e2d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:03.937144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cee44-b38e-4610-9adb-90a9fd84e2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:03.937584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cee44-b38e-4610-9adb-90a9fd84e2d9 admin admin] PATH_INFO: `/v3/projects/d9e18d3726ec4e2fa7cd9e732f9eaa3f/users/b1270c44012447e9b1464248496343aa/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:03.956158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cee44-b38e-4610-9adb-90a9fd84e2d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e18d3726ec4e2fa7cd9e732f9eaa3f, user_id=b1270c44012447e9b1464248496343aa, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:03.959535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cee44-b38e-4610-9adb-90a9fd84e2d9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:03.986099 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4006/7915] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:17:03 2021] PUT /identity/v3/projects/d9e18d3726ec4e2fa7cd9e732f9eaa3f/users/b1270c44012447e9b1464248496343aa/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:17:03.996082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792359a9-3dd4-46ed-9543-069057c2a60e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:03.996582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792359a9-3dd4-46ed-9543-069057c2a60e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:03.996916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792359a9-3dd4-46ed-9543-069057c2a60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:04.035815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-792359a9-3dd4-46ed-9543-069057c2a60e None None] MFA Rules not processed for user `b1270c44012447e9b1464248496343aa`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:04.046068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-792359a9-3dd4-46ed-9543-069057c2a60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:04.140872 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3910/7916] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:03 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:04.147300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cee44-b38e-4610-9adb-90a9fd84e2d9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:04.149284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d02cee44-b38e-4610-9adb-90a9fd84e2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:04.225378 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cee44-b38e-4610-9adb-90a9fd84e2d9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:04.230785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad1825-0218-4229-b353-98b526ac8e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:04.231327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad1825-0218-4229-b353-98b526ac8e43 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:04.231703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad1825-0218-4229-b353-98b526ac8e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:04.231973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad1825-0218-4229-b353-98b526ac8e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:04.243393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad1825-0218-4229-b353-98b526ac8e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:04.244856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad1825-0218-4229-b353-98b526ac8e43 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:04.256753 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4007/7917] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:04 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:17:21.886024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b28243-5358-4f41-9d8f-32459865da49 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:21.886639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b28243-5358-4f41-9d8f-32459865da49 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:21.886901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b28243-5358-4f41-9d8f-32459865da49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:21.919915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a4b28243-5358-4f41-9d8f-32459865da49 None None] MFA Rules not processed for user `84883df65dac439a8c1e454b7ad570e2`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:21.921157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a4b28243-5358-4f41-9d8f-32459865da49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:22.008674 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3911/7918] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:21 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:22.440126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad1825-0218-4229-b353-98b526ac8e43 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:22.441936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-67ad1825-0218-4229-b353-98b526ac8e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:22.491762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad1825-0218-4229-b353-98b526ac8e43 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:22.495534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08201f-e3b2-447e-aece-76206e5e2c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:22.496182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08201f-e3b2-447e-aece-76206e5e2c34 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:22.496498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08201f-e3b2-447e-aece-76206e5e2c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:22.496780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08201f-e3b2-447e-aece-76206e5e2c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:22.498787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4d08201f-e3b2-447e-aece-76206e5e2c34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:22.511667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08201f-e3b2-447e-aece-76206e5e2c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:22.513129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08201f-e3b2-447e-aece-76206e5e2c34 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:22.523733 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4008/7919] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:22 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:17:26.189866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b28243-5358-4f41-9d8f-32459865da49 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:26.193968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a4b28243-5358-4f41-9d8f-32459865da49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:26.318505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b28243-5358-4f41-9d8f-32459865da49 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:26.325942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442099ad-7551-4155-83ee-f5bbde87845e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:26.327217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442099ad-7551-4155-83ee-f5bbde87845e service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:26.327746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442099ad-7551-4155-83ee-f5bbde87845e service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:26.328795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442099ad-7551-4155-83ee-f5bbde87845e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:26.331490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-442099ad-7551-4155-83ee-f5bbde87845e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:26.350732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442099ad-7551-4155-83ee-f5bbde87845e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:26.354236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442099ad-7551-4155-83ee-f5bbde87845e service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:26.386542 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3912/7920] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:17:31.682515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08201f-e3b2-447e-aece-76206e5e2c34 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:31.684954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4d08201f-e3b2-447e-aece-76206e5e2c34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:31.816515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08201f-e3b2-447e-aece-76206e5e2c34 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:31.822727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af42dd1-2241-4c61-bdd7-728d6c79b336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:31.824460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af42dd1-2241-4c61-bdd7-728d6c79b336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:31.824756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af42dd1-2241-4c61-bdd7-728d6c79b336 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:31.825066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af42dd1-2241-4c61-bdd7-728d6c79b336 admin admin] PATH_INFO: `/v3/users/b346794f665e4717b6d4d8723932e0fc` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:31.826582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af42dd1-2241-4c61-bdd7-728d6c79b336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b346794f665e4717b6d4d8723932e0fc)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:31.829432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af42dd1-2241-4c61-bdd7-728d6c79b336 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:31.883870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0af42dd1-2241-4c61-bdd7-728d6c79b336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b346794f665e4717b6d4d8723932e0fc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:31.891396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0af42dd1-2241-4c61-bdd7-728d6c79b336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b346794f665e4717b6d4d8723932e0fc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:31.892074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0af42dd1-2241-4c61-bdd7-728d6c79b336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b346794f665e4717b6d4d8723932e0fc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:31.903766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0af42dd1-2241-4c61-bdd7-728d6c79b336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b346794f665e4717b6d4d8723932e0fc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:31.911942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0af42dd1-2241-4c61-bdd7-728d6c79b336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b346794f665e4717b6d4d8723932e0fc'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:31.918559 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4009/7921] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:17:31 2021] DELETE /identity/v3/users/b346794f665e4717b6d4d8723932e0fc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:31.923340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26603872-d2ac-4247-8047-21f13b033aa8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:31.923897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26603872-d2ac-4247-8047-21f13b033aa8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:31.923984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26603872-d2ac-4247-8047-21f13b033aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:31.951373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-26603872-d2ac-4247-8047-21f13b033aa8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:31.953387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-26603872-d2ac-4247-8047-21f13b033aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:32.030383 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3913/7922] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:32.041527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af42dd1-2241-4c61-bdd7-728d6c79b336 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:32.043682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0af42dd1-2241-4c61-bdd7-728d6c79b336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:32.110997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af42dd1-2241-4c61-bdd7-728d6c79b336 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:32.114699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee714aa-f486-41f0-90d4-71ae707058b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:32.115343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee714aa-f486-41f0-90d4-71ae707058b3 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:32.115624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee714aa-f486-41f0-90d4-71ae707058b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:32.115903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee714aa-f486-41f0-90d4-71ae707058b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:32.127876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee714aa-f486-41f0-90d4-71ae707058b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:32.129365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee714aa-f486-41f0-90d4-71ae707058b3 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:32.140989 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4010/7923] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:17:32.454509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26603872-d2ac-4247-8047-21f13b033aa8 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:32.456102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-26603872-d2ac-4247-8047-21f13b033aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:32.470305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26603872-d2ac-4247-8047-21f13b033aa8 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:32.476853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:32.478225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:32.478721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:32.479009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404 admin admin] PATH_INFO: `/v3/projects/362a3b4aa8aa4069aa95325acaf0b117` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:32.480843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=362a3b4aa8aa4069aa95325acaf0b117)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:32.482962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:32.553024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '362a3b4aa8aa4069aa95325acaf0b117', 'request_id': 'req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:32.560442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '362a3b4aa8aa4069aa95325acaf0b117', 'request_id': 'req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:32.568317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '362a3b4aa8aa4069aa95325acaf0b117', 'request_id': 'req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:32.582401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404 admin admin] The token cache is being invalidate because project 362a3b4aa8aa4069aa95325acaf0b117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:17:32.582698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:32.583365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:32.584915 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3914/7924] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:17:32 2021] DELETE /identity/v3/projects/362a3b4aa8aa4069aa95325acaf0b117 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:32.589959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee714aa-f486-41f0-90d4-71ae707058b3 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:32.600799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee714aa-f486-41f0-90d4-71ae707058b3 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:32.666851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686aa03e-4b6a-4b1b-9970-4cf3db8d2306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:32.668014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aa03e-4b6a-4b1b-9970-4cf3db8d2306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:32.668298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aa03e-4b6a-4b1b-9970-4cf3db8d2306 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:32.668696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aa03e-4b6a-4b1b-9970-4cf3db8d2306 admin admin] PATH_INFO: `/v3/users/c70a13320c234d8b8a355ebae1dd7fb2` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:32.669920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686aa03e-4b6a-4b1b-9970-4cf3db8d2306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c70a13320c234d8b8a355ebae1dd7fb2)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:32.672406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686aa03e-4b6a-4b1b-9970-4cf3db8d2306 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:32.732909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-686aa03e-4b6a-4b1b-9970-4cf3db8d2306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c70a13320c234d8b8a355ebae1dd7fb2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:32.742049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-686aa03e-4b6a-4b1b-9970-4cf3db8d2306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c70a13320c234d8b8a355ebae1dd7fb2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:32.743180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-686aa03e-4b6a-4b1b-9970-4cf3db8d2306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c70a13320c234d8b8a355ebae1dd7fb2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:32.758651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-686aa03e-4b6a-4b1b-9970-4cf3db8d2306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c70a13320c234d8b8a355ebae1dd7fb2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:32.768829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-686aa03e-4b6a-4b1b-9970-4cf3db8d2306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c70a13320c234d8b8a355ebae1dd7fb2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:32.775967 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4011/7925] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:17:32 2021] DELETE /identity/v3/users/c70a13320c234d8b8a355ebae1dd7fb2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:32.994168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:32.996076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:33.016637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd5dfb-ec05-4c7d-9523-6bfbc478f404 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:33.158280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ae0d3-823a-4184-9bae-3cf5427a5bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:33.159283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ae0d3-823a-4184-9bae-3cf5427a5bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:33.159764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ae0d3-823a-4184-9bae-3cf5427a5bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:33.160181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ae0d3-823a-4184-9bae-3cf5427a5bc2 admin admin] PATH_INFO: `/v3/projects/96a623bef8b44ad09974033cdb95984b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:33.161590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ae0d3-823a-4184-9bae-3cf5427a5bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a623bef8b44ad09974033cdb95984b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:33.164185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ae0d3-823a-4184-9bae-3cf5427a5bc2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:33.229252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c89ae0d3-823a-4184-9bae-3cf5427a5bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a623bef8b44ad09974033cdb95984b', 'request_id': 'req-c89ae0d3-823a-4184-9bae-3cf5427a5bc2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:33.235840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c89ae0d3-823a-4184-9bae-3cf5427a5bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a623bef8b44ad09974033cdb95984b', 'request_id': 'req-c89ae0d3-823a-4184-9bae-3cf5427a5bc2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:33.243534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c89ae0d3-823a-4184-9bae-3cf5427a5bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a623bef8b44ad09974033cdb95984b', 'request_id': 'req-c89ae0d3-823a-4184-9bae-3cf5427a5bc2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:33.256606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c89ae0d3-823a-4184-9bae-3cf5427a5bc2 admin admin] The token cache is being invalidate because project 96a623bef8b44ad09974033cdb95984b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:17:33.256887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c89ae0d3-823a-4184-9bae-3cf5427a5bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:33.257541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c89ae0d3-823a-4184-9bae-3cf5427a5bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:33.260167 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3915/7926] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:17:32 2021] DELETE /identity/v3/projects/96a623bef8b44ad09974033cdb95984b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:33.266583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dad608-1171-4942-8b7c-5610dc5583a0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:33.266943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dad608-1171-4942-8b7c-5610dc5583a0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:33.267249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dad608-1171-4942-8b7c-5610dc5583a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:33.324758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-76dad608-1171-4942-8b7c-5610dc5583a0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:33.325786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-76dad608-1171-4942-8b7c-5610dc5583a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:33.397997 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4012/7927] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:33.409609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb7e44-405a-4064-920b-2de58ecc247e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:33.409993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb7e44-405a-4064-920b-2de58ecc247e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:33.410313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb7e44-405a-4064-920b-2de58ecc247e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:33.433054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-04bb7e44-405a-4064-920b-2de58ecc247e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:33.434339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-04bb7e44-405a-4064-920b-2de58ecc247e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:33.445876 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3916/7928] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:33.450978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dad608-1171-4942-8b7c-5610dc5583a0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:33.463451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dad608-1171-4942-8b7c-5610dc5583a0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:33.469203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871937d-f303-4826-bc71-1c0968516597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:33.469952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871937d-f303-4826-bc71-1c0968516597 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:33.470950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871937d-f303-4826-bc71-1c0968516597 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:33.471293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871937d-f303-4826-bc71-1c0968516597 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:33.472613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871937d-f303-4826-bc71-1c0968516597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:17:33.473045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871937d-f303-4826-bc71-1c0968516597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:33.475160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871937d-f303-4826-bc71-1c0968516597 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:33.489365 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4013/7929] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:17:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:17:33.495833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb7e44-405a-4064-920b-2de58ecc247e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:33.507775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb7e44-405a-4064-920b-2de58ecc247e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:33.513353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c5783-8eea-412e-8f15-c0742b8dffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:33.514020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c5783-8eea-412e-8f15-c0742b8dffdc admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:33.514406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c5783-8eea-412e-8f15-c0742b8dffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:33.514821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c5783-8eea-412e-8f15-c0742b8dffdc admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:33.516544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c5783-8eea-412e-8f15-c0742b8dffdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:33.519094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c5783-8eea-412e-8f15-c0742b8dffdc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:33.553980 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3917/7930] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:17:33 2021] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:17:33.555448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871937d-f303-4826-bc71-1c0968516597 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:33.570092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871937d-f303-4826-bc71-1c0968516597 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:33.637227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110b6b7-d169-48bb-a4d0-8629d6225743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:33.637900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110b6b7-d169-48bb-a4d0-8629d6225743 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:33.638237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110b6b7-d169-48bb-a4d0-8629d6225743 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:33.638549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110b6b7-d169-48bb-a4d0-8629d6225743 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:33.639280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110b6b7-d169-48bb-a4d0-8629d6225743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:33.641887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110b6b7-d169-48bb-a4d0-8629d6225743 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:33.663494 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4014/7931] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:17:33 2021] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:17:33.667887 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c5783-8eea-412e-8f15-c0742b8dffdc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:33.681181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c5783-8eea-412e-8f15-c0742b8dffdc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:33.686781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf7a66-75d7-4ffc-8294-2c585907969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:33.688523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf7a66-75d7-4ffc-8294-2c585907969a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:33.689613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf7a66-75d7-4ffc-8294-2c585907969a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:33.690027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf7a66-75d7-4ffc-8294-2c585907969a admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:33.691242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf7a66-75d7-4ffc-8294-2c585907969a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:33.692852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf7a66-75d7-4ffc-8294-2c585907969a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:33.705507 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3918/7932] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:33 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:17:33.710937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110b6b7-d169-48bb-a4d0-8629d6225743 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:33.724875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110b6b7-d169-48bb-a4d0-8629d6225743 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:33.730075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42007fd-fabb-47ad-a139-b9109d740f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:33.730925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42007fd-fabb-47ad-a139-b9109d740f27 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:33.731246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42007fd-fabb-47ad-a139-b9109d740f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:33.731506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42007fd-fabb-47ad-a139-b9109d740f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:33.732408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42007fd-fabb-47ad-a139-b9109d740f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:33.734287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42007fd-fabb-47ad-a139-b9109d740f27 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:33.758088 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4015/7933] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:33 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:17:33.758951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf7a66-75d7-4ffc-8294-2c585907969a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:33.770457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf7a66-75d7-4ffc-8294-2c585907969a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:33.777152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4088c00-899f-4b6b-b7ea-f1c81106a759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:33.778642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4088c00-899f-4b6b-b7ea-f1c81106a759 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:33.778940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4088c00-899f-4b6b-b7ea-f1c81106a759 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:33.779230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4088c00-899f-4b6b-b7ea-f1c81106a759 admin admin] PATH_INFO: `/v3/projects/baec07aa967b4df38f3de7a137a7c1cf/users/f0201f326d854541b769fd03b77c6378/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:33.798077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4088c00-899f-4b6b-b7ea-f1c81106a759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baec07aa967b4df38f3de7a137a7c1cf, user_id=f0201f326d854541b769fd03b77c6378, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:33.800935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4088c00-899f-4b6b-b7ea-f1c81106a759 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:33.822322 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3919/7934] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:17:33 2021] PUT /identity/v3/projects/baec07aa967b4df38f3de7a137a7c1cf/users/f0201f326d854541b769fd03b77c6378/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:33.828785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c10a5-cde7-4038-b8f9-7f12dda85fa0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:33.829080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c10a5-cde7-4038-b8f9-7f12dda85fa0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:33.829431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c10a5-cde7-4038-b8f9-7f12dda85fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:33.863267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c87c10a5-cde7-4038-b8f9-7f12dda85fa0 None None] MFA Rules not processed for user `f0201f326d854541b769fd03b77c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:33.864597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c87c10a5-cde7-4038-b8f9-7f12dda85fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:33.946506 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4016/7935] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:33 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:33.950125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4088c00-899f-4b6b-b7ea-f1c81106a759 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:34.039899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4088c00-899f-4b6b-b7ea-f1c81106a759 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:34.047209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1abd4b-8ee7-405a-8201-0066ea1e34e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:34.047989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1abd4b-8ee7-405a-8201-0066ea1e34e3 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:34.048349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1abd4b-8ee7-405a-8201-0066ea1e34e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:34.048699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1abd4b-8ee7-405a-8201-0066ea1e34e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:34.049502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1abd4b-8ee7-405a-8201-0066ea1e34e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:34.052726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1abd4b-8ee7-405a-8201-0066ea1e34e3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:34.094105 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3920/7936] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:17:33 2021] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:17:34.096399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c10a5-cde7-4038-b8f9-7f12dda85fa0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:34.113797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c10a5-cde7-4038-b8f9-7f12dda85fa0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:34.211897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede13f45-6e38-4fbf-80eb-68a63db6c544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:34.212914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede13f45-6e38-4fbf-80eb-68a63db6c544 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:34.213239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede13f45-6e38-4fbf-80eb-68a63db6c544 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:34.213748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede13f45-6e38-4fbf-80eb-68a63db6c544 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:34.214569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede13f45-6e38-4fbf-80eb-68a63db6c544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:34.216655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede13f45-6e38-4fbf-80eb-68a63db6c544 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:34.243634 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4017/7937] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:17:34 2021] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:17:34.249558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1abd4b-8ee7-405a-8201-0066ea1e34e3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:34.273100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1abd4b-8ee7-405a-8201-0066ea1e34e3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:34.280234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebb279-cc38-4e92-9691-1e7239c93fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:34.281439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebb279-cc38-4e92-9691-1e7239c93fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:34.281727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebb279-cc38-4e92-9691-1e7239c93fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:34.282012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebb279-cc38-4e92-9691-1e7239c93fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:34.282791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebb279-cc38-4e92-9691-1e7239c93fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:34.284440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebb279-cc38-4e92-9691-1e7239c93fd9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:34.308709 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3921/7938] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:34 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:17:34.310550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede13f45-6e38-4fbf-80eb-68a63db6c544 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:34.324151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede13f45-6e38-4fbf-80eb-68a63db6c544 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:34.330829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75dc26-2f34-4098-9ec3-b53a7d79424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:34.338079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75dc26-2f34-4098-9ec3-b53a7d79424b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:34.338463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75dc26-2f34-4098-9ec3-b53a7d79424b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:34.339070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75dc26-2f34-4098-9ec3-b53a7d79424b admin admin] PATH_INFO: `/v3/projects/38e329d1ecf44dd8bdef0f2c6c449061/users/a8fe3fb1cf4a46e7b97064b70d47f4af/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:34.368776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75dc26-2f34-4098-9ec3-b53a7d79424b admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e329d1ecf44dd8bdef0f2c6c449061, user_id=a8fe3fb1cf4a46e7b97064b70d47f4af, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:34.372024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75dc26-2f34-4098-9ec3-b53a7d79424b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:34.392653 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4018/7939] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:17:34 2021] PUT /identity/v3/projects/38e329d1ecf44dd8bdef0f2c6c449061/users/a8fe3fb1cf4a46e7b97064b70d47f4af/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:34.396729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebb279-cc38-4e92-9691-1e7239c93fd9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:34.409472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebb279-cc38-4e92-9691-1e7239c93fd9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:34.498356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62873cb2-89cf-4cfa-a7ab-5c36fb4d008f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:34.499181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62873cb2-89cf-4cfa-a7ab-5c36fb4d008f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:34.503224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62873cb2-89cf-4cfa-a7ab-5c36fb4d008f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:34.503735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62873cb2-89cf-4cfa-a7ab-5c36fb4d008f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:34.505144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62873cb2-89cf-4cfa-a7ab-5c36fb4d008f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:34.508048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62873cb2-89cf-4cfa-a7ab-5c36fb4d008f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:34.526365 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3922/7940] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:34 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:17:34.530467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75dc26-2f34-4098-9ec3-b53a7d79424b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:34.543878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75dc26-2f34-4098-9ec3-b53a7d79424b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:34.551447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0489cd-d766-4b76-84cb-0a8ad99ce81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:34.552356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0489cd-d766-4b76-84cb-0a8ad99ce81e admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:34.552641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0489cd-d766-4b76-84cb-0a8ad99ce81e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:34.552914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0489cd-d766-4b76-84cb-0a8ad99ce81e admin admin] PATH_INFO: `/v3/projects/38e329d1ecf44dd8bdef0f2c6c449061/users/a8fe3fb1cf4a46e7b97064b70d47f4af/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:34.555119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0489cd-d766-4b76-84cb-0a8ad99ce81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e329d1ecf44dd8bdef0f2c6c449061, user_id=a8fe3fb1cf4a46e7b97064b70d47f4af, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:34.558024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0489cd-d766-4b76-84cb-0a8ad99ce81e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:34.572462 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4019/7941] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:17:34 2021] PUT /identity/v3/projects/38e329d1ecf44dd8bdef0f2c6c449061/users/a8fe3fb1cf4a46e7b97064b70d47f4af/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:34.584618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e2a51-34bf-4874-9af9-aaf3c57e907a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:34.586174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e2a51-34bf-4874-9af9-aaf3c57e907a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:34.595240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e2a51-34bf-4874-9af9-aaf3c57e907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:34.625973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-622e2a51-34bf-4874-9af9-aaf3c57e907a None None] MFA Rules not processed for user `a8fe3fb1cf4a46e7b97064b70d47f4af`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:34.627557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-622e2a51-34bf-4874-9af9-aaf3c57e907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:34.755654 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3923/7942] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:34 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:34.766952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0489cd-d766-4b76-84cb-0a8ad99ce81e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:34.771556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2f0489cd-d766-4b76-84cb-0a8ad99ce81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:34.849218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0489cd-d766-4b76-84cb-0a8ad99ce81e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:34.853911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed9fb7-de49-4eb8-9ddf-27a3a281b92c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:34.854914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9fb7-de49-4eb8-9ddf-27a3a281b92c service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:34.855318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9fb7-de49-4eb8-9ddf-27a3a281b92c service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:34.855666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9fb7-de49-4eb8-9ddf-27a3a281b92c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:34.866957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed9fb7-de49-4eb8-9ddf-27a3a281b92c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:34.868620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed9fb7-de49-4eb8-9ddf-27a3a281b92c service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:34.880393 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4020/7943] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:34 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:17:36.584507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e2a51-34bf-4874-9af9-aaf3c57e907a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:36.586667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-622e2a51-34bf-4874-9af9-aaf3c57e907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:36.606441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e2a51-34bf-4874-9af9-aaf3c57e907a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:36.611181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4aea0-24cc-4ede-b77c-5b8efd1f3cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:36.612248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4aea0-24cc-4ede-b77c-5b8efd1f3cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:36.612735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4aea0-24cc-4ede-b77c-5b8efd1f3cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:36.613197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4aea0-24cc-4ede-b77c-5b8efd1f3cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:36.615208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d8a4aea0-24cc-4ede-b77c-5b8efd1f3cf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:36.629734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4aea0-24cc-4ede-b77c-5b8efd1f3cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:36.631657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4aea0-24cc-4ede-b77c-5b8efd1f3cf5 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:36.646814 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3924/7944] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:36 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:17:36.853512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed9fb7-de49-4eb8-9ddf-27a3a281b92c service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:36.865964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed9fb7-de49-4eb8-9ddf-27a3a281b92c service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:36.870140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04761a4-0a4a-4557-9c27-074be486fe3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:36.870889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04761a4-0a4a-4557-9c27-074be486fe3a service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:36.871450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04761a4-0a4a-4557-9c27-074be486fe3a service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:36.871803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04761a4-0a4a-4557-9c27-074be486fe3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:36.932260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04761a4-0a4a-4557-9c27-074be486fe3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:36.933729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04761a4-0a4a-4557-9c27-074be486fe3a service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:36.944256 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4021/7945] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:36 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:17:38.400865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4aea0-24cc-4ede-b77c-5b8efd1f3cf5 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:38.469413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4aea0-24cc-4ede-b77c-5b8efd1f3cf5 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:38.474175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86236ad-bf17-4e15-91c6-6bb48b889b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:38.475068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86236ad-bf17-4e15-91c6-6bb48b889b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:38.475353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86236ad-bf17-4e15-91c6-6bb48b889b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:38.475630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86236ad-bf17-4e15-91c6-6bb48b889b79 admin admin] PATH_INFO: `/v3/users/f0201f326d854541b769fd03b77c6378` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:38.476846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86236ad-bf17-4e15-91c6-6bb48b889b79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0201f326d854541b769fd03b77c6378)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:38.478790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86236ad-bf17-4e15-91c6-6bb48b889b79 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:38.530396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f86236ad-bf17-4e15-91c6-6bb48b889b79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0201f326d854541b769fd03b77c6378'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:38.539254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f86236ad-bf17-4e15-91c6-6bb48b889b79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0201f326d854541b769fd03b77c6378'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:38.552216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f86236ad-bf17-4e15-91c6-6bb48b889b79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0201f326d854541b769fd03b77c6378'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:38.553021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f86236ad-bf17-4e15-91c6-6bb48b889b79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0201f326d854541b769fd03b77c6378'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:38.560035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f86236ad-bf17-4e15-91c6-6bb48b889b79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0201f326d854541b769fd03b77c6378'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:38.566905 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3925/7946] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:17:38 2021] DELETE /identity/v3/users/f0201f326d854541b769fd03b77c6378 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:38.571156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2d239-a79f-4e87-8569-a782f40e6ec9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:38.571625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2d239-a79f-4e87-8569-a782f40e6ec9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:38.571715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2d239-a79f-4e87-8569-a782f40e6ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:38.590049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2dd2d239-a79f-4e87-8569-a782f40e6ec9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:38.591506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2dd2d239-a79f-4e87-8569-a782f40e6ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:38.653579 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4022/7947] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:17:38.664394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86236ad-bf17-4e15-91c6-6bb48b889b79 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:38.665880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f86236ad-bf17-4e15-91c6-6bb48b889b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:38.728090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86236ad-bf17-4e15-91c6-6bb48b889b79 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:38.731773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed11e6e-9ed7-46a9-bfcc-489176c8f9c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:38.738272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed11e6e-9ed7-46a9-bfcc-489176c8f9c3 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:38.738272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed11e6e-9ed7-46a9-bfcc-489176c8f9c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:38.738272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed11e6e-9ed7-46a9-bfcc-489176c8f9c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:38.747899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed11e6e-9ed7-46a9-bfcc-489176c8f9c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:38.749846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed11e6e-9ed7-46a9-bfcc-489176c8f9c3 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:38.759799 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3926/7948] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:17:39.189179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2d239-a79f-4e87-8569-a782f40e6ec9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:39.190653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2dd2d239-a79f-4e87-8569-a782f40e6ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:39.203242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2d239-a79f-4e87-8569-a782f40e6ec9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:39.209260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:39.220642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:39.220642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:39.220642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f admin admin] PATH_INFO: `/v3/projects/baec07aa967b4df38f3de7a137a7c1cf` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:39.220642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f admin admin] RBAC: Authorizing `identity:delete_project(project_id=baec07aa967b4df38f3de7a137a7c1cf)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:39.220642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:39.283577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baec07aa967b4df38f3de7a137a7c1cf', 'request_id': 'req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:39.290285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baec07aa967b4df38f3de7a137a7c1cf', 'request_id': 'req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:39.301913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baec07aa967b4df38f3de7a137a7c1cf', 'request_id': 'req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:39.317487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f admin admin] The token cache is being invalidate because project baec07aa967b4df38f3de7a137a7c1cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:17:39.318470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:39.318573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:39.321216 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4023/7949] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:17:39 2021] DELETE /identity/v3/projects/baec07aa967b4df38f3de7a137a7c1cf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:39.325035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed11e6e-9ed7-46a9-bfcc-489176c8f9c3 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:39.335924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed11e6e-9ed7-46a9-bfcc-489176c8f9c3 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:39.397612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4918e-c8e6-435c-a21d-ebc5c3d6cd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:39.398537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4918e-c8e6-435c-a21d-ebc5c3d6cd7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:39.398823 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4918e-c8e6-435c-a21d-ebc5c3d6cd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:39.399111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4918e-c8e6-435c-a21d-ebc5c3d6cd7e admin admin] PATH_INFO: `/v3/users/a8fe3fb1cf4a46e7b97064b70d47f4af` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:39.400362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4918e-c8e6-435c-a21d-ebc5c3d6cd7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8fe3fb1cf4a46e7b97064b70d47f4af)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:39.402630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4918e-c8e6-435c-a21d-ebc5c3d6cd7e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:39.473869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-72f4918e-c8e6-435c-a21d-ebc5c3d6cd7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8fe3fb1cf4a46e7b97064b70d47f4af'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:39.481914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-72f4918e-c8e6-435c-a21d-ebc5c3d6cd7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8fe3fb1cf4a46e7b97064b70d47f4af'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:39.495178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-72f4918e-c8e6-435c-a21d-ebc5c3d6cd7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8fe3fb1cf4a46e7b97064b70d47f4af'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:39.496006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-72f4918e-c8e6-435c-a21d-ebc5c3d6cd7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8fe3fb1cf4a46e7b97064b70d47f4af'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:39.506174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-72f4918e-c8e6-435c-a21d-ebc5c3d6cd7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8fe3fb1cf4a46e7b97064b70d47f4af'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:39.514978 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3927/7950] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:17:39 2021] DELETE /identity/v3/users/a8fe3fb1cf4a46e7b97064b70d47f4af => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:39.946444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:39.948338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:39.966199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8d89d-3fe0-4f8b-8349-a9348ac0440f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:40.048248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c597a25-70b0-4897-b620-bc4f7d301c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:40.050159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c597a25-70b0-4897-b620-bc4f7d301c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:40.050612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c597a25-70b0-4897-b620-bc4f7d301c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:40.050832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c597a25-70b0-4897-b620-bc4f7d301c5b admin admin] PATH_INFO: `/v3/projects/38e329d1ecf44dd8bdef0f2c6c449061` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:40.053147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c597a25-70b0-4897-b620-bc4f7d301c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=38e329d1ecf44dd8bdef0f2c6c449061)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:40.055706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c597a25-70b0-4897-b620-bc4f7d301c5b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:40.121020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9c597a25-70b0-4897-b620-bc4f7d301c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38e329d1ecf44dd8bdef0f2c6c449061', 'request_id': 'req-9c597a25-70b0-4897-b620-bc4f7d301c5b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:40.128958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9c597a25-70b0-4897-b620-bc4f7d301c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38e329d1ecf44dd8bdef0f2c6c449061', 'request_id': 'req-9c597a25-70b0-4897-b620-bc4f7d301c5b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:40.139127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9c597a25-70b0-4897-b620-bc4f7d301c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38e329d1ecf44dd8bdef0f2c6c449061', 'request_id': 'req-9c597a25-70b0-4897-b620-bc4f7d301c5b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:40.151329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9c597a25-70b0-4897-b620-bc4f7d301c5b admin admin] The token cache is being invalidate because project 38e329d1ecf44dd8bdef0f2c6c449061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:17:40.151675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9c597a25-70b0-4897-b620-bc4f7d301c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:40.152336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9c597a25-70b0-4897-b620-bc4f7d301c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:40.154137 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4024/7951] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:17:39 2021] DELETE /identity/v3/projects/38e329d1ecf44dd8bdef0f2c6c449061 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:40.161687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9b395-3fc8-4744-aca6-d89fa2a9f2a3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:40.161982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9b395-3fc8-4744-aca6-d89fa2a9f2a3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:40.162457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9b395-3fc8-4744-aca6-d89fa2a9f2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:40.193855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-62b9b395-3fc8-4744-aca6-d89fa2a9f2a3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:40.195257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-62b9b395-3fc8-4744-aca6-d89fa2a9f2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:40.255709 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3928/7952] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:40.263672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e20e0-5134-4c77-86b8-fc3ae385aeef None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:40.263995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e20e0-5134-4c77-86b8-fc3ae385aeef None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:40.264317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e20e0-5134-4c77-86b8-fc3ae385aeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:40.283292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c43e20e0-5134-4c77-86b8-fc3ae385aeef None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:40.284581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c43e20e0-5134-4c77-86b8-fc3ae385aeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:40.292783 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4025/7953] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:40.296868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9b395-3fc8-4744-aca6-d89fa2a9f2a3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:40.306748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9b395-3fc8-4744-aca6-d89fa2a9f2a3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:40.311333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bfd45-4ebd-474f-965d-ba4cf079842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:40.312478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bfd45-4ebd-474f-965d-ba4cf079842f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:40.313007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bfd45-4ebd-474f-965d-ba4cf079842f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:40.313363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bfd45-4ebd-474f-965d-ba4cf079842f admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:40.314165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bfd45-4ebd-474f-965d-ba4cf079842f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:17:40.314504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bfd45-4ebd-474f-965d-ba4cf079842f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:40.316386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bfd45-4ebd-474f-965d-ba4cf079842f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:40.328741 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3929/7954] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:17:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:17:40.332833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e20e0-5134-4c77-86b8-fc3ae385aeef None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:40.342217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e20e0-5134-4c77-86b8-fc3ae385aeef None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:40.346996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325d90c-5f96-47d0-b853-2647623c9253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:40.347820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325d90c-5f96-47d0-b853-2647623c9253 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:40.348107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325d90c-5f96-47d0-b853-2647623c9253 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:40.348385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325d90c-5f96-47d0-b853-2647623c9253 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:40.349115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325d90c-5f96-47d0-b853-2647623c9253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:40.351096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325d90c-5f96-47d0-b853-2647623c9253 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:40.386387 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4026/7955] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:17:40 2021] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:17:40.387864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bfd45-4ebd-474f-965d-ba4cf079842f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:40.399748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bfd45-4ebd-474f-965d-ba4cf079842f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:40.463230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb2a6e-a09a-4fb0-97f8-03d647d43444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:40.463931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb2a6e-a09a-4fb0-97f8-03d647d43444 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:40.465265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb2a6e-a09a-4fb0-97f8-03d647d43444 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:40.465685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb2a6e-a09a-4fb0-97f8-03d647d43444 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:40.466564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb2a6e-a09a-4fb0-97f8-03d647d43444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:40.468687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb2a6e-a09a-4fb0-97f8-03d647d43444 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:40.508561 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3930/7956] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:17:40 2021] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:17:40.509843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325d90c-5f96-47d0-b853-2647623c9253 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:40.522695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325d90c-5f96-47d0-b853-2647623c9253 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:40.528256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd68441-ffc9-4d75-b713-159354089159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:40.529189 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd68441-ffc9-4d75-b713-159354089159 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:40.529705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd68441-ffc9-4d75-b713-159354089159 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:40.530341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd68441-ffc9-4d75-b713-159354089159 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:40.531654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd68441-ffc9-4d75-b713-159354089159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:40.533542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd68441-ffc9-4d75-b713-159354089159 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:40.545869 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4027/7957] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:40 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:17:40.550008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb2a6e-a09a-4fb0-97f8-03d647d43444 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:40.561132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb2a6e-a09a-4fb0-97f8-03d647d43444 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:40.568110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a4078-6213-4dd1-b712-f8db1b481818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:40.570886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a4078-6213-4dd1-b712-f8db1b481818 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:40.571458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a4078-6213-4dd1-b712-f8db1b481818 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:40.571948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a4078-6213-4dd1-b712-f8db1b481818 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:40.573002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a4078-6213-4dd1-b712-f8db1b481818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:40.574992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a4078-6213-4dd1-b712-f8db1b481818 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:40.591221 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3931/7958] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:40 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:17:40.595168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd68441-ffc9-4d75-b713-159354089159 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:40.607933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd68441-ffc9-4d75-b713-159354089159 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:40.615880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1fa89-474b-4e57-b42d-a0772971b511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:40.617717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1fa89-474b-4e57-b42d-a0772971b511 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:40.618798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1fa89-474b-4e57-b42d-a0772971b511 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:40.619441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1fa89-474b-4e57-b42d-a0772971b511 admin admin] PATH_INFO: `/v3/projects/ca44d9da45a74167a036ccb6dd1a9489/users/af2394ffcd374204b9caba2e697de8e5/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:40.646541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1fa89-474b-4e57-b42d-a0772971b511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca44d9da45a74167a036ccb6dd1a9489, user_id=af2394ffcd374204b9caba2e697de8e5, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:40.649830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1fa89-474b-4e57-b42d-a0772971b511 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:40.670332 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4028/7959] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:17:40 2021] PUT /identity/v3/projects/ca44d9da45a74167a036ccb6dd1a9489/users/af2394ffcd374204b9caba2e697de8e5/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:17:40.681657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600df261-2f2b-41ff-99f3-797c196d994b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:40.682383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600df261-2f2b-41ff-99f3-797c196d994b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:40.682734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600df261-2f2b-41ff-99f3-797c196d994b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:40.714720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-600df261-2f2b-41ff-99f3-797c196d994b None None] MFA Rules not processed for user `af2394ffcd374204b9caba2e697de8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:40.716270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-600df261-2f2b-41ff-99f3-797c196d994b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:40.817182 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3932/7960] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:40 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:40.818391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1fa89-474b-4e57-b42d-a0772971b511 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:40.896615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1fa89-474b-4e57-b42d-a0772971b511 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:40.903429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fc4c4-35b8-4495-a796-095a203ab937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:40.904272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fc4c4-35b8-4495-a796-095a203ab937 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:40.904595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fc4c4-35b8-4495-a796-095a203ab937 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:40.904894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fc4c4-35b8-4495-a796-095a203ab937 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:40.906018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fc4c4-35b8-4495-a796-095a203ab937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:40.908135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fc4c4-35b8-4495-a796-095a203ab937 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:40.937285 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4029/7961] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:17:40 2021] POST /identity/v3/projects => generated 391 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:17:40.941912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600df261-2f2b-41ff-99f3-797c196d994b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:40.957405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600df261-2f2b-41ff-99f3-797c196d994b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:41.038748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5381387-6529-4ac9-b0ef-629025894517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:41.039687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5381387-6529-4ac9-b0ef-629025894517 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:41.039983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5381387-6529-4ac9-b0ef-629025894517 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:41.040313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5381387-6529-4ac9-b0ef-629025894517 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:41.041044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5381387-6529-4ac9-b0ef-629025894517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:41.043257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5381387-6529-4ac9-b0ef-629025894517 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:41.076833 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3933/7962] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:17:40 2021] POST /identity/v3/users => generated 302 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:17:41.078937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fc4c4-35b8-4495-a796-095a203ab937 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:41.090550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fc4c4-35b8-4495-a796-095a203ab937 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:41.097836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486642bd-844f-429c-8656-67eea4295654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:41.098798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486642bd-844f-429c-8656-67eea4295654 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:41.099149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486642bd-844f-429c-8656-67eea4295654 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:41.099494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486642bd-844f-429c-8656-67eea4295654 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:41.100300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486642bd-844f-429c-8656-67eea4295654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:41.101990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486642bd-844f-429c-8656-67eea4295654 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:41.116404 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4030/7963] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:41 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:17:41.118693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5381387-6529-4ac9-b0ef-629025894517 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:41.129786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5381387-6529-4ac9-b0ef-629025894517 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:41.134883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b81a0-e79d-435d-a94f-8c0c872a70f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:41.136023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b81a0-e79d-435d-a94f-8c0c872a70f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:41.136136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b81a0-e79d-435d-a94f-8c0c872a70f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:41.136526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b81a0-e79d-435d-a94f-8c0c872a70f8 admin admin] PATH_INFO: `/v3/projects/fba234832e1848fbaae12b132c7aca8a/users/620d6da9c2e54911ad8a475e7fc1303e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:41.154705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b81a0-e79d-435d-a94f-8c0c872a70f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba234832e1848fbaae12b132c7aca8a, user_id=620d6da9c2e54911ad8a475e7fc1303e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:41.157934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b81a0-e79d-435d-a94f-8c0c872a70f8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:41.180070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486642bd-844f-429c-8656-67eea4295654 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:41.181289 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3934/7964] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:17:41 2021] PUT /identity/v3/projects/fba234832e1848fbaae12b132c7aca8a/users/620d6da9c2e54911ad8a475e7fc1303e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:41.196647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486642bd-844f-429c-8656-67eea4295654 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:41.258891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690af413-8110-4ca2-8a59-cf96596a3acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:41.259573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690af413-8110-4ca2-8a59-cf96596a3acb admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:41.259859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690af413-8110-4ca2-8a59-cf96596a3acb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:41.260140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690af413-8110-4ca2-8a59-cf96596a3acb admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:41.261062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690af413-8110-4ca2-8a59-cf96596a3acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:41.262744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690af413-8110-4ca2-8a59-cf96596a3acb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:41.273716 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4031/7965] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:41 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:17:41.278862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b81a0-e79d-435d-a94f-8c0c872a70f8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:41.290475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b81a0-e79d-435d-a94f-8c0c872a70f8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:41.295357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c57c41-4b20-4810-bd71-586fd30d5e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:41.296993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c57c41-4b20-4810-bd71-586fd30d5e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:41.297284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c57c41-4b20-4810-bd71-586fd30d5e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:41.297630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c57c41-4b20-4810-bd71-586fd30d5e7d admin admin] PATH_INFO: `/v3/projects/fba234832e1848fbaae12b132c7aca8a/users/620d6da9c2e54911ad8a475e7fc1303e/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:41.299778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c57c41-4b20-4810-bd71-586fd30d5e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba234832e1848fbaae12b132c7aca8a, user_id=620d6da9c2e54911ad8a475e7fc1303e, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:41.302526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c57c41-4b20-4810-bd71-586fd30d5e7d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:41.329663 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3935/7966] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:17:41 2021] PUT /identity/v3/projects/fba234832e1848fbaae12b132c7aca8a/users/620d6da9c2e54911ad8a475e7fc1303e/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:17:41.332575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dfe29-1530-4461-852f-ca3c3691b1e0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:41.332873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dfe29-1530-4461-852f-ca3c3691b1e0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:41.333156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dfe29-1530-4461-852f-ca3c3691b1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:41.365145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-425dfe29-1530-4461-852f-ca3c3691b1e0 None None] MFA Rules not processed for user `620d6da9c2e54911ad8a475e7fc1303e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:41.366735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-425dfe29-1530-4461-852f-ca3c3691b1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:41.475607 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4032/7967] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:41 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:41.487364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c57c41-4b20-4810-bd71-586fd30d5e7d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:41.489028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-12c57c41-4b20-4810-bd71-586fd30d5e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:41.557536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c57c41-4b20-4810-bd71-586fd30d5e7d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:41.561603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e6efa-45e3-4d56-a264-74b6f06e1efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:41.562338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e6efa-45e3-4d56-a264-74b6f06e1efa service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:41.562698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e6efa-45e3-4d56-a264-74b6f06e1efa service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:41.563145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e6efa-45e3-4d56-a264-74b6f06e1efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:41.573441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e6efa-45e3-4d56-a264-74b6f06e1efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:41.574940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e6efa-45e3-4d56-a264-74b6f06e1efa service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:41.585728 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3936/7968] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:41 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:17:44.622512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dfe29-1530-4461-852f-ca3c3691b1e0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:44.689235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dfe29-1530-4461-852f-ca3c3691b1e0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:44.694461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea10d41-de00-42d3-917e-e1dff46d023b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:44.695334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea10d41-de00-42d3-917e-e1dff46d023b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:44.695637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea10d41-de00-42d3-917e-e1dff46d023b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:44.695878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea10d41-de00-42d3-917e-e1dff46d023b admin admin] PATH_INFO: `/v3/users/af2394ffcd374204b9caba2e697de8e5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:44.697094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea10d41-de00-42d3-917e-e1dff46d023b admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2394ffcd374204b9caba2e697de8e5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:44.699167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea10d41-de00-42d3-917e-e1dff46d023b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:44.758001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ea10d41-de00-42d3-917e-e1dff46d023b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2394ffcd374204b9caba2e697de8e5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:44.771071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ea10d41-de00-42d3-917e-e1dff46d023b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2394ffcd374204b9caba2e697de8e5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:44.771978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ea10d41-de00-42d3-917e-e1dff46d023b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2394ffcd374204b9caba2e697de8e5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:44.790394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ea10d41-de00-42d3-917e-e1dff46d023b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2394ffcd374204b9caba2e697de8e5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:44.803474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2ea10d41-de00-42d3-917e-e1dff46d023b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2394ffcd374204b9caba2e697de8e5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:44.814543 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4033/7969] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:17:44 2021] DELETE /identity/v3/users/af2394ffcd374204b9caba2e697de8e5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:44.819406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16010-56c3-4e80-930d-657b6b5b896e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:44.820273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16010-56c3-4e80-930d-657b6b5b896e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:44.820936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16010-56c3-4e80-930d-657b6b5b896e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:44.845402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a6f16010-56c3-4e80-930d-657b6b5b896e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:44.846959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a6f16010-56c3-4e80-930d-657b6b5b896e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:44.944384 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3937/7970] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:44.958119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea10d41-de00-42d3-917e-e1dff46d023b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:44.959708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2ea10d41-de00-42d3-917e-e1dff46d023b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:45.046701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea10d41-de00-42d3-917e-e1dff46d023b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:45.050797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ca84c-86ac-4013-bd29-b27456072dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:45.051461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ca84c-86ac-4013-bd29-b27456072dff service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:45.051749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ca84c-86ac-4013-bd29-b27456072dff service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:45.052038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ca84c-86ac-4013-bd29-b27456072dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:45.065185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ca84c-86ac-4013-bd29-b27456072dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:45.066925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ca84c-86ac-4013-bd29-b27456072dff service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:45.078619 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4034/7971] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:17:45.718803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f16010-56c3-4e80-930d-657b6b5b896e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:45.720558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a6f16010-56c3-4e80-930d-657b6b5b896e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:45.757138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f16010-56c3-4e80-930d-657b6b5b896e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:45.763631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:45.764511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:45.765379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:45.765660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc admin admin] PATH_INFO: `/v3/projects/ca44d9da45a74167a036ccb6dd1a9489` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:45.766948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca44d9da45a74167a036ccb6dd1a9489)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:45.769043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:45.837782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca44d9da45a74167a036ccb6dd1a9489', 'request_id': 'req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:45.845466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca44d9da45a74167a036ccb6dd1a9489', 'request_id': 'req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:45.852153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca44d9da45a74167a036ccb6dd1a9489', 'request_id': 'req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:45.873129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc admin admin] The token cache is being invalidate because project ca44d9da45a74167a036ccb6dd1a9489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:17:45.873432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:45.874793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:45.876634 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3938/7972] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:17:45 2021] DELETE /identity/v3/projects/ca44d9da45a74167a036ccb6dd1a9489 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:45.880623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ca84c-86ac-4013-bd29-b27456072dff service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:45.890756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ca84c-86ac-4013-bd29-b27456072dff service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:45.994813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5e68c-aa00-45f9-bfda-c68c97271a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:45.995698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5e68c-aa00-45f9-bfda-c68c97271a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:45.996086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5e68c-aa00-45f9-bfda-c68c97271a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:45.996372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5e68c-aa00-45f9-bfda-c68c97271a25 admin admin] PATH_INFO: `/v3/users/620d6da9c2e54911ad8a475e7fc1303e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:45.997630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5e68c-aa00-45f9-bfda-c68c97271a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=620d6da9c2e54911ad8a475e7fc1303e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:46.000775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5e68c-aa00-45f9-bfda-c68c97271a25 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:46.136044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-97d5e68c-aa00-45f9-bfda-c68c97271a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620d6da9c2e54911ad8a475e7fc1303e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:46.148366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-97d5e68c-aa00-45f9-bfda-c68c97271a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620d6da9c2e54911ad8a475e7fc1303e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:46.149396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-97d5e68c-aa00-45f9-bfda-c68c97271a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620d6da9c2e54911ad8a475e7fc1303e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:46.189369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-97d5e68c-aa00-45f9-bfda-c68c97271a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620d6da9c2e54911ad8a475e7fc1303e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:46.204546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-97d5e68c-aa00-45f9-bfda-c68c97271a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620d6da9c2e54911ad8a475e7fc1303e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:46.219755 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4035/7973] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:17:45 2021] DELETE /identity/v3/users/620d6da9c2e54911ad8a475e7fc1303e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:17:46.687426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:46.688891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:46.705126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ccd50-9f77-4714-8609-d2fe7c4d09dc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:46.814037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1555a1-ada5-4f67-a45e-e0aaaef2c9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:46.814902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1555a1-ada5-4f67-a45e-e0aaaef2c9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:46.815191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1555a1-ada5-4f67-a45e-e0aaaef2c9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:46.815468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1555a1-ada5-4f67-a45e-e0aaaef2c9b0 admin admin] PATH_INFO: `/v3/projects/fba234832e1848fbaae12b132c7aca8a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:46.817127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1555a1-ada5-4f67-a45e-e0aaaef2c9b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba234832e1848fbaae12b132c7aca8a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:46.819113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1555a1-ada5-4f67-a45e-e0aaaef2c9b0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:46.881064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-eb1555a1-ada5-4f67-a45e-e0aaaef2c9b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba234832e1848fbaae12b132c7aca8a', 'request_id': 'req-eb1555a1-ada5-4f67-a45e-e0aaaef2c9b0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:46.893433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-eb1555a1-ada5-4f67-a45e-e0aaaef2c9b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba234832e1848fbaae12b132c7aca8a', 'request_id': 'req-eb1555a1-ada5-4f67-a45e-e0aaaef2c9b0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:46.903419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-eb1555a1-ada5-4f67-a45e-e0aaaef2c9b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba234832e1848fbaae12b132c7aca8a', 'request_id': 'req-eb1555a1-ada5-4f67-a45e-e0aaaef2c9b0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:46.920112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-eb1555a1-ada5-4f67-a45e-e0aaaef2c9b0 admin admin] The token cache is being invalidate because project fba234832e1848fbaae12b132c7aca8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:17:46.920400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-eb1555a1-ada5-4f67-a45e-e0aaaef2c9b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:46.921291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-eb1555a1-ada5-4f67-a45e-e0aaaef2c9b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:46.924147 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3939/7974] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:17:46 2021] DELETE /identity/v3/projects/fba234832e1848fbaae12b132c7aca8a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:46.930052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac8980-2b12-488d-a3cc-1e77fb7396c0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:46.931018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac8980-2b12-488d-a3cc-1e77fb7396c0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:46.931593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac8980-2b12-488d-a3cc-1e77fb7396c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:46.960814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-afac8980-2b12-488d-a3cc-1e77fb7396c0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:46.962212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-afac8980-2b12-488d-a3cc-1e77fb7396c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:47.027986 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4036/7975] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:17:47.035934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f83f4b-6481-4676-92cf-79494418e719 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:47.036228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f83f4b-6481-4676-92cf-79494418e719 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:47.036507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f83f4b-6481-4676-92cf-79494418e719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:47.055334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c7f83f4b-6481-4676-92cf-79494418e719 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:47.056647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c7f83f4b-6481-4676-92cf-79494418e719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:47.067235 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3940/7976] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:47.070802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac8980-2b12-488d-a3cc-1e77fb7396c0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:47.083837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac8980-2b12-488d-a3cc-1e77fb7396c0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:47.092397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d039597-0726-4911-b4a5-df6e4a3d8625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:47.093127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d039597-0726-4911-b4a5-df6e4a3d8625 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:47.093412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d039597-0726-4911-b4a5-df6e4a3d8625 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:47.093847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d039597-0726-4911-b4a5-df6e4a3d8625 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:47.094625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d039597-0726-4911-b4a5-df6e4a3d8625 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:17:47.094936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d039597-0726-4911-b4a5-df6e4a3d8625 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:47.096597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d039597-0726-4911-b4a5-df6e4a3d8625 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:47.109314 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4037/7977] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:17:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:17:47.114071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f83f4b-6481-4676-92cf-79494418e719 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:47.125951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f83f4b-6481-4676-92cf-79494418e719 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:47.132186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fd965-167f-4a19-9f7b-b7e1667b0bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:47.132578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fd965-167f-4a19-9f7b-b7e1667b0bce admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:47.132933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fd965-167f-4a19-9f7b-b7e1667b0bce admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:47.133280 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fd965-167f-4a19-9f7b-b7e1667b0bce admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:47.134004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fd965-167f-4a19-9f7b-b7e1667b0bce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:47.135954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fd965-167f-4a19-9f7b-b7e1667b0bce admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:47.173077 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3941/7978] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:17:47 2021] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:17:47.177206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d039597-0726-4911-b4a5-df6e4a3d8625 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:47.194283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d039597-0726-4911-b4a5-df6e4a3d8625 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:47.281284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b92b3-d2e5-4326-b72d-4c74e01fdcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:47.281964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b92b3-d2e5-4326-b72d-4c74e01fdcae admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:47.282285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b92b3-d2e5-4326-b72d-4c74e01fdcae admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:47.282583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b92b3-d2e5-4326-b72d-4c74e01fdcae admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:47.283233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b92b3-d2e5-4326-b72d-4c74e01fdcae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:47.285577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b92b3-d2e5-4326-b72d-4c74e01fdcae admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:47.313747 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4038/7979] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:17:47 2021] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:17:47.317940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fd965-167f-4a19-9f7b-b7e1667b0bce admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:47.330376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fd965-167f-4a19-9f7b-b7e1667b0bce admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:47.335389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ac802-2f25-47b3-abb7-9040594fdfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:47.336752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ac802-2f25-47b3-abb7-9040594fdfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:47.337036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ac802-2f25-47b3-abb7-9040594fdfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:47.337314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ac802-2f25-47b3-abb7-9040594fdfd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:47.338054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ac802-2f25-47b3-abb7-9040594fdfd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:47.339713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ac802-2f25-47b3-abb7-9040594fdfd5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:47.351093 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3942/7980] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:47 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:17:47.355165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b92b3-d2e5-4326-b72d-4c74e01fdcae admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:47.366474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b92b3-d2e5-4326-b72d-4c74e01fdcae admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:47.373460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b494b-6f85-49c0-a7c2-23c2841ddc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:47.374729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b494b-6f85-49c0-a7c2-23c2841ddc0d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:47.375016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b494b-6f85-49c0-a7c2-23c2841ddc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:47.375396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b494b-6f85-49c0-a7c2-23c2841ddc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:47.376435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b494b-6f85-49c0-a7c2-23c2841ddc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:47.377799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b494b-6f85-49c0-a7c2-23c2841ddc0d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:47.388601 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4039/7981] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:47 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:17:47.392920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ac802-2f25-47b3-abb7-9040594fdfd5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:47.402915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ac802-2f25-47b3-abb7-9040594fdfd5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:47.408065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5212c-068d-4aea-bf13-7d6737aefcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:47.408958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5212c-068d-4aea-bf13-7d6737aefcd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:47.409240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5212c-068d-4aea-bf13-7d6737aefcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:47.409518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5212c-068d-4aea-bf13-7d6737aefcd1 admin admin] PATH_INFO: `/v3/projects/8ababf23c96043ffa7a500358a5f9783/users/1c648c364990440bb95ea76b210f778e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:47.425235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5212c-068d-4aea-bf13-7d6737aefcd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ababf23c96043ffa7a500358a5f9783, user_id=1c648c364990440bb95ea76b210f778e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:47.427914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5212c-068d-4aea-bf13-7d6737aefcd1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:47.442370 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3943/7982] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:17:47 2021] PUT /identity/v3/projects/8ababf23c96043ffa7a500358a5f9783/users/1c648c364990440bb95ea76b210f778e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:47.452983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806e796-1028-4d91-916e-6706d89376f2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:47.453357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806e796-1028-4d91-916e-6706d89376f2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:47.453713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806e796-1028-4d91-916e-6706d89376f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:47.481563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a806e796-1028-4d91-916e-6706d89376f2 None None] MFA Rules not processed for user `1c648c364990440bb95ea76b210f778e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:47.482957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a806e796-1028-4d91-916e-6706d89376f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:47.554817 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4040/7983] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:47 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:47.581042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5212c-068d-4aea-bf13-7d6737aefcd1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:47.582860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6da5212c-068d-4aea-bf13-7d6737aefcd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:47.662353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5212c-068d-4aea-bf13-7d6737aefcd1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:47.669470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642b467-67d9-4223-9ef0-9bdf9f9a66ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:47.670146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642b467-67d9-4223-9ef0-9bdf9f9a66ad service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:47.670488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642b467-67d9-4223-9ef0-9bdf9f9a66ad service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:47.671957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642b467-67d9-4223-9ef0-9bdf9f9a66ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:47.681901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642b467-67d9-4223-9ef0-9bdf9f9a66ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:47.683582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642b467-67d9-4223-9ef0-9bdf9f9a66ad service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:47.700414 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3944/7984] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:47 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:17:48.504639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806e796-1028-4d91-916e-6706d89376f2 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:48.568022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806e796-1028-4d91-916e-6706d89376f2 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:48.579021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d1ace-743a-479d-ba91-1d8bf3752ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:48.579915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d1ace-743a-479d-ba91-1d8bf3752ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:48.580219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d1ace-743a-479d-ba91-1d8bf3752ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:48.580484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d1ace-743a-479d-ba91-1d8bf3752ecf admin admin] PATH_INFO: `/v3/users/1c648c364990440bb95ea76b210f778e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:48.581741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d1ace-743a-479d-ba91-1d8bf3752ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c648c364990440bb95ea76b210f778e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:48.583735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d1ace-743a-479d-ba91-1d8bf3752ecf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:48.638135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-748d1ace-743a-479d-ba91-1d8bf3752ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c648c364990440bb95ea76b210f778e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:48.647867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-748d1ace-743a-479d-ba91-1d8bf3752ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c648c364990440bb95ea76b210f778e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:48.649210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-748d1ace-743a-479d-ba91-1d8bf3752ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c648c364990440bb95ea76b210f778e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:48.664719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-748d1ace-743a-479d-ba91-1d8bf3752ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c648c364990440bb95ea76b210f778e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:48.679632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-748d1ace-743a-479d-ba91-1d8bf3752ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c648c364990440bb95ea76b210f778e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:48.690512 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4041/7985] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:17:48 2021] DELETE /identity/v3/users/1c648c364990440bb95ea76b210f778e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:48.694300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeb37c-a017-4bc3-9bf0-f2bb9da2cc20 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:48.695181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeb37c-a017-4bc3-9bf0-f2bb9da2cc20 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:48.696462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeb37c-a017-4bc3-9bf0-f2bb9da2cc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:48.734920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c8aeb37c-a017-4bc3-9bf0-f2bb9da2cc20 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:48.736622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c8aeb37c-a017-4bc3-9bf0-f2bb9da2cc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:48.860769 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3945/7986] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:48.872583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d1ace-743a-479d-ba91-1d8bf3752ecf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:48.875741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-748d1ace-743a-479d-ba91-1d8bf3752ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:48.951799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d1ace-743a-479d-ba91-1d8bf3752ecf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:48.955919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001432d-1484-4a4f-8a7b-1658faec341a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:48.956710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001432d-1484-4a4f-8a7b-1658faec341a service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:48.957003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001432d-1484-4a4f-8a7b-1658faec341a service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:48.957380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001432d-1484-4a4f-8a7b-1658faec341a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:48.968680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001432d-1484-4a4f-8a7b-1658faec341a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:48.970272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001432d-1484-4a4f-8a7b-1658faec341a service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:48.991995 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4042/7987] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:17:49.828110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aeb37c-a017-4bc3-9bf0-f2bb9da2cc20 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:49.829875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c8aeb37c-a017-4bc3-9bf0-f2bb9da2cc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:49.852547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aeb37c-a017-4bc3-9bf0-f2bb9da2cc20 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:49.868671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc741a-1643-47d6-9cd6-6e4409c54cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:49.869683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc741a-1643-47d6-9cd6-6e4409c54cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:49.870487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc741a-1643-47d6-9cd6-6e4409c54cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:49.870897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc741a-1643-47d6-9cd6-6e4409c54cb0 admin admin] PATH_INFO: `/v3/projects/8ababf23c96043ffa7a500358a5f9783` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:49.872384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc741a-1643-47d6-9cd6-6e4409c54cb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ababf23c96043ffa7a500358a5f9783)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:49.874899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc741a-1643-47d6-9cd6-6e4409c54cb0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:49.926664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74bc741a-1643-47d6-9cd6-6e4409c54cb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ababf23c96043ffa7a500358a5f9783', 'request_id': 'req-74bc741a-1643-47d6-9cd6-6e4409c54cb0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:49.933917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74bc741a-1643-47d6-9cd6-6e4409c54cb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ababf23c96043ffa7a500358a5f9783', 'request_id': 'req-74bc741a-1643-47d6-9cd6-6e4409c54cb0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:49.940573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74bc741a-1643-47d6-9cd6-6e4409c54cb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ababf23c96043ffa7a500358a5f9783', 'request_id': 'req-74bc741a-1643-47d6-9cd6-6e4409c54cb0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:49.955634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74bc741a-1643-47d6-9cd6-6e4409c54cb0 admin admin] The token cache is being invalidate because project 8ababf23c96043ffa7a500358a5f9783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:17:49.956090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74bc741a-1643-47d6-9cd6-6e4409c54cb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:49.956825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74bc741a-1643-47d6-9cd6-6e4409c54cb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:49.958934 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3946/7988] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:17:49 2021] DELETE /identity/v3/projects/8ababf23c96043ffa7a500358a5f9783 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:49.964234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1f4db-a2af-485c-b32d-18f2c460457f None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:49.964743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1f4db-a2af-485c-b32d-18f2c460457f None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:49.964843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1f4db-a2af-485c-b32d-18f2c460457f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:49.984847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f0f1f4db-a2af-485c-b32d-18f2c460457f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:49.987042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f0f1f4db-a2af-485c-b32d-18f2c460457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:50.057408 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4043/7989] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:50.067079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155655dd-f010-4ac6-9764-6340e1c2bc13 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:50.067472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155655dd-f010-4ac6-9764-6340e1c2bc13 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:50.067859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155655dd-f010-4ac6-9764-6340e1c2bc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:50.088286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-155655dd-f010-4ac6-9764-6340e1c2bc13 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:50.089853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-155655dd-f010-4ac6-9764-6340e1c2bc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:50.098291 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3947/7990] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:50.102475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1f4db-a2af-485c-b32d-18f2c460457f None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:50.112298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1f4db-a2af-485c-b32d-18f2c460457f None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:50.117408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced382fa-d6e9-41ca-b3ea-7e76cd8270a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:50.118078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced382fa-d6e9-41ca-b3ea-7e76cd8270a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:50.118428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced382fa-d6e9-41ca-b3ea-7e76cd8270a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:50.118710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced382fa-d6e9-41ca-b3ea-7e76cd8270a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:50.119448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced382fa-d6e9-41ca-b3ea-7e76cd8270a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:17:50.119758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced382fa-d6e9-41ca-b3ea-7e76cd8270a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:50.122266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced382fa-d6e9-41ca-b3ea-7e76cd8270a5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:50.142932 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4044/7991] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:17:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:17:50.144691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155655dd-f010-4ac6-9764-6340e1c2bc13 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:50.157872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155655dd-f010-4ac6-9764-6340e1c2bc13 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:50.163693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535ec72-1de5-4bf8-b0be-6e41d5fd9d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:50.165253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535ec72-1de5-4bf8-b0be-6e41d5fd9d3a admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:50.165646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535ec72-1de5-4bf8-b0be-6e41d5fd9d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:50.166030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535ec72-1de5-4bf8-b0be-6e41d5fd9d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:50.166904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535ec72-1de5-4bf8-b0be-6e41d5fd9d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:50.168934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535ec72-1de5-4bf8-b0be-6e41d5fd9d3a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:50.214181 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3948/7992] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:17:50 2021] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:17:50.215382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced382fa-d6e9-41ca-b3ea-7e76cd8270a5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:50.226169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced382fa-d6e9-41ca-b3ea-7e76cd8270a5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:50.312170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07c9f1-9556-4c1f-9291-897644fade5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:50.312853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07c9f1-9556-4c1f-9291-897644fade5b admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:50.313706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07c9f1-9556-4c1f-9291-897644fade5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:50.313706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07c9f1-9556-4c1f-9291-897644fade5b admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:50.314272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07c9f1-9556-4c1f-9291-897644fade5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:50.316505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07c9f1-9556-4c1f-9291-897644fade5b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:50.342009 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4045/7993] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:17:50 2021] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:17:50.346076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535ec72-1de5-4bf8-b0be-6e41d5fd9d3a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:50.356868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535ec72-1de5-4bf8-b0be-6e41d5fd9d3a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:50.362519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d294ffb-a7de-4b1f-a1f6-b0135b54a497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:50.363255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d294ffb-a7de-4b1f-a1f6-b0135b54a497 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:50.363553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d294ffb-a7de-4b1f-a1f6-b0135b54a497 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:50.363832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d294ffb-a7de-4b1f-a1f6-b0135b54a497 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:50.364573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d294ffb-a7de-4b1f-a1f6-b0135b54a497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:50.366352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d294ffb-a7de-4b1f-a1f6-b0135b54a497 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:50.382491 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3949/7994] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:50 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:17:50.383526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07c9f1-9556-4c1f-9291-897644fade5b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:50.394015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07c9f1-9556-4c1f-9291-897644fade5b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:50.399146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990c770-eaad-444e-a71b-54b50b3325d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:50.399815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990c770-eaad-444e-a71b-54b50b3325d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:50.400091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990c770-eaad-444e-a71b-54b50b3325d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:50.400370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990c770-eaad-444e-a71b-54b50b3325d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:50.401232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990c770-eaad-444e-a71b-54b50b3325d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:50.403042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990c770-eaad-444e-a71b-54b50b3325d4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:50.414305 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4046/7995] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:17:50.419073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d294ffb-a7de-4b1f-a1f6-b0135b54a497 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:50.433835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d294ffb-a7de-4b1f-a1f6-b0135b54a497 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:50.444512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95db52-7413-421e-94ae-8796481592fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:50.445618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95db52-7413-421e-94ae-8796481592fb admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:50.446011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95db52-7413-421e-94ae-8796481592fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:50.446436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95db52-7413-421e-94ae-8796481592fb admin admin] PATH_INFO: `/v3/projects/bf44039972604cd18c79369576ca9691/users/b8222216d1c840c0bab85cb4e881d8fb/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:50.462528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95db52-7413-421e-94ae-8796481592fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf44039972604cd18c79369576ca9691, user_id=b8222216d1c840c0bab85cb4e881d8fb, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:50.465298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95db52-7413-421e-94ae-8796481592fb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:50.480399 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3950/7996] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:17:50 2021] PUT /identity/v3/projects/bf44039972604cd18c79369576ca9691/users/b8222216d1c840c0bab85cb4e881d8fb/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:50.492430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94661e-8b1e-4a11-ae63-adf3bd645355 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:50.492900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94661e-8b1e-4a11-ae63-adf3bd645355 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:50.493335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94661e-8b1e-4a11-ae63-adf3bd645355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:50.527291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-af94661e-8b1e-4a11-ae63-adf3bd645355 None None] MFA Rules not processed for user `b8222216d1c840c0bab85cb4e881d8fb`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:50.529061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-af94661e-8b1e-4a11-ae63-adf3bd645355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:50.619672 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4047/7997] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:50 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:50.643672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95db52-7413-421e-94ae-8796481592fb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:50.645517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ea95db52-7413-421e-94ae-8796481592fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:50.745968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95db52-7413-421e-94ae-8796481592fb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:50.772006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e31eb-d3f1-4606-bc61-9050aeff7ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:50.775540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e31eb-d3f1-4606-bc61-9050aeff7ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:50.775952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e31eb-d3f1-4606-bc61-9050aeff7ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:50.781179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e31eb-d3f1-4606-bc61-9050aeff7ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:50.800891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e31eb-d3f1-4606-bc61-9050aeff7ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:50.802976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e31eb-d3f1-4606-bc61-9050aeff7ea0 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:50.815737 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3951/7998] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:50 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:17:53.444695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94661e-8b1e-4a11-ae63-adf3bd645355 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:53.444695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-af94661e-8b1e-4a11-ae63-adf3bd645355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:53.526927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94661e-8b1e-4a11-ae63-adf3bd645355 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:53.542961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62955206-6808-493f-bd51-6e8e97c225f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:53.544483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62955206-6808-493f-bd51-6e8e97c225f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:53.544868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62955206-6808-493f-bd51-6e8e97c225f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:53.545248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62955206-6808-493f-bd51-6e8e97c225f5 admin admin] PATH_INFO: `/v3/users/f292f8174a7a4de5bf8a848e49f85dbe` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:53.547936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62955206-6808-493f-bd51-6e8e97c225f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f292f8174a7a4de5bf8a848e49f85dbe)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:53.551053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62955206-6808-493f-bd51-6e8e97c225f5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:53.608847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-62955206-6808-493f-bd51-6e8e97c225f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f292f8174a7a4de5bf8a848e49f85dbe'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:53.615990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-62955206-6808-493f-bd51-6e8e97c225f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f292f8174a7a4de5bf8a848e49f85dbe'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:53.616816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-62955206-6808-493f-bd51-6e8e97c225f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f292f8174a7a4de5bf8a848e49f85dbe'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:53.630330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-62955206-6808-493f-bd51-6e8e97c225f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f292f8174a7a4de5bf8a848e49f85dbe'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:53.648550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-62955206-6808-493f-bd51-6e8e97c225f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f292f8174a7a4de5bf8a848e49f85dbe'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:53.660001 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4048/7999] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:17:53 2021] DELETE /identity/v3/users/f292f8174a7a4de5bf8a848e49f85dbe => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:53.661623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef1988-04df-450a-9e41-05d23c9914a2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:53.662062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef1988-04df-450a-9e41-05d23c9914a2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:53.662189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef1988-04df-450a-9e41-05d23c9914a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:53.701545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9bef1988-04df-450a-9e41-05d23c9914a2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:53.703049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9bef1988-04df-450a-9e41-05d23c9914a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:53.792453 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3952/8000] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:53.803548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62955206-6808-493f-bd51-6e8e97c225f5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:53.804981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-62955206-6808-493f-bd51-6e8e97c225f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:53.912710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62955206-6808-493f-bd51-6e8e97c225f5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:53.916868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809e2ce-e40f-4d61-baa5-7f6a6bff935f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:53.917789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809e2ce-e40f-4d61-baa5-7f6a6bff935f service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:53.918173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809e2ce-e40f-4d61-baa5-7f6a6bff935f service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:53.918582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809e2ce-e40f-4d61-baa5-7f6a6bff935f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:53.929132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809e2ce-e40f-4d61-baa5-7f6a6bff935f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:53.939734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809e2ce-e40f-4d61-baa5-7f6a6bff935f service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:53.953936 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4049/8001] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:17:54.310758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef1988-04df-450a-9e41-05d23c9914a2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:54.312264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9bef1988-04df-450a-9e41-05d23c9914a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:54.343475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef1988-04df-450a-9e41-05d23c9914a2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:54.349636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b2425-6475-4d19-826f-5853f1259af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:54.350864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b2425-6475-4d19-826f-5853f1259af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:54.351368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b2425-6475-4d19-826f-5853f1259af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:54.351859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b2425-6475-4d19-826f-5853f1259af1 admin admin] PATH_INFO: `/v3/projects/71c859bfcff54b5c85e6cb248341f37c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:54.353869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b2425-6475-4d19-826f-5853f1259af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c859bfcff54b5c85e6cb248341f37c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:54.356237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b2425-6475-4d19-826f-5853f1259af1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:54.424268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e68b2425-6475-4d19-826f-5853f1259af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c859bfcff54b5c85e6cb248341f37c', 'request_id': 'req-e68b2425-6475-4d19-826f-5853f1259af1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:54.435677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e68b2425-6475-4d19-826f-5853f1259af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c859bfcff54b5c85e6cb248341f37c', 'request_id': 'req-e68b2425-6475-4d19-826f-5853f1259af1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:54.444570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e68b2425-6475-4d19-826f-5853f1259af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c859bfcff54b5c85e6cb248341f37c', 'request_id': 'req-e68b2425-6475-4d19-826f-5853f1259af1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:54.470466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e68b2425-6475-4d19-826f-5853f1259af1 admin admin] The token cache is being invalidate because project 71c859bfcff54b5c85e6cb248341f37c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:17:54.470954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e68b2425-6475-4d19-826f-5853f1259af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:54.472032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e68b2425-6475-4d19-826f-5853f1259af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:54.475342 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3953/8002] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:17:54 2021] DELETE /identity/v3/projects/71c859bfcff54b5c85e6cb248341f37c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:54.479467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809e2ce-e40f-4d61-baa5-7f6a6bff935f service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:54.494869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809e2ce-e40f-4d61-baa5-7f6a6bff935f service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:54.574954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66014c3e-b8d3-4a22-a206-fc719105d444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:54.575862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66014c3e-b8d3-4a22-a206-fc719105d444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:54.576144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66014c3e-b8d3-4a22-a206-fc719105d444 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:54.576422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66014c3e-b8d3-4a22-a206-fc719105d444 admin admin] PATH_INFO: `/v3/users/0532fa2fbc544ce09628c91a9b834a05` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:54.579054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66014c3e-b8d3-4a22-a206-fc719105d444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0532fa2fbc544ce09628c91a9b834a05)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:54.581208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66014c3e-b8d3-4a22-a206-fc719105d444 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:54.654176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-66014c3e-b8d3-4a22-a206-fc719105d444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0532fa2fbc544ce09628c91a9b834a05'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:54.662745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-66014c3e-b8d3-4a22-a206-fc719105d444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0532fa2fbc544ce09628c91a9b834a05'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:54.663501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-66014c3e-b8d3-4a22-a206-fc719105d444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0532fa2fbc544ce09628c91a9b834a05'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:54.680280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-66014c3e-b8d3-4a22-a206-fc719105d444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0532fa2fbc544ce09628c91a9b834a05'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:54.692740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-66014c3e-b8d3-4a22-a206-fc719105d444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0532fa2fbc544ce09628c91a9b834a05'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:54.703066 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4050/8003] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:17:54 2021] DELETE /identity/v3/users/0532fa2fbc544ce09628c91a9b834a05 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:17:55.063818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b2425-6475-4d19-826f-5853f1259af1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:55.066206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e68b2425-6475-4d19-826f-5853f1259af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:55.096133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b2425-6475-4d19-826f-5853f1259af1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:55.200692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4be98f-1133-4ca5-96ce-eeeef3e2abf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:55.202053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4be98f-1133-4ca5-96ce-eeeef3e2abf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:55.202607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4be98f-1133-4ca5-96ce-eeeef3e2abf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:55.203113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4be98f-1133-4ca5-96ce-eeeef3e2abf2 admin admin] PATH_INFO: `/v3/projects/d534e25782c045aeb336ae118921c450` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:55.204856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4be98f-1133-4ca5-96ce-eeeef3e2abf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d534e25782c045aeb336ae118921c450)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:55.207661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4be98f-1133-4ca5-96ce-eeeef3e2abf2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:55.327902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0c4be98f-1133-4ca5-96ce-eeeef3e2abf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd534e25782c045aeb336ae118921c450', 'request_id': 'req-0c4be98f-1133-4ca5-96ce-eeeef3e2abf2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:55.338052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0c4be98f-1133-4ca5-96ce-eeeef3e2abf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd534e25782c045aeb336ae118921c450', 'request_id': 'req-0c4be98f-1133-4ca5-96ce-eeeef3e2abf2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:55.347760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0c4be98f-1133-4ca5-96ce-eeeef3e2abf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd534e25782c045aeb336ae118921c450', 'request_id': 'req-0c4be98f-1133-4ca5-96ce-eeeef3e2abf2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:55.371744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0c4be98f-1133-4ca5-96ce-eeeef3e2abf2 admin admin] The token cache is being invalidate because project d534e25782c045aeb336ae118921c450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:17:55.372035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0c4be98f-1133-4ca5-96ce-eeeef3e2abf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:55.372791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0c4be98f-1133-4ca5-96ce-eeeef3e2abf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:55.386275 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3954/8004] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:17:55 2021] DELETE /identity/v3/projects/d534e25782c045aeb336ae118921c450 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:58.615418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66014c3e-b8d3-4a22-a206-fc719105d444 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:58.617023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-66014c3e-b8d3-4a22-a206-fc719105d444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:58.630585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66014c3e-b8d3-4a22-a206-fc719105d444 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:58.708173 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00041fcc-6500-4e6b-8279-143e58aceed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:58.709291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00041fcc-6500-4e6b-8279-143e58aceed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:58.709796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00041fcc-6500-4e6b-8279-143e58aceed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:58.710290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00041fcc-6500-4e6b-8279-143e58aceed9 admin admin] PATH_INFO: `/v3/users/b8222216d1c840c0bab85cb4e881d8fb` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:58.716785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00041fcc-6500-4e6b-8279-143e58aceed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8222216d1c840c0bab85cb4e881d8fb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:58.720723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00041fcc-6500-4e6b-8279-143e58aceed9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:58.812396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-00041fcc-6500-4e6b-8279-143e58aceed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8222216d1c840c0bab85cb4e881d8fb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:58.820364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-00041fcc-6500-4e6b-8279-143e58aceed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8222216d1c840c0bab85cb4e881d8fb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:58.821382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-00041fcc-6500-4e6b-8279-143e58aceed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8222216d1c840c0bab85cb4e881d8fb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:58.837356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-00041fcc-6500-4e6b-8279-143e58aceed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8222216d1c840c0bab85cb4e881d8fb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:58.847003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-00041fcc-6500-4e6b-8279-143e58aceed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8222216d1c840c0bab85cb4e881d8fb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:58.853501 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4051/8005] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:17:58 2021] DELETE /identity/v3/users/b8222216d1c840c0bab85cb4e881d8fb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:17:58.858130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f158a-2cc4-4f93-8e9c-761a61c252d3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:58.858654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f158a-2cc4-4f93-8e9c-761a61c252d3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:58.858755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f158a-2cc4-4f93-8e9c-761a61c252d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:58.876778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-924f158a-2cc4-4f93-8e9c-761a61c252d3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:58.877886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-924f158a-2cc4-4f93-8e9c-761a61c252d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:58.937828 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3955/8006] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:58.948153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00041fcc-6500-4e6b-8279-143e58aceed9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:58.949625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-00041fcc-6500-4e6b-8279-143e58aceed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:59.008879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00041fcc-6500-4e6b-8279-143e58aceed9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:59.012717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885ddff-ff7d-482d-b184-34d52ff07481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:59.013367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885ddff-ff7d-482d-b184-34d52ff07481 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:59.013687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885ddff-ff7d-482d-b184-34d52ff07481 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:59.013971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885ddff-ff7d-482d-b184-34d52ff07481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:59.025021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885ddff-ff7d-482d-b184-34d52ff07481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:59.026619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885ddff-ff7d-482d-b184-34d52ff07481 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:59.036744 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4052/8007] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:17:59.210245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f158a-2cc4-4f93-8e9c-761a61c252d3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:59.211846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-924f158a-2cc4-4f93-8e9c-761a61c252d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:59.225836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f158a-2cc4-4f93-8e9c-761a61c252d3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:59.230786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a386648-877c-47cf-a20b-d187b1027cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:59.231824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a386648-877c-47cf-a20b-d187b1027cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:59.232049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a386648-877c-47cf-a20b-d187b1027cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:59.232334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a386648-877c-47cf-a20b-d187b1027cc2 admin admin] PATH_INFO: `/v3/projects/bf44039972604cd18c79369576ca9691` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:59.233536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a386648-877c-47cf-a20b-d187b1027cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf44039972604cd18c79369576ca9691)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:59.235719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a386648-877c-47cf-a20b-d187b1027cc2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:59.288056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0a386648-877c-47cf-a20b-d187b1027cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf44039972604cd18c79369576ca9691', 'request_id': 'req-0a386648-877c-47cf-a20b-d187b1027cc2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:59.294488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0a386648-877c-47cf-a20b-d187b1027cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf44039972604cd18c79369576ca9691', 'request_id': 'req-0a386648-877c-47cf-a20b-d187b1027cc2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:59.300998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0a386648-877c-47cf-a20b-d187b1027cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf44039972604cd18c79369576ca9691', 'request_id': 'req-0a386648-877c-47cf-a20b-d187b1027cc2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:59.317569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0a386648-877c-47cf-a20b-d187b1027cc2 admin admin] The token cache is being invalidate because project bf44039972604cd18c79369576ca9691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:17:59.317896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0a386648-877c-47cf-a20b-d187b1027cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:59.318572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0a386648-877c-47cf-a20b-d187b1027cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:17:59.320182 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3956/8008] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:17:59 2021] DELETE /identity/v3/projects/bf44039972604cd18c79369576ca9691 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:59.325991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d07b9-5e65-4b9d-86be-42b7d65a8006 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:59.326314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d07b9-5e65-4b9d-86be-42b7d65a8006 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:59.327222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d07b9-5e65-4b9d-86be-42b7d65a8006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:59.345253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fc3d07b9-5e65-4b9d-86be-42b7d65a8006 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:59.346740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fc3d07b9-5e65-4b9d-86be-42b7d65a8006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:59.415237 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4053/8009] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:59.423720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f36edc-28ca-4f0c-b925-68c4909e70e8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:59.424013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f36edc-28ca-4f0c-b925-68c4909e70e8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:59.424293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f36edc-28ca-4f0c-b925-68c4909e70e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:59.444285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-04f36edc-28ca-4f0c-b925-68c4909e70e8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:59.445536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-04f36edc-28ca-4f0c-b925-68c4909e70e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:59.453786 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3957/8010] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:59.458202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d07b9-5e65-4b9d-86be-42b7d65a8006 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:59.468935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d07b9-5e65-4b9d-86be-42b7d65a8006 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:59.476593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f67fea-92e6-40cc-810f-ff6d073da7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:59.477293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f67fea-92e6-40cc-810f-ff6d073da7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:59.477579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f67fea-92e6-40cc-810f-ff6d073da7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:59.477859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f67fea-92e6-40cc-810f-ff6d073da7e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:59.478640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f67fea-92e6-40cc-810f-ff6d073da7e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:17:59.478948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f67fea-92e6-40cc-810f-ff6d073da7e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:59.480549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f67fea-92e6-40cc-810f-ff6d073da7e3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:59.496442 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4054/8011] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:17:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:17:59.497495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f36edc-28ca-4f0c-b925-68c4909e70e8 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:59.507688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f36edc-28ca-4f0c-b925-68c4909e70e8 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:59.512379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff24192-70e8-4440-94a1-810647dd12ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:59.513032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff24192-70e8-4440-94a1-810647dd12ce admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:59.513316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff24192-70e8-4440-94a1-810647dd12ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:59.513589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff24192-70e8-4440-94a1-810647dd12ce admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:59.514324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff24192-70e8-4440-94a1-810647dd12ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:59.516220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff24192-70e8-4440-94a1-810647dd12ce admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:59.546285 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3958/8012] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:17:59 2021] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:17:59.550382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f67fea-92e6-40cc-810f-ff6d073da7e3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:59.560782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f67fea-92e6-40cc-810f-ff6d073da7e3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:59.616115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46afe8-6844-4b0b-985f-78b0904413e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:59.616796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46afe8-6844-4b0b-985f-78b0904413e2 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:59.617055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46afe8-6844-4b0b-985f-78b0904413e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:59.617335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46afe8-6844-4b0b-985f-78b0904413e2 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:59.618044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46afe8-6844-4b0b-985f-78b0904413e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:59.619991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46afe8-6844-4b0b-985f-78b0904413e2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:59.644393 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4055/8013] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:17:59 2021] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:17:59.645656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff24192-70e8-4440-94a1-810647dd12ce admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:59.655925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff24192-70e8-4440-94a1-810647dd12ce admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:59.660674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbb085-8fff-4eeb-a672-00b9192d39e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:59.661339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbb085-8fff-4eeb-a672-00b9192d39e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:59.661630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbb085-8fff-4eeb-a672-00b9192d39e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:59.661949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbb085-8fff-4eeb-a672-00b9192d39e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:59.662797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbb085-8fff-4eeb-a672-00b9192d39e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:59.664514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbb085-8fff-4eeb-a672-00b9192d39e7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:59.676343 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3959/8014] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:17:59.680353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46afe8-6844-4b0b-985f-78b0904413e2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:59.691640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46afe8-6844-4b0b-985f-78b0904413e2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:59.696357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f453ec-c58b-49c3-a196-d6895d34a764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:59.697014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f453ec-c58b-49c3-a196-d6895d34a764 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:59.697303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f453ec-c58b-49c3-a196-d6895d34a764 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:59.697586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f453ec-c58b-49c3-a196-d6895d34a764 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:59.698356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f453ec-c58b-49c3-a196-d6895d34a764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:59.699953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f453ec-c58b-49c3-a196-d6895d34a764 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:59.710909 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4056/8015] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:17:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:17:59.721273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbb085-8fff-4eeb-a672-00b9192d39e7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:59.732234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbb085-8fff-4eeb-a672-00b9192d39e7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:59.737709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b069a7-78d2-4fb8-9a90-6a5be310f596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:59.738716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b069a7-78d2-4fb8-9a90-6a5be310f596 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:59.738928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b069a7-78d2-4fb8-9a90-6a5be310f596 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:59.739211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b069a7-78d2-4fb8-9a90-6a5be310f596 admin admin] PATH_INFO: `/v3/projects/09b19140c9514e14bb529e04e1bb699b/users/65b1368bab5a400a8af6459c91778e56/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:59.759530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b069a7-78d2-4fb8-9a90-6a5be310f596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b19140c9514e14bb529e04e1bb699b, user_id=65b1368bab5a400a8af6459c91778e56, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:59.762421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b069a7-78d2-4fb8-9a90-6a5be310f596 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:59.776284 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3960/8016] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:17:59 2021] PUT /identity/v3/projects/09b19140c9514e14bb529e04e1bb699b/users/65b1368bab5a400a8af6459c91778e56/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:17:59.787690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0020c-b734-4e10-a6f2-d5c2ba3c902d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:59.787982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0020c-b734-4e10-a6f2-d5c2ba3c902d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:59.788257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0020c-b734-4e10-a6f2-d5c2ba3c902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:59.815494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b6e0020c-b734-4e10-a6f2-d5c2ba3c902d None None] MFA Rules not processed for user `65b1368bab5a400a8af6459c91778e56`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:17:59.817031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b6e0020c-b734-4e10-a6f2-d5c2ba3c902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:59.883427 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4057/8017] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:17:59 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:17:59.893945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b069a7-78d2-4fb8-9a90-6a5be310f596 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:17:59.895747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-92b069a7-78d2-4fb8-9a90-6a5be310f596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:17:59.955010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b069a7-78d2-4fb8-9a90-6a5be310f596 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:17:59.961228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d81fa-76b1-4495-83d2-60b29b98bb5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:17:59.961914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d81fa-76b1-4495-83d2-60b29b98bb5e service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:17:59.962228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d81fa-76b1-4495-83d2-60b29b98bb5e service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:17:59.962613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d81fa-76b1-4495-83d2-60b29b98bb5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:17:59.972192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d81fa-76b1-4495-83d2-60b29b98bb5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:17:59.973641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d81fa-76b1-4495-83d2-60b29b98bb5e service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:17:59.983985 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3961/8018] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:17:59 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:00.295419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0020c-b734-4e10-a6f2-d5c2ba3c902d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:00.297037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b6e0020c-b734-4e10-a6f2-d5c2ba3c902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:00.364876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0020c-b734-4e10-a6f2-d5c2ba3c902d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:00.369512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c488c31-7e4f-430e-a4b9-ab6a905da1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:00.370423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c488c31-7e4f-430e-a4b9-ab6a905da1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:00.370717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c488c31-7e4f-430e-a4b9-ab6a905da1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:00.371019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c488c31-7e4f-430e-a4b9-ab6a905da1f2 admin admin] PATH_INFO: `/v3/users/b1270c44012447e9b1464248496343aa` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:00.372234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c488c31-7e4f-430e-a4b9-ab6a905da1f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1270c44012447e9b1464248496343aa)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:00.374461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c488c31-7e4f-430e-a4b9-ab6a905da1f2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:00.424360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3c488c31-7e4f-430e-a4b9-ab6a905da1f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1270c44012447e9b1464248496343aa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:00.432760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3c488c31-7e4f-430e-a4b9-ab6a905da1f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1270c44012447e9b1464248496343aa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:00.433487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3c488c31-7e4f-430e-a4b9-ab6a905da1f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1270c44012447e9b1464248496343aa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:00.447083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3c488c31-7e4f-430e-a4b9-ab6a905da1f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1270c44012447e9b1464248496343aa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:00.455387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3c488c31-7e4f-430e-a4b9-ab6a905da1f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1270c44012447e9b1464248496343aa'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:00.462484 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4058/8019] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:00 2021] DELETE /identity/v3/users/b1270c44012447e9b1464248496343aa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:00.467167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62d8ce-5ade-4afd-ab05-375587fc50fa None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:00.467277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62d8ce-5ade-4afd-ab05-375587fc50fa None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:00.467516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62d8ce-5ade-4afd-ab05-375587fc50fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:00.485026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3d62d8ce-5ade-4afd-ab05-375587fc50fa None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:00.486395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3d62d8ce-5ade-4afd-ab05-375587fc50fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:00.548241 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3962/8020] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:00.560486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c488c31-7e4f-430e-a4b9-ab6a905da1f2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:00.562494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3c488c31-7e4f-430e-a4b9-ab6a905da1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:00.631637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c488c31-7e4f-430e-a4b9-ab6a905da1f2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:00.637354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf6743-2ed8-49f0-be63-96c9d3992d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:00.638041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf6743-2ed8-49f0-be63-96c9d3992d48 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:00.638437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf6743-2ed8-49f0-be63-96c9d3992d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:00.638725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf6743-2ed8-49f0-be63-96c9d3992d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:00.649716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf6743-2ed8-49f0-be63-96c9d3992d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:00.651235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf6743-2ed8-49f0-be63-96c9d3992d48 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:00.662435 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4059/8021] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:00.833099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62d8ce-5ade-4afd-ab05-375587fc50fa None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:00.834883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3d62d8ce-5ade-4afd-ab05-375587fc50fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:00.862782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62d8ce-5ade-4afd-ab05-375587fc50fa None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:00.869373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff510dcb-0e8b-4d15-96fe-0a02865ee130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:00.870238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff510dcb-0e8b-4d15-96fe-0a02865ee130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:00.870557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff510dcb-0e8b-4d15-96fe-0a02865ee130 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:00.870833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff510dcb-0e8b-4d15-96fe-0a02865ee130 admin admin] PATH_INFO: `/v3/projects/d9e18d3726ec4e2fa7cd9e732f9eaa3f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:00.872052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff510dcb-0e8b-4d15-96fe-0a02865ee130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e18d3726ec4e2fa7cd9e732f9eaa3f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:00.874550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff510dcb-0e8b-4d15-96fe-0a02865ee130 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:00.920710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ff510dcb-0e8b-4d15-96fe-0a02865ee130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e18d3726ec4e2fa7cd9e732f9eaa3f', 'request_id': 'req-ff510dcb-0e8b-4d15-96fe-0a02865ee130'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:00.926683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ff510dcb-0e8b-4d15-96fe-0a02865ee130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e18d3726ec4e2fa7cd9e732f9eaa3f', 'request_id': 'req-ff510dcb-0e8b-4d15-96fe-0a02865ee130'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:00.931852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ff510dcb-0e8b-4d15-96fe-0a02865ee130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e18d3726ec4e2fa7cd9e732f9eaa3f', 'request_id': 'req-ff510dcb-0e8b-4d15-96fe-0a02865ee130'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:00.944665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ff510dcb-0e8b-4d15-96fe-0a02865ee130 admin admin] The token cache is being invalidate because project d9e18d3726ec4e2fa7cd9e732f9eaa3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:00.944967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ff510dcb-0e8b-4d15-96fe-0a02865ee130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:00.945731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ff510dcb-0e8b-4d15-96fe-0a02865ee130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:00.947300 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3963/8022] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:00 2021] DELETE /identity/v3/projects/d9e18d3726ec4e2fa7cd9e732f9eaa3f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:00.953087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3948c-26fe-49ef-ace4-138370363be2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:00.953437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3948c-26fe-49ef-ace4-138370363be2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:00.953773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3948c-26fe-49ef-ace4-138370363be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:00.972059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8dc3948c-26fe-49ef-ace4-138370363be2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:00.973323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8dc3948c-26fe-49ef-ace4-138370363be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:01.031917 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4060/8023] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:01.040009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f44ad-6590-4c16-8f8f-1c3e32e26848 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:01.040620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f44ad-6590-4c16-8f8f-1c3e32e26848 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:01.041142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f44ad-6590-4c16-8f8f-1c3e32e26848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:01.064532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f30f44ad-6590-4c16-8f8f-1c3e32e26848 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:01.068724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f30f44ad-6590-4c16-8f8f-1c3e32e26848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:01.079362 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3964/8024] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:18:01.083987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3948c-26fe-49ef-ace4-138370363be2 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:01.095600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3948c-26fe-49ef-ace4-138370363be2 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:01.101066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92365be8-893b-40a0-b3de-28d29a829238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:01.101835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92365be8-893b-40a0-b3de-28d29a829238 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:01.102180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92365be8-893b-40a0-b3de-28d29a829238 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:01.102473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92365be8-893b-40a0-b3de-28d29a829238 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:01.103469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92365be8-893b-40a0-b3de-28d29a829238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:18:01.103767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92365be8-893b-40a0-b3de-28d29a829238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:01.105637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92365be8-893b-40a0-b3de-28d29a829238 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:01.117835 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4061/8025] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:18:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:18:01.122328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f44ad-6590-4c16-8f8f-1c3e32e26848 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:01.132353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f44ad-6590-4c16-8f8f-1c3e32e26848 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:01.137086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23549b2d-640e-4d0c-aa35-2d0f6556a385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:01.137758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23549b2d-640e-4d0c-aa35-2d0f6556a385 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:01.138049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23549b2d-640e-4d0c-aa35-2d0f6556a385 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:01.138375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23549b2d-640e-4d0c-aa35-2d0f6556a385 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:01.139096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23549b2d-640e-4d0c-aa35-2d0f6556a385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:01.141000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23549b2d-640e-4d0c-aa35-2d0f6556a385 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:01.168960 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3965/8026] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:01 2021] POST /identity/v3/projects => generated 359 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:01.170055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92365be8-893b-40a0-b3de-28d29a829238 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:01.180435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92365be8-893b-40a0-b3de-28d29a829238 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:01.236584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a430a6-6921-478d-b06d-86e5d86fe542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:01.237246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a430a6-6921-478d-b06d-86e5d86fe542 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:01.237532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a430a6-6921-478d-b06d-86e5d86fe542 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:01.237812 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a430a6-6921-478d-b06d-86e5d86fe542 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:01.238531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a430a6-6921-478d-b06d-86e5d86fe542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:01.240443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a430a6-6921-478d-b06d-86e5d86fe542 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:01.262775 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4062/8027] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:01 2021] POST /identity/v3/users => generated 280 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:01.264053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23549b2d-640e-4d0c-aa35-2d0f6556a385 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:01.274142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23549b2d-640e-4d0c-aa35-2d0f6556a385 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:01.278813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a5878-5911-47e8-94c3-bfabb7a562ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:01.279477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a5878-5911-47e8-94c3-bfabb7a562ff admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:01.280294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a5878-5911-47e8-94c3-bfabb7a562ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:01.280579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a5878-5911-47e8-94c3-bfabb7a562ff admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:01.281317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a5878-5911-47e8-94c3-bfabb7a562ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:01.282933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a5878-5911-47e8-94c3-bfabb7a562ff admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:01.296426 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3966/8028] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:01 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:01.297574 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a430a6-6921-478d-b06d-86e5d86fe542 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:01.307507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a430a6-6921-478d-b06d-86e5d86fe542 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:01.312281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041224c-9831-4c93-85b1-15dc57fb2750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:01.314296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041224c-9831-4c93-85b1-15dc57fb2750 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:01.314584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041224c-9831-4c93-85b1-15dc57fb2750 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:01.316667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041224c-9831-4c93-85b1-15dc57fb2750 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:01.317412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041224c-9831-4c93-85b1-15dc57fb2750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:01.320249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041224c-9831-4c93-85b1-15dc57fb2750 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:01.330469 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4063/8029] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:01 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:01.334509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a5878-5911-47e8-94c3-bfabb7a562ff admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:01.345077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a5878-5911-47e8-94c3-bfabb7a562ff admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:01.350049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfd33f-4944-49f9-a54a-b8b3996f80ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:01.350967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfd33f-4944-49f9-a54a-b8b3996f80ba admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:01.351251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfd33f-4944-49f9-a54a-b8b3996f80ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:01.351528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfd33f-4944-49f9-a54a-b8b3996f80ba admin admin] PATH_INFO: `/v3/projects/f2ea2e6cbb0547da9fe0ab7eb756a176/users/a00ad5da78d64ce1bd002de1a47beab0/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:01.366369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfd33f-4944-49f9-a54a-b8b3996f80ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ea2e6cbb0547da9fe0ab7eb756a176, user_id=a00ad5da78d64ce1bd002de1a47beab0, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:01.369619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfd33f-4944-49f9-a54a-b8b3996f80ba admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:01.381876 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3967/8030] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:01 2021] PUT /identity/v3/projects/f2ea2e6cbb0547da9fe0ab7eb756a176/users/a00ad5da78d64ce1bd002de1a47beab0/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:01.393140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9126846-30a2-45cd-843d-6cd9ed3ebb0c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:01.393467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9126846-30a2-45cd-843d-6cd9ed3ebb0c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:01.393751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9126846-30a2-45cd-843d-6cd9ed3ebb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:01.421669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b9126846-30a2-45cd-843d-6cd9ed3ebb0c None None] MFA Rules not processed for user `a00ad5da78d64ce1bd002de1a47beab0`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:01.423141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b9126846-30a2-45cd-843d-6cd9ed3ebb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:01.484886 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4064/8031] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:01 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:01.495401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfd33f-4944-49f9-a54a-b8b3996f80ba admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:01.497170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e5cfd33f-4944-49f9-a54a-b8b3996f80ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:01.554871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfd33f-4944-49f9-a54a-b8b3996f80ba admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:01.558536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda856f-3d6d-4a46-87cf-215025b3c70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:01.559179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda856f-3d6d-4a46-87cf-215025b3c70f service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:01.559470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda856f-3d6d-4a46-87cf-215025b3c70f service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:01.559753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda856f-3d6d-4a46-87cf-215025b3c70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:01.568265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda856f-3d6d-4a46-87cf-215025b3c70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:01.569719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda856f-3d6d-4a46-87cf-215025b3c70f service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:01.579158 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3968/8032] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:01 2021] GET /identity/v3/auth/tokens => generated 3226 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:18:10.436670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9126846-30a2-45cd-843d-6cd9ed3ebb0c None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:10.507507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9126846-30a2-45cd-843d-6cd9ed3ebb0c None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:10.512087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612aca7-dfe7-4e34-951e-bb4e752bafe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:10.512954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612aca7-dfe7-4e34-951e-bb4e752bafe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:10.513235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612aca7-dfe7-4e34-951e-bb4e752bafe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:10.513508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612aca7-dfe7-4e34-951e-bb4e752bafe3 admin admin] PATH_INFO: `/v3/users/a00ad5da78d64ce1bd002de1a47beab0` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:10.515305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612aca7-dfe7-4e34-951e-bb4e752bafe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a00ad5da78d64ce1bd002de1a47beab0)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:10.517230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612aca7-dfe7-4e34-951e-bb4e752bafe3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:10.562769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c612aca7-dfe7-4e34-951e-bb4e752bafe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a00ad5da78d64ce1bd002de1a47beab0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:10.570069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c612aca7-dfe7-4e34-951e-bb4e752bafe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a00ad5da78d64ce1bd002de1a47beab0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:10.570796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c612aca7-dfe7-4e34-951e-bb4e752bafe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a00ad5da78d64ce1bd002de1a47beab0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:10.583433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c612aca7-dfe7-4e34-951e-bb4e752bafe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a00ad5da78d64ce1bd002de1a47beab0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:10.591238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c612aca7-dfe7-4e34-951e-bb4e752bafe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a00ad5da78d64ce1bd002de1a47beab0'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:10.598296 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4065/8033] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:10 2021] DELETE /identity/v3/users/a00ad5da78d64ce1bd002de1a47beab0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:10.603272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd58fbc-4c1c-4571-a7db-414932913957 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:10.603771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd58fbc-4c1c-4571-a7db-414932913957 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:10.604279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd58fbc-4c1c-4571-a7db-414932913957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:10.624078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6cd58fbc-4c1c-4571-a7db-414932913957 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:10.625578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6cd58fbc-4c1c-4571-a7db-414932913957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:10.729333 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3969/8034] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:10.763731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612aca7-dfe7-4e34-951e-bb4e752bafe3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:10.765309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c612aca7-dfe7-4e34-951e-bb4e752bafe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:10.839424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612aca7-dfe7-4e34-951e-bb4e752bafe3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:10.843654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f85ea-7ef8-429f-b48b-6ff14f29e1be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:10.844026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f85ea-7ef8-429f-b48b-6ff14f29e1be service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:10.844381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f85ea-7ef8-429f-b48b-6ff14f29e1be service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:10.844690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f85ea-7ef8-429f-b48b-6ff14f29e1be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:10.861758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f85ea-7ef8-429f-b48b-6ff14f29e1be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:10.863090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f85ea-7ef8-429f-b48b-6ff14f29e1be service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:10.881824 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4066/8035] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:11.119734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd58fbc-4c1c-4571-a7db-414932913957 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:11.121739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6cd58fbc-4c1c-4571-a7db-414932913957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:11.139697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd58fbc-4c1c-4571-a7db-414932913957 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:11.144540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001f84a-b72a-4769-8f78-0094cfdaa60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:11.146043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001f84a-b72a-4769-8f78-0094cfdaa60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:11.146363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001f84a-b72a-4769-8f78-0094cfdaa60a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:11.146798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001f84a-b72a-4769-8f78-0094cfdaa60a admin admin] PATH_INFO: `/v3/projects/f2ea2e6cbb0547da9fe0ab7eb756a176` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:11.152836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001f84a-b72a-4769-8f78-0094cfdaa60a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ea2e6cbb0547da9fe0ab7eb756a176)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:11.155157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001f84a-b72a-4769-8f78-0094cfdaa60a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:11.220415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5001f84a-b72a-4769-8f78-0094cfdaa60a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ea2e6cbb0547da9fe0ab7eb756a176', 'request_id': 'req-5001f84a-b72a-4769-8f78-0094cfdaa60a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:11.227119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5001f84a-b72a-4769-8f78-0094cfdaa60a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ea2e6cbb0547da9fe0ab7eb756a176', 'request_id': 'req-5001f84a-b72a-4769-8f78-0094cfdaa60a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:11.232773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5001f84a-b72a-4769-8f78-0094cfdaa60a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ea2e6cbb0547da9fe0ab7eb756a176', 'request_id': 'req-5001f84a-b72a-4769-8f78-0094cfdaa60a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:11.250855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5001f84a-b72a-4769-8f78-0094cfdaa60a admin admin] The token cache is being invalidate because project f2ea2e6cbb0547da9fe0ab7eb756a176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:11.251377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5001f84a-b72a-4769-8f78-0094cfdaa60a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:11.252020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5001f84a-b72a-4769-8f78-0094cfdaa60a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:11.253810 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3970/8036] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:11 2021] DELETE /identity/v3/projects/f2ea2e6cbb0547da9fe0ab7eb756a176 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:11.259668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a8c29-133a-4ceb-b338-da307066afcd None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:11.259960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a8c29-133a-4ceb-b338-da307066afcd None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:11.260242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a8c29-133a-4ceb-b338-da307066afcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:11.279711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-514a8c29-133a-4ceb-b338-da307066afcd None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:11.281107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-514a8c29-133a-4ceb-b338-da307066afcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:11.343946 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4067/8037] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:11.351924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58e074-de1d-4c43-8f9f-af2eced1d4c6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:11.352432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58e074-de1d-4c43-8f9f-af2eced1d4c6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:11.352720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58e074-de1d-4c43-8f9f-af2eced1d4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:11.373781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-2c58e074-de1d-4c43-8f9f-af2eced1d4c6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:11.375293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2c58e074-de1d-4c43-8f9f-af2eced1d4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:11.385731 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3971/8038] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:11.390423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a8c29-133a-4ceb-b338-da307066afcd None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:11.401759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a8c29-133a-4ceb-b338-da307066afcd None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:11.406558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe335f-6a40-401c-a762-5b3df80b2dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:11.407159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe335f-6a40-401c-a762-5b3df80b2dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:11.407440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe335f-6a40-401c-a762-5b3df80b2dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:11.407716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe335f-6a40-401c-a762-5b3df80b2dd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:11.408485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe335f-6a40-401c-a762-5b3df80b2dd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:18:11.408792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe335f-6a40-401c-a762-5b3df80b2dd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:11.410422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe335f-6a40-401c-a762-5b3df80b2dd0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:11.426478 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4068/8039] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:18:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:18:11.439187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58e074-de1d-4c43-8f9f-af2eced1d4c6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:11.448921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58e074-de1d-4c43-8f9f-af2eced1d4c6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:11.453791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314fcb3-1e43-4116-bed8-8e32a31352c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:11.454554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314fcb3-1e43-4116-bed8-8e32a31352c8 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:11.454845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314fcb3-1e43-4116-bed8-8e32a31352c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:11.455125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314fcb3-1e43-4116-bed8-8e32a31352c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:11.455858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314fcb3-1e43-4116-bed8-8e32a31352c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:11.457743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314fcb3-1e43-4116-bed8-8e32a31352c8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:11.487512 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3972/8040] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:11 2021] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:11.488935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe335f-6a40-401c-a762-5b3df80b2dd0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:11.500364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe335f-6a40-401c-a762-5b3df80b2dd0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:11.570957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf342bc0-f5a4-4922-8667-c60c291bbcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:11.574140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf342bc0-f5a4-4922-8667-c60c291bbcaa admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:11.575433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf342bc0-f5a4-4922-8667-c60c291bbcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:11.575984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf342bc0-f5a4-4922-8667-c60c291bbcaa admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:11.577539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf342bc0-f5a4-4922-8667-c60c291bbcaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:11.580423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf342bc0-f5a4-4922-8667-c60c291bbcaa admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:11.626216 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4069/8041] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:11 2021] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:11.630452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314fcb3-1e43-4116-bed8-8e32a31352c8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:11.645551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314fcb3-1e43-4116-bed8-8e32a31352c8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:11.651097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665a283-e127-4432-a628-a6c3b8c8524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:11.651994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665a283-e127-4432-a628-a6c3b8c8524f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:11.652361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665a283-e127-4432-a628-a6c3b8c8524f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:11.652770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665a283-e127-4432-a628-a6c3b8c8524f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:11.654634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665a283-e127-4432-a628-a6c3b8c8524f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:11.656503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665a283-e127-4432-a628-a6c3b8c8524f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:11.687548 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3973/8042] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:11 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:11.691483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf342bc0-f5a4-4922-8667-c60c291bbcaa admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:11.720977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf342bc0-f5a4-4922-8667-c60c291bbcaa admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:11.731946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d442c2a-cfdc-47bf-84be-ba99cbe49098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:11.731946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d442c2a-cfdc-47bf-84be-ba99cbe49098 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:11.733100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d442c2a-cfdc-47bf-84be-ba99cbe49098 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:11.738429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d442c2a-cfdc-47bf-84be-ba99cbe49098 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:11.739421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d442c2a-cfdc-47bf-84be-ba99cbe49098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:11.745180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d442c2a-cfdc-47bf-84be-ba99cbe49098 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:11.782738 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4070/8043] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:11 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:18:11.787091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665a283-e127-4432-a628-a6c3b8c8524f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:11.802514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665a283-e127-4432-a628-a6c3b8c8524f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:11.816285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f600b-cc62-43d5-84cf-76ec4c0f75a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:11.817254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f600b-cc62-43d5-84cf-76ec4c0f75a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:11.817777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f600b-cc62-43d5-84cf-76ec4c0f75a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:11.818247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f600b-cc62-43d5-84cf-76ec4c0f75a0 admin admin] PATH_INFO: `/v3/projects/8b863c8755284679943e28b082161d06/users/841e5a32e8214bdc895fd7d2af9ee24e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:11.836009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f600b-cc62-43d5-84cf-76ec4c0f75a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b863c8755284679943e28b082161d06, user_id=841e5a32e8214bdc895fd7d2af9ee24e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:11.840066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f600b-cc62-43d5-84cf-76ec4c0f75a0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:11.870612 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3974/8044] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:11 2021] PUT /identity/v3/projects/8b863c8755284679943e28b082161d06/users/841e5a32e8214bdc895fd7d2af9ee24e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:11.885791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761313f-430b-4ba4-b8e8-c553aac53ab1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:11.886106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761313f-430b-4ba4-b8e8-c553aac53ab1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:11.886495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761313f-430b-4ba4-b8e8-c553aac53ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:11.943183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4761313f-430b-4ba4-b8e8-c553aac53ab1 None None] MFA Rules not processed for user `841e5a32e8214bdc895fd7d2af9ee24e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:11.945022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4761313f-430b-4ba4-b8e8-c553aac53ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:12.063668 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4071/8045] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:11 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:12.099329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f600b-cc62-43d5-84cf-76ec4c0f75a0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:12.101405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-523f600b-cc62-43d5-84cf-76ec4c0f75a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:12.224033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f600b-cc62-43d5-84cf-76ec4c0f75a0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:12.231278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33a286-da7e-477f-b221-adc6047a2497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:12.232451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33a286-da7e-477f-b221-adc6047a2497 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:12.232899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33a286-da7e-477f-b221-adc6047a2497 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:12.233338 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33a286-da7e-477f-b221-adc6047a2497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:12.243262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33a286-da7e-477f-b221-adc6047a2497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:12.244987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33a286-da7e-477f-b221-adc6047a2497 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:12.257511 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3975/8046] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:12 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:12.275349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761313f-430b-4ba4-b8e8-c553aac53ab1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:12.378055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761313f-430b-4ba4-b8e8-c553aac53ab1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:12.386224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4b64a-b383-48f3-aab1-2e2380da9182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:12.387291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4b64a-b383-48f3-aab1-2e2380da9182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:12.387672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4b64a-b383-48f3-aab1-2e2380da9182 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:12.388050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4b64a-b383-48f3-aab1-2e2380da9182 admin admin] PATH_INFO: `/v3/users/841e5a32e8214bdc895fd7d2af9ee24e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:12.390775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4b64a-b383-48f3-aab1-2e2380da9182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=841e5a32e8214bdc895fd7d2af9ee24e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:12.393463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4b64a-b383-48f3-aab1-2e2380da9182 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:12.465820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3b4b64a-b383-48f3-aab1-2e2380da9182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '841e5a32e8214bdc895fd7d2af9ee24e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:12.474884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3b4b64a-b383-48f3-aab1-2e2380da9182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '841e5a32e8214bdc895fd7d2af9ee24e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:12.475660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3b4b64a-b383-48f3-aab1-2e2380da9182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '841e5a32e8214bdc895fd7d2af9ee24e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:12.488130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3b4b64a-b383-48f3-aab1-2e2380da9182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '841e5a32e8214bdc895fd7d2af9ee24e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:12.497566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3b4b64a-b383-48f3-aab1-2e2380da9182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '841e5a32e8214bdc895fd7d2af9ee24e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:12.514998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5017a-f34d-4e5a-8a1c-c32f33740ec2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:12.515308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5017a-f34d-4e5a-8a1c-c32f33740ec2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:12.515912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5017a-f34d-4e5a-8a1c-c32f33740ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:12.517651 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4072/8047] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:12 2021] DELETE /identity/v3/users/841e5a32e8214bdc895fd7d2af9ee24e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:12.536416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-cfc5017a-f34d-4e5a-8a1c-c32f33740ec2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:12.537918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cfc5017a-f34d-4e5a-8a1c-c32f33740ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:12.626293 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3976/8048] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:12.639159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4b64a-b383-48f3-aab1-2e2380da9182 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:12.640704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d3b4b64a-b383-48f3-aab1-2e2380da9182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:12.715461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4b64a-b383-48f3-aab1-2e2380da9182 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:12.720787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aca483-b3c6-41ed-adf4-b50355aea531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:12.722099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aca483-b3c6-41ed-adf4-b50355aea531 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:12.722618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aca483-b3c6-41ed-adf4-b50355aea531 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:12.722922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aca483-b3c6-41ed-adf4-b50355aea531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:12.733498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aca483-b3c6-41ed-adf4-b50355aea531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:12.734990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aca483-b3c6-41ed-adf4-b50355aea531 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:12.745557 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4073/8049] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:13.209768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5017a-f34d-4e5a-8a1c-c32f33740ec2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:13.212368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cfc5017a-f34d-4e5a-8a1c-c32f33740ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:13.249422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5017a-f34d-4e5a-8a1c-c32f33740ec2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:13.261356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b9927-d466-4806-a696-ad5594cafda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:13.262274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b9927-d466-4806-a696-ad5594cafda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:13.262580 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b9927-d466-4806-a696-ad5594cafda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:13.262867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b9927-d466-4806-a696-ad5594cafda0 admin admin] PATH_INFO: `/v3/projects/8b863c8755284679943e28b082161d06` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:13.264156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b9927-d466-4806-a696-ad5594cafda0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b863c8755284679943e28b082161d06)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:13.266154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b9927-d466-4806-a696-ad5594cafda0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:13.331919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c70b9927-d466-4806-a696-ad5594cafda0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b863c8755284679943e28b082161d06', 'request_id': 'req-c70b9927-d466-4806-a696-ad5594cafda0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:13.344066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c70b9927-d466-4806-a696-ad5594cafda0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b863c8755284679943e28b082161d06', 'request_id': 'req-c70b9927-d466-4806-a696-ad5594cafda0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:13.350385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c70b9927-d466-4806-a696-ad5594cafda0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b863c8755284679943e28b082161d06', 'request_id': 'req-c70b9927-d466-4806-a696-ad5594cafda0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:13.366961 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c70b9927-d466-4806-a696-ad5594cafda0 admin admin] The token cache is being invalidate because project 8b863c8755284679943e28b082161d06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:13.367549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c70b9927-d466-4806-a696-ad5594cafda0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:13.368200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c70b9927-d466-4806-a696-ad5594cafda0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:13.370286 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3977/8050] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:13 2021] DELETE /identity/v3/projects/8b863c8755284679943e28b082161d06 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:13.375767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f35e40-79b9-4244-a456-afe5eebb9a8e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:13.376336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f35e40-79b9-4244-a456-afe5eebb9a8e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:13.376848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f35e40-79b9-4244-a456-afe5eebb9a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:13.397325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-10f35e40-79b9-4244-a456-afe5eebb9a8e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:13.398733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-10f35e40-79b9-4244-a456-afe5eebb9a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:13.479661 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4074/8051] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:13.480372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92587031-aed6-412d-9944-74158afaa3a8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:13.480672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92587031-aed6-412d-9944-74158afaa3a8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:13.480955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92587031-aed6-412d-9944-74158afaa3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:13.504396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-92587031-aed6-412d-9944-74158afaa3a8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:13.506651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-92587031-aed6-412d-9944-74158afaa3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:13.516547 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3978/8052] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:18:13.520991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f35e40-79b9-4244-a456-afe5eebb9a8e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:13.532569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f35e40-79b9-4244-a456-afe5eebb9a8e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:13.538828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e26ab-012a-42b2-a80d-a77d66524128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:13.539693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e26ab-012a-42b2-a80d-a77d66524128 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:13.540277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e26ab-012a-42b2-a80d-a77d66524128 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:13.540707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e26ab-012a-42b2-a80d-a77d66524128 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:13.541804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e26ab-012a-42b2-a80d-a77d66524128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:18:13.542280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e26ab-012a-42b2-a80d-a77d66524128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:13.545748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e26ab-012a-42b2-a80d-a77d66524128 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:13.574696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92587031-aed6-412d-9944-74158afaa3a8 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:13.575595 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4075/8053] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:18:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:18:13.594131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92587031-aed6-412d-9944-74158afaa3a8 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:13.602763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d831482-077f-42f0-a915-b04a82eb2751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:13.603863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d831482-077f-42f0-a915-b04a82eb2751 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:13.604014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d831482-077f-42f0-a915-b04a82eb2751 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:13.604307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d831482-077f-42f0-a915-b04a82eb2751 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:13.605030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d831482-077f-42f0-a915-b04a82eb2751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:13.610844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d831482-077f-42f0-a915-b04a82eb2751 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:13.658745 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3979/8054] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:13 2021] POST /identity/v3/projects => generated 355 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:13.659951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e26ab-012a-42b2-a80d-a77d66524128 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:13.672214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e26ab-012a-42b2-a80d-a77d66524128 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:13.750058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c55b54-2cae-4dff-b12c-a421c4fb6da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:13.751014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c55b54-2cae-4dff-b12c-a421c4fb6da5 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:13.751944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c55b54-2cae-4dff-b12c-a421c4fb6da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:13.751944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c55b54-2cae-4dff-b12c-a421c4fb6da5 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:13.752659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c55b54-2cae-4dff-b12c-a421c4fb6da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:13.755243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c55b54-2cae-4dff-b12c-a421c4fb6da5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:13.777691 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4076/8055] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:13 2021] POST /identity/v3/users => generated 278 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:13.782031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d831482-077f-42f0-a915-b04a82eb2751 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:13.794087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d831482-077f-42f0-a915-b04a82eb2751 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:13.801505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bf2a4-0eda-419d-af90-9b50d9a2df4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:13.802383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bf2a4-0eda-419d-af90-9b50d9a2df4e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:13.802847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bf2a4-0eda-419d-af90-9b50d9a2df4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:13.803275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bf2a4-0eda-419d-af90-9b50d9a2df4e admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:13.804096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0bf2a4-0eda-419d-af90-9b50d9a2df4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:13.808234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0bf2a4-0eda-419d-af90-9b50d9a2df4e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:13.825755 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3980/8056] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:13 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:13.828169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c55b54-2cae-4dff-b12c-a421c4fb6da5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:13.840094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c55b54-2cae-4dff-b12c-a421c4fb6da5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:13.845751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3e2e1-f0b6-435e-8524-22791ca12bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:13.846340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3e2e1-f0b6-435e-8524-22791ca12bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:13.846670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3e2e1-f0b6-435e-8524-22791ca12bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:13.847098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3e2e1-f0b6-435e-8524-22791ca12bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:13.848017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3e2e1-f0b6-435e-8524-22791ca12bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:13.855616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3e2e1-f0b6-435e-8524-22791ca12bf0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:13.866617 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4077/8057] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:13 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:13.872412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bf2a4-0eda-419d-af90-9b50d9a2df4e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:13.893702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bf2a4-0eda-419d-af90-9b50d9a2df4e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:13.900904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea0d0c-ea74-4289-826d-2378a97607e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:13.901833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea0d0c-ea74-4289-826d-2378a97607e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:13.902119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea0d0c-ea74-4289-826d-2378a97607e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:13.902442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea0d0c-ea74-4289-826d-2378a97607e3 admin admin] PATH_INFO: `/v3/projects/77c414586ca040b6ab572fb952debf9b/users/26b847b1d5f144fbb9c2e95bd76450b6/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:13.921503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea0d0c-ea74-4289-826d-2378a97607e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c414586ca040b6ab572fb952debf9b, user_id=26b847b1d5f144fbb9c2e95bd76450b6, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:13.924172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea0d0c-ea74-4289-826d-2378a97607e3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:13.948902 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3981/8058] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:13 2021] PUT /identity/v3/projects/77c414586ca040b6ab572fb952debf9b/users/26b847b1d5f144fbb9c2e95bd76450b6/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:13.950776 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570d681-6e70-467a-8f67-5792ef47c88a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:13.951734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570d681-6e70-467a-8f67-5792ef47c88a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:13.952576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570d681-6e70-467a-8f67-5792ef47c88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:13.982115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d570d681-6e70-467a-8f67-5792ef47c88a None None] MFA Rules not processed for user `26b847b1d5f144fbb9c2e95bd76450b6`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:13.983509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d570d681-6e70-467a-8f67-5792ef47c88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:14.063506 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4078/8059] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:13 2021] POST /identity/v3/auth/tokens => generated 3222 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:14.068168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea0d0c-ea74-4289-826d-2378a97607e3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:14.149125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea0d0c-ea74-4289-826d-2378a97607e3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:14.159141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d180d-5599-4aba-a6f5-c8a31c6c3352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:14.159906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d180d-5599-4aba-a6f5-c8a31c6c3352 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:14.160203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d180d-5599-4aba-a6f5-c8a31c6c3352 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:14.160535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d180d-5599-4aba-a6f5-c8a31c6c3352 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:14.161264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d180d-5599-4aba-a6f5-c8a31c6c3352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:14.163862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d180d-5599-4aba-a6f5-c8a31c6c3352 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:14.198414 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3982/8060] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:14 2021] POST /identity/v3/projects => generated 357 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:14.203013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570d681-6e70-467a-8f67-5792ef47c88a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:14.216849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570d681-6e70-467a-8f67-5792ef47c88a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:14.285971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ed394-685d-4c89-867c-a36cd74c0d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:14.286944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ed394-685d-4c89-867c-a36cd74c0d79 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:14.287375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ed394-685d-4c89-867c-a36cd74c0d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:14.288053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ed394-685d-4c89-867c-a36cd74c0d79 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:14.288919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ed394-685d-4c89-867c-a36cd74c0d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:14.291073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ed394-685d-4c89-867c-a36cd74c0d79 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:14.318457 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4079/8061] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:14 2021] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:14.321190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d180d-5599-4aba-a6f5-c8a31c6c3352 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:14.332321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d180d-5599-4aba-a6f5-c8a31c6c3352 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:14.337500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097b661-578b-4e91-9a06-461ee63468f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:14.338180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b661-578b-4e91-9a06-461ee63468f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:14.338584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b661-578b-4e91-9a06-461ee63468f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:14.338870 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b661-578b-4e91-9a06-461ee63468f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:14.339612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097b661-578b-4e91-9a06-461ee63468f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:14.341209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097b661-578b-4e91-9a06-461ee63468f6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:14.353359 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3983/8062] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:14.358174 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ed394-685d-4c89-867c-a36cd74c0d79 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:14.374647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ed394-685d-4c89-867c-a36cd74c0d79 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:14.382469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8357f9d-cb47-49f4-b147-f07ca089e8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:14.383420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8357f9d-cb47-49f4-b147-f07ca089e8c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:14.383703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8357f9d-cb47-49f4-b147-f07ca089e8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:14.383979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8357f9d-cb47-49f4-b147-f07ca089e8c6 admin admin] PATH_INFO: `/v3/projects/1833fb6c56f14ceeb9869f19947f5157/users/97fda1f4298d4fc8812e7bbdcd810f8b/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:14.401697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8357f9d-cb47-49f4-b147-f07ca089e8c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1833fb6c56f14ceeb9869f19947f5157, user_id=97fda1f4298d4fc8812e7bbdcd810f8b, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:14.404563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8357f9d-cb47-49f4-b147-f07ca089e8c6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:14.429517 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4080/8063] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:14 2021] PUT /identity/v3/projects/1833fb6c56f14ceeb9869f19947f5157/users/97fda1f4298d4fc8812e7bbdcd810f8b/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:14.433342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097b661-578b-4e91-9a06-461ee63468f6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:14.451057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097b661-578b-4e91-9a06-461ee63468f6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:14.517971 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90634872-df6a-48a0-9662-91813a8b6108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:14.521648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90634872-df6a-48a0-9662-91813a8b6108 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:14.521648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90634872-df6a-48a0-9662-91813a8b6108 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:14.521648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90634872-df6a-48a0-9662-91813a8b6108 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:14.521648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90634872-df6a-48a0-9662-91813a8b6108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:14.523083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90634872-df6a-48a0-9662-91813a8b6108 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:14.538307 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3984/8064] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:14.541698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8357f9d-cb47-49f4-b147-f07ca089e8c6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:14.556472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8357f9d-cb47-49f4-b147-f07ca089e8c6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:14.562603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafd065-eeb1-4f55-95a8-5f17dc8df293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:14.563497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafd065-eeb1-4f55-95a8-5f17dc8df293 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:14.563781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafd065-eeb1-4f55-95a8-5f17dc8df293 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:14.564064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafd065-eeb1-4f55-95a8-5f17dc8df293 admin admin] PATH_INFO: `/v3/projects/1833fb6c56f14ceeb9869f19947f5157/users/97fda1f4298d4fc8812e7bbdcd810f8b/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:14.566577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafd065-eeb1-4f55-95a8-5f17dc8df293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1833fb6c56f14ceeb9869f19947f5157, user_id=97fda1f4298d4fc8812e7bbdcd810f8b, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:14.569287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafd065-eeb1-4f55-95a8-5f17dc8df293 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:14.582075 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4081/8065] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:14 2021] PUT /identity/v3/projects/1833fb6c56f14ceeb9869f19947f5157/users/97fda1f4298d4fc8812e7bbdcd810f8b/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:14.593426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95587c-667b-4817-a4ce-250a3b20043b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:14.593716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95587c-667b-4817-a4ce-250a3b20043b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:14.593994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95587c-667b-4817-a4ce-250a3b20043b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:14.631781 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5d95587c-667b-4817-a4ce-250a3b20043b None None] MFA Rules not processed for user `97fda1f4298d4fc8812e7bbdcd810f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:14.632990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5d95587c-667b-4817-a4ce-250a3b20043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:14.700598 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3985/8066] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:14 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:14.721283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafd065-eeb1-4f55-95a8-5f17dc8df293 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:14.723386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3dafd065-eeb1-4f55-95a8-5f17dc8df293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:14.785923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafd065-eeb1-4f55-95a8-5f17dc8df293 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:14.789625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea28a4-548b-4d61-b4e5-e7930405e971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:14.790297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea28a4-548b-4d61-b4e5-e7930405e971 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:14.790594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea28a4-548b-4d61-b4e5-e7930405e971 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:14.790874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea28a4-548b-4d61-b4e5-e7930405e971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:14.800587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea28a4-548b-4d61-b4e5-e7930405e971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:14.802027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea28a4-548b-4d61-b4e5-e7930405e971 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:14.811502 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4082/8067] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:14 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:14.893431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95587c-667b-4817-a4ce-250a3b20043b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:14.906063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95587c-667b-4817-a4ce-250a3b20043b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:14.911340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba41f7-6544-4f4a-bde9-e0929200a3ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:14.912332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba41f7-6544-4f4a-bde9-e0929200a3ba service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:14.912604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba41f7-6544-4f4a-bde9-e0929200a3ba service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:14.912945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba41f7-6544-4f4a-bde9-e0929200a3ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:14.986789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba41f7-6544-4f4a-bde9-e0929200a3ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:14.988603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba41f7-6544-4f4a-bde9-e0929200a3ba service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:15.005241 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3986/8068] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:14 2021] GET /identity/v3/auth/tokens => generated 3222 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:20.577460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea28a4-548b-4d61-b4e5-e7930405e971 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:20.579060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d8ea28a4-548b-4d61-b4e5-e7930405e971 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:20.644199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea28a4-548b-4d61-b4e5-e7930405e971 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:20.648854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c763a-78b4-4b1c-8815-b9a7b2258661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:20.649709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c763a-78b4-4b1c-8815-b9a7b2258661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:20.649995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c763a-78b4-4b1c-8815-b9a7b2258661 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:20.650297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c763a-78b4-4b1c-8815-b9a7b2258661 admin admin] PATH_INFO: `/v3/users/65b1368bab5a400a8af6459c91778e56` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:20.651579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c763a-78b4-4b1c-8815-b9a7b2258661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b1368bab5a400a8af6459c91778e56)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:20.653489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c763a-78b4-4b1c-8815-b9a7b2258661 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:20.698627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-509c763a-78b4-4b1c-8815-b9a7b2258661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b1368bab5a400a8af6459c91778e56'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:20.705588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-509c763a-78b4-4b1c-8815-b9a7b2258661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b1368bab5a400a8af6459c91778e56'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:20.706274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-509c763a-78b4-4b1c-8815-b9a7b2258661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b1368bab5a400a8af6459c91778e56'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:20.721057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-509c763a-78b4-4b1c-8815-b9a7b2258661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b1368bab5a400a8af6459c91778e56'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:20.729577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-509c763a-78b4-4b1c-8815-b9a7b2258661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b1368bab5a400a8af6459c91778e56'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:20.737163 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4083/8069] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:20 2021] DELETE /identity/v3/users/65b1368bab5a400a8af6459c91778e56 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:20.741683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010665b6-0cd1-437b-8b4b-ca3ba51eb8be None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:20.742172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010665b6-0cd1-437b-8b4b-ca3ba51eb8be None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:20.742376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010665b6-0cd1-437b-8b4b-ca3ba51eb8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:20.760726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-010665b6-0cd1-437b-8b4b-ca3ba51eb8be None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:20.761930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-010665b6-0cd1-437b-8b4b-ca3ba51eb8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:20.822071 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3987/8070] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:20.832160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c763a-78b4-4b1c-8815-b9a7b2258661 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:20.833728 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-509c763a-78b4-4b1c-8815-b9a7b2258661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:20.892694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c763a-78b4-4b1c-8815-b9a7b2258661 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:20.896519 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ea52f-1e46-46e2-a057-dc761c1700d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:20.897159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ea52f-1e46-46e2-a057-dc761c1700d8 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:20.897443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ea52f-1e46-46e2-a057-dc761c1700d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:20.897722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ea52f-1e46-46e2-a057-dc761c1700d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:20.907217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ea52f-1e46-46e2-a057-dc761c1700d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:20.908631 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ea52f-1e46-46e2-a057-dc761c1700d8 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:20.918011 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4084/8071] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:21.088679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010665b6-0cd1-437b-8b4b-ca3ba51eb8be None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:21.090728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-010665b6-0cd1-437b-8b4b-ca3ba51eb8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:21.111381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010665b6-0cd1-437b-8b4b-ca3ba51eb8be None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:21.117398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22216e2-71c8-4896-80b3-5c30e39223ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:21.118313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22216e2-71c8-4896-80b3-5c30e39223ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:21.118671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22216e2-71c8-4896-80b3-5c30e39223ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:21.118943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22216e2-71c8-4896-80b3-5c30e39223ff admin admin] PATH_INFO: `/v3/projects/09b19140c9514e14bb529e04e1bb699b` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:21.120127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22216e2-71c8-4896-80b3-5c30e39223ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b19140c9514e14bb529e04e1bb699b)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:21.122012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22216e2-71c8-4896-80b3-5c30e39223ff admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:21.168901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f22216e2-71c8-4896-80b3-5c30e39223ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b19140c9514e14bb529e04e1bb699b', 'request_id': 'req-f22216e2-71c8-4896-80b3-5c30e39223ff'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:21.175373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f22216e2-71c8-4896-80b3-5c30e39223ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b19140c9514e14bb529e04e1bb699b', 'request_id': 'req-f22216e2-71c8-4896-80b3-5c30e39223ff'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:21.180914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f22216e2-71c8-4896-80b3-5c30e39223ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b19140c9514e14bb529e04e1bb699b', 'request_id': 'req-f22216e2-71c8-4896-80b3-5c30e39223ff'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:21.192718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f22216e2-71c8-4896-80b3-5c30e39223ff admin admin] The token cache is being invalidate because project 09b19140c9514e14bb529e04e1bb699b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:21.193010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f22216e2-71c8-4896-80b3-5c30e39223ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:21.193644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f22216e2-71c8-4896-80b3-5c30e39223ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:21.195197 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3988/8072] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:21 2021] DELETE /identity/v3/projects/09b19140c9514e14bb529e04e1bb699b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:21.201400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6718d1-2100-47ed-b995-2ec78521c927 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:21.201690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6718d1-2100-47ed-b995-2ec78521c927 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:21.201968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6718d1-2100-47ed-b995-2ec78521c927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:21.220373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ee6718d1-2100-47ed-b995-2ec78521c927 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:21.221522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ee6718d1-2100-47ed-b995-2ec78521c927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:21.276473 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4085/8073] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:21.284893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc5aae-7ede-4d2a-bb90-56036cc23fac None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:21.285184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc5aae-7ede-4d2a-bb90-56036cc23fac None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:21.285478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc5aae-7ede-4d2a-bb90-56036cc23fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:21.303186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f5dc5aae-7ede-4d2a-bb90-56036cc23fac None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:21.304356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f5dc5aae-7ede-4d2a-bb90-56036cc23fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:21.312158 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3989/8074] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:21.316690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6718d1-2100-47ed-b995-2ec78521c927 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:21.327099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6718d1-2100-47ed-b995-2ec78521c927 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:21.331868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2f479-33f4-45ce-a601-ed0ee741e642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:21.332516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2f479-33f4-45ce-a601-ed0ee741e642 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:21.332794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2f479-33f4-45ce-a601-ed0ee741e642 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:21.333078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2f479-33f4-45ce-a601-ed0ee741e642 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:21.333811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2f479-33f4-45ce-a601-ed0ee741e642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:18:21.334121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2f479-33f4-45ce-a601-ed0ee741e642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:21.335752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2f479-33f4-45ce-a601-ed0ee741e642 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:21.348421 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4086/8075] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:18:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:18:21.352692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc5aae-7ede-4d2a-bb90-56036cc23fac None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:21.361758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc5aae-7ede-4d2a-bb90-56036cc23fac None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:21.366355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e739b9-1c60-4a2d-8ddd-6dab7c652a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:21.366994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e739b9-1c60-4a2d-8ddd-6dab7c652a03 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:21.367281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e739b9-1c60-4a2d-8ddd-6dab7c652a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:21.367560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e739b9-1c60-4a2d-8ddd-6dab7c652a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:21.368261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e739b9-1c60-4a2d-8ddd-6dab7c652a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:21.370139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e739b9-1c60-4a2d-8ddd-6dab7c652a03 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:21.395678 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3990/8076] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:21 2021] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:21.400155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2f479-33f4-45ce-a601-ed0ee741e642 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:21.410717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2f479-33f4-45ce-a601-ed0ee741e642 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:21.473117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f5ee5-86ce-4b89-bafe-fe887317888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:21.473716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f5ee5-86ce-4b89-bafe-fe887317888f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:21.474094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f5ee5-86ce-4b89-bafe-fe887317888f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:21.474403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f5ee5-86ce-4b89-bafe-fe887317888f admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:21.475109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f5ee5-86ce-4b89-bafe-fe887317888f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:21.477069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f5ee5-86ce-4b89-bafe-fe887317888f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:21.496184 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4087/8077] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:21 2021] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:21.501551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e739b9-1c60-4a2d-8ddd-6dab7c652a03 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:21.511958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e739b9-1c60-4a2d-8ddd-6dab7c652a03 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:21.517332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea36e5-b1a7-425d-9629-3584c03f93b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:21.517994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea36e5-b1a7-425d-9629-3584c03f93b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:21.518317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea36e5-b1a7-425d-9629-3584c03f93b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:21.518737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea36e5-b1a7-425d-9629-3584c03f93b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:21.519481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea36e5-b1a7-425d-9629-3584c03f93b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:21.521072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea36e5-b1a7-425d-9629-3584c03f93b0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:21.532354 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3991/8078] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:21 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:21.536149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f5ee5-86ce-4b89-bafe-fe887317888f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:21.546126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f5ee5-86ce-4b89-bafe-fe887317888f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:21.551128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7762e7e-fede-4e99-bcfc-2aa243f4d71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:21.551791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7762e7e-fede-4e99-bcfc-2aa243f4d71b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:21.552077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7762e7e-fede-4e99-bcfc-2aa243f4d71b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:21.552357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7762e7e-fede-4e99-bcfc-2aa243f4d71b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:21.553116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7762e7e-fede-4e99-bcfc-2aa243f4d71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:21.554882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7762e7e-fede-4e99-bcfc-2aa243f4d71b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:21.565677 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4088/8079] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:21.571681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea36e5-b1a7-425d-9629-3584c03f93b0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:21.583649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea36e5-b1a7-425d-9629-3584c03f93b0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:21.589843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6126b56-ba67-4e0e-8492-f0ecaaa42a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:21.590806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6126b56-ba67-4e0e-8492-f0ecaaa42a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:21.591099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6126b56-ba67-4e0e-8492-f0ecaaa42a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:21.591445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6126b56-ba67-4e0e-8492-f0ecaaa42a5f admin admin] PATH_INFO: `/v3/projects/15925abff20943e0b0c27b13e4bf0167/users/5f64173ccb474d30b28929b53160fbaf/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:21.606742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6126b56-ba67-4e0e-8492-f0ecaaa42a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=15925abff20943e0b0c27b13e4bf0167, user_id=5f64173ccb474d30b28929b53160fbaf, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:21.609460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6126b56-ba67-4e0e-8492-f0ecaaa42a5f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:21.623590 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3992/8080] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:21 2021] PUT /identity/v3/projects/15925abff20943e0b0c27b13e4bf0167/users/5f64173ccb474d30b28929b53160fbaf/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:21.633396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f59127-3813-488d-be45-ece7f5d8de65 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:21.634018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f59127-3813-488d-be45-ece7f5d8de65 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:21.634018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f59127-3813-488d-be45-ece7f5d8de65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:21.662529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a9f59127-3813-488d-be45-ece7f5d8de65 None None] MFA Rules not processed for user `5f64173ccb474d30b28929b53160fbaf`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:21.663821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a9f59127-3813-488d-be45-ece7f5d8de65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:21.737837 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4089/8081] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:21 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:21.744876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6126b56-ba67-4e0e-8492-f0ecaaa42a5f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:21.746626 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c6126b56-ba67-4e0e-8492-f0ecaaa42a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:21.813070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6126b56-ba67-4e0e-8492-f0ecaaa42a5f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:21.817176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304498b-ff8a-482d-952f-fdde023eb333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:21.817716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304498b-ff8a-482d-952f-fdde023eb333 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:21.818000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304498b-ff8a-482d-952f-fdde023eb333 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:21.818302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304498b-ff8a-482d-952f-fdde023eb333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:21.829750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304498b-ff8a-482d-952f-fdde023eb333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:21.831383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304498b-ff8a-482d-952f-fdde023eb333 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:21.840681 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3993/8082] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:21 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:25.645239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f59127-3813-488d-be45-ece7f5d8de65 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:25.708933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f59127-3813-488d-be45-ece7f5d8de65 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:25.714977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe01e2c-abb6-4c4b-aeea-012a2fd2576c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:25.715904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe01e2c-abb6-4c4b-aeea-012a2fd2576c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:25.716815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe01e2c-abb6-4c4b-aeea-012a2fd2576c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:25.717098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe01e2c-abb6-4c4b-aeea-012a2fd2576c admin admin] PATH_INFO: `/v3/users/5f64173ccb474d30b28929b53160fbaf` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:25.718524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe01e2c-abb6-4c4b-aeea-012a2fd2576c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f64173ccb474d30b28929b53160fbaf)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:25.720737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe01e2c-abb6-4c4b-aeea-012a2fd2576c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:25.770507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebe01e2c-abb6-4c4b-aeea-012a2fd2576c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f64173ccb474d30b28929b53160fbaf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:25.779237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebe01e2c-abb6-4c4b-aeea-012a2fd2576c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f64173ccb474d30b28929b53160fbaf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:25.779995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebe01e2c-abb6-4c4b-aeea-012a2fd2576c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f64173ccb474d30b28929b53160fbaf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:25.792182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebe01e2c-abb6-4c4b-aeea-012a2fd2576c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f64173ccb474d30b28929b53160fbaf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:25.803267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebe01e2c-abb6-4c4b-aeea-012a2fd2576c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f64173ccb474d30b28929b53160fbaf'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:25.814239 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4090/8083] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:25 2021] DELETE /identity/v3/users/5f64173ccb474d30b28929b53160fbaf => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:25.819064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61026d24-99c8-497e-90fc-6f1d9593b3f7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:25.819568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61026d24-99c8-497e-90fc-6f1d9593b3f7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:25.819727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61026d24-99c8-497e-90fc-6f1d9593b3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:25.837509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-61026d24-99c8-497e-90fc-6f1d9593b3f7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:25.838744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-61026d24-99c8-497e-90fc-6f1d9593b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:25.895804 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3994/8084] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:25.906354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe01e2c-abb6-4c4b-aeea-012a2fd2576c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:25.907737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ebe01e2c-abb6-4c4b-aeea-012a2fd2576c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:25.966101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe01e2c-abb6-4c4b-aeea-012a2fd2576c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:25.969891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916d29f-99a7-447c-b72b-e2279db7508d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:25.970592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916d29f-99a7-447c-b72b-e2279db7508d service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:25.970871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916d29f-99a7-447c-b72b-e2279db7508d service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:25.971144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916d29f-99a7-447c-b72b-e2279db7508d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:25.980199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916d29f-99a7-447c-b72b-e2279db7508d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:25.981609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916d29f-99a7-447c-b72b-e2279db7508d service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:25.991763 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4091/8085] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:26.152619 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61026d24-99c8-497e-90fc-6f1d9593b3f7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:26.154606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-61026d24-99c8-497e-90fc-6f1d9593b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:26.167484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61026d24-99c8-497e-90fc-6f1d9593b3f7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:26.172694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b5258-f355-4558-8c51-20d4078bdbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:26.173760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5258-f355-4558-8c51-20d4078bdbae admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:26.174055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5258-f355-4558-8c51-20d4078bdbae admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:26.174367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5258-f355-4558-8c51-20d4078bdbae admin admin] PATH_INFO: `/v3/projects/15925abff20943e0b0c27b13e4bf0167` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:26.175606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b5258-f355-4558-8c51-20d4078bdbae admin admin] RBAC: Authorizing `identity:delete_project(project_id=15925abff20943e0b0c27b13e4bf0167)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:26.177834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b5258-f355-4558-8c51-20d4078bdbae admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:26.222240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6b4b5258-f355-4558-8c51-20d4078bdbae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15925abff20943e0b0c27b13e4bf0167', 'request_id': 'req-6b4b5258-f355-4558-8c51-20d4078bdbae'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:26.228086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6b4b5258-f355-4558-8c51-20d4078bdbae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15925abff20943e0b0c27b13e4bf0167', 'request_id': 'req-6b4b5258-f355-4558-8c51-20d4078bdbae'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:26.234113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6b4b5258-f355-4558-8c51-20d4078bdbae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15925abff20943e0b0c27b13e4bf0167', 'request_id': 'req-6b4b5258-f355-4558-8c51-20d4078bdbae'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:26.246365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6b4b5258-f355-4558-8c51-20d4078bdbae admin admin] The token cache is being invalidate because project 15925abff20943e0b0c27b13e4bf0167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:26.246660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6b4b5258-f355-4558-8c51-20d4078bdbae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:26.247322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6b4b5258-f355-4558-8c51-20d4078bdbae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:26.248888 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3995/8086] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:26 2021] DELETE /identity/v3/projects/15925abff20943e0b0c27b13e4bf0167 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:26.254822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f54b0-aa50-4a6c-861b-e78e73eae3d7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:26.255112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f54b0-aa50-4a6c-861b-e78e73eae3d7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:26.255391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f54b0-aa50-4a6c-861b-e78e73eae3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:26.273494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6d2f54b0-aa50-4a6c-861b-e78e73eae3d7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:26.274726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6d2f54b0-aa50-4a6c-861b-e78e73eae3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:26.332919 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4092/8087] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:26.342767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c228a7-5a89-477e-a911-988c36134ed9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:26.343064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c228a7-5a89-477e-a911-988c36134ed9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:26.343349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c228a7-5a89-477e-a911-988c36134ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:26.362800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c1c228a7-5a89-477e-a911-988c36134ed9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:26.363998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c1c228a7-5a89-477e-a911-988c36134ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:26.371951 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3996/8088] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:26.376018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f54b0-aa50-4a6c-861b-e78e73eae3d7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:26.385582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f54b0-aa50-4a6c-861b-e78e73eae3d7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:26.390713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae3eb3-40c8-4e26-bbd8-11e4a5d04dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:26.391362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae3eb3-40c8-4e26-bbd8-11e4a5d04dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:26.391645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae3eb3-40c8-4e26-bbd8-11e4a5d04dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:26.391924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae3eb3-40c8-4e26-bbd8-11e4a5d04dd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:26.392648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae3eb3-40c8-4e26-bbd8-11e4a5d04dd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:18:26.392955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae3eb3-40c8-4e26-bbd8-11e4a5d04dd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:26.394579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae3eb3-40c8-4e26-bbd8-11e4a5d04dd6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:26.406363 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4093/8089] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:18:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:18:26.410385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c228a7-5a89-477e-a911-988c36134ed9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:26.419355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c228a7-5a89-477e-a911-988c36134ed9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:26.424107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb4466-b8dd-4980-89b0-d25f5f41b456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:26.424762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb4466-b8dd-4980-89b0-d25f5f41b456 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:26.425044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb4466-b8dd-4980-89b0-d25f5f41b456 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:26.425320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb4466-b8dd-4980-89b0-d25f5f41b456 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:26.426016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb4466-b8dd-4980-89b0-d25f5f41b456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:26.427911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb4466-b8dd-4980-89b0-d25f5f41b456 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:26.453145 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3997/8090] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:26 2021] POST /identity/v3/projects => generated 403 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:26.457202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae3eb3-40c8-4e26-bbd8-11e4a5d04dd6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:26.467520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae3eb3-40c8-4e26-bbd8-11e4a5d04dd6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:26.521627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429343e-8ab8-4779-87c7-d2621f8c9a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:26.522330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429343e-8ab8-4779-87c7-d2621f8c9a42 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:26.522699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429343e-8ab8-4779-87c7-d2621f8c9a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:26.523124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429343e-8ab8-4779-87c7-d2621f8c9a42 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:26.523821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429343e-8ab8-4779-87c7-d2621f8c9a42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:26.525741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429343e-8ab8-4779-87c7-d2621f8c9a42 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:26.548534 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4094/8091] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:26 2021] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:26.549611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb4466-b8dd-4980-89b0-d25f5f41b456 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:26.559676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb4466-b8dd-4980-89b0-d25f5f41b456 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:26.564397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4872d71-b8bf-4506-b404-7be2aa7857ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:26.565045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4872d71-b8bf-4506-b404-7be2aa7857ff admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:26.565329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4872d71-b8bf-4506-b404-7be2aa7857ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:26.565604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4872d71-b8bf-4506-b404-7be2aa7857ff admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:26.566629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4872d71-b8bf-4506-b404-7be2aa7857ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:26.568196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4872d71-b8bf-4506-b404-7be2aa7857ff admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:26.578763 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3998/8092] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:26 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:18:26.582655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429343e-8ab8-4779-87c7-d2621f8c9a42 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:26.593070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429343e-8ab8-4779-87c7-d2621f8c9a42 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:26.597710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db54b5a-b410-4084-94b3-fc39c0289a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:26.598398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db54b5a-b410-4084-94b3-fc39c0289a3b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:26.598682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db54b5a-b410-4084-94b3-fc39c0289a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:26.598961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db54b5a-b410-4084-94b3-fc39c0289a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:26.599687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db54b5a-b410-4084-94b3-fc39c0289a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:26.601258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db54b5a-b410-4084-94b3-fc39c0289a3b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:26.610817 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4095/8093] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:26 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:26.615000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4872d71-b8bf-4506-b404-7be2aa7857ff admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:26.624957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4872d71-b8bf-4506-b404-7be2aa7857ff admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:26.631121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97974dc1-b5da-4fd9-aebd-0def5bf0d68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:26.632323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97974dc1-b5da-4fd9-aebd-0def5bf0d68e admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:26.632675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97974dc1-b5da-4fd9-aebd-0def5bf0d68e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:26.632975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97974dc1-b5da-4fd9-aebd-0def5bf0d68e admin admin] PATH_INFO: `/v3/projects/37e804fa3e684ef7b3d053445652667a/users/dba84d104bfc46cc8a14423b4c111338/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:26.648242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97974dc1-b5da-4fd9-aebd-0def5bf0d68e admin admin] RBAC: Authorizing `identity:create_grant(project_id=37e804fa3e684ef7b3d053445652667a, user_id=dba84d104bfc46cc8a14423b4c111338, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:26.650880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97974dc1-b5da-4fd9-aebd-0def5bf0d68e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:26.663904 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 3999/8094] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:26 2021] PUT /identity/v3/projects/37e804fa3e684ef7b3d053445652667a/users/dba84d104bfc46cc8a14423b4c111338/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:26.673564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad1442-a8b8-426b-90ca-a8edbab8e5e7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:26.674070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad1442-a8b8-426b-90ca-a8edbab8e5e7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:26.674177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad1442-a8b8-426b-90ca-a8edbab8e5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:26.703069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4bad1442-a8b8-426b-90ca-a8edbab8e5e7 None None] MFA Rules not processed for user `dba84d104bfc46cc8a14423b4c111338`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:26.704253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4bad1442-a8b8-426b-90ca-a8edbab8e5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:26.768341 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4096/8095] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:26 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:26.772786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97974dc1-b5da-4fd9-aebd-0def5bf0d68e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:26.832542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97974dc1-b5da-4fd9-aebd-0def5bf0d68e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:26.837120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fddf77-e2ed-42e3-86d4-20bb3e5e72e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:26.837765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fddf77-e2ed-42e3-86d4-20bb3e5e72e0 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:26.838109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fddf77-e2ed-42e3-86d4-20bb3e5e72e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:26.838432 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fddf77-e2ed-42e3-86d4-20bb3e5e72e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:26.839185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fddf77-e2ed-42e3-86d4-20bb3e5e72e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:26.846375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fddf77-e2ed-42e3-86d4-20bb3e5e72e0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:26.868570 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4000/8096] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:26 2021] POST /identity/v3/projects => generated 405 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:26.869806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad1442-a8b8-426b-90ca-a8edbab8e5e7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:26.886867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad1442-a8b8-426b-90ca-a8edbab8e5e7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:26.942364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113e33c-1b95-47fb-8d2b-92b77cb98340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:26.943042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113e33c-1b95-47fb-8d2b-92b77cb98340 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:26.943323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113e33c-1b95-47fb-8d2b-92b77cb98340 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:26.943620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113e33c-1b95-47fb-8d2b-92b77cb98340 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:26.944298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113e33c-1b95-47fb-8d2b-92b77cb98340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:26.946211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113e33c-1b95-47fb-8d2b-92b77cb98340 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:26.972765 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4097/8097] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:26 2021] POST /identity/v3/users => generated 309 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:26.972873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fddf77-e2ed-42e3-86d4-20bb3e5e72e0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:26.980326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fddf77-e2ed-42e3-86d4-20bb3e5e72e0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:26.985073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae48bc-67c5-4ac0-929b-14253305c135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:26.985725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae48bc-67c5-4ac0-929b-14253305c135 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:26.986008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae48bc-67c5-4ac0-929b-14253305c135 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:26.986494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae48bc-67c5-4ac0-929b-14253305c135 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:26.987594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae48bc-67c5-4ac0-929b-14253305c135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:26.989435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae48bc-67c5-4ac0-929b-14253305c135 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:27.001508 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4001/8098] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:26 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:27.005674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113e33c-1b95-47fb-8d2b-92b77cb98340 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:27.016674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113e33c-1b95-47fb-8d2b-92b77cb98340 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:27.021334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7bfcb-8786-472a-a6cf-5c275fd7c5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:27.022232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7bfcb-8786-472a-a6cf-5c275fd7c5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:27.022565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7bfcb-8786-472a-a6cf-5c275fd7c5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:27.022846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7bfcb-8786-472a-a6cf-5c275fd7c5a9 admin admin] PATH_INFO: `/v3/projects/d4eadbcfb0944d2d85016ed25da4430a/users/c4e045e983a2436daf3a94cc3b209083/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:27.039570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7bfcb-8786-472a-a6cf-5c275fd7c5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4eadbcfb0944d2d85016ed25da4430a, user_id=c4e045e983a2436daf3a94cc3b209083, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:27.042216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7bfcb-8786-472a-a6cf-5c275fd7c5a9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:27.062673 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4098/8099] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:27 2021] PUT /identity/v3/projects/d4eadbcfb0944d2d85016ed25da4430a/users/c4e045e983a2436daf3a94cc3b209083/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:27.066612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae48bc-67c5-4ac0-929b-14253305c135 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:27.079747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae48bc-67c5-4ac0-929b-14253305c135 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:27.134732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f66a5-4bec-4718-938f-838a1b3ec2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:27.135396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f66a5-4bec-4718-938f-838a1b3ec2be admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:27.135686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f66a5-4bec-4718-938f-838a1b3ec2be admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:27.135968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f66a5-4bec-4718-938f-838a1b3ec2be admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:27.136693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f66a5-4bec-4718-938f-838a1b3ec2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:27.138348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f66a5-4bec-4718-938f-838a1b3ec2be admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:27.147727 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4002/8100] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:27 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:27.151842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7bfcb-8786-472a-a6cf-5c275fd7c5a9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:27.161899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7bfcb-8786-472a-a6cf-5c275fd7c5a9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:27.166614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51337a67-09bd-4a3f-9a17-252133b1672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:27.167481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51337a67-09bd-4a3f-9a17-252133b1672b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:27.167790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51337a67-09bd-4a3f-9a17-252133b1672b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:27.168075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51337a67-09bd-4a3f-9a17-252133b1672b admin admin] PATH_INFO: `/v3/projects/d4eadbcfb0944d2d85016ed25da4430a/users/c4e045e983a2436daf3a94cc3b209083/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:27.170644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51337a67-09bd-4a3f-9a17-252133b1672b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4eadbcfb0944d2d85016ed25da4430a, user_id=c4e045e983a2436daf3a94cc3b209083, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:27.173248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51337a67-09bd-4a3f-9a17-252133b1672b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:27.183318 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4099/8101] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:27 2021] PUT /identity/v3/projects/d4eadbcfb0944d2d85016ed25da4430a/users/c4e045e983a2436daf3a94cc3b209083/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:27.195077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9cf3-013b-4c97-b1cf-f43c43594675 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:27.195375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9cf3-013b-4c97-b1cf-f43c43594675 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:27.195666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9cf3-013b-4c97-b1cf-f43c43594675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:27.221798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b05c9cf3-013b-4c97-b1cf-f43c43594675 None None] MFA Rules not processed for user `c4e045e983a2436daf3a94cc3b209083`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:27.223036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b05c9cf3-013b-4c97-b1cf-f43c43594675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:27.289089 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4003/8102] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:27 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:27.299448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51337a67-09bd-4a3f-9a17-252133b1672b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:27.301176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-51337a67-09bd-4a3f-9a17-252133b1672b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:27.359108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51337a67-09bd-4a3f-9a17-252133b1672b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:27.362772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084bc20-0901-47d0-83cf-0a25d3bf766f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:27.363408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084bc20-0901-47d0-83cf-0a25d3bf766f service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:27.363729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084bc20-0901-47d0-83cf-0a25d3bf766f service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:27.364006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084bc20-0901-47d0-83cf-0a25d3bf766f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:27.373505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084bc20-0901-47d0-83cf-0a25d3bf766f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:27.374976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084bc20-0901-47d0-83cf-0a25d3bf766f service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:27.384044 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4100/8103] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:27 2021] GET /identity/v3/auth/tokens => generated 3339 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:27.505162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9cf3-013b-4c97-b1cf-f43c43594675 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:27.565286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9cf3-013b-4c97-b1cf-f43c43594675 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:27.569940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46996da1-c629-4357-9cc9-88fb71909ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:27.570823 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46996da1-c629-4357-9cc9-88fb71909ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:27.571107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46996da1-c629-4357-9cc9-88fb71909ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:27.571384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46996da1-c629-4357-9cc9-88fb71909ae1 admin admin] PATH_INFO: `/v3/users/dba84d104bfc46cc8a14423b4c111338` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:27.572568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46996da1-c629-4357-9cc9-88fb71909ae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dba84d104bfc46cc8a14423b4c111338)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:27.574491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46996da1-c629-4357-9cc9-88fb71909ae1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:27.619469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-46996da1-c629-4357-9cc9-88fb71909ae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dba84d104bfc46cc8a14423b4c111338'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:27.626200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-46996da1-c629-4357-9cc9-88fb71909ae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dba84d104bfc46cc8a14423b4c111338'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:27.638393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-46996da1-c629-4357-9cc9-88fb71909ae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dba84d104bfc46cc8a14423b4c111338'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:27.639082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-46996da1-c629-4357-9cc9-88fb71909ae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dba84d104bfc46cc8a14423b4c111338'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:27.645649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-46996da1-c629-4357-9cc9-88fb71909ae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dba84d104bfc46cc8a14423b4c111338'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:27.651355 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4004/8104] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:27 2021] DELETE /identity/v3/users/dba84d104bfc46cc8a14423b4c111338 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:27.656410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001107a-ae89-40f1-a330-82ecaf8934b8 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:27.656701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001107a-ae89-40f1-a330-82ecaf8934b8 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:27.656983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001107a-ae89-40f1-a330-82ecaf8934b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:27.674768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8001107a-ae89-40f1-a330-82ecaf8934b8 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:27.675950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8001107a-ae89-40f1-a330-82ecaf8934b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:27.733647 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4101/8105] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:27.742833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46996da1-c629-4357-9cc9-88fb71909ae1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:27.744276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-46996da1-c629-4357-9cc9-88fb71909ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:27.802439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46996da1-c629-4357-9cc9-88fb71909ae1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:27.806126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76715a-cf2d-49b6-a3ab-8ef2bf30c78c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:27.806803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76715a-cf2d-49b6-a3ab-8ef2bf30c78c service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:27.807094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76715a-cf2d-49b6-a3ab-8ef2bf30c78c service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:27.807379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76715a-cf2d-49b6-a3ab-8ef2bf30c78c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:27.816523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76715a-cf2d-49b6-a3ab-8ef2bf30c78c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:27.817944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76715a-cf2d-49b6-a3ab-8ef2bf30c78c service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:27.828328 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4005/8106] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:28.088476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001107a-ae89-40f1-a330-82ecaf8934b8 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:28.090030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8001107a-ae89-40f1-a330-82ecaf8934b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:28.113019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001107a-ae89-40f1-a330-82ecaf8934b8 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:28.118238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623265ed-8d39-43d1-878b-715bafb9bc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:28.119317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623265ed-8d39-43d1-878b-715bafb9bc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:28.119669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623265ed-8d39-43d1-878b-715bafb9bc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:28.120009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623265ed-8d39-43d1-878b-715bafb9bc97 admin admin] PATH_INFO: `/v3/projects/37e804fa3e684ef7b3d053445652667a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:28.121783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623265ed-8d39-43d1-878b-715bafb9bc97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37e804fa3e684ef7b3d053445652667a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:28.124369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623265ed-8d39-43d1-878b-715bafb9bc97 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:28.177332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-623265ed-8d39-43d1-878b-715bafb9bc97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37e804fa3e684ef7b3d053445652667a', 'request_id': 'req-623265ed-8d39-43d1-878b-715bafb9bc97'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:28.183894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-623265ed-8d39-43d1-878b-715bafb9bc97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37e804fa3e684ef7b3d053445652667a', 'request_id': 'req-623265ed-8d39-43d1-878b-715bafb9bc97'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:28.191966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-623265ed-8d39-43d1-878b-715bafb9bc97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37e804fa3e684ef7b3d053445652667a', 'request_id': 'req-623265ed-8d39-43d1-878b-715bafb9bc97'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:28.203196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-623265ed-8d39-43d1-878b-715bafb9bc97 admin admin] The token cache is being invalidate because project 37e804fa3e684ef7b3d053445652667a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:28.203616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-623265ed-8d39-43d1-878b-715bafb9bc97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:28.204489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-623265ed-8d39-43d1-878b-715bafb9bc97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:28.206146 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4102/8107] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:28 2021] DELETE /identity/v3/projects/37e804fa3e684ef7b3d053445652667a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:28.210090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76715a-cf2d-49b6-a3ab-8ef2bf30c78c service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:28.220100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76715a-cf2d-49b6-a3ab-8ef2bf30c78c service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:28.276052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecb445-7702-4959-8885-b23014c4fcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:28.276925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecb445-7702-4959-8885-b23014c4fcf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:28.277211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecb445-7702-4959-8885-b23014c4fcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:28.277491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecb445-7702-4959-8885-b23014c4fcf5 admin admin] PATH_INFO: `/v3/users/c4e045e983a2436daf3a94cc3b209083` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:28.278775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecb445-7702-4959-8885-b23014c4fcf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e045e983a2436daf3a94cc3b209083)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:28.280737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecb445-7702-4959-8885-b23014c4fcf5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:28.347488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-91ecb445-7702-4959-8885-b23014c4fcf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e045e983a2436daf3a94cc3b209083'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:28.349159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-91ecb445-7702-4959-8885-b23014c4fcf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e045e983a2436daf3a94cc3b209083'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:28.361309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-91ecb445-7702-4959-8885-b23014c4fcf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e045e983a2436daf3a94cc3b209083'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:28.362025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-91ecb445-7702-4959-8885-b23014c4fcf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e045e983a2436daf3a94cc3b209083'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:28.370829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-91ecb445-7702-4959-8885-b23014c4fcf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e045e983a2436daf3a94cc3b209083'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:28.377306 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4006/8108] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:28 2021] DELETE /identity/v3/users/c4e045e983a2436daf3a94cc3b209083 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:28.653638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623265ed-8d39-43d1-878b-715bafb9bc97 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:28.655480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-623265ed-8d39-43d1-878b-715bafb9bc97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:28.670789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623265ed-8d39-43d1-878b-715bafb9bc97 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:28.742221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaeb319-346e-4991-90c6-4a964777b1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:28.743116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaeb319-346e-4991-90c6-4a964777b1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:28.743425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaeb319-346e-4991-90c6-4a964777b1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:28.743727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaeb319-346e-4991-90c6-4a964777b1bb admin admin] PATH_INFO: `/v3/projects/d4eadbcfb0944d2d85016ed25da4430a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:28.745013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaeb319-346e-4991-90c6-4a964777b1bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4eadbcfb0944d2d85016ed25da4430a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:28.746971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaeb319-346e-4991-90c6-4a964777b1bb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:28.798535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fbaeb319-346e-4991-90c6-4a964777b1bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4eadbcfb0944d2d85016ed25da4430a', 'request_id': 'req-fbaeb319-346e-4991-90c6-4a964777b1bb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:28.805066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fbaeb319-346e-4991-90c6-4a964777b1bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4eadbcfb0944d2d85016ed25da4430a', 'request_id': 'req-fbaeb319-346e-4991-90c6-4a964777b1bb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:28.813119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fbaeb319-346e-4991-90c6-4a964777b1bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4eadbcfb0944d2d85016ed25da4430a', 'request_id': 'req-fbaeb319-346e-4991-90c6-4a964777b1bb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:28.827579 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fbaeb319-346e-4991-90c6-4a964777b1bb admin admin] The token cache is being invalidate because project d4eadbcfb0944d2d85016ed25da4430a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:28.827872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fbaeb319-346e-4991-90c6-4a964777b1bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:28.828586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-fbaeb319-346e-4991-90c6-4a964777b1bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:28.830241 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4103/8109] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:28 2021] DELETE /identity/v3/projects/d4eadbcfb0944d2d85016ed25da4430a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:28.836126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9dbf3-6496-436b-9af3-d779a08b0996 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:28.836422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9dbf3-6496-436b-9af3-d779a08b0996 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:28.836707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9dbf3-6496-436b-9af3-d779a08b0996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:28.856225 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e4b9dbf3-6496-436b-9af3-d779a08b0996 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:28.858136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e4b9dbf3-6496-436b-9af3-d779a08b0996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:28.923522 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4007/8110] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:28.931989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb96203-7e16-468e-83a0-846632dc8d38 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:28.932284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb96203-7e16-468e-83a0-846632dc8d38 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:28.932578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb96203-7e16-468e-83a0-846632dc8d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:28.952875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1cb96203-7e16-468e-83a0-846632dc8d38 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:28.954221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1cb96203-7e16-468e-83a0-846632dc8d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:28.963663 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4104/8111] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:28.968407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9dbf3-6496-436b-9af3-d779a08b0996 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:28.978940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9dbf3-6496-436b-9af3-d779a08b0996 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:28.984219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11476564-bf82-4c10-8f5a-dbe0d3a058e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:28.985249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11476564-bf82-4c10-8f5a-dbe0d3a058e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:28.985249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11476564-bf82-4c10-8f5a-dbe0d3a058e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:28.985479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11476564-bf82-4c10-8f5a-dbe0d3a058e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:28.986121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11476564-bf82-4c10-8f5a-dbe0d3a058e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:18:28.987732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11476564-bf82-4c10-8f5a-dbe0d3a058e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:28.987732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11476564-bf82-4c10-8f5a-dbe0d3a058e9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:29.003986 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4008/8112] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:18:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:18:29.007691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb96203-7e16-468e-83a0-846632dc8d38 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:29.017876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb96203-7e16-468e-83a0-846632dc8d38 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:29.022832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d20e1-91e3-4dcf-8f1b-7340bc3d40e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:29.023662 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d20e1-91e3-4dcf-8f1b-7340bc3d40e1 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:29.024005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d20e1-91e3-4dcf-8f1b-7340bc3d40e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:29.024260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d20e1-91e3-4dcf-8f1b-7340bc3d40e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:29.025107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d20e1-91e3-4dcf-8f1b-7340bc3d40e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:29.027278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d20e1-91e3-4dcf-8f1b-7340bc3d40e1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:29.055281 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4105/8113] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:29 2021] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:29.060321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11476564-bf82-4c10-8f5a-dbe0d3a058e9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:29.073973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11476564-bf82-4c10-8f5a-dbe0d3a058e9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:29.133438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82466e-8602-47a8-9d88-abc5b36bfe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:29.134103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82466e-8602-47a8-9d88-abc5b36bfe25 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:29.134427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82466e-8602-47a8-9d88-abc5b36bfe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:29.134712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82466e-8602-47a8-9d88-abc5b36bfe25 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:29.135416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82466e-8602-47a8-9d88-abc5b36bfe25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:29.137452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82466e-8602-47a8-9d88-abc5b36bfe25 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:29.160766 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4009/8114] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:29 2021] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:29.162167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d20e1-91e3-4dcf-8f1b-7340bc3d40e1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:29.174677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d20e1-91e3-4dcf-8f1b-7340bc3d40e1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:29.179623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112acd2-f0d7-4027-86b9-66e07bd3de2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:29.180315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112acd2-f0d7-4027-86b9-66e07bd3de2b admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:29.180967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112acd2-f0d7-4027-86b9-66e07bd3de2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:29.181610 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112acd2-f0d7-4027-86b9-66e07bd3de2b admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:29.182817 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112acd2-f0d7-4027-86b9-66e07bd3de2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:29.184659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112acd2-f0d7-4027-86b9-66e07bd3de2b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:29.197606 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4106/8115] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:29 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:29.201773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82466e-8602-47a8-9d88-abc5b36bfe25 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:29.212140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82466e-8602-47a8-9d88-abc5b36bfe25 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:29.217965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e00326-6888-49a3-a11e-09fb5f3dad4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:29.218766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e00326-6888-49a3-a11e-09fb5f3dad4f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:29.219118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e00326-6888-49a3-a11e-09fb5f3dad4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:29.219399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e00326-6888-49a3-a11e-09fb5f3dad4f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:29.220130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e00326-6888-49a3-a11e-09fb5f3dad4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:29.221766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e00326-6888-49a3-a11e-09fb5f3dad4f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:29.232893 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4010/8116] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:29 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:29.237059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112acd2-f0d7-4027-86b9-66e07bd3de2b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:29.248046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112acd2-f0d7-4027-86b9-66e07bd3de2b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:29.253203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d878f2-9b60-4a2f-834e-c8245d60cc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:29.254113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d878f2-9b60-4a2f-834e-c8245d60cc0c admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:29.254458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d878f2-9b60-4a2f-834e-c8245d60cc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:29.254743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d878f2-9b60-4a2f-834e-c8245d60cc0c admin admin] PATH_INFO: `/v3/projects/fa039515df6e41be860338989ab70b54/users/491a015d11b1429787d611cff51c6824/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:29.270569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d878f2-9b60-4a2f-834e-c8245d60cc0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa039515df6e41be860338989ab70b54, user_id=491a015d11b1429787d611cff51c6824, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:29.273182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d878f2-9b60-4a2f-834e-c8245d60cc0c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:29.285935 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4107/8117] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:29 2021] PUT /identity/v3/projects/fa039515df6e41be860338989ab70b54/users/491a015d11b1429787d611cff51c6824/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:29.296444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69137-8265-4436-945c-3f5ed99153d5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:29.296731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69137-8265-4436-945c-3f5ed99153d5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:29.297016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69137-8265-4436-945c-3f5ed99153d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:29.322908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ece69137-8265-4436-945c-3f5ed99153d5 None None] MFA Rules not processed for user `491a015d11b1429787d611cff51c6824`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:29.324100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ece69137-8265-4436-945c-3f5ed99153d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:29.396397 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4011/8118] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:29 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:18:29.400779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d878f2-9b60-4a2f-834e-c8245d60cc0c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:29.462807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d878f2-9b60-4a2f-834e-c8245d60cc0c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:29.468278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188acc4-b6d1-4c54-81ef-7392aff3d102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:29.468851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188acc4-b6d1-4c54-81ef-7392aff3d102 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:29.469131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188acc4-b6d1-4c54-81ef-7392aff3d102 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:29.469406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188acc4-b6d1-4c54-81ef-7392aff3d102 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:29.470106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188acc4-b6d1-4c54-81ef-7392aff3d102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:29.472109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188acc4-b6d1-4c54-81ef-7392aff3d102 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:29.497345 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4108/8119] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:29 2021] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:29.501079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece69137-8265-4436-945c-3f5ed99153d5 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:29.511845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece69137-8265-4436-945c-3f5ed99153d5 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:29.568326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6778f-1cc0-40c7-a1be-4e33d6342c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:29.569000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6778f-1cc0-40c7-a1be-4e33d6342c80 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:29.569296 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6778f-1cc0-40c7-a1be-4e33d6342c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:29.569578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6778f-1cc0-40c7-a1be-4e33d6342c80 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:29.570322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6778f-1cc0-40c7-a1be-4e33d6342c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:29.575161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6778f-1cc0-40c7-a1be-4e33d6342c80 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:29.597016 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4012/8120] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:29 2021] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:29.600971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188acc4-b6d1-4c54-81ef-7392aff3d102 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:29.611821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188acc4-b6d1-4c54-81ef-7392aff3d102 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:29.616741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29bd78-cf11-43a5-842d-7ea93e3204a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:29.617396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29bd78-cf11-43a5-842d-7ea93e3204a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:29.617684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29bd78-cf11-43a5-842d-7ea93e3204a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:29.617981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29bd78-cf11-43a5-842d-7ea93e3204a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:29.618902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29bd78-cf11-43a5-842d-7ea93e3204a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:29.620478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29bd78-cf11-43a5-842d-7ea93e3204a3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:29.634147 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4109/8121] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:29 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:18:29.638510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6778f-1cc0-40c7-a1be-4e33d6342c80 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:29.649944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6778f-1cc0-40c7-a1be-4e33d6342c80 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:29.656978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1366f50-a0b9-4a1d-b46e-71126b3c7005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:29.657872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1366f50-a0b9-4a1d-b46e-71126b3c7005 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:29.658162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1366f50-a0b9-4a1d-b46e-71126b3c7005 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:29.658480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1366f50-a0b9-4a1d-b46e-71126b3c7005 admin admin] PATH_INFO: `/v3/projects/9f5bd24cfda049509d464a2866053a45/users/2efccbdf27ea40868bee46398487bceb/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:29.673204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1366f50-a0b9-4a1d-b46e-71126b3c7005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5bd24cfda049509d464a2866053a45, user_id=2efccbdf27ea40868bee46398487bceb, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:29.675890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1366f50-a0b9-4a1d-b46e-71126b3c7005 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:29.690338 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4013/8122] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:29 2021] PUT /identity/v3/projects/9f5bd24cfda049509d464a2866053a45/users/2efccbdf27ea40868bee46398487bceb/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:29.695383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29bd78-cf11-43a5-842d-7ea93e3204a3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:29.707778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29bd78-cf11-43a5-842d-7ea93e3204a3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:29.771112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbf8d3-783d-4d21-9458-f0fd97f96a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:29.771944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbf8d3-783d-4d21-9458-f0fd97f96a7c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:29.772339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbf8d3-783d-4d21-9458-f0fd97f96a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:29.772589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbf8d3-783d-4d21-9458-f0fd97f96a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:29.773673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbf8d3-783d-4d21-9458-f0fd97f96a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:29.775433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbf8d3-783d-4d21-9458-f0fd97f96a7c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:29.786345 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4110/8123] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:29 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:29.791042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1366f50-a0b9-4a1d-b46e-71126b3c7005 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:29.792005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbf8d3-783d-4d21-9458-f0fd97f96a7c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:29.795772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-52cbf8d3-783d-4d21-9458-f0fd97f96a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:29.802469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1366f50-a0b9-4a1d-b46e-71126b3c7005 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:29.808127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d229f-8dc9-4efd-8b89-6f57cd0da20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:29.809036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d229f-8dc9-4efd-8b89-6f57cd0da20d admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:29.809279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbf8d3-783d-4d21-9458-f0fd97f96a7c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:29.809382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d229f-8dc9-4efd-8b89-6f57cd0da20d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:29.809583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d229f-8dc9-4efd-8b89-6f57cd0da20d admin admin] PATH_INFO: `/v3/projects/9f5bd24cfda049509d464a2866053a45/users/2efccbdf27ea40868bee46398487bceb/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:29.812120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d229f-8dc9-4efd-8b89-6f57cd0da20d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5bd24cfda049509d464a2866053a45, user_id=2efccbdf27ea40868bee46398487bceb, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:29.814763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d229f-8dc9-4efd-8b89-6f57cd0da20d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:29.815142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4babd91-de6a-430a-abbf-3b5281bbedae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:29.816280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4babd91-de6a-430a-abbf-3b5281bbedae admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:29.816567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4babd91-de6a-430a-abbf-3b5281bbedae admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:29.816844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4babd91-de6a-430a-abbf-3b5281bbedae admin admin] PATH_INFO: `/v3/users/26b847b1d5f144fbb9c2e95bd76450b6` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:29.818144 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4babd91-de6a-430a-abbf-3b5281bbedae admin admin] RBAC: Authorizing `identity:delete_user(user_id=26b847b1d5f144fbb9c2e95bd76450b6)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:29.820252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4babd91-de6a-430a-abbf-3b5281bbedae admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:29.825463 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4014/8124] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:29 2021] PUT /identity/v3/projects/9f5bd24cfda049509d464a2866053a45/users/2efccbdf27ea40868bee46398487bceb/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:29.836481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feb6e4-003c-46eb-aefe-f64842061804 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:29.836773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feb6e4-003c-46eb-aefe-f64842061804 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:29.837048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feb6e4-003c-46eb-aefe-f64842061804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:29.862997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-75feb6e4-003c-46eb-aefe-f64842061804 None None] MFA Rules not processed for user `2efccbdf27ea40868bee46398487bceb`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:29.864191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-75feb6e4-003c-46eb-aefe-f64842061804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:29.866799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b4babd91-de6a-430a-abbf-3b5281bbedae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26b847b1d5f144fbb9c2e95bd76450b6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:29.874145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b4babd91-de6a-430a-abbf-3b5281bbedae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26b847b1d5f144fbb9c2e95bd76450b6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:29.874854 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b4babd91-de6a-430a-abbf-3b5281bbedae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26b847b1d5f144fbb9c2e95bd76450b6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:29.886557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b4babd91-de6a-430a-abbf-3b5281bbedae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26b847b1d5f144fbb9c2e95bd76450b6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:29.894704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b4babd91-de6a-430a-abbf-3b5281bbedae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26b847b1d5f144fbb9c2e95bd76450b6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:29.900744 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4111/8125] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:29 2021] DELETE /identity/v3/users/26b847b1d5f144fbb9c2e95bd76450b6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:29.905094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be87e82-8dcd-40a9-93e7-f0a89729e2ae None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:29.905409 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be87e82-8dcd-40a9-93e7-f0a89729e2ae None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:29.905671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be87e82-8dcd-40a9-93e7-f0a89729e2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:29.922541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1be87e82-8dcd-40a9-93e7-f0a89729e2ae None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:29.923739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1be87e82-8dcd-40a9-93e7-f0a89729e2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:29.932660 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4015/8126] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:29 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:18:29.943708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75feb6e4-003c-46eb-aefe-f64842061804 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:29.945032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-75feb6e4-003c-46eb-aefe-f64842061804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:29.981871 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4112/8127] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:18:29.992098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be87e82-8dcd-40a9-93e7-f0a89729e2ae None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:29.993485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1be87e82-8dcd-40a9-93e7-f0a89729e2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:30.003295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75feb6e4-003c-46eb-aefe-f64842061804 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:30.060966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c898a8-d130-496e-a22a-e9216925f602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:30.061620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c898a8-d130-496e-a22a-e9216925f602 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:30.061911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c898a8-d130-496e-a22a-e9216925f602 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:30.062194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c898a8-d130-496e-a22a-e9216925f602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:30.064726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be87e82-8dcd-40a9-93e7-f0a89729e2ae None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:30.069164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fde5d-b182-4f4b-82da-197d005ebaf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:30.069319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fde5d-b182-4f4b-82da-197d005ebaf0 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:30.069605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fde5d-b182-4f4b-82da-197d005ebaf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:30.069881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fde5d-b182-4f4b-82da-197d005ebaf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:30.079488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fde5d-b182-4f4b-82da-197d005ebaf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:30.080935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fde5d-b182-4f4b-82da-197d005ebaf0 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:30.090567 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4113/8128] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:18:30.124322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c898a8-d130-496e-a22a-e9216925f602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:30.126055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c898a8-d130-496e-a22a-e9216925f602 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:30.136489 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4016/8129] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:29 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:18:30.367764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fde5d-b182-4f4b-82da-197d005ebaf0 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:30.369254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-038fde5d-b182-4f4b-82da-197d005ebaf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:30.390623 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fde5d-b182-4f4b-82da-197d005ebaf0 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:30.396616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996dc3b-6a06-491f-bb38-b9c33520d45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:30.397489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996dc3b-6a06-491f-bb38-b9c33520d45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:30.397835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996dc3b-6a06-491f-bb38-b9c33520d45c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:30.398278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996dc3b-6a06-491f-bb38-b9c33520d45c admin admin] PATH_INFO: `/v3/projects/77c414586ca040b6ab572fb952debf9b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:30.399743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996dc3b-6a06-491f-bb38-b9c33520d45c admin admin] RBAC: Authorizing `identity:delete_project(project_id=77c414586ca040b6ab572fb952debf9b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:30.401900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996dc3b-6a06-491f-bb38-b9c33520d45c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:30.420718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c898a8-d130-496e-a22a-e9216925f602 service cinder] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:30.422309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-09c898a8-d130-496e-a22a-e9216925f602 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:30.436861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c898a8-d130-496e-a22a-e9216925f602 service cinder] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:30.441933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f10ca-b35f-4b18-ac39-33272b6c08a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:30.442985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f10ca-b35f-4b18-ac39-33272b6c08a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:30.443283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f10ca-b35f-4b18-ac39-33272b6c08a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:30.443566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f10ca-b35f-4b18-ac39-33272b6c08a8 admin admin] PATH_INFO: `/v3/users/491a015d11b1429787d611cff51c6824` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:30.444818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f10ca-b35f-4b18-ac39-33272b6c08a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=491a015d11b1429787d611cff51c6824)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:30.446810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f10ca-b35f-4b18-ac39-33272b6c08a8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:30.454780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6996dc3b-6a06-491f-bb38-b9c33520d45c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77c414586ca040b6ab572fb952debf9b', 'request_id': 'req-6996dc3b-6a06-491f-bb38-b9c33520d45c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:30.460846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6996dc3b-6a06-491f-bb38-b9c33520d45c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77c414586ca040b6ab572fb952debf9b', 'request_id': 'req-6996dc3b-6a06-491f-bb38-b9c33520d45c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:30.469887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6996dc3b-6a06-491f-bb38-b9c33520d45c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77c414586ca040b6ab572fb952debf9b', 'request_id': 'req-6996dc3b-6a06-491f-bb38-b9c33520d45c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:30.482345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6996dc3b-6a06-491f-bb38-b9c33520d45c admin admin] The token cache is being invalidate because project 77c414586ca040b6ab572fb952debf9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:30.482896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6996dc3b-6a06-491f-bb38-b9c33520d45c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:30.483679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6996dc3b-6a06-491f-bb38-b9c33520d45c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:30.485398 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4114/8130] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:30 2021] DELETE /identity/v3/projects/77c414586ca040b6ab572fb952debf9b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:30.489323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996dc3b-6a06-491f-bb38-b9c33520d45c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:30.490757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6996dc3b-6a06-491f-bb38-b9c33520d45c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:30.495170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a36f10ca-b35f-4b18-ac39-33272b6c08a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '491a015d11b1429787d611cff51c6824'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:30.501845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a36f10ca-b35f-4b18-ac39-33272b6c08a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '491a015d11b1429787d611cff51c6824'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:30.513397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a36f10ca-b35f-4b18-ac39-33272b6c08a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '491a015d11b1429787d611cff51c6824'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:30.514124 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a36f10ca-b35f-4b18-ac39-33272b6c08a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '491a015d11b1429787d611cff51c6824'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:30.522173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a36f10ca-b35f-4b18-ac39-33272b6c08a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '491a015d11b1429787d611cff51c6824'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:30.528917 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4017/8131] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:30 2021] DELETE /identity/v3/users/491a015d11b1429787d611cff51c6824 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:30.533434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba378d21-98a7-467c-b34d-ba10ebb7fd1d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:30.533776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba378d21-98a7-467c-b34d-ba10ebb7fd1d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:30.534084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba378d21-98a7-467c-b34d-ba10ebb7fd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:30.551793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ba378d21-98a7-467c-b34d-ba10ebb7fd1d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:30.552927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ba378d21-98a7-467c-b34d-ba10ebb7fd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:30.554084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996dc3b-6a06-491f-bb38-b9c33520d45c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:30.608967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17503d06-fdb5-4af6-8fc0-0392ccea2639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:30.609840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17503d06-fdb5-4af6-8fc0-0392ccea2639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:30.610124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17503d06-fdb5-4af6-8fc0-0392ccea2639 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:30.610442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17503d06-fdb5-4af6-8fc0-0392ccea2639 admin admin] PATH_INFO: `/v3/users/97fda1f4298d4fc8812e7bbdcd810f8b` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:30.610609 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4018/8132] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:18:30.612529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17503d06-fdb5-4af6-8fc0-0392ccea2639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97fda1f4298d4fc8812e7bbdcd810f8b)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:30.614535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17503d06-fdb5-4af6-8fc0-0392ccea2639 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:30.620854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba378d21-98a7-467c-b34d-ba10ebb7fd1d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:30.622177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ba378d21-98a7-467c-b34d-ba10ebb7fd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:30.665866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-17503d06-fdb5-4af6-8fc0-0392ccea2639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97fda1f4298d4fc8812e7bbdcd810f8b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:30.673198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-17503d06-fdb5-4af6-8fc0-0392ccea2639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97fda1f4298d4fc8812e7bbdcd810f8b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:30.673886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-17503d06-fdb5-4af6-8fc0-0392ccea2639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97fda1f4298d4fc8812e7bbdcd810f8b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:30.685911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-17503d06-fdb5-4af6-8fc0-0392ccea2639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97fda1f4298d4fc8812e7bbdcd810f8b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:30.688455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba378d21-98a7-467c-b34d-ba10ebb7fd1d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:30.692840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d86b2f-0266-4145-815e-fb792d3a8a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:30.693481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-17503d06-fdb5-4af6-8fc0-0392ccea2639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97fda1f4298d4fc8812e7bbdcd810f8b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:30.693611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d86b2f-0266-4145-815e-fb792d3a8a86 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:30.693872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d86b2f-0266-4145-815e-fb792d3a8a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:30.694151 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d86b2f-0266-4145-815e-fb792d3a8a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:30.695966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f5d86b2f-0266-4145-815e-fb792d3a8a86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:30.699441 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4115/8133] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:30 2021] DELETE /identity/v3/users/97fda1f4298d4fc8812e7bbdcd810f8b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:30.708328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d86b2f-0266-4145-815e-fb792d3a8a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:30.713419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d86b2f-0266-4145-815e-fb792d3a8a86 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:30.726321 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4019/8134] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:18:31.063457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17503d06-fdb5-4af6-8fc0-0392ccea2639 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:31.065581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-17503d06-fdb5-4af6-8fc0-0392ccea2639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:31.119069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d86b2f-0266-4145-815e-fb792d3a8a86 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:31.121175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f5d86b2f-0266-4145-815e-fb792d3a8a86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:31.143496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d86b2f-0266-4145-815e-fb792d3a8a86 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:31.146558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17503d06-fdb5-4af6-8fc0-0392ccea2639 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:31.151742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:31.152768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:31.153043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:31.153974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9 admin admin] PATH_INFO: `/v3/projects/fa039515df6e41be860338989ab70b54` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:31.155638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa039515df6e41be860338989ab70b54)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:31.157557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:31.163089 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2762a8-67ea-4c15-9f6b-35ccb58d6490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:31.163979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2762a8-67ea-4c15-9f6b-35ccb58d6490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:31.164266 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2762a8-67ea-4c15-9f6b-35ccb58d6490 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:31.164544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2762a8-67ea-4c15-9f6b-35ccb58d6490 admin admin] PATH_INFO: `/v3/projects/1833fb6c56f14ceeb9869f19947f5157` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:31.166417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2762a8-67ea-4c15-9f6b-35ccb58d6490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1833fb6c56f14ceeb9869f19947f5157)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:31.168339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2762a8-67ea-4c15-9f6b-35ccb58d6490 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:31.215724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa039515df6e41be860338989ab70b54', 'request_id': 'req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.221751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa039515df6e41be860338989ab70b54', 'request_id': 'req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.224875 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-aa2762a8-67ea-4c15-9f6b-35ccb58d6490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1833fb6c56f14ceeb9869f19947f5157', 'request_id': 'req-aa2762a8-67ea-4c15-9f6b-35ccb58d6490'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.230217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa039515df6e41be860338989ab70b54', 'request_id': 'req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.231965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-aa2762a8-67ea-4c15-9f6b-35ccb58d6490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1833fb6c56f14ceeb9869f19947f5157', 'request_id': 'req-aa2762a8-67ea-4c15-9f6b-35ccb58d6490'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.237492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-aa2762a8-67ea-4c15-9f6b-35ccb58d6490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1833fb6c56f14ceeb9869f19947f5157', 'request_id': 'req-aa2762a8-67ea-4c15-9f6b-35ccb58d6490'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.240552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9 admin admin] The token cache is being invalidate because project fa039515df6e41be860338989ab70b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:31.240875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.241712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.243679 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4116/8135] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:31 2021] DELETE /identity/v3/projects/fa039515df6e41be860338989ab70b54 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:31.248628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:31.249937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:31.250838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-aa2762a8-67ea-4c15-9f6b-35ccb58d6490 admin admin] The token cache is being invalidate because project 1833fb6c56f14ceeb9869f19947f5157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:31.251126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-aa2762a8-67ea-4c15-9f6b-35ccb58d6490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.251794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-aa2762a8-67ea-4c15-9f6b-35ccb58d6490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.253303 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4020/8136] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:31 2021] DELETE /identity/v3/projects/1833fb6c56f14ceeb9869f19947f5157 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:31.258801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a1502-5b5f-43cc-9914-21ebb41a9d3d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:31.259091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a1502-5b5f-43cc-9914-21ebb41a9d3d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:31.259404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a1502-5b5f-43cc-9914-21ebb41a9d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:31.277905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ba0a1502-5b5f-43cc-9914-21ebb41a9d3d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:31.279418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ba0a1502-5b5f-43cc-9914-21ebb41a9d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:31.311811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bc74f-b38c-437b-b9c7-f86ff15028a9 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:31.339358 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4021/8137] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:18:31.346990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036145d-702c-46d3-9845-1005c337c248 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:31.347288 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036145d-702c-46d3-9845-1005c337c248 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:31.347574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036145d-702c-46d3-9845-1005c337c248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:31.365354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c036145d-702c-46d3-9845-1005c337c248 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:31.365851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16beaa17-50df-4669-a5d4-fda1a9cb1773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:31.366581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c036145d-702c-46d3-9845-1005c337c248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:31.366760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beaa17-50df-4669-a5d4-fda1a9cb1773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:31.367041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beaa17-50df-4669-a5d4-fda1a9cb1773 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:31.367315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beaa17-50df-4669-a5d4-fda1a9cb1773 admin admin] PATH_INFO: `/v3/users/2efccbdf27ea40868bee46398487bceb` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:31.368526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16beaa17-50df-4669-a5d4-fda1a9cb1773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2efccbdf27ea40868bee46398487bceb)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:31.370464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16beaa17-50df-4669-a5d4-fda1a9cb1773 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:31.375051 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4022/8138] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:18:31.378994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036145d-702c-46d3-9845-1005c337c248 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:31.388337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036145d-702c-46d3-9845-1005c337c248 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:31.392986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f275248-5842-4463-b173-a49b9f3d2084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:31.393645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f275248-5842-4463-b173-a49b9f3d2084 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:31.393936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f275248-5842-4463-b173-a49b9f3d2084 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:31.394215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f275248-5842-4463-b173-a49b9f3d2084 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:31.394977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f275248-5842-4463-b173-a49b9f3d2084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:18:31.395287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f275248-5842-4463-b173-a49b9f3d2084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:31.396865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f275248-5842-4463-b173-a49b9f3d2084 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:31.411034 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4023/8139] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:18:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:18:31.415275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f275248-5842-4463-b173-a49b9f3d2084 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:31.418911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-16beaa17-50df-4669-a5d4-fda1a9cb1773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2efccbdf27ea40868bee46398487bceb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.425883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f275248-5842-4463-b173-a49b9f3d2084 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:31.426525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-16beaa17-50df-4669-a5d4-fda1a9cb1773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2efccbdf27ea40868bee46398487bceb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.428511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-16beaa17-50df-4669-a5d4-fda1a9cb1773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2efccbdf27ea40868bee46398487bceb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.432573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6a775-01ee-4bbb-b586-4d90f7baf026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:31.433221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6a775-01ee-4bbb-b586-4d90f7baf026 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:31.433504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6a775-01ee-4bbb-b586-4d90f7baf026 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:31.433784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6a775-01ee-4bbb-b586-4d90f7baf026 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:31.434510 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6a775-01ee-4bbb-b586-4d90f7baf026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:31.436928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6a775-01ee-4bbb-b586-4d90f7baf026 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:31.440762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-16beaa17-50df-4669-a5d4-fda1a9cb1773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2efccbdf27ea40868bee46398487bceb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.448597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-16beaa17-50df-4669-a5d4-fda1a9cb1773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2efccbdf27ea40868bee46398487bceb'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.455870 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4117/8140] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:31 2021] DELETE /identity/v3/users/2efccbdf27ea40868bee46398487bceb => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:31.471006 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4024/8141] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:31 2021] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:31.472081 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16beaa17-50df-4669-a5d4-fda1a9cb1773 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:31.473565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-16beaa17-50df-4669-a5d4-fda1a9cb1773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:31.539678 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16beaa17-50df-4669-a5d4-fda1a9cb1773 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:31.597465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf47554-a6ad-41f3-829f-fb7ddb1c6f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:31.597957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf47554-a6ad-41f3-829f-fb7ddb1c6f09 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:31.598241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf47554-a6ad-41f3-829f-fb7ddb1c6f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:31.598552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf47554-a6ad-41f3-829f-fb7ddb1c6f09 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:31.599265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf47554-a6ad-41f3-829f-fb7ddb1c6f09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:31.601216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf47554-a6ad-41f3-829f-fb7ddb1c6f09 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:31.621822 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4118/8142] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:31 2021] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:31.626724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6a775-01ee-4bbb-b586-4d90f7baf026 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:31.639150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6a775-01ee-4bbb-b586-4d90f7baf026 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:31.643776 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33447983-6294-40f7-973b-2aa458a24a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:31.644440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33447983-6294-40f7-973b-2aa458a24a67 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:31.644723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33447983-6294-40f7-973b-2aa458a24a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:31.645099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33447983-6294-40f7-973b-2aa458a24a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:31.645841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33447983-6294-40f7-973b-2aa458a24a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:31.647464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33447983-6294-40f7-973b-2aa458a24a67 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:31.657438 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4025/8143] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:31 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:18:31.662014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf47554-a6ad-41f3-829f-fb7ddb1c6f09 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:31.673570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf47554-a6ad-41f3-829f-fb7ddb1c6f09 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:31.678435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671225c2-0385-4a41-91bf-f55244668877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:31.679097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671225c2-0385-4a41-91bf-f55244668877 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:31.679383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671225c2-0385-4a41-91bf-f55244668877 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:31.679693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671225c2-0385-4a41-91bf-f55244668877 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:31.680462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671225c2-0385-4a41-91bf-f55244668877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:31.682061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671225c2-0385-4a41-91bf-f55244668877 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:31.693184 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4119/8144] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:31 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:31.697339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33447983-6294-40f7-973b-2aa458a24a67 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:31.707437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33447983-6294-40f7-973b-2aa458a24a67 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:31.712574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf95bb6-1770-4fc3-b35f-b5b2d275676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:31.713481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf95bb6-1770-4fc3-b35f-b5b2d275676d admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:31.713747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf95bb6-1770-4fc3-b35f-b5b2d275676d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:31.714021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf95bb6-1770-4fc3-b35f-b5b2d275676d admin admin] PATH_INFO: `/v3/projects/3db6eb840e0d408682a2e8cb8b14d6ce/users/69f55678adb040638581ec6a8d0c72f5/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:31.729744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf95bb6-1770-4fc3-b35f-b5b2d275676d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db6eb840e0d408682a2e8cb8b14d6ce, user_id=69f55678adb040638581ec6a8d0c72f5, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:31.732948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf95bb6-1770-4fc3-b35f-b5b2d275676d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:31.739771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671225c2-0385-4a41-91bf-f55244668877 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:31.741665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-671225c2-0385-4a41-91bf-f55244668877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:31.755105 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4026/8145] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:31 2021] PUT /identity/v3/projects/3db6eb840e0d408682a2e8cb8b14d6ce/users/69f55678adb040638581ec6a8d0c72f5/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:31.756463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671225c2-0385-4a41-91bf-f55244668877 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:31.765183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d5412-ec44-4229-98e5-58df064b9926 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:31.765735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d5412-ec44-4229-98e5-58df064b9926 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:31.766106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d5412-ec44-4229-98e5-58df064b9926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:31.797648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9b9d5412-ec44-4229-98e5-58df064b9926 None None] MFA Rules not processed for user `69f55678adb040638581ec6a8d0c72f5`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:31.798780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9b9d5412-ec44-4229-98e5-58df064b9926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:31.815330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d4581-1134-4a0e-80e4-51046863df11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:31.816467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d4581-1134-4a0e-80e4-51046863df11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:31.816759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d4581-1134-4a0e-80e4-51046863df11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:31.817045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d4581-1134-4a0e-80e4-51046863df11 admin admin] PATH_INFO: `/v3/projects/9f5bd24cfda049509d464a2866053a45` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:31.818297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d4581-1134-4a0e-80e4-51046863df11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f5bd24cfda049509d464a2866053a45)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:31.820228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d4581-1134-4a0e-80e4-51046863df11 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:31.863410 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4027/8146] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:31 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:18:31.867610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d5412-ec44-4229-98e5-58df064b9926 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:31.868422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d01d4581-1134-4a0e-80e4-51046863df11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f5bd24cfda049509d464a2866053a45', 'request_id': 'req-d01d4581-1134-4a0e-80e4-51046863df11'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.875336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d01d4581-1134-4a0e-80e4-51046863df11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f5bd24cfda049509d464a2866053a45', 'request_id': 'req-d01d4581-1134-4a0e-80e4-51046863df11'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.878488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d5412-ec44-4229-98e5-58df064b9926 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:31.882880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d01d4581-1134-4a0e-80e4-51046863df11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f5bd24cfda049509d464a2866053a45', 'request_id': 'req-d01d4581-1134-4a0e-80e4-51046863df11'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.893810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d01d4581-1134-4a0e-80e4-51046863df11 admin admin] The token cache is being invalidate because project 9f5bd24cfda049509d464a2866053a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:31.894102 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d01d4581-1134-4a0e-80e4-51046863df11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.894799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d01d4581-1134-4a0e-80e4-51046863df11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:31.896366 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4120/8147] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:31 2021] DELETE /identity/v3/projects/9f5bd24cfda049509d464a2866053a45 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:31.902852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee8268-3fcc-49d8-ad90-f31bd80b5ee3 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:31.903141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee8268-3fcc-49d8-ad90-f31bd80b5ee3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:31.903466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee8268-3fcc-49d8-ad90-f31bd80b5ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:31.921935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-01ee8268-3fcc-49d8-ad90-f31bd80b5ee3 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:31.923170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-01ee8268-3fcc-49d8-ad90-f31bd80b5ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:31.933191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc3107-598c-45ec-938b-246de5f8a60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:31.933848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc3107-598c-45ec-938b-246de5f8a60b admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:31.934134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc3107-598c-45ec-938b-246de5f8a60b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:31.934447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc3107-598c-45ec-938b-246de5f8a60b admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:31.935762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc3107-598c-45ec-938b-246de5f8a60b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:31.937639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc3107-598c-45ec-938b-246de5f8a60b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:31.972915 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4028/8148] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:31 2021] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:31.973859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc3107-598c-45ec-938b-246de5f8a60b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:31.975427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ffdc3107-598c-45ec-938b-246de5f8a60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:31.988637 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4121/8149] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:18:31.996235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267f059-b429-4185-8225-6500abb57a47 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:31.996528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267f059-b429-4185-8225-6500abb57a47 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:31.996839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267f059-b429-4185-8225-6500abb57a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.014197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3267f059-b429-4185-8225-6500abb57a47 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:32.015436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3267f059-b429-4185-8225-6500abb57a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:32.047792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc3107-598c-45ec-938b-246de5f8a60b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.053022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a43e87-8d1c-45d3-b469-5890a24e26fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.053898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a43e87-8d1c-45d3-b469-5890a24e26fc admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.054336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a43e87-8d1c-45d3-b469-5890a24e26fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.054625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a43e87-8d1c-45d3-b469-5890a24e26fc admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.055330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a43e87-8d1c-45d3-b469-5890a24e26fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.057551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a43e87-8d1c-45d3-b469-5890a24e26fc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.078423 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4122/8150] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:18:32.079347 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4029/8151] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:31 2021] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:32.082564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267f059-b429-4185-8225-6500abb57a47 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.082721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a43e87-8d1c-45d3-b469-5890a24e26fc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.091626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267f059-b429-4185-8225-6500abb57a47 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.092168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a43e87-8d1c-45d3-b469-5890a24e26fc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.096379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e5047-9b35-4679-b3f2-7840c862576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.096751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799a82b-9fc2-4cd4-9239-db7e7c3fa50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.097026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e5047-9b35-4679-b3f2-7840c862576e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.097323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e5047-9b35-4679-b3f2-7840c862576e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.097417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799a82b-9fc2-4cd4-9239-db7e7c3fa50a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.097594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e5047-9b35-4679-b3f2-7840c862576e admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.097697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799a82b-9fc2-4cd4-9239-db7e7c3fa50a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.097926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799a82b-9fc2-4cd4-9239-db7e7c3fa50a admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.098393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e5047-9b35-4679-b3f2-7840c862576e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:18:32.098671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e5047-9b35-4679-b3f2-7840c862576e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.098782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799a82b-9fc2-4cd4-9239-db7e7c3fa50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.100238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799a82b-9fc2-4cd4-9239-db7e7c3fa50a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.100351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e5047-9b35-4679-b3f2-7840c862576e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.110121 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4030/8152] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:32 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:32.114945 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4123/8153] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:18:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:18:32.115104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799a82b-9fc2-4cd4-9239-db7e7c3fa50a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.115889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e5047-9b35-4679-b3f2-7840c862576e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.124163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799a82b-9fc2-4cd4-9239-db7e7c3fa50a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.125961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e5047-9b35-4679-b3f2-7840c862576e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.128797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2f285-f5dc-4d5f-b8c2-6d006d163a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.129662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2f285-f5dc-4d5f-b8c2-6d006d163a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.129935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2f285-f5dc-4d5f-b8c2-6d006d163a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.130212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2f285-f5dc-4d5f-b8c2-6d006d163a34 admin admin] PATH_INFO: `/v3/projects/29722b54d9a743da8d755660aa95954c/users/c37d59978df54c4f94bef38a43c9fd43/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.130828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcff2d8-65ee-4d98-a786-a4c623bef815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.131457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcff2d8-65ee-4d98-a786-a4c623bef815 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.131742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcff2d8-65ee-4d98-a786-a4c623bef815 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.132025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcff2d8-65ee-4d98-a786-a4c623bef815 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.132717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcff2d8-65ee-4d98-a786-a4c623bef815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.134632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcff2d8-65ee-4d98-a786-a4c623bef815 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.145604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2f285-f5dc-4d5f-b8c2-6d006d163a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29722b54d9a743da8d755660aa95954c, user_id=c37d59978df54c4f94bef38a43c9fd43, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.148232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2f285-f5dc-4d5f-b8c2-6d006d163a34 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.164427 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4124/8154] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:32 2021] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:32.164620 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4031/8155] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:32 2021] PUT /identity/v3/projects/29722b54d9a743da8d755660aa95954c/users/c37d59978df54c4f94bef38a43c9fd43/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:32.166025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2f285-f5dc-4d5f-b8c2-6d006d163a34 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.166157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcff2d8-65ee-4d98-a786-a4c623bef815 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.225852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2f285-f5dc-4d5f-b8c2-6d006d163a34 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.226414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcff2d8-65ee-4d98-a786-a4c623bef815 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.230796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbb8fe-969f-4d92-ac16-5a7616f4bf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.231042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b35318-97bb-43ef-93bd-7d20eed46461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.231618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbb8fe-969f-4d92-ac16-5a7616f4bf72 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.231748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b35318-97bb-43ef-93bd-7d20eed46461 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.231909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbb8fe-969f-4d92-ac16-5a7616f4bf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.232010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b35318-97bb-43ef-93bd-7d20eed46461 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.232186 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbb8fe-969f-4d92-ac16-5a7616f4bf72 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.232278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b35318-97bb-43ef-93bd-7d20eed46461 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.232902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b35318-97bb-43ef-93bd-7d20eed46461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.233001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbb8fe-969f-4d92-ac16-5a7616f4bf72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.235019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b35318-97bb-43ef-93bd-7d20eed46461 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.238099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbb8fe-969f-4d92-ac16-5a7616f4bf72 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.251366 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4032/8156] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:32 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:32.255672 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4125/8157] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:32 2021] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:32.255800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbb8fe-969f-4d92-ac16-5a7616f4bf72 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.259204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b35318-97bb-43ef-93bd-7d20eed46461 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.266120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbb8fe-969f-4d92-ac16-5a7616f4bf72 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.269281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b35318-97bb-43ef-93bd-7d20eed46461 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.270710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f880f7-a50b-4e66-8837-16c0c0a12de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.271570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f880f7-a50b-4e66-8837-16c0c0a12de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.271860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f880f7-a50b-4e66-8837-16c0c0a12de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.272135 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f880f7-a50b-4e66-8837-16c0c0a12de7 admin admin] PATH_INFO: `/v3/projects/29722b54d9a743da8d755660aa95954c/users/c37d59978df54c4f94bef38a43c9fd43/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.274071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f880f7-a50b-4e66-8837-16c0c0a12de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29722b54d9a743da8d755660aa95954c, user_id=c37d59978df54c4f94bef38a43c9fd43, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.274276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fa969-c0a0-4aee-846a-9219d503a93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.274918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fa969-c0a0-4aee-846a-9219d503a93a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.275208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fa969-c0a0-4aee-846a-9219d503a93a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.275488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fa969-c0a0-4aee-846a-9219d503a93a admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.276212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fa969-c0a0-4aee-846a-9219d503a93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.276704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f880f7-a50b-4e66-8837-16c0c0a12de7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.277789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fa969-c0a0-4aee-846a-9219d503a93a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.287286 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4033/8158] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:32 2021] PUT /identity/v3/projects/29722b54d9a743da8d755660aa95954c/users/c37d59978df54c4f94bef38a43c9fd43/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:32.290278 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4126/8159] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:32 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:18:32.291573 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f880f7-a50b-4e66-8837-16c0c0a12de7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.298194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dc9b3-b704-419a-b72b-ce31abc5b83a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.298498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dc9b3-b704-419a-b72b-ce31abc5b83a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.298787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dc9b3-b704-419a-b72b-ce31abc5b83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.327233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f73dc9b3-b704-419a-b72b-ce31abc5b83a None None] MFA Rules not processed for user `c37d59978df54c4f94bef38a43c9fd43`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:32.328464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f73dc9b3-b704-419a-b72b-ce31abc5b83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:32.353318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f880f7-a50b-4e66-8837-16c0c0a12de7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.358539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aedbe3-9957-4080-af97-45baf396f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.359199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aedbe3-9957-4080-af97-45baf396f6bc admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.359515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aedbe3-9957-4080-af97-45baf396f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.359791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aedbe3-9957-4080-af97-45baf396f6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.360815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aedbe3-9957-4080-af97-45baf396f6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.362133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aedbe3-9957-4080-af97-45baf396f6bc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.372059 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4034/8160] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:32 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:18:32.376658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aedbe3-9957-4080-af97-45baf396f6bc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.386045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aedbe3-9957-4080-af97-45baf396f6bc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.390892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc29e7d-ad79-4db7-b950-06ccd64e4c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.391765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc29e7d-ad79-4db7-b950-06ccd64e4c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.392052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc29e7d-ad79-4db7-b950-06ccd64e4c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.392331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc29e7d-ad79-4db7-b950-06ccd64e4c8a admin admin] PATH_INFO: `/v3/projects/443754b6c278464ea41c9a3d3530643a/users/fe6a996f07dc42d686a737b4f2fc08c2/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.394624 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4127/8161] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:32 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:32.405438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dc9b3-b704-419a-b72b-ce31abc5b83a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.406784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f73dc9b3-b704-419a-b72b-ce31abc5b83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:32.406971 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc29e7d-ad79-4db7-b950-06ccd64e4c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=443754b6c278464ea41c9a3d3530643a, user_id=fe6a996f07dc42d686a737b4f2fc08c2, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.409608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc29e7d-ad79-4db7-b950-06ccd64e4c8a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.423081 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4035/8162] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:32 2021] PUT /identity/v3/projects/443754b6c278464ea41c9a3d3530643a/users/fe6a996f07dc42d686a737b4f2fc08c2/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:32.432709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eeccb-c04f-4fe2-8ae2-79ebc4b935f2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.433294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eeccb-c04f-4fe2-8ae2-79ebc4b935f2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.433294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eeccb-c04f-4fe2-8ae2-79ebc4b935f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.461415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9d4eeccb-c04f-4fe2-8ae2-79ebc4b935f2 None None] MFA Rules not processed for user `fe6a996f07dc42d686a737b4f2fc08c2`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:32.462681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9d4eeccb-c04f-4fe2-8ae2-79ebc4b935f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:32.471088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dc9b3-b704-419a-b72b-ce31abc5b83a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.518671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebc439-9b92-436f-8107-df8b2b106e86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.519314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebc439-9b92-436f-8107-df8b2b106e86 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.519594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebc439-9b92-436f-8107-df8b2b106e86 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.519884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebc439-9b92-436f-8107-df8b2b106e86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.526084 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4036/8163] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:32 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:18:32.530348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eeccb-c04f-4fe2-8ae2-79ebc4b935f2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.578967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebc439-9b92-436f-8107-df8b2b106e86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.580321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebc439-9b92-436f-8107-df8b2b106e86 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.589842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eeccb-c04f-4fe2-8ae2-79ebc4b935f2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.590057 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4128/8164] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:32 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:18:32.594538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d1cc7-06db-4e3e-a38b-938ee7a18acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.595196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d1cc7-06db-4e3e-a38b-938ee7a18acf admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.595484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d1cc7-06db-4e3e-a38b-938ee7a18acf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.595765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d1cc7-06db-4e3e-a38b-938ee7a18acf admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.596962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d1cc7-06db-4e3e-a38b-938ee7a18acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.598423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d1cc7-06db-4e3e-a38b-938ee7a18acf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.631595 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4037/8165] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:32 2021] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:32.636297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebc439-9b92-436f-8107-df8b2b106e86 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.646598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebc439-9b92-436f-8107-df8b2b106e86 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.708188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae2273-a125-43ac-a49b-4bb3b8485802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.708860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae2273-a125-43ac-a49b-4bb3b8485802 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.709477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae2273-a125-43ac-a49b-4bb3b8485802 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.709768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae2273-a125-43ac-a49b-4bb3b8485802 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.710516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae2273-a125-43ac-a49b-4bb3b8485802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.712470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae2273-a125-43ac-a49b-4bb3b8485802 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.733289 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4129/8166] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:32 2021] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:32.737161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d1cc7-06db-4e3e-a38b-938ee7a18acf admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.748530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d1cc7-06db-4e3e-a38b-938ee7a18acf admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.753403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a93a8-6c66-4194-af3d-7adb078bd172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.754076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a93a8-6c66-4194-af3d-7adb078bd172 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.754402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a93a8-6c66-4194-af3d-7adb078bd172 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.754678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a93a8-6c66-4194-af3d-7adb078bd172 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.755552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a93a8-6c66-4194-af3d-7adb078bd172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.757128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a93a8-6c66-4194-af3d-7adb078bd172 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.767498 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4038/8167] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:32 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:18:32.771949 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae2273-a125-43ac-a49b-4bb3b8485802 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.782699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae2273-a125-43ac-a49b-4bb3b8485802 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.788487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f782b-2f0c-4648-a406-b59abc5d636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.789353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f782b-2f0c-4648-a406-b59abc5d636a admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.789637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f782b-2f0c-4648-a406-b59abc5d636a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.789911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f782b-2f0c-4648-a406-b59abc5d636a admin admin] PATH_INFO: `/v3/projects/3fe7731efc7741e883ff050018d55d0c/users/7443ace8c1614e259db6a53ee685a78f/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.806867 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f782b-2f0c-4648-a406-b59abc5d636a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe7731efc7741e883ff050018d55d0c, user_id=7443ace8c1614e259db6a53ee685a78f, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.809544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f782b-2f0c-4648-a406-b59abc5d636a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.824887 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4130/8168] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:32 2021] PUT /identity/v3/projects/3fe7731efc7741e883ff050018d55d0c/users/7443ace8c1614e259db6a53ee685a78f/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:32.829448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a93a8-6c66-4194-af3d-7adb078bd172 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.839553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a93a8-6c66-4194-af3d-7adb078bd172 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.901724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72b516-a0b4-4189-930b-b8fd22fe99cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.902671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72b516-a0b4-4189-930b-b8fd22fe99cc admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.903097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72b516-a0b4-4189-930b-b8fd22fe99cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.903928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72b516-a0b4-4189-930b-b8fd22fe99cc admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.904745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72b516-a0b4-4189-930b-b8fd22fe99cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.906736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72b516-a0b4-4189-930b-b8fd22fe99cc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.907193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f782b-2f0c-4648-a406-b59abc5d636a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.918290 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4039/8169] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:32 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:32.922417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72b516-a0b4-4189-930b-b8fd22fe99cc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:32.932058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72b516-a0b4-4189-930b-b8fd22fe99cc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.936844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df0321-2443-482d-9f8c-b9490c7e9b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:32.937702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df0321-2443-482d-9f8c-b9490c7e9b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.937986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df0321-2443-482d-9f8c-b9490c7e9b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.938293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df0321-2443-482d-9f8c-b9490c7e9b13 admin admin] PATH_INFO: `/v3/projects/3fe7731efc7741e883ff050018d55d0c/users/7443ace8c1614e259db6a53ee685a78f/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.940272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df0321-2443-482d-9f8c-b9490c7e9b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe7731efc7741e883ff050018d55d0c, user_id=7443ace8c1614e259db6a53ee685a78f, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:32.944224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df0321-2443-482d-9f8c-b9490c7e9b13 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:32.955271 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4040/8170] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:32 2021] PUT /identity/v3/projects/3fe7731efc7741e883ff050018d55d0c/users/7443ace8c1614e259db6a53ee685a78f/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:32.966925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb3c1b-38f9-4519-bc2f-6f67dc1c821e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:32.967229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb3c1b-38f9-4519-bc2f-6f67dc1c821e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:32.967494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb3c1b-38f9-4519-bc2f-6f67dc1c821e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:32.973712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f782b-2f0c-4648-a406-b59abc5d636a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:32.995749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-67bb3c1b-38f9-4519-bc2f-6f67dc1c821e None None] MFA Rules not processed for user `7443ace8c1614e259db6a53ee685a78f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:32.996938 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-67bb3c1b-38f9-4519-bc2f-6f67dc1c821e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:33.029620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b11c1-3dae-410d-aba4-4ede79f3954a tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37d59978df54c4f94bef38a43c9fd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29722b54d9a743da8d755660aa95954c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:33.030304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b11c1-3dae-410d-aba4-4ede79f3954a tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:33.030591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b11c1-3dae-410d-aba4-4ede79f3954a tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:33.030899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b11c1-3dae-410d-aba4-4ede79f3954a tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:33.031626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b11c1-3dae-410d-aba4-4ede79f3954a tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:18:33.031936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b11c1-3dae-410d-aba4-4ede79f3954a tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:33.033567 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b11c1-3dae-410d-aba4-4ede79f3954a tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:33.047129 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4131/8171] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:18:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:18:33.050857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b11c1-3dae-410d-aba4-4ede79f3954a tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:33.060351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b11c1-3dae-410d-aba4-4ede79f3954a tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:33.064980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8386a3a-6ef5-4320-a811-df718a9d5e62 tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37d59978df54c4f94bef38a43c9fd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29722b54d9a743da8d755660aa95954c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:33.065648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8386a3a-6ef5-4320-a811-df718a9d5e62 tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:33.066194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8386a3a-6ef5-4320-a811-df718a9d5e62 tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:33.066507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8386a3a-6ef5-4320-a811-df718a9d5e62 tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:33.067201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8386a3a-6ef5-4320-a811-df718a9d5e62 tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:33.069110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8386a3a-6ef5-4320-a811-df718a9d5e62 tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:33.072313 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4041/8172] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:32 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:33.083165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb3c1b-38f9-4519-bc2f-6f67dc1c821e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:33.100427 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4132/8173] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:33 2021] POST /identity/v3/projects => generated 353 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:33.101626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8386a3a-6ef5-4320-a811-df718a9d5e62 tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:33.140651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb3c1b-38f9-4519-bc2f-6f67dc1c821e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:33.163220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8386a3a-6ef5-4320-a811-df718a9d5e62 tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:33.168250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd067ac5-d6c3-48d6-be53-bfff5a24547e tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37d59978df54c4f94bef38a43c9fd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29722b54d9a743da8d755660aa95954c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:33.169205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd067ac5-d6c3-48d6-be53-bfff5a24547e tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:33.169720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd067ac5-d6c3-48d6-be53-bfff5a24547e tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:33.170070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd067ac5-d6c3-48d6-be53-bfff5a24547e tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:33.171001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd067ac5-d6c3-48d6-be53-bfff5a24547e tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:18:33.171314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd067ac5-d6c3-48d6-be53-bfff5a24547e tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:33.173058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd067ac5-d6c3-48d6-be53-bfff5a24547e tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:33.188030 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4133/8174] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:18:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:18:33.190191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dfec9-dfb1-4c65-ba44-3f04e83dc3b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:33.191120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dfec9-dfb1-4c65-ba44-3f04e83dc3b8 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:33.191403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dfec9-dfb1-4c65-ba44-3f04e83dc3b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:33.191675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dfec9-dfb1-4c65-ba44-3f04e83dc3b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:33.220375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd067ac5-d6c3-48d6-be53-bfff5a24547e tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:33.229916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd067ac5-d6c3-48d6-be53-bfff5a24547e tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:33.234569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da3f66-d3e9-498d-be7c-350c93ab5cff tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c37d59978df54c4f94bef38a43c9fd43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29722b54d9a743da8d755660aa95954c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:33.235407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da3f66-d3e9-498d-be7c-350c93ab5cff tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:33.235689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da3f66-d3e9-498d-be7c-350c93ab5cff tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:33.235967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da3f66-d3e9-498d-be7c-350c93ab5cff tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] PATH_INFO: `/v3/projects/4f61bfc258804f9ca8cd49422dd6e18f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:33.237228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da3f66-d3e9-498d-be7c-350c93ab5cff tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4f61bfc258804f9ca8cd49422dd6e18f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:33.239180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da3f66-d3e9-498d-be7c-350c93ab5cff tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:33.250642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176dfec9-dfb1-4c65-ba44-3f04e83dc3b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:33.252061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176dfec9-dfb1-4c65-ba44-3f04e83dc3b8 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:33.261341 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4042/8175] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:33 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:18:33.286715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47da3f66-d3e9-498d-be7c-350c93ab5cff tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f61bfc258804f9ca8cd49422dd6e18f', 'request_id': 'req-47da3f66-d3e9-498d-be7c-350c93ab5cff'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:33.294717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47da3f66-d3e9-498d-be7c-350c93ab5cff tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f61bfc258804f9ca8cd49422dd6e18f', 'request_id': 'req-47da3f66-d3e9-498d-be7c-350c93ab5cff'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:33.302446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47da3f66-d3e9-498d-be7c-350c93ab5cff tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f61bfc258804f9ca8cd49422dd6e18f', 'request_id': 'req-47da3f66-d3e9-498d-be7c-350c93ab5cff'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:33.312916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47da3f66-d3e9-498d-be7c-350c93ab5cff tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] The token cache is being invalidate because project 4f61bfc258804f9ca8cd49422dd6e18f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:33.313208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47da3f66-d3e9-498d-be7c-350c93ab5cff tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:33.313869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-47da3f66-d3e9-498d-be7c-350c93ab5cff tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:33.315515 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4134/8176] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:33 2021] DELETE /identity/v3/projects/4f61bfc258804f9ca8cd49422dd6e18f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:33.335814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dfec9-dfb1-4c65-ba44-3f04e83dc3b8 service cinder] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:33.337226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-176dfec9-dfb1-4c65-ba44-3f04e83dc3b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:33.352710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dfec9-dfb1-4c65-ba44-3f04e83dc3b8 service cinder] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:33.404139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02b9c9-b105-418e-bde7-f9e423907dbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:33.404884 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02b9c9-b105-418e-bde7-f9e423907dbf service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:33.405242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02b9c9-b105-418e-bde7-f9e423907dbf service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:33.405692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02b9c9-b105-418e-bde7-f9e423907dbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:33.407843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4b02b9c9-b105-418e-bde7-f9e423907dbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:33.468977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02b9c9-b105-418e-bde7-f9e423907dbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:33.470433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02b9c9-b105-418e-bde7-f9e423907dbf service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:33.479402 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4043/8177] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:33 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:33.521090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da3f66-d3e9-498d-be7c-350c93ab5cff tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:33.522680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-47da3f66-d3e9-498d-be7c-350c93ab5cff tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:33.592499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da3f66-d3e9-498d-be7c-350c93ab5cff tempest-VolumeQuotaClassesTest-1002034767 tempest-VolumeQuotaClassesTest-1002034767-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:33.597458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9df0d-eff3-48b4-a3e4-628028e0d044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:33.598469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9df0d-eff3-48b4-a3e4-628028e0d044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:33.598787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9df0d-eff3-48b4-a3e4-628028e0d044 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:33.599229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9df0d-eff3-48b4-a3e4-628028e0d044 admin admin] PATH_INFO: `/v3/users/69f55678adb040638581ec6a8d0c72f5` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:33.600608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9df0d-eff3-48b4-a3e4-628028e0d044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69f55678adb040638581ec6a8d0c72f5)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:33.602588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9df0d-eff3-48b4-a3e4-628028e0d044 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:33.653659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-71d9df0d-eff3-48b4-a3e4-628028e0d044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69f55678adb040638581ec6a8d0c72f5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:33.660271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-71d9df0d-eff3-48b4-a3e4-628028e0d044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69f55678adb040638581ec6a8d0c72f5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:33.660929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-71d9df0d-eff3-48b4-a3e4-628028e0d044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69f55678adb040638581ec6a8d0c72f5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:33.672197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-71d9df0d-eff3-48b4-a3e4-628028e0d044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69f55678adb040638581ec6a8d0c72f5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:33.678959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-71d9df0d-eff3-48b4-a3e4-628028e0d044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69f55678adb040638581ec6a8d0c72f5'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:33.685108 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4135/8178] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:33 2021] DELETE /identity/v3/users/69f55678adb040638581ec6a8d0c72f5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:33.689787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f62ec7-369a-45d3-9576-cf3c970b7792 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:33.690083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f62ec7-369a-45d3-9576-cf3c970b7792 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:33.690394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f62ec7-369a-45d3-9576-cf3c970b7792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:33.708237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-63f62ec7-369a-45d3-9576-cf3c970b7792 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:33.709423 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-63f62ec7-369a-45d3-9576-cf3c970b7792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:33.766688 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4044/8179] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:33.776387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9df0d-eff3-48b4-a3e4-628028e0d044 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:33.777764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-71d9df0d-eff3-48b4-a3e4-628028e0d044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:33.835181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9df0d-eff3-48b4-a3e4-628028e0d044 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:33.838793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0676d-dccb-4285-afb6-37f6dd19800c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:33.839423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0676d-dccb-4285-afb6-37f6dd19800c service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:33.839759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0676d-dccb-4285-afb6-37f6dd19800c service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:33.839978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0676d-dccb-4285-afb6-37f6dd19800c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:33.848952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0676d-dccb-4285-afb6-37f6dd19800c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:33.850407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0676d-dccb-4285-afb6-37f6dd19800c service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:33.860232 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4136/8180] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:34.121849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f62ec7-369a-45d3-9576-cf3c970b7792 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:34.123918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-63f62ec7-369a-45d3-9576-cf3c970b7792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:34.136456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f62ec7-369a-45d3-9576-cf3c970b7792 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:34.141137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:34.142001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:34.142340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:34.142636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8 admin admin] PATH_INFO: `/v3/projects/3db6eb840e0d408682a2e8cb8b14d6ce` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:34.144522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db6eb840e0d408682a2e8cb8b14d6ce)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:34.146412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:34.193023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db6eb840e0d408682a2e8cb8b14d6ce', 'request_id': 'req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:34.199143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db6eb840e0d408682a2e8cb8b14d6ce', 'request_id': 'req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:34.204529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db6eb840e0d408682a2e8cb8b14d6ce', 'request_id': 'req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:34.216515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8 admin admin] The token cache is being invalidate because project 3db6eb840e0d408682a2e8cb8b14d6ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:34.216792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:34.217401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:34.218990 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4045/8181] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:34 2021] DELETE /identity/v3/projects/3db6eb840e0d408682a2e8cb8b14d6ce => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:34.222986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0676d-dccb-4285-afb6-37f6dd19800c service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:34.232961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0676d-dccb-4285-afb6-37f6dd19800c service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:34.285230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c5767-34fb-479f-9872-d196e2cf1ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:34.286088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5767-34fb-479f-9872-d196e2cf1ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:34.286434 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5767-34fb-479f-9872-d196e2cf1ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:34.286715 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5767-34fb-479f-9872-d196e2cf1ab3 admin admin] PATH_INFO: `/v3/users/c37d59978df54c4f94bef38a43c9fd43` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:34.287961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c5767-34fb-479f-9872-d196e2cf1ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c37d59978df54c4f94bef38a43c9fd43)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:34.289909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c5767-34fb-479f-9872-d196e2cf1ab3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:34.333444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0d3c5767-34fb-479f-9872-d196e2cf1ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c37d59978df54c4f94bef38a43c9fd43'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:34.340206 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0d3c5767-34fb-479f-9872-d196e2cf1ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c37d59978df54c4f94bef38a43c9fd43'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:34.341363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0d3c5767-34fb-479f-9872-d196e2cf1ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c37d59978df54c4f94bef38a43c9fd43'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:34.352766 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0d3c5767-34fb-479f-9872-d196e2cf1ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c37d59978df54c4f94bef38a43c9fd43'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:34.360571 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-0d3c5767-34fb-479f-9872-d196e2cf1ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c37d59978df54c4f94bef38a43c9fd43'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:34.367048 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4137/8182] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:34 2021] DELETE /identity/v3/users/c37d59978df54c4f94bef38a43c9fd43 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:34.634343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:34.637346 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:34.651098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df6cfe-1f69-4e15-8e1b-988d1f0cb5c8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:34.717246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe61b74-eb30-46b5-bb25-946fa53b80f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:34.717794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe61b74-eb30-46b5-bb25-946fa53b80f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:34.718085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe61b74-eb30-46b5-bb25-946fa53b80f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:34.718462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe61b74-eb30-46b5-bb25-946fa53b80f0 admin admin] PATH_INFO: `/v3/projects/29722b54d9a743da8d755660aa95954c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:34.719699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe61b74-eb30-46b5-bb25-946fa53b80f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29722b54d9a743da8d755660aa95954c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:34.721669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe61b74-eb30-46b5-bb25-946fa53b80f0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:34.769142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bfe61b74-eb30-46b5-bb25-946fa53b80f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29722b54d9a743da8d755660aa95954c', 'request_id': 'req-bfe61b74-eb30-46b5-bb25-946fa53b80f0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:34.775067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bfe61b74-eb30-46b5-bb25-946fa53b80f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29722b54d9a743da8d755660aa95954c', 'request_id': 'req-bfe61b74-eb30-46b5-bb25-946fa53b80f0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:34.780392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bfe61b74-eb30-46b5-bb25-946fa53b80f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29722b54d9a743da8d755660aa95954c', 'request_id': 'req-bfe61b74-eb30-46b5-bb25-946fa53b80f0'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:34.792256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bfe61b74-eb30-46b5-bb25-946fa53b80f0 admin admin] The token cache is being invalidate because project 29722b54d9a743da8d755660aa95954c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:34.792840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bfe61b74-eb30-46b5-bb25-946fa53b80f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:34.793617 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-bfe61b74-eb30-46b5-bb25-946fa53b80f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:34.796183 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4046/8183] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:34 2021] DELETE /identity/v3/projects/29722b54d9a743da8d755660aa95954c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:34.802198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ad39b-1311-4a87-a2f7-bf9a27bf474e None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:34.802509 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ad39b-1311-4a87-a2f7-bf9a27bf474e None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:34.802793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ad39b-1311-4a87-a2f7-bf9a27bf474e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:34.822501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6e0ad39b-1311-4a87-a2f7-bf9a27bf474e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:34.823718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6e0ad39b-1311-4a87-a2f7-bf9a27bf474e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:34.883735 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4138/8184] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:34.891717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3074e3-2c95-4a45-9249-61438113ecb6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:34.892012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3074e3-2c95-4a45-9249-61438113ecb6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:34.892293 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3074e3-2c95-4a45-9249-61438113ecb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:34.913810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ff3074e3-2c95-4a45-9249-61438113ecb6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:34.915047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ff3074e3-2c95-4a45-9249-61438113ecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:34.926676 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4047/8185] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:34.930764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ad39b-1311-4a87-a2f7-bf9a27bf474e None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:34.946806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ad39b-1311-4a87-a2f7-bf9a27bf474e None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:34.953215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7655620-18e9-486e-971c-1442f198b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:34.953796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7655620-18e9-486e-971c-1442f198b5ab admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:34.954559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7655620-18e9-486e-971c-1442f198b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:34.954730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7655620-18e9-486e-971c-1442f198b5ab admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:34.955555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7655620-18e9-486e-971c-1442f198b5ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:18:34.956058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7655620-18e9-486e-971c-1442f198b5ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:34.958231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7655620-18e9-486e-971c-1442f198b5ab admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:34.977245 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4139/8186] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:18:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:18:34.978603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3074e3-2c95-4a45-9249-61438113ecb6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:34.990113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3074e3-2c95-4a45-9249-61438113ecb6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:34.995258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68590bb6-8a11-4213-ae29-0168eea8adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:34.995945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68590bb6-8a11-4213-ae29-0168eea8adde admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:34.996235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68590bb6-8a11-4213-ae29-0168eea8adde admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:34.996519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68590bb6-8a11-4213-ae29-0168eea8adde admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:34.997329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68590bb6-8a11-4213-ae29-0168eea8adde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:34.999161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68590bb6-8a11-4213-ae29-0168eea8adde admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:35.031343 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4048/8187] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:34 2021] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:35.035639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7655620-18e9-486e-971c-1442f198b5ab admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:35.047506 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7655620-18e9-486e-971c-1442f198b5ab admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:35.107175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b6ef-e2b9-424c-b34a-1a0d98c28d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:35.107943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b6ef-e2b9-424c-b34a-1a0d98c28d55 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:35.108230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b6ef-e2b9-424c-b34a-1a0d98c28d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:35.108511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b6ef-e2b9-424c-b34a-1a0d98c28d55 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:35.109221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8b6ef-e2b9-424c-b34a-1a0d98c28d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:35.111168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8b6ef-e2b9-424c-b34a-1a0d98c28d55 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:35.132180 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4140/8188] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:35 2021] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:35.136960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68590bb6-8a11-4213-ae29-0168eea8adde admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:35.147919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68590bb6-8a11-4213-ae29-0168eea8adde admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:35.153027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be74491-99df-4c54-a5d0-19461d2dbe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:35.154378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be74491-99df-4c54-a5d0-19461d2dbe76 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:35.154667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be74491-99df-4c54-a5d0-19461d2dbe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:35.155047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be74491-99df-4c54-a5d0-19461d2dbe76 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:35.155856 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be74491-99df-4c54-a5d0-19461d2dbe76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:35.157720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be74491-99df-4c54-a5d0-19461d2dbe76 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:35.170972 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4049/8189] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:35 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:18:35.175190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b6ef-e2b9-424c-b34a-1a0d98c28d55 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:35.185389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b6ef-e2b9-424c-b34a-1a0d98c28d55 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:35.190437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e43f2-1def-4742-8671-57f9e533fb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:35.191372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e43f2-1def-4742-8671-57f9e533fb23 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:35.191664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e43f2-1def-4742-8671-57f9e533fb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:35.191943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e43f2-1def-4742-8671-57f9e533fb23 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:35.192683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e43f2-1def-4742-8671-57f9e533fb23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:35.194364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e43f2-1def-4742-8671-57f9e533fb23 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:35.204762 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4141/8190] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:18:35.209063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be74491-99df-4c54-a5d0-19461d2dbe76 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:35.219801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be74491-99df-4c54-a5d0-19461d2dbe76 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:35.224549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f60a6-09a7-4c52-8996-211dca44d29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:35.225421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f60a6-09a7-4c52-8996-211dca44d29a admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:35.225706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f60a6-09a7-4c52-8996-211dca44d29a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:35.225981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f60a6-09a7-4c52-8996-211dca44d29a admin admin] PATH_INFO: `/v3/projects/4d8c99b7fd9244adad31d9b662e4f4c9/users/5c1a2e7775a042f394bfac5c6e007c5e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:35.242945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f60a6-09a7-4c52-8996-211dca44d29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8c99b7fd9244adad31d9b662e4f4c9, user_id=5c1a2e7775a042f394bfac5c6e007c5e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:35.245579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f60a6-09a7-4c52-8996-211dca44d29a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:35.258735 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4050/8191] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:35 2021] PUT /identity/v3/projects/4d8c99b7fd9244adad31d9b662e4f4c9/users/5c1a2e7775a042f394bfac5c6e007c5e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:35.270032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecf250-8486-4d2f-87b4-91d0cc2bc233 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:35.270563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecf250-8486-4d2f-87b4-91d0cc2bc233 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:35.270653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecf250-8486-4d2f-87b4-91d0cc2bc233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:35.301681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b5ecf250-8486-4d2f-87b4-91d0cc2bc233 None None] MFA Rules not processed for user `5c1a2e7775a042f394bfac5c6e007c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:35.302967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b5ecf250-8486-4d2f-87b4-91d0cc2bc233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:35.366567 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4142/8192] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:35 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:35.371102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f60a6-09a7-4c52-8996-211dca44d29a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:35.434058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f60a6-09a7-4c52-8996-211dca44d29a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:35.438671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811b3fe-a211-42db-908a-c61386481e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:35.439326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811b3fe-a211-42db-908a-c61386481e8f admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:35.439613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811b3fe-a211-42db-908a-c61386481e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:35.439890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811b3fe-a211-42db-908a-c61386481e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:35.440598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811b3fe-a211-42db-908a-c61386481e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:35.442760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811b3fe-a211-42db-908a-c61386481e8f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:35.468510 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4051/8193] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:35 2021] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:35.473100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecf250-8486-4d2f-87b4-91d0cc2bc233 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:35.484223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecf250-8486-4d2f-87b4-91d0cc2bc233 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:35.544935 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b1129-dbf6-4c4d-bd09-7343720a9495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:35.545672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b1129-dbf6-4c4d-bd09-7343720a9495 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:35.546083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b1129-dbf6-4c4d-bd09-7343720a9495 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:35.546471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b1129-dbf6-4c4d-bd09-7343720a9495 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:35.547591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b1129-dbf6-4c4d-bd09-7343720a9495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:35.549853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b1129-dbf6-4c4d-bd09-7343720a9495 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:35.570150 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4143/8194] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:35 2021] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:35.574035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811b3fe-a211-42db-908a-c61386481e8f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:35.584594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811b3fe-a211-42db-908a-c61386481e8f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:35.589434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a038c9-42d5-4e55-a9d2-912e86d9d99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:35.590086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a038c9-42d5-4e55-a9d2-912e86d9d99a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:35.590409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a038c9-42d5-4e55-a9d2-912e86d9d99a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:35.590690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a038c9-42d5-4e55-a9d2-912e86d9d99a admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:35.592060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a038c9-42d5-4e55-a9d2-912e86d9d99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:35.593646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a038c9-42d5-4e55-a9d2-912e86d9d99a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:35.604515 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4052/8195] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:35 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:35.608859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b1129-dbf6-4c4d-bd09-7343720a9495 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:35.619112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b1129-dbf6-4c4d-bd09-7343720a9495 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:35.623986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743976a8-f99f-46da-8422-606ce6744e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:35.624863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743976a8-f99f-46da-8422-606ce6744e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:35.625258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743976a8-f99f-46da-8422-606ce6744e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:35.625541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743976a8-f99f-46da-8422-606ce6744e28 admin admin] PATH_INFO: `/v3/projects/22639890030b4e0eb0c7d3eef5cb55b6/users/38c29c7f3975421896c3793603f3a47a/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:35.644652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743976a8-f99f-46da-8422-606ce6744e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22639890030b4e0eb0c7d3eef5cb55b6, user_id=38c29c7f3975421896c3793603f3a47a, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:35.647445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743976a8-f99f-46da-8422-606ce6744e28 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:35.660923 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4144/8196] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:35 2021] PUT /identity/v3/projects/22639890030b4e0eb0c7d3eef5cb55b6/users/38c29c7f3975421896c3793603f3a47a/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:35.664829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a038c9-42d5-4e55-a9d2-912e86d9d99a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:35.675040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a038c9-42d5-4e55-a9d2-912e86d9d99a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:35.730524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18398aed-031b-48b6-89a1-b6fe32f3be88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:35.731194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18398aed-031b-48b6-89a1-b6fe32f3be88 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:35.732048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18398aed-031b-48b6-89a1-b6fe32f3be88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:35.732326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18398aed-031b-48b6-89a1-b6fe32f3be88 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:35.733056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18398aed-031b-48b6-89a1-b6fe32f3be88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:35.734664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18398aed-031b-48b6-89a1-b6fe32f3be88 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:35.744368 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4053/8197] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:35 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:35.748557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743976a8-f99f-46da-8422-606ce6744e28 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:35.758992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743976a8-f99f-46da-8422-606ce6744e28 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:35.763719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f4ec-7c7f-4a6c-8938-d2bc90aead59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:35.764591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f4ec-7c7f-4a6c-8938-d2bc90aead59 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:35.764877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f4ec-7c7f-4a6c-8938-d2bc90aead59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:35.765160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f4ec-7c7f-4a6c-8938-d2bc90aead59 admin admin] PATH_INFO: `/v3/projects/22639890030b4e0eb0c7d3eef5cb55b6/users/38c29c7f3975421896c3793603f3a47a/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:35.767223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46f4ec-7c7f-4a6c-8938-d2bc90aead59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22639890030b4e0eb0c7d3eef5cb55b6, user_id=38c29c7f3975421896c3793603f3a47a, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:35.769840 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46f4ec-7c7f-4a6c-8938-d2bc90aead59 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:35.780283 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4145/8198] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:35 2021] PUT /identity/v3/projects/22639890030b4e0eb0c7d3eef5cb55b6/users/38c29c7f3975421896c3793603f3a47a/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:35.790118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bc6f7-fbbc-44e2-a311-31b953e694e6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:35.790453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bc6f7-fbbc-44e2-a311-31b953e694e6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:35.790743 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bc6f7-fbbc-44e2-a311-31b953e694e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:35.817567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a38bc6f7-fbbc-44e2-a311-31b953e694e6 None None] MFA Rules not processed for user `38c29c7f3975421896c3793603f3a47a`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:35.818814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a38bc6f7-fbbc-44e2-a311-31b953e694e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:35.884268 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4054/8199] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:35 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:35.895202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f4ec-7c7f-4a6c-8938-d2bc90aead59 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:35.896878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bb46f4ec-7c7f-4a6c-8938-d2bc90aead59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:35.958640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f4ec-7c7f-4a6c-8938-d2bc90aead59 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:35.962365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491764eb-f9c9-4e9f-b614-69141a3bc5ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:35.963007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491764eb-f9c9-4e9f-b614-69141a3bc5ef service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:35.963293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491764eb-f9c9-4e9f-b614-69141a3bc5ef service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:35.963576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491764eb-f9c9-4e9f-b614-69141a3bc5ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:35.973373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491764eb-f9c9-4e9f-b614-69141a3bc5ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:35.974846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491764eb-f9c9-4e9f-b614-69141a3bc5ef service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:35.985719 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4146/8200] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:35 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:36.106682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bc6f7-fbbc-44e2-a311-31b953e694e6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:36.171222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bc6f7-fbbc-44e2-a311-31b953e694e6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:36.176049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b4d65-966a-4b42-a71c-cc0d8ca7afb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:36.176922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b4d65-966a-4b42-a71c-cc0d8ca7afb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:36.177208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b4d65-966a-4b42-a71c-cc0d8ca7afb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:36.177519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b4d65-966a-4b42-a71c-cc0d8ca7afb3 admin admin] PATH_INFO: `/v3/users/5c1a2e7775a042f394bfac5c6e007c5e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:36.178783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b4d65-966a-4b42-a71c-cc0d8ca7afb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c1a2e7775a042f394bfac5c6e007c5e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:36.180695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b4d65-966a-4b42-a71c-cc0d8ca7afb3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:36.228321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8b0b4d65-966a-4b42-a71c-cc0d8ca7afb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c1a2e7775a042f394bfac5c6e007c5e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:36.234952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8b0b4d65-966a-4b42-a71c-cc0d8ca7afb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c1a2e7775a042f394bfac5c6e007c5e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:36.246191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8b0b4d65-966a-4b42-a71c-cc0d8ca7afb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c1a2e7775a042f394bfac5c6e007c5e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:36.246928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8b0b4d65-966a-4b42-a71c-cc0d8ca7afb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c1a2e7775a042f394bfac5c6e007c5e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:36.256264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-8b0b4d65-966a-4b42-a71c-cc0d8ca7afb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c1a2e7775a042f394bfac5c6e007c5e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:36.262423 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4055/8201] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:36 2021] DELETE /identity/v3/users/5c1a2e7775a042f394bfac5c6e007c5e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:36.267479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb182ea-de3d-4111-a7b4-7e410172289d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:36.267755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb182ea-de3d-4111-a7b4-7e410172289d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:36.268056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb182ea-de3d-4111-a7b4-7e410172289d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:36.286011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1eb182ea-de3d-4111-a7b4-7e410172289d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:36.287251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1eb182ea-de3d-4111-a7b4-7e410172289d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:36.348366 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4147/8202] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:36.358428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b4d65-966a-4b42-a71c-cc0d8ca7afb3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:36.360155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8b0b4d65-966a-4b42-a71c-cc0d8ca7afb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:36.431575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b4d65-966a-4b42-a71c-cc0d8ca7afb3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:36.435882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4c641-5d48-4c6f-b8e5-2da16f3cc517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:36.436540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4c641-5d48-4c6f-b8e5-2da16f3cc517 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:36.436825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4c641-5d48-4c6f-b8e5-2da16f3cc517 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:36.437251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4c641-5d48-4c6f-b8e5-2da16f3cc517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:36.448154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4c641-5d48-4c6f-b8e5-2da16f3cc517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:36.449612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4c641-5d48-4c6f-b8e5-2da16f3cc517 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:36.460999 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4056/8203] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:36.748386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb182ea-de3d-4111-a7b4-7e410172289d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:36.749788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1eb182ea-de3d-4111-a7b4-7e410172289d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:36.764494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb182ea-de3d-4111-a7b4-7e410172289d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:36.770198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2acc8-b5d7-4542-9811-9b145ada139f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:36.771380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2acc8-b5d7-4542-9811-9b145ada139f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:36.771674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2acc8-b5d7-4542-9811-9b145ada139f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:36.771975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2acc8-b5d7-4542-9811-9b145ada139f admin admin] PATH_INFO: `/v3/projects/4d8c99b7fd9244adad31d9b662e4f4c9` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:36.773216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2acc8-b5d7-4542-9811-9b145ada139f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8c99b7fd9244adad31d9b662e4f4c9)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:36.775211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2acc8-b5d7-4542-9811-9b145ada139f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:36.820597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8ea2acc8-b5d7-4542-9811-9b145ada139f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8c99b7fd9244adad31d9b662e4f4c9', 'request_id': 'req-8ea2acc8-b5d7-4542-9811-9b145ada139f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:36.827446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8ea2acc8-b5d7-4542-9811-9b145ada139f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8c99b7fd9244adad31d9b662e4f4c9', 'request_id': 'req-8ea2acc8-b5d7-4542-9811-9b145ada139f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:36.833901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8ea2acc8-b5d7-4542-9811-9b145ada139f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8c99b7fd9244adad31d9b662e4f4c9', 'request_id': 'req-8ea2acc8-b5d7-4542-9811-9b145ada139f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:36.843719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8ea2acc8-b5d7-4542-9811-9b145ada139f admin admin] The token cache is being invalidate because project 4d8c99b7fd9244adad31d9b662e4f4c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:36.844008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8ea2acc8-b5d7-4542-9811-9b145ada139f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:36.844624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8ea2acc8-b5d7-4542-9811-9b145ada139f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:36.846120 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4148/8204] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:36 2021] DELETE /identity/v3/projects/4d8c99b7fd9244adad31d9b662e4f4c9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:36.850153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4c641-5d48-4c6f-b8e5-2da16f3cc517 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:36.860164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4c641-5d48-4c6f-b8e5-2da16f3cc517 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:36.914778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae9929-6b00-4ac1-91d2-ffe65953c593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:36.915640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae9929-6b00-4ac1-91d2-ffe65953c593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:36.915921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae9929-6b00-4ac1-91d2-ffe65953c593 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:36.916196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae9929-6b00-4ac1-91d2-ffe65953c593 admin admin] PATH_INFO: `/v3/users/38c29c7f3975421896c3793603f3a47a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:36.917369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae9929-6b00-4ac1-91d2-ffe65953c593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c29c7f3975421896c3793603f3a47a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:36.919796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae9929-6b00-4ac1-91d2-ffe65953c593 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:36.966628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-70ae9929-6b00-4ac1-91d2-ffe65953c593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c29c7f3975421896c3793603f3a47a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:36.973227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-70ae9929-6b00-4ac1-91d2-ffe65953c593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c29c7f3975421896c3793603f3a47a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:36.984848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-70ae9929-6b00-4ac1-91d2-ffe65953c593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c29c7f3975421896c3793603f3a47a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:36.985511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-70ae9929-6b00-4ac1-91d2-ffe65953c593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c29c7f3975421896c3793603f3a47a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:36.993166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-70ae9929-6b00-4ac1-91d2-ffe65953c593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c29c7f3975421896c3793603f3a47a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:36.999841 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4057/8205] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:36 2021] DELETE /identity/v3/users/38c29c7f3975421896c3793603f3a47a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:37.269774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2acc8-b5d7-4542-9811-9b145ada139f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:37.271256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8ea2acc8-b5d7-4542-9811-9b145ada139f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:37.284673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2acc8-b5d7-4542-9811-9b145ada139f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:37.339241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886d2db-4b7e-4aad-89e3-b71f1a289a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:37.340089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886d2db-4b7e-4aad-89e3-b71f1a289a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:37.340369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886d2db-4b7e-4aad-89e3-b71f1a289a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:37.341158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886d2db-4b7e-4aad-89e3-b71f1a289a6a admin admin] PATH_INFO: `/v3/projects/22639890030b4e0eb0c7d3eef5cb55b6` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:37.342379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886d2db-4b7e-4aad-89e3-b71f1a289a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=22639890030b4e0eb0c7d3eef5cb55b6)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:37.344301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886d2db-4b7e-4aad-89e3-b71f1a289a6a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:37.388630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b886d2db-4b7e-4aad-89e3-b71f1a289a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22639890030b4e0eb0c7d3eef5cb55b6', 'request_id': 'req-b886d2db-4b7e-4aad-89e3-b71f1a289a6a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:37.394516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b886d2db-4b7e-4aad-89e3-b71f1a289a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22639890030b4e0eb0c7d3eef5cb55b6', 'request_id': 'req-b886d2db-4b7e-4aad-89e3-b71f1a289a6a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:37.401593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b886d2db-4b7e-4aad-89e3-b71f1a289a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22639890030b4e0eb0c7d3eef5cb55b6', 'request_id': 'req-b886d2db-4b7e-4aad-89e3-b71f1a289a6a'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:37.412306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b886d2db-4b7e-4aad-89e3-b71f1a289a6a admin admin] The token cache is being invalidate because project 22639890030b4e0eb0c7d3eef5cb55b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:37.412670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b886d2db-4b7e-4aad-89e3-b71f1a289a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:37.413323 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b886d2db-4b7e-4aad-89e3-b71f1a289a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:37.414886 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4149/8206] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:37 2021] DELETE /identity/v3/projects/22639890030b4e0eb0c7d3eef5cb55b6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:37.421398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf66ca-b309-446b-bed6-69be6cbb0b7f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:37.421691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf66ca-b309-446b-bed6-69be6cbb0b7f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:37.421970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf66ca-b309-446b-bed6-69be6cbb0b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:37.439792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8ddf66ca-b309-446b-bed6-69be6cbb0b7f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:37.441234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8ddf66ca-b309-446b-bed6-69be6cbb0b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:37.502343 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4058/8207] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:37.511326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5aa56-c21e-4675-9eff-5287464bf2c5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:37.511741 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5aa56-c21e-4675-9eff-5287464bf2c5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:37.512111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5aa56-c21e-4675-9eff-5287464bf2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:37.531007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b0e5aa56-c21e-4675-9eff-5287464bf2c5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:37.532201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b0e5aa56-c21e-4675-9eff-5287464bf2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:37.540010 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4150/8208] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:37.544960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf66ca-b309-446b-bed6-69be6cbb0b7f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:37.554622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf66ca-b309-446b-bed6-69be6cbb0b7f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:37.559319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd41ab9-129a-4ed9-9d4e-dedd493c2281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:37.560050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd41ab9-129a-4ed9-9d4e-dedd493c2281 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:37.560335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd41ab9-129a-4ed9-9d4e-dedd493c2281 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:37.560614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd41ab9-129a-4ed9-9d4e-dedd493c2281 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:37.561348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd41ab9-129a-4ed9-9d4e-dedd493c2281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:18:37.561660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd41ab9-129a-4ed9-9d4e-dedd493c2281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:37.563289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd41ab9-129a-4ed9-9d4e-dedd493c2281 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:37.576013 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4059/8209] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:18:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:18:37.580172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5aa56-c21e-4675-9eff-5287464bf2c5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:37.589358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5aa56-c21e-4675-9eff-5287464bf2c5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:37.595440 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308b987-1333-4f24-9cb0-92107f685e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:37.596091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308b987-1333-4f24-9cb0-92107f685e62 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:37.596369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308b987-1333-4f24-9cb0-92107f685e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:37.596702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308b987-1333-4f24-9cb0-92107f685e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:37.597398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308b987-1333-4f24-9cb0-92107f685e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:37.599324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308b987-1333-4f24-9cb0-92107f685e62 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:37.628324 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4151/8210] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:37 2021] POST /identity/v3/projects => generated 409 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:37.632640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd41ab9-129a-4ed9-9d4e-dedd493c2281 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:37.645359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd41ab9-129a-4ed9-9d4e-dedd493c2281 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:37.706826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15adfe-a6d6-41ff-bfdf-75a00c0b8fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:37.707644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15adfe-a6d6-41ff-bfdf-75a00c0b8fbf admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:37.707941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15adfe-a6d6-41ff-bfdf-75a00c0b8fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:37.708220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15adfe-a6d6-41ff-bfdf-75a00c0b8fbf admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:37.708925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15adfe-a6d6-41ff-bfdf-75a00c0b8fbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:37.710881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15adfe-a6d6-41ff-bfdf-75a00c0b8fbf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:37.737872 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4060/8211] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:37 2021] POST /identity/v3/users => generated 305 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:37.740214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308b987-1333-4f24-9cb0-92107f685e62 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:37.750594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308b987-1333-4f24-9cb0-92107f685e62 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:37.757043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be1d95-a03c-40ca-877b-18f6db634409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:37.757827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be1d95-a03c-40ca-877b-18f6db634409 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:37.758118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be1d95-a03c-40ca-877b-18f6db634409 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:37.758427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be1d95-a03c-40ca-877b-18f6db634409 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:37.759160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be1d95-a03c-40ca-877b-18f6db634409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:37.760754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be1d95-a03c-40ca-877b-18f6db634409 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:37.776477 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4152/8212] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:37 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:37.779254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15adfe-a6d6-41ff-bfdf-75a00c0b8fbf admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:37.790727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15adfe-a6d6-41ff-bfdf-75a00c0b8fbf admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:37.796524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35a9ce-fb69-4143-b8e0-a732c6b38ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:37.797281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35a9ce-fb69-4143-b8e0-a732c6b38ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:37.797705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35a9ce-fb69-4143-b8e0-a732c6b38ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:37.798026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35a9ce-fb69-4143-b8e0-a732c6b38ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:37.798852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35a9ce-fb69-4143-b8e0-a732c6b38ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:37.800708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35a9ce-fb69-4143-b8e0-a732c6b38ce5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:37.815689 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4061/8213] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:37 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:37.817087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be1d95-a03c-40ca-877b-18f6db634409 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:37.827837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be1d95-a03c-40ca-877b-18f6db634409 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:37.834086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185895d-5153-496a-9b21-d7beca2665ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:37.835032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185895d-5153-496a-9b21-d7beca2665ef admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:37.835315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185895d-5153-496a-9b21-d7beca2665ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:37.835637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185895d-5153-496a-9b21-d7beca2665ef admin admin] PATH_INFO: `/v3/projects/f611af1fd922479788c6c7b294186add/users/b31bb5ec543e47d7b1a72c8611b2dca1/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:37.859237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185895d-5153-496a-9b21-d7beca2665ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f611af1fd922479788c6c7b294186add, user_id=b31bb5ec543e47d7b1a72c8611b2dca1, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:37.869346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185895d-5153-496a-9b21-d7beca2665ef admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:37.887504 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4153/8214] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:37 2021] PUT /identity/v3/projects/f611af1fd922479788c6c7b294186add/users/b31bb5ec543e47d7b1a72c8611b2dca1/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:37.898349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b05179-0a86-4e57-aa6d-a4c9c71b3577 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:37.898881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b05179-0a86-4e57-aa6d-a4c9c71b3577 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:37.898973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b05179-0a86-4e57-aa6d-a4c9c71b3577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:37.928037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-39b05179-0a86-4e57-aa6d-a4c9c71b3577 None None] MFA Rules not processed for user `b31bb5ec543e47d7b1a72c8611b2dca1`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:37.929250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-39b05179-0a86-4e57-aa6d-a4c9c71b3577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:38.014104 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4062/8215] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:37 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:38.018726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185895d-5153-496a-9b21-d7beca2665ef admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:38.101218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185895d-5153-496a-9b21-d7beca2665ef admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:38.108294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a44d37-64d1-4ef1-9a58-8790d3b73743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:38.109073 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a44d37-64d1-4ef1-9a58-8790d3b73743 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:38.109451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a44d37-64d1-4ef1-9a58-8790d3b73743 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:38.109918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a44d37-64d1-4ef1-9a58-8790d3b73743 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:38.111131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a44d37-64d1-4ef1-9a58-8790d3b73743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:38.113561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a44d37-64d1-4ef1-9a58-8790d3b73743 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:38.150125 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4154/8216] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:38 2021] POST /identity/v3/projects => generated 407 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:38.154994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b05179-0a86-4e57-aa6d-a4c9c71b3577 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:38.169993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b05179-0a86-4e57-aa6d-a4c9c71b3577 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:38.236145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bb2fd-0b7e-4201-83a0-bc3e268eb4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:38.236967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bb2fd-0b7e-4201-83a0-bc3e268eb4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:38.237209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bb2fd-0b7e-4201-83a0-bc3e268eb4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:38.237495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bb2fd-0b7e-4201-83a0-bc3e268eb4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:38.238408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bb2fd-0b7e-4201-83a0-bc3e268eb4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:38.240192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bb2fd-0b7e-4201-83a0-bc3e268eb4c8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:38.266410 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4063/8217] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:38 2021] POST /identity/v3/users => generated 310 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:38.270961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a44d37-64d1-4ef1-9a58-8790d3b73743 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:38.283961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a44d37-64d1-4ef1-9a58-8790d3b73743 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:38.289754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dafa0-786d-4462-8b5a-ae49cdc95d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:38.290660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dafa0-786d-4462-8b5a-ae49cdc95d1c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:38.291075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dafa0-786d-4462-8b5a-ae49cdc95d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:38.291526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dafa0-786d-4462-8b5a-ae49cdc95d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:38.292278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dafa0-786d-4462-8b5a-ae49cdc95d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:38.294608 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dafa0-786d-4462-8b5a-ae49cdc95d1c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:38.306539 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4155/8218] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:38 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:38.310702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bb2fd-0b7e-4201-83a0-bc3e268eb4c8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:38.321637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bb2fd-0b7e-4201-83a0-bc3e268eb4c8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:38.328212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4633b29-f99b-4e59-9304-5dd49b748187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:38.329244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633b29-f99b-4e59-9304-5dd49b748187 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:38.329648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633b29-f99b-4e59-9304-5dd49b748187 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:38.329927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633b29-f99b-4e59-9304-5dd49b748187 admin admin] PATH_INFO: `/v3/projects/b95820945aa84eb8a537c60296362abe/users/804a986b17724a7c8b616e3e892097ba/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:38.350813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4633b29-f99b-4e59-9304-5dd49b748187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95820945aa84eb8a537c60296362abe, user_id=804a986b17724a7c8b616e3e892097ba, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:38.353512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4633b29-f99b-4e59-9304-5dd49b748187 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:38.369007 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4064/8219] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:38 2021] PUT /identity/v3/projects/b95820945aa84eb8a537c60296362abe/users/804a986b17724a7c8b616e3e892097ba/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:38.373436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dafa0-786d-4462-8b5a-ae49cdc95d1c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:38.384556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dafa0-786d-4462-8b5a-ae49cdc95d1c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:38.441751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b80e04-3bc1-416d-af21-977ea7477880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:38.442449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b80e04-3bc1-416d-af21-977ea7477880 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:38.442740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b80e04-3bc1-416d-af21-977ea7477880 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:38.443026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b80e04-3bc1-416d-af21-977ea7477880 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:38.443784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b80e04-3bc1-416d-af21-977ea7477880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:38.445424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b80e04-3bc1-416d-af21-977ea7477880 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:38.455571 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4156/8220] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:38 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:38.459679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4633b29-f99b-4e59-9304-5dd49b748187 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:38.470484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4633b29-f99b-4e59-9304-5dd49b748187 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:38.475148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780393e7-289f-461e-be6f-a06bc62dc226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:38.476020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780393e7-289f-461e-be6f-a06bc62dc226 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:38.476311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780393e7-289f-461e-be6f-a06bc62dc226 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:38.476596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780393e7-289f-461e-be6f-a06bc62dc226 admin admin] PATH_INFO: `/v3/projects/b95820945aa84eb8a537c60296362abe/users/804a986b17724a7c8b616e3e892097ba/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:38.478649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780393e7-289f-461e-be6f-a06bc62dc226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95820945aa84eb8a537c60296362abe, user_id=804a986b17724a7c8b616e3e892097ba, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:38.481289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780393e7-289f-461e-be6f-a06bc62dc226 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:38.491302 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4065/8221] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:38 2021] PUT /identity/v3/projects/b95820945aa84eb8a537c60296362abe/users/804a986b17724a7c8b616e3e892097ba/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:38.501228 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bde27-9442-47d5-bb34-c0d64ad6fd1d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:38.501523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bde27-9442-47d5-bb34-c0d64ad6fd1d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:38.501827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bde27-9442-47d5-bb34-c0d64ad6fd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:38.529209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ca3bde27-9442-47d5-bb34-c0d64ad6fd1d None None] MFA Rules not processed for user `804a986b17724a7c8b616e3e892097ba`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:38.530599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ca3bde27-9442-47d5-bb34-c0d64ad6fd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:38.597982 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4157/8222] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:38 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:38.607994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780393e7-289f-461e-be6f-a06bc62dc226 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:38.609790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-780393e7-289f-461e-be6f-a06bc62dc226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:38.624664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bde27-9442-47d5-bb34-c0d64ad6fd1d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:38.626134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ca3bde27-9442-47d5-bb34-c0d64ad6fd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:38.668877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780393e7-289f-461e-be6f-a06bc62dc226 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:38.672523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7ed69-33d7-4350-a8eb-813293a79ba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:38.673177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ed69-33d7-4350-a8eb-813293a79ba2 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:38.673467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ed69-33d7-4350-a8eb-813293a79ba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:38.673777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ed69-33d7-4350-a8eb-813293a79ba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:38.682785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7ed69-33d7-4350-a8eb-813293a79ba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:38.684214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7ed69-33d7-4350-a8eb-813293a79ba2 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:38.685914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bde27-9442-47d5-bb34-c0d64ad6fd1d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:38.689763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c5842-fa2e-45bf-aad8-324cfa1d840f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:38.690454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c5842-fa2e-45bf-aad8-324cfa1d840f service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:38.690742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c5842-fa2e-45bf-aad8-324cfa1d840f service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:38.691301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c5842-fa2e-45bf-aad8-324cfa1d840f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:38.693152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b18c5842-fa2e-45bf-aad8-324cfa1d840f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:38.694524 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4066/8223] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:38 2021] GET /identity/v3/auth/tokens => generated 3341 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:38.774902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c5842-fa2e-45bf-aad8-324cfa1d840f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:38.776338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c5842-fa2e-45bf-aad8-324cfa1d840f service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:38.786366 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4158/8224] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:38 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:18:38.837893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7ed69-33d7-4350-a8eb-813293a79ba2 service cinder] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:38.848705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7ed69-33d7-4350-a8eb-813293a79ba2 service cinder] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:38.852358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98b33f-75c2-4825-889b-444de61bb8be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:38.853003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98b33f-75c2-4825-889b-444de61bb8be service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:38.853290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98b33f-75c2-4825-889b-444de61bb8be service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:38.853574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98b33f-75c2-4825-889b-444de61bb8be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:38.909214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98b33f-75c2-4825-889b-444de61bb8be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:38.910692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98b33f-75c2-4825-889b-444de61bb8be service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:38.919544 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4067/8225] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:38 2021] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:41.543415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c5842-fa2e-45bf-aad8-324cfa1d840f service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:41.544961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b18c5842-fa2e-45bf-aad8-324cfa1d840f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:41.610939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c5842-fa2e-45bf-aad8-324cfa1d840f service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:41.617690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722c72c-5fd0-45f7-9aaf-29d27ea4e7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:41.618603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722c72c-5fd0-45f7-9aaf-29d27ea4e7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:41.618910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722c72c-5fd0-45f7-9aaf-29d27ea4e7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:41.619185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722c72c-5fd0-45f7-9aaf-29d27ea4e7ec admin admin] PATH_INFO: `/v3/users/fe6a996f07dc42d686a737b4f2fc08c2` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:41.620397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722c72c-5fd0-45f7-9aaf-29d27ea4e7ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe6a996f07dc42d686a737b4f2fc08c2)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:41.622464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722c72c-5fd0-45f7-9aaf-29d27ea4e7ec admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:41.669468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f722c72c-5fd0-45f7-9aaf-29d27ea4e7ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe6a996f07dc42d686a737b4f2fc08c2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:41.676500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f722c72c-5fd0-45f7-9aaf-29d27ea4e7ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe6a996f07dc42d686a737b4f2fc08c2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:41.677177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f722c72c-5fd0-45f7-9aaf-29d27ea4e7ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe6a996f07dc42d686a737b4f2fc08c2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:41.689510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f722c72c-5fd0-45f7-9aaf-29d27ea4e7ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe6a996f07dc42d686a737b4f2fc08c2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:41.698552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f722c72c-5fd0-45f7-9aaf-29d27ea4e7ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe6a996f07dc42d686a737b4f2fc08c2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:41.705213 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4159/8226] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:41 2021] DELETE /identity/v3/users/fe6a996f07dc42d686a737b4f2fc08c2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:41.709842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81b03a-b6fb-4230-ab1c-de0247edadae None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:41.710684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81b03a-b6fb-4230-ab1c-de0247edadae None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:41.711231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81b03a-b6fb-4230-ab1c-de0247edadae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:41.728954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4a81b03a-b6fb-4230-ab1c-de0247edadae None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:41.730207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4a81b03a-b6fb-4230-ab1c-de0247edadae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:41.790928 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4068/8227] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:41.801083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722c72c-5fd0-45f7-9aaf-29d27ea4e7ec admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:41.802586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f722c72c-5fd0-45f7-9aaf-29d27ea4e7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:41.867581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722c72c-5fd0-45f7-9aaf-29d27ea4e7ec admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:41.873393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff19f50-0adc-4b73-adf8-2c88e80b3f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:41.874056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff19f50-0adc-4b73-adf8-2c88e80b3f15 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:41.874382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff19f50-0adc-4b73-adf8-2c88e80b3f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:41.874663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff19f50-0adc-4b73-adf8-2c88e80b3f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:41.885456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff19f50-0adc-4b73-adf8-2c88e80b3f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:41.887359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff19f50-0adc-4b73-adf8-2c88e80b3f15 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:41.897992 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4160/8228] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:42.163042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81b03a-b6fb-4230-ab1c-de0247edadae None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:42.164489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4a81b03a-b6fb-4230-ab1c-de0247edadae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:42.177329 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81b03a-b6fb-4230-ab1c-de0247edadae None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:42.182276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471d91e-8461-4e0e-b1ad-546416781cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:42.183150 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471d91e-8461-4e0e-b1ad-546416781cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:42.183436 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471d91e-8461-4e0e-b1ad-546416781cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:42.183720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471d91e-8461-4e0e-b1ad-546416781cb5 admin admin] PATH_INFO: `/v3/projects/443754b6c278464ea41c9a3d3530643a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:42.186119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471d91e-8461-4e0e-b1ad-546416781cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=443754b6c278464ea41c9a3d3530643a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:42.188465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471d91e-8461-4e0e-b1ad-546416781cb5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:42.245894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b471d91e-8461-4e0e-b1ad-546416781cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '443754b6c278464ea41c9a3d3530643a', 'request_id': 'req-b471d91e-8461-4e0e-b1ad-546416781cb5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:42.252989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b471d91e-8461-4e0e-b1ad-546416781cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '443754b6c278464ea41c9a3d3530643a', 'request_id': 'req-b471d91e-8461-4e0e-b1ad-546416781cb5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:42.258387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b471d91e-8461-4e0e-b1ad-546416781cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '443754b6c278464ea41c9a3d3530643a', 'request_id': 'req-b471d91e-8461-4e0e-b1ad-546416781cb5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:42.271415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b471d91e-8461-4e0e-b1ad-546416781cb5 admin admin] The token cache is being invalidate because project 443754b6c278464ea41c9a3d3530643a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:42.271708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b471d91e-8461-4e0e-b1ad-546416781cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:42.272397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b471d91e-8461-4e0e-b1ad-546416781cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:42.274002 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4069/8229] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:42 2021] DELETE /identity/v3/projects/443754b6c278464ea41c9a3d3530643a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:42.278177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff19f50-0adc-4b73-adf8-2c88e80b3f15 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:42.287813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff19f50-0adc-4b73-adf8-2c88e80b3f15 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:42.343845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724e897-325b-4f74-a32b-91444fc25bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:42.344708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724e897-325b-4f74-a32b-91444fc25bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:42.344992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724e897-325b-4f74-a32b-91444fc25bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:42.345272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724e897-325b-4f74-a32b-91444fc25bb0 admin admin] PATH_INFO: `/v3/users/7443ace8c1614e259db6a53ee685a78f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:42.346499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724e897-325b-4f74-a32b-91444fc25bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7443ace8c1614e259db6a53ee685a78f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:42.348399 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724e897-325b-4f74-a32b-91444fc25bb0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:42.391595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2724e897-325b-4f74-a32b-91444fc25bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7443ace8c1614e259db6a53ee685a78f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:42.398449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2724e897-325b-4f74-a32b-91444fc25bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7443ace8c1614e259db6a53ee685a78f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:42.399120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2724e897-325b-4f74-a32b-91444fc25bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7443ace8c1614e259db6a53ee685a78f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:42.410818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2724e897-325b-4f74-a32b-91444fc25bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7443ace8c1614e259db6a53ee685a78f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:42.417924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-2724e897-325b-4f74-a32b-91444fc25bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7443ace8c1614e259db6a53ee685a78f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:42.424259 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4161/8230] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:42 2021] DELETE /identity/v3/users/7443ace8c1614e259db6a53ee685a78f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:42.686441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471d91e-8461-4e0e-b1ad-546416781cb5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:42.687995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b471d91e-8461-4e0e-b1ad-546416781cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:42.701854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471d91e-8461-4e0e-b1ad-546416781cb5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:42.759804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e19bf1-900f-455d-9336-ac7394253e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:42.760667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e19bf1-900f-455d-9336-ac7394253e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:42.760958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e19bf1-900f-455d-9336-ac7394253e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:42.761246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e19bf1-900f-455d-9336-ac7394253e8d admin admin] PATH_INFO: `/v3/projects/3fe7731efc7741e883ff050018d55d0c` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:42.762520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e19bf1-900f-455d-9336-ac7394253e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fe7731efc7741e883ff050018d55d0c)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:42.764409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e19bf1-900f-455d-9336-ac7394253e8d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:42.809426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-01e19bf1-900f-455d-9336-ac7394253e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fe7731efc7741e883ff050018d55d0c', 'request_id': 'req-01e19bf1-900f-455d-9336-ac7394253e8d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:42.815236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-01e19bf1-900f-455d-9336-ac7394253e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fe7731efc7741e883ff050018d55d0c', 'request_id': 'req-01e19bf1-900f-455d-9336-ac7394253e8d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:42.820893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-01e19bf1-900f-455d-9336-ac7394253e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fe7731efc7741e883ff050018d55d0c', 'request_id': 'req-01e19bf1-900f-455d-9336-ac7394253e8d'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:42.833194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-01e19bf1-900f-455d-9336-ac7394253e8d admin admin] The token cache is being invalidate because project 3fe7731efc7741e883ff050018d55d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:42.833486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-01e19bf1-900f-455d-9336-ac7394253e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:42.834126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-01e19bf1-900f-455d-9336-ac7394253e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:42.835943 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4070/8231] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:42 2021] DELETE /identity/v3/projects/3fe7731efc7741e883ff050018d55d0c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:42.844136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2de07-44b7-480f-ab07-8c4c05984f69 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:42.844694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2de07-44b7-480f-ab07-8c4c05984f69 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:42.844694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2de07-44b7-480f-ab07-8c4c05984f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:42.863369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6ac2de07-44b7-480f-ab07-8c4c05984f69 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:42.864456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6ac2de07-44b7-480f-ab07-8c4c05984f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:42.930362 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4162/8232] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:42.936609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33eb80-df59-4fd1-8e84-e80e5408dc9f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:42.937359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33eb80-df59-4fd1-8e84-e80e5408dc9f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:42.937359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33eb80-df59-4fd1-8e84-e80e5408dc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:42.960369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0b33eb80-df59-4fd1-8e84-e80e5408dc9f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:42.961590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0b33eb80-df59-4fd1-8e84-e80e5408dc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:42.970417 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4071/8233] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:18:42.974693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2de07-44b7-480f-ab07-8c4c05984f69 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:42.984785 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2de07-44b7-480f-ab07-8c4c05984f69 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:42.990120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c421b0-181c-42b8-80a8-ea48e69d401e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:42.990826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c421b0-181c-42b8-80a8-ea48e69d401e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:42.991113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c421b0-181c-42b8-80a8-ea48e69d401e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:42.991394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c421b0-181c-42b8-80a8-ea48e69d401e admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:42.992898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c421b0-181c-42b8-80a8-ea48e69d401e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:18:42.992898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c421b0-181c-42b8-80a8-ea48e69d401e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:42.994060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c421b0-181c-42b8-80a8-ea48e69d401e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:43.006720 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4163/8234] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:18:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:18:43.011230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33eb80-df59-4fd1-8e84-e80e5408dc9f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:43.021643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33eb80-df59-4fd1-8e84-e80e5408dc9f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:43.026474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b7e05-37eb-4145-8db1-24b8db3591db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:43.027128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b7e05-37eb-4145-8db1-24b8db3591db admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:43.027478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b7e05-37eb-4145-8db1-24b8db3591db admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:43.027763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b7e05-37eb-4145-8db1-24b8db3591db admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:43.029028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b7e05-37eb-4145-8db1-24b8db3591db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:43.030929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b7e05-37eb-4145-8db1-24b8db3591db admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:43.057106 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4072/8235] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:43 2021] POST /identity/v3/projects => generated 401 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:43.061926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c421b0-181c-42b8-80a8-ea48e69d401e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:43.072578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c421b0-181c-42b8-80a8-ea48e69d401e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:43.133444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf67ba-348d-41ca-bb71-55f809fcf205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:43.134235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf67ba-348d-41ca-bb71-55f809fcf205 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:43.134555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf67ba-348d-41ca-bb71-55f809fcf205 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:43.134823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf67ba-348d-41ca-bb71-55f809fcf205 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:43.135517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf67ba-348d-41ca-bb71-55f809fcf205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:43.137959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf67ba-348d-41ca-bb71-55f809fcf205 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:43.158528 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4164/8236] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:43 2021] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:43.162890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b7e05-37eb-4145-8db1-24b8db3591db admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:43.173716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b7e05-37eb-4145-8db1-24b8db3591db admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:43.178992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b0b90-63f0-4f34-a6c5-2be239f5a3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:43.179795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0b90-63f0-4f34-a6c5-2be239f5a3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:43.179969 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0b90-63f0-4f34-a6c5-2be239f5a3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:43.180247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0b90-63f0-4f34-a6c5-2be239f5a3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:43.181029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b0b90-63f0-4f34-a6c5-2be239f5a3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:43.182648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b0b90-63f0-4f34-a6c5-2be239f5a3a7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:43.195164 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4073/8237] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:43 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:43.199199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf67ba-348d-41ca-bb71-55f809fcf205 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:43.210448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf67ba-348d-41ca-bb71-55f809fcf205 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:43.215221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278d444-35ec-4599-ab4d-d862bb86f1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:43.215912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278d444-35ec-4599-ab4d-d862bb86f1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:43.216200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278d444-35ec-4599-ab4d-d862bb86f1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:43.216990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278d444-35ec-4599-ab4d-d862bb86f1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:43.217209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278d444-35ec-4599-ab4d-d862bb86f1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:43.218878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278d444-35ec-4599-ab4d-d862bb86f1e1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:43.231886 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4165/8238] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:43 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:43.235753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b0b90-63f0-4f34-a6c5-2be239f5a3a7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:43.247883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b0b90-63f0-4f34-a6c5-2be239f5a3a7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:43.253153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bba4c-e5e4-4174-b9d3-40841521a718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:43.254301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bba4c-e5e4-4174-b9d3-40841521a718 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:43.254637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bba4c-e5e4-4174-b9d3-40841521a718 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:43.255033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bba4c-e5e4-4174-b9d3-40841521a718 admin admin] PATH_INFO: `/v3/projects/4cdf08de0149458b8e0d406196ec5633/users/ff76fa11a9ed4e5bba94c5e614314737/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:43.273637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bba4c-e5e4-4174-b9d3-40841521a718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cdf08de0149458b8e0d406196ec5633, user_id=ff76fa11a9ed4e5bba94c5e614314737, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:43.276660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bba4c-e5e4-4174-b9d3-40841521a718 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:43.293669 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4074/8239] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:43 2021] PUT /identity/v3/projects/4cdf08de0149458b8e0d406196ec5633/users/ff76fa11a9ed4e5bba94c5e614314737/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:43.304430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1c8c1-5cce-4edc-8985-9caedbc3d715 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:43.304905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1c8c1-5cce-4edc-8985-9caedbc3d715 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:43.305259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1c8c1-5cce-4edc-8985-9caedbc3d715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:43.333702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-daa1c8c1-5cce-4edc-8985-9caedbc3d715 None None] MFA Rules not processed for user `ff76fa11a9ed4e5bba94c5e614314737`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:43.334943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-daa1c8c1-5cce-4edc-8985-9caedbc3d715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:43.400233 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4166/8240] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:43 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:43.404728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bba4c-e5e4-4174-b9d3-40841521a718 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:43.464149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bba4c-e5e4-4174-b9d3-40841521a718 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:43.468888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e094d-9f38-4216-8e57-03916c40412d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:43.469537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e094d-9f38-4216-8e57-03916c40412d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:43.469826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e094d-9f38-4216-8e57-03916c40412d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:43.470116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e094d-9f38-4216-8e57-03916c40412d admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:43.470850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e094d-9f38-4216-8e57-03916c40412d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:43.472739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e094d-9f38-4216-8e57-03916c40412d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:43.496395 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4075/8241] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:43 2021] POST /identity/v3/projects => generated 401 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:43.500912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1c8c1-5cce-4edc-8985-9caedbc3d715 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:43.511446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1c8c1-5cce-4edc-8985-9caedbc3d715 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:43.569455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60d3eb-2264-4a6e-8266-4371f703f03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:43.570159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60d3eb-2264-4a6e-8266-4371f703f03e admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:43.570484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60d3eb-2264-4a6e-8266-4371f703f03e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:43.570765 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60d3eb-2264-4a6e-8266-4371f703f03e admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:43.571521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60d3eb-2264-4a6e-8266-4371f703f03e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:43.573385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60d3eb-2264-4a6e-8266-4371f703f03e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:43.593391 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4167/8242] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:43 2021] POST /identity/v3/users => generated 307 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:43.597439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e094d-9f38-4216-8e57-03916c40412d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:43.608282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e094d-9f38-4216-8e57-03916c40412d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:43.612957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fb0a9-05f9-4688-8bf6-9861ffe67d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:43.613608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fb0a9-05f9-4688-8bf6-9861ffe67d70 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:43.613895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fb0a9-05f9-4688-8bf6-9861ffe67d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:43.614174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fb0a9-05f9-4688-8bf6-9861ffe67d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:43.614940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fb0a9-05f9-4688-8bf6-9861ffe67d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:43.616517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fb0a9-05f9-4688-8bf6-9861ffe67d70 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:43.627770 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4076/8243] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:43 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:43.631633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60d3eb-2264-4a6e-8266-4371f703f03e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:43.641559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60d3eb-2264-4a6e-8266-4371f703f03e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:43.646152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930bfce-53b6-42dc-a936-53159b1162d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:43.647057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930bfce-53b6-42dc-a936-53159b1162d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:43.647338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930bfce-53b6-42dc-a936-53159b1162d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:43.647613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930bfce-53b6-42dc-a936-53159b1162d7 admin admin] PATH_INFO: `/v3/projects/61b562a0cb57447485515f31f4344424/users/5f1e8a00d2174a648fe94d38c9e9f117/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:43.661652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930bfce-53b6-42dc-a936-53159b1162d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b562a0cb57447485515f31f4344424, user_id=5f1e8a00d2174a648fe94d38c9e9f117, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:43.664299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930bfce-53b6-42dc-a936-53159b1162d7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:43.677812 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4168/8244] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:43 2021] PUT /identity/v3/projects/61b562a0cb57447485515f31f4344424/users/5f1e8a00d2174a648fe94d38c9e9f117/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:43.681709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fb0a9-05f9-4688-8bf6-9861ffe67d70 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:43.692420 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fb0a9-05f9-4688-8bf6-9861ffe67d70 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:43.747316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d9c59-e976-4dc1-8b5c-aa5d5ad721bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:43.747981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d9c59-e976-4dc1-8b5c-aa5d5ad721bb admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:43.748262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d9c59-e976-4dc1-8b5c-aa5d5ad721bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:43.748537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d9c59-e976-4dc1-8b5c-aa5d5ad721bb admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:43.749261 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d9c59-e976-4dc1-8b5c-aa5d5ad721bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:43.750891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d9c59-e976-4dc1-8b5c-aa5d5ad721bb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:43.760388 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4077/8245] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:43 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:18:43.764667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930bfce-53b6-42dc-a936-53159b1162d7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:43.774793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930bfce-53b6-42dc-a936-53159b1162d7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:43.779500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236c38a-de26-4fe1-be6b-262d26afb972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:43.780389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236c38a-de26-4fe1-be6b-262d26afb972 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:43.780669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236c38a-de26-4fe1-be6b-262d26afb972 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:43.780972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236c38a-de26-4fe1-be6b-262d26afb972 admin admin] PATH_INFO: `/v3/projects/61b562a0cb57447485515f31f4344424/users/5f1e8a00d2174a648fe94d38c9e9f117/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:43.783058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236c38a-de26-4fe1-be6b-262d26afb972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b562a0cb57447485515f31f4344424, user_id=5f1e8a00d2174a648fe94d38c9e9f117, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:43.785708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236c38a-de26-4fe1-be6b-262d26afb972 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:43.796472 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4169/8246] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:43 2021] PUT /identity/v3/projects/61b562a0cb57447485515f31f4344424/users/5f1e8a00d2174a648fe94d38c9e9f117/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:43.806114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8db160-dcba-411d-a767-4eb87aad27d3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:43.806446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8db160-dcba-411d-a767-4eb87aad27d3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:43.806734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8db160-dcba-411d-a767-4eb87aad27d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:43.834444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0f8db160-dcba-411d-a767-4eb87aad27d3 None None] MFA Rules not processed for user `5f1e8a00d2174a648fe94d38c9e9f117`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:43.835567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0f8db160-dcba-411d-a767-4eb87aad27d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:43.902775 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4078/8247] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:43 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:43.912688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236c38a-de26-4fe1-be6b-262d26afb972 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:43.914386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5236c38a-de26-4fe1-be6b-262d26afb972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:43.973787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236c38a-de26-4fe1-be6b-262d26afb972 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:43.977808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9d2eb-332c-4c37-bb1f-71623d109f91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:43.978487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9d2eb-332c-4c37-bb1f-71623d109f91 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:43.978774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9d2eb-332c-4c37-bb1f-71623d109f91 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:43.979060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9d2eb-332c-4c37-bb1f-71623d109f91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:43.988929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9d2eb-332c-4c37-bb1f-71623d109f91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:43.990439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9d2eb-332c-4c37-bb1f-71623d109f91 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:43.999966 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4170/8248] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:43 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:44.073367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8db160-dcba-411d-a767-4eb87aad27d3 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:44.086299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8db160-dcba-411d-a767-4eb87aad27d3 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:44.090980 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c64fa-fc1c-4a9e-8b85-9d45a9c9f5b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:44.091639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c64fa-fc1c-4a9e-8b85-9d45a9c9f5b3 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:44.091925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c64fa-fc1c-4a9e-8b85-9d45a9c9f5b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:44.092200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c64fa-fc1c-4a9e-8b85-9d45a9c9f5b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:44.132833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9d2eb-332c-4c37-bb1f-71623d109f91 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:44.134593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-91b9d2eb-332c-4c37-bb1f-71623d109f91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:44.151094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c64fa-fc1c-4a9e-8b85-9d45a9c9f5b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:44.152524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c64fa-fc1c-4a9e-8b85-9d45a9c9f5b3 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:44.162100 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4079/8249] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:44 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:44.199186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9d2eb-332c-4c37-bb1f-71623d109f91 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:44.203868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8ff97-1ad4-451f-9dd4-abb21673a1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:44.204731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8ff97-1ad4-451f-9dd4-abb21673a1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:44.205015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8ff97-1ad4-451f-9dd4-abb21673a1db admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:44.205296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8ff97-1ad4-451f-9dd4-abb21673a1db admin admin] PATH_INFO: `/v3/users/b31bb5ec543e47d7b1a72c8611b2dca1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:44.206554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8ff97-1ad4-451f-9dd4-abb21673a1db admin admin] RBAC: Authorizing `identity:delete_user(user_id=b31bb5ec543e47d7b1a72c8611b2dca1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:44.208477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8ff97-1ad4-451f-9dd4-abb21673a1db admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:44.255972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6db8ff97-1ad4-451f-9dd4-abb21673a1db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b31bb5ec543e47d7b1a72c8611b2dca1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:44.263689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6db8ff97-1ad4-451f-9dd4-abb21673a1db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b31bb5ec543e47d7b1a72c8611b2dca1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:44.264584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6db8ff97-1ad4-451f-9dd4-abb21673a1db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b31bb5ec543e47d7b1a72c8611b2dca1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:44.277105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6db8ff97-1ad4-451f-9dd4-abb21673a1db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b31bb5ec543e47d7b1a72c8611b2dca1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:44.285109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6db8ff97-1ad4-451f-9dd4-abb21673a1db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b31bb5ec543e47d7b1a72c8611b2dca1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:44.291233 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4171/8250] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:44 2021] DELETE /identity/v3/users/b31bb5ec543e47d7b1a72c8611b2dca1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:44.296209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c2927-ac69-4661-ac3e-efc319e6ddde None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:44.296556 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c2927-ac69-4661-ac3e-efc319e6ddde None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:44.296774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c2927-ac69-4661-ac3e-efc319e6ddde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:44.314232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-de6c2927-ac69-4661-ac3e-efc319e6ddde None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:44.315480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-de6c2927-ac69-4661-ac3e-efc319e6ddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:44.385497 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4080/8251] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:44.400746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8ff97-1ad4-451f-9dd4-abb21673a1db admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:44.402644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6db8ff97-1ad4-451f-9dd4-abb21673a1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:44.467026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8ff97-1ad4-451f-9dd4-abb21673a1db admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:44.470781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7711c4-1af3-4ac1-8085-57edf437ea10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:44.471425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7711c4-1af3-4ac1-8085-57edf437ea10 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:44.471712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7711c4-1af3-4ac1-8085-57edf437ea10 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:44.471992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7711c4-1af3-4ac1-8085-57edf437ea10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:44.481889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7711c4-1af3-4ac1-8085-57edf437ea10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:44.483360 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7711c4-1af3-4ac1-8085-57edf437ea10 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:44.493534 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4172/8252] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:44.768876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c2927-ac69-4661-ac3e-efc319e6ddde None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:44.770476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-de6c2927-ac69-4661-ac3e-efc319e6ddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:44.784074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c2927-ac69-4661-ac3e-efc319e6ddde None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:44.788655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a254bd5-648b-4e2d-a191-47da4a5902b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:44.789515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a254bd5-648b-4e2d-a191-47da4a5902b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:44.789802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a254bd5-648b-4e2d-a191-47da4a5902b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:44.790080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a254bd5-648b-4e2d-a191-47da4a5902b9 admin admin] PATH_INFO: `/v3/projects/f611af1fd922479788c6c7b294186add` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:44.791319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a254bd5-648b-4e2d-a191-47da4a5902b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f611af1fd922479788c6c7b294186add)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:44.793235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a254bd5-648b-4e2d-a191-47da4a5902b9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:44.838724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6a254bd5-648b-4e2d-a191-47da4a5902b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f611af1fd922479788c6c7b294186add', 'request_id': 'req-6a254bd5-648b-4e2d-a191-47da4a5902b9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:44.844582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6a254bd5-648b-4e2d-a191-47da4a5902b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f611af1fd922479788c6c7b294186add', 'request_id': 'req-6a254bd5-648b-4e2d-a191-47da4a5902b9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:44.849840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6a254bd5-648b-4e2d-a191-47da4a5902b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f611af1fd922479788c6c7b294186add', 'request_id': 'req-6a254bd5-648b-4e2d-a191-47da4a5902b9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:44.861944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6a254bd5-648b-4e2d-a191-47da4a5902b9 admin admin] The token cache is being invalidate because project f611af1fd922479788c6c7b294186add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:44.862245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6a254bd5-648b-4e2d-a191-47da4a5902b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:44.862874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6a254bd5-648b-4e2d-a191-47da4a5902b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:44.864478 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4081/8253] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:44 2021] DELETE /identity/v3/projects/f611af1fd922479788c6c7b294186add => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:44.868475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7711c4-1af3-4ac1-8085-57edf437ea10 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:44.878525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7711c4-1af3-4ac1-8085-57edf437ea10 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:44.932471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc71ccf-8322-449a-95a3-821abc8d9d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:44.933328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc71ccf-8322-449a-95a3-821abc8d9d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:44.933611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc71ccf-8322-449a-95a3-821abc8d9d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:44.933889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc71ccf-8322-449a-95a3-821abc8d9d7a admin admin] PATH_INFO: `/v3/users/804a986b17724a7c8b616e3e892097ba` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:44.935628 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc71ccf-8322-449a-95a3-821abc8d9d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=804a986b17724a7c8b616e3e892097ba)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:44.937529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc71ccf-8322-449a-95a3-821abc8d9d7a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:44.983181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9bc71ccf-8322-449a-95a3-821abc8d9d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '804a986b17724a7c8b616e3e892097ba'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:44.989881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9bc71ccf-8322-449a-95a3-821abc8d9d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '804a986b17724a7c8b616e3e892097ba'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:44.990665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9bc71ccf-8322-449a-95a3-821abc8d9d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '804a986b17724a7c8b616e3e892097ba'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:45.003977 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9bc71ccf-8322-449a-95a3-821abc8d9d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '804a986b17724a7c8b616e3e892097ba'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:45.011136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9bc71ccf-8322-449a-95a3-821abc8d9d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '804a986b17724a7c8b616e3e892097ba'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:45.017785 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4173/8254] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:44 2021] DELETE /identity/v3/users/804a986b17724a7c8b616e3e892097ba => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:45.287400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a254bd5-648b-4e2d-a191-47da4a5902b9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:45.289496 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6a254bd5-648b-4e2d-a191-47da4a5902b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:45.305901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a254bd5-648b-4e2d-a191-47da4a5902b9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:45.362680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e2b50-8c09-4029-bbcc-da00f64aa9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:45.363536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e2b50-8c09-4029-bbcc-da00f64aa9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:45.363821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e2b50-8c09-4029-bbcc-da00f64aa9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:45.364101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e2b50-8c09-4029-bbcc-da00f64aa9aa admin admin] PATH_INFO: `/v3/projects/b95820945aa84eb8a537c60296362abe` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:45.365275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e2b50-8c09-4029-bbcc-da00f64aa9aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95820945aa84eb8a537c60296362abe)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:45.367217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e2b50-8c09-4029-bbcc-da00f64aa9aa admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:45.428963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2f6e2b50-8c09-4029-bbcc-da00f64aa9aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95820945aa84eb8a537c60296362abe', 'request_id': 'req-2f6e2b50-8c09-4029-bbcc-da00f64aa9aa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:45.436104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2f6e2b50-8c09-4029-bbcc-da00f64aa9aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95820945aa84eb8a537c60296362abe', 'request_id': 'req-2f6e2b50-8c09-4029-bbcc-da00f64aa9aa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:45.441682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2f6e2b50-8c09-4029-bbcc-da00f64aa9aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95820945aa84eb8a537c60296362abe', 'request_id': 'req-2f6e2b50-8c09-4029-bbcc-da00f64aa9aa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:45.454163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2f6e2b50-8c09-4029-bbcc-da00f64aa9aa admin admin] The token cache is being invalidate because project b95820945aa84eb8a537c60296362abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:45.454483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2f6e2b50-8c09-4029-bbcc-da00f64aa9aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:45.455110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-2f6e2b50-8c09-4029-bbcc-da00f64aa9aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:45.456642 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4082/8255] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:45 2021] DELETE /identity/v3/projects/b95820945aa84eb8a537c60296362abe => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:45.462263 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dfb6a-37e2-4002-9162-56afc103107a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:45.462585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dfb6a-37e2-4002-9162-56afc103107a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:45.462864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dfb6a-37e2-4002-9162-56afc103107a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:45.482214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-058dfb6a-37e2-4002-9162-56afc103107a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:45.483436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-058dfb6a-37e2-4002-9162-56afc103107a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:45.547313 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4174/8256] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:45.554889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c09aa-47c8-4b73-89ee-d2451fd840b1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:45.555183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c09aa-47c8-4b73-89ee-d2451fd840b1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:45.555465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c09aa-47c8-4b73-89ee-d2451fd840b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:45.574128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-bd6c09aa-47c8-4b73-89ee-d2451fd840b1 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:45.575408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bd6c09aa-47c8-4b73-89ee-d2451fd840b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:45.583713 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4083/8257] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:45.587906 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058dfb6a-37e2-4002-9162-56afc103107a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:45.597994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058dfb6a-37e2-4002-9162-56afc103107a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:45.602730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2ff64-71ca-4132-8ff8-7686abe8947e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:45.603220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2ff64-71ca-4132-8ff8-7686abe8947e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:45.603503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2ff64-71ca-4132-8ff8-7686abe8947e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:45.603775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2ff64-71ca-4132-8ff8-7686abe8947e admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:45.604497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2ff64-71ca-4132-8ff8-7686abe8947e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:18:45.604803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2ff64-71ca-4132-8ff8-7686abe8947e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:45.606961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2ff64-71ca-4132-8ff8-7686abe8947e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:45.619329 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4175/8258] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:18:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:18:45.624603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c09aa-47c8-4b73-89ee-d2451fd840b1 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:45.635790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c09aa-47c8-4b73-89ee-d2451fd840b1 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:45.640548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521481a7-e12e-40f4-90f0-eb165e2af8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:45.641222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521481a7-e12e-40f4-90f0-eb165e2af8ad admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:45.641520 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521481a7-e12e-40f4-90f0-eb165e2af8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:45.641803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521481a7-e12e-40f4-90f0-eb165e2af8ad admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:45.642629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521481a7-e12e-40f4-90f0-eb165e2af8ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:45.644570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521481a7-e12e-40f4-90f0-eb165e2af8ad admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:45.672279 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4084/8259] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:45 2021] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:45.675508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2ff64-71ca-4132-8ff8-7686abe8947e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:45.685568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2ff64-71ca-4132-8ff8-7686abe8947e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:45.756514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d1a5f-ce96-4693-967f-38a6aa4719f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:45.757190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d1a5f-ce96-4693-967f-38a6aa4719f6 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:45.757470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d1a5f-ce96-4693-967f-38a6aa4719f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:45.757746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d1a5f-ce96-4693-967f-38a6aa4719f6 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:45.758677 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d1a5f-ce96-4693-967f-38a6aa4719f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:45.761235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d1a5f-ce96-4693-967f-38a6aa4719f6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:45.786286 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4176/8260] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:45 2021] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:45.791843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521481a7-e12e-40f4-90f0-eb165e2af8ad admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:45.803937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521481a7-e12e-40f4-90f0-eb165e2af8ad admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:45.808786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a9562-9fd9-48d4-b84f-bca2c927c891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:45.809908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a9562-9fd9-48d4-b84f-bca2c927c891 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:45.810613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a9562-9fd9-48d4-b84f-bca2c927c891 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:45.810748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a9562-9fd9-48d4-b84f-bca2c927c891 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:45.811825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a9562-9fd9-48d4-b84f-bca2c927c891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:45.814187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a9562-9fd9-48d4-b84f-bca2c927c891 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:45.826408 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4085/8261] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:45 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:45.830612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d1a5f-ce96-4693-967f-38a6aa4719f6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:45.842179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d1a5f-ce96-4693-967f-38a6aa4719f6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:45.847116 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a3a5e-2b12-4773-8380-6587c2da5317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:45.847778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a3a5e-2b12-4773-8380-6587c2da5317 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:45.848065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a3a5e-2b12-4773-8380-6587c2da5317 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:45.848348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a3a5e-2b12-4773-8380-6587c2da5317 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:45.849076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a3a5e-2b12-4773-8380-6587c2da5317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:45.850721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a3a5e-2b12-4773-8380-6587c2da5317 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:45.861501 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4177/8262] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:45 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:45.865618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a9562-9fd9-48d4-b84f-bca2c927c891 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:45.875747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a9562-9fd9-48d4-b84f-bca2c927c891 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:45.880443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2e676-65c8-419c-b7b3-7465378747a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:45.881318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2e676-65c8-419c-b7b3-7465378747a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:45.881602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2e676-65c8-419c-b7b3-7465378747a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:45.881879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2e676-65c8-419c-b7b3-7465378747a5 admin admin] PATH_INFO: `/v3/projects/0a9b1da363674623bfab3da0ef60a62d/users/4a2f4eb279914c21912e022444361cc5/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:45.896459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2e676-65c8-419c-b7b3-7465378747a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9b1da363674623bfab3da0ef60a62d, user_id=4a2f4eb279914c21912e022444361cc5, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:45.899115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2e676-65c8-419c-b7b3-7465378747a5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:45.912641 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4086/8263] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:45 2021] PUT /identity/v3/projects/0a9b1da363674623bfab3da0ef60a62d/users/4a2f4eb279914c21912e022444361cc5/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:45.922619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f4bf0-a0fb-4da3-91e8-96f623c62d27 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:45.922910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f4bf0-a0fb-4da3-91e8-96f623c62d27 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:45.923220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f4bf0-a0fb-4da3-91e8-96f623c62d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:45.948997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a15f4bf0-a0fb-4da3-91e8-96f623c62d27 None None] MFA Rules not processed for user `4a2f4eb279914c21912e022444361cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:45.950680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a15f4bf0-a0fb-4da3-91e8-96f623c62d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:46.020594 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4178/8264] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:45 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:46.025453 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2e676-65c8-419c-b7b3-7465378747a5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:46.088207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2e676-65c8-419c-b7b3-7465378747a5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:46.093644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dfa48-73fb-4bb0-b7bc-5a154e66dca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:46.094330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dfa48-73fb-4bb0-b7bc-5a154e66dca4 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:46.094622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dfa48-73fb-4bb0-b7bc-5a154e66dca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:46.094903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dfa48-73fb-4bb0-b7bc-5a154e66dca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:46.095600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297dfa48-73fb-4bb0-b7bc-5a154e66dca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:46.097561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297dfa48-73fb-4bb0-b7bc-5a154e66dca4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:46.121542 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4087/8265] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:46 2021] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:46.125732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f4bf0-a0fb-4da3-91e8-96f623c62d27 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:46.136630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f4bf0-a0fb-4da3-91e8-96f623c62d27 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:46.192905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c64f50-0f29-4fed-a21d-d48e825beb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:46.193573 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c64f50-0f29-4fed-a21d-d48e825beb73 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:46.193857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c64f50-0f29-4fed-a21d-d48e825beb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:46.194139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c64f50-0f29-4fed-a21d-d48e825beb73 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:46.194874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c64f50-0f29-4fed-a21d-d48e825beb73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:46.196787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c64f50-0f29-4fed-a21d-d48e825beb73 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:46.216709 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4179/8266] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:46 2021] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:46.220595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dfa48-73fb-4bb0-b7bc-5a154e66dca4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:46.230792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dfa48-73fb-4bb0-b7bc-5a154e66dca4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:46.235448 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c422af3-4cfe-416d-8931-6c278fd585a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:46.236102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c422af3-4cfe-416d-8931-6c278fd585a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:46.236392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c422af3-4cfe-416d-8931-6c278fd585a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:46.236675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c422af3-4cfe-416d-8931-6c278fd585a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:46.237403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c422af3-4cfe-416d-8931-6c278fd585a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:46.239027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c422af3-4cfe-416d-8931-6c278fd585a0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:46.249821 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4088/8267] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:46 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:46.253680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c64f50-0f29-4fed-a21d-d48e825beb73 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:46.264164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c64f50-0f29-4fed-a21d-d48e825beb73 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:46.268795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e6cfc-7748-417e-bfcf-fa2e3f9467c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:46.269656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6cfc-7748-417e-bfcf-fa2e3f9467c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:46.269944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6cfc-7748-417e-bfcf-fa2e3f9467c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:46.270225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6cfc-7748-417e-bfcf-fa2e3f9467c2 admin admin] PATH_INFO: `/v3/projects/588cf3dc52bc4320ad6af73de0cd87ee/users/b5886f1556ed40bd9c4a236ad93120e5/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:46.284773 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e6cfc-7748-417e-bfcf-fa2e3f9467c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=588cf3dc52bc4320ad6af73de0cd87ee, user_id=b5886f1556ed40bd9c4a236ad93120e5, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:46.287462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e6cfc-7748-417e-bfcf-fa2e3f9467c2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:46.299721 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4180/8268] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:46 2021] PUT /identity/v3/projects/588cf3dc52bc4320ad6af73de0cd87ee/users/b5886f1556ed40bd9c4a236ad93120e5/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:46.303433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c422af3-4cfe-416d-8931-6c278fd585a0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:46.314157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c422af3-4cfe-416d-8931-6c278fd585a0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:46.370813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b1f27-83a7-40ab-a242-256007de6bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:46.372072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b1f27-83a7-40ab-a242-256007de6bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:46.372377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b1f27-83a7-40ab-a242-256007de6bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:46.372655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b1f27-83a7-40ab-a242-256007de6bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:46.373383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b1f27-83a7-40ab-a242-256007de6bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:46.374990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b1f27-83a7-40ab-a242-256007de6bc0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:46.384345 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4089/8269] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:46 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:46.389300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e6cfc-7748-417e-bfcf-fa2e3f9467c2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:46.399529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e6cfc-7748-417e-bfcf-fa2e3f9467c2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:46.404202 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273b2d9-11ac-4155-94ea-e44f927f0f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:46.405066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273b2d9-11ac-4155-94ea-e44f927f0f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:46.405349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273b2d9-11ac-4155-94ea-e44f927f0f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:46.405625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273b2d9-11ac-4155-94ea-e44f927f0f5b admin admin] PATH_INFO: `/v3/projects/588cf3dc52bc4320ad6af73de0cd87ee/users/b5886f1556ed40bd9c4a236ad93120e5/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:46.407665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273b2d9-11ac-4155-94ea-e44f927f0f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=588cf3dc52bc4320ad6af73de0cd87ee, user_id=b5886f1556ed40bd9c4a236ad93120e5, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:46.410308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273b2d9-11ac-4155-94ea-e44f927f0f5b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:46.420153 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4181/8270] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:46 2021] PUT /identity/v3/projects/588cf3dc52bc4320ad6af73de0cd87ee/users/b5886f1556ed40bd9c4a236ad93120e5/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:46.429989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad9e92-eaff-4226-b479-9440993ba6ab None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:46.430313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad9e92-eaff-4226-b479-9440993ba6ab None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:46.430602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad9e92-eaff-4226-b479-9440993ba6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:46.457203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-baad9e92-eaff-4226-b479-9440993ba6ab None None] MFA Rules not processed for user `b5886f1556ed40bd9c4a236ad93120e5`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:46.458434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-baad9e92-eaff-4226-b479-9440993ba6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:46.523231 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4090/8271] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:46 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:46.533713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273b2d9-11ac-4155-94ea-e44f927f0f5b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:46.535445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0273b2d9-11ac-4155-94ea-e44f927f0f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:46.595455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273b2d9-11ac-4155-94ea-e44f927f0f5b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:46.599142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e79aa7-7a0d-4b2c-a012-e92d85bb0297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:46.599800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e79aa7-7a0d-4b2c-a012-e92d85bb0297 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:46.600080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e79aa7-7a0d-4b2c-a012-e92d85bb0297 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:46.600366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e79aa7-7a0d-4b2c-a012-e92d85bb0297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:46.611028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e79aa7-7a0d-4b2c-a012-e92d85bb0297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:46.612468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e79aa7-7a0d-4b2c-a012-e92d85bb0297 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:46.622906 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4182/8272] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:46 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:46.708587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad9e92-eaff-4226-b479-9440993ba6ab None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:46.724274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad9e92-eaff-4226-b479-9440993ba6ab None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:46.727942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf9b9c-facc-4342-a60a-6abd87b5cb08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:46.728620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf9b9c-facc-4342-a60a-6abd87b5cb08 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:46.728907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf9b9c-facc-4342-a60a-6abd87b5cb08 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:46.729187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf9b9c-facc-4342-a60a-6abd87b5cb08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:46.784854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf9b9c-facc-4342-a60a-6abd87b5cb08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:46.786299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf9b9c-facc-4342-a60a-6abd87b5cb08 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:46.795731 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4091/8273] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:46 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:18:48.185844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e79aa7-7a0d-4b2c-a012-e92d85bb0297 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:48.187374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-25e79aa7-7a0d-4b2c-a012-e92d85bb0297 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:48.271002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e79aa7-7a0d-4b2c-a012-e92d85bb0297 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:48.275486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd46115-999a-4d52-9558-6e534ddf2935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:48.276406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd46115-999a-4d52-9558-6e534ddf2935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:48.276629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd46115-999a-4d52-9558-6e534ddf2935 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:48.276915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd46115-999a-4d52-9558-6e534ddf2935 admin admin] PATH_INFO: `/v3/users/ff76fa11a9ed4e5bba94c5e614314737` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:48.278143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd46115-999a-4d52-9558-6e534ddf2935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff76fa11a9ed4e5bba94c5e614314737)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:48.280092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd46115-999a-4d52-9558-6e534ddf2935 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:48.333895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-abd46115-999a-4d52-9558-6e534ddf2935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff76fa11a9ed4e5bba94c5e614314737'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:48.348236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-abd46115-999a-4d52-9558-6e534ddf2935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff76fa11a9ed4e5bba94c5e614314737'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:48.349339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-abd46115-999a-4d52-9558-6e534ddf2935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff76fa11a9ed4e5bba94c5e614314737'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:48.381404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-abd46115-999a-4d52-9558-6e534ddf2935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff76fa11a9ed4e5bba94c5e614314737'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:48.391952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-abd46115-999a-4d52-9558-6e534ddf2935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff76fa11a9ed4e5bba94c5e614314737'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:48.399486 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4183/8274] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:48 2021] DELETE /identity/v3/users/ff76fa11a9ed4e5bba94c5e614314737 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:48.403835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525ea09-a1e2-4082-b1a3-04a92c62a8a2 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:48.404698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525ea09-a1e2-4082-b1a3-04a92c62a8a2 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:48.405315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525ea09-a1e2-4082-b1a3-04a92c62a8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:48.425181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4525ea09-a1e2-4082-b1a3-04a92c62a8a2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:48.427152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4525ea09-a1e2-4082-b1a3-04a92c62a8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:48.503133 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4092/8275] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:48.514100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd46115-999a-4d52-9558-6e534ddf2935 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:48.515600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-abd46115-999a-4d52-9558-6e534ddf2935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:48.583182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd46115-999a-4d52-9558-6e534ddf2935 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:48.587084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca7af3-40dc-4f87-b498-9c0e584a137c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:48.587730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca7af3-40dc-4f87-b498-9c0e584a137c service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:48.588009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca7af3-40dc-4f87-b498-9c0e584a137c service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:48.588286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca7af3-40dc-4f87-b498-9c0e584a137c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:48.598442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca7af3-40dc-4f87-b498-9c0e584a137c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:48.599876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca7af3-40dc-4f87-b498-9c0e584a137c service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:48.610510 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4184/8276] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:48.875456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525ea09-a1e2-4082-b1a3-04a92c62a8a2 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:48.876992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4525ea09-a1e2-4082-b1a3-04a92c62a8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:48.890665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525ea09-a1e2-4082-b1a3-04a92c62a8a2 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:48.895976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0578746-6c6a-4d8c-a445-1daa5c107723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:48.897035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0578746-6c6a-4d8c-a445-1daa5c107723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:48.897319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0578746-6c6a-4d8c-a445-1daa5c107723 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:48.897745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0578746-6c6a-4d8c-a445-1daa5c107723 admin admin] PATH_INFO: `/v3/projects/4cdf08de0149458b8e0d406196ec5633` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:48.899155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0578746-6c6a-4d8c-a445-1daa5c107723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cdf08de0149458b8e0d406196ec5633)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:48.901064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0578746-6c6a-4d8c-a445-1daa5c107723 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:48.947227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c0578746-6c6a-4d8c-a445-1daa5c107723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cdf08de0149458b8e0d406196ec5633', 'request_id': 'req-c0578746-6c6a-4d8c-a445-1daa5c107723'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:48.953862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c0578746-6c6a-4d8c-a445-1daa5c107723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cdf08de0149458b8e0d406196ec5633', 'request_id': 'req-c0578746-6c6a-4d8c-a445-1daa5c107723'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:48.959532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c0578746-6c6a-4d8c-a445-1daa5c107723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cdf08de0149458b8e0d406196ec5633', 'request_id': 'req-c0578746-6c6a-4d8c-a445-1daa5c107723'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:48.973893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c0578746-6c6a-4d8c-a445-1daa5c107723 admin admin] The token cache is being invalidate because project 4cdf08de0149458b8e0d406196ec5633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:48.974189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c0578746-6c6a-4d8c-a445-1daa5c107723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:48.975048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c0578746-6c6a-4d8c-a445-1daa5c107723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:48.976721 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4093/8277] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:48 2021] DELETE /identity/v3/projects/4cdf08de0149458b8e0d406196ec5633 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:48.980837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca7af3-40dc-4f87-b498-9c0e584a137c service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:48.991442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca7af3-40dc-4f87-b498-9c0e584a137c service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:49.055016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb4689-b43c-412b-a38d-852bda2a7aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:49.055701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb4689-b43c-412b-a38d-852bda2a7aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:49.055981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb4689-b43c-412b-a38d-852bda2a7aae admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:49.056258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb4689-b43c-412b-a38d-852bda2a7aae admin admin] PATH_INFO: `/v3/users/5f1e8a00d2174a648fe94d38c9e9f117` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:49.057485 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb4689-b43c-412b-a38d-852bda2a7aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f1e8a00d2174a648fe94d38c9e9f117)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:49.060727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb4689-b43c-412b-a38d-852bda2a7aae admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:49.161400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3eb4689-b43c-412b-a38d-852bda2a7aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f1e8a00d2174a648fe94d38c9e9f117'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:49.169432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3eb4689-b43c-412b-a38d-852bda2a7aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f1e8a00d2174a648fe94d38c9e9f117'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:49.170219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3eb4689-b43c-412b-a38d-852bda2a7aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f1e8a00d2174a648fe94d38c9e9f117'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:49.183021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3eb4689-b43c-412b-a38d-852bda2a7aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f1e8a00d2174a648fe94d38c9e9f117'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:49.194237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-d3eb4689-b43c-412b-a38d-852bda2a7aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f1e8a00d2174a648fe94d38c9e9f117'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:49.205314 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4185/8278] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:48 2021] DELETE /identity/v3/users/5f1e8a00d2174a648fe94d38c9e9f117 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:49.570024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0578746-6c6a-4d8c-a445-1daa5c107723 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:49.572965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c0578746-6c6a-4d8c-a445-1daa5c107723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:49.635231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0578746-6c6a-4d8c-a445-1daa5c107723 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:49.727233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2a380-9abc-4be1-a62e-a8621f49ade1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:49.728137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2a380-9abc-4be1-a62e-a8621f49ade1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:49.728426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2a380-9abc-4be1-a62e-a8621f49ade1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:49.728715 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2a380-9abc-4be1-a62e-a8621f49ade1 admin admin] PATH_INFO: `/v3/projects/61b562a0cb57447485515f31f4344424` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:49.729908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2a380-9abc-4be1-a62e-a8621f49ade1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b562a0cb57447485515f31f4344424)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:49.733369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2a380-9abc-4be1-a62e-a8621f49ade1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:49.800717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6ce2a380-9abc-4be1-a62e-a8621f49ade1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b562a0cb57447485515f31f4344424', 'request_id': 'req-6ce2a380-9abc-4be1-a62e-a8621f49ade1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:49.826243 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6ce2a380-9abc-4be1-a62e-a8621f49ade1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b562a0cb57447485515f31f4344424', 'request_id': 'req-6ce2a380-9abc-4be1-a62e-a8621f49ade1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:49.839155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6ce2a380-9abc-4be1-a62e-a8621f49ade1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b562a0cb57447485515f31f4344424', 'request_id': 'req-6ce2a380-9abc-4be1-a62e-a8621f49ade1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:49.857083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6ce2a380-9abc-4be1-a62e-a8621f49ade1 admin admin] The token cache is being invalidate because project 61b562a0cb57447485515f31f4344424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:49.857679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6ce2a380-9abc-4be1-a62e-a8621f49ade1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:49.858590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-6ce2a380-9abc-4be1-a62e-a8621f49ade1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:49.861282 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4094/8279] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:49 2021] DELETE /identity/v3/projects/61b562a0cb57447485515f31f4344424 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:49.867023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c1128-196a-41ca-a165-3753ea91c389 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:49.867333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c1128-196a-41ca-a165-3753ea91c389 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:49.867621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c1128-196a-41ca-a165-3753ea91c389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:49.892349 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0f9c1128-196a-41ca-a165-3753ea91c389 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:49.894639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0f9c1128-196a-41ca-a165-3753ea91c389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:49.969003 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4186/8280] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:49.977116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8171c4-f4ab-4356-bf5f-6091e2e61f4e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:49.977406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8171c4-f4ab-4356-bf5f-6091e2e61f4e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:49.977754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8171c4-f4ab-4356-bf5f-6091e2e61f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:50.000122 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8a8171c4-f4ab-4356-bf5f-6091e2e61f4e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:50.002343 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8a8171c4-f4ab-4356-bf5f-6091e2e61f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:50.014428 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4095/8281] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:50.020244 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c1128-196a-41ca-a165-3753ea91c389 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:50.032361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c1128-196a-41ca-a165-3753ea91c389 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:50.037652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09fcfb-023a-4f6c-83ca-939cb2d936e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:50.038357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09fcfb-023a-4f6c-83ca-939cb2d936e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:50.038832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09fcfb-023a-4f6c-83ca-939cb2d936e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:50.039135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09fcfb-023a-4f6c-83ca-939cb2d936e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:50.040188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09fcfb-023a-4f6c-83ca-939cb2d936e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:18:50.040497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09fcfb-023a-4f6c-83ca-939cb2d936e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:50.042235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09fcfb-023a-4f6c-83ca-939cb2d936e2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:50.062988 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4187/8282] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:18:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:18:50.064174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8171c4-f4ab-4356-bf5f-6091e2e61f4e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:50.074367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8171c4-f4ab-4356-bf5f-6091e2e61f4e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:50.079880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2f949-0651-49b3-b530-c13a7b4dfbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:50.080714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2f949-0651-49b3-b530-c13a7b4dfbf7 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:50.081012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2f949-0651-49b3-b530-c13a7b4dfbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:50.081290 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2f949-0651-49b3-b530-c13a7b4dfbf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:50.082012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2f949-0651-49b3-b530-c13a7b4dfbf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:50.083986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2f949-0651-49b3-b530-c13a7b4dfbf7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:50.132235 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4096/8283] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:50 2021] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:50.133554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09fcfb-023a-4f6c-83ca-939cb2d936e2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:50.145387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09fcfb-023a-4f6c-83ca-939cb2d936e2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:50.232359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715bdd3-bd51-49a9-a00a-cd9f67b8a819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:50.234023 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715bdd3-bd51-49a9-a00a-cd9f67b8a819 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:50.234481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715bdd3-bd51-49a9-a00a-cd9f67b8a819 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:50.235076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715bdd3-bd51-49a9-a00a-cd9f67b8a819 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:50.236594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715bdd3-bd51-49a9-a00a-cd9f67b8a819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:50.239404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715bdd3-bd51-49a9-a00a-cd9f67b8a819 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:50.276734 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4188/8284] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:50 2021] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:50.281133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2f949-0651-49b3-b530-c13a7b4dfbf7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:50.299180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2f949-0651-49b3-b530-c13a7b4dfbf7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:50.321811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb977e-a37d-4bd3-9c4e-67bccaae69cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:50.322676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb977e-a37d-4bd3-9c4e-67bccaae69cf admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:50.322939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb977e-a37d-4bd3-9c4e-67bccaae69cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:50.323347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb977e-a37d-4bd3-9c4e-67bccaae69cf admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:50.324103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb977e-a37d-4bd3-9c4e-67bccaae69cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:50.326519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb977e-a37d-4bd3-9c4e-67bccaae69cf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:50.342295 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4097/8285] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:50 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:50.345877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715bdd3-bd51-49a9-a00a-cd9f67b8a819 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:50.360328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715bdd3-bd51-49a9-a00a-cd9f67b8a819 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:50.365947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc23d5-0353-45d5-8275-0cdafd514c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:50.366644 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc23d5-0353-45d5-8275-0cdafd514c16 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:50.366930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc23d5-0353-45d5-8275-0cdafd514c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:50.367205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc23d5-0353-45d5-8275-0cdafd514c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:50.367950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc23d5-0353-45d5-8275-0cdafd514c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:50.369542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc23d5-0353-45d5-8275-0cdafd514c16 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:50.383220 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4189/8286] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:50 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:50.388123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb977e-a37d-4bd3-9c4e-67bccaae69cf admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:50.398920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb977e-a37d-4bd3-9c4e-67bccaae69cf admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:50.405623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b54f4-6e3c-43ab-bcef-a1031ec00001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:50.406882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b54f4-6e3c-43ab-bcef-a1031ec00001 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:50.407154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b54f4-6e3c-43ab-bcef-a1031ec00001 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:50.407433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b54f4-6e3c-43ab-bcef-a1031ec00001 admin admin] PATH_INFO: `/v3/projects/7c696c6cad1c43398c00e0efebc99682/users/df641caa3083410ea417302a3971ebae/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:50.441672 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b54f4-6e3c-43ab-bcef-a1031ec00001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c696c6cad1c43398c00e0efebc99682, user_id=df641caa3083410ea417302a3971ebae, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:50.445992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b54f4-6e3c-43ab-bcef-a1031ec00001 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:50.463427 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4098/8287] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:50 2021] PUT /identity/v3/projects/7c696c6cad1c43398c00e0efebc99682/users/df641caa3083410ea417302a3971ebae/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:50.476498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fc50d-a13a-4747-b800-d70fafda54c1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:50.476907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fc50d-a13a-4747-b800-d70fafda54c1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:50.477553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fc50d-a13a-4747-b800-d70fafda54c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:50.508138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0a5fc50d-a13a-4747-b800-d70fafda54c1 None None] MFA Rules not processed for user `df641caa3083410ea417302a3971ebae`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:50.509344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0a5fc50d-a13a-4747-b800-d70fafda54c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:50.603478 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4190/8288] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:50 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:50.607347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b54f4-6e3c-43ab-bcef-a1031ec00001 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:50.709588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b54f4-6e3c-43ab-bcef-a1031ec00001 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:50.734814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75742db-3787-46dd-bdcd-dfc93205f471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:50.736260 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75742db-3787-46dd-bdcd-dfc93205f471 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:50.736796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75742db-3787-46dd-bdcd-dfc93205f471 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:50.737184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75742db-3787-46dd-bdcd-dfc93205f471 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:50.738552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75742db-3787-46dd-bdcd-dfc93205f471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:50.742770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75742db-3787-46dd-bdcd-dfc93205f471 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:50.777129 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4099/8289] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:50 2021] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:50.778674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fc50d-a13a-4747-b800-d70fafda54c1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:50.790148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fc50d-a13a-4747-b800-d70fafda54c1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:50.869271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802dfcd-0b9d-4fc0-b42e-bb76ae6e34ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:50.870201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802dfcd-0b9d-4fc0-b42e-bb76ae6e34ec admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:50.870536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802dfcd-0b9d-4fc0-b42e-bb76ae6e34ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:50.870954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802dfcd-0b9d-4fc0-b42e-bb76ae6e34ec admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:50.872218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802dfcd-0b9d-4fc0-b42e-bb76ae6e34ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:50.874191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802dfcd-0b9d-4fc0-b42e-bb76ae6e34ec admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:50.896780 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4191/8290] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:50 2021] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:50.901941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75742db-3787-46dd-bdcd-dfc93205f471 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:50.913171 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75742db-3787-46dd-bdcd-dfc93205f471 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:50.921709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952107b8-1245-4c1b-bb07-985a61387591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:50.922692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952107b8-1245-4c1b-bb07-985a61387591 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:50.923042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952107b8-1245-4c1b-bb07-985a61387591 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:50.923355 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952107b8-1245-4c1b-bb07-985a61387591 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:50.924180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952107b8-1245-4c1b-bb07-985a61387591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:50.926043 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952107b8-1245-4c1b-bb07-985a61387591 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:50.942649 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4100/8291] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:50 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:50.943959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802dfcd-0b9d-4fc0-b42e-bb76ae6e34ec admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:50.957708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802dfcd-0b9d-4fc0-b42e-bb76ae6e34ec admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:50.964131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20ba14-ff8f-4b00-a322-9bd4e0128671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:50.964894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20ba14-ff8f-4b00-a322-9bd4e0128671 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:50.965239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20ba14-ff8f-4b00-a322-9bd4e0128671 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:50.965581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20ba14-ff8f-4b00-a322-9bd4e0128671 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:50.966416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20ba14-ff8f-4b00-a322-9bd4e0128671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:50.968232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20ba14-ff8f-4b00-a322-9bd4e0128671 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:50.980294 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4192/8292] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:50 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:50.985786 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952107b8-1245-4c1b-bb07-985a61387591 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:50.997373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952107b8-1245-4c1b-bb07-985a61387591 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:51.002127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6c4c3-b05e-4299-a787-4151d1756ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:51.003076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6c4c3-b05e-4299-a787-4151d1756ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:51.003605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6c4c3-b05e-4299-a787-4151d1756ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:51.003981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6c4c3-b05e-4299-a787-4151d1756ba1 admin admin] PATH_INFO: `/v3/projects/9d26a3fdd4ff4eaa9f424c5a64299851/users/7e550670cdfb4cf0a088b17d73bdea62/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:51.025806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6c4c3-b05e-4299-a787-4151d1756ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d26a3fdd4ff4eaa9f424c5a64299851, user_id=7e550670cdfb4cf0a088b17d73bdea62, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:51.028650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6c4c3-b05e-4299-a787-4151d1756ba1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:51.043563 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4101/8293] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:50 2021] PUT /identity/v3/projects/9d26a3fdd4ff4eaa9f424c5a64299851/users/7e550670cdfb4cf0a088b17d73bdea62/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:51.054531 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7badcd3-55f3-415b-9dea-fc84013ab7e5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:51.054917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7badcd3-55f3-415b-9dea-fc84013ab7e5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:51.055274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7badcd3-55f3-415b-9dea-fc84013ab7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:51.084468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-d7badcd3-55f3-415b-9dea-fc84013ab7e5 None None] MFA Rules not processed for user `7e550670cdfb4cf0a088b17d73bdea62`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:51.085627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d7badcd3-55f3-415b-9dea-fc84013ab7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:51.164256 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4193/8294] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:51 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:51.169365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6c4c3-b05e-4299-a787-4151d1756ba1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:51.229104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6c4c3-b05e-4299-a787-4151d1756ba1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:51.234417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a41e83-683d-4e49-a758-178d5ca5a76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:51.235079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a41e83-683d-4e49-a758-178d5ca5a76a admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:51.235366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a41e83-683d-4e49-a758-178d5ca5a76a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:51.235675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a41e83-683d-4e49-a758-178d5ca5a76a admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:51.236373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a41e83-683d-4e49-a758-178d5ca5a76a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:51.238321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a41e83-683d-4e49-a758-178d5ca5a76a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:51.262815 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4102/8295] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:51 2021] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:51.266877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7badcd3-55f3-415b-9dea-fc84013ab7e5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:51.277367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7badcd3-55f3-415b-9dea-fc84013ab7e5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:51.334910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c0754-d842-451f-aac5-97617df5d0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:51.335584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c0754-d842-451f-aac5-97617df5d0fb admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:51.335865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c0754-d842-451f-aac5-97617df5d0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:51.336141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c0754-d842-451f-aac5-97617df5d0fb admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:51.336841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c0754-d842-451f-aac5-97617df5d0fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:51.338778 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c0754-d842-451f-aac5-97617df5d0fb admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:51.358028 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4194/8296] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:51 2021] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:51.362077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a41e83-683d-4e49-a758-178d5ca5a76a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:51.372708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a41e83-683d-4e49-a758-178d5ca5a76a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:51.377673 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa128d42-c31f-4e6d-b641-0cb259ca31d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:51.378354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa128d42-c31f-4e6d-b641-0cb259ca31d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:51.378640 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa128d42-c31f-4e6d-b641-0cb259ca31d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:51.378915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa128d42-c31f-4e6d-b641-0cb259ca31d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:51.379634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa128d42-c31f-4e6d-b641-0cb259ca31d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:51.381198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa128d42-c31f-4e6d-b641-0cb259ca31d8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:51.391388 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4103/8297] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:51.395278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c0754-d842-451f-aac5-97617df5d0fb admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:51.405061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c0754-d842-451f-aac5-97617df5d0fb admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:51.409532 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187fdc6-a6f7-41a2-ba8d-2e5a2158127e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:51.410433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187fdc6-a6f7-41a2-ba8d-2e5a2158127e admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:51.410718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187fdc6-a6f7-41a2-ba8d-2e5a2158127e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:51.410993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187fdc6-a6f7-41a2-ba8d-2e5a2158127e admin admin] PATH_INFO: `/v3/projects/c61a6e6a794c423aa180e4795816c450/users/d50e396185854a79a33e49031190889a/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:51.425670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187fdc6-a6f7-41a2-ba8d-2e5a2158127e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c61a6e6a794c423aa180e4795816c450, user_id=d50e396185854a79a33e49031190889a, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:51.428529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187fdc6-a6f7-41a2-ba8d-2e5a2158127e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:51.441902 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4195/8298] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:51 2021] PUT /identity/v3/projects/c61a6e6a794c423aa180e4795816c450/users/d50e396185854a79a33e49031190889a/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:51.445912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa128d42-c31f-4e6d-b641-0cb259ca31d8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:51.455911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa128d42-c31f-4e6d-b641-0cb259ca31d8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:51.510332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a5814-0a63-42f0-b8eb-07b13b9b85b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:51.510989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5814-0a63-42f0-b8eb-07b13b9b85b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:51.511275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5814-0a63-42f0-b8eb-07b13b9b85b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:51.511554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5814-0a63-42f0-b8eb-07b13b9b85b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:51.512334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a5814-0a63-42f0-b8eb-07b13b9b85b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:51.513888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a5814-0a63-42f0-b8eb-07b13b9b85b5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:51.523230 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4104/8299] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:51 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:51.527308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187fdc6-a6f7-41a2-ba8d-2e5a2158127e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:51.538883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187fdc6-a6f7-41a2-ba8d-2e5a2158127e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:51.544018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576db36-21cc-4652-8568-b68a2998fafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:51.545027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576db36-21cc-4652-8568-b68a2998fafd admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:51.545302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576db36-21cc-4652-8568-b68a2998fafd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:51.545572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576db36-21cc-4652-8568-b68a2998fafd admin admin] PATH_INFO: `/v3/projects/c61a6e6a794c423aa180e4795816c450/users/d50e396185854a79a33e49031190889a/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:51.547700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576db36-21cc-4652-8568-b68a2998fafd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c61a6e6a794c423aa180e4795816c450, user_id=d50e396185854a79a33e49031190889a, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:51.550429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576db36-21cc-4652-8568-b68a2998fafd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:51.560571 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4196/8300] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:51 2021] PUT /identity/v3/projects/c61a6e6a794c423aa180e4795816c450/users/d50e396185854a79a33e49031190889a/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:51.571149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cda05d-07c4-4893-a007-d143d14e1e0d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:51.571459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cda05d-07c4-4893-a007-d143d14e1e0d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:51.571792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cda05d-07c4-4893-a007-d143d14e1e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:51.599843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b2cda05d-07c4-4893-a007-d143d14e1e0d None None] MFA Rules not processed for user `d50e396185854a79a33e49031190889a`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:51.601015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b2cda05d-07c4-4893-a007-d143d14e1e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:51.672907 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4105/8301] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:51 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:51.683496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576db36-21cc-4652-8568-b68a2998fafd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:51.685207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2576db36-21cc-4652-8568-b68a2998fafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:51.755004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576db36-21cc-4652-8568-b68a2998fafd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:51.759304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e4061-97f6-4f3d-b562-93e4692ef212 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:51.760183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e4061-97f6-4f3d-b562-93e4692ef212 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:51.760442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e4061-97f6-4f3d-b562-93e4692ef212 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:51.760791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e4061-97f6-4f3d-b562-93e4692ef212 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:51.823967 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e4061-97f6-4f3d-b562-93e4692ef212 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:51.826382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e4061-97f6-4f3d-b562-93e4692ef212 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:51.839566 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4197/8302] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:51 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:51.860359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cda05d-07c4-4893-a007-d143d14e1e0d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:51.862117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b2cda05d-07c4-4893-a007-d143d14e1e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:51.932585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cda05d-07c4-4893-a007-d143d14e1e0d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:51.938406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4060d-c6e8-479d-87f7-0645c69479ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:51.939309 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4060d-c6e8-479d-87f7-0645c69479ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:51.939597 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4060d-c6e8-479d-87f7-0645c69479ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:51.939876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4060d-c6e8-479d-87f7-0645c69479ea admin admin] PATH_INFO: `/v3/users/4a2f4eb279914c21912e022444361cc5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:51.941367 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4060d-c6e8-479d-87f7-0645c69479ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2f4eb279914c21912e022444361cc5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:51.943316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4060d-c6e8-479d-87f7-0645c69479ea admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:51.998197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ead4060d-c6e8-479d-87f7-0645c69479ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2f4eb279914c21912e022444361cc5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:52.006846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ead4060d-c6e8-479d-87f7-0645c69479ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2f4eb279914c21912e022444361cc5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:52.022621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ead4060d-c6e8-479d-87f7-0645c69479ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2f4eb279914c21912e022444361cc5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:52.023473 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ead4060d-c6e8-479d-87f7-0645c69479ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2f4eb279914c21912e022444361cc5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:52.032995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ead4060d-c6e8-479d-87f7-0645c69479ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2f4eb279914c21912e022444361cc5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:52.042419 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4106/8303] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:51 2021] DELETE /identity/v3/users/4a2f4eb279914c21912e022444361cc5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:52.044904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c2ec8-282c-4a44-acf0-8f631671e770 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:52.045201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c2ec8-282c-4a44-acf0-8f631671e770 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:52.045466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c2ec8-282c-4a44-acf0-8f631671e770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:52.072516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-170c2ec8-282c-4a44-acf0-8f631671e770 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:52.073860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-170c2ec8-282c-4a44-acf0-8f631671e770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:52.158419 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4198/8304] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:52.168956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4060d-c6e8-479d-87f7-0645c69479ea admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:52.170770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ead4060d-c6e8-479d-87f7-0645c69479ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:52.244614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4060d-c6e8-479d-87f7-0645c69479ea admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:52.250375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c6068-f580-4972-b060-448eb372f10e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:52.251220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c6068-f580-4972-b060-448eb372f10e service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:52.251602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c6068-f580-4972-b060-448eb372f10e service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:52.252091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c6068-f580-4972-b060-448eb372f10e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:52.262861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c6068-f580-4972-b060-448eb372f10e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:52.264304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c6068-f580-4972-b060-448eb372f10e service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:52.278544 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4107/8305] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:52.563242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c2ec8-282c-4a44-acf0-8f631671e770 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:52.565572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-170c2ec8-282c-4a44-acf0-8f631671e770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:52.579371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c2ec8-282c-4a44-acf0-8f631671e770 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:52.584423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647ea48-090a-4795-afba-b820463496b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:52.585375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647ea48-090a-4795-afba-b820463496b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:52.585971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647ea48-090a-4795-afba-b820463496b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:52.586321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647ea48-090a-4795-afba-b820463496b4 admin admin] PATH_INFO: `/v3/projects/0a9b1da363674623bfab3da0ef60a62d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:52.587858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647ea48-090a-4795-afba-b820463496b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a9b1da363674623bfab3da0ef60a62d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:52.590050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647ea48-090a-4795-afba-b820463496b4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:52.651024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1647ea48-090a-4795-afba-b820463496b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a9b1da363674623bfab3da0ef60a62d', 'request_id': 'req-1647ea48-090a-4795-afba-b820463496b4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:52.658760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1647ea48-090a-4795-afba-b820463496b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a9b1da363674623bfab3da0ef60a62d', 'request_id': 'req-1647ea48-090a-4795-afba-b820463496b4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:52.666712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1647ea48-090a-4795-afba-b820463496b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a9b1da363674623bfab3da0ef60a62d', 'request_id': 'req-1647ea48-090a-4795-afba-b820463496b4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:52.677843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1647ea48-090a-4795-afba-b820463496b4 admin admin] The token cache is being invalidate because project 0a9b1da363674623bfab3da0ef60a62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:52.678136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1647ea48-090a-4795-afba-b820463496b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:52.678939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-1647ea48-090a-4795-afba-b820463496b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:52.680642 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4199/8306] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:52 2021] DELETE /identity/v3/projects/0a9b1da363674623bfab3da0ef60a62d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:52.684572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c6068-f580-4972-b060-448eb372f10e service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:52.695822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c6068-f580-4972-b060-448eb372f10e service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:52.760522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324a615-8df3-4b44-b94e-f9065757357e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:52.761421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324a615-8df3-4b44-b94e-f9065757357e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:52.761777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324a615-8df3-4b44-b94e-f9065757357e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:52.762635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324a615-8df3-4b44-b94e-f9065757357e admin admin] PATH_INFO: `/v3/users/b5886f1556ed40bd9c4a236ad93120e5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:52.763954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324a615-8df3-4b44-b94e-f9065757357e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5886f1556ed40bd9c4a236ad93120e5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:52.766227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324a615-8df3-4b44-b94e-f9065757357e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:52.816062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c324a615-8df3-4b44-b94e-f9065757357e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5886f1556ed40bd9c4a236ad93120e5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:52.823747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c324a615-8df3-4b44-b94e-f9065757357e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5886f1556ed40bd9c4a236ad93120e5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:52.844959 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c324a615-8df3-4b44-b94e-f9065757357e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5886f1556ed40bd9c4a236ad93120e5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:52.846010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c324a615-8df3-4b44-b94e-f9065757357e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5886f1556ed40bd9c4a236ad93120e5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:52.856084 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c324a615-8df3-4b44-b94e-f9065757357e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5886f1556ed40bd9c4a236ad93120e5'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:52.863752 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4108/8307] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:52 2021] DELETE /identity/v3/users/b5886f1556ed40bd9c4a236ad93120e5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:53.377861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647ea48-090a-4795-afba-b820463496b4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:53.379836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1647ea48-090a-4795-afba-b820463496b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:53.446950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324a615-8df3-4b44-b94e-f9065757357e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:53.448172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647ea48-090a-4795-afba-b820463496b4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:53.448955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c324a615-8df3-4b44-b94e-f9065757357e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:53.508793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880811b6-f99a-47fe-99d0-25cbec1678b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:53.508793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880811b6-f99a-47fe-99d0-25cbec1678b1 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:53.508793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880811b6-f99a-47fe-99d0-25cbec1678b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:53.509059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880811b6-f99a-47fe-99d0-25cbec1678b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:53.510832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-880811b6-f99a-47fe-99d0-25cbec1678b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:53.553995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324a615-8df3-4b44-b94e-f9065757357e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:53.568426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f66e8d-dd1c-4a60-bdd4-3128cbeba7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:53.570303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f66e8d-dd1c-4a60-bdd4-3128cbeba7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:53.570494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f66e8d-dd1c-4a60-bdd4-3128cbeba7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:53.570779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f66e8d-dd1c-4a60-bdd4-3128cbeba7e3 admin admin] PATH_INFO: `/v3/projects/588cf3dc52bc4320ad6af73de0cd87ee` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:53.572459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f66e8d-dd1c-4a60-bdd4-3128cbeba7e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=588cf3dc52bc4320ad6af73de0cd87ee)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:53.575017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f66e8d-dd1c-4a60-bdd4-3128cbeba7e3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:53.603417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880811b6-f99a-47fe-99d0-25cbec1678b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:53.604931 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880811b6-f99a-47fe-99d0-25cbec1678b1 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:53.615057 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4200/8308] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:53 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:53.615853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880811b6-f99a-47fe-99d0-25cbec1678b1 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:53.617090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-880811b6-f99a-47fe-99d0-25cbec1678b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:53.639525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-91f66e8d-dd1c-4a60-bdd4-3128cbeba7e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '588cf3dc52bc4320ad6af73de0cd87ee', 'request_id': 'req-91f66e8d-dd1c-4a60-bdd4-3128cbeba7e3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:53.648013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-91f66e8d-dd1c-4a60-bdd4-3128cbeba7e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '588cf3dc52bc4320ad6af73de0cd87ee', 'request_id': 'req-91f66e8d-dd1c-4a60-bdd4-3128cbeba7e3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:53.656213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-91f66e8d-dd1c-4a60-bdd4-3128cbeba7e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '588cf3dc52bc4320ad6af73de0cd87ee', 'request_id': 'req-91f66e8d-dd1c-4a60-bdd4-3128cbeba7e3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:53.672268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-91f66e8d-dd1c-4a60-bdd4-3128cbeba7e3 admin admin] The token cache is being invalidate because project 588cf3dc52bc4320ad6af73de0cd87ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:53.672647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-91f66e8d-dd1c-4a60-bdd4-3128cbeba7e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:53.673532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-91f66e8d-dd1c-4a60-bdd4-3128cbeba7e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:53.675195 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4109/8309] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:53 2021] DELETE /identity/v3/projects/588cf3dc52bc4320ad6af73de0cd87ee => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:53.681025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc6099-96be-4932-bf58-fb4df3026c41 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:53.681321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc6099-96be-4932-bf58-fb4df3026c41 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:53.681606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc6099-96be-4932-bf58-fb4df3026c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:53.696550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880811b6-f99a-47fe-99d0-25cbec1678b1 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:53.704294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e2bc6099-96be-4932-bf58-fb4df3026c41 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:53.705508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e2bc6099-96be-4932-bf58-fb4df3026c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:53.754617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df116794-7d12-4fcf-b7b9-8262936ba004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:53.755278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df116794-7d12-4fcf-b7b9-8262936ba004 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:53.755598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df116794-7d12-4fcf-b7b9-8262936ba004 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:53.755851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df116794-7d12-4fcf-b7b9-8262936ba004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:53.757811 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-df116794-7d12-4fcf-b7b9-8262936ba004 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:53.778422 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4110/8310] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:53.781479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a45ae-d5dd-49f0-8192-655054f7eb76 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:53.781773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a45ae-d5dd-49f0-8192-655054f7eb76 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:53.782057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a45ae-d5dd-49f0-8192-655054f7eb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:53.800615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-161a45ae-d5dd-49f0-8192-655054f7eb76 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:53.801811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-161a45ae-d5dd-49f0-8192-655054f7eb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:53.810677 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4111/8311] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:53.814766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a45ae-d5dd-49f0-8192-655054f7eb76 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:53.825644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a45ae-d5dd-49f0-8192-655054f7eb76 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:53.827254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df116794-7d12-4fcf-b7b9-8262936ba004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:53.828699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df116794-7d12-4fcf-b7b9-8262936ba004 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:53.830963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445bd1e-1c0c-4680-8fa2-f50cf13cc2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:53.831835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445bd1e-1c0c-4680-8fa2-f50cf13cc2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:53.832138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445bd1e-1c0c-4680-8fa2-f50cf13cc2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:53.832419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445bd1e-1c0c-4680-8fa2-f50cf13cc2f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:53.833157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445bd1e-1c0c-4680-8fa2-f50cf13cc2f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:18:53.833610 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445bd1e-1c0c-4680-8fa2-f50cf13cc2f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:53.835402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445bd1e-1c0c-4680-8fa2-f50cf13cc2f2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:53.838970 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4201/8312] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:53.849213 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4112/8313] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:18:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:18:53.853632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df116794-7d12-4fcf-b7b9-8262936ba004 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:53.865168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df116794-7d12-4fcf-b7b9-8262936ba004 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:53.870110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb857ab7-b300-4b10-b836-e14e85f7c81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:53.870889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb857ab7-b300-4b10-b836-e14e85f7c81e admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:53.871277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb857ab7-b300-4b10-b836-e14e85f7c81e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:53.871648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb857ab7-b300-4b10-b836-e14e85f7c81e admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:53.872369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb857ab7-b300-4b10-b836-e14e85f7c81e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:53.874282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb857ab7-b300-4b10-b836-e14e85f7c81e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:53.902978 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4202/8314] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:53 2021] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:53.907011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445bd1e-1c0c-4680-8fa2-f50cf13cc2f2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:53.918964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445bd1e-1c0c-4680-8fa2-f50cf13cc2f2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:53.985216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1b069-2d83-471a-8361-b34f3f1bb791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:53.985798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1b069-2d83-471a-8361-b34f3f1bb791 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:53.986082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1b069-2d83-471a-8361-b34f3f1bb791 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:53.986406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1b069-2d83-471a-8361-b34f3f1bb791 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:53.987098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1b069-2d83-471a-8361-b34f3f1bb791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:53.989163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1b069-2d83-471a-8361-b34f3f1bb791 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:54.013840 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4113/8315] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:53 2021] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:54.017951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb857ab7-b300-4b10-b836-e14e85f7c81e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:54.032327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb857ab7-b300-4b10-b836-e14e85f7c81e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:54.038462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c0ebd-5a3e-4810-8d05-d0faec959647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:54.039450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c0ebd-5a3e-4810-8d05-d0faec959647 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:54.039915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c0ebd-5a3e-4810-8d05-d0faec959647 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:54.040266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c0ebd-5a3e-4810-8d05-d0faec959647 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:54.041629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c0ebd-5a3e-4810-8d05-d0faec959647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:54.044588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c0ebd-5a3e-4810-8d05-d0faec959647 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:54.057281 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4203/8316] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:54 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:54.061325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1b069-2d83-471a-8361-b34f3f1bb791 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:54.078659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1b069-2d83-471a-8361-b34f3f1bb791 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:54.083434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8647b-3d7a-4e34-8f09-98008cd694cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:54.084108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8647b-3d7a-4e34-8f09-98008cd694cf admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:54.084397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8647b-3d7a-4e34-8f09-98008cd694cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:54.084679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8647b-3d7a-4e34-8f09-98008cd694cf admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:54.085631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8647b-3d7a-4e34-8f09-98008cd694cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:54.087253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8647b-3d7a-4e34-8f09-98008cd694cf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:54.101184 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4114/8317] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:54 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:54.105647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c0ebd-5a3e-4810-8d05-d0faec959647 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:54.118554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c0ebd-5a3e-4810-8d05-d0faec959647 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:54.124302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ce080-6396-4599-afb2-cc817d4fdb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:54.125562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ce080-6396-4599-afb2-cc817d4fdb23 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:54.125697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ce080-6396-4599-afb2-cc817d4fdb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:54.126208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ce080-6396-4599-afb2-cc817d4fdb23 admin admin] PATH_INFO: `/v3/projects/d718ff85265a4e759076b9e7bb109062/users/c055f836d1d84aec8608a1f0268fdd09/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:54.142928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ce080-6396-4599-afb2-cc817d4fdb23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d718ff85265a4e759076b9e7bb109062, user_id=c055f836d1d84aec8608a1f0268fdd09, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:54.145763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ce080-6396-4599-afb2-cc817d4fdb23 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:54.166502 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4204/8318] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:54 2021] PUT /identity/v3/projects/d718ff85265a4e759076b9e7bb109062/users/c055f836d1d84aec8608a1f0268fdd09/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:54.176421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a645c8-f9c5-402f-bf55-ca3c28f749fc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:54.176718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a645c8-f9c5-402f-bf55-ca3c28f749fc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:54.177002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a645c8-f9c5-402f-bf55-ca3c28f749fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:54.208591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b1a645c8-f9c5-402f-bf55-ca3c28f749fc None None] MFA Rules not processed for user `c055f836d1d84aec8608a1f0268fdd09`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:54.210612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b1a645c8-f9c5-402f-bf55-ca3c28f749fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:54.212721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ce080-6396-4599-afb2-cc817d4fdb23 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:54.214414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-410ce080-6396-4599-afb2-cc817d4fdb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:54.276771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ce080-6396-4599-afb2-cc817d4fdb23 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:54.278767 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4115/8319] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:54 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:54.283215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a645c8-f9c5-402f-bf55-ca3c28f749fc None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:54.285617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e887f5c-d540-47f5-910d-b21f3c606d29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:54.286301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887f5c-d540-47f5-910d-b21f3c606d29 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:54.286772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887f5c-d540-47f5-910d-b21f3c606d29 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:54.287078 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887f5c-d540-47f5-910d-b21f3c606d29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:54.289247 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4e887f5c-d540-47f5-910d-b21f3c606d29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:54.349931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a645c8-f9c5-402f-bf55-ca3c28f749fc None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:54.354764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e887f5c-d540-47f5-910d-b21f3c606d29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:54.355053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e068da-4a0c-451c-8516-9f087288dc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:54.355778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e068da-4a0c-451c-8516-9f087288dc2d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:54.356065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e068da-4a0c-451c-8516-9f087288dc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:54.356255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e887f5c-d540-47f5-910d-b21f3c606d29 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:54.356360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e068da-4a0c-451c-8516-9f087288dc2d admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:54.357100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e068da-4a0c-451c-8516-9f087288dc2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:54.359137 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e068da-4a0c-451c-8516-9f087288dc2d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:54.365915 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4205/8320] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:54 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:18:54.385631 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4116/8321] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:54 2021] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:18:54.390533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e887f5c-d540-47f5-910d-b21f3c606d29 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:54.404919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e887f5c-d540-47f5-910d-b21f3c606d29 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:54.481595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b22a97-5eee-45fa-9e6d-c0e475ce5558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:54.482289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b22a97-5eee-45fa-9e6d-c0e475ce5558 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:54.482585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b22a97-5eee-45fa-9e6d-c0e475ce5558 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:54.482868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b22a97-5eee-45fa-9e6d-c0e475ce5558 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:54.483748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b22a97-5eee-45fa-9e6d-c0e475ce5558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:54.486066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b22a97-5eee-45fa-9e6d-c0e475ce5558 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:54.518593 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4206/8322] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:54 2021] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:54.520071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e068da-4a0c-451c-8516-9f087288dc2d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:54.533872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e068da-4a0c-451c-8516-9f087288dc2d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:54.538966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1142d4-ef67-447b-aa92-c56cf1c4270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:54.539644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1142d4-ef67-447b-aa92-c56cf1c4270c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:54.539932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1142d4-ef67-447b-aa92-c56cf1c4270c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:54.540350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1142d4-ef67-447b-aa92-c56cf1c4270c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:54.541095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1142d4-ef67-447b-aa92-c56cf1c4270c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:54.542769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1142d4-ef67-447b-aa92-c56cf1c4270c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:54.555028 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4117/8323] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:54 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:54.560780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b22a97-5eee-45fa-9e6d-c0e475ce5558 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:54.573413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b22a97-5eee-45fa-9e6d-c0e475ce5558 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:54.581111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61be479-1e9f-44e5-8fd3-6129cb9027f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:54.581992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61be479-1e9f-44e5-8fd3-6129cb9027f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:54.582302 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61be479-1e9f-44e5-8fd3-6129cb9027f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:54.582616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61be479-1e9f-44e5-8fd3-6129cb9027f1 admin admin] PATH_INFO: `/v3/projects/b0e6327e3fee4149b6d586b3eae60558/users/c044455a10a147169e8999fcbd8828c9/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:54.600126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61be479-1e9f-44e5-8fd3-6129cb9027f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e6327e3fee4149b6d586b3eae60558, user_id=c044455a10a147169e8999fcbd8828c9, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:54.602952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61be479-1e9f-44e5-8fd3-6129cb9027f1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:54.619696 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4207/8324] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:54 2021] PUT /identity/v3/projects/b0e6327e3fee4149b6d586b3eae60558/users/c044455a10a147169e8999fcbd8828c9/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:54.624264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1142d4-ef67-447b-aa92-c56cf1c4270c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:54.637631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1142d4-ef67-447b-aa92-c56cf1c4270c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:54.711703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19200b-a66d-4fad-8ac0-e2d2e6b661f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:54.713126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19200b-a66d-4fad-8ac0-e2d2e6b661f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:54.713632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19200b-a66d-4fad-8ac0-e2d2e6b661f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:54.713824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19200b-a66d-4fad-8ac0-e2d2e6b661f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:54.714755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19200b-a66d-4fad-8ac0-e2d2e6b661f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:54.716788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19200b-a66d-4fad-8ac0-e2d2e6b661f8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:54.730071 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4118/8325] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:54 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:54.734441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61be479-1e9f-44e5-8fd3-6129cb9027f1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:54.748559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61be479-1e9f-44e5-8fd3-6129cb9027f1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:54.755083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d741d-c5db-46c5-b5ca-56e40dd8e716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:54.756185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d741d-c5db-46c5-b5ca-56e40dd8e716 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:54.756536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d741d-c5db-46c5-b5ca-56e40dd8e716 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:54.756870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d741d-c5db-46c5-b5ca-56e40dd8e716 admin admin] PATH_INFO: `/v3/projects/b0e6327e3fee4149b6d586b3eae60558/users/c044455a10a147169e8999fcbd8828c9/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:54.759468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d741d-c5db-46c5-b5ca-56e40dd8e716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e6327e3fee4149b6d586b3eae60558, user_id=c044455a10a147169e8999fcbd8828c9, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:54.763594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d741d-c5db-46c5-b5ca-56e40dd8e716 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:54.778293 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4208/8326] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:54 2021] PUT /identity/v3/projects/b0e6327e3fee4149b6d586b3eae60558/users/c044455a10a147169e8999fcbd8828c9/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:54.787368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f99bd3-15c6-40ba-b597-c823df82f605 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:54.787671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f99bd3-15c6-40ba-b597-c823df82f605 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:54.787953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f99bd3-15c6-40ba-b597-c823df82f605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:54.817196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e7f99bd3-15c6-40ba-b597-c823df82f605 None None] MFA Rules not processed for user `c044455a10a147169e8999fcbd8828c9`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:54.818488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e7f99bd3-15c6-40ba-b597-c823df82f605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:54.906288 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4119/8327] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:54 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:54.917552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d741d-c5db-46c5-b5ca-56e40dd8e716 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:54.921405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e92d741d-c5db-46c5-b5ca-56e40dd8e716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:54.998970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d741d-c5db-46c5-b5ca-56e40dd8e716 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:55.003084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35f23f-f7e2-4b12-b573-9f19d66e7c23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:55.003829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35f23f-f7e2-4b12-b573-9f19d66e7c23 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:55.004126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35f23f-f7e2-4b12-b573-9f19d66e7c23 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:55.004397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35f23f-f7e2-4b12-b573-9f19d66e7c23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:55.017369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35f23f-f7e2-4b12-b573-9f19d66e7c23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:55.018825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35f23f-f7e2-4b12-b573-9f19d66e7c23 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:55.047867 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4209/8328] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:54 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:18:55.113594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f99bd3-15c6-40ba-b597-c823df82f605 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:55.128721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f99bd3-15c6-40ba-b597-c823df82f605 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:55.132438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0db98-c5b0-4e85-b533-ad155cc0cba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:55.133090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0db98-c5b0-4e85-b533-ad155cc0cba6 service cinder] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:55.133381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0db98-c5b0-4e85-b533-ad155cc0cba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:55.133662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0db98-c5b0-4e85-b533-ad155cc0cba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:55.205106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0db98-c5b0-4e85-b533-ad155cc0cba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:55.207322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0db98-c5b0-4e85-b533-ad155cc0cba6 service cinder] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:55.219477 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4120/8329] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:55 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:55.469413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35f23f-f7e2-4b12-b573-9f19d66e7c23 service cinder] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:55.551153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35f23f-f7e2-4b12-b573-9f19d66e7c23 service cinder] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:55.556420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210c5ae-0d12-457e-b1a1-65cdef0ee7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:55.557278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c5ae-0d12-457e-b1a1-65cdef0ee7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:55.557557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c5ae-0d12-457e-b1a1-65cdef0ee7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:55.557829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c5ae-0d12-457e-b1a1-65cdef0ee7c0 admin admin] PATH_INFO: `/v3/users/c055f836d1d84aec8608a1f0268fdd09` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:55.559224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210c5ae-0d12-457e-b1a1-65cdef0ee7c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c055f836d1d84aec8608a1f0268fdd09)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:55.561250 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210c5ae-0d12-457e-b1a1-65cdef0ee7c0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:55.617822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e210c5ae-0d12-457e-b1a1-65cdef0ee7c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c055f836d1d84aec8608a1f0268fdd09'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:55.638875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e210c5ae-0d12-457e-b1a1-65cdef0ee7c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c055f836d1d84aec8608a1f0268fdd09'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:55.641429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e210c5ae-0d12-457e-b1a1-65cdef0ee7c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c055f836d1d84aec8608a1f0268fdd09'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:55.671112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e210c5ae-0d12-457e-b1a1-65cdef0ee7c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c055f836d1d84aec8608a1f0268fdd09'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:55.685928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e210c5ae-0d12-457e-b1a1-65cdef0ee7c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c055f836d1d84aec8608a1f0268fdd09'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:55.694523 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4210/8330] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:55 2021] DELETE /identity/v3/users/c055f836d1d84aec8608a1f0268fdd09 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:55.700609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb95afd-a88a-4893-939a-636f67634c97 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:55.701039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb95afd-a88a-4893-939a-636f67634c97 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:55.701414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb95afd-a88a-4893-939a-636f67634c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:55.732101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-eeb95afd-a88a-4893-939a-636f67634c97 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:55.732875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210c5ae-0d12-457e-b1a1-65cdef0ee7c0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:55.734417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e210c5ae-0d12-457e-b1a1-65cdef0ee7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:55.736783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eeb95afd-a88a-4893-939a-636f67634c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:55.822309 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4121/8331] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:55.837628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb95afd-a88a-4893-939a-636f67634c97 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:55.842549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eeb95afd-a88a-4893-939a-636f67634c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:55.879130 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210c5ae-0d12-457e-b1a1-65cdef0ee7c0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:55.883291 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb95afd-a88a-4893-939a-636f67634c97 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:55.889055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba1747-96bd-43af-ae24-a5466e79e392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:55.891471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba1747-96bd-43af-ae24-a5466e79e392 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:55.892012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba1747-96bd-43af-ae24-a5466e79e392 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:55.893143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba1747-96bd-43af-ae24-a5466e79e392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:55.896889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c9ba1747-96bd-43af-ae24-a5466e79e392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:55.907522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c580ea8-955a-44f7-a83b-03b8c537e874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:55.908667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c580ea8-955a-44f7-a83b-03b8c537e874 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:55.909315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c580ea8-955a-44f7-a83b-03b8c537e874 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:55.909803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c580ea8-955a-44f7-a83b-03b8c537e874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:55.935070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba1747-96bd-43af-ae24-a5466e79e392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:55.938088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba1747-96bd-43af-ae24-a5466e79e392 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:55.967594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c580ea8-955a-44f7-a83b-03b8c537e874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:55.969391 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4211/8332] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:55 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:18:55.970030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c580ea8-955a-44f7-a83b-03b8c537e874 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:55.981138 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4122/8333] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:56.548146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba1747-96bd-43af-ae24-a5466e79e392 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:56.549727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c9ba1747-96bd-43af-ae24-a5466e79e392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:56.574301 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba1747-96bd-43af-ae24-a5466e79e392 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:56.578782 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:56.580200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:56.580528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:56.580762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7 admin admin] PATH_INFO: `/v3/projects/d718ff85265a4e759076b9e7bb109062` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:56.582009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d718ff85265a4e759076b9e7bb109062)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:56.583962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:56.644759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd718ff85265a4e759076b9e7bb109062', 'request_id': 'req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:56.651314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd718ff85265a4e759076b9e7bb109062', 'request_id': 'req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:56.663515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd718ff85265a4e759076b9e7bb109062', 'request_id': 'req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:56.683138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7 admin admin] The token cache is being invalidate because project d718ff85265a4e759076b9e7bb109062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:56.683489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:56.684493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:56.686332 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4212/8334] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:56 2021] DELETE /identity/v3/projects/d718ff85265a4e759076b9e7bb109062 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:56.690379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c580ea8-955a-44f7-a83b-03b8c537e874 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:56.701249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c580ea8-955a-44f7-a83b-03b8c537e874 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:56.836680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74410823-bea9-48ef-8d35-1ea632ce8117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:56.838336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74410823-bea9-48ef-8d35-1ea632ce8117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:56.838605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74410823-bea9-48ef-8d35-1ea632ce8117 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:56.838917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74410823-bea9-48ef-8d35-1ea632ce8117 admin admin] PATH_INFO: `/v3/users/c044455a10a147169e8999fcbd8828c9` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:56.842670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74410823-bea9-48ef-8d35-1ea632ce8117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c044455a10a147169e8999fcbd8828c9)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:56.844757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74410823-bea9-48ef-8d35-1ea632ce8117 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:56.912068 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74410823-bea9-48ef-8d35-1ea632ce8117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c044455a10a147169e8999fcbd8828c9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:56.926513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74410823-bea9-48ef-8d35-1ea632ce8117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c044455a10a147169e8999fcbd8828c9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:56.941784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74410823-bea9-48ef-8d35-1ea632ce8117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c044455a10a147169e8999fcbd8828c9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:56.942813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74410823-bea9-48ef-8d35-1ea632ce8117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c044455a10a147169e8999fcbd8828c9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:56.955635 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74410823-bea9-48ef-8d35-1ea632ce8117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c044455a10a147169e8999fcbd8828c9'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:56.962678 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4123/8335] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:56 2021] DELETE /identity/v3/users/c044455a10a147169e8999fcbd8828c9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:57.504745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:57.506162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:57.534061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce8cd6-8c3f-4ea2-825d-729926288ce7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:57.650591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fe279-fc62-4b38-9ca6-94e73207d04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:57.651568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fe279-fc62-4b38-9ca6-94e73207d04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:57.651877 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fe279-fc62-4b38-9ca6-94e73207d04e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:57.652196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fe279-fc62-4b38-9ca6-94e73207d04e admin admin] PATH_INFO: `/v3/projects/b0e6327e3fee4149b6d586b3eae60558` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:57.653761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fe279-fc62-4b38-9ca6-94e73207d04e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0e6327e3fee4149b6d586b3eae60558)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:57.655915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fe279-fc62-4b38-9ca6-94e73207d04e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:57.731675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-994fe279-fc62-4b38-9ca6-94e73207d04e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0e6327e3fee4149b6d586b3eae60558', 'request_id': 'req-994fe279-fc62-4b38-9ca6-94e73207d04e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:57.746551 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-994fe279-fc62-4b38-9ca6-94e73207d04e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0e6327e3fee4149b6d586b3eae60558', 'request_id': 'req-994fe279-fc62-4b38-9ca6-94e73207d04e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:57.756869 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-994fe279-fc62-4b38-9ca6-94e73207d04e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0e6327e3fee4149b6d586b3eae60558', 'request_id': 'req-994fe279-fc62-4b38-9ca6-94e73207d04e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:57.778802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-994fe279-fc62-4b38-9ca6-94e73207d04e admin admin] The token cache is being invalidate because project b0e6327e3fee4149b6d586b3eae60558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:57.779268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-994fe279-fc62-4b38-9ca6-94e73207d04e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:57.780104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-994fe279-fc62-4b38-9ca6-94e73207d04e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:57.781962 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4213/8336] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:57 2021] DELETE /identity/v3/projects/b0e6327e3fee4149b6d586b3eae60558 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:57.788349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926881a8-36fe-467c-a6c1-6227b00b333d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:57.789052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926881a8-36fe-467c-a6c1-6227b00b333d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:57.789513 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926881a8-36fe-467c-a6c1-6227b00b333d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:57.809809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-926881a8-36fe-467c-a6c1-6227b00b333d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:57.811554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-926881a8-36fe-467c-a6c1-6227b00b333d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:57.888885 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4124/8337] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:57.897125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ab357-aa15-40f2-a4fb-865b40584a34 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:57.897438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ab357-aa15-40f2-a4fb-865b40584a34 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:57.897726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ab357-aa15-40f2-a4fb-865b40584a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:57.917314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9f1ab357-aa15-40f2-a4fb-865b40584a34 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:57.919187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9f1ab357-aa15-40f2-a4fb-865b40584a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:57.927305 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4214/8338] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:18:57.931838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926881a8-36fe-467c-a6c1-6227b00b333d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:57.944189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926881a8-36fe-467c-a6c1-6227b00b333d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:57.949267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befca8f7-1ad2-41ee-9119-37af1fa6481f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:57.949933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befca8f7-1ad2-41ee-9119-37af1fa6481f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:57.950222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befca8f7-1ad2-41ee-9119-37af1fa6481f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:57.950553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befca8f7-1ad2-41ee-9119-37af1fa6481f admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:57.951467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befca8f7-1ad2-41ee-9119-37af1fa6481f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:18:57.951935 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befca8f7-1ad2-41ee-9119-37af1fa6481f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:57.953680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befca8f7-1ad2-41ee-9119-37af1fa6481f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:57.968132 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4125/8339] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:18:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:18:57.972119 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ab357-aa15-40f2-a4fb-865b40584a34 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:57.982463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ab357-aa15-40f2-a4fb-865b40584a34 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:57.987693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c3f11-cd45-4f12-a291-2f0a9dd63872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:57.988385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c3f11-cd45-4f12-a291-2f0a9dd63872 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:57.988971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c3f11-cd45-4f12-a291-2f0a9dd63872 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:57.989262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c3f11-cd45-4f12-a291-2f0a9dd63872 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:57.989963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c3f11-cd45-4f12-a291-2f0a9dd63872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:57.991919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c3f11-cd45-4f12-a291-2f0a9dd63872 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:58.024370 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4215/8340] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:18:57 2021] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:58.028092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befca8f7-1ad2-41ee-9119-37af1fa6481f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:58.038849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befca8f7-1ad2-41ee-9119-37af1fa6481f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:58.100751 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc38bd-a3ff-4940-8646-e40b6c443638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:58.101424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc38bd-a3ff-4940-8646-e40b6c443638 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:58.101712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc38bd-a3ff-4940-8646-e40b6c443638 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:58.101994 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc38bd-a3ff-4940-8646-e40b6c443638 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:58.102852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc38bd-a3ff-4940-8646-e40b6c443638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:58.104760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc38bd-a3ff-4940-8646-e40b6c443638 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:58.126190 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4126/8341] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:18:58 2021] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:18:58.131389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c3f11-cd45-4f12-a291-2f0a9dd63872 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:58.141816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c3f11-cd45-4f12-a291-2f0a9dd63872 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:58.146694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5a347-eaf1-4ca6-ac0c-517dd2e41d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:58.147350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5a347-eaf1-4ca6-ac0c-517dd2e41d90 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:58.147633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5a347-eaf1-4ca6-ac0c-517dd2e41d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:58.147913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5a347-eaf1-4ca6-ac0c-517dd2e41d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:58.148650 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5a347-eaf1-4ca6-ac0c-517dd2e41d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:58.150243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5a347-eaf1-4ca6-ac0c-517dd2e41d90 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:58.160572 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4216/8342] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:58.164501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc38bd-a3ff-4940-8646-e40b6c443638 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:58.174879 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc38bd-a3ff-4940-8646-e40b6c443638 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:58.179649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4cc29-1475-402e-b857-1e9ca984ad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:58.180320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4cc29-1475-402e-b857-1e9ca984ad25 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:58.180609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4cc29-1475-402e-b857-1e9ca984ad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:58.180893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4cc29-1475-402e-b857-1e9ca984ad25 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:58.181631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4cc29-1475-402e-b857-1e9ca984ad25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:58.183262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4cc29-1475-402e-b857-1e9ca984ad25 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:58.194213 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4127/8343] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:18:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:18:58.198395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5a347-eaf1-4ca6-ac0c-517dd2e41d90 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:58.208275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5a347-eaf1-4ca6-ac0c-517dd2e41d90 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:58.212911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff55a2-3882-40e2-88dd-5ae8b87ed474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:58.213831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff55a2-3882-40e2-88dd-5ae8b87ed474 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:58.214121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff55a2-3882-40e2-88dd-5ae8b87ed474 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:58.214436 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff55a2-3882-40e2-88dd-5ae8b87ed474 admin admin] PATH_INFO: `/v3/projects/811b51c4fb9b4bebb5c0c2097d53b345/users/758e5861ca584e189fc8a8bb95045d8e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:58.229575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff55a2-3882-40e2-88dd-5ae8b87ed474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=811b51c4fb9b4bebb5c0c2097d53b345, user_id=758e5861ca584e189fc8a8bb95045d8e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:58.232865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff55a2-3882-40e2-88dd-5ae8b87ed474 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:58.245923 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4217/8344] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:18:58 2021] PUT /identity/v3/projects/811b51c4fb9b4bebb5c0c2097d53b345/users/758e5861ca584e189fc8a8bb95045d8e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:18:58.256366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1b913-b88f-4392-9215-b6270d0829e0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:58.256527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1b913-b88f-4392-9215-b6270d0829e0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:58.256678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1b913-b88f-4392-9215-b6270d0829e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:58.283665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6dc1b913-b88f-4392-9215-b6270d0829e0 None None] MFA Rules not processed for user `758e5861ca584e189fc8a8bb95045d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:58.284883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6dc1b913-b88f-4392-9215-b6270d0829e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:58.353571 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4128/8345] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:58 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:58.363860 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff55a2-3882-40e2-88dd-5ae8b87ed474 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:58.365578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-07ff55a2-3882-40e2-88dd-5ae8b87ed474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:58.424742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff55a2-3882-40e2-88dd-5ae8b87ed474 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:58.428504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf1240-30d1-4594-905f-2956b0069f38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:58.429149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf1240-30d1-4594-905f-2956b0069f38 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:58.429432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf1240-30d1-4594-905f-2956b0069f38 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:58.429712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf1240-30d1-4594-905f-2956b0069f38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:58.439528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf1240-30d1-4594-905f-2956b0069f38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:58.441204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf1240-30d1-4594-905f-2956b0069f38 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:58.449913 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4218/8346] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:58 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:18:58.599315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1b913-b88f-4392-9215-b6270d0829e0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:58.600795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6dc1b913-b88f-4392-9215-b6270d0829e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:58.697902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1b913-b88f-4392-9215-b6270d0829e0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:58.705582 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b64110-f460-444a-ad86-643875e3503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:58.707590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b64110-f460-444a-ad86-643875e3503c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:58.708532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b64110-f460-444a-ad86-643875e3503c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:58.708532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b64110-f460-444a-ad86-643875e3503c admin admin] PATH_INFO: `/v3/users/df641caa3083410ea417302a3971ebae` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:58.719175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b64110-f460-444a-ad86-643875e3503c admin admin] RBAC: Authorizing `identity:delete_user(user_id=df641caa3083410ea417302a3971ebae)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:58.721382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b64110-f460-444a-ad86-643875e3503c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:58.828686 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-13b64110-f460-444a-ad86-643875e3503c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df641caa3083410ea417302a3971ebae'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:58.846075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-13b64110-f460-444a-ad86-643875e3503c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df641caa3083410ea417302a3971ebae'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:58.898574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-13b64110-f460-444a-ad86-643875e3503c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df641caa3083410ea417302a3971ebae'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:58.903764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-13b64110-f460-444a-ad86-643875e3503c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df641caa3083410ea417302a3971ebae'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:58.920271 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-13b64110-f460-444a-ad86-643875e3503c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df641caa3083410ea417302a3971ebae'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:58.931049 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4129/8347] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:58 2021] DELETE /identity/v3/users/df641caa3083410ea417302a3971ebae => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:58.932350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2a0f5-45e2-4d57-857c-8ec8373d8377 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:58.932808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2a0f5-45e2-4d57-857c-8ec8373d8377 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:58.934293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2a0f5-45e2-4d57-857c-8ec8373d8377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:58.978657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e8e2a0f5-45e2-4d57-857c-8ec8373d8377 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:18:58.980006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e8e2a0f5-45e2-4d57-857c-8ec8373d8377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:59.066174 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4219/8348] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:18:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:18:59.076989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b64110-f460-444a-ad86-643875e3503c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:59.079201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-13b64110-f460-444a-ad86-643875e3503c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:59.147746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b64110-f460-444a-ad86-643875e3503c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:59.151306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9813803-b71a-4254-8f8c-d0b616fe345b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:59.151960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9813803-b71a-4254-8f8c-d0b616fe345b service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:59.152277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9813803-b71a-4254-8f8c-d0b616fe345b service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:59.152559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9813803-b71a-4254-8f8c-d0b616fe345b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:59.161759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9813803-b71a-4254-8f8c-d0b616fe345b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:59.163233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9813803-b71a-4254-8f8c-d0b616fe345b service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:59.173103 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4130/8349] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:18:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:18:59.440191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2a0f5-45e2-4d57-857c-8ec8373d8377 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:59.445553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e8e2a0f5-45e2-4d57-857c-8ec8373d8377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:18:59.461666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2a0f5-45e2-4d57-857c-8ec8373d8377 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:59.468024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38623e-3586-4a15-a916-4f1548a70502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:59.469000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38623e-3586-4a15-a916-4f1548a70502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:59.469164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38623e-3586-4a15-a916-4f1548a70502 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:59.469446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38623e-3586-4a15-a916-4f1548a70502 admin admin] PATH_INFO: `/v3/projects/7c696c6cad1c43398c00e0efebc99682` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:59.470680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38623e-3586-4a15-a916-4f1548a70502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c696c6cad1c43398c00e0efebc99682)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:59.472588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38623e-3586-4a15-a916-4f1548a70502 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:59.519681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ac38623e-3586-4a15-a916-4f1548a70502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c696c6cad1c43398c00e0efebc99682', 'request_id': 'req-ac38623e-3586-4a15-a916-4f1548a70502'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:59.525754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ac38623e-3586-4a15-a916-4f1548a70502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c696c6cad1c43398c00e0efebc99682', 'request_id': 'req-ac38623e-3586-4a15-a916-4f1548a70502'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:59.537828 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ac38623e-3586-4a15-a916-4f1548a70502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c696c6cad1c43398c00e0efebc99682', 'request_id': 'req-ac38623e-3586-4a15-a916-4f1548a70502'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:59.549498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ac38623e-3586-4a15-a916-4f1548a70502 admin admin] The token cache is being invalidate because project 7c696c6cad1c43398c00e0efebc99682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:18:59.549791 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ac38623e-3586-4a15-a916-4f1548a70502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:59.550498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ac38623e-3586-4a15-a916-4f1548a70502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:59.552049 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4220/8350] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:18:59 2021] DELETE /identity/v3/projects/7c696c6cad1c43398c00e0efebc99682 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:18:59.556031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9813803-b71a-4254-8f8c-d0b616fe345b service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:18:59.566939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9813803-b71a-4254-8f8c-d0b616fe345b service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:18:59.641549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc6b0c-2174-466a-a630-c868bb6d5b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:18:59.642464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6b0c-2174-466a-a630-c868bb6d5b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:18:59.642924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6b0c-2174-466a-a630-c868bb6d5b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:18:59.643216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6b0c-2174-466a-a630-c868bb6d5b05 admin admin] PATH_INFO: `/v3/users/7e550670cdfb4cf0a088b17d73bdea62` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:18:59.644674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc6b0c-2174-466a-a630-c868bb6d5b05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e550670cdfb4cf0a088b17d73bdea62)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:18:59.646923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc6b0c-2174-466a-a630-c868bb6d5b05 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:18:59.701934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ebc6b0c-2174-466a-a630-c868bb6d5b05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e550670cdfb4cf0a088b17d73bdea62'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:59.709463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ebc6b0c-2174-466a-a630-c868bb6d5b05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e550670cdfb4cf0a088b17d73bdea62'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:59.731942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ebc6b0c-2174-466a-a630-c868bb6d5b05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e550670cdfb4cf0a088b17d73bdea62'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:59.732702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ebc6b0c-2174-466a-a630-c868bb6d5b05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e550670cdfb4cf0a088b17d73bdea62'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:59.749014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9ebc6b0c-2174-466a-a630-c868bb6d5b05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e550670cdfb4cf0a088b17d73bdea62'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:18:59.755464 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4131/8351] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:18:59 2021] DELETE /identity/v3/users/7e550670cdfb4cf0a088b17d73bdea62 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:19:00.203865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38623e-3586-4a15-a916-4f1548a70502 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:00.207175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ac38623e-3586-4a15-a916-4f1548a70502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:00.232264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38623e-3586-4a15-a916-4f1548a70502 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:00.311117 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55456955-6a94-42c1-ac3e-5fa83edd5b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:00.311976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55456955-6a94-42c1-ac3e-5fa83edd5b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:00.312262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55456955-6a94-42c1-ac3e-5fa83edd5b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:00.312534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55456955-6a94-42c1-ac3e-5fa83edd5b4c admin admin] PATH_INFO: `/v3/projects/9d26a3fdd4ff4eaa9f424c5a64299851` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:00.314297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55456955-6a94-42c1-ac3e-5fa83edd5b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d26a3fdd4ff4eaa9f424c5a64299851)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:00.316544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55456955-6a94-42c1-ac3e-5fa83edd5b4c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:00.363414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-55456955-6a94-42c1-ac3e-5fa83edd5b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d26a3fdd4ff4eaa9f424c5a64299851', 'request_id': 'req-55456955-6a94-42c1-ac3e-5fa83edd5b4c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:00.369343 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-55456955-6a94-42c1-ac3e-5fa83edd5b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d26a3fdd4ff4eaa9f424c5a64299851', 'request_id': 'req-55456955-6a94-42c1-ac3e-5fa83edd5b4c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:00.376891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-55456955-6a94-42c1-ac3e-5fa83edd5b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d26a3fdd4ff4eaa9f424c5a64299851', 'request_id': 'req-55456955-6a94-42c1-ac3e-5fa83edd5b4c'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:00.387894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-55456955-6a94-42c1-ac3e-5fa83edd5b4c admin admin] The token cache is being invalidate because project 9d26a3fdd4ff4eaa9f424c5a64299851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:19:00.388177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-55456955-6a94-42c1-ac3e-5fa83edd5b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:00.388834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-55456955-6a94-42c1-ac3e-5fa83edd5b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:00.390552 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4221/8352] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:19:00 2021] DELETE /identity/v3/projects/9d26a3fdd4ff4eaa9f424c5a64299851 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:19:00.394566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc6b0c-2174-466a-a630-c868bb6d5b05 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:00.396071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9ebc6b0c-2174-466a-a630-c868bb6d5b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:00.409550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc6b0c-2174-466a-a630-c868bb6d5b05 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:00.468341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c7c9a-f165-4878-97bb-0d3f6769058a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:00.469224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c7c9a-f165-4878-97bb-0d3f6769058a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:00.469521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c7c9a-f165-4878-97bb-0d3f6769058a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:00.469803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c7c9a-f165-4878-97bb-0d3f6769058a admin admin] PATH_INFO: `/v3/users/d50e396185854a79a33e49031190889a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:00.471229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c7c9a-f165-4878-97bb-0d3f6769058a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50e396185854a79a33e49031190889a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:00.473162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c7c9a-f165-4878-97bb-0d3f6769058a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:00.522861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4e0c7c9a-f165-4878-97bb-0d3f6769058a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50e396185854a79a33e49031190889a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:00.530488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4e0c7c9a-f165-4878-97bb-0d3f6769058a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50e396185854a79a33e49031190889a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:00.545897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4e0c7c9a-f165-4878-97bb-0d3f6769058a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50e396185854a79a33e49031190889a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:00.546926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4e0c7c9a-f165-4878-97bb-0d3f6769058a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50e396185854a79a33e49031190889a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:00.555297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-4e0c7c9a-f165-4878-97bb-0d3f6769058a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50e396185854a79a33e49031190889a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:00.562422 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4132/8353] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:19:00 2021] DELETE /identity/v3/users/d50e396185854a79a33e49031190889a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:19:00.899613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55456955-6a94-42c1-ac3e-5fa83edd5b4c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:00.901965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-55456955-6a94-42c1-ac3e-5fa83edd5b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:00.925275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55456955-6a94-42c1-ac3e-5fa83edd5b4c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:00.997406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e3e02-1337-4261-be09-0ff9aff2b5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:00.998542 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e3e02-1337-4261-be09-0ff9aff2b5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:00.999471 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e3e02-1337-4261-be09-0ff9aff2b5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:00.999613 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e3e02-1337-4261-be09-0ff9aff2b5c9 admin admin] PATH_INFO: `/v3/projects/c61a6e6a794c423aa180e4795816c450` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:01.003018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e3e02-1337-4261-be09-0ff9aff2b5c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c61a6e6a794c423aa180e4795816c450)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:01.019447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e3e02-1337-4261-be09-0ff9aff2b5c9 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:01.095664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7e6e3e02-1337-4261-be09-0ff9aff2b5c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c61a6e6a794c423aa180e4795816c450', 'request_id': 'req-7e6e3e02-1337-4261-be09-0ff9aff2b5c9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:01.104003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7e6e3e02-1337-4261-be09-0ff9aff2b5c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c61a6e6a794c423aa180e4795816c450', 'request_id': 'req-7e6e3e02-1337-4261-be09-0ff9aff2b5c9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:01.117895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7e6e3e02-1337-4261-be09-0ff9aff2b5c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c61a6e6a794c423aa180e4795816c450', 'request_id': 'req-7e6e3e02-1337-4261-be09-0ff9aff2b5c9'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:01.130172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7e6e3e02-1337-4261-be09-0ff9aff2b5c9 admin admin] The token cache is being invalidate because project c61a6e6a794c423aa180e4795816c450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:19:01.130503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7e6e3e02-1337-4261-be09-0ff9aff2b5c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:01.131277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7e6e3e02-1337-4261-be09-0ff9aff2b5c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:01.133942 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4222/8354] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:19:00 2021] DELETE /identity/v3/projects/c61a6e6a794c423aa180e4795816c450 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:19:01.140902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc54c14-407e-4455-9809-808f61851b67 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:01.141421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc54c14-407e-4455-9809-808f61851b67 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:01.141727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc54c14-407e-4455-9809-808f61851b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:01.170874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1fc54c14-407e-4455-9809-808f61851b67 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:01.172787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1fc54c14-407e-4455-9809-808f61851b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:01.257865 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4133/8355] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:19:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:19:01.267529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c75ab-39f1-44f7-9f08-7b28e95ede08 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:01.268392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c75ab-39f1-44f7-9f08-7b28e95ede08 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:01.268997 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c75ab-39f1-44f7-9f08-7b28e95ede08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:01.297536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4b7c75ab-39f1-44f7-9f08-7b28e95ede08 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:01.299303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4b7c75ab-39f1-44f7-9f08-7b28e95ede08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:01.312405 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4223/8356] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:19:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:19:01.315197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc54c14-407e-4455-9809-808f61851b67 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:01.327812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc54c14-407e-4455-9809-808f61851b67 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:01.333247 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb35f1-7e53-4b2b-a12b-d7652e87e4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:01.333999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb35f1-7e53-4b2b-a12b-d7652e87e4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:01.334645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb35f1-7e53-4b2b-a12b-d7652e87e4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:01.335006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb35f1-7e53-4b2b-a12b-d7652e87e4e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:01.335934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb35f1-7e53-4b2b-a12b-d7652e87e4e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:19:01.336324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb35f1-7e53-4b2b-a12b-d7652e87e4e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:01.338508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb35f1-7e53-4b2b-a12b-d7652e87e4e5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:01.362228 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4134/8357] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:19:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:19:01.365150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c75ab-39f1-44f7-9f08-7b28e95ede08 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:01.387634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c75ab-39f1-44f7-9f08-7b28e95ede08 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:01.394382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153bb73-29f3-4f56-bfac-71c561d4a68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:01.396118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153bb73-29f3-4f56-bfac-71c561d4a68d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:01.396561 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153bb73-29f3-4f56-bfac-71c561d4a68d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:01.397439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153bb73-29f3-4f56-bfac-71c561d4a68d admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:01.398849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153bb73-29f3-4f56-bfac-71c561d4a68d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:01.402859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153bb73-29f3-4f56-bfac-71c561d4a68d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:01.450562 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4224/8358] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:19:01 2021] POST /identity/v3/projects => generated 389 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:19:01.458042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb35f1-7e53-4b2b-a12b-d7652e87e4e5 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:01.469937 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb35f1-7e53-4b2b-a12b-d7652e87e4e5 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:01.541944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d7768-56d9-42d6-9ccd-d3d94b0524d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:01.542810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d7768-56d9-42d6-9ccd-d3d94b0524d6 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:01.543656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d7768-56d9-42d6-9ccd-d3d94b0524d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:01.543950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d7768-56d9-42d6-9ccd-d3d94b0524d6 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:01.544738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d7768-56d9-42d6-9ccd-d3d94b0524d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:01.547238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d7768-56d9-42d6-9ccd-d3d94b0524d6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:01.548763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153bb73-29f3-4f56-bfac-71c561d4a68d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:01.550926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e153bb73-29f3-4f56-bfac-71c561d4a68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:01.565633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153bb73-29f3-4f56-bfac-71c561d4a68d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:01.571034 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcb881-a113-4892-acf7-ce5ed4eaff34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:01.571703 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4135/8359] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:19:01 2021] POST /identity/v3/users => generated 295 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:19:01.572112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb881-a113-4892-acf7-ce5ed4eaff34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:01.572402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb881-a113-4892-acf7-ce5ed4eaff34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:01.572682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb881-a113-4892-acf7-ce5ed4eaff34 admin admin] PATH_INFO: `/v3/users/d32598482c834073b8fe24c84cb57d2f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:01.573917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebcb881-a113-4892-acf7-ce5ed4eaff34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d32598482c834073b8fe24c84cb57d2f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:01.576444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d7768-56d9-42d6-9ccd-d3d94b0524d6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:01.576565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebcb881-a113-4892-acf7-ce5ed4eaff34 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:01.586140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d7768-56d9-42d6-9ccd-d3d94b0524d6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:01.591558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a07983-f8ca-4a91-959e-8b770698d9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:01.592232 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a07983-f8ca-4a91-959e-8b770698d9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:01.592501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a07983-f8ca-4a91-959e-8b770698d9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:01.592780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a07983-f8ca-4a91-959e-8b770698d9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:01.593514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a07983-f8ca-4a91-959e-8b770698d9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:01.595113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a07983-f8ca-4a91-959e-8b770698d9c0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:01.608630 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4136/8360] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:19:01 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:19:01.611773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a07983-f8ca-4a91-959e-8b770698d9c0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:01.622033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a07983-f8ca-4a91-959e-8b770698d9c0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:01.626832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7ebcb881-a113-4892-acf7-ce5ed4eaff34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd32598482c834073b8fe24c84cb57d2f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:01.627164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5f8fe-6711-4a48-b38c-347c03affa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:01.628037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5f8fe-6711-4a48-b38c-347c03affa5e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:01.628320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5f8fe-6711-4a48-b38c-347c03affa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:01.628628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5f8fe-6711-4a48-b38c-347c03affa5e admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:01.629605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5f8fe-6711-4a48-b38c-347c03affa5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:01.631627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5f8fe-6711-4a48-b38c-347c03affa5e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:01.635016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7ebcb881-a113-4892-acf7-ce5ed4eaff34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd32598482c834073b8fe24c84cb57d2f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:01.635743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7ebcb881-a113-4892-acf7-ce5ed4eaff34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd32598482c834073b8fe24c84cb57d2f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:01.643621 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4137/8361] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:19:01 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:19:01.647793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5f8fe-6711-4a48-b38c-347c03affa5e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:01.651266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7ebcb881-a113-4892-acf7-ce5ed4eaff34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd32598482c834073b8fe24c84cb57d2f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:01.658041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5f8fe-6711-4a48-b38c-347c03affa5e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:01.660798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7ebcb881-a113-4892-acf7-ce5ed4eaff34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd32598482c834073b8fe24c84cb57d2f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:01.663538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbbf37-2296-4904-9d08-1c933e3f9c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:01.664426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbbf37-2296-4904-9d08-1c933e3f9c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:01.664713 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbbf37-2296-4904-9d08-1c933e3f9c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:01.664995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbbf37-2296-4904-9d08-1c933e3f9c91 admin admin] PATH_INFO: `/v3/projects/4fc0be93c7544e6eb79d01c1bf880625/users/577286e40c5a4bf6a56af13d061f2151/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:01.668023 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4225/8362] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:19:01 2021] DELETE /identity/v3/users/d32598482c834073b8fe24c84cb57d2f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:19:01.686736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbbf37-2296-4904-9d08-1c933e3f9c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc0be93c7544e6eb79d01c1bf880625, user_id=577286e40c5a4bf6a56af13d061f2151, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:01.689405 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbbf37-2296-4904-9d08-1c933e3f9c91 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:01.711685 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4138/8363] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:19:01 2021] PUT /identity/v3/projects/4fc0be93c7544e6eb79d01c1bf880625/users/577286e40c5a4bf6a56af13d061f2151/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:19:01.713490 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5876f-f65a-4a8f-94dd-aa46962e7fb9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:01.713788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5876f-f65a-4a8f-94dd-aa46962e7fb9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:01.714070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5876f-f65a-4a8f-94dd-aa46962e7fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:01.742660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-54f5876f-f65a-4a8f-94dd-aa46962e7fb9 None None] MFA Rules not processed for user `577286e40c5a4bf6a56af13d061f2151`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:01.744054 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-54f5876f-f65a-4a8f-94dd-aa46962e7fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:01.809630 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4226/8364] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:19:01 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:19:01.814406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbbf37-2296-4904-9d08-1c933e3f9c91 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:01.816624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-56dbbf37-2296-4904-9d08-1c933e3f9c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:01.844553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5876f-f65a-4a8f-94dd-aa46962e7fb9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:01.846105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-54f5876f-f65a-4a8f-94dd-aa46962e7fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:01.890802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbbf37-2296-4904-9d08-1c933e3f9c91 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:01.895537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c2f8a-aa15-488f-874e-1720d8cf75de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:01.896197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c2f8a-aa15-488f-874e-1720d8cf75de admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:01.896488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c2f8a-aa15-488f-874e-1720d8cf75de admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:01.896771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c2f8a-aa15-488f-874e-1720d8cf75de admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:01.897486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c2f8a-aa15-488f-874e-1720d8cf75de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:01.899434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c2f8a-aa15-488f-874e-1720d8cf75de admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:01.924891 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4139/8365] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:19:01 2021] POST /identity/v3/projects => generated 389 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:19:01.925221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5876f-f65a-4a8f-94dd-aa46962e7fb9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:01.928752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c2f8a-aa15-488f-874e-1720d8cf75de admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:01.980649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e944df-5b08-44a2-a2d8-3744c76b0c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:01.981537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e944df-5b08-44a2-a2d8-3744c76b0c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:01.981830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e944df-5b08-44a2-a2d8-3744c76b0c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:01.982241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e944df-5b08-44a2-a2d8-3744c76b0c98 admin admin] PATH_INFO: `/v3/projects/de79cd87d023436a80d3cc5428586e21` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:01.983478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e944df-5b08-44a2-a2d8-3744c76b0c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de79cd87d023436a80d3cc5428586e21)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:01.985455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e944df-5b08-44a2-a2d8-3744c76b0c98 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:01.989509 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c2f8a-aa15-488f-874e-1720d8cf75de admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:01.994377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038a666-bedc-4c6e-8549-787a06d7c902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:01.995131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038a666-bedc-4c6e-8549-787a06d7c902 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:01.995418 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038a666-bedc-4c6e-8549-787a06d7c902 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:01.995698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038a666-bedc-4c6e-8549-787a06d7c902 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:01.996929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038a666-bedc-4c6e-8549-787a06d7c902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:01.998858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038a666-bedc-4c6e-8549-787a06d7c902 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:02.020621 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4140/8366] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:19:01 2021] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:19:02.024564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038a666-bedc-4c6e-8549-787a06d7c902 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:02.037391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c0e944df-5b08-44a2-a2d8-3744c76b0c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de79cd87d023436a80d3cc5428586e21', 'request_id': 'req-c0e944df-5b08-44a2-a2d8-3744c76b0c98'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:02.037667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038a666-bedc-4c6e-8549-787a06d7c902 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:02.040972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c0e944df-5b08-44a2-a2d8-3744c76b0c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de79cd87d023436a80d3cc5428586e21', 'request_id': 'req-c0e944df-5b08-44a2-a2d8-3744c76b0c98'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:02.049143 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c0e944df-5b08-44a2-a2d8-3744c76b0c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de79cd87d023436a80d3cc5428586e21', 'request_id': 'req-c0e944df-5b08-44a2-a2d8-3744c76b0c98'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:02.059915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c0e944df-5b08-44a2-a2d8-3744c76b0c98 admin admin] The token cache is being invalidate because project de79cd87d023436a80d3cc5428586e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:19:02.060211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c0e944df-5b08-44a2-a2d8-3744c76b0c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:02.060980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c0e944df-5b08-44a2-a2d8-3744c76b0c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:02.062801 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4227/8367] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:19:01 2021] DELETE /identity/v3/projects/de79cd87d023436a80d3cc5428586e21 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:19:02.066852 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e944df-5b08-44a2-a2d8-3744c76b0c98 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:02.068901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c0e944df-5b08-44a2-a2d8-3744c76b0c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:02.102321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06486c-f4eb-4721-9bc3-6d910abe5a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:02.102995 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06486c-f4eb-4721-9bc3-6d910abe5a38 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:02.103283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06486c-f4eb-4721-9bc3-6d910abe5a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:02.103565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06486c-f4eb-4721-9bc3-6d910abe5a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:02.104294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06486c-f4eb-4721-9bc3-6d910abe5a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:02.105914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06486c-f4eb-4721-9bc3-6d910abe5a38 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:02.115473 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4141/8368] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:19:02 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:19:02.119392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06486c-f4eb-4721-9bc3-6d910abe5a38 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:02.121576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6a06486c-f4eb-4721-9bc3-6d910abe5a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:02.133909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e944df-5b08-44a2-a2d8-3744c76b0c98 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:02.134957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06486c-f4eb-4721-9bc3-6d910abe5a38 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:02.140029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e16d9d-6079-4325-b74d-3206d2399955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:02.140489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d3160-fddc-4c7a-8dec-772c9ce1824e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:02.140927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16d9d-6079-4325-b74d-3206d2399955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:02.141146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d3160-fddc-4c7a-8dec-772c9ce1824e admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:02.141283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16d9d-6079-4325-b74d-3206d2399955 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:02.141438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d3160-fddc-4c7a-8dec-772c9ce1824e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:02.141538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16d9d-6079-4325-b74d-3206d2399955 admin admin] PATH_INFO: `/v3/users/b5c4ff3ea3e14de683a0a64bd9e75d46` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:02.141721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d3160-fddc-4c7a-8dec-772c9ce1824e admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:02.142494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d3160-fddc-4c7a-8dec-772c9ce1824e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:02.144069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d3160-fddc-4c7a-8dec-772c9ce1824e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:02.157085 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4142/8369] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:19:02 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:19:02.157251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e16d9d-6079-4325-b74d-3206d2399955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c4ff3ea3e14de683a0a64bd9e75d46)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:02.157251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e16d9d-6079-4325-b74d-3206d2399955 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:02.158050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d3160-fddc-4c7a-8dec-772c9ce1824e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:02.169120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d3160-fddc-4c7a-8dec-772c9ce1824e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:02.173461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e237559-736c-49f8-9a87-93a895adab27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:02.174392 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e237559-736c-49f8-9a87-93a895adab27 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:02.174688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e237559-736c-49f8-9a87-93a895adab27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:02.174973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e237559-736c-49f8-9a87-93a895adab27 admin admin] PATH_INFO: `/v3/projects/776871d5117f4694812ba92d79b5cc03/users/6198ccce86e549758387b3473c58a64e/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:02.193565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e237559-736c-49f8-9a87-93a895adab27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=776871d5117f4694812ba92d79b5cc03, user_id=6198ccce86e549758387b3473c58a64e, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:02.196569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e237559-736c-49f8-9a87-93a895adab27 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:02.211664 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4143/8370] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:19:02 2021] PUT /identity/v3/projects/776871d5117f4694812ba92d79b5cc03/users/6198ccce86e549758387b3473c58a64e/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:19:02.212913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c2e16d9d-6079-4325-b74d-3206d2399955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c4ff3ea3e14de683a0a64bd9e75d46'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:02.221784 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c2e16d9d-6079-4325-b74d-3206d2399955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c4ff3ea3e14de683a0a64bd9e75d46'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:02.222943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9451be8-e21e-43dc-97ac-fa8aa5c9c25b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:02.223064 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c2e16d9d-6079-4325-b74d-3206d2399955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c4ff3ea3e14de683a0a64bd9e75d46'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:02.223564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9451be8-e21e-43dc-97ac-fa8aa5c9c25b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:02.224195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9451be8-e21e-43dc-97ac-fa8aa5c9c25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:02.238115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c2e16d9d-6079-4325-b74d-3206d2399955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c4ff3ea3e14de683a0a64bd9e75d46'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:02.245265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-c2e16d9d-6079-4325-b74d-3206d2399955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c4ff3ea3e14de683a0a64bd9e75d46'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:02.254016 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4228/8371] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:19:02 2021] DELETE /identity/v3/users/b5c4ff3ea3e14de683a0a64bd9e75d46 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:19:02.261342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d9451be8-e21e-43dc-97ac-fa8aa5c9c25b None None] MFA Rules not processed for user `6198ccce86e549758387b3473c58a64e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:02.263412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d9451be8-e21e-43dc-97ac-fa8aa5c9c25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:02.339941 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4144/8372] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:19:02 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:19:02.340915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e16d9d-6079-4325-b74d-3206d2399955 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:02.342992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c2e16d9d-6079-4325-b74d-3206d2399955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:02.417316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e16d9d-6079-4325-b74d-3206d2399955 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:02.425208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b6550-0819-4965-8ef8-f11b1728dc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:02.425880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b6550-0819-4965-8ef8-f11b1728dc57 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:02.426170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b6550-0819-4965-8ef8-f11b1728dc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:02.426492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b6550-0819-4965-8ef8-f11b1728dc57 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:02.427225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b6550-0819-4965-8ef8-f11b1728dc57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:02.429123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b6550-0819-4965-8ef8-f11b1728dc57 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:02.451234 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9451be8-e21e-43dc-97ac-fa8aa5c9c25b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:02.452986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d9451be8-e21e-43dc-97ac-fa8aa5c9c25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:02.465516 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4229/8373] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:19:02 2021] POST /identity/v3/projects => generated 389 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:19:02.469672 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b6550-0819-4965-8ef8-f11b1728dc57 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:02.499666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9451be8-e21e-43dc-97ac-fa8aa5c9c25b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:02.543438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b6550-0819-4965-8ef8-f11b1728dc57 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:02.548376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cd6ac-0848-492b-bc9e-2f98b62e7246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:02.549046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cd6ac-0848-492b-bc9e-2f98b62e7246 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:02.549331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cd6ac-0848-492b-bc9e-2f98b62e7246 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:02.549624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cd6ac-0848-492b-bc9e-2f98b62e7246 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:02.550359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cd6ac-0848-492b-bc9e-2f98b62e7246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:02.552261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cd6ac-0848-492b-bc9e-2f98b62e7246 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:02.572295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f6f7b-9349-4b48-9290-d28cd45da55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:02.573164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f6f7b-9349-4b48-9290-d28cd45da55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:02.573456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f6f7b-9349-4b48-9290-d28cd45da55b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:02.573732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f6f7b-9349-4b48-9290-d28cd45da55b admin admin] PATH_INFO: `/v3/projects/b21789afba8948ae88ea829b75a3eedc` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:02.576397 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4230/8374] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:19:02 2021] POST /identity/v3/users => generated 301 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:19:02.580200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cd6ac-0848-492b-bc9e-2f98b62e7246 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:02.588697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f6f7b-9349-4b48-9290-d28cd45da55b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b21789afba8948ae88ea829b75a3eedc)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:02.590901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f6f7b-9349-4b48-9290-d28cd45da55b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:02.594605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cd6ac-0848-492b-bc9e-2f98b62e7246 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:02.599624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c8797-b828-4038-a27f-192f4843eb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:02.600279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c8797-b828-4038-a27f-192f4843eb3d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:02.600565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c8797-b828-4038-a27f-192f4843eb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:02.600847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c8797-b828-4038-a27f-192f4843eb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:02.601588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c8797-b828-4038-a27f-192f4843eb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:02.603294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c8797-b828-4038-a27f-192f4843eb3d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:02.614301 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4231/8375] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:19:02 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:19:02.618104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c8797-b828-4038-a27f-192f4843eb3d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:02.630056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c8797-b828-4038-a27f-192f4843eb3d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:02.635880 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1bfe4-2550-4e23-a17a-1901db9f5a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:02.637091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1bfe4-2550-4e23-a17a-1901db9f5a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:02.637376 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1bfe4-2550-4e23-a17a-1901db9f5a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:02.637671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1bfe4-2550-4e23-a17a-1901db9f5a82 admin admin] PATH_INFO: `/v3/projects/3beb09d4bfb94a468517eba8c3a9289e/users/bd8644c0328d426bb1ec81cfe7f801c1/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:02.657624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-381f6f7b-9349-4b48-9290-d28cd45da55b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b21789afba8948ae88ea829b75a3eedc', 'request_id': 'req-381f6f7b-9349-4b48-9290-d28cd45da55b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:02.666910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-381f6f7b-9349-4b48-9290-d28cd45da55b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b21789afba8948ae88ea829b75a3eedc', 'request_id': 'req-381f6f7b-9349-4b48-9290-d28cd45da55b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:02.674691 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-381f6f7b-9349-4b48-9290-d28cd45da55b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b21789afba8948ae88ea829b75a3eedc', 'request_id': 'req-381f6f7b-9349-4b48-9290-d28cd45da55b'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:02.691535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-381f6f7b-9349-4b48-9290-d28cd45da55b admin admin] The token cache is being invalidate because project b21789afba8948ae88ea829b75a3eedc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:19:02.691807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-381f6f7b-9349-4b48-9290-d28cd45da55b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:02.692499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-381f6f7b-9349-4b48-9290-d28cd45da55b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:02.694082 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4145/8376] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:19:02 2021] DELETE /identity/v3/projects/b21789afba8948ae88ea829b75a3eedc => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:19:02.825707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1bfe4-2550-4e23-a17a-1901db9f5a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3beb09d4bfb94a468517eba8c3a9289e, user_id=bd8644c0328d426bb1ec81cfe7f801c1, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:02.829645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1bfe4-2550-4e23-a17a-1901db9f5a82 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:02.876076 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4232/8377] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:19:02 2021] PUT /identity/v3/projects/3beb09d4bfb94a468517eba8c3a9289e/users/bd8644c0328d426bb1ec81cfe7f801c1/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:19:02.879315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f6f7b-9349-4b48-9290-d28cd45da55b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:02.881221 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-381f6f7b-9349-4b48-9290-d28cd45da55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:02.970840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f6f7b-9349-4b48-9290-d28cd45da55b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:03.034287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7a65f-27a8-4b1a-b195-96eb73396dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:03.034903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7a65f-27a8-4b1a-b195-96eb73396dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:03.035195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7a65f-27a8-4b1a-b195-96eb73396dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:03.035477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7a65f-27a8-4b1a-b195-96eb73396dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:03.036262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7a65f-27a8-4b1a-b195-96eb73396dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:03.037972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7a65f-27a8-4b1a-b195-96eb73396dd0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:03.052165 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4146/8378] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:19:02 2021] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:19:03.057197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1bfe4-2550-4e23-a17a-1901db9f5a82 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:03.083684 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1bfe4-2550-4e23-a17a-1901db9f5a82 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:03.092556 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc33a7a-fff3-4f8d-ad42-956cfa796539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:03.093663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33a7a-fff3-4f8d-ad42-956cfa796539 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:03.093912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33a7a-fff3-4f8d-ad42-956cfa796539 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:03.094204 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33a7a-fff3-4f8d-ad42-956cfa796539 admin admin] PATH_INFO: `/v3/projects/3beb09d4bfb94a468517eba8c3a9289e/users/bd8644c0328d426bb1ec81cfe7f801c1/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:03.097112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc33a7a-fff3-4f8d-ad42-956cfa796539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3beb09d4bfb94a468517eba8c3a9289e, user_id=bd8644c0328d426bb1ec81cfe7f801c1, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:03.099984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc33a7a-fff3-4f8d-ad42-956cfa796539 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:03.112938 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4233/8379] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:19:03 2021] PUT /identity/v3/projects/3beb09d4bfb94a468517eba8c3a9289e/users/bd8644c0328d426bb1ec81cfe7f801c1/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:19:03.124112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19cc08-c142-4011-82c8-36734942a3be None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:03.124426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19cc08-c142-4011-82c8-36734942a3be None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:03.124721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19cc08-c142-4011-82c8-36734942a3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:03.159708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-da19cc08-c142-4011-82c8-36734942a3be None None] MFA Rules not processed for user `bd8644c0328d426bb1ec81cfe7f801c1`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:03.160996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-da19cc08-c142-4011-82c8-36734942a3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:03.234517 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4147/8380] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:19:03 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:19:03.246927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc33a7a-fff3-4f8d-ad42-956cfa796539 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:03.248732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8dc33a7a-fff3-4f8d-ad42-956cfa796539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:03.340794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc33a7a-fff3-4f8d-ad42-956cfa796539 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:03.346374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdb336-6e87-443e-8595-def6c19b0fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:03.347013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb336-6e87-443e-8595-def6c19b0fef service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:03.347292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb336-6e87-443e-8595-def6c19b0fef service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:03.347568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb336-6e87-443e-8595-def6c19b0fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:03.349846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a0fdb336-6e87-443e-8595-def6c19b0fef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:03.405442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdb336-6e87-443e-8595-def6c19b0fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:03.407094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdb336-6e87-443e-8595-def6c19b0fef service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:03.415645 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4234/8381] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:19:03 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:19:05.016558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19cc08-c142-4011-82c8-36734942a3be None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:05.018110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-da19cc08-c142-4011-82c8-36734942a3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:05.085476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19cc08-c142-4011-82c8-36734942a3be None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:05.090000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391bc5b-7630-412d-877e-b0aad1b33ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:05.090902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391bc5b-7630-412d-877e-b0aad1b33ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:05.091182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391bc5b-7630-412d-877e-b0aad1b33ede admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:05.091457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391bc5b-7630-412d-877e-b0aad1b33ede admin admin] PATH_INFO: `/v3/users/758e5861ca584e189fc8a8bb95045d8e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:05.092663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391bc5b-7630-412d-877e-b0aad1b33ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=758e5861ca584e189fc8a8bb95045d8e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:05.094590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391bc5b-7630-412d-877e-b0aad1b33ede admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:05.143587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e391bc5b-7630-412d-877e-b0aad1b33ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '758e5861ca584e189fc8a8bb95045d8e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:05.150782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e391bc5b-7630-412d-877e-b0aad1b33ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '758e5861ca584e189fc8a8bb95045d8e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:05.162305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e391bc5b-7630-412d-877e-b0aad1b33ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '758e5861ca584e189fc8a8bb95045d8e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:05.163012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e391bc5b-7630-412d-877e-b0aad1b33ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '758e5861ca584e189fc8a8bb95045d8e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:05.170722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e391bc5b-7630-412d-877e-b0aad1b33ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '758e5861ca584e189fc8a8bb95045d8e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:05.177206 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4148/8382] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:19:05 2021] DELETE /identity/v3/users/758e5861ca584e189fc8a8bb95045d8e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:19:05.182028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5cfd6-fe59-40a6-9c10-0852890fb898 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:05.182938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5cfd6-fe59-40a6-9c10-0852890fb898 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:05.183874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5cfd6-fe59-40a6-9c10-0852890fb898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:05.206503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-07f5cfd6-fe59-40a6-9c10-0852890fb898 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:05.208260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-07f5cfd6-fe59-40a6-9c10-0852890fb898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:05.276710 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4235/8383] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:19:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:19:05.286648 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391bc5b-7630-412d-877e-b0aad1b33ede admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:05.288044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e391bc5b-7630-412d-877e-b0aad1b33ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:05.348132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391bc5b-7630-412d-877e-b0aad1b33ede admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:05.353189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a6aed-16ee-4123-b2c8-d1a1e557c684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:05.354101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a6aed-16ee-4123-b2c8-d1a1e557c684 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:05.354744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a6aed-16ee-4123-b2c8-d1a1e557c684 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:05.355754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a6aed-16ee-4123-b2c8-d1a1e557c684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:05.367586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a6aed-16ee-4123-b2c8-d1a1e557c684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:05.369240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a6aed-16ee-4123-b2c8-d1a1e557c684 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:05.380935 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4149/8384] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:19:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:19:05.647062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5cfd6-fe59-40a6-9c10-0852890fb898 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:05.649238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-07f5cfd6-fe59-40a6-9c10-0852890fb898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:05.663944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5cfd6-fe59-40a6-9c10-0852890fb898 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:05.669748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563b37c-2f0c-47ed-99c5-bbe689e5c081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:05.670659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563b37c-2f0c-47ed-99c5-bbe689e5c081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:05.670945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563b37c-2f0c-47ed-99c5-bbe689e5c081 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:05.671227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563b37c-2f0c-47ed-99c5-bbe689e5c081 admin admin] PATH_INFO: `/v3/projects/811b51c4fb9b4bebb5c0c2097d53b345` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:05.672593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9563b37c-2f0c-47ed-99c5-bbe689e5c081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=811b51c4fb9b4bebb5c0c2097d53b345)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:05.674501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9563b37c-2f0c-47ed-99c5-bbe689e5c081 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:05.721999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9563b37c-2f0c-47ed-99c5-bbe689e5c081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '811b51c4fb9b4bebb5c0c2097d53b345', 'request_id': 'req-9563b37c-2f0c-47ed-99c5-bbe689e5c081'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:05.728194 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9563b37c-2f0c-47ed-99c5-bbe689e5c081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '811b51c4fb9b4bebb5c0c2097d53b345', 'request_id': 'req-9563b37c-2f0c-47ed-99c5-bbe689e5c081'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:05.738850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9563b37c-2f0c-47ed-99c5-bbe689e5c081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '811b51c4fb9b4bebb5c0c2097d53b345', 'request_id': 'req-9563b37c-2f0c-47ed-99c5-bbe689e5c081'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:05.750517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9563b37c-2f0c-47ed-99c5-bbe689e5c081 admin admin] The token cache is being invalidate because project 811b51c4fb9b4bebb5c0c2097d53b345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:19:05.750808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9563b37c-2f0c-47ed-99c5-bbe689e5c081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:05.751477 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9563b37c-2f0c-47ed-99c5-bbe689e5c081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:05.753301 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4236/8385] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:19:05 2021] DELETE /identity/v3/projects/811b51c4fb9b4bebb5c0c2097d53b345 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:19:05.758766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed733a18-c2a1-4ea4-85a1-dfd82248f990 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:05.759065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed733a18-c2a1-4ea4-85a1-dfd82248f990 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:05.759353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed733a18-c2a1-4ea4-85a1-dfd82248f990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:05.776564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ed733a18-c2a1-4ea4-85a1-dfd82248f990 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:05.778349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ed733a18-c2a1-4ea4-85a1-dfd82248f990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:05.837638 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4150/8386] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:19:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:19:05.847181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff2e6e-f31b-4c84-952a-08bc35f430b2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:05.847475 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff2e6e-f31b-4c84-952a-08bc35f430b2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:05.847761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff2e6e-f31b-4c84-952a-08bc35f430b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:05.867991 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-68ff2e6e-f31b-4c84-952a-08bc35f430b2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:05.869271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-68ff2e6e-f31b-4c84-952a-08bc35f430b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:05.877180 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4237/8387] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:19:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:19:05.881623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed733a18-c2a1-4ea4-85a1-dfd82248f990 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:05.891564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed733a18-c2a1-4ea4-85a1-dfd82248f990 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:05.896279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf19da-d8b3-4843-a476-f3c12c57baa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:05.896940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf19da-d8b3-4843-a476-f3c12c57baa3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:05.897230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf19da-d8b3-4843-a476-f3c12c57baa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:05.897508 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf19da-d8b3-4843-a476-f3c12c57baa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:05.898273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf19da-d8b3-4843-a476-f3c12c57baa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:19:05.898593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf19da-d8b3-4843-a476-f3c12c57baa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:05.900207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf19da-d8b3-4843-a476-f3c12c57baa3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:05.915710 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4151/8388] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:19:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:19:05.916699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff2e6e-f31b-4c84-952a-08bc35f430b2 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:05.926563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff2e6e-f31b-4c84-952a-08bc35f430b2 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:05.931472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959c274-7ce4-4c25-a43f-32da8fbb09cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:05.932216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959c274-7ce4-4c25-a43f-32da8fbb09cf admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:05.932559 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959c274-7ce4-4c25-a43f-32da8fbb09cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:05.932904 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959c274-7ce4-4c25-a43f-32da8fbb09cf admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:05.933735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959c274-7ce4-4c25-a43f-32da8fbb09cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:05.935818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959c274-7ce4-4c25-a43f-32da8fbb09cf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:05.963809 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4238/8389] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:19:05 2021] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:19:05.971970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf19da-d8b3-4843-a476-f3c12c57baa3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:05.978459 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959c274-7ce4-4c25-a43f-32da8fbb09cf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:05.980153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7959c274-7ce4-4c25-a43f-32da8fbb09cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:05.983700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf19da-d8b3-4843-a476-f3c12c57baa3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:06.040208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959c274-7ce4-4c25-a43f-32da8fbb09cf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:06.045690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd55261-210e-499f-bf45-d3127bb8e78f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:06.046620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd55261-210e-499f-bf45-d3127bb8e78f service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:06.047150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd55261-210e-499f-bf45-d3127bb8e78f service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:06.047450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad46e42-d200-4bbc-b832-87627f418f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:06.048132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad46e42-d200-4bbc-b832-87627f418f94 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:06.048421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad46e42-d200-4bbc-b832-87627f418f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:06.048679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd55261-210e-499f-bf45-d3127bb8e78f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:06.048799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad46e42-d200-4bbc-b832-87627f418f94 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:06.049399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad46e42-d200-4bbc-b832-87627f418f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:06.050952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ebd55261-210e-499f-bf45-d3127bb8e78f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:06.051384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad46e42-d200-4bbc-b832-87627f418f94 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:06.073450 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4152/8390] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:19:05 2021] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:19:06.078058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad46e42-d200-4bbc-b832-87627f418f94 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:06.090168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad46e42-d200-4bbc-b832-87627f418f94 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:06.094944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a4ec0-b204-41db-a207-63af556bd3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:06.095613 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a4ec0-b204-41db-a207-63af556bd3da admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:06.095903 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a4ec0-b204-41db-a207-63af556bd3da admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:06.096187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a4ec0-b204-41db-a207-63af556bd3da admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:06.096922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a4ec0-b204-41db-a207-63af556bd3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:06.098574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a4ec0-b204-41db-a207-63af556bd3da admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:06.108786 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4153/8391] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:19:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:19:06.112445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a4ec0-b204-41db-a207-63af556bd3da admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:06.120402 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd55261-210e-499f-bf45-d3127bb8e78f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:06.121894 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd55261-210e-499f-bf45-d3127bb8e78f service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:06.122400 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a4ec0-b204-41db-a207-63af556bd3da admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:06.127449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a0e28-d18c-4593-b5e3-d943f4a29662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:06.128287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a0e28-d18c-4593-b5e3-d943f4a29662 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:06.128583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a0e28-d18c-4593-b5e3-d943f4a29662 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:06.128869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a0e28-d18c-4593-b5e3-d943f4a29662 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:06.129605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a0e28-d18c-4593-b5e3-d943f4a29662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:06.131319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a0e28-d18c-4593-b5e3-d943f4a29662 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:06.133369 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4239/8392] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:19:05 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:19:06.147991 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4154/8393] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:19:06 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:19:06.151976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd55261-210e-499f-bf45-d3127bb8e78f service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:06.166851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd55261-210e-499f-bf45-d3127bb8e78f service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:06.173094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81a259-4c8b-4249-a7e3-105173419a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:06.174335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81a259-4c8b-4249-a7e3-105173419a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:06.174683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81a259-4c8b-4249-a7e3-105173419a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:06.175107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81a259-4c8b-4249-a7e3-105173419a71 admin admin] PATH_INFO: `/v3/projects/126c6d3b7ace4bd2ae9d84ba23cf9ccb/users/90e59ad9f3924293afdb08a62848402f/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:06.201364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81a259-4c8b-4249-a7e3-105173419a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=126c6d3b7ace4bd2ae9d84ba23cf9ccb, user_id=90e59ad9f3924293afdb08a62848402f, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:06.204180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81a259-4c8b-4249-a7e3-105173419a71 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:06.220547 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4240/8394] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:19:06 2021] PUT /identity/v3/projects/126c6d3b7ace4bd2ae9d84ba23cf9ccb/users/90e59ad9f3924293afdb08a62848402f/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:19:06.225714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3848bd-83f8-432b-858f-90622e1f18e5 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:06.226011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3848bd-83f8-432b-858f-90622e1f18e5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:06.226322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3848bd-83f8-432b-858f-90622e1f18e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:06.244220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1a3848bd-83f8-432b-858f-90622e1f18e5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:06.245440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1a3848bd-83f8-432b-858f-90622e1f18e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:06.310206 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4155/8395] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:19:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:19:06.321219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81a259-4c8b-4249-a7e3-105173419a71 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:06.322889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7a81a259-4c8b-4249-a7e3-105173419a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:06.404654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81a259-4c8b-4249-a7e3-105173419a71 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:06.408480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c771c0-1530-4fba-9806-681b747701ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:06.409131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c771c0-1530-4fba-9806-681b747701ab service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:06.409416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c771c0-1530-4fba-9806-681b747701ab service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:06.409698 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c771c0-1530-4fba-9806-681b747701ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:06.420177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c771c0-1530-4fba-9806-681b747701ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:06.421772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c771c0-1530-4fba-9806-681b747701ab service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:06.432202 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4241/8396] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:19:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:19:07.481157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c634eb4-5768-4c45-bc55-e48ef1a750bc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:07.481659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c634eb4-5768-4c45-bc55-e48ef1a750bc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:07.481758 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c634eb4-5768-4c45-bc55-e48ef1a750bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:07.512059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0c634eb4-5768-4c45-bc55-e48ef1a750bc None None] MFA Rules not processed for user `90e59ad9f3924293afdb08a62848402f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:07.514516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0c634eb4-5768-4c45-bc55-e48ef1a750bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:07.640804 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4156/8397] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:19:07 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:19:07.652689 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c771c0-1530-4fba-9806-681b747701ab service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:07.654858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b8c771c0-1530-4fba-9806-681b747701ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:07.747431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c771c0-1530-4fba-9806-681b747701ab service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:07.751634 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76cb25-b352-4e50-a770-7bb748d49ccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:07.752700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76cb25-b352-4e50-a770-7bb748d49ccb service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:07.753284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76cb25-b352-4e50-a770-7bb748d49ccb service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:07.753730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76cb25-b352-4e50-a770-7bb748d49ccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:07.769648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76cb25-b352-4e50-a770-7bb748d49ccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:07.771525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76cb25-b352-4e50-a770-7bb748d49ccb service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:07.793632 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4242/8398] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:19:07 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:19:09.319771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e939de-6cdc-405b-bb4c-a28fc5ea0069 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:09.320262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e939de-6cdc-405b-bb4c-a28fc5ea0069 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:09.320372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e939de-6cdc-405b-bb4c-a28fc5ea0069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:09.340345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-23e939de-6cdc-405b-bb4c-a28fc5ea0069 None None] MFA Rules not processed for user `90e59ad9f3924293afdb08a62848402f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:09.341559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-23e939de-6cdc-405b-bb4c-a28fc5ea0069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:09.348978 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4157/8399] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:19:09 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:19:10.215822 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c90f43-ba75-4620-912e-b408e2a03c19 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:10.216332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c90f43-ba75-4620-912e-b408e2a03c19 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:10.216713 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c90f43-ba75-4620-912e-b408e2a03c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:10.236405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-52c90f43-ba75-4620-912e-b408e2a03c19 None None] MFA Rules not processed for user `577286e40c5a4bf6a56af13d061f2151`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:10.237718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-52c90f43-ba75-4620-912e-b408e2a03c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:10.309165 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4243/8400] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:19:10 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:19:10.323249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e939de-6cdc-405b-bb4c-a28fc5ea0069 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:10.324222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-23e939de-6cdc-405b-bb4c-a28fc5ea0069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:10.429102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e939de-6cdc-405b-bb4c-a28fc5ea0069 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:10.436269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07779e2-9846-41d0-922f-eab56603682c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:10.437015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07779e2-9846-41d0-922f-eab56603682c service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:10.437744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07779e2-9846-41d0-922f-eab56603682c service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:10.438274 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07779e2-9846-41d0-922f-eab56603682c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:10.440295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c07779e2-9846-41d0-922f-eab56603682c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:10.459269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07779e2-9846-41d0-922f-eab56603682c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:10.461167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07779e2-9846-41d0-922f-eab56603682c service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:10.476998 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4158/8401] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:19:10 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:19:17.943172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c90f43-ba75-4620-912e-b408e2a03c19 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:17.944660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-52c90f43-ba75-4620-912e-b408e2a03c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:18.020140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c90f43-ba75-4620-912e-b408e2a03c19 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:18.025795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc358c52-fa8e-4b02-9e51-b604784c330d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:18.027089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc358c52-fa8e-4b02-9e51-b604784c330d service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:18.027261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc358c52-fa8e-4b02-9e51-b604784c330d service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:18.027516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc358c52-fa8e-4b02-9e51-b604784c330d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:18.029258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fc358c52-fa8e-4b02-9e51-b604784c330d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:18.043660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc358c52-fa8e-4b02-9e51-b604784c330d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:18.045219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc358c52-fa8e-4b02-9e51-b604784c330d service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:18.057747 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4244/8402] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:19:17 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:19:23.974446 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01656352-5bb3-481a-9394-373e25485ca1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:23.975033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01656352-5bb3-481a-9394-373e25485ca1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:23.975033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01656352-5bb3-481a-9394-373e25485ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:23.992657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-01656352-5bb3-481a-9394-373e25485ca1 None None] MFA Rules not processed for user `90e59ad9f3924293afdb08a62848402f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:23.993858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-01656352-5bb3-481a-9394-373e25485ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:24.000810 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4159/8403] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:19:23 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:19:28.212047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a2a1c-db2a-4f6a-a90c-d21b6186ecee None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:28.212605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a2a1c-db2a-4f6a-a90c-d21b6186ecee None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:28.213113 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a2a1c-db2a-4f6a-a90c-d21b6186ecee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:28.239795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e15a2a1c-db2a-4f6a-a90c-d21b6186ecee None None] MFA Rules not processed for user `84883df65dac439a8c1e454b7ad570e2`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:28.242245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e15a2a1c-db2a-4f6a-a90c-d21b6186ecee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:28.326404 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4245/8404] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:19:28 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:19:39.217529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01656352-5bb3-481a-9394-373e25485ca1 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:39.234636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01656352-5bb3-481a-9394-373e25485ca1 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:39.240554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832791b-34ac-4e45-ad39-772a019a4ffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:39.241206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832791b-34ac-4e45-ad39-772a019a4ffb service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:39.241491 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832791b-34ac-4e45-ad39-772a019a4ffb service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:39.241769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832791b-34ac-4e45-ad39-772a019a4ffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:39.243574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9832791b-34ac-4e45-ad39-772a019a4ffb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:39.258920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832791b-34ac-4e45-ad39-772a019a4ffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:39.260516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832791b-34ac-4e45-ad39-772a019a4ffb service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:39.273687 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4160/8405] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:19:39 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:19:39.341389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a2a1c-db2a-4f6a-a90c-d21b6186ecee None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:39.355192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a2a1c-db2a-4f6a-a90c-d21b6186ecee None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:39.360643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef681039-b785-4227-bb70-faed624bcef6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:39.361264 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef681039-b785-4227-bb70-faed624bcef6 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:39.361548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef681039-b785-4227-bb70-faed624bcef6 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:39.361820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef681039-b785-4227-bb70-faed624bcef6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:39.363664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ef681039-b785-4227-bb70-faed624bcef6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:39.390606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef681039-b785-4227-bb70-faed624bcef6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:39.392115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef681039-b785-4227-bb70-faed624bcef6 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:39.405597 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4246/8406] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:19:39 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:19:41.661337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e65040-ce11-430b-8bb2-7a25f0d302c0 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:41.661818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e65040-ce11-430b-8bb2-7a25f0d302c0 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:41.661900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e65040-ce11-430b-8bb2-7a25f0d302c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:41.720907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-39e65040-ce11-430b-8bb2-7a25f0d302c0 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:41.722113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-39e65040-ce11-430b-8bb2-7a25f0d302c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:41.777550 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4161/8407] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:19:41 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:19:41.828560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef681039-b785-4227-bb70-faed624bcef6 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:41.830042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ef681039-b785-4227-bb70-faed624bcef6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:41.913346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef681039-b785-4227-bb70-faed624bcef6 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:41.918396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0846f-a602-4c55-af71-53c0afd126eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:41.919041 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0846f-a602-4c55-af71-53c0afd126eb service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:41.919324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0846f-a602-4c55-af71-53c0afd126eb service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:41.919597 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0846f-a602-4c55-af71-53c0afd126eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:41.927734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0846f-a602-4c55-af71-53c0afd126eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:41.929308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0846f-a602-4c55-af71-53c0afd126eb service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:41.937661 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4247/8408] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:19:41 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:19:55.210865 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e65040-ce11-430b-8bb2-7a25f0d302c0 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:55.231383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e65040-ce11-430b-8bb2-7a25f0d302c0 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:55.236512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76b7b8-7d70-4363-9238-3478cd87c55d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:55.237164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76b7b8-7d70-4363-9238-3478cd87c55d service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:55.237454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76b7b8-7d70-4363-9238-3478cd87c55d service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:55.237738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76b7b8-7d70-4363-9238-3478cd87c55d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:55.239576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7f76b7b8-7d70-4363-9238-3478cd87c55d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:55.265655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76b7b8-7d70-4363-9238-3478cd87c55d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:55.267311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76b7b8-7d70-4363-9238-3478cd87c55d service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:55.285079 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4162/8409] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:19:55 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:19:56.634187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8e1e7-e9a5-4b42-a76c-c011aacb6cd1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:56.634755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8e1e7-e9a5-4b42-a76c-c011aacb6cd1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:56.634755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8e1e7-e9a5-4b42-a76c-c011aacb6cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:56.652261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-ecc8e1e7-e9a5-4b42-a76c-c011aacb6cd1 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:56.653947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ecc8e1e7-e9a5-4b42-a76c-c011aacb6cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:56.661348 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4248/8410] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 21:19:56 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:19:56.674911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76b7b8-7d70-4363-9238-3478cd87c55d service placement] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:56.688284 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76b7b8-7d70-4363-9238-3478cd87c55d service placement] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:56.693504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c61cc-fa6d-4e22-a92a-0135a58a594e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:56.694136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c61cc-fa6d-4e22-a92a-0135a58a594e service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:56.694455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c61cc-fa6d-4e22-a92a-0135a58a594e service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:56.694738 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c61cc-fa6d-4e22-a92a-0135a58a594e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:56.702917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c61cc-fa6d-4e22-a92a-0135a58a594e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:56.704465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c61cc-fa6d-4e22-a92a-0135a58a594e service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:56.712313 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4163/8411] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:19:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:19:58.579702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8e1e7-e9a5-4b42-a76c-c011aacb6cd1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:58.592279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8e1e7-e9a5-4b42-a76c-c011aacb6cd1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:58.596965 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4579472-c8a6-4cb9-a9e1-237050f83438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:58.597933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4579472-c8a6-4cb9-a9e1-237050f83438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:58.598216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4579472-c8a6-4cb9-a9e1-237050f83438 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:58.598540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4579472-c8a6-4cb9-a9e1-237050f83438 admin admin] PATH_INFO: `/v3/users/90e59ad9f3924293afdb08a62848402f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:58.599748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4579472-c8a6-4cb9-a9e1-237050f83438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e59ad9f3924293afdb08a62848402f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:58.601688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4579472-c8a6-4cb9-a9e1-237050f83438 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:58.646241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4579472-c8a6-4cb9-a9e1-237050f83438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e59ad9f3924293afdb08a62848402f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:58.653410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4579472-c8a6-4cb9-a9e1-237050f83438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e59ad9f3924293afdb08a62848402f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:58.654111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4579472-c8a6-4cb9-a9e1-237050f83438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e59ad9f3924293afdb08a62848402f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:58.667757 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4579472-c8a6-4cb9-a9e1-237050f83438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e59ad9f3924293afdb08a62848402f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:58.675089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e4579472-c8a6-4cb9-a9e1-237050f83438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e59ad9f3924293afdb08a62848402f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:58.680947 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4249/8412] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:19:58 2021] DELETE /identity/v3/users/90e59ad9f3924293afdb08a62848402f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:19:58.846141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c61cc-fa6d-4e22-a92a-0135a58a594e service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:58.856747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c61cc-fa6d-4e22-a92a-0135a58a594e service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:58.912206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b1e51-b962-480f-b574-18ffe2ca8eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:58.912982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1e51-b962-480f-b574-18ffe2ca8eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:58.913269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1e51-b962-480f-b574-18ffe2ca8eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:58.913549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1e51-b962-480f-b574-18ffe2ca8eb6 admin admin] PATH_INFO: `/v3/projects/126c6d3b7ace4bd2ae9d84ba23cf9ccb` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:58.914765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b1e51-b962-480f-b574-18ffe2ca8eb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=126c6d3b7ace4bd2ae9d84ba23cf9ccb)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:58.916651 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b1e51-b962-480f-b574-18ffe2ca8eb6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:58.961752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ca9b1e51-b962-480f-b574-18ffe2ca8eb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'request_id': 'req-ca9b1e51-b962-480f-b574-18ffe2ca8eb6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:58.967645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ca9b1e51-b962-480f-b574-18ffe2ca8eb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'request_id': 'req-ca9b1e51-b962-480f-b574-18ffe2ca8eb6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:58.972878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ca9b1e51-b962-480f-b574-18ffe2ca8eb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '126c6d3b7ace4bd2ae9d84ba23cf9ccb', 'request_id': 'req-ca9b1e51-b962-480f-b574-18ffe2ca8eb6'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:58.984115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ca9b1e51-b962-480f-b574-18ffe2ca8eb6 admin admin] The token cache is being invalidate because project 126c6d3b7ace4bd2ae9d84ba23cf9ccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:19:58.984403 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ca9b1e51-b962-480f-b574-18ffe2ca8eb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:58.985050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ca9b1e51-b962-480f-b574-18ffe2ca8eb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:19:58.986611 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4164/8413] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:19:58 2021] DELETE /identity/v3/projects/126c6d3b7ace4bd2ae9d84ba23cf9ccb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:19:58.992503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abc2bc-4afe-4829-bffc-c12afb61f29d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:58.992789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abc2bc-4afe-4829-bffc-c12afb61f29d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:58.993068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abc2bc-4afe-4829-bffc-c12afb61f29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:59.011278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-13abc2bc-4afe-4829-bffc-c12afb61f29d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:59.013098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-13abc2bc-4afe-4829-bffc-c12afb61f29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:59.069662 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4250/8414] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:19:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:19:59.077998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff54d4-aef9-46ec-bd9f-033eccaf8b5d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:59.078322 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff54d4-aef9-46ec-bd9f-033eccaf8b5d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:59.078612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff54d4-aef9-46ec-bd9f-033eccaf8b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:59.096519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-75ff54d4-aef9-46ec-bd9f-033eccaf8b5d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:59.097718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-75ff54d4-aef9-46ec-bd9f-033eccaf8b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:59.105789 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4165/8415] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:19:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:19:59.109802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abc2bc-4afe-4829-bffc-c12afb61f29d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:59.119444 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abc2bc-4afe-4829-bffc-c12afb61f29d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:59.124638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a8016-fbca-470b-8814-ab159ae364cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:59.125317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a8016-fbca-470b-8814-ab159ae364cd admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:59.125601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a8016-fbca-470b-8814-ab159ae364cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:59.125881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a8016-fbca-470b-8814-ab159ae364cd admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:59.126649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a8016-fbca-470b-8814-ab159ae364cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:19:59.126957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a8016-fbca-470b-8814-ab159ae364cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:59.128541 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a8016-fbca-470b-8814-ab159ae364cd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:59.140455 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4251/8416] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:19:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:19:59.144951 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff54d4-aef9-46ec-bd9f-033eccaf8b5d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:59.154114 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff54d4-aef9-46ec-bd9f-033eccaf8b5d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:59.158780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6605741-0e13-4740-93b6-fba1b2a6ca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:59.159408 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6605741-0e13-4740-93b6-fba1b2a6ca95 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:59.159694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6605741-0e13-4740-93b6-fba1b2a6ca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:59.159972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6605741-0e13-4740-93b6-fba1b2a6ca95 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:59.160668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6605741-0e13-4740-93b6-fba1b2a6ca95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:59.162666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6605741-0e13-4740-93b6-fba1b2a6ca95 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:59.188115 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4166/8417] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:19:59 2021] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:19:59.192585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a8016-fbca-470b-8814-ab159ae364cd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:59.202875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a8016-fbca-470b-8814-ab159ae364cd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:59.255058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa36b6e-597c-4fa0-a7b9-38dbc6b02468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:59.255709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36b6e-597c-4fa0-a7b9-38dbc6b02468 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:59.255985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36b6e-597c-4fa0-a7b9-38dbc6b02468 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:59.256259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36b6e-597c-4fa0-a7b9-38dbc6b02468 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:59.256947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa36b6e-597c-4fa0-a7b9-38dbc6b02468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:59.258876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa36b6e-597c-4fa0-a7b9-38dbc6b02468 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:59.277585 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4252/8418] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:19:59 2021] POST /identity/v3/users => generated 283 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:19:59.281756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6605741-0e13-4740-93b6-fba1b2a6ca95 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:59.292042 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6605741-0e13-4740-93b6-fba1b2a6ca95 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:59.297168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bc3ba-123e-469b-9c21-31efe745b8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:59.297819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bc3ba-123e-469b-9c21-31efe745b8fe admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:59.298109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bc3ba-123e-469b-9c21-31efe745b8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:59.298463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bc3ba-123e-469b-9c21-31efe745b8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:59.299197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bc3ba-123e-469b-9c21-31efe745b8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:59.300773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bc3ba-123e-469b-9c21-31efe745b8fe admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:59.311702 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4167/8419] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:19:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:19:59.315798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa36b6e-597c-4fa0-a7b9-38dbc6b02468 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:59.325566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa36b6e-597c-4fa0-a7b9-38dbc6b02468 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:59.330334 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05ace5-1918-485d-af95-caf570f164a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:59.330972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05ace5-1918-485d-af95-caf570f164a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:59.331260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05ace5-1918-485d-af95-caf570f164a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:59.331530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05ace5-1918-485d-af95-caf570f164a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:59.332549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05ace5-1918-485d-af95-caf570f164a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:59.333803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05ace5-1918-485d-af95-caf570f164a5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:59.343551 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4253/8420] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:19:59 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:19:59.347703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bc3ba-123e-469b-9c21-31efe745b8fe admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:59.358014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bc3ba-123e-469b-9c21-31efe745b8fe admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:59.362680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc54fc4-ed62-4956-8349-416318db37eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:59.363554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc54fc4-ed62-4956-8349-416318db37eb admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:59.363846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc54fc4-ed62-4956-8349-416318db37eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:59.364131 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc54fc4-ed62-4956-8349-416318db37eb admin admin] PATH_INFO: `/v3/projects/2fd45aa886e940deb809bd034a4ff584/users/7b40b53fd4724970b40c970ef8680d22/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:59.378818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc54fc4-ed62-4956-8349-416318db37eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd45aa886e940deb809bd034a4ff584, user_id=7b40b53fd4724970b40c970ef8680d22, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:59.381477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc54fc4-ed62-4956-8349-416318db37eb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:59.393969 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4168/8421] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:19:59 2021] PUT /identity/v3/projects/2fd45aa886e940deb809bd034a4ff584/users/7b40b53fd4724970b40c970ef8680d22/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:19:59.399123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f399651-cbaf-41ac-8ea4-27406dd7bae5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:59.399418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f399651-cbaf-41ac-8ea4-27406dd7bae5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:59.399702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f399651-cbaf-41ac-8ea4-27406dd7bae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:59.417147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5f399651-cbaf-41ac-8ea4-27406dd7bae5 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:19:59.418825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5f399651-cbaf-41ac-8ea4-27406dd7bae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:59.474710 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4254/8422] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:19:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:19:59.484894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc54fc4-ed62-4956-8349-416318db37eb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:19:59.486594 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-dbc54fc4-ed62-4956-8349-416318db37eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:19:59.545315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc54fc4-ed62-4956-8349-416318db37eb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:19:59.548983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e3ccd-1a87-4cf6-9b7a-6434c04468de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:19:59.549652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e3ccd-1a87-4cf6-9b7a-6434c04468de service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:19:59.549941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e3ccd-1a87-4cf6-9b7a-6434c04468de service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:19:59.550219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e3ccd-1a87-4cf6-9b7a-6434c04468de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:19:59.559692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e3ccd-1a87-4cf6-9b7a-6434c04468de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:19:59.561107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e3ccd-1a87-4cf6-9b7a-6434c04468de service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:19:59.570780 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4169/8423] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:19:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:20:04.188515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e51f87-c79b-415f-b358-51035a5c0011 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:04.189010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e51f87-c79b-415f-b358-51035a5c0011 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:04.189121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e51f87-c79b-415f-b358-51035a5c0011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:04.219175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-17e51f87-c79b-415f-b358-51035a5c0011 None None] MFA Rules not processed for user `7b40b53fd4724970b40c970ef8680d22`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:20:04.220380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-17e51f87-c79b-415f-b358-51035a5c0011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:20:04.293571 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4255/8424] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:20:04 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:20:04.298143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e3ccd-1a87-4cf6-9b7a-6434c04468de service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:04.309709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e3ccd-1a87-4cf6-9b7a-6434c04468de service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:04.314876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d429c-d106-4c37-81cf-e2dbc8b1b3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:04.315957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d429c-d106-4c37-81cf-e2dbc8b1b3ef admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:04.316340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d429c-d106-4c37-81cf-e2dbc8b1b3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:04.316847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d429c-d106-4c37-81cf-e2dbc8b1b3ef admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:04.317721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d429c-d106-4c37-81cf-e2dbc8b1b3ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:04.323848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d429c-d106-4c37-81cf-e2dbc8b1b3ef admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:04.351315 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4170/8425] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:20:04 2021] POST /identity/v3/users => generated 287 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:20:04.355463 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e51f87-c79b-415f-b358-51035a5c0011 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:04.366656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e51f87-c79b-415f-b358-51035a5c0011 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:04.371756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf692c7d-8395-44eb-970d-c346661f442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:04.372430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf692c7d-8395-44eb-970d-c346661f442a admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:04.372708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf692c7d-8395-44eb-970d-c346661f442a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:04.372985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf692c7d-8395-44eb-970d-c346661f442a admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:04.373717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf692c7d-8395-44eb-970d-c346661f442a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:04.375578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf692c7d-8395-44eb-970d-c346661f442a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:04.386463 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4256/8426] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:20:04 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:20:04.391242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d429c-d106-4c37-81cf-e2dbc8b1b3ef admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:04.402082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d429c-d106-4c37-81cf-e2dbc8b1b3ef admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:04.408078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245e230-6d40-47fc-a5a4-2f91a110c939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:04.409103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245e230-6d40-47fc-a5a4-2f91a110c939 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:04.409396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245e230-6d40-47fc-a5a4-2f91a110c939 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:04.409675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245e230-6d40-47fc-a5a4-2f91a110c939 admin admin] PATH_INFO: `/v3/system/users/67a576d5122245e9aa90f332a3366ba3/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:04.425677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245e230-6d40-47fc-a5a4-2f91a110c939 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=67a576d5122245e9aa90f332a3366ba3, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:04.427340 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245e230-6d40-47fc-a5a4-2f91a110c939 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:04.437120 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4171/8427] 10.222.0.13 () {60 vars in 1377 bytes} [Sat Dec 18 21:20:04 2021] PUT /identity/v3/system/users/67a576d5122245e9aa90f332a3366ba3/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:20:04.448104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04771c87-f9fa-4467-8b1b-534d1e1cafc2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:04.448706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04771c87-f9fa-4467-8b1b-534d1e1cafc2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:04.449903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04771c87-f9fa-4467-8b1b-534d1e1cafc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:04.490390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-04771c87-f9fa-4467-8b1b-534d1e1cafc2 None None] MFA Rules not processed for user `67a576d5122245e9aa90f332a3366ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:20:04.492271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-04771c87-f9fa-4467-8b1b-534d1e1cafc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:20:04.569781 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4257/8428] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:20:04 2021] POST /identity/v3/auth/tokens => generated 2404 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Dec 18 21:20:04.574742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245e230-6d40-47fc-a5a4-2f91a110c939 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:04.674680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245e230-6d40-47fc-a5a4-2f91a110c939 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:04.716699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe4ddc-fe79-4d95-ab5c-bcd33e27284b None tempest-ImageQuotaTest-248482842-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67a576d5122245e9aa90f332a3366ba3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:04.717638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe4ddc-fe79-4d95-ab5c-bcd33e27284b None tempest-ImageQuotaTest-248482842-system-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:04.718021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe4ddc-fe79-4d95-ab5c-bcd33e27284b None tempest-ImageQuotaTest-248482842-system-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:04.718440 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe4ddc-fe79-4d95-ab5c-bcd33e27284b None tempest-ImageQuotaTest-248482842-system-admin] PATH_INFO: `/v3/services` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:04.719277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe4ddc-fe79-4d95-ab5c-bcd33e27284b None tempest-ImageQuotaTest-248482842-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:04.720941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe4ddc-fe79-4d95-ab5c-bcd33e27284b None tempest-ImageQuotaTest-248482842-system-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:04.730402 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4172/8429] 10.222.0.13 () {58 vars in 1109 bytes} [Sat Dec 18 21:20:04 2021] GET /identity/v3/services => generated 2191 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:20:04.735255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04771c87-f9fa-4467-8b1b-534d1e1cafc2 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:04.861286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04771c87-f9fa-4467-8b1b-534d1e1cafc2 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:04.896169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7a331-d609-4134-9564-87536cad5c8b None tempest-ImageQuotaTest-248482842-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67a576d5122245e9aa90f332a3366ba3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:04.897586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7a331-d609-4134-9564-87536cad5c8b None tempest-ImageQuotaTest-248482842-system-admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:04.897586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7a331-d609-4134-9564-87536cad5c8b None tempest-ImageQuotaTest-248482842-system-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:04.897792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7a331-d609-4134-9564-87536cad5c8b None tempest-ImageQuotaTest-248482842-system-admin] PATH_INFO: `/v3/limits` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:04.898625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7a331-d609-4134-9564-87536cad5c8b None tempest-ImageQuotaTest-248482842-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:04.899818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7a331-d609-4134-9564-87536cad5c8b None tempest-ImageQuotaTest-248482842-system-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:04.932916 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-49f7a331-d609-4134-9564-87536cad5c8b None tempest-ImageQuotaTest-248482842-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Dec 18 21:20:04.938433 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4258/8430] 10.222.0.13 () {60 vars in 1125 bytes} [Sat Dec 18 21:20:04 2021] POST /identity/v3/limits => generated 124 bytes in 204 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Dec 18 21:20:04.945567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe4ddc-fe79-4d95-ab5c-bcd33e27284b None tempest-ImageQuotaTest-248482842-system-admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:05.071021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe4ddc-fe79-4d95-ab5c-bcd33e27284b None tempest-ImageQuotaTest-248482842-system-admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:05.112252 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8eaeb-8685-4bf9-845a-04491689caa5 None tempest-ImageQuotaTest-248482842-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67a576d5122245e9aa90f332a3366ba3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:05.112916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8eaeb-8685-4bf9-845a-04491689caa5 None tempest-ImageQuotaTest-248482842-system-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:05.113254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8eaeb-8685-4bf9-845a-04491689caa5 None tempest-ImageQuotaTest-248482842-system-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:05.113905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8eaeb-8685-4bf9-845a-04491689caa5 None tempest-ImageQuotaTest-248482842-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:05.115059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8eaeb-8685-4bf9-845a-04491689caa5 None tempest-ImageQuotaTest-248482842-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:05.116316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8eaeb-8685-4bf9-845a-04491689caa5 None tempest-ImageQuotaTest-248482842-system-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:05.125391 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4173/8431] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 21:20:04 2021] GET /identity/v3/registered_limits => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:20:05.130512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7a331-d609-4134-9564-87536cad5c8b None tempest-ImageQuotaTest-248482842-system-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:05.241219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7a331-d609-4134-9564-87536cad5c8b None tempest-ImageQuotaTest-248482842-system-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:05.277037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d93ed4-0d69-4df6-b3ca-f480afff2082 None tempest-ImageQuotaTest-248482842-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67a576d5122245e9aa90f332a3366ba3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:05.277729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d93ed4-0d69-4df6-b3ca-f480afff2082 None tempest-ImageQuotaTest-248482842-system-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:05.278006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d93ed4-0d69-4df6-b3ca-f480afff2082 None tempest-ImageQuotaTest-248482842-system-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:05.278424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d93ed4-0d69-4df6-b3ca-f480afff2082 None tempest-ImageQuotaTest-248482842-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:05.278994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d93ed4-0d69-4df6-b3ca-f480afff2082 None tempest-ImageQuotaTest-248482842-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:05.280058 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d93ed4-0d69-4df6-b3ca-f480afff2082 None tempest-ImageQuotaTest-248482842-system-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:05.285474 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4259/8432] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Dec 18 21:20:05 2021] GET /identity/v3/registered_limits => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:20:09.659799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dada39-cfcc-4640-9e8f-38798937b0b7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:09.661176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dada39-cfcc-4640-9e8f-38798937b0b7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:09.665324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dada39-cfcc-4640-9e8f-38798937b0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:09.697854 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-09dada39-cfcc-4640-9e8f-38798937b0b7 None None] MFA Rules not processed for user `577286e40c5a4bf6a56af13d061f2151`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:20:09.702521 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-09dada39-cfcc-4640-9e8f-38798937b0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:20:09.803231 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4174/8433] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:20:09 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:20:10.091583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d93ed4-0d69-4df6-b3ca-f480afff2082 None tempest-ImageQuotaTest-248482842-system-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:10.108324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d93ed4-0d69-4df6-b3ca-f480afff2082 None tempest-ImageQuotaTest-248482842-system-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:10.126007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3c358-8f74-444d-8403-70135c87beb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:10.127154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3c358-8f74-444d-8403-70135c87beb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:10.127473 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3c358-8f74-444d-8403-70135c87beb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:10.127727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3c358-8f74-444d-8403-70135c87beb8 admin admin] PATH_INFO: `/v3/users/7b40b53fd4724970b40c970ef8680d22` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:10.131176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3c358-8f74-444d-8403-70135c87beb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b40b53fd4724970b40c970ef8680d22)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:10.136394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3c358-8f74-444d-8403-70135c87beb8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:10.222523 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9eb3c358-8f74-444d-8403-70135c87beb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b40b53fd4724970b40c970ef8680d22'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:10.226792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dada39-cfcc-4640-9e8f-38798937b0b7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:10.229113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-09dada39-cfcc-4640-9e8f-38798937b0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:20:10.231468 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9eb3c358-8f74-444d-8403-70135c87beb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b40b53fd4724970b40c970ef8680d22'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:10.232229 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9eb3c358-8f74-444d-8403-70135c87beb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b40b53fd4724970b40c970ef8680d22'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:10.245811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dada39-cfcc-4640-9e8f-38798937b0b7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:10.249067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9eb3c358-8f74-444d-8403-70135c87beb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b40b53fd4724970b40c970ef8680d22'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:10.250663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b770b-b897-4fa5-bced-b2e4f3c717a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:10.251734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b770b-b897-4fa5-bced-b2e4f3c717a1 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:10.252037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b770b-b897-4fa5-bced-b2e4f3c717a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:10.252325 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b770b-b897-4fa5-bced-b2e4f3c717a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:10.255321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4c1b770b-b897-4fa5-bced-b2e4f3c717a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:20:10.259952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-9eb3c358-8f74-444d-8403-70135c87beb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b40b53fd4724970b40c970ef8680d22'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:10.268891 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4260/8434] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:20:10 2021] DELETE /identity/v3/users/7b40b53fd4724970b40c970ef8680d22 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:20:10.288253 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b770b-b897-4fa5-bced-b2e4f3c717a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:10.289543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b770b-b897-4fa5-bced-b2e4f3c717a1 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:10.301702 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4175/8435] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:20:10 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:20:10.689826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3c358-8f74-444d-8403-70135c87beb8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:10.691893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9eb3c358-8f74-444d-8403-70135c87beb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:20:10.846356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3c358-8f74-444d-8403-70135c87beb8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:10.852460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:10.853636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:10.854172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:10.854703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b admin admin] PATH_INFO: `/v3/projects/2fd45aa886e940deb809bd034a4ff584` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:10.856260 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd45aa886e940deb809bd034a4ff584)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:10.858985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:10.930279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd45aa886e940deb809bd034a4ff584', 'request_id': 'req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:10.940179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd45aa886e940deb809bd034a4ff584', 'request_id': 'req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:10.957508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd45aa886e940deb809bd034a4ff584', 'request_id': 'req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:10.986800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b admin admin] The token cache is being invalidate because project 2fd45aa886e940deb809bd034a4ff584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:20:10.986800 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:10.987457 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:10.989032 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4261/8436] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:20:10 2021] DELETE /identity/v3/projects/2fd45aa886e940deb809bd034a4ff584 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:20:10.993046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b770b-b897-4fa5-bced-b2e4f3c717a1 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:11.024621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b770b-b897-4fa5-bced-b2e4f3c717a1 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:11.134731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c8025-ceb4-46ca-9e25-1160b5c0e15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:11.135984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c8025-ceb4-46ca-9e25-1160b5c0e15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:11.137127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c8025-ceb4-46ca-9e25-1160b5c0e15f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:11.137616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c8025-ceb4-46ca-9e25-1160b5c0e15f admin admin] PATH_INFO: `/v3/users/67a576d5122245e9aa90f332a3366ba3` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:11.140430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c8025-ceb4-46ca-9e25-1160b5c0e15f admin admin] RBAC: Authorizing `identity:delete_user(user_id=67a576d5122245e9aa90f332a3366ba3)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:11.142709 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c8025-ceb4-46ca-9e25-1160b5c0e15f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:11.249946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-027c8025-ceb4-46ca-9e25-1160b5c0e15f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67a576d5122245e9aa90f332a3366ba3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:11.258986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-027c8025-ceb4-46ca-9e25-1160b5c0e15f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67a576d5122245e9aa90f332a3366ba3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:11.278978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-027c8025-ceb4-46ca-9e25-1160b5c0e15f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67a576d5122245e9aa90f332a3366ba3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:11.279877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-027c8025-ceb4-46ca-9e25-1160b5c0e15f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67a576d5122245e9aa90f332a3366ba3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:11.291571 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-027c8025-ceb4-46ca-9e25-1160b5c0e15f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67a576d5122245e9aa90f332a3366ba3'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:11.321358 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4176/8437] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:20:10 2021] DELETE /identity/v3/users/67a576d5122245e9aa90f332a3366ba3 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:20:11.699515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:11.701152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:20:11.730670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab8ffa-37b2-46cd-be22-d1da906fc10b admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:11.818818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f1e79-020e-4f90-8ed4-a19d04b11612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:11.819988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f1e79-020e-4f90-8ed4-a19d04b11612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:11.820464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f1e79-020e-4f90-8ed4-a19d04b11612 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:11.820958 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f1e79-020e-4f90-8ed4-a19d04b11612 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:11.829383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f1e79-020e-4f90-8ed4-a19d04b11612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:11.831315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f1e79-020e-4f90-8ed4-a19d04b11612 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:11.844699 ncdv-master-1 devstack@keystone.service[96646]: WARNING keystone.server.flask.application [None req-f37f1e79-020e-4f90-8ed4-a19d04b11612 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Dec 18 21:20:11.845926 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4262/8438] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Dec 18 21:20:11 2021] DELETE /identity/v3/projects/None => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 18 21:20:36.152564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c8025-ceb4-46ca-9e25-1160b5c0e15f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:36.154182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-027c8025-ceb4-46ca-9e25-1160b5c0e15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:20:36.167525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c8025-ceb4-46ca-9e25-1160b5c0e15f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:36.172112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9b549-f967-43b3-bf9f-1776dd740da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:36.172977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9b549-f967-43b3-bf9f-1776dd740da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:36.173265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9b549-f967-43b3-bf9f-1776dd740da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:36.173576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9b549-f967-43b3-bf9f-1776dd740da7 admin admin] PATH_INFO: `/v3/users/577286e40c5a4bf6a56af13d061f2151` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:36.174803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9b549-f967-43b3-bf9f-1776dd740da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=577286e40c5a4bf6a56af13d061f2151)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:36.176699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9b549-f967-43b3-bf9f-1776dd740da7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:36.221550 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7bf9b549-f967-43b3-bf9f-1776dd740da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '577286e40c5a4bf6a56af13d061f2151'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:36.228134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7bf9b549-f967-43b3-bf9f-1776dd740da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '577286e40c5a4bf6a56af13d061f2151'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:36.239182 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7bf9b549-f967-43b3-bf9f-1776dd740da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '577286e40c5a4bf6a56af13d061f2151'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:36.239833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7bf9b549-f967-43b3-bf9f-1776dd740da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '577286e40c5a4bf6a56af13d061f2151'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:36.248779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-7bf9b549-f967-43b3-bf9f-1776dd740da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '577286e40c5a4bf6a56af13d061f2151'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:36.255241 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4177/8439] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:20:36 2021] DELETE /identity/v3/users/577286e40c5a4bf6a56af13d061f2151 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:20:36.259754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f209b-4bed-4d24-8dde-c86b2b189b1a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:36.260727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f209b-4bed-4d24-8dde-c86b2b189b1a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:36.260841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f209b-4bed-4d24-8dde-c86b2b189b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:36.278632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0c0f209b-4bed-4d24-8dde-c86b2b189b1a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:20:36.279796 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0c0f209b-4bed-4d24-8dde-c86b2b189b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:20:36.335253 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4263/8440] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:20:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:20:36.345371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9b549-f967-43b3-bf9f-1776dd740da7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:36.346819 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7bf9b549-f967-43b3-bf9f-1776dd740da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:20:36.404354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9b549-f967-43b3-bf9f-1776dd740da7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:36.407950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d59c2-a8af-4ad6-a0a5-ffa05a765a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:36.408593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d59c2-a8af-4ad6-a0a5-ffa05a765a56 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:36.408880 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d59c2-a8af-4ad6-a0a5-ffa05a765a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:36.409159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d59c2-a8af-4ad6-a0a5-ffa05a765a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:36.418117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d59c2-a8af-4ad6-a0a5-ffa05a765a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:36.419575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d59c2-a8af-4ad6-a0a5-ffa05a765a56 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:36.428811 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4178/8441] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:20:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:20:36.601489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f209b-4bed-4d24-8dde-c86b2b189b1a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:36.602973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0c0f209b-4bed-4d24-8dde-c86b2b189b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:20:36.615171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f209b-4bed-4d24-8dde-c86b2b189b1a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:36.620168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e46045-b213-4219-94f5-6eb696a019e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:36.621458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e46045-b213-4219-94f5-6eb696a019e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:36.621458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e46045-b213-4219-94f5-6eb696a019e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:36.621673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e46045-b213-4219-94f5-6eb696a019e8 admin admin] PATH_INFO: `/v3/projects/4fc0be93c7544e6eb79d01c1bf880625` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:36.622755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e46045-b213-4219-94f5-6eb696a019e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc0be93c7544e6eb79d01c1bf880625)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:36.624637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e46045-b213-4219-94f5-6eb696a019e8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:36.669805 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-22e46045-b213-4219-94f5-6eb696a019e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc0be93c7544e6eb79d01c1bf880625', 'request_id': 'req-22e46045-b213-4219-94f5-6eb696a019e8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:36.675843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-22e46045-b213-4219-94f5-6eb696a019e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc0be93c7544e6eb79d01c1bf880625', 'request_id': 'req-22e46045-b213-4219-94f5-6eb696a019e8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:36.683231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-22e46045-b213-4219-94f5-6eb696a019e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc0be93c7544e6eb79d01c1bf880625', 'request_id': 'req-22e46045-b213-4219-94f5-6eb696a019e8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:36.693276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-22e46045-b213-4219-94f5-6eb696a019e8 admin admin] The token cache is being invalidate because project 4fc0be93c7544e6eb79d01c1bf880625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:20:36.693557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-22e46045-b213-4219-94f5-6eb696a019e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:36.694168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-22e46045-b213-4219-94f5-6eb696a019e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:36.695701 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4264/8442] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:20:36 2021] DELETE /identity/v3/projects/4fc0be93c7544e6eb79d01c1bf880625 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:20:36.700443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d59c2-a8af-4ad6-a0a5-ffa05a765a56 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:36.710054 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d59c2-a8af-4ad6-a0a5-ffa05a765a56 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:36.766050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e53391-4a99-4d07-b5ce-6304df9fc74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:36.766848 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e53391-4a99-4d07-b5ce-6304df9fc74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:36.767129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e53391-4a99-4d07-b5ce-6304df9fc74e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:36.767402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e53391-4a99-4d07-b5ce-6304df9fc74e admin admin] PATH_INFO: `/v3/users/6198ccce86e549758387b3473c58a64e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:36.768586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e53391-4a99-4d07-b5ce-6304df9fc74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6198ccce86e549758387b3473c58a64e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:36.770500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e53391-4a99-4d07-b5ce-6304df9fc74e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:36.814358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-71e53391-4a99-4d07-b5ce-6304df9fc74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6198ccce86e549758387b3473c58a64e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:36.821148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-71e53391-4a99-4d07-b5ce-6304df9fc74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6198ccce86e549758387b3473c58a64e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:36.832317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-71e53391-4a99-4d07-b5ce-6304df9fc74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6198ccce86e549758387b3473c58a64e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:36.832990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-71e53391-4a99-4d07-b5ce-6304df9fc74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6198ccce86e549758387b3473c58a64e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:36.840219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-71e53391-4a99-4d07-b5ce-6304df9fc74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6198ccce86e549758387b3473c58a64e'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:36.846029 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4179/8443] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:20:36 2021] DELETE /identity/v3/users/6198ccce86e549758387b3473c58a64e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:20:37.109642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e46045-b213-4219-94f5-6eb696a019e8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:37.111111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-22e46045-b213-4219-94f5-6eb696a019e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:20:37.125848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e46045-b213-4219-94f5-6eb696a019e8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:37.183497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0511b0-4e68-42b3-b43e-a9697469d7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:37.184341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0511b0-4e68-42b3-b43e-a9697469d7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:37.184616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0511b0-4e68-42b3-b43e-a9697469d7af admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:37.184889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0511b0-4e68-42b3-b43e-a9697469d7af admin admin] PATH_INFO: `/v3/projects/776871d5117f4694812ba92d79b5cc03` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:37.186055 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0511b0-4e68-42b3-b43e-a9697469d7af admin admin] RBAC: Authorizing `identity:delete_project(project_id=776871d5117f4694812ba92d79b5cc03)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:37.188131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0511b0-4e68-42b3-b43e-a9697469d7af admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:37.232421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6c0511b0-4e68-42b3-b43e-a9697469d7af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '776871d5117f4694812ba92d79b5cc03', 'request_id': 'req-6c0511b0-4e68-42b3-b43e-a9697469d7af'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:37.238208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6c0511b0-4e68-42b3-b43e-a9697469d7af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '776871d5117f4694812ba92d79b5cc03', 'request_id': 'req-6c0511b0-4e68-42b3-b43e-a9697469d7af'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:37.245096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6c0511b0-4e68-42b3-b43e-a9697469d7af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '776871d5117f4694812ba92d79b5cc03', 'request_id': 'req-6c0511b0-4e68-42b3-b43e-a9697469d7af'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:37.255050 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6c0511b0-4e68-42b3-b43e-a9697469d7af admin admin] The token cache is being invalidate because project 776871d5117f4694812ba92d79b5cc03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:20:37.255338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6c0511b0-4e68-42b3-b43e-a9697469d7af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:37.256052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-6c0511b0-4e68-42b3-b43e-a9697469d7af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:37.257606 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4265/8444] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:20:37 2021] DELETE /identity/v3/projects/776871d5117f4694812ba92d79b5cc03 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:20:37.262286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e53391-4a99-4d07-b5ce-6304df9fc74e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:37.263737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-71e53391-4a99-4d07-b5ce-6304df9fc74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:20:37.276991 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e53391-4a99-4d07-b5ce-6304df9fc74e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:37.329809 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392cafa-1349-4f19-9c5e-6e449a71fe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:37.330627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392cafa-1349-4f19-9c5e-6e449a71fe49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:37.330911 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392cafa-1349-4f19-9c5e-6e449a71fe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:37.331187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392cafa-1349-4f19-9c5e-6e449a71fe49 admin admin] PATH_INFO: `/v3/users/bd8644c0328d426bb1ec81cfe7f801c1` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:37.332361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392cafa-1349-4f19-9c5e-6e449a71fe49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd8644c0328d426bb1ec81cfe7f801c1)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:37.334344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392cafa-1349-4f19-9c5e-6e449a71fe49 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:37.378140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a392cafa-1349-4f19-9c5e-6e449a71fe49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd8644c0328d426bb1ec81cfe7f801c1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:37.384646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a392cafa-1349-4f19-9c5e-6e449a71fe49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd8644c0328d426bb1ec81cfe7f801c1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:37.396090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a392cafa-1349-4f19-9c5e-6e449a71fe49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd8644c0328d426bb1ec81cfe7f801c1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:37.396762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a392cafa-1349-4f19-9c5e-6e449a71fe49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd8644c0328d426bb1ec81cfe7f801c1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:37.404441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-a392cafa-1349-4f19-9c5e-6e449a71fe49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd8644c0328d426bb1ec81cfe7f801c1'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:37.410359 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4180/8445] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:20:37 2021] DELETE /identity/v3/users/bd8644c0328d426bb1ec81cfe7f801c1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:20:37.576036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0511b0-4e68-42b3-b43e-a9697469d7af admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:20:37.577524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6c0511b0-4e68-42b3-b43e-a9697469d7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:20:37.590704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0511b0-4e68-42b3-b43e-a9697469d7af admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:20:37.645836 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371904a-3e52-4c1d-97e1-a22542222b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:20:37.646726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371904a-3e52-4c1d-97e1-a22542222b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:20:37.647015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371904a-3e52-4c1d-97e1-a22542222b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:20:37.647292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371904a-3e52-4c1d-97e1-a22542222b80 admin admin] PATH_INFO: `/v3/projects/3beb09d4bfb94a468517eba8c3a9289e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:20:37.648480 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371904a-3e52-4c1d-97e1-a22542222b80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3beb09d4bfb94a468517eba8c3a9289e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:20:37.650401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371904a-3e52-4c1d-97e1-a22542222b80 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:20:37.695429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8371904a-3e52-4c1d-97e1-a22542222b80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3beb09d4bfb94a468517eba8c3a9289e', 'request_id': 'req-8371904a-3e52-4c1d-97e1-a22542222b80'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:37.701956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8371904a-3e52-4c1d-97e1-a22542222b80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3beb09d4bfb94a468517eba8c3a9289e', 'request_id': 'req-8371904a-3e52-4c1d-97e1-a22542222b80'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:37.708915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8371904a-3e52-4c1d-97e1-a22542222b80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3beb09d4bfb94a468517eba8c3a9289e', 'request_id': 'req-8371904a-3e52-4c1d-97e1-a22542222b80'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:37.719779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8371904a-3e52-4c1d-97e1-a22542222b80 admin admin] The token cache is being invalidate because project 3beb09d4bfb94a468517eba8c3a9289e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:20:37.720066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8371904a-3e52-4c1d-97e1-a22542222b80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:37.720714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8371904a-3e52-4c1d-97e1-a22542222b80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:20:37.722272 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4266/8446] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:20:37 2021] DELETE /identity/v3/projects/3beb09d4bfb94a468517eba8c3a9289e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:21:41.971929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392cafa-1349-4f19-9c5e-6e449a71fe49 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:41.973398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a392cafa-1349-4f19-9c5e-6e449a71fe49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:41.988039 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392cafa-1349-4f19-9c5e-6e449a71fe49 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:42.043529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e472aa-7227-4f82-ab4a-ec59839d20e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:42.044407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e472aa-7227-4f82-ab4a-ec59839d20e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:42.044707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e472aa-7227-4f82-ab4a-ec59839d20e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:42.044989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e472aa-7227-4f82-ab4a-ec59839d20e6 admin admin] PATH_INFO: `/v3/users/84883df65dac439a8c1e454b7ad570e2` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:42.046197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e472aa-7227-4f82-ab4a-ec59839d20e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84883df65dac439a8c1e454b7ad570e2)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:42.048276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e472aa-7227-4f82-ab4a-ec59839d20e6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:42.093540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f8e472aa-7227-4f82-ab4a-ec59839d20e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84883df65dac439a8c1e454b7ad570e2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:42.100553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f8e472aa-7227-4f82-ab4a-ec59839d20e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84883df65dac439a8c1e454b7ad570e2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:42.111718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f8e472aa-7227-4f82-ab4a-ec59839d20e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84883df65dac439a8c1e454b7ad570e2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:42.112460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f8e472aa-7227-4f82-ab4a-ec59839d20e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84883df65dac439a8c1e454b7ad570e2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:42.119132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-f8e472aa-7227-4f82-ab4a-ec59839d20e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84883df65dac439a8c1e454b7ad570e2'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:42.125382 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4181/8447] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:21:41 2021] DELETE /identity/v3/users/84883df65dac439a8c1e454b7ad570e2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:21:42.291543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371904a-3e52-4c1d-97e1-a22542222b80 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:42.293243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8371904a-3e52-4c1d-97e1-a22542222b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:42.307987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371904a-3e52-4c1d-97e1-a22542222b80 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:42.363298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2e1e1-80fb-4f88-a48f-f0ce58ad907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:42.364147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e1e1-80fb-4f88-a48f-f0ce58ad907e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:42.364432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e1e1-80fb-4f88-a48f-f0ce58ad907e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:42.364709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e1e1-80fb-4f88-a48f-f0ce58ad907e admin admin] PATH_INFO: `/v3/projects/c2d14b131ac74307b9aa94aded5f3f5e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:42.365922 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2e1e1-80fb-4f88-a48f-f0ce58ad907e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d14b131ac74307b9aa94aded5f3f5e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:42.367866 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2e1e1-80fb-4f88-a48f-f0ce58ad907e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:42.411352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-eaa2e1e1-80fb-4f88-a48f-f0ce58ad907e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d14b131ac74307b9aa94aded5f3f5e', 'request_id': 'req-eaa2e1e1-80fb-4f88-a48f-f0ce58ad907e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:42.417759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-eaa2e1e1-80fb-4f88-a48f-f0ce58ad907e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d14b131ac74307b9aa94aded5f3f5e', 'request_id': 'req-eaa2e1e1-80fb-4f88-a48f-f0ce58ad907e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:42.424543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-eaa2e1e1-80fb-4f88-a48f-f0ce58ad907e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d14b131ac74307b9aa94aded5f3f5e', 'request_id': 'req-eaa2e1e1-80fb-4f88-a48f-f0ce58ad907e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:42.434763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-eaa2e1e1-80fb-4f88-a48f-f0ce58ad907e admin admin] The token cache is being invalidate because project c2d14b131ac74307b9aa94aded5f3f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:21:42.435043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-eaa2e1e1-80fb-4f88-a48f-f0ce58ad907e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:42.435651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-eaa2e1e1-80fb-4f88-a48f-f0ce58ad907e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:42.437119 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4267/8448] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:21:42 2021] DELETE /identity/v3/projects/c2d14b131ac74307b9aa94aded5f3f5e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:21:42.443045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b46148-6504-440e-82ee-74b75e68ac59 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:42.443341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b46148-6504-440e-82ee-74b75e68ac59 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:42.443624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b46148-6504-440e-82ee-74b75e68ac59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:42.460566 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-88b46148-6504-440e-82ee-74b75e68ac59 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:21:42.461771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-88b46148-6504-440e-82ee-74b75e68ac59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:42.517484 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4182/8449] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:21:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:21:42.524900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf61aa3-5c38-4c0a-9b5c-19348576d325 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:42.525279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf61aa3-5c38-4c0a-9b5c-19348576d325 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:42.525621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf61aa3-5c38-4c0a-9b5c-19348576d325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:42.543779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4cf61aa3-5c38-4c0a-9b5c-19348576d325 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:21:42.544952 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4cf61aa3-5c38-4c0a-9b5c-19348576d325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:42.552774 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4268/8450] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:21:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:21:42.557433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b46148-6504-440e-82ee-74b75e68ac59 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:42.567090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b46148-6504-440e-82ee-74b75e68ac59 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:42.571634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cfae9-e9cb-4122-b179-f6a4aabb0dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:42.572305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cfae9-e9cb-4122-b179-f6a4aabb0dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:42.572592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cfae9-e9cb-4122-b179-f6a4aabb0dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:42.572868 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cfae9-e9cb-4122-b179-f6a4aabb0dc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:42.573596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575cfae9-e9cb-4122-b179-f6a4aabb0dc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:21:42.573898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575cfae9-e9cb-4122-b179-f6a4aabb0dc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:42.575502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575cfae9-e9cb-4122-b179-f6a4aabb0dc8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:42.586638 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4183/8451] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:21:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:21:42.590699 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf61aa3-5c38-4c0a-9b5c-19348576d325 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:42.599648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf61aa3-5c38-4c0a-9b5c-19348576d325 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:42.604706 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137c5f1-5ff2-469d-9604-bf7a8e2c2dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:42.605359 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137c5f1-5ff2-469d-9604-bf7a8e2c2dbd admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:42.605638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137c5f1-5ff2-469d-9604-bf7a8e2c2dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:42.605912 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137c5f1-5ff2-469d-9604-bf7a8e2c2dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:42.606638 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137c5f1-5ff2-469d-9604-bf7a8e2c2dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:42.608500 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137c5f1-5ff2-469d-9604-bf7a8e2c2dbd admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:42.632718 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4269/8452] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:21:42 2021] POST /identity/v3/projects => generated 399 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:21:42.636603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cfae9-e9cb-4122-b179-f6a4aabb0dc8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:42.646301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cfae9-e9cb-4122-b179-f6a4aabb0dc8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:42.700430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527bbac-e43d-4396-9556-35868565c1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:42.701111 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527bbac-e43d-4396-9556-35868565c1bb admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:42.701396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527bbac-e43d-4396-9556-35868565c1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:42.701698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527bbac-e43d-4396-9556-35868565c1bb admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:42.702443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527bbac-e43d-4396-9556-35868565c1bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:42.704389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527bbac-e43d-4396-9556-35868565c1bb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:42.724965 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4184/8453] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:21:42 2021] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:21:42.729676 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137c5f1-5ff2-469d-9604-bf7a8e2c2dbd admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:42.740225 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137c5f1-5ff2-469d-9604-bf7a8e2c2dbd admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:42.744851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384f5ca-9000-485f-a717-9cadd828d288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:42.745501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384f5ca-9000-485f-a717-9cadd828d288 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:42.745786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384f5ca-9000-485f-a717-9cadd828d288 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:42.746063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384f5ca-9000-485f-a717-9cadd828d288 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:42.746826 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384f5ca-9000-485f-a717-9cadd828d288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:42.748419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384f5ca-9000-485f-a717-9cadd828d288 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:42.758957 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4270/8454] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:21:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:21:42.762821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527bbac-e43d-4396-9556-35868565c1bb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:42.772577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527bbac-e43d-4396-9556-35868565c1bb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:42.777570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1a419-c781-453e-9cfb-869c5aaa2886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:42.778220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1a419-c781-453e-9cfb-869c5aaa2886 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:42.778544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1a419-c781-453e-9cfb-869c5aaa2886 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:42.778821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1a419-c781-453e-9cfb-869c5aaa2886 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:42.779547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1a419-c781-453e-9cfb-869c5aaa2886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:42.781113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1a419-c781-453e-9cfb-869c5aaa2886 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:42.790798 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4185/8455] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:21:42 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:21:42.795750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384f5ca-9000-485f-a717-9cadd828d288 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:42.805661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384f5ca-9000-485f-a717-9cadd828d288 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:42.810192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456282ba-0c36-498f-a453-f3a15ade5862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:42.811085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456282ba-0c36-498f-a453-f3a15ade5862 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:42.811355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456282ba-0c36-498f-a453-f3a15ade5862 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:42.811682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456282ba-0c36-498f-a453-f3a15ade5862 admin admin] PATH_INFO: `/v3/projects/f2d587b9df89484f91c65e226aed736e/users/0393506d7e8140b2aa49a1d0508a617a/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:42.826042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456282ba-0c36-498f-a453-f3a15ade5862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d587b9df89484f91c65e226aed736e, user_id=0393506d7e8140b2aa49a1d0508a617a, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:42.829472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456282ba-0c36-498f-a453-f3a15ade5862 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:42.842721 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4271/8456] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:21:42 2021] PUT /identity/v3/projects/f2d587b9df89484f91c65e226aed736e/users/0393506d7e8140b2aa49a1d0508a617a/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:21:42.852579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba878dd0-8b07-4c6f-9432-6cd517cd46d6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:42.852869 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba878dd0-8b07-4c6f-9432-6cd517cd46d6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:42.853139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba878dd0-8b07-4c6f-9432-6cd517cd46d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:42.879817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ba878dd0-8b07-4c6f-9432-6cd517cd46d6 None None] MFA Rules not processed for user `0393506d7e8140b2aa49a1d0508a617a`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:21:42.880958 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ba878dd0-8b07-4c6f-9432-6cd517cd46d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:42.944298 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4186/8457] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:21:42 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:21:42.954990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456282ba-0c36-498f-a453-f3a15ade5862 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:42.956659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-456282ba-0c36-498f-a453-f3a15ade5862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:43.014141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456282ba-0c36-498f-a453-f3a15ade5862 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:43.017763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c41a4-74dc-4ef2-b776-ccba753e2a45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bd53b4d64643d28ac7f4ea0ea45f90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:43.018419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c41a4-74dc-4ef2-b776-ccba753e2a45 service cinder] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:43.018702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c41a4-74dc-4ef2-b776-ccba753e2a45 service cinder] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:43.019049 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c41a4-74dc-4ef2-b776-ccba753e2a45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:43.027709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c41a4-74dc-4ef2-b776-ccba753e2a45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:43.029060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c41a4-74dc-4ef2-b776-ccba753e2a45 service cinder] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:43.037581 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4272/8458] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:21:42 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:21:47.926559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba878dd0-8b07-4c6f-9432-6cd517cd46d6 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:47.987345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba878dd0-8b07-4c6f-9432-6cd517cd46d6 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:47.991988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7736b-c99f-4642-bf52-9b6fad8680ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:47.993077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7736b-c99f-4642-bf52-9b6fad8680ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:47.993753 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7736b-c99f-4642-bf52-9b6fad8680ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:47.994034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7736b-c99f-4642-bf52-9b6fad8680ab admin admin] PATH_INFO: `/v3/users/0393506d7e8140b2aa49a1d0508a617a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:47.995771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7736b-c99f-4642-bf52-9b6fad8680ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=0393506d7e8140b2aa49a1d0508a617a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:47.997655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7736b-c99f-4642-bf52-9b6fad8680ab admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:48.042504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b2f7736b-c99f-4642-bf52-9b6fad8680ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0393506d7e8140b2aa49a1d0508a617a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:48.049011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b2f7736b-c99f-4642-bf52-9b6fad8680ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0393506d7e8140b2aa49a1d0508a617a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:48.060602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b2f7736b-c99f-4642-bf52-9b6fad8680ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0393506d7e8140b2aa49a1d0508a617a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:48.061267 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b2f7736b-c99f-4642-bf52-9b6fad8680ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0393506d7e8140b2aa49a1d0508a617a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:48.068547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-b2f7736b-c99f-4642-bf52-9b6fad8680ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0393506d7e8140b2aa49a1d0508a617a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:48.074827 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4187/8459] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:21:47 2021] DELETE /identity/v3/users/0393506d7e8140b2aa49a1d0508a617a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:21:48.079472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa00dfe-69ce-419f-ba41-78090f12200d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:48.079968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa00dfe-69ce-419f-ba41-78090f12200d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:48.080067 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa00dfe-69ce-419f-ba41-78090f12200d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:48.097425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3fa00dfe-69ce-419f-ba41-78090f12200d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:21:48.098633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3fa00dfe-69ce-419f-ba41-78090f12200d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:48.154065 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4273/8460] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:21:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:21:48.163820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7736b-c99f-4642-bf52-9b6fad8680ab admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:48.165240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b2f7736b-c99f-4642-bf52-9b6fad8680ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:48.225175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7736b-c99f-4642-bf52-9b6fad8680ab admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:48.228833 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9a76a-3668-4e67-b5e3-6595f56931b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:48.229469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9a76a-3668-4e67-b5e3-6595f56931b4 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:48.229761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9a76a-3668-4e67-b5e3-6595f56931b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:48.230022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9a76a-3668-4e67-b5e3-6595f56931b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:48.238862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9a76a-3668-4e67-b5e3-6595f56931b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:48.240203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9a76a-3668-4e67-b5e3-6595f56931b4 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:48.249787 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4188/8461] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:21:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:21:48.511001 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa00dfe-69ce-419f-ba41-78090f12200d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:48.512398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3fa00dfe-69ce-419f-ba41-78090f12200d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:48.524599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa00dfe-69ce-419f-ba41-78090f12200d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:48.529252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2e5aa-1df9-49df-847d-dd467172dfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:48.530099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2e5aa-1df9-49df-847d-dd467172dfb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:48.530417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2e5aa-1df9-49df-847d-dd467172dfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:48.530824 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2e5aa-1df9-49df-847d-dd467172dfb6 admin admin] PATH_INFO: `/v3/projects/f2d587b9df89484f91c65e226aed736e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:48.532009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2e5aa-1df9-49df-847d-dd467172dfb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d587b9df89484f91c65e226aed736e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:48.533900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2e5aa-1df9-49df-847d-dd467172dfb6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:48.580843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e9b2e5aa-1df9-49df-847d-dd467172dfb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d587b9df89484f91c65e226aed736e', 'request_id': 'req-e9b2e5aa-1df9-49df-847d-dd467172dfb6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:48.586764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e9b2e5aa-1df9-49df-847d-dd467172dfb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d587b9df89484f91c65e226aed736e', 'request_id': 'req-e9b2e5aa-1df9-49df-847d-dd467172dfb6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:48.593727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e9b2e5aa-1df9-49df-847d-dd467172dfb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d587b9df89484f91c65e226aed736e', 'request_id': 'req-e9b2e5aa-1df9-49df-847d-dd467172dfb6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:48.603397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e9b2e5aa-1df9-49df-847d-dd467172dfb6 admin admin] The token cache is being invalidate because project f2d587b9df89484f91c65e226aed736e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:21:48.603681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e9b2e5aa-1df9-49df-847d-dd467172dfb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:48.604797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-e9b2e5aa-1df9-49df-847d-dd467172dfb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:21:48.606316 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4274/8462] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:21:48 2021] DELETE /identity/v3/projects/f2d587b9df89484f91c65e226aed736e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:21:48.612008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29203fa-f799-4efc-8a57-9be265884569 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:48.612324 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29203fa-f799-4efc-8a57-9be265884569 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:48.612609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29203fa-f799-4efc-8a57-9be265884569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:48.630814 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c29203fa-f799-4efc-8a57-9be265884569 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:21:48.632012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c29203fa-f799-4efc-8a57-9be265884569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:48.689604 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4189/8463] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:21:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:21:48.698758 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45278f-240c-49b8-9660-17f38d359eb2 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:48.699047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45278f-240c-49b8-9660-17f38d359eb2 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:48.699327 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45278f-240c-49b8-9660-17f38d359eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:48.717565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2f45278f-240c-49b8-9660-17f38d359eb2 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:21:48.718790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2f45278f-240c-49b8-9660-17f38d359eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:48.726539 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4275/8464] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:21:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:21:48.731292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29203fa-f799-4efc-8a57-9be265884569 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:48.741096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29203fa-f799-4efc-8a57-9be265884569 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:48.745703 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936951ee-cfd3-41c3-89fa-9b7dd6bd6f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:48.746394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936951ee-cfd3-41c3-89fa-9b7dd6bd6f88 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:48.746684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936951ee-cfd3-41c3-89fa-9b7dd6bd6f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:48.746965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936951ee-cfd3-41c3-89fa-9b7dd6bd6f88 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:48.747839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936951ee-cfd3-41c3-89fa-9b7dd6bd6f88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:21:48.748152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936951ee-cfd3-41c3-89fa-9b7dd6bd6f88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:48.749756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936951ee-cfd3-41c3-89fa-9b7dd6bd6f88 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:48.761199 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4190/8465] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:21:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:21:48.765287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45278f-240c-49b8-9660-17f38d359eb2 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:48.774365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45278f-240c-49b8-9660-17f38d359eb2 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:48.779446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a84b3-3410-4d50-b0e7-b3066ab2b875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:48.780075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a84b3-3410-4d50-b0e7-b3066ab2b875 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:48.780373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a84b3-3410-4d50-b0e7-b3066ab2b875 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:48.780629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a84b3-3410-4d50-b0e7-b3066ab2b875 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:48.781342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a84b3-3410-4d50-b0e7-b3066ab2b875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:48.783245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a84b3-3410-4d50-b0e7-b3066ab2b875 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:48.807920 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4276/8466] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:21:48 2021] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:21:48.812010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936951ee-cfd3-41c3-89fa-9b7dd6bd6f88 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:48.822040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936951ee-cfd3-41c3-89fa-9b7dd6bd6f88 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:48.877336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468de24b-de8a-4486-a142-c27eb3530da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:48.877999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468de24b-de8a-4486-a142-c27eb3530da3 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:48.878317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468de24b-de8a-4486-a142-c27eb3530da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:48.878601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468de24b-de8a-4486-a142-c27eb3530da3 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:48.879337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468de24b-de8a-4486-a142-c27eb3530da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:48.881283 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468de24b-de8a-4486-a142-c27eb3530da3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:48.899971 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4191/8467] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:21:48 2021] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:21:48.904902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a84b3-3410-4d50-b0e7-b3066ab2b875 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:48.915005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a84b3-3410-4d50-b0e7-b3066ab2b875 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:48.920435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bebce-978e-4dfc-a16d-ff0cda4d0584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:48.921086 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bebce-978e-4dfc-a16d-ff0cda4d0584 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:48.921366 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bebce-978e-4dfc-a16d-ff0cda4d0584 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:48.921641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bebce-978e-4dfc-a16d-ff0cda4d0584 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:48.922404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bebce-978e-4dfc-a16d-ff0cda4d0584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:48.923969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bebce-978e-4dfc-a16d-ff0cda4d0584 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:48.935094 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4277/8468] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:21:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:21:48.938984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468de24b-de8a-4486-a142-c27eb3530da3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:48.949082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468de24b-de8a-4486-a142-c27eb3530da3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:48.954372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9af72-f7ee-4170-8332-adc555c125c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:48.955059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9af72-f7ee-4170-8332-adc555c125c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:48.955349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9af72-f7ee-4170-8332-adc555c125c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:48.955634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9af72-f7ee-4170-8332-adc555c125c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:48.956366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9af72-f7ee-4170-8332-adc555c125c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:48.957977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9af72-f7ee-4170-8332-adc555c125c8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:48.968247 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4192/8469] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:21:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:21:48.972160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bebce-978e-4dfc-a16d-ff0cda4d0584 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:48.982515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bebce-978e-4dfc-a16d-ff0cda4d0584 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:48.987164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a335ae4-5d67-477e-a880-7f3cfc712738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:48.988029 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a335ae4-5d67-477e-a880-7f3cfc712738 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:48.988314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a335ae4-5d67-477e-a880-7f3cfc712738 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:48.988595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a335ae4-5d67-477e-a880-7f3cfc712738 admin admin] PATH_INFO: `/v3/projects/12ebb2d131744779969f033e54696e15/users/9373fe72d79041f8afc18454e442e9ea/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:49.003522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a335ae4-5d67-477e-a880-7f3cfc712738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ebb2d131744779969f033e54696e15, user_id=9373fe72d79041f8afc18454e442e9ea, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:49.006133 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a335ae4-5d67-477e-a880-7f3cfc712738 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:49.018791 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4278/8470] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:21:48 2021] PUT /identity/v3/projects/12ebb2d131744779969f033e54696e15/users/9373fe72d79041f8afc18454e442e9ea/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:21:49.029184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c256f2b-52a8-430d-a272-7027a08febb8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:49.029505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c256f2b-52a8-430d-a272-7027a08febb8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:49.029793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c256f2b-52a8-430d-a272-7027a08febb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:49.056733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1c256f2b-52a8-430d-a272-7027a08febb8 None None] MFA Rules not processed for user `9373fe72d79041f8afc18454e442e9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:21:49.058085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1c256f2b-52a8-430d-a272-7027a08febb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:49.119799 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4193/8471] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:21:49 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:21:49.124232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a335ae4-5d67-477e-a880-7f3cfc712738 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:49.182344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a335ae4-5d67-477e-a880-7f3cfc712738 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:49.187042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ad5b9-3472-4632-b868-6c1f64e3ed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:49.187696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ad5b9-3472-4632-b868-6c1f64e3ed87 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:49.187979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ad5b9-3472-4632-b868-6c1f64e3ed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:49.188259 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ad5b9-3472-4632-b868-6c1f64e3ed87 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:49.188955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ad5b9-3472-4632-b868-6c1f64e3ed87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:49.191161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ad5b9-3472-4632-b868-6c1f64e3ed87 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:49.217369 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4279/8472] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:21:49 2021] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:21:49.221470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c256f2b-52a8-430d-a272-7027a08febb8 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:49.232608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c256f2b-52a8-430d-a272-7027a08febb8 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:49.286605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee47be-10fe-4937-b328-dcfbe1373ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:49.287204 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee47be-10fe-4937-b328-dcfbe1373ecc admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:49.287493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee47be-10fe-4937-b328-dcfbe1373ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:49.287788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee47be-10fe-4937-b328-dcfbe1373ecc admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:49.288466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee47be-10fe-4937-b328-dcfbe1373ecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:49.290383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee47be-10fe-4937-b328-dcfbe1373ecc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:49.309230 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4194/8473] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:21:49 2021] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:21:49.313192 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ad5b9-3472-4632-b868-6c1f64e3ed87 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:49.324298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ad5b9-3472-4632-b868-6c1f64e3ed87 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:49.329351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71f3d0-25fa-4167-a89c-209b62492229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:49.329990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71f3d0-25fa-4167-a89c-209b62492229 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:49.330284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71f3d0-25fa-4167-a89c-209b62492229 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:49.330568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71f3d0-25fa-4167-a89c-209b62492229 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:49.331284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71f3d0-25fa-4167-a89c-209b62492229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:49.332844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71f3d0-25fa-4167-a89c-209b62492229 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:49.344008 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4280/8474] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:21:49 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:21:49.348199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee47be-10fe-4937-b328-dcfbe1373ecc admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:49.358285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee47be-10fe-4937-b328-dcfbe1373ecc admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:49.362921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64048f72-f42d-419d-9d9d-9963d02a896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:49.363835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64048f72-f42d-419d-9d9d-9963d02a896c admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:49.364120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64048f72-f42d-419d-9d9d-9963d02a896c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:49.364397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64048f72-f42d-419d-9d9d-9963d02a896c admin admin] PATH_INFO: `/v3/projects/ac351031272f470c9420674273326e76/users/3c186b1fc74d4602aa473bb6bc3f18ea/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:49.379530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64048f72-f42d-419d-9d9d-9963d02a896c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac351031272f470c9420674273326e76, user_id=3c186b1fc74d4602aa473bb6bc3f18ea, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:49.382159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64048f72-f42d-419d-9d9d-9963d02a896c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:49.396638 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4195/8475] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:21:49 2021] PUT /identity/v3/projects/ac351031272f470c9420674273326e76/users/3c186b1fc74d4602aa473bb6bc3f18ea/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:21:49.400711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71f3d0-25fa-4167-a89c-209b62492229 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:49.411344 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71f3d0-25fa-4167-a89c-209b62492229 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:49.465198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c965e-f315-4138-98f4-6bfa5c344f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:49.465853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c965e-f315-4138-98f4-6bfa5c344f24 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:49.466138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c965e-f315-4138-98f4-6bfa5c344f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:49.466450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c965e-f315-4138-98f4-6bfa5c344f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:49.467175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c965e-f315-4138-98f4-6bfa5c344f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:49.468756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c965e-f315-4138-98f4-6bfa5c344f24 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:49.478479 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4281/8476] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:21:49 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:21:49.482764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64048f72-f42d-419d-9d9d-9963d02a896c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:49.492757 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64048f72-f42d-419d-9d9d-9963d02a896c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:49.497845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad14c7-709f-4c63-8184-382ec3fce8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:49.498744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad14c7-709f-4c63-8184-382ec3fce8a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:49.499028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad14c7-709f-4c63-8184-382ec3fce8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:49.499422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad14c7-709f-4c63-8184-382ec3fce8a4 admin admin] PATH_INFO: `/v3/projects/ac351031272f470c9420674273326e76/users/3c186b1fc74d4602aa473bb6bc3f18ea/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:49.501498 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad14c7-709f-4c63-8184-382ec3fce8a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac351031272f470c9420674273326e76, user_id=3c186b1fc74d4602aa473bb6bc3f18ea, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:49.504120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad14c7-709f-4c63-8184-382ec3fce8a4 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:49.514873 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4196/8477] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:21:49 2021] PUT /identity/v3/projects/ac351031272f470c9420674273326e76/users/3c186b1fc74d4602aa473bb6bc3f18ea/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:21:49.524891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744608d6-80b3-4bb5-b4ce-8c24e45a7b42 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:49.525176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744608d6-80b3-4bb5-b4ce-8c24e45a7b42 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:49.526231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744608d6-80b3-4bb5-b4ce-8c24e45a7b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:49.553030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-744608d6-80b3-4bb5-b4ce-8c24e45a7b42 None None] MFA Rules not processed for user `3c186b1fc74d4602aa473bb6bc3f18ea`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:21:49.554243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-744608d6-80b3-4bb5-b4ce-8c24e45a7b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:49.622716 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4282/8478] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:21:49 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:21:49.633458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad14c7-709f-4c63-8184-382ec3fce8a4 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:49.635317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-53ad14c7-709f-4c63-8184-382ec3fce8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:49.701952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad14c7-709f-4c63-8184-382ec3fce8a4 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:49.705729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07989f-17d8-4777-af6f-1743b01a3985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:49.706425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07989f-17d8-4777-af6f-1743b01a3985 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:49.706719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07989f-17d8-4777-af6f-1743b01a3985 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:49.707004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07989f-17d8-4777-af6f-1743b01a3985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:49.764065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07989f-17d8-4777-af6f-1743b01a3985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:49.765542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07989f-17d8-4777-af6f-1743b01a3985 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:49.774328 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4197/8479] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:21:49 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:21:51.831132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744608d6-80b3-4bb5-b4ce-8c24e45a7b42 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:51.832585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-744608d6-80b3-4bb5-b4ce-8c24e45a7b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:51.847512 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744608d6-80b3-4bb5-b4ce-8c24e45a7b42 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:51.851351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9f8d0-fb38-43bb-aa59-b21c70120075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:51.852077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9f8d0-fb38-43bb-aa59-b21c70120075 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:51.852365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9f8d0-fb38-43bb-aa59-b21c70120075 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:51.852645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9f8d0-fb38-43bb-aa59-b21c70120075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:51.863518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9f8d0-fb38-43bb-aa59-b21c70120075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:51.865042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9f8d0-fb38-43bb-aa59-b21c70120075 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:51.874378 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4283/8480] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:21:51 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:21:57.588783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7094bc4-2989-497a-97dc-bfe8e0fb75fa None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:57.589385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7094bc4-2989-497a-97dc-bfe8e0fb75fa None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:57.589385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7094bc4-2989-497a-97dc-bfe8e0fb75fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:57.607953 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e7094bc4-2989-497a-97dc-bfe8e0fb75fa None None] MFA Rules not processed for user `9373fe72d79041f8afc18454e442e9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:21:57.609173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e7094bc4-2989-497a-97dc-bfe8e0fb75fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:57.617041 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4198/8481] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:21:57 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:21:57.653946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9f8d0-fb38-43bb-aa59-b21c70120075 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:57.655395 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-83b9f8d0-fb38-43bb-aa59-b21c70120075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:57.716883 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9f8d0-fb38-43bb-aa59-b21c70120075 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:57.720718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01617798-8f84-4bd1-b1f0-40158c3b2c0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:57.721369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01617798-8f84-4bd1-b1f0-40158c3b2c0b service glance] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:57.721653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01617798-8f84-4bd1-b1f0-40158c3b2c0b service glance] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:57.721932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01617798-8f84-4bd1-b1f0-40158c3b2c0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:57.723736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-01617798-8f84-4bd1-b1f0-40158c3b2c0b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:57.797902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01617798-8f84-4bd1-b1f0-40158c3b2c0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:57.799411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01617798-8f84-4bd1-b1f0-40158c3b2c0b service glance] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:57.813562 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4284/8482] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:21:57 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:21:58.417332 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7094bc4-2989-497a-97dc-bfe8e0fb75fa None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:21:58.429456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7094bc4-2989-497a-97dc-bfe8e0fb75fa None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:21:58.433759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c042c-b043-4552-a22d-b2aa65f2a16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:21:58.434429 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c042c-b043-4552-a22d-b2aa65f2a16b service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:21:58.434721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c042c-b043-4552-a22d-b2aa65f2a16b service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:21:58.435002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c042c-b043-4552-a22d-b2aa65f2a16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:21:58.436815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6a1c042c-b043-4552-a22d-b2aa65f2a16b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:21:58.455281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c042c-b043-4552-a22d-b2aa65f2a16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:21:58.456742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c042c-b043-4552-a22d-b2aa65f2a16b service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:21:58.470830 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4199/8483] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:21:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:22:44.560733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01617798-8f84-4bd1-b1f0-40158c3b2c0b service glance] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:22:44.573636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01617798-8f84-4bd1-b1f0-40158c3b2c0b service glance] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:22:44.579127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e38118-6003-44d9-86d2-cd120652a1a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:22:44.580100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e38118-6003-44d9-86d2-cd120652a1a5 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:22:44.580390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e38118-6003-44d9-86d2-cd120652a1a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:22:44.580675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e38118-6003-44d9-86d2-cd120652a1a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:22:44.582484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-63e38118-6003-44d9-86d2-cd120652a1a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:22:44.595252 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e38118-6003-44d9-86d2-cd120652a1a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:22:44.596670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e38118-6003-44d9-86d2-cd120652a1a5 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:22:44.606731 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4285/8484] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:22:44 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:22:48.470605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dda3b-f5fb-49b8-a9e9-a91d54d22f05 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:22:48.470605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dda3b-f5fb-49b8-a9e9-a91d54d22f05 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:22:48.471258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dda3b-f5fb-49b8-a9e9-a91d54d22f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:22:48.489506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-033dda3b-f5fb-49b8-a9e9-a91d54d22f05 None None] MFA Rules not processed for user `9373fe72d79041f8afc18454e442e9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:22:48.491064 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-033dda3b-f5fb-49b8-a9e9-a91d54d22f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:22:48.498678 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4200/8485] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:22:48 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:22:55.683693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e38118-6003-44d9-86d2-cd120652a1a5 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:22:55.688269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-63e38118-6003-44d9-86d2-cd120652a1a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:22:55.725085 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e38118-6003-44d9-86d2-cd120652a1a5 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:22:55.732367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4bd46-6055-4553-b370-3279fa6f79b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:22:55.733138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4bd46-6055-4553-b370-3279fa6f79b1 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:22:55.733483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4bd46-6055-4553-b370-3279fa6f79b1 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:22:55.733823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4bd46-6055-4553-b370-3279fa6f79b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:22:55.741293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-21d4bd46-6055-4553-b370-3279fa6f79b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:22:55.763418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4bd46-6055-4553-b370-3279fa6f79b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:22:55.765185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4bd46-6055-4553-b370-3279fa6f79b1 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:22:55.781754 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4286/8486] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:22:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:23:48.329147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f38a7-2d7b-46ce-a7c9-03d68210427f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:23:48.329704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f38a7-2d7b-46ce-a7c9-03d68210427f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:23:48.329704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f38a7-2d7b-46ce-a7c9-03d68210427f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:23:48.347373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-af7f38a7-2d7b-46ce-a7c9-03d68210427f None None] MFA Rules not processed for user `9373fe72d79041f8afc18454e442e9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:23:48.348480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-af7f38a7-2d7b-46ce-a7c9-03d68210427f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:23:48.356001 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4201/8487] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:23:48 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:23:57.292279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4bd46-6055-4553-b370-3279fa6f79b1 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:23:57.315044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4bd46-6055-4553-b370-3279fa6f79b1 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:23:57.318709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d81d6d-2dbe-4757-b550-66d11149a5eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:23:57.319390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81d6d-2dbe-4757-b550-66d11149a5eb service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:23:57.319671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81d6d-2dbe-4757-b550-66d11149a5eb service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:23:57.319964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81d6d-2dbe-4757-b550-66d11149a5eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:23:57.321695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d4d81d6d-2dbe-4757-b550-66d11149a5eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:23:57.333438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d81d6d-2dbe-4757-b550-66d11149a5eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:23:57.334902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d81d6d-2dbe-4757-b550-66d11149a5eb service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:23:57.344997 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4287/8488] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:23:57 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:24:46.322208 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f38a7-2d7b-46ce-a7c9-03d68210427f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:46.395700 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f38a7-2d7b-46ce-a7c9-03d68210427f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:46.401279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958e394-2886-4d23-8b79-b3a2e9db1fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:46.402166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e394-2886-4d23-8b79-b3a2e9db1fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:46.402500 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e394-2886-4d23-8b79-b3a2e9db1fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:46.402846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e394-2886-4d23-8b79-b3a2e9db1fb8 admin admin] PATH_INFO: `/v3/users/9373fe72d79041f8afc18454e442e9ea` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:46.404152 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958e394-2886-4d23-8b79-b3a2e9db1fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9373fe72d79041f8afc18454e442e9ea)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:46.406070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958e394-2886-4d23-8b79-b3a2e9db1fb8 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:46.458156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9958e394-2886-4d23-8b79-b3a2e9db1fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9373fe72d79041f8afc18454e442e9ea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:46.464914 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9958e394-2886-4d23-8b79-b3a2e9db1fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9373fe72d79041f8afc18454e442e9ea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:46.476011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9958e394-2886-4d23-8b79-b3a2e9db1fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9373fe72d79041f8afc18454e442e9ea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:46.476687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9958e394-2886-4d23-8b79-b3a2e9db1fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9373fe72d79041f8afc18454e442e9ea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:46.483960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-9958e394-2886-4d23-8b79-b3a2e9db1fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9373fe72d79041f8afc18454e442e9ea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:46.490076 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4202/8489] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:24:46 2021] DELETE /identity/v3/users/9373fe72d79041f8afc18454e442e9ea => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:24:46.494667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78af4b-cd25-4933-bc21-1499eb17b0fc None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:46.495184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78af4b-cd25-4933-bc21-1499eb17b0fc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:46.495293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78af4b-cd25-4933-bc21-1499eb17b0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:46.513853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1d78af4b-cd25-4933-bc21-1499eb17b0fc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:24:46.515090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1d78af4b-cd25-4933-bc21-1499eb17b0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:24:46.571029 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4288/8490] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:24:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:24:46.581419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958e394-2886-4d23-8b79-b3a2e9db1fb8 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:46.582849 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9958e394-2886-4d23-8b79-b3a2e9db1fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:24:46.640013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958e394-2886-4d23-8b79-b3a2e9db1fb8 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:46.643634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a87de7-0267-406e-900f-33b0d745870b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:46.644559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a87de7-0267-406e-900f-33b0d745870b service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:46.644845 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a87de7-0267-406e-900f-33b0d745870b service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:46.645157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a87de7-0267-406e-900f-33b0d745870b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:46.653915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a87de7-0267-406e-900f-33b0d745870b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:46.655546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a87de7-0267-406e-900f-33b0d745870b service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:46.665366 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4203/8491] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:24:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:24:46.827751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78af4b-cd25-4933-bc21-1499eb17b0fc None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:46.829587 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1d78af4b-cd25-4933-bc21-1499eb17b0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:24:46.844420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78af4b-cd25-4933-bc21-1499eb17b0fc None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:46.849106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2117fc-e1be-4b15-8082-590e266fcd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:46.849981 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2117fc-e1be-4b15-8082-590e266fcd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:46.850276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2117fc-e1be-4b15-8082-590e266fcd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:46.850557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2117fc-e1be-4b15-8082-590e266fcd29 admin admin] PATH_INFO: `/v3/projects/12ebb2d131744779969f033e54696e15` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:46.851878 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2117fc-e1be-4b15-8082-590e266fcd29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ebb2d131744779969f033e54696e15)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:46.853726 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2117fc-e1be-4b15-8082-590e266fcd29 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:46.897759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8f2117fc-e1be-4b15-8082-590e266fcd29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ebb2d131744779969f033e54696e15', 'request_id': 'req-8f2117fc-e1be-4b15-8082-590e266fcd29'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:46.903585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8f2117fc-e1be-4b15-8082-590e266fcd29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ebb2d131744779969f033e54696e15', 'request_id': 'req-8f2117fc-e1be-4b15-8082-590e266fcd29'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:46.910385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8f2117fc-e1be-4b15-8082-590e266fcd29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ebb2d131744779969f033e54696e15', 'request_id': 'req-8f2117fc-e1be-4b15-8082-590e266fcd29'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:46.921094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8f2117fc-e1be-4b15-8082-590e266fcd29 admin admin] The token cache is being invalidate because project 12ebb2d131744779969f033e54696e15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:24:46.921380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8f2117fc-e1be-4b15-8082-590e266fcd29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:46.922018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8f2117fc-e1be-4b15-8082-590e266fcd29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:46.923533 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4289/8492] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:24:46 2021] DELETE /identity/v3/projects/12ebb2d131744779969f033e54696e15 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:24:46.927478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a87de7-0267-406e-900f-33b0d745870b service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:46.937576 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a87de7-0267-406e-900f-33b0d745870b service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:46.991277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7cdb0-4510-46e8-a3ba-760fe8a6cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:46.992147 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7cdb0-4510-46e8-a3ba-760fe8a6cec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:46.992463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7cdb0-4510-46e8-a3ba-760fe8a6cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:46.992748 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7cdb0-4510-46e8-a3ba-760fe8a6cec0 admin admin] PATH_INFO: `/v3/users/3c186b1fc74d4602aa473bb6bc3f18ea` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:46.993982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7cdb0-4510-46e8-a3ba-760fe8a6cec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c186b1fc74d4602aa473bb6bc3f18ea)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:46.995964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7cdb0-4510-46e8-a3ba-760fe8a6cec0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:47.041901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74d7cdb0-4510-46e8-a3ba-760fe8a6cec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c186b1fc74d4602aa473bb6bc3f18ea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:47.049413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74d7cdb0-4510-46e8-a3ba-760fe8a6cec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c186b1fc74d4602aa473bb6bc3f18ea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:47.061297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74d7cdb0-4510-46e8-a3ba-760fe8a6cec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c186b1fc74d4602aa473bb6bc3f18ea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:47.062091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74d7cdb0-4510-46e8-a3ba-760fe8a6cec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c186b1fc74d4602aa473bb6bc3f18ea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:47.069842 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-74d7cdb0-4510-46e8-a3ba-760fe8a6cec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c186b1fc74d4602aa473bb6bc3f18ea'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:47.076280 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4204/8493] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:24:46 2021] DELETE /identity/v3/users/3c186b1fc74d4602aa473bb6bc3f18ea => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:24:47.339641 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2117fc-e1be-4b15-8082-590e266fcd29 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:47.341907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8f2117fc-e1be-4b15-8082-590e266fcd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:24:47.355032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2117fc-e1be-4b15-8082-590e266fcd29 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:47.412802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd18a0-3fc5-4081-bb12-3a1ea5437bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:47.413653 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd18a0-3fc5-4081-bb12-3a1ea5437bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:47.413937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd18a0-3fc5-4081-bb12-3a1ea5437bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:47.414214 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd18a0-3fc5-4081-bb12-3a1ea5437bb6 admin admin] PATH_INFO: `/v3/projects/ac351031272f470c9420674273326e76` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:47.415447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd18a0-3fc5-4081-bb12-3a1ea5437bb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac351031272f470c9420674273326e76)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:47.417333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd18a0-3fc5-4081-bb12-3a1ea5437bb6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:47.462727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-53bd18a0-3fc5-4081-bb12-3a1ea5437bb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac351031272f470c9420674273326e76', 'request_id': 'req-53bd18a0-3fc5-4081-bb12-3a1ea5437bb6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:47.469151 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-53bd18a0-3fc5-4081-bb12-3a1ea5437bb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac351031272f470c9420674273326e76', 'request_id': 'req-53bd18a0-3fc5-4081-bb12-3a1ea5437bb6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:47.476255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-53bd18a0-3fc5-4081-bb12-3a1ea5437bb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac351031272f470c9420674273326e76', 'request_id': 'req-53bd18a0-3fc5-4081-bb12-3a1ea5437bb6'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:47.486318 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-53bd18a0-3fc5-4081-bb12-3a1ea5437bb6 admin admin] The token cache is being invalidate because project ac351031272f470c9420674273326e76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:24:47.486603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-53bd18a0-3fc5-4081-bb12-3a1ea5437bb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:47.487243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-53bd18a0-3fc5-4081-bb12-3a1ea5437bb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:24:47.488755 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4290/8494] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:24:47 2021] DELETE /identity/v3/projects/ac351031272f470c9420674273326e76 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:24:47.495106 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c505-6ddc-42db-9fe0-2e803f7b92da None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:47.495565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c505-6ddc-42db-9fe0-2e803f7b92da None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:47.495671 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c505-6ddc-42db-9fe0-2e803f7b92da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:47.513654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0198c505-6ddc-42db-9fe0-2e803f7b92da None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:24:47.514906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0198c505-6ddc-42db-9fe0-2e803f7b92da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:24:47.571829 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4205/8495] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:24:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:24:47.580910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a59d90-17e7-4bd4-b42c-a3331ed02acc None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:47.581367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a59d90-17e7-4bd4-b42c-a3331ed02acc None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:47.581484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a59d90-17e7-4bd4-b42c-a3331ed02acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:47.600000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a6a59d90-17e7-4bd4-b42c-a3331ed02acc None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:24:47.601182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a6a59d90-17e7-4bd4-b42c-a3331ed02acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:24:47.609275 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4291/8496] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:24:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:24:47.615349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198c505-6ddc-42db-9fe0-2e803f7b92da None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:47.625110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198c505-6ddc-42db-9fe0-2e803f7b92da None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:47.629768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f4944-54f5-43f6-bfb8-30e938197270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:47.630460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f4944-54f5-43f6-bfb8-30e938197270 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:47.630750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f4944-54f5-43f6-bfb8-30e938197270 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:47.631033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f4944-54f5-43f6-bfb8-30e938197270 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:47.631767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f4944-54f5-43f6-bfb8-30e938197270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:24:47.632076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f4944-54f5-43f6-bfb8-30e938197270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:47.633647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f4944-54f5-43f6-bfb8-30e938197270 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:47.645644 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4206/8497] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:24:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:24:47.649557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a59d90-17e7-4bd4-b42c-a3331ed02acc None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:47.660245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a59d90-17e7-4bd4-b42c-a3331ed02acc None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:47.664944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446a9c7-6d0d-44dc-a3a4-2cb6e898b110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:47.665612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446a9c7-6d0d-44dc-a3a4-2cb6e898b110 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:47.665887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446a9c7-6d0d-44dc-a3a4-2cb6e898b110 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:47.666160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446a9c7-6d0d-44dc-a3a4-2cb6e898b110 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:47.666893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446a9c7-6d0d-44dc-a3a4-2cb6e898b110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:47.668821 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446a9c7-6d0d-44dc-a3a4-2cb6e898b110 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:47.703070 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4292/8498] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:24:47 2021] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:24:47.707300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f4944-54f5-43f6-bfb8-30e938197270 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:47.718066 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f4944-54f5-43f6-bfb8-30e938197270 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:47.773115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664680e-f02e-4042-98c3-f40cdd72cd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:47.773773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664680e-f02e-4042-98c3-f40cdd72cd5b admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:47.774060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664680e-f02e-4042-98c3-f40cdd72cd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:47.774371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664680e-f02e-4042-98c3-f40cdd72cd5b admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:47.775075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664680e-f02e-4042-98c3-f40cdd72cd5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:47.776973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664680e-f02e-4042-98c3-f40cdd72cd5b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:47.795930 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4207/8499] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:24:47 2021] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:24:47.800175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446a9c7-6d0d-44dc-a3a4-2cb6e898b110 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:47.810932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446a9c7-6d0d-44dc-a3a4-2cb6e898b110 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:47.816154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69f4a2-afda-4f9e-a8be-07c355d1b6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:47.816794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69f4a2-afda-4f9e-a8be-07c355d1b6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:47.817076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69f4a2-afda-4f9e-a8be-07c355d1b6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:47.817352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69f4a2-afda-4f9e-a8be-07c355d1b6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:47.818076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69f4a2-afda-4f9e-a8be-07c355d1b6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:47.819688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69f4a2-afda-4f9e-a8be-07c355d1b6a4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:47.830440 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4293/8500] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:24:47 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:24:47.834365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664680e-f02e-4042-98c3-f40cdd72cd5b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:47.844173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664680e-f02e-4042-98c3-f40cdd72cd5b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:47.848769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e0e48-dd5d-46bf-9bb6-f9aac979a932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:47.849415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e0e48-dd5d-46bf-9bb6-f9aac979a932 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:47.849701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e0e48-dd5d-46bf-9bb6-f9aac979a932 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:47.849979 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e0e48-dd5d-46bf-9bb6-f9aac979a932 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:47.850795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e0e48-dd5d-46bf-9bb6-f9aac979a932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:47.852313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e0e48-dd5d-46bf-9bb6-f9aac979a932 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:47.861899 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4208/8501] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:24:47 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:24:47.865748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69f4a2-afda-4f9e-a8be-07c355d1b6a4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:47.876389 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69f4a2-afda-4f9e-a8be-07c355d1b6a4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:47.882730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdd4db-0f7b-4bfb-9ffd-b6a312adb92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:47.883625 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdd4db-0f7b-4bfb-9ffd-b6a312adb92a admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:47.883889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdd4db-0f7b-4bfb-9ffd-b6a312adb92a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:47.884162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdd4db-0f7b-4bfb-9ffd-b6a312adb92a admin admin] PATH_INFO: `/v3/projects/294815d868e14c1e891b4b86a397ac8e/users/57603d680eb644bc9d56f772ce4b5bb4/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:47.898959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdd4db-0f7b-4bfb-9ffd-b6a312adb92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=294815d868e14c1e891b4b86a397ac8e, user_id=57603d680eb644bc9d56f772ce4b5bb4, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:47.901611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdd4db-0f7b-4bfb-9ffd-b6a312adb92a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:47.914003 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4294/8502] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:24:47 2021] PUT /identity/v3/projects/294815d868e14c1e891b4b86a397ac8e/users/57603d680eb644bc9d56f772ce4b5bb4/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:24:47.919190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ee3b8-91dd-40da-b69a-38f7e23902f6 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:47.919483 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ee3b8-91dd-40da-b69a-38f7e23902f6 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:47.919764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ee3b8-91dd-40da-b69a-38f7e23902f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:47.937458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-cc2ee3b8-91dd-40da-b69a-38f7e23902f6 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:24:47.938677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cc2ee3b8-91dd-40da-b69a-38f7e23902f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:24:47.994155 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4209/8503] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:24:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:24:48.004460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdd4db-0f7b-4bfb-9ffd-b6a312adb92a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:48.006185 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-23bdd4db-0f7b-4bfb-9ffd-b6a312adb92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:24:48.064424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdd4db-0f7b-4bfb-9ffd-b6a312adb92a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:48.068335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219801f-fe8d-4a8f-b644-824c28907a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:48.068974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219801f-fe8d-4a8f-b644-824c28907a44 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:48.069257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219801f-fe8d-4a8f-b644-824c28907a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:48.069537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219801f-fe8d-4a8f-b644-824c28907a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:48.079175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219801f-fe8d-4a8f-b644-824c28907a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:48.080593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219801f-fe8d-4a8f-b644-824c28907a44 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:48.089735 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4295/8504] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:24:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:24:51.812094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b1114-2122-4a6a-9bdc-843f3877b152 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:51.812643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b1114-2122-4a6a-9bdc-843f3877b152 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:51.812643 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b1114-2122-4a6a-9bdc-843f3877b152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:51.841832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-686b1114-2122-4a6a-9bdc-843f3877b152 None None] MFA Rules not processed for user `57603d680eb644bc9d56f772ce4b5bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:24:51.843103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-686b1114-2122-4a6a-9bdc-843f3877b152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:24:51.907780 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4210/8505] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:24:51 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:24:51.912160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219801f-fe8d-4a8f-b644-824c28907a44 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:51.922499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219801f-fe8d-4a8f-b644-824c28907a44 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:51.927483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7ff89-266f-42ab-83c3-4f799a4558f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:51.927972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7ff89-266f-42ab-83c3-4f799a4558f5 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:51.928251 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7ff89-266f-42ab-83c3-4f799a4558f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:51.928528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7ff89-266f-42ab-83c3-4f799a4558f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:51.929271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7ff89-266f-42ab-83c3-4f799a4558f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:51.931197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7ff89-266f-42ab-83c3-4f799a4558f5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:51.957452 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4296/8506] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:24:51 2021] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:24:51.961604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b1114-2122-4a6a-9bdc-843f3877b152 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:51.972375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b1114-2122-4a6a-9bdc-843f3877b152 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:52.027761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e1639-49e1-429b-87b5-ba5e86ecca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:52.028434 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e1639-49e1-429b-87b5-ba5e86ecca45 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:52.028723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e1639-49e1-429b-87b5-ba5e86ecca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:52.029000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e1639-49e1-429b-87b5-ba5e86ecca45 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:52.029722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e1639-49e1-429b-87b5-ba5e86ecca45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:52.031662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e1639-49e1-429b-87b5-ba5e86ecca45 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:52.052277 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4211/8507] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:24:51 2021] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:24:52.056363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7ff89-266f-42ab-83c3-4f799a4558f5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:52.068503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7ff89-266f-42ab-83c3-4f799a4558f5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:52.073245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933a8c2-b734-464a-a696-68b472255619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:52.075258 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933a8c2-b734-464a-a696-68b472255619 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:52.075558 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933a8c2-b734-464a-a696-68b472255619 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:52.075842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933a8c2-b734-464a-a696-68b472255619 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:52.076680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933a8c2-b734-464a-a696-68b472255619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:52.078316 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933a8c2-b734-464a-a696-68b472255619 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:52.089757 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4297/8508] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:24:52 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:24:52.094642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e1639-49e1-429b-87b5-ba5e86ecca45 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:52.104966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e1639-49e1-429b-87b5-ba5e86ecca45 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:52.110129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a99c1-e9fd-42b9-930e-8e05bf386fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:52.111041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a99c1-e9fd-42b9-930e-8e05bf386fff admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:52.111445 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a99c1-e9fd-42b9-930e-8e05bf386fff admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:52.111729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a99c1-e9fd-42b9-930e-8e05bf386fff admin admin] PATH_INFO: `/v3/projects/e3ef666d989f4d4299e2942f7f5206d8/users/de867458a3ef4e5c82571557cebb0597/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:52.126878 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a99c1-e9fd-42b9-930e-8e05bf386fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ef666d989f4d4299e2942f7f5206d8, user_id=de867458a3ef4e5c82571557cebb0597, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:52.129517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a99c1-e9fd-42b9-930e-8e05bf386fff admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:52.143882 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4212/8509] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:24:52 2021] PUT /identity/v3/projects/e3ef666d989f4d4299e2942f7f5206d8/users/de867458a3ef4e5c82571557cebb0597/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:24:52.147933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933a8c2-b734-464a-a696-68b472255619 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:52.158062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933a8c2-b734-464a-a696-68b472255619 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:52.216536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3503b03-b2d0-4abe-b473-9a6d0b1e0585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:52.217237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3503b03-b2d0-4abe-b473-9a6d0b1e0585 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:52.217518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3503b03-b2d0-4abe-b473-9a6d0b1e0585 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:52.217871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3503b03-b2d0-4abe-b473-9a6d0b1e0585 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:52.218688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3503b03-b2d0-4abe-b473-9a6d0b1e0585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:52.222188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3503b03-b2d0-4abe-b473-9a6d0b1e0585 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:52.231404 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4298/8510] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:24:52 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:24:52.238052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a99c1-e9fd-42b9-930e-8e05bf386fff admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:52.248515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a99c1-e9fd-42b9-930e-8e05bf386fff admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:52.253658 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955e1d5-2e83-4b3c-a219-706e6b1a95e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:52.254733 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955e1d5-2e83-4b3c-a219-706e6b1a95e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:52.255017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955e1d5-2e83-4b3c-a219-706e6b1a95e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:52.255299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955e1d5-2e83-4b3c-a219-706e6b1a95e5 admin admin] PATH_INFO: `/v3/projects/e3ef666d989f4d4299e2942f7f5206d8/users/de867458a3ef4e5c82571557cebb0597/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:52.257380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955e1d5-2e83-4b3c-a219-706e6b1a95e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ef666d989f4d4299e2942f7f5206d8, user_id=de867458a3ef4e5c82571557cebb0597, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:52.260058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955e1d5-2e83-4b3c-a219-706e6b1a95e5 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:52.275127 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4213/8511] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:24:52 2021] PUT /identity/v3/projects/e3ef666d989f4d4299e2942f7f5206d8/users/de867458a3ef4e5c82571557cebb0597/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:24:53.839309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3503b03-b2d0-4abe-b473-9a6d0b1e0585 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:53.842534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c3503b03-b2d0-4abe-b473-9a6d0b1e0585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:24:53.954400 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3503b03-b2d0-4abe-b473-9a6d0b1e0585 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:54.040563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0d602-d8a7-4e12-8a00-45cc1d923e3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:54.041347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0d602-d8a7-4e12-8a00-45cc1d923e3d service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:54.041515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0d602-d8a7-4e12-8a00-45cc1d923e3d service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:54.042282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0d602-d8a7-4e12-8a00-45cc1d923e3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:54.044273 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cda0d602-d8a7-4e12-8a00-45cc1d923e3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:24:54.060390 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0d602-d8a7-4e12-8a00-45cc1d923e3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:54.062181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0d602-d8a7-4e12-8a00-45cc1d923e3d service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:54.081593 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4299/8512] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:24:53 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:24:57.270790 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8947c-f13e-4dda-a590-ec696b7b5342 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:57.271339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8947c-f13e-4dda-a590-ec696b7b5342 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:57.271339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8947c-f13e-4dda-a590-ec696b7b5342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:57.300178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-21a8947c-f13e-4dda-a590-ec696b7b5342 None None] MFA Rules not processed for user `de867458a3ef4e5c82571557cebb0597`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:24:57.301413 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-21a8947c-f13e-4dda-a590-ec696b7b5342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:24:57.368648 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4214/8513] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:24:57 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:24:57.381772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0d602-d8a7-4e12-8a00-45cc1d923e3d service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:57.383268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-cda0d602-d8a7-4e12-8a00-45cc1d923e3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:24:57.469428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0d602-d8a7-4e12-8a00-45cc1d923e3d service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:57.474962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340f842-384d-4ee3-b48e-01101a93ae28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:57.475611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340f842-384d-4ee3-b48e-01101a93ae28 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:57.475898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340f842-384d-4ee3-b48e-01101a93ae28 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:57.476176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340f842-384d-4ee3-b48e-01101a93ae28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:57.534098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340f842-384d-4ee3-b48e-01101a93ae28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:57.535787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340f842-384d-4ee3-b48e-01101a93ae28 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:57.544773 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4300/8514] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:24:57 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:24:58.737562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16373c5-03e5-412a-9647-4735475fd038 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:58.738055 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16373c5-03e5-412a-9647-4735475fd038 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:58.738173 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16373c5-03e5-412a-9647-4735475fd038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:58.756113 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f16373c5-03e5-412a-9647-4735475fd038 None None] MFA Rules not processed for user `57603d680eb644bc9d56f772ce4b5bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:24:58.757428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f16373c5-03e5-412a-9647-4735475fd038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:24:58.764371 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4215/8515] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:24:58 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:24:58.915293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340f842-384d-4ee3-b48e-01101a93ae28 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:58.916738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3340f842-384d-4ee3-b48e-01101a93ae28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:24:58.934429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340f842-384d-4ee3-b48e-01101a93ae28 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:58.940099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e1be3-2110-4d19-90dd-51291ea87217 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:58.940738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e1be3-2110-4d19-90dd-51291ea87217 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:58.941018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e1be3-2110-4d19-90dd-51291ea87217 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:58.941295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e1be3-2110-4d19-90dd-51291ea87217 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:58.943071 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ef8e1be3-2110-4d19-90dd-51291ea87217 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:24:58.956861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e1be3-2110-4d19-90dd-51291ea87217 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:58.958498 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e1be3-2110-4d19-90dd-51291ea87217 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:58.971228 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4301/8516] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:24:58 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:24:59.473654 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16373c5-03e5-412a-9647-4735475fd038 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:24:59.496846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16373c5-03e5-412a-9647-4735475fd038 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:24:59.502397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db7ab1-54e9-4254-97e4-b76be05b0b4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:24:59.503211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db7ab1-54e9-4254-97e4-b76be05b0b4a service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:24:59.503511 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db7ab1-54e9-4254-97e4-b76be05b0b4a service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:24:59.503800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db7ab1-54e9-4254-97e4-b76be05b0b4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:24:59.505630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-85db7ab1-54e9-4254-97e4-b76be05b0b4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:24:59.522301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db7ab1-54e9-4254-97e4-b76be05b0b4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:24:59.524315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db7ab1-54e9-4254-97e4-b76be05b0b4a service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:24:59.538707 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4216/8517] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:24:59 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:25:02.029451 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e1be3-2110-4d19-90dd-51291ea87217 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:25:02.031526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ef8e1be3-2110-4d19-90dd-51291ea87217 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:25:02.073534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e1be3-2110-4d19-90dd-51291ea87217 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:25:02.081717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246961fb-7453-4c23-9df1-770f6a541e94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:25:02.082734 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246961fb-7453-4c23-9df1-770f6a541e94 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:25:02.083010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246961fb-7453-4c23-9df1-770f6a541e94 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:25:02.083276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246961fb-7453-4c23-9df1-770f6a541e94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:25:02.085749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-246961fb-7453-4c23-9df1-770f6a541e94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:25:02.103112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246961fb-7453-4c23-9df1-770f6a541e94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:25:02.106358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246961fb-7453-4c23-9df1-770f6a541e94 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:25:02.122203 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4302/8518] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:25:02 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:25:07.395412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db7ab1-54e9-4254-97e4-b76be05b0b4a service placement] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:25:07.411963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db7ab1-54e9-4254-97e4-b76be05b0b4a service placement] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:25:07.417611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b9947-122d-4597-9dd5-f256b9e9c95b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:25:07.418948 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b9947-122d-4597-9dd5-f256b9e9c95b service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:25:07.419240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b9947-122d-4597-9dd5-f256b9e9c95b service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:25:07.419519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b9947-122d-4597-9dd5-f256b9e9c95b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:25:07.421294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ee1b9947-122d-4597-9dd5-f256b9e9c95b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:25:07.436041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b9947-122d-4597-9dd5-f256b9e9c95b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:25:07.437702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b9947-122d-4597-9dd5-f256b9e9c95b service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:25:07.450808 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4217/8519] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:25:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:25:09.344106 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246961fb-7453-4c23-9df1-770f6a541e94 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:25:09.397808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246961fb-7453-4c23-9df1-770f6a541e94 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:25:09.401355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d1d67-1880-47af-8da3-b5bedbb0e415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:25:09.402039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d1d67-1880-47af-8da3-b5bedbb0e415 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:25:09.402354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d1d67-1880-47af-8da3-b5bedbb0e415 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:25:09.402645 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d1d67-1880-47af-8da3-b5bedbb0e415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:25:09.411383 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d1d67-1880-47af-8da3-b5bedbb0e415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:25:09.412795 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d1d67-1880-47af-8da3-b5bedbb0e415 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:25:09.422439 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4303/8520] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:25:09 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:25:46.185430 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b9947-122d-4597-9dd5-f256b9e9c95b service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:25:46.197073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b9947-122d-4597-9dd5-f256b9e9c95b service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:25:46.201093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b222b3f-a4ba-4574-b932-3e9ba523ce65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:25:46.201716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b222b3f-a4ba-4574-b932-3e9ba523ce65 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:25:46.201999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b222b3f-a4ba-4574-b932-3e9ba523ce65 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:25:46.202294 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b222b3f-a4ba-4574-b932-3e9ba523ce65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:25:46.204019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4b222b3f-a4ba-4574-b932-3e9ba523ce65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:25:46.215417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b222b3f-a4ba-4574-b932-3e9ba523ce65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:25:46.217404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b222b3f-a4ba-4574-b932-3e9ba523ce65 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:25:46.227726 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4218/8521] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:25:46 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:27:50.566930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d1d67-1880-47af-8da3-b5bedbb0e415 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:27:50.588320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d1d67-1880-47af-8da3-b5bedbb0e415 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:27:50.591953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f763fcf-6fd6-455c-b86a-5296f242651a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:27:50.592580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f763fcf-6fd6-455c-b86a-5296f242651a service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:27:50.592864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f763fcf-6fd6-455c-b86a-5296f242651a service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:27:50.593138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f763fcf-6fd6-455c-b86a-5296f242651a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:27:50.594957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5f763fcf-6fd6-455c-b86a-5296f242651a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:27:50.639152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f763fcf-6fd6-455c-b86a-5296f242651a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:27:50.640586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f763fcf-6fd6-455c-b86a-5296f242651a service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:27:50.650884 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4304/8522] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:27:50 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:29:50.777478 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b222b3f-a4ba-4574-b932-3e9ba523ce65 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:29:50.798378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b222b3f-a4ba-4574-b932-3e9ba523ce65 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:29:50.801981 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc4753-c3ef-4898-86ea-dba0ffc556ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:29:50.802650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc4753-c3ef-4898-86ea-dba0ffc556ae service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:29:50.802968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc4753-c3ef-4898-86ea-dba0ffc556ae service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:29:50.803251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc4753-c3ef-4898-86ea-dba0ffc556ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:29:50.804983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eedc4753-c3ef-4898-86ea-dba0ffc556ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:29:50.859098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc4753-c3ef-4898-86ea-dba0ffc556ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:29:50.860465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc4753-c3ef-4898-86ea-dba0ffc556ae service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:29:50.874160 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4219/8523] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:29:50 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:29:52.077216 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f763fcf-6fd6-455c-b86a-5296f242651a service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:29:52.088582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f763fcf-6fd6-455c-b86a-5296f242651a service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:29:52.092275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26579b-ccc0-4b4c-a8fb-9f7872e4b90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:29:52.092908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26579b-ccc0-4b4c-a8fb-9f7872e4b90f service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:29:52.093220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26579b-ccc0-4b4c-a8fb-9f7872e4b90f service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:29:52.093496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26579b-ccc0-4b4c-a8fb-9f7872e4b90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:29:52.095905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fa26579b-ccc0-4b4c-a8fb-9f7872e4b90f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:29:52.111516 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26579b-ccc0-4b4c-a8fb-9f7872e4b90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:29:52.112933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26579b-ccc0-4b4c-a8fb-9f7872e4b90f service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:29:52.126582 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4305/8524] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:29:52 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:29:55.128424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc4753-c3ef-4898-86ea-dba0ffc556ae service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:29:55.139536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc4753-c3ef-4898-86ea-dba0ffc556ae service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:29:55.143167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb87429-e223-4f79-b7cc-b5ddb2807e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:29:55.143804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb87429-e223-4f79-b7cc-b5ddb2807e93 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:29:55.144088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb87429-e223-4f79-b7cc-b5ddb2807e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:29:55.144364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb87429-e223-4f79-b7cc-b5ddb2807e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:29:55.212834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb87429-e223-4f79-b7cc-b5ddb2807e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:29:55.214331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb87429-e223-4f79-b7cc-b5ddb2807e93 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:29:55.223835 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4220/8525] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:29:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:29:58.783059 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26579b-ccc0-4b4c-a8fb-9f7872e4b90f service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:29:58.796939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26579b-ccc0-4b4c-a8fb-9f7872e4b90f service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:29:58.802798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938541b-0e63-46bc-b0df-ab4883a4b60d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:29:58.803433 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938541b-0e63-46bc-b0df-ab4883a4b60d service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:29:58.803710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938541b-0e63-46bc-b0df-ab4883a4b60d service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:29:58.803983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938541b-0e63-46bc-b0df-ab4883a4b60d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:29:58.814913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938541b-0e63-46bc-b0df-ab4883a4b60d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:29:58.816479 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938541b-0e63-46bc-b0df-ab4883a4b60d service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:29:58.829827 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4306/8526] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:29:58 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:30:01.443812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb87429-e223-4f79-b7cc-b5ddb2807e93 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:01.455714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb87429-e223-4f79-b7cc-b5ddb2807e93 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:01.460982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f6e55-c7e1-46a6-9ee7-03d07c817767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:01.462051 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f6e55-c7e1-46a6-9ee7-03d07c817767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:01.462381 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f6e55-c7e1-46a6-9ee7-03d07c817767 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:01.462737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f6e55-c7e1-46a6-9ee7-03d07c817767 admin admin] PATH_INFO: `/v3/users/57603d680eb644bc9d56f772ce4b5bb4` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:01.464134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f6e55-c7e1-46a6-9ee7-03d07c817767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57603d680eb644bc9d56f772ce4b5bb4)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:01.466242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f6e55-c7e1-46a6-9ee7-03d07c817767 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:01.534447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-135f6e55-c7e1-46a6-9ee7-03d07c817767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57603d680eb644bc9d56f772ce4b5bb4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:01.541746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-135f6e55-c7e1-46a6-9ee7-03d07c817767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57603d680eb644bc9d56f772ce4b5bb4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:01.556907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-135f6e55-c7e1-46a6-9ee7-03d07c817767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57603d680eb644bc9d56f772ce4b5bb4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:01.556907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-135f6e55-c7e1-46a6-9ee7-03d07c817767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57603d680eb644bc9d56f772ce4b5bb4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:01.563295 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-135f6e55-c7e1-46a6-9ee7-03d07c817767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57603d680eb644bc9d56f772ce4b5bb4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:01.570078 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4221/8527] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:30:01 2021] DELETE /identity/v3/users/57603d680eb644bc9d56f772ce4b5bb4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:30:01.763959 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938541b-0e63-46bc-b0df-ab4883a4b60d service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:01.777746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938541b-0e63-46bc-b0df-ab4883a4b60d service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:01.842009 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71604e02-cbf3-44f2-b32d-07f56a6e7c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:01.842892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71604e02-cbf3-44f2-b32d-07f56a6e7c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:01.843181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71604e02-cbf3-44f2-b32d-07f56a6e7c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:01.843455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71604e02-cbf3-44f2-b32d-07f56a6e7c43 admin admin] PATH_INFO: `/v3/projects/294815d868e14c1e891b4b86a397ac8e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:01.845271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71604e02-cbf3-44f2-b32d-07f56a6e7c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=294815d868e14c1e891b4b86a397ac8e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:01.847203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71604e02-cbf3-44f2-b32d-07f56a6e7c43 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:01.890760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-71604e02-cbf3-44f2-b32d-07f56a6e7c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294815d868e14c1e891b4b86a397ac8e', 'request_id': 'req-71604e02-cbf3-44f2-b32d-07f56a6e7c43'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:01.897182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-71604e02-cbf3-44f2-b32d-07f56a6e7c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294815d868e14c1e891b4b86a397ac8e', 'request_id': 'req-71604e02-cbf3-44f2-b32d-07f56a6e7c43'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:01.904226 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-71604e02-cbf3-44f2-b32d-07f56a6e7c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294815d868e14c1e891b4b86a397ac8e', 'request_id': 'req-71604e02-cbf3-44f2-b32d-07f56a6e7c43'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:01.926604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-71604e02-cbf3-44f2-b32d-07f56a6e7c43 admin admin] The token cache is being invalidate because project 294815d868e14c1e891b4b86a397ac8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:30:01.926899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-71604e02-cbf3-44f2-b32d-07f56a6e7c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:01.927525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-71604e02-cbf3-44f2-b32d-07f56a6e7c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:01.929049 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4307/8528] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:30:01 2021] DELETE /identity/v3/projects/294815d868e14c1e891b4b86a397ac8e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:30:01.933097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f6e55-c7e1-46a6-9ee7-03d07c817767 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:01.934499 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-135f6e55-c7e1-46a6-9ee7-03d07c817767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:01.947634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f6e55-c7e1-46a6-9ee7-03d07c817767 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:02.002808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fd762-a28a-4b13-bb04-650ff3e247a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:02.003677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fd762-a28a-4b13-bb04-650ff3e247a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:02.003970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fd762-a28a-4b13-bb04-650ff3e247a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:02.004255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fd762-a28a-4b13-bb04-650ff3e247a6 admin admin] PATH_INFO: `/v3/users/de867458a3ef4e5c82571557cebb0597` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:02.005471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fd762-a28a-4b13-bb04-650ff3e247a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de867458a3ef4e5c82571557cebb0597)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:02.007428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fd762-a28a-4b13-bb04-650ff3e247a6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:02.052633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-432fd762-a28a-4b13-bb04-650ff3e247a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de867458a3ef4e5c82571557cebb0597'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:02.059662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-432fd762-a28a-4b13-bb04-650ff3e247a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de867458a3ef4e5c82571557cebb0597'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:02.070985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-432fd762-a28a-4b13-bb04-650ff3e247a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de867458a3ef4e5c82571557cebb0597'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:02.071936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-432fd762-a28a-4b13-bb04-650ff3e247a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de867458a3ef4e5c82571557cebb0597'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:02.079589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-432fd762-a28a-4b13-bb04-650ff3e247a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de867458a3ef4e5c82571557cebb0597'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:02.085299 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4222/8529] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:30:01 2021] DELETE /identity/v3/users/de867458a3ef4e5c82571557cebb0597 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:30:02.256379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71604e02-cbf3-44f2-b32d-07f56a6e7c43 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:02.257842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-71604e02-cbf3-44f2-b32d-07f56a6e7c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:02.271017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71604e02-cbf3-44f2-b32d-07f56a6e7c43 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:02.326888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f65fe-4d02-44e0-a159-e05b5ad9dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:02.327739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f65fe-4d02-44e0-a159-e05b5ad9dc24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:02.328024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f65fe-4d02-44e0-a159-e05b5ad9dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:02.328308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f65fe-4d02-44e0-a159-e05b5ad9dc24 admin admin] PATH_INFO: `/v3/projects/e3ef666d989f4d4299e2942f7f5206d8` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:02.330227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f65fe-4d02-44e0-a159-e05b5ad9dc24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ef666d989f4d4299e2942f7f5206d8)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:02.332351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f65fe-4d02-44e0-a159-e05b5ad9dc24 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:02.375944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8a0f65fe-4d02-44e0-a159-e05b5ad9dc24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ef666d989f4d4299e2942f7f5206d8', 'request_id': 'req-8a0f65fe-4d02-44e0-a159-e05b5ad9dc24'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:02.381879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8a0f65fe-4d02-44e0-a159-e05b5ad9dc24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ef666d989f4d4299e2942f7f5206d8', 'request_id': 'req-8a0f65fe-4d02-44e0-a159-e05b5ad9dc24'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:02.388803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8a0f65fe-4d02-44e0-a159-e05b5ad9dc24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ef666d989f4d4299e2942f7f5206d8', 'request_id': 'req-8a0f65fe-4d02-44e0-a159-e05b5ad9dc24'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:02.399060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8a0f65fe-4d02-44e0-a159-e05b5ad9dc24 admin admin] The token cache is being invalidate because project e3ef666d989f4d4299e2942f7f5206d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:30:02.399345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8a0f65fe-4d02-44e0-a159-e05b5ad9dc24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:02.399964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8a0f65fe-4d02-44e0-a159-e05b5ad9dc24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:02.401457 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4308/8530] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:30:02 2021] DELETE /identity/v3/projects/e3ef666d989f4d4299e2942f7f5206d8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:30:05.930199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fd762-a28a-4b13-bb04-650ff3e247a6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:05.931639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-432fd762-a28a-4b13-bb04-650ff3e247a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:06.011641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fd762-a28a-4b13-bb04-650ff3e247a6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:06.070062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a0f01-2eeb-447d-b515-b5c36074519e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:06.070813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a0f01-2eeb-447d-b515-b5c36074519e service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:06.071108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a0f01-2eeb-447d-b515-b5c36074519e service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:06.071391 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a0f01-2eeb-447d-b515-b5c36074519e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:06.073514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-802a0f01-2eeb-447d-b515-b5c36074519e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:06.087387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a0f01-2eeb-447d-b515-b5c36074519e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:06.088952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a0f01-2eeb-447d-b515-b5c36074519e service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:06.101665 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4223/8531] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:30:05 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:30:11.956138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236cc5-45bf-4493-8cd2-80025b2c7b8b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:11.956720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236cc5-45bf-4493-8cd2-80025b2c7b8b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:11.956720 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236cc5-45bf-4493-8cd2-80025b2c7b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:12.009680 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5a236cc5-45bf-4493-8cd2-80025b2c7b8b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:30:12.010825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5a236cc5-45bf-4493-8cd2-80025b2c7b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:12.066281 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4309/8532] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:30:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:30:12.074889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328273c9-0875-4e7b-b5bf-7921ef9eea71 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:12.075368 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328273c9-0875-4e7b-b5bf-7921ef9eea71 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:12.075481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328273c9-0875-4e7b-b5bf-7921ef9eea71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:12.092966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-328273c9-0875-4e7b-b5bf-7921ef9eea71 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:30:12.094128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-328273c9-0875-4e7b-b5bf-7921ef9eea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:12.101897 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4224/8533] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:30:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:30:12.106337 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a236cc5-45bf-4493-8cd2-80025b2c7b8b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:12.116347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a236cc5-45bf-4493-8cd2-80025b2c7b8b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:12.120948 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a1171-8eba-46bc-a74e-45a5b57182be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:12.121601 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a1171-8eba-46bc-a74e-45a5b57182be admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:12.121886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a1171-8eba-46bc-a74e-45a5b57182be admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:12.122169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a1171-8eba-46bc-a74e-45a5b57182be admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:12.122933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a1171-8eba-46bc-a74e-45a5b57182be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:30:12.123242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a1171-8eba-46bc-a74e-45a5b57182be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:12.124832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a1171-8eba-46bc-a74e-45a5b57182be admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:12.136664 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4310/8534] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:30:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:30:12.146694 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328273c9-0875-4e7b-b5bf-7921ef9eea71 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:12.155909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328273c9-0875-4e7b-b5bf-7921ef9eea71 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:12.160614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2ff8f-de00-4fad-bdf0-0e180029aae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:12.161270 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2ff8f-de00-4fad-bdf0-0e180029aae2 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:12.161560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2ff8f-de00-4fad-bdf0-0e180029aae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:12.161839 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2ff8f-de00-4fad-bdf0-0e180029aae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:12.162596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2ff8f-de00-4fad-bdf0-0e180029aae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:12.164470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2ff8f-de00-4fad-bdf0-0e180029aae2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:12.192174 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4225/8535] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:30:12 2021] POST /identity/v3/projects => generated 393 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:30:12.194406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a1171-8eba-46bc-a74e-45a5b57182be admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:12.205340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a1171-8eba-46bc-a74e-45a5b57182be admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:12.260693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31000406-9aa4-41d1-9f39-0a903953fb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:12.261278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000406-9aa4-41d1-9f39-0a903953fb01 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:12.261564 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000406-9aa4-41d1-9f39-0a903953fb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:12.261844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000406-9aa4-41d1-9f39-0a903953fb01 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:12.262578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31000406-9aa4-41d1-9f39-0a903953fb01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:12.264493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31000406-9aa4-41d1-9f39-0a903953fb01 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:12.283521 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4311/8536] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:30:12 2021] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:30:12.287644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2ff8f-de00-4fad-bdf0-0e180029aae2 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:12.297907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2ff8f-de00-4fad-bdf0-0e180029aae2 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:12.303031 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9bd66-deb3-48be-a646-535fd3ce1b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:12.303707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9bd66-deb3-48be-a646-535fd3ce1b2c admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:12.303990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9bd66-deb3-48be-a646-535fd3ce1b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:12.304264 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9bd66-deb3-48be-a646-535fd3ce1b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:12.304985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9bd66-deb3-48be-a646-535fd3ce1b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:12.306616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9bd66-deb3-48be-a646-535fd3ce1b2c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:12.316829 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4226/8537] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:30:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:30:12.321031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31000406-9aa4-41d1-9f39-0a903953fb01 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:12.331657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31000406-9aa4-41d1-9f39-0a903953fb01 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:12.336227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255a910-6c33-4a17-98bf-1d591a33346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:12.336870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255a910-6c33-4a17-98bf-1d591a33346d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:12.337154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255a910-6c33-4a17-98bf-1d591a33346d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:12.337431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255a910-6c33-4a17-98bf-1d591a33346d admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:12.338183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255a910-6c33-4a17-98bf-1d591a33346d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:12.339803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255a910-6c33-4a17-98bf-1d591a33346d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:12.349438 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4312/8538] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:30:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:30:12.353502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9bd66-deb3-48be-a646-535fd3ce1b2c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:12.363677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9bd66-deb3-48be-a646-535fd3ce1b2c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:12.368240 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9e319-453d-4351-a615-13c88934544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:12.369104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9e319-453d-4351-a615-13c88934544c admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:12.369382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9e319-453d-4351-a615-13c88934544c admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:12.369655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9e319-453d-4351-a615-13c88934544c admin admin] PATH_INFO: `/v3/projects/6f52949ca7754cb0bb38b4fa73ca59e5/users/38bad590d33c4304b6a7908e1d3b43e3/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:12.385394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9e319-453d-4351-a615-13c88934544c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f52949ca7754cb0bb38b4fa73ca59e5, user_id=38bad590d33c4304b6a7908e1d3b43e3, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:12.388094 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9e319-453d-4351-a615-13c88934544c admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:12.400412 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4227/8539] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:30:12 2021] PUT /identity/v3/projects/6f52949ca7754cb0bb38b4fa73ca59e5/users/38bad590d33c4304b6a7908e1d3b43e3/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:30:12.413602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4c58-b550-45e3-a983-0abfce2a22b1 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:12.413928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4c58-b550-45e3-a983-0abfce2a22b1 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:12.414211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4c58-b550-45e3-a983-0abfce2a22b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:12.441100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-659b4c58-b550-45e3-a983-0abfce2a22b1 None None] MFA Rules not processed for user `38bad590d33c4304b6a7908e1d3b43e3`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:30:12.442363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-659b4c58-b550-45e3-a983-0abfce2a22b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:12.504465 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4313/8540] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:30:12 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:30:12.508921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9e319-453d-4351-a615-13c88934544c admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:12.567168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9e319-453d-4351-a615-13c88934544c admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:12.572011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c085f-5a60-4401-8653-b6fec14ff254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:12.572661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c085f-5a60-4401-8653-b6fec14ff254 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:12.572944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c085f-5a60-4401-8653-b6fec14ff254 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:12.573219 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c085f-5a60-4401-8653-b6fec14ff254 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:12.573928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c085f-5a60-4401-8653-b6fec14ff254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:12.575832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c085f-5a60-4401-8653-b6fec14ff254 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:12.600316 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4228/8541] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:30:12 2021] POST /identity/v3/projects => generated 391 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:30:12.604565 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b4c58-b550-45e3-a983-0abfce2a22b1 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:12.615659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b4c58-b550-45e3-a983-0abfce2a22b1 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:12.670234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5378a-7213-405a-bbd4-6792fd6724be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:12.670969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5378a-7213-405a-bbd4-6792fd6724be admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:12.671270 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5378a-7213-405a-bbd4-6792fd6724be admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:12.671527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5378a-7213-405a-bbd4-6792fd6724be admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:12.672217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5378a-7213-405a-bbd4-6792fd6724be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:12.674104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5378a-7213-405a-bbd4-6792fd6724be admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:12.697126 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4314/8542] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:30:12 2021] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:30:12.701742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c085f-5a60-4401-8653-b6fec14ff254 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:12.715192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c085f-5a60-4401-8653-b6fec14ff254 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:12.720866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5757c-8079-4012-822c-dcc0963a75f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:12.722065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5757c-8079-4012-822c-dcc0963a75f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:12.722486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5757c-8079-4012-822c-dcc0963a75f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:12.722801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5757c-8079-4012-822c-dcc0963a75f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:12.723726 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5757c-8079-4012-822c-dcc0963a75f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:12.725527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5757c-8079-4012-822c-dcc0963a75f3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:12.738351 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4229/8543] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:30:12 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:30:12.742589 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5378a-7213-405a-bbd4-6792fd6724be admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:12.754621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5378a-7213-405a-bbd4-6792fd6724be admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:12.760980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f743f3-677f-481a-9579-0438d330de8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:12.762427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f743f3-677f-481a-9579-0438d330de8f admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:12.763007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f743f3-677f-481a-9579-0438d330de8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:12.763679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f743f3-677f-481a-9579-0438d330de8f admin admin] PATH_INFO: `/v3/projects/13323e42804f45bfa615f57dc06a356a/users/5a79698c2f37433aabb73db7e8a11b77/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:12.783136 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f743f3-677f-481a-9579-0438d330de8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=13323e42804f45bfa615f57dc06a356a, user_id=5a79698c2f37433aabb73db7e8a11b77, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:12.786319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f743f3-677f-481a-9579-0438d330de8f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:12.798452 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4315/8544] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:30:12 2021] PUT /identity/v3/projects/13323e42804f45bfa615f57dc06a356a/users/5a79698c2f37433aabb73db7e8a11b77/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:30:12.804461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5757c-8079-4012-822c-dcc0963a75f3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:12.814299 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5757c-8079-4012-822c-dcc0963a75f3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:12.869376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40e833-2078-46c2-b3b4-c9e79b017965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:12.870037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40e833-2078-46c2-b3b4-c9e79b017965 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:12.870350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40e833-2078-46c2-b3b4-c9e79b017965 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:12.870630 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40e833-2078-46c2-b3b4-c9e79b017965 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:12.871352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40e833-2078-46c2-b3b4-c9e79b017965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:12.872929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40e833-2078-46c2-b3b4-c9e79b017965 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:12.884179 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4230/8545] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:30:12 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:30:12.888639 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f743f3-677f-481a-9579-0438d330de8f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:12.899095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f743f3-677f-481a-9579-0438d330de8f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:12.903737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f1958-1da1-46d8-859a-d215381b8b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:12.904633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f1958-1da1-46d8-859a-d215381b8b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:12.904916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f1958-1da1-46d8-859a-d215381b8b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:12.905195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f1958-1da1-46d8-859a-d215381b8b84 admin admin] PATH_INFO: `/v3/projects/13323e42804f45bfa615f57dc06a356a/users/5a79698c2f37433aabb73db7e8a11b77/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:12.907255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f1958-1da1-46d8-859a-d215381b8b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13323e42804f45bfa615f57dc06a356a, user_id=5a79698c2f37433aabb73db7e8a11b77, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:12.910422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f1958-1da1-46d8-859a-d215381b8b84 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:12.920213 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4316/8546] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:30:12 2021] PUT /identity/v3/projects/13323e42804f45bfa615f57dc06a356a/users/5a79698c2f37433aabb73db7e8a11b77/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:30:12.931156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2648d7-535e-49a5-9ad2-c24d589fa43d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:12.931449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2648d7-535e-49a5-9ad2-c24d589fa43d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:12.931731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2648d7-535e-49a5-9ad2-c24d589fa43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:12.957710 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6b2648d7-535e-49a5-9ad2-c24d589fa43d None None] MFA Rules not processed for user `5a79698c2f37433aabb73db7e8a11b77`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:30:12.958941 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6b2648d7-535e-49a5-9ad2-c24d589fa43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:13.024095 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4231/8547] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:30:12 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:30:13.075417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b5ce5-8734-42d7-af11-35df31203ef9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:13.076003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b5ce5-8734-42d7-af11-35df31203ef9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:13.076003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b5ce5-8734-42d7-af11-35df31203ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:13.093774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2a9b5ce5-8734-42d7-af11-35df31203ef9 None None] MFA Rules not processed for user `38bad590d33c4304b6a7908e1d3b43e3`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:30:13.094982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2a9b5ce5-8734-42d7-af11-35df31203ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:13.151188 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4317/8548] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:30:13 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:30:13.164239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2648d7-535e-49a5-9ad2-c24d589fa43d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:13.165625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6b2648d7-535e-49a5-9ad2-c24d589fa43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:13.243632 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2648d7-535e-49a5-9ad2-c24d589fa43d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:13.249233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18f983-b7cf-4708-ab83-729e7a9f1f2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:13.249881 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18f983-b7cf-4708-ab83-729e7a9f1f2d service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:13.250168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18f983-b7cf-4708-ab83-729e7a9f1f2d service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:13.250481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18f983-b7cf-4708-ab83-729e7a9f1f2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:13.258123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18f983-b7cf-4708-ab83-729e7a9f1f2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:13.259754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18f983-b7cf-4708-ab83-729e7a9f1f2d service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:13.269022 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4232/8549] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:30:13 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:30:13.743956 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b5ce5-8734-42d7-af11-35df31203ef9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:13.745430 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2a9b5ce5-8734-42d7-af11-35df31203ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:13.815780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b5ce5-8734-42d7-af11-35df31203ef9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:13.821283 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039aec7-1f18-4c6a-ae6a-f8fd9c17f37b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:13.822108 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039aec7-1f18-4c6a-ae6a-f8fd9c17f37b service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:13.822419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039aec7-1f18-4c6a-ae6a-f8fd9c17f37b service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:13.822697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039aec7-1f18-4c6a-ae6a-f8fd9c17f37b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:13.824431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c039aec7-1f18-4c6a-ae6a-f8fd9c17f37b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:13.837724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039aec7-1f18-4c6a-ae6a-f8fd9c17f37b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:13.839306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039aec7-1f18-4c6a-ae6a-f8fd9c17f37b service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:13.851158 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4318/8550] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:30:13 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:30:16.224179 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18f983-b7cf-4708-ab83-729e7a9f1f2d service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:16.244985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18f983-b7cf-4708-ab83-729e7a9f1f2d service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:16.251978 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10656ad3-a227-4c9c-aad7-05f3dcadd338 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:16.253214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10656ad3-a227-4c9c-aad7-05f3dcadd338 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:16.253512 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10656ad3-a227-4c9c-aad7-05f3dcadd338 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:16.258831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10656ad3-a227-4c9c-aad7-05f3dcadd338 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:16.260976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-10656ad3-a227-4c9c-aad7-05f3dcadd338 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:16.280119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10656ad3-a227-4c9c-aad7-05f3dcadd338 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:16.281745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10656ad3-a227-4c9c-aad7-05f3dcadd338 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:16.296394 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4233/8551] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:30:16 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:30:20.876552 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039aec7-1f18-4c6a-ae6a-f8fd9c17f37b service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:20.878718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c039aec7-1f18-4c6a-ae6a-f8fd9c17f37b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:20.898445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039aec7-1f18-4c6a-ae6a-f8fd9c17f37b service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:20.903893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0d691-7aad-451e-90ea-be1a93f4985b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:20.904528 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0d691-7aad-451e-90ea-be1a93f4985b service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:20.904807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0d691-7aad-451e-90ea-be1a93f4985b service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:20.905079 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0d691-7aad-451e-90ea-be1a93f4985b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:20.906819 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9fb0d691-7aad-451e-90ea-be1a93f4985b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:20.921320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0d691-7aad-451e-90ea-be1a93f4985b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:20.923062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0d691-7aad-451e-90ea-be1a93f4985b service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:20.936989 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4319/8552] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:30:20 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:30:23.174815 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10656ad3-a227-4c9c-aad7-05f3dcadd338 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:23.188639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10656ad3-a227-4c9c-aad7-05f3dcadd338 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:23.194659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e4200-f4e3-4832-a250-2bd3c9636f36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:23.195281 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e4200-f4e3-4832-a250-2bd3c9636f36 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:23.195564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e4200-f4e3-4832-a250-2bd3c9636f36 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:23.195846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e4200-f4e3-4832-a250-2bd3c9636f36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:23.204251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e4200-f4e3-4832-a250-2bd3c9636f36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:23.205804 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e4200-f4e3-4832-a250-2bd3c9636f36 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:23.215053 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4234/8553] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:30:23 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:30:23.230007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78babbf5-dda1-4a89-a7ce-9f545d616c3a None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:23.230643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78babbf5-dda1-4a89-a7ce-9f545d616c3a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:23.230772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78babbf5-dda1-4a89-a7ce-9f545d616c3a None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:23.232707 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4320/8554] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 21:30:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 21:30:23.237921 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e4200-f4e3-4832-a250-2bd3c9636f36 service nova] Authenticating service token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 21:30:23.252080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e4200-f4e3-4832-a250-2bd3c9636f36 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:23.260789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e4200-f4e3-4832-a250-2bd3c9636f36 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:23.265331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb7011-ee7b-4502-9769-c35daba3b200 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79698c2f37433aabb73db7e8a11b77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13323e42804f45bfa615f57dc06a356a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:23.266174 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb7011-ee7b-4502-9769-c35daba3b200 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:23.266495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb7011-ee7b-4502-9769-c35daba3b200 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:23.266801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb7011-ee7b-4502-9769-c35daba3b200 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] PATH_INFO: `/v3/projects/13323e42804f45bfa615f57dc06a356a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:23.268009 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb7011-ee7b-4502-9769-c35daba3b200 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] RBAC: Authorizing `identity:get_project(project_id=13323e42804f45bfa615f57dc06a356a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:23.269764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb7011-ee7b-4502-9769-c35daba3b200 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:23.271476 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4235/8555] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 21:30:23 2021] GET /identity/v3/projects/13323e42804f45bfa615f57dc06a356a => generated 391 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:30:23.421862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78babbf5-dda1-4a89-a7ce-9f545d616c3a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:23.423575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-78babbf5-dda1-4a89-a7ce-9f545d616c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:23.482855 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78babbf5-dda1-4a89-a7ce-9f545d616c3a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:23.486401 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e1733-8e2b-4ab8-9f62-1ab63fc0be32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:23.487035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e1733-8e2b-4ab8-9f62-1ab63fc0be32 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:23.487315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e1733-8e2b-4ab8-9f62-1ab63fc0be32 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:23.487590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e1733-8e2b-4ab8-9f62-1ab63fc0be32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:23.489910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-689e1733-8e2b-4ab8-9f62-1ab63fc0be32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:23.501392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e1733-8e2b-4ab8-9f62-1ab63fc0be32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:23.502849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e1733-8e2b-4ab8-9f62-1ab63fc0be32 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:23.512925 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4321/8556] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:30:23 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:30:23.649263 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea69b90-9300-4b96-9f84-fd8b698dc451 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:23.649579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea69b90-9300-4b96-9f84-fd8b698dc451 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:23.649858 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea69b90-9300-4b96-9f84-fd8b698dc451 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:23.651708 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4236/8557] 10.222.0.13 () {54 vars in 912 bytes} [Sat Dec 18 21:30:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 21:30:23.656787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e1733-8e2b-4ab8-9f62-1ab63fc0be32 service neutron] Authenticating service token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 18 21:30:23.672702 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e1733-8e2b-4ab8-9f62-1ab63fc0be32 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:23.682962 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e1733-8e2b-4ab8-9f62-1ab63fc0be32 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:23.687927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfffa6-11d7-4dff-b89d-0ba183ce3625 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79698c2f37433aabb73db7e8a11b77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13323e42804f45bfa615f57dc06a356a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:23.688825 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfffa6-11d7-4dff-b89d-0ba183ce3625 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:23.689105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfffa6-11d7-4dff-b89d-0ba183ce3625 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:23.689379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfffa6-11d7-4dff-b89d-0ba183ce3625 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] PATH_INFO: `/v3/projects/13323e42804f45bfa615f57dc06a356a` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:23.690673 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfffa6-11d7-4dff-b89d-0ba183ce3625 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] RBAC: Authorizing `identity:get_project(project_id=13323e42804f45bfa615f57dc06a356a)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:23.692491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfffa6-11d7-4dff-b89d-0ba183ce3625 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:23.694217 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4322/8558] 10.222.0.13 () {58 vars in 1443 bytes} [Sat Dec 18 21:30:23 2021] GET /identity/v3/projects/13323e42804f45bfa615f57dc06a356a => generated 391 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:30:23.838745 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea69b90-9300-4b96-9f84-fd8b698dc451 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:23.852156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea69b90-9300-4b96-9f84-fd8b698dc451 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:23.855684 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6d082-4f31-450a-a184-2532e1e14d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:23.856308 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6d082-4f31-450a-a184-2532e1e14d19 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:23.856590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6d082-4f31-450a-a184-2532e1e14d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:23.856866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6d082-4f31-450a-a184-2532e1e14d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:23.858611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e5f6d082-4f31-450a-a184-2532e1e14d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:23.870012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6d082-4f31-450a-a184-2532e1e14d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:23.871458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6d082-4f31-450a-a184-2532e1e14d19 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:23.881309 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4237/8559] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:30:23 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:30:26.513028 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfffa6-11d7-4dff-b89d-0ba183ce3625 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:26.573940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfffa6-11d7-4dff-b89d-0ba183ce3625 tempest-ServersAdminNegativeTestJSON-526570926 tempest-ServersAdminNegativeTestJSON-526570926-project-admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:26.578460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474f0df-f258-4fc8-b924-557cf9883657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:26.579305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474f0df-f258-4fc8-b924-557cf9883657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:26.579586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474f0df-f258-4fc8-b924-557cf9883657 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:26.579861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474f0df-f258-4fc8-b924-557cf9883657 admin admin] PATH_INFO: `/v3/users/38bad590d33c4304b6a7908e1d3b43e3` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:26.581051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474f0df-f258-4fc8-b924-557cf9883657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38bad590d33c4304b6a7908e1d3b43e3)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:26.583017 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474f0df-f258-4fc8-b924-557cf9883657 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:26.628845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b474f0df-f258-4fc8-b924-557cf9883657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38bad590d33c4304b6a7908e1d3b43e3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:26.635435 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b474f0df-f258-4fc8-b924-557cf9883657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38bad590d33c4304b6a7908e1d3b43e3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:26.636083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b474f0df-f258-4fc8-b924-557cf9883657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38bad590d33c4304b6a7908e1d3b43e3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:26.647352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b474f0df-f258-4fc8-b924-557cf9883657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38bad590d33c4304b6a7908e1d3b43e3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:26.654888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b474f0df-f258-4fc8-b924-557cf9883657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38bad590d33c4304b6a7908e1d3b43e3'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:26.661209 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4323/8560] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:30:26 2021] DELETE /identity/v3/users/38bad590d33c4304b6a7908e1d3b43e3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:30:26.665852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5953576-075e-4be1-b9ee-f37e3cee1b6e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:26.666339 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5953576-075e-4be1-b9ee-f37e3cee1b6e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:26.666437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5953576-075e-4be1-b9ee-f37e3cee1b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:26.684669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b5953576-075e-4be1-b9ee-f37e3cee1b6e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:30:26.685861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b5953576-075e-4be1-b9ee-f37e3cee1b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:26.742387 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4238/8561] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:30:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:30:26.752700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474f0df-f258-4fc8-b924-557cf9883657 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:26.754125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b474f0df-f258-4fc8-b924-557cf9883657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:26.825932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474f0df-f258-4fc8-b924-557cf9883657 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:26.829664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de0c2a-9254-4485-a0bf-1aaeefad8815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:26.830356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de0c2a-9254-4485-a0bf-1aaeefad8815 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:26.830658 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de0c2a-9254-4485-a0bf-1aaeefad8815 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:26.830930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de0c2a-9254-4485-a0bf-1aaeefad8815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:26.841205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de0c2a-9254-4485-a0bf-1aaeefad8815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:26.842688 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de0c2a-9254-4485-a0bf-1aaeefad8815 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:26.854177 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4324/8562] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:30:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:30:27.017441 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5953576-075e-4be1-b9ee-f37e3cee1b6e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:27.019091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b5953576-075e-4be1-b9ee-f37e3cee1b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:27.032621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5953576-075e-4be1-b9ee-f37e3cee1b6e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:27.037944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:27.038841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:27.039130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:27.039487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf admin admin] PATH_INFO: `/v3/projects/6f52949ca7754cb0bb38b4fa73ca59e5` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:27.040668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f52949ca7754cb0bb38b4fa73ca59e5)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:27.042596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:27.088170 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f52949ca7754cb0bb38b4fa73ca59e5', 'request_id': 'req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:27.099962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f52949ca7754cb0bb38b4fa73ca59e5', 'request_id': 'req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:27.102096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f52949ca7754cb0bb38b4fa73ca59e5', 'request_id': 'req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:27.115142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf admin admin] The token cache is being invalidate because project 6f52949ca7754cb0bb38b4fa73ca59e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:30:27.115459 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:27.116082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:27.117608 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4239/8563] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:30:27 2021] DELETE /identity/v3/projects/6f52949ca7754cb0bb38b4fa73ca59e5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:30:27.122924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de0c2a-9254-4485-a0bf-1aaeefad8815 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:27.132536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de0c2a-9254-4485-a0bf-1aaeefad8815 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:27.187060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cccad-d3ca-480f-b383-264033aa3e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:27.187911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cccad-d3ca-480f-b383-264033aa3e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:27.188188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cccad-d3ca-480f-b383-264033aa3e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:27.188460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cccad-d3ca-480f-b383-264033aa3e42 admin admin] PATH_INFO: `/v3/users/5a79698c2f37433aabb73db7e8a11b77` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:27.189667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cccad-d3ca-480f-b383-264033aa3e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a79698c2f37433aabb73db7e8a11b77)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:27.191722 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cccad-d3ca-480f-b383-264033aa3e42 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:27.236066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-240cccad-d3ca-480f-b383-264033aa3e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a79698c2f37433aabb73db7e8a11b77'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:27.242752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-240cccad-d3ca-480f-b383-264033aa3e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a79698c2f37433aabb73db7e8a11b77'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:27.243411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-240cccad-d3ca-480f-b383-264033aa3e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a79698c2f37433aabb73db7e8a11b77'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:27.254872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-240cccad-d3ca-480f-b383-264033aa3e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a79698c2f37433aabb73db7e8a11b77'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:27.261729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-240cccad-d3ca-480f-b383-264033aa3e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a79698c2f37433aabb73db7e8a11b77'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:27.267556 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4325/8564] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:30:27 2021] DELETE /identity/v3/users/5a79698c2f37433aabb73db7e8a11b77 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:30:27.527930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:27.529394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:27.545586 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eb7ab-5e26-478d-8dbd-30d5679fabdf admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:27.602093 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1da7d1-9619-4c8f-8ce4-22b96eed265f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:27.602996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1da7d1-9619-4c8f-8ce4-22b96eed265f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:27.603279 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1da7d1-9619-4c8f-8ce4-22b96eed265f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:27.603554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1da7d1-9619-4c8f-8ce4-22b96eed265f admin admin] PATH_INFO: `/v3/projects/13323e42804f45bfa615f57dc06a356a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:27.604737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1da7d1-9619-4c8f-8ce4-22b96eed265f admin admin] RBAC: Authorizing `identity:delete_project(project_id=13323e42804f45bfa615f57dc06a356a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:27.606652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1da7d1-9619-4c8f-8ce4-22b96eed265f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:27.649825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1d1da7d1-9619-4c8f-8ce4-22b96eed265f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13323e42804f45bfa615f57dc06a356a', 'request_id': 'req-1d1da7d1-9619-4c8f-8ce4-22b96eed265f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:27.655683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1d1da7d1-9619-4c8f-8ce4-22b96eed265f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13323e42804f45bfa615f57dc06a356a', 'request_id': 'req-1d1da7d1-9619-4c8f-8ce4-22b96eed265f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:27.661514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1d1da7d1-9619-4c8f-8ce4-22b96eed265f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13323e42804f45bfa615f57dc06a356a', 'request_id': 'req-1d1da7d1-9619-4c8f-8ce4-22b96eed265f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:27.673082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1d1da7d1-9619-4c8f-8ce4-22b96eed265f admin admin] The token cache is being invalidate because project 13323e42804f45bfa615f57dc06a356a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:30:27.673665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1d1da7d1-9619-4c8f-8ce4-22b96eed265f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:27.673972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1d1da7d1-9619-4c8f-8ce4-22b96eed265f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:30:27.675536 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4240/8565] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:30:27 2021] DELETE /identity/v3/projects/13323e42804f45bfa615f57dc06a356a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:30:27.682365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a469c-df3f-4bca-abba-22cb5cff27eb None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:27.682838 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a469c-df3f-4bca-abba-22cb5cff27eb None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:27.683053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a469c-df3f-4bca-abba-22cb5cff27eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:27.702507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b61a469c-df3f-4bca-abba-22cb5cff27eb None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:30:27.703701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b61a469c-df3f-4bca-abba-22cb5cff27eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:27.760973 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4326/8566] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:30:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:30:27.769983 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b347d7-9fe5-442b-8ac7-a9b503271cbf None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:27.770306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b347d7-9fe5-442b-8ac7-a9b503271cbf None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:27.770645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b347d7-9fe5-442b-8ac7-a9b503271cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:27.790063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a7b347d7-9fe5-442b-8ac7-a9b503271cbf None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:30:27.791275 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a7b347d7-9fe5-442b-8ac7-a9b503271cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:27.799152 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4241/8567] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:30:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:30:27.803438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a469c-df3f-4bca-abba-22cb5cff27eb None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:27.812787 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a469c-df3f-4bca-abba-22cb5cff27eb None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:27.817309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e779218-735e-4887-be0a-57370bbda616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:27.817946 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e779218-735e-4887-be0a-57370bbda616 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:27.818223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e779218-735e-4887-be0a-57370bbda616 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:27.818533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e779218-735e-4887-be0a-57370bbda616 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:27.819249 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e779218-735e-4887-be0a-57370bbda616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:30:27.819549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e779218-735e-4887-be0a-57370bbda616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:27.821146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e779218-735e-4887-be0a-57370bbda616 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:27.833046 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4327/8568] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:30:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:30:27.837535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b347d7-9fe5-442b-8ac7-a9b503271cbf None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:27.846562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b347d7-9fe5-442b-8ac7-a9b503271cbf None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:27.851771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae50323-b5da-4090-b965-587f0f5d002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:27.852482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae50323-b5da-4090-b965-587f0f5d002b admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:27.852785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae50323-b5da-4090-b965-587f0f5d002b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:27.853061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae50323-b5da-4090-b965-587f0f5d002b admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:27.853760 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae50323-b5da-4090-b965-587f0f5d002b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:27.855650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae50323-b5da-4090-b965-587f0f5d002b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:27.880392 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4242/8569] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:30:27 2021] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:30:27.885255 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e779218-735e-4887-be0a-57370bbda616 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:27.895447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e779218-735e-4887-be0a-57370bbda616 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:27.949406 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c61875-0160-49d9-a9db-c3a19faaf9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:27.950063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c61875-0160-49d9-a9db-c3a19faaf9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:27.950379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c61875-0160-49d9-a9db-c3a19faaf9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:27.950656 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c61875-0160-49d9-a9db-c3a19faaf9d5 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:27.951353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c61875-0160-49d9-a9db-c3a19faaf9d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:27.953269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c61875-0160-49d9-a9db-c3a19faaf9d5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:27.971882 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4328/8570] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:30:27 2021] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:30:27.976452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae50323-b5da-4090-b965-587f0f5d002b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:27.986454 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae50323-b5da-4090-b965-587f0f5d002b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:27.991598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c7e69-42b2-4edc-b018-039f9e364df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:27.992244 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c7e69-42b2-4edc-b018-039f9e364df9 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:27.992528 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c7e69-42b2-4edc-b018-039f9e364df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:27.992807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c7e69-42b2-4edc-b018-039f9e364df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:27.993579 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c7e69-42b2-4edc-b018-039f9e364df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:27.995159 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c7e69-42b2-4edc-b018-039f9e364df9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:28.005613 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4243/8571] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:30:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:30:28.009382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c61875-0160-49d9-a9db-c3a19faaf9d5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:28.018982 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c61875-0160-49d9-a9db-c3a19faaf9d5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:28.024184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbe98c-f900-441f-a0e6-4e0b5d237910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:28.024768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbe98c-f900-441f-a0e6-4e0b5d237910 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:28.025053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbe98c-f900-441f-a0e6-4e0b5d237910 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:28.025330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbe98c-f900-441f-a0e6-4e0b5d237910 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:28.026061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbe98c-f900-441f-a0e6-4e0b5d237910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:28.027666 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbe98c-f900-441f-a0e6-4e0b5d237910 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:28.037315 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4329/8572] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:30:28 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:30:28.041493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c7e69-42b2-4edc-b018-039f9e364df9 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:28.051304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c7e69-42b2-4edc-b018-039f9e364df9 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:28.055820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cbb15-0bac-4f65-821a-86f3a3e47420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:28.056682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cbb15-0bac-4f65-821a-86f3a3e47420 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:28.056965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cbb15-0bac-4f65-821a-86f3a3e47420 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:28.057238 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cbb15-0bac-4f65-821a-86f3a3e47420 admin admin] PATH_INFO: `/v3/projects/68c8fcdf62d4488494c91a4cb55c2456/users/a862e89dfc994d3fbbbdb0a08826d554/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:28.071628 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6cbb15-0bac-4f65-821a-86f3a3e47420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c8fcdf62d4488494c91a4cb55c2456, user_id=a862e89dfc994d3fbbbdb0a08826d554, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:28.074514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6cbb15-0bac-4f65-821a-86f3a3e47420 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:28.087592 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4244/8573] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:30:28 2021] PUT /identity/v3/projects/68c8fcdf62d4488494c91a4cb55c2456/users/a862e89dfc994d3fbbbdb0a08826d554/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:30:28.092693 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8818f-191f-4389-acd2-9e0ca3763b5a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:28.093035 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8818f-191f-4389-acd2-9e0ca3763b5a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:28.093326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8818f-191f-4389-acd2-9e0ca3763b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:28.110747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2ca8818f-191f-4389-acd2-9e0ca3763b5a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:30:28.111986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2ca8818f-191f-4389-acd2-9e0ca3763b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:28.170530 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4330/8574] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:30:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:30:28.180384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cbb15-0bac-4f65-821a-86f3a3e47420 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:28.182162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2d6cbb15-0bac-4f65-821a-86f3a3e47420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:28.240166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cbb15-0bac-4f65-821a-86f3a3e47420 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:28.243837 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c1e08-be37-4030-97ce-a4446737ca9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:28.244482 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c1e08-be37-4030-97ce-a4446737ca9b service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:28.244769 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c1e08-be37-4030-97ce-a4446737ca9b service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:28.245048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c1e08-be37-4030-97ce-a4446737ca9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:28.254495 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c1e08-be37-4030-97ce-a4446737ca9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:28.255901 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c1e08-be37-4030-97ce-a4446737ca9b service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:28.265046 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4245/8575] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:30:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:30:28.879031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d117c-3978-40e9-af04-974afeaca206 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:28.879560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d117c-3978-40e9-af04-974afeaca206 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:28.879560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d117c-3978-40e9-af04-974afeaca206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:28.906272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-df1d117c-3978-40e9-af04-974afeaca206 None None] MFA Rules not processed for user `a862e89dfc994d3fbbbdb0a08826d554`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:30:28.907535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-df1d117c-3978-40e9-af04-974afeaca206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:28.971124 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4331/8576] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:30:28 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:30:28.983909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71edf47-f0ae-40d0-bf28-0c3054108619 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:28.984458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71edf47-f0ae-40d0-bf28-0c3054108619 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:28.984458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71edf47-f0ae-40d0-bf28-0c3054108619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:29.001928 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c71edf47-f0ae-40d0-bf28-0c3054108619 None None] MFA Rules not processed for user `a862e89dfc994d3fbbbdb0a08826d554`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:30:29.003220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c71edf47-f0ae-40d0-bf28-0c3054108619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:29.010874 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4246/8577] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:30:28 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:30:29.023168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d117c-3978-40e9-af04-974afeaca206 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:29.025544 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-df1d117c-3978-40e9-af04-974afeaca206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:29.100522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d117c-3978-40e9-af04-974afeaca206 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:29.106063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c0709-a10b-4beb-8866-397bd49671a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:29.106744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c0709-a10b-4beb-8866-397bd49671a1 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:29.107030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c0709-a10b-4beb-8866-397bd49671a1 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:29.107309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c0709-a10b-4beb-8866-397bd49671a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:29.115022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c0709-a10b-4beb-8866-397bd49671a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:29.116593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c0709-a10b-4beb-8866-397bd49671a1 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:29.126889 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4332/8578] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:30:29 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:30:39.257900 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71edf47-f0ae-40d0-bf28-0c3054108619 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:39.259273 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c71edf47-f0ae-40d0-bf28-0c3054108619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:39.274292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71edf47-f0ae-40d0-bf28-0c3054108619 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:39.278083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44483a-8c7b-40dc-9fe3-8bb02aa94e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:39.278764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44483a-8c7b-40dc-9fe3-8bb02aa94e8b service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:39.279053 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44483a-8c7b-40dc-9fe3-8bb02aa94e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:39.279335 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44483a-8c7b-40dc-9fe3-8bb02aa94e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:39.281107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1a44483a-8c7b-40dc-9fe3-8bb02aa94e8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:39.293468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44483a-8c7b-40dc-9fe3-8bb02aa94e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:39.294985 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44483a-8c7b-40dc-9fe3-8bb02aa94e8b service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:39.305718 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4247/8579] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:30:39 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:30:39.395984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319d22f-459e-4bec-bd75-d69e17f2131a None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:39.396533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319d22f-459e-4bec-bd75-d69e17f2131a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:39.396533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319d22f-459e-4bec-bd75-d69e17f2131a None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:39.398342 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4333/8580] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 21:30:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 21:30:39.403475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795148c-f203-47eb-96a8-f48103f0ea5d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:39.403767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795148c-f203-47eb-96a8-f48103f0ea5d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:39.404046 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795148c-f203-47eb-96a8-f48103f0ea5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:39.449926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3795148c-f203-47eb-96a8-f48103f0ea5d None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:30:39.451156 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3795148c-f203-47eb-96a8-f48103f0ea5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:39.511049 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4248/8581] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:30:39 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:30:39.531846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319d22f-459e-4bec-bd75-d69e17f2131a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:30:39.533502 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2319d22f-459e-4bec-bd75-d69e17f2131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:30:39.552230 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319d22f-459e-4bec-bd75-d69e17f2131a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:30:39.557188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fdba2-c532-4b32-9e91-20c3e64620fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:30:39.557823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fdba2-c532-4b32-9e91-20c3e64620fd service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:30:39.558105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fdba2-c532-4b32-9e91-20c3e64620fd service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:30:39.558428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fdba2-c532-4b32-9e91-20c3e64620fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:30:39.567461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fdba2-c532-4b32-9e91-20c3e64620fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:30:39.570165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fdba2-c532-4b32-9e91-20c3e64620fd service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:30:39.580031 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4334/8582] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:30:39 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:31:08.735262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795148c-f203-47eb-96a8-f48103f0ea5d None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:31:08.747562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795148c-f203-47eb-96a8-f48103f0ea5d None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:31:08.751223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b789a9-8a28-42ff-bfda-444ceae14172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:31:08.751917 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b789a9-8a28-42ff-bfda-444ceae14172 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:08.752203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b789a9-8a28-42ff-bfda-444ceae14172 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:08.752480 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b789a9-8a28-42ff-bfda-444ceae14172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:08.754278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-69b789a9-8a28-42ff-bfda-444ceae14172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:31:08.765724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b789a9-8a28-42ff-bfda-444ceae14172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:31:08.767155 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b789a9-8a28-42ff-bfda-444ceae14172 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:31:08.777103 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4249/8583] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:31:08 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:31:09.218416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fdba2-c532-4b32-9e91-20c3e64620fd service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:31:09.219841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-846fdba2-c532-4b32-9e91-20c3e64620fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:31:09.240882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fdba2-c532-4b32-9e91-20c3e64620fd service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:31:09.246902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd6241-05e5-48cb-94b4-438133a9b16f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:31:09.247161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd6241-05e5-48cb-94b4-438133a9b16f service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:09.247381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd6241-05e5-48cb-94b4-438133a9b16f service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:09.247669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd6241-05e5-48cb-94b4-438133a9b16f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:09.249493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3bfd6241-05e5-48cb-94b4-438133a9b16f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:31:09.264806 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd6241-05e5-48cb-94b4-438133a9b16f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:31:09.266438 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd6241-05e5-48cb-94b4-438133a9b16f service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:31:09.280907 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4335/8584] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:31:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:31:16.396989 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b789a9-8a28-42ff-bfda-444ceae14172 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:31:16.412074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b789a9-8a28-42ff-bfda-444ceae14172 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:31:16.417010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb86bc-99a5-47f0-b0f2-bb203de189f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:31:16.417906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb86bc-99a5-47f0-b0f2-bb203de189f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:16.418187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb86bc-99a5-47f0-b0f2-bb203de189f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:16.418502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb86bc-99a5-47f0-b0f2-bb203de189f2 admin admin] PATH_INFO: `/v3/users/a862e89dfc994d3fbbbdb0a08826d554` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:16.419699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb86bc-99a5-47f0-b0f2-bb203de189f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a862e89dfc994d3fbbbdb0a08826d554)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:31:16.421581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb86bc-99a5-47f0-b0f2-bb203de189f2 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:31:16.468976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-15bb86bc-99a5-47f0-b0f2-bb203de189f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a862e89dfc994d3fbbbdb0a08826d554'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:31:16.476289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-15bb86bc-99a5-47f0-b0f2-bb203de189f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a862e89dfc994d3fbbbdb0a08826d554'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:31:16.487909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-15bb86bc-99a5-47f0-b0f2-bb203de189f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a862e89dfc994d3fbbbdb0a08826d554'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:31:16.488590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-15bb86bc-99a5-47f0-b0f2-bb203de189f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a862e89dfc994d3fbbbdb0a08826d554'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:31:16.495705 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-15bb86bc-99a5-47f0-b0f2-bb203de189f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a862e89dfc994d3fbbbdb0a08826d554'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:31:16.501713 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4250/8585] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:31:16 2021] DELETE /identity/v3/users/a862e89dfc994d3fbbbdb0a08826d554 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:31:16.670889 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd6241-05e5-48cb-94b4-438133a9b16f service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:31:16.681916 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd6241-05e5-48cb-94b4-438133a9b16f service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:31:16.739604 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec80ba-441a-4598-87b4-b4b3fbf9cdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:31:16.740481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec80ba-441a-4598-87b4-b4b3fbf9cdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:16.740745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec80ba-441a-4598-87b4-b4b3fbf9cdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:16.741020 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec80ba-441a-4598-87b4-b4b3fbf9cdf1 admin admin] PATH_INFO: `/v3/projects/68c8fcdf62d4488494c91a4cb55c2456` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:16.742231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec80ba-441a-4598-87b4-b4b3fbf9cdf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c8fcdf62d4488494c91a4cb55c2456)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:31:16.744157 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec80ba-441a-4598-87b4-b4b3fbf9cdf1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:31:16.789101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-18ec80ba-441a-4598-87b4-b4b3fbf9cdf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c8fcdf62d4488494c91a4cb55c2456', 'request_id': 'req-18ec80ba-441a-4598-87b4-b4b3fbf9cdf1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:31:16.795538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-18ec80ba-441a-4598-87b4-b4b3fbf9cdf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c8fcdf62d4488494c91a4cb55c2456', 'request_id': 'req-18ec80ba-441a-4598-87b4-b4b3fbf9cdf1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:31:16.804423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-18ec80ba-441a-4598-87b4-b4b3fbf9cdf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c8fcdf62d4488494c91a4cb55c2456', 'request_id': 'req-18ec80ba-441a-4598-87b4-b4b3fbf9cdf1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:31:16.814978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-18ec80ba-441a-4598-87b4-b4b3fbf9cdf1 admin admin] The token cache is being invalidate because project 68c8fcdf62d4488494c91a4cb55c2456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:31:16.815309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-18ec80ba-441a-4598-87b4-b4b3fbf9cdf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:31:16.816453 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-18ec80ba-441a-4598-87b4-b4b3fbf9cdf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:31:16.818004 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4336/8586] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:31:16 2021] DELETE /identity/v3/projects/68c8fcdf62d4488494c91a4cb55c2456 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:31:16.824041 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5569d-48da-4213-891f-e3547e12041b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:16.824333 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5569d-48da-4213-891f-e3547e12041b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:16.824633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5569d-48da-4213-891f-e3547e12041b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:16.843036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-84f5569d-48da-4213-891f-e3547e12041b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:31:16.844248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-84f5569d-48da-4213-891f-e3547e12041b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:31:16.901560 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4251/8587] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:31:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:31:16.909269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5338b6-adb3-407e-ab8b-53c2c0003511 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:16.909611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5338b6-adb3-407e-ab8b-53c2c0003511 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:16.909895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5338b6-adb3-407e-ab8b-53c2c0003511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:16.927727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4d5338b6-adb3-407e-ab8b-53c2c0003511 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:31:16.928832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4d5338b6-adb3-407e-ab8b-53c2c0003511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:31:16.936584 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4337/8588] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:31:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:31:16.940663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5569d-48da-4213-891f-e3547e12041b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:31:16.951272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5569d-48da-4213-891f-e3547e12041b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:31:16.955831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa836fd0-50df-44e6-abae-87d7f38b6ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:31:16.957117 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa836fd0-50df-44e6-abae-87d7f38b6ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:16.957406 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa836fd0-50df-44e6-abae-87d7f38b6ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:16.957688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa836fd0-50df-44e6-abae-87d7f38b6ce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:16.958475 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa836fd0-50df-44e6-abae-87d7f38b6ce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:31:16.958789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa836fd0-50df-44e6-abae-87d7f38b6ce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:31:16.960374 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa836fd0-50df-44e6-abae-87d7f38b6ce1 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:31:16.971758 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4252/8589] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:31:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:31:16.975873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5338b6-adb3-407e-ab8b-53c2c0003511 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:31:16.984737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5338b6-adb3-407e-ab8b-53c2c0003511 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:31:16.989355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cb1cd-1357-4247-b9ba-d8db3319bdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:31:16.989988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cb1cd-1357-4247-b9ba-d8db3319bdc8 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:16.990364 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cb1cd-1357-4247-b9ba-d8db3319bdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:16.990646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cb1cd-1357-4247-b9ba-d8db3319bdc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:16.991326 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cb1cd-1357-4247-b9ba-d8db3319bdc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:31:16.993196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cb1cd-1357-4247-b9ba-d8db3319bdc8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:31:17.017745 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4338/8590] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:31:16 2021] POST /identity/v3/projects => generated 385 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:31:17.022584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa836fd0-50df-44e6-abae-87d7f38b6ce1 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:31:17.032569 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa836fd0-50df-44e6-abae-87d7f38b6ce1 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:31:17.087565 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802dee9-92fa-409e-863f-e6858e242b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:31:17.088251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802dee9-92fa-409e-863f-e6858e242b20 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:17.088545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802dee9-92fa-409e-863f-e6858e242b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:17.088824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802dee9-92fa-409e-863f-e6858e242b20 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:17.089533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802dee9-92fa-409e-863f-e6858e242b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:31:17.091487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802dee9-92fa-409e-863f-e6858e242b20 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:31:17.110444 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4253/8591] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:31:17 2021] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:31:17.115332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cb1cd-1357-4247-b9ba-d8db3319bdc8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:31:17.125481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cb1cd-1357-4247-b9ba-d8db3319bdc8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:31:17.130695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31a606-fb1e-4d05-a8a5-b150bf736392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:31:17.131339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31a606-fb1e-4d05-a8a5-b150bf736392 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:17.131622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31a606-fb1e-4d05-a8a5-b150bf736392 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:17.131898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31a606-fb1e-4d05-a8a5-b150bf736392 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:17.132617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31a606-fb1e-4d05-a8a5-b150bf736392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:31:17.134196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31a606-fb1e-4d05-a8a5-b150bf736392 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:31:17.144785 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4339/8592] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:31:17 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:31:17.148676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802dee9-92fa-409e-863f-e6858e242b20 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:31:17.158563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802dee9-92fa-409e-863f-e6858e242b20 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:31:17.163129 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff42f82-2d0e-4490-b725-5a2ccc1abea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:31:17.163775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff42f82-2d0e-4490-b725-5a2ccc1abea0 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:17.164061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff42f82-2d0e-4490-b725-5a2ccc1abea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:17.164337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff42f82-2d0e-4490-b725-5a2ccc1abea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:17.165063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff42f82-2d0e-4490-b725-5a2ccc1abea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:31:17.166692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff42f82-2d0e-4490-b725-5a2ccc1abea0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:31:17.177173 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4254/8593] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:31:17 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:31:17.181164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31a606-fb1e-4d05-a8a5-b150bf736392 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:31:17.191605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31a606-fb1e-4d05-a8a5-b150bf736392 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:31:17.196241 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7b93f-3d1c-4924-90f5-35dce99cd9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:31:17.197104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7b93f-3d1c-4924-90f5-35dce99cd9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:17.197391 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7b93f-3d1c-4924-90f5-35dce99cd9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:17.197670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7b93f-3d1c-4924-90f5-35dce99cd9bf admin admin] PATH_INFO: `/v3/projects/1fef6da50bfa450ba842674c07090fc1/users/3a774440d2524acfaecf6af8cfba1507/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:17.213482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7b93f-3d1c-4924-90f5-35dce99cd9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fef6da50bfa450ba842674c07090fc1, user_id=3a774440d2524acfaecf6af8cfba1507, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:31:17.216191 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7b93f-3d1c-4924-90f5-35dce99cd9bf admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:31:17.228463 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4340/8594] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:31:17 2021] PUT /identity/v3/projects/1fef6da50bfa450ba842674c07090fc1/users/3a774440d2524acfaecf6af8cfba1507/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:31:17.233472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436b73c-afac-4e26-bf75-fc2df76d9713 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:17.233762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436b73c-afac-4e26-bf75-fc2df76d9713 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:17.234071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436b73c-afac-4e26-bf75-fc2df76d9713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:17.251799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e436b73c-afac-4e26-bf75-fc2df76d9713 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:31:17.252977 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e436b73c-afac-4e26-bf75-fc2df76d9713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:31:17.308804 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4255/8595] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:31:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:31:17.319342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7b93f-3d1c-4924-90f5-35dce99cd9bf admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:31:17.320985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-93c7b93f-3d1c-4924-90f5-35dce99cd9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:31:17.377987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7b93f-3d1c-4924-90f5-35dce99cd9bf admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:31:17.382235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8676f36-b5e3-4ae0-b093-8d3e80f262b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:31:17.382929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8676f36-b5e3-4ae0-b093-8d3e80f262b3 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:17.383210 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8676f36-b5e3-4ae0-b093-8d3e80f262b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:17.383482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8676f36-b5e3-4ae0-b093-8d3e80f262b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:17.392254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8676f36-b5e3-4ae0-b093-8d3e80f262b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:31:17.393663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8676f36-b5e3-4ae0-b093-8d3e80f262b3 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:31:17.403135 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4341/8596] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:31:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:31:18.033407 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897fd2d-d5c5-4a9e-b8e2-c49bfb760b4c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:18.033910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897fd2d-d5c5-4a9e-b8e2-c49bfb760b4c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:18.034023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897fd2d-d5c5-4a9e-b8e2-c49bfb760b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:18.061197 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e897fd2d-d5c5-4a9e-b8e2-c49bfb760b4c None None] MFA Rules not processed for user `3a774440d2524acfaecf6af8cfba1507`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:31:18.062437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e897fd2d-d5c5-4a9e-b8e2-c49bfb760b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:31:18.131590 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4256/8597] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:31:18 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:31:18.145105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d3a52-20be-497e-a669-b332434a6189 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:18.145657 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d3a52-20be-497e-a669-b332434a6189 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:18.145769 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d3a52-20be-497e-a669-b332434a6189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:18.163648 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-115d3a52-20be-497e-a669-b332434a6189 None None] MFA Rules not processed for user `3a774440d2524acfaecf6af8cfba1507`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:31:18.164847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-115d3a52-20be-497e-a669-b332434a6189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:31:18.171756 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4342/8598] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:31:18 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:31:18.183872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897fd2d-d5c5-4a9e-b8e2-c49bfb760b4c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:31:18.185388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e897fd2d-d5c5-4a9e-b8e2-c49bfb760b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:31:18.259990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897fd2d-d5c5-4a9e-b8e2-c49bfb760b4c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:31:18.265450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35aa6f-4ca3-4bd2-be39-5ad0135259a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:31:18.266098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35aa6f-4ca3-4bd2-be39-5ad0135259a6 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:18.266426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35aa6f-4ca3-4bd2-be39-5ad0135259a6 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:18.266707 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35aa6f-4ca3-4bd2-be39-5ad0135259a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:18.276130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35aa6f-4ca3-4bd2-be39-5ad0135259a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:31:18.278145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35aa6f-4ca3-4bd2-be39-5ad0135259a6 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:31:18.287288 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4257/8599] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:31:18 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:31:30.362611 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b8c65-0c33-4810-b1a0-37a4a858815a None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:30.363197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b8c65-0c33-4810-b1a0-37a4a858815a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:30.363197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b8c65-0c33-4810-b1a0-37a4a858815a None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:30.364966 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4343/8600] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 21:31:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 21:31:30.370143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1496ea9-9430-4ae3-abbc-89b4a804c6d3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:30.370589 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1496ea9-9430-4ae3-abbc-89b4a804c6d3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:30.370765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1496ea9-9430-4ae3-abbc-89b4a804c6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:30.388827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-d1496ea9-9430-4ae3-abbc-89b4a804c6d3 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:31:30.390203 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d1496ea9-9430-4ae3-abbc-89b4a804c6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:31:30.454757 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4258/8601] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:31:30 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:31:30.476242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b8c65-0c33-4810-b1a0-37a4a858815a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:31:30.477917 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d15b8c65-0c33-4810-b1a0-37a4a858815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:31:30.496293 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b8c65-0c33-4810-b1a0-37a4a858815a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:31:30.501261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d1641-802d-4aac-a555-f7c566812eff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:31:30.501910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d1641-802d-4aac-a555-f7c566812eff service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:31:30.502196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d1641-802d-4aac-a555-f7c566812eff service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:31:30.502492 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d1641-802d-4aac-a555-f7c566812eff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:31:30.511525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d1641-802d-4aac-a555-f7c566812eff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:31:30.513114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d1641-802d-4aac-a555-f7c566812eff service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:31:30.523298 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4344/8602] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:31:30 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:32:05.190416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233c613-cb26-4761-bf4b-45a598fe172a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:05.190976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233c613-cb26-4761-bf4b-45a598fe172a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:05.190976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233c613-cb26-4761-bf4b-45a598fe172a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:05.210949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e233c613-cb26-4761-bf4b-45a598fe172a None None] MFA Rules not processed for user `3a774440d2524acfaecf6af8cfba1507`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:32:05.212210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e233c613-cb26-4761-bf4b-45a598fe172a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:32:05.220162 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4259/8603] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:32:05 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:32:15.783966 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23de6f-f9fd-49aa-a0c1-867aa3483170 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:15.784550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23de6f-f9fd-49aa-a0c1-867aa3483170 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:15.784550 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23de6f-f9fd-49aa-a0c1-867aa3483170 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:15.786278 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4345/8604] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 21:32:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 21:32:15.791490 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521b0b5-39fb-4df6-99d5-8d0817af7da4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:15.791955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521b0b5-39fb-4df6-99d5-8d0817af7da4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:15.792103 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521b0b5-39fb-4df6-99d5-8d0817af7da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:15.810679 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a521b0b5-39fb-4df6-99d5-8d0817af7da4 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:32:15.811889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a521b0b5-39fb-4df6-99d5-8d0817af7da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:32:15.822992 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4260/8605] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:32:15 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:32:15.845807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23de6f-f9fd-49aa-a0c1-867aa3483170 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:32:15.847643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9d23de6f-f9fd-49aa-a0c1-867aa3483170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:32:15.867583 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23de6f-f9fd-49aa-a0c1-867aa3483170 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:32:15.872775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824ce59-9e23-462b-be05-0fd85b9c8db7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:32:15.873410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824ce59-9e23-462b-be05-0fd85b9c8db7 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:15.873696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824ce59-9e23-462b-be05-0fd85b9c8db7 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:15.873975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824ce59-9e23-462b-be05-0fd85b9c8db7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:15.883381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824ce59-9e23-462b-be05-0fd85b9c8db7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:32:15.884950 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824ce59-9e23-462b-be05-0fd85b9c8db7 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:32:15.895241 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4346/8606] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:32:15 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:32:53.407773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521b0b5-39fb-4df6-99d5-8d0817af7da4 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:32:53.418721 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521b0b5-39fb-4df6-99d5-8d0817af7da4 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:32:53.423701 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae1884-7ea2-417c-b7b3-8af21bedf8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:32:53.424633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae1884-7ea2-417c-b7b3-8af21bedf8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:53.424963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae1884-7ea2-417c-b7b3-8af21bedf8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:53.425133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae1884-7ea2-417c-b7b3-8af21bedf8e9 admin admin] PATH_INFO: `/v3/users/3a774440d2524acfaecf6af8cfba1507` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:53.426467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae1884-7ea2-417c-b7b3-8af21bedf8e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a774440d2524acfaecf6af8cfba1507)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:32:53.429369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae1884-7ea2-417c-b7b3-8af21bedf8e9 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:32:53.475800 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c3ae1884-7ea2-417c-b7b3-8af21bedf8e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a774440d2524acfaecf6af8cfba1507'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:32:53.482768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c3ae1884-7ea2-417c-b7b3-8af21bedf8e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a774440d2524acfaecf6af8cfba1507'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:32:53.494458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c3ae1884-7ea2-417c-b7b3-8af21bedf8e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a774440d2524acfaecf6af8cfba1507'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:32:53.495157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c3ae1884-7ea2-417c-b7b3-8af21bedf8e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a774440d2524acfaecf6af8cfba1507'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:32:53.502172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c3ae1884-7ea2-417c-b7b3-8af21bedf8e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a774440d2524acfaecf6af8cfba1507'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:32:53.508657 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4261/8607] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:32:53 2021] DELETE /identity/v3/users/3a774440d2524acfaecf6af8cfba1507 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:32:53.683652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824ce59-9e23-462b-be05-0fd85b9c8db7 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:32:53.695936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824ce59-9e23-462b-be05-0fd85b9c8db7 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:32:53.757262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9684e-19bd-4cd0-92a1-ea11a989d5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:32:53.758104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9684e-19bd-4cd0-92a1-ea11a989d5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:53.758422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9684e-19bd-4cd0-92a1-ea11a989d5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:53.758694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9684e-19bd-4cd0-92a1-ea11a989d5f2 admin admin] PATH_INFO: `/v3/projects/1fef6da50bfa450ba842674c07090fc1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:53.759864 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd9684e-19bd-4cd0-92a1-ea11a989d5f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fef6da50bfa450ba842674c07090fc1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:32:53.761748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd9684e-19bd-4cd0-92a1-ea11a989d5f2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:32:53.805718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebd9684e-19bd-4cd0-92a1-ea11a989d5f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fef6da50bfa450ba842674c07090fc1', 'request_id': 'req-ebd9684e-19bd-4cd0-92a1-ea11a989d5f2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:32:53.811900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebd9684e-19bd-4cd0-92a1-ea11a989d5f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fef6da50bfa450ba842674c07090fc1', 'request_id': 'req-ebd9684e-19bd-4cd0-92a1-ea11a989d5f2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:32:53.820361 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebd9684e-19bd-4cd0-92a1-ea11a989d5f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fef6da50bfa450ba842674c07090fc1', 'request_id': 'req-ebd9684e-19bd-4cd0-92a1-ea11a989d5f2'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:32:53.831006 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebd9684e-19bd-4cd0-92a1-ea11a989d5f2 admin admin] The token cache is being invalidate because project 1fef6da50bfa450ba842674c07090fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:32:53.831298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebd9684e-19bd-4cd0-92a1-ea11a989d5f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:32:53.831923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-ebd9684e-19bd-4cd0-92a1-ea11a989d5f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:32:53.833447 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4347/8608] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:32:53 2021] DELETE /identity/v3/projects/1fef6da50bfa450ba842674c07090fc1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:32:53.839609 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344404b-57ad-4174-9a2b-26b3e8494d88 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:53.839930 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344404b-57ad-4174-9a2b-26b3e8494d88 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:53.840233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344404b-57ad-4174-9a2b-26b3e8494d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:53.858127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7344404b-57ad-4174-9a2b-26b3e8494d88 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:32:53.859337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7344404b-57ad-4174-9a2b-26b3e8494d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:32:53.917123 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4262/8609] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:32:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:32:53.925188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363b7c6-bc16-4ea3-841e-2a49d44e144a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:53.925478 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363b7c6-bc16-4ea3-841e-2a49d44e144a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:53.925783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363b7c6-bc16-4ea3-841e-2a49d44e144a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:53.945700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7363b7c6-bc16-4ea3-841e-2a49d44e144a None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:32:53.946936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7363b7c6-bc16-4ea3-841e-2a49d44e144a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:32:53.955299 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4348/8610] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:32:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:32:53.959587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344404b-57ad-4174-9a2b-26b3e8494d88 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:32:53.969178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344404b-57ad-4174-9a2b-26b3e8494d88 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:32:53.973724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a611e58-a3f5-4071-acf7-3ed157930def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:32:53.974422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a611e58-a3f5-4071-acf7-3ed157930def admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:53.974756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a611e58-a3f5-4071-acf7-3ed157930def admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:53.975035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a611e58-a3f5-4071-acf7-3ed157930def admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:53.975759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a611e58-a3f5-4071-acf7-3ed157930def admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:32:53.976067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a611e58-a3f5-4071-acf7-3ed157930def admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:32:53.977666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a611e58-a3f5-4071-acf7-3ed157930def admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:32:53.989026 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4263/8611] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:32:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:32:53.993582 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363b7c6-bc16-4ea3-841e-2a49d44e144a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:32:54.002586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363b7c6-bc16-4ea3-841e-2a49d44e144a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:32:54.007814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2e5c0-a85b-4c25-a553-0c0c40a8d4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:32:54.008442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2e5c0-a85b-4c25-a553-0c0c40a8d4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:54.008725 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2e5c0-a85b-4c25-a553-0c0c40a8d4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:54.009002 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2e5c0-a85b-4c25-a553-0c0c40a8d4a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:54.009732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2e5c0-a85b-4c25-a553-0c0c40a8d4a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:32:54.011649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2e5c0-a85b-4c25-a553-0c0c40a8d4a7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:32:54.035687 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4349/8612] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:32:53 2021] POST /identity/v3/projects => generated 379 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:32:54.039836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a611e58-a3f5-4071-acf7-3ed157930def admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:32:54.049458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a611e58-a3f5-4071-acf7-3ed157930def admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:32:54.108357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844076d4-136d-4e94-9d26-e5e9dae471e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:32:54.109033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844076d4-136d-4e94-9d26-e5e9dae471e0 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:54.109326 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844076d4-136d-4e94-9d26-e5e9dae471e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:54.109608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844076d4-136d-4e94-9d26-e5e9dae471e0 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:54.110349 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844076d4-136d-4e94-9d26-e5e9dae471e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:32:54.112256 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844076d4-136d-4e94-9d26-e5e9dae471e0 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:32:54.131913 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4264/8613] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:32:54 2021] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:32:54.136084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2e5c0-a85b-4c25-a553-0c0c40a8d4a7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:32:54.146314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2e5c0-a85b-4c25-a553-0c0c40a8d4a7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:32:54.150870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf54aa1-e223-415b-a110-7814b838f3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:32:54.151547 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf54aa1-e223-415b-a110-7814b838f3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:54.151831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf54aa1-e223-415b-a110-7814b838f3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:54.152109 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf54aa1-e223-415b-a110-7814b838f3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:54.152839 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf54aa1-e223-415b-a110-7814b838f3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:32:54.154570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf54aa1-e223-415b-a110-7814b838f3d0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:32:54.165217 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4350/8614] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:32:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:32:54.168940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844076d4-136d-4e94-9d26-e5e9dae471e0 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:32:54.179307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844076d4-136d-4e94-9d26-e5e9dae471e0 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:32:54.183913 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58876377-9fc1-42fb-864d-f29692922669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:32:54.184564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58876377-9fc1-42fb-864d-f29692922669 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:54.184853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58876377-9fc1-42fb-864d-f29692922669 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:54.185127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58876377-9fc1-42fb-864d-f29692922669 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:54.185846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58876377-9fc1-42fb-864d-f29692922669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:32:54.187456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58876377-9fc1-42fb-864d-f29692922669 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:32:54.197107 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4265/8615] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:32:54 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:32:54.201357 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf54aa1-e223-415b-a110-7814b838f3d0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:32:54.211075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf54aa1-e223-415b-a110-7814b838f3d0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:32:54.215858 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46071173-4c32-4eef-9349-863a8197a916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:32:54.216714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46071173-4c32-4eef-9349-863a8197a916 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:54.216994 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46071173-4c32-4eef-9349-863a8197a916 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:54.217266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46071173-4c32-4eef-9349-863a8197a916 admin admin] PATH_INFO: `/v3/projects/542852f38d9b4ee7a351cc80abbd3d19/users/8ad7185a2f28494a95c01e273e6f7212/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:54.231830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46071173-4c32-4eef-9349-863a8197a916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=542852f38d9b4ee7a351cc80abbd3d19, user_id=8ad7185a2f28494a95c01e273e6f7212, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:32:54.234441 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46071173-4c32-4eef-9349-863a8197a916 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:32:54.247700 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4351/8616] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:32:54 2021] PUT /identity/v3/projects/542852f38d9b4ee7a351cc80abbd3d19/users/8ad7185a2f28494a95c01e273e6f7212/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:32:54.252666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd727e4-8933-4f2f-ac7d-5c734072aa62 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:54.253056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd727e4-8933-4f2f-ac7d-5c734072aa62 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:54.253336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd727e4-8933-4f2f-ac7d-5c734072aa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:54.272435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-3fd727e4-8933-4f2f-ac7d-5c734072aa62 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:32:54.273621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3fd727e4-8933-4f2f-ac7d-5c734072aa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:32:54.329960 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4266/8617] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:32:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:32:54.339675 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46071173-4c32-4eef-9349-863a8197a916 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:32:54.341329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-46071173-4c32-4eef-9349-863a8197a916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:32:54.398990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46071173-4c32-4eef-9349-863a8197a916 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:32:54.402602 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb994383-ecc1-41b2-91b8-ad8e0b269c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:32:54.403239 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb994383-ecc1-41b2-91b8-ad8e0b269c46 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:54.403526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb994383-ecc1-41b2-91b8-ad8e0b269c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:54.403837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb994383-ecc1-41b2-91b8-ad8e0b269c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:54.413407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb994383-ecc1-41b2-91b8-ad8e0b269c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:32:54.415053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb994383-ecc1-41b2-91b8-ad8e0b269c46 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:32:54.424388 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4352/8618] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:32:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:32:58.390554 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04790a88-1aa0-4896-97bb-524153830f09 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:58.391101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04790a88-1aa0-4896-97bb-524153830f09 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:58.391211 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04790a88-1aa0-4896-97bb-524153830f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:58.418895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-04790a88-1aa0-4896-97bb-524153830f09 None None] MFA Rules not processed for user `8ad7185a2f28494a95c01e273e6f7212`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:32:58.420028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-04790a88-1aa0-4896-97bb-524153830f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:32:58.484324 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4267/8619] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:32:58 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:32:58.497497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb994383-ecc1-41b2-91b8-ad8e0b269c46 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:32:58.498978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fb994383-ecc1-41b2-91b8-ad8e0b269c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:32:58.572940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb994383-ecc1-41b2-91b8-ad8e0b269c46 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:32:58.578771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11d6e2-8f6b-49de-a926-217baa4f61c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:32:58.579416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11d6e2-8f6b-49de-a926-217baa4f61c6 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:32:58.579704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11d6e2-8f6b-49de-a926-217baa4f61c6 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:32:58.579986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11d6e2-8f6b-49de-a926-217baa4f61c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:32:58.588665 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11d6e2-8f6b-49de-a926-217baa4f61c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:32:58.590299 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11d6e2-8f6b-49de-a926-217baa4f61c6 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:32:58.599416 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4353/8620] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:32:58 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:33:00.312536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1096ac-2646-49a5-b695-575d6fea34bd None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:33:00.313019 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1096ac-2646-49a5-b695-575d6fea34bd None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:33:00.313125 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1096ac-2646-49a5-b695-575d6fea34bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:33:00.331747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5e1096ac-2646-49a5-b695-575d6fea34bd None None] MFA Rules not processed for user `8ad7185a2f28494a95c01e273e6f7212`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:33:00.332939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5e1096ac-2646-49a5-b695-575d6fea34bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:33:00.339863 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4268/8621] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:33:00 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:34:52.855517 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce41bdb-c003-4b07-85d1-b68e2d7a7503 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:34:52.856114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce41bdb-c003-4b07-85d1-b68e2d7a7503 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:34:52.856114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce41bdb-c003-4b07-85d1-b68e2d7a7503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:34:52.892598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-2ce41bdb-c003-4b07-85d1-b68e2d7a7503 None None] MFA Rules not processed for user `6f8eeb55c523480fb45d4bbb8afe8e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:34:52.893799 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2ce41bdb-c003-4b07-85d1-b68e2d7a7503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:34:52.909913 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4354/8622] 10.222.0.13 () {58 vars in 1061 bytes} [Sat Dec 18 21:34:52 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:34:52.916077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1096ac-2646-49a5-b695-575d6fea34bd None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:34:52.925192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1096ac-2646-49a5-b695-575d6fea34bd None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:34:52.929872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a3d5f-6ff6-40ef-adf4-6530c48f8129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:34:52.930841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a3d5f-6ff6-40ef-adf4-6530c48f8129 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:34:52.931127 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a3d5f-6ff6-40ef-adf4-6530c48f8129 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:34:52.931728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a3d5f-6ff6-40ef-adf4-6530c48f8129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:34:52.933690 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-432a3d5f-6ff6-40ef-adf4-6530c48f8129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:34:52.950003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a3d5f-6ff6-40ef-adf4-6530c48f8129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:34:52.951474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a3d5f-6ff6-40ef-adf4-6530c48f8129 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:34:52.964939 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4269/8623] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:34:52 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:34:53.339087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dd2be-a073-43b8-8578-f4e76b3bdbc3 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:34:53.339686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dd2be-a073-43b8-8578-f4e76b3bdbc3 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:34:53.339975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dd2be-a073-43b8-8578-f4e76b3bdbc3 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:34:53.341775 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4355/8624] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 21:34:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 21:34:53.347278 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23042e-6378-4c36-9bed-ec3dac3dd086 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:34:53.347647 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23042e-6378-4c36-9bed-ec3dac3dd086 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:34:53.348026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23042e-6378-4c36-9bed-ec3dac3dd086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:34:53.368942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7b23042e-6378-4c36-9bed-ec3dac3dd086 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:34:53.370230 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7b23042e-6378-4c36-9bed-ec3dac3dd086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:34:53.437591 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4270/8625] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:34:53 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:34:53.459043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dd2be-a073-43b8-8578-f4e76b3bdbc3 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:34:53.460809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-149dd2be-a073-43b8-8578-f4e76b3bdbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:34:53.479845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dd2be-a073-43b8-8578-f4e76b3bdbc3 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:34:53.484844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fd905-610d-4bd1-8847-ec57cddb1f9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:34:53.485469 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fd905-610d-4bd1-8847-ec57cddb1f9f service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:34:53.485752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fd905-610d-4bd1-8847-ec57cddb1f9f service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:34:53.486031 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fd905-610d-4bd1-8847-ec57cddb1f9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:34:53.494938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fd905-610d-4bd1-8847-ec57cddb1f9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:34:53.496508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fd905-610d-4bd1-8847-ec57cddb1f9f service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:34:53.505981 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4356/8626] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:34:53 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:34:54.449641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23042e-6378-4c36-9bed-ec3dac3dd086 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:34:54.458883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23042e-6378-4c36-9bed-ec3dac3dd086 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:34:54.463141 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6ecda-f58b-4665-98a3-6dceb51352ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:34:54.463791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6ecda-f58b-4665-98a3-6dceb51352ce service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:34:54.464083 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6ecda-f58b-4665-98a3-6dceb51352ce service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:34:54.464386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6ecda-f58b-4665-98a3-6dceb51352ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:34:54.466193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3ac6ecda-f58b-4665-98a3-6dceb51352ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:34:54.483357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6ecda-f58b-4665-98a3-6dceb51352ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:34:54.484813 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6ecda-f58b-4665-98a3-6dceb51352ce service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:34:54.498286 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4271/8627] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:34:54 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:35:04.829940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fd905-610d-4bd1-8847-ec57cddb1f9f service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:35:04.857091 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fd905-610d-4bd1-8847-ec57cddb1f9f service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:35:04.862196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f5535-1b9b-4e06-a1f5-6015d03997b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:35:04.862845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f5535-1b9b-4e06-a1f5-6015d03997b9 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:35:04.863131 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f5535-1b9b-4e06-a1f5-6015d03997b9 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:35:04.863412 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f5535-1b9b-4e06-a1f5-6015d03997b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:35:04.865186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d17f5535-1b9b-4e06-a1f5-6015d03997b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:35:04.879446 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f5535-1b9b-4e06-a1f5-6015d03997b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:35:04.881003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f5535-1b9b-4e06-a1f5-6015d03997b9 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:35:04.893075 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4357/8628] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:35:04 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:35:07.414744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd764833-c4d8-4d01-9f6f-d64e2b49ff45 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:35:07.415305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd764833-c4d8-4d01-9f6f-d64e2b49ff45 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:35:07.415305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd764833-c4d8-4d01-9f6f-d64e2b49ff45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:35:07.433562 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-cd764833-c4d8-4d01-9f6f-d64e2b49ff45 None None] MFA Rules not processed for user `6f8eeb55c523480fb45d4bbb8afe8e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:35:07.434866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cd764833-c4d8-4d01-9f6f-d64e2b49ff45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:35:07.441612 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4272/8629] 10.222.0.13 () {58 vars in 1061 bytes} [Sat Dec 18 21:35:07 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:35:07.448237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f5535-1b9b-4e06-a1f5-6015d03997b9 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:35:07.457354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f5535-1b9b-4e06-a1f5-6015d03997b9 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:35:07.461504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb705174-b42e-4a97-a1e4-216c1769e123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:35:07.462150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb705174-b42e-4a97-a1e4-216c1769e123 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:35:07.462467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb705174-b42e-4a97-a1e4-216c1769e123 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:35:07.462768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb705174-b42e-4a97-a1e4-216c1769e123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:35:07.464622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bb705174-b42e-4a97-a1e4-216c1769e123 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:35:07.478830 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb705174-b42e-4a97-a1e4-216c1769e123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:35:07.480246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb705174-b42e-4a97-a1e4-216c1769e123 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:35:07.490423 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4358/8630] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:35:07 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:35:12.235522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd764833-c4d8-4d01-9f6f-d64e2b49ff45 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:35:12.250862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd764833-c4d8-4d01-9f6f-d64e2b49ff45 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:35:12.255949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715d149-4387-4333-9a2a-51bb9c027217 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:35:12.256584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715d149-4387-4333-9a2a-51bb9c027217 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:35:12.256877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715d149-4387-4333-9a2a-51bb9c027217 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:35:12.257158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715d149-4387-4333-9a2a-51bb9c027217 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:35:12.259350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1715d149-4387-4333-9a2a-51bb9c027217 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:35:12.273618 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715d149-4387-4333-9a2a-51bb9c027217 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:35:12.275222 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715d149-4387-4333-9a2a-51bb9c027217 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:35:12.287612 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4273/8631] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:35:12 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:35:16.518419 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb6f80-1076-49f2-957c-1b88c6bb8ce5 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:35:16.518978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb6f80-1076-49f2-957c-1b88c6bb8ce5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:35:16.518978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb6f80-1076-49f2-957c-1b88c6bb8ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:35:16.540709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-fedb6f80-1076-49f2-957c-1b88c6bb8ce5 None None] MFA Rules not processed for user `8ad7185a2f28494a95c01e273e6f7212`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:35:16.541995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fedb6f80-1076-49f2-957c-1b88c6bb8ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:35:16.549002 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4359/8632] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:35:16 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:35:17.190145 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715d149-4387-4333-9a2a-51bb9c027217 service placement] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:35:17.203607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715d149-4387-4333-9a2a-51bb9c027217 service placement] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:35:17.211871 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58943b80-5e4e-4083-aaee-e97a7a2d1da3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:35:17.212649 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58943b80-5e4e-4083-aaee-e97a7a2d1da3 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:35:17.213010 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58943b80-5e4e-4083-aaee-e97a7a2d1da3 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:35:17.213524 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58943b80-5e4e-4083-aaee-e97a7a2d1da3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:35:17.215706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-58943b80-5e4e-4083-aaee-e97a7a2d1da3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:35:17.231023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58943b80-5e4e-4083-aaee-e97a7a2d1da3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:35:17.232665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58943b80-5e4e-4083-aaee-e97a7a2d1da3 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:35:17.246125 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4274/8633] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:35:17 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:35:19.596232 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb6f80-1076-49f2-957c-1b88c6bb8ce5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:35:19.598682 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fedb6f80-1076-49f2-957c-1b88c6bb8ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:35:19.637128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb6f80-1076-49f2-957c-1b88c6bb8ce5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:35:19.646511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093bcad-6aa2-4d97-af9f-adc52b0eb8f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:35:19.647428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093bcad-6aa2-4d97-af9f-adc52b0eb8f1 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:35:19.647910 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093bcad-6aa2-4d97-af9f-adc52b0eb8f1 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:35:19.648892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093bcad-6aa2-4d97-af9f-adc52b0eb8f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:35:19.651442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3093bcad-6aa2-4d97-af9f-adc52b0eb8f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:35:19.678507 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093bcad-6aa2-4d97-af9f-adc52b0eb8f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:35:19.680708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093bcad-6aa2-4d97-af9f-adc52b0eb8f1 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:35:19.714550 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4360/8634] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:35:19 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:35:26.186693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58943b80-5e4e-4083-aaee-e97a7a2d1da3 service placement] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:35:26.202572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58943b80-5e4e-4083-aaee-e97a7a2d1da3 service placement] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:35:26.208435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b8266-e2dd-43da-9d5e-3d10a529cad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:35:26.209119 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8266-e2dd-43da-9d5e-3d10a529cad9 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:35:26.209469 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8266-e2dd-43da-9d5e-3d10a529cad9 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:35:26.209756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8266-e2dd-43da-9d5e-3d10a529cad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:35:26.211614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-2a1b8266-e2dd-43da-9d5e-3d10a529cad9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:35:26.226946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b8266-e2dd-43da-9d5e-3d10a529cad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:35:26.228545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b8266-e2dd-43da-9d5e-3d10a529cad9 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:35:26.244428 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4275/8635] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:35:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:36:09.616167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093bcad-6aa2-4d97-af9f-adc52b0eb8f1 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:36:09.625868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093bcad-6aa2-4d97-af9f-adc52b0eb8f1 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:36:09.629633 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74e4d4-7553-4183-8b13-75acbbe26768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:36:09.630350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74e4d4-7553-4183-8b13-75acbbe26768 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:36:09.630568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74e4d4-7553-4183-8b13-75acbbe26768 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:36:09.630844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74e4d4-7553-4183-8b13-75acbbe26768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:36:09.633149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-fe74e4d4-7553-4183-8b13-75acbbe26768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:36:09.644737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74e4d4-7553-4183-8b13-75acbbe26768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:36:09.646137 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74e4d4-7553-4183-8b13-75acbbe26768 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:36:09.656112 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4361/8636] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:36:09 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:37:22.305725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b8266-e2dd-43da-9d5e-3d10a529cad9 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:37:22.314774 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b8266-e2dd-43da-9d5e-3d10a529cad9 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:37:22.318350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ec58b-64ab-435c-a303-449b0736f498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:37:22.318993 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ec58b-64ab-435c-a303-449b0736f498 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:37:22.319306 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ec58b-64ab-435c-a303-449b0736f498 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:37:22.319584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ec58b-64ab-435c-a303-449b0736f498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:37:22.321314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-019ec58b-64ab-435c-a303-449b0736f498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:37:22.333568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ec58b-64ab-435c-a303-449b0736f498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:37:22.335544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ec58b-64ab-435c-a303-449b0736f498 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:37:22.346027 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4276/8637] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:37:22 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:37:22.428835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d8c75-df19-4729-9e44-e26561b4a617 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:37:22.429432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d8c75-df19-4729-9e44-e26561b4a617 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:37:22.429432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d8c75-df19-4729-9e44-e26561b4a617 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:37:22.431425 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4362/8638] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 21:37:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 21:37:22.436882 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a72da-605d-4dba-8eb2-95c292787928 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:37:22.438402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a72da-605d-4dba-8eb2-95c292787928 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:37:22.438402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a72da-605d-4dba-8eb2-95c292787928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:37:22.458536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-bf8a72da-605d-4dba-8eb2-95c292787928 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:37:22.460396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bf8a72da-605d-4dba-8eb2-95c292787928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:37:22.469174 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4277/8639] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:37:22 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:37:22.490429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d8c75-df19-4729-9e44-e26561b4a617 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:37:22.492123 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5e3d8c75-df19-4729-9e44-e26561b4a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:37:22.511053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d8c75-df19-4729-9e44-e26561b4a617 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:37:22.515993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ce371-5996-4143-89c6-08f168a3abe7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:37:22.516615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ce371-5996-4143-89c6-08f168a3abe7 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:37:22.516893 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ce371-5996-4143-89c6-08f168a3abe7 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:37:22.517175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ce371-5996-4143-89c6-08f168a3abe7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:37:22.525892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ce371-5996-4143-89c6-08f168a3abe7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:37:22.527474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ce371-5996-4143-89c6-08f168a3abe7 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:37:22.536778 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4363/8640] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:37:22 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:37:22.685017 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b50f5-64f7-44e2-b568-7cdd1d3ed602 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:37:22.685311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b50f5-64f7-44e2-b568-7cdd1d3ed602 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:37:22.685591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b50f5-64f7-44e2-b568-7cdd1d3ed602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:37:22.703755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0c3b50f5-64f7-44e2-b568-7cdd1d3ed602 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:37:22.705184 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0c3b50f5-64f7-44e2-b568-7cdd1d3ed602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:37:22.714511 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4278/8641] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:37:22 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:37:22.726413 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ce371-5996-4143-89c6-08f168a3abe7 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:37:22.739803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ce371-5996-4143-89c6-08f168a3abe7 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:37:22.745272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed789f-8145-4598-9605-6d2ae2cc18e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:37:22.745920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed789f-8145-4598-9605-6d2ae2cc18e8 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:37:22.746205 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed789f-8145-4598-9605-6d2ae2cc18e8 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:37:22.746514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed789f-8145-4598-9605-6d2ae2cc18e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:37:22.755501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed789f-8145-4598-9605-6d2ae2cc18e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:37:22.757581 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed789f-8145-4598-9605-6d2ae2cc18e8 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:37:22.767196 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4364/8642] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:37:22 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:37:26.995209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b50f5-64f7-44e2-b568-7cdd1d3ed602 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:37:27.011484 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b50f5-64f7-44e2-b568-7cdd1d3ed602 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:37:27.017595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fe0d6-52b6-478e-aec6-66d34d92a428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:37:27.018553 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fe0d6-52b6-478e-aec6-66d34d92a428 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:37:27.018689 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fe0d6-52b6-478e-aec6-66d34d92a428 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:37:27.019036 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fe0d6-52b6-478e-aec6-66d34d92a428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:37:27.020963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bf5fe0d6-52b6-478e-aec6-66d34d92a428 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:37:27.038359 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fe0d6-52b6-478e-aec6-66d34d92a428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:37:27.040466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fe0d6-52b6-478e-aec6-66d34d92a428 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:37:27.057729 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4279/8643] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:37:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:37:36.416786 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf61e8-61f1-4f77-9642-ba14d19bde72 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:37:36.417276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf61e8-61f1-4f77-9642-ba14d19bde72 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:37:36.417375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf61e8-61f1-4f77-9642-ba14d19bde72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:37:36.435095 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4ecf61e8-61f1-4f77-9642-ba14d19bde72 None None] MFA Rules not processed for user `8ad7185a2f28494a95c01e273e6f7212`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:37:36.436317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4ecf61e8-61f1-4f77-9642-ba14d19bde72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:37:36.443202 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4365/8644] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:37:36 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:37:36.742001 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fe0d6-52b6-478e-aec6-66d34d92a428 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:37:36.751652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fe0d6-52b6-478e-aec6-66d34d92a428 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:37:36.755379 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8d480-c276-4687-a2a8-9bc51be66274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:37:36.756025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8d480-c276-4687-a2a8-9bc51be66274 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:37:36.756342 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8d480-c276-4687-a2a8-9bc51be66274 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:37:36.756623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8d480-c276-4687-a2a8-9bc51be66274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:37:36.758437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-74c8d480-c276-4687-a2a8-9bc51be66274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:37:36.770207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8d480-c276-4687-a2a8-9bc51be66274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:37:36.771636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8d480-c276-4687-a2a8-9bc51be66274 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:37:36.781720 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4280/8645] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:37:36 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:37:37.077518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2385d-7c41-4ef7-a0bf-b1cd05e781a0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:37:37.077890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2385d-7c41-4ef7-a0bf-b1cd05e781a0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:37:37.078467 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2385d-7c41-4ef7-a0bf-b1cd05e781a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:37:37.104704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5dd2385d-7c41-4ef7-a0bf-b1cd05e781a0 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:37:37.105913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5dd2385d-7c41-4ef7-a0bf-b1cd05e781a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:37:37.114922 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4366/8646] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:37:37 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:37:37.126682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8d480-c276-4687-a2a8-9bc51be66274 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:37:37.140924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8d480-c276-4687-a2a8-9bc51be66274 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:37:37.145821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcbee8-f550-4259-800b-8a335f8352cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:37:37.146476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcbee8-f550-4259-800b-8a335f8352cb service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:37:37.146765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcbee8-f550-4259-800b-8a335f8352cb service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:37:37.147071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcbee8-f550-4259-800b-8a335f8352cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:37:37.155990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dcbee8-f550-4259-800b-8a335f8352cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:37:37.157545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dcbee8-f550-4259-800b-8a335f8352cb service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:37:37.168291 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4281/8647] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:37:37 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:37:59.420090 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2385d-7c41-4ef7-a0bf-b1cd05e781a0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:37:59.434845 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2385d-7c41-4ef7-a0bf-b1cd05e781a0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:37:59.440281 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9d3dc-ff64-4089-9eb7-96f5077f3b6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:37:59.440911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d3dc-ff64-4089-9eb7-96f5077f3b6e service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:37:59.441196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d3dc-ff64-4089-9eb7-96f5077f3b6e service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:37:59.441493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d3dc-ff64-4089-9eb7-96f5077f3b6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:37:59.449585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9d3dc-ff64-4089-9eb7-96f5077f3b6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:37:59.451186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9d3dc-ff64-4089-9eb7-96f5077f3b6e service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:37:59.460294 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4367/8648] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:37:59 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:39:28.366183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26ca64-1183-47eb-8ea1-96d67537b12b None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:39:28.366768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26ca64-1183-47eb-8ea1-96d67537b12b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:39:28.366768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26ca64-1183-47eb-8ea1-96d67537b12b None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:39:28.368677 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4282/8649] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 21:39:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 21:39:28.374032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e82f9-ae7b-4b49-8922-dcae56ba2a26 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:39:28.374537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e82f9-ae7b-4b49-8922-dcae56ba2a26 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:39:28.374764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e82f9-ae7b-4b49-8922-dcae56ba2a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:39:28.403369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-a19e82f9-ae7b-4b49-8922-dcae56ba2a26 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:39:28.404575 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a19e82f9-ae7b-4b49-8922-dcae56ba2a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:39:28.422456 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4368/8650] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:39:28 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:39:28.446728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26ca64-1183-47eb-8ea1-96d67537b12b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:39:28.463588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26ca64-1183-47eb-8ea1-96d67537b12b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:39:28.468476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ebf3e-0cfd-4c64-9bc1-f559a253d6c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:39:28.469109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ebf3e-0cfd-4c64-9bc1-f559a253d6c9 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:39:28.469393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ebf3e-0cfd-4c64-9bc1-f559a253d6c9 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:39:28.469667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ebf3e-0cfd-4c64-9bc1-f559a253d6c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:39:28.478077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ebf3e-0cfd-4c64-9bc1-f559a253d6c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:39:28.479666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ebf3e-0cfd-4c64-9bc1-f559a253d6c9 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:39:28.489051 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4283/8651] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:39:28 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:39:53.940534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e82f9-ae7b-4b49-8922-dcae56ba2a26 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:39:53.960890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e82f9-ae7b-4b49-8922-dcae56ba2a26 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:39:53.965277 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccb08e-afc6-4969-9aa3-3fc00612a1cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:39:53.965973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccb08e-afc6-4969-9aa3-3fc00612a1cd service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:39:53.966207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccb08e-afc6-4969-9aa3-3fc00612a1cd service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:39:53.966521 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccb08e-afc6-4969-9aa3-3fc00612a1cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:39:54.005149 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccb08e-afc6-4969-9aa3-3fc00612a1cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:39:54.006669 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccb08e-afc6-4969-9aa3-3fc00612a1cd service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:39:54.020239 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4369/8652] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:39:53 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:39:56.390890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c974b6-2363-4682-910d-a90b17557a4b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:39:56.391404 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c974b6-2363-4682-910d-a90b17557a4b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:39:56.391505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c974b6-2363-4682-910d-a90b17557a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:39:56.408371 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-67c974b6-2363-4682-910d-a90b17557a4b None None] MFA Rules not processed for user `8ad7185a2f28494a95c01e273e6f7212`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:39:56.409561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-67c974b6-2363-4682-910d-a90b17557a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:39:56.416845 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4284/8653] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:39:56 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:39:56.451269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc10f00-cf66-4188-9e18-9482c5bd7f0a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:39:56.451668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc10f00-cf66-4188-9e18-9482c5bd7f0a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:39:56.451929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc10f00-cf66-4188-9e18-9482c5bd7f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:39:56.499092 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8dc10f00-cf66-4188-9e18-9482c5bd7f0a None None] MFA Rules not processed for user `82fb4302bcd54627a264f22ad78aa339`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:39:56.500276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8dc10f00-cf66-4188-9e18-9482c5bd7f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:39:56.557204 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4370/8654] 10.222.0.13 () {58 vars in 1059 bytes} [Sat Dec 18 21:39:56 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:39:56.563549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c974b6-2363-4682-910d-a90b17557a4b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:39:56.572762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c974b6-2363-4682-910d-a90b17557a4b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:39:56.576450 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5a4c0-0b32-46ca-9055-d2386a58e5ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:39:56.577130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5a4c0-0b32-46ca-9055-d2386a58e5ee service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:39:56.577415 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5a4c0-0b32-46ca-9055-d2386a58e5ee service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:39:56.577765 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5a4c0-0b32-46ca-9055-d2386a58e5ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:39:56.592905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5a4c0-0b32-46ca-9055-d2386a58e5ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:39:56.594313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5a4c0-0b32-46ca-9055-d2386a58e5ee service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:39:56.608396 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4285/8655] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:39:56 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:40:07.017876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc10f00-cf66-4188-9e18-9482c5bd7f0a None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:40:07.027367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc10f00-cf66-4188-9e18-9482c5bd7f0a None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:40:07.031008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df185439-1baa-451d-a087-98d47a88084b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:40:07.031646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df185439-1baa-451d-a087-98d47a88084b service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:40:07.031934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df185439-1baa-451d-a087-98d47a88084b service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:40:07.032212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df185439-1baa-451d-a087-98d47a88084b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:40:07.042790 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df185439-1baa-451d-a087-98d47a88084b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:40:07.044358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df185439-1baa-451d-a087-98d47a88084b service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:40:07.056135 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4371/8656] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:40:07 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:40:11.798722 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5a4c0-0b32-46ca-9055-d2386a58e5ee service glance] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:40:11.812466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5a4c0-0b32-46ca-9055-d2386a58e5ee service glance] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:40:11.817664 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3885ed7-c373-4cb8-a3f2-6b000e9487cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:40:11.818351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3885ed7-c373-4cb8-a3f2-6b000e9487cd service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:40:11.818645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3885ed7-c373-4cb8-a3f2-6b000e9487cd service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:40:11.818929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3885ed7-c373-4cb8-a3f2-6b000e9487cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:40:11.830485 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3885ed7-c373-4cb8-a3f2-6b000e9487cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:40:11.832300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3885ed7-c373-4cb8-a3f2-6b000e9487cd service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:40:11.844925 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4286/8657] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:40:11 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:40:15.905847 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df185439-1baa-451d-a087-98d47a88084b service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:40:15.919973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df185439-1baa-451d-a087-98d47a88084b service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:40:15.924919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765010b-4b50-40d7-81ca-0d266db71114 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:40:15.925536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765010b-4b50-40d7-81ca-0d266db71114 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:40:15.925816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765010b-4b50-40d7-81ca-0d266db71114 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:40:15.926087 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765010b-4b50-40d7-81ca-0d266db71114 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:40:15.937710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765010b-4b50-40d7-81ca-0d266db71114 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:40:15.939313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765010b-4b50-40d7-81ca-0d266db71114 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:40:15.952405 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4372/8658] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:40:15 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:41:48.519120 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3885ed7-c373-4cb8-a3f2-6b000e9487cd service placement] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:41:48.527973 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3885ed7-c373-4cb8-a3f2-6b000e9487cd service placement] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:41:48.531564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88478aca-0fed-4948-8a5f-ae15f0d8fda7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:41:48.532198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88478aca-0fed-4948-8a5f-ae15f0d8fda7 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:41:48.532486 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88478aca-0fed-4948-8a5f-ae15f0d8fda7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:41:48.532770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88478aca-0fed-4948-8a5f-ae15f0d8fda7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:41:48.534529 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-88478aca-0fed-4948-8a5f-ae15f0d8fda7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:41:48.559255 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88478aca-0fed-4948-8a5f-ae15f0d8fda7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:41:48.560666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88478aca-0fed-4948-8a5f-ae15f0d8fda7 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:41:48.570729 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4287/8659] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:41:48 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:41:48.797618 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927f820-1cc2-4e5e-90e2-be810c5e47a5 None None] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:41:48.798237 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927f820-1cc2-4e5e-90e2-be810c5e47a5 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:41:48.798844 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927f820-1cc2-4e5e-90e2-be810c5e47a5 None None] PATH_INFO: `/` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:41:48.800714 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4373/8660] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 21:41:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 21:41:48.806834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed3fad-ff6a-410c-b3c7-cd4012a039f1 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:41:48.807072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed3fad-ff6a-410c-b3c7-cd4012a039f1 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:41:48.807377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed3fad-ff6a-410c-b3c7-cd4012a039f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:41:48.874128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-67ed3fad-ff6a-410c-b3c7-cd4012a039f1 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:41:48.875341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-67ed3fad-ff6a-410c-b3c7-cd4012a039f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:41:48.884138 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4288/8661] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:41:48 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:41:48.905296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927f820-1cc2-4e5e-90e2-be810c5e47a5 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:41:48.921815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927f820-1cc2-4e5e-90e2-be810c5e47a5 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:41:48.926704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50395213-ed2c-4e8f-a299-27326de4fd7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:41:48.927328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50395213-ed2c-4e8f-a299-27326de4fd7d service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:41:48.927642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50395213-ed2c-4e8f-a299-27326de4fd7d service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:41:48.927927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50395213-ed2c-4e8f-a299-27326de4fd7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:41:48.936100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50395213-ed2c-4e8f-a299-27326de4fd7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:41:48.937664 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50395213-ed2c-4e8f-a299-27326de4fd7d service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:41:48.947097 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4374/8662] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:41:48 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:42:03.181181 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed3fad-ff6a-410c-b3c7-cd4012a039f1 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:03.190625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed3fad-ff6a-410c-b3c7-cd4012a039f1 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:03.195020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def8d7b-7486-4884-beba-df973d3878cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:03.195792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def8d7b-7486-4884-beba-df973d3878cc service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:03.196085 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def8d7b-7486-4884-beba-df973d3878cc service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:03.196895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def8d7b-7486-4884-beba-df973d3878cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:03.206708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def8d7b-7486-4884-beba-df973d3878cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:03.208376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def8d7b-7486-4884-beba-df973d3878cc service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:03.218473 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4289/8663] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:42:03 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:42:03.627304 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50395213-ed2c-4e8f-a299-27326de4fd7d service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:03.642801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50395213-ed2c-4e8f-a299-27326de4fd7d service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:03.648533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e05f9b-5197-465e-b8c3-2d8226a850df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:03.649176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e05f9b-5197-465e-b8c3-2d8226a850df service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:03.649461 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e05f9b-5197-465e-b8c3-2d8226a850df service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:03.649746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e05f9b-5197-465e-b8c3-2d8226a850df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:03.661256 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e05f9b-5197-465e-b8c3-2d8226a850df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:03.662879 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e05f9b-5197-465e-b8c3-2d8226a850df service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:03.677108 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4375/8664] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:42:03 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:42:12.160100 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def8d7b-7486-4884-beba-df973d3878cc service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:12.181764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def8d7b-7486-4884-beba-df973d3878cc service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:12.187376 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a942a46-1845-4d1d-8459-94147de763d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:12.188020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a942a46-1845-4d1d-8459-94147de763d3 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:12.188305 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a942a46-1845-4d1d-8459-94147de763d3 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:12.188591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a942a46-1845-4d1d-8459-94147de763d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:12.202108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a942a46-1845-4d1d-8459-94147de763d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:12.203741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a942a46-1845-4d1d-8459-94147de763d3 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:12.218483 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4290/8665] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:42:12 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:42:14.794207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6704ec9-ed41-4d54-96ec-efbcd31a4a46 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:14.794798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6704ec9-ed41-4d54-96ec-efbcd31a4a46 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:14.794798 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6704ec9-ed41-4d54-96ec-efbcd31a4a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:14.815233 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-b6704ec9-ed41-4d54-96ec-efbcd31a4a46 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:42:14.816437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b6704ec9-ed41-4d54-96ec-efbcd31a4a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:14.825300 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4376/8666] 10.222.0.31 () {58 vars in 1015 bytes} [Sat Dec 18 21:42:14 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:42:14.840269 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a942a46-1845-4d1d-8459-94147de763d3 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:14.854592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a942a46-1845-4d1d-8459-94147de763d3 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:14.859798 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef021e-a821-46ca-872c-a7d8940c805b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:14.860443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef021e-a821-46ca-872c-a7d8940c805b service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:14.860727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef021e-a821-46ca-872c-a7d8940c805b service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:14.861004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef021e-a821-46ca-872c-a7d8940c805b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:14.870336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef021e-a821-46ca-872c-a7d8940c805b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:14.871895 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef021e-a821-46ca-872c-a7d8940c805b service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:14.881952 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4291/8667] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:42:14 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:42:24.902747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6704ec9-ed41-4d54-96ec-efbcd31a4a46 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:24.911843 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6704ec9-ed41-4d54-96ec-efbcd31a4a46 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:24.915416 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747041f-29ca-4358-878a-9a62d17b8e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:24.916046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747041f-29ca-4358-878a-9a62d17b8e8a service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:24.916331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747041f-29ca-4358-878a-9a62d17b8e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:24.916612 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747041f-29ca-4358-878a-9a62d17b8e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:24.925350 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747041f-29ca-4358-878a-9a62d17b8e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:24.926813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747041f-29ca-4358-878a-9a62d17b8e8a service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:24.954623 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4377/8668] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:42:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:42:28.105149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef021e-a821-46ca-872c-a7d8940c805b service placement] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:28.117794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef021e-a821-46ca-872c-a7d8940c805b service placement] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:28.123444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f29a8a-0b03-411b-bb9e-2a3c0b9a51b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:28.124734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f29a8a-0b03-411b-bb9e-2a3c0b9a51b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:28.124916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f29a8a-0b03-411b-bb9e-2a3c0b9a51b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:28.125265 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f29a8a-0b03-411b-bb9e-2a3c0b9a51b6 admin admin] PATH_INFO: `/v3/users/8ad7185a2f28494a95c01e273e6f7212` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:28.126650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f29a8a-0b03-411b-bb9e-2a3c0b9a51b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ad7185a2f28494a95c01e273e6f7212)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:28.128727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f29a8a-0b03-411b-bb9e-2a3c0b9a51b6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:28.177045 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-24f29a8a-0b03-411b-bb9e-2a3c0b9a51b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ad7185a2f28494a95c01e273e6f7212'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:28.184201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-24f29a8a-0b03-411b-bb9e-2a3c0b9a51b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ad7185a2f28494a95c01e273e6f7212'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:28.195489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-24f29a8a-0b03-411b-bb9e-2a3c0b9a51b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ad7185a2f28494a95c01e273e6f7212'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:28.196161 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-24f29a8a-0b03-411b-bb9e-2a3c0b9a51b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ad7185a2f28494a95c01e273e6f7212'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:28.202889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-24f29a8a-0b03-411b-bb9e-2a3c0b9a51b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ad7185a2f28494a95c01e273e6f7212'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:28.209343 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4292/8669] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:42:28 2021] DELETE /identity/v3/users/8ad7185a2f28494a95c01e273e6f7212 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:42:28.379330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747041f-29ca-4358-878a-9a62d17b8e8a service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:28.390781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747041f-29ca-4358-878a-9a62d17b8e8a service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:28.446265 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94cd26-9e37-4a72-a2d7-5fe7268c85e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:28.447170 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94cd26-9e37-4a72-a2d7-5fe7268c85e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:28.447454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94cd26-9e37-4a72-a2d7-5fe7268c85e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:28.447810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94cd26-9e37-4a72-a2d7-5fe7268c85e4 admin admin] PATH_INFO: `/v3/projects/542852f38d9b4ee7a351cc80abbd3d19` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:28.449013 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94cd26-9e37-4a72-a2d7-5fe7268c85e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=542852f38d9b4ee7a351cc80abbd3d19)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:28.450995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94cd26-9e37-4a72-a2d7-5fe7268c85e4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:28.496213 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4c94cd26-9e37-4a72-a2d7-5fe7268c85e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542852f38d9b4ee7a351cc80abbd3d19', 'request_id': 'req-4c94cd26-9e37-4a72-a2d7-5fe7268c85e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:28.501996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4c94cd26-9e37-4a72-a2d7-5fe7268c85e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542852f38d9b4ee7a351cc80abbd3d19', 'request_id': 'req-4c94cd26-9e37-4a72-a2d7-5fe7268c85e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:28.509180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4c94cd26-9e37-4a72-a2d7-5fe7268c85e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542852f38d9b4ee7a351cc80abbd3d19', 'request_id': 'req-4c94cd26-9e37-4a72-a2d7-5fe7268c85e4'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:28.532526 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4c94cd26-9e37-4a72-a2d7-5fe7268c85e4 admin admin] The token cache is being invalidate because project 542852f38d9b4ee7a351cc80abbd3d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:42:28.532808 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4c94cd26-9e37-4a72-a2d7-5fe7268c85e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:28.533424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-4c94cd26-9e37-4a72-a2d7-5fe7268c85e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:28.534953 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4378/8670] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:42:28 2021] DELETE /identity/v3/projects/542852f38d9b4ee7a351cc80abbd3d19 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:42:28.541361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ec837-cc37-4fd9-9e04-69af988ddf30 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:28.541666 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ec837-cc37-4fd9-9e04-69af988ddf30 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:28.541955 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ec837-cc37-4fd9-9e04-69af988ddf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:28.587115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-ce0ec837-cc37-4fd9-9e04-69af988ddf30 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:42:28.588730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ce0ec837-cc37-4fd9-9e04-69af988ddf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:28.644614 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4293/8671] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:42:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:42:28.653224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940aaee-b767-4ae9-b755-8ac8698e4979 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:28.653513 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940aaee-b767-4ae9-b755-8ac8698e4979 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:28.653794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940aaee-b767-4ae9-b755-8ac8698e4979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:28.671897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7940aaee-b767-4ae9-b755-8ac8698e4979 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:42:28.673076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7940aaee-b767-4ae9-b755-8ac8698e4979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:28.680800 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4379/8672] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:42:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:42:28.684835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ec837-cc37-4fd9-9e04-69af988ddf30 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:28.694185 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ec837-cc37-4fd9-9e04-69af988ddf30 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:28.698636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98096155-6d03-4a8c-8595-06a5de41ee2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:28.699277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98096155-6d03-4a8c-8595-06a5de41ee2a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:28.699560 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98096155-6d03-4a8c-8595-06a5de41ee2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:28.699838 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98096155-6d03-4a8c-8595-06a5de41ee2a admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:28.700559 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98096155-6d03-4a8c-8595-06a5de41ee2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:42:28.700866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98096155-6d03-4a8c-8595-06a5de41ee2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:28.702822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98096155-6d03-4a8c-8595-06a5de41ee2a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:28.715026 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4294/8673] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:42:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:42:28.719022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940aaee-b767-4ae9-b755-8ac8698e4979 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:28.729279 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940aaee-b767-4ae9-b755-8ac8698e4979 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:28.734339 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd088eee-94ae-444d-95c7-7e5331fb3d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:28.734954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd088eee-94ae-444d-95c7-7e5331fb3d2d admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:28.735235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd088eee-94ae-444d-95c7-7e5331fb3d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:28.735510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd088eee-94ae-444d-95c7-7e5331fb3d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:28.736203 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd088eee-94ae-444d-95c7-7e5331fb3d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:28.738099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd088eee-94ae-444d-95c7-7e5331fb3d2d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:28.771527 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4380/8674] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:42:28 2021] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:42:28.776218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98096155-6d03-4a8c-8595-06a5de41ee2a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:28.786056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98096155-6d03-4a8c-8595-06a5de41ee2a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:28.840568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c9f4d-2eb6-4260-865b-648ca505915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:28.841228 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c9f4d-2eb6-4260-865b-648ca505915d admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:28.841515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c9f4d-2eb6-4260-865b-648ca505915d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:28.841793 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c9f4d-2eb6-4260-865b-648ca505915d admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:28.842525 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c9f4d-2eb6-4260-865b-648ca505915d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:28.844412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c9f4d-2eb6-4260-865b-648ca505915d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:28.863109 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4295/8675] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:42:28 2021] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:42:28.867208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd088eee-94ae-444d-95c7-7e5331fb3d2d admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:28.877331 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd088eee-94ae-444d-95c7-7e5331fb3d2d admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:28.882016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f13bc-3518-4ceb-9ecb-ea002466e825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:28.882705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f13bc-3518-4ceb-9ecb-ea002466e825 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:28.883019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f13bc-3518-4ceb-9ecb-ea002466e825 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:28.883298 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f13bc-3518-4ceb-9ecb-ea002466e825 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:28.884021 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f13bc-3518-4ceb-9ecb-ea002466e825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:28.885596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f13bc-3518-4ceb-9ecb-ea002466e825 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:28.895401 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4381/8676] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:42:28 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:42:28.899029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c9f4d-2eb6-4260-865b-648ca505915d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:28.909057 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c9f4d-2eb6-4260-865b-648ca505915d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:28.913656 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c95898-b620-4a55-a16d-ed19f1485815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:28.914334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c95898-b620-4a55-a16d-ed19f1485815 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:28.915239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c95898-b620-4a55-a16d-ed19f1485815 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:28.915532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c95898-b620-4a55-a16d-ed19f1485815 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:28.916832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c95898-b620-4a55-a16d-ed19f1485815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:28.918419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c95898-b620-4a55-a16d-ed19f1485815 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:28.928115 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4296/8677] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:42:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:42:28.932253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f13bc-3518-4ceb-9ecb-ea002466e825 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:28.942038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f13bc-3518-4ceb-9ecb-ea002466e825 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:28.946570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a535eb-ca6f-4d6d-82df-fb797888581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:28.947913 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a535eb-ca6f-4d6d-82df-fb797888581c admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:28.948187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a535eb-ca6f-4d6d-82df-fb797888581c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:28.948456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a535eb-ca6f-4d6d-82df-fb797888581c admin admin] PATH_INFO: `/v3/projects/42db9342b99048278dc6eb082fbe7941/users/8d2747fedaf441218a89cdf5bedb81b4/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:28.963207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a535eb-ca6f-4d6d-82df-fb797888581c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42db9342b99048278dc6eb082fbe7941, user_id=8d2747fedaf441218a89cdf5bedb81b4, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:28.965814 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a535eb-ca6f-4d6d-82df-fb797888581c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:28.978520 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4382/8678] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:42:28 2021] PUT /identity/v3/projects/42db9342b99048278dc6eb082fbe7941/users/8d2747fedaf441218a89cdf5bedb81b4/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:42:28.983507 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cc923-9a1a-4f05-920e-a79dde93f69d None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:28.983803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cc923-9a1a-4f05-920e-a79dde93f69d None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:28.984091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cc923-9a1a-4f05-920e-a79dde93f69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:29.002133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-573cc923-9a1a-4f05-920e-a79dde93f69d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:42:29.003425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-573cc923-9a1a-4f05-920e-a79dde93f69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:29.060889 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4297/8679] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:42:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:42:29.070703 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a535eb-ca6f-4d6d-82df-fb797888581c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:29.072993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-75a535eb-ca6f-4d6d-82df-fb797888581c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:29.126636 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a535eb-ca6f-4d6d-82df-fb797888581c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:29.130104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2b1b6-7881-4e24-8412-c1ebf266c5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:29.130759 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2b1b6-7881-4e24-8412-c1ebf266c5af service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:29.131042 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2b1b6-7881-4e24-8412-c1ebf266c5af service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:29.131325 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2b1b6-7881-4e24-8412-c1ebf266c5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:29.140848 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2b1b6-7881-4e24-8412-c1ebf266c5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:29.142377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2b1b6-7881-4e24-8412-c1ebf266c5af service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:29.152519 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4383/8680] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:42:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:42:29.757910 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41681f8-8363-43fe-94b0-4ec4460c8e22 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:29.758591 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41681f8-8363-43fe-94b0-4ec4460c8e22 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:29.758893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41681f8-8363-43fe-94b0-4ec4460c8e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:29.785665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-c41681f8-8363-43fe-94b0-4ec4460c8e22 None None] MFA Rules not processed for user `8d2747fedaf441218a89cdf5bedb81b4`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:42:29.786907 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c41681f8-8363-43fe-94b0-4ec4460c8e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:29.852316 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4298/8681] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:42:29 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:42:29.862694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c28f0-81c9-42dc-a4a3-66dc270d4083 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:29.863172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c28f0-81c9-42dc-a4a3-66dc270d4083 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:29.863289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c28f0-81c9-42dc-a4a3-66dc270d4083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:29.881134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4e3c28f0-81c9-42dc-a4a3-66dc270d4083 None None] MFA Rules not processed for user `8d2747fedaf441218a89cdf5bedb81b4`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:42:29.882375 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4e3c28f0-81c9-42dc-a4a3-66dc270d4083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:29.890039 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4384/8682] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:42:29 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:42:29.901685 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41681f8-8363-43fe-94b0-4ec4460c8e22 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:29.903121 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-c41681f8-8363-43fe-94b0-4ec4460c8e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:29.995421 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41681f8-8363-43fe-94b0-4ec4460c8e22 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:30.001195 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d73923-c966-41d4-8029-0e7b0db0dcb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:30.001866 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d73923-c966-41d4-8029-0e7b0db0dcb1 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:30.002154 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d73923-c966-41d4-8029-0e7b0db0dcb1 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:30.002474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d73923-c966-41d4-8029-0e7b0db0dcb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:30.011729 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d73923-c966-41d4-8029-0e7b0db0dcb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:30.013330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d73923-c966-41d4-8029-0e7b0db0dcb1 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:30.023210 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4299/8683] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:42:29 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:42:33.240482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c28f0-81c9-42dc-a4a3-66dc270d4083 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:33.260330 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c28f0-81c9-42dc-a4a3-66dc270d4083 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:33.270503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1a58a-75f4-4fa9-bb36-96ebac8f187f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:33.271287 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1a58a-75f4-4fa9-bb36-96ebac8f187f service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:33.271600 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1a58a-75f4-4fa9-bb36-96ebac8f187f service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:33.271875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1a58a-75f4-4fa9-bb36-96ebac8f187f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:33.273679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-a2a1a58a-75f4-4fa9-bb36-96ebac8f187f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:33.288607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1a58a-75f4-4fa9-bb36-96ebac8f187f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:33.290193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1a58a-75f4-4fa9-bb36-96ebac8f187f service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:33.303206 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4385/8684] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:42:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:42:40.138224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d079cb2-b141-4d31-9236-e47b500fbdcf None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:40.138724 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d079cb2-b141-4d31-9236-e47b500fbdcf None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:40.138847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d079cb2-b141-4d31-9236-e47b500fbdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:40.155982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0d079cb2-b141-4d31-9236-e47b500fbdcf None None] MFA Rules not processed for user `8d2747fedaf441218a89cdf5bedb81b4`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:42:40.157178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0d079cb2-b141-4d31-9236-e47b500fbdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:40.163981 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4300/8685] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:42:40 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:42:40.408112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1a58a-75f4-4fa9-bb36-96ebac8f187f service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:40.417392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1a58a-75f4-4fa9-bb36-96ebac8f187f service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:40.421065 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9f3a4-42b4-4b5d-8320-a052a7bcee6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:40.421724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9f3a4-42b4-4b5d-8320-a052a7bcee6f service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:40.422005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9f3a4-42b4-4b5d-8320-a052a7bcee6f service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:40.422340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9f3a4-42b4-4b5d-8320-a052a7bcee6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:40.424080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-71d9f3a4-42b4-4b5d-8320-a052a7bcee6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:40.435748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9f3a4-42b4-4b5d-8320-a052a7bcee6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:40.437147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9f3a4-42b4-4b5d-8320-a052a7bcee6f service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:40.447739 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4386/8686] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:42:40 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:42:40.758005 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df0376-50d1-4315-98dc-ee5e815943b4 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:40.758334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df0376-50d1-4315-98dc-ee5e815943b4 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:40.758603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df0376-50d1-4315-98dc-ee5e815943b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:40.777732 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-96df0376-50d1-4315-98dc-ee5e815943b4 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:42:40.778956 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-96df0376-50d1-4315-98dc-ee5e815943b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:40.840270 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4301/8687] 10.222.0.13 () {58 vars in 1057 bytes} [Sat Dec 18 21:42:40 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:42:40.846627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9f3a4-42b4-4b5d-8320-a052a7bcee6f service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:40.858818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9f3a4-42b4-4b5d-8320-a052a7bcee6f service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:40.863740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe1eb6-8e81-48f5-8fcc-9d40f415fc11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:40.864362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe1eb6-8e81-48f5-8fcc-9d40f415fc11 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:40.864643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe1eb6-8e81-48f5-8fcc-9d40f415fc11 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:40.864926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe1eb6-8e81-48f5-8fcc-9d40f415fc11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:40.866671 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-22fe1eb6-8e81-48f5-8fcc-9d40f415fc11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:40.877484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe1eb6-8e81-48f5-8fcc-9d40f415fc11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:40.879015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe1eb6-8e81-48f5-8fcc-9d40f415fc11 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:40.888969 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4387/8688] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:42:40 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:42:41.324905 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16f976-59d3-4bc5-8d7d-31555c2db082 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:41.325472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16f976-59d3-4bc5-8d7d-31555c2db082 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:41.325472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16f976-59d3-4bc5-8d7d-31555c2db082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:41.343841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0f16f976-59d3-4bc5-8d7d-31555c2db082 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:42:41.345623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0f16f976-59d3-4bc5-8d7d-31555c2db082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:41.354381 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4302/8689] 10.222.0.36 () {58 vars in 1015 bytes} [Sat Dec 18 21:42:41 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:42:41.368941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe1eb6-8e81-48f5-8fcc-9d40f415fc11 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:41.370856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-22fe1eb6-8e81-48f5-8fcc-9d40f415fc11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:41.386685 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe1eb6-8e81-48f5-8fcc-9d40f415fc11 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:41.391862 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea93b32-17d2-411f-9133-2ded81d8e788 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:41.392427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea93b32-17d2-411f-9133-2ded81d8e788 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:41.392711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea93b32-17d2-411f-9133-2ded81d8e788 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:41.392988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea93b32-17d2-411f-9133-2ded81d8e788 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:41.401219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea93b32-17d2-411f-9133-2ded81d8e788 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:41.402810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea93b32-17d2-411f-9133-2ded81d8e788 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:41.412647 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4388/8690] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:42:41 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:42:57.817822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16f976-59d3-4bc5-8d7d-31555c2db082 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:57.830233 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16f976-59d3-4bc5-8d7d-31555c2db082 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:57.835142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b4c43-2549-4fcd-a92a-f205a1ff0600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:57.836037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b4c43-2549-4fcd-a92a-f205a1ff0600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:57.836323 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b4c43-2549-4fcd-a92a-f205a1ff0600 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:57.836606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b4c43-2549-4fcd-a92a-f205a1ff0600 admin admin] PATH_INFO: `/v3/users/8d2747fedaf441218a89cdf5bedb81b4` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:57.837811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b4c43-2549-4fcd-a92a-f205a1ff0600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d2747fedaf441218a89cdf5bedb81b4)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:57.840389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b4c43-2549-4fcd-a92a-f205a1ff0600 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:57.884791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e49b4c43-2549-4fcd-a92a-f205a1ff0600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d2747fedaf441218a89cdf5bedb81b4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:57.892853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e49b4c43-2549-4fcd-a92a-f205a1ff0600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d2747fedaf441218a89cdf5bedb81b4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:57.905058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e49b4c43-2549-4fcd-a92a-f205a1ff0600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d2747fedaf441218a89cdf5bedb81b4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:57.905799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e49b4c43-2549-4fcd-a92a-f205a1ff0600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d2747fedaf441218a89cdf5bedb81b4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:57.912780 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e49b4c43-2549-4fcd-a92a-f205a1ff0600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d2747fedaf441218a89cdf5bedb81b4'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:57.918719 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4303/8691] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:42:57 2021] DELETE /identity/v3/users/8d2747fedaf441218a89cdf5bedb81b4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:42:58.082038 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea93b32-17d2-411f-9133-2ded81d8e788 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:58.093300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea93b32-17d2-411f-9133-2ded81d8e788 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:58.147169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f859d0-69d1-4621-a2f2-1a8e0087116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:58.148014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f859d0-69d1-4621-a2f2-1a8e0087116f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:58.148296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f859d0-69d1-4621-a2f2-1a8e0087116f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:58.148572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f859d0-69d1-4621-a2f2-1a8e0087116f admin admin] PATH_INFO: `/v3/projects/42db9342b99048278dc6eb082fbe7941` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:58.149747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f859d0-69d1-4621-a2f2-1a8e0087116f admin admin] RBAC: Authorizing `identity:delete_project(project_id=42db9342b99048278dc6eb082fbe7941)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:58.152743 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f859d0-69d1-4621-a2f2-1a8e0087116f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:58.197842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b7f859d0-69d1-4621-a2f2-1a8e0087116f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42db9342b99048278dc6eb082fbe7941', 'request_id': 'req-b7f859d0-69d1-4621-a2f2-1a8e0087116f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:58.204286 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b7f859d0-69d1-4621-a2f2-1a8e0087116f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42db9342b99048278dc6eb082fbe7941', 'request_id': 'req-b7f859d0-69d1-4621-a2f2-1a8e0087116f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:58.212767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b7f859d0-69d1-4621-a2f2-1a8e0087116f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42db9342b99048278dc6eb082fbe7941', 'request_id': 'req-b7f859d0-69d1-4621-a2f2-1a8e0087116f'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:58.223267 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b7f859d0-69d1-4621-a2f2-1a8e0087116f admin admin] The token cache is being invalidate because project 42db9342b99048278dc6eb082fbe7941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:42:58.223585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b7f859d0-69d1-4621-a2f2-1a8e0087116f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:58.224235 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-b7f859d0-69d1-4621-a2f2-1a8e0087116f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:42:58.225769 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4389/8692] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:42:58 2021] DELETE /identity/v3/projects/42db9342b99048278dc6eb082fbe7941 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:42:58.231772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b227-4781-4dca-911f-9a1a16ee325f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:58.232070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b227-4781-4dca-911f-9a1a16ee325f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:58.232352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b227-4781-4dca-911f-9a1a16ee325f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:58.252014 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-0777b227-4781-4dca-911f-9a1a16ee325f None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:42:58.253217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0777b227-4781-4dca-911f-9a1a16ee325f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:58.309100 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4304/8693] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:42:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:42:58.317557 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d03ce-02e8-4b06-8b36-8c968c4bfd24 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:58.317873 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d03ce-02e8-4b06-8b36-8c968c4bfd24 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:58.318369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d03ce-02e8-4b06-8b36-8c968c4bfd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:58.336764 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-021d03ce-02e8-4b06-8b36-8c968c4bfd24 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:42:58.337943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-021d03ce-02e8-4b06-8b36-8c968c4bfd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:58.345674 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4390/8694] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:42:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:42:58.349788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777b227-4781-4dca-911f-9a1a16ee325f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:58.359966 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777b227-4781-4dca-911f-9a1a16ee325f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:58.364583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b6c0b-4e7c-45a1-90d3-566e8ef832b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:58.365236 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b6c0b-4e7c-45a1-90d3-566e8ef832b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:58.365540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b6c0b-4e7c-45a1-90d3-566e8ef832b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:58.365812 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b6c0b-4e7c-45a1-90d3-566e8ef832b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:58.366652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b6c0b-4e7c-45a1-90d3-566e8ef832b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:42:58.366963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b6c0b-4e7c-45a1-90d3-566e8ef832b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:58.368546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b6c0b-4e7c-45a1-90d3-566e8ef832b3 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:58.380159 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4305/8695] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:42:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:42:58.384427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d03ce-02e8-4b06-8b36-8c968c4bfd24 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:58.394077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d03ce-02e8-4b06-8b36-8c968c4bfd24 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:58.398696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f00fb-90a6-4d63-8615-99a0799d5292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:58.399341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f00fb-90a6-4d63-8615-99a0799d5292 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:58.399609 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f00fb-90a6-4d63-8615-99a0799d5292 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:58.399882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f00fb-90a6-4d63-8615-99a0799d5292 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:58.400578 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f00fb-90a6-4d63-8615-99a0799d5292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:58.402482 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f00fb-90a6-4d63-8615-99a0799d5292 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:58.427258 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4391/8696] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:42:58 2021] POST /identity/v3/projects => generated 367 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:42:58.431082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b6c0b-4e7c-45a1-90d3-566e8ef832b3 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:58.441254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b6c0b-4e7c-45a1-90d3-566e8ef832b3 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:58.495784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f4343-de44-40b9-85d8-e4784a499eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:58.496366 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f4343-de44-40b9-85d8-e4784a499eeb admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:58.496660 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f4343-de44-40b9-85d8-e4784a499eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:58.496932 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f4343-de44-40b9-85d8-e4784a499eeb admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:58.497625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f4343-de44-40b9-85d8-e4784a499eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:58.499530 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f4343-de44-40b9-85d8-e4784a499eeb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:58.518512 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4306/8697] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:42:58 2021] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:42:58.522930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f00fb-90a6-4d63-8615-99a0799d5292 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:58.533158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f00fb-90a6-4d63-8615-99a0799d5292 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:58.537831 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e36884-8be8-48fc-9bb1-ec23734caab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:58.538511 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e36884-8be8-48fc-9bb1-ec23734caab0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:58.538801 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e36884-8be8-48fc-9bb1-ec23734caab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:58.539084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e36884-8be8-48fc-9bb1-ec23734caab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:58.539816 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e36884-8be8-48fc-9bb1-ec23734caab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:58.541405 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e36884-8be8-48fc-9bb1-ec23734caab0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:58.552103 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4392/8698] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:42:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:42:58.556021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f4343-de44-40b9-85d8-e4784a499eeb admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:58.567040 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f4343-de44-40b9-85d8-e4784a499eeb admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:58.571642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924288d5-ae14-4a97-856a-3ac3fb9e192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:58.572867 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924288d5-ae14-4a97-856a-3ac3fb9e192f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:58.573157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924288d5-ae14-4a97-856a-3ac3fb9e192f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:58.573435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924288d5-ae14-4a97-856a-3ac3fb9e192f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:58.574166 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924288d5-ae14-4a97-856a-3ac3fb9e192f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:58.575766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924288d5-ae14-4a97-856a-3ac3fb9e192f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:58.585562 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4307/8699] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:42:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:42:58.589530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e36884-8be8-48fc-9bb1-ec23734caab0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:58.599227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e36884-8be8-48fc-9bb1-ec23734caab0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:58.603794 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd196b12-2db4-48b7-9526-6a01c4536f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:58.605138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd196b12-2db4-48b7-9526-6a01c4536f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:58.605414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd196b12-2db4-48b7-9526-6a01c4536f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:58.605686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd196b12-2db4-48b7-9526-6a01c4536f63 admin admin] PATH_INFO: `/v3/projects/6986e432e3b045cbb1cf0f3d28efc33c/users/e64a833362bb45de951fc1faaecc73c7/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:58.619750 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd196b12-2db4-48b7-9526-6a01c4536f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6986e432e3b045cbb1cf0f3d28efc33c, user_id=e64a833362bb45de951fc1faaecc73c7, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:58.622987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd196b12-2db4-48b7-9526-6a01c4536f63 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:58.635725 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4393/8700] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:42:58 2021] PUT /identity/v3/projects/6986e432e3b045cbb1cf0f3d28efc33c/users/e64a833362bb45de951fc1faaecc73c7/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:42:58.645846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa66a8e-ae5d-442a-a56f-3af3fa82967e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:58.646138 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa66a8e-ae5d-442a-a56f-3af3fa82967e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:58.646470 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa66a8e-ae5d-442a-a56f-3af3fa82967e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:58.672734 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-6aa66a8e-ae5d-442a-a56f-3af3fa82967e None None] MFA Rules not processed for user `e64a833362bb45de951fc1faaecc73c7`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:42:58.673929 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-6aa66a8e-ae5d-442a-a56f-3af3fa82967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:58.736234 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4308/8701] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:42:58 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:42:58.747804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd196b12-2db4-48b7-9526-6a01c4536f63 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:42:58.749442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bd196b12-2db4-48b7-9526-6a01c4536f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:42:58.803454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd196b12-2db4-48b7-9526-6a01c4536f63 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:42:58.807126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d29152-00b6-49fd-a075-da94aa8ecb42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:42:58.808311 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d29152-00b6-49fd-a075-da94aa8ecb42 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:42:58.808606 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d29152-00b6-49fd-a075-da94aa8ecb42 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:42:58.808859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d29152-00b6-49fd-a075-da94aa8ecb42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:42:58.817269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d29152-00b6-49fd-a075-da94aa8ecb42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:42:58.818716 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d29152-00b6-49fd-a075-da94aa8ecb42 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:42:58.827290 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4394/8702] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:42:58 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:43:10.519945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa66a8e-ae5d-442a-a56f-3af3fa82967e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:10.581891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa66a8e-ae5d-442a-a56f-3af3fa82967e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:10.587169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7523f3-917f-403e-bd21-e56f97847b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:10.588035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7523f3-917f-403e-bd21-e56f97847b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:10.588345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7523f3-917f-403e-bd21-e56f97847b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:10.588623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7523f3-917f-403e-bd21-e56f97847b0d admin admin] PATH_INFO: `/v3/users/e64a833362bb45de951fc1faaecc73c7` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:10.589808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7523f3-917f-403e-bd21-e56f97847b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64a833362bb45de951fc1faaecc73c7)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:10.591763 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7523f3-917f-403e-bd21-e56f97847b0d admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:10.637827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5d7523f3-917f-403e-bd21-e56f97847b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64a833362bb45de951fc1faaecc73c7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:10.644472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5d7523f3-917f-403e-bd21-e56f97847b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64a833362bb45de951fc1faaecc73c7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:10.655898 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5d7523f3-917f-403e-bd21-e56f97847b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64a833362bb45de951fc1faaecc73c7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:10.656574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5d7523f3-917f-403e-bd21-e56f97847b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64a833362bb45de951fc1faaecc73c7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:10.663778 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5d7523f3-917f-403e-bd21-e56f97847b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64a833362bb45de951fc1faaecc73c7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:10.670524 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4309/8703] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:43:10 2021] DELETE /identity/v3/users/e64a833362bb45de951fc1faaecc73c7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:43:10.675161 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db0875-d387-4b9f-89b0-2b867e91f523 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:10.675647 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db0875-d387-4b9f-89b0-2b867e91f523 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:10.675748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db0875-d387-4b9f-89b0-2b867e91f523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:10.695088 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-94db0875-d387-4b9f-89b0-2b867e91f523 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:43:10.696284 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-94db0875-d387-4b9f-89b0-2b867e91f523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:10.754511 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4395/8704] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:43:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:43:10.764487 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7523f3-917f-403e-bd21-e56f97847b0d admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:10.765846 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5d7523f3-917f-403e-bd21-e56f97847b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:10.820378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7523f3-917f-403e-bd21-e56f97847b0d admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:10.824004 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79955392-7fee-41f0-95c8-74066ffdb610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:10.824638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79955392-7fee-41f0-95c8-74066ffdb610 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:10.824920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79955392-7fee-41f0-95c8-74066ffdb610 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:10.825196 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79955392-7fee-41f0-95c8-74066ffdb610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:10.834622 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79955392-7fee-41f0-95c8-74066ffdb610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:10.835965 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79955392-7fee-41f0-95c8-74066ffdb610 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:10.845336 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4310/8705] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:43:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:43:11.011410 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db0875-d387-4b9f-89b0-2b867e91f523 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:11.012797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-94db0875-d387-4b9f-89b0-2b867e91f523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:11.030974 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db0875-d387-4b9f-89b0-2b867e91f523 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:11.035774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a22ce-ab51-43b6-bc4f-0b11cbc86fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:11.036586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a22ce-ab51-43b6-bc4f-0b11cbc86fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:11.036850 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a22ce-ab51-43b6-bc4f-0b11cbc86fce admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:11.037163 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a22ce-ab51-43b6-bc4f-0b11cbc86fce admin admin] PATH_INFO: `/v3/projects/6986e432e3b045cbb1cf0f3d28efc33c` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:11.038394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a22ce-ab51-43b6-bc4f-0b11cbc86fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=6986e432e3b045cbb1cf0f3d28efc33c)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:11.040300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a22ce-ab51-43b6-bc4f-0b11cbc86fce admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:11.085381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a59a22ce-ab51-43b6-bc4f-0b11cbc86fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6986e432e3b045cbb1cf0f3d28efc33c', 'request_id': 'req-a59a22ce-ab51-43b6-bc4f-0b11cbc86fce'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:11.091897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a59a22ce-ab51-43b6-bc4f-0b11cbc86fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6986e432e3b045cbb1cf0f3d28efc33c', 'request_id': 'req-a59a22ce-ab51-43b6-bc4f-0b11cbc86fce'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:11.099199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a59a22ce-ab51-43b6-bc4f-0b11cbc86fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6986e432e3b045cbb1cf0f3d28efc33c', 'request_id': 'req-a59a22ce-ab51-43b6-bc4f-0b11cbc86fce'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:11.110147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a59a22ce-ab51-43b6-bc4f-0b11cbc86fce admin admin] The token cache is being invalidate because project 6986e432e3b045cbb1cf0f3d28efc33c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:43:11.110481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a59a22ce-ab51-43b6-bc4f-0b11cbc86fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:11.111115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-a59a22ce-ab51-43b6-bc4f-0b11cbc86fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:11.112637 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4396/8706] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:43:11 2021] DELETE /identity/v3/projects/6986e432e3b045cbb1cf0f3d28efc33c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:43:11.118784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c822c-e476-4e5a-8fcd-eb6cf0b8c9d7 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:11.119075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c822c-e476-4e5a-8fcd-eb6cf0b8c9d7 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:11.119354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c822c-e476-4e5a-8fcd-eb6cf0b8c9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:11.136411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-297c822c-e476-4e5a-8fcd-eb6cf0b8c9d7 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:43:11.137588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-297c822c-e476-4e5a-8fcd-eb6cf0b8c9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:11.195681 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4311/8707] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:43:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:43:11.203448 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74203e6b-7b85-4c11-af6b-0babfec8a8b9 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:11.203735 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74203e6b-7b85-4c11-af6b-0babfec8a8b9 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:11.204015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74203e6b-7b85-4c11-af6b-0babfec8a8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:11.222562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-74203e6b-7b85-4c11-af6b-0babfec8a8b9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:43:11.223746 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-74203e6b-7b85-4c11-af6b-0babfec8a8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:11.232143 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4397/8708] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:43:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:43:11.236224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c822c-e476-4e5a-8fcd-eb6cf0b8c9d7 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:11.245558 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c822c-e476-4e5a-8fcd-eb6cf0b8c9d7 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:11.250056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36056605-4678-4b56-b0a4-3810229b259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:11.251011 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36056605-4678-4b56-b0a4-3810229b259a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:11.251297 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36056605-4678-4b56-b0a4-3810229b259a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:11.251574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36056605-4678-4b56-b0a4-3810229b259a admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:11.252331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36056605-4678-4b56-b0a4-3810229b259a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:43:11.252639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36056605-4678-4b56-b0a4-3810229b259a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:11.254199 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36056605-4678-4b56-b0a4-3810229b259a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:11.265786 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4312/8709] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:43:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 18 21:43:11.270160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74203e6b-7b85-4c11-af6b-0babfec8a8b9 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:11.282818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74203e6b-7b85-4c11-af6b-0babfec8a8b9 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:11.288132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86aa9eb-4cae-4d53-990c-9010865ae06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:11.288823 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aa9eb-4cae-4d53-990c-9010865ae06a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:11.289107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aa9eb-4cae-4d53-990c-9010865ae06a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:11.289385 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aa9eb-4cae-4d53-990c-9010865ae06a admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:11.290082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86aa9eb-4cae-4d53-990c-9010865ae06a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:11.292048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86aa9eb-4cae-4d53-990c-9010865ae06a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:11.316577 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4398/8710] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:43:11 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:43:11.320698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36056605-4678-4b56-b0a4-3810229b259a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:11.330986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36056605-4678-4b56-b0a4-3810229b259a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:11.386214 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1c126-eb00-4a6f-b69d-a1c47a8a0f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:11.386906 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1c126-eb00-4a6f-b69d-a1c47a8a0f55 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:11.387190 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1c126-eb00-4a6f-b69d-a1c47a8a0f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:11.387464 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1c126-eb00-4a6f-b69d-a1c47a8a0f55 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:11.388158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1c126-eb00-4a6f-b69d-a1c47a8a0f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:11.390037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1c126-eb00-4a6f-b69d-a1c47a8a0f55 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:11.409171 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4313/8711] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:43:11 2021] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:43:11.414074 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86aa9eb-4cae-4d53-990c-9010865ae06a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:11.424184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86aa9eb-4cae-4d53-990c-9010865ae06a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:11.428892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510d7bf-6a91-4f4e-b3e4-1a986ae30ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:11.429534 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510d7bf-6a91-4f4e-b3e4-1a986ae30ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:11.429813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510d7bf-6a91-4f4e-b3e4-1a986ae30ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:11.430083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510d7bf-6a91-4f4e-b3e4-1a986ae30ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:11.430853 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510d7bf-6a91-4f4e-b3e4-1a986ae30ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:11.432472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510d7bf-6a91-4f4e-b3e4-1a986ae30ce3 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:11.442605 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4399/8712] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:43:11 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:43:11.446178 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1c126-eb00-4a6f-b69d-a1c47a8a0f55 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:11.456886 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1c126-eb00-4a6f-b69d-a1c47a8a0f55 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:11.461699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5f11e-ec73-4eff-bedf-627fc774be8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:11.462372 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f11e-ec73-4eff-bedf-627fc774be8b admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:11.462682 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f11e-ec73-4eff-bedf-627fc774be8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:11.462996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f11e-ec73-4eff-bedf-627fc774be8b admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:11.464289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5f11e-ec73-4eff-bedf-627fc774be8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:11.465836 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5f11e-ec73-4eff-bedf-627fc774be8b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:11.475706 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4314/8713] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:43:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:43:11.479619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510d7bf-6a91-4f4e-b3e4-1a986ae30ce3 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:11.489536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510d7bf-6a91-4f4e-b3e4-1a986ae30ce3 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:11.494075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ddcb8-51a2-49c1-9e0c-cfe43e092457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:11.494973 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ddcb8-51a2-49c1-9e0c-cfe43e092457 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:11.495253 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ddcb8-51a2-49c1-9e0c-cfe43e092457 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:11.495530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ddcb8-51a2-49c1-9e0c-cfe43e092457 admin admin] PATH_INFO: `/v3/projects/4cba2d92003b4384beebaef96d3cf506/users/5bfe99d22b3a461ca8aa708a46fe701f/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:11.509546 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ddcb8-51a2-49c1-9e0c-cfe43e092457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cba2d92003b4384beebaef96d3cf506, user_id=5bfe99d22b3a461ca8aa708a46fe701f, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:11.512681 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ddcb8-51a2-49c1-9e0c-cfe43e092457 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:11.525308 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4400/8714] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:43:11 2021] PUT /identity/v3/projects/4cba2d92003b4384beebaef96d3cf506/users/5bfe99d22b3a461ca8aa708a46fe701f/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:43:11.535752 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efa1d9-cf64-49fc-b331-8e5b16e0547f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:11.536217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efa1d9-cf64-49fc-b331-8e5b16e0547f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:11.536336 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efa1d9-cf64-49fc-b331-8e5b16e0547f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:11.562069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-06efa1d9-cf64-49fc-b331-8e5b16e0547f None None] MFA Rules not processed for user `5bfe99d22b3a461ca8aa708a46fe701f`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:43:11.563285 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-06efa1d9-cf64-49fc-b331-8e5b16e0547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:11.626036 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4315/8715] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:43:11 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:43:11.636810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ddcb8-51a2-49c1-9e0c-cfe43e092457 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:11.638549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-197ddcb8-51a2-49c1-9e0c-cfe43e092457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:11.696060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ddcb8-51a2-49c1-9e0c-cfe43e092457 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:11.700370 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90099e-7637-4d75-8819-299535abb99a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:11.700968 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90099e-7637-4d75-8819-299535abb99a service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:11.701248 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90099e-7637-4d75-8819-299535abb99a service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:11.701525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90099e-7637-4d75-8819-299535abb99a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:11.709918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90099e-7637-4d75-8819-299535abb99a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:11.711464 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90099e-7637-4d75-8819-299535abb99a service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:11.720622 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4401/8716] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:43:11 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:43:16.088644 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efa1d9-cf64-49fc-b331-8e5b16e0547f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:16.149876 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efa1d9-cf64-49fc-b331-8e5b16e0547f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:16.154923 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5bf18-31bd-4e11-906e-a8ce1b60b7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:16.155784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5bf18-31bd-4e11-906e-a8ce1b60b7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:16.156070 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5bf18-31bd-4e11-906e-a8ce1b60b7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:16.156350 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5bf18-31bd-4e11-906e-a8ce1b60b7cd admin admin] PATH_INFO: `/v3/users/5bfe99d22b3a461ca8aa708a46fe701f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:16.157538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5bf18-31bd-4e11-906e-a8ce1b60b7cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bfe99d22b3a461ca8aa708a46fe701f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:16.159547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5bf18-31bd-4e11-906e-a8ce1b60b7cd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:16.204328 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e0f5bf18-31bd-4e11-906e-a8ce1b60b7cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bfe99d22b3a461ca8aa708a46fe701f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:16.211239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e0f5bf18-31bd-4e11-906e-a8ce1b60b7cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bfe99d22b3a461ca8aa708a46fe701f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:16.222944 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e0f5bf18-31bd-4e11-906e-a8ce1b60b7cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bfe99d22b3a461ca8aa708a46fe701f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:16.223602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e0f5bf18-31bd-4e11-906e-a8ce1b60b7cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bfe99d22b3a461ca8aa708a46fe701f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:16.231681 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-e0f5bf18-31bd-4e11-906e-a8ce1b60b7cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bfe99d22b3a461ca8aa708a46fe701f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:16.237565 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4316/8717] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:43:16 2021] DELETE /identity/v3/users/5bfe99d22b3a461ca8aa708a46fe701f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:43:16.242076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3348c0-9e8e-4db1-8dbd-b14c50a60270 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:16.242596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3348c0-9e8e-4db1-8dbd-b14c50a60270 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:16.242697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3348c0-9e8e-4db1-8dbd-b14c50a60270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:16.259919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-7a3348c0-9e8e-4db1-8dbd-b14c50a60270 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:43:16.261112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7a3348c0-9e8e-4db1-8dbd-b14c50a60270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:16.318384 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4402/8718] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:43:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:43:16.328136 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5bf18-31bd-4e11-906e-a8ce1b60b7cd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:16.329532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e0f5bf18-31bd-4e11-906e-a8ce1b60b7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:16.385731 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5bf18-31bd-4e11-906e-a8ce1b60b7cd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:16.389458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10500fe9-8ae4-48c1-a223-4260ffc06017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:16.390098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10500fe9-8ae4-48c1-a223-4260ffc06017 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:16.390431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10500fe9-8ae4-48c1-a223-4260ffc06017 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:16.390711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10500fe9-8ae4-48c1-a223-4260ffc06017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:16.399605 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10500fe9-8ae4-48c1-a223-4260ffc06017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:16.401539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10500fe9-8ae4-48c1-a223-4260ffc06017 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:16.410812 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4317/8719] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:43:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:43:16.573857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3348c0-9e8e-4db1-8dbd-b14c50a60270 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:16.575297 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-7a3348c0-9e8e-4db1-8dbd-b14c50a60270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:16.588717 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3348c0-9e8e-4db1-8dbd-b14c50a60270 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:16.593305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e44b70-e928-4e62-a38c-180f8df70e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:16.594341 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e44b70-e928-4e62-a38c-180f8df70e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:16.594622 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e44b70-e928-4e62-a38c-180f8df70e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:16.595100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e44b70-e928-4e62-a38c-180f8df70e00 admin admin] PATH_INFO: `/v3/projects/4cba2d92003b4384beebaef96d3cf506` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:16.596815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e44b70-e928-4e62-a38c-180f8df70e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cba2d92003b4384beebaef96d3cf506)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:16.598832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e44b70-e928-4e62-a38c-180f8df70e00 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:16.643987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-55e44b70-e928-4e62-a38c-180f8df70e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cba2d92003b4384beebaef96d3cf506', 'request_id': 'req-55e44b70-e928-4e62-a38c-180f8df70e00'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:16.649930 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-55e44b70-e928-4e62-a38c-180f8df70e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cba2d92003b4384beebaef96d3cf506', 'request_id': 'req-55e44b70-e928-4e62-a38c-180f8df70e00'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:16.657921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-55e44b70-e928-4e62-a38c-180f8df70e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cba2d92003b4384beebaef96d3cf506', 'request_id': 'req-55e44b70-e928-4e62-a38c-180f8df70e00'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:16.668289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-55e44b70-e928-4e62-a38c-180f8df70e00 admin admin] The token cache is being invalidate because project 4cba2d92003b4384beebaef96d3cf506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:43:16.668576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-55e44b70-e928-4e62-a38c-180f8df70e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:16.669197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-55e44b70-e928-4e62-a38c-180f8df70e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:43:16.670821 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4403/8720] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:43:16 2021] DELETE /identity/v3/projects/4cba2d92003b4384beebaef96d3cf506 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:43:16.677954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948be9a-a8e2-4960-9e33-dfb5b359eb77 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:16.678317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948be9a-a8e2-4960-9e33-dfb5b359eb77 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:16.678587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948be9a-a8e2-4960-9e33-dfb5b359eb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:16.695824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-5948be9a-a8e2-4960-9e33-dfb5b359eb77 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:43:16.697048 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5948be9a-a8e2-4960-9e33-dfb5b359eb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:16.754727 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4318/8721] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:43:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:43:16.763134 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c923abe-530b-4e2d-bc01-c34de408826d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:16.763424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c923abe-530b-4e2d-bc01-c34de408826d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:16.763729 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c923abe-530b-4e2d-bc01-c34de408826d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:16.782084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-1c923abe-530b-4e2d-bc01-c34de408826d None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:43:16.783288 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1c923abe-530b-4e2d-bc01-c34de408826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:16.791579 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4404/8722] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:43:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:43:16.795603 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948be9a-a8e2-4960-9e33-dfb5b359eb77 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:16.805246 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948be9a-a8e2-4960-9e33-dfb5b359eb77 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:16.809862 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd4cb0-0ab7-4ad7-bf62-8840da19c25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:16.810543 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4cb0-0ab7-4ad7-bf62-8840da19c25a admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:16.810826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4cb0-0ab7-4ad7-bf62-8840da19c25a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:16.811101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4cb0-0ab7-4ad7-bf62-8840da19c25a admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:16.811830 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd4cb0-0ab7-4ad7-bf62-8840da19c25a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:43:16.812163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd4cb0-0ab7-4ad7-bf62-8840da19c25a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:16.813727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd4cb0-0ab7-4ad7-bf62-8840da19c25a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:16.825430 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4319/8723] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:43:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:43:16.829732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c923abe-530b-4e2d-bc01-c34de408826d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:16.843212 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c923abe-530b-4e2d-bc01-c34de408826d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:16.847955 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef62a64-3dba-4cef-bc24-00ec8624e0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:16.848603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef62a64-3dba-4cef-bc24-00ec8624e0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:16.848885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef62a64-3dba-4cef-bc24-00ec8624e0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:16.849160 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef62a64-3dba-4cef-bc24-00ec8624e0b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:16.849861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef62a64-3dba-4cef-bc24-00ec8624e0b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:16.851783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef62a64-3dba-4cef-bc24-00ec8624e0b2 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:16.877052 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4405/8724] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:43:16 2021] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:43:16.881634 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd4cb0-0ab7-4ad7-bf62-8840da19c25a admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:16.892209 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd4cb0-0ab7-4ad7-bf62-8840da19c25a admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:16.946414 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e0f6a-9fd2-460d-aa17-d927d451d615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:16.947078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e0f6a-9fd2-460d-aa17-d927d451d615 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:16.947970 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e0f6a-9fd2-460d-aa17-d927d451d615 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:16.948282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e0f6a-9fd2-460d-aa17-d927d451d615 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:16.949016 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e0f6a-9fd2-460d-aa17-d927d451d615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:16.950964 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e0f6a-9fd2-460d-aa17-d927d451d615 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:16.970590 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4320/8725] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:43:16 2021] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:43:16.974730 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef62a64-3dba-4cef-bc24-00ec8624e0b2 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:16.984881 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef62a64-3dba-4cef-bc24-00ec8624e0b2 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:16.989455 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2693d-16c4-4571-b024-8050a1b2920e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:16.990100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2693d-16c4-4571-b024-8050a1b2920e admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:16.990424 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2693d-16c4-4571-b024-8050a1b2920e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:16.990705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2693d-16c4-4571-b024-8050a1b2920e admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:16.991429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2693d-16c4-4571-b024-8050a1b2920e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:16.993010 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2693d-16c4-4571-b024-8050a1b2920e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:17.003948 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4406/8726] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:43:16 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:43:17.007788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e0f6a-9fd2-460d-aa17-d927d451d615 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:17.018364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e0f6a-9fd2-460d-aa17-d927d451d615 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:17.023007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b90687-6abe-4230-9c4e-5f22a841b913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:17.023688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b90687-6abe-4230-9c4e-5f22a841b913 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:17.023976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b90687-6abe-4230-9c4e-5f22a841b913 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:17.024257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b90687-6abe-4230-9c4e-5f22a841b913 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:17.024986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b90687-6abe-4230-9c4e-5f22a841b913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:17.026637 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b90687-6abe-4230-9c4e-5f22a841b913 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:17.036471 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4321/8727] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:43:17 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:43:17.040411 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2693d-16c4-4571-b024-8050a1b2920e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:17.050145 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2693d-16c4-4571-b024-8050a1b2920e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:17.054803 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483e80f-ba61-47dd-9f2e-c183fe1cd4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:17.055655 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483e80f-ba61-47dd-9f2e-c183fe1cd4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:17.055939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483e80f-ba61-47dd-9f2e-c183fe1cd4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:17.056219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483e80f-ba61-47dd-9f2e-c183fe1cd4ae admin admin] PATH_INFO: `/v3/projects/fb1a66fd59be4793a6090985e8ae5998/users/9ce8de7276144144a52e038b19adda07/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:17.071496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483e80f-ba61-47dd-9f2e-c183fe1cd4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb1a66fd59be4793a6090985e8ae5998, user_id=9ce8de7276144144a52e038b19adda07, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:17.074842 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483e80f-ba61-47dd-9f2e-c183fe1cd4ae admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:17.087495 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4407/8728] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:43:17 2021] PUT /identity/v3/projects/fb1a66fd59be4793a6090985e8ae5998/users/9ce8de7276144144a52e038b19adda07/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:43:17.092516 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6aba1-d840-4ed5-aea7-69ec3b596856 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:17.093002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6aba1-d840-4ed5-aea7-69ec3b596856 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:17.093107 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6aba1-d840-4ed5-aea7-69ec3b596856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:17.110363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-38b6aba1-d840-4ed5-aea7-69ec3b596856 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:43:17.111557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-38b6aba1-d840-4ed5-aea7-69ec3b596856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:17.167580 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4322/8729] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:43:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:43:17.177408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483e80f-ba61-47dd-9f2e-c183fe1cd4ae admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:17.179082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d483e80f-ba61-47dd-9f2e-c183fe1cd4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:17.238100 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483e80f-ba61-47dd-9f2e-c183fe1cd4ae admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:17.241763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f082d-23cf-44b4-a7af-833f3d8847f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:17.242456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f082d-23cf-44b4-a7af-833f3d8847f7 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:17.243000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f082d-23cf-44b4-a7af-833f3d8847f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:17.243110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f082d-23cf-44b4-a7af-833f3d8847f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:17.252317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f082d-23cf-44b4-a7af-833f3d8847f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:17.253742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f082d-23cf-44b4-a7af-833f3d8847f7 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:17.263582 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4408/8730] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:43:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:43:21.181364 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a1bb0-23b0-4ed4-a8ac-15e51e52b788 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:21.181936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a1bb0-23b0-4ed4-a8ac-15e51e52b788 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:21.182023 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a1bb0-23b0-4ed4-a8ac-15e51e52b788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:21.214354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-9a3a1bb0-23b0-4ed4-a8ac-15e51e52b788 None None] MFA Rules not processed for user `9ce8de7276144144a52e038b19adda07`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:43:21.215625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9a3a1bb0-23b0-4ed4-a8ac-15e51e52b788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:21.289589 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4323/8731] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:43:21 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:43:21.295426 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f082d-23cf-44b4-a7af-833f3d8847f7 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:21.305351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f082d-23cf-44b4-a7af-833f3d8847f7 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:21.310442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae61fee-0a0b-48f5-b5c8-6b12796cc58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:21.311096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae61fee-0a0b-48f5-b5c8-6b12796cc58f admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:21.311373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae61fee-0a0b-48f5-b5c8-6b12796cc58f admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:21.311646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae61fee-0a0b-48f5-b5c8-6b12796cc58f admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:21.312346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae61fee-0a0b-48f5-b5c8-6b12796cc58f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:21.314245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae61fee-0a0b-48f5-b5c8-6b12796cc58f admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:21.344797 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4409/8732] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:43:21 2021] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:43:21.349050 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a1bb0-23b0-4ed4-a8ac-15e51e52b788 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:21.360433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a1bb0-23b0-4ed4-a8ac-15e51e52b788 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:21.420536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d019b0-3907-4431-ba4f-ac0fef627dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:21.421292 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d019b0-3907-4431-ba4f-ac0fef627dce admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:21.421583 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d019b0-3907-4431-ba4f-ac0fef627dce admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:21.421863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d019b0-3907-4431-ba4f-ac0fef627dce admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:21.422623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d019b0-3907-4431-ba4f-ac0fef627dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:21.424549 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d019b0-3907-4431-ba4f-ac0fef627dce admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:21.447939 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4324/8733] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:43:21 2021] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:43:21.452139 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae61fee-0a0b-48f5-b5c8-6b12796cc58f admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:21.463421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae61fee-0a0b-48f5-b5c8-6b12796cc58f admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:21.468398 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e623406-2c59-49f2-b24f-efa74ab2ac10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:21.469147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e623406-2c59-49f2-b24f-efa74ab2ac10 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:21.469488 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e623406-2c59-49f2-b24f-efa74ab2ac10 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:21.469856 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e623406-2c59-49f2-b24f-efa74ab2ac10 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:21.470632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e623406-2c59-49f2-b24f-efa74ab2ac10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:21.472428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e623406-2c59-49f2-b24f-efa74ab2ac10 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:21.484107 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4410/8734] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:43:21 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:43:21.488460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d019b0-3907-4431-ba4f-ac0fef627dce admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:21.499633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d019b0-3907-4431-ba4f-ac0fef627dce admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:21.504422 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64102cdf-b17c-4c0e-bcc4-4638e1f70f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:21.505419 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64102cdf-b17c-4c0e-bcc4-4638e1f70f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:21.505773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64102cdf-b17c-4c0e-bcc4-4638e1f70f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:21.506123 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64102cdf-b17c-4c0e-bcc4-4638e1f70f05 admin admin] PATH_INFO: `/v3/projects/67edc3d6735d4b5ca7f0f1961d9c0813/users/e798ad7a88294f39964680ed4c9e128d/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:21.523130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64102cdf-b17c-4c0e-bcc4-4638e1f70f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67edc3d6735d4b5ca7f0f1961d9c0813, user_id=e798ad7a88294f39964680ed4c9e128d, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:21.525826 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64102cdf-b17c-4c0e-bcc4-4638e1f70f05 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:21.539768 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4325/8735] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:43:21 2021] PUT /identity/v3/projects/67edc3d6735d4b5ca7f0f1961d9c0813/users/e798ad7a88294f39964680ed4c9e128d/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:43:21.543788 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e623406-2c59-49f2-b24f-efa74ab2ac10 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:21.553911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e623406-2c59-49f2-b24f-efa74ab2ac10 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:21.612820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34157d3f-55ef-4f6b-8067-73843230a820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:21.613489 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34157d3f-55ef-4f6b-8067-73843230a820 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:21.613771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34157d3f-55ef-4f6b-8067-73843230a820 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:21.614083 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34157d3f-55ef-4f6b-8067-73843230a820 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:21.614892 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34157d3f-55ef-4f6b-8067-73843230a820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:21.616496 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34157d3f-55ef-4f6b-8067-73843230a820 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:21.632782 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64102cdf-b17c-4c0e-bcc4-4638e1f70f05 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:21.634427 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4411/8736] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:43:21 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:43:21.647358 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64102cdf-b17c-4c0e-bcc4-4638e1f70f05 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:21.652584 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec80d3e-0a07-4344-a7c9-4ae7e1209e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:21.653575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec80d3e-0a07-4344-a7c9-4ae7e1209e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:21.653940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec80d3e-0a07-4344-a7c9-4ae7e1209e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:21.654327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec80d3e-0a07-4344-a7c9-4ae7e1209e67 admin admin] PATH_INFO: `/v3/projects/67edc3d6735d4b5ca7f0f1961d9c0813/users/e798ad7a88294f39964680ed4c9e128d/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:21.656502 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec80d3e-0a07-4344-a7c9-4ae7e1209e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67edc3d6735d4b5ca7f0f1961d9c0813, user_id=e798ad7a88294f39964680ed4c9e128d, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:21.659389 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec80d3e-0a07-4344-a7c9-4ae7e1209e67 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:21.671956 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4326/8737] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:43:21 2021] PUT /identity/v3/projects/67edc3d6735d4b5ca7f0f1961d9c0813/users/e798ad7a88294f39964680ed4c9e128d/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:43:26.518576 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49cf08-96f0-4f96-8d91-b5b0bf6fdf5a None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:26.519098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49cf08-96f0-4f96-8d91-b5b0bf6fdf5a None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:26.519218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49cf08-96f0-4f96-8d91-b5b0bf6fdf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:26.548362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-0d49cf08-96f0-4f96-8d91-b5b0bf6fdf5a None None] MFA Rules not processed for user `e798ad7a88294f39964680ed4c9e128d`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:43:26.549591 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0d49cf08-96f0-4f96-8d91-b5b0bf6fdf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:26.624450 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4412/8738] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:43:26 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:43:26.652890 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec80d3e-0a07-4344-a7c9-4ae7e1209e67 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:26.654708 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1ec80d3e-0a07-4344-a7c9-4ae7e1209e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:26.713952 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec80d3e-0a07-4344-a7c9-4ae7e1209e67 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:26.718962 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674f497-ddfc-4bf3-b75e-6ed41142e26b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:26.719661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674f497-ddfc-4bf3-b75e-6ed41142e26b service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:26.719949 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674f497-ddfc-4bf3-b75e-6ed41142e26b service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:26.720229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674f497-ddfc-4bf3-b75e-6ed41142e26b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:26.780390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674f497-ddfc-4bf3-b75e-6ed41142e26b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:26.781834 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674f497-ddfc-4bf3-b75e-6ed41142e26b service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:26.792320 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4327/8739] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:43:26 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:43:26.905332 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be487e-389c-4a64-800a-b537c7f94cf0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:26.905640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be487e-389c-4a64-800a-b537c7f94cf0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:26.905947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be487e-389c-4a64-800a-b537c7f94cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:26.952861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-13be487e-389c-4a64-800a-b537c7f94cf0 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:43:26.954125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-13be487e-389c-4a64-800a-b537c7f94cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:27.016384 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4413/8740] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:43:26 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:43:27.069286 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d9703-6a4d-4977-9e54-a28d93915f59 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:27.069581 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d9703-6a4d-4977-9e54-a28d93915f59 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:27.069864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d9703-6a4d-4977-9e54-a28d93915f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:27.116716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-611d9703-6a4d-4977-9e54-a28d93915f59 None None] MFA Rules not processed for user `f5e4bc28d0744b65ab520bf79cea5a45`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:43:27.117909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-611d9703-6a4d-4977-9e54-a28d93915f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:27.187242 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4328/8741] 10.222.0.13 () {58 vars in 1039 bytes} [Sat Dec 18 21:43:27 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:43:27.193642 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be487e-389c-4a64-800a-b537c7f94cf0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:27.206107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be487e-389c-4a64-800a-b537c7f94cf0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:27.211295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0736c1f-50c9-4a59-bcc6-25c42865a6b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:27.211926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0736c1f-50c9-4a59-bcc6-25c42865a6b9 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:27.212209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0736c1f-50c9-4a59-bcc6-25c42865a6b9 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:27.212484 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0736c1f-50c9-4a59-bcc6-25c42865a6b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:27.221004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0736c1f-50c9-4a59-bcc6-25c42865a6b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:27.222607 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0736c1f-50c9-4a59-bcc6-25c42865a6b9 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:27.230686 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4414/8742] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:43:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:43:36.142409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6109e-b715-43cd-8fb0-aff0fe6e0258 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:36.142968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6109e-b715-43cd-8fb0-aff0fe6e0258 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:36.142968 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6109e-b715-43cd-8fb0-aff0fe6e0258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:36.159818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-55a6109e-b715-43cd-8fb0-aff0fe6e0258 None None] MFA Rules not processed for user `9ce8de7276144144a52e038b19adda07`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:43:36.160986 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-55a6109e-b715-43cd-8fb0-aff0fe6e0258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:36.168214 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4329/8743] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:43:36 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:43:36.731322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0736c1f-50c9-4a59-bcc6-25c42865a6b9 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:36.734649 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e0736c1f-50c9-4a59-bcc6-25c42865a6b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:36.804140 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0736c1f-50c9-4a59-bcc6-25c42865a6b9 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:36.809234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b444ed6-a24e-4913-ad1d-7566ed4e0673 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:36.809871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b444ed6-a24e-4913-ad1d-7566ed4e0673 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:36.810154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b444ed6-a24e-4913-ad1d-7566ed4e0673 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:36.810476 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b444ed6-a24e-4913-ad1d-7566ed4e0673 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:36.812231 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-0b444ed6-a24e-4913-ad1d-7566ed4e0673 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:36.823718 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b444ed6-a24e-4913-ad1d-7566ed4e0673 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:36.825275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b444ed6-a24e-4913-ad1d-7566ed4e0673 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:36.835090 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4415/8744] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:43:36 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:43:37.905163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dd077-f8ad-450c-adb0-db9c6c8bc79a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:37.905670 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dd077-f8ad-450c-adb0-db9c6c8bc79a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:37.905771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dd077-f8ad-450c-adb0-db9c6c8bc79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:37.926861 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a59dd077-f8ad-450c-adb0-db9c6c8bc79a None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:43:37.928076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a59dd077-f8ad-450c-adb0-db9c6c8bc79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:43:37.935316 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4330/8745] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:43:37 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:43:37.948900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b444ed6-a24e-4913-ad1d-7566ed4e0673 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:43:37.966686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b444ed6-a24e-4913-ad1d-7566ed4e0673 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:43:37.972605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe084b-25a7-4410-ba06-2fc7710e54f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:43:37.973887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe084b-25a7-4410-ba06-2fc7710e54f1 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:43:37.974179 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe084b-25a7-4410-ba06-2fc7710e54f1 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:43:37.974501 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe084b-25a7-4410-ba06-2fc7710e54f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:43:37.984015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe084b-25a7-4410-ba06-2fc7710e54f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:43:37.985627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe084b-25a7-4410-ba06-2fc7710e54f1 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:43:37.995720 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4416/8746] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:43:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:44:01.242810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59dd077-f8ad-450c-adb0-db9c6c8bc79a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:44:01.295518 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59dd077-f8ad-450c-adb0-db9c6c8bc79a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:44:01.299097 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c898ae2-bb21-48e9-b8f7-e68649327aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:44:01.299736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c898ae2-bb21-48e9-b8f7-e68649327aad service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:44:01.300022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c898ae2-bb21-48e9-b8f7-e68649327aad service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:44:01.300300 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c898ae2-bb21-48e9-b8f7-e68649327aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:44:01.308972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c898ae2-bb21-48e9-b8f7-e68649327aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:44:01.310396 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c898ae2-bb21-48e9-b8f7-e68649327aad service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:44:01.319477 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4331/8747] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:44:01 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:44:36.377124 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee7b58-c78b-4612-9486-337f6e3785bf None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:44:36.377705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee7b58-c78b-4612-9486-337f6e3785bf None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:44:36.377705 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee7b58-c78b-4612-9486-337f6e3785bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:44:36.414737 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f7ee7b58-c78b-4612-9486-337f6e3785bf None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:44:36.415963 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f7ee7b58-c78b-4612-9486-337f6e3785bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:44:36.484470 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4417/8748] 10.222.0.13 () {58 vars in 1058 bytes} [Sat Dec 18 21:44:36 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:44:37.671081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f5bbd-a27c-4835-9a76-88855291ed32 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:44:37.671623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f5bbd-a27c-4835-9a76-88855291ed32 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:44:37.671623 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f5bbd-a27c-4835-9a76-88855291ed32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:44:37.690175 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a79f5bbd-a27c-4835-9a76-88855291ed32 None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:44:37.691411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a79f5bbd-a27c-4835-9a76-88855291ed32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:44:37.700478 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4332/8749] 10.222.0.13 () {58 vars in 1058 bytes} [Sat Dec 18 21:44:37 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:44:38.882407 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc809667-d8aa-4fbe-aac4-ce290b29b59c None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:44:38.882989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc809667-d8aa-4fbe-aac4-ce290b29b59c None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:44:38.882989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc809667-d8aa-4fbe-aac4-ce290b29b59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:44:38.901156 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-bc809667-d8aa-4fbe-aac4-ce290b29b59c None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:44:38.902374 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-bc809667-d8aa-4fbe-aac4-ce290b29b59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:44:38.911444 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4418/8750] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:44:38 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:44:38.922541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f5bbd-a27c-4835-9a76-88855291ed32 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:44:38.932465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f5bbd-a27c-4835-9a76-88855291ed32 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:44:38.936144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b05427-5bdf-47f4-aff8-fda89b3e1236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:44:38.936783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b05427-5bdf-47f4-aff8-fda89b3e1236 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:44:38.937071 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b05427-5bdf-47f4-aff8-fda89b3e1236 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:44:38.937352 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b05427-5bdf-47f4-aff8-fda89b3e1236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:44:38.947982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b05427-5bdf-47f4-aff8-fda89b3e1236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:44:38.949476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b05427-5bdf-47f4-aff8-fda89b3e1236 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:44:38.960198 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4333/8751] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:44:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:44:42.504494 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfec2f-d992-4ff9-b4f7-7042777bec26 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:44:42.505056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfec2f-d992-4ff9-b4f7-7042777bec26 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:44:42.505056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfec2f-d992-4ff9-b4f7-7042777bec26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:44:42.523380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-40dfec2f-d992-4ff9-b4f7-7042777bec26 None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:44:42.524593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-40dfec2f-d992-4ff9-b4f7-7042777bec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:44:42.533958 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4419/8752] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:44:42 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:44:42.545361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b05427-5bdf-47f4-aff8-fda89b3e1236 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:44:42.553599 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b05427-5bdf-47f4-aff8-fda89b3e1236 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:44:42.557711 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe1ff7-3095-4c38-b893-906c32e9190f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:44:42.558444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe1ff7-3095-4c38-b893-906c32e9190f service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:44:42.558735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe1ff7-3095-4c38-b893-906c32e9190f service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:44:42.559015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe1ff7-3095-4c38-b893-906c32e9190f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:44:42.568824 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe1ff7-3095-4c38-b893-906c32e9190f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:44:42.570220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe1ff7-3095-4c38-b893-906c32e9190f service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:44:42.581315 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4334/8753] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:44:42 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:45:09.528752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dfd49-baa1-43c0-9e92-6f3419248a74 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:09.529393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dfd49-baa1-43c0-9e92-6f3419248a74 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:09.529393 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dfd49-baa1-43c0-9e92-6f3419248a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:09.564012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-122dfd49-baa1-43c0-9e92-6f3419248a74 None None] MFA Rules not processed for user `6f8eeb55c523480fb45d4bbb8afe8e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:45:09.565190 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-122dfd49-baa1-43c0-9e92-6f3419248a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:45:09.580905 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4420/8754] 10.222.0.31 () {58 vars in 1015 bytes} [Sat Dec 18 21:45:09 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:45:09.595737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe1ff7-3095-4c38-b893-906c32e9190f service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:09.597112 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1efe1ff7-3095-4c38-b893-906c32e9190f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:45:09.616840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe1ff7-3095-4c38-b893-906c32e9190f service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:09.621841 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fcc9c-2b28-41be-a832-4f6b62f1c934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:09.622522 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fcc9c-2b28-41be-a832-4f6b62f1c934 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:09.622810 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fcc9c-2b28-41be-a832-4f6b62f1c934 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:09.623092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fcc9c-2b28-41be-a832-4f6b62f1c934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:09.630237 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fcc9c-2b28-41be-a832-4f6b62f1c934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:09.631746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fcc9c-2b28-41be-a832-4f6b62f1c934 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:09.639878 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4335/8755] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:45:09 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:45:19.985690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd56ab2-0e4b-4b9c-9ed2-ee16ccedd737 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:19.986107 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd56ab2-0e4b-4b9c-9ed2-ee16ccedd737 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:19.986345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd56ab2-0e4b-4b9c-9ed2-ee16ccedd737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:20.011362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-4fd56ab2-0e4b-4b9c-9ed2-ee16ccedd737 None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:45:20.015193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-4fd56ab2-0e4b-4b9c-9ed2-ee16ccedd737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:45:20.038585 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4421/8756] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:45:19 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:45:20.054534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fcc9c-2b28-41be-a832-4f6b62f1c934 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:20.071427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fcc9c-2b28-41be-a832-4f6b62f1c934 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:20.078463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b96c5f-64b9-4e9e-95b5-9fb6c96f6210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:20.079567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b96c5f-64b9-4e9e-95b5-9fb6c96f6210 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:20.080090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b96c5f-64b9-4e9e-95b5-9fb6c96f6210 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:20.080548 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b96c5f-64b9-4e9e-95b5-9fb6c96f6210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:20.094000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b96c5f-64b9-4e9e-95b5-9fb6c96f6210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:20.096003 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b96c5f-64b9-4e9e-95b5-9fb6c96f6210 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:20.111173 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4336/8757] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:45:20 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:45:25.811939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb96a6-50dc-4dfd-881d-fe9528fa3da6 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:25.812520 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb96a6-50dc-4dfd-881d-fe9528fa3da6 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:25.812643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb96a6-50dc-4dfd-881d-fe9528fa3da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:25.832282 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c6cb96a6-50dc-4dfd-881d-fe9528fa3da6 None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:45:25.833753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c6cb96a6-50dc-4dfd-881d-fe9528fa3da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:45:25.845578 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4422/8758] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:45:25 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:45:25.859704 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b96c5f-64b9-4e9e-95b5-9fb6c96f6210 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:25.870840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b96c5f-64b9-4e9e-95b5-9fb6c96f6210 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:25.876770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ba7ed-8b8e-4e57-b139-bdd368d67a47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:25.877425 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ba7ed-8b8e-4e57-b139-bdd368d67a47 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:25.877714 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ba7ed-8b8e-4e57-b139-bdd368d67a47 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:25.877997 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ba7ed-8b8e-4e57-b139-bdd368d67a47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:25.887920 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ba7ed-8b8e-4e57-b139-bdd368d67a47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:25.890146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ba7ed-8b8e-4e57-b139-bdd368d67a47 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:25.904095 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4337/8759] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:45:25 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:45:27.275439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7276b6-e9fc-49f1-8514-4b65bbb0f44d None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:27.275888 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7276b6-e9fc-49f1-8514-4b65bbb0f44d None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:27.275995 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7276b6-e9fc-49f1-8514-4b65bbb0f44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:27.293793 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-9d7276b6-e9fc-49f1-8514-4b65bbb0f44d None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:45:27.295003 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-9d7276b6-e9fc-49f1-8514-4b65bbb0f44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:45:27.301995 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4423/8760] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 21:45:27 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:45:27.343006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ba7ed-8b8e-4e57-b139-bdd368d67a47 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:27.354636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ba7ed-8b8e-4e57-b139-bdd368d67a47 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:27.359747 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5917246-a19f-410b-b0d3-3f69d500c02e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:27.360378 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5917246-a19f-410b-b0d3-3f69d500c02e service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:27.360668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5917246-a19f-410b-b0d3-3f69d500c02e service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:27.360950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5917246-a19f-410b-b0d3-3f69d500c02e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:27.368889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5917246-a19f-410b-b0d3-3f69d500c02e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:27.370481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5917246-a19f-410b-b0d3-3f69d500c02e service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:27.378353 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4338/8761] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:45:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:45:34.173358 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7276b6-e9fc-49f1-8514-4b65bbb0f44d None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:34.237727 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7276b6-e9fc-49f1-8514-4b65bbb0f44d None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:34.242754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b78611-fca9-46be-8b1b-4a7438b9cc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:34.243616 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b78611-fca9-46be-8b1b-4a7438b9cc0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:34.243899 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b78611-fca9-46be-8b1b-4a7438b9cc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:34.244181 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b78611-fca9-46be-8b1b-4a7438b9cc0e admin admin] PATH_INFO: `/v3/users/9ce8de7276144144a52e038b19adda07` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:34.245384 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b78611-fca9-46be-8b1b-4a7438b9cc0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce8de7276144144a52e038b19adda07)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:34.247354 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b78611-fca9-46be-8b1b-4a7438b9cc0e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:34.293285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-58b78611-fca9-46be-8b1b-4a7438b9cc0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce8de7276144144a52e038b19adda07'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:34.299810 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-58b78611-fca9-46be-8b1b-4a7438b9cc0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce8de7276144144a52e038b19adda07'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:34.300466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-58b78611-fca9-46be-8b1b-4a7438b9cc0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce8de7276144144a52e038b19adda07'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:34.313061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-58b78611-fca9-46be-8b1b-4a7438b9cc0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce8de7276144144a52e038b19adda07'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:34.319768 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-58b78611-fca9-46be-8b1b-4a7438b9cc0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce8de7276144144a52e038b19adda07'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:34.325820 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4424/8762] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:45:34 2021] DELETE /identity/v3/users/9ce8de7276144144a52e038b19adda07 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:45:34.500409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5917246-a19f-410b-b0d3-3f69d500c02e service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:34.512116 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5917246-a19f-410b-b0d3-3f69d500c02e service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:34.568575 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22796935-edc8-4a20-a0cc-2de9334c1c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:34.569435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22796935-edc8-4a20-a0cc-2de9334c1c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:34.569749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22796935-edc8-4a20-a0cc-2de9334c1c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:34.570062 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22796935-edc8-4a20-a0cc-2de9334c1c8f admin admin] PATH_INFO: `/v3/projects/fb1a66fd59be4793a6090985e8ae5998` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:34.571850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22796935-edc8-4a20-a0cc-2de9334c1c8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb1a66fd59be4793a6090985e8ae5998)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:34.573772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22796935-edc8-4a20-a0cc-2de9334c1c8f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:34.618347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-22796935-edc8-4a20-a0cc-2de9334c1c8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb1a66fd59be4793a6090985e8ae5998', 'request_id': 'req-22796935-edc8-4a20-a0cc-2de9334c1c8f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:34.624775 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-22796935-edc8-4a20-a0cc-2de9334c1c8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb1a66fd59be4793a6090985e8ae5998', 'request_id': 'req-22796935-edc8-4a20-a0cc-2de9334c1c8f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:34.630006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-22796935-edc8-4a20-a0cc-2de9334c1c8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb1a66fd59be4793a6090985e8ae5998', 'request_id': 'req-22796935-edc8-4a20-a0cc-2de9334c1c8f'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:34.642411 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-22796935-edc8-4a20-a0cc-2de9334c1c8f admin admin] The token cache is being invalidate because project fb1a66fd59be4793a6090985e8ae5998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:45:34.642702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-22796935-edc8-4a20-a0cc-2de9334c1c8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:34.643321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-22796935-edc8-4a20-a0cc-2de9334c1c8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:34.644837 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4339/8763] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:45:34 2021] DELETE /identity/v3/projects/fb1a66fd59be4793a6090985e8ae5998 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:45:34.649336 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b78611-fca9-46be-8b1b-4a7438b9cc0e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:34.650754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-58b78611-fca9-46be-8b1b-4a7438b9cc0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:45:34.663761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b78611-fca9-46be-8b1b-4a7438b9cc0e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:34.719146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df907edd-a75f-425f-9e83-532908d30bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:34.720018 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df907edd-a75f-425f-9e83-532908d30bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:34.720306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df907edd-a75f-425f-9e83-532908d30bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:34.720585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df907edd-a75f-425f-9e83-532908d30bb0 admin admin] PATH_INFO: `/v3/users/e798ad7a88294f39964680ed4c9e128d` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:34.721802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df907edd-a75f-425f-9e83-532908d30bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e798ad7a88294f39964680ed4c9e128d)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:34.723763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df907edd-a75f-425f-9e83-532908d30bb0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:34.769056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-df907edd-a75f-425f-9e83-532908d30bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e798ad7a88294f39964680ed4c9e128d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:34.776291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-df907edd-a75f-425f-9e83-532908d30bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e798ad7a88294f39964680ed4c9e128d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:34.776954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-df907edd-a75f-425f-9e83-532908d30bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e798ad7a88294f39964680ed4c9e128d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:34.788280 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-df907edd-a75f-425f-9e83-532908d30bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e798ad7a88294f39964680ed4c9e128d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:34.795303 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-df907edd-a75f-425f-9e83-532908d30bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e798ad7a88294f39964680ed4c9e128d'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:34.801004 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4425/8764] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:45:34 2021] DELETE /identity/v3/users/e798ad7a88294f39964680ed4c9e128d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:45:34.968996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22796935-edc8-4a20-a0cc-2de9334c1c8f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:34.970458 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-22796935-edc8-4a20-a0cc-2de9334c1c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:45:34.986967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22796935-edc8-4a20-a0cc-2de9334c1c8f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:35.042311 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2dd4c-fa16-425f-80b6-ae9162b7b1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:35.043172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2dd4c-fa16-425f-80b6-ae9162b7b1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:35.043557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2dd4c-fa16-425f-80b6-ae9162b7b1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:35.043749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2dd4c-fa16-425f-80b6-ae9162b7b1cc admin admin] PATH_INFO: `/v3/projects/67edc3d6735d4b5ca7f0f1961d9c0813` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:35.044919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2dd4c-fa16-425f-80b6-ae9162b7b1cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=67edc3d6735d4b5ca7f0f1961d9c0813)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:35.046851 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2dd4c-fa16-425f-80b6-ae9162b7b1cc admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:35.091456 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c8e2dd4c-fa16-425f-80b6-ae9162b7b1cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67edc3d6735d4b5ca7f0f1961d9c0813', 'request_id': 'req-c8e2dd4c-fa16-425f-80b6-ae9162b7b1cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:35.097382 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c8e2dd4c-fa16-425f-80b6-ae9162b7b1cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67edc3d6735d4b5ca7f0f1961d9c0813', 'request_id': 'req-c8e2dd4c-fa16-425f-80b6-ae9162b7b1cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:35.102840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c8e2dd4c-fa16-425f-80b6-ae9162b7b1cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67edc3d6735d4b5ca7f0f1961d9c0813', 'request_id': 'req-c8e2dd4c-fa16-425f-80b6-ae9162b7b1cc'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:35.114534 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c8e2dd4c-fa16-425f-80b6-ae9162b7b1cc admin admin] The token cache is being invalidate because project 67edc3d6735d4b5ca7f0f1961d9c0813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:45:35.114818 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c8e2dd4c-fa16-425f-80b6-ae9162b7b1cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:35.115476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-c8e2dd4c-fa16-425f-80b6-ae9162b7b1cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:45:35.116995 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4340/8765] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:45:34 2021] DELETE /identity/v3/projects/67edc3d6735d4b5ca7f0f1961d9c0813 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:45:35.123474 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aa7d4-b0d4-4d03-b76a-cb81536aec15 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:35.123767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aa7d4-b0d4-4d03-b76a-cb81536aec15 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:35.124053 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aa7d4-b0d4-4d03-b76a-cb81536aec15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:35.143896 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-353aa7d4-b0d4-4d03-b76a-cb81536aec15 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:45:35.145125 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-353aa7d4-b0d4-4d03-b76a-cb81536aec15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:45:35.201754 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4426/8766] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:45:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:45:35.209835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91570fed-9a9d-4d07-a89e-3da3252863e9 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:35.210128 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91570fed-9a9d-4d07-a89e-3da3252863e9 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:35.210437 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91570fed-9a9d-4d07-a89e-3da3252863e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:35.228934 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-91570fed-9a9d-4d07-a89e-3da3252863e9 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:45:35.230056 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-91570fed-9a9d-4d07-a89e-3da3252863e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:45:35.237850 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4341/8767] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:45:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:45:35.241832 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353aa7d4-b0d4-4d03-b76a-cb81536aec15 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:35.251632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353aa7d4-b0d4-4d03-b76a-cb81536aec15 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:35.257061 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05055bf-c49f-4f6a-8314-586d9ecf86a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:35.257724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05055bf-c49f-4f6a-8314-586d9ecf86a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:35.258709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05055bf-c49f-4f6a-8314-586d9ecf86a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:35.258990 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05055bf-c49f-4f6a-8314-586d9ecf86a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:35.259752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05055bf-c49f-4f6a-8314-586d9ecf86a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:45:35.260056 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05055bf-c49f-4f6a-8314-586d9ecf86a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:35.261646 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05055bf-c49f-4f6a-8314-586d9ecf86a0 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:35.280302 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4427/8768] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:45:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:45:35.281515 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91570fed-9a9d-4d07-a89e-3da3252863e9 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:35.290843 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91570fed-9a9d-4d07-a89e-3da3252863e9 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:35.295541 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499ff3b-a57a-4103-94c8-1ac2604c5a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:35.296183 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499ff3b-a57a-4103-94c8-1ac2604c5a51 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:35.296466 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499ff3b-a57a-4103-94c8-1ac2604c5a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:35.296744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499ff3b-a57a-4103-94c8-1ac2604c5a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:35.297435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499ff3b-a57a-4103-94c8-1ac2604c5a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:35.299351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499ff3b-a57a-4103-94c8-1ac2604c5a51 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:35.324243 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4342/8769] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:45:35 2021] POST /identity/v3/projects => generated 393 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:45:35.328495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05055bf-c49f-4f6a-8314-586d9ecf86a0 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:35.339710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05055bf-c49f-4f6a-8314-586d9ecf86a0 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:35.394048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5c881-edd5-4f0f-8477-14d8f15100ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:35.394742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c881-edd5-4f0f-8477-14d8f15100ed admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:35.395027 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c881-edd5-4f0f-8477-14d8f15100ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:35.395305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c881-edd5-4f0f-8477-14d8f15100ed admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:35.396011 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5c881-edd5-4f0f-8477-14d8f15100ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:35.397980 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5c881-edd5-4f0f-8477-14d8f15100ed admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:35.417367 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4428/8770] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:45:35 2021] POST /identity/v3/users => generated 297 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:45:35.421531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499ff3b-a57a-4103-94c8-1ac2604c5a51 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:35.431811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499ff3b-a57a-4103-94c8-1ac2604c5a51 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:35.436783 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94400e-0cde-4fe2-acc9-f5c77fccf111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:35.437438 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94400e-0cde-4fe2-acc9-f5c77fccf111 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:35.437723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94400e-0cde-4fe2-acc9-f5c77fccf111 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:35.438030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94400e-0cde-4fe2-acc9-f5c77fccf111 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:35.438794 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94400e-0cde-4fe2-acc9-f5c77fccf111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:35.440361 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94400e-0cde-4fe2-acc9-f5c77fccf111 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:35.452238 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4343/8771] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:45:35 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:45:35.456138 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5c881-edd5-4f0f-8477-14d8f15100ed admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:35.466756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5c881-edd5-4f0f-8477-14d8f15100ed admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:35.471392 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bab33-25db-4667-bdd9-4d2a39bb7f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:35.472039 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bab33-25db-4667-bdd9-4d2a39bb7f4d admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:35.472322 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bab33-25db-4667-bdd9-4d2a39bb7f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:35.472603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bab33-25db-4667-bdd9-4d2a39bb7f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:35.473353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bab33-25db-4667-bdd9-4d2a39bb7f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:35.474969 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bab33-25db-4667-bdd9-4d2a39bb7f4d admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:35.484654 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4429/8772] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:45:35 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:45:35.488536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94400e-0cde-4fe2-acc9-f5c77fccf111 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:35.498427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94400e-0cde-4fe2-acc9-f5c77fccf111 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:35.503082 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af2cde-4ec4-4087-9de5-fe64d540373b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:35.503975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af2cde-4ec4-4087-9de5-fe64d540373b admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:35.504250 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af2cde-4ec4-4087-9de5-fe64d540373b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:35.504531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af2cde-4ec4-4087-9de5-fe64d540373b admin admin] PATH_INFO: `/v3/projects/0ca451d1f26f48f583722f5ed440bf41/users/eccd820a1e45482abb10a2a787bf0341/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:35.519008 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af2cde-4ec4-4087-9de5-fe64d540373b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca451d1f26f48f583722f5ed440bf41, user_id=eccd820a1e45482abb10a2a787bf0341, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:35.521615 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af2cde-4ec4-4087-9de5-fe64d540373b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:35.534564 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4344/8773] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:45:35 2021] PUT /identity/v3/projects/0ca451d1f26f48f583722f5ed440bf41/users/eccd820a1e45482abb10a2a787bf0341/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:45:35.544779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9204ff4-e11e-4829-a209-f413353d3369 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:35.545077 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9204ff4-e11e-4829-a209-f413353d3369 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:35.545362 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9204ff4-e11e-4829-a209-f413353d3369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:35.571748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f9204ff4-e11e-4829-a209-f413353d3369 None None] MFA Rules not processed for user `eccd820a1e45482abb10a2a787bf0341`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:45:35.572938 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f9204ff4-e11e-4829-a209-f413353d3369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:45:35.635779 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4430/8774] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:45:35 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:45:35.640239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af2cde-4ec4-4087-9de5-fe64d540373b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:35.700627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af2cde-4ec4-4087-9de5-fe64d540373b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:35.705341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a75d0-1979-4c2d-8762-1c657647317e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:35.705992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a75d0-1979-4c2d-8762-1c657647317e admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:35.706315 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a75d0-1979-4c2d-8762-1c657647317e admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:35.706602 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a75d0-1979-4c2d-8762-1c657647317e admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:35.707301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a75d0-1979-4c2d-8762-1c657647317e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:35.709442 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a75d0-1979-4c2d-8762-1c657647317e admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:35.733692 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4345/8775] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:45:35 2021] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:45:35.737960 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9204ff4-e11e-4829-a209-f413353d3369 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:35.749175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9204ff4-e11e-4829-a209-f413353d3369 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:35.803745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca53b57-b6fd-4fb0-927c-c05f402c7c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:35.804431 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca53b57-b6fd-4fb0-927c-c05f402c7c6a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:35.804731 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca53b57-b6fd-4fb0-927c-c05f402c7c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:35.805580 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca53b57-b6fd-4fb0-927c-c05f402c7c6a admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:35.806313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca53b57-b6fd-4fb0-927c-c05f402c7c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:35.808224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca53b57-b6fd-4fb0-927c-c05f402c7c6a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:35.828979 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4431/8776] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:45:35 2021] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 21:45:35.833536 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a75d0-1979-4c2d-8762-1c657647317e admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:35.843706 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a75d0-1979-4c2d-8762-1c657647317e admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:35.848272 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdb13c-996f-4592-a193-f8e4455fcf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:35.848919 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdb13c-996f-4592-a193-f8e4455fcf24 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:35.849200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdb13c-996f-4592-a193-f8e4455fcf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:35.849472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdb13c-996f-4592-a193-f8e4455fcf24 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:35.850194 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdb13c-996f-4592-a193-f8e4455fcf24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:35.851784 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdb13c-996f-4592-a193-f8e4455fcf24 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:35.861899 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4346/8777] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:45:35 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:45:35.865809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca53b57-b6fd-4fb0-927c-c05f402c7c6a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:35.880466 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca53b57-b6fd-4fb0-927c-c05f402c7c6a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:35.885700 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c61604-0b3e-4c24-9617-4ed0bf606fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:35.886593 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c61604-0b3e-4c24-9617-4ed0bf606fab admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:35.886870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c61604-0b3e-4c24-9617-4ed0bf606fab admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:35.887142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c61604-0b3e-4c24-9617-4ed0bf606fab admin admin] PATH_INFO: `/v3/projects/a7c79d57b56c437b876126530e71bf7f/users/abf0d3acead247519fc357e8d6bef825/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:35.901396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c61604-0b3e-4c24-9617-4ed0bf606fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c79d57b56c437b876126530e71bf7f, user_id=abf0d3acead247519fc357e8d6bef825, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:35.904127 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c61604-0b3e-4c24-9617-4ed0bf606fab admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:35.916876 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4432/8778] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:45:35 2021] PUT /identity/v3/projects/a7c79d57b56c437b876126530e71bf7f/users/abf0d3acead247519fc357e8d6bef825/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:45:35.920999 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdb13c-996f-4592-a193-f8e4455fcf24 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:35.931728 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdb13c-996f-4592-a193-f8e4455fcf24 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:35.986957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5937399-4760-4f4e-be02-abd12d537cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:35.987612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5937399-4760-4f4e-be02-abd12d537cfb admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:35.987893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5937399-4760-4f4e-be02-abd12d537cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:35.988215 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5937399-4760-4f4e-be02-abd12d537cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:35.988918 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5937399-4760-4f4e-be02-abd12d537cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:35.990646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5937399-4760-4f4e-be02-abd12d537cfb admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:36.000766 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4347/8779] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:45:35 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:45:36.004886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c61604-0b3e-4c24-9617-4ed0bf606fab admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:36.014986 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c61604-0b3e-4c24-9617-4ed0bf606fab admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:36.019632 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a6d31-ef7d-47d9-9a6b-52c4efcf00c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:36.020497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a6d31-ef7d-47d9-9a6b-52c4efcf00c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:36.020781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a6d31-ef7d-47d9-9a6b-52c4efcf00c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:36.021062 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a6d31-ef7d-47d9-9a6b-52c4efcf00c7 admin admin] PATH_INFO: `/v3/projects/a7c79d57b56c437b876126530e71bf7f/users/abf0d3acead247519fc357e8d6bef825/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:36.023097 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a6d31-ef7d-47d9-9a6b-52c4efcf00c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c79d57b56c437b876126530e71bf7f, user_id=abf0d3acead247519fc357e8d6bef825, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:36.025721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a6d31-ef7d-47d9-9a6b-52c4efcf00c7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:36.035745 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4433/8780] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:45:36 2021] PUT /identity/v3/projects/a7c79d57b56c437b876126530e71bf7f/users/abf0d3acead247519fc357e8d6bef825/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:45:36.047080 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5adeb9-74a4-4e8b-9610-36d01b3edd92 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:36.047375 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5adeb9-74a4-4e8b-9610-36d01b3edd92 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:36.047659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5adeb9-74a4-4e8b-9610-36d01b3edd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:36.073570 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-be5adeb9-74a4-4e8b-9610-36d01b3edd92 None None] MFA Rules not processed for user `abf0d3acead247519fc357e8d6bef825`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:45:36.074799 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-be5adeb9-74a4-4e8b-9610-36d01b3edd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:45:36.139957 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4348/8781] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:45:36 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:45:36.152295 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a6d31-ef7d-47d9-9a6b-52c4efcf00c7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:36.154004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f34a6d31-ef7d-47d9-9a6b-52c4efcf00c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:45:36.236586 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a6d31-ef7d-47d9-9a6b-52c4efcf00c7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:36.242218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ba477-929f-4d9f-9131-ebd6734204af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:36.242859 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ba477-929f-4d9f-9131-ebd6734204af service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:36.243142 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ba477-929f-4d9f-9131-ebd6734204af service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:36.243418 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ba477-929f-4d9f-9131-ebd6734204af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:36.296420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ba477-929f-4d9f-9131-ebd6734204af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:36.297992 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ba477-929f-4d9f-9131-ebd6734204af service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:36.306600 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4434/8782] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:45:36 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:45:39.672035 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5adeb9-74a4-4e8b-9610-36d01b3edd92 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:39.673477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-be5adeb9-74a4-4e8b-9610-36d01b3edd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:45:39.733488 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5adeb9-74a4-4e8b-9610-36d01b3edd92 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:39.741126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ddd75-245f-401c-998b-c69050a88c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:39.741957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ddd75-245f-401c-998b-c69050a88c5f service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:39.742337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ddd75-245f-401c-998b-c69050a88c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:39.742687 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ddd75-245f-401c-998b-c69050a88c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:39.755463 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ddd75-245f-401c-998b-c69050a88c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:39.757091 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ddd75-245f-401c-998b-c69050a88c5f service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:39.767379 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4349/8783] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:45:39 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:45:42.783234 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06824f08-0ac9-4e03-af3e-2479454b545b None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:42.783779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06824f08-0ac9-4e03-af3e-2479454b545b None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:42.783779 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06824f08-0ac9-4e03-af3e-2479454b545b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:42.802184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-06824f08-0ac9-4e03-af3e-2479454b545b None None] MFA Rules not processed for user `eccd820a1e45482abb10a2a787bf0341`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:45:42.803425 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-06824f08-0ac9-4e03-af3e-2479454b545b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:45:42.811313 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4435/8784] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:45:42 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:45:43.170607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce84b1c-a132-4c55-87c4-fff1e9d50a4c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:43.171692 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce84b1c-a132-4c55-87c4-fff1e9d50a4c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:43.172148 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce84b1c-a132-4c55-87c4-fff1e9d50a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:43.194892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7ce84b1c-a132-4c55-87c4-fff1e9d50a4c None None] MFA Rules not processed for user `6f8eeb55c523480fb45d4bbb8afe8e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:45:43.196889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7ce84b1c-a132-4c55-87c4-fff1e9d50a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:45:43.203836 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4350/8785] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:45:43 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:45:43.218508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06824f08-0ac9-4e03-af3e-2479454b545b None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:43.230630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06824f08-0ac9-4e03-af3e-2479454b545b None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:43.235781 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63216dac-7b68-4d5e-9a63-44976eab2e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:43.236445 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63216dac-7b68-4d5e-9a63-44976eab2e1c service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:43.236920 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63216dac-7b68-4d5e-9a63-44976eab2e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:43.237209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63216dac-7b68-4d5e-9a63-44976eab2e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:43.246005 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63216dac-7b68-4d5e-9a63-44976eab2e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:43.247491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63216dac-7b68-4d5e-9a63-44976eab2e1c service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:43.258714 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4436/8786] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:45:43 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:45:45.486227 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7d1be-9ff7-41ab-8d8c-fc178e14d08b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:45.486779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7d1be-9ff7-41ab-8d8c-fc178e14d08b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:45.487000 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7d1be-9ff7-41ab-8d8c-fc178e14d08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:45.509334 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-90d7d1be-9ff7-41ab-8d8c-fc178e14d08b None None] MFA Rules not processed for user `6f8eeb55c523480fb45d4bbb8afe8e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:45:45.510927 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-90d7d1be-9ff7-41ab-8d8c-fc178e14d08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:45:45.519873 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4351/8787] 10.222.0.36 () {58 vars in 1015 bytes} [Sat Dec 18 21:45:45 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:45:45.538723 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63216dac-7b68-4d5e-9a63-44976eab2e1c service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:45.552518 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63216dac-7b68-4d5e-9a63-44976eab2e1c service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:45.557421 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffe785-fc98-41da-8520-9f06aba36f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:45.558543 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffe785-fc98-41da-8520-9f06aba36f93 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:45.559168 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffe785-fc98-41da-8520-9f06aba36f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:45.559719 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffe785-fc98-41da-8520-9f06aba36f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:45.572827 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffe785-fc98-41da-8520-9f06aba36f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:45.574487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffe785-fc98-41da-8520-9f06aba36f93 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:45.584098 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4437/8788] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:45:45 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:45:53.130963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997c65-49f9-4d41-a90a-8a5b0104d1ae None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:53.131449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997c65-49f9-4d41-a90a-8a5b0104d1ae None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:53.131574 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997c65-49f9-4d41-a90a-8a5b0104d1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:53.152049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-e8997c65-49f9-4d41-a90a-8a5b0104d1ae None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:45:53.153426 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-e8997c65-49f9-4d41-a90a-8a5b0104d1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:45:53.166815 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4352/8789] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:45:53 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:45:53.180296 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffe785-fc98-41da-8520-9f06aba36f93 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:45:53.193347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffe785-fc98-41da-8520-9f06aba36f93 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:45:53.199984 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722737d-4ceb-4779-890d-5974ca9da140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:45:53.200624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722737d-4ceb-4779-890d-5974ca9da140 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:45:53.200903 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722737d-4ceb-4779-890d-5974ca9da140 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:45:53.201797 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722737d-4ceb-4779-890d-5974ca9da140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:45:53.212346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722737d-4ceb-4779-890d-5974ca9da140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:45:53.213907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722737d-4ceb-4779-890d-5974ca9da140 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:45:53.225034 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4438/8790] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:45:53 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:46:51.653614 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe3067-a735-4c12-8bbe-bb8e26371e1f None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:46:51.654207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe3067-a735-4c12-8bbe-bb8e26371e1f None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:46:51.654207 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe3067-a735-4c12-8bbe-bb8e26371e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:46:51.673668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-afbe3067-a735-4c12-8bbe-bb8e26371e1f None None] MFA Rules not processed for user `eccd820a1e45482abb10a2a787bf0341`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:46:51.674925 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-afbe3067-a735-4c12-8bbe-bb8e26371e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:46:51.682994 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4353/8791] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:46:51 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:47:17.811437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722737d-4ceb-4779-890d-5974ca9da140 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:47:17.813030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-2722737d-4ceb-4779-890d-5974ca9da140 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:47:17.892367 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722737d-4ceb-4779-890d-5974ca9da140 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:47:17.898333 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72794afa-c4c7-4ecc-ada3-931f79c12ad7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:47:17.899857 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72794afa-c4c7-4ecc-ada3-931f79c12ad7 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:47:17.900300 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72794afa-c4c7-4ecc-ada3-931f79c12ad7 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:47:17.901690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72794afa-c4c7-4ecc-ada3-931f79c12ad7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:47:17.903486 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-72794afa-c4c7-4ecc-ada3-931f79c12ad7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:47:17.916347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72794afa-c4c7-4ecc-ada3-931f79c12ad7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:47:17.917918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72794afa-c4c7-4ecc-ada3-931f79c12ad7 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:47:17.927515 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4439/8792] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:47:17 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:48:23.940501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe3067-a735-4c12-8bbe-bb8e26371e1f None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:48:23.952506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe3067-a735-4c12-8bbe-bb8e26371e1f None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:48:23.957547 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d06161-20ff-47f8-9978-0af4c08289c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:48:23.958193 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d06161-20ff-47f8-9978-0af4c08289c5 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:48:23.958545 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d06161-20ff-47f8-9978-0af4c08289c5 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:48:23.958893 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d06161-20ff-47f8-9978-0af4c08289c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:48:23.960904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-81d06161-20ff-47f8-9978-0af4c08289c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:48:23.973360 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d06161-20ff-47f8-9978-0af4c08289c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:48:23.974974 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d06161-20ff-47f8-9978-0af4c08289c5 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:48:23.985734 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4354/8793] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:48:23 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:48:28.524890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d38ce-76d1-4679-9f2c-75480bcf3e73 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:48:28.526629 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d38ce-76d1-4679-9f2c-75480bcf3e73 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:48:28.527098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d38ce-76d1-4679-9f2c-75480bcf3e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:48:28.546874 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f74d38ce-76d1-4679-9f2c-75480bcf3e73 None None] MFA Rules not processed for user `eccd820a1e45482abb10a2a787bf0341`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:48:28.548219 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f74d38ce-76d1-4679-9f2c-75480bcf3e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:48:28.555627 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4440/8794] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:48:28 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:48:28.896200 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cae12-026a-4467-b6bf-519972df56db None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:48:28.896787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cae12-026a-4467-b6bf-519972df56db None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:48:28.896787 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cae12-026a-4467-b6bf-519972df56db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:48:28.914967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-b83cae12-026a-4467-b6bf-519972df56db None None] MFA Rules not processed for user `6f8eeb55c523480fb45d4bbb8afe8e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:48:28.916832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-b83cae12-026a-4467-b6bf-519972df56db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:48:28.923292 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4355/8795] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:48:28 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:48:28.935596 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d38ce-76d1-4679-9f2c-75480bcf3e73 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:48:28.944835 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d38ce-76d1-4679-9f2c-75480bcf3e73 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:48:28.948342 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e31c9d-6ba4-40e3-9b2e-d3cfd2d2e840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:48:28.948975 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e31c9d-6ba4-40e3-9b2e-d3cfd2d2e840 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:48:28.949254 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e31c9d-6ba4-40e3-9b2e-d3cfd2d2e840 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:48:28.949527 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e31c9d-6ba4-40e3-9b2e-d3cfd2d2e840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:48:28.956514 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e31c9d-6ba4-40e3-9b2e-d3cfd2d2e840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:48:28.957928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e31c9d-6ba4-40e3-9b2e-d3cfd2d2e840 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:48:28.966563 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4441/8796] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:48:28 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:48:29.317331 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9dc31-5c20-4223-8f53-0e4267921309 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:48:29.317877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9dc31-5c20-4223-8f53-0e4267921309 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:48:29.318397 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9dc31-5c20-4223-8f53-0e4267921309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:48:29.342668 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-cad9dc31-5c20-4223-8f53-0e4267921309 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:48:29.344383 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-cad9dc31-5c20-4223-8f53-0e4267921309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:48:29.365331 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4356/8797] 10.222.0.13 () {58 vars in 1057 bytes} [Sat Dec 18 21:48:29 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:48:29.373215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e31c9d-6ba4-40e3-9b2e-d3cfd2d2e840 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:48:29.391175 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e31c9d-6ba4-40e3-9b2e-d3cfd2d2e840 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:48:29.398999 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bd02e-ff05-4817-93f1-2a2f38ef82ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:48:29.399813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd02e-ff05-4817-93f1-2a2f38ef82ad service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:48:29.400667 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd02e-ff05-4817-93f1-2a2f38ef82ad service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:48:29.401165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd02e-ff05-4817-93f1-2a2f38ef82ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:48:29.403075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b35bd02e-ff05-4817-93f1-2a2f38ef82ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:48:29.417346 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bd02e-ff05-4817-93f1-2a2f38ef82ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:48:29.419291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bd02e-ff05-4817-93f1-2a2f38ef82ad service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:48:29.431771 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4442/8798] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:48:29 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:49:16.783165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e60d62-41db-430d-aaf2-f89a5090f8a3 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:49:16.783770 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e60d62-41db-430d-aaf2-f89a5090f8a3 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:49:16.783889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e60d62-41db-430d-aaf2-f89a5090f8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:49:16.802533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-78e60d62-41db-430d-aaf2-f89a5090f8a3 None None] MFA Rules not processed for user `6f8eeb55c523480fb45d4bbb8afe8e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:49:16.803803 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-78e60d62-41db-430d-aaf2-f89a5090f8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:49:16.810428 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4357/8799] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:49:16 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:49:16.823271 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bd02e-ff05-4817-93f1-2a2f38ef82ad service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:49:16.824749 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b35bd02e-ff05-4817-93f1-2a2f38ef82ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:49:16.836380 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bd02e-ff05-4817-93f1-2a2f38ef82ad service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:49:16.840707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6514e-071c-4555-b53c-8d20e62ae4d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:49:16.841338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6514e-071c-4555-b53c-8d20e62ae4d9 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:49:16.841617 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6514e-071c-4555-b53c-8d20e62ae4d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:49:16.841890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6514e-071c-4555-b53c-8d20e62ae4d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:49:16.849148 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6514e-071c-4555-b53c-8d20e62ae4d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:49:16.850614 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6514e-071c-4555-b53c-8d20e62ae4d9 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:49:16.859625 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4443/8800] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:49:16 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:49:16.950771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2cbb6-7ed8-4232-9977-f17a7579bff5 None None] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:49:16.951063 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2cbb6-7ed8-4232-9977-f17a7579bff5 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:49:16.951344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2cbb6-7ed8-4232-9977-f17a7579bff5 None None] PATH_INFO: `/` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:49:16.953139 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4358/8801] 10.222.0.13 () {54 vars in 921 bytes} [Sat Dec 18 21:49:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 18 21:49:16.958008 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6d834-1119-42a5-a4f7-3d11a26f06a4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:49:16.958328 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6d834-1119-42a5-a4f7-3d11a26f06a4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:49:16.958659 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6d834-1119-42a5-a4f7-3d11a26f06a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:49:16.978150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f3d6d834-1119-42a5-a4f7-3d11a26f06a4 None None] MFA Rules not processed for user `55f16dc3d38a4270a0fb29944a655356`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:49:16.979371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f3d6d834-1119-42a5-a4f7-3d11a26f06a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:49:16.987697 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4444/8802] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:49:16 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:49:17.007936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2cbb6-7ed8-4232-9977-f17a7579bff5 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:49:17.021791 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2cbb6-7ed8-4232-9977-f17a7579bff5 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:49:17.027611 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbe8b2-2c37-4876-923c-b23b3812969b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:49:17.028248 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbe8b2-2c37-4876-923c-b23b3812969b service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:49:17.028557 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbe8b2-2c37-4876-923c-b23b3812969b service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:49:17.028831 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbe8b2-2c37-4876-923c-b23b3812969b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:49:17.037206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cbe8b2-2c37-4876-923c-b23b3812969b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:49:17.038821 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cbe8b2-2c37-4876-923c-b23b3812969b service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:49:17.048232 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4359/8803] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:49:17 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:49:17.206397 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6d834-1119-42a5-a4f7-3d11a26f06a4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:49:17.219115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6d834-1119-42a5-a4f7-3d11a26f06a4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:49:17.224171 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e133f2-1112-41b9-a0b9-f9c6c6eb0394 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:49:17.224813 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e133f2-1112-41b9-a0b9-f9c6c6eb0394 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:49:17.225094 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e133f2-1112-41b9-a0b9-f9c6c6eb0394 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:49:17.225368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e133f2-1112-41b9-a0b9-f9c6c6eb0394 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:49:17.227150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-63e133f2-1112-41b9-a0b9-f9c6c6eb0394 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:49:17.238472 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e133f2-1112-41b9-a0b9-f9c6c6eb0394 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:49:17.240047 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e133f2-1112-41b9-a0b9-f9c6c6eb0394 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:49:17.249643 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4445/8804] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:49:17 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:50:06.114108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbe8b2-2c37-4876-923c-b23b3812969b service placement] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:50:06.133864 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbe8b2-2c37-4876-923c-b23b3812969b service placement] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:50:06.138341 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b52575-e453-462e-9105-00fe2c638200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:50:06.139109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b52575-e453-462e-9105-00fe2c638200 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:50:06.139600 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b52575-e453-462e-9105-00fe2c638200 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:50:06.139883 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b52575-e453-462e-9105-00fe2c638200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:50:06.141663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-53b52575-e453-462e-9105-00fe2c638200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:50:06.207771 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b52575-e453-462e-9105-00fe2c638200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:50:06.209639 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b52575-e453-462e-9105-00fe2c638200 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:50:06.222422 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4360/8805] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:50:06 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:50:07.400971 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e133f2-1112-41b9-a0b9-f9c6c6eb0394 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:50:07.420707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e133f2-1112-41b9-a0b9-f9c6c6eb0394 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:50:07.424439 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f416f0-c63f-4426-9edc-864086bdf9d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:50:07.425075 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f416f0-c63f-4426-9edc-864086bdf9d6 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:50:07.425356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f416f0-c63f-4426-9edc-864086bdf9d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:50:07.425661 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f416f0-c63f-4426-9edc-864086bdf9d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:50:07.427941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-91f416f0-c63f-4426-9edc-864086bdf9d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:50:07.441159 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f416f0-c63f-4426-9edc-864086bdf9d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:50:07.442605 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f416f0-c63f-4426-9edc-864086bdf9d6 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:50:07.454007 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4446/8806] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:50:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:50:18.009235 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d23a9-ea38-443c-bd02-92777e0e0061 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:50:18.009665 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d23a9-ea38-443c-bd02-92777e0e0061 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:50:18.009939 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d23a9-ea38-443c-bd02-92777e0e0061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:50:18.027792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f13d23a9-ea38-443c-bd02-92777e0e0061 None None] MFA Rules not processed for user `eccd820a1e45482abb10a2a787bf0341`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:50:18.028998 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f13d23a9-ea38-443c-bd02-92777e0e0061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:50:18.036161 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4361/8807] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:50:18 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:50:20.836007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f416f0-c63f-4426-9edc-864086bdf9d6 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:50:20.849146 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f416f0-c63f-4426-9edc-864086bdf9d6 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:50:20.854562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24daf7d9-d2e8-499b-a335-c78a91270b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:50:20.855348 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf7d9-d2e8-499b-a335-c78a91270b35 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:50:20.856261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf7d9-d2e8-499b-a335-c78a91270b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:50:20.856710 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf7d9-d2e8-499b-a335-c78a91270b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:50:20.859919 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-24daf7d9-d2e8-499b-a335-c78a91270b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:50:20.870926 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24daf7d9-d2e8-499b-a335-c78a91270b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:50:20.872939 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24daf7d9-d2e8-499b-a335-c78a91270b35 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:50:20.883673 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4447/8808] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:50:20 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:50:29.975494 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d23a9-ea38-443c-bd02-92777e0e0061 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:50:29.989501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d23a9-ea38-443c-bd02-92777e0e0061 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:50:29.995245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9e667-ffb6-41d3-874e-1c12430817fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:50:29.996467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9e667-ffb6-41d3-874e-1c12430817fc service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:50:29.996766 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9e667-ffb6-41d3-874e-1c12430817fc service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:50:29.997098 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9e667-ffb6-41d3-874e-1c12430817fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:50:29.998894 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-eba9e667-ffb6-41d3-874e-1c12430817fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:50:30.011149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9e667-ffb6-41d3-874e-1c12430817fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:50:30.012829 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9e667-ffb6-41d3-874e-1c12430817fc service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:50:30.026890 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4362/8809] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:50:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:50:53.386422 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24daf7d9-d2e8-499b-a335-c78a91270b35 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:50:53.399783 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24daf7d9-d2e8-499b-a335-c78a91270b35 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:50:53.405324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f02eec-4d04-4edf-8cd4-7813faccc97c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:50:53.405979 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f02eec-4d04-4edf-8cd4-7813faccc97c service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:50:53.406274 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f02eec-4d04-4edf-8cd4-7813faccc97c service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:50:53.406566 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f02eec-4d04-4edf-8cd4-7813faccc97c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:50:53.414310 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f02eec-4d04-4edf-8cd4-7813faccc97c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:50:53.415914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f02eec-4d04-4edf-8cd4-7813faccc97c service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:50:53.424613 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4448/8810] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:50:53 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:51:46.848739 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9e667-ffb6-41d3-874e-1c12430817fc service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:51:46.861629 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9e667-ffb6-41d3-874e-1c12430817fc service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:51:46.868110 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cf6ab-5321-46c9-a628-d462b401af3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:51:46.868936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cf6ab-5321-46c9-a628-d462b401af3a service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:51:46.869314 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cf6ab-5321-46c9-a628-d462b401af3a service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:51:46.869764 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cf6ab-5321-46c9-a628-d462b401af3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:51:46.871676 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f67cf6ab-5321-46c9-a628-d462b401af3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:51:46.884588 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cf6ab-5321-46c9-a628-d462b401af3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:51:46.886158 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cf6ab-5321-46c9-a628-d462b401af3a service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:51:46.904027 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4363/8811] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:51:46 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:51:54.469524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f02eec-4d04-4edf-8cd4-7813faccc97c service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:51:54.478701 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f02eec-4d04-4edf-8cd4-7813faccc97c service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:51:54.482807 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e8e0c-5cda-4939-b9e4-9d2f5140c881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:51:54.483465 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e8e0c-5cda-4939-b9e4-9d2f5140c881 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:51:54.483747 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e8e0c-5cda-4939-b9e4-9d2f5140c881 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:51:54.484026 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e8e0c-5cda-4939-b9e4-9d2f5140c881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:51:54.492815 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e8e0c-5cda-4939-b9e4-9d2f5140c881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:51:54.494245 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e8e0c-5cda-4939-b9e4-9d2f5140c881 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:51:54.504789 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4449/8812] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:51:54 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:51:57.062678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a986e-8428-4fcf-a903-0fbb5021740c None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:51:57.063220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a986e-8428-4fcf-a903-0fbb5021740c None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:51:57.063220 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a986e-8428-4fcf-a903-0fbb5021740c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:51:57.082756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-137a986e-8428-4fcf-a903-0fbb5021740c None None] MFA Rules not processed for user `eccd820a1e45482abb10a2a787bf0341`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:51:57.083984 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-137a986e-8428-4fcf-a903-0fbb5021740c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:51:57.092463 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4364/8813] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:51:57 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:51:57.447932 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e8e0c-5cda-4939-b9e4-9d2f5140c881 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:51:57.456925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e8e0c-5cda-4939-b9e4-9d2f5140c881 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:51:57.461089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c75da7-c6e5-4902-98ef-77a2b45b9c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:51:57.461774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c75da7-c6e5-4902-98ef-77a2b45b9c78 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:51:57.462063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c75da7-c6e5-4902-98ef-77a2b45b9c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:51:57.462379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c75da7-c6e5-4902-98ef-77a2b45b9c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:51:57.471080 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c75da7-c6e5-4902-98ef-77a2b45b9c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:51:57.473953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c75da7-c6e5-4902-98ef-77a2b45b9c78 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:51:57.483096 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4450/8814] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:51:57 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:52:00.041320 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a986e-8428-4fcf-a903-0fbb5021740c None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:52:00.053105 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a986e-8428-4fcf-a903-0fbb5021740c None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:52:00.057251 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8322c10-b987-4bb9-aa9d-f37f2ec2f457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:52:00.058172 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8322c10-b987-4bb9-aa9d-f37f2ec2f457 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:52:00.059398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8322c10-b987-4bb9-aa9d-f37f2ec2f457 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:52:00.059859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8322c10-b987-4bb9-aa9d-f37f2ec2f457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:52:00.069007 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8322c10-b987-4bb9-aa9d-f37f2ec2f457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:52:00.070761 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8322c10-b987-4bb9-aa9d-f37f2ec2f457 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:52:00.083944 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4365/8815] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:52:00 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:52:05.038404 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c75da7-c6e5-4902-98ef-77a2b45b9c78 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:52:05.053510 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c75da7-c6e5-4902-98ef-77a2b45b9c78 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:52:05.060372 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1c671-0d7e-4d13-8f75-4f3fbbc556b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:52:05.061158 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1c671-0d7e-4d13-8f75-4f3fbbc556b2 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:52:05.061458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1c671-0d7e-4d13-8f75-4f3fbbc556b2 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:52:05.061742 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1c671-0d7e-4d13-8f75-4f3fbbc556b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:52:05.071417 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1c671-0d7e-4d13-8f75-4f3fbbc556b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:52:05.073024 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1c671-0d7e-4d13-8f75-4f3fbbc556b2 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:52:05.084362 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4451/8816] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:52:05 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:52:22.775563 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8322c10-b987-4bb9-aa9d-f37f2ec2f457 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:52:22.788954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8322c10-b987-4bb9-aa9d-f37f2ec2f457 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:52:22.794797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce046e08-df46-4b5e-8cc4-57da56fb750a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:52:22.795976 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce046e08-df46-4b5e-8cc4-57da56fb750a service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:52:22.796302 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce046e08-df46-4b5e-8cc4-57da56fb750a service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:52:22.796590 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce046e08-df46-4b5e-8cc4-57da56fb750a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:52:22.805449 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce046e08-df46-4b5e-8cc4-57da56fb750a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:52:22.807077 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce046e08-df46-4b5e-8cc4-57da56fb750a service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:52:22.817172 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4366/8817] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:52:22 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:52:59.572694 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1c671-0d7e-4d13-8f75-4f3fbbc556b2 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:52:59.653627 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1c671-0d7e-4d13-8f75-4f3fbbc556b2 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:52:59.658289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13546a4c-98b8-49b5-ae13-0217626d3b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:52:59.659150 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13546a4c-98b8-49b5-ae13-0217626d3b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:52:59.659432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13546a4c-98b8-49b5-ae13-0217626d3b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:52:59.659736 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13546a4c-98b8-49b5-ae13-0217626d3b62 admin admin] PATH_INFO: `/v3/users/eccd820a1e45482abb10a2a787bf0341` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:52:59.660951 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13546a4c-98b8-49b5-ae13-0217626d3b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eccd820a1e45482abb10a2a787bf0341)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:52:59.662921 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13546a4c-98b8-49b5-ae13-0217626d3b62 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:52:59.709022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-13546a4c-98b8-49b5-ae13-0217626d3b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eccd820a1e45482abb10a2a787bf0341'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:52:59.716560 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-13546a4c-98b8-49b5-ae13-0217626d3b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eccd820a1e45482abb10a2a787bf0341'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:52:59.716760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-13546a4c-98b8-49b5-ae13-0217626d3b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eccd820a1e45482abb10a2a787bf0341'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:52:59.728121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-13546a4c-98b8-49b5-ae13-0217626d3b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eccd820a1e45482abb10a2a787bf0341'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:52:59.738266 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-13546a4c-98b8-49b5-ae13-0217626d3b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eccd820a1e45482abb10a2a787bf0341'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:52:59.744197 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4452/8818] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:52:59 2021] DELETE /identity/v3/users/eccd820a1e45482abb10a2a787bf0341 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:52:59.749472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011254d-ba40-44c6-859f-066b947d7c4e None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:52:59.749957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011254d-ba40-44c6-859f-066b947d7c4e None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:52:59.750069 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011254d-ba40-44c6-859f-066b947d7c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:52:59.787936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-a011254d-ba40-44c6-859f-066b947d7c4e None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:52:59.789092 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a011254d-ba40-44c6-859f-066b947d7c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:52:59.847534 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4367/8819] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:52:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:52:59.857363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13546a4c-98b8-49b5-ae13-0217626d3b62 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:52:59.859278 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-13546a4c-98b8-49b5-ae13-0217626d3b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:52:59.929309 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13546a4c-98b8-49b5-ae13-0217626d3b62 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:52:59.935063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8784be-d357-4a70-9510-6807cc5af595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:52:59.935789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8784be-d357-4a70-9510-6807cc5af595 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:52:59.936068 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8784be-d357-4a70-9510-6807cc5af595 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:52:59.936345 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8784be-d357-4a70-9510-6807cc5af595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:52:59.946120 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8784be-d357-4a70-9510-6807cc5af595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:52:59.947620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8784be-d357-4a70-9510-6807cc5af595 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:52:59.957095 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4453/8820] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:52:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 18 21:53:00.125667 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011254d-ba40-44c6-859f-066b947d7c4e None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:00.127188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-a011254d-ba40-44c6-859f-066b947d7c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:53:00.139412 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011254d-ba40-44c6-859f-066b947d7c4e None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:00.144393 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:00.145254 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:00.145661 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:00.145946 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa admin admin] PATH_INFO: `/v3/projects/0ca451d1f26f48f583722f5ed440bf41` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:00.147298 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca451d1f26f48f583722f5ed440bf41)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:00.149108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:00.195933 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca451d1f26f48f583722f5ed440bf41', 'request_id': 'req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:53:00.201792 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca451d1f26f48f583722f5ed440bf41', 'request_id': 'req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:53:00.207146 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca451d1f26f48f583722f5ed440bf41', 'request_id': 'req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:53:00.219572 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa admin admin] The token cache is being invalidate because project 0ca451d1f26f48f583722f5ed440bf41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:53:00.219860 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:53:00.220476 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:53:00.222004 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4368/8821] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:53:00 2021] DELETE /identity/v3/projects/0ca451d1f26f48f583722f5ed440bf41 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:53:00.226004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8784be-d357-4a70-9510-6807cc5af595 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:00.236394 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8784be-d357-4a70-9510-6807cc5af595 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:00.295066 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3f1b6-0bc2-435a-8ecb-3e4874a6d04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:00.295996 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3f1b6-0bc2-435a-8ecb-3e4874a6d04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:00.296218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3f1b6-0bc2-435a-8ecb-3e4874a6d04e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:00.296491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3f1b6-0bc2-435a-8ecb-3e4874a6d04e admin admin] PATH_INFO: `/v3/users/abf0d3acead247519fc357e8d6bef825` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:00.297691 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3f1b6-0bc2-435a-8ecb-3e4874a6d04e admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf0d3acead247519fc357e8d6bef825)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:00.299640 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3f1b6-0bc2-435a-8ecb-3e4874a6d04e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:00.343756 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-74d3f1b6-0bc2-435a-8ecb-3e4874a6d04e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf0d3acead247519fc357e8d6bef825'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:53:00.350340 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-74d3f1b6-0bc2-435a-8ecb-3e4874a6d04e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf0d3acead247519fc357e8d6bef825'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:53:00.350993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-74d3f1b6-0bc2-435a-8ecb-3e4874a6d04e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf0d3acead247519fc357e8d6bef825'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:53:00.362209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-74d3f1b6-0bc2-435a-8ecb-3e4874a6d04e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf0d3acead247519fc357e8d6bef825'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:53:00.369238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-74d3f1b6-0bc2-435a-8ecb-3e4874a6d04e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf0d3acead247519fc357e8d6bef825'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:53:00.375236 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4454/8822] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 21:53:00 2021] DELETE /identity/v3/users/abf0d3acead247519fc357e8d6bef825 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:53:00.637087 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:00.638633 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:53:00.652351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b09fd-9189-4490-bc3c-c9e1fb06b3aa admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:00.707817 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36d91a-b411-4841-be95-96f9c7665e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:00.708675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36d91a-b411-4841-be95-96f9c7665e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:00.708967 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36d91a-b411-4841-be95-96f9c7665e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:00.709258 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36d91a-b411-4841-be95-96f9c7665e27 admin admin] PATH_INFO: `/v3/projects/a7c79d57b56c437b876126530e71bf7f` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:00.710746 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36d91a-b411-4841-be95-96f9c7665e27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7c79d57b56c437b876126530e71bf7f)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:00.712655 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36d91a-b411-4841-be95-96f9c7665e27 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:00.757060 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ec36d91a-b411-4841-be95-96f9c7665e27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c79d57b56c437b876126530e71bf7f', 'request_id': 'req-ec36d91a-b411-4841-be95-96f9c7665e27'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:53:00.763002 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ec36d91a-b411-4841-be95-96f9c7665e27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c79d57b56c437b876126530e71bf7f', 'request_id': 'req-ec36d91a-b411-4841-be95-96f9c7665e27'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:53:00.768873 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ec36d91a-b411-4841-be95-96f9c7665e27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c79d57b56c437b876126530e71bf7f', 'request_id': 'req-ec36d91a-b411-4841-be95-96f9c7665e27'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:53:00.781891 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ec36d91a-b411-4841-be95-96f9c7665e27 admin admin] The token cache is being invalidate because project a7c79d57b56c437b876126530e71bf7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 21:53:00.782188 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ec36d91a-b411-4841-be95-96f9c7665e27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:53:00.783957 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-ec36d91a-b411-4841-be95-96f9c7665e27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 21:53:00.785679 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4369/8823] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 21:53:00 2021] DELETE /identity/v3/projects/a7c79d57b56c437b876126530e71bf7f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:53:00.792415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbd758-68c4-4dac-8825-2bb970ad5803 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:00.792927 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbd758-68c4-4dac-8825-2bb970ad5803 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:00.793063 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbd758-68c4-4dac-8825-2bb970ad5803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:00.839863 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-09fbd758-68c4-4dac-8825-2bb970ad5803 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:53:00.841070 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-09fbd758-68c4-4dac-8825-2bb970ad5803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:53:00.897218 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4455/8824] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:53:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:53:00.905636 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6bccd-fdb4-4555-9515-f88ce6d1856b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:00.905931 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6bccd-fdb4-4555-9515-f88ce6d1856b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:00.906351 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6bccd-fdb4-4555-9515-f88ce6d1856b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:00.924698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-1ea6bccd-fdb4-4555-9515-f88ce6d1856b None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:53:00.925889 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-1ea6bccd-fdb4-4555-9515-f88ce6d1856b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:53:00.933802 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4370/8825] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:53:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 18 21:53:00.938483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbd758-68c4-4dac-8825-2bb970ad5803 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:00.948121 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbd758-68c4-4dac-8825-2bb970ad5803 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:00.953290 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc2c18-e9c0-4c43-be48-8173fddec19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:00.953934 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc2c18-e9c0-4c43-be48-8173fddec19c admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:00.954221 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc2c18-e9c0-4c43-be48-8173fddec19c admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:00.954538 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc2c18-e9c0-4c43-be48-8173fddec19c admin admin] PATH_INFO: `/v3/domains` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:00.955262 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc2c18-e9c0-4c43-be48-8173fddec19c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96646) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 21:53:00.955570 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc2c18-e9c0-4c43-be48-8173fddec19c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:00.957164 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc2c18-e9c0-4c43-be48-8173fddec19c admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:00.968559 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4456/8826] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 21:53:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 21:53:00.972688 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6bccd-fdb4-4555-9515-f88ce6d1856b None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:00.981720 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6bccd-fdb4-4555-9515-f88ce6d1856b None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:00.986896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a4d8c-ffda-47b2-aa90-fbe66944b6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:00.987540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a4d8c-ffda-47b2-aa90-fbe66944b6bd admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:00.987827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a4d8c-ffda-47b2-aa90-fbe66944b6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:00.988109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a4d8c-ffda-47b2-aa90-fbe66944b6bd admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:00.988857 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a4d8c-ffda-47b2-aa90-fbe66944b6bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:00.990762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a4d8c-ffda-47b2-aa90-fbe66944b6bd admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:01.025357 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4371/8827] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:53:00 2021] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:53:01.029515 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc2c18-e9c0-4c43-be48-8173fddec19c admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:01.039487 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc2c18-e9c0-4c43-be48-8173fddec19c admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:01.094414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57729274-98aa-4af3-9a5f-84d5278c36a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:01.095007 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57729274-98aa-4af3-9a5f-84d5278c36a1 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:01.095294 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57729274-98aa-4af3-9a5f-84d5278c36a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:01.095577 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57729274-98aa-4af3-9a5f-84d5278c36a1 admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:01.096269 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57729274-98aa-4af3-9a5f-84d5278c36a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:01.098208 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57729274-98aa-4af3-9a5f-84d5278c36a1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:01.117794 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4457/8828] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:53:01 2021] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:53:01.121755 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a4d8c-ffda-47b2-aa90-fbe66944b6bd admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:01.132317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a4d8c-ffda-47b2-aa90-fbe66944b6bd admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:01.136827 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc5783-ef7f-4ac9-9483-0ae0165fa25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:01.137472 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc5783-ef7f-4ac9-9483-0ae0165fa25f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:01.137754 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc5783-ef7f-4ac9-9483-0ae0165fa25f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:01.138028 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc5783-ef7f-4ac9-9483-0ae0165fa25f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:01.138795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc5783-ef7f-4ac9-9483-0ae0165fa25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:01.140387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc5783-ef7f-4ac9-9483-0ae0165fa25f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:01.149900 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4372/8829] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:53:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:53:01.153595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57729274-98aa-4af3-9a5f-84d5278c36a1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:01.163670 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57729274-98aa-4af3-9a5f-84d5278c36a1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:01.168545 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afbc90-da77-408f-916f-eee1fe7ceb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:01.169196 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afbc90-da77-408f-916f-eee1fe7ceb34 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:01.169483 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afbc90-da77-408f-916f-eee1fe7ceb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:01.169763 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afbc90-da77-408f-916f-eee1fe7ceb34 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:01.171762 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afbc90-da77-408f-916f-eee1fe7ceb34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:01.173437 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afbc90-da77-408f-916f-eee1fe7ceb34 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:01.183740 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4458/8830] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:53:01 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:53:01.188523 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc5783-ef7f-4ac9-9483-0ae0165fa25f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:01.198801 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc5783-ef7f-4ac9-9483-0ae0165fa25f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:01.203439 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13eb538-2d09-4b4b-9c91-92364495eef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:01.204317 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13eb538-2d09-4b4b-9c91-92364495eef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:01.204606 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13eb538-2d09-4b4b-9c91-92364495eef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:01.204892 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13eb538-2d09-4b4b-9c91-92364495eef6 admin admin] PATH_INFO: `/v3/projects/c7e4c296f0144644b9107d08244cb934/users/d138402b28b3454aaca10ca070a1f7e7/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:01.220344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13eb538-2d09-4b4b-9c91-92364495eef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e4c296f0144644b9107d08244cb934, user_id=d138402b28b3454aaca10ca070a1f7e7, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:01.223025 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13eb538-2d09-4b4b-9c91-92364495eef6 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:01.236297 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4373/8831] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:53:01 2021] PUT /identity/v3/projects/c7e4c296f0144644b9107d08244cb934/users/d138402b28b3454aaca10ca070a1f7e7/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:53:01.241414 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd67fa-a433-4556-b426-697ce26e3294 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:01.241708 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd67fa-a433-4556-b426-697ce26e3294 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:01.242032 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd67fa-a433-4556-b426-697ce26e3294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:01.260128 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f4cd67fa-a433-4556-b426-697ce26e3294 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:53:01.261321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f4cd67fa-a433-4556-b426-697ce26e3294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:53:01.317820 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4459/8832] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:53:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:53:01.327674 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13eb538-2d09-4b4b-9c91-92364495eef6 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:01.329357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-d13eb538-2d09-4b4b-9c91-92364495eef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:53:01.384461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13eb538-2d09-4b4b-9c91-92364495eef6 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:01.388027 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47af075-ed35-4071-b09b-9f17ce4c8578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:01.388683 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47af075-ed35-4071-b09b-9f17ce4c8578 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:01.389078 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47af075-ed35-4071-b09b-9f17ce4c8578 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:01.389327 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47af075-ed35-4071-b09b-9f17ce4c8578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:01.398144 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47af075-ed35-4071-b09b-9f17ce4c8578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:01.399585 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47af075-ed35-4071-b09b-9f17ce4c8578 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:01.409589 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4374/8833] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:53:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:53:05.390933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec93675-408b-438f-aefd-074b3424f9ab None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:05.391508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec93675-408b-438f-aefd-074b3424f9ab None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:05.391508 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec93675-408b-438f-aefd-074b3424f9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:05.419911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6ec93675-408b-438f-aefd-074b3424f9ab None None] MFA Rules not processed for user `d138402b28b3454aaca10ca070a1f7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:53:05.421152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6ec93675-408b-438f-aefd-074b3424f9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:53:05.484279 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4460/8834] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:53:05 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:53:05.488795 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47af075-ed35-4071-b09b-9f17ce4c8578 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:05.499535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47af075-ed35-4071-b09b-9f17ce4c8578 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:05.505540 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff4427-754c-4227-aefb-a6492003a053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:05.506457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff4427-754c-4227-aefb-a6492003a053 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:05.506742 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff4427-754c-4227-aefb-a6492003a053 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:05.507020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff4427-754c-4227-aefb-a6492003a053 admin admin] PATH_INFO: `/v3/projects` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:05.507723 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff4427-754c-4227-aefb-a6492003a053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:05.509663 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff4427-754c-4227-aefb-a6492003a053 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:05.537662 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4375/8835] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 21:53:05 2021] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:53:05.538872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec93675-408b-438f-aefd-074b3424f9ab None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:05.550033 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec93675-408b-438f-aefd-074b3424f9ab None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:05.612432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb298d3-2388-49c0-89d6-59fb6e0afd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:05.613105 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb298d3-2388-49c0-89d6-59fb6e0afd1a admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:05.613386 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb298d3-2388-49c0-89d6-59fb6e0afd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:05.613660 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb298d3-2388-49c0-89d6-59fb6e0afd1a admin admin] PATH_INFO: `/v3/users` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:05.614387 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb298d3-2388-49c0-89d6-59fb6e0afd1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:05.616292 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb298d3-2388-49c0-89d6-59fb6e0afd1a admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:05.636849 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4461/8836] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 21:53:05 2021] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 21:53:05.641032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff4427-754c-4227-aefb-a6492003a053 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:05.651140 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff4427-754c-4227-aefb-a6492003a053 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:05.656257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285139df-7bcf-4c93-97bc-1e8a68817c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:05.656940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285139df-7bcf-4c93-97bc-1e8a68817c84 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:05.657229 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285139df-7bcf-4c93-97bc-1e8a68817c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:05.657503 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285139df-7bcf-4c93-97bc-1e8a68817c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:05.658231 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285139df-7bcf-4c93-97bc-1e8a68817c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:05.659835 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285139df-7bcf-4c93-97bc-1e8a68817c84 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:05.670915 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4376/8837] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:53:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 21:53:05.675141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb298d3-2388-49c0-89d6-59fb6e0afd1a admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:05.692126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb298d3-2388-49c0-89d6-59fb6e0afd1a admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:05.697112 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb3550-a047-486c-a4a5-c33b2942ae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:05.697761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb3550-a047-486c-a4a5-c33b2942ae01 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:05.698114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb3550-a047-486c-a4a5-c33b2942ae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:05.698363 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb3550-a047-486c-a4a5-c33b2942ae01 admin admin] PATH_INFO: `/v3/projects/32042eedd46449a1adddb5403dca947f/users/0ddebf6fbd93461988f26ecb34296b1a/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:05.714217 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb3550-a047-486c-a4a5-c33b2942ae01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32042eedd46449a1adddb5403dca947f, user_id=0ddebf6fbd93461988f26ecb34296b1a, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:05.717069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb3550-a047-486c-a4a5-c33b2942ae01 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:05.730975 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4462/8838] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:53:05 2021] PUT /identity/v3/projects/32042eedd46449a1adddb5403dca947f/users/0ddebf6fbd93461988f26ecb34296b1a/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 21:53:05.735539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285139df-7bcf-4c93-97bc-1e8a68817c84 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:05.745874 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285139df-7bcf-4c93-97bc-1e8a68817c84 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:05.813307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d13e99-0197-4331-a4a5-2be54e73f06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:05.813982 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d13e99-0197-4331-a4a5-2be54e73f06f admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:05.814307 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d13e99-0197-4331-a4a5-2be54e73f06f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:05.814593 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d13e99-0197-4331-a4a5-2be54e73f06f admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:05.815330 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d13e99-0197-4331-a4a5-2be54e73f06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:05.816940 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d13e99-0197-4331-a4a5-2be54e73f06f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:05.827902 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4377/8839] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 21:53:05 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 21:53:05.832118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb3550-a047-486c-a4a5-c33b2942ae01 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:05.843624 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb3550-a047-486c-a4a5-c33b2942ae01 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:05.848415 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9b9af-d896-4b94-9b7d-cfc094c3efc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:05.849379 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9b9af-d896-4b94-9b7d-cfc094c3efc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:05.849620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9b9af-d896-4b94-9b7d-cfc094c3efc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:05.849902 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9b9af-d896-4b94-9b7d-cfc094c3efc6 admin admin] PATH_INFO: `/v3/projects/32042eedd46449a1adddb5403dca947f/users/0ddebf6fbd93461988f26ecb34296b1a/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:05.852004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9b9af-d896-4b94-9b7d-cfc094c3efc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32042eedd46449a1adddb5403dca947f, user_id=0ddebf6fbd93461988f26ecb34296b1a, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:05.854697 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9b9af-d896-4b94-9b7d-cfc094c3efc6 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:05.865631 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4463/8840] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 21:53:05 2021] PUT /identity/v3/projects/32042eedd46449a1adddb5403dca947f/users/0ddebf6fbd93461988f26ecb34296b1a/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 21:53:10.404616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93287b0-1e3e-4b8b-bba9-1ab4eb53c66b None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:10.405109 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93287b0-1e3e-4b8b-bba9-1ab4eb53c66b None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:10.405223 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93287b0-1e3e-4b8b-bba9-1ab4eb53c66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:10.437716 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f93287b0-1e3e-4b8b-bba9-1ab4eb53c66b None None] MFA Rules not processed for user `0ddebf6fbd93461988f26ecb34296b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:53:10.439527 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f93287b0-1e3e-4b8b-bba9-1ab4eb53c66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:53:10.513318 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4378/8841] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:53:10 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:53:10.525900 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9b9af-d896-4b94-9b7d-cfc094c3efc6 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:10.528353 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-25c9b9af-d896-4b94-9b7d-cfc094c3efc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:53:10.634069 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9b9af-d896-4b94-9b7d-cfc094c3efc6 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:10.645983 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1b217-6097-4474-9d44-8165baad3b13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:10.647537 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1b217-6097-4474-9d44-8165baad3b13 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:10.648177 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1b217-6097-4474-9d44-8165baad3b13 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:10.648637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1b217-6097-4474-9d44-8165baad3b13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:10.715872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1b217-6097-4474-9d44-8165baad3b13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:10.719495 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1b217-6097-4474-9d44-8165baad3b13 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:10.734117 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4464/8842] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:53:10 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:53:12.322061 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428259c9-38ea-4df8-bfa7-60a8ab001ccc None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:12.322698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428259c9-38ea-4df8-bfa7-60a8ab001ccc None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:12.322698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428259c9-38ea-4df8-bfa7-60a8ab001ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:12.341936 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-428259c9-38ea-4df8-bfa7-60a8ab001ccc None None] MFA Rules not processed for user `d138402b28b3454aaca10ca070a1f7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:53:12.343202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-428259c9-38ea-4df8-bfa7-60a8ab001ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:53:12.350175 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4379/8843] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:53:12 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:53:27.931882 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1b217-6097-4474-9d44-8165baad3b13 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:27.933257 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-56a1b217-6097-4474-9d44-8165baad3b13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:53:28.010076 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1b217-6097-4474-9d44-8165baad3b13 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:28.015014 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cd665-d278-480b-8528-5633777d47af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:28.015643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cd665-d278-480b-8528-5633777d47af service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:28.015923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cd665-d278-480b-8528-5633777d47af service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:28.016200 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cd665-d278-480b-8528-5633777d47af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:28.017918 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3b7cd665-d278-480b-8528-5633777d47af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:53:28.029351 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cd665-d278-480b-8528-5633777d47af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:28.031162 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cd665-d278-480b-8528-5633777d47af service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:28.040527 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4465/8844] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:53:27 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:53:29.015192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428259c9-38ea-4df8-bfa7-60a8ab001ccc None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:53:29.017132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-428259c9-38ea-4df8-bfa7-60a8ab001ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:53:29.071987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428259c9-38ea-4df8-bfa7-60a8ab001ccc None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:53:29.075601 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9196364-43cf-49c4-8c04-4d07a0c3fc10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:53:29.076242 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196364-43cf-49c4-8c04-4d07a0c3fc10 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:53:29.076533 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196364-43cf-49c4-8c04-4d07a0c3fc10 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:53:29.076816 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196364-43cf-49c4-8c04-4d07a0c3fc10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:53:29.086756 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9196364-43cf-49c4-8c04-4d07a0c3fc10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:53:29.088162 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9196364-43cf-49c4-8c04-4d07a0c3fc10 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:53:29.097577 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4380/8845] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:53:29 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:55:26.406276 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fcbac-166d-42e4-b26f-6ce0885b8380 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:55:26.406771 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fcbac-166d-42e4-b26f-6ce0885b8380 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:55:26.406890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fcbac-166d-42e4-b26f-6ce0885b8380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:55:26.464037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-e90fcbac-166d-42e4-b26f-6ce0885b8380 None None] MFA Rules not processed for user `82fb4302bcd54627a264f22ad78aa339`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:55:26.465242 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-e90fcbac-166d-42e4-b26f-6ce0885b8380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:55:26.522840 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4466/8846] 10.222.0.13 () {58 vars in 1059 bytes} [Sat Dec 18 21:55:26 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:55:26.529462 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9196364-43cf-49c4-8c04-4d07a0c3fc10 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:55:26.539357 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9196364-43cf-49c4-8c04-4d07a0c3fc10 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:55:26.542807 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071d3b8-be63-452b-9ab0-ec8ec007dc29 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:55:26.543431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071d3b8-be63-452b-9ab0-ec8ec007dc29 service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:55:26.543712 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071d3b8-be63-452b-9ab0-ec8ec007dc29 service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:55:26.543987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071d3b8-be63-452b-9ab0-ec8ec007dc29 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:55:26.545730 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5071d3b8-be63-452b-9ab0-ec8ec007dc29 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:55:26.558616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071d3b8-be63-452b-9ab0-ec8ec007dc29 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:55:26.560024 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071d3b8-be63-452b-9ab0-ec8ec007dc29 service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:55:26.581180 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4381/8847] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:55:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:55:26.826152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fcbac-166d-42e4-b26f-6ce0885b8380 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:55:26.845089 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fcbac-166d-42e4-b26f-6ce0885b8380 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:55:26.848964 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10c872-5317-4569-a731-66a29ae65f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:55:26.849595 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10c872-5317-4569-a731-66a29ae65f99 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:55:26.849886 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10c872-5317-4569-a731-66a29ae65f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:55:26.850154 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10c872-5317-4569-a731-66a29ae65f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:55:26.851925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8b10c872-5317-4569-a731-66a29ae65f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:55:26.865227 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10c872-5317-4569-a731-66a29ae65f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:55:26.866690 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10c872-5317-4569-a731-66a29ae65f99 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:55:26.877838 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4467/8848] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:55:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:55:39.008607 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2926-a7f4-47dd-9efe-4be7b3ed3335 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:55:39.009142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2926-a7f4-47dd-9efe-4be7b3ed3335 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:55:39.009142 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2926-a7f4-47dd-9efe-4be7b3ed3335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:55:39.056427 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-01bb2926-a7f4-47dd-9efe-4be7b3ed3335 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:55:39.057538 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-01bb2926-a7f4-47dd-9efe-4be7b3ed3335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:55:39.122311 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4382/8849] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:55:39 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:55:39.172568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10c872-5317-4569-a731-66a29ae65f99 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:55:39.173941 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8b10c872-5317-4569-a731-66a29ae65f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:55:39.263454 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10c872-5317-4569-a731-66a29ae65f99 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:55:39.269114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959ef45-8e26-4cbc-aec6-3b0d3d92153f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:55:39.269752 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959ef45-8e26-4cbc-aec6-3b0d3d92153f service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:55:39.270037 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959ef45-8e26-4cbc-aec6-3b0d3d92153f service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:55:39.270356 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959ef45-8e26-4cbc-aec6-3b0d3d92153f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:55:39.278329 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959ef45-8e26-4cbc-aec6-3b0d3d92153f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:55:39.279924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959ef45-8e26-4cbc-aec6-3b0d3d92153f service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:55:39.287773 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4468/8850] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:55:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 21:55:48.564384 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb2926-a7f4-47dd-9efe-4be7b3ed3335 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:55:48.573646 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb2926-a7f4-47dd-9efe-4be7b3ed3335 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:55:48.577205 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52debe-6cd2-4b0b-b976-01aedd0d4a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:55:48.577847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52debe-6cd2-4b0b-b976-01aedd0d4a32 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:55:48.578134 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52debe-6cd2-4b0b-b976-01aedd0d4a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:55:48.578452 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52debe-6cd2-4b0b-b976-01aedd0d4a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:55:48.580402 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ca52debe-6cd2-4b0b-b976-01aedd0d4a32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:55:48.589852 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52debe-6cd2-4b0b-b976-01aedd0d4a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:55:48.591304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52debe-6cd2-4b0b-b976-01aedd0d4a32 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:55:48.598928 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4383/8851] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:55:48 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:55:51.933207 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6caa5b6-84ec-49bd-859c-e6b8cffea248 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:55:51.933792 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6caa5b6-84ec-49bd-859c-e6b8cffea248 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:55:51.934084 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6caa5b6-84ec-49bd-859c-e6b8cffea248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:55:51.972470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-f6caa5b6-84ec-49bd-859c-e6b8cffea248 None None] MFA Rules not processed for user `a180acaefee3489788068c927fbe403c`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:55:51.973674 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-f6caa5b6-84ec-49bd-859c-e6b8cffea248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:55:51.983556 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4469/8852] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Dec 18 21:55:51 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:55:51.996517 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52debe-6cd2-4b0b-b976-01aedd0d4a32 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:55:52.006872 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52debe-6cd2-4b0b-b976-01aedd0d4a32 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:55:52.010468 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58472d5-fe5c-48dd-91b0-e05ac288f565 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82fb4302bcd54627a264f22ad78aa339', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:55:52.011101 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58472d5-fe5c-48dd-91b0-e05ac288f565 service glance] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:55:52.011388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58472d5-fe5c-48dd-91b0-e05ac288f565 service glance] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:55:52.011669 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58472d5-fe5c-48dd-91b0-e05ac288f565 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:55:52.022796 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58472d5-fe5c-48dd-91b0-e05ac288f565 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:55:52.024310 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58472d5-fe5c-48dd-91b0-e05ac288f565 service glance] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:55:52.035433 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4384/8853] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:55:51 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:55:52.101928 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6caa5b6-84ec-49bd-859c-e6b8cffea248 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:55:52.110954 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6caa5b6-84ec-49bd-859c-e6b8cffea248 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:55:52.114539 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b3c1b-515c-4dda-895d-ae7c282ae795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:55:52.115165 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b3c1b-515c-4dda-895d-ae7c282ae795 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:55:52.115442 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b3c1b-515c-4dda-895d-ae7c282ae795 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:55:52.115714 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b3c1b-515c-4dda-895d-ae7c282ae795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:55:52.117443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c70b3c1b-515c-4dda-895d-ae7c282ae795 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:55:52.127015 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b3c1b-515c-4dda-895d-ae7c282ae795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:55:52.128420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b3c1b-515c-4dda-895d-ae7c282ae795 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:55:52.136112 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4470/8854] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:55:52 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:55:52.216369 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58472d5-fe5c-48dd-91b0-e05ac288f565 service glance] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:55:52.227592 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58472d5-fe5c-48dd-91b0-e05ac288f565 service glance] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:55:52.232561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5adec-bd12-4d91-afc6-e74df68367b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:55:52.233198 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5adec-bd12-4d91-afc6-e74df68367b3 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:55:52.233489 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5adec-bd12-4d91-afc6-e74df68367b3 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:55:52.233772 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5adec-bd12-4d91-afc6-e74df68367b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:55:52.236049 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0ae5adec-bd12-4d91-afc6-e74df68367b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:55:52.247133 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5adec-bd12-4d91-afc6-e74df68367b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:55:52.248695 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5adec-bd12-4d91-afc6-e74df68367b3 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:55:52.258945 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4385/8855] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:55:52 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:55:53.954887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b3c1b-515c-4dda-895d-ae7c282ae795 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:55:53.956536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c70b3c1b-515c-4dda-895d-ae7c282ae795 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:55:53.974427 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b3c1b-515c-4dda-895d-ae7c282ae795 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:55:53.980530 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea0cd3-25b6-4e65-a223-9f7ff39ad7c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:55:53.981291 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea0cd3-25b6-4e65-a223-9f7ff39ad7c4 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:55:53.981643 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea0cd3-25b6-4e65-a223-9f7ff39ad7c4 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:55:53.982004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea0cd3-25b6-4e65-a223-9f7ff39ad7c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:55:53.983972 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-76ea0cd3-25b6-4e65-a223-9f7ff39ad7c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:55:53.998909 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea0cd3-25b6-4e65-a223-9f7ff39ad7c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:55:54.000751 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea0cd3-25b6-4e65-a223-9f7ff39ad7c4 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:55:54.017761 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4471/8856] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:55:53 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:55:54.668090 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600816d-2851-4650-b29f-3659e8eaddbb None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:55:54.668616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600816d-2851-4650-b29f-3659e8eaddbb None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:55:54.668736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600816d-2851-4650-b29f-3659e8eaddbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:55:54.686319 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-8600816d-2851-4650-b29f-3659e8eaddbb None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:55:54.687519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8600816d-2851-4650-b29f-3659e8eaddbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:55:54.694765 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4386/8857] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 21:55:54 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:55:54.708780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea0cd3-25b6-4e65-a223-9f7ff39ad7c4 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:55:54.720533 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea0cd3-25b6-4e65-a223-9f7ff39ad7c4 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:55:54.725536 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22f7f9-5fd2-41d9-a827-8f195b2ec208 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:55:54.726176 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22f7f9-5fd2-41d9-a827-8f195b2ec208 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:55:54.726493 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22f7f9-5fd2-41d9-a827-8f195b2ec208 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:55:54.726780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22f7f9-5fd2-41d9-a827-8f195b2ec208 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:55:54.734993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22f7f9-5fd2-41d9-a827-8f195b2ec208 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:55:54.736572 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22f7f9-5fd2-41d9-a827-8f195b2ec208 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:55:54.745034 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4472/8858] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:55:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 21:56:11.527356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4984490-ff81-4ab3-831b-b2681b170291 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:56:11.527897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4984490-ff81-4ab3-831b-b2681b170291 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:56:11.527897 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4984490-ff81-4ab3-831b-b2681b170291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:56:11.547032 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-f4984490-ff81-4ab3-831b-b2681b170291 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:56:11.565444 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-f4984490-ff81-4ab3-831b-b2681b170291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:56:11.572464 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4387/8859] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 21:56:11 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:56:11.585829 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22f7f9-5fd2-41d9-a827-8f195b2ec208 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:56:11.596905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22f7f9-5fd2-41d9-a827-8f195b2ec208 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:56:11.601937 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c8069-b316-44fe-888e-1811d7e85d72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:56:11.602615 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c8069-b316-44fe-888e-1811d7e85d72 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:56:11.602898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c8069-b316-44fe-888e-1811d7e85d72 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:56:11.603186 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c8069-b316-44fe-888e-1811d7e85d72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:56:11.611147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c8069-b316-44fe-888e-1811d7e85d72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:56:11.612695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c8069-b316-44fe-888e-1811d7e85d72 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:56:11.620531 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4473/8860] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 21:56:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 18 21:57:27.726847 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4984490-ff81-4ab3-831b-b2681b170291 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:57:27.741163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4984490-ff81-4ab3-831b-b2681b170291 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:57:27.749096 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff850c24-0b10-4b73-ad13-8a51acb707df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:57:27.749908 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff850c24-0b10-4b73-ad13-8a51acb707df service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:57:27.750201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff850c24-0b10-4b73-ad13-8a51acb707df service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:57:27.750514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff850c24-0b10-4b73-ad13-8a51acb707df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:57:27.752950 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ff850c24-0b10-4b73-ad13-8a51acb707df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:57:27.771115 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff850c24-0b10-4b73-ad13-8a51acb707df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:57:27.773249 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff850c24-0b10-4b73-ad13-8a51acb707df service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:57:27.786866 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4388/8861] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:57:27 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:57:27.883201 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c8069-b316-44fe-888e-1811d7e85d72 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:57:27.894268 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c8069-b316-44fe-888e-1811d7e85d72 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:57:27.905529 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd99eb-6c12-4239-8b3b-d524ab12f327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:57:27.906183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd99eb-6c12-4239-8b3b-d524ab12f327 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:57:27.906603 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd99eb-6c12-4239-8b3b-d524ab12f327 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:57:27.906978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd99eb-6c12-4239-8b3b-d524ab12f327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:57:27.909099 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3bcd99eb-6c12-4239-8b3b-d524ab12f327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:57:27.921046 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd99eb-6c12-4239-8b3b-d524ab12f327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:57:27.922503 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd99eb-6c12-4239-8b3b-d524ab12f327 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:57:27.931103 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4474/8862] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:57:27 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:57:28.769750 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff850c24-0b10-4b73-ad13-8a51acb707df service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:57:28.789767 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff850c24-0b10-4b73-ad13-8a51acb707df service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:57:28.794840 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faff41b-7dce-47cb-b342-a69f928197df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:57:28.795604 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faff41b-7dce-47cb-b342-a69f928197df service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:57:28.795853 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faff41b-7dce-47cb-b342-a69f928197df service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:57:28.796104 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faff41b-7dce-47cb-b342-a69f928197df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:57:28.797987 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-9faff41b-7dce-47cb-b342-a69f928197df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:57:28.809698 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faff41b-7dce-47cb-b342-a69f928197df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:57:28.811289 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faff41b-7dce-47cb-b342-a69f928197df service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:57:28.821494 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4389/8863] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:57:28 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:57:33.852381 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c986384-208f-4a12-8d88-4ddbc97390e4 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:57:33.852884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c986384-208f-4a12-8d88-4ddbc97390e4 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:57:33.853012 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c986384-208f-4a12-8d88-4ddbc97390e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:57:33.870118 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-6c986384-208f-4a12-8d88-4ddbc97390e4 None None] MFA Rules not processed for user `d138402b28b3454aaca10ca070a1f7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 21:57:33.871423 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6c986384-208f-4a12-8d88-4ddbc97390e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:57:33.878103 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4475/8864] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 21:57:33 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 21:57:35.934395 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faff41b-7dce-47cb-b342-a69f928197df service placement] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:57:35.944431 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faff41b-7dce-47cb-b342-a69f928197df service placement] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:57:35.948022 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab471928-ed69-4ae8-8b62-955e051c5395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:57:35.948659 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab471928-ed69-4ae8-8b62-955e051c5395 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:57:35.948945 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab471928-ed69-4ae8-8b62-955e051c5395 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:57:35.949226 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab471928-ed69-4ae8-8b62-955e051c5395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:57:35.951021 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ab471928-ed69-4ae8-8b62-955e051c5395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:57:35.960118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab471928-ed69-4ae8-8b62-955e051c5395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:57:35.961788 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab471928-ed69-4ae8-8b62-955e051c5395 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:57:35.969456 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4390/8865] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:57:35 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:57:37.420335 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c986384-208f-4a12-8d88-4ddbc97390e4 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:57:37.421721 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6c986384-208f-4a12-8d88-4ddbc97390e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:57:37.436592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c986384-208f-4a12-8d88-4ddbc97390e4 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:57:37.441428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ea81f-cf0e-454d-bc55-234cf1d5ba39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:57:37.442052 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea81f-cf0e-454d-bc55-234cf1d5ba39 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:57:37.442945 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea81f-cf0e-454d-bc55-234cf1d5ba39 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:57:37.443224 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea81f-cf0e-454d-bc55-234cf1d5ba39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:57:37.444914 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-ed6ea81f-cf0e-454d-bc55-234cf1d5ba39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:57:37.455760 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ea81f-cf0e-454d-bc55-234cf1d5ba39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:57:37.457373 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ea81f-cf0e-454d-bc55-234cf1d5ba39 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:57:37.467406 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4476/8866] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:57:37 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:57:48.180477 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab471928-ed69-4ae8-8b62-955e051c5395 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:57:48.194373 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab471928-ed69-4ae8-8b62-955e051c5395 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:57:48.200072 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03360ea2-27bc-4a30-a7f2-f4348127e480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:57:48.200802 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03360ea2-27bc-4a30-a7f2-f4348127e480 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:57:48.201167 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03360ea2-27bc-4a30-a7f2-f4348127e480 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:57:48.201514 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03360ea2-27bc-4a30-a7f2-f4348127e480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:57:48.203501 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-03360ea2-27bc-4a30-a7f2-f4348127e480 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 21:57:48.215954 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03360ea2-27bc-4a30-a7f2-f4348127e480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:57:48.217531 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03360ea2-27bc-4a30-a7f2-f4348127e480 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:57:48.228190 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4391/8867] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:57:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:58:34.908683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ea81f-cf0e-454d-bc55-234cf1d5ba39 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:58:34.920428 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ea81f-cf0e-454d-bc55-234cf1d5ba39 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:58:34.927818 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7657d11-ffc5-462f-ae5e-5e8b809edd26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:58:34.928432 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7657d11-ffc5-462f-ae5e-5e8b809edd26 service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:58:34.928712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7657d11-ffc5-462f-ae5e-5e8b809edd26 service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:58:34.928989 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7657d11-ffc5-462f-ae5e-5e8b809edd26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:58:34.938907 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7657d11-ffc5-462f-ae5e-5e8b809edd26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:58:34.940890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7657d11-ffc5-462f-ae5e-5e8b809edd26 service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:58:34.952079 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4477/8868] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:58:34 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 21:59:57.027680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03360ea2-27bc-4a30-a7f2-f4348127e480 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 21:59:57.040015 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03360ea2-27bc-4a30-a7f2-f4348127e480 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 21:59:57.045451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b51c6-da51-4953-919f-30e37fe19e6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 21:59:57.046086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b51c6-da51-4953-919f-30e37fe19e6a service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 21:59:57.046416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b51c6-da51-4953-919f-30e37fe19e6a service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 21:59:57.046702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b51c6-da51-4953-919f-30e37fe19e6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 21:59:57.054239 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b51c6-da51-4953-919f-30e37fe19e6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 21:59:57.055822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b51c6-da51-4953-919f-30e37fe19e6a service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 21:59:57.064455 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4392/8869] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 21:59:57 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:00:11.324944 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7657d11-ffc5-462f-ae5e-5e8b809edd26 service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:00:11.344096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7657d11-ffc5-462f-ae5e-5e8b809edd26 service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:00:11.347745 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d658c-3c1b-4548-9b6b-d441368622c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:00:11.348377 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d658c-3c1b-4548-9b6b-d441368622c7 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:00:11.348663 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d658c-3c1b-4548-9b6b-d441368622c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:00:11.348943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d658c-3c1b-4548-9b6b-d441368622c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:00:11.350753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-813d658c-3c1b-4548-9b6b-d441368622c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:00:11.379554 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d658c-3c1b-4548-9b6b-d441368622c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:00:11.380905 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d658c-3c1b-4548-9b6b-d441368622c7 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:00:11.388522 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4478/8870] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:00:11 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:01:48.978578 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b51c6-da51-4953-919f-30e37fe19e6a service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:01:49.040169 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b51c6-da51-4953-919f-30e37fe19e6a service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:01:49.047075 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec594a7-f0ca-4abe-96b8-a685a89f1dc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:01:49.048189 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec594a7-f0ca-4abe-96b8-a685a89f1dc9 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:01:49.048808 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec594a7-f0ca-4abe-96b8-a685a89f1dc9 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:01:49.049153 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec594a7-f0ca-4abe-96b8-a685a89f1dc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:01:49.060736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec594a7-f0ca-4abe-96b8-a685a89f1dc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:01:49.062460 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec594a7-f0ca-4abe-96b8-a685a89f1dc9 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:01:49.074626 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4393/8871] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:01:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:01:49.176540 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d658c-3c1b-4548-9b6b-d441368622c7 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:01:49.185594 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d658c-3c1b-4548-9b6b-d441368622c7 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:01:49.189897 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab35be7-fcc2-4d07-a6c4-62d445139f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:01:49.190780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab35be7-fcc2-4d07-a6c4-62d445139f29 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:01:49.191215 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab35be7-fcc2-4d07-a6c4-62d445139f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:01:49.192347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab35be7-fcc2-4d07-a6c4-62d445139f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:01:49.203940 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab35be7-fcc2-4d07-a6c4-62d445139f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:01:49.205452 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab35be7-fcc2-4d07-a6c4-62d445139f29 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:01:49.217544 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4479/8872] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:01:49 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:01:50.495026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec594a7-f0ca-4abe-96b8-a685a89f1dc9 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:01:50.504012 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec594a7-f0ca-4abe-96b8-a685a89f1dc9 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:01:50.507719 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f815d6-e6e9-4b63-b72a-e563f03909e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:01:50.508354 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f815d6-e6e9-4b63-b72a-e563f03909e9 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:01:50.508641 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f815d6-e6e9-4b63-b72a-e563f03909e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:01:50.508922 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f815d6-e6e9-4b63-b72a-e563f03909e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:01:50.519099 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f815d6-e6e9-4b63-b72a-e563f03909e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:01:50.520504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f815d6-e6e9-4b63-b72a-e563f03909e9 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:01:50.531307 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4394/8873] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:01:50 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:01:53.009320 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab35be7-fcc2-4d07-a6c4-62d445139f29 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:01:53.017732 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab35be7-fcc2-4d07-a6c4-62d445139f29 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:01:53.022243 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b104790-0b3a-4f0f-a22c-70ff7db8c0d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:01:53.022923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b104790-0b3a-4f0f-a22c-70ff7db8c0d5 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:01:53.023211 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b104790-0b3a-4f0f-a22c-70ff7db8c0d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:01:53.023491 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b104790-0b3a-4f0f-a22c-70ff7db8c0d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:01:53.082683 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b104790-0b3a-4f0f-a22c-70ff7db8c0d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:01:53.084098 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b104790-0b3a-4f0f-a22c-70ff7db8c0d5 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:01:53.093659 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4480/8874] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:01:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:01:59.213143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f815d6-e6e9-4b63-b72a-e563f03909e9 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:01:59.221218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f815d6-e6e9-4b63-b72a-e563f03909e9 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:01:59.225696 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35719a-84a2-4970-896a-97a378813664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:01:59.226537 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35719a-84a2-4970-896a-97a378813664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:01:59.226820 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35719a-84a2-4970-896a-97a378813664 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:01:59.227095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35719a-84a2-4970-896a-97a378813664 admin admin] PATH_INFO: `/v3/users/d138402b28b3454aaca10ca070a1f7e7` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:01:59.228316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35719a-84a2-4970-896a-97a378813664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d138402b28b3454aaca10ca070a1f7e7)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:01:59.230206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35719a-84a2-4970-896a-97a378813664 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:01:59.274924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0e35719a-84a2-4970-896a-97a378813664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd138402b28b3454aaca10ca070a1f7e7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:01:59.281624 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0e35719a-84a2-4970-896a-97a378813664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd138402b28b3454aaca10ca070a1f7e7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:01:59.293896 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0e35719a-84a2-4970-896a-97a378813664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd138402b28b3454aaca10ca070a1f7e7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:01:59.294620 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0e35719a-84a2-4970-896a-97a378813664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd138402b28b3454aaca10ca070a1f7e7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:01:59.302481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-0e35719a-84a2-4970-896a-97a378813664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd138402b28b3454aaca10ca070a1f7e7'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:01:59.308382 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4395/8875] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 22:01:59 2021] DELETE /identity/v3/users/d138402b28b3454aaca10ca070a1f7e7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 22:01:59.475837 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b104790-0b3a-4f0f-a22c-70ff7db8c0d5 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:01:59.489141 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b104790-0b3a-4f0f-a22c-70ff7db8c0d5 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:01:59.542953 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:01:59.543802 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:01:59.544082 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:01:59.544371 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8 admin admin] PATH_INFO: `/v3/projects/c7e4c296f0144644b9107d08244cb934` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:01:59.545555 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e4c296f0144644b9107d08244cb934)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:01:59.547470 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:01:59.592524 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e4c296f0144644b9107d08244cb934', 'request_id': 'req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:01:59.599135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e4c296f0144644b9107d08244cb934', 'request_id': 'req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:01:59.606314 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e4c296f0144644b9107d08244cb934', 'request_id': 'req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:01:59.616549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8 admin admin] The token cache is being invalidate because project c7e4c296f0144644b9107d08244cb934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 22:01:59.616833 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:01:59.617450 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:01:59.619038 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4481/8876] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 22:01:59 2021] DELETE /identity/v3/projects/c7e4c296f0144644b9107d08244cb934 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 22:01:59.623157 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35719a-84a2-4970-896a-97a378813664 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:01:59.624650 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0e35719a-84a2-4970-896a-97a378813664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:01:59.637416 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35719a-84a2-4970-896a-97a378813664 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:01:59.692132 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043651c-f955-41d6-9a7e-c93c3a26815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:01:59.692992 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043651c-f955-41d6-9a7e-c93c3a26815a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:01:59.693276 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043651c-f955-41d6-9a7e-c93c3a26815a admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:01:59.693555 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043651c-f955-41d6-9a7e-c93c3a26815a admin admin] PATH_INFO: `/v3/users/0ddebf6fbd93461988f26ecb34296b1a` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:01:59.694773 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043651c-f955-41d6-9a7e-c93c3a26815a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ddebf6fbd93461988f26ecb34296b1a)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:01:59.696657 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043651c-f955-41d6-9a7e-c93c3a26815a admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:01:59.743924 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1043651c-f955-41d6-9a7e-c93c3a26815a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ddebf6fbd93461988f26ecb34296b1a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:01:59.752126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1043651c-f955-41d6-9a7e-c93c3a26815a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ddebf6fbd93461988f26ecb34296b1a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:01:59.763943 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1043651c-f955-41d6-9a7e-c93c3a26815a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ddebf6fbd93461988f26ecb34296b1a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:01:59.764652 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1043651c-f955-41d6-9a7e-c93c3a26815a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ddebf6fbd93461988f26ecb34296b1a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:01:59.771759 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-1043651c-f955-41d6-9a7e-c93c3a26815a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ddebf6fbd93461988f26ecb34296b1a'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:01:59.777594 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4396/8877] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 22:01:59 2021] DELETE /identity/v3/users/0ddebf6fbd93461988f26ecb34296b1a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 22:01:59.945687 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:01:59.947365 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:01:59.962563 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9fb2b-ce9f-4df4-9d6d-8a6b13283ac8 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:00.018925 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80f8a8-533c-4b1f-9ca0-225e00a8809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:00.019724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f8a8-533c-4b1f-9ca0-225e00a8809e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:00.020004 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f8a8-533c-4b1f-9ca0-225e00a8809e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:00.020275 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f8a8-533c-4b1f-9ca0-225e00a8809e admin admin] PATH_INFO: `/v3/projects/32042eedd46449a1adddb5403dca947f` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:00.021458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80f8a8-533c-4b1f-9ca0-225e00a8809e admin admin] RBAC: Authorizing `identity:delete_project(project_id=32042eedd46449a1adddb5403dca947f)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:00.023767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80f8a8-533c-4b1f-9ca0-225e00a8809e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:00.069548 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7d80f8a8-533c-4b1f-9ca0-225e00a8809e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32042eedd46449a1adddb5403dca947f', 'request_id': 'req-7d80f8a8-533c-4b1f-9ca0-225e00a8809e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:02:00.075846 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7d80f8a8-533c-4b1f-9ca0-225e00a8809e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32042eedd46449a1adddb5403dca947f', 'request_id': 'req-7d80f8a8-533c-4b1f-9ca0-225e00a8809e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:02:00.083712 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7d80f8a8-533c-4b1f-9ca0-225e00a8809e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32042eedd46449a1adddb5403dca947f', 'request_id': 'req-7d80f8a8-533c-4b1f-9ca0-225e00a8809e'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:02:00.094305 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7d80f8a8-533c-4b1f-9ca0-225e00a8809e admin admin] The token cache is being invalidate because project 32042eedd46449a1adddb5403dca947f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96646) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 22:02:00.094686 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7d80f8a8-533c-4b1f-9ca0-225e00a8809e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:02:00.095338 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-7d80f8a8-533c-4b1f-9ca0-225e00a8809e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:02:00.097511 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4482/8878] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 22:01:59 2021] DELETE /identity/v3/projects/32042eedd46449a1adddb5403dca947f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 22:02:00.103544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12cdcc-561f-4e5a-b758-7552208ae030 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:00.103859 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12cdcc-561f-4e5a-b758-7552208ae030 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:00.104165 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12cdcc-561f-4e5a-b758-7552208ae030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:00.121337 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-7b12cdcc-561f-4e5a-b758-7552208ae030 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 22:02:00.122564 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-7b12cdcc-561f-4e5a-b758-7552208ae030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:02:00.178211 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4397/8879] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 22:02:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 22:02:00.186568 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd18af-69b3-4693-bc8f-335c1fe292c0 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:00.186861 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd18af-69b3-4693-bc8f-335c1fe292c0 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:00.187147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd18af-69b3-4693-bc8f-335c1fe292c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:00.206809 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-57dd18af-69b3-4693-bc8f-335c1fe292c0 None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 22:02:00.208000 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-57dd18af-69b3-4693-bc8f-335c1fe292c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:02:00.216234 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4483/8880] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 22:02:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 22:02:00.220595 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12cdcc-561f-4e5a-b758-7552208ae030 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:02:00.230762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12cdcc-561f-4e5a-b758-7552208ae030 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:00.235435 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99923d0b-9c2f-4894-b6ec-49b0503f1740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:00.236088 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99923d0b-9c2f-4894-b6ec-49b0503f1740 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:00.236398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99923d0b-9c2f-4894-b6ec-49b0503f1740 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:00.236718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99923d0b-9c2f-4894-b6ec-49b0503f1740 admin admin] PATH_INFO: `/v3/domains` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:00.237398 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99923d0b-9c2f-4894-b6ec-49b0503f1740 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 18 22:02:00.237702 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99923d0b-9c2f-4894-b6ec-49b0503f1740 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:00.239321 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99923d0b-9c2f-4894-b6ec-49b0503f1740 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:00.250759 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4398/8881] 10.222.0.13 () {58 vars in 1152 bytes} [Sat Dec 18 22:02:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 18 22:02:00.256321 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd18af-69b3-4693-bc8f-335c1fe292c0 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:02:00.265875 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd18af-69b3-4693-bc8f-335c1fe292c0 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:00.271592 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3483a4-8e09-4a7d-8791-53dad2a09eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:00.272261 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3483a4-8e09-4a7d-8791-53dad2a09eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:00.272619 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3483a4-8e09-4a7d-8791-53dad2a09eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:00.272988 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3483a4-8e09-4a7d-8791-53dad2a09eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:00.273775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3483a4-8e09-4a7d-8791-53dad2a09eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:00.275774 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3483a4-8e09-4a7d-8791-53dad2a09eb5 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:00.301779 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4484/8882] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 22:02:00 2021] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 22:02:00.306073 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99923d0b-9c2f-4894-b6ec-49b0503f1740 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:02:00.317033 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99923d0b-9c2f-4894-b6ec-49b0503f1740 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:00.375020 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadc1d1-1cb2-44b6-afb6-98b350eea93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:00.375736 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadc1d1-1cb2-44b6-afb6-98b350eea93b admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:00.376029 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadc1d1-1cb2-44b6-afb6-98b350eea93b admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:00.376316 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadc1d1-1cb2-44b6-afb6-98b350eea93b admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:00.377030 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadc1d1-1cb2-44b6-afb6-98b350eea93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:00.379506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadc1d1-1cb2-44b6-afb6-98b350eea93b admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:00.399658 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4399/8883] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 22:02:00 2021] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 22:02:00.404182 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3483a4-8e09-4a7d-8791-53dad2a09eb5 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:02:00.415101 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3483a4-8e09-4a7d-8791-53dad2a09eb5 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:00.419911 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9628b9-8dd2-41b8-966c-1d0fcdb6a0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:00.420588 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9628b9-8dd2-41b8-966c-1d0fcdb6a0ed admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:00.420890 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9628b9-8dd2-41b8-966c-1d0fcdb6a0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:00.421195 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9628b9-8dd2-41b8-966c-1d0fcdb6a0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:00.421923 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9628b9-8dd2-41b8-966c-1d0fcdb6a0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:00.423562 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9628b9-8dd2-41b8-966c-1d0fcdb6a0ed admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:00.435300 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4485/8884] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 22:02:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 22:02:00.439505 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadc1d1-1cb2-44b6-afb6-98b350eea93b admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:02:00.450095 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadc1d1-1cb2-44b6-afb6-98b350eea93b admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:00.454926 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475741a-77f5-49ab-89fc-e5bc3b3dc748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:00.456206 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475741a-77f5-49ab-89fc-e5bc3b3dc748 admin admin] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:00.456542 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475741a-77f5-49ab-89fc-e5bc3b3dc748 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:00.456825 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475741a-77f5-49ab-89fc-e5bc3b3dc748 admin admin] PATH_INFO: `/v3/roles` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:00.457561 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475741a-77f5-49ab-89fc-e5bc3b3dc748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:00.459192 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475741a-77f5-49ab-89fc-e5bc3b3dc748 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:00.469179 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4400/8885] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 22:02:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 22:02:00.473198 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9628b9-8dd2-41b8-966c-1d0fcdb6a0ed admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:02:00.482957 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9628b9-8dd2-41b8-966c-1d0fcdb6a0ed admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:00.488016 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0f03a-4b87-4d79-b5ca-37a0d87d702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:00.488887 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0f03a-4b87-4d79-b5ca-37a0d87d702e admin admin] REQUEST_METHOD: `PUT` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:00.489172 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0f03a-4b87-4d79-b5ca-37a0d87d702e admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:00.489460 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0f03a-4b87-4d79-b5ca-37a0d87d702e admin admin] PATH_INFO: `/v3/projects/bb152351dd1a4914b8b0a47536625080/users/3ad9bb5f9c834d75bb3833e4a9df0159/roles/d9c784a85e0540d0abdfedac9386a842` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:00.504188 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0f03a-4b87-4d79-b5ca-37a0d87d702e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb152351dd1a4914b8b0a47536625080, user_id=3ad9bb5f9c834d75bb3833e4a9df0159, role_id=d9c784a85e0540d0abdfedac9386a842)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:00.506865 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0f03a-4b87-4d79-b5ca-37a0d87d702e admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:00.519375 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4486/8886] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 22:02:00 2021] PUT /identity/v3/projects/bb152351dd1a4914b8b0a47536625080/users/3ad9bb5f9c834d75bb3833e4a9df0159/roles/d9c784a85e0540d0abdfedac9386a842 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 22:02:00.524433 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81f1a9-971b-4b9a-b3ef-5933112a08de None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:00.524677 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81f1a9-971b-4b9a-b3ef-5933112a08de None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:00.524960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81f1a9-971b-4b9a-b3ef-5933112a08de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:00.542424 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-4b81f1a9-971b-4b9a-b3ef-5933112a08de None None] MFA Rules not processed for user `3410b38ddeaf4d83ae78d94fba3a424e`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 22:02:00.543616 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4b81f1a9-971b-4b9a-b3ef-5933112a08de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:02:00.601181 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4401/8887] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 22:02:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 22:02:00.611115 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0f03a-4b87-4d79-b5ca-37a0d87d702e admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:02:00.613408 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-35c0f03a-4b87-4d79-b5ca-37a0d87d702e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:02:00.669929 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0f03a-4b87-4d79-b5ca-37a0d87d702e admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:00.673711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e6bb8-c331-40c8-b525-77414f56c8e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:00.674885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e6bb8-c331-40c8-b525-77414f56c8e0 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:00.675169 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e6bb8-c331-40c8-b525-77414f56c8e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:00.675447 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e6bb8-c331-40c8-b525-77414f56c8e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:00.684668 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e6bb8-c331-40c8-b525-77414f56c8e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:00.686096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e6bb8-c331-40c8-b525-77414f56c8e0 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:00.696124 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4487/8888] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:02:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:02:04.419631 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662452d2-1938-414c-b17f-550a1945cf7a None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:04.420168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662452d2-1938-414c-b17f-550a1945cf7a None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:04.420168 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662452d2-1938-414c-b17f-550a1945cf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:04.448241 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-662452d2-1938-414c-b17f-550a1945cf7a None None] MFA Rules not processed for user `3ad9bb5f9c834d75bb3833e4a9df0159`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 22:02:04.449386 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-662452d2-1938-414c-b17f-550a1945cf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:02:04.514518 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4402/8889] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 22:02:04 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 22:02:04.519199 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e6bb8-c331-40c8-b525-77414f56c8e0 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:02:04.529057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e6bb8-c331-40c8-b525-77414f56c8e0 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:04.533754 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c5b5e-5127-43f1-9d03-a42e7fdebaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:04.534429 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c5b5e-5127-43f1-9d03-a42e7fdebaf1 admin admin] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:04.534709 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c5b5e-5127-43f1-9d03-a42e7fdebaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:04.535048 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c5b5e-5127-43f1-9d03-a42e7fdebaf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:04.535898 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c5b5e-5127-43f1-9d03-a42e7fdebaf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:04.537870 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c5b5e-5127-43f1-9d03-a42e7fdebaf1 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:04.567488 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4488/8890] 10.222.0.13 () {60 vars in 1152 bytes} [Sat Dec 18 22:02:04 2021] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 18 22:02:04.568608 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662452d2-1938-414c-b17f-550a1945cf7a None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:02:04.579390 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662452d2-1938-414c-b17f-550a1945cf7a None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:04.638428 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfcdc3-7404-4f39-8078-1f85cd61a7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:04.639102 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfcdc3-7404-4f39-8078-1f85cd61a7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:04.639385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfcdc3-7404-4f39-8078-1f85cd61a7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:04.639662 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfcdc3-7404-4f39-8078-1f85cd61a7c7 admin admin] PATH_INFO: `/v3/users` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:04.640365 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfcdc3-7404-4f39-8078-1f85cd61a7c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:04.642546 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfcdc3-7404-4f39-8078-1f85cd61a7c7 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:04.663764 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4403/8891] 10.222.0.13 () {60 vars in 1143 bytes} [Sat Dec 18 22:02:04 2021] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 18 22:02:04.668943 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c5b5e-5127-43f1-9d03-a42e7fdebaf1 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:02:04.679761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c5b5e-5127-43f1-9d03-a42e7fdebaf1 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:04.685104 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbfff0-7a21-468a-a474-9bd0f1d16a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:04.685772 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbfff0-7a21-468a-a474-9bd0f1d16a12 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:04.686111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbfff0-7a21-468a-a474-9bd0f1d16a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:04.686449 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbfff0-7a21-468a-a474-9bd0f1d16a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:04.687180 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbfff0-7a21-468a-a474-9bd0f1d16a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:04.688947 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbfff0-7a21-468a-a474-9bd0f1d16a12 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:04.700057 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4489/8892] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 22:02:04 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 18 22:02:04.704587 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfcdc3-7404-4f39-8078-1f85cd61a7c7 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:02:04.714975 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfcdc3-7404-4f39-8078-1f85cd61a7c7 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:04.720577 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040cd7f-7119-41c9-9594-169c96ca9d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:04.722481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040cd7f-7119-41c9-9594-169c96ca9d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:04.722481 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040cd7f-7119-41c9-9594-169c96ca9d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:04.722699 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040cd7f-7119-41c9-9594-169c96ca9d6f admin admin] PATH_INFO: `/v3/projects/56cda4dd779341c5a19761fdb2cf6a54/users/99b3a3c2ae2945648264fbfb0c5510a1/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:04.740735 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040cd7f-7119-41c9-9594-169c96ca9d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cda4dd779341c5a19761fdb2cf6a54, user_id=99b3a3c2ae2945648264fbfb0c5510a1, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:04.743492 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040cd7f-7119-41c9-9594-169c96ca9d6f admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:04.765774 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4404/8893] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 22:02:04 2021] PUT /identity/v3/projects/56cda4dd779341c5a19761fdb2cf6a54/users/99b3a3c2ae2945648264fbfb0c5510a1/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 18 22:02:04.766620 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbfff0-7a21-468a-a474-9bd0f1d16a12 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:02:04.784505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbfff0-7a21-468a-a474-9bd0f1d16a12 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:04.846924 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c67a2-abab-4da5-8345-9473fdef1794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:04.847590 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c67a2-abab-4da5-8345-9473fdef1794 admin admin] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:04.847871 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c67a2-abab-4da5-8345-9473fdef1794 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:04.848147 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c67a2-abab-4da5-8345-9473fdef1794 admin admin] PATH_INFO: `/v3/roles` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:04.848908 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c67a2-abab-4da5-8345-9473fdef1794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:04.850535 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c67a2-abab-4da5-8345-9473fdef1794 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:04.860428 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4490/8894] 10.222.0.13 () {58 vars in 1121 bytes} [Sat Dec 18 22:02:04 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 18 22:02:04.865268 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040cd7f-7119-41c9-9594-169c96ca9d6f admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:02:04.875855 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040cd7f-7119-41c9-9594-169c96ca9d6f admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:04.880627 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806f331-7c26-468b-9a7d-8f27fd1efd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:04.881506 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806f331-7c26-468b-9a7d-8f27fd1efd68 admin admin] REQUEST_METHOD: `PUT` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:04.881797 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806f331-7c26-468b-9a7d-8f27fd1efd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:04.882081 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806f331-7c26-468b-9a7d-8f27fd1efd68 admin admin] PATH_INFO: `/v3/projects/56cda4dd779341c5a19761fdb2cf6a54/users/99b3a3c2ae2945648264fbfb0c5510a1/roles/422f56dd2e5b4c57a3e3decac47f893e` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:04.884130 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806f331-7c26-468b-9a7d-8f27fd1efd68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cda4dd779341c5a19761fdb2cf6a54, user_id=99b3a3c2ae2945648264fbfb0c5510a1, role_id=422f56dd2e5b4c57a3e3decac47f893e)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:04.886806 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806f331-7c26-468b-9a7d-8f27fd1efd68 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:04.897940 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4405/8895] 10.222.0.13 () {60 vars in 1482 bytes} [Sat Dec 18 22:02:04 2021] PUT /identity/v3/projects/56cda4dd779341c5a19761fdb2cf6a54/users/99b3a3c2ae2945648264fbfb0c5510a1/roles/422f56dd2e5b4c57a3e3decac47f893e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 22:02:09.482187 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9b98b-bf87-47ef-87f9-1b8fe020b354 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:09.482740 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9b98b-bf87-47ef-87f9-1b8fe020b354 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:09.483096 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9b98b-bf87-47ef-87f9-1b8fe020b354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:09.516961 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-c9e9b98b-bf87-47ef-87f9-1b8fe020b354 None None] MFA Rules not processed for user `99b3a3c2ae2945648264fbfb0c5510a1`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 22:02:09.518223 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-c9e9b98b-bf87-47ef-87f9-1b8fe020b354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:02:09.606522 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4491/8896] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 22:02:09 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 22:02:09.619282 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806f331-7c26-468b-9a7d-8f27fd1efd68 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:02:09.621052 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8806f331-7c26-468b-9a7d-8f27fd1efd68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:02:09.692844 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806f331-7c26-468b-9a7d-8f27fd1efd68 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:09.698467 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104d6fb-f902-4a4b-b380-f1cc51de2dbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:09.699118 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104d6fb-f902-4a4b-b380-f1cc51de2dbf service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:09.699401 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104d6fb-f902-4a4b-b380-f1cc51de2dbf service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:09.699678 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104d6fb-f902-4a4b-b380-f1cc51de2dbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:09.758447 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104d6fb-f902-4a4b-b380-f1cc51de2dbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:09.760257 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104d6fb-f902-4a4b-b380-f1cc51de2dbf service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:09.769946 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4406/8897] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:02:09 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:02:10.973111 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ebec4-5c2b-4726-a911-0455b8e5a578 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:10.973711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ebec4-5c2b-4726-a911-0455b8e5a578 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:10.973711 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ebec4-5c2b-4726-a911-0455b8e5a578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:10.991761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-5f8ebec4-5c2b-4726-a911-0455b8e5a578 None None] MFA Rules not processed for user `3ad9bb5f9c834d75bb3833e4a9df0159`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 22:02:10.992942 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5f8ebec4-5c2b-4726-a911-0455b8e5a578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:02:10.999954 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4492/8898] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 22:02:10 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 22:02:13.323680 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104d6fb-f902-4a4b-b380-f1cc51de2dbf service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:02:13.393313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104d6fb-f902-4a4b-b380-f1cc51de2dbf service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:13.397202 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b5491-7d17-4e28-a757-9f9cdfcf8085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:13.397863 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b5491-7d17-4e28-a757-9f9cdfcf8085 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:13.398149 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b5491-7d17-4e28-a757-9f9cdfcf8085 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:13.398461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b5491-7d17-4e28-a757-9f9cdfcf8085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:13.400409 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-574b5491-7d17-4e28-a757-9f9cdfcf8085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:02:13.410850 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b5491-7d17-4e28-a757-9f9cdfcf8085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:13.412287 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b5491-7d17-4e28-a757-9f9cdfcf8085 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:13.421528 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4407/8899] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:02:13 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:02:21.319915 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ebec4-5c2b-4726-a911-0455b8e5a578 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:02:21.330585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ebec4-5c2b-4726-a911-0455b8e5a578 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:21.335834 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0463ca-6291-4d52-a307-2f25fc482ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:21.336755 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0463ca-6291-4d52-a307-2f25fc482ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:21.337043 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0463ca-6291-4d52-a307-2f25fc482ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:21.337324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0463ca-6291-4d52-a307-2f25fc482ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:21.347129 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0463ca-6291-4d52-a307-2f25fc482ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:21.348553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0463ca-6291-4d52-a307-2f25fc482ac2 service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:21.358063 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4493/8900] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:02:21 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:02:35.788915 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b5491-7d17-4e28-a757-9f9cdfcf8085 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:02:35.790377 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-574b5491-7d17-4e28-a757-9f9cdfcf8085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:02:35.872822 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b5491-7d17-4e28-a757-9f9cdfcf8085 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:02:35.879347 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81aacd-cab2-4103-aa7d-47c802d51708 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:02:35.880493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81aacd-cab2-4103-aa7d-47c802d51708 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:02:35.880762 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81aacd-cab2-4103-aa7d-47c802d51708 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:02:35.881059 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81aacd-cab2-4103-aa7d-47c802d51708 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:02:35.883212 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-4b81aacd-cab2-4103-aa7d-47c802d51708 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:02:35.898245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81aacd-cab2-4103-aa7d-47c802d51708 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:02:35.900277 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81aacd-cab2-4103-aa7d-47c802d51708 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:02:35.914060 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4408/8901] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:02:35 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:03:37.952222 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0463ca-6291-4d52-a307-2f25fc482ac2 service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:03:37.953585 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-1a0463ca-6291-4d52-a307-2f25fc482ac2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:03:37.981051 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0463ca-6291-4d52-a307-2f25fc482ac2 service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:03:37.986352 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166a655-c91b-46b9-908a-7437b5b1c0af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:03:37.986985 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166a655-c91b-46b9-908a-7437b5b1c0af service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:03:37.987272 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166a655-c91b-46b9-908a-7437b5b1c0af service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:03:37.987549 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166a655-c91b-46b9-908a-7437b5b1c0af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:03:37.989285 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b166a655-c91b-46b9-908a-7437b5b1c0af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:03:38.000313 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166a655-c91b-46b9-908a-7437b5b1c0af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:03:38.001868 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166a655-c91b-46b9-908a-7437b5b1c0af service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:03:38.011351 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4494/8902] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:03:37 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:04:19.411362 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d1924-10f6-4110-acff-62034160b0d8 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:04:19.412217 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d1924-10f6-4110-acff-62034160b0d8 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:04:19.412532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d1924-10f6-4110-acff-62034160b0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:04:19.430737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-bf7d1924-10f6-4110-acff-62034160b0d8 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 22:04:19.431916 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-bf7d1924-10f6-4110-acff-62034160b0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:04:19.485135 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4409/8903] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 22:04:19 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 22:04:19.532110 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166a655-c91b-46b9-908a-7437b5b1c0af service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:04:19.533505 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-b166a655-c91b-46b9-908a-7437b5b1c0af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:04:19.600153 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166a655-c91b-46b9-908a-7437b5b1c0af service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:04:19.605553 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19bef0-d468-4680-8f84-8266e1b25c3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:04:19.606183 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19bef0-d468-4680-8f84-8266e1b25c3f service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:04:19.606497 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19bef0-d468-4680-8f84-8266e1b25c3f service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:04:19.606775 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19bef0-d468-4680-8f84-8266e1b25c3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:04:19.614738 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19bef0-d468-4680-8f84-8266e1b25c3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:04:19.616308 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19bef0-d468-4680-8f84-8266e1b25c3f service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:04:19.624720 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4495/8904] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 22:04:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 22:04:22.571455 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d1924-10f6-4110-acff-62034160b0d8 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:04:22.590479 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d1924-10f6-4110-acff-62034160b0d8 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:04:22.597832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c647a36-83df-48a8-81ba-9b5c3c6dff30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:04:22.597832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c647a36-83df-48a8-81ba-9b5c3c6dff30 service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:04:22.597832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c647a36-83df-48a8-81ba-9b5c3c6dff30 service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:04:22.597832 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c647a36-83df-48a8-81ba-9b5c3c6dff30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:04:22.599568 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-0c647a36-83df-48a8-81ba-9b5c3c6dff30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:04:22.643963 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c647a36-83df-48a8-81ba-9b5c3c6dff30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:04:22.645899 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c647a36-83df-48a8-81ba-9b5c3c6dff30 service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:04:22.658047 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4410/8905] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:04:22 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:04:29.465382 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0b077-82f7-4462-9df4-f2fb158b5b24 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:04:29.465876 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0b077-82f7-4462-9df4-f2fb158b5b24 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:04:29.465993 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0b077-82f7-4462-9df4-f2fb158b5b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:04:29.483315 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-36f0b077-82f7-4462-9df4-f2fb158b5b24 None None] MFA Rules not processed for user `3ad9bb5f9c834d75bb3833e4a9df0159`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 22:04:29.484522 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-36f0b077-82f7-4462-9df4-f2fb158b5b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:04:29.491430 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4496/8906] 10.222.0.13 () {58 vars in 957 bytes} [Sat Dec 18 22:04:29 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 22:04:31.144598 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c647a36-83df-48a8-81ba-9b5c3c6dff30 service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:04:31.156126 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c647a36-83df-48a8-81ba-9b5c3c6dff30 service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:04:31.161552 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93b824-402a-4968-b2ea-b8f84997f68b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:04:31.162210 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93b824-402a-4968-b2ea-b8f84997f68b service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:04:31.162532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93b824-402a-4968-b2ea-b8f84997f68b service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:04:31.162811 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93b824-402a-4968-b2ea-b8f84997f68b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:04:31.164693 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-ff93b824-402a-4968-b2ea-b8f84997f68b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:04:31.176612 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93b824-402a-4968-b2ea-b8f84997f68b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:04:31.178180 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93b824-402a-4968-b2ea-b8f84997f68b service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:04:31.189021 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4411/8907] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:04:31 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:04:32.429193 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d9817-9f40-4c10-b581-0dd97c82f6a7 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:04:32.429789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d9817-9f40-4c10-b581-0dd97c82f6a7 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:04:32.429789 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d9817-9f40-4c10-b581-0dd97c82f6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:04:32.448841 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-8d3d9817-9f40-4c10-b581-0dd97c82f6a7 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 22:04:32.450060 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8d3d9817-9f40-4c10-b581-0dd97c82f6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:04:32.457405 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4497/8908] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 22:04:32 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 22:04:32.473187 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93b824-402a-4968-b2ea-b8f84997f68b service placement] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:04:32.484972 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93b824-402a-4968-b2ea-b8f84997f68b service placement] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:04:32.490047 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f28a6-a0c1-4cd7-9a58-0246176de61b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:04:32.490749 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f28a6-a0c1-4cd7-9a58-0246176de61b service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:04:32.491037 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f28a6-a0c1-4cd7-9a58-0246176de61b service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:04:32.491318 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f28a6-a0c1-4cd7-9a58-0246176de61b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:04:32.500363 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f28a6-a0c1-4cd7-9a58-0246176de61b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:04:32.501960 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f28a6-a0c1-4cd7-9a58-0246176de61b service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:04:32.511563 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4412/8909] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 22:04:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 22:04:43.287218 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d9817-9f40-4c10-b581-0dd97c82f6a7 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:04:43.288651 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8d3d9817-9f40-4c10-b581-0dd97c82f6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:04:43.313970 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d9817-9f40-4c10-b581-0dd97c82f6a7 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:04:43.317637 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97edb4d-138e-48f4-b414-8879843c439d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:04:43.318369 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97edb4d-138e-48f4-b414-8879843c439d service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:04:43.318654 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97edb4d-138e-48f4-b414-8879843c439d service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:04:43.318933 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97edb4d-138e-48f4-b414-8879843c439d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:04:43.320884 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-d97edb4d-138e-48f4-b414-8879843c439d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:04:43.331978 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97edb4d-138e-48f4-b414-8879843c439d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:04:43.333420 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97edb4d-138e-48f4-b414-8879843c439d service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:04:43.342969 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4498/8910] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:04:43 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:04:54.217990 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f28a6-a0c1-4cd7-9a58-0246176de61b service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:04:54.220653 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-3d0f28a6-a0c1-4cd7-9a58-0246176de61b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:04:54.236013 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f28a6-a0c1-4cd7-9a58-0246176de61b service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:04:54.241394 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cde84a-c627-4e6e-9f47-38f10238209d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:04:54.242034 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cde84a-c627-4e6e-9f47-38f10238209d service nova] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:04:54.242353 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cde84a-c627-4e6e-9f47-38f10238209d service nova] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:04:54.242642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cde84a-c627-4e6e-9f47-38f10238209d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:04:54.244388 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-63cde84a-c627-4e6e-9f47-38f10238209d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:04:54.256638 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cde84a-c627-4e6e-9f47-38f10238209d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:04:54.258777 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cde84a-c627-4e6e-9f47-38f10238209d service nova] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:04:54.269680 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4413/8911] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:04:54 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:06:36.322022 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715801cd-64f0-4de5-b2a2-36610fc6dc08 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:06:36.322621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715801cd-64f0-4de5-b2a2-36610fc6dc08 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:06:36.322621 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715801cd-64f0-4de5-b2a2-36610fc6dc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:06:36.381652 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-715801cd-64f0-4de5-b2a2-36610fc6dc08 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 22:06:36.382976 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-715801cd-64f0-4de5-b2a2-36610fc6dc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:06:36.399091 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4499/8912] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Dec 18 22:06:36 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 22:06:36.443380 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cde84a-c627-4e6e-9f47-38f10238209d service nova] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:06:36.464539 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cde84a-c627-4e6e-9f47-38f10238209d service nova] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:06:36.470218 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c4dbe-633b-4bbe-b54c-a0ac1edaf7ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:06:36.470904 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c4dbe-633b-4bbe-b54c-a0ac1edaf7ca service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:06:36.471191 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c4dbe-633b-4bbe-b54c-a0ac1edaf7ca service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:06:36.471471 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c4dbe-633b-4bbe-b54c-a0ac1edaf7ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:06:36.481785 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c4dbe-633b-4bbe-b54c-a0ac1edaf7ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:06:36.483385 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c4dbe-633b-4bbe-b54c-a0ac1edaf7ca service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:06:36.491558 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4414/8913] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 22:06:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 22:06:45.520704 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75f872-ec8d-41e7-a7a3-3807cfed6f35 None None] REQUEST_METHOD: `POST` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:06:45.521236 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75f872-ec8d-41e7-a7a3-3807cfed6f35 None None] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:06:45.521355 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75f872-ec8d-41e7-a7a3-3807cfed6f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:06:45.539209 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.auth.core [None req-3d75f872-ec8d-41e7-a7a3-3807cfed6f35 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96646) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 22:06:45.540317 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-3d75f872-ec8d-41e7-a7a3-3807cfed6f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:06:45.548030 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4500/8914] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 22:06:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 22:06:45.560942 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c4dbe-633b-4bbe-b54c-a0ac1edaf7ca service swift] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:06:45.571213 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c4dbe-633b-4bbe-b54c-a0ac1edaf7ca service swift] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:06:45.576164 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbd948-1ee6-4ea2-a6cb-56613b52d335 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:06:45.576789 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbd948-1ee6-4ea2-a6cb-56613b52d335 service swift] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:06:45.577076 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbd948-1ee6-4ea2-a6cb-56613b52d335 service swift] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:06:45.577356 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbd948-1ee6-4ea2-a6cb-56613b52d335 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:06:45.585143 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbd948-1ee6-4ea2-a6cb-56613b52d335 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:06:45.586737 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbd948-1ee6-4ea2-a6cb-56613b52d335 service swift] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:06:45.595391 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4415/8915] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 22:06:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 22:06:49.505635 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75f872-ec8d-41e7-a7a3-3807cfed6f35 None None] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:06:49.533630 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75f872-ec8d-41e7-a7a3-3807cfed6f35 None None] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:06:49.539481 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa038e-a262-479a-bdf0-2660a4ccad91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a180acaefee3489788068c927fbe403c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:06:49.540155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa038e-a262-479a-bdf0-2660a4ccad91 service nova] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:06:49.540443 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa038e-a262-479a-bdf0-2660a4ccad91 service nova] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:06:49.540724 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa038e-a262-479a-bdf0-2660a4ccad91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:06:49.543044 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-6dfa038e-a262-479a-bdf0-2660a4ccad91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:06:49.555306 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa038e-a262-479a-bdf0-2660a4ccad91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:06:49.556895 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa038e-a262-479a-bdf0-2660a4ccad91 service nova] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:06:49.568468 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4501/8916] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:06:49 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:06:50.789139 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdce64-2f82-4c1f-a6a3-9e1956e4f752 None None] REQUEST_METHOD: `POST` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:06:50.789621 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdce64-2f82-4c1f-a6a3-9e1956e4f752 None None] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:06:50.789741 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdce64-2f82-4c1f-a6a3-9e1956e4f752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:06:50.807304 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.auth.core [None req-34cdce64-2f82-4c1f-a6a3-9e1956e4f752 None None] MFA Rules not processed for user `1157bb6f43474dfa96d91a444d850b67`. Rule list: `[]` (Enabled: `True`). {{(pid=96645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 18 22:06:50.809067 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-34cdce64-2f82-4c1f-a6a3-9e1956e4f752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:06:50.816087 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4416/8917] 10.222.0.13 () {58 vars in 967 bytes} [Sat Dec 18 22:06:50 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 18 22:06:50.829761 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa038e-a262-479a-bdf0-2660a4ccad91 service nova] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:06:50.840987 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa038e-a262-479a-bdf0-2660a4ccad91 service nova] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:06:50.846114 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eda71e-a74d-497b-924e-fd97962d8215 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5e4bc28d0744b65ab520bf79cea5a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:06:50.846767 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eda71e-a74d-497b-924e-fd97962d8215 service swift] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:06:50.847045 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eda71e-a74d-497b-924e-fd97962d8215 service swift] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:06:50.847324 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eda71e-a74d-497b-924e-fd97962d8215 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:06:50.855197 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eda71e-a74d-497b-924e-fd97962d8215 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:06:50.856748 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eda71e-a74d-497b-924e-fd97962d8215 service swift] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:06:50.864581 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4502/8918] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Dec 18 22:06:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 18 22:06:52.562645 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdce64-2f82-4c1f-a6a3-9e1956e4f752 None None] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:06:52.583177 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdce64-2f82-4c1f-a6a3-9e1956e4f752 None None] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:06:52.587074 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab61a80-68bd-4ba8-a4d1-389d4a51d33f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:06:52.587909 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61a80-68bd-4ba8-a4d1-389d4a51d33f service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:06:52.588201 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61a80-68bd-4ba8-a4d1-389d4a51d33f service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:06:52.588675 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61a80-68bd-4ba8-a4d1-389d4a51d33f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:06:52.590526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-8ab61a80-68bd-4ba8-a4d1-389d4a51d33f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:06:52.604526 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab61a80-68bd-4ba8-a4d1-389d4a51d33f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:06:52.607224 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab61a80-68bd-4ba8-a4d1-389d4a51d33f service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:06:52.618959 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4417/8919] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:06:52 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:06:53.820289 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eda71e-a74d-497b-924e-fd97962d8215 service swift] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:06:53.829126 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eda71e-a74d-497b-924e-fd97962d8215 service swift] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:06:53.832707 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bef5d-0c87-4d58-9af2-d4b9d8d5982f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:06:53.833319 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bef5d-0c87-4d58-9af2-d4b9d8d5982f service neutron] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:06:53.833599 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bef5d-0c87-4d58-9af2-d4b9d8d5982f service neutron] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:06:53.833872 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bef5d-0c87-4d58-9af2-d4b9d8d5982f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:06:53.835626 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-040bef5d-0c87-4d58-9af2-d4b9d8d5982f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:06:53.849901 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bef5d-0c87-4d58-9af2-d4b9d8d5982f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:06:53.851347 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bef5d-0c87-4d58-9af2-d4b9d8d5982f service neutron] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:06:53.862466 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4503/8920] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:06:53 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:07:00.662697 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab61a80-68bd-4ba8-a4d1-389d4a51d33f service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:07:00.671625 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab61a80-68bd-4ba8-a4d1-389d4a51d33f service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:07:00.675245 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac875f0-af84-4b30-86f8-990d6bdd0846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8eeb55c523480fb45d4bbb8afe8e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:07:00.675888 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac875f0-af84-4b30-86f8-990d6bdd0846 service neutron] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:07:00.676176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac875f0-af84-4b30-86f8-990d6bdd0846 service neutron] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:07:00.676457 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac875f0-af84-4b30-86f8-990d6bdd0846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:07:00.746725 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac875f0-af84-4b30-86f8-990d6bdd0846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:07:00.748216 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac875f0-af84-4b30-86f8-990d6bdd0846 service neutron] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:07:00.768402 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4418/8921] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:07:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:07:01.549036 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bef5d-0c87-4d58-9af2-d4b9d8d5982f service neutron] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:07:01.560885 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bef5d-0c87-4d58-9af2-d4b9d8d5982f service neutron] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:07:01.565569 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47af5b-b4a9-4bc7-ae9a-bd40c62104a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:07:01.566462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47af5b-b4a9-4bc7-ae9a-bd40c62104a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:07:01.566744 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47af5b-b4a9-4bc7-ae9a-bd40c62104a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:07:01.567019 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47af5b-b4a9-4bc7-ae9a-bd40c62104a4 admin admin] PATH_INFO: `/v3/users/3ad9bb5f9c834d75bb3833e4a9df0159` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:07:01.568238 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47af5b-b4a9-4bc7-ae9a-bd40c62104a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad9bb5f9c834d75bb3833e4a9df0159)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:07:01.570135 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47af5b-b4a9-4bc7-ae9a-bd40c62104a4 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:07:01.613820 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8e47af5b-b4a9-4bc7-ae9a-bd40c62104a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad9bb5f9c834d75bb3833e4a9df0159'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:01.620368 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8e47af5b-b4a9-4bc7-ae9a-bd40c62104a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad9bb5f9c834d75bb3833e4a9df0159'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:01.621030 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8e47af5b-b4a9-4bc7-ae9a-bd40c62104a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad9bb5f9c834d75bb3833e4a9df0159'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:01.633692 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8e47af5b-b4a9-4bc7-ae9a-bd40c62104a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad9bb5f9c834d75bb3833e4a9df0159'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:01.640312 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8e47af5b-b4a9-4bc7-ae9a-bd40c62104a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad9bb5f9c834d75bb3833e4a9df0159'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:01.646181 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4504/8922] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 22:07:01 2021] DELETE /identity/v3/users/3ad9bb5f9c834d75bb3833e4a9df0159 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 22:07:01.812642 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac875f0-af84-4b30-86f8-990d6bdd0846 service neutron] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:07:01.822387 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac875f0-af84-4b30-86f8-990d6bdd0846 service neutron] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:07:01.880313 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f42ef5-16ff-43bf-b936-8344337eba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:07:01.881163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f42ef5-16ff-43bf-b936-8344337eba81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:07:01.881451 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f42ef5-16ff-43bf-b936-8344337eba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:07:01.881727 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f42ef5-16ff-43bf-b936-8344337eba81 admin admin] PATH_INFO: `/v3/projects/bb152351dd1a4914b8b0a47536625080` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:07:01.883006 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f42ef5-16ff-43bf-b936-8344337eba81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb152351dd1a4914b8b0a47536625080)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:07:01.884988 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f42ef5-16ff-43bf-b936-8344337eba81 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:07:01.928902 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-67f42ef5-16ff-43bf-b936-8344337eba81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb152351dd1a4914b8b0a47536625080', 'request_id': 'req-67f42ef5-16ff-43bf-b936-8344337eba81'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:01.935303 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-67f42ef5-16ff-43bf-b936-8344337eba81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb152351dd1a4914b8b0a47536625080', 'request_id': 'req-67f42ef5-16ff-43bf-b936-8344337eba81'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:01.940567 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-67f42ef5-16ff-43bf-b936-8344337eba81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb152351dd1a4914b8b0a47536625080', 'request_id': 'req-67f42ef5-16ff-43bf-b936-8344337eba81'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:01.964108 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-67f42ef5-16ff-43bf-b936-8344337eba81 admin admin] The token cache is being invalidate because project bb152351dd1a4914b8b0a47536625080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 22:07:01.964399 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-67f42ef5-16ff-43bf-b936-8344337eba81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:01.965026 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-67f42ef5-16ff-43bf-b936-8344337eba81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:01.966845 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4419/8923] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 22:07:01 2021] DELETE /identity/v3/projects/bb152351dd1a4914b8b0a47536625080 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 22:07:01.971456 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47af5b-b4a9-4bc7-ae9a-bd40c62104a4 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:07:01.972851 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8e47af5b-b4a9-4bc7-ae9a-bd40c62104a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:07:01.985936 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47af5b-b4a9-4bc7-ae9a-bd40c62104a4 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:07:02.039598 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6dfa9f-6755-4ae3-9f29-d70605cca7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:07:02.040458 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dfa9f-6755-4ae3-9f29-d70605cca7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:07:02.040753 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dfa9f-6755-4ae3-9f29-d70605cca7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:07:02.041025 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dfa9f-6755-4ae3-9f29-d70605cca7a7 admin admin] PATH_INFO: `/v3/users/99b3a3c2ae2945648264fbfb0c5510a1` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:07:02.042240 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6dfa9f-6755-4ae3-9f29-d70605cca7a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99b3a3c2ae2945648264fbfb0c5510a1)` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:07:02.044246 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6dfa9f-6755-4ae3-9f29-d70605cca7a7 admin admin] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:07:02.088780 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8c6dfa9f-6755-4ae3-9f29-d70605cca7a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99b3a3c2ae2945648264fbfb0c5510a1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:02.095499 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8c6dfa9f-6755-4ae3-9f29-d70605cca7a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99b3a3c2ae2945648264fbfb0c5510a1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:02.096155 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8c6dfa9f-6755-4ae3-9f29-d70605cca7a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99b3a3c2ae2945648264fbfb0c5510a1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:02.107696 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8c6dfa9f-6755-4ae3-9f29-d70605cca7a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99b3a3c2ae2945648264fbfb0c5510a1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:02.114584 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.notifications [None req-8c6dfa9f-6755-4ae3-9f29-d70605cca7a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99b3a3c2ae2945648264fbfb0c5510a1'} {{(pid=96646) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:02.120261 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4505/8924] 10.222.0.13 () {58 vars in 1223 bytes} [Sat Dec 18 22:07:01 2021] DELETE /identity/v3/users/99b3a3c2ae2945648264fbfb0c5510a1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 22:07:02.286532 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f42ef5-16ff-43bf-b936-8344337eba81 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:07:02.288044 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-67f42ef5-16ff-43bf-b936-8344337eba81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:07:02.301504 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f42ef5-16ff-43bf-b936-8344337eba81 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:07:02.357877 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30bea9-e28e-4aed-9b17-0518c1a55e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3410b38ddeaf4d83ae78d94fba3a424e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b04c3d19c79d4c208395e97f9d293618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:07:02.358779 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30bea9-e28e-4aed-9b17-0518c1a55e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:07:02.359065 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30bea9-e28e-4aed-9b17-0518c1a55e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:07:02.359345 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30bea9-e28e-4aed-9b17-0518c1a55e02 admin admin] PATH_INFO: `/v3/projects/56cda4dd779341c5a19761fdb2cf6a54` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:07:02.360544 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30bea9-e28e-4aed-9b17-0518c1a55e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56cda4dd779341c5a19761fdb2cf6a54)` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:07:02.362465 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30bea9-e28e-4aed-9b17-0518c1a55e02 admin admin] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:07:02.408301 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5b30bea9-e28e-4aed-9b17-0518c1a55e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56cda4dd779341c5a19761fdb2cf6a54', 'request_id': 'req-5b30bea9-e28e-4aed-9b17-0518c1a55e02'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:02.414493 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5b30bea9-e28e-4aed-9b17-0518c1a55e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56cda4dd779341c5a19761fdb2cf6a54', 'request_id': 'req-5b30bea9-e28e-4aed-9b17-0518c1a55e02'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:02.420417 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5b30bea9-e28e-4aed-9b17-0518c1a55e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56cda4dd779341c5a19761fdb2cf6a54', 'request_id': 'req-5b30bea9-e28e-4aed-9b17-0518c1a55e02'} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:02.435058 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5b30bea9-e28e-4aed-9b17-0518c1a55e02 admin admin] The token cache is being invalidate because project 56cda4dd779341c5a19761fdb2cf6a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 18 22:07:02.435348 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5b30bea9-e28e-4aed-9b17-0518c1a55e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:02.435996 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.notifications [None req-5b30bea9-e28e-4aed-9b17-0518c1a55e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 18 22:07:02.437712 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4420/8925] 10.222.0.13 () {58 vars in 1232 bytes} [Sat Dec 18 22:07:02 2021] DELETE /identity/v3/projects/56cda4dd779341c5a19761fdb2cf6a54 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 18 22:07:40.736679 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6dfa9f-6755-4ae3-9f29-d70605cca7a7 admin admin] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:07:40.738220 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-8c6dfa9f-6755-4ae3-9f29-d70605cca7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:07:40.813733 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6dfa9f-6755-4ae3-9f29-d70605cca7a7 admin admin] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:07:40.874178 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13d353-24f7-4b07-9813-ef321116885d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:07:40.874849 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13d353-24f7-4b07-9813-ef321116885d service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:07:40.875132 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13d353-24f7-4b07-9813-ef321116885d service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:07:40.875403 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13d353-24f7-4b07-9813-ef321116885d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:07:40.877167 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5f13d353-24f7-4b07-9813-ef321116885d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:07:40.887891 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13d353-24f7-4b07-9813-ef321116885d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:07:40.890057 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13d353-24f7-4b07-9813-ef321116885d service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:07:40.899459 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4506/8926] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:07:40 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:08:41.881262 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30bea9-e28e-4aed-9b17-0518c1a55e02 admin admin] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:08:41.882717 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-5b30bea9-e28e-4aed-9b17-0518c1a55e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:08:41.897551 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30bea9-e28e-4aed-9b17-0518c1a55e02 admin admin] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:08:41.902535 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e87506-f3ed-41b1-b6de-88ea1488f4eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:08:41.903176 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87506-f3ed-41b1-b6de-88ea1488f4eb service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:08:41.903474 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87506-f3ed-41b1-b6de-88ea1488f4eb service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:08:41.903744 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e87506-f3ed-41b1-b6de-88ea1488f4eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:08:41.906086 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.fernet_utils [None req-83e87506-f3ed-41b1-b6de-88ea1488f4eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:08:41.917079 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e87506-f3ed-41b1-b6de-88ea1488f4eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:08:41.918768 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e87506-f3ed-41b1-b6de-88ea1488f4eb service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:08:41.928574 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4421/8927] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:08:41 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:12:46.746804 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13d353-24f7-4b07-9813-ef321116885d service placement] Authenticating user token {{(pid=96646) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:12:46.748184 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.fernet_utils [None req-5f13d353-24f7-4b07-9813-ef321116885d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96646) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 18 22:12:46.808504 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13d353-24f7-4b07-9813-ef321116885d service placement] Validating token access rules against request {{(pid=96646) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:12:46.813525 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624209b-42f1-42d9-a8fd-1edd4e34e4be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96646) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:12:46.814152 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624209b-42f1-42d9-a8fd-1edd4e34e4be service placement] REQUEST_METHOD: `GET` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:12:46.814462 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624209b-42f1-42d9-a8fd-1edd4e34e4be service placement] SCRIPT_NAME: `/identity` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:12:46.814739 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624209b-42f1-42d9-a8fd-1edd4e34e4be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96646) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:12:46.823695 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624209b-42f1-42d9-a8fd-1edd4e34e4be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:12:46.825396 ncdv-master-1 devstack@keystone.service[96646]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624209b-42f1-42d9-a8fd-1edd4e34e4be service placement] RBAC: Authorization granted {{(pid=96646) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:12:46.837238 ncdv-master-1 devstack@keystone.service[96646]: [pid: 96646|app: 0|req: 4507/8928] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:12:46 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 18 22:13:46.837344 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e87506-f3ed-41b1-b6de-88ea1488f4eb service placement] Authenticating user token {{(pid=96645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 18 22:13:46.876596 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e87506-f3ed-41b1-b6de-88ea1488f4eb service placement] Validating token access rules against request {{(pid=96645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 18 22:13:46.882519 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee62c18-7e5e-4f31-a593-2d20d168b2a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f16dc3d38a4270a0fb29944a655356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd4d15f423642fa8da604b758048203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 18 22:13:46.883163 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee62c18-7e5e-4f31-a593-2d20d168b2a8 service placement] REQUEST_METHOD: `GET` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 18 22:13:46.883443 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee62c18-7e5e-4f31-a593-2d20d168b2a8 service placement] SCRIPT_NAME: `/identity` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 18 22:13:46.883718 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee62c18-7e5e-4f31-a593-2d20d168b2a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 18 22:13:46.891912 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee62c18-7e5e-4f31-a593-2d20d168b2a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 18 22:13:46.893461 ncdv-master-1 devstack@keystone.service[96645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee62c18-7e5e-4f31-a593-2d20d168b2a8 service placement] RBAC: Authorization granted {{(pid=96645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 18 22:13:46.903449 ncdv-master-1 devstack@keystone.service[96645]: [pid: 96645|app: 0|req: 4422/8929] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Dec 18 22:13:46 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)